2024-03-23T23:27:57.106 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-23T23:27:57.106 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner mchangir --archive /home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616400 --name mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}} -- /home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616400/orig.config.yaml 2024-03-23T23:27:57.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-23T23:27:57.245 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616400 branch: wip-mchangir-testing-main-20240318.032620 description: fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}} email: mchangir@redhat.com first_in_suite: false job_id: '7616400' kernel: client: branch: testing flavor: default kdb: true sha1: 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-mchangir-testing-main-20240318.032620 ceph: cephfs: fs: - name: a - name: b session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 filestore flush min: 0 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - overall HEALTH_ - \(MON_DOWN\) - SLOW_OPS - slow request sha1: 3be9a5c9bc793e11e2800a8c0c696e8b46742033 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: cephfs_name: a client.1: cephfs_name: b install: ceph: flavor: default sha1: 3be9a5c9bc793e11e2800a8c0c696e8b46742033 kclient: client.0: cephfs_name: a client.1: cephfs_name: b syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-testing-main-20240318.032620 sha1: 3be9a5c9bc793e11e2800a8c0c696e8b46742033 owner: mchangir priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 3550 sha1: 3be9a5c9bc793e11e2800a8c0c696e8b46742033 sleep_before_teardown: 0 subset: 613/1024 suite: fs suite_branch: wip-mchangir-testing-main-20240318.032620 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 3be9a5c9bc793e11e2800a8c0c696e8b46742033 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi008.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJN38IWx94OLOMXUXdFrdT37nqwqtfkJzR43R06nGM7XS6nGJmg0rG09Eh8zbXVEzJnk5dyYmUZbX5A7ECQIFx0= smithi196.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK8YegBLgKIYs1tCXSJgZygUC8okbxmgyW3Bo4qT/lXzZIgBTWgvCyNQ1UwaePBVTdPiU13/gD1i2t3Q/ETquuU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - mon_thrash: check_mds_failover: true revive_delay: 20 thrash_delay: 10 - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-22_09:49:57 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-23T23:27:57.246 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa; will attempt to use it 2024-03-23T23:27:57.246 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks 2024-03-23T23:27:57.247 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-23T23:27:57.248 INFO:teuthology.task.internal:Checking packages... 2024-03-23T23:27:57.272 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '3be9a5c9bc793e11e2800a8c0c696e8b46742033' 2024-03-23T23:27:57.273 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-23T23:27:57.273 INFO:teuthology.packaging:ref: None 2024-03-23T23:27:57.273 INFO:teuthology.packaging:tag: None 2024-03-23T23:27:57.273 INFO:teuthology.packaging:branch: wip-mchangir-testing-main-20240318.032620 2024-03-23T23:27:57.273 INFO:teuthology.packaging:sha1: 3be9a5c9bc793e11e2800a8c0c696e8b46742033 2024-03-23T23:27:57.273 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-mchangir-testing-main-20240318.032620 2024-03-23T23:27:57.420 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2145-g3be9a5c9-1jammy 2024-03-23T23:27:57.422 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-23T23:27:57.428 INFO:teuthology.task.internal:no buildpackages task found 2024-03-23T23:27:57.429 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-23T23:27:57.451 INFO:teuthology.task.internal:Saving configuration 2024-03-23T23:27:57.470 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-23T23:27:57.486 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-23T23:27:57.511 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616400', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-23 23:22:19.138598', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOf+/RVSdgKZYdXp/6QjdluWqAnbTD+2Peb++dNF74Gx'} 2024-03-23T23:27:57.532 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616400', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-23 23:22:19.136853', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEuV0j28AYmynqH83d9PbEOf+rkyq+GqRpGmefhkcfPB'} 2024-03-23T23:27:57.532 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-23T23:27:57.537 INFO:teuthology.task.internal:roles: ubuntu@smithi008.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-03-23T23:27:57.538 INFO:teuthology.task.internal:roles: ubuntu@smithi196.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2024-03-23T23:27:57.538 INFO:teuthology.run_tasks:Running task console_log... 2024-03-23T23:27:57.604 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc5dd397310>, signals=[15]) 2024-03-23T23:27:57.604 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-23T23:27:57.610 INFO:teuthology.task.internal:Opening connections... 2024-03-23T23:27:57.610 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi008.front.sepia.ceph.com 2024-03-23T23:27:57.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T23:27:57.693 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi196.front.sepia.ceph.com 2024-03-23T23:27:57.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T23:27:57.770 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-23T23:27:57.776 DEBUG:teuthology.orchestra.run.smithi008:> uname -m 2024-03-23T23:27:57.782 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2024-03-23T23:27:57.782 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2024-03-23T23:27:57.829 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-23T23:27:57.829 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="Ubuntu" 2024-03-23T23:27:57.830 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="22.04" 2024-03-23T23:27:57.830 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-23T23:27:57.830 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_CODENAME=jammy 2024-03-23T23:27:57.830 INFO:teuthology.orchestra.run.smithi008.stdout:ID=ubuntu 2024-03-23T23:27:57.830 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE=debian 2024-03-23T23:27:57.830 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-23T23:27:57.830 INFO:teuthology.orchestra.run.smithi008.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-23T23:27:57.830 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-23T23:27:57.830 INFO:teuthology.orchestra.run.smithi008.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-23T23:27:57.830 INFO:teuthology.orchestra.run.smithi008.stdout:UBUNTU_CODENAME=jammy 2024-03-23T23:27:57.831 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2024-03-23T23:27:57.849 DEBUG:teuthology.orchestra.run.smithi196:> uname -m 2024-03-23T23:27:57.854 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2024-03-23T23:27:57.854 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2024-03-23T23:27:57.902 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-23T23:27:57.902 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="Ubuntu" 2024-03-23T23:27:57.902 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="22.04" 2024-03-23T23:27:57.902 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-23T23:27:57.902 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_CODENAME=jammy 2024-03-23T23:27:57.902 INFO:teuthology.orchestra.run.smithi196.stdout:ID=ubuntu 2024-03-23T23:27:57.902 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE=debian 2024-03-23T23:27:57.902 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-23T23:27:57.902 INFO:teuthology.orchestra.run.smithi196.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-23T23:27:57.902 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-23T23:27:57.903 INFO:teuthology.orchestra.run.smithi196.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-23T23:27:57.903 INFO:teuthology.orchestra.run.smithi196.stdout:UBUNTU_CODENAME=jammy 2024-03-23T23:27:57.903 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2024-03-23T23:27:57.923 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-23T23:27:57.932 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-23T23:27:57.936 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-23T23:27:57.937 DEBUG:teuthology.orchestra.run.smithi008:> test '!' -e /home/ubuntu/cephtest 2024-03-23T23:27:57.939 DEBUG:teuthology.orchestra.run.smithi196:> test '!' -e /home/ubuntu/cephtest 2024-03-23T23:27:57.949 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-23T23:27:57.954 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-23T23:27:57.954 DEBUG:teuthology.orchestra.run.smithi008:> test -z $(ls -A /var/lib/ceph) 2024-03-23T23:27:57.987 DEBUG:teuthology.orchestra.run.smithi196:> test -z $(ls -A /var/lib/ceph) 2024-03-23T23:27:58.003 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-23T23:27:58.059 INFO:teuthology.run_tasks:Running task kernel... 2024-03-23T23:27:58.073 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '5ec3e6e88b2e2783e09498588bb1f433ae9c8986'} 2024-03-23T23:27:58.074 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}} 2024-03-23T23:27:58.074 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-03-23T23:27:58.074 DEBUG:teuthology.orchestra.run.smithi008:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-23T23:27:58.075 DEBUG:teuthology.orchestra.run.smithi196:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-23T23:27:58.079 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-23T23:27:58.079 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-23T23:27:58.080 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-03-23T23:27:58.082 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-03-23T23:27:58.287 DEBUG:teuthology.task.kernel:sha1 for client.1 is 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 2024-03-23T23:27:58.287 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5ec3e6e88b2e2783e09498588bb1f433ae9c8986"... 2024-03-23T23:27:58.288 DEBUG:teuthology.orchestra.run.smithi196:> uname -r 2024-03-23T23:27:58.293 INFO:teuthology.orchestra.run.smithi196.stdout:5.15.0-56-generic 2024-03-23T23:27:58.293 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 2024-03-23T23:27:58.294 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-23T23:27:58.294 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2024-03-23T23:27:58.294 DEBUG:teuthology.orchestra.run.smithi196:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-03-23T23:27:58.306 DEBUG:teuthology.task.kernel:sha1 for client.0 is 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 2024-03-23T23:27:58.307 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5ec3e6e88b2e2783e09498588bb1f433ae9c8986"... 2024-03-23T23:27:58.307 DEBUG:teuthology.orchestra.run.smithi008:> uname -r 2024-03-23T23:27:58.312 INFO:teuthology.orchestra.run.smithi008.stdout:5.15.0-56-generic 2024-03-23T23:27:58.312 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 2024-03-23T23:27:58.313 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-23T23:27:58.313 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-03-23T23:27:58.313 DEBUG:teuthology.orchestra.run.smithi008:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-03-23T23:27:58.349 INFO:teuthology.orchestra.run.smithi196.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-03-23T23:27:58.370 INFO:teuthology.orchestra.run.smithi008.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-03-23T23:27:58.497 INFO:teuthology.orchestra.run.smithi008.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-03-23T23:27:58.497 INFO:teuthology.orchestra.run.smithi008.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-03-23T23:27:58.497 INFO:teuthology.orchestra.run.smithi008.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-03-23T23:27:58.497 INFO:teuthology.orchestra.run.smithi008.stderr:hint: 2024-03-23T23:27:58.497 INFO:teuthology.orchestra.run.smithi008.stderr:hint: git config --global init.defaultBranch 2024-03-23T23:27:58.497 INFO:teuthology.orchestra.run.smithi008.stderr:hint: 2024-03-23T23:27:58.497 INFO:teuthology.orchestra.run.smithi008.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-03-23T23:27:58.498 INFO:teuthology.orchestra.run.smithi008.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-03-23T23:27:58.498 INFO:teuthology.orchestra.run.smithi008.stderr:hint: 2024-03-23T23:27:58.498 INFO:teuthology.orchestra.run.smithi008.stderr:hint: git branch -m 2024-03-23T23:27:58.498 INFO:teuthology.orchestra.run.smithi008.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-03-23T23:27:58.500 DEBUG:teuthology.orchestra.run.smithi008:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-03-23T23:27:58.515 INFO:teuthology.orchestra.run.smithi196.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-03-23T23:27:58.515 INFO:teuthology.orchestra.run.smithi196.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-03-23T23:27:58.515 INFO:teuthology.orchestra.run.smithi196.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-03-23T23:27:58.515 INFO:teuthology.orchestra.run.smithi196.stderr:hint: 2024-03-23T23:27:58.515 INFO:teuthology.orchestra.run.smithi196.stderr:hint: git config --global init.defaultBranch 2024-03-23T23:27:58.515 INFO:teuthology.orchestra.run.smithi196.stderr:hint: 2024-03-23T23:27:58.515 INFO:teuthology.orchestra.run.smithi196.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-03-23T23:27:58.515 INFO:teuthology.orchestra.run.smithi196.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-03-23T23:27:58.515 INFO:teuthology.orchestra.run.smithi196.stderr:hint: 2024-03-23T23:27:58.515 INFO:teuthology.orchestra.run.smithi196.stderr:hint: git branch -m 2024-03-23T23:27:58.516 INFO:teuthology.orchestra.run.smithi196.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-03-23T23:27:58.519 DEBUG:teuthology.orchestra.run.smithi196:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-03-23T23:27:58.564 DEBUG:teuthology.orchestra.run.smithi008:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-03-23T23:27:58.585 DEBUG:teuthology.orchestra.run.smithi196:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-03-23T23:27:58.622 DEBUG:teuthology.orchestra.run.smithi008:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-03-23T23:27:58.646 DEBUG:teuthology.orchestra.run.smithi196:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-03-23T23:28:40.371 INFO:teuthology.orchestra.run.smithi196.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-03-23T23:28:40.371 INFO:teuthology.orchestra.run.smithi196.stderr: * [new branch] main -> origin/main 2024-03-23T23:28:40.404 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20190312 -> 20190312 2024-03-23T23:28:40.404 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20190416 -> 20190416 2024-03-23T23:28:40.404 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20190514 -> 20190514 2024-03-23T23:28:40.404 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20190618 -> 20190618 2024-03-23T23:28:40.406 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20190717 -> 20190717 2024-03-23T23:28:40.406 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20190815 -> 20190815 2024-03-23T23:28:40.406 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20190923 -> 20190923 2024-03-23T23:28:40.406 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20191022 -> 20191022 2024-03-23T23:28:40.406 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20191215 -> 20191215 2024-03-23T23:28:40.406 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20200122 -> 20200122 2024-03-23T23:28:40.406 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20200316 -> 20200316 2024-03-23T23:28:40.406 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20200421 -> 20200421 2024-03-23T23:28:40.406 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20200519 -> 20200519 2024-03-23T23:28:40.409 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20200619 -> 20200619 2024-03-23T23:28:40.409 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20200721 -> 20200721 2024-03-23T23:28:40.409 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20200817 -> 20200817 2024-03-23T23:28:40.409 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20200918 -> 20200918 2024-03-23T23:28:40.409 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20201022 -> 20201022 2024-03-23T23:28:40.409 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20201118 -> 20201118 2024-03-23T23:28:40.409 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20201218 -> 20201218 2024-03-23T23:28:40.409 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20210208 -> 20210208 2024-03-23T23:28:40.409 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20210315 -> 20210315 2024-03-23T23:28:40.409 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20210511 -> 20210511 2024-03-23T23:28:40.409 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20210716 -> 20210716 2024-03-23T23:28:40.409 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20210818 -> 20210818 2024-03-23T23:28:40.409 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20210919 -> 20210919 2024-03-23T23:28:40.410 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20211027 -> 20211027 2024-03-23T23:28:40.410 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20211216 -> 20211216 2024-03-23T23:28:40.410 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20220209 -> 20220209 2024-03-23T23:28:40.412 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20220310 -> 20220310 2024-03-23T23:28:40.412 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20220411 -> 20220411 2024-03-23T23:28:40.412 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20220509 -> 20220509 2024-03-23T23:28:40.412 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20220610 -> 20220610 2024-03-23T23:28:40.412 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20220708 -> 20220708 2024-03-23T23:28:40.412 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20220815 -> 20220815 2024-03-23T23:28:40.412 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20220913 -> 20220913 2024-03-23T23:28:40.413 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20221012 -> 20221012 2024-03-23T23:28:40.413 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20221109 -> 20221109 2024-03-23T23:28:40.413 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20221214 -> 20221214 2024-03-23T23:28:40.413 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20230117 -> 20230117 2024-03-23T23:28:40.413 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20230210 -> 20230210 2024-03-23T23:28:40.413 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20230310 -> 20230310 2024-03-23T23:28:40.413 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20230404 -> 20230404 2024-03-23T23:28:40.413 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20230515 -> 20230515 2024-03-23T23:28:40.413 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20230625 -> 20230625 2024-03-23T23:28:40.414 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20230804 -> 20230804 2024-03-23T23:28:40.414 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20230919 -> 20230919 2024-03-23T23:28:40.414 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20231030 -> 20231030 2024-03-23T23:28:40.414 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20231111 -> 20231111 2024-03-23T23:28:40.415 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20231211 -> 20231211 2024-03-23T23:28:40.415 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20240115 -> 20240115 2024-03-23T23:28:40.415 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20240220 -> 20240220 2024-03-23T23:28:40.415 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20240312 -> 20240312 2024-03-23T23:28:40.492 INFO:teuthology.orchestra.run.smithi008.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-03-23T23:28:40.492 INFO:teuthology.orchestra.run.smithi008.stderr: * [new branch] main -> origin/main 2024-03-23T23:28:40.526 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20190312 -> 20190312 2024-03-23T23:28:40.527 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20190416 -> 20190416 2024-03-23T23:28:40.527 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20190514 -> 20190514 2024-03-23T23:28:40.527 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20190618 -> 20190618 2024-03-23T23:28:40.527 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20190717 -> 20190717 2024-03-23T23:28:40.527 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20190815 -> 20190815 2024-03-23T23:28:40.527 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20190923 -> 20190923 2024-03-23T23:28:40.529 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20191022 -> 20191022 2024-03-23T23:28:40.529 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20191215 -> 20191215 2024-03-23T23:28:40.529 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20200122 -> 20200122 2024-03-23T23:28:40.529 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20200316 -> 20200316 2024-03-23T23:28:40.529 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20200421 -> 20200421 2024-03-23T23:28:40.529 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20200519 -> 20200519 2024-03-23T23:28:40.530 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20200619 -> 20200619 2024-03-23T23:28:40.530 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20200721 -> 20200721 2024-03-23T23:28:40.530 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20200817 -> 20200817 2024-03-23T23:28:40.530 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20200918 -> 20200918 2024-03-23T23:28:40.530 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20201022 -> 20201022 2024-03-23T23:28:40.530 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20201118 -> 20201118 2024-03-23T23:28:40.530 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20201218 -> 20201218 2024-03-23T23:28:40.530 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20210208 -> 20210208 2024-03-23T23:28:40.530 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20210315 -> 20210315 2024-03-23T23:28:40.530 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20210511 -> 20210511 2024-03-23T23:28:40.531 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20210716 -> 20210716 2024-03-23T23:28:40.531 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20210818 -> 20210818 2024-03-23T23:28:40.533 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20210919 -> 20210919 2024-03-23T23:28:40.533 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20211027 -> 20211027 2024-03-23T23:28:40.534 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20211216 -> 20211216 2024-03-23T23:28:40.534 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20220209 -> 20220209 2024-03-23T23:28:40.534 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20220310 -> 20220310 2024-03-23T23:28:40.534 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20220411 -> 20220411 2024-03-23T23:28:40.534 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20220509 -> 20220509 2024-03-23T23:28:40.534 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20220610 -> 20220610 2024-03-23T23:28:40.534 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20220708 -> 20220708 2024-03-23T23:28:40.534 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20220815 -> 20220815 2024-03-23T23:28:40.534 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20220913 -> 20220913 2024-03-23T23:28:40.534 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20221012 -> 20221012 2024-03-23T23:28:40.534 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20221109 -> 20221109 2024-03-23T23:28:40.534 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20221214 -> 20221214 2024-03-23T23:28:40.534 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20230117 -> 20230117 2024-03-23T23:28:40.535 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20230210 -> 20230210 2024-03-23T23:28:40.535 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20230310 -> 20230310 2024-03-23T23:28:40.535 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20230404 -> 20230404 2024-03-23T23:28:40.535 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20230515 -> 20230515 2024-03-23T23:28:40.535 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20230625 -> 20230625 2024-03-23T23:28:40.535 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20230804 -> 20230804 2024-03-23T23:28:40.535 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20230919 -> 20230919 2024-03-23T23:28:40.535 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20231030 -> 20231030 2024-03-23T23:28:40.535 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20231111 -> 20231111 2024-03-23T23:28:40.535 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20231211 -> 20231211 2024-03-23T23:28:40.535 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20240115 -> 20240115 2024-03-23T23:28:40.535 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20240220 -> 20240220 2024-03-23T23:28:40.535 INFO:teuthology.orchestra.run.smithi008.stderr: * [new tag] 20240312 -> 20240312 2024-03-23T23:28:44.600 INFO:teuthology.orchestra.run.smithi196.stderr:Updating files: 51% (1849/3598) Updating files: 52% (1871/3598) Updating files: 53% (1907/3598) Updating files: 54% (1943/3598) Updating files: 55% (1979/3598) Updating files: 56% (2015/3598) Updating files: 57% (2051/3598) Updating files: 58% (2087/3598) Updating files: 59% (2123/3598) Updating files: 60% (2159/3598) Updating files: 61% (2195/3598) Updating files: 62% (2231/3598) Updating files: 63% (2267/3598) Updating files: 64% (2303/3598) Updating files: 64% (2326/3598) Updating files: 65% (2339/3598) Updating files: 66% (2375/3598) Updating files: 67% (2411/3598) Updating files: 68% (2447/3598) Updating files: 69% (2483/3598) Updating files: 70% (2519/3598) Updating files: 71% (2555/3598) Updating files: 72% (2591/3598) Updating files: 73% (2627/3598) Updating files: 74% (2663/3598) Updating files: 75% (2699/3598) Updating files: 76% (2735/3598) Updating files: 77% (2771/3598) Updating files: 77% (2785/3598) Updating files: 78% (2807/3598) Updating files: 79% (2843/3598) Updating files: 80% (2879/3598) Updating files: 81% (2915/3598) Updating files: 82% (2951/3598) Updating files: 83% (2987/3598) Updating files: 84% (3023/3598) Updating files: 85% (3059/3598) Updating files: 86% (3095/3598) Updating files: 87% (3131/3598) Updating files: 88% (3167/3598) Updating files: 89% (3203/3598) Updating files: 89% (3226/3598) Updating files: 90% (3239/3598) Updating files: 91% (3275/3598) Updating files: 92% (3311/3598) Updating files: 93% (3347/3598) Updating files: 94% (3383/3598) Updating files: 95% (3419/3598) Updating files: 96% (3455/3598) Updating files: 97% (3491/3598) Updating files: 98% (3527/3598) Updating files: 99% (3563/3598) Updating files: 100% (3598/3598) Updating files: 100% (3598/3598), done. 2024-03-23T23:28:44.605 INFO:teuthology.orchestra.run.smithi196.stdout:HEAD is now at e068ccf0 Merge branch 'robot/pr-0-1711100280' into 'main' 2024-03-23T23:28:44.626 INFO:teuthology.task.kernel:Downloading kernel 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 on client.1... 2024-03-23T23:28:44.626 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5ec3e6e88b2e2783e09498588bb1f433ae9c8986 2024-03-23T23:28:44.775 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/5ec3e6e88b2e2783e09498588bb1f433ae9c8986/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-g5ec3e6e88b2e/ 2024-03-23T23:28:44.775 DEBUG:teuthology.orchestra.run.smithi196:> rm -f /tmp/linux-image.deb && echo linux-image-6.8.0-g5ec3e6e88b2e_6.8.0-g5ec3e6e88b2e-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/5ec3e6e88b2e2783e09498588bb1f433ae9c8986/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-g5ec3e6e88b2e/ --input-file=- 2024-03-23T23:28:44.778 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi196.front.sepia.ceph.com to complete... 2024-03-23T23:28:44.950 INFO:teuthology.orchestra.run.smithi008.stderr:Updating files: 48% (1755/3598) Updating files: 49% (1764/3598) Updating files: 50% (1799/3598) Updating files: 51% (1835/3598) Updating files: 52% (1871/3598) Updating files: 53% (1907/3598) Updating files: 54% (1943/3598) Updating files: 55% (1979/3598) Updating files: 56% (2015/3598) Updating files: 57% (2051/3598) Updating files: 58% (2087/3598) Updating files: 59% (2123/3598) Updating files: 60% (2159/3598) Updating files: 61% (2195/3598) Updating files: 61% (2224/3598) Updating files: 62% (2231/3598) Updating files: 63% (2267/3598) Updating files: 64% (2303/3598) Updating files: 65% (2339/3598) Updating files: 66% (2375/3598) Updating files: 67% (2411/3598) Updating files: 68% (2447/3598) Updating files: 69% (2483/3598) Updating files: 70% (2519/3598) Updating files: 71% (2555/3598) Updating files: 71% (2580/3598) Updating files: 72% (2591/3598) Updating files: 73% (2627/3598) Updating files: 74% (2663/3598) Updating files: 75% (2699/3598) Updating files: 76% (2735/3598) Updating files: 77% (2771/3598) Updating files: 78% (2807/3598) Updating files: 79% (2843/3598) Updating files: 80% (2879/3598) Updating files: 81% (2915/3598) Updating files: 82% (2951/3598) Updating files: 83% (2987/3598) Updating files: 83% (3008/3598) Updating files: 84% (3023/3598) Updating files: 85% (3059/3598) Updating files: 86% (3095/3598) Updating files: 87% (3131/3598) Updating files: 88% (3167/3598) Updating files: 89% (3203/3598) Updating files: 90% (3239/3598) Updating files: 91% (3275/3598) Updating files: 92% (3311/3598) Updating files: 93% (3347/3598) Updating files: 94% (3383/3598) Updating files: 95% (3419/3598) Updating files: 96% (3455/3598) Updating files: 97% (3491/3598) Updating files: 98% (3527/3598) Updating files: 99% (3563/3598) Updating files: 100% (3598/3598) Updating files: 100% (3598/3598), done. 2024-03-23T23:28:44.955 INFO:teuthology.orchestra.run.smithi008.stdout:HEAD is now at e068ccf0 Merge branch 'robot/pr-0-1711100280' into 'main' 2024-03-23T23:28:44.977 INFO:teuthology.task.kernel:Downloading kernel 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 on client.0... 2024-03-23T23:28:44.977 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5ec3e6e88b2e2783e09498588bb1f433ae9c8986 2024-03-23T23:28:45.123 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/5ec3e6e88b2e2783e09498588bb1f433ae9c8986/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-g5ec3e6e88b2e/ 2024-03-23T23:28:45.123 DEBUG:teuthology.orchestra.run.smithi008:> rm -f /tmp/linux-image.deb && echo linux-image-6.8.0-g5ec3e6e88b2e_6.8.0-g5ec3e6e88b2e-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/5ec3e6e88b2e2783e09498588bb1f433ae9c8986/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-g5ec3e6e88b2e/ --input-file=- 2024-03-23T23:28:45.125 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi008.front.sepia.ceph.com to complete... 2024-03-23T23:28:46.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23 23:28:46 URL:https://3.chacra.ceph.com/r/kernel/testing/5ec3e6e88b2e2783e09498588bb1f433ae9c8986/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-g5ec3e6e88b2e/linux-image-6.8.0-g5ec3e6e88b2e_6.8.0-g5ec3e6e88b2e-1_amd64.deb [39270258/39270258] -> "/tmp/linux-image.deb" [1] 2024-03-23T23:28:46.522 INFO:teuthology.orchestra.run.smithi196.stderr:FINISHED --2024-03-23 23:28:46-- 2024-03-23T23:28:46.522 INFO:teuthology.orchestra.run.smithi196.stderr:Total wall clock time: 1.7s 2024-03-23T23:28:46.522 INFO:teuthology.orchestra.run.smithi196.stderr:Downloaded: 1 files, 37M in 1.5s (24.6 MB/s) 2024-03-23T23:28:46.526 INFO:teuthology.task.kernel:Installing kernel 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 on client.1... 2024-03-23T23:28:46.526 DEBUG:teuthology.orchestra.run.smithi196:> sudo dpkg -i /tmp/linux-image.deb 2024-03-23T23:28:46.803 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package linux-image-6.8.0-g5ec3e6e88b2e. 2024-03-23T23:28:48.741 INFO:teuthology.orchestra.run.smithi196.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-03-23T23:28:48.745 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-03-23T23:28:48.871 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-image-6.8.0-g5ec3e6e88b2e (6.8.0-g5ec3e6e88b2e-1) ... 2024-03-23T23:28:51.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23 23:28:51 URL:https://3.chacra.ceph.com/r/kernel/testing/5ec3e6e88b2e2783e09498588bb1f433ae9c8986/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-g5ec3e6e88b2e/linux-image-6.8.0-g5ec3e6e88b2e_6.8.0-g5ec3e6e88b2e-1_amd64.deb [39270258/39270258] -> "/tmp/linux-image.deb" [1] 2024-03-23T23:28:51.190 INFO:teuthology.orchestra.run.smithi008.stderr:FINISHED --2024-03-23 23:28:51-- 2024-03-23T23:28:51.190 INFO:teuthology.orchestra.run.smithi008.stderr:Total wall clock time: 6.0s 2024-03-23T23:28:51.190 INFO:teuthology.orchestra.run.smithi008.stderr:Downloaded: 1 files, 37M in 5.8s (6.42 MB/s) 2024-03-23T23:28:51.196 INFO:teuthology.task.kernel:Installing kernel 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 on client.0... 2024-03-23T23:28:51.197 DEBUG:teuthology.orchestra.run.smithi008:> sudo dpkg -i /tmp/linux-image.deb 2024-03-23T23:28:51.420 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package linux-image-6.8.0-g5ec3e6e88b2e. 2024-03-23T23:28:52.501 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-image-6.8.0-g5ec3e6e88b2e (6.8.0-g5ec3e6e88b2e-1) ... 2024-03-23T23:28:52.610 INFO:teuthology.orchestra.run.smithi196.stderr:update-initramfs: Generating /boot/initrd.img-6.8.0-g5ec3e6e88b2e 2024-03-23T23:28:53.446 INFO:teuthology.orchestra.run.smithi008.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-03-23T23:28:53.450 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-03-23T23:28:53.574 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking linux-image-6.8.0-g5ec3e6e88b2e (6.8.0-g5ec3e6e88b2e-1) ... 2024-03-23T23:28:56.838 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up linux-image-6.8.0-g5ec3e6e88b2e (6.8.0-g5ec3e6e88b2e-1) ... 2024-03-23T23:28:56.950 INFO:teuthology.orchestra.run.smithi008.stderr:update-initramfs: Generating /boot/initrd.img-6.8.0-g5ec3e6e88b2e 2024-03-23T23:29:14.184 INFO:teuthology.orchestra.run.smithi196.stderr:Sourcing file `/etc/default/grub' 2024-03-23T23:29:14.203 INFO:teuthology.orchestra.run.smithi196.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-23T23:29:14.228 INFO:teuthology.orchestra.run.smithi196.stderr:Generating grub configuration file ... 2024-03-23T23:29:14.541 INFO:teuthology.orchestra.run.smithi196.stderr:Found linux image: /boot/vmlinuz-6.8.0-g5ec3e6e88b2e 2024-03-23T23:29:14.561 INFO:teuthology.orchestra.run.smithi196.stderr:Found initrd image: /boot/initrd.img-6.8.0-g5ec3e6e88b2e 2024-03-23T23:29:14.900 INFO:teuthology.orchestra.run.smithi196.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-23T23:29:14.916 INFO:teuthology.orchestra.run.smithi196.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-23T23:29:14.977 INFO:teuthology.orchestra.run.smithi196.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-23T23:29:14.982 INFO:teuthology.orchestra.run.smithi196.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-23T23:29:15.139 INFO:teuthology.orchestra.run.smithi196.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-23T23:29:15.139 INFO:teuthology.orchestra.run.smithi196.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-03-23T23:29:15.139 INFO:teuthology.orchestra.run.smithi196.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-23T23:29:15.170 INFO:teuthology.orchestra.run.smithi196.stderr:done 2024-03-23T23:29:15.399 DEBUG:teuthology.orchestra.run.smithi196:> dpkg-deb -c /tmp/linux-image.deb 2024-03-23T23:29:15.448 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./ 2024-03-23T23:29:15.448 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./boot/ 2024-03-23T23:29:15.448 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 4474370 2024-03-19 20:13 ./boot/System.map-6.8.0-g5ec3e6e88b2e 2024-03-23T23:29:15.460 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 170904 2024-03-19 20:13 ./boot/config-6.8.0-g5ec3e6e88b2e 2024-03-23T23:29:15.460 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11555840 2024-03-19 20:13 ./boot/vmlinuz-6.8.0-g5ec3e6e88b2e 2024-03-23T23:29:15.479 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./etc/ 2024-03-23T23:29:15.479 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./etc/kernel/ 2024-03-23T23:29:15.479 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./etc/kernel/postinst.d/ 2024-03-23T23:29:15.479 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./etc/kernel/postrm.d/ 2024-03-23T23:29:15.479 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./etc/kernel/preinst.d/ 2024-03-23T23:29:15.479 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./etc/kernel/prerm.d/ 2024-03-23T23:29:15.479 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/ 2024-03-23T23:29:15.479 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/ 2024-03-23T23:29:15.480 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/ 2024-03-23T23:29:15.480 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/ 2024-03-23T23:29:15.480 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/ 2024-03-23T23:29:15.480 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/ 2024-03-23T23:29:15.480 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/ 2024-03-23T23:29:15.480 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 490449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/aesni-intel.ko 2024-03-23T23:29:15.482 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25297 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-23T23:29:15.482 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29417 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-23T23:29:15.482 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-23T23:29:15.482 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 93081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-23T23:29:15.482 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 106697 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-23T23:29:15.482 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 152145 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-23T23:29:15.483 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12457 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-23T23:29:15.483 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13681 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-23T23:29:15.483 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 83857 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-23T23:29:15.483 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18649 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-23T23:29:15.483 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 47185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-23T23:29:15.483 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 47177 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-23T23:29:15.483 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 51697 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-23T23:29:15.483 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 39601 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-23T23:29:15.483 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 42537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-23T23:29:15.483 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 58489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-23T23:29:15.483 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 50393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-23T23:29:15.483 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31961 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-23T23:29:15.483 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-23T23:29:15.484 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kernel/ 2024-03-23T23:29:15.484 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kernel/cpu/ 2024-03-23T23:29:15.484 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kernel/cpu/mce/ 2024-03-23T23:29:15.484 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 41433 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-23T23:29:15.484 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13593 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kernel/cpuid.ko 2024-03-23T23:29:15.484 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17849 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kernel/msr.ko 2024-03-23T23:29:15.484 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kvm/ 2024-03-23T23:29:15.484 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 354265 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-23T23:29:15.484 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 886177 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-23T23:29:15.484 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 2294937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kvm/kvm.ko 2024-03-23T23:29:15.496 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/ 2024-03-23T23:29:15.496 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 53841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/af_alg.ko 2024-03-23T23:29:15.496 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/algif_hash.ko 2024-03-23T23:29:15.497 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21593 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/algif_skcipher.ko 2024-03-23T23:29:15.497 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17113 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/ansi_cprng.ko 2024-03-23T23:29:15.497 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19553 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/anubis.ko 2024-03-23T23:29:15.497 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9585 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/arc4.ko 2024-03-23T23:29:15.497 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/asymmetric_keys/ 2024-03-23T23:29:15.497 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10089 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-03-23T23:29:15.497 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/ 2024-03-23T23:29:15.497 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11153 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_memcpy.ko 2024-03-23T23:29:15.497 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_pq.ko 2024-03-23T23:29:15.497 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21457 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-23T23:29:15.497 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_tx.ko 2024-03-23T23:29:15.497 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_xor.ko 2024-03-23T23:29:15.498 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/raid6test.ko 2024-03-23T23:29:15.498 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20337 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/authenc.ko 2024-03-23T23:29:15.498 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22353 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/authencesn.ko 2024-03-23T23:29:15.498 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/blake2b_generic.ko 2024-03-23T23:29:15.498 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/blowfish_common.ko 2024-03-23T23:29:15.498 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/blowfish_generic.ko 2024-03-23T23:29:15.498 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 38713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/camellia_generic.ko 2024-03-23T23:29:15.498 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cast5_generic.ko 2024-03-23T23:29:15.498 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cast6_generic.ko 2024-03-23T23:29:15.498 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cast_common.ko 2024-03-23T23:29:15.498 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/ccm.ko 2024-03-23T23:29:15.498 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cmac.ko 2024-03-23T23:29:15.499 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/crc32_generic.ko 2024-03-23T23:29:15.499 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 47681 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cryptd.ko 2024-03-23T23:29:15.499 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 39473 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/crypto_engine.ko 2024-03-23T23:29:15.499 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26921 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/crypto_simd.ko 2024-03-23T23:29:15.499 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/crypto_user.ko 2024-03-23T23:29:15.499 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17649 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cts.ko 2024-03-23T23:29:15.499 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/des_generic.ko 2024-03-23T23:29:15.499 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15593 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/dh_generic.ko 2024-03-23T23:29:15.499 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10913 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/echainiv.ko 2024-03-23T23:29:15.499 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25241 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/essiv.ko 2024-03-23T23:29:15.499 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17905 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/fcrypt.ko 2024-03-23T23:29:15.499 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26809 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/khazad.ko 2024-03-23T23:29:15.499 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/lrw.ko 2024-03-23T23:29:15.499 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11425 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/lz4.ko 2024-03-23T23:29:15.500 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/lz4hc.ko 2024-03-23T23:29:15.500 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11609 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/md4.ko 2024-03-23T23:29:15.500 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/michael_mic.ko 2024-03-23T23:29:15.500 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10585 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/pcbc.ko 2024-03-23T23:29:15.500 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/pcrypt.ko 2024-03-23T23:29:15.500 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15961 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/rmd160.ko 2024-03-23T23:29:15.500 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/seed.ko 2024-03-23T23:29:15.500 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/serpent_generic.ko 2024-03-23T23:29:15.500 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 143033 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/tcrypt.ko 2024-03-23T23:29:15.500 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10793 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/tea.ko 2024-03-23T23:29:15.500 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28681 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/twofish_common.ko 2024-03-23T23:29:15.500 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13073 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/twofish_generic.ko 2024-03-23T23:29:15.500 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/vmac.ko 2024-03-23T23:29:15.501 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36097 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/wp512.ko 2024-03-23T23:29:15.501 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/xcbc.ko 2024-03-23T23:29:15.501 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/xor.ko 2024-03-23T23:29:15.501 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/xts.ko 2024-03-23T23:29:15.501 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/xxhash_generic.ko 2024-03-23T23:29:15.501 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ 2024-03-23T23:29:15.501 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/ 2024-03-23T23:29:15.501 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18473 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/acpi_extlog.ko 2024-03-23T23:29:15.501 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26889 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-23T23:29:15.501 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28153 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/acpi_pad.ko 2024-03-23T23:29:15.501 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/apei/ 2024-03-23T23:29:15.501 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31969 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/apei/einj.ko 2024-03-23T23:29:15.502 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/ec_sys.ko 2024-03-23T23:29:15.502 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/platform_profile.ko 2024-03-23T23:29:15.502 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/sbs.ko 2024-03-23T23:29:15.502 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19433 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/sbshc.ko 2024-03-23T23:29:15.502 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 104433 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/video.ko 2024-03-23T23:29:15.502 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/ 2024-03-23T23:29:15.502 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21505 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/acard-ahci.ko 2024-03-23T23:29:15.502 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 89937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/ahci.ko 2024-03-23T23:29:15.502 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/ahci_platform.ko 2024-03-23T23:29:15.502 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 88313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/libahci.ko 2024-03-23T23:29:15.502 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34889 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/libahci_platform.ko 2024-03-23T23:29:15.502 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17041 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_acpi.ko 2024-03-23T23:29:15.502 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_ali.ko 2024-03-23T23:29:15.503 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33417 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_amd.ko 2024-03-23T23:29:15.503 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_artop.ko 2024-03-23T23:29:15.503 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_atiixp.ko 2024-03-23T23:29:15.503 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24849 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_atp867x.ko 2024-03-23T23:29:15.503 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_cmd640.ko 2024-03-23T23:29:15.503 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25089 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_cmd64x.ko 2024-03-23T23:29:15.503 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_cypress.ko 2024-03-23T23:29:15.503 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17753 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_efar.ko 2024-03-23T23:29:15.503 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21849 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_hpt366.ko 2024-03-23T23:29:15.503 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_hpt37x.ko 2024-03-23T23:29:15.503 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23033 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-23T23:29:15.503 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-23T23:29:15.503 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_it8213.ko 2024-03-23T23:29:15.504 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35177 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_it821x.ko 2024-03-23T23:29:15.504 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12793 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_jmicron.ko 2024-03-23T23:29:15.504 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 52177 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_legacy.ko 2024-03-23T23:29:15.504 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15089 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_marvell.ko 2024-03-23T23:29:15.504 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_mpiix.ko 2024-03-23T23:29:15.504 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_netcell.ko 2024-03-23T23:29:15.504 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_ninja32.ko 2024-03-23T23:29:15.504 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_ns87410.ko 2024-03-23T23:29:15.504 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17265 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_ns87415.ko 2024-03-23T23:29:15.504 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16473 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_oldpiix.ko 2024-03-23T23:29:15.504 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_opti.ko 2024-03-23T23:29:15.504 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20585 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_optidma.ko 2024-03-23T23:29:15.504 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_pcmcia.ko 2024-03-23T23:29:15.504 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 37697 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-23T23:29:15.505 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20457 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-23T23:29:15.505 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14129 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_piccolo.ko 2024-03-23T23:29:15.505 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15353 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_radisys.ko 2024-03-23T23:29:15.505 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19433 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_rdc.ko 2024-03-23T23:29:15.505 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_rz1000.ko 2024-03-23T23:29:15.505 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13785 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_sch.ko 2024-03-23T23:29:15.505 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23001 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_serverworks.ko 2024-03-23T23:29:15.505 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_sil680.ko 2024-03-23T23:29:15.505 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19601 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_sl82c105.ko 2024-03-23T23:29:15.505 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15913 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_triflex.ko 2024-03-23T23:29:15.505 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_via.ko 2024-03-23T23:29:15.505 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pdc_adma.ko 2024-03-23T23:29:15.505 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_inic162x.ko 2024-03-23T23:29:15.506 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 83257 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_mv.ko 2024-03-23T23:29:15.506 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 70305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_nv.ko 2024-03-23T23:29:15.506 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 37281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_promise.ko 2024-03-23T23:29:15.506 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_qstor.ko 2024-03-23T23:29:15.506 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_sil.ko 2024-03-23T23:29:15.506 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 38177 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_sil24.ko 2024-03-23T23:29:15.506 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17857 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_sis.ko 2024-03-23T23:29:15.506 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20353 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_svw.ko 2024-03-23T23:29:15.506 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 44705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_sx4.ko 2024-03-23T23:29:15.506 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_uli.ko 2024-03-23T23:29:15.506 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_via.ko 2024-03-23T23:29:15.506 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_vsc.ko 2024-03-23T23:29:15.507 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/auxdisplay/ 2024-03-23T23:29:15.507 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/auxdisplay/ks0108.ko 2024-03-23T23:29:15.507 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/bcma/ 2024-03-23T23:29:15.507 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 124457 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/bcma/bcma.ko 2024-03-23T23:29:15.507 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/ 2024-03-23T23:29:15.507 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/aoe/ 2024-03-23T23:29:15.507 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 113833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/aoe/aoe.ko 2024-03-23T23:29:15.507 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/drbd/ 2024-03-23T23:29:15.507 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 964817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/drbd/drbd.ko 2024-03-23T23:29:15.507 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 169705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/floppy.ko 2024-03-23T23:29:15.507 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/mtip32xx/ 2024-03-23T23:29:15.507 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 94217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-23T23:29:15.554 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 116337 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/nbd.ko 2024-03-23T23:29:15.555 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/null_blk/ 2024-03-23T23:29:15.555 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 110329 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/null_blk/null_blk.ko 2024-03-23T23:29:15.555 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 98193 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/pktcdvd.ko 2024-03-23T23:29:15.555 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 263641 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/rbd.ko 2024-03-23T23:29:15.555 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/xen-blkback/ 2024-03-23T23:29:15.555 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 98121 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-23T23:29:15.555 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/zram/ 2024-03-23T23:29:15.555 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 58777 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/zram/zram.ko 2024-03-23T23:29:15.555 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ 2024-03-23T23:29:15.555 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30681 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/applicom.ko 2024-03-23T23:29:15.555 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11913 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hangcheck-timer.ko 2024-03-23T23:29:15.555 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/ 2024-03-23T23:29:15.556 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13801 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-23T23:29:15.556 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-23T23:29:15.556 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13073 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-23T23:29:15.556 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11073 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/via-rng.ko 2024-03-23T23:29:15.556 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-23T23:29:15.556 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ 2024-03-23T23:29:15.556 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30617 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-23T23:29:15.556 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 148521 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-23T23:29:15.556 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-23T23:29:15.556 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 139361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-23T23:29:15.556 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 70873 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-23T23:29:15.556 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 53417 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-23T23:29:15.556 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/lp.ko 2024-03-23T23:29:15.557 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/mwave/ 2024-03-23T23:29:15.557 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 84025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/mwave/mwave.ko 2024-03-23T23:29:15.557 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25785 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/nvram.ko 2024-03-23T23:29:15.557 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ppdev.ko 2024-03-23T23:29:15.557 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 51025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tlclk.ko 2024-03-23T23:29:15.557 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/ 2024-03-23T23:29:15.557 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-23T23:29:15.557 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15785 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-03-23T23:29:15.557 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-03-23T23:29:15.557 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-03-23T23:29:15.557 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-23T23:29:15.557 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22609 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-23T23:29:15.557 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23465 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-03-23T23:29:15.558 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/xillybus/ 2024-03-23T23:29:15.558 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16905 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/xillybus/xillybus_class.ko 2024-03-23T23:29:15.558 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 50849 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/xillybus/xillybus_core.ko 2024-03-23T23:29:15.558 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-03-23T23:29:15.558 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/clk/ 2024-03-23T23:29:15.558 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/clk/clk-palmas.ko 2024-03-23T23:29:15.558 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 47729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/clk/clk-si5351.ko 2024-03-23T23:29:15.558 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/clk/clk-twl6040.ko 2024-03-23T23:29:15.558 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19153 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/clk/clk-wm831x.ko 2024-03-23T23:29:15.558 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/ 2024-03-23T23:29:15.558 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-23T23:29:15.558 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-23T23:29:15.558 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25793 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-23T23:29:15.559 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/ 2024-03-23T23:29:15.559 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/ccp/ 2024-03-23T23:29:15.559 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 70473 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-23T23:29:15.559 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 246841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/ccp/ccp.ko 2024-03-23T23:29:15.559 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/ 2024-03-23T23:29:15.559 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat/ 2024-03-23T23:29:15.559 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat/qat_common/ 2024-03-23T23:29:15.559 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 570497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-23T23:29:15.559 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-03-23T23:29:15.559 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24049 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-23T23:29:15.559 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19905 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/padlock-aes.ko 2024-03-23T23:29:15.559 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/padlock-sha.ko 2024-03-23T23:29:15.559 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/virtio/ 2024-03-23T23:29:15.559 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 70433 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-23T23:29:15.560 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dca/ 2024-03-23T23:29:15.560 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dca/dca.ko 2024-03-23T23:29:15.560 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma/ 2024-03-23T23:29:15.560 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma/dw/ 2024-03-23T23:29:15.560 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-23T23:29:15.560 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma/ioat/ 2024-03-23T23:29:15.560 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 122817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-23T23:29:15.560 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/ 2024-03-23T23:29:15.560 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 80305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/amd64_edac.ko 2024-03-23T23:29:15.560 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35673 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/e752x_edac.ko 2024-03-23T23:29:15.560 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 41641 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/edac_mce_amd.ko 2024-03-23T23:29:15.561 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i3000_edac.ko 2024-03-23T23:29:15.561 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17969 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i3200_edac.ko 2024-03-23T23:29:15.561 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i5100_edac.ko 2024-03-23T23:29:15.561 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i5400_edac.ko 2024-03-23T23:29:15.561 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i7300_edac.ko 2024-03-23T23:29:15.561 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 51945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i7core_edac.ko 2024-03-23T23:29:15.561 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18273 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i82975x_edac.ko 2024-03-23T23:29:15.561 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/ie31200_edac.ko 2024-03-23T23:29:15.561 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 56737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/sb_edac.ko 2024-03-23T23:29:15.561 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/x38_edac.ko 2024-03-23T23:29:15.561 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/extcon/ 2024-03-23T23:29:15.561 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/extcon/extcon-gpio.ko 2024-03-23T23:29:15.561 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27089 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/extcon/extcon-max14577.ko 2024-03-23T23:29:15.561 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/extcon/extcon-max77693.ko 2024-03-23T23:29:15.562 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24649 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/extcon/extcon-max8997.ko 2024-03-23T23:29:15.562 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/extcon/extcon-palmas.ko 2024-03-23T23:29:15.562 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23617 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/extcon/extcon-rt8973a.ko 2024-03-23T23:29:15.562 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27689 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/extcon/extcon-sm5502.ko 2024-03-23T23:29:15.562 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/firmware/ 2024-03-23T23:29:15.562 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/firmware/dmi-sysfs.ko 2024-03-23T23:29:15.562 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/firmware/efi/ 2024-03-23T23:29:15.562 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15425 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/firmware/efi/efi-pstore.ko 2024-03-23T23:29:15.562 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-23T23:29:15.562 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/ 2024-03-23T23:29:15.562 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-adp5520.ko 2024-03-23T23:29:15.562 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-amd8111.ko 2024-03-23T23:29:15.562 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-arizona.ko 2024-03-23T23:29:15.563 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-da9052.ko 2024-03-23T23:29:15.563 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-da9055.ko 2024-03-23T23:29:15.563 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21969 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-dln2.ko 2024-03-23T23:29:15.563 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 77753 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-f7188x.ko 2024-03-23T23:29:15.563 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-generic.ko 2024-03-23T23:29:15.563 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19481 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-ich.ko 2024-03-23T23:29:15.563 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-03-23T23:29:15.563 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14017 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-kempld.ko 2024-03-23T23:29:15.563 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-lp3943.ko 2024-03-23T23:29:15.563 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9417 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-max7300.ko 2024-03-23T23:29:15.563 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11809 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-max730x.ko 2024-03-23T23:29:15.563 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-max732x.ko 2024-03-23T23:29:15.563 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25049 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-03-23T23:29:15.564 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 47449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-pca953x.ko 2024-03-23T23:29:15.564 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-pcf857x.ko 2024-03-23T23:29:15.564 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-rdc321x.ko 2024-03-23T23:29:15.564 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20505 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-sch.ko 2024-03-23T23:29:15.564 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-sch311x.ko 2024-03-23T23:29:15.564 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-tps65912.ko 2024-03-23T23:29:15.564 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20969 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-twl4030.ko 2024-03-23T23:29:15.564 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11329 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-twl6040.ko 2024-03-23T23:29:15.564 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20505 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-23T23:29:15.564 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-vx855.ko 2024-03-23T23:29:15.564 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-wm831x.ko 2024-03-23T23:29:15.564 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-wm8350.ko 2024-03-23T23:29:15.564 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-wm8994.ko 2024-03-23T23:29:15.564 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/ 2024-03-23T23:29:15.565 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11481 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-a4tech.ko 2024-03-23T23:29:15.565 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 39417 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-apple.ko 2024-03-23T23:29:15.565 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-appleir.ko 2024-03-23T23:29:15.565 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8257 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-aureal.ko 2024-03-23T23:29:15.565 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-axff.ko 2024-03-23T23:29:15.565 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-belkin.ko 2024-03-23T23:29:15.565 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-cherry.ko 2024-03-23T23:29:15.565 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-chicony.ko 2024-03-23T23:29:15.565 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 60665 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-cp2112.ko 2024-03-23T23:29:15.565 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-cypress.ko 2024-03-23T23:29:15.565 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16297 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-dr.ko 2024-03-23T23:29:15.565 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10601 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-elecom.ko 2024-03-23T23:29:15.565 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-elo.ko 2024-03-23T23:29:15.566 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-emsff.ko 2024-03-23T23:29:15.566 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-ezkey.ko 2024-03-23T23:29:15.566 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-gaff.ko 2024-03-23T23:29:15.566 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-generic.ko 2024-03-23T23:29:15.566 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17033 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-gt683r.ko 2024-03-23T23:29:15.566 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12585 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-gyration.ko 2024-03-23T23:29:15.566 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10073 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-23T23:29:15.566 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10369 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-23T23:29:15.566 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14353 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-holtekff.ko 2024-03-23T23:29:15.566 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-hyperv.ko 2024-03-23T23:29:15.566 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-icade.ko 2024-03-23T23:29:15.566 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9145 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-kensington.ko 2024-03-23T23:29:15.566 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-keytouch.ko 2024-03-23T23:29:15.566 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17113 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-kye.ko 2024-03-23T23:29:15.567 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-lcpower.ko 2024-03-23T23:29:15.567 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-led.ko 2024-03-23T23:29:15.567 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 42849 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-lenovo.ko 2024-03-23T23:29:15.567 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30601 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-lg-g15.ko 2024-03-23T23:29:15.567 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 57977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-23T23:29:15.567 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 101545 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-23T23:29:15.567 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 80921 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-logitech.ko 2024-03-23T23:29:15.567 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-magicmouse.ko 2024-03-23T23:29:15.567 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21873 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-microsoft.ko 2024-03-23T23:29:15.567 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10265 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-monterey.ko 2024-03-23T23:29:15.567 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 50281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-multitouch.ko 2024-03-23T23:29:15.567 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-ntrig.ko 2024-03-23T23:29:15.567 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8761 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-ortek.ko 2024-03-23T23:29:15.568 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-penmount.ko 2024-03-23T23:29:15.568 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12193 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-petalynx.ko 2024-03-23T23:29:15.568 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 72865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-picolcd.ko 2024-03-23T23:29:15.568 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-pl.ko 2024-03-23T23:29:15.568 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-plantronics.ko 2024-03-23T23:29:15.568 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8329 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-primax.ko 2024-03-23T23:29:15.568 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-rmi.ko 2024-03-23T23:29:15.568 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-23T23:29:15.568 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13961 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-common.ko 2024-03-23T23:29:15.568 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31329 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-23T23:29:15.568 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-23T23:29:15.568 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-23T23:29:15.568 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21033 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-23T23:29:15.568 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-23T23:29:15.569 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-23T23:29:15.569 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-23T23:29:15.569 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-23T23:29:15.569 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19425 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-23T23:29:15.569 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23241 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat.ko 2024-03-23T23:29:15.569 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13585 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-saitek.ko 2024-03-23T23:29:15.569 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15097 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-samsung.ko 2024-03-23T23:29:15.569 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-23T23:29:15.569 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13513 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-sjoy.ko 2024-03-23T23:29:15.569 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 51161 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-sony.ko 2024-03-23T23:29:15.569 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-speedlink.ko 2024-03-23T23:29:15.569 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-steelseries.ko 2024-03-23T23:29:15.569 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-sunplus.ko 2024-03-23T23:29:15.569 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-23T23:29:15.570 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-tivo.ko 2024-03-23T23:29:15.570 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15001 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-tmff.ko 2024-03-23T23:29:15.570 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14289 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-topseed.ko 2024-03-23T23:29:15.570 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-twinhan.ko 2024-03-23T23:29:15.570 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 70993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-uclogic.ko 2024-03-23T23:29:15.570 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-waltop.ko 2024-03-23T23:29:15.570 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 143393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-wiimote.ko 2024-03-23T23:29:15.570 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8065 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-xinmo.ko 2024-03-23T23:29:15.570 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-zpff.ko 2024-03-23T23:29:15.570 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-zydacron.ko 2024-03-23T23:29:15.570 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 269233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid.ko 2024-03-23T23:29:15.570 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/uhid.ko 2024-03-23T23:29:15.570 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/usbhid/ 2024-03-23T23:29:15.570 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 125641 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/usbhid/usbhid.ko 2024-03-23T23:29:15.571 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19049 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/usbhid/usbkbd.ko 2024-03-23T23:29:15.571 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/usbhid/usbmouse.ko 2024-03-23T23:29:15.571 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 218881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/wacom.ko 2024-03-23T23:29:15.571 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hv/ 2024-03-23T23:29:15.571 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 64305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hv/hv_balloon.ko 2024-03-23T23:29:15.571 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 90113 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hv/hv_utils.ko 2024-03-23T23:29:15.571 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 304953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hv/hv_vmbus.ko 2024-03-23T23:29:15.571 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ 2024-03-23T23:29:15.571 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 66801 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/abituguru.ko 2024-03-23T23:29:15.571 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 61817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/abituguru3.ko 2024-03-23T23:29:15.571 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-23T23:29:15.571 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17417 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ad7414.ko 2024-03-23T23:29:15.572 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ad7418.ko 2024-03-23T23:29:15.572 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25161 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adc128d818.ko 2024-03-23T23:29:15.572 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31641 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm1025.ko 2024-03-23T23:29:15.572 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 97889 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm1026.ko 2024-03-23T23:29:15.572 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm1029.ko 2024-03-23T23:29:15.572 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 45465 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm1031.ko 2024-03-23T23:29:15.572 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm9240.ko 2024-03-23T23:29:15.572 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14681 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ads7828.ko 2024-03-23T23:29:15.572 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10681 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7410.ko 2024-03-23T23:29:15.572 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21961 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7411.ko 2024-03-23T23:29:15.572 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 74321 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7462.ko 2024-03-23T23:29:15.572 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 39497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7470.ko 2024-03-23T23:29:15.572 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 69313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7475.ko 2024-03-23T23:29:15.572 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19545 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7x10.ko 2024-03-23T23:29:15.572 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 38985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/amc6821.ko 2024-03-23T23:29:15.573 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 55113 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/applesmc.ko 2024-03-23T23:29:15.573 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 49825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/asb100.ko 2024-03-23T23:29:15.573 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 58529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/asc7621.ko 2024-03-23T23:29:15.573 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 40729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-23T23:29:15.573 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/atxp1.ko 2024-03-23T23:29:15.573 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/coretemp.ko 2024-03-23T23:29:15.573 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/da9052-hwmon.ko 2024-03-23T23:29:15.573 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/da9055-hwmon.ko 2024-03-23T23:29:15.573 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 49241 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-23T23:29:15.573 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 99513 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/dme1737.ko 2024-03-23T23:29:15.573 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ds1621.ko 2024-03-23T23:29:15.573 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ds620.ko 2024-03-23T23:29:15.573 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/emc1403.ko 2024-03-23T23:29:15.573 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33097 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/emc2103.ko 2024-03-23T23:29:15.574 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/emc6w201.ko 2024-03-23T23:29:15.574 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 66897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/f71805f.ko 2024-03-23T23:29:15.574 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 94601 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/f71882fg.ko 2024-03-23T23:29:15.574 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 41313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/f75375s.ko 2024-03-23T23:29:15.574 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21681 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/fam15h_power.ko 2024-03-23T23:29:15.574 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 55361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/fschmd.ko 2024-03-23T23:29:15.574 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/g760a.ko 2024-03-23T23:29:15.574 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/g762.ko 2024-03-23T23:29:15.574 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 46713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/gl518sm.ko 2024-03-23T23:29:15.574 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 45441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/gl520sm.ko 2024-03-23T23:29:15.574 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/hih6130.ko 2024-03-23T23:29:15.574 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-23T23:29:15.574 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/i5500_temp.ko 2024-03-23T23:29:15.575 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22513 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/i5k_amb.ko 2024-03-23T23:29:15.575 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ibmaem.ko 2024-03-23T23:29:15.575 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ibmpex.ko 2024-03-23T23:29:15.575 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24785 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ina209.ko 2024-03-23T23:29:15.575 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ina2xx.ko 2024-03-23T23:29:15.575 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 140137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/it87.ko 2024-03-23T23:29:15.575 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18753 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/jc42.ko 2024-03-23T23:29:15.575 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/k10temp.ko 2024-03-23T23:29:15.575 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13793 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/k8temp.ko 2024-03-23T23:29:15.575 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lineage-pem.ko 2024-03-23T23:29:15.575 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 48513 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm63.ko 2024-03-23T23:29:15.575 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16609 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm73.ko 2024-03-23T23:29:15.575 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 38849 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm75.ko 2024-03-23T23:29:15.575 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm77.ko 2024-03-23T23:29:15.576 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34505 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm78.ko 2024-03-23T23:29:15.576 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm80.ko 2024-03-23T23:29:15.576 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16801 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm83.ko 2024-03-23T23:29:15.576 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 72745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm85.ko 2024-03-23T23:29:15.576 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 46065 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm87.ko 2024-03-23T23:29:15.576 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 37825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm90.ko 2024-03-23T23:29:15.576 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm92.ko 2024-03-23T23:29:15.576 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 108753 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm93.ko 2024-03-23T23:29:15.576 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm95234.ko 2024-03-23T23:29:15.576 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16113 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm95241.ko 2024-03-23T23:29:15.576 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm95245.ko 2024-03-23T23:29:15.576 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc2945.ko 2024-03-23T23:29:15.576 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4151.ko 2024-03-23T23:29:15.577 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15105 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4215.ko 2024-03-23T23:29:15.577 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14801 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4222.ko 2024-03-23T23:29:15.577 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4245.ko 2024-03-23T23:29:15.577 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13161 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4260.ko 2024-03-23T23:29:15.577 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14905 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4261.ko 2024-03-23T23:29:15.577 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max16065.ko 2024-03-23T23:29:15.577 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max1619.ko 2024-03-23T23:29:15.577 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24265 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max1668.ko 2024-03-23T23:29:15.577 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max197.ko 2024-03-23T23:29:15.577 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27041 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max6639.ko 2024-03-23T23:29:15.577 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max6650.ko 2024-03-23T23:29:15.577 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35689 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max6697.ko 2024-03-23T23:29:15.577 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/mc13783-adc.ko 2024-03-23T23:29:15.577 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/mcp3021.ko 2024-03-23T23:29:15.578 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-03-23T23:29:15.578 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 47793 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/nct6683.ko 2024-03-23T23:29:15.578 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 119849 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/nct6775-core.ko 2024-03-23T23:29:15.578 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 61441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/nct6775.ko 2024-03-23T23:29:15.578 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 59649 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/nct7802.ko 2024-03-23T23:29:15.578 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 82721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pc87360.ko 2024-03-23T23:29:15.578 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 54345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pc87427.ko 2024-03-23T23:29:15.578 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pcf8591.ko 2024-03-23T23:29:15.578 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/ 2024-03-23T23:29:15.578 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21265 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-23T23:29:15.578 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16969 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-23T23:29:15.578 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28241 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-23T23:29:15.579 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-23T23:29:15.579 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-23T23:29:15.579 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10089 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-23T23:29:15.579 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15417 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-23T23:29:15.579 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 82481 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-23T23:29:15.579 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8649 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-23T23:29:15.579 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30641 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-23T23:29:15.579 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-23T23:29:15.579 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20593 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-23T23:29:15.579 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/powr1220.ko 2024-03-23T23:29:15.579 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21681 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sch5627.ko 2024-03-23T23:29:15.579 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sch5636.ko 2024-03-23T23:29:15.579 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29153 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-23T23:29:15.579 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32049 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sht15.ko 2024-03-23T23:29:15.580 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13417 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sht21.ko 2024-03-23T23:29:15.580 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/shtc1.ko 2024-03-23T23:29:15.580 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 40489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sis5595.ko 2024-03-23T23:29:15.580 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19809 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/smsc47b397.ko 2024-03-23T23:29:15.580 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 40361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/smsc47m1.ko 2024-03-23T23:29:15.580 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 37289 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/smsc47m192.ko 2024-03-23T23:29:15.580 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26465 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/thmc50.ko 2024-03-23T23:29:15.580 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16969 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/tmp102.ko 2024-03-23T23:29:15.580 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/tmp103.ko 2024-03-23T23:29:15.580 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/tmp401.ko 2024-03-23T23:29:15.580 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/tmp421.ko 2024-03-23T23:29:15.580 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19625 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/via-cputemp.ko 2024-03-23T23:29:15.580 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 43449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/via686a.ko 2024-03-23T23:29:15.581 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 52369 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/vt1211.ko 2024-03-23T23:29:15.581 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 53209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/vt8231.ko 2024-03-23T23:29:15.581 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 58265 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83627ehf.ko 2024-03-23T23:29:15.581 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 79841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83627hf.ko 2024-03-23T23:29:15.581 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 71257 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83781d.ko 2024-03-23T23:29:15.581 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 63137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83791d.ko 2024-03-23T23:29:15.581 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 71233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83792d.ko 2024-03-23T23:29:15.581 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 101385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83793.ko 2024-03-23T23:29:15.581 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 119417 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83795.ko 2024-03-23T23:29:15.581 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83l785ts.ko 2024-03-23T23:29:15.581 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83l786ng.ko 2024-03-23T23:29:15.581 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-03-23T23:29:15.581 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-03-23T23:29:15.581 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/ 2024-03-23T23:29:15.582 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/algos/ 2024-03-23T23:29:15.582 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-23T23:29:15.582 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19249 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-23T23:29:15.582 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/ 2024-03-23T23:29:15.582 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-03-23T23:29:15.582 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32481 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-03-23T23:29:15.582 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-03-23T23:29:15.582 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-23T23:29:15.582 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-23T23:29:15.582 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16041 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-23T23:29:15.582 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-03-23T23:29:15.582 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 6833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-23T23:29:15.582 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13857 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-03-23T23:29:15.583 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 50305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-23T23:29:15.583 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23801 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-23T23:29:15.583 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-23T23:29:15.583 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17241 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-23T23:29:15.583 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-03-23T23:29:15.583 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-03-23T23:29:15.583 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 67689 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-23T23:29:15.583 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-23T23:29:15.583 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 47801 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-23T23:29:15.583 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17625 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-03-23T23:29:15.583 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17777 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-23T23:29:15.583 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23545 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-23T23:29:15.583 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-03-23T23:29:15.584 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25049 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-23T23:29:15.584 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-23T23:29:15.584 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 50977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-23T23:29:15.584 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-03-23T23:29:15.584 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-23T23:29:15.584 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-23T23:29:15.584 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-03-23T23:29:15.584 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29265 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-03-23T23:29:15.584 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-23T23:29:15.584 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19145 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-03-23T23:29:15.584 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-23T23:29:15.584 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-23T23:29:15.584 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27625 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-23T23:29:15.585 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-23T23:29:15.585 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 47569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-03-23T23:29:15.585 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/i2c-mux.ko 2024-03-23T23:29:15.585 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/i2c-smbus.ko 2024-03-23T23:29:15.585 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/i2c-stub.ko 2024-03-23T23:29:15.585 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/muxes/ 2024-03-23T23:29:15.585 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15097 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-03-23T23:29:15.585 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-03-23T23:29:15.585 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29641 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-03-23T23:29:15.585 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ 2024-03-23T23:29:15.585 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/ 2024-03-23T23:29:15.585 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 273529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-23T23:29:15.585 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 883945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/ib_core.ko 2024-03-23T23:29:15.586 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 69185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-23T23:29:15.586 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 324337 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-23T23:29:15.587 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 97841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-23T23:29:15.587 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 282345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-23T23:29:15.587 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 66057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-23T23:29:15.587 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/ 2024-03-23T23:29:15.587 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/cxgb4/ 2024-03-23T23:29:15.587 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 493185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-23T23:29:15.587 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mlx4/ 2024-03-23T23:29:15.587 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 420593 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-23T23:29:15.587 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mlx5/ 2024-03-23T23:29:15.587 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 741737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-23T23:29:15.587 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mthca/ 2024-03-23T23:29:15.587 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 296881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-23T23:29:15.587 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/ocrdma/ 2024-03-23T23:29:15.588 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 153729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-03-23T23:29:15.588 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/usnic/ 2024-03-23T23:29:15.588 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 169145 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-03-23T23:29:15.588 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/ 2024-03-23T23:29:15.588 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/ipoib/ 2024-03-23T23:29:15.588 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 266577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-23T23:29:15.588 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/iser/ 2024-03-23T23:29:15.588 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 100281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-23T23:29:15.588 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/isert/ 2024-03-23T23:29:15.588 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 111337 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-23T23:29:15.588 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/srp/ 2024-03-23T23:29:15.588 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 128665 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-23T23:29:15.588 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/srpt/ 2024-03-23T23:29:15.589 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 129801 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-23T23:29:15.589 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/ 2024-03-23T23:29:15.589 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/evbug.ko 2024-03-23T23:29:15.589 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24033 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/ff-memless.ko 2024-03-23T23:29:15.589 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/gameport/ 2024-03-23T23:29:15.589 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11785 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-23T23:29:15.589 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-23T23:29:15.589 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 41457 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/gameport/gameport.ko 2024-03-23T23:29:15.589 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 41713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/joydev.ko 2024-03-23T23:29:15.589 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/ 2024-03-23T23:29:15.589 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-03-23T23:29:15.589 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12609 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-03-23T23:29:15.589 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-03-23T23:29:15.589 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24481 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-03-23T23:29:15.590 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 37281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-23T23:29:15.590 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18785 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-03-23T23:29:15.590 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/lkkbd.ko 2024-03-23T23:29:15.590 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/lm8323.ko 2024-03-23T23:29:15.590 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14321 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/lm8333.ko 2024-03-23T23:29:15.590 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-03-23T23:29:15.590 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18121 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-03-23T23:29:15.590 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-03-23T23:29:15.590 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-03-23T23:29:15.590 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/newtonkbd.ko 2024-03-23T23:29:15.590 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-03-23T23:29:15.590 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14073 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/qt1070.ko 2024-03-23T23:29:15.590 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/qt2160.ko 2024-03-23T23:29:15.590 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-03-23T23:29:15.591 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/stowaway.ko 2024-03-23T23:29:15.591 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/sunkbd.ko 2024-03-23T23:29:15.591 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17329 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-03-23T23:29:15.591 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-03-23T23:29:15.591 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-03-23T23:29:15.591 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11665 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/xtkbd.ko 2024-03-23T23:29:15.591 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11369 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/matrix-keymap.ko 2024-03-23T23:29:15.591 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/ 2024-03-23T23:29:15.591 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/appletouch.ko 2024-03-23T23:29:15.591 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34089 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/bcm5974.ko 2024-03-23T23:29:15.591 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 123201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/cyapatp.ko 2024-03-23T23:29:15.591 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 89393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-23T23:29:15.591 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/gpio_mouse.ko 2024-03-23T23:29:15.591 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 335921 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/psmouse.ko 2024-03-23T23:29:15.592 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14593 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/sermouse.ko 2024-03-23T23:29:15.592 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23785 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-23T23:29:15.592 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22473 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-23T23:29:15.592 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-23T23:29:15.592 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/rmi4/ 2024-03-23T23:29:15.592 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 109601 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-23T23:29:15.592 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/ 2024-03-23T23:29:15.592 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/altera_ps2.ko 2024-03-23T23:29:15.592 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/arc_ps2.ko 2024-03-23T23:29:15.592 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17689 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/ct82c710.ko 2024-03-23T23:29:15.592 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16857 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-23T23:29:15.592 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/parkbd.ko 2024-03-23T23:29:15.592 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/pcips2.ko 2024-03-23T23:29:15.593 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20073 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/ps2mult.ko 2024-03-23T23:29:15.593 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/serio_raw.ko 2024-03-23T23:29:15.593 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17889 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/serport.ko 2024-03-23T23:29:15.593 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13241 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/sparse-keymap.ko 2024-03-23T23:29:15.593 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/ 2024-03-23T23:29:15.593 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-88pm860x.ko 2024-03-23T23:29:15.593 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11289 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-adp5520.ko 2024-03-23T23:29:15.593 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 59657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-bd2802.ko 2024-03-23T23:29:15.593 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24689 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-blinkm.ko 2024-03-23T23:29:15.593 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-da903x.ko 2024-03-23T23:29:15.593 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12145 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-da9052.ko 2024-03-23T23:29:15.593 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16689 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-gpio.ko 2024-03-23T23:29:15.593 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15697 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-lm3530.ko 2024-03-23T23:29:15.593 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-lm3533.ko 2024-03-23T23:29:15.594 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19257 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-lm355x.ko 2024-03-23T23:29:15.594 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-lm3642.ko 2024-03-23T23:29:15.594 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16145 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-lp3944.ko 2024-03-23T23:29:15.594 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11145 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-lp8788.ko 2024-03-23T23:29:15.594 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-max8997.ko 2024-03-23T23:29:15.594 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-mc13783.ko 2024-03-23T23:29:15.594 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13289 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-menf21bmc.ko 2024-03-23T23:29:15.594 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-pca9532.ko 2024-03-23T23:29:15.594 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-pca955x.ko 2024-03-23T23:29:15.594 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17761 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-pca963x.ko 2024-03-23T23:29:15.594 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34337 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-ss4200.ko 2024-03-23T23:29:15.594 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23905 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-tca6507.ko 2024-03-23T23:29:15.594 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-wm831x-status.ko 2024-03-23T23:29:15.595 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11753 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-wm8350.ko 2024-03-23T23:29:15.595 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ 2024-03-23T23:29:15.595 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9889 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-23T23:29:15.595 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-23T23:29:15.595 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-23T23:29:15.595 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7521 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-23T23:29:15.595 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-23T23:29:15.595 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14145 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-23T23:29:15.595 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-23T23:29:15.595 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11793 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-23T23:29:15.595 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13969 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-23T23:29:15.595 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/ 2024-03-23T23:29:15.596 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/bcache/ 2024-03-23T23:29:15.596 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 647121 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/bcache/bcache.ko 2024-03-23T23:29:15.596 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 40489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-bio-prison.ko 2024-03-23T23:29:15.596 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 93321 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-bufio.ko 2024-03-23T23:29:15.596 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 47441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-cache-smq.ko 2024-03-23T23:29:15.596 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 155825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-cache.ko 2024-03-23T23:29:15.596 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 107937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-crypt.ko 2024-03-23T23:29:15.596 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-delay.ko 2024-03-23T23:29:15.596 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 53769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-era.ko 2024-03-23T23:29:15.596 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-flakey.ko 2024-03-23T23:29:15.596 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 41441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-log-userspace.ko 2024-03-23T23:29:15.596 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32649 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-log.ko 2024-03-23T23:29:15.596 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 49449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-mirror.ko 2024-03-23T23:29:15.596 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 77881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-multipath.ko 2024-03-23T23:29:15.597 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-queue-length.ko 2024-03-23T23:29:15.597 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 70985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-raid.ko 2024-03-23T23:29:15.597 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-region-hash.ko 2024-03-23T23:29:15.597 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15777 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-round-robin.ko 2024-03-23T23:29:15.597 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-service-time.ko 2024-03-23T23:29:15.597 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 109457 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-snapshot.ko 2024-03-23T23:29:15.597 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19265 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-switch.ko 2024-03-23T23:29:15.597 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 181777 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-thin-pool.ko 2024-03-23T23:29:15.597 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 53737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-verity.ko 2024-03-23T23:29:15.597 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8481 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-zero.ko 2024-03-23T23:29:15.597 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/persistent-data/ 2024-03-23T23:29:15.597 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 199881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-23T23:29:15.597 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 37321 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/raid0.ko 2024-03-23T23:29:15.598 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 100841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/raid1.ko 2024-03-23T23:29:15.598 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 126369 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/raid10.ko 2024-03-23T23:29:15.598 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 368497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/raid456.ko 2024-03-23T23:29:15.598 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/ 2024-03-23T23:29:15.598 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/ 2024-03-23T23:29:15.598 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 178049 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptbase.ko 2024-03-23T23:29:15.598 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 63241 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptctl.ko 2024-03-23T23:29:15.598 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 46249 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptfc.ko 2024-03-23T23:29:15.598 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 37121 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptlan.ko 2024-03-23T23:29:15.598 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 123233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptsas.ko 2024-03-23T23:29:15.598 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 80921 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptscsih.ko 2024-03-23T23:29:15.598 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 52865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptspi.ko 2024-03-23T23:29:15.598 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/ 2024-03-23T23:29:15.598 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/88pm800.ko 2024-03-23T23:29:15.599 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12673 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/88pm805.ko 2024-03-23T23:29:15.599 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11105 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/88pm80x.ko 2024-03-23T23:29:15.599 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/arizona-i2c.ko 2024-03-23T23:29:15.599 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 123649 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/arizona.ko 2024-03-23T23:29:15.599 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11873 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/bcm590xx.ko 2024-03-23T23:29:15.599 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17369 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/cros_ec_dev.ko 2024-03-23T23:29:15.599 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34849 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/dln2.ko 2024-03-23T23:29:15.599 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16593 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/janz-cmodio.ko 2024-03-23T23:29:15.599 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 53489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/kempld-core.ko 2024-03-23T23:29:15.599 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27433 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/lm3533-core.ko 2024-03-23T23:29:15.599 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-03-23T23:29:15.599 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12921 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/lp3943.ko 2024-03-23T23:29:15.599 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 56969 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/lpc_ich.ko 2024-03-23T23:29:15.599 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/lpc_sch.ko 2024-03-23T23:29:15.600 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17321 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/max8907.ko 2024-03-23T23:29:15.600 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29761 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/mc13xxx-core.ko 2024-03-23T23:29:15.600 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-03-23T23:29:15.600 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/menf21bmc.ko 2024-03-23T23:29:15.600 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/pcf50633-adc.ko 2024-03-23T23:29:15.600 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/pcf50633-gpio.ko 2024-03-23T23:29:15.600 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34793 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/pcf50633.ko 2024-03-23T23:29:15.600 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10001 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-03-23T23:29:15.600 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/retu-mfd.ko 2024-03-23T23:29:15.600 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 80345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/si476x-core.ko 2024-03-23T23:29:15.600 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 48369 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/sm501.ko 2024-03-23T23:29:15.600 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 51209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/tps65010.ko 2024-03-23T23:29:15.600 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10265 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/tps6507x.ko 2024-03-23T23:29:15.600 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/viperboard.ko 2024-03-23T23:29:15.601 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/vx855.ko 2024-03-23T23:29:15.601 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17857 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/wl1273-core.ko 2024-03-23T23:29:15.601 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 44265 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/wm8994.ko 2024-03-23T23:29:15.601 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/ 2024-03-23T23:29:15.601 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-03-23T23:29:15.601 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 48393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/ad525x_dpot.ko 2024-03-23T23:29:15.601 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/altera-stapl/ 2024-03-23T23:29:15.601 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 46513 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-23T23:29:15.601 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18297 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/apds9802als.ko 2024-03-23T23:29:15.601 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36641 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/apds990x.ko 2024-03-23T23:29:15.601 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 45497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/bh1770glc.ko 2024-03-23T23:29:15.601 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/c2port/ 2024-03-23T23:29:15.601 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11049 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-03-23T23:29:15.601 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/c2port/core.ko 2024-03-23T23:29:15.602 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/cb710/ 2024-03-23T23:29:15.602 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/cb710/cb710.ko 2024-03-23T23:29:15.602 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/ds1682.ko 2024-03-23T23:29:15.602 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8801 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/dummy-irq.ko 2024-03-23T23:29:15.602 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/echo/ 2024-03-23T23:29:15.602 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/echo/echo.ko 2024-03-23T23:29:15.602 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/eeprom/ 2024-03-23T23:29:15.602 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 39025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/eeprom/at24.ko 2024-03-23T23:29:15.602 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14673 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-23T23:29:15.602 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/eeprom/max6875.ko 2024-03-23T23:29:15.602 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32913 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/enclosure.ko 2024-03-23T23:29:15.602 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/genwqe/ 2024-03-23T23:29:15.602 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 152073 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-03-23T23:29:15.603 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14041 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/hmc6352.ko 2024-03-23T23:29:15.603 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/hpilo.ko 2024-03-23T23:29:15.603 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/ibmasm/ 2024-03-23T23:29:15.603 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 72561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-03-23T23:29:15.603 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19689 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/ics932s401.ko 2024-03-23T23:29:15.603 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21593 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/isl29003.ko 2024-03-23T23:29:15.603 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15665 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/isl29020.ko 2024-03-23T23:29:15.603 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/lis3lv02d/ 2024-03-23T23:29:15.603 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 42417 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-23T23:29:15.603 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-23T23:29:15.603 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/mei/ 2024-03-23T23:29:15.603 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 126153 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/mei/mei-me.ko 2024-03-23T23:29:15.603 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 56377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/mei/mei-txe.ko 2024-03-23T23:29:15.603 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 313601 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/mei/mei.ko 2024-03-23T23:29:15.603 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/phantom.ko 2024-03-23T23:29:15.604 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/ti-st/ 2024-03-23T23:29:15.604 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 74305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/ti-st/st_drv.ko 2024-03-23T23:29:15.604 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/tifm_7xx1.ko 2024-03-23T23:29:15.604 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28689 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/tifm_core.ko 2024-03-23T23:29:15.604 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18641 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/tsl2550.ko 2024-03-23T23:29:15.604 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 48345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/vmw_balloon.ko 2024-03-23T23:29:15.604 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/vmw_vmci/ 2024-03-23T23:29:15.604 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 183569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-23T23:29:15.604 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ 2024-03-23T23:29:15.604 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/bonding/ 2024-03-23T23:29:15.604 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 491609 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/bonding/bonding.ko 2024-03-23T23:29:15.604 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/ 2024-03-23T23:29:15.604 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/b53/ 2024-03-23T23:29:15.604 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 105937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-23T23:29:15.605 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 40225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-23T23:29:15.605 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-23T23:29:15.605 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/mv88e6xxx/ 2024-03-23T23:29:15.605 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 459001 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-23T23:29:15.605 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dummy.ko 2024-03-23T23:29:15.605 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/eql.ko 2024-03-23T23:29:15.605 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/ 2024-03-23T23:29:15.605 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com/ 2024-03-23T23:29:15.605 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 45961 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-23T23:29:15.605 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 42193 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-23T23:29:15.605 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 130665 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-23T23:29:15.605 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 68785 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-23T23:29:15.605 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390/ 2024-03-23T23:29:15.605 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 38049 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-23T23:29:15.606 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 64617 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-23T23:29:15.606 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27089 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-23T23:29:15.606 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 101617 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-23T23:29:15.606 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/adaptec/ 2024-03-23T23:29:15.606 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 54625 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-23T23:29:15.606 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/agere/ 2024-03-23T23:29:15.606 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 69169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-23T23:29:15.606 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/alteon/ 2024-03-23T23:29:15.606 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 59993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-23T23:29:15.606 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/altera/ 2024-03-23T23:29:15.606 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 41409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-23T23:29:15.606 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/amd/ 2024-03-23T23:29:15.606 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 54617 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-23T23:29:15.607 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 49193 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-23T23:29:15.607 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 87457 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-23T23:29:15.607 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/ 2024-03-23T23:29:15.607 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/alx/ 2024-03-23T23:29:15.607 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 97201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-23T23:29:15.607 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-03-23T23:29:15.607 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 102497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-23T23:29:15.607 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-03-23T23:29:15.607 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 90209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-23T23:29:15.607 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atlx/ 2024-03-23T23:29:15.607 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 81321 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-23T23:29:15.607 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 69545 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-23T23:29:15.607 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/ 2024-03-23T23:29:15.607 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 78385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-23T23:29:15.608 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 176697 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-23T23:29:15.608 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-03-23T23:29:15.608 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1434505 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-23T23:29:15.675 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 128369 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-23T23:29:15.675 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/genet/ 2024-03-23T23:29:15.675 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 131281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-23T23:29:15.675 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 314329 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-23T23:29:15.676 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/brocade/ 2024-03-23T23:29:15.676 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/brocade/bna/ 2024-03-23T23:29:15.676 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 323737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-23T23:29:15.676 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/ 2024-03-23T23:29:15.676 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-03-23T23:29:15.676 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 193593 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-23T23:29:15.676 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-03-23T23:29:15.676 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 347217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-23T23:29:15.676 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-03-23T23:29:15.676 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1045449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-23T23:29:15.676 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-03-23T23:29:15.676 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 166145 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-23T23:29:15.676 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-03-23T23:29:15.677 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-23T23:29:15.677 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/cisco/ 2024-03-23T23:29:15.677 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/cisco/enic/ 2024-03-23T23:29:15.677 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 204249 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-23T23:29:15.677 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/ 2024-03-23T23:29:15.677 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/ 2024-03-23T23:29:15.677 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 69433 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-23T23:29:15.677 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 61425 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-23T23:29:15.677 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 141201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-23T23:29:15.677 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 51369 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-23T23:29:15.677 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 62833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-23T23:29:15.677 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-23T23:29:15.677 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dlink/ 2024-03-23T23:29:15.678 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 60673 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-23T23:29:15.678 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 62833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-23T23:29:15.678 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 45489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dnet.ko 2024-03-23T23:29:15.678 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25097 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/ec_bhf.ko 2024-03-23T23:29:15.678 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/emulex/ 2024-03-23T23:29:15.678 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/emulex/benet/ 2024-03-23T23:29:15.678 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 281217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-23T23:29:15.678 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 49457 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/ethoc.ko 2024-03-23T23:29:15.678 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 51785 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/fealnx.ko 2024-03-23T23:29:15.678 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/fujitsu/ 2024-03-23T23:29:15.678 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 45553 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-03-23T23:29:15.678 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/ 2024-03-23T23:29:15.678 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 90305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-23T23:29:15.679 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e1000/ 2024-03-23T23:29:15.679 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 295697 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-23T23:29:15.679 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e1000e/ 2024-03-23T23:29:15.679 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 584353 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-23T23:29:15.679 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/fm10k/ 2024-03-23T23:29:15.679 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 246041 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-23T23:29:15.679 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/i40e/ 2024-03-23T23:29:15.679 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 944545 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-23T23:29:15.679 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/iavf/ 2024-03-23T23:29:15.679 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 288529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-23T23:29:15.679 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/igb/ 2024-03-23T23:29:15.679 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 513673 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-23T23:29:15.679 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/igbvf/ 2024-03-23T23:29:15.679 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 93489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-23T23:29:15.680 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-03-23T23:29:15.680 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 735169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-23T23:29:15.680 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-03-23T23:29:15.680 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 151745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-23T23:29:15.680 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 86993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/jme.ko 2024-03-23T23:29:15.680 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/marvell/ 2024-03-23T23:29:15.680 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21241 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-23T23:29:15.680 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 102441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-23T23:29:15.680 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 122609 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-23T23:29:15.680 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/ 2024-03-23T23:29:15.680 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-03-23T23:29:15.680 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 727481 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-23T23:29:15.680 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 278881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-23T23:29:15.681 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-03-23T23:29:15.681 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-03-23T23:29:15.681 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1122297 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-23T23:29:15.681 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/micrel/ 2024-03-23T23:29:15.681 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 52985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-03-23T23:29:15.681 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 40881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-03-23T23:29:15.681 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-03-23T23:29:15.681 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 95577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-23T23:29:15.681 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/myricom/ 2024-03-23T23:29:15.681 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-03-23T23:29:15.681 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 108409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-23T23:29:15.681 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/natsemi/ 2024-03-23T23:29:15.681 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 73617 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-23T23:29:15.682 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 47801 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-23T23:29:15.682 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/neterion/ 2024-03-23T23:29:15.682 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 151097 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-23T23:29:15.682 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/nvidia/ 2024-03-23T23:29:15.682 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 136801 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-23T23:29:15.682 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/packetengines/ 2024-03-23T23:29:15.682 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 50433 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-23T23:29:15.682 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 42985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-23T23:29:15.682 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/ 2024-03-23T23:29:15.682 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-03-23T23:29:15.682 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 227865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-23T23:29:15.683 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 87017 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-23T23:29:15.683 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-03-23T23:29:15.683 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 672057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-23T23:29:15.683 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/rdc/ 2024-03-23T23:29:15.683 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 42937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-23T23:29:15.683 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek/ 2024-03-23T23:29:15.683 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 67281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-23T23:29:15.683 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 83809 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-23T23:29:15.683 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29161 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-23T23:29:15.683 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 194073 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-23T23:29:15.683 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/samsung/ 2024-03-23T23:29:15.683 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-03-23T23:29:15.683 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 104049 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-03-23T23:29:15.683 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sfc/ 2024-03-23T23:29:15.684 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1067001 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-23T23:29:15.684 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/silan/ 2024-03-23T23:29:15.684 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 47009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-23T23:29:15.684 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sis/ 2024-03-23T23:29:15.684 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 54729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-23T23:29:15.684 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 63201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-23T23:29:15.684 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc/ 2024-03-23T23:29:15.684 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 61425 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-23T23:29:15.684 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 67297 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-23T23:29:15.684 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 73257 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-23T23:29:15.684 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 68049 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-23T23:29:15.684 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/stmicro/ 2024-03-23T23:29:15.684 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-03-23T23:29:15.684 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13033 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-03-23T23:29:15.685 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 39385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-23T23:29:15.685 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18457 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-03-23T23:29:15.685 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 495777 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-23T23:29:15.685 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun/ 2024-03-23T23:29:15.685 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 103185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-23T23:29:15.685 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 166049 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-23T23:29:15.685 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 66273 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-23T23:29:15.685 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 78721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-23T23:29:15.685 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/tehuti/ 2024-03-23T23:29:15.685 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 50017 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-23T23:29:15.685 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/ti/ 2024-03-23T23:29:15.685 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 92345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-23T23:29:15.685 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/via/ 2024-03-23T23:29:15.686 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 79937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-23T23:29:15.686 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 83721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-23T23:29:15.686 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/wiznet/ 2024-03-23T23:29:15.686 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 46313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-23T23:29:15.686 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-23T23:29:15.686 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/xircom/ 2024-03-23T23:29:15.686 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 59921 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-23T23:29:15.686 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/fddi/ 2024-03-23T23:29:15.686 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 41185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/fddi/defxx.ko 2024-03-23T23:29:15.686 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/fddi/skfp/ 2024-03-23T23:29:15.686 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 217113 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/fddi/skfp/skfp.ko 2024-03-23T23:29:15.686 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 74993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/geneve.ko 2024-03-23T23:29:15.687 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/hyperv/ 2024-03-23T23:29:15.687 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 237265 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-23T23:29:15.687 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ieee802154/ 2024-03-23T23:29:15.687 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-23T23:29:15.687 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ifb.ko 2024-03-23T23:29:15.687 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ipvlan/ 2024-03-23T23:29:15.687 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 85857 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-23T23:29:15.687 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 62897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/macvlan.ko 2024-03-23T23:29:15.687 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16161 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/macvtap.ko 2024-03-23T23:29:15.687 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio/ 2024-03-23T23:29:15.687 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21249 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-23T23:29:15.687 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-23T23:29:15.687 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio/mdio-gpio.ko 2024-03-23T23:29:15.687 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-23T23:29:15.688 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio.ko 2024-03-23T23:29:15.688 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20425 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mii.ko 2024-03-23T23:29:15.688 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 45057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/netconsole.ko 2024-03-23T23:29:15.688 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/nlmon.ko 2024-03-23T23:29:15.688 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/pcs/ 2024-03-23T23:29:15.688 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-23T23:29:15.688 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 39137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-23T23:29:15.688 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/ 2024-03-23T23:29:15.688 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10369 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/amd.ko 2024-03-23T23:29:15.688 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 49937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-23T23:29:15.688 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 44633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-23T23:29:15.688 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/bcm87xx.ko 2024-03-23T23:29:15.688 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 44825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/broadcom.ko 2024-03-23T23:29:15.688 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10545 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/cicada.ko 2024-03-23T23:29:15.689 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/davicom.ko 2024-03-23T23:29:15.689 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9369 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/et1011c.ko 2024-03-23T23:29:15.689 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/icplus.ko 2024-03-23T23:29:15.689 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/lxt.ko 2024-03-23T23:29:15.689 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 81961 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/marvell.ko 2024-03-23T23:29:15.689 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 76569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/micrel.ko 2024-03-23T23:29:15.689 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/national.ko 2024-03-23T23:29:15.689 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 99009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/phylink.ko 2024-03-23T23:29:15.689 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/qsemi.ko 2024-03-23T23:29:15.689 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 49977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/realtek.ko 2024-03-23T23:29:15.689 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30097 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/smsc.ko 2024-03-23T23:29:15.689 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10777 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/ste10Xp.ko 2024-03-23T23:29:15.689 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/vitesse.ko 2024-03-23T23:29:15.689 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/plip/ 2024-03-23T23:29:15.690 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 43769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/plip/plip.ko 2024-03-23T23:29:15.690 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ 2024-03-23T23:29:15.690 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15889 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-23T23:29:15.690 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_async.ko 2024-03-23T23:29:15.690 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17681 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-23T23:29:15.690 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-23T23:29:15.690 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28753 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-23T23:29:15.690 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 42673 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/pppoe.ko 2024-03-23T23:29:15.690 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13353 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/pppox.ko 2024-03-23T23:29:15.690 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32673 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/pptp.ko 2024-03-23T23:29:15.690 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/sb1000.ko 2024-03-23T23:29:15.690 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/slip/ 2024-03-23T23:29:15.690 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 42393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/slip/slip.ko 2024-03-23T23:29:15.691 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/sungem_phy.ko 2024-03-23T23:29:15.691 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 64561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/tap.ko 2024-03-23T23:29:15.691 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/ 2024-03-23T23:29:15.691 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 107233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team.ko 2024-03-23T23:29:15.691 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13457 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-23T23:29:15.691 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-23T23:29:15.691 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-23T23:29:15.691 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9617 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_random.ko 2024-03-23T23:29:15.691 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-23T23:29:15.691 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 86825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/veth.ko 2024-03-23T23:29:15.691 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/vmxnet3/ 2024-03-23T23:29:15.691 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 144361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-23T23:29:15.691 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/vxlan/ 2024-03-23T23:29:15.691 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 307193 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/vxlan/vxlan.ko 2024-03-23T23:29:15.692 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/xen-netback/ 2024-03-23T23:29:15.692 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 144017 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-23T23:29:15.692 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ntb/ 2024-03-23T23:29:15.692 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ntb/ntb.ko 2024-03-23T23:29:15.692 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/nvme/ 2024-03-23T23:29:15.692 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/nvme/host/ 2024-03-23T23:29:15.692 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 267745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/nvme/host/nvme-core.ko 2024-03-23T23:29:15.692 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 103361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/nvme/host/nvme.ko 2024-03-23T23:29:15.692 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport/ 2024-03-23T23:29:15.692 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 131329 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport/parport.ko 2024-03-23T23:29:15.692 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14465 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport/parport_cs.ko 2024-03-23T23:29:15.692 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 85217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport/parport_pc.ko 2024-03-23T23:29:15.692 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport/parport_serial.ko 2024-03-23T23:29:15.692 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/ 2024-03-23T23:29:15.693 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/hotplug/ 2024-03-23T23:29:15.693 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24913 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-23T23:29:15.693 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-03-23T23:29:15.693 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20297 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-03-23T23:29:15.693 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/pci-stub.ko 2024-03-23T23:29:15.693 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 46369 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/xen-pcifront.ko 2024-03-23T23:29:15.693 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia/ 2024-03-23T23:29:15.693 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia/i82092.ko 2024-03-23T23:29:15.693 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 146153 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia/pcmcia.ko 2024-03-23T23:29:15.693 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 62081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia/pcmcia_core.ko 2024-03-23T23:29:15.693 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34257 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-03-23T23:29:15.693 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34177 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia/pd6729.ko 2024-03-23T23:29:15.693 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 112793 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-23T23:29:15.693 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/phy/ 2024-03-23T23:29:15.694 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/phy/broadcom/ 2024-03-23T23:29:15.694 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-03-23T23:29:15.694 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/phy/samsung/ 2024-03-23T23:29:15.694 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-03-23T23:29:15.694 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pinctrl/ 2024-03-23T23:29:15.694 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pinctrl/intel/ 2024-03-23T23:29:15.694 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 69033 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-23T23:29:15.694 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/ 2024-03-23T23:29:15.694 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/chrome/ 2024-03-23T23:29:15.694 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 51233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-03-23T23:29:15.694 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24585 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/chrome/cros_ec.ko 2024-03-23T23:29:15.694 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21353 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-03-23T23:29:15.694 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-03-23T23:29:15.695 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26105 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-03-23T23:29:15.695 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-03-23T23:29:15.695 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17257 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-03-23T23:29:15.695 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/ 2024-03-23T23:29:15.695 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 73601 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-23T23:29:15.695 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 39057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/acerhdf.ko 2024-03-23T23:29:15.695 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-23T23:29:15.695 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 59569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-23T23:29:15.695 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-23T23:29:15.695 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 131945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-23T23:29:15.695 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36753 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-23T23:29:15.695 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 49025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-23T23:29:15.695 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-23T23:29:15.695 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 40169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-23T23:29:15.696 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22425 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-23T23:29:15.696 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36505 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/hdaps.ko 2024-03-23T23:29:15.696 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/ibm_rtl.ko 2024-03-23T23:29:15.696 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/intel/ 2024-03-23T23:29:15.696 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-23T23:29:15.696 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-03-23T23:29:15.696 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 44537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/intel_ips.ko 2024-03-23T23:29:15.696 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-23T23:29:15.696 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10289 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-23T23:29:15.696 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-23T23:29:15.696 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 42233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-23T23:29:15.696 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14073 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-23T23:29:15.696 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-23T23:29:15.696 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13617 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-23T23:29:15.697 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-23T23:29:15.697 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10049 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-23T23:29:15.697 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 48481 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/wmi.ko 2024-03-23T23:29:15.697 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/ 2024-03-23T23:29:15.697 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/ 2024-03-23T23:29:15.697 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/88pm860x_battery.ko 2024-03-23T23:29:15.697 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33889 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/88pm860x_charger.ko 2024-03-23T23:29:15.697 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 54961 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/bq2415x_charger.ko 2024-03-23T23:29:15.697 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 59505 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/bq24190_charger.ko 2024-03-23T23:29:15.697 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21457 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/bq24735-charger.ko 2024-03-23T23:29:15.697 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-03-23T23:29:15.697 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19513 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/da9030_battery.ko 2024-03-23T23:29:15.697 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/da9052-battery.ko 2024-03-23T23:29:15.697 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/ds2760_battery.ko 2024-03-23T23:29:15.698 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23121 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/ds2780_battery.ko 2024-03-23T23:29:15.698 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23257 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/ds2781_battery.ko 2024-03-23T23:29:15.698 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23553 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/ds2782_battery.ko 2024-03-23T23:29:15.698 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20257 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/gpio-charger.ko 2024-03-23T23:29:15.698 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/isp1704_charger.ko 2024-03-23T23:29:15.698 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20177 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/lp8727_charger.ko 2024-03-23T23:29:15.698 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12481 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/max14577_charger.ko 2024-03-23T23:29:15.698 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30193 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/max17042_battery.ko 2024-03-23T23:29:15.698 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/max8903_charger.ko 2024-03-23T23:29:15.698 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/max8925_power.ko 2024-03-23T23:29:15.698 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/pcf50633-charger.ko 2024-03-23T23:29:15.698 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 37841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/sbs-battery.ko 2024-03-23T23:29:15.698 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28289 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/test_power.ko 2024-03-23T23:29:15.699 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/tps65090-charger.ko 2024-03-23T23:29:15.699 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11873 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/wm831x_backup.ko 2024-03-23T23:29:15.699 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/wm831x_power.ko 2024-03-23T23:29:15.699 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22321 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/wm8350_power.ko 2024-03-23T23:29:15.699 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/powercap/ 2024-03-23T23:29:15.699 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 58105 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-23T23:29:15.699 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17625 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-23T23:29:15.699 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/ 2024-03-23T23:29:15.699 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/clients/ 2024-03-23T23:29:15.699 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15433 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-23T23:29:15.699 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13153 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-23T23:29:15.699 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16073 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/clients/pps_parport.ko 2024-03-23T23:29:15.699 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 41801 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/pps_core.ko 2024-03-23T23:29:15.699 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ptp/ 2024-03-23T23:29:15.699 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 70873 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ptp/ptp.ko 2024-03-23T23:29:15.700 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ptp/ptp_kvm.ko 2024-03-23T23:29:15.700 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/ 2024-03-23T23:29:15.700 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-88pm80x.ko 2024-03-23T23:29:15.700 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24425 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-88pm860x.ko 2024-03-23T23:29:15.700 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15297 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-23T23:29:15.700 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-da9052.ko 2024-03-23T23:29:15.700 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-da9055.ko 2024-03-23T23:29:15.700 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-da9063.ko 2024-03-23T23:29:15.700 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-23T23:29:15.700 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 68481 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-23T23:29:15.700 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-23T23:29:15.700 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18121 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-23T23:29:15.700 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16641 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-23T23:29:15.700 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13857 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-23T23:29:15.701 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13273 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-23T23:29:15.701 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14601 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-23T23:29:15.701 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23609 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-23T23:29:15.701 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-em3027.ko 2024-03-23T23:29:15.701 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-23T23:29:15.701 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-23T23:29:15.701 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35873 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-23T23:29:15.701 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-lp8788.ko 2024-03-23T23:29:15.701 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 38001 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-23T23:29:15.701 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-23T23:29:15.701 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25849 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-23T23:29:15.701 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-m48t86.ko 2024-03-23T23:29:15.701 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-max6900.ko 2024-03-23T23:29:15.701 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-max8907.ko 2024-03-23T23:29:15.702 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15249 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-max8925.ko 2024-03-23T23:29:15.702 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-max8997.ko 2024-03-23T23:29:15.702 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16585 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-max8998.ko 2024-03-23T23:29:15.702 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18417 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-03-23T23:29:15.702 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-23T23:29:15.702 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-palmas.ko 2024-03-23T23:29:15.702 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 46537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-23T23:29:15.702 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf50633.ko 2024-03-23T23:29:15.702 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-23T23:29:15.702 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-23T23:29:15.702 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-23T23:29:15.702 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-23T23:29:15.702 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rc5t583.ko 2024-03-23T23:29:15.703 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-23T23:29:15.703 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-23T23:29:15.703 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-23T23:29:15.703 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25161 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-23T23:29:15.703 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20017 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-23T23:29:15.703 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21521 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-s35390a.ko 2024-03-23T23:29:15.703 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-23T23:29:15.703 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17793 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-tps6586x.ko 2024-03-23T23:29:15.703 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21241 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-tps65910.ko 2024-03-23T23:29:15.703 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-wm831x.ko 2024-03-23T23:29:15.703 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-wm8350.ko 2024-03-23T23:29:15.703 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27777 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-x1205.ko 2024-03-23T23:29:15.703 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/ 2024-03-23T23:29:15.704 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 77529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/3w-9xxx.ko 2024-03-23T23:29:15.704 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 57721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/3w-sas.ko 2024-03-23T23:29:15.704 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 55017 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/3w-xxxx.ko 2024-03-23T23:29:15.704 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 135345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/BusLogic.ko 2024-03-23T23:29:15.704 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/a100u2w.ko 2024-03-23T23:29:15.704 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aacraid/ 2024-03-23T23:29:15.704 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 271441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-23T23:29:15.704 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 100473 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/advansys.ko 2024-03-23T23:29:15.704 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aic7xxx/ 2024-03-23T23:29:15.704 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 356865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-23T23:29:15.704 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 295929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-23T23:29:15.704 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aic94xx/ 2024-03-23T23:29:15.704 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 189145 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-03-23T23:29:15.704 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/am53c974.ko 2024-03-23T23:29:15.705 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/arcmsr/ 2024-03-23T23:29:15.705 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 108209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-23T23:29:15.705 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 38097 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/atp870u.ko 2024-03-23T23:29:15.705 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/be2iscsi/ 2024-03-23T23:29:15.705 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 246937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-23T23:29:15.705 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bfa/ 2024-03-23T23:29:15.705 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1171953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bfa/bfa.ko 2024-03-23T23:29:15.705 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bnx2fc/ 2024-03-23T23:29:15.705 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 238401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-23T23:29:15.705 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bnx2i/ 2024-03-23T23:29:15.705 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 115329 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-23T23:29:15.705 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 40785 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/ch.ko 2024-03-23T23:29:15.705 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/csiostor/ 2024-03-23T23:29:15.706 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 308961 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-23T23:29:15.706 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/ 2024-03-23T23:29:15.706 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-03-23T23:29:15.706 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 76041 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-23T23:29:15.706 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-03-23T23:29:15.706 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 101425 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-23T23:29:15.706 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 146753 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-23T23:29:15.706 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 75977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/dc395x.ko 2024-03-23T23:29:15.706 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 38209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/dmx3191d.ko 2024-03-23T23:29:15.706 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/esas2r/ 2024-03-23T23:29:15.706 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 212385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-23T23:29:15.706 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 60505 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/esp_scsi.ko 2024-03-23T23:29:15.706 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fcoe/ 2024-03-23T23:29:15.707 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 78225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-23T23:29:15.707 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 157729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-23T23:29:15.707 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18857 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fdomain.ko 2024-03-23T23:29:15.707 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fnic/ 2024-03-23T23:29:15.707 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 294953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fnic/fnic.ko 2024-03-23T23:29:15.707 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 201729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/hpsa.ko 2024-03-23T23:29:15.707 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 51121 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/hptiop.ko 2024-03-23T23:29:15.707 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 48945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/hv_storvsc.ko 2024-03-23T23:29:15.707 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36129 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/imm.ko 2024-03-23T23:29:15.707 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 43977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/initio.ko 2024-03-23T23:29:15.707 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 265945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/ipr.ko 2024-03-23T23:29:15.707 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 101881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/ips.ko 2024-03-23T23:29:15.707 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/isci/ 2024-03-23T23:29:15.707 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 317193 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/isci/isci.ko 2024-03-23T23:29:15.708 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26289 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-23T23:29:15.708 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 52865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-23T23:29:15.708 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libfc/ 2024-03-23T23:29:15.708 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 315321 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libfc/libfc.ko 2024-03-23T23:29:15.708 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 145497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libiscsi.ko 2024-03-23T23:29:15.708 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 53809 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-23T23:29:15.708 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libsas/ 2024-03-23T23:29:15.708 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 216401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libsas/libsas.ko 2024-03-23T23:29:15.708 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/lpfc/ 2024-03-23T23:29:15.708 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 2194089 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-23T23:29:15.708 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid/ 2024-03-23T23:29:15.708 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 73473 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-23T23:29:15.708 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33433 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-23T23:29:15.709 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 310689 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-23T23:29:15.709 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 85521 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid.ko 2024-03-23T23:29:15.709 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mpt3sas/ 2024-03-23T23:29:15.709 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 659633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-23T23:29:15.709 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mvsas/ 2024-03-23T23:29:15.709 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 119489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-23T23:29:15.709 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 78041 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mvumi.ko 2024-03-23T23:29:15.709 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/pcmcia/ 2024-03-23T23:29:15.709 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 81561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-03-23T23:29:15.709 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11617 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-03-23T23:29:15.709 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-03-23T23:29:15.709 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23761 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-03-23T23:29:15.709 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/pm8001/ 2024-03-23T23:29:15.709 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 366337 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-23T23:29:15.709 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 124601 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/pmcraid.ko 2024-03-23T23:29:15.710 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34425 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/ppa.ko 2024-03-23T23:29:15.710 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 55337 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla1280.ko 2024-03-23T23:29:15.710 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla2xxx/ 2024-03-23T23:29:15.710 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1876753 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-23T23:29:15.710 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 85193 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-23T23:29:15.710 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla4xxx/ 2024-03-23T23:29:15.710 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 558953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-23T23:29:15.710 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qlogicfas408.ko 2024-03-23T23:29:15.710 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/raid_class.ko 2024-03-23T23:29:15.710 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 261081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_debug.ko 2024-03-23T23:29:15.710 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 173929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-23T23:29:15.710 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 280113 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-23T23:29:15.710 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 97625 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-23T23:29:15.710 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 73865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-23T23:29:15.711 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 44889 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-23T23:29:15.711 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26161 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/ses.ko 2024-03-23T23:29:15.711 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 115649 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/st.ko 2024-03-23T23:29:15.711 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 46737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/stex.ko 2024-03-23T23:29:15.711 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/sym53c8xx_2/ 2024-03-23T23:29:15.711 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 164889 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-23T23:29:15.711 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 44857 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/virtio_scsi.ko 2024-03-23T23:29:15.711 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 50233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-23T23:29:15.711 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 39881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/wd719x.ko 2024-03-23T23:29:15.711 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 49929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/xen-scsifront.ko 2024-03-23T23:29:15.711 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ssb/ 2024-03-23T23:29:15.711 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 129393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ssb/ssb.ko 2024-03-23T23:29:15.711 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/ 2024-03-23T23:29:15.711 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/iscsi/ 2024-03-23T23:29:15.712 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 736761 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-23T23:29:15.712 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/loopback/ 2024-03-23T23:29:15.712 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 49881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-23T23:29:15.712 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 39617 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_file.ko 2024-03-23T23:29:15.712 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 42809 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_iblock.ko 2024-03-23T23:29:15.712 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 931521 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_mod.ko 2024-03-23T23:29:15.712 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 44153 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_pscsi.ko 2024-03-23T23:29:15.712 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 122489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_user.ko 2024-03-23T23:29:15.712 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/tcm_fc/ 2024-03-23T23:29:15.712 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 75521 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-23T23:29:15.712 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/ 2024-03-23T23:29:15.712 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/ 2024-03-23T23:29:15.712 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/ 2024-03-23T23:29:15.712 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-23T23:29:15.713 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-23T23:29:15.713 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9857 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-23T23:29:15.713 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-23T23:29:15.713 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14873 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-23T23:29:15.713 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16257 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-23T23:29:15.713 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30425 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-23T23:29:15.713 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-23T23:29:15.713 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-23T23:29:15.713 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-23T23:29:15.713 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10753 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-23T23:29:15.713 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-23T23:29:15.713 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36961 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-23T23:29:15.713 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14905 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-23T23:29:15.714 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11465 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-23T23:29:15.714 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30809 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-03-23T23:29:15.714 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-23T23:29:15.714 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11417 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-23T23:29:15.714 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-23T23:29:15.714 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/ 2024-03-23T23:29:15.714 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/ipwireless/ 2024-03-23T23:29:15.714 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 78353 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-23T23:29:15.714 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 57777 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/moxa.ko 2024-03-23T23:29:15.714 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 50865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/mxser.ko 2024-03-23T23:29:15.714 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 108489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/n_gsm.ko 2024-03-23T23:29:15.714 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31873 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/n_hdlc.ko 2024-03-23T23:29:15.714 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 67841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/nozomi.ko 2024-03-23T23:29:15.714 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/ 2024-03-23T23:29:15.715 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/8250/ 2024-03-23T23:29:15.715 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34793 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-03-23T23:29:15.715 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 59401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-23T23:29:15.715 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-03-23T23:29:15.715 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22481 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/altera_uart.ko 2024-03-23T23:29:15.715 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9337 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/arc_uart.ko 2024-03-23T23:29:15.715 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 72553 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-03-23T23:29:15.715 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/jsm/ 2024-03-23T23:29:15.715 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 101993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-23T23:29:15.715 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28697 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/rp2.ko 2024-03-23T23:29:15.715 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 53177 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/sc16is7xx.ko 2024-03-23T23:29:15.715 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs/ 2024-03-23T23:29:15.715 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs/core/ 2024-03-23T23:29:15.716 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 545401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-23T23:29:15.716 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs/host/ 2024-03-23T23:29:15.716 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-23T23:29:15.716 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14513 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-03-23T23:29:15.716 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/ 2024-03-23T23:29:15.716 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 44473 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio.ko 2024-03-23T23:29:15.716 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12153 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_aec.ko 2024-03-23T23:29:15.716 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_cif.ko 2024-03-23T23:29:15.716 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_dmem_genirq.ko 2024-03-23T23:29:15.716 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_mf624.ko 2024-03-23T23:29:15.716 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12089 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_netx.ko 2024-03-23T23:29:15.716 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10505 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_pci_generic.ko 2024-03-23T23:29:15.716 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15961 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-03-23T23:29:15.716 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13545 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_sercos3.ko 2024-03-23T23:29:15.717 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/ 2024-03-23T23:29:15.717 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/c67x00/ 2024-03-23T23:29:15.717 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 73225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/c67x00/c67x00.ko 2024-03-23T23:29:15.717 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/chipidea/ 2024-03-23T23:29:15.717 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 145793 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-03-23T23:29:15.717 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-03-23T23:29:15.717 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-03-23T23:29:15.717 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12617 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-03-23T23:29:15.717 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13121 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-03-23T23:29:15.717 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class/ 2024-03-23T23:29:15.717 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 87009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class/cdc-acm.ko 2024-03-23T23:29:15.717 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 51257 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-23T23:29:15.717 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 47217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class/usblp.ko 2024-03-23T23:29:15.717 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 89769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class/usbtmc.ko 2024-03-23T23:29:15.718 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/common/ 2024-03-23T23:29:15.718 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/common/ulpi.ko 2024-03-23T23:29:15.718 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/dwc2/ 2024-03-23T23:29:15.718 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-03-23T23:29:15.718 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/dwc3/ 2024-03-23T23:29:15.718 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-03-23T23:29:15.718 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-03-23T23:29:15.718 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 452825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/dwc3/dwc3.ko 2024-03-23T23:29:15.718 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/ 2024-03-23T23:29:15.718 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/ 2024-03-23T23:29:15.718 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 60329 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/u_ether.ko 2024-03-23T23:29:15.718 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 51793 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/u_serial.ko 2024-03-23T23:29:15.718 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-03-23T23:29:15.719 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 42353 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-03-23T23:29:15.719 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27857 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-03-23T23:29:15.719 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36417 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-03-23T23:29:15.719 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 92409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-03-23T23:29:15.719 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 50945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-03-23T23:29:15.719 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 122257 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-03-23T23:29:15.719 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 59865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-03-23T23:29:15.719 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22089 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-03-23T23:29:15.719 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-03-23T23:29:15.719 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 57633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-03-23T23:29:15.719 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 85521 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-03-23T23:29:15.719 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19177 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-03-23T23:29:15.719 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 58025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-03-23T23:29:15.719 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 67353 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-03-23T23:29:15.720 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/legacy/ 2024-03-23T23:29:15.720 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21177 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-03-23T23:29:15.720 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17969 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-03-23T23:29:15.720 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-03-23T23:29:15.720 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-03-23T23:29:15.720 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-03-23T23:29:15.720 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18921 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-03-23T23:29:15.720 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-03-23T23:29:15.720 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16889 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-03-23T23:29:15.720 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-03-23T23:29:15.720 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16697 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-03-23T23:29:15.720 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-03-23T23:29:15.720 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27113 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-03-23T23:29:15.720 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 62369 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-03-23T23:29:15.721 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15105 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-03-23T23:29:15.721 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 161233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/libcomposite.ko 2024-03-23T23:29:15.721 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/udc/ 2024-03-23T23:29:15.721 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17609 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-03-23T23:29:15.721 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/udc/bdc/ 2024-03-23T23:29:15.721 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 157617 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-03-23T23:29:15.721 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36001 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-03-23T23:29:15.721 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 52929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-03-23T23:29:15.721 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 69617 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-03-23T23:29:15.721 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 55953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-03-23T23:29:15.721 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 75969 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/udc/net2272.ko 2024-03-23T23:29:15.721 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 74985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/udc/net2280.ko 2024-03-23T23:29:15.721 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 73017 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-03-23T23:29:15.721 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 65881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-03-23T23:29:15.722 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 66001 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-03-23T23:29:15.722 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 81409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-03-23T23:29:15.722 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 156337 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-03-23T23:29:15.722 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/host/ 2024-03-23T23:29:15.722 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11505 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/host/bcma-hcd.ko 2024-03-23T23:29:15.722 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 80017 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/host/isp116x-hcd.ko 2024-03-23T23:29:15.722 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 87193 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-03-23T23:29:15.722 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 78777 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-03-23T23:29:15.722 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 51393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-23T23:29:15.722 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15505 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/host/sl811_cs.ko 2024-03-23T23:29:15.722 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/host/ssb-hcd.ko 2024-03-23T23:29:15.722 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26625 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-03-23T23:29:15.722 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/image/ 2024-03-23T23:29:15.723 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/image/mdc800.ko 2024-03-23T23:29:15.723 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/image/microtek.ko 2024-03-23T23:29:15.723 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/ 2024-03-23T23:29:15.723 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 41633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/adutux.ko 2024-03-23T23:29:15.723 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20617 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/appledisplay.ko 2024-03-23T23:29:15.723 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17625 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-03-23T23:29:15.723 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22961 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/cytherm.ko 2024-03-23T23:29:15.723 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13641 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/ehset.ko 2024-03-23T23:29:15.723 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14969 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/emi26.ko 2024-03-23T23:29:15.723 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/emi62.ko 2024-03-23T23:29:15.723 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/ezusb.ko 2024-03-23T23:29:15.723 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19145 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/idmouse.ko 2024-03-23T23:29:15.723 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36457 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/iowarrior.ko 2024-03-23T23:29:15.723 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-23T23:29:15.724 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/ldusb.ko 2024-03-23T23:29:15.724 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36105 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/legousbtower.ko 2024-03-23T23:29:15.724 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/lvstest.ko 2024-03-23T23:29:15.724 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/sisusbvga/ 2024-03-23T23:29:15.724 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 64745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-23T23:29:15.724 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-23T23:29:15.724 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/usb3503.ko 2024-03-23T23:29:15.724 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/usblcd.ko 2024-03-23T23:29:15.724 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-23T23:29:15.724 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 70721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/usbtest.ko 2024-03-23T23:29:15.724 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 41817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/uss720.ko 2024-03-23T23:29:15.724 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/yurex.ko 2024-03-23T23:29:15.724 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/mon/ 2024-03-23T23:29:15.725 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 72825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/mon/usbmon.ko 2024-03-23T23:29:15.725 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/musb/ 2024-03-23T23:29:15.725 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 301633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/musb/musb_hdrc.ko 2024-03-23T23:29:15.725 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/phy/ 2024-03-23T23:29:15.725 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20961 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/phy/phy-generic.ko 2024-03-23T23:29:15.725 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20073 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-03-23T23:29:15.725 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12161 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/phy/phy-isp1301.ko 2024-03-23T23:29:15.725 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21649 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/phy/phy-tahvo.ko 2024-03-23T23:29:15.725 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ 2024-03-23T23:29:15.725 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13121 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/aircable.ko 2024-03-23T23:29:15.725 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33241 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ark3116.ko 2024-03-23T23:29:15.725 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-23T23:29:15.725 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 38017 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ch341.ko 2024-03-23T23:29:15.725 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 70281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/cp210x.ko 2024-03-23T23:29:15.726 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30961 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/cyberjack.ko 2024-03-23T23:29:15.726 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 58121 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-23T23:29:15.726 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 49721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-23T23:29:15.726 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/empeg.ko 2024-03-23T23:29:15.726 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 44185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/f81232.ko 2024-03-23T23:29:15.726 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 175105 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-23T23:29:15.726 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 53017 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-23T23:29:15.726 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 136985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-23T23:29:15.726 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 124745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/io_ti.ko 2024-03-23T23:29:15.726 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 67681 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ipaq.ko 2024-03-23T23:29:15.726 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19073 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ipw.ko 2024-03-23T23:29:15.726 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26809 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ir-usb.ko 2024-03-23T23:29:15.726 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 58137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-23T23:29:15.726 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 107433 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/keyspan.ko 2024-03-23T23:29:15.727 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35521 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-23T23:29:15.727 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-23T23:29:15.727 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33593 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-23T23:29:15.727 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/mct_u232.ko 2024-03-23T23:29:15.727 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/metro-usb.ko 2024-03-23T23:29:15.727 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 66361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/mos7720.ko 2024-03-23T23:29:15.727 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 78129 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/mos7840.ko 2024-03-23T23:29:15.727 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 56249 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/mxuport.ko 2024-03-23T23:29:15.727 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/navman.ko 2024-03-23T23:29:15.727 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11921 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/omninet.ko 2024-03-23T23:29:15.727 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24545 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/opticon.ko 2024-03-23T23:29:15.727 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 191825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/option.ko 2024-03-23T23:29:15.727 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 38985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/oti6858.ko 2024-03-23T23:29:15.727 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 54265 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/pl2303.ko 2024-03-23T23:29:15.728 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9649 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/qcaux.ko 2024-03-23T23:29:15.728 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 38025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/qcserial.ko 2024-03-23T23:29:15.728 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/quatech2.ko 2024-03-23T23:29:15.728 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15297 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/safe_serial.ko 2024-03-23T23:29:15.728 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 51537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/sierra.ko 2024-03-23T23:29:15.728 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21585 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-23T23:29:15.728 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29905 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ssu100.ko 2024-03-23T23:29:15.728 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/symbolserial.ko 2024-03-23T23:29:15.728 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 61393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-23T23:29:15.728 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23625 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-23T23:29:15.728 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10145 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/usb_debug.ko 2024-03-23T23:29:15.728 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33113 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-23T23:29:15.728 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 125529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/usbserial.ko 2024-03-23T23:29:15.728 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28665 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/visor.ko 2024-03-23T23:29:15.729 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 37313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/whiteheat.ko 2024-03-23T23:29:15.729 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/wishbone-serial.ko 2024-03-23T23:29:15.729 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-23T23:29:15.729 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ 2024-03-23T23:29:15.729 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 52761 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/uas.ko 2024-03-23T23:29:15.729 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25857 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-23T23:29:15.729 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-23T23:29:15.729 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21889 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-23T23:29:15.729 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-23T23:29:15.729 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-23T23:29:15.729 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19521 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-23T23:29:15.729 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-23T23:29:15.729 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-karma.ko 2024-03-23T23:29:15.729 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-23T23:29:15.730 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-23T23:29:15.730 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28809 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-23T23:29:15.730 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19425 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-23T23:29:15.730 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35249 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-23T23:29:15.730 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 180329 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/usb-storage.ko 2024-03-23T23:29:15.730 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/usbip/ 2024-03-23T23:29:15.730 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 67401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-23T23:29:15.730 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 71025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-23T23:29:15.730 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 104065 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-23T23:29:15.730 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/ 2024-03-23T23:29:15.730 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/pci/ 2024-03-23T23:29:15.730 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 162865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-23T23:29:15.730 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-23T23:29:15.731 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 103673 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/vfio.ko 2024-03-23T23:29:15.731 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 76441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-23T23:29:15.731 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost/ 2024-03-23T23:29:15.731 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 113665 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost/vhost.ko 2024-03-23T23:29:15.731 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16913 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-23T23:29:15.731 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 58001 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost/vhost_net.ko 2024-03-23T23:29:15.731 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 89057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost/vhost_scsi.ko 2024-03-23T23:29:15.731 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/ 2024-03-23T23:29:15.731 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/ 2024-03-23T23:29:15.731 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15321 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-03-23T23:29:15.731 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12297 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/aat2870_bl.ko 2024-03-23T23:29:15.731 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/adp5520_bl.ko 2024-03-23T23:29:15.731 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32513 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/adp8860_bl.ko 2024-03-23T23:29:15.732 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 39897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/adp8870_bl.ko 2024-03-23T23:29:15.732 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/apple_bl.ko 2024-03-23T23:29:15.732 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16681 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/as3711_bl.ko 2024-03-23T23:29:15.732 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/bd6107.ko 2024-03-23T23:29:15.732 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/da903x_bl.ko 2024-03-23T23:29:15.732 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11177 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/da9052_bl.ko 2024-03-23T23:29:15.732 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/gpio_backlight.ko 2024-03-23T23:29:15.732 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14673 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/kb3886_bl.ko 2024-03-23T23:29:15.732 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/lcd.ko 2024-03-23T23:29:15.732 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/lm3533_bl.ko 2024-03-23T23:29:15.732 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19241 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/lm3639_bl.ko 2024-03-23T23:29:15.732 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11337 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/lv5207lp.ko 2024-03-23T23:29:15.732 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14249 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/max8925_bl.ko 2024-03-23T23:29:15.732 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/pandora_bl.ko 2024-03-23T23:29:15.733 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10761 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-03-23T23:29:15.733 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10801 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-23T23:29:15.733 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12625 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/wm831x_bl.ko 2024-03-23T23:29:15.733 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/ 2024-03-23T23:29:15.733 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/masters/ 2024-03-23T23:29:15.733 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18697 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/masters/ds2482.ko 2024-03-23T23:29:15.733 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 39121 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/masters/ds2490.ko 2024-03-23T23:29:15.733 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/masters/matrox_w1.ko 2024-03-23T23:29:15.733 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11273 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/masters/w1-gpio.ko 2024-03-23T23:29:15.733 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/ 2024-03-23T23:29:15.733 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-23T23:29:15.733 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22649 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-23T23:29:15.733 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15017 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-23T23:29:15.733 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-23T23:29:15.734 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-23T23:29:15.734 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-23T23:29:15.734 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-23T23:29:15.734 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-23T23:29:15.734 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-23T23:29:15.734 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7297 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-23T23:29:15.734 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 56337 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-23T23:29:15.734 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 103049 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/wire.ko 2024-03-23T23:29:15.734 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/ 2024-03-23T23:29:15.734 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/acquirewdt.ko 2024-03-23T23:29:15.734 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20545 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/advantechwdt.ko 2024-03-23T23:29:15.734 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18465 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-23T23:29:15.734 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22873 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-23T23:29:15.735 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/cpu5wdt.ko 2024-03-23T23:29:15.735 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13521 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/da9052_wdt.ko 2024-03-23T23:29:15.735 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12681 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/da9055_wdt.ko 2024-03-23T23:29:15.735 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/da9063_wdt.ko 2024-03-23T23:29:15.735 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/dw_wdt.ko 2024-03-23T23:29:15.735 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/eurotechwdt.ko 2024-03-23T23:29:15.735 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-23T23:29:15.735 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/hpwdt.ko 2024-03-23T23:29:15.735 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/i6300esb.ko 2024-03-23T23:29:15.735 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-23T23:29:15.735 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-23T23:29:15.735 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19641 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/ib700wdt.ko 2024-03-23T23:29:15.736 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18601 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/ibmasr.ko 2024-03-23T23:29:15.736 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19617 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-23T23:29:15.736 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21129 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-23T23:29:15.736 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14001 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/it87_wdt.ko 2024-03-23T23:29:15.736 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/kempld_wdt.ko 2024-03-23T23:29:15.736 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/machzwd.ko 2024-03-23T23:29:15.736 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14625 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/mena21_wdt.ko 2024-03-23T23:29:15.736 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13121 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-03-23T23:29:15.736 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24585 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/nv_tco.ko 2024-03-23T23:29:15.736 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-03-23T23:29:15.736 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/pc87413_wdt.ko 2024-03-23T23:29:15.736 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 39921 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-23T23:29:15.736 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-23T23:29:15.736 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/retu_wdt.ko 2024-03-23T23:29:15.737 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-03-23T23:29:15.737 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14033 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-03-23T23:29:15.737 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-23T23:29:15.737 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/sc1200wdt.ko 2024-03-23T23:29:15.737 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-23T23:29:15.737 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21481 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-03-23T23:29:15.737 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/softdog.ko 2024-03-23T23:29:15.737 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22177 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-23T23:29:15.737 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/twl4030_wdt.ko 2024-03-23T23:29:15.737 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/via_wdt.ko 2024-03-23T23:29:15.737 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20241 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-23T23:29:15.737 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-23T23:29:15.737 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-23T23:29:15.737 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19513 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/wafer5823wdt.ko 2024-03-23T23:29:15.738 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28001 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/wdt_pci.ko 2024-03-23T23:29:15.738 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16161 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/wm831x_wdt.ko 2024-03-23T23:29:15.738 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13689 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/wm8350_wdt.ko 2024-03-23T23:29:15.738 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15609 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/xen_wdt.ko 2024-03-23T23:29:15.738 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/ 2024-03-23T23:29:15.738 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-evtchn.ko 2024-03-23T23:29:15.738 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26673 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-gntalloc.ko 2024-03-23T23:29:15.738 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 47769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-gntdev.ko 2024-03-23T23:29:15.738 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-pciback/ 2024-03-23T23:29:15.738 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 176385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-23T23:29:15.738 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 40097 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-privcmd.ko 2024-03-23T23:29:15.738 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 71153 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-scsiback.ko 2024-03-23T23:29:15.738 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xenfs/ 2024-03-23T23:29:15.739 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-23T23:29:15.739 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ 2024-03-23T23:29:15.739 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/9p/ 2024-03-23T23:29:15.739 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 158281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/9p/9p.ko 2024-03-23T23:29:15.739 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/adfs/ 2024-03-23T23:29:15.739 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 61721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/adfs/adfs.ko 2024-03-23T23:29:15.739 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/affs/ 2024-03-23T23:29:15.739 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 163417 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/affs/affs.ko 2024-03-23T23:29:15.739 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/afs/ 2024-03-23T23:29:15.739 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1019225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/afs/kafs.ko 2024-03-23T23:29:15.739 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/autofs/ 2024-03-23T23:29:15.739 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 103225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/autofs/autofs4.ko 2024-03-23T23:29:15.739 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/befs/ 2024-03-23T23:29:15.739 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 64625 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/befs/befs.ko 2024-03-23T23:29:15.739 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/bfs/ 2024-03-23T23:29:15.740 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 41017 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/bfs/bfs.ko 2024-03-23T23:29:15.740 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 38649 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/binfmt_misc.ko 2024-03-23T23:29:15.740 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/btrfs/ 2024-03-23T23:29:15.740 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 3487553 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/btrfs/btrfs.ko 2024-03-23T23:29:15.740 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/cachefiles/ 2024-03-23T23:29:15.740 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 305897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/cachefiles/cachefiles.ko 2024-03-23T23:29:15.740 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ceph/ 2024-03-23T23:29:15.740 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1335721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ceph/ceph.ko 2024-03-23T23:29:15.740 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/coda/ 2024-03-23T23:29:15.740 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 97769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/coda/coda.ko 2024-03-23T23:29:15.740 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/configfs/ 2024-03-23T23:29:15.740 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 108577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/configfs/configfs.ko 2024-03-23T23:29:15.740 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/cramfs/ 2024-03-23T23:29:15.740 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29593 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/cramfs/cramfs.ko 2024-03-23T23:29:15.741 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/dlm/ 2024-03-23T23:29:15.741 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 644249 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/dlm/dlm.ko 2024-03-23T23:29:15.741 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/efs/ 2024-03-23T23:29:15.741 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/efs/efs.ko 2024-03-23T23:29:15.741 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/f2fs/ 2024-03-23T23:29:15.741 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1527665 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/f2fs/f2fs.ko 2024-03-23T23:29:15.741 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fat/ 2024-03-23T23:29:15.741 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fat/msdos.ko 2024-03-23T23:29:15.741 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/freevxfs/ 2024-03-23T23:29:15.741 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 42561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/freevxfs/freevxfs.ko 2024-03-23T23:29:15.741 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fuse/ 2024-03-23T23:29:15.741 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24297 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fuse/cuse.ko 2024-03-23T23:29:15.741 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/gfs2/ 2024-03-23T23:29:15.741 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1231361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/gfs2/gfs2.ko 2024-03-23T23:29:15.742 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/hfs/ 2024-03-23T23:29:15.742 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 141713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/hfs/hfs.ko 2024-03-23T23:29:15.742 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/hfsplus/ 2024-03-23T23:29:15.742 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 223281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/hfsplus/hfsplus.ko 2024-03-23T23:29:15.742 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/hpfs/ 2024-03-23T23:29:15.742 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 193545 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/hpfs/hpfs.ko 2024-03-23T23:29:15.787 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/isofs/ 2024-03-23T23:29:15.788 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 74737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/isofs/isofs.ko 2024-03-23T23:29:15.788 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/jfs/ 2024-03-23T23:29:15.788 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 420449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/jfs/jfs.ko 2024-03-23T23:29:15.788 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/lockd/ 2024-03-23T23:29:15.788 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 281705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/lockd/lockd.ko 2024-03-23T23:29:15.788 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/minix/ 2024-03-23T23:29:15.788 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 88937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/minix/minix.ko 2024-03-23T23:29:15.788 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/netfs/ 2024-03-23T23:29:15.788 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 490505 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/netfs/netfs.ko 2024-03-23T23:29:15.788 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/ 2024-03-23T23:29:15.788 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/blocklayout/ 2024-03-23T23:29:15.788 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 81457 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-23T23:29:15.789 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/filelayout/ 2024-03-23T23:29:15.789 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 59353 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-23T23:29:15.789 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/flexfilelayout/ 2024-03-23T23:29:15.789 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 117377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-23T23:29:15.789 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1058377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/nfs.ko 2024-03-23T23:29:15.789 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 66361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/nfsv2.ko 2024-03-23T23:29:15.789 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 120193 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/nfsv3.ko 2024-03-23T23:29:15.789 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 2041825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/nfsv4.ko 2024-03-23T23:29:15.789 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs_common/ 2024-03-23T23:29:15.789 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs_common/grace.ko 2024-03-23T23:29:15.789 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs_common/nfs_acl.ko 2024-03-23T23:29:15.789 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfsd/ 2024-03-23T23:29:15.789 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1511665 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfsd/nfsd.ko 2024-03-23T23:29:15.789 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nilfs2/ 2024-03-23T23:29:15.790 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 582529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nilfs2/nilfs2.ko 2024-03-23T23:29:15.790 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/ 2024-03-23T23:29:15.790 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13697 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-celtic.ko 2024-03-23T23:29:15.790 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13073 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-centeuro.ko 2024-03-23T23:29:15.790 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13697 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-croatian.ko 2024-03-23T23:29:15.790 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-cyrillic.ko 2024-03-23T23:29:15.790 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-gaelic.ko 2024-03-23T23:29:15.790 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12761 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-greek.ko 2024-03-23T23:29:15.790 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13697 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-iceland.ko 2024-03-23T23:29:15.790 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13073 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-inuit.ko 2024-03-23T23:29:15.790 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14001 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-roman.ko 2024-03-23T23:29:15.790 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13697 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-romanian.ko 2024-03-23T23:29:15.790 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13697 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-turkish.ko 2024-03-23T23:29:15.791 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_ascii.ko 2024-03-23T23:29:15.791 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp1250.ko 2024-03-23T23:29:15.791 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp1251.ko 2024-03-23T23:29:15.791 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp1255.ko 2024-03-23T23:29:15.791 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp737.ko 2024-03-23T23:29:15.791 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp775.ko 2024-03-23T23:29:15.791 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12129 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp850.ko 2024-03-23T23:29:15.791 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12129 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp852.ko 2024-03-23T23:29:15.791 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12129 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp855.ko 2024-03-23T23:29:15.791 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp857.ko 2024-03-23T23:29:15.791 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12753 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp860.ko 2024-03-23T23:29:15.791 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13065 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp861.ko 2024-03-23T23:29:15.791 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp862.ko 2024-03-23T23:29:15.792 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13065 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp863.ko 2024-03-23T23:29:15.792 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12753 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp864.ko 2024-03-23T23:29:15.792 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13065 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp865.ko 2024-03-23T23:29:15.792 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp866.ko 2024-03-23T23:29:15.792 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12129 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp869.ko 2024-03-23T23:29:15.792 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11889 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp874.ko 2024-03-23T23:29:15.792 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 94041 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp932.ko 2024-03-23T23:29:15.792 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 142577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp936.ko 2024-03-23T23:29:15.792 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 165649 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp949.ko 2024-03-23T23:29:15.792 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 118025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp950.ko 2024-03-23T23:29:15.792 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12369 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_euc-jp.ko 2024-03-23T23:29:15.792 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-1.ko 2024-03-23T23:29:15.792 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-13.ko 2024-03-23T23:29:15.793 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-14.ko 2024-03-23T23:29:15.793 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-15.ko 2024-03-23T23:29:15.793 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-2.ko 2024-03-23T23:29:15.793 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-3.ko 2024-03-23T23:29:15.793 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-4.ko 2024-03-23T23:29:15.793 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-5.ko 2024-03-23T23:29:15.793 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11521 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-6.ko 2024-03-23T23:29:15.793 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-7.ko 2024-03-23T23:29:15.793 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11521 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-9.ko 2024-03-23T23:29:15.793 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_koi8-r.ko 2024-03-23T23:29:15.793 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_koi8-ru.ko 2024-03-23T23:29:15.793 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_koi8-u.ko 2024-03-23T23:29:15.793 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7473 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-23T23:29:15.793 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8257 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_utf8.ko 2024-03-23T23:29:15.794 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ntfs/ 2024-03-23T23:29:15.794 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 220545 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ntfs/ntfs.ko 2024-03-23T23:29:15.794 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/ 2024-03-23T23:29:15.794 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/cluster/ 2024-03-23T23:29:15.794 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 244673 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-23T23:29:15.794 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/dlm/ 2024-03-23T23:29:15.794 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 440681 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-23T23:29:15.794 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/dlmfs/ 2024-03-23T23:29:15.794 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 54177 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-23T23:29:15.794 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 2590849 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/ocfs2.ko 2024-03-23T23:29:15.794 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-23T23:29:15.794 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-23T23:29:15.794 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-23T23:29:15.795 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/omfs/ 2024-03-23T23:29:15.795 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 53705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/omfs/omfs.ko 2024-03-23T23:29:15.795 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/overlayfs/ 2024-03-23T23:29:15.795 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 360953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/overlayfs/overlay.ko 2024-03-23T23:29:15.795 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/pstore/ 2024-03-23T23:29:15.795 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 56945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/pstore/ramoops.ko 2024-03-23T23:29:15.795 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/qnx4/ 2024-03-23T23:29:15.795 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26913 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/qnx4/qnx4.ko 2024-03-23T23:29:15.795 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/qnx6/ 2024-03-23T23:29:15.795 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 46625 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/qnx6/qnx6.ko 2024-03-23T23:29:15.795 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/quota/ 2024-03-23T23:29:15.795 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30785 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/quota/quota_tree.ko 2024-03-23T23:29:15.795 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/quota/quota_v1.ko 2024-03-23T23:29:15.795 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/quota/quota_v2.ko 2024-03-23T23:29:15.796 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/reiserfs/ 2024-03-23T23:29:15.796 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 532289 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/reiserfs/reiserfs.ko 2024-03-23T23:29:15.796 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/romfs/ 2024-03-23T23:29:15.796 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28905 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/romfs/romfs.ko 2024-03-23T23:29:15.796 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/ 2024-03-23T23:29:15.796 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/client/ 2024-03-23T23:29:15.796 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 2712601 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/client/cifs.ko 2024-03-23T23:29:15.796 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/common/ 2024-03-23T23:29:15.796 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7065 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/common/cifs_arc4.ko 2024-03-23T23:29:15.796 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/common/cifs_md4.ko 2024-03-23T23:29:15.796 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/squashfs/ 2024-03-23T23:29:15.796 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 134809 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/squashfs/squashfs.ko 2024-03-23T23:29:15.796 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/sysv/ 2024-03-23T23:29:15.796 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 91329 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/sysv/sysv.ko 2024-03-23T23:29:15.797 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/udf/ 2024-03-23T23:29:15.797 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 248409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/udf/udf.ko 2024-03-23T23:29:15.797 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ufs/ 2024-03-23T23:29:15.797 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 162785 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ufs/ufs.ko 2024-03-23T23:29:15.797 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/xfs/ 2024-03-23T23:29:15.797 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 4036193 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/xfs/xfs.ko 2024-03-23T23:29:15.797 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/ 2024-03-23T23:29:15.797 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/locking/ 2024-03-23T23:29:15.797 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 80489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/locking/locktorture.ko 2024-03-23T23:29:15.797 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/time/ 2024-03-23T23:29:15.797 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13641 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/time/test_udelay.ko 2024-03-23T23:29:15.797 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 60265 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/torture.ko 2024-03-23T23:29:15.797 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/ 2024-03-23T23:29:15.797 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 6737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crc-itu-t.ko 2024-03-23T23:29:15.798 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 6441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crc7.ko 2024-03-23T23:29:15.798 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 6937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crc8.ko 2024-03-23T23:29:15.798 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crypto/ 2024-03-23T23:29:15.798 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crypto/libarc4.ko 2024-03-23T23:29:15.798 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crypto/libdes.ko 2024-03-23T23:29:15.798 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/interval_tree_test.ko 2024-03-23T23:29:15.798 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8329 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/libcrc32c.ko 2024-03-23T23:29:15.798 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24857 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/lru_cache.ko 2024-03-23T23:29:15.798 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/lz4/ 2024-03-23T23:29:15.798 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/lz4/lz4_compress.ko 2024-03-23T23:29:15.798 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/lz4/lz4hc_compress.ko 2024-03-23T23:29:15.798 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/math/ 2024-03-23T23:29:15.798 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 6529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/math/cordic.ko 2024-03-23T23:29:15.798 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8121 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/memory-notifier-error-inject.ko 2024-03-23T23:29:15.799 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10761 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/notifier-error-inject.ko 2024-03-23T23:29:15.799 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/percpu_test.ko 2024-03-23T23:29:15.799 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/pm-notifier-error-inject.ko 2024-03-23T23:29:15.799 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/raid6/ 2024-03-23T23:29:15.799 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 143337 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/raid6/raid6_pq.ko 2024-03-23T23:29:15.799 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21017 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/rbtree_test.ko 2024-03-23T23:29:15.799 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/reed_solomon/ 2024-03-23T23:29:15.799 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-23T23:29:15.799 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 38745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/test-kstrtox.ko 2024-03-23T23:29:15.799 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/test-string_helpers.ko 2024-03-23T23:29:15.799 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 4863225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/test_bpf.ko 2024-03-23T23:29:15.799 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 48993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/test_firmware.ko 2024-03-23T23:29:15.800 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 6281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/test_module.ko 2024-03-23T23:29:15.800 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/test_user_copy.ko 2024-03-23T23:29:15.800 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/ts_bm.ko 2024-03-23T23:29:15.800 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11033 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/ts_fsm.ko 2024-03-23T23:29:15.800 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/ts_kmp.ko 2024-03-23T23:29:15.800 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/xz/ 2024-03-23T23:29:15.800 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/xz/xz_dec_test.ko 2024-03-23T23:29:15.800 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/mm/ 2024-03-23T23:29:15.800 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18129 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/mm/hwpoison-inject.ko 2024-03-23T23:29:15.800 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ 2024-03-23T23:29:15.800 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/ 2024-03-23T23:29:15.800 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 55777 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/6lowpan.ko 2024-03-23T23:29:15.800 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 6961 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_dest.ko 2024-03-23T23:29:15.800 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 6969 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_fragment.ko 2024-03-23T23:29:15.801 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 6961 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_hop.ko 2024-03-23T23:29:15.801 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 6897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-23T23:29:15.801 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 6969 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_mobility.ko 2024-03-23T23:29:15.801 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 6905 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_routing.ko 2024-03-23T23:29:15.801 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15241 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_udp.ko 2024-03-23T23:29:15.801 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/ 2024-03-23T23:29:15.801 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/garp.ko 2024-03-23T23:29:15.801 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34753 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/mrp.ko 2024-03-23T23:29:15.801 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/p8022.ko 2024-03-23T23:29:15.801 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/psnap.ko 2024-03-23T23:29:15.801 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/stp.ko 2024-03-23T23:29:15.801 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/8021q/ 2024-03-23T23:29:15.801 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 82897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/8021q/8021q.ko 2024-03-23T23:29:15.801 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p/ 2024-03-23T23:29:15.802 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 198833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p/9pnet.ko 2024-03-23T23:29:15.802 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36145 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p/9pnet_fd.ko 2024-03-23T23:29:15.802 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26249 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p/9pnet_rdma.ko 2024-03-23T23:29:15.802 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32249 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p/9pnet_virtio.ko 2024-03-23T23:29:15.802 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/batman-adv/ 2024-03-23T23:29:15.802 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 667545 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/batman-adv/batman-adv.ko 2024-03-23T23:29:15.802 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/ 2024-03-23T23:29:15.802 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 67769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/br_netfilter.ko 2024-03-23T23:29:15.802 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 790673 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/bridge.ko 2024-03-23T23:29:15.802 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ 2024-03-23T23:29:15.802 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-23T23:29:15.802 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12289 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-23T23:29:15.802 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-23T23:29:15.802 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-23T23:29:15.803 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-23T23:29:15.803 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8649 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-23T23:29:15.803 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-23T23:29:15.803 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-23T23:29:15.803 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13193 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-23T23:29:15.803 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-23T23:29:15.803 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-23T23:29:15.803 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8289 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-23T23:29:15.803 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-23T23:29:15.803 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-23T23:29:15.803 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-23T23:29:15.803 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-23T23:29:15.803 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-23T23:29:15.803 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11545 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-23T23:29:15.804 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-23T23:29:15.804 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-23T23:29:15.804 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 55945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebtables.ko 2024-03-23T23:29:15.804 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-23T23:29:15.804 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13849 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-23T23:29:15.804 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ceph/ 2024-03-23T23:29:15.804 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1046825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ceph/libceph.ko 2024-03-23T23:29:15.804 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/core/ 2024-03-23T23:29:15.804 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 125705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/core/pktgen.ko 2024-03-23T23:29:15.804 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp/ 2024-03-23T23:29:15.804 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 194505 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp/dccp.ko 2024-03-23T23:29:15.804 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp/dccp_diag.ko 2024-03-23T23:29:15.804 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 58745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp/dccp_ipv4.ko 2024-03-23T23:29:15.804 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 61401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp/dccp_ipv6.ko 2024-03-23T23:29:15.805 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/ 2024-03-23T23:29:15.805 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 390089 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/dsa_core.ko 2024-03-23T23:29:15.805 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/tag_brcm.ko 2024-03-23T23:29:15.805 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12601 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/tag_dsa.ko 2024-03-23T23:29:15.805 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/tag_none.ko 2024-03-23T23:29:15.805 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/tag_trailer.ko 2024-03-23T23:29:15.805 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/hsr/ 2024-03-23T23:29:15.805 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 102073 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/hsr/hsr.ko 2024-03-23T23:29:15.805 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154/ 2024-03-23T23:29:15.805 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154/6lowpan/ 2024-03-23T23:29:15.805 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 45505 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-23T23:29:15.805 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 284721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154/ieee802154.ko 2024-03-23T23:29:15.805 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 47881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-23T23:29:15.805 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ 2024-03-23T23:29:15.806 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24785 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ah4.ko 2024-03-23T23:29:15.806 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 39097 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/esp4.ko 2024-03-23T23:29:15.806 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 48249 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/fou.ko 2024-03-23T23:29:15.806 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18033 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/gre.ko 2024-03-23T23:29:15.806 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 51217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/inet_diag.ko 2024-03-23T23:29:15.806 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 61137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ip_gre.ko 2024-03-23T23:29:15.806 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 61513 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ip_tunnel.ko 2024-03-23T23:29:15.806 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ip_vti.ko 2024-03-23T23:29:15.806 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ipcomp.ko 2024-03-23T23:29:15.806 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ipip.ko 2024-03-23T23:29:15.806 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ 2024-03-23T23:29:15.806 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 38009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-23T23:29:15.806 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8777 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-23T23:29:15.807 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10321 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-23T23:29:15.807 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 42057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ip_tables.ko 2024-03-23T23:29:15.807 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9969 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-23T23:29:15.807 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9585 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-03-23T23:29:15.807 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-23T23:29:15.807 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11089 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-23T23:29:15.807 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14785 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-23T23:29:15.807 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-03-23T23:29:15.807 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-23T23:29:15.807 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-23T23:29:15.807 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-23T23:29:15.807 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10321 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-23T23:29:15.807 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-23T23:29:15.807 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-23T23:29:15.808 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-23T23:29:15.808 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-23T23:29:15.808 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13241 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-23T23:29:15.808 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21041 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-03-23T23:29:15.808 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-23T23:29:15.808 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-23T23:29:15.808 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-23T23:29:15.808 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17017 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-23T23:29:15.808 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8913 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-23T23:29:15.808 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_bic.ko 2024-03-23T23:29:15.808 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13649 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_dctcp.ko 2024-03-23T23:29:15.808 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15969 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_diag.ko 2024-03-23T23:29:15.808 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_highspeed.ko 2024-03-23T23:29:15.808 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_htcp.ko 2024-03-23T23:29:15.809 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10353 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_hybla.ko 2024-03-23T23:29:15.809 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_illinois.ko 2024-03-23T23:29:15.809 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_lp.ko 2024-03-23T23:29:15.809 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_scalable.ko 2024-03-23T23:29:15.809 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14329 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_vegas.ko 2024-03-23T23:29:15.809 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10001 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_veno.ko 2024-03-23T23:29:15.809 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10857 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_westwood.ko 2024-03-23T23:29:15.809 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10097 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_yeah.ko 2024-03-23T23:29:15.809 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tunnel4.ko 2024-03-23T23:29:15.809 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/udp_diag.ko 2024-03-23T23:29:15.809 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 45057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/udp_tunnel.ko 2024-03-23T23:29:15.809 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-23T23:29:15.809 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ 2024-03-23T23:29:15.809 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ah6.ko 2024-03-23T23:29:15.810 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 39729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/esp6.ko 2024-03-23T23:29:15.810 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/fou6.ko 2024-03-23T23:29:15.810 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 79929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ip6_gre.ko 2024-03-23T23:29:15.810 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 94169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ip6_tunnel.ko 2024-03-23T23:29:15.810 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14257 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-23T23:29:15.810 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 54273 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ip6_vti.ko 2024-03-23T23:29:15.810 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ipcomp6.ko 2024-03-23T23:29:15.810 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/mip6.ko 2024-03-23T23:29:15.810 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ 2024-03-23T23:29:15.810 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 42553 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-23T23:29:15.810 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11665 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-03-23T23:29:15.810 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-23T23:29:15.810 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14041 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-23T23:29:15.811 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-23T23:29:15.811 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-23T23:29:15.811 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16113 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-23T23:29:15.811 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-23T23:29:15.811 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-23T23:29:15.811 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9809 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-23T23:29:15.811 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-23T23:29:15.811 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10809 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-23T23:29:15.811 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-23T23:29:15.811 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11033 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-23T23:29:15.811 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-23T23:29:15.811 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-23T23:29:15.811 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10337 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-23T23:29:15.812 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 39137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-23T23:29:15.812 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8353 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-23T23:29:15.812 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25265 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-23T23:29:15.812 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-23T23:29:15.812 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15297 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-23T23:29:15.812 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-23T23:29:15.812 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-23T23:29:15.812 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8913 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-23T23:29:15.812 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 74881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/sit.ko 2024-03-23T23:29:15.812 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24153 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/tunnel6.ko 2024-03-23T23:29:15.812 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23297 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-23T23:29:15.812 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/key/ 2024-03-23T23:29:15.812 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 84401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/key/af_key.ko 2024-03-23T23:29:15.812 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/ 2024-03-23T23:29:15.812 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 125209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_core.ko 2024-03-23T23:29:15.813 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-23T23:29:15.813 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_eth.ko 2024-03-23T23:29:15.813 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_ip.ko 2024-03-23T23:29:15.813 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 37377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_ip6.ko 2024-03-23T23:29:15.813 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_netlink.ko 2024-03-23T23:29:15.813 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 53233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_ppp.ko 2024-03-23T23:29:15.813 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/lapb/ 2024-03-23T23:29:15.813 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 48121 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/lapb/lapb.ko 2024-03-23T23:29:15.813 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/llc/ 2024-03-23T23:29:15.813 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/llc/llc.ko 2024-03-23T23:29:15.813 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 268521 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/llc/llc2.ko 2024-03-23T23:29:15.813 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/mac802154/ 2024-03-23T23:29:15.813 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 309417 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/mac802154/mac802154.ko 2024-03-23T23:29:15.813 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/mpls/ 2024-03-23T23:29:15.814 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/mpls/mpls_gso.ko 2024-03-23T23:29:15.814 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ 2024-03-23T23:29:15.814 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ 2024-03-23T23:29:15.814 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 119705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set.ko 2024-03-23T23:29:15.814 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28617 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-23T23:29:15.814 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-23T23:29:15.814 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-23T23:29:15.814 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 99993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-23T23:29:15.814 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 100281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-23T23:29:15.814 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 102553 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-23T23:29:15.814 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 102345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-23T23:29:15.814 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 111673 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-23T23:29:15.814 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 59193 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-23T23:29:15.815 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 108345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-23T23:29:15.815 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 112145 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-23T23:29:15.815 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 112409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-23T23:29:15.815 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 110337 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-23T23:29:15.815 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 113289 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-23T23:29:15.815 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-23T23:29:15.815 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ 2024-03-23T23:29:15.815 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 412513 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-23T23:29:15.815 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-23T23:29:15.815 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-23T23:29:15.815 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17681 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-23T23:29:15.815 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-23T23:29:15.815 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-23T23:29:15.815 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-23T23:29:15.816 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-23T23:29:15.816 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10641 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-23T23:29:15.816 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9265 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-23T23:29:15.816 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-23T23:29:15.816 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13545 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-23T23:29:15.816 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-23T23:29:15.816 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-23T23:29:15.816 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 49169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conncount.ko 2024-03-23T23:29:15.816 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 411769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack.ko 2024-03-23T23:29:15.816 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-23T23:29:15.816 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10297 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-23T23:29:15.816 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33665 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-23T23:29:15.816 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 118161 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-23T23:29:15.817 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22089 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-23T23:29:15.817 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-23T23:29:15.817 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 108313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-23T23:29:15.817 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-23T23:29:15.817 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17297 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-23T23:29:15.817 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 66537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-23T23:29:15.817 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-23T23:29:15.817 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-23T23:29:15.817 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10017 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-23T23:29:15.817 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 92233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_flow_table.ko 2024-03-23T23:29:15.817 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9553 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-23T23:29:15.817 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 38081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_log_syslog.ko 2024-03-23T23:29:15.817 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 96521 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat.ko 2024-03-23T23:29:15.817 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10033 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-23T23:29:15.818 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-23T23:29:15.818 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11761 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_irc.ko 2024-03-23T23:29:15.818 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_sip.ko 2024-03-23T23:29:15.818 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-23T23:29:15.818 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 44137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-23T23:29:15.818 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 623473 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_tables.ko 2024-03-23T23:29:15.818 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 42513 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink.ko 2024-03-23T23:29:15.818 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30161 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-23T23:29:15.818 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30353 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-03-23T23:29:15.818 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 39561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink_log.ko 2024-03-23T23:29:15.818 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-23T23:29:15.818 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 49649 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-23T23:29:15.818 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10473 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_chain_nat.ko 2024-03-23T23:29:15.818 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_compat.ko 2024-03-23T23:29:15.819 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 40809 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_ct.ko 2024-03-23T23:29:15.819 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9505 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-23T23:29:15.819 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11425 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_fib.ko 2024-03-23T23:29:15.819 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-23T23:29:15.819 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14097 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_hash.ko 2024-03-23T23:29:15.819 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20033 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_limit.ko 2024-03-23T23:29:15.819 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_log.ko 2024-03-23T23:29:15.819 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_masq.ko 2024-03-23T23:29:15.819 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14329 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_nat.ko 2024-03-23T23:29:15.819 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_numgen.ko 2024-03-23T23:29:15.819 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11753 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_osf.ko 2024-03-23T23:29:15.819 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_queue.ko 2024-03-23T23:29:15.819 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14097 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_redir.ko 2024-03-23T23:29:15.820 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_reject.ko 2024-03-23T23:29:15.820 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_reject_inet.ko 2024-03-23T23:29:15.820 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_socket.ko 2024-03-23T23:29:15.820 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_synproxy.ko 2024-03-23T23:29:15.820 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_tproxy.ko 2024-03-23T23:29:15.820 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 89233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/x_tables.ko 2024-03-23T23:29:15.820 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_AUDIT.ko 2024-03-23T23:29:15.820 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-23T23:29:15.820 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-23T23:29:15.820 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-23T23:29:15.820 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_CT.ko 2024-03-23T23:29:15.820 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_DSCP.ko 2024-03-23T23:29:15.820 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_HL.ko 2024-03-23T23:29:15.820 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_HMARK.ko 2024-03-23T23:29:15.821 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 38777 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-23T23:29:15.821 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13801 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_LED.ko 2024-03-23T23:29:15.821 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_LOG.ko 2024-03-23T23:29:15.821 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-23T23:29:15.821 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_NETMAP.ko 2024-03-23T23:29:15.821 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_NFLOG.ko 2024-03-23T23:29:15.821 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13193 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-23T23:29:15.821 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_RATEEST.ko 2024-03-23T23:29:15.821 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-23T23:29:15.821 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14249 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_SECMARK.ko 2024-03-23T23:29:15.821 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-23T23:29:15.821 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10337 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-23T23:29:15.821 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TEE.ko 2024-03-23T23:29:15.822 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16697 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TPROXY.ko 2024-03-23T23:29:15.822 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TRACE.ko 2024-03-23T23:29:15.822 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13097 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_addrtype.ko 2024-03-23T23:29:15.822 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13809 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_bpf.ko 2024-03-23T23:29:15.822 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_cgroup.ko 2024-03-23T23:29:15.822 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11121 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_cluster.ko 2024-03-23T23:29:15.822 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_comment.ko 2024-03-23T23:29:15.822 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10369 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_connbytes.ko 2024-03-23T23:29:15.822 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11257 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_connlabel.ko 2024-03-23T23:29:15.822 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_connlimit.ko 2024-03-23T23:29:15.822 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13353 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_connmark.ko 2024-03-23T23:29:15.822 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_conntrack.ko 2024-03-23T23:29:15.822 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_cpu.ko 2024-03-23T23:29:15.822 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10889 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_dccp.ko 2024-03-23T23:29:15.823 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_devgroup.ko 2024-03-23T23:29:15.823 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_dscp.ko 2024-03-23T23:29:15.823 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_ecn.ko 2024-03-23T23:29:15.823 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_esp.ko 2024-03-23T23:29:15.823 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 43201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_hashlimit.ko 2024-03-23T23:29:15.823 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_helper.ko 2024-03-23T23:29:15.823 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7777 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_hl.ko 2024-03-23T23:29:15.823 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_ipcomp.ko 2024-03-23T23:29:15.823 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_iprange.ko 2024-03-23T23:29:15.823 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11697 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_ipvs.ko 2024-03-23T23:29:15.823 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_l2tp.ko 2024-03-23T23:29:15.823 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7905 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_length.ko 2024-03-23T23:29:15.823 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10121 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_limit.ko 2024-03-23T23:29:15.823 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7457 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_mac.ko 2024-03-23T23:29:15.824 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_mark.ko 2024-03-23T23:29:15.824 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_multiport.ko 2024-03-23T23:29:15.824 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_nat.ko 2024-03-23T23:29:15.824 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_nfacct.ko 2024-03-23T23:29:15.824 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_osf.ko 2024-03-23T23:29:15.824 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_owner.ko 2024-03-23T23:29:15.824 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10017 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_physdev.ko 2024-03-23T23:29:15.824 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_pkttype.ko 2024-03-23T23:29:15.824 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_policy.ko 2024-03-23T23:29:15.824 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_quota.ko 2024-03-23T23:29:15.824 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_rateest.ko 2024-03-23T23:29:15.824 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_realm.ko 2024-03-23T23:29:15.824 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_recent.ko 2024-03-23T23:29:15.824 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13241 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_sctp.ko 2024-03-23T23:29:15.825 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30001 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_set.ko 2024-03-23T23:29:15.825 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_socket.ko 2024-03-23T23:29:15.825 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9417 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_state.ko 2024-03-23T23:29:15.825 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_statistic.ko 2024-03-23T23:29:15.825 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_string.ko 2024-03-23T23:29:15.825 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8457 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_tcpmss.ko 2024-03-23T23:29:15.825 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15681 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_tcpudp.ko 2024-03-23T23:29:15.825 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_time.ko 2024-03-23T23:29:15.825 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_u32.ko 2024-03-23T23:29:15.825 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netlink/ 2024-03-23T23:29:15.825 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netlink/netlink_diag.ko 2024-03-23T23:29:15.825 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/nsh/ 2024-03-23T23:29:15.825 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12337 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/nsh/nsh.ko 2024-03-23T23:29:15.825 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch/ 2024-03-23T23:29:15.826 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 384201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch/openvswitch.ko 2024-03-23T23:29:15.826 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10369 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch/vport-geneve.ko 2024-03-23T23:29:15.826 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch/vport-gre.ko 2024-03-23T23:29:15.826 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch/vport-vxlan.ko 2024-03-23T23:29:15.826 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/packet/ 2024-03-23T23:29:15.826 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13473 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/packet/af_packet_diag.ko 2024-03-23T23:29:15.826 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/phonet/ 2024-03-23T23:29:15.826 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 112553 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/phonet/phonet.ko 2024-03-23T23:29:15.826 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 55057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/phonet/pn_pep.ko 2024-03-23T23:29:15.826 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/rds/ 2024-03-23T23:29:15.826 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 253961 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/rds/rds.ko 2024-03-23T23:29:15.826 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 165105 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/rds/rds_rdma.ko 2024-03-23T23:29:15.826 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 68097 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/rds/rds_tcp.ko 2024-03-23T23:29:15.827 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/rxrpc/ 2024-03-23T23:29:15.827 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 828297 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/rxrpc/rxrpc.ko 2024-03-23T23:29:15.827 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/ 2024-03-23T23:29:15.827 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32153 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_csum.ko 2024-03-23T23:29:15.827 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_gact.ko 2024-03-23T23:29:15.827 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 37089 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_mirred.ko 2024-03-23T23:29:15.827 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_nat.ko 2024-03-23T23:29:15.827 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 43353 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_pedit.ko 2024-03-23T23:29:15.827 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_police.ko 2024-03-23T23:29:15.827 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20193 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_simple.ko 2024-03-23T23:29:15.827 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_skbedit.ko 2024-03-23T23:29:15.827 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_vlan.ko 2024-03-23T23:29:15.827 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_basic.ko 2024-03-23T23:29:15.827 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33873 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_bpf.ko 2024-03-23T23:29:15.828 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_cgroup.ko 2024-03-23T23:29:15.828 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_flow.ko 2024-03-23T23:29:15.828 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_fw.ko 2024-03-23T23:29:15.828 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 39521 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_route.ko 2024-03-23T23:29:15.828 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 62657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_u32.ko 2024-03-23T23:29:15.828 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7465 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_cmp.ko 2024-03-23T23:29:15.828 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13321 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_ipset.ko 2024-03-23T23:29:15.828 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33425 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_meta.ko 2024-03-23T23:29:15.828 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7921 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_nbyte.ko 2024-03-23T23:29:15.828 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_text.ko 2024-03-23T23:29:15.828 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7273 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_u32.ko 2024-03-23T23:29:15.828 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21673 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_choke.ko 2024-03-23T23:29:15.828 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_codel.ko 2024-03-23T23:29:15.828 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34593 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_drr.ko 2024-03-23T23:29:15.829 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35793 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_fq.ko 2024-03-23T23:29:15.829 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31521 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_fq_codel.ko 2024-03-23T23:29:15.829 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35457 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_gred.ko 2024-03-23T23:29:15.829 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 49849 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_hfsc.ko 2024-03-23T23:29:15.829 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_hhf.ko 2024-03-23T23:29:15.829 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 66449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_htb.ko 2024-03-23T23:29:15.829 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26089 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_ingress.ko 2024-03-23T23:29:15.829 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_mqprio.ko 2024-03-23T23:29:15.829 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10809 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_mqprio_lib.ko 2024-03-23T23:29:15.829 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26089 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_multiq.ko 2024-03-23T23:29:15.829 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36153 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_netem.ko 2024-03-23T23:29:15.829 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_pie.ko 2024-03-23T23:29:15.829 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10665 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_plug.ko 2024-03-23T23:29:15.830 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24777 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_prio.ko 2024-03-23T23:29:15.830 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 48537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_qfq.ko 2024-03-23T23:29:15.830 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_red.ko 2024-03-23T23:29:15.830 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26793 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_sfb.ko 2024-03-23T23:29:15.830 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31321 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_sfq.ko 2024-03-23T23:29:15.830 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_tbf.ko 2024-03-23T23:29:15.830 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28273 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_teql.ko 2024-03-23T23:29:15.830 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sctp/ 2024-03-23T23:29:15.830 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 932945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sctp/sctp.ko 2024-03-23T23:29:15.830 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20249 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sctp/sctp_diag.ko 2024-03-23T23:29:15.830 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/ 2024-03-23T23:29:15.830 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/auth_gss/ 2024-03-23T23:29:15.830 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 337009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-23T23:29:15.830 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 55041 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-23T23:29:15.831 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1513905 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/sunrpc.ko 2024-03-23T23:29:15.831 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/xprtrdma/ 2024-03-23T23:29:15.831 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 704761 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-23T23:29:15.831 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/tipc/ 2024-03-23T23:29:15.831 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/tipc/diag.ko 2024-03-23T23:29:15.831 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 867249 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/tipc/tipc.ko 2024-03-23T23:29:15.831 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/unix/ 2024-03-23T23:29:15.831 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/unix/unix_diag.ko 2024-03-23T23:29:15.831 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/ 2024-03-23T23:29:15.831 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 87745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-23T23:29:15.831 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 67953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-23T23:29:15.831 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 98113 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vsock.ko 2024-03-23T23:29:15.831 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-23T23:29:15.831 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-23T23:29:15.832 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/x25/ 2024-03-23T23:29:15.832 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 131273 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/x25/x25.ko 2024-03-23T23:29:15.832 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/xfrm/ 2024-03-23T23:29:15.832 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23065 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/xfrm/xfrm_algo.ko 2024-03-23T23:29:15.832 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20553 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-23T23:29:15.832 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 105217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/xfrm/xfrm_user.ko 2024-03-23T23:29:15.832 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/virt/ 2024-03-23T23:29:15.832 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/virt/lib/ 2024-03-23T23:29:15.832 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/virt/lib/irqbypass.ko 2024-03-23T23:29:15.832 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 642383 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/modules.alias 2024-03-23T23:29:15.832 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 625850 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/modules.alias.bin 2024-03-23T23:29:15.832 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7677 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/modules.builtin 2024-03-23T23:29:15.832 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23498 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/modules.builtin.alias.bin 2024-03-23T23:29:15.832 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9916 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/modules.builtin.bin 2024-03-23T23:29:15.833 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 70732 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/modules.builtin.modinfo 2024-03-23T23:29:15.833 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 147214 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/modules.dep 2024-03-23T23:29:15.833 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 233213 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/modules.dep.bin 2024-03-23T23:29:15.833 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 210 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/modules.devname 2024-03-23T23:29:15.833 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 72614 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/modules.order 2024-03-23T23:29:15.833 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 879 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/modules.softdep 2024-03-23T23:29:15.833 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 257955 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/modules.symbols 2024-03-23T23:29:15.833 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 312782 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/modules.symbols.bin 2024-03-23T23:29:15.833 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./usr/ 2024-03-23T23:29:15.833 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./usr/share/ 2024-03-23T23:29:15.833 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./usr/share/doc/ 2024-03-23T23:29:15.833 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./usr/share/doc/linux-image-6.8.0-g5ec3e6e88b2e/ 2024-03-23T23:29:15.833 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 171 2024-03-19 20:13 ./usr/share/doc/linux-image-6.8.0-g5ec3e6e88b2e/changelog.Debian.gz 2024-03-23T23:29:15.834 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 691 2024-03-19 20:13 ./usr/share/doc/linux-image-6.8.0-g5ec3e6e88b2e/copyright 2024-03-23T23:29:15.839 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g5ec3e6e88b2e 2024-03-23T23:29:15.839 INFO:teuthology.task.kernel:searching for kernel 6.8.0-g5ec3e6e88b2e 2024-03-23T23:29:15.839 DEBUG:teuthology.orchestra.run.smithi196:> egrep '(submenu|menuentry.*6.8.0-g5ec3e6e88b2e).*{' /boot/grub/grub.cfg 2024-03-23T23:29:15.846 INFO:teuthology.orchestra.run.smithi196.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-03-23T23:29:15.846 INFO:teuthology.orchestra.run.smithi196.stdout: menuentry 'Ubuntu, with Linux 6.8.0-g5ec3e6e88b2e' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.8.0-g5ec3e6e88b2e-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-03-23T23:29:15.846 INFO:teuthology.orchestra.run.smithi196.stdout: menuentry 'Ubuntu, with Linux 6.8.0-g5ec3e6e88b2e (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.8.0-g5ec3e6e88b2e-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-03-23T23:29:15.846 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-03-23T23:29:15.847 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.8.0-g5ec3e6e88b2e 2024-03-23T23:29:15.847 DEBUG:teuthology.orchestra.run.smithi196:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-03-23T23:29:15.891 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi196.front.sepia.ceph.com to complete... 2024-03-23T23:29:16.311 INFO:teuthology.orchestra.run.smithi196.stderr:Sourcing file `/etc/default/grub' 2024-03-23T23:29:16.312 INFO:teuthology.orchestra.run.smithi196.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-23T23:29:16.334 INFO:teuthology.orchestra.run.smithi196.stderr:Generating grub configuration file ... 2024-03-23T23:29:16.503 INFO:teuthology.orchestra.run.smithi196.stderr:Found linux image: /boot/vmlinuz-6.8.0-g5ec3e6e88b2e 2024-03-23T23:29:16.508 INFO:teuthology.orchestra.run.smithi196.stderr:Found initrd image: /boot/initrd.img-6.8.0-g5ec3e6e88b2e 2024-03-23T23:29:16.758 INFO:teuthology.orchestra.run.smithi196.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-23T23:29:16.764 INFO:teuthology.orchestra.run.smithi196.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-23T23:29:16.807 INFO:teuthology.orchestra.run.smithi196.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-23T23:29:16.813 INFO:teuthology.orchestra.run.smithi196.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-23T23:29:16.938 INFO:teuthology.orchestra.run.smithi196.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-23T23:29:16.938 INFO:teuthology.orchestra.run.smithi196.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-03-23T23:29:16.938 INFO:teuthology.orchestra.run.smithi196.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-23T23:29:16.959 INFO:teuthology.orchestra.run.smithi196.stderr:done 2024-03-23T23:29:18.579 INFO:teuthology.orchestra.run.smithi008.stderr:Sourcing file `/etc/default/grub' 2024-03-23T23:29:18.596 INFO:teuthology.orchestra.run.smithi008.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-23T23:29:18.626 INFO:teuthology.orchestra.run.smithi008.stderr:Generating grub configuration file ... 2024-03-23T23:29:18.913 INFO:teuthology.orchestra.run.smithi008.stderr:Found linux image: /boot/vmlinuz-6.8.0-g5ec3e6e88b2e 2024-03-23T23:29:18.927 INFO:teuthology.orchestra.run.smithi008.stderr:Found initrd image: /boot/initrd.img-6.8.0-g5ec3e6e88b2e 2024-03-23T23:29:19.234 INFO:teuthology.orchestra.run.smithi008.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-23T23:29:19.242 INFO:teuthology.orchestra.run.smithi008.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-23T23:29:19.309 INFO:teuthology.orchestra.run.smithi008.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-23T23:29:19.315 INFO:teuthology.orchestra.run.smithi008.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-23T23:29:19.474 INFO:teuthology.orchestra.run.smithi008.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-23T23:29:19.474 INFO:teuthology.orchestra.run.smithi008.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-03-23T23:29:19.475 INFO:teuthology.orchestra.run.smithi008.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-23T23:29:19.513 INFO:teuthology.orchestra.run.smithi008.stderr:done 2024-03-23T23:29:19.695 DEBUG:teuthology.orchestra.run.smithi008:> dpkg-deb -c /tmp/linux-image.deb 2024-03-23T23:29:19.703 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./ 2024-03-23T23:29:19.703 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./boot/ 2024-03-23T23:29:19.703 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 4474370 2024-03-19 20:13 ./boot/System.map-6.8.0-g5ec3e6e88b2e 2024-03-23T23:29:19.714 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 170904 2024-03-19 20:13 ./boot/config-6.8.0-g5ec3e6e88b2e 2024-03-23T23:29:19.714 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11555840 2024-03-19 20:13 ./boot/vmlinuz-6.8.0-g5ec3e6e88b2e 2024-03-23T23:29:19.732 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./etc/ 2024-03-23T23:29:19.732 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./etc/kernel/ 2024-03-23T23:29:19.732 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./etc/kernel/postinst.d/ 2024-03-23T23:29:19.732 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./etc/kernel/postrm.d/ 2024-03-23T23:29:19.733 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./etc/kernel/preinst.d/ 2024-03-23T23:29:19.733 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./etc/kernel/prerm.d/ 2024-03-23T23:29:19.733 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/ 2024-03-23T23:29:19.733 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/ 2024-03-23T23:29:19.733 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/ 2024-03-23T23:29:19.733 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/ 2024-03-23T23:29:19.733 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/ 2024-03-23T23:29:19.733 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/ 2024-03-23T23:29:19.733 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/ 2024-03-23T23:29:19.733 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 490449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/aesni-intel.ko 2024-03-23T23:29:19.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 25297 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-23T23:29:19.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 29417 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-23T23:29:19.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 30209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-23T23:29:19.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 93081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-23T23:29:19.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 106697 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-23T23:29:19.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 152145 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-23T23:29:19.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12457 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-23T23:29:19.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13681 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-23T23:29:19.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 83857 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-23T23:29:19.738 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18649 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-23T23:29:19.738 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 47185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-23T23:29:19.738 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 47177 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-23T23:29:19.738 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 51697 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-23T23:29:19.738 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 39601 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-23T23:29:19.738 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 42537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-23T23:29:19.738 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 58489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-23T23:29:19.738 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 50393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-23T23:29:19.738 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 31961 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-23T23:29:19.738 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-23T23:29:19.738 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kernel/ 2024-03-23T23:29:19.738 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kernel/cpu/ 2024-03-23T23:29:19.738 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kernel/cpu/mce/ 2024-03-23T23:29:19.739 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 41433 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-23T23:29:19.739 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13593 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kernel/cpuid.ko 2024-03-23T23:29:19.739 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17849 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kernel/msr.ko 2024-03-23T23:29:19.739 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kvm/ 2024-03-23T23:29:19.739 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 354265 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-23T23:29:19.739 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 886177 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-23T23:29:19.739 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 2294937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kvm/kvm.ko 2024-03-23T23:29:19.806 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/ 2024-03-23T23:29:19.806 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 53841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/af_alg.ko 2024-03-23T23:29:19.806 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/algif_hash.ko 2024-03-23T23:29:19.806 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21593 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/algif_skcipher.ko 2024-03-23T23:29:19.806 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17113 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/ansi_cprng.ko 2024-03-23T23:29:19.806 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19553 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/anubis.ko 2024-03-23T23:29:19.806 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9585 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/arc4.ko 2024-03-23T23:29:19.806 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/asymmetric_keys/ 2024-03-23T23:29:19.806 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10089 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-03-23T23:29:19.807 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/ 2024-03-23T23:29:19.807 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11153 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_memcpy.ko 2024-03-23T23:29:19.807 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_pq.ko 2024-03-23T23:29:19.807 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21457 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-23T23:29:19.807 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_tx.ko 2024-03-23T23:29:19.807 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_xor.ko 2024-03-23T23:29:19.807 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/raid6test.ko 2024-03-23T23:29:19.807 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20337 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/authenc.ko 2024-03-23T23:29:19.807 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 22353 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/authencesn.ko 2024-03-23T23:29:19.807 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/blake2b_generic.ko 2024-03-23T23:29:19.807 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/blowfish_common.ko 2024-03-23T23:29:19.807 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/blowfish_generic.ko 2024-03-23T23:29:19.807 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 38713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/camellia_generic.ko 2024-03-23T23:29:19.808 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 27233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cast5_generic.ko 2024-03-23T23:29:19.808 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cast6_generic.ko 2024-03-23T23:29:19.808 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cast_common.ko 2024-03-23T23:29:19.808 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 35185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/ccm.ko 2024-03-23T23:29:19.808 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cmac.ko 2024-03-23T23:29:19.808 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/crc32_generic.ko 2024-03-23T23:29:19.808 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 47681 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cryptd.ko 2024-03-23T23:29:19.808 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 39473 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/crypto_engine.ko 2024-03-23T23:29:19.808 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26921 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/crypto_simd.ko 2024-03-23T23:29:19.808 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 24945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/crypto_user.ko 2024-03-23T23:29:19.808 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17649 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cts.ko 2024-03-23T23:29:19.808 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/des_generic.ko 2024-03-23T23:29:19.808 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15593 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/dh_generic.ko 2024-03-23T23:29:19.809 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10913 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/echainiv.ko 2024-03-23T23:29:19.809 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 25241 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/essiv.ko 2024-03-23T23:29:19.809 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17905 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/fcrypt.ko 2024-03-23T23:29:19.809 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26809 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/khazad.ko 2024-03-23T23:29:19.809 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/lrw.ko 2024-03-23T23:29:19.809 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11425 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/lz4.ko 2024-03-23T23:29:19.809 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/lz4hc.ko 2024-03-23T23:29:19.809 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11609 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/md4.ko 2024-03-23T23:29:19.809 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/michael_mic.ko 2024-03-23T23:29:19.809 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10585 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/pcbc.ko 2024-03-23T23:29:19.809 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/pcrypt.ko 2024-03-23T23:29:19.810 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15961 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/rmd160.ko 2024-03-23T23:29:19.810 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 29305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/seed.ko 2024-03-23T23:29:19.810 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/serpent_generic.ko 2024-03-23T23:29:19.810 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 143033 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/tcrypt.ko 2024-03-23T23:29:19.810 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10793 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/tea.ko 2024-03-23T23:29:19.810 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 28681 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/twofish_common.ko 2024-03-23T23:29:19.810 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13073 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/twofish_generic.ko 2024-03-23T23:29:19.810 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/vmac.ko 2024-03-23T23:29:19.810 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 36097 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/wp512.ko 2024-03-23T23:29:19.811 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/xcbc.ko 2024-03-23T23:29:19.811 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/xor.ko 2024-03-23T23:29:19.811 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/xts.ko 2024-03-23T23:29:19.811 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/xxhash_generic.ko 2024-03-23T23:29:19.811 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ 2024-03-23T23:29:19.811 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/ 2024-03-23T23:29:19.811 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18473 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/acpi_extlog.ko 2024-03-23T23:29:19.811 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26889 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-23T23:29:19.811 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 28153 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/acpi_pad.ko 2024-03-23T23:29:19.811 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/apei/ 2024-03-23T23:29:19.811 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 31969 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/apei/einj.ko 2024-03-23T23:29:19.811 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/ec_sys.ko 2024-03-23T23:29:19.811 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/platform_profile.ko 2024-03-23T23:29:19.812 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 24313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/sbs.ko 2024-03-23T23:29:19.812 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19433 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/sbshc.ko 2024-03-23T23:29:19.812 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 104433 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/video.ko 2024-03-23T23:29:19.812 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/ 2024-03-23T23:29:19.812 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21505 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/acard-ahci.ko 2024-03-23T23:29:19.812 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 89937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/ahci.ko 2024-03-23T23:29:19.812 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/ahci_platform.ko 2024-03-23T23:29:19.812 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 88313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/libahci.ko 2024-03-23T23:29:19.812 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 34889 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/libahci_platform.ko 2024-03-23T23:29:19.812 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17041 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_acpi.ko 2024-03-23T23:29:19.812 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 30345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_ali.ko 2024-03-23T23:29:19.812 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 33417 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_amd.ko 2024-03-23T23:29:19.813 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_artop.ko 2024-03-23T23:29:19.813 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_atiixp.ko 2024-03-23T23:29:19.813 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 24849 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_atp867x.ko 2024-03-23T23:29:19.813 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_cmd640.ko 2024-03-23T23:29:19.813 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 25089 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_cmd64x.ko 2024-03-23T23:29:19.813 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_cypress.ko 2024-03-23T23:29:19.813 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17753 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_efar.ko 2024-03-23T23:29:19.813 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21849 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_hpt366.ko 2024-03-23T23:29:19.813 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 33881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_hpt37x.ko 2024-03-23T23:29:19.813 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23033 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-23T23:29:19.813 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-23T23:29:19.814 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_it8213.ko 2024-03-23T23:29:19.814 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 35177 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_it821x.ko 2024-03-23T23:29:19.814 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12793 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_jmicron.ko 2024-03-23T23:29:19.814 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 52177 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_legacy.ko 2024-03-23T23:29:19.814 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15089 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_marvell.ko 2024-03-23T23:29:19.814 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_mpiix.ko 2024-03-23T23:29:19.814 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_netcell.ko 2024-03-23T23:29:19.814 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_ninja32.ko 2024-03-23T23:29:19.814 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_ns87410.ko 2024-03-23T23:29:19.815 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17265 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_ns87415.ko 2024-03-23T23:29:19.815 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16473 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_oldpiix.ko 2024-03-23T23:29:19.815 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_opti.ko 2024-03-23T23:29:19.815 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20585 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_optidma.ko 2024-03-23T23:29:19.815 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 32489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_pcmcia.ko 2024-03-23T23:29:19.815 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 37697 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-23T23:29:19.815 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20457 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-23T23:29:19.815 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14129 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_piccolo.ko 2024-03-23T23:29:19.815 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15353 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_radisys.ko 2024-03-23T23:29:19.815 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19433 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_rdc.ko 2024-03-23T23:29:19.815 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_rz1000.ko 2024-03-23T23:29:19.815 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13785 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_sch.ko 2024-03-23T23:29:19.815 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23001 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_serverworks.ko 2024-03-23T23:29:19.815 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_sil680.ko 2024-03-23T23:29:19.816 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19601 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_sl82c105.ko 2024-03-23T23:29:19.816 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15913 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_triflex.ko 2024-03-23T23:29:19.816 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 30345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_via.ko 2024-03-23T23:29:19.816 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 22705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pdc_adma.ko 2024-03-23T23:29:19.816 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 29025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_inic162x.ko 2024-03-23T23:29:19.816 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 83257 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_mv.ko 2024-03-23T23:29:19.816 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 70305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_nv.ko 2024-03-23T23:29:19.816 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 37281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_promise.ko 2024-03-23T23:29:19.816 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 22945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_qstor.ko 2024-03-23T23:29:19.816 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 29185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_sil.ko 2024-03-23T23:29:19.816 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 38177 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_sil24.ko 2024-03-23T23:29:19.816 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17857 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_sis.ko 2024-03-23T23:29:19.816 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20353 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_svw.ko 2024-03-23T23:29:19.816 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 44705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_sx4.ko 2024-03-23T23:29:19.817 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_uli.ko 2024-03-23T23:29:19.817 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 34977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_via.ko 2024-03-23T23:29:19.817 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_vsc.ko 2024-03-23T23:29:19.817 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/auxdisplay/ 2024-03-23T23:29:19.817 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/auxdisplay/ks0108.ko 2024-03-23T23:29:19.817 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/bcma/ 2024-03-23T23:29:19.817 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 124457 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/bcma/bcma.ko 2024-03-23T23:29:19.817 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/ 2024-03-23T23:29:19.817 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/aoe/ 2024-03-23T23:29:19.817 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 113833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/aoe/aoe.ko 2024-03-23T23:29:19.817 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/drbd/ 2024-03-23T23:29:19.817 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 964817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/drbd/drbd.ko 2024-03-23T23:29:19.817 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 169705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/floppy.ko 2024-03-23T23:29:19.818 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/mtip32xx/ 2024-03-23T23:29:19.818 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 94217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-23T23:29:19.818 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 116337 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/nbd.ko 2024-03-23T23:29:19.818 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/null_blk/ 2024-03-23T23:29:19.818 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 110329 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/null_blk/null_blk.ko 2024-03-23T23:29:19.818 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 98193 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/pktcdvd.ko 2024-03-23T23:29:19.818 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 263641 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/rbd.ko 2024-03-23T23:29:19.818 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/xen-blkback/ 2024-03-23T23:29:19.818 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 98121 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-23T23:29:19.818 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/zram/ 2024-03-23T23:29:19.818 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 58777 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/zram/zram.ko 2024-03-23T23:29:19.818 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ 2024-03-23T23:29:19.818 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 30681 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/applicom.ko 2024-03-23T23:29:19.819 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11913 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hangcheck-timer.ko 2024-03-23T23:29:19.819 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/ 2024-03-23T23:29:19.819 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13801 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-23T23:29:19.819 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-23T23:29:19.819 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13073 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-23T23:29:19.819 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11073 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/via-rng.ko 2024-03-23T23:29:19.819 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-23T23:29:19.819 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ 2024-03-23T23:29:19.819 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 30617 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-23T23:29:19.819 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 148521 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-23T23:29:19.819 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-23T23:29:19.819 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 139361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-23T23:29:19.819 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 70873 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-23T23:29:19.819 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 53417 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-23T23:29:19.820 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 36233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/lp.ko 2024-03-23T23:29:19.820 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/mwave/ 2024-03-23T23:29:19.820 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 84025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/mwave/mwave.ko 2024-03-23T23:29:19.820 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 25785 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/nvram.ko 2024-03-23T23:29:19.820 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 32081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ppdev.ko 2024-03-23T23:29:19.820 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 51025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tlclk.ko 2024-03-23T23:29:19.820 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/ 2024-03-23T23:29:19.820 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-23T23:29:19.820 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15785 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-03-23T23:29:19.820 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-03-23T23:29:19.820 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 32769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-03-23T23:29:19.820 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 30025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-23T23:29:19.820 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 22609 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-23T23:29:19.821 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23465 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-03-23T23:29:19.821 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/xillybus/ 2024-03-23T23:29:19.821 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16905 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/xillybus/xillybus_class.ko 2024-03-23T23:29:19.821 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 50849 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/xillybus/xillybus_core.ko 2024-03-23T23:29:19.821 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-03-23T23:29:19.821 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/clk/ 2024-03-23T23:29:19.821 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/clk/clk-palmas.ko 2024-03-23T23:29:19.821 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 47729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/clk/clk-si5351.ko 2024-03-23T23:29:19.821 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/clk/clk-twl6040.ko 2024-03-23T23:29:19.821 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19153 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/clk/clk-wm831x.ko 2024-03-23T23:29:19.821 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/ 2024-03-23T23:29:19.821 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-23T23:29:19.821 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-23T23:29:19.821 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 25793 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-23T23:29:19.822 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/ 2024-03-23T23:29:19.822 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/ccp/ 2024-03-23T23:29:19.822 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 70473 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-23T23:29:19.822 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 246841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/ccp/ccp.ko 2024-03-23T23:29:19.822 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/ 2024-03-23T23:29:19.822 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat/ 2024-03-23T23:29:19.822 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat/qat_common/ 2024-03-23T23:29:19.822 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 570497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-23T23:29:19.822 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-03-23T23:29:19.822 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 24049 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-23T23:29:19.822 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19905 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/padlock-aes.ko 2024-03-23T23:29:19.822 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/padlock-sha.ko 2024-03-23T23:29:19.822 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/virtio/ 2024-03-23T23:29:19.823 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 70433 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-23T23:29:19.823 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dca/ 2024-03-23T23:29:19.823 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 29705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dca/dca.ko 2024-03-23T23:29:19.823 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma/ 2024-03-23T23:29:19.823 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma/dw/ 2024-03-23T23:29:19.823 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-23T23:29:19.823 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma/ioat/ 2024-03-23T23:29:19.823 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 122817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-23T23:29:19.823 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/ 2024-03-23T23:29:19.823 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 80305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/amd64_edac.ko 2024-03-23T23:29:19.823 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 35673 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/e752x_edac.ko 2024-03-23T23:29:19.823 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 41641 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/edac_mce_amd.ko 2024-03-23T23:29:19.823 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i3000_edac.ko 2024-03-23T23:29:19.824 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17969 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i3200_edac.ko 2024-03-23T23:29:19.824 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 22441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i5100_edac.ko 2024-03-23T23:29:19.824 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 25497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i5400_edac.ko 2024-03-23T23:29:19.824 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 24817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i7300_edac.ko 2024-03-23T23:29:19.824 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 51945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i7core_edac.ko 2024-03-23T23:29:19.824 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18273 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i82975x_edac.ko 2024-03-23T23:29:19.824 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/ie31200_edac.ko 2024-03-23T23:29:19.824 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 56737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/sb_edac.ko 2024-03-23T23:29:19.824 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/x38_edac.ko 2024-03-23T23:29:19.824 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/extcon/ 2024-03-23T23:29:19.824 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/extcon/extcon-gpio.ko 2024-03-23T23:29:19.824 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 27089 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/extcon/extcon-max14577.ko 2024-03-23T23:29:19.824 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 30217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/extcon/extcon-max77693.ko 2024-03-23T23:29:19.824 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 24649 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/extcon/extcon-max8997.ko 2024-03-23T23:29:19.825 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/extcon/extcon-palmas.ko 2024-03-23T23:29:19.825 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23617 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/extcon/extcon-rt8973a.ko 2024-03-23T23:29:19.825 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 27689 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/extcon/extcon-sm5502.ko 2024-03-23T23:29:19.825 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/firmware/ 2024-03-23T23:29:19.825 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 34881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/firmware/dmi-sysfs.ko 2024-03-23T23:29:19.825 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/firmware/efi/ 2024-03-23T23:29:19.825 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15425 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/firmware/efi/efi-pstore.ko 2024-03-23T23:29:19.825 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-23T23:29:19.825 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/ 2024-03-23T23:29:19.825 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-adp5520.ko 2024-03-23T23:29:19.825 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-amd8111.ko 2024-03-23T23:29:19.825 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-arizona.ko 2024-03-23T23:29:19.825 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-da9052.ko 2024-03-23T23:29:19.826 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-da9055.ko 2024-03-23T23:29:19.826 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21969 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-dln2.ko 2024-03-23T23:29:19.826 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 77753 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-f7188x.ko 2024-03-23T23:29:19.826 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 31305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-generic.ko 2024-03-23T23:29:19.826 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19481 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-ich.ko 2024-03-23T23:29:19.826 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-03-23T23:29:19.826 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14017 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-kempld.ko 2024-03-23T23:29:19.826 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-lp3943.ko 2024-03-23T23:29:19.826 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9417 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-max7300.ko 2024-03-23T23:29:19.826 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11809 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-max730x.ko 2024-03-23T23:29:19.826 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-max732x.ko 2024-03-23T23:29:19.826 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 25049 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-03-23T23:29:19.826 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 47449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-pca953x.ko 2024-03-23T23:29:19.826 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-pcf857x.ko 2024-03-23T23:29:19.827 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-rdc321x.ko 2024-03-23T23:29:19.827 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20505 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-sch.ko 2024-03-23T23:29:19.827 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-sch311x.ko 2024-03-23T23:29:19.827 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-tps65912.ko 2024-03-23T23:29:19.827 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20969 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-twl4030.ko 2024-03-23T23:29:19.827 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11329 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-twl6040.ko 2024-03-23T23:29:19.827 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20505 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-23T23:29:19.827 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-vx855.ko 2024-03-23T23:29:19.827 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-wm831x.ko 2024-03-23T23:29:19.827 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-wm8350.ko 2024-03-23T23:29:19.827 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-wm8994.ko 2024-03-23T23:29:19.827 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/ 2024-03-23T23:29:19.827 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11481 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-a4tech.ko 2024-03-23T23:29:19.828 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 39417 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-apple.ko 2024-03-23T23:29:19.828 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-appleir.ko 2024-03-23T23:29:19.828 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8257 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-aureal.ko 2024-03-23T23:29:19.828 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-axff.ko 2024-03-23T23:29:19.828 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-belkin.ko 2024-03-23T23:29:19.828 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-cherry.ko 2024-03-23T23:29:19.828 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-chicony.ko 2024-03-23T23:29:19.828 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 60665 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-cp2112.ko 2024-03-23T23:29:19.828 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-cypress.ko 2024-03-23T23:29:19.828 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16297 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-dr.ko 2024-03-23T23:29:19.828 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10601 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-elecom.ko 2024-03-23T23:29:19.828 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-elo.ko 2024-03-23T23:29:19.828 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-emsff.ko 2024-03-23T23:29:19.829 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-ezkey.ko 2024-03-23T23:29:19.829 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-gaff.ko 2024-03-23T23:29:19.829 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-generic.ko 2024-03-23T23:29:19.829 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17033 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-gt683r.ko 2024-03-23T23:29:19.829 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12585 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-gyration.ko 2024-03-23T23:29:19.829 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10073 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-23T23:29:19.829 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10369 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-23T23:29:19.829 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14353 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-holtekff.ko 2024-03-23T23:29:19.829 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-hyperv.ko 2024-03-23T23:29:19.829 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-icade.ko 2024-03-23T23:29:19.829 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9145 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-kensington.ko 2024-03-23T23:29:19.829 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-keytouch.ko 2024-03-23T23:29:19.829 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17113 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-kye.ko 2024-03-23T23:29:19.830 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-lcpower.ko 2024-03-23T23:29:19.830 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-led.ko 2024-03-23T23:29:19.830 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 42849 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-lenovo.ko 2024-03-23T23:29:19.830 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 30601 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-lg-g15.ko 2024-03-23T23:29:19.830 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 57977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-23T23:29:19.830 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 101545 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-23T23:29:19.830 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 80921 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-logitech.ko 2024-03-23T23:29:19.830 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 30705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-magicmouse.ko 2024-03-23T23:29:19.830 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21873 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-microsoft.ko 2024-03-23T23:29:19.830 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10265 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-monterey.ko 2024-03-23T23:29:19.830 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 50281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-multitouch.ko 2024-03-23T23:29:19.830 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 32497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-ntrig.ko 2024-03-23T23:29:19.830 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8761 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-ortek.ko 2024-03-23T23:29:19.831 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-penmount.ko 2024-03-23T23:29:19.831 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12193 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-petalynx.ko 2024-03-23T23:29:19.831 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 72865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-picolcd.ko 2024-03-23T23:29:19.831 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-pl.ko 2024-03-23T23:29:19.831 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-plantronics.ko 2024-03-23T23:29:19.831 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8329 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-primax.ko 2024-03-23T23:29:19.831 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 35529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-rmi.ko 2024-03-23T23:29:19.831 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-23T23:29:19.831 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13961 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-common.ko 2024-03-23T23:29:19.831 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 31329 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-23T23:29:19.831 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 29633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-23T23:29:19.831 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 31025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-23T23:29:19.831 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21033 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-23T23:29:19.831 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 29385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-23T23:29:19.832 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-23T23:29:19.832 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 29217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-23T23:29:19.832 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 27841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-23T23:29:19.832 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19425 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-23T23:29:19.832 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23241 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat.ko 2024-03-23T23:29:19.832 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13585 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-saitek.ko 2024-03-23T23:29:19.832 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15097 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-samsung.ko 2024-03-23T23:29:19.832 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 36721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-23T23:29:19.832 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13513 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-sjoy.ko 2024-03-23T23:29:19.832 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 51161 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-sony.ko 2024-03-23T23:29:19.832 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-speedlink.ko 2024-03-23T23:29:19.832 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 25201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-steelseries.ko 2024-03-23T23:29:19.832 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-sunplus.ko 2024-03-23T23:29:19.832 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-23T23:29:19.833 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-tivo.ko 2024-03-23T23:29:19.833 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15001 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-tmff.ko 2024-03-23T23:29:19.833 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14289 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-topseed.ko 2024-03-23T23:29:19.833 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-twinhan.ko 2024-03-23T23:29:19.833 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 70993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-uclogic.ko 2024-03-23T23:29:19.833 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-waltop.ko 2024-03-23T23:29:19.833 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 143393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-wiimote.ko 2024-03-23T23:29:19.833 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8065 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-xinmo.ko 2024-03-23T23:29:19.833 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-zpff.ko 2024-03-23T23:29:19.833 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-zydacron.ko 2024-03-23T23:29:19.833 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 269233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid.ko 2024-03-23T23:29:19.833 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 32233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/uhid.ko 2024-03-23T23:29:19.833 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/usbhid/ 2024-03-23T23:29:19.833 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 125641 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/usbhid/usbhid.ko 2024-03-23T23:29:19.834 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19049 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/usbhid/usbkbd.ko 2024-03-23T23:29:19.834 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/usbhid/usbmouse.ko 2024-03-23T23:29:19.834 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 218881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/wacom.ko 2024-03-23T23:29:19.834 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hv/ 2024-03-23T23:29:19.834 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 64305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hv/hv_balloon.ko 2024-03-23T23:29:19.834 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 90113 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hv/hv_utils.ko 2024-03-23T23:29:19.834 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 304953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hv/hv_vmbus.ko 2024-03-23T23:29:19.834 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ 2024-03-23T23:29:19.834 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 66801 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/abituguru.ko 2024-03-23T23:29:19.834 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 61817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/abituguru3.ko 2024-03-23T23:29:19.834 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 34577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-23T23:29:19.834 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17417 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ad7414.ko 2024-03-23T23:29:19.834 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ad7418.ko 2024-03-23T23:29:19.835 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 25161 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adc128d818.ko 2024-03-23T23:29:19.835 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 31641 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm1025.ko 2024-03-23T23:29:19.835 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 97889 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm1026.ko 2024-03-23T23:29:19.835 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm1029.ko 2024-03-23T23:29:19.835 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 45465 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm1031.ko 2024-03-23T23:29:19.835 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm9240.ko 2024-03-23T23:29:19.835 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14681 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ads7828.ko 2024-03-23T23:29:19.835 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10681 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7410.ko 2024-03-23T23:29:19.835 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21961 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7411.ko 2024-03-23T23:29:19.835 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 74321 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7462.ko 2024-03-23T23:29:19.835 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 39497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7470.ko 2024-03-23T23:29:19.836 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 69313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7475.ko 2024-03-23T23:29:19.836 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19545 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7x10.ko 2024-03-23T23:29:19.836 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 38985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/amc6821.ko 2024-03-23T23:29:19.836 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 55113 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/applesmc.ko 2024-03-23T23:29:19.836 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 49825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/asb100.ko 2024-03-23T23:29:19.836 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 58529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/asc7621.ko 2024-03-23T23:29:19.836 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 40729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-23T23:29:19.836 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/atxp1.ko 2024-03-23T23:29:19.836 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 28137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/coretemp.ko 2024-03-23T23:29:19.836 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 24497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/da9052-hwmon.ko 2024-03-23T23:29:19.836 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/da9055-hwmon.ko 2024-03-23T23:29:19.836 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 49241 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-23T23:29:19.836 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 99513 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/dme1737.ko 2024-03-23T23:29:19.836 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ds1621.ko 2024-03-23T23:29:19.837 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ds620.ko 2024-03-23T23:29:19.837 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 29841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/emc1403.ko 2024-03-23T23:29:19.837 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 33097 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/emc2103.ko 2024-03-23T23:29:19.837 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 30233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/emc6w201.ko 2024-03-23T23:29:19.837 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 66897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/f71805f.ko 2024-03-23T23:29:19.837 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 94601 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/f71882fg.ko 2024-03-23T23:29:19.837 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 41313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/f75375s.ko 2024-03-23T23:29:19.837 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21681 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/fam15h_power.ko 2024-03-23T23:29:19.837 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 55361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/fschmd.ko 2024-03-23T23:29:19.837 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/g760a.ko 2024-03-23T23:29:19.837 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/g762.ko 2024-03-23T23:29:19.837 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 46713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/gl518sm.ko 2024-03-23T23:29:19.837 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 45441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/gl520sm.ko 2024-03-23T23:29:19.837 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/hih6130.ko 2024-03-23T23:29:19.838 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-23T23:29:19.838 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/i5500_temp.ko 2024-03-23T23:29:19.838 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 22513 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/i5k_amb.ko 2024-03-23T23:29:19.838 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 34441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ibmaem.ko 2024-03-23T23:29:19.838 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ibmpex.ko 2024-03-23T23:29:19.838 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 24785 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ina209.ko 2024-03-23T23:29:19.838 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ina2xx.ko 2024-03-23T23:29:19.838 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 140137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/it87.ko 2024-03-23T23:29:19.838 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18753 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/jc42.ko 2024-03-23T23:29:19.838 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 24561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/k10temp.ko 2024-03-23T23:29:19.838 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13793 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/k8temp.ko 2024-03-23T23:29:19.838 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lineage-pem.ko 2024-03-23T23:29:19.838 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 48513 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm63.ko 2024-03-23T23:29:19.839 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16609 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm73.ko 2024-03-23T23:29:19.839 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 38849 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm75.ko 2024-03-23T23:29:19.839 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm77.ko 2024-03-23T23:29:19.839 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 34505 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm78.ko 2024-03-23T23:29:19.839 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 31657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm80.ko 2024-03-23T23:29:19.839 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16801 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm83.ko 2024-03-23T23:29:19.839 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 72745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm85.ko 2024-03-23T23:29:19.839 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 46065 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm87.ko 2024-03-23T23:29:19.839 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 37825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm90.ko 2024-03-23T23:29:19.839 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm92.ko 2024-03-23T23:29:19.839 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 108753 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm93.ko 2024-03-23T23:29:19.839 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 33305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm95234.ko 2024-03-23T23:29:19.839 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16113 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm95241.ko 2024-03-23T23:29:19.839 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm95245.ko 2024-03-23T23:29:19.840 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc2945.ko 2024-03-23T23:29:19.840 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4151.ko 2024-03-23T23:29:19.840 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15105 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4215.ko 2024-03-23T23:29:19.840 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14801 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4222.ko 2024-03-23T23:29:19.840 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4245.ko 2024-03-23T23:29:19.840 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13161 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4260.ko 2024-03-23T23:29:19.840 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14905 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4261.ko 2024-03-23T23:29:19.840 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 33401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max16065.ko 2024-03-23T23:29:19.840 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max1619.ko 2024-03-23T23:29:19.840 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 24265 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max1668.ko 2024-03-23T23:29:19.840 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max197.ko 2024-03-23T23:29:19.840 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 27041 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max6639.ko 2024-03-23T23:29:19.840 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max6650.ko 2024-03-23T23:29:19.841 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 35689 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max6697.ko 2024-03-23T23:29:19.841 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/mc13783-adc.ko 2024-03-23T23:29:19.841 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/mcp3021.ko 2024-03-23T23:29:19.841 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-03-23T23:29:19.841 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 47793 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/nct6683.ko 2024-03-23T23:29:19.841 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 119849 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/nct6775-core.ko 2024-03-23T23:29:19.841 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 61441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/nct6775.ko 2024-03-23T23:29:19.841 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 59649 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/nct7802.ko 2024-03-23T23:29:19.841 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 82721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pc87360.ko 2024-03-23T23:29:19.841 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 54345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pc87427.ko 2024-03-23T23:29:19.841 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pcf8591.ko 2024-03-23T23:29:19.841 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/ 2024-03-23T23:29:19.841 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21265 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-23T23:29:19.841 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16969 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-23T23:29:19.842 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 28241 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-23T23:29:19.842 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-23T23:29:19.842 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-23T23:29:19.842 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10089 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-23T23:29:19.842 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15417 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-23T23:29:19.842 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 82481 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-23T23:29:19.842 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8649 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-23T23:29:19.842 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 30641 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-23T23:29:19.842 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-23T23:29:19.842 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20593 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-23T23:29:19.842 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/powr1220.ko 2024-03-23T23:29:19.842 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21681 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sch5627.ko 2024-03-23T23:29:19.842 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 28729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sch5636.ko 2024-03-23T23:29:19.842 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 29153 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-23T23:29:19.843 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 32049 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sht15.ko 2024-03-23T23:29:19.843 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13417 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sht21.ko 2024-03-23T23:29:19.843 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/shtc1.ko 2024-03-23T23:29:19.843 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 40489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sis5595.ko 2024-03-23T23:29:19.843 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19809 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/smsc47b397.ko 2024-03-23T23:29:19.843 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 40361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/smsc47m1.ko 2024-03-23T23:29:19.843 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 37289 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/smsc47m192.ko 2024-03-23T23:29:19.843 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26465 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/thmc50.ko 2024-03-23T23:29:19.843 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16969 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/tmp102.ko 2024-03-23T23:29:19.843 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/tmp103.ko 2024-03-23T23:29:19.843 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/tmp401.ko 2024-03-23T23:29:19.843 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/tmp421.ko 2024-03-23T23:29:19.843 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19625 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/via-cputemp.ko 2024-03-23T23:29:19.843 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 43449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/via686a.ko 2024-03-23T23:29:19.844 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 52369 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/vt1211.ko 2024-03-23T23:29:19.844 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 53209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/vt8231.ko 2024-03-23T23:29:19.844 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 58265 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83627ehf.ko 2024-03-23T23:29:19.844 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 79841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83627hf.ko 2024-03-23T23:29:19.844 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 71257 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83781d.ko 2024-03-23T23:29:19.844 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 63137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83791d.ko 2024-03-23T23:29:19.844 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 71233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83792d.ko 2024-03-23T23:29:19.844 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 101385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83793.ko 2024-03-23T23:29:19.844 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 119417 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83795.ko 2024-03-23T23:29:19.844 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83l785ts.ko 2024-03-23T23:29:19.844 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 35529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83l786ng.ko 2024-03-23T23:29:19.844 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-03-23T23:29:19.844 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-03-23T23:29:19.845 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/ 2024-03-23T23:29:19.845 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/algos/ 2024-03-23T23:29:19.845 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-23T23:29:19.845 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19249 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-23T23:29:19.845 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/ 2024-03-23T23:29:19.845 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 30865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-03-23T23:29:19.845 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 32481 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-03-23T23:29:19.845 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 30393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-03-23T23:29:19.845 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-23T23:29:19.845 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 28081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-23T23:29:19.845 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16041 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-23T23:29:19.845 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-03-23T23:29:19.845 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 6833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-23T23:29:19.845 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13857 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-03-23T23:29:19.846 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 50305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-23T23:29:19.846 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23801 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-23T23:29:19.846 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-23T23:29:19.846 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17241 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-23T23:29:19.846 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-03-23T23:29:19.846 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-03-23T23:29:19.846 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 67689 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-23T23:29:19.846 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 22345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-23T23:29:19.846 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 47801 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-23T23:29:19.846 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17625 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-03-23T23:29:19.846 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17777 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-23T23:29:19.846 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23545 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-23T23:29:19.846 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-03-23T23:29:19.847 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 25049 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-23T23:29:19.847 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-23T23:29:19.847 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 50977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-23T23:29:19.847 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-03-23T23:29:19.847 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-23T23:29:19.847 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-23T23:29:19.847 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 22217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-03-23T23:29:19.847 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 29265 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-03-23T23:29:19.847 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-23T23:29:19.847 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19145 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-03-23T23:29:19.847 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-23T23:29:19.847 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-23T23:29:19.847 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 27625 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-23T23:29:19.847 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-23T23:29:19.848 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 47569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-03-23T23:29:19.848 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 22361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/i2c-mux.ko 2024-03-23T23:29:19.848 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/i2c-smbus.ko 2024-03-23T23:29:19.848 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/i2c-stub.ko 2024-03-23T23:29:19.848 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/muxes/ 2024-03-23T23:29:19.848 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15097 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-03-23T23:29:19.848 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-03-23T23:29:19.848 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 29641 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-03-23T23:29:19.848 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ 2024-03-23T23:29:19.848 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/ 2024-03-23T23:29:19.848 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 273529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-23T23:29:19.848 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 883945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/ib_core.ko 2024-03-23T23:29:19.848 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 69185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-23T23:29:19.849 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 324337 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-23T23:29:19.849 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 97841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-23T23:29:19.849 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 282345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-23T23:29:19.849 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 66057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-23T23:29:19.849 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/ 2024-03-23T23:29:19.849 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/cxgb4/ 2024-03-23T23:29:19.849 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 493185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-23T23:29:19.849 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mlx4/ 2024-03-23T23:29:19.849 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 420593 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-23T23:29:19.849 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mlx5/ 2024-03-23T23:29:19.849 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 741737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-23T23:29:19.849 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mthca/ 2024-03-23T23:29:19.849 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 296881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-23T23:29:19.850 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/ocrdma/ 2024-03-23T23:29:19.850 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 153729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-03-23T23:29:19.850 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/usnic/ 2024-03-23T23:29:19.850 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 169145 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-03-23T23:29:19.850 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/ 2024-03-23T23:29:19.850 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/ipoib/ 2024-03-23T23:29:19.850 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 266577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-23T23:29:19.850 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/iser/ 2024-03-23T23:29:19.850 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 100281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-23T23:29:19.850 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/isert/ 2024-03-23T23:29:19.850 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 111337 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-23T23:29:19.850 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/srp/ 2024-03-23T23:29:19.850 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 128665 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-23T23:29:19.851 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/srpt/ 2024-03-23T23:29:19.851 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 129801 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-23T23:29:19.851 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/ 2024-03-23T23:29:19.851 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/evbug.ko 2024-03-23T23:29:19.851 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 24033 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/ff-memless.ko 2024-03-23T23:29:19.851 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/gameport/ 2024-03-23T23:29:19.851 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11785 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-23T23:29:19.851 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-23T23:29:19.851 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 41457 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/gameport/gameport.ko 2024-03-23T23:29:19.851 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 41713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/joydev.ko 2024-03-23T23:29:19.851 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/ 2024-03-23T23:29:19.851 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-03-23T23:29:19.851 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12609 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-03-23T23:29:19.852 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-03-23T23:29:19.852 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 24481 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-03-23T23:29:19.852 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 37281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-23T23:29:19.852 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18785 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-03-23T23:29:19.852 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/lkkbd.ko 2024-03-23T23:29:19.852 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/lm8323.ko 2024-03-23T23:29:19.852 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14321 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/lm8333.ko 2024-03-23T23:29:19.852 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 24233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-03-23T23:29:19.852 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18121 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-03-23T23:29:19.852 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-03-23T23:29:19.852 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-03-23T23:29:19.852 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/newtonkbd.ko 2024-03-23T23:29:19.852 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-03-23T23:29:19.852 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14073 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/qt1070.ko 2024-03-23T23:29:19.853 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/qt2160.ko 2024-03-23T23:29:19.853 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-03-23T23:29:19.853 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/stowaway.ko 2024-03-23T23:29:19.853 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/sunkbd.ko 2024-03-23T23:29:19.853 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17329 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-03-23T23:29:19.853 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-03-23T23:29:19.853 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-03-23T23:29:19.853 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11665 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/xtkbd.ko 2024-03-23T23:29:19.853 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11369 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/matrix-keymap.ko 2024-03-23T23:29:19.853 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/ 2024-03-23T23:29:19.853 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 34233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/appletouch.ko 2024-03-23T23:29:19.853 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 34089 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/bcm5974.ko 2024-03-23T23:29:19.853 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 123201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/cyapatp.ko 2024-03-23T23:29:19.853 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 89393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-23T23:29:19.854 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/gpio_mouse.ko 2024-03-23T23:29:19.854 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 335921 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/psmouse.ko 2024-03-23T23:29:19.854 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14593 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/sermouse.ko 2024-03-23T23:29:19.854 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23785 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-23T23:29:19.854 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 22473 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-23T23:29:19.854 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-23T23:29:19.854 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/rmi4/ 2024-03-23T23:29:19.854 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 109601 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-23T23:29:19.854 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/ 2024-03-23T23:29:19.854 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/altera_ps2.ko 2024-03-23T23:29:19.854 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/arc_ps2.ko 2024-03-23T23:29:19.854 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17689 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/ct82c710.ko 2024-03-23T23:29:19.854 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16857 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-23T23:29:19.854 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/parkbd.ko 2024-03-23T23:29:19.855 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/pcips2.ko 2024-03-23T23:29:19.855 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20073 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/ps2mult.ko 2024-03-23T23:29:19.855 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 24057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/serio_raw.ko 2024-03-23T23:29:19.855 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17889 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/serport.ko 2024-03-23T23:29:19.855 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13241 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/sparse-keymap.ko 2024-03-23T23:29:19.855 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/ 2024-03-23T23:29:19.855 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-88pm860x.ko 2024-03-23T23:29:19.855 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11289 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-adp5520.ko 2024-03-23T23:29:19.855 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 59657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-bd2802.ko 2024-03-23T23:29:19.855 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 24689 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-blinkm.ko 2024-03-23T23:29:19.855 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-da903x.ko 2024-03-23T23:29:19.855 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12145 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-da9052.ko 2024-03-23T23:29:19.855 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16689 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-gpio.ko 2024-03-23T23:29:19.856 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15697 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-lm3530.ko 2024-03-23T23:29:19.856 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 30409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-lm3533.ko 2024-03-23T23:29:19.856 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19257 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-lm355x.ko 2024-03-23T23:29:19.856 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-lm3642.ko 2024-03-23T23:29:19.856 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16145 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-lp3944.ko 2024-03-23T23:29:19.856 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11145 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-lp8788.ko 2024-03-23T23:29:19.856 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-max8997.ko 2024-03-23T23:29:19.856 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-mc13783.ko 2024-03-23T23:29:19.856 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13289 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-menf21bmc.ko 2024-03-23T23:29:19.856 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-pca9532.ko 2024-03-23T23:29:19.856 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-pca955x.ko 2024-03-23T23:29:19.856 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17761 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-pca963x.ko 2024-03-23T23:29:19.856 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 34337 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-ss4200.ko 2024-03-23T23:29:19.856 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23905 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-tca6507.ko 2024-03-23T23:29:19.857 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-wm831x-status.ko 2024-03-23T23:29:19.857 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11753 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-wm8350.ko 2024-03-23T23:29:19.857 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ 2024-03-23T23:29:19.857 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9889 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-23T23:29:19.857 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-23T23:29:19.857 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-23T23:29:19.857 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 7521 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-23T23:29:19.857 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-23T23:29:19.857 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14145 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-23T23:29:19.857 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-23T23:29:19.857 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11793 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-23T23:29:19.857 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13969 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-23T23:29:19.857 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/ 2024-03-23T23:29:19.857 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/bcache/ 2024-03-23T23:29:19.858 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 647121 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/bcache/bcache.ko 2024-03-23T23:29:19.858 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 40489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-bio-prison.ko 2024-03-23T23:29:19.858 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 93321 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-bufio.ko 2024-03-23T23:29:19.858 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 47441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-cache-smq.ko 2024-03-23T23:29:19.858 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 155825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-cache.ko 2024-03-23T23:29:19.858 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 107937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-crypt.ko 2024-03-23T23:29:19.858 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-delay.ko 2024-03-23T23:29:19.858 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 53769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-era.ko 2024-03-23T23:29:19.858 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 28217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-flakey.ko 2024-03-23T23:29:19.858 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 41441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-log-userspace.ko 2024-03-23T23:29:19.858 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 32649 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-log.ko 2024-03-23T23:29:19.858 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 49449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-mirror.ko 2024-03-23T23:29:19.859 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 77881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-multipath.ko 2024-03-23T23:29:19.859 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-queue-length.ko 2024-03-23T23:29:19.859 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 70985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-raid.ko 2024-03-23T23:29:19.859 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 36201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-region-hash.ko 2024-03-23T23:29:19.859 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15777 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-round-robin.ko 2024-03-23T23:29:19.859 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-service-time.ko 2024-03-23T23:29:19.859 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 109457 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-snapshot.ko 2024-03-23T23:29:19.859 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19265 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-switch.ko 2024-03-23T23:29:19.859 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 181777 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-thin-pool.ko 2024-03-23T23:29:19.859 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 53737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-verity.ko 2024-03-23T23:29:19.859 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8481 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-zero.ko 2024-03-23T23:29:19.859 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/persistent-data/ 2024-03-23T23:29:19.859 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 199881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-23T23:29:19.860 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 37321 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/raid0.ko 2024-03-23T23:29:19.860 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 100841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/raid1.ko 2024-03-23T23:29:19.860 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 126369 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/raid10.ko 2024-03-23T23:29:19.860 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 368497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/raid456.ko 2024-03-23T23:29:19.860 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/ 2024-03-23T23:29:19.860 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/ 2024-03-23T23:29:19.860 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 178049 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptbase.ko 2024-03-23T23:29:19.860 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 63241 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptctl.ko 2024-03-23T23:29:19.860 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 46249 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptfc.ko 2024-03-23T23:29:19.860 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 37121 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptlan.ko 2024-03-23T23:29:19.860 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 123233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptsas.ko 2024-03-23T23:29:19.860 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 80921 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptscsih.ko 2024-03-23T23:29:19.860 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 52865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptspi.ko 2024-03-23T23:29:19.860 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/ 2024-03-23T23:29:19.861 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/88pm800.ko 2024-03-23T23:29:19.861 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12673 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/88pm805.ko 2024-03-23T23:29:19.861 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11105 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/88pm80x.ko 2024-03-23T23:29:19.861 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/arizona-i2c.ko 2024-03-23T23:29:19.861 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 123649 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/arizona.ko 2024-03-23T23:29:19.861 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11873 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/bcm590xx.ko 2024-03-23T23:29:19.861 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17369 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/cros_ec_dev.ko 2024-03-23T23:29:19.861 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 34849 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/dln2.ko 2024-03-23T23:29:19.861 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16593 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/janz-cmodio.ko 2024-03-23T23:29:19.861 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 53489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/kempld-core.ko 2024-03-23T23:29:19.861 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 27433 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/lm3533-core.ko 2024-03-23T23:29:19.861 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-03-23T23:29:19.861 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12921 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/lp3943.ko 2024-03-23T23:29:19.862 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 56969 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/lpc_ich.ko 2024-03-23T23:29:19.862 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/lpc_sch.ko 2024-03-23T23:29:19.862 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17321 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/max8907.ko 2024-03-23T23:29:19.862 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 29761 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/mc13xxx-core.ko 2024-03-23T23:29:19.862 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-03-23T23:29:19.862 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/menf21bmc.ko 2024-03-23T23:29:19.862 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/pcf50633-adc.ko 2024-03-23T23:29:19.862 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/pcf50633-gpio.ko 2024-03-23T23:29:19.862 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 34793 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/pcf50633.ko 2024-03-23T23:29:19.862 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10001 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-03-23T23:29:19.862 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/retu-mfd.ko 2024-03-23T23:29:19.862 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 80345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/si476x-core.ko 2024-03-23T23:29:19.863 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 48369 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/sm501.ko 2024-03-23T23:29:19.863 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 51209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/tps65010.ko 2024-03-23T23:29:19.863 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10265 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/tps6507x.ko 2024-03-23T23:29:19.863 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/viperboard.ko 2024-03-23T23:29:19.863 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/vx855.ko 2024-03-23T23:29:19.863 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17857 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/wl1273-core.ko 2024-03-23T23:29:19.863 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 44265 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/wm8994.ko 2024-03-23T23:29:19.863 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/ 2024-03-23T23:29:19.863 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-03-23T23:29:19.863 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 48393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/ad525x_dpot.ko 2024-03-23T23:29:19.863 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/altera-stapl/ 2024-03-23T23:29:19.863 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 46513 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-23T23:29:19.863 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18297 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/apds9802als.ko 2024-03-23T23:29:19.863 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 36641 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/apds990x.ko 2024-03-23T23:29:19.864 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 45497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/bh1770glc.ko 2024-03-23T23:29:19.864 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/c2port/ 2024-03-23T23:29:19.864 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11049 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-03-23T23:29:19.864 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 35497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/c2port/core.ko 2024-03-23T23:29:19.864 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/cb710/ 2024-03-23T23:29:19.864 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 25081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/cb710/cb710.ko 2024-03-23T23:29:19.864 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/ds1682.ko 2024-03-23T23:29:19.864 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8801 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/dummy-irq.ko 2024-03-23T23:29:19.864 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/echo/ 2024-03-23T23:29:19.864 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/echo/echo.ko 2024-03-23T23:29:19.864 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/eeprom/ 2024-03-23T23:29:19.864 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 39025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/eeprom/at24.ko 2024-03-23T23:29:19.864 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14673 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-23T23:29:19.865 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/eeprom/max6875.ko 2024-03-23T23:29:19.865 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 32913 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/enclosure.ko 2024-03-23T23:29:19.865 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/genwqe/ 2024-03-23T23:29:19.865 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 152073 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-03-23T23:29:19.865 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14041 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/hmc6352.ko 2024-03-23T23:29:19.865 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 31169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/hpilo.ko 2024-03-23T23:29:19.865 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/ibmasm/ 2024-03-23T23:29:19.865 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 72561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-03-23T23:29:19.865 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19689 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/ics932s401.ko 2024-03-23T23:29:19.865 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21593 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/isl29003.ko 2024-03-23T23:29:19.865 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15665 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/isl29020.ko 2024-03-23T23:29:19.865 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/lis3lv02d/ 2024-03-23T23:29:19.865 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 42417 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-23T23:29:19.866 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-23T23:29:19.866 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/mei/ 2024-03-23T23:29:19.866 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 126153 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/mei/mei-me.ko 2024-03-23T23:29:19.866 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 56377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/mei/mei-txe.ko 2024-03-23T23:29:19.866 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 313601 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/mei/mei.ko 2024-03-23T23:29:19.866 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 31401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/phantom.ko 2024-03-23T23:29:19.866 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/ti-st/ 2024-03-23T23:29:19.866 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 74305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/ti-st/st_drv.ko 2024-03-23T23:29:19.866 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 24209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/tifm_7xx1.ko 2024-03-23T23:29:19.866 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 28689 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/tifm_core.ko 2024-03-23T23:29:19.866 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18641 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/tsl2550.ko 2024-03-23T23:29:19.866 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 48345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/vmw_balloon.ko 2024-03-23T23:29:19.866 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/vmw_vmci/ 2024-03-23T23:29:19.867 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 183569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-23T23:29:19.867 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ 2024-03-23T23:29:19.867 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/bonding/ 2024-03-23T23:29:19.867 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 491609 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/bonding/bonding.ko 2024-03-23T23:29:19.867 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/ 2024-03-23T23:29:19.867 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/b53/ 2024-03-23T23:29:19.867 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 105937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-23T23:29:19.867 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 40225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-23T23:29:19.867 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-23T23:29:19.867 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/mv88e6xxx/ 2024-03-23T23:29:19.867 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 459001 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-23T23:29:19.867 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dummy.ko 2024-03-23T23:29:19.868 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/eql.ko 2024-03-23T23:29:19.868 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/ 2024-03-23T23:29:19.868 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com/ 2024-03-23T23:29:19.868 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 45961 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-23T23:29:19.868 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 42193 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-23T23:29:19.868 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 130665 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-23T23:29:19.868 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 68785 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-23T23:29:19.868 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390/ 2024-03-23T23:29:19.868 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 38049 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-23T23:29:19.868 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 64617 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-23T23:29:19.868 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 27089 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-23T23:29:19.868 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 101617 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-23T23:29:19.868 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/adaptec/ 2024-03-23T23:29:19.869 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 54625 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-23T23:29:19.869 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/agere/ 2024-03-23T23:29:19.869 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 69169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-23T23:29:19.869 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/alteon/ 2024-03-23T23:29:19.869 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 59993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-23T23:29:19.869 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/altera/ 2024-03-23T23:29:19.869 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 41409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-23T23:29:19.869 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/amd/ 2024-03-23T23:29:19.869 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 54617 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-23T23:29:19.869 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 49193 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-23T23:29:19.869 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 87457 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-23T23:29:19.869 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/ 2024-03-23T23:29:19.869 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/alx/ 2024-03-23T23:29:19.870 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 97201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-23T23:29:19.870 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-03-23T23:29:19.870 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 102497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-23T23:29:19.870 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-03-23T23:29:19.870 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 90209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-23T23:29:19.870 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atlx/ 2024-03-23T23:29:19.870 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 81321 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-23T23:29:19.870 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 69545 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-23T23:29:19.870 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/ 2024-03-23T23:29:19.870 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 78385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-23T23:29:19.870 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 176697 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-23T23:29:19.870 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-03-23T23:29:19.871 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 1434505 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-23T23:29:19.871 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 128369 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-23T23:29:19.871 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/genet/ 2024-03-23T23:29:19.871 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 131281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-23T23:29:19.871 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 314329 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-23T23:29:19.946 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/brocade/ 2024-03-23T23:29:19.946 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/brocade/bna/ 2024-03-23T23:29:19.946 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 323737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-23T23:29:19.946 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/ 2024-03-23T23:29:19.946 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-03-23T23:29:19.946 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 193593 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-23T23:29:19.946 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-03-23T23:29:19.946 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 347217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-23T23:29:19.946 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-03-23T23:29:19.946 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 1045449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-23T23:29:19.947 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-03-23T23:29:19.947 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 166145 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-23T23:29:19.947 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-03-23T23:29:19.947 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 34865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-23T23:29:19.947 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/cisco/ 2024-03-23T23:29:19.947 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/cisco/enic/ 2024-03-23T23:29:19.947 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 204249 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-23T23:29:19.947 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/ 2024-03-23T23:29:19.947 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/ 2024-03-23T23:29:19.947 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 69433 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-23T23:29:19.947 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 61425 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-23T23:29:19.947 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 141201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-23T23:29:19.947 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 51369 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-23T23:29:19.948 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 62833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-23T23:29:19.948 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 31209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-23T23:29:19.948 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dlink/ 2024-03-23T23:29:19.948 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 60673 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-23T23:29:19.948 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 62833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-23T23:29:19.948 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 45489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dnet.ko 2024-03-23T23:29:19.948 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 25097 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/ec_bhf.ko 2024-03-23T23:29:19.948 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/emulex/ 2024-03-23T23:29:19.948 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/emulex/benet/ 2024-03-23T23:29:19.948 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 281217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-23T23:29:19.948 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 49457 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/ethoc.ko 2024-03-23T23:29:19.948 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 51785 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/fealnx.ko 2024-03-23T23:29:19.948 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/fujitsu/ 2024-03-23T23:29:19.949 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 45553 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-03-23T23:29:19.949 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/ 2024-03-23T23:29:19.949 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 90305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-23T23:29:19.949 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e1000/ 2024-03-23T23:29:19.949 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 295697 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-23T23:29:19.949 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e1000e/ 2024-03-23T23:29:19.949 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 584353 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-23T23:29:19.949 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/fm10k/ 2024-03-23T23:29:19.949 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 246041 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-23T23:29:19.949 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/i40e/ 2024-03-23T23:29:19.949 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 944545 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-23T23:29:19.949 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/iavf/ 2024-03-23T23:29:19.949 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 288529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-23T23:29:19.950 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/igb/ 2024-03-23T23:29:19.950 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 513673 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-23T23:29:19.950 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/igbvf/ 2024-03-23T23:29:19.950 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 93489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-23T23:29:19.950 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-03-23T23:29:19.950 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 735169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-23T23:29:19.950 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-03-23T23:29:19.950 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 151745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-23T23:29:19.950 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 86993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/jme.ko 2024-03-23T23:29:19.950 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/marvell/ 2024-03-23T23:29:19.950 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21241 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-23T23:29:19.950 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 102441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-23T23:29:19.950 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 122609 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-23T23:29:19.951 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/ 2024-03-23T23:29:19.951 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-03-23T23:29:19.951 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 727481 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-23T23:29:19.951 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 278881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-23T23:29:19.951 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-03-23T23:29:19.951 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-03-23T23:29:19.951 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 1122297 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-23T23:29:19.951 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/micrel/ 2024-03-23T23:29:19.951 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 52985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-03-23T23:29:19.951 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 40881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-03-23T23:29:19.951 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-03-23T23:29:19.951 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 95577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-23T23:29:19.951 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/myricom/ 2024-03-23T23:29:19.952 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-03-23T23:29:19.952 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 108409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-23T23:29:19.952 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/natsemi/ 2024-03-23T23:29:19.952 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 73617 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-23T23:29:19.952 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 47801 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-23T23:29:19.952 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/neterion/ 2024-03-23T23:29:19.952 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 151097 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-23T23:29:19.952 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/nvidia/ 2024-03-23T23:29:19.952 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 136801 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-23T23:29:19.952 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/packetengines/ 2024-03-23T23:29:19.952 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 50433 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-23T23:29:19.952 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 42985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-23T23:29:19.953 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/ 2024-03-23T23:29:19.953 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-03-23T23:29:19.953 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 227865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-23T23:29:19.953 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 87017 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-23T23:29:19.953 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-03-23T23:29:19.953 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 672057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-23T23:29:19.953 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/rdc/ 2024-03-23T23:29:19.953 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 42937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-23T23:29:19.953 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek/ 2024-03-23T23:29:19.953 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 67281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-23T23:29:19.953 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 83809 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-23T23:29:19.953 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 29161 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-23T23:29:19.953 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 194073 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-23T23:29:19.953 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/samsung/ 2024-03-23T23:29:19.954 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-03-23T23:29:19.954 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 104049 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-03-23T23:29:19.954 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sfc/ 2024-03-23T23:29:19.954 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 1067001 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-23T23:29:19.954 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/silan/ 2024-03-23T23:29:19.954 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 47009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-23T23:29:19.954 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sis/ 2024-03-23T23:29:19.954 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 54729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-23T23:29:19.955 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 63201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-23T23:29:19.956 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc/ 2024-03-23T23:29:19.956 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 61425 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-23T23:29:19.956 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 67297 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-23T23:29:19.956 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 73257 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-23T23:29:19.956 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 68049 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-23T23:29:19.956 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/stmicro/ 2024-03-23T23:29:19.956 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-03-23T23:29:19.956 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13033 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-03-23T23:29:19.956 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 39385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-23T23:29:19.957 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18457 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-03-23T23:29:19.957 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 495777 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-23T23:29:19.957 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun/ 2024-03-23T23:29:19.957 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 103185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-23T23:29:19.957 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 166049 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-23T23:29:19.957 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 66273 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-23T23:29:19.957 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 78721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-23T23:29:19.957 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/tehuti/ 2024-03-23T23:29:19.957 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 50017 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-23T23:29:19.957 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/ti/ 2024-03-23T23:29:19.957 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 92345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-23T23:29:19.957 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/via/ 2024-03-23T23:29:19.957 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 79937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-23T23:29:19.958 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 83721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-23T23:29:19.958 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/wiznet/ 2024-03-23T23:29:19.958 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 46313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-23T23:29:19.958 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 30825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-23T23:29:19.958 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/xircom/ 2024-03-23T23:29:19.958 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 59921 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-23T23:29:19.958 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/fddi/ 2024-03-23T23:29:19.958 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 41185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/fddi/defxx.ko 2024-03-23T23:29:19.958 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/fddi/skfp/ 2024-03-23T23:29:19.959 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 217113 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/fddi/skfp/skfp.ko 2024-03-23T23:29:19.959 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 74993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/geneve.ko 2024-03-23T23:29:19.959 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/hyperv/ 2024-03-23T23:29:19.959 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 237265 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-23T23:29:19.959 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ieee802154/ 2024-03-23T23:29:19.959 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-23T23:29:19.959 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 25281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ifb.ko 2024-03-23T23:29:19.959 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ipvlan/ 2024-03-23T23:29:19.959 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 85857 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-23T23:29:19.959 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 62897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/macvlan.ko 2024-03-23T23:29:19.959 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16161 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/macvtap.ko 2024-03-23T23:29:19.959 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio/ 2024-03-23T23:29:19.959 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21249 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-23T23:29:19.960 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-23T23:29:19.960 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio/mdio-gpio.ko 2024-03-23T23:29:19.960 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-23T23:29:19.960 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio.ko 2024-03-23T23:29:19.960 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20425 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mii.ko 2024-03-23T23:29:19.960 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 45057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/netconsole.ko 2024-03-23T23:29:19.960 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/nlmon.ko 2024-03-23T23:29:19.960 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/pcs/ 2024-03-23T23:29:19.960 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-23T23:29:19.960 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 39137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-23T23:29:19.961 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/ 2024-03-23T23:29:19.961 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10369 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/amd.ko 2024-03-23T23:29:19.961 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 49937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-23T23:29:19.961 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 44633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-23T23:29:19.961 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/bcm87xx.ko 2024-03-23T23:29:19.961 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 44825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/broadcom.ko 2024-03-23T23:29:19.961 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10545 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/cicada.ko 2024-03-23T23:29:19.961 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/davicom.ko 2024-03-23T23:29:19.961 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9369 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/et1011c.ko 2024-03-23T23:29:19.961 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 24881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/icplus.ko 2024-03-23T23:29:19.961 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/lxt.ko 2024-03-23T23:29:19.962 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 81961 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/marvell.ko 2024-03-23T23:29:19.962 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 76569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/micrel.ko 2024-03-23T23:29:19.962 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/national.ko 2024-03-23T23:29:19.962 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 99009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/phylink.ko 2024-03-23T23:29:19.962 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/qsemi.ko 2024-03-23T23:29:19.962 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 49977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/realtek.ko 2024-03-23T23:29:19.962 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 30097 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/smsc.ko 2024-03-23T23:29:19.962 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10777 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/ste10Xp.ko 2024-03-23T23:29:19.962 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 24209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/vitesse.ko 2024-03-23T23:29:19.962 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/plip/ 2024-03-23T23:29:19.962 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 43769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/plip/plip.ko 2024-03-23T23:29:19.963 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ 2024-03-23T23:29:19.963 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15889 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-23T23:29:19.963 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 29729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_async.ko 2024-03-23T23:29:19.963 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17681 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-23T23:29:19.963 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-23T23:29:19.963 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 28753 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-23T23:29:19.963 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 42673 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/pppoe.ko 2024-03-23T23:29:19.963 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13353 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/pppox.ko 2024-03-23T23:29:19.963 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 32673 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/pptp.ko 2024-03-23T23:29:19.963 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 28361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/sb1000.ko 2024-03-23T23:29:19.963 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/slip/ 2024-03-23T23:29:19.964 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 42393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/slip/slip.ko 2024-03-23T23:29:19.964 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/sungem_phy.ko 2024-03-23T23:29:19.964 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 64561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/tap.ko 2024-03-23T23:29:19.964 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/ 2024-03-23T23:29:19.964 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 107233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team.ko 2024-03-23T23:29:19.964 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13457 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-23T23:29:19.964 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-23T23:29:19.964 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 28841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-23T23:29:19.964 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9617 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_random.ko 2024-03-23T23:29:19.964 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-23T23:29:19.965 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 86825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/veth.ko 2024-03-23T23:29:19.965 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/vmxnet3/ 2024-03-23T23:29:19.965 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 144361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-23T23:29:19.965 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/vxlan/ 2024-03-23T23:29:19.965 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 307193 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/vxlan/vxlan.ko 2024-03-23T23:29:19.965 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/xen-netback/ 2024-03-23T23:29:19.965 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 144017 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-23T23:29:19.965 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ntb/ 2024-03-23T23:29:19.965 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ntb/ntb.ko 2024-03-23T23:29:19.966 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/nvme/ 2024-03-23T23:29:19.966 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/nvme/host/ 2024-03-23T23:29:19.966 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 267745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/nvme/host/nvme-core.ko 2024-03-23T23:29:19.966 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 103361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/nvme/host/nvme.ko 2024-03-23T23:29:19.966 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport/ 2024-03-23T23:29:19.966 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 131329 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport/parport.ko 2024-03-23T23:29:19.966 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14465 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport/parport_cs.ko 2024-03-23T23:29:19.966 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 85217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport/parport_pc.ko 2024-03-23T23:29:19.966 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 27569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport/parport_serial.ko 2024-03-23T23:29:19.966 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/ 2024-03-23T23:29:19.967 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/hotplug/ 2024-03-23T23:29:19.967 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 24913 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-23T23:29:19.967 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-03-23T23:29:19.967 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20297 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-03-23T23:29:19.967 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/pci-stub.ko 2024-03-23T23:29:19.967 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 46369 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/xen-pcifront.ko 2024-03-23T23:29:19.967 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia/ 2024-03-23T23:29:19.967 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia/i82092.ko 2024-03-23T23:29:19.967 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 146153 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia/pcmcia.ko 2024-03-23T23:29:19.967 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 62081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia/pcmcia_core.ko 2024-03-23T23:29:19.967 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 34257 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-03-23T23:29:19.967 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 34177 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia/pd6729.ko 2024-03-23T23:29:19.967 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 112793 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-23T23:29:19.967 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/phy/ 2024-03-23T23:29:19.968 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/phy/broadcom/ 2024-03-23T23:29:19.968 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-03-23T23:29:19.968 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/phy/samsung/ 2024-03-23T23:29:19.968 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-03-23T23:29:19.968 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pinctrl/ 2024-03-23T23:29:19.968 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pinctrl/intel/ 2024-03-23T23:29:19.968 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 69033 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-23T23:29:19.968 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/ 2024-03-23T23:29:19.968 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/chrome/ 2024-03-23T23:29:19.968 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 51233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-03-23T23:29:19.968 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 24585 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/chrome/cros_ec.ko 2024-03-23T23:29:19.968 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21353 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-03-23T23:29:19.968 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 25377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-03-23T23:29:19.968 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26105 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-03-23T23:29:19.969 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-03-23T23:29:19.969 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17257 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-03-23T23:29:19.969 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/ 2024-03-23T23:29:19.969 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 73601 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-23T23:29:19.969 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 39057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/acerhdf.ko 2024-03-23T23:29:19.969 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 36929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-23T23:29:19.969 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 59569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-23T23:29:19.969 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 31385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-23T23:29:19.969 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 131945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-23T23:29:19.969 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 36753 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-23T23:29:19.969 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 49025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-23T23:29:19.969 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-23T23:29:19.969 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 40169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-23T23:29:19.969 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 22425 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-23T23:29:19.970 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 36505 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/hdaps.ko 2024-03-23T23:29:19.970 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/ibm_rtl.ko 2024-03-23T23:29:19.970 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/intel/ 2024-03-23T23:29:19.970 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-23T23:29:19.970 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-03-23T23:29:19.970 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 44537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/intel_ips.ko 2024-03-23T23:29:19.970 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-23T23:29:19.970 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10289 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-23T23:29:19.970 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 34705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-23T23:29:19.970 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 42233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-23T23:29:19.970 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14073 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-23T23:29:19.970 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-23T23:29:19.970 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13617 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-23T23:29:19.971 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-23T23:29:19.971 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10049 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-23T23:29:19.971 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 48481 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/wmi.ko 2024-03-23T23:29:19.971 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/ 2024-03-23T23:29:19.971 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/ 2024-03-23T23:29:19.971 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 30137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/88pm860x_battery.ko 2024-03-23T23:29:19.971 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 33889 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/88pm860x_charger.ko 2024-03-23T23:29:19.971 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 54961 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/bq2415x_charger.ko 2024-03-23T23:29:19.971 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 59505 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/bq24190_charger.ko 2024-03-23T23:29:19.971 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21457 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/bq24735-charger.ko 2024-03-23T23:29:19.971 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-03-23T23:29:19.971 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19513 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/da9030_battery.ko 2024-03-23T23:29:19.971 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/da9052-battery.ko 2024-03-23T23:29:19.972 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 29185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/ds2760_battery.ko 2024-03-23T23:29:19.972 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23121 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/ds2780_battery.ko 2024-03-23T23:29:19.972 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23257 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/ds2781_battery.ko 2024-03-23T23:29:19.972 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23553 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/ds2782_battery.ko 2024-03-23T23:29:19.972 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20257 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/gpio-charger.ko 2024-03-23T23:29:19.972 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/isp1704_charger.ko 2024-03-23T23:29:19.972 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20177 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/lp8727_charger.ko 2024-03-23T23:29:19.972 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12481 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/max14577_charger.ko 2024-03-23T23:29:19.972 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 30193 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/max17042_battery.ko 2024-03-23T23:29:19.972 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/max8903_charger.ko 2024-03-23T23:29:19.972 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/max8925_power.ko 2024-03-23T23:29:19.972 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/pcf50633-charger.ko 2024-03-23T23:29:19.972 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 37841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/sbs-battery.ko 2024-03-23T23:29:19.972 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 28289 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/test_power.ko 2024-03-23T23:29:19.973 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/tps65090-charger.ko 2024-03-23T23:29:19.973 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11873 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/wm831x_backup.ko 2024-03-23T23:29:19.973 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 24361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/wm831x_power.ko 2024-03-23T23:29:19.973 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 22321 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/power/supply/wm8350_power.ko 2024-03-23T23:29:19.973 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/powercap/ 2024-03-23T23:29:19.973 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 58105 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-23T23:29:19.973 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17625 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-23T23:29:19.973 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/ 2024-03-23T23:29:19.973 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/clients/ 2024-03-23T23:29:19.973 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15433 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-23T23:29:19.973 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13153 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-23T23:29:19.973 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16073 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/clients/pps_parport.ko 2024-03-23T23:29:19.973 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 41801 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/pps_core.ko 2024-03-23T23:29:19.973 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ptp/ 2024-03-23T23:29:19.974 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 70873 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ptp/ptp.ko 2024-03-23T23:29:19.974 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ptp/ptp_kvm.ko 2024-03-23T23:29:19.974 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/ 2024-03-23T23:29:19.974 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-88pm80x.ko 2024-03-23T23:29:19.974 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 24425 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-88pm860x.ko 2024-03-23T23:29:19.974 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15297 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-23T23:29:19.974 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-da9052.ko 2024-03-23T23:29:19.974 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-da9055.ko 2024-03-23T23:29:19.974 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-da9063.ko 2024-03-23T23:29:19.974 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-23T23:29:19.974 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 68481 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-23T23:29:19.974 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-23T23:29:19.974 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18121 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-23T23:29:19.974 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16641 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-23T23:29:19.975 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13857 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-23T23:29:19.975 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13273 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-23T23:29:19.975 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14601 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-23T23:29:19.975 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23609 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-23T23:29:19.975 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-em3027.ko 2024-03-23T23:29:19.975 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 24233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-23T23:29:19.975 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-23T23:29:19.975 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 35873 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-23T23:29:19.975 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-lp8788.ko 2024-03-23T23:29:19.975 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 38001 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-23T23:29:19.975 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-23T23:29:19.975 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 25849 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-23T23:29:19.976 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-m48t86.ko 2024-03-23T23:29:19.976 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-max6900.ko 2024-03-23T23:29:19.976 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-max8907.ko 2024-03-23T23:29:19.976 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15249 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-max8925.ko 2024-03-23T23:29:19.976 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 25713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-max8997.ko 2024-03-23T23:29:19.976 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16585 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-max8998.ko 2024-03-23T23:29:19.976 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18417 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-03-23T23:29:19.976 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-23T23:29:19.976 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-palmas.ko 2024-03-23T23:29:19.976 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 46537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-23T23:29:19.976 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf50633.ko 2024-03-23T23:29:19.976 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-23T23:29:19.976 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-23T23:29:19.976 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 29721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-23T23:29:19.977 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-23T23:29:19.977 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rc5t583.ko 2024-03-23T23:29:19.977 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-23T23:29:19.977 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 33657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-23T23:29:19.977 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 27737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-23T23:29:19.977 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 25161 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-23T23:29:19.977 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20017 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-23T23:29:19.977 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21521 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-s35390a.ko 2024-03-23T23:29:19.977 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-23T23:29:19.977 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17793 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-tps6586x.ko 2024-03-23T23:29:19.977 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21241 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-tps65910.ko 2024-03-23T23:29:19.977 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-wm831x.ko 2024-03-23T23:29:19.977 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-wm8350.ko 2024-03-23T23:29:19.978 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 27777 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-x1205.ko 2024-03-23T23:29:19.978 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/ 2024-03-23T23:29:19.978 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 77529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/3w-9xxx.ko 2024-03-23T23:29:19.978 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 57721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/3w-sas.ko 2024-03-23T23:29:19.978 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 55017 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/3w-xxxx.ko 2024-03-23T23:29:19.978 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 135345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/BusLogic.ko 2024-03-23T23:29:19.978 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/a100u2w.ko 2024-03-23T23:29:19.978 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aacraid/ 2024-03-23T23:29:19.978 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 271441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-23T23:29:19.978 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 100473 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/advansys.ko 2024-03-23T23:29:19.978 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aic7xxx/ 2024-03-23T23:29:19.978 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 356865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-23T23:29:19.978 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 295929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-23T23:29:19.978 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aic94xx/ 2024-03-23T23:29:19.979 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 189145 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-03-23T23:29:19.979 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/am53c974.ko 2024-03-23T23:29:19.979 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/arcmsr/ 2024-03-23T23:29:19.979 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 108209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-23T23:29:19.979 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 38097 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/atp870u.ko 2024-03-23T23:29:19.979 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/be2iscsi/ 2024-03-23T23:29:19.979 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 246937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-23T23:29:19.979 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bfa/ 2024-03-23T23:29:19.979 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 1171953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bfa/bfa.ko 2024-03-23T23:29:19.979 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bnx2fc/ 2024-03-23T23:29:19.979 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 238401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-23T23:29:19.979 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bnx2i/ 2024-03-23T23:29:19.979 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 115329 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-23T23:29:19.980 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 40785 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/ch.ko 2024-03-23T23:29:19.980 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/csiostor/ 2024-03-23T23:29:19.980 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 308961 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-23T23:29:19.980 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/ 2024-03-23T23:29:19.980 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-03-23T23:29:19.980 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 76041 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-23T23:29:19.980 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-03-23T23:29:19.980 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 101425 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-23T23:29:19.980 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 146753 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-23T23:29:19.980 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 75977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/dc395x.ko 2024-03-23T23:29:19.980 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 38209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/dmx3191d.ko 2024-03-23T23:29:19.980 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/esas2r/ 2024-03-23T23:29:19.980 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 212385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-23T23:29:19.980 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 60505 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/esp_scsi.ko 2024-03-23T23:29:19.981 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fcoe/ 2024-03-23T23:29:19.981 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 78225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-23T23:29:19.981 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 157729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-23T23:29:19.981 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18857 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fdomain.ko 2024-03-23T23:29:19.981 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fnic/ 2024-03-23T23:29:19.981 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 294953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fnic/fnic.ko 2024-03-23T23:29:19.981 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 201729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/hpsa.ko 2024-03-23T23:29:19.981 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 51121 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/hptiop.ko 2024-03-23T23:29:19.981 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 48945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/hv_storvsc.ko 2024-03-23T23:29:19.981 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 36129 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/imm.ko 2024-03-23T23:29:19.981 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 43977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/initio.ko 2024-03-23T23:29:19.981 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 265945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/ipr.ko 2024-03-23T23:29:19.981 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 101881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/ips.ko 2024-03-23T23:29:19.982 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/isci/ 2024-03-23T23:29:19.982 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 317193 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/isci/isci.ko 2024-03-23T23:29:19.982 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26289 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-23T23:29:19.982 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 52865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-23T23:29:19.982 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libfc/ 2024-03-23T23:29:19.982 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 315321 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libfc/libfc.ko 2024-03-23T23:29:19.982 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 145497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libiscsi.ko 2024-03-23T23:29:19.982 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 53809 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-23T23:29:19.982 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libsas/ 2024-03-23T23:29:19.982 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 216401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libsas/libsas.ko 2024-03-23T23:29:19.982 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/lpfc/ 2024-03-23T23:29:19.982 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 2194089 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-23T23:29:19.982 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid/ 2024-03-23T23:29:19.983 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 73473 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-23T23:29:19.983 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 33433 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-23T23:29:19.983 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 310689 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-23T23:29:19.983 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 85521 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid.ko 2024-03-23T23:29:19.983 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mpt3sas/ 2024-03-23T23:29:19.983 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 659633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-23T23:29:19.983 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mvsas/ 2024-03-23T23:29:19.983 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 119489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-23T23:29:19.983 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 78041 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mvumi.ko 2024-03-23T23:29:19.983 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/pcmcia/ 2024-03-23T23:29:19.983 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 81561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-03-23T23:29:19.983 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11617 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-03-23T23:29:19.983 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-03-23T23:29:19.984 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23761 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-03-23T23:29:19.984 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/pm8001/ 2024-03-23T23:29:19.984 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 366337 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-23T23:29:19.984 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 124601 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/pmcraid.ko 2024-03-23T23:29:19.984 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 34425 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/ppa.ko 2024-03-23T23:29:19.984 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 55337 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla1280.ko 2024-03-23T23:29:19.984 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla2xxx/ 2024-03-23T23:29:19.984 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 1876753 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-23T23:29:19.984 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 85193 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-23T23:29:19.984 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla4xxx/ 2024-03-23T23:29:19.984 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 558953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-23T23:29:19.984 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qlogicfas408.ko 2024-03-23T23:29:19.984 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/raid_class.ko 2024-03-23T23:29:19.984 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 261081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_debug.ko 2024-03-23T23:29:19.985 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 173929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-23T23:29:19.985 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 280113 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-23T23:29:19.985 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 97625 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-23T23:29:19.985 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 73865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-23T23:29:19.985 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 44889 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-23T23:29:19.985 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26161 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/ses.ko 2024-03-23T23:29:19.985 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 115649 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/st.ko 2024-03-23T23:29:19.985 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 46737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/stex.ko 2024-03-23T23:29:19.985 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/sym53c8xx_2/ 2024-03-23T23:29:19.985 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 164889 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-23T23:29:19.985 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 44857 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/virtio_scsi.ko 2024-03-23T23:29:19.985 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 50233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-23T23:29:19.985 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 39881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/wd719x.ko 2024-03-23T23:29:19.986 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 49929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/xen-scsifront.ko 2024-03-23T23:29:19.986 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ssb/ 2024-03-23T23:29:19.986 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 129393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ssb/ssb.ko 2024-03-23T23:29:19.986 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/ 2024-03-23T23:29:19.986 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/iscsi/ 2024-03-23T23:29:19.986 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 736761 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-23T23:29:19.986 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/loopback/ 2024-03-23T23:29:19.986 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 49881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-23T23:29:19.986 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 39617 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_file.ko 2024-03-23T23:29:19.986 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 42809 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_iblock.ko 2024-03-23T23:29:19.986 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 931521 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_mod.ko 2024-03-23T23:29:19.986 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 44153 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_pscsi.ko 2024-03-23T23:29:19.987 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 122489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_user.ko 2024-03-23T23:29:19.987 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/tcm_fc/ 2024-03-23T23:29:19.987 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 75521 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-23T23:29:19.987 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/ 2024-03-23T23:29:19.987 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/ 2024-03-23T23:29:19.987 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/ 2024-03-23T23:29:19.987 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-23T23:29:19.987 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 29225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-23T23:29:19.987 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9857 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-23T23:29:19.987 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-23T23:29:19.987 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14873 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-23T23:29:19.987 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16257 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-23T23:29:19.987 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 30425 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-23T23:29:19.988 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 22633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-23T23:29:19.988 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-23T23:29:19.988 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-23T23:29:19.988 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10753 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-23T23:29:19.988 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-23T23:29:19.988 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 36961 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-23T23:29:19.988 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14905 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-23T23:29:19.988 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11465 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-23T23:29:19.988 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 30809 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-03-23T23:29:19.989 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-23T23:29:19.989 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11417 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-23T23:29:19.989 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-23T23:29:19.989 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/ 2024-03-23T23:29:19.989 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/ipwireless/ 2024-03-23T23:29:19.989 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 78353 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-23T23:29:19.989 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 57777 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/moxa.ko 2024-03-23T23:29:19.989 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 50865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/mxser.ko 2024-03-23T23:29:19.989 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 108489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/n_gsm.ko 2024-03-23T23:29:19.989 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 31873 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/n_hdlc.ko 2024-03-23T23:29:19.989 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 67841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/nozomi.ko 2024-03-23T23:29:19.989 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/ 2024-03-23T23:29:19.990 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/8250/ 2024-03-23T23:29:19.990 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 34793 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-03-23T23:29:19.990 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 59401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-23T23:29:19.990 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-03-23T23:29:19.990 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 22481 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/altera_uart.ko 2024-03-23T23:29:19.990 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9337 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/arc_uart.ko 2024-03-23T23:29:19.990 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 72553 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-03-23T23:29:19.990 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/jsm/ 2024-03-23T23:29:19.990 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 101993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-23T23:29:19.990 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 28697 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/rp2.ko 2024-03-23T23:29:19.990 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 53177 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/sc16is7xx.ko 2024-03-23T23:29:19.990 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs/ 2024-03-23T23:29:19.990 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs/core/ 2024-03-23T23:29:19.991 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 545401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-23T23:29:19.991 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs/host/ 2024-03-23T23:29:19.991 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 28833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-23T23:29:19.991 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14513 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-03-23T23:29:19.991 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/ 2024-03-23T23:29:19.991 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 44473 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio.ko 2024-03-23T23:29:19.991 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12153 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_aec.ko 2024-03-23T23:29:19.991 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_cif.ko 2024-03-23T23:29:19.991 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_dmem_genirq.ko 2024-03-23T23:29:19.992 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_mf624.ko 2024-03-23T23:29:19.992 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12089 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_netx.ko 2024-03-23T23:29:19.992 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10505 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_pci_generic.ko 2024-03-23T23:29:19.992 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15961 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-03-23T23:29:19.992 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13545 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_sercos3.ko 2024-03-23T23:29:19.992 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/ 2024-03-23T23:29:19.992 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/c67x00/ 2024-03-23T23:29:19.992 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 73225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/c67x00/c67x00.ko 2024-03-23T23:29:19.992 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/chipidea/ 2024-03-23T23:29:19.992 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 145793 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-03-23T23:29:19.992 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-03-23T23:29:19.992 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-03-23T23:29:19.992 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12617 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-03-23T23:29:19.992 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13121 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-03-23T23:29:19.993 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class/ 2024-03-23T23:29:19.993 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 87009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class/cdc-acm.ko 2024-03-23T23:29:19.993 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 51257 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-23T23:29:19.993 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 47217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class/usblp.ko 2024-03-23T23:29:19.993 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 89769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class/usbtmc.ko 2024-03-23T23:29:19.993 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/common/ 2024-03-23T23:29:19.993 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 22865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/common/ulpi.ko 2024-03-23T23:29:19.993 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/dwc2/ 2024-03-23T23:29:19.993 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-03-23T23:29:19.994 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/dwc3/ 2024-03-23T23:29:19.994 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-03-23T23:29:19.994 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 30217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-03-23T23:29:19.994 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 452825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/dwc3/dwc3.ko 2024-03-23T23:29:19.994 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/ 2024-03-23T23:29:19.994 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/ 2024-03-23T23:29:19.994 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 60329 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/u_ether.ko 2024-03-23T23:29:19.994 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 51793 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/u_serial.ko 2024-03-23T23:29:19.994 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 28745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-03-23T23:29:19.994 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 42353 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-03-23T23:29:19.994 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 27857 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-03-23T23:29:19.994 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 36417 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-03-23T23:29:19.995 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 92409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-03-23T23:29:19.995 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 50945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-03-23T23:29:19.995 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 122257 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-03-23T23:29:19.995 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 59865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-03-23T23:29:19.995 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 22089 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-03-23T23:29:19.995 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 31169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-03-23T23:29:19.995 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 57633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-03-23T23:29:19.995 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 85521 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-03-23T23:29:19.995 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19177 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-03-23T23:29:19.995 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 58025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-03-23T23:29:19.996 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 67353 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-03-23T23:29:19.996 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/legacy/ 2024-03-23T23:29:19.996 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21177 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-03-23T23:29:19.996 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17969 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-03-23T23:29:19.996 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-03-23T23:29:19.996 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-03-23T23:29:19.996 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 28313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-03-23T23:29:19.996 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18921 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-03-23T23:29:19.996 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-03-23T23:29:19.996 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16889 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-03-23T23:29:19.996 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 31985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-03-23T23:29:19.996 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16697 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-03-23T23:29:19.997 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-03-23T23:29:19.997 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 27113 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-03-23T23:29:19.997 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 62369 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-03-23T23:29:19.997 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15105 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-03-23T23:29:19.997 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 161233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/libcomposite.ko 2024-03-23T23:29:19.997 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/udc/ 2024-03-23T23:29:19.997 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17609 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-03-23T23:29:19.997 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/udc/bdc/ 2024-03-23T23:29:19.997 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 157617 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-03-23T23:29:19.997 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 36001 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-03-23T23:29:19.997 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 52929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-03-23T23:29:19.998 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 69617 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-03-23T23:29:19.998 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 55953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-03-23T23:29:19.998 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 75969 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/udc/net2272.ko 2024-03-23T23:29:19.998 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 74985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/udc/net2280.ko 2024-03-23T23:29:19.998 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 73017 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-03-23T23:29:19.998 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 65881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-03-23T23:29:19.998 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 66001 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-03-23T23:29:19.998 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 81409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-03-23T23:29:19.998 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 156337 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-03-23T23:29:19.998 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/host/ 2024-03-23T23:29:19.998 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11505 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/host/bcma-hcd.ko 2024-03-23T23:29:19.998 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 80017 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/host/isp116x-hcd.ko 2024-03-23T23:29:19.998 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 87193 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-03-23T23:29:19.999 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 78777 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-03-23T23:29:19.999 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 51393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-23T23:29:19.999 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15505 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/host/sl811_cs.ko 2024-03-23T23:29:19.999 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/host/ssb-hcd.ko 2024-03-23T23:29:19.999 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26625 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-03-23T23:29:19.999 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/image/ 2024-03-23T23:29:19.999 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 34497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/image/mdc800.ko 2024-03-23T23:29:19.999 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/image/microtek.ko 2024-03-23T23:29:19.999 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/ 2024-03-23T23:29:19.999 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 41633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/adutux.ko 2024-03-23T23:29:19.999 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20617 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/appledisplay.ko 2024-03-23T23:29:19.999 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17625 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-03-23T23:29:19.999 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 22961 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/cytherm.ko 2024-03-23T23:29:19.999 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13641 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/ehset.ko 2024-03-23T23:29:20.000 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14969 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/emi26.ko 2024-03-23T23:29:20.000 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/emi62.ko 2024-03-23T23:29:20.000 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/ezusb.ko 2024-03-23T23:29:20.000 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19145 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/idmouse.ko 2024-03-23T23:29:20.000 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 36457 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/iowarrior.ko 2024-03-23T23:29:20.000 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-23T23:29:20.000 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 36441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/ldusb.ko 2024-03-23T23:29:20.000 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 36105 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/legousbtower.ko 2024-03-23T23:29:20.000 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 27705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/lvstest.ko 2024-03-23T23:29:20.000 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/sisusbvga/ 2024-03-23T23:29:20.000 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 64745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-23T23:29:20.000 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-23T23:29:20.000 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/usb3503.ko 2024-03-23T23:29:20.000 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 25057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/usblcd.ko 2024-03-23T23:29:20.001 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 22657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-23T23:29:20.001 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 70721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/usbtest.ko 2024-03-23T23:29:20.001 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 41817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/uss720.ko 2024-03-23T23:29:20.001 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 27225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/yurex.ko 2024-03-23T23:29:20.001 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/mon/ 2024-03-23T23:29:20.001 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 72825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/mon/usbmon.ko 2024-03-23T23:29:20.001 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/musb/ 2024-03-23T23:29:20.001 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 301633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/musb/musb_hdrc.ko 2024-03-23T23:29:20.001 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/phy/ 2024-03-23T23:29:20.001 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20961 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/phy/phy-generic.ko 2024-03-23T23:29:20.001 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20073 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-03-23T23:29:20.001 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12161 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/phy/phy-isp1301.ko 2024-03-23T23:29:20.001 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21649 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/phy/phy-tahvo.ko 2024-03-23T23:29:20.001 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ 2024-03-23T23:29:20.002 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13121 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/aircable.ko 2024-03-23T23:29:20.002 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 33241 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ark3116.ko 2024-03-23T23:29:20.002 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-23T23:29:20.002 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 38017 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ch341.ko 2024-03-23T23:29:20.002 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 70281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/cp210x.ko 2024-03-23T23:29:20.002 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 30961 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/cyberjack.ko 2024-03-23T23:29:20.002 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 58121 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-23T23:29:20.002 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 49721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-23T23:29:20.002 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/empeg.ko 2024-03-23T23:29:20.003 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 44185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/f81232.ko 2024-03-23T23:29:20.003 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 175105 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-23T23:29:20.003 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 53017 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-23T23:29:20.003 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 136985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-23T23:29:20.003 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 124745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/io_ti.ko 2024-03-23T23:29:20.003 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 67681 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ipaq.ko 2024-03-23T23:29:20.003 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19073 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ipw.ko 2024-03-23T23:29:20.003 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26809 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ir-usb.ko 2024-03-23T23:29:20.003 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 58137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-23T23:29:20.003 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 107433 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/keyspan.ko 2024-03-23T23:29:20.004 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 35521 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-23T23:29:20.004 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 25569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-23T23:29:20.004 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 33593 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-23T23:29:20.004 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 32865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/mct_u232.ko 2024-03-23T23:29:20.004 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/metro-usb.ko 2024-03-23T23:29:20.004 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 66361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/mos7720.ko 2024-03-23T23:29:20.004 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 78129 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/mos7840.ko 2024-03-23T23:29:20.004 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 56249 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/mxuport.ko 2024-03-23T23:29:20.004 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/navman.ko 2024-03-23T23:29:20.005 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11921 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/omninet.ko 2024-03-23T23:29:20.005 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 24545 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/opticon.ko 2024-03-23T23:29:20.005 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 191825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/option.ko 2024-03-23T23:29:20.005 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 38985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/oti6858.ko 2024-03-23T23:29:20.005 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 54265 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/pl2303.ko 2024-03-23T23:29:20.005 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9649 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/qcaux.ko 2024-03-23T23:29:20.005 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 38025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/qcserial.ko 2024-03-23T23:29:20.005 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 34233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/quatech2.ko 2024-03-23T23:29:20.005 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15297 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/safe_serial.ko 2024-03-23T23:29:20.006 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 51537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/sierra.ko 2024-03-23T23:29:20.006 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21585 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-23T23:29:20.006 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 29905 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ssu100.ko 2024-03-23T23:29:20.006 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/symbolserial.ko 2024-03-23T23:29:20.006 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 61393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-23T23:29:20.006 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23625 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-23T23:29:20.006 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10145 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/usb_debug.ko 2024-03-23T23:29:20.006 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 33113 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-23T23:29:20.006 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 125529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/usbserial.ko 2024-03-23T23:29:20.006 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 28665 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/visor.ko 2024-03-23T23:29:20.006 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 37313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/whiteheat.ko 2024-03-23T23:29:20.006 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/wishbone-serial.ko 2024-03-23T23:29:20.006 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-23T23:29:20.006 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ 2024-03-23T23:29:20.007 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 52761 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/uas.ko 2024-03-23T23:29:20.007 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 25857 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-23T23:29:20.007 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-23T23:29:20.007 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21889 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-23T23:29:20.007 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 33401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-23T23:29:20.007 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-23T23:29:20.007 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19521 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-23T23:29:20.007 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-23T23:29:20.007 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-karma.ko 2024-03-23T23:29:20.007 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-23T23:29:20.007 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 28345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-23T23:29:20.007 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 28809 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-23T23:29:20.007 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19425 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-23T23:29:20.008 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 35249 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-23T23:29:20.008 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 180329 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/usb-storage.ko 2024-03-23T23:29:20.008 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/usbip/ 2024-03-23T23:29:20.008 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 67401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-23T23:29:20.008 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 71025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-23T23:29:20.008 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 104065 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-23T23:29:20.008 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/ 2024-03-23T23:29:20.008 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/pci/ 2024-03-23T23:29:20.008 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 162865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-23T23:29:20.008 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 29393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-23T23:29:20.008 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 103673 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/vfio.ko 2024-03-23T23:29:20.008 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 76441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-23T23:29:20.008 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost/ 2024-03-23T23:29:20.009 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 113665 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost/vhost.ko 2024-03-23T23:29:20.009 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16913 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-23T23:29:20.009 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 58001 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost/vhost_net.ko 2024-03-23T23:29:20.009 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 89057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost/vhost_scsi.ko 2024-03-23T23:29:20.009 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/ 2024-03-23T23:29:20.009 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/ 2024-03-23T23:29:20.009 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15321 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-03-23T23:29:20.009 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12297 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/aat2870_bl.ko 2024-03-23T23:29:20.009 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/adp5520_bl.ko 2024-03-23T23:29:20.009 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 32513 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/adp8860_bl.ko 2024-03-23T23:29:20.009 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 39897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/adp8870_bl.ko 2024-03-23T23:29:20.009 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/apple_bl.ko 2024-03-23T23:29:20.009 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16681 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/as3711_bl.ko 2024-03-23T23:29:20.009 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/bd6107.ko 2024-03-23T23:29:20.010 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/da903x_bl.ko 2024-03-23T23:29:20.010 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11177 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/da9052_bl.ko 2024-03-23T23:29:20.010 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/gpio_backlight.ko 2024-03-23T23:29:20.010 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14673 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/kb3886_bl.ko 2024-03-23T23:29:20.010 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/lcd.ko 2024-03-23T23:29:20.010 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/lm3533_bl.ko 2024-03-23T23:29:20.010 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19241 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/lm3639_bl.ko 2024-03-23T23:29:20.010 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11337 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/lv5207lp.ko 2024-03-23T23:29:20.010 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14249 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/max8925_bl.ko 2024-03-23T23:29:20.010 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/pandora_bl.ko 2024-03-23T23:29:20.010 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10761 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-03-23T23:29:20.010 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10801 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-23T23:29:20.010 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12625 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/wm831x_bl.ko 2024-03-23T23:29:20.011 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/ 2024-03-23T23:29:20.011 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/masters/ 2024-03-23T23:29:20.011 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18697 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/masters/ds2482.ko 2024-03-23T23:29:20.011 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 39121 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/masters/ds2490.ko 2024-03-23T23:29:20.011 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/masters/matrox_w1.ko 2024-03-23T23:29:20.011 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11273 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/masters/w1-gpio.ko 2024-03-23T23:29:20.011 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/ 2024-03-23T23:29:20.011 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-23T23:29:20.011 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 22649 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-23T23:29:20.011 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15017 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-23T23:29:20.011 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-23T23:29:20.011 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-23T23:29:20.011 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-23T23:29:20.011 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-23T23:29:20.012 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-23T23:29:20.012 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-23T23:29:20.012 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 7297 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-23T23:29:20.012 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 56337 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-23T23:29:20.012 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 103049 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/wire.ko 2024-03-23T23:29:20.012 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/ 2024-03-23T23:29:20.012 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/acquirewdt.ko 2024-03-23T23:29:20.012 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20545 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/advantechwdt.ko 2024-03-23T23:29:20.012 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18465 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-23T23:29:20.012 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 22873 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-23T23:29:20.012 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/cpu5wdt.ko 2024-03-23T23:29:20.012 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13521 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/da9052_wdt.ko 2024-03-23T23:29:20.012 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12681 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/da9055_wdt.ko 2024-03-23T23:29:20.013 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/da9063_wdt.ko 2024-03-23T23:29:20.013 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/dw_wdt.ko 2024-03-23T23:29:20.013 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/eurotechwdt.ko 2024-03-23T23:29:20.013 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-23T23:29:20.013 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 27393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/hpwdt.ko 2024-03-23T23:29:20.013 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/i6300esb.ko 2024-03-23T23:29:20.013 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-23T23:29:20.013 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-23T23:29:20.013 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19641 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/ib700wdt.ko 2024-03-23T23:29:20.013 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18601 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/ibmasr.ko 2024-03-23T23:29:20.013 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19617 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-23T23:29:20.013 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21129 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-23T23:29:20.014 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14001 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/it87_wdt.ko 2024-03-23T23:29:20.014 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21393 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/kempld_wdt.ko 2024-03-23T23:29:20.014 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/machzwd.ko 2024-03-23T23:29:20.014 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14625 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/mena21_wdt.ko 2024-03-23T23:29:20.014 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13121 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-03-23T23:29:20.014 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 24585 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/nv_tco.ko 2024-03-23T23:29:20.014 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-03-23T23:29:20.014 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/pc87413_wdt.ko 2024-03-23T23:29:20.014 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 39921 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-23T23:29:20.014 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 31737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-23T23:29:20.014 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/retu_wdt.ko 2024-03-23T23:29:20.014 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-03-23T23:29:20.015 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14033 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-03-23T23:29:20.015 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-23T23:29:20.015 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 24633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/sc1200wdt.ko 2024-03-23T23:29:20.015 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-23T23:29:20.015 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21481 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-03-23T23:29:20.015 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/softdog.ko 2024-03-23T23:29:20.015 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 22177 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-23T23:29:20.015 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/twl4030_wdt.ko 2024-03-23T23:29:20.015 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/via_wdt.ko 2024-03-23T23:29:20.015 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20241 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-23T23:29:20.015 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-23T23:29:20.015 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 28569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-23T23:29:20.015 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19513 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/wafer5823wdt.ko 2024-03-23T23:29:20.016 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 28001 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/wdt_pci.ko 2024-03-23T23:29:20.016 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16161 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/wm831x_wdt.ko 2024-03-23T23:29:20.016 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13689 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/wm8350_wdt.ko 2024-03-23T23:29:20.016 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15609 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/xen_wdt.ko 2024-03-23T23:29:20.016 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/ 2024-03-23T23:29:20.016 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 24633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-evtchn.ko 2024-03-23T23:29:20.016 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26673 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-gntalloc.ko 2024-03-23T23:29:20.016 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 47769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-gntdev.ko 2024-03-23T23:29:20.016 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-pciback/ 2024-03-23T23:29:20.016 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 176385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-23T23:29:20.016 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 40097 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-privcmd.ko 2024-03-23T23:29:20.016 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 71153 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-scsiback.ko 2024-03-23T23:29:20.016 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xenfs/ 2024-03-23T23:29:20.016 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-23T23:29:20.017 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ 2024-03-23T23:29:20.017 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/9p/ 2024-03-23T23:29:20.017 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 158281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/9p/9p.ko 2024-03-23T23:29:20.017 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/adfs/ 2024-03-23T23:29:20.017 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 61721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/adfs/adfs.ko 2024-03-23T23:29:20.017 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/affs/ 2024-03-23T23:29:20.017 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 163417 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/affs/affs.ko 2024-03-23T23:29:20.017 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/afs/ 2024-03-23T23:29:20.017 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 1019225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/afs/kafs.ko 2024-03-23T23:29:20.017 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/autofs/ 2024-03-23T23:29:20.017 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 103225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/autofs/autofs4.ko 2024-03-23T23:29:20.017 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/befs/ 2024-03-23T23:29:20.017 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 64625 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/befs/befs.ko 2024-03-23T23:29:20.018 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/bfs/ 2024-03-23T23:29:20.018 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 41017 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/bfs/bfs.ko 2024-03-23T23:29:20.018 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 38649 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/binfmt_misc.ko 2024-03-23T23:29:20.018 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/btrfs/ 2024-03-23T23:29:20.018 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 3487553 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/btrfs/btrfs.ko 2024-03-23T23:29:20.018 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/cachefiles/ 2024-03-23T23:29:20.018 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 305897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/cachefiles/cachefiles.ko 2024-03-23T23:29:20.018 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ceph/ 2024-03-23T23:29:20.018 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 1335721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ceph/ceph.ko 2024-03-23T23:29:20.018 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/coda/ 2024-03-23T23:29:20.018 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 97769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/coda/coda.ko 2024-03-23T23:29:20.018 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/configfs/ 2024-03-23T23:29:20.018 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 108577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/configfs/configfs.ko 2024-03-23T23:29:20.019 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/cramfs/ 2024-03-23T23:29:20.019 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 29593 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/cramfs/cramfs.ko 2024-03-23T23:29:20.019 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/dlm/ 2024-03-23T23:29:20.019 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 644249 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/dlm/dlm.ko 2024-03-23T23:29:20.019 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/efs/ 2024-03-23T23:29:20.019 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 36729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/efs/efs.ko 2024-03-23T23:29:20.019 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/f2fs/ 2024-03-23T23:29:20.019 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 1527665 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/f2fs/f2fs.ko 2024-03-23T23:29:20.019 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fat/ 2024-03-23T23:29:20.019 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 27841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fat/msdos.ko 2024-03-23T23:29:20.019 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/freevxfs/ 2024-03-23T23:29:20.019 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 42561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/freevxfs/freevxfs.ko 2024-03-23T23:29:20.019 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fuse/ 2024-03-23T23:29:20.020 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 24297 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fuse/cuse.ko 2024-03-23T23:29:20.020 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/gfs2/ 2024-03-23T23:29:20.020 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 1231361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/gfs2/gfs2.ko 2024-03-23T23:29:20.020 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/hfs/ 2024-03-23T23:29:20.020 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 141713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/hfs/hfs.ko 2024-03-23T23:29:20.020 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/hfsplus/ 2024-03-23T23:29:20.020 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 223281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/hfsplus/hfsplus.ko 2024-03-23T23:29:20.020 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/hpfs/ 2024-03-23T23:29:20.020 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 193545 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/hpfs/hpfs.ko 2024-03-23T23:29:20.020 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/isofs/ 2024-03-23T23:29:20.020 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 74737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/isofs/isofs.ko 2024-03-23T23:29:20.020 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/jfs/ 2024-03-23T23:29:20.021 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 420449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/jfs/jfs.ko 2024-03-23T23:29:20.021 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/lockd/ 2024-03-23T23:29:20.021 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 281705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/lockd/lockd.ko 2024-03-23T23:29:20.021 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/minix/ 2024-03-23T23:29:20.021 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 88937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/minix/minix.ko 2024-03-23T23:29:20.021 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/netfs/ 2024-03-23T23:29:20.021 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 490505 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/netfs/netfs.ko 2024-03-23T23:29:20.021 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/ 2024-03-23T23:29:20.022 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/blocklayout/ 2024-03-23T23:29:20.022 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 81457 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-23T23:29:20.022 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/filelayout/ 2024-03-23T23:29:20.022 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 59353 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-23T23:29:20.022 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/flexfilelayout/ 2024-03-23T23:29:20.022 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 117377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-23T23:29:20.022 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 1058377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/nfs.ko 2024-03-23T23:29:20.022 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 66361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/nfsv2.ko 2024-03-23T23:29:20.022 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 120193 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/nfsv3.ko 2024-03-23T23:29:20.022 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 2041825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/nfsv4.ko 2024-03-23T23:29:20.022 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs_common/ 2024-03-23T23:29:20.022 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs_common/grace.ko 2024-03-23T23:29:20.023 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs_common/nfs_acl.ko 2024-03-23T23:29:20.023 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfsd/ 2024-03-23T23:29:20.023 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 1511665 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfsd/nfsd.ko 2024-03-23T23:29:20.023 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nilfs2/ 2024-03-23T23:29:20.023 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 582529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nilfs2/nilfs2.ko 2024-03-23T23:29:20.023 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/ 2024-03-23T23:29:20.023 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13697 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-celtic.ko 2024-03-23T23:29:20.023 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13073 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-centeuro.ko 2024-03-23T23:29:20.023 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13697 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-croatian.ko 2024-03-23T23:29:20.023 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-cyrillic.ko 2024-03-23T23:29:20.023 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-gaelic.ko 2024-03-23T23:29:20.023 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12761 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-greek.ko 2024-03-23T23:29:20.023 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13697 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-iceland.ko 2024-03-23T23:29:20.024 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13073 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-inuit.ko 2024-03-23T23:29:20.024 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14001 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-roman.ko 2024-03-23T23:29:20.024 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13697 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-romanian.ko 2024-03-23T23:29:20.024 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13697 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-turkish.ko 2024-03-23T23:29:20.024 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_ascii.ko 2024-03-23T23:29:20.024 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp1250.ko 2024-03-23T23:29:20.024 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp1251.ko 2024-03-23T23:29:20.024 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp1255.ko 2024-03-23T23:29:20.024 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp737.ko 2024-03-23T23:29:20.024 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp775.ko 2024-03-23T23:29:20.024 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12129 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp850.ko 2024-03-23T23:29:20.024 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12129 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp852.ko 2024-03-23T23:29:20.024 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12129 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp855.ko 2024-03-23T23:29:20.025 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp857.ko 2024-03-23T23:29:20.025 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12753 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp860.ko 2024-03-23T23:29:20.025 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13065 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp861.ko 2024-03-23T23:29:20.025 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp862.ko 2024-03-23T23:29:20.025 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13065 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp863.ko 2024-03-23T23:29:20.025 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12753 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp864.ko 2024-03-23T23:29:20.025 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13065 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp865.ko 2024-03-23T23:29:20.025 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp866.ko 2024-03-23T23:29:20.025 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12129 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp869.ko 2024-03-23T23:29:20.025 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11889 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp874.ko 2024-03-23T23:29:20.025 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 94041 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp932.ko 2024-03-23T23:29:20.025 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 142577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp936.ko 2024-03-23T23:29:20.025 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 165649 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp949.ko 2024-03-23T23:29:20.026 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 118025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp950.ko 2024-03-23T23:29:20.026 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12369 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_euc-jp.ko 2024-03-23T23:29:20.026 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-1.ko 2024-03-23T23:29:20.026 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-13.ko 2024-03-23T23:29:20.026 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-14.ko 2024-03-23T23:29:20.026 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-15.ko 2024-03-23T23:29:20.026 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-2.ko 2024-03-23T23:29:20.026 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-3.ko 2024-03-23T23:29:20.026 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-4.ko 2024-03-23T23:29:20.026 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-5.ko 2024-03-23T23:29:20.026 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11521 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-6.ko 2024-03-23T23:29:20.026 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-7.ko 2024-03-23T23:29:20.026 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11521 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-9.ko 2024-03-23T23:29:20.027 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_koi8-r.ko 2024-03-23T23:29:20.027 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 7929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_koi8-ru.ko 2024-03-23T23:29:20.027 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_koi8-u.ko 2024-03-23T23:29:20.027 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 7473 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-23T23:29:20.027 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8257 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_utf8.ko 2024-03-23T23:29:20.027 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ntfs/ 2024-03-23T23:29:20.027 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 220545 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ntfs/ntfs.ko 2024-03-23T23:29:20.027 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/ 2024-03-23T23:29:20.027 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/cluster/ 2024-03-23T23:29:20.027 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 244673 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-23T23:29:20.027 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/dlm/ 2024-03-23T23:29:20.027 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 440681 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-23T23:29:20.027 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/dlmfs/ 2024-03-23T23:29:20.028 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 54177 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-23T23:29:20.028 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 2590849 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/ocfs2.ko 2024-03-23T23:29:20.070 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-23T23:29:20.070 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 31633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-23T23:29:20.070 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 35737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-23T23:29:20.070 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/omfs/ 2024-03-23T23:29:20.070 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 53705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/omfs/omfs.ko 2024-03-23T23:29:20.070 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/overlayfs/ 2024-03-23T23:29:20.070 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 360953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/overlayfs/overlay.ko 2024-03-23T23:29:20.071 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/pstore/ 2024-03-23T23:29:20.071 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 56945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/pstore/ramoops.ko 2024-03-23T23:29:20.071 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/qnx4/ 2024-03-23T23:29:20.071 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26913 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/qnx4/qnx4.ko 2024-03-23T23:29:20.071 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/qnx6/ 2024-03-23T23:29:20.071 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 46625 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/qnx6/qnx6.ko 2024-03-23T23:29:20.071 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/quota/ 2024-03-23T23:29:20.071 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 30785 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/quota/quota_tree.ko 2024-03-23T23:29:20.071 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/quota/quota_v1.ko 2024-03-23T23:29:20.071 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/quota/quota_v2.ko 2024-03-23T23:29:20.071 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/reiserfs/ 2024-03-23T23:29:20.072 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 532289 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/reiserfs/reiserfs.ko 2024-03-23T23:29:20.072 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/romfs/ 2024-03-23T23:29:20.072 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 28905 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/romfs/romfs.ko 2024-03-23T23:29:20.072 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/ 2024-03-23T23:29:20.072 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/client/ 2024-03-23T23:29:20.072 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 2712601 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/client/cifs.ko 2024-03-23T23:29:20.072 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/common/ 2024-03-23T23:29:20.072 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 7065 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/common/cifs_arc4.ko 2024-03-23T23:29:20.072 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/common/cifs_md4.ko 2024-03-23T23:29:20.072 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/squashfs/ 2024-03-23T23:29:20.072 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 134809 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/squashfs/squashfs.ko 2024-03-23T23:29:20.072 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/sysv/ 2024-03-23T23:29:20.073 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 91329 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/sysv/sysv.ko 2024-03-23T23:29:20.073 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/udf/ 2024-03-23T23:29:20.073 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 248409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/udf/udf.ko 2024-03-23T23:29:20.073 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ufs/ 2024-03-23T23:29:20.073 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 162785 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ufs/ufs.ko 2024-03-23T23:29:20.073 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/xfs/ 2024-03-23T23:29:20.073 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 4036193 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/xfs/xfs.ko 2024-03-23T23:29:20.073 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/ 2024-03-23T23:29:20.073 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/locking/ 2024-03-23T23:29:20.074 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 80489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/locking/locktorture.ko 2024-03-23T23:29:20.074 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/time/ 2024-03-23T23:29:20.074 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13641 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/time/test_udelay.ko 2024-03-23T23:29:20.074 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 60265 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/torture.ko 2024-03-23T23:29:20.074 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/ 2024-03-23T23:29:20.074 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 6737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crc-itu-t.ko 2024-03-23T23:29:20.074 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 6441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crc7.ko 2024-03-23T23:29:20.074 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 6937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crc8.ko 2024-03-23T23:29:20.074 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crypto/ 2024-03-23T23:29:20.074 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 7009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crypto/libarc4.ko 2024-03-23T23:29:20.075 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 36993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crypto/libdes.ko 2024-03-23T23:29:20.075 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/interval_tree_test.ko 2024-03-23T23:29:20.075 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8329 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/libcrc32c.ko 2024-03-23T23:29:20.075 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 24857 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/lru_cache.ko 2024-03-23T23:29:20.075 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/lz4/ 2024-03-23T23:29:20.075 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 33705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/lz4/lz4_compress.ko 2024-03-23T23:29:20.075 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 22537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/lz4/lz4hc_compress.ko 2024-03-23T23:29:20.075 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/math/ 2024-03-23T23:29:20.075 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 6529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/math/cordic.ko 2024-03-23T23:29:20.075 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8121 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/memory-notifier-error-inject.ko 2024-03-23T23:29:20.075 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10761 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/notifier-error-inject.ko 2024-03-23T23:29:20.075 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/percpu_test.ko 2024-03-23T23:29:20.076 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/pm-notifier-error-inject.ko 2024-03-23T23:29:20.076 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/raid6/ 2024-03-23T23:29:20.076 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 143337 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/raid6/raid6_pq.ko 2024-03-23T23:29:20.076 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21017 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/rbtree_test.ko 2024-03-23T23:29:20.076 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/reed_solomon/ 2024-03-23T23:29:20.076 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-23T23:29:20.076 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 38745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/test-kstrtox.ko 2024-03-23T23:29:20.076 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/test-string_helpers.ko 2024-03-23T23:29:20.076 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 4863225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/test_bpf.ko 2024-03-23T23:29:20.077 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 48993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/test_firmware.ko 2024-03-23T23:29:20.077 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 6281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/test_module.ko 2024-03-23T23:29:20.077 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/test_user_copy.ko 2024-03-23T23:29:20.077 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/ts_bm.ko 2024-03-23T23:29:20.077 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11033 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/ts_fsm.ko 2024-03-23T23:29:20.077 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/ts_kmp.ko 2024-03-23T23:29:20.077 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/xz/ 2024-03-23T23:29:20.077 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/xz/xz_dec_test.ko 2024-03-23T23:29:20.077 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/mm/ 2024-03-23T23:29:20.077 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18129 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/mm/hwpoison-inject.ko 2024-03-23T23:29:20.077 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ 2024-03-23T23:29:20.077 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/ 2024-03-23T23:29:20.077 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 55777 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/6lowpan.ko 2024-03-23T23:29:20.078 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 6961 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_dest.ko 2024-03-23T23:29:20.078 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 6969 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_fragment.ko 2024-03-23T23:29:20.078 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 6961 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_hop.ko 2024-03-23T23:29:20.078 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 6897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-23T23:29:20.078 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 6969 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_mobility.ko 2024-03-23T23:29:20.078 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 6905 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_routing.ko 2024-03-23T23:29:20.078 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15241 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_udp.ko 2024-03-23T23:29:20.078 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/ 2024-03-23T23:29:20.078 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 30409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/garp.ko 2024-03-23T23:29:20.078 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 34753 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/mrp.ko 2024-03-23T23:29:20.078 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/p8022.ko 2024-03-23T23:29:20.078 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/psnap.ko 2024-03-23T23:29:20.079 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/stp.ko 2024-03-23T23:29:20.079 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/8021q/ 2024-03-23T23:29:20.079 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 82897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/8021q/8021q.ko 2024-03-23T23:29:20.079 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p/ 2024-03-23T23:29:20.079 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 198833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p/9pnet.ko 2024-03-23T23:29:20.079 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 36145 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p/9pnet_fd.ko 2024-03-23T23:29:20.079 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26249 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p/9pnet_rdma.ko 2024-03-23T23:29:20.079 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 32249 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p/9pnet_virtio.ko 2024-03-23T23:29:20.079 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/batman-adv/ 2024-03-23T23:29:20.079 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 667545 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/batman-adv/batman-adv.ko 2024-03-23T23:29:20.080 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/ 2024-03-23T23:29:20.080 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 67769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/br_netfilter.ko 2024-03-23T23:29:20.080 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 790673 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/bridge.ko 2024-03-23T23:29:20.080 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ 2024-03-23T23:29:20.080 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 7561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-23T23:29:20.080 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12289 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-23T23:29:20.080 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-23T23:29:20.080 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-23T23:29:20.081 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-23T23:29:20.081 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8649 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-23T23:29:20.081 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-23T23:29:20.081 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-23T23:29:20.081 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13193 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-23T23:29:20.081 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 7497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-23T23:29:20.081 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 7497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-23T23:29:20.081 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8289 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-23T23:29:20.081 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 7441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-23T23:29:20.082 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-23T23:29:20.082 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-23T23:29:20.082 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-23T23:29:20.082 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-23T23:29:20.082 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11545 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-23T23:29:20.082 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-23T23:29:20.082 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-23T23:29:20.082 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 55945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebtables.ko 2024-03-23T23:29:20.082 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-23T23:29:20.082 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13849 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-23T23:29:20.082 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ceph/ 2024-03-23T23:29:20.082 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 1046825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ceph/libceph.ko 2024-03-23T23:29:20.082 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/core/ 2024-03-23T23:29:20.083 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 125705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/core/pktgen.ko 2024-03-23T23:29:20.083 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp/ 2024-03-23T23:29:20.083 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 194505 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp/dccp.ko 2024-03-23T23:29:20.083 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp/dccp_diag.ko 2024-03-23T23:29:20.083 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 58745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp/dccp_ipv4.ko 2024-03-23T23:29:20.083 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 61401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp/dccp_ipv6.ko 2024-03-23T23:29:20.083 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/ 2024-03-23T23:29:20.083 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 390089 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/dsa_core.ko 2024-03-23T23:29:20.083 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/tag_brcm.ko 2024-03-23T23:29:20.083 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12601 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/tag_dsa.ko 2024-03-23T23:29:20.083 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 7745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/tag_none.ko 2024-03-23T23:29:20.083 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/tag_trailer.ko 2024-03-23T23:29:20.083 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/hsr/ 2024-03-23T23:29:20.084 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 102073 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/hsr/hsr.ko 2024-03-23T23:29:20.084 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154/ 2024-03-23T23:29:20.084 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154/6lowpan/ 2024-03-23T23:29:20.084 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 45505 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-23T23:29:20.084 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 284721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154/ieee802154.ko 2024-03-23T23:29:20.084 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 47881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-23T23:29:20.084 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ 2024-03-23T23:29:20.084 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 24785 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ah4.ko 2024-03-23T23:29:20.084 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 39097 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/esp4.ko 2024-03-23T23:29:20.084 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 48249 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/fou.ko 2024-03-23T23:29:20.084 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18033 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/gre.ko 2024-03-23T23:29:20.084 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 51217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/inet_diag.ko 2024-03-23T23:29:20.084 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 61137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ip_gre.ko 2024-03-23T23:29:20.085 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 61513 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ip_tunnel.ko 2024-03-23T23:29:20.085 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 34929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ip_vti.ko 2024-03-23T23:29:20.085 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ipcomp.ko 2024-03-23T23:29:20.085 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 29081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ipip.ko 2024-03-23T23:29:20.085 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ 2024-03-23T23:29:20.085 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 38009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-23T23:29:20.085 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8777 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-23T23:29:20.085 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10321 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-23T23:29:20.085 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 42057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ip_tables.ko 2024-03-23T23:29:20.085 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9969 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-23T23:29:20.085 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9585 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-03-23T23:29:20.085 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-23T23:29:20.085 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11089 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-23T23:29:20.086 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14785 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-23T23:29:20.086 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-03-23T23:29:20.086 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-23T23:29:20.086 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-23T23:29:20.086 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-23T23:29:20.086 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10321 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-23T23:29:20.086 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-23T23:29:20.086 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-23T23:29:20.086 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 27529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-23T23:29:20.086 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-23T23:29:20.086 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13241 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-23T23:29:20.086 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21041 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-03-23T23:29:20.086 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-23T23:29:20.087 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-23T23:29:20.087 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-23T23:29:20.087 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17017 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-23T23:29:20.087 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8913 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-23T23:29:20.087 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_bic.ko 2024-03-23T23:29:20.087 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13649 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_dctcp.ko 2024-03-23T23:29:20.087 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15969 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_diag.ko 2024-03-23T23:29:20.087 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_highspeed.ko 2024-03-23T23:29:20.087 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_htcp.ko 2024-03-23T23:29:20.087 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10353 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_hybla.ko 2024-03-23T23:29:20.087 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_illinois.ko 2024-03-23T23:29:20.087 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_lp.ko 2024-03-23T23:29:20.087 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_scalable.ko 2024-03-23T23:29:20.087 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14329 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_vegas.ko 2024-03-23T23:29:20.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10001 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_veno.ko 2024-03-23T23:29:20.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10857 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_westwood.ko 2024-03-23T23:29:20.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10097 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_yeah.ko 2024-03-23T23:29:20.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 22633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tunnel4.ko 2024-03-23T23:29:20.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/udp_diag.ko 2024-03-23T23:29:20.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 45057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/udp_tunnel.ko 2024-03-23T23:29:20.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-23T23:29:20.088 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ 2024-03-23T23:29:20.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ah6.ko 2024-03-23T23:29:20.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 39729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/esp6.ko 2024-03-23T23:29:20.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/fou6.ko 2024-03-23T23:29:20.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 79929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ip6_gre.ko 2024-03-23T23:29:20.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 94169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ip6_tunnel.ko 2024-03-23T23:29:20.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14257 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-23T23:29:20.089 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 54273 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ip6_vti.ko 2024-03-23T23:29:20.089 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ipcomp6.ko 2024-03-23T23:29:20.089 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/mip6.ko 2024-03-23T23:29:20.089 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ 2024-03-23T23:29:20.089 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 42553 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-23T23:29:20.089 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11665 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-03-23T23:29:20.089 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-23T23:29:20.089 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14041 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-23T23:29:20.089 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-23T23:29:20.089 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 7705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-23T23:29:20.089 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16113 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-23T23:29:20.089 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-23T23:29:20.089 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-23T23:29:20.090 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9809 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-23T23:29:20.090 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-23T23:29:20.090 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10809 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-23T23:29:20.090 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-23T23:29:20.090 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11033 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-23T23:29:20.090 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15025 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-23T23:29:20.090 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-23T23:29:20.090 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10337 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-23T23:29:20.090 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 39137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-23T23:29:20.090 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8353 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-23T23:29:20.090 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 25265 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-23T23:29:20.090 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-23T23:29:20.090 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15297 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-23T23:29:20.091 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-23T23:29:20.091 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-23T23:29:20.091 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8913 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-23T23:29:20.091 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 74881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/sit.ko 2024-03-23T23:29:20.091 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 24153 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/tunnel6.ko 2024-03-23T23:29:20.091 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23297 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-23T23:29:20.091 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/key/ 2024-03-23T23:29:20.091 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 84401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/key/af_key.ko 2024-03-23T23:29:20.091 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/ 2024-03-23T23:29:20.091 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 125209 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_core.ko 2024-03-23T23:29:20.091 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-23T23:29:20.091 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 25817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_eth.ko 2024-03-23T23:29:20.091 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 36497 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_ip.ko 2024-03-23T23:29:20.092 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 37377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_ip6.ko 2024-03-23T23:29:20.092 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 33449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_netlink.ko 2024-03-23T23:29:20.092 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 53233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_ppp.ko 2024-03-23T23:29:20.092 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/lapb/ 2024-03-23T23:29:20.092 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 48121 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/lapb/lapb.ko 2024-03-23T23:29:20.092 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/llc/ 2024-03-23T23:29:20.092 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 22833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/llc/llc.ko 2024-03-23T23:29:20.092 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 268521 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/llc/llc2.ko 2024-03-23T23:29:20.092 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/mac802154/ 2024-03-23T23:29:20.092 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 309417 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/mac802154/mac802154.ko 2024-03-23T23:29:20.092 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/mpls/ 2024-03-23T23:29:20.092 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/mpls/mpls_gso.ko 2024-03-23T23:29:20.092 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ 2024-03-23T23:29:20.092 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ 2024-03-23T23:29:20.093 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 119705 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set.ko 2024-03-23T23:29:20.093 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 28617 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-23T23:29:20.093 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 27305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-23T23:29:20.093 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-23T23:29:20.093 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 99993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-23T23:29:20.093 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 100281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-23T23:29:20.093 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 102553 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-23T23:29:20.093 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 102345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-23T23:29:20.093 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 111673 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-23T23:29:20.093 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 59193 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-23T23:29:20.093 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 108345 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-23T23:29:20.093 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 112145 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-23T23:29:20.093 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 112409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-23T23:29:20.093 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 110337 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-23T23:29:20.094 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 113289 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-23T23:29:20.094 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 30305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-23T23:29:20.094 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ 2024-03-23T23:29:20.094 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 412513 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-23T23:29:20.094 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11993 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-23T23:29:20.094 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 7657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-23T23:29:20.094 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17681 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-23T23:29:20.094 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-23T23:29:20.094 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-23T23:29:20.094 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 7657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-23T23:29:20.094 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 7721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-23T23:29:20.094 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10641 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-23T23:29:20.094 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9265 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-23T23:29:20.095 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 7721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-23T23:29:20.095 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13545 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-23T23:29:20.095 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 7721 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-23T23:29:20.095 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-23T23:29:20.095 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 49169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conncount.ko 2024-03-23T23:29:20.095 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 411769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack.ko 2024-03-23T23:29:20.095 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15881 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-23T23:29:20.095 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10297 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-23T23:29:20.095 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 33665 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-23T23:29:20.095 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 118161 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-23T23:29:20.095 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 22089 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-23T23:29:20.095 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-23T23:29:20.095 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 108313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-23T23:29:20.095 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 33577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-23T23:29:20.096 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17297 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-23T23:29:20.096 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 66537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-23T23:29:20.096 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-23T23:29:20.096 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-23T23:29:20.096 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10017 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-23T23:29:20.096 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 92233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_flow_table.ko 2024-03-23T23:29:20.096 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9553 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-23T23:29:20.096 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 38081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_log_syslog.ko 2024-03-23T23:29:20.096 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 96521 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat.ko 2024-03-23T23:29:20.096 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10033 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-23T23:29:20.096 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12529 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-23T23:29:20.096 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11761 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_irc.ko 2024-03-23T23:29:20.096 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 28833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_sip.ko 2024-03-23T23:29:20.096 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-23T23:29:20.097 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 44137 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-23T23:29:20.097 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 623473 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_tables.ko 2024-03-23T23:29:20.097 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 42513 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink.ko 2024-03-23T23:29:20.097 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 30161 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-23T23:29:20.097 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 30353 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-03-23T23:29:20.097 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 39561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink_log.ko 2024-03-23T23:29:20.097 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 22937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-23T23:29:20.097 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 49649 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-23T23:29:20.097 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10473 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_chain_nat.ko 2024-03-23T23:29:20.097 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 33561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_compat.ko 2024-03-23T23:29:20.097 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 40809 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_ct.ko 2024-03-23T23:29:20.097 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9505 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-23T23:29:20.097 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11425 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_fib.ko 2024-03-23T23:29:20.097 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-23T23:29:20.098 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14097 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_hash.ko 2024-03-23T23:29:20.098 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20033 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_limit.ko 2024-03-23T23:29:20.098 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_log.ko 2024-03-23T23:29:20.098 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_masq.ko 2024-03-23T23:29:20.098 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14329 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_nat.ko 2024-03-23T23:29:20.098 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_numgen.ko 2024-03-23T23:29:20.098 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11753 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_osf.ko 2024-03-23T23:29:20.098 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_queue.ko 2024-03-23T23:29:20.098 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14097 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_redir.ko 2024-03-23T23:29:20.098 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_reject.ko 2024-03-23T23:29:20.098 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9985 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_reject_inet.ko 2024-03-23T23:29:20.098 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12841 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_socket.ko 2024-03-23T23:29:20.098 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_synproxy.ko 2024-03-23T23:29:20.099 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_tproxy.ko 2024-03-23T23:29:20.099 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 89233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/x_tables.ko 2024-03-23T23:29:20.099 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_AUDIT.ko 2024-03-23T23:29:20.099 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-23T23:29:20.099 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 7633 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-23T23:29:20.099 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-23T23:29:20.099 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 18081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_CT.ko 2024-03-23T23:29:20.099 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_DSCP.ko 2024-03-23T23:29:20.099 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_HL.ko 2024-03-23T23:29:20.099 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13281 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_HMARK.ko 2024-03-23T23:29:20.099 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 38777 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-23T23:29:20.099 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13801 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_LED.ko 2024-03-23T23:29:20.099 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_LOG.ko 2024-03-23T23:29:20.099 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-23T23:29:20.100 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11561 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_NETMAP.ko 2024-03-23T23:29:20.100 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_NFLOG.ko 2024-03-23T23:29:20.100 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13193 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-23T23:29:20.100 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_RATEEST.ko 2024-03-23T23:29:20.100 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-23T23:29:20.100 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14249 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_SECMARK.ko 2024-03-23T23:29:20.100 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-23T23:29:20.100 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10337 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-23T23:29:20.100 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TEE.ko 2024-03-23T23:29:20.100 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16697 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TPROXY.ko 2024-03-23T23:29:20.100 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8233 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TRACE.ko 2024-03-23T23:29:20.100 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13097 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_addrtype.ko 2024-03-23T23:29:20.100 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13809 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_bpf.ko 2024-03-23T23:29:20.100 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_cgroup.ko 2024-03-23T23:29:20.101 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11121 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_cluster.ko 2024-03-23T23:29:20.101 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 7409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_comment.ko 2024-03-23T23:29:20.101 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10369 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_connbytes.ko 2024-03-23T23:29:20.101 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11257 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_connlabel.ko 2024-03-23T23:29:20.101 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_connlimit.ko 2024-03-23T23:29:20.101 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13353 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_connmark.ko 2024-03-23T23:29:20.101 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12305 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_conntrack.ko 2024-03-23T23:29:20.101 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 7729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_cpu.ko 2024-03-23T23:29:20.101 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10889 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_dccp.ko 2024-03-23T23:29:20.101 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 7769 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_devgroup.ko 2024-03-23T23:29:20.101 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_dscp.ko 2024-03-23T23:29:20.101 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10569 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_ecn.ko 2024-03-23T23:29:20.101 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_esp.ko 2024-03-23T23:29:20.101 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 43201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_hashlimit.ko 2024-03-23T23:29:20.102 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_helper.ko 2024-03-23T23:29:20.102 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 7777 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_hl.ko 2024-03-23T23:29:20.102 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11825 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_ipcomp.ko 2024-03-23T23:29:20.102 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_iprange.ko 2024-03-23T23:29:20.102 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11697 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_ipvs.ko 2024-03-23T23:29:20.102 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_l2tp.ko 2024-03-23T23:29:20.102 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 7905 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_length.ko 2024-03-23T23:29:20.102 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10121 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_limit.ko 2024-03-23T23:29:20.102 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 7457 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_mac.ko 2024-03-23T23:29:20.102 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_mark.ko 2024-03-23T23:29:20.102 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11729 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_multiport.ko 2024-03-23T23:29:20.102 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13737 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_nat.ko 2024-03-23T23:29:20.102 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_nfacct.ko 2024-03-23T23:29:20.103 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_osf.ko 2024-03-23T23:29:20.103 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_owner.ko 2024-03-23T23:29:20.103 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10017 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_physdev.ko 2024-03-23T23:29:20.103 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 7537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_pkttype.ko 2024-03-23T23:29:20.103 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11897 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_policy.ko 2024-03-23T23:29:20.103 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9385 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_quota.ko 2024-03-23T23:29:20.103 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_rateest.ko 2024-03-23T23:29:20.103 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8169 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_realm.ko 2024-03-23T23:29:20.103 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 36361 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_recent.ko 2024-03-23T23:29:20.103 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13241 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_sctp.ko 2024-03-23T23:29:20.103 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 30001 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_set.ko 2024-03-23T23:29:20.103 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 16817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_socket.ko 2024-03-23T23:29:20.103 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9417 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_state.ko 2024-03-23T23:29:20.103 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_statistic.ko 2024-03-23T23:29:20.103 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8713 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_string.ko 2024-03-23T23:29:20.104 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 8457 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_tcpmss.ko 2024-03-23T23:29:20.104 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15681 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_tcpudp.ko 2024-03-23T23:29:20.104 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_time.ko 2024-03-23T23:29:20.104 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9313 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_u32.ko 2024-03-23T23:29:20.104 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netlink/ 2024-03-23T23:29:20.104 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 14441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netlink/netlink_diag.ko 2024-03-23T23:29:20.104 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/nsh/ 2024-03-23T23:29:20.104 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 12337 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/nsh/nsh.ko 2024-03-23T23:29:20.104 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch/ 2024-03-23T23:29:20.104 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 384201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch/openvswitch.ko 2024-03-23T23:29:20.104 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10369 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch/vport-geneve.ko 2024-03-23T23:29:20.105 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch/vport-gre.ko 2024-03-23T23:29:20.105 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11833 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch/vport-vxlan.ko 2024-03-23T23:29:20.105 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/packet/ 2024-03-23T23:29:20.105 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13473 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/packet/af_packet_diag.ko 2024-03-23T23:29:20.105 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/phonet/ 2024-03-23T23:29:20.105 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 112553 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/phonet/phonet.ko 2024-03-23T23:29:20.105 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 55057 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/phonet/pn_pep.ko 2024-03-23T23:29:20.105 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/rds/ 2024-03-23T23:29:20.105 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 253961 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/rds/rds.ko 2024-03-23T23:29:20.105 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 165105 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/rds/rds_rdma.ko 2024-03-23T23:29:20.105 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 68097 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/rds/rds_tcp.ko 2024-03-23T23:29:20.106 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/rxrpc/ 2024-03-23T23:29:20.106 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 828297 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/rxrpc/rxrpc.ko 2024-03-23T23:29:20.106 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/ 2024-03-23T23:29:20.106 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 32153 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_csum.ko 2024-03-23T23:29:20.106 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23489 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_gact.ko 2024-03-23T23:29:20.106 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 37089 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_mirred.ko 2024-03-23T23:29:20.106 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23377 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_nat.ko 2024-03-23T23:29:20.106 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 43353 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_pedit.ko 2024-03-23T23:29:20.106 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 31929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_police.ko 2024-03-23T23:29:20.106 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20193 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_simple.ko 2024-03-23T23:29:20.106 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 35201 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_skbedit.ko 2024-03-23T23:29:20.106 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 36577 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_vlan.ko 2024-03-23T23:29:20.107 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_basic.ko 2024-03-23T23:29:20.107 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 33873 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_bpf.ko 2024-03-23T23:29:20.107 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 19185 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_cgroup.ko 2024-03-23T23:29:20.107 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 31409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_flow.ko 2024-03-23T23:29:20.107 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 31865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_fw.ko 2024-03-23T23:29:20.107 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 39521 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_route.ko 2024-03-23T23:29:20.107 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 62657 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_u32.ko 2024-03-23T23:29:20.107 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 7465 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_cmp.ko 2024-03-23T23:29:20.107 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 13321 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_ipset.ko 2024-03-23T23:29:20.107 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 33425 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_meta.ko 2024-03-23T23:29:20.107 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 7921 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_nbyte.ko 2024-03-23T23:29:20.108 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10929 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_text.ko 2024-03-23T23:29:20.108 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 7273 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_u32.ko 2024-03-23T23:29:20.108 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21673 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_choke.ko 2024-03-23T23:29:20.108 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20865 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_codel.ko 2024-03-23T23:29:20.108 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 34593 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_drr.ko 2024-03-23T23:29:20.108 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 35793 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_fq.ko 2024-03-23T23:29:20.108 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 31521 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_fq_codel.ko 2024-03-23T23:29:20.108 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 35457 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_gred.ko 2024-03-23T23:29:20.108 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 49849 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_hfsc.ko 2024-03-23T23:29:20.108 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 21977 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_hhf.ko 2024-03-23T23:29:20.108 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 66449 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_htb.ko 2024-03-23T23:29:20.108 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26089 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_ingress.ko 2024-03-23T23:29:20.108 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 30225 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_mqprio.ko 2024-03-23T23:29:20.108 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10809 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_mqprio_lib.ko 2024-03-23T23:29:20.109 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26089 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_multiq.ko 2024-03-23T23:29:20.109 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 36153 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_netem.ko 2024-03-23T23:29:20.109 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 27409 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_pie.ko 2024-03-23T23:29:20.109 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10665 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_plug.ko 2024-03-23T23:29:20.109 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 24777 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_prio.ko 2024-03-23T23:29:20.109 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 48537 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_qfq.ko 2024-03-23T23:29:20.109 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 32817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_red.ko 2024-03-23T23:29:20.109 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 26793 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_sfb.ko 2024-03-23T23:29:20.109 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 31321 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_sfq.ko 2024-03-23T23:29:20.110 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 28945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_tbf.ko 2024-03-23T23:29:20.110 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 28273 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_teql.ko 2024-03-23T23:29:20.110 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sctp/ 2024-03-23T23:29:20.110 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 932945 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sctp/sctp.ko 2024-03-23T23:29:20.110 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20249 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sctp/sctp_diag.ko 2024-03-23T23:29:20.110 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/ 2024-03-23T23:29:20.110 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/auth_gss/ 2024-03-23T23:29:20.110 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 337009 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-23T23:29:20.110 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 55041 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-23T23:29:20.110 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 1513905 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/sunrpc.ko 2024-03-23T23:29:20.110 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/xprtrdma/ 2024-03-23T23:29:20.110 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 704761 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-23T23:29:20.110 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/tipc/ 2024-03-23T23:29:20.111 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 10401 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/tipc/diag.ko 2024-03-23T23:29:20.111 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 867249 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/tipc/tipc.ko 2024-03-23T23:29:20.111 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/unix/ 2024-03-23T23:29:20.111 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15937 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/unix/unix_diag.ko 2024-03-23T23:29:20.111 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/ 2024-03-23T23:29:20.111 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 87745 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-23T23:29:20.111 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 67953 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-23T23:29:20.111 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 98113 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vsock.ko 2024-03-23T23:29:20.111 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 11081 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-23T23:29:20.111 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 17817 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-23T23:29:20.111 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/x25/ 2024-03-23T23:29:20.112 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 131273 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/x25/x25.ko 2024-03-23T23:29:20.112 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/xfrm/ 2024-03-23T23:29:20.112 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23065 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/xfrm/xfrm_algo.ko 2024-03-23T23:29:20.112 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 20553 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-23T23:29:20.112 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 105217 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/xfrm/xfrm_user.ko 2024-03-23T23:29:20.112 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/virt/ 2024-03-23T23:29:20.112 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/virt/lib/ 2024-03-23T23:29:20.112 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 15441 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/kernel/virt/lib/irqbypass.ko 2024-03-23T23:29:20.112 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 642383 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/modules.alias 2024-03-23T23:29:20.112 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 625850 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/modules.alias.bin 2024-03-23T23:29:20.113 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 7677 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/modules.builtin 2024-03-23T23:29:20.113 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 23498 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/modules.builtin.alias.bin 2024-03-23T23:29:20.113 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 9916 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/modules.builtin.bin 2024-03-23T23:29:20.113 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 70732 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/modules.builtin.modinfo 2024-03-23T23:29:20.113 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 147214 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/modules.dep 2024-03-23T23:29:20.113 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 233213 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/modules.dep.bin 2024-03-23T23:29:20.113 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 210 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/modules.devname 2024-03-23T23:29:20.113 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 72614 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/modules.order 2024-03-23T23:29:20.113 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 879 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/modules.softdep 2024-03-23T23:29:20.113 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 257955 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/modules.symbols 2024-03-23T23:29:20.113 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 312782 2024-03-19 20:13 ./lib/modules/6.8.0-g5ec3e6e88b2e/modules.symbols.bin 2024-03-23T23:29:20.113 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./usr/ 2024-03-23T23:29:20.113 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./usr/share/ 2024-03-23T23:29:20.114 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./usr/share/doc/ 2024-03-23T23:29:20.114 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x root/root 0 2024-03-19 20:13 ./usr/share/doc/linux-image-6.8.0-g5ec3e6e88b2e/ 2024-03-23T23:29:20.114 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 171 2024-03-19 20:13 ./usr/share/doc/linux-image-6.8.0-g5ec3e6e88b2e/changelog.Debian.gz 2024-03-23T23:29:20.114 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r-- root/root 691 2024-03-19 20:13 ./usr/share/doc/linux-image-6.8.0-g5ec3e6e88b2e/copyright 2024-03-23T23:29:20.119 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g5ec3e6e88b2e 2024-03-23T23:29:20.119 INFO:teuthology.task.kernel:searching for kernel 6.8.0-g5ec3e6e88b2e 2024-03-23T23:29:20.119 DEBUG:teuthology.orchestra.run.smithi008:> egrep '(submenu|menuentry.*6.8.0-g5ec3e6e88b2e).*{' /boot/grub/grub.cfg 2024-03-23T23:29:20.126 INFO:teuthology.orchestra.run.smithi008.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-03-23T23:29:20.126 INFO:teuthology.orchestra.run.smithi008.stdout: menuentry 'Ubuntu, with Linux 6.8.0-g5ec3e6e88b2e' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.8.0-g5ec3e6e88b2e-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-03-23T23:29:20.126 INFO:teuthology.orchestra.run.smithi008.stdout: menuentry 'Ubuntu, with Linux 6.8.0-g5ec3e6e88b2e (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.8.0-g5ec3e6e88b2e-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-03-23T23:29:20.127 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-03-23T23:29:20.127 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.8.0-g5ec3e6e88b2e 2024-03-23T23:29:20.127 DEBUG:teuthology.orchestra.run.smithi008:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-03-23T23:29:20.171 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi008.front.sepia.ceph.com to complete... 2024-03-23T23:29:20.564 INFO:teuthology.orchestra.run.smithi008.stderr:Sourcing file `/etc/default/grub' 2024-03-23T23:29:20.565 INFO:teuthology.orchestra.run.smithi008.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-23T23:29:20.580 INFO:teuthology.orchestra.run.smithi008.stderr:Generating grub configuration file ... 2024-03-23T23:29:20.746 INFO:teuthology.orchestra.run.smithi008.stderr:Found linux image: /boot/vmlinuz-6.8.0-g5ec3e6e88b2e 2024-03-23T23:29:20.752 INFO:teuthology.orchestra.run.smithi008.stderr:Found initrd image: /boot/initrd.img-6.8.0-g5ec3e6e88b2e 2024-03-23T23:29:20.982 INFO:teuthology.orchestra.run.smithi008.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-23T23:29:20.987 INFO:teuthology.orchestra.run.smithi008.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-23T23:29:21.027 INFO:teuthology.orchestra.run.smithi008.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-23T23:29:21.032 INFO:teuthology.orchestra.run.smithi008.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-23T23:29:21.145 INFO:teuthology.orchestra.run.smithi008.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-23T23:29:21.145 INFO:teuthology.orchestra.run.smithi008.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-03-23T23:29:21.146 INFO:teuthology.orchestra.run.smithi008.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-23T23:29:21.167 INFO:teuthology.orchestra.run.smithi008.stderr:done 2024-03-23T23:29:22.310 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-03-23T23:29:48.112 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-03-23T23:29:48.113 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-03-23T23:29:48.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T23:29:52.314 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-03-23T23:29:52.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2024-03-23T23:29:52.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T23:30:06.494 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-03-23T23:30:10.846 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-03-23T23:30:15.498 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-03-23T23:30:15.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T23:30:18.558 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-03-23T23:30:19.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2024-03-23T23:30:19.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T23:30:22.911 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-03-23T23:30:30.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-03-23T23:30:30.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T23:30:34.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2024-03-23T23:30:34.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T23:30:48.990 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-03-23T23:31:04.004 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-03-23T23:31:04.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T23:31:04.503 DEBUG:teuthology.orchestra.run.smithi196:> true 2024-03-23T23:31:05.727 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-03-23T23:31:05.727 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.8.0-g5ec3e6e88b2e"... 2024-03-23T23:31:05.727 DEBUG:teuthology.orchestra.run.smithi196:> uname -r 2024-03-23T23:31:05.776 INFO:teuthology.orchestra.run.smithi196.stdout:6.8.0-g5ec3e6e88b2e 2024-03-23T23:31:05.776 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g5ec3e6e88b2e vs 6.8.0-g5ec3e6e88b2e 2024-03-23T23:31:05.776 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-23T23:31:05.776 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-03-23T23:31:06.613 DEBUG:teuthology.orchestra.run.smithi008:> true 2024-03-23T23:31:06.777 DEBUG:teuthology.parallel:result is None 2024-03-23T23:31:07.301 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2024-03-23T23:31:07.301 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.8.0-g5ec3e6e88b2e"... 2024-03-23T23:31:07.301 DEBUG:teuthology.orchestra.run.smithi008:> uname -r 2024-03-23T23:31:07.351 INFO:teuthology.orchestra.run.smithi008.stdout:6.8.0-g5ec3e6e88b2e 2024-03-23T23:31:07.351 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g5ec3e6e88b2e vs 6.8.0-g5ec3e6e88b2e 2024-03-23T23:31:07.351 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-23T23:31:07.351 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-03-23T23:31:08.352 DEBUG:teuthology.parallel:result is None 2024-03-23T23:31:08.352 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-23T23:31:08.364 INFO:teuthology.task.internal:Creating test directory... 2024-03-23T23:31:08.365 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-23T23:31:08.368 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-23T23:31:08.376 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-23T23:31:08.382 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-23T23:31:08.389 INFO:teuthology.task.internal:Creating archive directory... 2024-03-23T23:31:08.389 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-23T23:31:08.418 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-23T23:31:08.449 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-23T23:31:08.456 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-23T23:31:08.456 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-23T23:31:08.473 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-23T23:31:08.553 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-23T23:31:08.580 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-23T23:31:08.584 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-23T23:31:08.609 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-23T23:31:08.612 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-23T23:31:08.619 INFO:teuthology.task.internal:Configuring sudo... 2024-03-23T23:31:08.619 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-23T23:31:08.622 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-23T23:31:08.642 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-23T23:31:08.651 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-23T23:31:08.651 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-23T23:31:08.686 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-23T23:31:08.693 DEBUG:teuthology.orchestra.run.smithi008:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-23T23:31:08.744 DEBUG:teuthology.orchestra.run.smithi008:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-23T23:31:08.796 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-23T23:31:08.796 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-23T23:31:08.875 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-23T23:31:08.884 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-23T23:31:08.936 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-23T23:31:08.936 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-23T23:31:09.001 DEBUG:teuthology.orchestra.run.smithi008:> sudo service rsyslog restart 2024-03-23T23:31:09.005 DEBUG:teuthology.orchestra.run.smithi196:> sudo service rsyslog restart 2024-03-23T23:31:09.183 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-23T23:31:09.191 INFO:teuthology.task.internal:Starting timer... 2024-03-23T23:31:09.191 INFO:teuthology.run_tasks:Running task pcp... 2024-03-23T23:31:09.201 INFO:teuthology.run_tasks:Running task selinux... 2024-03-23T23:31:09.210 DEBUG:teuthology.task.selinux:Excluding smithi008: OS 'ubuntu' does not support SELinux 2024-03-23T23:31:09.210 DEBUG:teuthology.task.selinux:Excluding smithi196: OS 'ubuntu' does not support SELinux 2024-03-23T23:31:09.210 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-23T23:31:09.210 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-03-23T23:31:09.210 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-23T23:31:09.210 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-23T23:31:09.219 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-23T23:31:09.235 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-23T23:31:09.236 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi008.front.sepia.ceph.com,smithi196.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-23T23:38:49.942 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi008.front.sepia.ceph.com'), Remote(name='ubuntu@smithi196.front.sepia.ceph.com')] 2024-03-23T23:38:49.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2024-03-23T23:38:49.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T23:38:50.030 DEBUG:teuthology.orchestra.run.smithi008:> true 2024-03-23T23:38:50.146 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2024-03-23T23:38:50.146 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-03-23T23:38:50.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T23:38:50.233 DEBUG:teuthology.orchestra.run.smithi196:> true 2024-03-23T23:38:50.361 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-03-23T23:38:50.362 INFO:teuthology.run_tasks:Running task clock... 2024-03-23T23:38:50.375 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-23T23:38:50.375 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-23T23:38:50.375 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-23T23:38:50.379 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-23T23:38:50.379 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-23T23:38:50.415 INFO:teuthology.orchestra.run.smithi008.stdout:23 Mar 23:38:50 ntpd[17074]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-03-23T23:38:50.415 INFO:teuthology.orchestra.run.smithi008.stdout:23 Mar 23:38:50 ntpd[17074]: Command line: ntpd -gq 2024-03-23T23:38:50.415 INFO:teuthology.orchestra.run.smithi008.stdout:23 Mar 23:38:50 ntpd[17074]: ---------------------------------------------------- 2024-03-23T23:38:50.415 INFO:teuthology.orchestra.run.smithi008.stdout:23 Mar 23:38:50 ntpd[17074]: ntp-4 is maintained by Network Time Foundation, 2024-03-23T23:38:50.415 INFO:teuthology.orchestra.run.smithi008.stdout:23 Mar 23:38:50 ntpd[17074]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-03-23T23:38:50.416 INFO:teuthology.orchestra.run.smithi008.stdout:23 Mar 23:38:50 ntpd[17074]: corporation. Support and training for ntp-4 are 2024-03-23T23:38:50.416 INFO:teuthology.orchestra.run.smithi008.stdout:23 Mar 23:38:50 ntpd[17074]: available at https://www.nwtime.org/support 2024-03-23T23:38:50.416 INFO:teuthology.orchestra.run.smithi008.stdout:23 Mar 23:38:50 ntpd[17074]: ---------------------------------------------------- 2024-03-23T23:38:50.416 INFO:teuthology.orchestra.run.smithi008.stdout:23 Mar 23:38:50 ntpd[17074]: proto: precision = 0.043 usec (-24) 2024-03-23T23:38:50.416 INFO:teuthology.orchestra.run.smithi008.stdout:23 Mar 23:38:50 ntpd[17074]: basedate set to 2022-02-04 2024-03-23T23:38:50.417 INFO:teuthology.orchestra.run.smithi008.stdout:23 Mar 23:38:50 ntpd[17074]: gps base set to 2022-02-06 (week 2196) 2024-03-23T23:38:50.417 INFO:teuthology.orchestra.run.smithi008.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-23T23:38:50.417 INFO:teuthology.orchestra.run.smithi008.stdout:23 Mar 23:38:50 ntpd[17074]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-23T23:38:50.417 INFO:teuthology.orchestra.run.smithi008.stderr:restrict ::: KOD does nothing without LIMITED. 2024-03-23T23:38:50.418 INFO:teuthology.orchestra.run.smithi008.stdout:23 Mar 23:38:50 ntpd[17074]: restrict ::: KOD does nothing without LIMITED. 2024-03-23T23:38:50.419 INFO:teuthology.orchestra.run.smithi008.stdout:23 Mar 23:38:50 ntpd[17074]: Listen and drop on 0 v6wildcard [::]:123 2024-03-23T23:38:50.419 INFO:teuthology.orchestra.run.smithi008.stdout:23 Mar 23:38:50 ntpd[17074]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-03-23T23:38:50.419 INFO:teuthology.orchestra.run.smithi008.stdout:23 Mar 23:38:50 ntpd[17074]: Listen normally on 2 lo 127.0.0.1:123 2024-03-23T23:38:50.419 INFO:teuthology.orchestra.run.smithi008.stdout:23 Mar 23:38:50 ntpd[17074]: Listen normally on 3 ens1f0 172.21.15.8:123 2024-03-23T23:38:50.419 INFO:teuthology.orchestra.run.smithi008.stdout:23 Mar 23:38:50 ntpd[17074]: Listen normally on 4 lo [::1]:123 2024-03-23T23:38:50.419 INFO:teuthology.orchestra.run.smithi008.stdout:23 Mar 23:38:50 ntpd[17074]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:25fe%4]:123 2024-03-23T23:38:50.419 INFO:teuthology.orchestra.run.smithi008.stdout:23 Mar 23:38:50 ntpd[17074]: Listening on routing socket on fd #22 for interface updates 2024-03-23T23:38:50.445 INFO:teuthology.orchestra.run.smithi196.stdout:23 Mar 23:38:50 ntpd[17183]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-03-23T23:38:50.445 INFO:teuthology.orchestra.run.smithi196.stdout:23 Mar 23:38:50 ntpd[17183]: Command line: ntpd -gq 2024-03-23T23:38:50.445 INFO:teuthology.orchestra.run.smithi196.stdout:23 Mar 23:38:50 ntpd[17183]: ---------------------------------------------------- 2024-03-23T23:38:50.445 INFO:teuthology.orchestra.run.smithi196.stdout:23 Mar 23:38:50 ntpd[17183]: ntp-4 is maintained by Network Time Foundation, 2024-03-23T23:38:50.445 INFO:teuthology.orchestra.run.smithi196.stdout:23 Mar 23:38:50 ntpd[17183]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-03-23T23:38:50.445 INFO:teuthology.orchestra.run.smithi196.stdout:23 Mar 23:38:50 ntpd[17183]: corporation. Support and training for ntp-4 are 2024-03-23T23:38:50.445 INFO:teuthology.orchestra.run.smithi196.stdout:23 Mar 23:38:50 ntpd[17183]: available at https://www.nwtime.org/support 2024-03-23T23:38:50.445 INFO:teuthology.orchestra.run.smithi196.stdout:23 Mar 23:38:50 ntpd[17183]: ---------------------------------------------------- 2024-03-23T23:38:50.446 INFO:teuthology.orchestra.run.smithi196.stdout:23 Mar 23:38:50 ntpd[17183]: proto: precision = 0.043 usec (-24) 2024-03-23T23:38:50.446 INFO:teuthology.orchestra.run.smithi196.stdout:23 Mar 23:38:50 ntpd[17183]: basedate set to 2022-02-04 2024-03-23T23:38:50.446 INFO:teuthology.orchestra.run.smithi196.stdout:23 Mar 23:38:50 ntpd[17183]: gps base set to 2022-02-06 (week 2196) 2024-03-23T23:38:50.446 INFO:teuthology.orchestra.run.smithi196.stdout:23 Mar 23:38:50 ntpd[17183]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-23T23:38:50.446 INFO:teuthology.orchestra.run.smithi196.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-23T23:38:50.447 INFO:teuthology.orchestra.run.smithi196.stderr:restrict ::: KOD does nothing without LIMITED. 2024-03-23T23:38:50.447 INFO:teuthology.orchestra.run.smithi196.stdout:23 Mar 23:38:50 ntpd[17183]: restrict ::: KOD does nothing without LIMITED. 2024-03-23T23:38:50.448 INFO:teuthology.orchestra.run.smithi196.stdout:23 Mar 23:38:50 ntpd[17183]: Listen and drop on 0 v6wildcard [::]:123 2024-03-23T23:38:50.448 INFO:teuthology.orchestra.run.smithi196.stdout:23 Mar 23:38:50 ntpd[17183]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-03-23T23:38:50.448 INFO:teuthology.orchestra.run.smithi196.stdout:23 Mar 23:38:50 ntpd[17183]: Listen normally on 2 lo 127.0.0.1:123 2024-03-23T23:38:50.448 INFO:teuthology.orchestra.run.smithi196.stdout:23 Mar 23:38:50 ntpd[17183]: Listen normally on 3 enp3s0f1 172.21.15.196:123 2024-03-23T23:38:50.448 INFO:teuthology.orchestra.run.smithi196.stdout:23 Mar 23:38:50 ntpd[17183]: Listen normally on 4 lo [::1]:123 2024-03-23T23:38:50.449 INFO:teuthology.orchestra.run.smithi196.stdout:23 Mar 23:38:50 ntpd[17183]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f47%5]:123 2024-03-23T23:38:50.449 INFO:teuthology.orchestra.run.smithi196.stdout:23 Mar 23:38:50 ntpd[17183]: Listening on routing socket on fd #22 for interface updates 2024-03-23T23:38:51.416 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:51 ntpd[17074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:51.416 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:51 ntpd[17074]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:51.417 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:51 ntpd[17074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:51.417 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:51 ntpd[17074]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:51.417 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:51 ntpd[17074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:51.417 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:51 ntpd[17074]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:51.417 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:51 ntpd[17074]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-23T23:38:51.417 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:51 ntpd[17074]: can't open /var/log/ntpstats/peerstats.20240323: Permission denied 2024-03-23T23:38:51.417 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:51 ntpd[17074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:51.417 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:51 ntpd[17074]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:51.417 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:51 ntpd[17074]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-23T23:38:51.417 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:51 ntpd[17074]: can't open /var/log/ntpstats/peerstats.20240323: Permission denied 2024-03-23T23:38:51.446 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:51 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:51.446 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:51 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:51.446 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:51 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:51.446 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:51 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:51.446 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:51 ntpd[17183]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-23T23:38:51.446 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:51 ntpd[17183]: can't open /var/log/ntpstats/peerstats.20240323: Permission denied 2024-03-23T23:38:52.415 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:52 ntpd[17074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:52.416 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:52 ntpd[17074]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:52.417 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:52 ntpd[17074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:52.417 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:52 ntpd[17074]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:52.417 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:52 ntpd[17074]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-23T23:38:52.417 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:52 ntpd[17074]: can't open /var/log/ntpstats/peerstats.20240323: Permission denied 2024-03-23T23:38:52.448 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:52 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:52.448 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:52 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:52.448 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:52 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:52.448 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:52 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:52.448 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:52 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:52.448 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:52 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:52.448 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:52 ntpd[17183]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-23T23:38:52.448 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:52 ntpd[17183]: can't open /var/log/ntpstats/peerstats.20240323: Permission denied 2024-03-23T23:38:53.416 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:53 ntpd[17074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:53.416 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:53 ntpd[17074]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:53.419 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:53 ntpd[17074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:53.419 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:53 ntpd[17074]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:53.419 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:53 ntpd[17074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:53.419 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:53 ntpd[17074]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:53.419 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:53 ntpd[17074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:53.419 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:53 ntpd[17074]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:53.419 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:53 ntpd[17074]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-23T23:38:53.420 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:53 ntpd[17074]: can't open /var/log/ntpstats/peerstats.20240323: Permission denied 2024-03-23T23:38:53.420 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:53 ntpd[17074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:53.420 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:53 ntpd[17074]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:53.420 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:53 ntpd[17074]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-23T23:38:53.420 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:53 ntpd[17074]: can't open /var/log/ntpstats/peerstats.20240323: Permission denied 2024-03-23T23:38:53.445 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:53 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:53.446 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:53 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:53.446 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:53 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:53.446 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:53 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:53.446 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:53 ntpd[17183]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-23T23:38:53.446 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:53 ntpd[17183]: can't open /var/log/ntpstats/peerstats.20240323: Permission denied 2024-03-23T23:38:54.416 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:54 ntpd[17074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:54.416 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:54 ntpd[17074]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:54.416 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:54 ntpd[17074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:54.416 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:54 ntpd[17074]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:54.417 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:54 ntpd[17074]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-23T23:38:54.417 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:54 ntpd[17074]: can't open /var/log/ntpstats/peerstats.20240323: Permission denied 2024-03-23T23:38:54.446 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:54 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:54.447 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:54 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:54.447 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:54 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:54.447 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:54 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:54.447 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:54 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:54.447 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:54 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:54.447 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:54 ntpd[17183]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-23T23:38:54.447 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:54 ntpd[17183]: can't open /var/log/ntpstats/peerstats.20240323: Permission denied 2024-03-23T23:38:54.447 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:54 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:54.447 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:54 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:54.447 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:54 ntpd[17183]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-23T23:38:54.447 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:54 ntpd[17183]: can't open /var/log/ntpstats/peerstats.20240323: Permission denied 2024-03-23T23:38:55.417 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:55 ntpd[17074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:55.417 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:55 ntpd[17074]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:55.417 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:55 ntpd[17074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:55.417 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:55 ntpd[17074]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:55.417 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:55 ntpd[17074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:55.417 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:55 ntpd[17074]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:55.417 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:55 ntpd[17074]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-23T23:38:55.417 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:55 ntpd[17074]: can't open /var/log/ntpstats/peerstats.20240323: Permission denied 2024-03-23T23:38:55.417 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:55 ntpd[17074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:55.418 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:55 ntpd[17074]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:55.418 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:55 ntpd[17074]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-23T23:38:55.418 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:55 ntpd[17074]: can't open /var/log/ntpstats/peerstats.20240323: Permission denied 2024-03-23T23:38:55.446 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:55 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:55.446 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:55 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:55.446 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:55 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:55.446 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:55 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:55.446 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:55 ntpd[17183]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-23T23:38:55.446 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:55 ntpd[17183]: can't open /var/log/ntpstats/peerstats.20240323: Permission denied 2024-03-23T23:38:56.416 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:56 ntpd[17074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:56.416 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:56 ntpd[17074]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:56.416 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:56 ntpd[17074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:56.416 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:56 ntpd[17074]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:56.416 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:56 ntpd[17074]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-23T23:38:56.416 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:56 ntpd[17074]: can't open /var/log/ntpstats/peerstats.20240323: Permission denied 2024-03-23T23:38:56.446 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:56 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:56.446 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:56 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:56.446 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:56 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:56.446 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:56 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:56.446 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:56 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:56.446 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:56 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:56.446 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:56 ntpd[17183]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-23T23:38:56.447 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:56 ntpd[17183]: can't open /var/log/ntpstats/peerstats.20240323: Permission denied 2024-03-23T23:38:56.447 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:56 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:56.447 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:56 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:56.447 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:56 ntpd[17183]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-23T23:38:56.447 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:56 ntpd[17183]: can't open /var/log/ntpstats/peerstats.20240323: Permission denied 2024-03-23T23:38:57.416 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:57 ntpd[17074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:57.416 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:57 ntpd[17074]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:57.416 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:57 ntpd[17074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:57.417 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:57 ntpd[17074]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:57.417 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:57 ntpd[17074]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:57.417 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:57 ntpd[17074]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:57.417 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:57 ntpd[17074]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-23T23:38:57.417 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:57 ntpd[17074]: can't open /var/log/ntpstats/peerstats.20240323: Permission denied 2024-03-23T23:38:57.417 INFO:teuthology.orchestra.run.smithi008.stdout:23 Mar 23:38:57 ntpd[17074]: ntpd: time slew +0.000364 s 2024-03-23T23:38:57.417 INFO:teuthology.orchestra.run.smithi008.stdout:ntpd: time slew +0.000364s 2024-03-23T23:38:57.418 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:57 ntpd[17074]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-03-23T23:38:57.418 INFO:teuthology.orchestra.run.smithi008.stderr:23 Mar 23:38:57 ntpd[17074]: can't open /var/log/ntpstats/loopstats.20240323: Permission denied 2024-03-23T23:38:57.446 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:57 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:57.446 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:57 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:57.446 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:57 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-23T23:38:57.446 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:57 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240323: Permission denied 2024-03-23T23:38:57.446 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:57 ntpd[17183]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-23T23:38:57.446 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:57 ntpd[17183]: can't open /var/log/ntpstats/peerstats.20240323: Permission denied 2024-03-23T23:38:57.447 INFO:teuthology.orchestra.run.smithi196.stdout:23 Mar 23:38:57 ntpd[17183]: ntpd: time slew -0.000747 s 2024-03-23T23:38:57.447 INFO:teuthology.orchestra.run.smithi196.stdout:ntpd: time slew -0.000747s 2024-03-23T23:38:57.447 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:57 ntpd[17183]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-03-23T23:38:57.447 INFO:teuthology.orchestra.run.smithi196.stderr:23 Mar 23:38:57 ntpd[17183]: can't open /var/log/ntpstats/loopstats.20240323: Permission denied 2024-03-23T23:38:57.519 INFO:teuthology.orchestra.run.smithi008.stdout: remote refid st t when poll reach delay offset jitter 2024-03-23T23:38:57.519 INFO:teuthology.orchestra.run.smithi008.stdout:============================================================================== 2024-03-23T23:38:57.519 INFO:teuthology.orchestra.run.smithi008.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-23T23:38:57.519 INFO:teuthology.orchestra.run.smithi008.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-23T23:38:57.519 INFO:teuthology.orchestra.run.smithi008.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-23T23:38:57.519 INFO:teuthology.orchestra.run.smithi008.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-23T23:38:57.571 INFO:teuthology.orchestra.run.smithi196.stdout: remote refid st t when poll reach delay offset jitter 2024-03-23T23:38:57.571 INFO:teuthology.orchestra.run.smithi196.stdout:============================================================================== 2024-03-23T23:38:57.571 INFO:teuthology.orchestra.run.smithi196.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-23T23:38:57.571 INFO:teuthology.orchestra.run.smithi196.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-23T23:38:57.571 INFO:teuthology.orchestra.run.smithi196.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-23T23:38:57.571 INFO:teuthology.orchestra.run.smithi196.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-23T23:38:57.572 INFO:teuthology.run_tasks:Running task install... 2024-03-23T23:38:57.582 DEBUG:teuthology.task.install:project ceph 2024-03-23T23:38:57.583 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3be9a5c9bc793e11e2800a8c0c696e8b46742033'}} 2024-03-23T23:38:57.583 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3be9a5c9bc793e11e2800a8c0c696e8b46742033'} 2024-03-23T23:38:57.583 INFO:teuthology.task.install:Using flavor: default 2024-03-23T23:38:57.588 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-23T23:38:57.589 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-23T23:38:57.589 DEBUG:teuthology.orchestra.run.smithi008:> sudo apt-key list | grep Ceph 2024-03-23T23:38:57.590 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-key list | grep Ceph 2024-03-23T23:38:57.694 INFO:teuthology.orchestra.run.smithi008.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-03-23T23:38:57.716 INFO:teuthology.orchestra.run.smithi196.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-03-23T23:38:57.747 INFO:teuthology.orchestra.run.smithi008.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-03-23T23:38:57.748 INFO:teuthology.orchestra.run.smithi008.stdout:uid [ unknown] Ceph.com (release key) 2024-03-23T23:38:57.749 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-03-23T23:38:57.749 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-03-23T23:38:57.749 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3be9a5c9bc793e11e2800a8c0c696e8b46742033 2024-03-23T23:38:57.766 INFO:teuthology.orchestra.run.smithi196.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-03-23T23:38:57.766 INFO:teuthology.orchestra.run.smithi196.stdout:uid [ unknown] Ceph.com (release key) 2024-03-23T23:38:57.767 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-03-23T23:38:57.767 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-03-23T23:38:57.767 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3be9a5c9bc793e11e2800a8c0c696e8b46742033 2024-03-23T23:38:57.893 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default/ 2024-03-23T23:38:57.893 INFO:teuthology.task.install.deb:Package version is 19.0.0-2145-g3be9a5c9-1jammy 2024-03-23T23:38:57.913 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default/ 2024-03-23T23:38:57.913 INFO:teuthology.task.install.deb:Package version is 19.0.0-2145-g3be9a5c9-1jammy 2024-03-23T23:38:58.003 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-23T23:38:58.003 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-03-23T23:38:58.023 DEBUG:teuthology.orchestra.run.smithi008:> sudo apt-get update 2024-03-23T23:38:58.029 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-23T23:38:58.029 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-03-23T23:38:58.048 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-get update 2024-03-23T23:38:58.234 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-23T23:38:58.234 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-23T23:38:58.235 INFO:teuthology.orchestra.run.smithi008.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-23T23:38:58.243 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-23T23:38:58.263 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-23T23:38:58.318 INFO:teuthology.orchestra.run.smithi008.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy InRelease 2024-03-23T23:38:58.339 INFO:teuthology.orchestra.run.smithi196.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy InRelease 2024-03-23T23:38:58.348 INFO:teuthology.orchestra.run.smithi008.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-23T23:38:58.357 INFO:teuthology.orchestra.run.smithi008.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-03-23T23:38:58.375 INFO:teuthology.orchestra.run.smithi196.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-03-23T23:38:58.394 INFO:teuthology.orchestra.run.smithi008.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy Release.gpg 2024-03-23T23:38:58.412 INFO:teuthology.orchestra.run.smithi196.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy Release.gpg 2024-03-23T23:38:58.429 INFO:teuthology.orchestra.run.smithi008.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,404 B] 2024-03-23T23:38:58.430 INFO:teuthology.orchestra.run.smithi008.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-23T23:38:58.448 INFO:teuthology.orchestra.run.smithi196.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-03-23T23:38:58.477 INFO:teuthology.orchestra.run.smithi008.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-03-23T23:38:58.511 INFO:teuthology.orchestra.run.smithi008.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-23T23:38:58.530 INFO:teuthology.orchestra.run.smithi196.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,404 B] 2024-03-23T23:38:58.820 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 28.9 kB in 1s (52.3 kB/s) 2024-03-23T23:38:58.843 INFO:teuthology.orchestra.run.smithi008.stdout:Fetched 28.9 kB in 1s (48.6 kB/s) 2024-03-23T23:38:59.776 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-03-23T23:38:59.791 DEBUG:teuthology.orchestra.run.smithi196:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2145-g3be9a5c9-1jammy cephadm=19.0.0-2145-g3be9a5c9-1jammy ceph-mds=19.0.0-2145-g3be9a5c9-1jammy ceph-mgr=19.0.0-2145-g3be9a5c9-1jammy ceph-common=19.0.0-2145-g3be9a5c9-1jammy ceph-fuse=19.0.0-2145-g3be9a5c9-1jammy ceph-test=19.0.0-2145-g3be9a5c9-1jammy ceph-volume=19.0.0-2145-g3be9a5c9-1jammy radosgw=19.0.0-2145-g3be9a5c9-1jammy python3-rados=19.0.0-2145-g3be9a5c9-1jammy python3-rgw=19.0.0-2145-g3be9a5c9-1jammy python3-cephfs=19.0.0-2145-g3be9a5c9-1jammy python3-rbd=19.0.0-2145-g3be9a5c9-1jammy libcephfs2=19.0.0-2145-g3be9a5c9-1jammy libcephfs-dev=19.0.0-2145-g3be9a5c9-1jammy librados2=19.0.0-2145-g3be9a5c9-1jammy librbd1=19.0.0-2145-g3be9a5c9-1jammy rbd-fuse=19.0.0-2145-g3be9a5c9-1jammy python3-cephfs=19.0.0-2145-g3be9a5c9-1jammy cephfs-shell=19.0.0-2145-g3be9a5c9-1jammy cephfs-top=19.0.0-2145-g3be9a5c9-1jammy cephfs-mirror=19.0.0-2145-g3be9a5c9-1jammy 2024-03-23T23:38:59.837 INFO:teuthology.orchestra.run.smithi008.stdout:Reading package lists... 2024-03-23T23:38:59.851 DEBUG:teuthology.orchestra.run.smithi008:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2145-g3be9a5c9-1jammy cephadm=19.0.0-2145-g3be9a5c9-1jammy ceph-mds=19.0.0-2145-g3be9a5c9-1jammy ceph-mgr=19.0.0-2145-g3be9a5c9-1jammy ceph-common=19.0.0-2145-g3be9a5c9-1jammy ceph-fuse=19.0.0-2145-g3be9a5c9-1jammy ceph-test=19.0.0-2145-g3be9a5c9-1jammy ceph-volume=19.0.0-2145-g3be9a5c9-1jammy radosgw=19.0.0-2145-g3be9a5c9-1jammy python3-rados=19.0.0-2145-g3be9a5c9-1jammy python3-rgw=19.0.0-2145-g3be9a5c9-1jammy python3-cephfs=19.0.0-2145-g3be9a5c9-1jammy python3-rbd=19.0.0-2145-g3be9a5c9-1jammy libcephfs2=19.0.0-2145-g3be9a5c9-1jammy libcephfs-dev=19.0.0-2145-g3be9a5c9-1jammy librados2=19.0.0-2145-g3be9a5c9-1jammy librbd1=19.0.0-2145-g3be9a5c9-1jammy rbd-fuse=19.0.0-2145-g3be9a5c9-1jammy python3-cephfs=19.0.0-2145-g3be9a5c9-1jammy cephfs-shell=19.0.0-2145-g3be9a5c9-1jammy cephfs-top=19.0.0-2145-g3be9a5c9-1jammy cephfs-mirror=19.0.0-2145-g3be9a5c9-1jammy 2024-03-23T23:38:59.866 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-03-23T23:38:59.928 INFO:teuthology.orchestra.run.smithi008.stdout:Reading package lists... 2024-03-23T23:39:00.037 INFO:teuthology.orchestra.run.smithi196.stdout:Building dependency tree... 2024-03-23T23:39:00.038 INFO:teuthology.orchestra.run.smithi196.stdout:Reading state information... 2024-03-23T23:39:00.110 INFO:teuthology.orchestra.run.smithi008.stdout:Building dependency tree... 2024-03-23T23:39:00.111 INFO:teuthology.orchestra.run.smithi008.stdout:Reading state information... 2024-03-23T23:39:00.216 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages were automatically installed and are no longer required: 2024-03-23T23:39:00.216 INFO:teuthology.orchestra.run.smithi196.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-23T23:39:00.216 INFO:teuthology.orchestra.run.smithi196.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-23T23:39:00.216 INFO:teuthology.orchestra.run.smithi196.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-23T23:39:00.217 INFO:teuthology.orchestra.run.smithi196.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-23T23:39:00.217 INFO:teuthology.orchestra.run.smithi196.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-23T23:39:00.217 INFO:teuthology.orchestra.run.smithi196.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-23T23:39:00.217 INFO:teuthology.orchestra.run.smithi196.stdout:The following additional packages will be installed: 2024-03-23T23:39:00.218 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-03-23T23:39:00.218 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-03-23T23:39:00.218 INFO:teuthology.orchestra.run.smithi196.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-23T23:39:00.218 INFO:teuthology.orchestra.run.smithi196.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-03-23T23:39:00.219 INFO:teuthology.orchestra.run.smithi196.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-03-23T23:39:00.219 INFO:teuthology.orchestra.run.smithi196.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-03-23T23:39:00.219 INFO:teuthology.orchestra.run.smithi196.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-03-23T23:39:00.219 INFO:teuthology.orchestra.run.smithi196.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-03-23T23:39:00.219 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-03-23T23:39:00.219 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-03-23T23:39:00.220 INFO:teuthology.orchestra.run.smithi196.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-03-23T23:39:00.220 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-03-23T23:39:00.220 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-03-23T23:39:00.220 INFO:teuthology.orchestra.run.smithi196.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-03-23T23:39:00.220 INFO:teuthology.orchestra.run.smithi196.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-03-23T23:39:00.220 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-03-23T23:39:00.220 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-03-23T23:39:00.220 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-03-23T23:39:00.220 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-03-23T23:39:00.220 INFO:teuthology.orchestra.run.smithi196.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-03-23T23:39:00.220 INFO:teuthology.orchestra.run.smithi196.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-03-23T23:39:00.220 INFO:teuthology.orchestra.run.smithi196.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-03-23T23:39:00.220 INFO:teuthology.orchestra.run.smithi196.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-03-23T23:39:00.221 INFO:teuthology.orchestra.run.smithi196.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-03-23T23:39:00.221 INFO:teuthology.orchestra.run.smithi196.stdout:Suggested packages: 2024-03-23T23:39:00.221 INFO:teuthology.orchestra.run.smithi196.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-03-23T23:39:00.221 INFO:teuthology.orchestra.run.smithi196.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-03-23T23:39:00.221 INFO:teuthology.orchestra.run.smithi196.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-03-23T23:39:00.221 INFO:teuthology.orchestra.run.smithi196.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-03-23T23:39:00.221 INFO:teuthology.orchestra.run.smithi196.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-03-23T23:39:00.221 INFO:teuthology.orchestra.run.smithi196.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-03-23T23:39:00.221 INFO:teuthology.orchestra.run.smithi196.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-03-23T23:39:00.221 INFO:teuthology.orchestra.run.smithi196.stdout:Recommended packages: 2024-03-23T23:39:00.222 INFO:teuthology.orchestra.run.smithi196.stdout: btrfs-tools 2024-03-23T23:39:00.285 INFO:teuthology.orchestra.run.smithi008.stdout:The following packages were automatically installed and are no longer required: 2024-03-23T23:39:00.285 INFO:teuthology.orchestra.run.smithi008.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-23T23:39:00.285 INFO:teuthology.orchestra.run.smithi008.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-23T23:39:00.285 INFO:teuthology.orchestra.run.smithi008.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-23T23:39:00.285 INFO:teuthology.orchestra.run.smithi008.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-23T23:39:00.286 INFO:teuthology.orchestra.run.smithi008.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-23T23:39:00.286 INFO:teuthology.orchestra.run.smithi008.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-23T23:39:00.286 INFO:teuthology.orchestra.run.smithi008.stdout:The following additional packages will be installed: 2024-03-23T23:39:00.286 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-03-23T23:39:00.286 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-03-23T23:39:00.288 INFO:teuthology.orchestra.run.smithi008.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-23T23:39:00.288 INFO:teuthology.orchestra.run.smithi008.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-03-23T23:39:00.288 INFO:teuthology.orchestra.run.smithi008.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-03-23T23:39:00.288 INFO:teuthology.orchestra.run.smithi008.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-03-23T23:39:00.289 INFO:teuthology.orchestra.run.smithi008.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-03-23T23:39:00.289 INFO:teuthology.orchestra.run.smithi008.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-03-23T23:39:00.289 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-03-23T23:39:00.289 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-03-23T23:39:00.289 INFO:teuthology.orchestra.run.smithi008.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-03-23T23:39:00.289 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-03-23T23:39:00.289 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-03-23T23:39:00.289 INFO:teuthology.orchestra.run.smithi008.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-03-23T23:39:00.289 INFO:teuthology.orchestra.run.smithi008.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-03-23T23:39:00.289 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-03-23T23:39:00.289 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-03-23T23:39:00.289 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-03-23T23:39:00.290 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-03-23T23:39:00.290 INFO:teuthology.orchestra.run.smithi008.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-03-23T23:39:00.290 INFO:teuthology.orchestra.run.smithi008.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-03-23T23:39:00.290 INFO:teuthology.orchestra.run.smithi008.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-03-23T23:39:00.290 INFO:teuthology.orchestra.run.smithi008.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-03-23T23:39:00.290 INFO:teuthology.orchestra.run.smithi008.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-03-23T23:39:00.291 INFO:teuthology.orchestra.run.smithi008.stdout:Suggested packages: 2024-03-23T23:39:00.291 INFO:teuthology.orchestra.run.smithi008.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-03-23T23:39:00.291 INFO:teuthology.orchestra.run.smithi008.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-03-23T23:39:00.291 INFO:teuthology.orchestra.run.smithi008.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-03-23T23:39:00.291 INFO:teuthology.orchestra.run.smithi008.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-03-23T23:39:00.291 INFO:teuthology.orchestra.run.smithi008.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-03-23T23:39:00.291 INFO:teuthology.orchestra.run.smithi008.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-03-23T23:39:00.291 INFO:teuthology.orchestra.run.smithi008.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-03-23T23:39:00.291 INFO:teuthology.orchestra.run.smithi008.stdout:Recommended packages: 2024-03-23T23:39:00.291 INFO:teuthology.orchestra.run.smithi008.stdout: btrfs-tools 2024-03-23T23:39:00.369 INFO:teuthology.orchestra.run.smithi196.stdout:The following NEW packages will be installed: 2024-03-23T23:39:00.369 INFO:teuthology.orchestra.run.smithi196.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-03-23T23:39:00.369 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-03-23T23:39:00.369 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-03-23T23:39:00.369 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-03-23T23:39:00.371 INFO:teuthology.orchestra.run.smithi196.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-23T23:39:00.371 INFO:teuthology.orchestra.run.smithi196.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-03-23T23:39:00.371 INFO:teuthology.orchestra.run.smithi196.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-03-23T23:39:00.371 INFO:teuthology.orchestra.run.smithi196.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-03-23T23:39:00.371 INFO:teuthology.orchestra.run.smithi196.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-03-23T23:39:00.372 INFO:teuthology.orchestra.run.smithi196.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-03-23T23:39:00.372 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-03-23T23:39:00.372 INFO:teuthology.orchestra.run.smithi196.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-03-23T23:39:00.372 INFO:teuthology.orchestra.run.smithi196.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-03-23T23:39:00.372 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-03-23T23:39:00.372 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-03-23T23:39:00.372 INFO:teuthology.orchestra.run.smithi196.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-03-23T23:39:00.372 INFO:teuthology.orchestra.run.smithi196.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-03-23T23:39:00.372 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-03-23T23:39:00.372 INFO:teuthology.orchestra.run.smithi196.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-03-23T23:39:00.372 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-03-23T23:39:00.372 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-03-23T23:39:00.372 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-03-23T23:39:00.373 INFO:teuthology.orchestra.run.smithi196.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-03-23T23:39:00.373 INFO:teuthology.orchestra.run.smithi196.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-03-23T23:39:00.373 INFO:teuthology.orchestra.run.smithi196.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-03-23T23:39:00.373 INFO:teuthology.orchestra.run.smithi196.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-03-23T23:39:00.373 INFO:teuthology.orchestra.run.smithi196.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-03-23T23:39:00.373 INFO:teuthology.orchestra.run.smithi196.stdout: socat unzip xmlstarlet zip 2024-03-23T23:39:00.447 INFO:teuthology.orchestra.run.smithi008.stdout:The following NEW packages will be installed: 2024-03-23T23:39:00.447 INFO:teuthology.orchestra.run.smithi008.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-03-23T23:39:00.447 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-03-23T23:39:00.447 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-03-23T23:39:00.447 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-03-23T23:39:00.448 INFO:teuthology.orchestra.run.smithi008.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-23T23:39:00.448 INFO:teuthology.orchestra.run.smithi008.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-03-23T23:39:00.448 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-03-23T23:39:00.448 INFO:teuthology.orchestra.run.smithi008.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-03-23T23:39:00.448 INFO:teuthology.orchestra.run.smithi008.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-03-23T23:39:00.448 INFO:teuthology.orchestra.run.smithi008.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-03-23T23:39:00.448 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-03-23T23:39:00.448 INFO:teuthology.orchestra.run.smithi008.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-03-23T23:39:00.448 INFO:teuthology.orchestra.run.smithi008.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-03-23T23:39:00.448 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-03-23T23:39:00.448 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-03-23T23:39:00.448 INFO:teuthology.orchestra.run.smithi008.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-03-23T23:39:00.448 INFO:teuthology.orchestra.run.smithi008.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-03-23T23:39:00.449 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-03-23T23:39:00.449 INFO:teuthology.orchestra.run.smithi008.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-03-23T23:39:00.449 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-03-23T23:39:00.449 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-03-23T23:39:00.449 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-03-23T23:39:00.449 INFO:teuthology.orchestra.run.smithi008.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-03-23T23:39:00.449 INFO:teuthology.orchestra.run.smithi008.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-03-23T23:39:00.449 INFO:teuthology.orchestra.run.smithi008.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-03-23T23:39:00.449 INFO:teuthology.orchestra.run.smithi008.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-03-23T23:39:00.449 INFO:teuthology.orchestra.run.smithi008.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-03-23T23:39:00.450 INFO:teuthology.orchestra.run.smithi008.stdout: socat unzip xmlstarlet zip 2024-03-23T23:39:00.450 INFO:teuthology.orchestra.run.smithi196.stdout:0 upgraded, 124 newly installed, 0 to remove and 288 not upgraded. 2024-03-23T23:39:00.450 INFO:teuthology.orchestra.run.smithi196.stdout:Need to get 178 MB of archives. 2024-03-23T23:39:00.450 INFO:teuthology.orchestra.run.smithi196.stdout:After this operation, 738 MB of additional disk space will be used. 2024-03-23T23:39:00.450 INFO:teuthology.orchestra.run.smithi196.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-03-23T23:39:00.467 INFO:teuthology.orchestra.run.smithi196.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-03-23T23:39:00.478 INFO:teuthology.orchestra.run.smithi196.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-03-23T23:39:00.530 INFO:teuthology.orchestra.run.smithi196.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-03-23T23:39:00.556 INFO:teuthology.orchestra.run.smithi196.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-03-23T23:39:00.560 INFO:teuthology.orchestra.run.smithi196.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-03-23T23:39:00.574 INFO:teuthology.orchestra.run.smithi196.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-03-23T23:39:00.599 INFO:teuthology.orchestra.run.smithi008.stdout:0 upgraded, 124 newly installed, 0 to remove and 288 not upgraded. 2024-03-23T23:39:00.599 INFO:teuthology.orchestra.run.smithi008.stdout:Need to get 178 MB of archives. 2024-03-23T23:39:00.599 INFO:teuthology.orchestra.run.smithi008.stdout:After this operation, 738 MB of additional disk space will be used. 2024-03-23T23:39:00.599 INFO:teuthology.orchestra.run.smithi008.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2145-g3be9a5c9-1jammy [3,553 kB] 2024-03-23T23:39:00.599 INFO:teuthology.orchestra.run.smithi196.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2145-g3be9a5c9-1jammy [3,553 kB] 2024-03-23T23:39:00.621 INFO:teuthology.orchestra.run.smithi196.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-03-23T23:39:00.623 INFO:teuthology.orchestra.run.smithi196.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-03-23T23:39:00.630 INFO:teuthology.orchestra.run.smithi196.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-03-23T23:39:00.633 INFO:teuthology.orchestra.run.smithi196.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-03-23T23:39:00.634 INFO:teuthology.orchestra.run.smithi196.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-03-23T23:39:00.641 INFO:teuthology.orchestra.run.smithi196.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-03-23T23:39:00.643 INFO:teuthology.orchestra.run.smithi196.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-03-23T23:39:00.644 INFO:teuthology.orchestra.run.smithi008.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-03-23T23:39:00.645 INFO:teuthology.orchestra.run.smithi196.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-03-23T23:39:00.646 INFO:teuthology.orchestra.run.smithi196.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-03-23T23:39:00.647 INFO:teuthology.orchestra.run.smithi196.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-03-23T23:39:00.667 INFO:teuthology.orchestra.run.smithi196.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-03-23T23:39:00.669 INFO:teuthology.orchestra.run.smithi196.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-03-23T23:39:00.671 INFO:teuthology.orchestra.run.smithi196.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-03-23T23:39:00.671 INFO:teuthology.orchestra.run.smithi196.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-03-23T23:39:00.672 INFO:teuthology.orchestra.run.smithi196.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-03-23T23:39:00.673 INFO:teuthology.orchestra.run.smithi196.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-03-23T23:39:00.687 INFO:teuthology.orchestra.run.smithi196.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-03-23T23:39:00.688 INFO:teuthology.orchestra.run.smithi196.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-03-23T23:39:00.688 INFO:teuthology.orchestra.run.smithi196.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-03-23T23:39:00.689 INFO:teuthology.orchestra.run.smithi196.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-03-23T23:39:00.708 INFO:teuthology.orchestra.run.smithi196.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-03-23T23:39:00.709 INFO:teuthology.orchestra.run.smithi196.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-03-23T23:39:00.711 INFO:teuthology.orchestra.run.smithi196.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-03-23T23:39:00.712 INFO:teuthology.orchestra.run.smithi196.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-03-23T23:39:00.713 INFO:teuthology.orchestra.run.smithi196.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-03-23T23:39:00.713 INFO:teuthology.orchestra.run.smithi196.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-03-23T23:39:00.727 INFO:teuthology.orchestra.run.smithi008.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-03-23T23:39:00.729 INFO:teuthology.orchestra.run.smithi196.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-03-23T23:39:00.729 INFO:teuthology.orchestra.run.smithi196.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-03-23T23:39:00.730 INFO:teuthology.orchestra.run.smithi196.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-03-23T23:39:00.731 INFO:teuthology.orchestra.run.smithi196.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-03-23T23:39:00.749 INFO:teuthology.orchestra.run.smithi196.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-03-23T23:39:00.750 INFO:teuthology.orchestra.run.smithi196.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-03-23T23:39:00.754 INFO:teuthology.orchestra.run.smithi196.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-03-23T23:39:00.755 INFO:teuthology.orchestra.run.smithi196.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-03-23T23:39:00.756 INFO:teuthology.orchestra.run.smithi196.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-03-23T23:39:00.756 INFO:teuthology.orchestra.run.smithi196.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-03-23T23:39:00.770 INFO:teuthology.orchestra.run.smithi196.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-03-23T23:39:00.774 INFO:teuthology.orchestra.run.smithi008.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-03-23T23:39:00.774 INFO:teuthology.orchestra.run.smithi196.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-03-23T23:39:00.774 INFO:teuthology.orchestra.run.smithi196.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-03-23T23:39:00.774 INFO:teuthology.orchestra.run.smithi196.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-03-23T23:39:00.791 INFO:teuthology.orchestra.run.smithi196.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-03-23T23:39:00.793 INFO:teuthology.orchestra.run.smithi196.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-03-23T23:39:00.794 INFO:teuthology.orchestra.run.smithi196.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-03-23T23:39:00.794 INFO:teuthology.orchestra.run.smithi196.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-03-23T23:39:00.796 INFO:teuthology.orchestra.run.smithi196.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-03-23T23:39:00.842 INFO:teuthology.orchestra.run.smithi008.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2145-g3be9a5c9-1jammy [3,223 kB] 2024-03-23T23:39:00.846 INFO:teuthology.orchestra.run.smithi196.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-03-23T23:39:00.847 INFO:teuthology.orchestra.run.smithi196.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-03-23T23:39:00.848 INFO:teuthology.orchestra.run.smithi196.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-03-23T23:39:00.849 INFO:teuthology.orchestra.run.smithi196.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-03-23T23:39:00.850 INFO:teuthology.orchestra.run.smithi196.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-03-23T23:39:00.870 INFO:teuthology.orchestra.run.smithi196.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-03-23T23:39:00.872 INFO:teuthology.orchestra.run.smithi196.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-03-23T23:39:00.872 INFO:teuthology.orchestra.run.smithi196.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-03-23T23:39:00.890 INFO:teuthology.orchestra.run.smithi196.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-03-23T23:39:00.890 INFO:teuthology.orchestra.run.smithi196.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-03-23T23:39:00.891 INFO:teuthology.orchestra.run.smithi196.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-03-23T23:39:00.891 INFO:teuthology.orchestra.run.smithi196.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-03-23T23:39:00.892 INFO:teuthology.orchestra.run.smithi196.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-03-23T23:39:00.892 INFO:teuthology.orchestra.run.smithi196.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-03-23T23:39:00.904 INFO:teuthology.orchestra.run.smithi196.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-03-23T23:39:00.905 INFO:teuthology.orchestra.run.smithi196.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-03-23T23:39:00.909 INFO:teuthology.orchestra.run.smithi196.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-03-23T23:39:00.925 INFO:teuthology.orchestra.run.smithi196.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-03-23T23:39:00.926 INFO:teuthology.orchestra.run.smithi196.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-03-23T23:39:00.926 INFO:teuthology.orchestra.run.smithi196.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-03-23T23:39:00.930 INFO:teuthology.orchestra.run.smithi196.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-03-23T23:39:00.933 INFO:teuthology.orchestra.run.smithi196.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-03-23T23:39:00.933 INFO:teuthology.orchestra.run.smithi196.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-03-23T23:39:00.934 INFO:teuthology.orchestra.run.smithi196.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-03-23T23:39:00.945 INFO:teuthology.orchestra.run.smithi196.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-03-23T23:39:00.949 INFO:teuthology.orchestra.run.smithi196.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-03-23T23:39:00.950 INFO:teuthology.orchestra.run.smithi196.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-03-23T23:39:00.957 INFO:teuthology.orchestra.run.smithi008.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2145-g3be9a5c9-1jammy [712 kB] 2024-03-23T23:39:00.966 INFO:teuthology.orchestra.run.smithi196.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-03-23T23:39:00.966 INFO:teuthology.orchestra.run.smithi196.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-03-23T23:39:00.967 INFO:teuthology.orchestra.run.smithi196.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-03-23T23:39:00.967 INFO:teuthology.orchestra.run.smithi196.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-03-23T23:39:00.968 INFO:teuthology.orchestra.run.smithi196.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-03-23T23:39:00.969 INFO:teuthology.orchestra.run.smithi196.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-03-23T23:39:00.974 INFO:teuthology.orchestra.run.smithi008.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-03-23T23:39:00.976 INFO:teuthology.orchestra.run.smithi196.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-03-23T23:39:00.986 INFO:teuthology.orchestra.run.smithi196.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-03-23T23:39:00.986 INFO:teuthology.orchestra.run.smithi196.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-03-23T23:39:00.988 INFO:teuthology.orchestra.run.smithi196.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-03-23T23:39:00.994 INFO:teuthology.orchestra.run.smithi008.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2145-g3be9a5c9-1jammy [356 kB] 2024-03-23T23:39:01.006 INFO:teuthology.orchestra.run.smithi196.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-03-23T23:39:01.008 INFO:teuthology.orchestra.run.smithi008.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2145-g3be9a5c9-1jammy [32.8 kB] 2024-03-23T23:39:01.009 INFO:teuthology.orchestra.run.smithi008.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2145-g3be9a5c9-1jammy [180 kB] 2024-03-23T23:39:01.015 INFO:teuthology.orchestra.run.smithi008.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2145-g3be9a5c9-1jammy [64.6 kB] 2024-03-23T23:39:01.018 INFO:teuthology.orchestra.run.smithi008.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2145-g3be9a5c9-1jammy [330 kB] 2024-03-23T23:39:01.029 INFO:teuthology.orchestra.run.smithi008.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2145-g3be9a5c9-1jammy [6,659 kB] 2024-03-23T23:39:01.069 INFO:teuthology.orchestra.run.smithi008.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-03-23T23:39:01.082 INFO:teuthology.orchestra.run.smithi008.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-03-23T23:39:01.133 INFO:teuthology.orchestra.run.smithi008.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-03-23T23:39:01.291 INFO:teuthology.orchestra.run.smithi008.stdout:Get:17 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2145-g3be9a5c9-1jammy [112 kB] 2024-03-23T23:39:01.292 INFO:teuthology.orchestra.run.smithi008.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2145-g3be9a5c9-1jammy [467 kB] 2024-03-23T23:39:01.307 INFO:teuthology.orchestra.run.smithi008.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2145-g3be9a5c9-1jammy [25.0 MB] 2024-03-23T23:39:01.309 INFO:teuthology.orchestra.run.smithi008.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-03-23T23:39:01.318 INFO:teuthology.orchestra.run.smithi008.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-03-23T23:39:01.345 INFO:teuthology.orchestra.run.smithi008.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-03-23T23:39:01.350 INFO:teuthology.orchestra.run.smithi196.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2145-g3be9a5c9-1jammy [3,223 kB] 2024-03-23T23:39:01.352 INFO:teuthology.orchestra.run.smithi008.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-03-23T23:39:01.517 INFO:teuthology.orchestra.run.smithi008.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-03-23T23:39:01.829 INFO:teuthology.orchestra.run.smithi196.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2145-g3be9a5c9-1jammy [712 kB] 2024-03-23T23:39:01.929 INFO:teuthology.orchestra.run.smithi196.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2145-g3be9a5c9-1jammy [356 kB] 2024-03-23T23:39:01.988 INFO:teuthology.orchestra.run.smithi196.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2145-g3be9a5c9-1jammy [32.8 kB] 2024-03-23T23:39:01.990 INFO:teuthology.orchestra.run.smithi196.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2145-g3be9a5c9-1jammy [180 kB] 2024-03-23T23:39:02.013 INFO:teuthology.orchestra.run.smithi196.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2145-g3be9a5c9-1jammy [64.6 kB] 2024-03-23T23:39:02.025 INFO:teuthology.orchestra.run.smithi196.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2145-g3be9a5c9-1jammy [330 kB] 2024-03-23T23:39:02.076 INFO:teuthology.orchestra.run.smithi196.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2145-g3be9a5c9-1jammy [6,659 kB] 2024-03-23T23:39:02.098 INFO:teuthology.orchestra.run.smithi008.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-03-23T23:39:02.113 INFO:teuthology.orchestra.run.smithi008.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-03-23T23:39:02.128 INFO:teuthology.orchestra.run.smithi008.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-03-23T23:39:02.137 INFO:teuthology.orchestra.run.smithi008.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-03-23T23:39:02.138 INFO:teuthology.orchestra.run.smithi008.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-03-23T23:39:02.154 INFO:teuthology.orchestra.run.smithi008.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-03-23T23:39:02.191 INFO:teuthology.orchestra.run.smithi008.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-03-23T23:39:02.205 INFO:teuthology.orchestra.run.smithi008.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-03-23T23:39:02.209 INFO:teuthology.orchestra.run.smithi008.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-03-23T23:39:02.209 INFO:teuthology.orchestra.run.smithi008.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-03-23T23:39:02.362 INFO:teuthology.orchestra.run.smithi008.stdout:Get:35 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2145-g3be9a5c9-1jammy [5,083 kB] 2024-03-23T23:39:02.380 INFO:teuthology.orchestra.run.smithi008.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-03-23T23:39:02.463 INFO:teuthology.orchestra.run.smithi008.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-03-23T23:39:02.470 INFO:teuthology.orchestra.run.smithi008.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-03-23T23:39:02.545 INFO:teuthology.orchestra.run.smithi008.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-03-23T23:39:02.569 INFO:teuthology.orchestra.run.smithi008.stdout:Get:40 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2145-g3be9a5c9-1jammy [244 kB] 2024-03-23T23:39:02.573 INFO:teuthology.orchestra.run.smithi008.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-03-23T23:39:02.579 INFO:teuthology.orchestra.run.smithi008.stdout:Get:42 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2145-g3be9a5c9-1jammy [124 kB] 2024-03-23T23:39:02.583 INFO:teuthology.orchestra.run.smithi008.stdout:Get:43 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2145-g3be9a5c9-1jammy [1,525 kB] 2024-03-23T23:39:02.584 INFO:teuthology.orchestra.run.smithi008.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-03-23T23:39:02.626 INFO:teuthology.orchestra.run.smithi008.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-03-23T23:39:02.647 INFO:teuthology.orchestra.run.smithi008.stdout:Get:46 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2145-g3be9a5c9-1jammy [6,254 kB] 2024-03-23T23:39:02.804 INFO:teuthology.orchestra.run.smithi008.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-03-23T23:39:02.819 INFO:teuthology.orchestra.run.smithi008.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-03-23T23:39:02.825 INFO:teuthology.orchestra.run.smithi008.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-03-23T23:39:02.830 INFO:teuthology.orchestra.run.smithi008.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-03-23T23:39:02.912 INFO:teuthology.orchestra.run.smithi008.stdout:Get:51 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2145-g3be9a5c9-1jammy [22.8 MB] 2024-03-23T23:39:03.015 INFO:teuthology.orchestra.run.smithi008.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-03-23T23:39:03.070 INFO:teuthology.orchestra.run.smithi196.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2145-g3be9a5c9-1jammy [112 kB] 2024-03-23T23:39:03.087 INFO:teuthology.orchestra.run.smithi196.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2145-g3be9a5c9-1jammy [467 kB] 2024-03-23T23:39:03.098 INFO:teuthology.orchestra.run.smithi008.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-03-23T23:39:03.113 INFO:teuthology.orchestra.run.smithi008.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-03-23T23:39:03.155 INFO:teuthology.orchestra.run.smithi196.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2145-g3be9a5c9-1jammy [25.0 MB] 2024-03-23T23:39:03.299 INFO:teuthology.orchestra.run.smithi008.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-03-23T23:39:03.350 INFO:teuthology.orchestra.run.smithi008.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-03-23T23:39:03.362 INFO:teuthology.orchestra.run.smithi008.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-03-23T23:39:03.521 INFO:teuthology.orchestra.run.smithi008.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-03-23T23:39:03.521 INFO:teuthology.orchestra.run.smithi008.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-03-23T23:39:03.526 INFO:teuthology.orchestra.run.smithi008.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-03-23T23:39:03.531 INFO:teuthology.orchestra.run.smithi008.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-03-23T23:39:03.545 INFO:teuthology.orchestra.run.smithi008.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-03-23T23:39:03.730 INFO:teuthology.orchestra.run.smithi008.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-03-23T23:39:03.881 INFO:teuthology.orchestra.run.smithi008.stdout:Get:64 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2145-g3be9a5c9-1jammy [14.0 kB] 2024-03-23T23:39:03.881 INFO:teuthology.orchestra.run.smithi008.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2145-g3be9a5c9-1jammy [870 kB] 2024-03-23T23:39:03.911 INFO:teuthology.orchestra.run.smithi008.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2145-g3be9a5c9-1jammy [2,385 kB] 2024-03-23T23:39:03.992 INFO:teuthology.orchestra.run.smithi008.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-03-23T23:39:04.012 INFO:teuthology.orchestra.run.smithi008.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2145-g3be9a5c9-1jammy [777 kB] 2024-03-23T23:39:04.045 INFO:teuthology.orchestra.run.smithi008.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2145-g3be9a5c9-1jammy [144 kB] 2024-03-23T23:39:04.050 INFO:teuthology.orchestra.run.smithi008.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2145-g3be9a5c9-1jammy [1,936 kB] 2024-03-23T23:39:04.119 INFO:teuthology.orchestra.run.smithi008.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-03-23T23:39:04.133 INFO:teuthology.orchestra.run.smithi008.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2145-g3be9a5c9-1jammy [8,625 kB] 2024-03-23T23:39:04.162 INFO:teuthology.orchestra.run.smithi008.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-03-23T23:39:04.251 INFO:teuthology.orchestra.run.smithi008.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-03-23T23:39:04.260 INFO:teuthology.orchestra.run.smithi008.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-03-23T23:39:04.273 INFO:teuthology.orchestra.run.smithi008.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-03-23T23:39:04.314 INFO:teuthology.orchestra.run.smithi008.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-03-23T23:39:04.502 INFO:teuthology.orchestra.run.smithi008.stdout:Get:78 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2145-g3be9a5c9-1jammy [14.2 kB] 2024-03-23T23:39:04.502 INFO:teuthology.orchestra.run.smithi008.stdout:Get:79 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2145-g3be9a5c9-1jammy [50.2 MB] 2024-03-23T23:39:04.576 INFO:teuthology.orchestra.run.smithi008.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-03-23T23:39:04.577 INFO:teuthology.orchestra.run.smithi008.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-03-23T23:39:04.578 INFO:teuthology.orchestra.run.smithi008.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-03-23T23:39:04.743 INFO:teuthology.orchestra.run.smithi008.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-03-23T23:39:05.086 INFO:teuthology.orchestra.run.smithi008.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-03-23T23:39:05.495 INFO:teuthology.orchestra.run.smithi008.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-03-23T23:39:05.504 INFO:teuthology.orchestra.run.smithi008.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-03-23T23:39:05.505 INFO:teuthology.orchestra.run.smithi008.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-03-23T23:39:05.576 INFO:teuthology.orchestra.run.smithi008.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-03-23T23:39:05.576 INFO:teuthology.orchestra.run.smithi008.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-03-23T23:39:05.576 INFO:teuthology.orchestra.run.smithi008.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-03-23T23:39:05.577 INFO:teuthology.orchestra.run.smithi008.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-03-23T23:39:05.578 INFO:teuthology.orchestra.run.smithi008.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-03-23T23:39:05.579 INFO:teuthology.orchestra.run.smithi008.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-03-23T23:39:05.743 INFO:teuthology.orchestra.run.smithi008.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-03-23T23:39:05.960 INFO:teuthology.orchestra.run.smithi008.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-03-23T23:39:06.289 INFO:teuthology.orchestra.run.smithi008.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-03-23T23:39:06.335 INFO:teuthology.orchestra.run.smithi008.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-03-23T23:39:06.362 INFO:teuthology.orchestra.run.smithi008.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-03-23T23:39:06.371 INFO:teuthology.orchestra.run.smithi008.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-03-23T23:39:06.416 INFO:teuthology.orchestra.run.smithi008.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-03-23T23:39:06.442 INFO:teuthology.orchestra.run.smithi008.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-03-23T23:39:06.444 INFO:teuthology.orchestra.run.smithi008.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-03-23T23:39:06.451 INFO:teuthology.orchestra.run.smithi008.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-03-23T23:39:06.454 INFO:teuthology.orchestra.run.smithi008.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-03-23T23:39:06.643 INFO:teuthology.orchestra.run.smithi008.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2145-g3be9a5c9-1jammy [121 kB] 2024-03-23T23:39:06.644 INFO:teuthology.orchestra.run.smithi008.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-2145-g3be9a5c9-1jammy [228 kB] 2024-03-23T23:39:06.646 INFO:teuthology.orchestra.run.smithi008.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-2145-g3be9a5c9-1jammy [34.0 kB] 2024-03-23T23:39:06.647 INFO:teuthology.orchestra.run.smithi008.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-2145-g3be9a5c9-1jammy [23.4 kB] 2024-03-23T23:39:06.647 INFO:teuthology.orchestra.run.smithi008.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2145-g3be9a5c9-1jammy [38.5 kB] 2024-03-23T23:39:06.648 INFO:teuthology.orchestra.run.smithi008.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2145-g3be9a5c9-1jammy [13.2 MB] 2024-03-23T23:39:06.650 INFO:teuthology.orchestra.run.smithi008.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-03-23T23:39:06.798 INFO:teuthology.orchestra.run.smithi196.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2145-g3be9a5c9-1jammy [5,083 kB] 2024-03-23T23:39:06.909 INFO:teuthology.orchestra.run.smithi008.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-03-23T23:39:07.171 INFO:teuthology.orchestra.run.smithi008.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-03-23T23:39:07.173 INFO:teuthology.orchestra.run.smithi008.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-03-23T23:39:07.189 INFO:teuthology.orchestra.run.smithi008.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-03-23T23:39:07.194 INFO:teuthology.orchestra.run.smithi008.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-03-23T23:39:07.204 INFO:teuthology.orchestra.run.smithi008.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2145-g3be9a5c9-1jammy [91.7 kB] 2024-03-23T23:39:07.232 INFO:teuthology.orchestra.run.smithi008.stdout:Get:118 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-03-23T23:39:07.246 INFO:teuthology.orchestra.run.smithi008.stdout:Get:119 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-03-23T23:39:07.337 INFO:teuthology.orchestra.run.smithi008.stdout:Get:120 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-03-23T23:39:07.338 INFO:teuthology.orchestra.run.smithi008.stdout:Get:121 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-03-23T23:39:07.340 INFO:teuthology.orchestra.run.smithi008.stdout:Get:122 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-03-23T23:39:07.386 INFO:teuthology.orchestra.run.smithi196.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2145-g3be9a5c9-1jammy [244 kB] 2024-03-23T23:39:07.405 INFO:teuthology.orchestra.run.smithi196.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2145-g3be9a5c9-1jammy [124 kB] 2024-03-23T23:39:07.409 INFO:teuthology.orchestra.run.smithi196.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2145-g3be9a5c9-1jammy [1,525 kB] 2024-03-23T23:39:07.520 INFO:teuthology.orchestra.run.smithi008.stdout:Get:123 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-03-23T23:39:07.530 INFO:teuthology.orchestra.run.smithi196.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2145-g3be9a5c9-1jammy [6,254 kB] 2024-03-23T23:39:07.785 INFO:teuthology.orchestra.run.smithi008.stdout:Get:124 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-03-23T23:39:08.003 INFO:teuthology.orchestra.run.smithi196.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2145-g3be9a5c9-1jammy [22.8 MB] 2024-03-23T23:39:08.915 INFO:teuthology.orchestra.run.smithi008.stdout:Fetched 178 MB in 8s (22.9 MB/s) 2024-03-23T23:39:09.043 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-pyperclip. 2024-03-23T23:39:09.113 INFO:teuthology.orchestra.run.smithi008.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132923 files and directories currently installed.) 2024-03-23T23:39:09.117 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-03-23T23:39:09.158 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-03-23T23:39:09.486 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-wcwidth. 2024-03-23T23:39:09.500 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-03-23T23:39:09.545 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-23T23:39:09.642 INFO:teuthology.orchestra.run.smithi196.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2145-g3be9a5c9-1jammy [14.0 kB] 2024-03-23T23:39:09.643 INFO:teuthology.orchestra.run.smithi196.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2145-g3be9a5c9-1jammy [870 kB] 2024-03-23T23:39:09.684 INFO:teuthology.orchestra.run.smithi196.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2145-g3be9a5c9-1jammy [2,385 kB] 2024-03-23T23:39:09.824 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-cmd2. 2024-03-23T23:39:09.839 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-03-23T23:39:09.858 INFO:teuthology.orchestra.run.smithi196.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2145-g3be9a5c9-1jammy [777 kB] 2024-03-23T23:39:09.883 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-03-23T23:39:09.898 INFO:teuthology.orchestra.run.smithi196.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2145-g3be9a5c9-1jammy [144 kB] 2024-03-23T23:39:09.920 INFO:teuthology.orchestra.run.smithi196.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2145-g3be9a5c9-1jammy [1,936 kB] 2024-03-23T23:39:10.039 INFO:teuthology.orchestra.run.smithi196.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2145-g3be9a5c9-1jammy [8,625 kB] 2024-03-23T23:39:10.228 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-03-23T23:39:10.243 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-03-23T23:39:10.361 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-23T23:39:10.615 INFO:teuthology.orchestra.run.smithi196.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2145-g3be9a5c9-1jammy [14.2 kB] 2024-03-23T23:39:10.615 INFO:teuthology.orchestra.run.smithi196.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2145-g3be9a5c9-1jammy [50.2 MB] 2024-03-23T23:39:10.665 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-03-23T23:39:10.680 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-03-23T23:39:10.723 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-23T23:39:11.093 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-03-23T23:39:11.108 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-03-23T23:39:11.152 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-23T23:39:11.547 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-03-23T23:39:11.562 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-23T23:39:11.604 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-23T23:39:11.958 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-03-23T23:39:11.973 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-23T23:39:12.016 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-23T23:39:12.319 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-03-23T23:39:12.335 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-23T23:39:12.378 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-23T23:39:12.756 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-03-23T23:39:12.771 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-03-23T23:39:12.814 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-23T23:39:13.417 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package librados2. 2024-03-23T23:39:13.433 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../010-librados2_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:13.467 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking librados2 (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:13.878 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package librbd1. 2024-03-23T23:39:13.894 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../011-librbd1_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:13.905 INFO:teuthology.orchestra.run.smithi196.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2145-g3be9a5c9-1jammy [121 kB] 2024-03-23T23:39:13.906 INFO:teuthology.orchestra.run.smithi196.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-2145-g3be9a5c9-1jammy [228 kB] 2024-03-23T23:39:13.921 INFO:teuthology.orchestra.run.smithi196.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-2145-g3be9a5c9-1jammy [34.0 kB] 2024-03-23T23:39:13.921 INFO:teuthology.orchestra.run.smithi196.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-2145-g3be9a5c9-1jammy [23.4 kB] 2024-03-23T23:39:13.921 INFO:teuthology.orchestra.run.smithi196.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2145-g3be9a5c9-1jammy [38.5 kB] 2024-03-23T23:39:13.922 INFO:teuthology.orchestra.run.smithi196.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2145-g3be9a5c9-1jammy [13.2 MB] 2024-03-23T23:39:13.937 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking librbd1 (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:14.323 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libcephfs2. 2024-03-23T23:39:14.339 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:14.381 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libcephfs2 (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:14.693 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-rados. 2024-03-23T23:39:14.709 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../013-python3-rados_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:14.732 INFO:teuthology.orchestra.run.smithi196.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2145-g3be9a5c9-1jammy [91.7 kB] 2024-03-23T23:39:14.751 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-rados (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:15.029 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-03-23T23:39:15.044 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-2145-g3be9a5c9-1jammy_all.deb ... 2024-03-23T23:39:15.078 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-ceph-argparse (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:15.306 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-cephfs. 2024-03-23T23:39:15.321 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:15.364 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-cephfs (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:15.382 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 178 MB in 14s (12.4 MB/s) 2024-03-23T23:39:15.522 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pyperclip. 2024-03-23T23:39:15.590 INFO:teuthology.orchestra.run.smithi196.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132923 files and directories currently installed.) 2024-03-23T23:39:15.594 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-03-23T23:39:15.637 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-03-23T23:39:15.667 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-ceph-common. 2024-03-23T23:39:15.682 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-2145-g3be9a5c9-1jammy_all.deb ... 2024-03-23T23:39:15.725 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-ceph-common (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:15.939 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-wcwidth. 2024-03-23T23:39:15.953 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-03-23T23:39:15.990 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-23T23:39:16.070 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-prettytable. 2024-03-23T23:39:16.085 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-03-23T23:39:16.128 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-03-23T23:39:16.309 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cmd2. 2024-03-23T23:39:16.323 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-03-23T23:39:16.348 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-rbd. 2024-03-23T23:39:16.359 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-03-23T23:39:16.364 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:16.398 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-rbd (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:16.704 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-03-23T23:39:16.717 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-03-23T23:39:16.742 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-03-23T23:39:16.758 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-03-23T23:39:16.801 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-23T23:39:16.820 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-23T23:39:17.112 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-03-23T23:39:17.123 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-03-23T23:39:17.126 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-03-23T23:39:17.138 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-03-23T23:39:17.170 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-03-23T23:39:17.182 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-23T23:39:17.465 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-03-23T23:39:17.480 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-03-23T23:39:17.523 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-23T23:39:17.543 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-03-23T23:39:17.558 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-03-23T23:39:17.602 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-23T23:39:17.801 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package lua5.1. 2024-03-23T23:39:17.817 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-03-23T23:39:17.851 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-03-23T23:39:18.272 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-03-23T23:39:18.287 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-23T23:39:18.305 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package lua-any. 2024-03-23T23:39:18.320 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-03-23T23:39:18.330 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-23T23:39:18.363 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking lua-any (27ubuntu1) ... 2024-03-23T23:39:18.607 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package zip. 2024-03-23T23:39:18.623 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-03-23T23:39:18.666 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking zip (3.0-12build2) ... 2024-03-23T23:39:18.759 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-03-23T23:39:18.774 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-23T23:39:18.817 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-23T23:39:18.928 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package unzip. 2024-03-23T23:39:18.943 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-03-23T23:39:18.977 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-03-23T23:39:19.145 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-03-23T23:39:19.160 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-23T23:39:19.228 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-23T23:39:19.357 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package luarocks. 2024-03-23T23:39:19.376 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-03-23T23:39:19.416 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-03-23T23:39:19.548 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-03-23T23:39:19.563 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-03-23T23:39:19.599 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-23T23:39:19.799 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package librgw2. 2024-03-23T23:39:19.814 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../027-librgw2_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:19.856 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking librgw2 (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:19.926 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package librados2. 2024-03-23T23:39:19.940 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../010-librados2_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:19.984 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librados2 (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:20.351 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-rgw. 2024-03-23T23:39:20.366 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:20.418 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-rgw (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:20.444 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package librbd1. 2024-03-23T23:39:20.460 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../011-librbd1_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:20.502 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librbd1 (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:20.738 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package liboath0:amd64. 2024-03-23T23:39:20.753 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-03-23T23:39:20.788 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-03-23T23:39:20.905 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libcephfs2. 2024-03-23T23:39:20.919 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:20.963 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libcephfs2 (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:21.098 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libradosstriper1. 2024-03-23T23:39:21.115 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:21.156 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libradosstriper1 (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:21.241 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-rados. 2024-03-23T23:39:21.255 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../013-python3-rados_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:21.306 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-rados (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:21.602 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-03-23T23:39:21.603 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package ceph-common. 2024-03-23T23:39:21.617 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-2145-g3be9a5c9-1jammy_all.deb ... 2024-03-23T23:39:21.618 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../031-ceph-common_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:21.660 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking ceph-common (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:21.669 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-ceph-argparse (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:21.921 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cephfs. 2024-03-23T23:39:21.936 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:21.980 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cephfs (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:22.318 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-ceph-common. 2024-03-23T23:39:22.330 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-2145-g3be9a5c9-1jammy_all.deb ... 2024-03-23T23:39:22.373 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-ceph-common (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:22.702 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-prettytable. 2024-03-23T23:39:22.716 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-03-23T23:39:22.740 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package ceph-base. 2024-03-23T23:39:22.756 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../032-ceph-base_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:22.760 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-03-23T23:39:22.800 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking ceph-base (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:23.013 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-rbd. 2024-03-23T23:39:23.027 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:23.062 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-rbd (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:23.328 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-03-23T23:39:23.342 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-03-23T23:39:23.415 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-03-23T23:39:23.430 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-03-23T23:39:23.498 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-23T23:39:23.595 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-03-23T23:39:23.776 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-03-23T23:39:23.791 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-03-23T23:39:23.835 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-03-23T23:39:23.898 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-cheroot. 2024-03-23T23:39:23.913 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-03-23T23:39:23.956 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-23T23:39:24.137 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-03-23T23:39:24.152 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-03-23T23:39:24.187 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-23T23:39:24.276 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-03-23T23:39:24.291 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-03-23T23:39:24.343 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-03-23T23:39:24.507 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package lua5.1. 2024-03-23T23:39:24.522 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-03-23T23:39:24.566 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-03-23T23:39:24.637 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-jaraco.text. 2024-03-23T23:39:24.653 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-03-23T23:39:24.687 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-03-23T23:39:24.893 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package lua-any. 2024-03-23T23:39:24.908 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-03-23T23:39:24.952 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking lua-any (27ubuntu1) ... 2024-03-23T23:39:24.982 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-03-23T23:39:24.998 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-03-23T23:39:25.040 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-03-23T23:39:25.187 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package zip. 2024-03-23T23:39:25.202 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-03-23T23:39:25.238 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking zip (3.0-12build2) ... 2024-03-23T23:39:25.343 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-tempora. 2024-03-23T23:39:25.359 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-03-23T23:39:25.401 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-03-23T23:39:25.565 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package unzip. 2024-03-23T23:39:25.580 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-03-23T23:39:25.623 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-03-23T23:39:25.721 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-portend. 2024-03-23T23:39:25.737 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-03-23T23:39:25.779 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-03-23T23:39:26.044 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package luarocks. 2024-03-23T23:39:26.057 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-03-23T23:39:26.059 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-03-23T23:39:26.073 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-03-23T23:39:26.102 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-03-23T23:39:26.116 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-03-23T23:39:26.427 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-cherrypy3. 2024-03-23T23:39:26.443 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-03-23T23:39:26.485 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-03-23T23:39:26.518 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package librgw2. 2024-03-23T23:39:26.532 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../027-librgw2_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:26.576 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librgw2 (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:26.814 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-natsort. 2024-03-23T23:39:26.830 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-03-23T23:39:26.864 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-03-23T23:39:27.045 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-rgw. 2024-03-23T23:39:27.060 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:27.120 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-rgw (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:27.159 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-logutils. 2024-03-23T23:39:27.174 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-03-23T23:39:27.217 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-03-23T23:39:27.440 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package liboath0:amd64. 2024-03-23T23:39:27.454 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-03-23T23:39:27.498 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-03-23T23:39:27.529 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-markupsafe. 2024-03-23T23:39:27.544 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-03-23T23:39:27.587 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-03-23T23:39:27.818 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libradosstriper1. 2024-03-23T23:39:27.832 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:27.876 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libradosstriper1 (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:27.915 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-mako. 2024-03-23T23:39:27.930 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-03-23T23:39:27.973 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-23T23:39:28.293 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-simplegeneric. 2024-03-23T23:39:28.309 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-03-23T23:39:28.343 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-03-23T23:39:28.346 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-common. 2024-03-23T23:39:28.361 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../031-ceph-common_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:28.404 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-common (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:28.655 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-singledispatch. 2024-03-23T23:39:28.670 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-03-23T23:39:28.713 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-03-23T23:39:29.024 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-webob. 2024-03-23T23:39:29.039 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-03-23T23:39:29.082 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-03-23T23:39:29.434 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-base. 2024-03-23T23:39:29.444 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-waitress. 2024-03-23T23:39:29.449 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../032-ceph-base_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:29.459 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-03-23T23:39:29.493 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-base (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:29.505 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-23T23:39:29.822 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-tempita. 2024-03-23T23:39:29.837 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-03-23T23:39:29.880 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-03-23T23:39:30.055 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-03-23T23:39:30.068 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-03-23T23:39:30.113 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-03-23T23:39:30.208 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-paste. 2024-03-23T23:39:30.224 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-03-23T23:39:30.266 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-03-23T23:39:30.441 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cheroot. 2024-03-23T23:39:30.454 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-03-23T23:39:30.501 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-23T23:39:30.587 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-03-23T23:39:30.602 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-03-23T23:39:30.645 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-03-23T23:39:30.854 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-03-23T23:39:30.869 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-03-23T23:39:30.921 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-03-23T23:39:30.931 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-pastedeploy. 2024-03-23T23:39:30.946 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-03-23T23:39:30.989 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-03-23T23:39:31.190 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jaraco.text. 2024-03-23T23:39:31.205 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-03-23T23:39:31.240 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-03-23T23:39:31.309 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-webtest. 2024-03-23T23:39:31.324 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-03-23T23:39:31.367 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-03-23T23:39:31.576 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-03-23T23:39:31.590 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-03-23T23:39:31.634 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-03-23T23:39:31.654 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-pecan. 2024-03-23T23:39:31.669 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-03-23T23:39:31.712 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-03-23T23:39:31.937 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-tempora. 2024-03-23T23:39:31.951 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-03-23T23:39:32.012 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-03-23T23:39:32.042 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-certifi. 2024-03-23T23:39:32.057 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-03-23T23:39:32.100 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-03-23T23:39:32.290 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-portend. 2024-03-23T23:39:32.304 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-03-23T23:39:32.339 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-03-23T23:39:32.445 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-idna. 2024-03-23T23:39:32.460 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-03-23T23:39:32.503 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-idna (3.3-1) ... 2024-03-23T23:39:32.642 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-03-23T23:39:32.657 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-03-23T23:39:32.700 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-03-23T23:39:32.823 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-urllib3. 2024-03-23T23:39:32.838 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-03-23T23:39:32.881 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-23T23:39:32.987 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cherrypy3. 2024-03-23T23:39:33.002 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-03-23T23:39:33.037 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-03-23T23:39:33.209 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-requests. 2024-03-23T23:39:33.225 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-03-23T23:39:33.267 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-23T23:39:34.066 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-natsort. 2024-03-23T23:39:34.081 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-03-23T23:39:34.115 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-03-23T23:39:34.255 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-werkzeug. 2024-03-23T23:39:34.270 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-03-23T23:39:34.304 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-23T23:39:34.369 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-logutils. 2024-03-23T23:39:34.383 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-03-23T23:39:34.418 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-03-23T23:39:34.624 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-03-23T23:39:34.640 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-2145-g3be9a5c9-1jammy_all.deb ... 2024-03-23T23:39:34.682 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:34.754 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-markupsafe. 2024-03-23T23:39:34.769 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-03-23T23:39:34.812 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-03-23T23:39:35.088 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-03-23T23:39:35.103 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:35.146 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:35.148 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-mako. 2024-03-23T23:39:35.163 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-03-23T23:39:35.207 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-23T23:39:35.457 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-bcrypt. 2024-03-23T23:39:35.474 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-03-23T23:39:35.523 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-03-23T23:39:35.543 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-simplegeneric. 2024-03-23T23:39:35.558 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-03-23T23:39:35.610 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-03-23T23:39:35.785 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-openssl. 2024-03-23T23:39:35.801 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-03-23T23:39:35.843 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-03-23T23:39:35.896 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-singledispatch. 2024-03-23T23:39:35.911 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-03-23T23:39:35.946 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-03-23T23:39:36.180 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package ceph-mgr. 2024-03-23T23:39:36.196 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:36.215 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-webob. 2024-03-23T23:39:36.230 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-03-23T23:39:36.238 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking ceph-mgr (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:36.297 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-03-23T23:39:36.633 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package ceph-mon. 2024-03-23T23:39:36.643 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-waitress. 2024-03-23T23:39:36.649 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:36.657 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-03-23T23:39:36.691 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking ceph-mon (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:36.703 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-23T23:39:37.037 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-tempita. 2024-03-23T23:39:37.052 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-03-23T23:39:37.095 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-03-23T23:39:37.237 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package ceph-osd. 2024-03-23T23:39:37.253 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:37.286 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking ceph-osd (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:37.398 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-paste. 2024-03-23T23:39:37.413 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-03-23T23:39:37.456 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-03-23T23:39:37.809 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-03-23T23:39:37.824 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-03-23T23:39:37.867 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-03-23T23:39:38.048 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package ceph. 2024-03-23T23:39:38.066 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../068-ceph_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:38.106 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking ceph (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:38.187 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pastedeploy. 2024-03-23T23:39:38.202 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-03-23T23:39:38.237 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-03-23T23:39:38.342 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package ceph-fuse. 2024-03-23T23:39:38.358 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:38.400 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking ceph-fuse (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:38.498 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-webtest. 2024-03-23T23:39:38.513 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-03-23T23:39:38.556 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-03-23T23:39:38.884 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pecan. 2024-03-23T23:39:38.899 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-03-23T23:39:38.942 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-03-23T23:39:38.954 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package ceph-mds. 2024-03-23T23:39:38.968 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:39.004 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking ceph-mds (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:39.297 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-certifi. 2024-03-23T23:39:39.311 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-03-23T23:39:39.372 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-03-23T23:39:39.382 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package cephadm. 2024-03-23T23:39:39.396 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../071-cephadm_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:39.440 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking cephadm (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:39.682 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-idna. 2024-03-23T23:39:39.697 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-03-23T23:39:39.735 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-asyncssh. 2024-03-23T23:39:39.741 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-idna (3.3-1) ... 2024-03-23T23:39:39.748 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-03-23T23:39:39.793 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-03-23T23:39:40.069 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-urllib3. 2024-03-23T23:39:40.083 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-03-23T23:39:40.119 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-23T23:39:40.171 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-babel-localedata. 2024-03-23T23:39:40.185 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-03-23T23:39:40.237 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-23T23:39:40.447 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-requests. 2024-03-23T23:39:40.462 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-03-23T23:39:40.505 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-23T23:39:40.799 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-werkzeug. 2024-03-23T23:39:40.814 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-03-23T23:39:40.849 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-23T23:39:41.119 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-03-23T23:39:41.133 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-2145-g3be9a5c9-1jammy_all.deb ... 2024-03-23T23:39:41.193 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:41.242 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-babel. 2024-03-23T23:39:41.255 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-03-23T23:39:41.292 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-03-23T23:39:41.557 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-03-23T23:39:41.571 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:41.614 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:41.629 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-jinja2. 2024-03-23T23:39:41.641 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-03-23T23:39:41.679 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-23T23:39:41.942 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-bcrypt. 2024-03-23T23:39:41.957 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-03-23T23:39:42.000 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-03-23T23:39:42.061 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-03-23T23:39:42.073 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-2145-g3be9a5c9-1jammy_all.deb ... 2024-03-23T23:39:42.115 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:42.287 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-openssl. 2024-03-23T23:39:42.301 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-03-23T23:39:42.336 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-03-23T23:39:42.435 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-repoze.lru. 2024-03-23T23:39:42.449 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-03-23T23:39:42.493 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-03-23T23:39:42.664 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr. 2024-03-23T23:39:42.679 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:42.724 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:42.772 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-routes. 2024-03-23T23:39:42.786 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-03-23T23:39:42.830 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-03-23T23:39:43.126 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mon. 2024-03-23T23:39:43.141 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:43.183 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-03-23T23:39:43.183 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mon (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:43.197 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-2145-g3be9a5c9-1jammy_all.deb ... 2024-03-23T23:39:43.241 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:43.661 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-03-23T23:39:43.674 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-03-23T23:39:43.711 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-23T23:39:43.821 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-osd. 2024-03-23T23:39:43.834 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:43.879 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-osd (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:44.398 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-joblib. 2024-03-23T23:39:44.412 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-03-23T23:39:44.456 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-03-23T23:39:44.582 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph. 2024-03-23T23:39:44.596 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../068-ceph_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:44.632 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:44.793 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-03-23T23:39:44.806 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-03-23T23:39:44.921 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-03-23T23:39:44.976 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-fuse. 2024-03-23T23:39:44.991 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:45.034 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-fuse (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:45.190 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-sklearn. 2024-03-23T23:39:45.203 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-03-23T23:39:45.248 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-23T23:39:45.387 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mds. 2024-03-23T23:39:45.402 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:45.445 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mds (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:45.823 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package cephadm. 2024-03-23T23:39:45.838 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../071-cephadm_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:45.873 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking cephadm (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:45.951 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-03-23T23:39:45.964 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-2145-g3be9a5c9-1jammy_all.deb ... 2024-03-23T23:39:46.001 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:46.175 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-asyncssh. 2024-03-23T23:39:46.191 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-03-23T23:39:46.233 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-03-23T23:39:46.561 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python-babel-localedata. 2024-03-23T23:39:46.576 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-03-23T23:39:46.611 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-23T23:39:46.930 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-cachetools. 2024-03-23T23:39:46.943 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-03-23T23:39:46.987 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-03-23T23:39:47.266 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-pyasn1. 2024-03-23T23:39:47.280 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-03-23T23:39:47.324 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-03-23T23:39:47.632 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-babel. 2024-03-23T23:39:47.646 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-03-23T23:39:47.682 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-03-23T23:39:47.686 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-03-23T23:39:47.702 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-03-23T23:39:47.744 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-03-23T23:39:47.985 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jinja2. 2024-03-23T23:39:47.999 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-03-23T23:39:48.035 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-23T23:39:48.047 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-rsa. 2024-03-23T23:39:48.062 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-03-23T23:39:48.105 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-rsa (4.8-1) ... 2024-03-23T23:39:48.346 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-03-23T23:39:48.360 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-2145-g3be9a5c9-1jammy_all.deb ... 2024-03-23T23:39:48.396 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:48.426 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-google-auth. 2024-03-23T23:39:48.441 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-03-23T23:39:48.484 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-03-23T23:39:48.813 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-03-23T23:39:48.827 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-03-23T23:39:48.871 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-23T23:39:49.008 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-repoze.lru. 2024-03-23T23:39:49.022 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-03-23T23:39:49.057 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-03-23T23:39:49.183 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-websocket. 2024-03-23T23:39:49.194 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-03-23T23:39:49.233 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-03-23T23:39:49.395 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-routes. 2024-03-23T23:39:49.401 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-03-23T23:39:49.444 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-03-23T23:39:49.561 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-kubernetes. 2024-03-23T23:39:49.571 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-03-23T23:39:49.614 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-23T23:39:49.772 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-03-23T23:39:49.787 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-2145-g3be9a5c9-1jammy_all.deb ... 2024-03-23T23:39:49.832 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:50.250 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-03-23T23:39:50.257 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-03-23T23:39:50.302 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-23T23:39:50.325 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-03-23T23:39:50.337 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-2145-g3be9a5c9-1jammy_all.deb ... 2024-03-23T23:39:50.366 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:50.669 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libonig5:amd64. 2024-03-23T23:39:50.680 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-03-23T23:39:50.719 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-23T23:39:50.812 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-joblib. 2024-03-23T23:39:50.818 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-03-23T23:39:50.853 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-03-23T23:39:51.081 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libjq1:amd64. 2024-03-23T23:39:51.091 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-03-23T23:39:51.139 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-23T23:39:51.239 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-03-23T23:39:51.251 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-03-23T23:39:51.366 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-03-23T23:39:51.384 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package jq. 2024-03-23T23:39:51.396 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-03-23T23:39:51.425 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-03-23T23:39:51.661 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-sklearn. 2024-03-23T23:39:51.661 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package socat. 2024-03-23T23:39:51.673 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-03-23T23:39:51.675 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-03-23T23:39:51.710 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-23T23:39:51.711 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-03-23T23:39:51.997 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package xmlstarlet. 2024-03-23T23:39:52.009 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-03-23T23:39:52.056 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-03-23T23:39:52.353 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-03-23T23:39:52.363 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-2145-g3be9a5c9-1jammy_all.deb ... 2024-03-23T23:39:52.377 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package ceph-test. 2024-03-23T23:39:52.387 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../099-ceph-test_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:52.402 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:52.418 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking ceph-test (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:53.439 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cachetools. 2024-03-23T23:39:53.450 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-03-23T23:39:53.508 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-03-23T23:39:53.833 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pyasn1. 2024-03-23T23:39:53.845 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-03-23T23:39:53.874 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-03-23T23:39:54.203 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-03-23T23:39:54.215 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-03-23T23:39:54.253 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-03-23T23:39:54.547 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-rsa. 2024-03-23T23:39:54.559 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-03-23T23:39:54.690 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package ceph-volume. 2024-03-23T23:39:54.701 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-2145-g3be9a5c9-1jammy_all.deb ... 2024-03-23T23:39:54.740 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking ceph-volume (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:54.755 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-rsa (4.8-1) ... 2024-03-23T23:39:55.059 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-google-auth. 2024-03-23T23:39:55.071 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-03-23T23:39:55.109 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-03-23T23:39:55.119 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package cephfs-mirror. 2024-03-23T23:39:55.130 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:55.169 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking cephfs-mirror (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:55.446 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-03-23T23:39:55.455 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-colorama. 2024-03-23T23:39:55.457 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-03-23T23:39:55.466 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-03-23T23:39:55.495 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-23T23:39:55.496 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-03-23T23:39:55.741 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package cephfs-shell. 2024-03-23T23:39:55.752 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-2145-g3be9a5c9-1jammy_all.deb ... 2024-03-23T23:39:55.791 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking cephfs-shell (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:55.806 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-websocket. 2024-03-23T23:39:55.817 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-03-23T23:39:55.856 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-03-23T23:39:56.044 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package cephfs-top. 2024-03-23T23:39:56.055 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-2145-g3be9a5c9-1jammy_all.deb ... 2024-03-23T23:39:56.093 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking cephfs-top (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:56.193 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-kubernetes. 2024-03-23T23:39:56.204 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-03-23T23:39:56.243 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-23T23:39:56.329 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libcephfs-dev. 2024-03-23T23:39:56.341 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:56.379 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libcephfs-dev (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:56.674 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package lua-socket:amd64. 2024-03-23T23:39:56.685 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-03-23T23:39:56.715 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-23T23:39:56.940 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-03-23T23:39:56.950 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-2145-g3be9a5c9-1jammy_all.deb ... 2024-03-23T23:39:56.989 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:57.045 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package lua-sec:amd64. 2024-03-23T23:39:57.056 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-03-23T23:39:57.095 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-03-23T23:39:57.325 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libonig5:amd64. 2024-03-23T23:39:57.336 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-03-23T23:39:57.375 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-23T23:39:57.474 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package nvme-cli. 2024-03-23T23:39:57.485 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-03-23T23:39:57.523 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-03-23T23:39:57.687 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libjq1:amd64. 2024-03-23T23:39:57.697 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-03-23T23:39:57.736 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-23T23:39:57.954 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package pkg-config. 2024-03-23T23:39:57.966 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-03-23T23:39:58.004 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-03-23T23:39:58.031 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package jq. 2024-03-23T23:39:58.041 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-03-23T23:39:58.081 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-03-23T23:39:58.241 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-03-23T23:39:58.252 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-03-23T23:39:58.290 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-03-23T23:39:58.333 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package socat. 2024-03-23T23:39:58.344 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-03-23T23:39:58.383 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-03-23T23:39:58.703 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-iniconfig. 2024-03-23T23:39:58.703 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package xmlstarlet. 2024-03-23T23:39:58.714 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-03-23T23:39:58.717 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-03-23T23:39:58.752 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-03-23T23:39:58.753 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-03-23T23:39:59.055 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-pastescript. 2024-03-23T23:39:59.067 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-03-23T23:39:59.104 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-03-23T23:39:59.107 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-test. 2024-03-23T23:39:59.117 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../099-ceph-test_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:39:59.157 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-test (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:39:59.433 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-pluggy. 2024-03-23T23:39:59.444 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-03-23T23:39:59.483 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-03-23T23:39:59.819 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-psutil. 2024-03-23T23:39:59.830 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-03-23T23:39:59.869 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-03-23T23:40:00.189 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-py. 2024-03-23T23:40:00.200 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-03-23T23:40:00.239 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-py (1.10.0-1) ... 2024-03-23T23:40:00.551 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-pygments. 2024-03-23T23:40:00.561 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-03-23T23:40:00.617 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-03-23T23:40:01.061 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-volume. 2024-03-23T23:40:01.069 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-2145-g3be9a5c9-1jammy_all.deb ... 2024-03-23T23:40:01.071 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-pyinotify. 2024-03-23T23:40:01.081 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-03-23T23:40:01.111 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-volume (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:01.121 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-03-23T23:40:01.391 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-toml. 2024-03-23T23:40:01.401 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-03-23T23:40:01.432 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-03-23T23:40:01.531 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package cephfs-mirror. 2024-03-23T23:40:01.539 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:40:01.581 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking cephfs-mirror (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:01.735 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-pytest. 2024-03-23T23:40:01.747 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-03-23T23:40:01.785 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-03-23T23:40:01.892 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-colorama. 2024-03-23T23:40:01.900 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-03-23T23:40:01.942 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-03-23T23:40:02.105 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-simplejson. 2024-03-23T23:40:02.116 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-03-23T23:40:02.147 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-03-23T23:40:02.195 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package cephfs-shell. 2024-03-23T23:40:02.205 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-2145-g3be9a5c9-1jammy_all.deb ... 2024-03-23T23:40:02.236 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking cephfs-shell (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:02.392 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-03-23T23:40:02.402 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-03-23T23:40:02.441 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-03-23T23:40:02.496 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package cephfs-top. 2024-03-23T23:40:02.505 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-2145-g3be9a5c9-1jammy_all.deb ... 2024-03-23T23:40:02.546 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking cephfs-top (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:02.824 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libcephfs-dev. 2024-03-23T23:40:02.833 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:40:02.874 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libcephfs-dev (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:03.154 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package radosgw. 2024-03-23T23:40:03.164 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../122-radosgw_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:40:03.176 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package lua-socket:amd64. 2024-03-23T23:40:03.186 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-03-23T23:40:03.204 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking radosgw (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:03.226 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-23T23:40:03.572 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package lua-sec:amd64. 2024-03-23T23:40:03.582 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-03-23T23:40:03.622 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-03-23T23:40:03.815 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package rbd-fuse. 2024-03-23T23:40:03.825 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:40:03.874 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking rbd-fuse (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:04.017 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package nvme-cli. 2024-03-23T23:40:04.027 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-03-23T23:40:04.067 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-03-23T23:40:04.182 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-03-23T23:40:04.439 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package pkg-config. 2024-03-23T23:40:04.448 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-03-23T23:40:04.462 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-23T23:40:04.480 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-03-23T23:40:04.577 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-03-23T23:40:04.766 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-03-23T23:40:04.776 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-03-23T23:40:04.816 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-03-23T23:40:05.050 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-03-23T23:40:05.228 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-iniconfig. 2024-03-23T23:40:05.239 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-03-23T23:40:05.277 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-03-23T23:40:05.547 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pastescript. 2024-03-23T23:40:05.559 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-03-23T23:40:05.581 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-03-23T23:40:05.588 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-03-23T23:40:05.900 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pluggy. 2024-03-23T23:40:05.910 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-03-23T23:40:05.950 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-03-23T23:40:06.193 INFO:teuthology.orchestra.run.smithi008.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-03-23T23:40:06.238 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-psutil. 2024-03-23T23:40:06.249 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-03-23T23:40:06.250 INFO:teuthology.orchestra.run.smithi008.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-03-23T23:40:06.288 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-03-23T23:40:06.299 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up cephadm (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:06.632 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-py. 2024-03-23T23:40:06.643 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-03-23T23:40:06.682 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-py (1.10.0-1) ... 2024-03-23T23:40:06.834 INFO:teuthology.orchestra.run.smithi008.stdout:Adding system user cephadm....done 2024-03-23T23:40:06.979 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-23T23:40:07.043 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pygments. 2024-03-23T23:40:07.054 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-03-23T23:40:07.093 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-03-23T23:40:07.314 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-03-23T23:40:07.522 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pyinotify. 2024-03-23T23:40:07.532 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-03-23T23:40:07.597 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-03-23T23:40:07.624 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-03-23T23:40:07.750 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-03-23T23:40:07.899 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-toml. 2024-03-23T23:40:07.910 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-03-23T23:40:07.949 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-03-23T23:40:08.018 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-03-23T23:40:08.244 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pytest. 2024-03-23T23:40:08.254 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-03-23T23:40:08.269 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-03-23T23:40:08.285 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-03-23T23:40:08.395 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-py (1.10.0-1) ... 2024-03-23T23:40:08.631 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-simplejson. 2024-03-23T23:40:08.641 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-03-23T23:40:08.680 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-03-23T23:40:08.747 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-03-23T23:40:08.974 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-03-23T23:40:08.985 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-03-23T23:40:09.024 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-03-23T23:40:09.124 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-03-23T23:40:09.401 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-03-23T23:40:09.669 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-03-23T23:40:09.953 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-03-23T23:40:09.969 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package radosgw. 2024-03-23T23:40:09.980 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../122-radosgw_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:40:10.011 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking radosgw (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:10.205 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-03-23T23:40:10.472 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-03-23T23:40:10.614 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package rbd-fuse. 2024-03-23T23:40:10.625 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-2145-g3be9a5c9-1jammy_amd64.deb ... 2024-03-23T23:40:10.664 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking rbd-fuse (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:10.751 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-03-23T23:40:10.970 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-03-23T23:40:11.017 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-ceph-argparse (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:11.244 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-23T23:40:11.326 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-23T23:40:11.361 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-03-23T23:40:11.435 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-23T23:40:11.544 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-03-23T23:40:11.631 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-03-23T23:40:11.813 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-03-23T23:40:11.913 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-03-23T23:40:12.032 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-03-23T23:40:12.164 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-03-23T23:40:12.536 INFO:teuthology.orchestra.run.smithi008.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-03-23T23:40:12.571 INFO:teuthology.orchestra.run.smithi008.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-03-23T23:40:12.619 INFO:teuthology.orchestra.run.smithi196.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-03-23T23:40:12.635 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-23T23:40:12.655 INFO:teuthology.orchestra.run.smithi196.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-03-23T23:40:12.713 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up cephadm (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:12.761 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-03-23T23:40:13.162 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-23T23:40:13.214 INFO:teuthology.orchestra.run.smithi196.stdout:Adding system user cephadm....done 2024-03-23T23:40:13.272 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-03-23T23:40:13.402 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-23T23:40:13.531 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-03-23T23:40:13.678 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-03-23T23:40:13.807 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-03-23T23:40:13.937 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-03-23T23:40:14.063 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-03-23T23:40:14.150 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up zip (3.0-12build2) ... 2024-03-23T23:40:14.276 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-03-23T23:40:14.323 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-03-23T23:40:14.591 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-03-23T23:40:14.716 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-py (1.10.0-1) ... 2024-03-23T23:40:15.035 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-03-23T23:40:15.186 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-03-23T23:40:15.429 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-03-23T23:40:15.463 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-03-23T23:40:15.589 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-03-23T23:40:15.715 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-23T23:40:15.740 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-03-23T23:40:16.024 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-03-23T23:40:16.088 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-03-23T23:40:16.299 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-03-23T23:40:16.499 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-03-23T23:40:16.625 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-03-23T23:40:16.761 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-03-23T23:40:17.068 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-03-23T23:40:17.179 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-23T23:40:17.344 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-03-23T23:40:17.480 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-03-23T23:40:17.595 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-ceph-argparse (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:17.806 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-23T23:40:17.898 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-23T23:40:18.022 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-23T23:40:18.148 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-03-23T23:40:18.166 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-03-23T23:40:18.449 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-03-23T23:40:18.450 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-03-23T23:40:18.559 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-ceph-common (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:18.575 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-03-23T23:40:18.853 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-idna (3.3-1) ... 2024-03-23T23:40:18.876 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-03-23T23:40:19.212 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-23T23:40:19.356 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-03-23T23:40:19.389 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-03-23T23:40:19.495 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-23T23:40:19.622 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-03-23T23:40:20.006 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-23T23:40:20.157 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-03-23T23:40:20.458 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-03-23T23:40:20.494 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-03-23T23:40:20.720 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-23T23:40:20.734 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-03-23T23:40:20.854 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-toml (0.10.2-1) ... 2024-03-23T23:40:21.043 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up zip (3.0-12build2) ... 2024-03-23T23:40:21.131 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-23T23:40:21.161 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-03-23T23:40:21.257 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-03-23T23:40:21.391 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-23T23:40:21.734 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-03-23T23:40:21.846 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-03-23T23:40:21.994 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-03-23T23:40:22.147 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-03-23T23:40:22.262 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-23T23:40:22.273 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-03-23T23:40:22.388 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-03-23T23:40:22.416 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-23T23:40:22.706 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-03-23T23:40:22.759 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-03-23T23:40:22.982 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-03-23T23:40:23.160 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-03-23T23:40:23.258 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-03-23T23:40:23.411 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-03-23T23:40:23.534 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-03-23T23:40:23.786 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-03-23T23:40:23.796 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-23T23:40:24.053 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-23T23:40:24.097 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-03-23T23:40:24.179 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-03-23T23:40:24.423 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-23T23:40:24.480 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-23T23:40:24.607 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-23T23:40:24.783 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-03-23T23:40:24.925 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-03-23T23:40:25.059 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-03-23T23:40:25.176 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-ceph-common (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:25.243 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-03-23T23:40:25.478 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-idna (3.3-1) ... 2024-03-23T23:40:25.519 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-23T23:40:25.645 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-03-23T23:40:25.754 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-03-23T23:40:25.826 INFO:teuthology.orchestra.run.smithi008.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-03-23T23:40:25.845 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-23T23:40:26.114 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-23T23:40:26.240 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-03-23T23:40:26.659 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-03-23T23:40:26.960 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up lua-any (27ubuntu1) ... 2024-03-23T23:40:27.076 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-03-23T23:40:27.086 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-portend (3.0.0-1) ... 2024-03-23T23:40:27.294 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-23T23:40:27.354 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-23T23:40:27.462 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-toml (0.10.2-1) ... 2024-03-23T23:40:27.480 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-23T23:40:27.746 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-23T23:40:27.806 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-03-23T23:40:27.872 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-03-23T23:40:28.023 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-23T23:40:28.132 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-23T23:40:28.333 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-03-23T23:40:28.425 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-03-23T23:40:28.634 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-03-23T23:40:28.636 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-rsa (4.8-1) ... 2024-03-23T23:40:28.893 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-23T23:40:28.913 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-03-23T23:40:29.002 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-03-23T23:40:29.189 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-23T23:40:29.312 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-03-23T23:40:29.466 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-03-23T23:40:29.580 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-03-23T23:40:29.860 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-03-23T23:40:29.864 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-03-23T23:40:30.132 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-03-23T23:40:30.152 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-03-23T23:40:30.400 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-03-23T23:40:30.530 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-23T23:40:30.656 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up librados2 (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:30.709 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-23T23:40:30.782 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:30.826 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-03-23T23:40:30.909 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-03-23T23:40:31.094 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-23T23:40:31.220 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-23T23:40:31.262 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libcephfs2 (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:31.413 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libradosstriper1 (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:31.521 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-03-23T23:40:31.539 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-03-23T23:40:31.840 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up librbd1 (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:31.856 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-03-23T23:40:31.969 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up ceph-mgr-modules-core (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:32.095 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up ceph-fuse (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:32.123 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-23T23:40:32.274 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-03-23T23:40:32.306 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-23T23:40:32.306 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-23T23:40:32.400 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-03-23T23:40:32.489 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-03-23T23:40:32.735 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-23T23:40:32.878 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-03-23T23:40:32.963 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libcephfs-dev (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:33.088 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-rados (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:33.214 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up librgw2 (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:33.287 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-03-23T23:40:33.341 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up cephfs-top (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:33.491 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-23T23:40:33.564 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up lua-any (27ubuntu1) ... 2024-03-23T23:40:33.689 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-portend (3.0.0-1) ... 2024-03-23T23:40:33.958 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-23T23:40:34.108 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-23T23:40:34.426 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-03-23T23:40:34.718 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-23T23:40:34.854 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-rbd (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:34.980 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up rbd-fuse (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:34.995 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-03-23T23:40:35.106 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-rgw (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:35.206 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-rsa (4.8-1) ... 2024-03-23T23:40:35.232 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-cephfs (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:35.374 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up cephfs-shell (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:35.501 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up ceph-common (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:35.516 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-03-23T23:40:35.800 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-23T23:40:36.093 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-03-23T23:40:36.129 INFO:teuthology.orchestra.run.smithi008.stdout:Adding group ceph....done 2024-03-23T23:40:36.470 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-03-23T23:40:36.488 INFO:teuthology.orchestra.run.smithi008.stdout:Adding system user ceph....done 2024-03-23T23:40:36.657 INFO:teuthology.orchestra.run.smithi008.stdout:Setting system user ceph properties....done 2024-03-23T23:40:36.676 INFO:teuthology.orchestra.run.smithi008.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-03-23T23:40:36.796 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-03-23T23:40:36.829 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-03-23T23:40:37.165 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-23T23:40:37.229 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-03-23T23:40:37.292 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librados2 (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:37.401 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:37.502 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-03-23T23:40:37.879 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libcephfs2 (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:37.902 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up cephfs-mirror (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:38.005 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libradosstriper1 (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:38.101 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-03-23T23:40:38.101 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-03-23T23:40:38.131 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-03-23T23:40:38.433 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librbd1 (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:38.542 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-modules-core (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:38.651 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-fuse (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:38.753 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up ceph-test (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:38.845 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-23T23:40:38.845 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-23T23:40:38.879 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up radosgw (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:39.425 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-23T23:40:39.425 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-23T23:40:39.461 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libcephfs-dev (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:39.612 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-rados (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:39.738 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librgw2 (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:39.864 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up cephfs-top (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:39.990 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-23T23:40:40.089 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up ceph-base (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:40.460 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-03-23T23:40:41.117 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up ceph-mds (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:41.285 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-rbd (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:41.356 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-23T23:40:41.356 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-23T23:40:41.436 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up rbd-fuse (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:41.562 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-rgw (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:41.688 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cephfs (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:41.814 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up cephfs-shell (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:41.940 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-common (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:42.036 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up ceph-mgr (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:42.248 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-23T23:40:42.248 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-23T23:40:42.475 INFO:teuthology.orchestra.run.smithi196.stdout:Adding group ceph....done 2024-03-23T23:40:42.853 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up ceph-osd (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:42.876 INFO:teuthology.orchestra.run.smithi196.stdout:Adding system user ceph....done 2024-03-23T23:40:43.054 INFO:teuthology.orchestra.run.smithi196.stdout:Setting system user ceph properties....done 2024-03-23T23:40:43.073 INFO:teuthology.orchestra.run.smithi196.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-03-23T23:40:43.180 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-23T23:40:43.180 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-23T23:40:43.212 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-03-23T23:40:43.575 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-03-23T23:40:43.805 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:43.931 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:44.077 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up ceph-mon (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:44.257 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up cephfs-mirror (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:44.290 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-23T23:40:44.291 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-23T23:40:44.470 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-03-23T23:40:44.470 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-03-23T23:40:44.959 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up ceph-mgr-cephadm (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:45.067 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-test (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:45.102 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up ceph (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:45.184 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up radosgw (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:45.203 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up ceph-mgr-dashboard (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:45.338 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up ceph-volume (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:45.686 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-23T23:40:45.686 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-23T23:40:45.859 INFO:teuthology.orchestra.run.smithi008.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-03-23T23:40:45.974 INFO:teuthology.orchestra.run.smithi008.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-23T23:40:46.126 INFO:teuthology.orchestra.run.smithi008.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-23T23:40:46.295 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-base (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:46.654 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-03-23T23:40:47.228 INFO:teuthology.orchestra.run.smithi008.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-23T23:40:47.330 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mds (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:47.600 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-23T23:40:47.600 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-23T23:40:47.995 INFO:teuthology.orchestra.run.smithi008.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-23T23:40:47.999 DEBUG:teuthology.orchestra.run.smithi008:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-03-23T23:40:48.074 INFO:teuthology.orchestra.run.smithi008.stdout:Reading package lists... 2024-03-23T23:40:48.223 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:48.250 INFO:teuthology.orchestra.run.smithi008.stdout:Building dependency tree... 2024-03-23T23:40:48.250 INFO:teuthology.orchestra.run.smithi008.stdout:Reading state information... 2024-03-23T23:40:48.416 INFO:teuthology.orchestra.run.smithi008.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-03-23T23:40:48.416 INFO:teuthology.orchestra.run.smithi008.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-03-23T23:40:48.416 INFO:teuthology.orchestra.run.smithi008.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-03-23T23:40:48.416 INFO:teuthology.orchestra.run.smithi008.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-03-23T23:40:48.416 INFO:teuthology.orchestra.run.smithi008.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-03-23T23:40:48.416 INFO:teuthology.orchestra.run.smithi008.stdout:The following packages were automatically installed and are no longer required: 2024-03-23T23:40:48.416 INFO:teuthology.orchestra.run.smithi008.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-23T23:40:48.416 INFO:teuthology.orchestra.run.smithi008.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-23T23:40:48.416 INFO:teuthology.orchestra.run.smithi008.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-23T23:40:48.417 INFO:teuthology.orchestra.run.smithi008.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-23T23:40:48.417 INFO:teuthology.orchestra.run.smithi008.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-23T23:40:48.417 INFO:teuthology.orchestra.run.smithi008.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-23T23:40:48.418 INFO:teuthology.orchestra.run.smithi008.stdout:The following additional packages will be installed: 2024-03-23T23:40:48.418 INFO:teuthology.orchestra.run.smithi008.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-03-23T23:40:48.418 INFO:teuthology.orchestra.run.smithi008.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-03-23T23:40:48.418 INFO:teuthology.orchestra.run.smithi008.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-03-23T23:40:48.418 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-03-23T23:40:48.419 INFO:teuthology.orchestra.run.smithi008.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-03-23T23:40:48.419 INFO:teuthology.orchestra.run.smithi008.stdout:Suggested packages: 2024-03-23T23:40:48.419 INFO:teuthology.orchestra.run.smithi008.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-03-23T23:40:48.419 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-03-23T23:40:48.419 INFO:teuthology.orchestra.run.smithi008.stdout: libengine-pkcs11-openssl 2024-03-23T23:40:48.437 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-23T23:40:48.437 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-23T23:40:48.470 INFO:teuthology.orchestra.run.smithi008.stdout:The following NEW packages will be installed: 2024-03-23T23:40:48.470 INFO:teuthology.orchestra.run.smithi008.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-03-23T23:40:48.470 INFO:teuthology.orchestra.run.smithi008.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-03-23T23:40:48.471 INFO:teuthology.orchestra.run.smithi008.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-03-23T23:40:48.471 INFO:teuthology.orchestra.run.smithi008.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-03-23T23:40:48.471 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-03-23T23:40:48.471 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-03-23T23:40:48.471 INFO:teuthology.orchestra.run.smithi008.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-03-23T23:40:48.472 INFO:teuthology.orchestra.run.smithi008.stdout:The following packages will be upgraded: 2024-03-23T23:40:48.473 INFO:teuthology.orchestra.run.smithi008.stdout: libssl3 2024-03-23T23:40:48.558 INFO:teuthology.orchestra.run.smithi008.stdout:1 upgraded, 39 newly installed, 0 to remove and 287 not upgraded. 2024-03-23T23:40:48.558 INFO:teuthology.orchestra.run.smithi008.stdout:Need to get 54.6 MB of archives. 2024-03-23T23:40:48.558 INFO:teuthology.orchestra.run.smithi008.stdout:After this operation, 202 MB of additional disk space will be used. 2024-03-23T23:40:48.558 INFO:teuthology.orchestra.run.smithi008.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-03-23T23:40:48.683 INFO:teuthology.orchestra.run.smithi008.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-03-23T23:40:48.751 INFO:teuthology.orchestra.run.smithi008.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-03-23T23:40:48.761 INFO:teuthology.orchestra.run.smithi008.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-03-23T23:40:48.762 INFO:teuthology.orchestra.run.smithi008.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-03-23T23:40:48.763 INFO:teuthology.orchestra.run.smithi008.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-03-23T23:40:48.764 INFO:teuthology.orchestra.run.smithi008.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-03-23T23:40:48.765 INFO:teuthology.orchestra.run.smithi008.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-03-23T23:40:48.766 INFO:teuthology.orchestra.run.smithi008.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-03-23T23:40:48.767 INFO:teuthology.orchestra.run.smithi008.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-03-23T23:40:48.767 INFO:teuthology.orchestra.run.smithi008.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-03-23T23:40:48.774 INFO:teuthology.orchestra.run.smithi008.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-03-23T23:40:48.788 INFO:teuthology.orchestra.run.smithi008.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-03-23T23:40:49.049 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-osd (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:49.198 INFO:teuthology.orchestra.run.smithi008.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-03-23T23:40:49.200 INFO:teuthology.orchestra.run.smithi008.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-03-23T23:40:49.201 INFO:teuthology.orchestra.run.smithi008.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-03-23T23:40:49.204 INFO:teuthology.orchestra.run.smithi008.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-03-23T23:40:49.204 INFO:teuthology.orchestra.run.smithi008.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-03-23T23:40:49.209 INFO:teuthology.orchestra.run.smithi008.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-03-23T23:40:49.210 INFO:teuthology.orchestra.run.smithi008.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-03-23T23:40:49.227 INFO:teuthology.orchestra.run.smithi008.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-03-23T23:40:49.227 INFO:teuthology.orchestra.run.smithi008.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-03-23T23:40:49.265 INFO:teuthology.orchestra.run.smithi008.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-03-23T23:40:49.272 INFO:teuthology.orchestra.run.smithi008.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-03-23T23:40:49.284 INFO:teuthology.orchestra.run.smithi008.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-03-23T23:40:49.318 INFO:teuthology.orchestra.run.smithi008.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-03-23T23:40:49.329 INFO:teuthology.orchestra.run.smithi008.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-03-23T23:40:49.330 INFO:teuthology.orchestra.run.smithi008.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-03-23T23:40:49.331 INFO:teuthology.orchestra.run.smithi008.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-03-23T23:40:49.331 INFO:teuthology.orchestra.run.smithi008.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-03-23T23:40:49.353 INFO:teuthology.orchestra.run.smithi008.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-03-23T23:40:49.355 INFO:teuthology.orchestra.run.smithi008.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-03-23T23:40:49.358 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-23T23:40:49.358 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-23T23:40:49.594 INFO:teuthology.orchestra.run.smithi008.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-03-23T23:40:49.594 INFO:teuthology.orchestra.run.smithi008.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-03-23T23:40:49.594 INFO:teuthology.orchestra.run.smithi008.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-03-23T23:40:49.594 INFO:teuthology.orchestra.run.smithi008.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-03-23T23:40:49.595 INFO:teuthology.orchestra.run.smithi008.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-03-23T23:40:49.595 INFO:teuthology.orchestra.run.smithi008.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-03-23T23:40:49.608 INFO:teuthology.orchestra.run.smithi008.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-03-23T23:40:49.609 INFO:teuthology.orchestra.run.smithi008.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-03-23T23:40:49.992 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:50.011 INFO:teuthology.orchestra.run.smithi008.stdout:Preconfiguring packages ... 2024-03-23T23:40:50.110 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:50.159 INFO:teuthology.orchestra.run.smithi008.stdout:Fetched 54.6 MB in 1s (48.4 MB/s) 2024-03-23T23:40:50.252 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mon (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:50.300 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package flex. 2024-03-23T23:40:50.374 INFO:teuthology.orchestra.run.smithi008.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140586 files and directories currently installed.) 2024-03-23T23:40:50.377 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-03-23T23:40:50.416 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking flex (2.6.4-8build2) ... 2024-03-23T23:40:50.460 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-23T23:40:50.460 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-23T23:40:51.062 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-03-23T23:40:51.121 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-cephadm (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:51.206 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-03-23T23:40:51.263 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:51.389 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-dashboard (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:51.532 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-volume (19.0.0-2145-g3be9a5c9-1jammy) ... 2024-03-23T23:40:51.571 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-23T23:40:51.876 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-03-23T23:40:51.985 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-23T23:40:52.099 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package bison. 2024-03-23T23:40:52.137 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-23T23:40:52.172 INFO:teuthology.orchestra.run.smithi008.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140659 files and directories currently installed.) 2024-03-23T23:40:52.176 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-03-23T23:40:52.226 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-03-23T23:40:52.602 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-03-23T23:40:52.617 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-03-23T23:40:52.652 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-03-23T23:40:52.980 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package dump. 2024-03-23T23:40:52.996 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-03-23T23:40:53.064 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking dump (0.4b47-3) ... 2024-03-23T23:40:53.279 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-23T23:40:53.325 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package indent. 2024-03-23T23:40:53.341 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-03-23T23:40:53.384 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-03-23T23:40:53.628 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-03-23T23:40:53.644 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-03-23T23:40:53.687 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-03-23T23:40:53.990 INFO:teuthology.orchestra.run.smithi196.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-23T23:40:53.990 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-03-23T23:40:53.994 DEBUG:teuthology.orchestra.run.smithi196:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-03-23T23:40:54.006 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-03-23T23:40:54.048 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-03-23T23:40:54.068 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-03-23T23:40:54.245 INFO:teuthology.orchestra.run.smithi196.stdout:Building dependency tree... 2024-03-23T23:40:54.246 INFO:teuthology.orchestra.run.smithi196.stdout:Reading state information... 2024-03-23T23:40:54.326 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-03-23T23:40:54.342 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-03-23T23:40:54.384 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-03-23T23:40:54.403 INFO:teuthology.orchestra.run.smithi196.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-03-23T23:40:54.403 INFO:teuthology.orchestra.run.smithi196.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-03-23T23:40:54.404 INFO:teuthology.orchestra.run.smithi196.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-03-23T23:40:54.404 INFO:teuthology.orchestra.run.smithi196.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-03-23T23:40:54.404 INFO:teuthology.orchestra.run.smithi196.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-03-23T23:40:54.404 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages were automatically installed and are no longer required: 2024-03-23T23:40:54.404 INFO:teuthology.orchestra.run.smithi196.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-23T23:40:54.404 INFO:teuthology.orchestra.run.smithi196.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-23T23:40:54.404 INFO:teuthology.orchestra.run.smithi196.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-23T23:40:54.404 INFO:teuthology.orchestra.run.smithi196.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-23T23:40:54.405 INFO:teuthology.orchestra.run.smithi196.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-23T23:40:54.405 INFO:teuthology.orchestra.run.smithi196.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-23T23:40:54.406 INFO:teuthology.orchestra.run.smithi196.stdout:The following additional packages will be installed: 2024-03-23T23:40:54.406 INFO:teuthology.orchestra.run.smithi196.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-03-23T23:40:54.406 INFO:teuthology.orchestra.run.smithi196.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-03-23T23:40:54.406 INFO:teuthology.orchestra.run.smithi196.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-03-23T23:40:54.406 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-03-23T23:40:54.406 INFO:teuthology.orchestra.run.smithi196.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-03-23T23:40:54.406 INFO:teuthology.orchestra.run.smithi196.stdout:Suggested packages: 2024-03-23T23:40:54.407 INFO:teuthology.orchestra.run.smithi196.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-03-23T23:40:54.407 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-03-23T23:40:54.407 INFO:teuthology.orchestra.run.smithi196.stdout: libengine-pkcs11-openssl 2024-03-23T23:40:54.456 INFO:teuthology.orchestra.run.smithi196.stdout:The following NEW packages will be installed: 2024-03-23T23:40:54.457 INFO:teuthology.orchestra.run.smithi196.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-03-23T23:40:54.457 INFO:teuthology.orchestra.run.smithi196.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-03-23T23:40:54.457 INFO:teuthology.orchestra.run.smithi196.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-03-23T23:40:54.457 INFO:teuthology.orchestra.run.smithi196.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-03-23T23:40:54.458 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-03-23T23:40:54.458 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-03-23T23:40:54.458 INFO:teuthology.orchestra.run.smithi196.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-03-23T23:40:54.459 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages will be upgraded: 2024-03-23T23:40:54.459 INFO:teuthology.orchestra.run.smithi196.stdout: libssl3 2024-03-23T23:40:54.573 INFO:teuthology.orchestra.run.smithi196.stdout:1 upgraded, 39 newly installed, 0 to remove and 287 not upgraded. 2024-03-23T23:40:54.574 INFO:teuthology.orchestra.run.smithi196.stdout:Need to get 54.6 MB of archives. 2024-03-23T23:40:54.574 INFO:teuthology.orchestra.run.smithi196.stdout:After this operation, 202 MB of additional disk space will be used. 2024-03-23T23:40:54.574 INFO:teuthology.orchestra.run.smithi196.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-03-23T23:40:54.721 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libfl2:amd64. 2024-03-23T23:40:54.738 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-03-23T23:40:54.779 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-03-23T23:40:54.884 INFO:teuthology.orchestra.run.smithi196.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-03-23T23:40:55.032 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-03-23T23:40:55.048 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-03-23T23:40:55.069 INFO:teuthology.orchestra.run.smithi196.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-03-23T23:40:55.090 INFO:teuthology.orchestra.run.smithi196.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-03-23T23:40:55.090 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-03-23T23:40:55.091 INFO:teuthology.orchestra.run.smithi196.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-03-23T23:40:55.095 INFO:teuthology.orchestra.run.smithi196.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-03-23T23:40:55.099 INFO:teuthology.orchestra.run.smithi196.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-03-23T23:40:55.100 INFO:teuthology.orchestra.run.smithi196.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-03-23T23:40:55.102 INFO:teuthology.orchestra.run.smithi196.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-03-23T23:40:55.104 INFO:teuthology.orchestra.run.smithi196.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-03-23T23:40:55.104 INFO:teuthology.orchestra.run.smithi196.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-03-23T23:40:55.115 INFO:teuthology.orchestra.run.smithi196.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-03-23T23:40:55.146 INFO:teuthology.orchestra.run.smithi196.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-03-23T23:40:55.359 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libjson-perl. 2024-03-23T23:40:55.376 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-03-23T23:40:55.417 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-03-23T23:40:55.654 INFO:teuthology.orchestra.run.smithi196.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-03-23T23:40:55.656 INFO:teuthology.orchestra.run.smithi196.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-03-23T23:40:55.657 INFO:teuthology.orchestra.run.smithi196.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-03-23T23:40:55.659 INFO:teuthology.orchestra.run.smithi196.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-03-23T23:40:55.659 INFO:teuthology.orchestra.run.smithi196.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-03-23T23:40:55.664 INFO:teuthology.orchestra.run.smithi196.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-03-23T23:40:55.666 INFO:teuthology.orchestra.run.smithi196.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-03-23T23:40:55.679 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libllvm14:amd64. 2024-03-23T23:40:55.680 INFO:teuthology.orchestra.run.smithi196.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-03-23T23:40:55.680 INFO:teuthology.orchestra.run.smithi196.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-03-23T23:40:55.695 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-03-23T23:40:55.714 INFO:teuthology.orchestra.run.smithi196.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-03-23T23:40:55.725 INFO:teuthology.orchestra.run.smithi196.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-03-23T23:40:55.737 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-03-23T23:40:55.738 INFO:teuthology.orchestra.run.smithi196.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-03-23T23:40:55.770 INFO:teuthology.orchestra.run.smithi196.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-03-23T23:40:55.782 INFO:teuthology.orchestra.run.smithi196.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-03-23T23:40:55.783 INFO:teuthology.orchestra.run.smithi196.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-03-23T23:40:55.783 INFO:teuthology.orchestra.run.smithi196.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-03-23T23:40:55.784 INFO:teuthology.orchestra.run.smithi196.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-03-23T23:40:55.804 INFO:teuthology.orchestra.run.smithi196.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-03-23T23:40:55.807 INFO:teuthology.orchestra.run.smithi196.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-03-23T23:40:56.077 INFO:teuthology.orchestra.run.smithi196.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-03-23T23:40:56.077 INFO:teuthology.orchestra.run.smithi196.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-03-23T23:40:56.077 INFO:teuthology.orchestra.run.smithi196.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-03-23T23:40:56.078 INFO:teuthology.orchestra.run.smithi196.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-03-23T23:40:56.078 INFO:teuthology.orchestra.run.smithi196.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-03-23T23:40:56.078 INFO:teuthology.orchestra.run.smithi196.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-03-23T23:40:56.094 INFO:teuthology.orchestra.run.smithi196.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-03-23T23:40:56.094 INFO:teuthology.orchestra.run.smithi196.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-03-23T23:40:56.471 INFO:teuthology.orchestra.run.smithi196.stdout:Preconfiguring packages ... 2024-03-23T23:40:56.652 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 54.6 MB in 2s (33.6 MB/s) 2024-03-23T23:40:56.769 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package flex. 2024-03-23T23:40:56.839 INFO:teuthology.orchestra.run.smithi196.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140586 files and directories currently installed.) 2024-03-23T23:40:56.843 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-03-23T23:40:56.893 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking flex (2.6.4-8build2) ... 2024-03-23T23:40:57.107 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-03-23T23:40:57.124 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-03-23T23:40:57.165 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-03-23T23:40:57.426 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libmbim-proxy. 2024-03-23T23:40:57.443 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-03-23T23:40:57.453 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-03-23T23:40:57.484 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-03-23T23:40:57.632 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-03-23T23:40:57.787 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-03-23T23:40:57.804 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-03-23T23:40:57.862 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-03-23T23:40:58.046 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-23T23:40:58.198 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libndp0:amd64. 2024-03-23T23:40:58.215 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-03-23T23:40:58.256 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-03-23T23:40:58.584 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libnm0:amd64. 2024-03-23T23:40:58.601 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-03-23T23:40:58.615 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package bison. 2024-03-23T23:40:58.642 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-03-23T23:40:58.686 INFO:teuthology.orchestra.run.smithi196.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140659 files and directories currently installed.) 2024-03-23T23:40:58.690 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-03-23T23:40:58.734 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-03-23T23:40:59.004 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libpq5:amd64. 2024-03-23T23:40:59.020 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-23T23:40:59.062 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-03-23T23:40:59.177 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-03-23T23:40:59.191 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-03-23T23:40:59.235 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-03-23T23:40:59.365 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-03-23T23:40:59.381 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-03-23T23:40:59.423 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-03-23T23:40:59.563 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package dump. 2024-03-23T23:40:59.578 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-03-23T23:40:59.692 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libqmi-proxy. 2024-03-23T23:40:59.708 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-03-23T23:40:59.750 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-03-23T23:40:59.796 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking dump (0.4b47-3) ... 2024-03-23T23:40:59.995 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-03-23T23:41:00.011 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-03-23T23:41:00.024 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package indent. 2024-03-23T23:41:00.039 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-03-23T23:41:00.069 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-23T23:41:00.082 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-03-23T23:41:00.377 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-03-23T23:41:00.392 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-03-23T23:41:00.427 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-03-23T23:41:00.540 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-03-23T23:41:00.556 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-03-23T23:41:00.598 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-03-23T23:41:00.747 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-03-23T23:41:00.762 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-03-23T23:41:00.805 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-03-23T23:41:01.058 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-03-23T23:41:01.068 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package modemmanager. 2024-03-23T23:41:01.073 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-03-23T23:41:01.084 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-03-23T23:41:01.107 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-03-23T23:41:01.142 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-03-23T23:41:01.589 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libfl2:amd64. 2024-03-23T23:41:01.605 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-03-23T23:41:01.647 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-03-23T23:41:01.858 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package network-manager. 2024-03-23T23:41:01.876 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-03-23T23:41:01.899 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-03-23T23:41:01.915 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-03-23T23:41:01.925 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-03-23T23:41:01.949 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-03-23T23:41:02.210 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libjson-perl. 2024-03-23T23:41:02.226 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-03-23T23:41:02.269 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-03-23T23:41:02.555 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libllvm14:amd64. 2024-03-23T23:41:02.571 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-03-23T23:41:02.599 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package ppp. 2024-03-23T23:41:02.613 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-03-23T23:41:02.618 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-03-23T23:41:02.974 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-03-23T23:41:03.329 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package pptp-linux. 2024-03-23T23:41:03.344 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-03-23T23:41:03.387 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-03-23T23:41:03.623 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package network-manager-pptp. 2024-03-23T23:41:03.639 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-03-23T23:41:03.673 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-03-23T23:41:03.951 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package postgresql-client-common. 2024-03-23T23:41:03.957 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-03-23T23:41:03.967 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-03-23T23:41:03.973 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-03-23T23:41:04.009 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking postgresql-client-common (238) ... 2024-03-23T23:41:04.015 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-03-23T23:41:04.293 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libmbim-proxy. 2024-03-23T23:41:04.309 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-03-23T23:41:04.313 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package postgresql-client-14. 2024-03-23T23:41:04.330 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-23T23:41:04.359 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-03-23T23:41:04.388 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-23T23:41:04.670 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-03-23T23:41:04.686 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-03-23T23:41:04.729 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-03-23T23:41:04.902 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package postgresql-common. 2024-03-23T23:41:04.917 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-03-23T23:41:04.970 INFO:teuthology.orchestra.run.smithi008.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-03-23T23:41:05.000 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking postgresql-common (238) ... 2024-03-23T23:41:05.098 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libndp0:amd64. 2024-03-23T23:41:05.114 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-03-23T23:41:05.156 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-03-23T23:41:05.459 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package postgresql-14. 2024-03-23T23:41:05.479 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-23T23:41:05.509 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libnm0:amd64. 2024-03-23T23:41:05.520 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-23T23:41:05.525 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-03-23T23:41:05.559 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-03-23T23:41:05.845 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libpq5:amd64. 2024-03-23T23:41:05.861 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-23T23:41:05.904 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-03-23T23:41:06.332 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-03-23T23:41:06.349 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-03-23T23:41:06.390 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-03-23T23:41:06.726 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libqmi-proxy. 2024-03-23T23:41:06.742 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-03-23T23:41:06.784 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-03-23T23:41:06.864 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package postgresql. 2024-03-23T23:41:06.880 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-03-23T23:41:06.922 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking postgresql (14+238) ... 2024-03-23T23:41:06.995 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-03-23T23:41:07.011 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-03-23T23:41:07.061 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-23T23:41:07.166 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package postgresql-client. 2024-03-23T23:41:07.181 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-03-23T23:41:07.224 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking postgresql-client (14+238) ... 2024-03-23T23:41:07.477 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package postgresql-contrib. 2024-03-23T23:41:07.492 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-03-23T23:41:07.535 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking postgresql-contrib (14+238) ... 2024-03-23T23:41:07.565 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-03-23T23:41:07.580 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-03-23T23:41:07.623 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-03-23T23:41:07.854 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package tcl8.6. 2024-03-23T23:41:07.870 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-03-23T23:41:07.904 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-03-23T23:41:07.959 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package modemmanager. 2024-03-23T23:41:07.975 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-03-23T23:41:08.009 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-03-23T23:41:08.165 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package tcl. 2024-03-23T23:41:08.181 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-03-23T23:41:08.228 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-03-23T23:41:08.576 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package wpasupplicant. 2024-03-23T23:41:08.593 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-03-23T23:41:08.634 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-03-23T23:41:08.649 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package network-manager. 2024-03-23T23:41:08.664 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-03-23T23:41:08.715 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-03-23T23:41:08.998 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-03-23T23:41:09.014 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-03-23T23:41:09.055 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-03-23T23:41:09.389 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ppp. 2024-03-23T23:41:09.400 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package usb-modeswitch. 2024-03-23T23:41:09.405 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-03-23T23:41:09.417 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-03-23T23:41:09.467 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-03-23T23:41:09.744 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-03-23T23:41:09.753 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up postgresql-client-common (238) ... 2024-03-23T23:41:09.948 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up flex (2.6.4-8build2) ... 2024-03-23T23:41:10.043 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package pptp-linux. 2024-03-23T23:41:10.057 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-03-23T23:41:10.074 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-03-23T23:41:10.093 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-03-23T23:41:10.200 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-03-23T23:41:10.326 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-03-23T23:41:10.362 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package network-manager-pptp. 2024-03-23T23:41:10.376 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-03-23T23:41:10.421 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-03-23T23:41:10.452 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-03-23T23:41:10.578 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-23T23:41:10.723 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package postgresql-client-common. 2024-03-23T23:41:10.737 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-03-23T23:41:10.781 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking postgresql-client-common (238) ... 2024-03-23T23:41:11.110 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package postgresql-client-14. 2024-03-23T23:41:11.133 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-23T23:41:11.177 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-23T23:41:11.544 INFO:teuthology.orchestra.run.smithi008.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-03-23T23:41:11.643 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-03-23T23:41:12.029 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-03-23T23:41:12.029 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-03-23T23:41:12.293 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package postgresql-common. 2024-03-23T23:41:12.311 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-03-23T23:41:12.370 INFO:teuthology.orchestra.run.smithi196.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-03-23T23:41:12.417 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking postgresql-common (238) ... 2024-03-23T23:41:12.697 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-03-23T23:41:12.798 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-23T23:41:12.820 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package postgresql-14. 2024-03-23T23:41:12.831 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-23T23:41:12.869 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-23T23:41:12.924 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-03-23T23:41:13.049 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-03-23T23:41:13.225 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-03-23T23:41:13.352 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-03-23T23:41:13.477 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-03-23T23:41:13.994 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package postgresql. 2024-03-23T23:41:14.009 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-03-23T23:41:14.052 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking postgresql (14+238) ... 2024-03-23T23:41:14.099 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-03-23T23:41:14.258 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up dump (0.4b47-3) ... 2024-03-23T23:41:14.338 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package postgresql-client. 2024-03-23T23:41:14.352 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-03-23T23:41:14.354 INFO:teuthology.orchestra.run.smithi008.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-03-23T23:41:14.396 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking postgresql-client (14+238) ... 2024-03-23T23:41:14.419 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-03-23T23:41:14.546 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-03-23T23:41:14.623 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package postgresql-contrib. 2024-03-23T23:41:14.638 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-03-23T23:41:14.673 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking postgresql-contrib (14+238) ... 2024-03-23T23:41:14.679 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up tcl (8.6.11+1build2) ... 2024-03-23T23:41:14.788 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libjson-perl (4.04000-1) ... 2024-03-23T23:41:14.889 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-03-23T23:41:14.979 INFO:teuthology.orchestra.run.smithi008.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-03-23T23:41:15.034 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package tcl8.6. 2024-03-23T23:41:15.049 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-03-23T23:41:15.050 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-03-23T23:41:15.092 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-03-23T23:41:15.176 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-03-23T23:41:15.369 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package tcl. 2024-03-23T23:41:15.376 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-03-23T23:41:15.385 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-03-23T23:41:15.424 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-03-23T23:41:15.503 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-03-23T23:41:15.637 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-03-23T23:41:15.781 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package wpasupplicant. 2024-03-23T23:41:15.797 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-03-23T23:41:15.797 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up postgresql-client (14+238) ... 2024-03-23T23:41:15.839 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-03-23T23:41:15.898 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-03-23T23:41:16.210 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-03-23T23:41:16.225 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-03-23T23:41:16.276 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-03-23T23:41:16.479 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:16.479 INFO:teuthology.orchestra.run.smithi008.stdout:The following network interfaces were found in /etc/network/interfaces 2024-03-23T23:41:16.479 INFO:teuthology.orchestra.run.smithi008.stdout:which means they are currently configured by ifupdown: 2024-03-23T23:41:16.479 INFO:teuthology.orchestra.run.smithi008.stdout:- ens1f0 2024-03-23T23:41:16.480 INFO:teuthology.orchestra.run.smithi008.stdout:If you want to manage those interfaces with NetworkManager instead 2024-03-23T23:41:16.480 INFO:teuthology.orchestra.run.smithi008.stdout:remove their configuration from /etc/network/interfaces. 2024-03-23T23:41:16.480 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:16.619 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-03-23T23:41:16.621 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package usb-modeswitch. 2024-03-23T23:41:16.637 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-03-23T23:41:16.721 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-03-23T23:41:17.014 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up postgresql-client-common (238) ... 2024-03-23T23:41:17.062 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-03-23T23:41:17.278 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up flex (2.6.4-8build2) ... 2024-03-23T23:41:17.403 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-03-23T23:41:17.475 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-03-23T23:41:17.529 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-03-23T23:41:17.655 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-03-23T23:41:17.781 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-03-23T23:41:17.932 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-23T23:41:18.209 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-03-23T23:41:18.360 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-03-23T23:41:18.486 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-03-23T23:41:18.631 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up postgresql-common (238) ... 2024-03-23T23:41:18.881 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-03-23T23:41:18.979 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-03-23T23:41:19.383 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-03-23T23:41:19.383 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-03-23T23:41:19.571 INFO:teuthology.orchestra.run.smithi008.stdout:Adding user postgres to group ssl-cert 2024-03-23T23:41:19.850 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:19.850 INFO:teuthology.orchestra.run.smithi008.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-03-23T23:41:20.057 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-03-23T23:41:20.120 INFO:teuthology.orchestra.run.smithi008.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-03-23T23:41:20.120 INFO:teuthology.orchestra.run.smithi008.stdout:Removing obsolete dictionary files: 2024-03-23T23:41:20.174 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-23T23:41:20.292 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-03-23T23:41:20.418 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-03-23T23:41:20.545 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-03-23T23:41:20.670 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-03-23T23:41:20.804 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-03-23T23:41:20.861 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-03-23T23:41:21.358 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-23T23:41:21.476 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-03-23T23:41:21.619 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up dump (0.4b47-3) ... 2024-03-23T23:41:21.712 INFO:teuthology.orchestra.run.smithi008.stdout:Creating new PostgreSQL cluster 14/main ... 2024-03-23T23:41:21.713 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-03-23T23:41:21.729 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-03-23T23:41:21.774 INFO:teuthology.orchestra.run.smithi008.stdout:The files belonging to this database system will be owned by user "postgres". 2024-03-23T23:41:21.774 INFO:teuthology.orchestra.run.smithi008.stdout:This user must also own the server process. 2024-03-23T23:41:21.774 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:21.774 INFO:teuthology.orchestra.run.smithi008.stdout:The database cluster will be initialized with locale "en_US". 2024-03-23T23:41:21.774 INFO:teuthology.orchestra.run.smithi008.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-03-23T23:41:21.774 INFO:teuthology.orchestra.run.smithi008.stdout:The default text search configuration will be set to "english". 2024-03-23T23:41:21.774 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:21.774 INFO:teuthology.orchestra.run.smithi008.stdout:Data page checksums are disabled. 2024-03-23T23:41:21.774 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:21.774 INFO:teuthology.orchestra.run.smithi008.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-03-23T23:41:21.775 INFO:teuthology.orchestra.run.smithi008.stdout:creating subdirectories ... ok 2024-03-23T23:41:21.775 INFO:teuthology.orchestra.run.smithi008.stdout:selecting dynamic shared memory implementation ... posix 2024-03-23T23:41:21.779 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-03-23T23:41:21.799 INFO:teuthology.orchestra.run.smithi008.stdout:selecting default max_connections ... 100 2024-03-23T23:41:21.835 INFO:teuthology.orchestra.run.smithi008.stdout:selecting default shared_buffers ... 128MB 2024-03-23T23:41:21.848 INFO:teuthology.orchestra.run.smithi008.stdout:selecting default time zone ... Etc/UTC 2024-03-23T23:41:21.849 INFO:teuthology.orchestra.run.smithi008.stdout:creating configuration files ... ok 2024-03-23T23:41:21.922 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-03-23T23:41:22.023 INFO:teuthology.orchestra.run.smithi008.stdout:running bootstrap script ... ok 2024-03-23T23:41:22.047 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up tcl (8.6.11+1build2) ... 2024-03-23T23:41:22.199 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libjson-perl (4.04000-1) ... 2024-03-23T23:41:22.324 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-03-23T23:41:22.415 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-03-23T23:41:22.468 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-03-23T23:41:22.577 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-03-23T23:41:22.688 INFO:teuthology.orchestra.run.smithi008.stdout:performing post-bootstrap initialization ... ok 2024-03-23T23:41:22.786 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-03-23T23:41:22.921 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-03-23T23:41:23.047 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-03-23T23:41:23.215 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up postgresql-client (14+238) ... 2024-03-23T23:41:23.286 INFO:teuthology.orchestra.run.smithi008.stdout:syncing data to disk ... ok 2024-03-23T23:41:23.371 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-03-23T23:41:23.797 INFO:teuthology.orchestra.run.smithi008.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-03-23T23:41:23.933 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:23.933 INFO:teuthology.orchestra.run.smithi196.stdout:The following network interfaces were found in /etc/network/interfaces 2024-03-23T23:41:23.933 INFO:teuthology.orchestra.run.smithi196.stdout:which means they are currently configured by ifupdown: 2024-03-23T23:41:23.933 INFO:teuthology.orchestra.run.smithi196.stdout:- enp3s0f1 2024-03-23T23:41:23.933 INFO:teuthology.orchestra.run.smithi196.stdout:If you want to manage those interfaces with NetworkManager instead 2024-03-23T23:41:23.934 INFO:teuthology.orchestra.run.smithi196.stdout:remove their configuration from /etc/network/interfaces. 2024-03-23T23:41:23.934 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:24.066 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-03-23T23:41:24.496 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-03-23T23:41:24.898 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-03-23T23:41:25.518 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-03-23T23:41:25.669 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-03-23T23:41:25.821 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-03-23T23:41:25.947 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up postgresql-common (238) ... 2024-03-23T23:41:26.939 INFO:teuthology.orchestra.run.smithi196.stdout:Adding user postgres to group ssl-cert 2024-03-23T23:41:27.065 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-03-23T23:41:27.174 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up postgresql-contrib (14+238) ... 2024-03-23T23:41:27.244 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:27.244 INFO:teuthology.orchestra.run.smithi196.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-03-23T23:41:27.275 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up postgresql (14+238) ... 2024-03-23T23:41:27.401 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-03-23T23:41:27.504 INFO:teuthology.orchestra.run.smithi196.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-03-23T23:41:27.504 INFO:teuthology.orchestra.run.smithi196.stdout:Removing obsolete dictionary files: 2024-03-23T23:41:27.552 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-03-23T23:41:27.822 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-03-23T23:41:27.823 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-03-23T23:41:28.207 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-03-23T23:41:28.596 INFO:teuthology.orchestra.run.smithi008.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-03-23T23:41:28.672 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-23T23:41:28.882 INFO:teuthology.orchestra.run.smithi008.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-23T23:41:29.011 INFO:teuthology.orchestra.run.smithi196.stdout:Creating new PostgreSQL cluster 14/main ... 2024-03-23T23:41:29.030 INFO:teuthology.orchestra.run.smithi196.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-03-23T23:41:29.042 INFO:teuthology.orchestra.run.smithi008.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-23T23:41:29.084 INFO:teuthology.orchestra.run.smithi196.stdout:The files belonging to this database system will be owned by user "postgres". 2024-03-23T23:41:29.084 INFO:teuthology.orchestra.run.smithi196.stdout:This user must also own the server process. 2024-03-23T23:41:29.084 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:29.084 INFO:teuthology.orchestra.run.smithi196.stdout:The database cluster will be initialized with locale "en_US". 2024-03-23T23:41:29.084 INFO:teuthology.orchestra.run.smithi196.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-03-23T23:41:29.084 INFO:teuthology.orchestra.run.smithi196.stdout:The default text search configuration will be set to "english". 2024-03-23T23:41:29.085 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:29.085 INFO:teuthology.orchestra.run.smithi196.stdout:Data page checksums are disabled. 2024-03-23T23:41:29.085 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:29.085 INFO:teuthology.orchestra.run.smithi196.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-03-23T23:41:29.085 INFO:teuthology.orchestra.run.smithi196.stdout:creating subdirectories ... ok 2024-03-23T23:41:29.085 INFO:teuthology.orchestra.run.smithi196.stdout:selecting dynamic shared memory implementation ... posix 2024-03-23T23:41:29.109 INFO:teuthology.orchestra.run.smithi196.stdout:selecting default max_connections ... 100 2024-03-23T23:41:29.143 INFO:teuthology.orchestra.run.smithi196.stdout:selecting default shared_buffers ... 128MB 2024-03-23T23:41:29.156 INFO:teuthology.orchestra.run.smithi196.stdout:selecting default time zone ... Etc/UTC 2024-03-23T23:41:29.157 INFO:teuthology.orchestra.run.smithi196.stdout:creating configuration files ... ok 2024-03-23T23:41:29.322 INFO:teuthology.orchestra.run.smithi196.stdout:running bootstrap script ... ok 2024-03-23T23:41:29.916 INFO:teuthology.orchestra.run.smithi196.stdout:performing post-bootstrap initialization ... ok 2024-03-23T23:41:30.506 INFO:teuthology.orchestra.run.smithi196.stdout:syncing data to disk ... ok 2024-03-23T23:41:30.511 INFO:teuthology.orchestra.run.smithi008.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-03-23T23:41:30.595 INFO:teuthology.orchestra.run.smithi008.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-23T23:41:31.030 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-03-23T23:41:31.132 INFO:teuthology.orchestra.run.smithi008.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-23T23:41:31.139 DEBUG:teuthology.parallel:result is None 2024-03-23T23:41:34.631 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-03-23T23:41:34.765 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up postgresql-contrib (14+238) ... 2024-03-23T23:41:34.924 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up postgresql (14+238) ... 2024-03-23T23:41:35.041 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-03-23T23:41:35.150 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-03-23T23:41:35.395 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-03-23T23:41:35.395 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-03-23T23:41:36.186 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-03-23T23:41:36.555 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-23T23:41:36.706 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-23T23:41:38.133 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-03-23T23:41:38.234 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-23T23:41:38.773 INFO:teuthology.orchestra.run.smithi196.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-23T23:41:38.778 DEBUG:teuthology.parallel:result is None 2024-03-23T23:41:38.779 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3be9a5c9bc793e11e2800a8c0c696e8b46742033 2024-03-23T23:41:38.932 DEBUG:teuthology.orchestra.run.smithi008:> dpkg-query -W -f '${Version}' ceph 2024-03-23T23:41:38.957 INFO:teuthology.orchestra.run.smithi008.stdout:19.0.0-2145-g3be9a5c9-1jammy 2024-03-23T23:41:38.958 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2145-g3be9a5c9-1jammy 2024-03-23T23:41:38.958 INFO:teuthology.task.install:The correct ceph version 19.0.0-2145-g3be9a5c9-1jammy is installed. 2024-03-23T23:41:38.960 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3be9a5c9bc793e11e2800a8c0c696e8b46742033 2024-03-23T23:41:39.178 DEBUG:teuthology.orchestra.run.smithi196:> dpkg-query -W -f '${Version}' ceph 2024-03-23T23:41:39.250 INFO:teuthology.orchestra.run.smithi196.stdout:19.0.0-2145-g3be9a5c9-1jammy 2024-03-23T23:41:39.251 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2145-g3be9a5c9-1jammy 2024-03-23T23:41:39.251 INFO:teuthology.task.install:The correct ceph version 19.0.0-2145-g3be9a5c9-1jammy is installed. 2024-03-23T23:41:39.252 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-23T23:41:39.253 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-23T23:41:39.253 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-23T23:41:39.277 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-23T23:41:39.277 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-23T23:41:39.322 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-23T23:41:39.322 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-23T23:41:39.322 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/daemon-helper 2024-03-23T23:41:39.351 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-23T23:41:39.420 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-23T23:41:39.420 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/daemon-helper 2024-03-23T23:41:39.441 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-23T23:41:39.504 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-23T23:41:39.504 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-23T23:41:39.504 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-23T23:41:39.561 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-23T23:41:39.626 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-23T23:41:39.626 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-23T23:41:39.646 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-23T23:41:39.707 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-23T23:41:39.707 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-23T23:41:39.707 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/stdin-killer 2024-03-23T23:41:39.729 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-23T23:41:39.797 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-23T23:41:39.797 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/stdin-killer 2024-03-23T23:41:39.817 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-23T23:41:39.883 INFO:teuthology.run_tasks:Running task ceph... 2024-03-23T23:41:39.984 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-23T23:41:39.984 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 777 /var/log/ceph 2024-03-23T23:41:39.987 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 777 /var/log/ceph 2024-03-23T23:41:40.006 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-23T23:41:40.007 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-23T23:41:40.054 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-23T23:41:40.072 INFO:tasks.ceph:Creating extra log directories... 2024-03-23T23:41:40.073 DEBUG:teuthology.orchestra.run.smithi008:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-23T23:41:40.115 DEBUG:teuthology.orchestra.run.smithi196:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-23T23:41:40.142 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-23T23:41:40.142 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-23T23:41:40.142 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-23T23:41:40.142 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-23T23:41:40.142 DEBUG:teuthology.orchestra.run.smithi008:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-23T23:41:40.184 DEBUG:teuthology.orchestra.run.smithi008:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-23T23:41:40.278 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-23T23:41:40.278 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-23T23:41:40.286 DEBUG:teuthology.orchestra.run.smithi196:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-23T23:41:40.378 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-23T23:41:40.378 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-23T23:41:40.378 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616400', 'branch': 'wip-mchangir-testing-main-20240318.032620', 'description': 'fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7616400', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '5ec3e6e88b2e2783e09498588bb1f433ae9c8986'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-testing-main-20240318.032620'}, 'ceph': {'cephfs': {'fs': [{'name': 'a'}, {'name': 'b'}], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'sha1': '3be9a5c9bc793e11e2800a8c0c696e8b46742033'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'cephfs_name': 'a'}, 'client.1': {'cephfs_name': 'b'}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3be9a5c9bc793e11e2800a8c0c696e8b46742033'}}, 'kclient': {'client.0': {'cephfs_name': 'a'}, 'client.1': {'cephfs_name': 'b'}, 'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-testing-main-20240318.032620', 'sha1': '3be9a5c9bc793e11e2800a8c0c696e8b46742033'}}, 'owner': 'mchangir', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 3550, 'sha1': '3be9a5c9bc793e11e2800a8c0c696e8b46742033', 'sleep_before_teardown': 0, 'subset': '613/1024', 'suite': 'fs', 'suite_branch': 'wip-mchangir-testing-main-20240318.032620', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '3be9a5c9bc793e11e2800a8c0c696e8b46742033', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi008.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJN38IWx94OLOMXUXdFrdT37nqwqtfkJzR43R06nGM7XS6nGJmg0rG09Eh8zbXVEzJnk5dyYmUZbX5A7ECQIFx0=', 'smithi196.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK8YegBLgKIYs1tCXSJgZygUC8okbxmgyW3Bo4qT/lXzZIgBTWgvCyNQ1UwaePBVTdPiU13/gD1i2t3Q/ETquuU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '5ec3e6e88b2e2783e09498588bb1f433ae9c8986'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3be9a5c9bc793e11e2800a8c0c696e8b46742033'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'fs': [{'name': 'a'}, {'name': 'b'}], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'sha1': '3be9a5c9bc793e11e2800a8c0c696e8b46742033', 'cluster': 'ceph'}}, {'kclient': None}, {'mon_thrash': {'check_mds_failover': True, 'revive_delay': 20, 'thrash_delay': 10}}, {'workunit': {'clients': {'all': ['suites/ffsb.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-22_09:49:57', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-23T23:41:40.379 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-23T23:41:40.382 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-23T23:41:40.428 DEBUG:teuthology.orchestra.run.smithi008:> sudo install -d -m0777 -- /var/run/ceph 2024-03-23T23:41:40.435 DEBUG:teuthology.orchestra.run.smithi196:> sudo install -d -m0777 -- /var/run/ceph 2024-03-23T23:41:40.494 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-23T23:41:40.494 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/scratch_devs of=/dev/stdout 2024-03-23T23:41:40.504 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-23T23:41:40.505 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_1 2024-03-23T23:41:40.561 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-23T23:41:40.561 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-23T23:41:40.561 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 900 Links: 1 2024-03-23T23:41:40.561 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-23T23:41:40.561 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2024-03-23 23:35:19.503671786 +0000 2024-03-23T23:41:40.562 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2024-03-23 23:35:19.227674252 +0000 2024-03-23T23:41:40.562 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2024-03-23 23:35:19.227674252 +0000 2024-03-23T23:41:40.562 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2024-03-23 23:35:19.227674252 +0000 2024-03-23T23:41:40.562 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-23T23:41:40.623 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2024-03-23T23:41:40.624 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2024-03-23T23:41:40.624 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000269171 s, 1.9 MB/s 2024-03-23T23:41:40.626 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-23T23:41:40.683 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_2 2024-03-23T23:41:40.733 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-23T23:41:40.734 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-23T23:41:40.734 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 915 Links: 1 2024-03-23T23:41:40.734 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-23T23:41:40.734 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2024-03-23 23:35:20.011667249 +0000 2024-03-23T23:41:40.734 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2024-03-23 23:35:19.739669678 +0000 2024-03-23T23:41:40.734 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2024-03-23 23:35:19.739669678 +0000 2024-03-23T23:41:40.734 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2024-03-23 23:35:19.739669678 +0000 2024-03-23T23:41:40.735 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-23T23:41:40.796 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2024-03-23T23:41:40.796 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2024-03-23T23:41:40.796 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000267916 s, 1.9 MB/s 2024-03-23T23:41:40.798 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-23T23:41:40.855 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_3 2024-03-23T23:41:40.905 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-23T23:41:40.905 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-23T23:41:40.905 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 934 Links: 1 2024-03-23T23:41:40.905 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-23T23:41:40.906 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2024-03-23 23:35:20.555662392 +0000 2024-03-23T23:41:40.906 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2024-03-23 23:35:20.275664891 +0000 2024-03-23T23:41:40.906 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2024-03-23 23:35:20.275664891 +0000 2024-03-23T23:41:40.906 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2024-03-23 23:35:20.275664891 +0000 2024-03-23T23:41:40.906 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-23T23:41:40.967 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2024-03-23T23:41:40.967 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2024-03-23T23:41:40.967 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000267148 s, 1.9 MB/s 2024-03-23T23:41:40.969 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-23T23:41:41.023 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_4 2024-03-23T23:41:41.078 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-23T23:41:41.078 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-23T23:41:41.078 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 952 Links: 1 2024-03-23T23:41:41.079 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-23T23:41:41.079 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2024-03-23 23:35:20.811660104 +0000 2024-03-23T23:41:41.079 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2024-03-23 23:35:20.807660140 +0000 2024-03-23T23:41:41.079 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2024-03-23 23:35:20.807660140 +0000 2024-03-23T23:41:41.079 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2024-03-23 23:35:20.807660140 +0000 2024-03-23T23:41:41.079 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-23T23:41:41.139 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2024-03-23T23:41:41.140 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2024-03-23T23:41:41.140 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000266546 s, 1.9 MB/s 2024-03-23T23:41:41.142 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-23T23:41:41.199 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-23T23:41:41.199 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-23T23:41:41.199 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/scratch_devs of=/dev/stdout 2024-03-23T23:41:41.208 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-23T23:41:41.208 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_1 2024-03-23T23:41:41.256 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-23T23:41:41.256 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-23T23:41:41.257 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 878 Links: 1 2024-03-23T23:41:41.257 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-23T23:41:41.257 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-03-23 23:35:19.505039304 +0000 2024-03-23T23:41:41.257 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-03-23 23:35:19.225041800 +0000 2024-03-23T23:41:41.257 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-03-23 23:35:19.225041800 +0000 2024-03-23T23:41:41.257 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-03-23 23:35:19.225041800 +0000 2024-03-23T23:41:41.257 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-23T23:41:41.318 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-03-23T23:41:41.318 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-03-23T23:41:41.318 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000654398 s, 782 kB/s 2024-03-23T23:41:41.320 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-23T23:41:41.374 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_2 2024-03-23T23:41:41.424 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-23T23:41:41.424 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-23T23:41:41.424 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 895 Links: 1 2024-03-23T23:41:41.425 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-23T23:41:41.425 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-03-23 23:35:20.013034779 +0000 2024-03-23T23:41:41.425 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-03-23 23:35:19.765036988 +0000 2024-03-23T23:41:41.425 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-03-23 23:35:19.765036988 +0000 2024-03-23T23:41:41.425 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-03-23 23:35:19.765036988 +0000 2024-03-23T23:41:41.425 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-23T23:41:41.487 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-03-23T23:41:41.488 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-03-23T23:41:41.488 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000396247 s, 1.3 MB/s 2024-03-23T23:41:41.489 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-23T23:41:41.543 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_3 2024-03-23T23:41:41.593 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-23T23:41:41.593 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-23T23:41:41.593 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 910 Links: 1 2024-03-23T23:41:41.593 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-23T23:41:41.593 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-03-23 23:35:20.581029718 +0000 2024-03-23T23:41:41.593 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-03-23 23:35:20.289032319 +0000 2024-03-23T23:41:41.593 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-03-23 23:35:20.289032319 +0000 2024-03-23T23:41:41.593 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-03-23 23:35:20.289032319 +0000 2024-03-23T23:41:41.594 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-23T23:41:41.654 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-03-23T23:41:41.654 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-03-23T23:41:41.655 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000380757 s, 1.3 MB/s 2024-03-23T23:41:41.656 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-23T23:41:41.710 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_4 2024-03-23T23:41:41.760 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-23T23:41:41.761 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-23T23:41:41.761 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-03-23T23:41:41.761 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-23T23:41:41.761 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-03-23 23:35:21.137024766 +0000 2024-03-23T23:41:41.761 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-03-23 23:35:20.869027152 +0000 2024-03-23T23:41:41.761 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-03-23 23:35:20.869027152 +0000 2024-03-23T23:41:41.761 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-03-23 23:35:20.869027152 +0000 2024-03-23T23:41:41.761 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-23T23:41:41.826 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-03-23T23:41:41.826 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-03-23T23:41:41.826 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000398191 s, 1.3 MB/s 2024-03-23T23:41:41.828 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-23T23:41:41.882 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-23T23:41:41.883 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi008.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi196.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-23T23:41:41.883 INFO:tasks.ceph:Generating config... 2024-03-23T23:41:41.884 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-23T23:41:41.884 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-03-23T23:41:41.884 INFO:tasks.ceph:[client] debug client = 20 2024-03-23T23:41:41.884 INFO:tasks.ceph:[client] debug ms = 1 2024-03-23T23:41:41.885 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-23T23:41:41.885 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-23T23:41:41.885 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-03-23T23:41:41.885 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-23T23:41:41.885 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-23T23:41:41.885 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-23T23:41:41.885 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-03-23T23:41:41.885 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-03-23T23:41:41.885 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-03-23T23:41:41.885 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-03-23T23:41:41.885 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-23T23:41:41.885 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-23T23:41:41.885 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-23T23:41:41.886 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-23T23:41:41.886 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-23T23:41:41.886 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-23T23:41:41.886 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-23T23:41:41.886 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-23T23:41:41.886 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-23T23:41:41.886 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-23T23:41:41.886 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-23T23:41:41.886 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-23T23:41:41.886 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-23T23:41:41.886 INFO:tasks.ceph:[osd] bdev async discard = True 2024-03-23T23:41:41.886 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-03-23T23:41:41.886 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-03-23T23:41:41.886 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-23T23:41:41.887 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-23T23:41:41.887 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-03-23T23:41:41.887 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-03-23T23:41:41.887 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-23T23:41:41.887 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-23T23:41:41.887 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-03-23T23:41:41.887 INFO:tasks.ceph:[osd] filestore flush min = 0 2024-03-23T23:41:41.887 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-23T23:41:41.887 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-23T23:41:41.887 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-23T23:41:41.887 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-03-23T23:41:41.887 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-23T23:41:41.887 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-03-23T23:41:41.887 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-23T23:41:41.887 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-23T23:41:41.890 INFO:tasks.ceph:Setting up mon.a... 2024-03-23T23:41:41.890 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-23T23:41:41.936 INFO:teuthology.orchestra.run.smithi008.stdout:creating /etc/ceph/ceph.keyring 2024-03-23T23:41:41.947 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-23T23:41:42.038 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-23T23:41:42.059 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.8'), ('mon.b', '172.21.15.196'), ('mon.c', '[v2:172.21.15.196:3301,v1:172.21.15.196:6790]')] 2024-03-23T23:41:42.060 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.8,172.21.15.196,[v2:172.21.15.196:3301,v1:172.21.15.196:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-23T23:41:42.060 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-23T23:41:42.061 DEBUG:teuthology.orchestra.run.smithi008:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-23T23:41:42.108 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.8 --add b 172.21.15.196 --addv c '[v2:172.21.15.196:3301,v1:172.21.15.196:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-23T23:41:42.200 INFO:teuthology.orchestra.run.smithi008.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-23T23:41:42.200 INFO:teuthology.orchestra.run.smithi008.stdout:monmaptool: generated fsid c1a2a381-bc04-418a-8aea-f38031d04f8d 2024-03-23T23:41:42.201 INFO:teuthology.orchestra.run.smithi008.stdout:setting min_mon_release = quincy 2024-03-23T23:41:42.201 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 0 2024-03-23T23:41:42.201 INFO:teuthology.orchestra.run.smithi008.stdout:fsid c1a2a381-bc04-418a-8aea-f38031d04f8d 2024-03-23T23:41:42.201 INFO:teuthology.orchestra.run.smithi008.stdout:last_changed 2024-03-23T23:41:42.202826+0000 2024-03-23T23:41:42.201 INFO:teuthology.orchestra.run.smithi008.stdout:created 2024-03-23T23:41:42.202826+0000 2024-03-23T23:41:42.201 INFO:teuthology.orchestra.run.smithi008.stdout:min_mon_release 17 (quincy) 2024-03-23T23:41:42.201 INFO:teuthology.orchestra.run.smithi008.stdout:election_strategy: 1 2024-03-23T23:41:42.201 INFO:teuthology.orchestra.run.smithi008.stdout:0: [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] mon.a 2024-03-23T23:41:42.201 INFO:teuthology.orchestra.run.smithi008.stdout:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-03-23T23:41:42.201 INFO:teuthology.orchestra.run.smithi008.stdout:2: [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] mon.c 2024-03-23T23:41:42.201 INFO:teuthology.orchestra.run.smithi008.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-23T23:41:42.204 DEBUG:teuthology.orchestra.run.smithi008:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-23T23:41:42.212 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c1a2a381-bc04-418a-8aea-f38031d04f8d... 2024-03-23T23:41:42.213 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-23T23:41:42.259 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-23T23:41:42.299 INFO:teuthology.orchestra.run.smithi008.stdout:[global] 2024-03-23T23:41:42.299 INFO:teuthology.orchestra.run.smithi008.stdout: chdir = "" 2024-03-23T23:41:42.299 INFO:teuthology.orchestra.run.smithi008.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-23T23:41:42.299 INFO:teuthology.orchestra.run.smithi008.stdout: auth supported = cephx 2024-03-23T23:41:42.299 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:42.302 INFO:teuthology.orchestra.run.smithi008.stdout: filestore xattr use omap = true 2024-03-23T23:41:42.302 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:42.302 INFO:teuthology.orchestra.run.smithi008.stdout: mon clock drift allowed = 1.000 2024-03-23T23:41:42.302 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:42.302 INFO:teuthology.orchestra.run.smithi008.stdout: osd crush chooseleaf type = 0 2024-03-23T23:41:42.302 INFO:teuthology.orchestra.run.smithi008.stdout: auth debug = true 2024-03-23T23:41:42.302 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:42.302 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on old message = true 2024-03-23T23:41:42.302 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on bug = true 2024-03-23T23:41:42.303 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:42.303 INFO:teuthology.orchestra.run.smithi008.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-23T23:41:42.303 INFO:teuthology.orchestra.run.smithi008.stdout: mon pg warn max object skew = 0 2024-03-23T23:41:42.303 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:42.303 INFO:teuthology.orchestra.run.smithi008.stdout: # disable pg_autoscaler by default for new pools 2024-03-23T23:41:42.303 INFO:teuthology.orchestra.run.smithi008.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-23T23:41:42.303 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:42.303 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default size = 2 2024-03-23T23:41:42.303 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:42.303 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd allow primary affinity = true 2024-03-23T23:41:42.303 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd allow pg remap = true 2024-03-23T23:41:42.303 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on legacy crush tunables = false 2024-03-23T23:41:42.303 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on crush straw calc version zero = false 2024-03-23T23:41:42.304 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on no sortbitwise = false 2024-03-23T23:41:42.304 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on osd down out interval zero = false 2024-03-23T23:41:42.304 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on too few osds = false 2024-03-23T23:41:42.304 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-23T23:41:42.304 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-23T23:41:42.304 INFO:teuthology.orchestra.run.smithi008.stdout: mon_allow_pool_size_one = true 2024-03-23T23:41:42.304 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:42.304 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-23T23:41:42.304 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:42.304 INFO:teuthology.orchestra.run.smithi008.stdout: osd default data pool replay window = 5 2024-03-23T23:41:42.304 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:42.304 INFO:teuthology.orchestra.run.smithi008.stdout: mon allow pool delete = true 2024-03-23T23:41:42.304 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:42.304 INFO:teuthology.orchestra.run.smithi008.stdout: mon cluster log file level = debug 2024-03-23T23:41:42.305 INFO:teuthology.orchestra.run.smithi008.stdout: debug asserts on shutdown = true 2024-03-23T23:41:42.305 INFO:teuthology.orchestra.run.smithi008.stdout: mon health detail to clog = false 2024-03-23T23:41:42.305 INFO:teuthology.orchestra.run.smithi008.stdout: mon host = "172.21.15.8,172.21.15.196,[v2:172.21.15.196:3301,v1:172.21.15.196:6790]" 2024-03-23T23:41:42.305 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on skipped message = False 2024-03-23T23:41:42.305 INFO:teuthology.orchestra.run.smithi008.stdout: fsid = c1a2a381-bc04-418a-8aea-f38031d04f8d 2024-03-23T23:41:42.305 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:42.305 INFO:teuthology.orchestra.run.smithi008.stdout:[osd] 2024-03-23T23:41:42.305 INFO:teuthology.orchestra.run.smithi008.stdout: osd journal size = 100 2024-03-23T23:41:42.305 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:42.305 INFO:teuthology.orchestra.run.smithi008.stdout: osd scrub load threshold = 5.0 2024-03-23T23:41:42.305 INFO:teuthology.orchestra.run.smithi008.stdout: osd scrub max interval = 600 2024-03-23T23:41:42.306 INFO:teuthology.orchestra.run.smithi008.stdout: osd mclock profile = high_recovery_ops 2024-03-23T23:41:42.306 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:42.306 INFO:teuthology.orchestra.run.smithi008.stdout: osd recover clone overlap = true 2024-03-23T23:41:42.306 INFO:teuthology.orchestra.run.smithi008.stdout: osd recovery max chunk = 1048576 2024-03-23T23:41:42.306 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:42.306 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug shutdown = true 2024-03-23T23:41:42.306 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug op order = true 2024-03-23T23:41:42.306 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug verify stray on activate = true 2024-03-23T23:41:42.306 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug trim objects = true 2024-03-23T23:41:42.306 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:42.306 INFO:teuthology.orchestra.run.smithi008.stdout: osd open classes on start = true 2024-03-23T23:41:42.306 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug pg log writeout = true 2024-03-23T23:41:42.306 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:42.307 INFO:teuthology.orchestra.run.smithi008.stdout: osd deep scrub update digest min age = 30 2024-03-23T23:41:42.307 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:42.307 INFO:teuthology.orchestra.run.smithi008.stdout: osd map max advance = 10 2024-03-23T23:41:42.307 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:42.307 INFO:teuthology.orchestra.run.smithi008.stdout: journal zero on create = true 2024-03-23T23:41:42.307 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:42.307 INFO:teuthology.orchestra.run.smithi008.stdout: filestore ondisk finisher threads = 3 2024-03-23T23:41:42.307 INFO:teuthology.orchestra.run.smithi008.stdout: filestore apply finisher threads = 3 2024-03-23T23:41:42.307 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:42.307 INFO:teuthology.orchestra.run.smithi008.stdout: bdev debug aio = true 2024-03-23T23:41:42.307 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug misdirected ops = true 2024-03-23T23:41:42.308 INFO:teuthology.orchestra.run.smithi008.stdout: bdev async discard = True 2024-03-23T23:41:42.308 INFO:teuthology.orchestra.run.smithi008.stdout: bdev enable discard = True 2024-03-23T23:41:42.308 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore allocator = bitmap 2024-03-23T23:41:42.308 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore block size = 96636764160 2024-03-23T23:41:42.308 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore fsck on mount = True 2024-03-23T23:41:42.308 INFO:teuthology.orchestra.run.smithi008.stdout: debug bluefs = 1/20 2024-03-23T23:41:42.308 INFO:teuthology.orchestra.run.smithi008.stdout: debug bluestore = 1/20 2024-03-23T23:41:42.308 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2024-03-23T23:41:42.309 INFO:teuthology.orchestra.run.smithi008.stdout: debug osd = 20 2024-03-23T23:41:42.309 INFO:teuthology.orchestra.run.smithi008.stdout: debug rocksdb = 4/10 2024-03-23T23:41:42.309 INFO:teuthology.orchestra.run.smithi008.stdout: filestore flush min = 0 2024-03-23T23:41:42.309 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd backfillfull_ratio = 0.85 2024-03-23T23:41:42.309 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd full ratio = 0.9 2024-03-23T23:41:42.309 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd nearfull ratio = 0.8 2024-03-23T23:41:42.309 INFO:teuthology.orchestra.run.smithi008.stdout: osd blocked scrub grace period = 3600 2024-03-23T23:41:42.309 INFO:teuthology.orchestra.run.smithi008.stdout: osd failsafe full ratio = 0.95 2024-03-23T23:41:42.309 INFO:teuthology.orchestra.run.smithi008.stdout: osd max markdown count = 1000 2024-03-23T23:41:42.309 INFO:teuthology.orchestra.run.smithi008.stdout: osd objectstore = bluestore 2024-03-23T23:41:42.309 INFO:teuthology.orchestra.run.smithi008.stdout: osd op complaint time = 180 2024-03-23T23:41:42.309 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:42.310 INFO:teuthology.orchestra.run.smithi008.stdout:[mgr] 2024-03-23T23:41:42.310 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2024-03-23T23:41:42.310 INFO:teuthology.orchestra.run.smithi008.stdout: debug mgr = 20 2024-03-23T23:41:42.310 INFO:teuthology.orchestra.run.smithi008.stdout: debug mon = 20 2024-03-23T23:41:42.310 INFO:teuthology.orchestra.run.smithi008.stdout: debug auth = 20 2024-03-23T23:41:42.310 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min pgs per osd = 4 2024-03-23T23:41:42.310 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min bytes per osd = 10 2024-03-23T23:41:42.310 INFO:teuthology.orchestra.run.smithi008.stdout: mgr/telemetry/nag = false 2024-03-23T23:41:42.310 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:42.310 INFO:teuthology.orchestra.run.smithi008.stdout:[mon] 2024-03-23T23:41:42.310 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2024-03-23T23:41:42.310 INFO:teuthology.orchestra.run.smithi008.stdout: debug mon = 20 2024-03-23T23:41:42.311 INFO:teuthology.orchestra.run.smithi008.stdout: debug paxos = 20 2024-03-23T23:41:42.311 INFO:teuthology.orchestra.run.smithi008.stdout: debug auth = 20 2024-03-23T23:41:42.311 INFO:teuthology.orchestra.run.smithi008.stdout: mon data avail warn = 5 2024-03-23T23:41:42.311 INFO:teuthology.orchestra.run.smithi008.stdout: mon mgr mkfs grace = 240 2024-03-23T23:41:42.311 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min pgs per osd = 4 2024-03-23T23:41:42.311 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd reporter subtree level = osd 2024-03-23T23:41:42.311 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd prime pg temp = true 2024-03-23T23:41:42.311 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min bytes per osd = 10 2024-03-23T23:41:42.311 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:42.311 INFO:teuthology.orchestra.run.smithi008.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-23T23:41:42.311 INFO:teuthology.orchestra.run.smithi008.stdout: auth mon ticket ttl = 660 # 11m 2024-03-23T23:41:42.312 INFO:teuthology.orchestra.run.smithi008.stdout: auth service ticket ttl = 240 # 4m 2024-03-23T23:41:42.312 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:42.312 INFO:teuthology.orchestra.run.smithi008.stdout: # don't complain about insecure global_id in the test suite 2024-03-23T23:41:42.312 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-23T23:41:42.312 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-23T23:41:42.312 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:42.312 INFO:teuthology.orchestra.run.smithi008.stdout: # 1m isn't quite enough 2024-03-23T23:41:42.312 INFO:teuthology.orchestra.run.smithi008.stdout: mon_down_mkfs_grace = 2m 2024-03-23T23:41:42.312 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:42.312 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_filestore_osds = false 2024-03-23T23:41:42.312 INFO:teuthology.orchestra.run.smithi008.stdout: mon op complaint time = 120 2024-03-23T23:41:42.312 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:41:42.312 INFO:teuthology.orchestra.run.smithi008.stdout:[client] 2024-03-23T23:41:42.313 INFO:teuthology.orchestra.run.smithi008.stdout: rgw cache enabled = true 2024-03-23T23:41:42.313 INFO:teuthology.orchestra.run.smithi008.stdout: rgw enable ops log = true 2024-03-23T23:41:42.313 INFO:teuthology.orchestra.run.smithi008.stdout: rgw enable usage log = true 2024-03-23T23:41:42.313 INFO:teuthology.orchestra.run.smithi008.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-23T23:41:42.313 INFO:teuthology.orchestra.run.smithi008.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-23T23:41:42.313 INFO:teuthology.orchestra.run.smithi008.stdout: client mount timeout = 600 2024-03-23T23:41:42.313 INFO:teuthology.orchestra.run.smithi008.stdout: client_shutdown_timeout = 120 2024-03-23T23:41:42.313 INFO:teuthology.orchestra.run.smithi008.stdout: debug client = 20 2024-03-23T23:41:42.313 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2024-03-23T23:41:42.313 INFO:teuthology.orchestra.run.smithi008.stdout: rados mon op timeout = 900 2024-03-23T23:41:42.313 INFO:teuthology.orchestra.run.smithi008.stdout: rados osd op timeout = 900 2024-03-23T23:41:42.313 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.a] 2024-03-23T23:41:42.313 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.b] 2024-03-23T23:41:42.314 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.c] 2024-03-23T23:41:42.314 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.a] 2024-03-23T23:41:42.314 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.c] 2024-03-23T23:41:42.314 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.b] 2024-03-23T23:41:42.314 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.d] 2024-03-23T23:41:42.314 INFO:teuthology.orchestra.run.smithi008.stdout:[mds] 2024-03-23T23:41:42.314 INFO:teuthology.orchestra.run.smithi008.stdout: debug mds = 20 2024-03-23T23:41:42.314 INFO:teuthology.orchestra.run.smithi008.stdout: debug mds balancer = 20 2024-03-23T23:41:42.314 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2024-03-23T23:41:42.314 INFO:teuthology.orchestra.run.smithi008.stdout: mds bal fragment size max = 10000 2024-03-23T23:41:42.314 INFO:teuthology.orchestra.run.smithi008.stdout: mds bal merge size = 5 2024-03-23T23:41:42.314 INFO:teuthology.orchestra.run.smithi008.stdout: mds bal split bits = 3 2024-03-23T23:41:42.314 INFO:teuthology.orchestra.run.smithi008.stdout: mds bal split size = 100 2024-03-23T23:41:42.315 INFO:teuthology.orchestra.run.smithi008.stdout: mds debug frag = True 2024-03-23T23:41:42.315 INFO:teuthology.orchestra.run.smithi008.stdout: mds debug scatterstat = True 2024-03-23T23:41:42.315 INFO:teuthology.orchestra.run.smithi008.stdout: mds op complaint time = 180 2024-03-23T23:41:42.315 INFO:teuthology.orchestra.run.smithi008.stdout: mds verify scatter = True 2024-03-23T23:41:42.315 INFO:teuthology.orchestra.run.smithi008.stdout: osd op complaint time = 180 2024-03-23T23:41:42.315 INFO:teuthology.orchestra.run.smithi008.stdout: rados mon op timeout = 900 2024-03-23T23:41:42.315 INFO:teuthology.orchestra.run.smithi008.stdout: rados osd op timeout = 900 2024-03-23T23:41:42.316 INFO:teuthology.orchestra.run.smithi196.stdout:[global] 2024-03-23T23:41:42.316 INFO:teuthology.orchestra.run.smithi196.stdout: chdir = "" 2024-03-23T23:41:42.316 INFO:teuthology.orchestra.run.smithi196.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-23T23:41:42.316 INFO:teuthology.orchestra.run.smithi196.stdout: auth supported = cephx 2024-03-23T23:41:42.316 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:42.316 INFO:teuthology.orchestra.run.smithi196.stdout: filestore xattr use omap = true 2024-03-23T23:41:42.316 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:42.316 INFO:teuthology.orchestra.run.smithi196.stdout: mon clock drift allowed = 1.000 2024-03-23T23:41:42.317 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:42.317 INFO:teuthology.orchestra.run.smithi196.stdout: osd crush chooseleaf type = 0 2024-03-23T23:41:42.317 INFO:teuthology.orchestra.run.smithi196.stdout: auth debug = true 2024-03-23T23:41:42.317 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:42.317 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on old message = true 2024-03-23T23:41:42.317 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on bug = true 2024-03-23T23:41:42.317 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:42.317 INFO:teuthology.orchestra.run.smithi196.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-23T23:41:42.317 INFO:teuthology.orchestra.run.smithi196.stdout: mon pg warn max object skew = 0 2024-03-23T23:41:42.317 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:42.317 INFO:teuthology.orchestra.run.smithi196.stdout: # disable pg_autoscaler by default for new pools 2024-03-23T23:41:42.317 INFO:teuthology.orchestra.run.smithi196.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-23T23:41:42.317 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:42.318 INFO:teuthology.orchestra.run.smithi196.stdout: osd pool default size = 2 2024-03-23T23:41:42.318 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:42.318 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd allow primary affinity = true 2024-03-23T23:41:42.318 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd allow pg remap = true 2024-03-23T23:41:42.318 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on legacy crush tunables = false 2024-03-23T23:41:42.318 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on crush straw calc version zero = false 2024-03-23T23:41:42.318 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on no sortbitwise = false 2024-03-23T23:41:42.318 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on osd down out interval zero = false 2024-03-23T23:41:42.319 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on too few osds = false 2024-03-23T23:41:42.319 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-23T23:41:42.319 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-23T23:41:42.319 INFO:teuthology.orchestra.run.smithi196.stdout: mon_allow_pool_size_one = true 2024-03-23T23:41:42.319 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:42.319 INFO:teuthology.orchestra.run.smithi196.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-23T23:41:42.319 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:42.319 INFO:teuthology.orchestra.run.smithi196.stdout: osd default data pool replay window = 5 2024-03-23T23:41:42.319 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:42.319 INFO:teuthology.orchestra.run.smithi196.stdout: mon allow pool delete = true 2024-03-23T23:41:42.319 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:42.320 INFO:teuthology.orchestra.run.smithi196.stdout: mon cluster log file level = debug 2024-03-23T23:41:42.320 INFO:teuthology.orchestra.run.smithi196.stdout: debug asserts on shutdown = true 2024-03-23T23:41:42.320 INFO:teuthology.orchestra.run.smithi196.stdout: mon health detail to clog = false 2024-03-23T23:41:42.320 INFO:teuthology.orchestra.run.smithi196.stdout: mon host = "172.21.15.8,172.21.15.196,[v2:172.21.15.196:3301,v1:172.21.15.196:6790]" 2024-03-23T23:41:42.320 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on skipped message = False 2024-03-23T23:41:42.320 INFO:teuthology.orchestra.run.smithi196.stdout: fsid = c1a2a381-bc04-418a-8aea-f38031d04f8d 2024-03-23T23:41:42.320 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:42.320 INFO:teuthology.orchestra.run.smithi196.stdout:[osd] 2024-03-23T23:41:42.320 INFO:teuthology.orchestra.run.smithi196.stdout: osd journal size = 100 2024-03-23T23:41:42.320 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:42.320 INFO:teuthology.orchestra.run.smithi196.stdout: osd scrub load threshold = 5.0 2024-03-23T23:41:42.320 INFO:teuthology.orchestra.run.smithi196.stdout: osd scrub max interval = 600 2024-03-23T23:41:42.320 INFO:teuthology.orchestra.run.smithi196.stdout: osd mclock profile = high_recovery_ops 2024-03-23T23:41:42.321 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:42.321 INFO:teuthology.orchestra.run.smithi196.stdout: osd recover clone overlap = true 2024-03-23T23:41:42.321 INFO:teuthology.orchestra.run.smithi196.stdout: osd recovery max chunk = 1048576 2024-03-23T23:41:42.321 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:42.321 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug shutdown = true 2024-03-23T23:41:42.321 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug op order = true 2024-03-23T23:41:42.321 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug verify stray on activate = true 2024-03-23T23:41:42.321 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug trim objects = true 2024-03-23T23:41:42.321 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:42.321 INFO:teuthology.orchestra.run.smithi196.stdout: osd open classes on start = true 2024-03-23T23:41:42.321 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug pg log writeout = true 2024-03-23T23:41:42.321 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:42.322 INFO:teuthology.orchestra.run.smithi196.stdout: osd deep scrub update digest min age = 30 2024-03-23T23:41:42.322 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:42.322 INFO:teuthology.orchestra.run.smithi196.stdout: osd map max advance = 10 2024-03-23T23:41:42.322 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:42.322 INFO:teuthology.orchestra.run.smithi196.stdout: journal zero on create = true 2024-03-23T23:41:42.322 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:42.322 INFO:teuthology.orchestra.run.smithi196.stdout: filestore ondisk finisher threads = 3 2024-03-23T23:41:42.322 INFO:teuthology.orchestra.run.smithi196.stdout: filestore apply finisher threads = 3 2024-03-23T23:41:42.322 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:42.322 INFO:teuthology.orchestra.run.smithi196.stdout: bdev debug aio = true 2024-03-23T23:41:42.322 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug misdirected ops = true 2024-03-23T23:41:42.322 INFO:teuthology.orchestra.run.smithi196.stdout: bdev async discard = True 2024-03-23T23:41:42.323 INFO:teuthology.orchestra.run.smithi196.stdout: bdev enable discard = True 2024-03-23T23:41:42.323 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore allocator = bitmap 2024-03-23T23:41:42.323 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore block size = 96636764160 2024-03-23T23:41:42.323 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore fsck on mount = True 2024-03-23T23:41:42.323 INFO:teuthology.orchestra.run.smithi196.stdout: debug bluefs = 1/20 2024-03-23T23:41:42.323 INFO:teuthology.orchestra.run.smithi196.stdout: debug bluestore = 1/20 2024-03-23T23:41:42.323 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-03-23T23:41:42.323 INFO:teuthology.orchestra.run.smithi196.stdout: debug osd = 20 2024-03-23T23:41:42.323 INFO:teuthology.orchestra.run.smithi196.stdout: debug rocksdb = 4/10 2024-03-23T23:41:42.323 INFO:teuthology.orchestra.run.smithi196.stdout: filestore flush min = 0 2024-03-23T23:41:42.323 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd backfillfull_ratio = 0.85 2024-03-23T23:41:42.323 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd full ratio = 0.9 2024-03-23T23:41:42.323 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd nearfull ratio = 0.8 2024-03-23T23:41:42.323 INFO:teuthology.orchestra.run.smithi196.stdout: osd blocked scrub grace period = 3600 2024-03-23T23:41:42.324 INFO:teuthology.orchestra.run.smithi196.stdout: osd failsafe full ratio = 0.95 2024-03-23T23:41:42.324 INFO:teuthology.orchestra.run.smithi196.stdout: osd max markdown count = 1000 2024-03-23T23:41:42.324 INFO:teuthology.orchestra.run.smithi196.stdout: osd objectstore = bluestore 2024-03-23T23:41:42.324 INFO:teuthology.orchestra.run.smithi196.stdout: osd op complaint time = 180 2024-03-23T23:41:42.324 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:42.324 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr] 2024-03-23T23:41:42.324 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-03-23T23:41:42.324 INFO:teuthology.orchestra.run.smithi196.stdout: debug mgr = 20 2024-03-23T23:41:42.324 INFO:teuthology.orchestra.run.smithi196.stdout: debug mon = 20 2024-03-23T23:41:42.324 INFO:teuthology.orchestra.run.smithi196.stdout: debug auth = 20 2024-03-23T23:41:42.324 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min pgs per osd = 4 2024-03-23T23:41:42.324 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min bytes per osd = 10 2024-03-23T23:41:42.324 INFO:teuthology.orchestra.run.smithi196.stdout: mgr/telemetry/nag = false 2024-03-23T23:41:42.325 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:42.325 INFO:teuthology.orchestra.run.smithi196.stdout:[mon] 2024-03-23T23:41:42.325 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-03-23T23:41:42.325 INFO:teuthology.orchestra.run.smithi196.stdout: debug mon = 20 2024-03-23T23:41:42.325 INFO:teuthology.orchestra.run.smithi196.stdout: debug paxos = 20 2024-03-23T23:41:42.325 INFO:teuthology.orchestra.run.smithi196.stdout: debug auth = 20 2024-03-23T23:41:42.325 INFO:teuthology.orchestra.run.smithi196.stdout: mon data avail warn = 5 2024-03-23T23:41:42.325 INFO:teuthology.orchestra.run.smithi196.stdout: mon mgr mkfs grace = 240 2024-03-23T23:41:42.325 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min pgs per osd = 4 2024-03-23T23:41:42.325 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd reporter subtree level = osd 2024-03-23T23:41:42.325 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd prime pg temp = true 2024-03-23T23:41:42.325 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min bytes per osd = 10 2024-03-23T23:41:42.326 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:42.326 INFO:teuthology.orchestra.run.smithi196.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-23T23:41:42.326 INFO:teuthology.orchestra.run.smithi196.stdout: auth mon ticket ttl = 660 # 11m 2024-03-23T23:41:42.326 INFO:teuthology.orchestra.run.smithi196.stdout: auth service ticket ttl = 240 # 4m 2024-03-23T23:41:42.326 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:42.326 INFO:teuthology.orchestra.run.smithi196.stdout: # don't complain about insecure global_id in the test suite 2024-03-23T23:41:42.326 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-23T23:41:42.326 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-23T23:41:42.326 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:42.326 INFO:teuthology.orchestra.run.smithi196.stdout: # 1m isn't quite enough 2024-03-23T23:41:42.326 INFO:teuthology.orchestra.run.smithi196.stdout: mon_down_mkfs_grace = 2m 2024-03-23T23:41:42.326 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:42.326 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_filestore_osds = false 2024-03-23T23:41:42.327 INFO:teuthology.orchestra.run.smithi196.stdout: mon op complaint time = 120 2024-03-23T23:41:42.327 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-23T23:41:42.327 INFO:teuthology.orchestra.run.smithi196.stdout:[client] 2024-03-23T23:41:42.327 INFO:teuthology.orchestra.run.smithi196.stdout: rgw cache enabled = true 2024-03-23T23:41:42.327 INFO:teuthology.orchestra.run.smithi196.stdout: rgw enable ops log = true 2024-03-23T23:41:42.327 INFO:teuthology.orchestra.run.smithi196.stdout: rgw enable usage log = true 2024-03-23T23:41:42.327 INFO:teuthology.orchestra.run.smithi196.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-23T23:41:42.327 INFO:teuthology.orchestra.run.smithi196.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-23T23:41:42.327 INFO:teuthology.orchestra.run.smithi196.stdout: client mount timeout = 600 2024-03-23T23:41:42.327 INFO:teuthology.orchestra.run.smithi196.stdout: client_shutdown_timeout = 120 2024-03-23T23:41:42.327 INFO:teuthology.orchestra.run.smithi196.stdout: debug client = 20 2024-03-23T23:41:42.327 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-03-23T23:41:42.327 INFO:teuthology.orchestra.run.smithi196.stdout: rados mon op timeout = 900 2024-03-23T23:41:42.327 INFO:teuthology.orchestra.run.smithi196.stdout: rados osd op timeout = 900 2024-03-23T23:41:42.328 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.a] 2024-03-23T23:41:42.328 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.b] 2024-03-23T23:41:42.328 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.c] 2024-03-23T23:41:42.328 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.a] 2024-03-23T23:41:42.328 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.c] 2024-03-23T23:41:42.328 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.b] 2024-03-23T23:41:42.328 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.d] 2024-03-23T23:41:42.328 INFO:teuthology.orchestra.run.smithi196.stdout:[mds] 2024-03-23T23:41:42.328 INFO:teuthology.orchestra.run.smithi196.stdout: debug mds = 20 2024-03-23T23:41:42.328 INFO:teuthology.orchestra.run.smithi196.stdout: debug mds balancer = 20 2024-03-23T23:41:42.328 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-03-23T23:41:42.328 INFO:teuthology.orchestra.run.smithi196.stdout: mds bal fragment size max = 10000 2024-03-23T23:41:42.328 INFO:teuthology.orchestra.run.smithi196.stdout: mds bal merge size = 5 2024-03-23T23:41:42.329 INFO:teuthology.orchestra.run.smithi196.stdout: mds bal split bits = 3 2024-03-23T23:41:42.329 INFO:teuthology.orchestra.run.smithi196.stdout: mds bal split size = 100 2024-03-23T23:41:42.329 INFO:teuthology.orchestra.run.smithi196.stdout: mds debug frag = True 2024-03-23T23:41:42.329 INFO:teuthology.orchestra.run.smithi196.stdout: mds debug scatterstat = True 2024-03-23T23:41:42.329 INFO:teuthology.orchestra.run.smithi196.stdout: mds op complaint time = 180 2024-03-23T23:41:42.329 INFO:teuthology.orchestra.run.smithi196.stdout: mds verify scatter = True 2024-03-23T23:41:42.329 INFO:teuthology.orchestra.run.smithi196.stdout: osd op complaint time = 180 2024-03-23T23:41:42.329 INFO:teuthology.orchestra.run.smithi196.stdout: rados mon op timeout = 900 2024-03-23T23:41:42.329 INFO:teuthology.orchestra.run.smithi196.stdout: rados osd op timeout = 900 2024-03-23T23:41:42.331 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-23T23:41:42.331 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-23T23:41:42.430 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-23T23:41:42.431 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-23T23:41:42.431 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-23T23:41:42.439 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-23T23:41:42.439 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-23T23:41:42.492 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi008.front.sepia.ceph.com 2024-03-23T23:41:42.492 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-23T23:41:42.492 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-23T23:41:42.492 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-23T23:41:42.563 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-23T23:41:42.564 DEBUG:teuthology.orchestra.run.smithi008:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-23T23:41:42.613 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi196.front.sepia.ceph.com 2024-03-23T23:41:42.613 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-23T23:41:42.613 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-23T23:41:42.613 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-23T23:41:42.650 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-23T23:41:42.650 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-23T23:41:42.713 INFO:tasks.ceph:Setting up mon nodes... 2024-03-23T23:41:42.713 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-23T23:41:42.714 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-23T23:41:42.770 INFO:teuthology.orchestra.run.smithi008.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-23T23:41:42.776 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-23T23:41:42.837 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-23T23:41:42.854 INFO:tasks.ceph:Setting up mds nodes... 2024-03-23T23:41:42.854 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-23T23:41:42.912 INFO:teuthology.orchestra.run.smithi008.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-23T23:41:42.916 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-23T23:41:42.936 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-03-23T23:41:43.034 INFO:teuthology.orchestra.run.smithi008.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-03-23T23:41:43.039 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-03-23T23:41:43.059 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-23T23:41:43.118 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-23T23:41:43.122 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-23T23:41:43.142 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-03-23T23:41:43.238 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-03-23T23:41:43.243 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-03-23T23:41:43.262 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-23T23:41:43.263 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-23T23:41:43.306 INFO:teuthology.orchestra.run.smithi008.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-23T23:41:43.323 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-23T23:41:43.363 INFO:teuthology.orchestra.run.smithi196.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-03-23T23:41:43.380 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-23T23:41:43.380 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi008.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi196.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-23T23:41:43.380 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-23T23:41:43.400 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-23T23:41:43.400 INFO:tasks.ceph:role: osd.0 2024-03-23T23:41:43.400 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi008.front.sepia.ceph.com 2024-03-23T23:41:43.401 DEBUG:teuthology.orchestra.run.smithi008:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-23T23:41:43.463 INFO:teuthology.orchestra.run.smithi008.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-23T23:41:43.463 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-23T23:41:43.463 INFO:teuthology.orchestra.run.smithi008.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-23T23:41:43.463 INFO:teuthology.orchestra.run.smithi008.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-23T23:41:43.463 INFO:teuthology.orchestra.run.smithi008.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-23T23:41:43.463 INFO:teuthology.orchestra.run.smithi008.stdout: = sunit=0 swidth=0 blks 2024-03-23T23:41:43.463 INFO:teuthology.orchestra.run.smithi008.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-23T23:41:43.464 INFO:teuthology.orchestra.run.smithi008.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-23T23:41:43.464 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-23T23:41:43.464 INFO:teuthology.orchestra.run.smithi008.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-23T23:41:43.488 INFO:teuthology.orchestra.run.smithi008.stdout:Discarding blocks...Done. 2024-03-23T23:41:43.490 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi008.front.sepia.ceph.com -o noatime 2024-03-23T23:41:43.491 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-23T23:41:43.557 DEBUG:teuthology.orchestra.run.smithi008:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-23T23:41:43.620 INFO:teuthology.orchestra.run.smithi008.stderr:sudo: /sbin/restorecon: command not found 2024-03-23T23:41:43.620 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-23T23:41:43.621 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-23T23:41:43.683 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-23T23:41:43.683 INFO:tasks.ceph:role: osd.1 2024-03-23T23:41:43.683 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi008.front.sepia.ceph.com 2024-03-23T23:41:43.684 DEBUG:teuthology.orchestra.run.smithi008:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-23T23:41:43.744 INFO:teuthology.orchestra.run.smithi008.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-23T23:41:43.744 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-23T23:41:43.744 INFO:teuthology.orchestra.run.smithi008.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-23T23:41:43.744 INFO:teuthology.orchestra.run.smithi008.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-23T23:41:43.745 INFO:teuthology.orchestra.run.smithi008.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-23T23:41:43.745 INFO:teuthology.orchestra.run.smithi008.stdout: = sunit=0 swidth=0 blks 2024-03-23T23:41:43.745 INFO:teuthology.orchestra.run.smithi008.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-23T23:41:43.745 INFO:teuthology.orchestra.run.smithi008.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-23T23:41:43.745 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-23T23:41:43.745 INFO:teuthology.orchestra.run.smithi008.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-23T23:41:43.769 INFO:teuthology.orchestra.run.smithi008.stdout:Discarding blocks...Done. 2024-03-23T23:41:43.771 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi008.front.sepia.ceph.com -o noatime 2024-03-23T23:41:43.771 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-23T23:41:43.841 DEBUG:teuthology.orchestra.run.smithi008:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-23T23:41:43.899 INFO:teuthology.orchestra.run.smithi008.stderr:sudo: /sbin/restorecon: command not found 2024-03-23T23:41:43.900 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-23T23:41:43.900 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-23T23:41:43.963 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-23T23:41:43.963 INFO:tasks.ceph:role: osd.2 2024-03-23T23:41:43.964 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi008.front.sepia.ceph.com 2024-03-23T23:41:43.964 DEBUG:teuthology.orchestra.run.smithi008:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-23T23:41:44.024 INFO:teuthology.orchestra.run.smithi008.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-23T23:41:44.024 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-23T23:41:44.024 INFO:teuthology.orchestra.run.smithi008.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-23T23:41:44.024 INFO:teuthology.orchestra.run.smithi008.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-23T23:41:44.024 INFO:teuthology.orchestra.run.smithi008.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-23T23:41:44.024 INFO:teuthology.orchestra.run.smithi008.stdout: = sunit=0 swidth=0 blks 2024-03-23T23:41:44.024 INFO:teuthology.orchestra.run.smithi008.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-23T23:41:44.024 INFO:teuthology.orchestra.run.smithi008.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-23T23:41:44.024 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-23T23:41:44.025 INFO:teuthology.orchestra.run.smithi008.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-23T23:41:44.048 INFO:teuthology.orchestra.run.smithi008.stdout:Discarding blocks...Done. 2024-03-23T23:41:44.051 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi008.front.sepia.ceph.com -o noatime 2024-03-23T23:41:44.051 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-23T23:41:44.116 DEBUG:teuthology.orchestra.run.smithi008:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-23T23:41:44.175 INFO:teuthology.orchestra.run.smithi008.stderr:sudo: /sbin/restorecon: command not found 2024-03-23T23:41:44.176 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-23T23:41:44.176 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-23T23:41:44.243 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-23T23:41:44.243 INFO:tasks.ceph:role: osd.3 2024-03-23T23:41:44.244 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi008.front.sepia.ceph.com 2024-03-23T23:41:44.244 DEBUG:teuthology.orchestra.run.smithi008:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-23T23:41:44.303 INFO:teuthology.orchestra.run.smithi008.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-23T23:41:44.303 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-23T23:41:44.304 INFO:teuthology.orchestra.run.smithi008.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-23T23:41:44.304 INFO:teuthology.orchestra.run.smithi008.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-23T23:41:44.304 INFO:teuthology.orchestra.run.smithi008.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-23T23:41:44.304 INFO:teuthology.orchestra.run.smithi008.stdout: = sunit=0 swidth=0 blks 2024-03-23T23:41:44.304 INFO:teuthology.orchestra.run.smithi008.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-23T23:41:44.304 INFO:teuthology.orchestra.run.smithi008.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-23T23:41:44.304 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-23T23:41:44.304 INFO:teuthology.orchestra.run.smithi008.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-23T23:41:44.329 INFO:teuthology.orchestra.run.smithi008.stdout:Discarding blocks...Done. 2024-03-23T23:41:44.331 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi008.front.sepia.ceph.com -o noatime 2024-03-23T23:41:44.331 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-23T23:41:44.400 DEBUG:teuthology.orchestra.run.smithi008:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-23T23:41:44.456 INFO:teuthology.orchestra.run.smithi008.stderr:sudo: /sbin/restorecon: command not found 2024-03-23T23:41:44.456 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-23T23:41:44.457 DEBUG:teuthology.orchestra.run.smithi008:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-23T23:41:44.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:41:44.577+0000 7fbbc84727c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-23T23:41:44.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:41:44.577+0000 7fbbc84727c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-23T23:41:44.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:41:44.577+0000 7fbbc84727c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-23T23:41:44.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:41:44.577+0000 7fbbc84727c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-23T23:41:44.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:41:44.577+0000 7fbbc84727c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-23T23:41:44.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:41:44.581+0000 7fbbc84727c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-23T23:41:47.548 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-23T23:41:47.570 DEBUG:teuthology.orchestra.run.smithi008:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-23T23:41:47.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:41:47.665+0000 7f267a63d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-23T23:41:47.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:41:47.665+0000 7f267a63d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-23T23:41:47.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:41:47.665+0000 7f267a63d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-23T23:41:47.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:41:47.665+0000 7f267a63d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-23T23:41:47.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:41:47.665+0000 7f267a63d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-23T23:41:47.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:41:47.665+0000 7f267a63d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-23T23:41:50.659 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-23T23:41:50.680 DEBUG:teuthology.orchestra.run.smithi008:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-23T23:41:50.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:41:50.777+0000 7fc5c346b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-23T23:41:50.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:41:50.777+0000 7fc5c346b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-23T23:41:50.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:41:50.777+0000 7fc5c346b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-23T23:41:50.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:41:50.777+0000 7fc5c346b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-23T23:41:50.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:41:50.777+0000 7fc5c346b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-23T23:41:50.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:41:50.777+0000 7fc5c346b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-23T23:41:53.758 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-23T23:41:53.779 DEBUG:teuthology.orchestra.run.smithi008:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-23T23:41:53.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:41:53.869+0000 7f67de8047c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-23T23:41:53.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:41:53.869+0000 7f67de8047c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-23T23:41:53.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:41:53.873+0000 7f67de8047c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-23T23:41:53.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:41:53.873+0000 7f67de8047c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-23T23:41:53.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:41:53.873+0000 7f67de8047c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-23T23:41:53.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:41:53.873+0000 7f67de8047c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-23T23:41:56.862 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-23T23:41:56.883 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-23T23:41:56.905 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-23T23:41:56.905 INFO:tasks.ceph:role: osd.4 2024-03-23T23:41:56.905 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi196.front.sepia.ceph.com 2024-03-23T23:41:56.905 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-23T23:41:56.980 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-23T23:41:56.980 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-23T23:41:56.980 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-23T23:41:56.980 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-23T23:41:56.981 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-23T23:41:56.981 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-03-23T23:41:56.981 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-23T23:41:56.981 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-23T23:41:56.981 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-23T23:41:56.981 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-23T23:41:57.444 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-03-23T23:41:57.451 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-03-23T23:41:57.451 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-23T23:41:57.559 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-23T23:41:57.576 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: /sbin/restorecon: command not found 2024-03-23T23:41:57.577 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-23T23:41:57.577 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-23T23:41:57.644 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-23T23:41:57.644 INFO:tasks.ceph:role: osd.5 2024-03-23T23:41:57.644 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi196.front.sepia.ceph.com 2024-03-23T23:41:57.644 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-23T23:41:57.720 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-23T23:41:57.721 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-23T23:41:57.721 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-23T23:41:57.721 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-23T23:41:57.721 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-23T23:41:57.721 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-03-23T23:41:57.721 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-23T23:41:57.721 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-23T23:41:57.721 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-23T23:41:57.721 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-23T23:41:58.220 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-03-23T23:41:58.223 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-03-23T23:41:58.223 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-23T23:41:58.386 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-23T23:41:58.403 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: /sbin/restorecon: command not found 2024-03-23T23:41:58.404 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-23T23:41:58.404 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-23T23:41:58.468 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-23T23:41:58.468 INFO:tasks.ceph:role: osd.6 2024-03-23T23:41:58.468 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi196.front.sepia.ceph.com 2024-03-23T23:41:58.469 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-23T23:41:58.541 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-23T23:41:58.541 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-23T23:41:58.541 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-23T23:41:58.541 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-23T23:41:58.541 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-23T23:41:58.541 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-03-23T23:41:58.542 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-23T23:41:58.542 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-23T23:41:58.542 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-23T23:41:58.542 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-23T23:41:59.027 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-03-23T23:41:59.030 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-03-23T23:41:59.030 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-23T23:41:59.125 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-23T23:41:59.141 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: /sbin/restorecon: command not found 2024-03-23T23:41:59.142 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-23T23:41:59.142 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-23T23:41:59.203 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-23T23:41:59.203 INFO:tasks.ceph:role: osd.7 2024-03-23T23:41:59.203 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi196.front.sepia.ceph.com 2024-03-23T23:41:59.204 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-23T23:41:59.275 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-23T23:41:59.275 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-23T23:41:59.275 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-23T23:41:59.275 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-23T23:41:59.275 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-23T23:41:59.276 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-03-23T23:41:59.276 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-23T23:41:59.276 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-23T23:41:59.276 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-23T23:41:59.276 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-23T23:41:59.738 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-03-23T23:41:59.742 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-03-23T23:41:59.742 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-23T23:41:59.850 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-23T23:41:59.867 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: /sbin/restorecon: command not found 2024-03-23T23:41:59.868 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-23T23:41:59.868 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-23T23:42:00.004 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:00.002+0000 7f76cc4ea7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-23T23:42:00.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:00.006+0000 7f76cc4ea7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-23T23:42:00.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:00.006+0000 7f76cc4ea7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-23T23:42:00.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:00.006+0000 7f76cc4ea7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-23T23:42:00.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:00.006+0000 7f76cc4ea7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-23T23:42:00.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:00.014+0000 7f76cc4ea7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-23T23:42:02.988 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-23T23:42:03.009 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-23T23:42:03.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:03.106+0000 7fce555157c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-23T23:42:03.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:03.110+0000 7fce555157c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-23T23:42:03.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:03.110+0000 7fce555157c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-23T23:42:03.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:03.110+0000 7fce555157c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-23T23:42:03.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:03.110+0000 7fce555157c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-23T23:42:03.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:03.110+0000 7fce555157c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-23T23:42:06.086 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-23T23:42:06.106 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-23T23:42:06.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:06.198+0000 7fa77b7e17c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-23T23:42:06.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:06.198+0000 7fa77b7e17c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-23T23:42:06.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:06.198+0000 7fa77b7e17c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-23T23:42:06.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:06.198+0000 7fa77b7e17c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-23T23:42:06.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:06.198+0000 7fa77b7e17c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-23T23:42:06.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:06.202+0000 7fa77b7e17c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-23T23:42:09.177 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-23T23:42:09.198 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-23T23:42:09.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:09.294+0000 7f21841b47c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-23T23:42:09.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:09.294+0000 7f21841b47c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-23T23:42:09.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:09.294+0000 7f21841b47c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-23T23:42:09.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:09.294+0000 7f21841b47c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-23T23:42:09.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:09.294+0000 7f21841b47c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-23T23:42:09.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:09.298+0000 7f21841b47c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-23T23:42:10.380 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:42:10.384 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:42:12.301 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-23T23:42:12.327 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-23T23:42:12.327 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-23T23:42:12.327 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-23T23:42:12.352 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-23T23:42:12.352 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-23T23:42:12.421 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-23T23:42:12.421 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-03-23T23:42:12.489 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-23T23:42:12.489 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-23T23:42:12.560 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-23T23:42:12.561 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-23T23:42:12.627 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-23T23:42:12.628 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-23T23:42:12.652 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-23T23:42:12.652 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-23T23:42:12.718 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-23T23:42:12.718 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-23T23:42:12.740 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-23T23:42:12.740 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-23T23:42:12.807 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-23T23:42:12.808 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-03-23T23:42:12.878 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-23T23:42:12.878 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-23T23:42:12.941 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-23T23:42:12.942 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-23T23:42:13.007 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-23T23:42:13.007 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-23T23:42:13.068 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-23T23:42:13.068 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-23T23:42:13.133 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-23T23:42:13.133 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-23T23:42:13.142 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-23T23:42:13.142 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-03-23T23:42:13.190 INFO:tasks.ceph:Adding keys to all mons... 2024-03-23T23:42:13.190 DEBUG:teuthology.orchestra.run.smithi008:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-23T23:42:13.193 DEBUG:teuthology.orchestra.run.smithi196:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-23T23:42:13.238 INFO:teuthology.orchestra.run.smithi008.stdout:[mgr.y] 2024-03-23T23:42:13.238 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQC2aP9l9QITLhAA+v23VWzdHTTK+GgUEEEsWQ== 2024-03-23T23:42:13.239 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.a] 2024-03-23T23:42:13.239 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQC2aP9lVbKDNhAA2tWMeJyrE7hajsfX6QipEQ== 2024-03-23T23:42:13.239 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.c] 2024-03-23T23:42:13.239 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQC3aP9l6gM7AhAAfnVjQpcQ5shobovnOiiilw== 2024-03-23T23:42:13.239 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.0] 2024-03-23T23:42:13.240 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQC4aP9lg7W0IhAAUf+o2755PYGanvQ5zQoWUw== 2024-03-23T23:42:13.240 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.1] 2024-03-23T23:42:13.240 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQC7aP9l8J/MJxAAkNpwbkB6vZ2kwW+ffkfUmw== 2024-03-23T23:42:13.240 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.2] 2024-03-23T23:42:13.240 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQC+aP9lq+t0LhAAgEfRoTg/OlRljpqFwnTZhQ== 2024-03-23T23:42:13.240 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.3] 2024-03-23T23:42:13.241 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQDBaP9ld80iNBAAw7QMvgeQGMlPOj2WOTq/Mg== 2024-03-23T23:42:13.241 INFO:teuthology.orchestra.run.smithi008.stdout:[mgr.x] 2024-03-23T23:42:13.241 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQC2aP9lpm4qMhAAkP5d3eDpB/q/QEGDJUZHMA== 2024-03-23T23:42:13.241 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.b] 2024-03-23T23:42:13.241 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQC3aP9lB95HBxAALg+kplA9GTCW45CipJU38Q== 2024-03-23T23:42:13.241 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.d] 2024-03-23T23:42:13.241 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQC3aP9ltXB7DhAAYCNhQSLtLt2EykA627ykTg== 2024-03-23T23:42:13.242 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.4] 2024-03-23T23:42:13.242 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQDIaP9lJTuDABAA3VvPiAw7yvVGUkd1AgTEow== 2024-03-23T23:42:13.242 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.5] 2024-03-23T23:42:13.242 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQDLaP9lFzm0BhAA0L+ECrhtRUBZnab1BkET2g== 2024-03-23T23:42:13.243 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.6] 2024-03-23T23:42:13.243 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQDOaP9lVJgdDBAAHMo5uZcqI+gL9uYudbD5ow== 2024-03-23T23:42:13.243 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.7] 2024-03-23T23:42:13.243 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQDRaP9lpm3dERAAotRCaEe7h4x5Y677WqFkaw== 2024-03-23T23:42:13.243 INFO:teuthology.orchestra.run.smithi008.stdout:[client.0] 2024-03-23T23:42:13.243 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQC3aP9lYdpnEhAAed/Of5bh7SPyfHkPIk79BQ== 2024-03-23T23:42:13.244 INFO:teuthology.orchestra.run.smithi008.stdout:[client.1] 2024-03-23T23:42:13.244 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQC3aP9lHK7sFRAAONAPfYBbRFlHNiOijJMy4w== 2024-03-23T23:42:13.249 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr.y] 2024-03-23T23:42:13.250 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQC2aP9l9QITLhAA+v23VWzdHTTK+GgUEEEsWQ== 2024-03-23T23:42:13.250 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.a] 2024-03-23T23:42:13.250 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQC2aP9lVbKDNhAA2tWMeJyrE7hajsfX6QipEQ== 2024-03-23T23:42:13.250 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.c] 2024-03-23T23:42:13.250 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQC3aP9l6gM7AhAAfnVjQpcQ5shobovnOiiilw== 2024-03-23T23:42:13.250 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.0] 2024-03-23T23:42:13.250 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQC4aP9lg7W0IhAAUf+o2755PYGanvQ5zQoWUw== 2024-03-23T23:42:13.251 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.1] 2024-03-23T23:42:13.251 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQC7aP9l8J/MJxAAkNpwbkB6vZ2kwW+ffkfUmw== 2024-03-23T23:42:13.251 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.2] 2024-03-23T23:42:13.251 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQC+aP9lq+t0LhAAgEfRoTg/OlRljpqFwnTZhQ== 2024-03-23T23:42:13.251 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.3] 2024-03-23T23:42:13.251 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDBaP9ld80iNBAAw7QMvgeQGMlPOj2WOTq/Mg== 2024-03-23T23:42:13.252 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr.x] 2024-03-23T23:42:13.252 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQC2aP9lpm4qMhAAkP5d3eDpB/q/QEGDJUZHMA== 2024-03-23T23:42:13.252 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.b] 2024-03-23T23:42:13.252 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQC3aP9lB95HBxAALg+kplA9GTCW45CipJU38Q== 2024-03-23T23:42:13.252 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.d] 2024-03-23T23:42:13.252 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQC3aP9ltXB7DhAAYCNhQSLtLt2EykA627ykTg== 2024-03-23T23:42:13.252 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.4] 2024-03-23T23:42:13.252 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDIaP9lJTuDABAA3VvPiAw7yvVGUkd1AgTEow== 2024-03-23T23:42:13.253 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.5] 2024-03-23T23:42:13.253 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDLaP9lFzm0BhAA0L+ECrhtRUBZnab1BkET2g== 2024-03-23T23:42:13.253 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.6] 2024-03-23T23:42:13.253 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDOaP9lVJgdDBAAHMo5uZcqI+gL9uYudbD5ow== 2024-03-23T23:42:13.253 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.7] 2024-03-23T23:42:13.254 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDRaP9lpm3dERAAotRCaEe7h4x5Y677WqFkaw== 2024-03-23T23:42:13.254 INFO:teuthology.orchestra.run.smithi196.stdout:[client.0] 2024-03-23T23:42:13.254 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQC3aP9lYdpnEhAAed/Of5bh7SPyfHkPIk79BQ== 2024-03-23T23:42:13.254 INFO:teuthology.orchestra.run.smithi196.stdout:[client.1] 2024-03-23T23:42:13.254 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQC3aP9lHK7sFRAAONAPfYBbRFlHNiOijJMy4w== 2024-03-23T23:42:13.255 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-23T23:42:13.297 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-23T23:42:13.355 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-23T23:42:13.359 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-23T23:42:13.416 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-23T23:42:13.421 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-23T23:42:13.478 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T23:42:13.485 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T23:42:13.540 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T23:42:13.546 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T23:42:13.603 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T23:42:13.607 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T23:42:13.662 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T23:42:13.668 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T23:42:13.724 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-23T23:42:13.730 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-23T23:42:13.788 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-23T23:42:13.794 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-23T23:42:13.852 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-23T23:42:13.860 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-23T23:42:13.918 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T23:42:13.922 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T23:42:13.978 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T23:42:13.984 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T23:42:14.040 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T23:42:14.047 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T23:42:14.103 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T23:42:14.108 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T23:42:14.165 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-23T23:42:14.171 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-23T23:42:14.228 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-23T23:42:14.233 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-23T23:42:14.291 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-23T23:42:14.291 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-23T23:42:14.314 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-23T23:42:14.425 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-23T23:42:14.445 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-23T23:42:14.464 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-23T23:42:14.576 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-23T23:42:14.595 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-23T23:42:14.658 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-23T23:42:14.766 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-23T23:42:14.785 DEBUG:teuthology.orchestra.run.smithi008:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-23T23:42:14.788 DEBUG:teuthology.orchestra.run.smithi196:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-23T23:42:14.835 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-23T23:42:14.835 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-23T23:42:14.836 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-23T23:42:14.838 INFO:tasks.ceph.mon.a:Started 2024-03-23T23:42:14.839 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-23T23:42:14.839 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-23T23:42:14.878 INFO:tasks.ceph.mon.b:Started 2024-03-23T23:42:14.878 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-23T23:42:14.878 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-23T23:42:14.881 INFO:tasks.ceph.mon.c:Started 2024-03-23T23:42:14.881 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-23T23:42:14.881 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-23T23:42:14.882 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-23T23:42:14.884 INFO:tasks.ceph.mgr.y:Started 2024-03-23T23:42:14.885 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-23T23:42:14.885 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-23T23:42:14.888 INFO:tasks.ceph.mgr.x:Started 2024-03-23T23:42:14.888 INFO:tasks.ceph:Setting crush tunables to default 2024-03-23T23:42:14.888 DEBUG:teuthology.orchestra.run.smithi008:> sudo ceph --cluster ceph osd crush tunables default 2024-03-23T23:42:15.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.025+0000 7f984ce00640 1 Processor -- start 2024-03-23T23:42:15.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.029+0000 7f984ce00640 1 -- start start 2024-03-23T23:42:15.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.029+0000 7f984ce00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f98480c4fb0 0x7f98481542c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:15.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.029+0000 7f984ce00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f98480c86b0 0x7f98480ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:15.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.029+0000 7f984ce00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98480c5770 con 0x7f9848151000 2024-03-23T23:42:15.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.029+0000 7f984ce00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98480c84a0 con 0x7f98480c4fb0 2024-03-23T23:42:15.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.029+0000 7f984ce00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98480c46a0 con 0x7f98480c86b0 2024-03-23T23:42:15.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.053+0000 7f9845400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f98480c4fb0 0x7f98481542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:15.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.053+0000 7f9845e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f9848151000 0x7f98480c6e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:39604/0 (socket says 172.21.15.8:39604) 2024-03-23T23:42:15.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.053+0000 7f9845e00640 1 -- 172.21.15.8:0/4034278528 learned_addr learned my addr 172.21.15.8:0/4034278528 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:15.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.053+0000 7f9846800640 1 --2- 172.21.15.8:0/4034278528 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f98480c86b0 0x7f98480ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:15.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.053+0000 7f9845400640 1 -- 172.21.15.8:0/4034278528 >> v2:172.21.15.196:3300/0 conn(0x7f98480c4fb0 msgr2=0x7f98481542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:42:15.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.053+0000 7f9845400640 1 -- 172.21.15.8:0/4034278528 >> v2:172.21.15.196:3300/0 conn(0x7f98480c4fb0 msgr2=0x7f98481542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:42:15.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.053+0000 7f9845400640 1 --2- 172.21.15.8:0/4034278528 >> v2:172.21.15.196:3300/0 conn(0x7f98480c4fb0 0x7f98481542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:42:15.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.053+0000 7f9845400640 1 --2- 172.21.15.8:0/4034278528 >> v2:172.21.15.196:3300/0 conn(0x7f98480c4fb0 0x7f98481542c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:42:15.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.053+0000 7f9846800640 1 -- 172.21.15.8:0/4034278528 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f98480c86b0 msgr2=0x7f98480ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T23:42:15.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.053+0000 7f9846800640 1 -- 172.21.15.8:0/4034278528 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f98480c86b0 msgr2=0x7f98480ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:42:15.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.053+0000 7f9846800640 1 --2- 172.21.15.8:0/4034278528 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f98480c86b0 0x7f98480ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:42:15.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.053+0000 7f9846800640 1 --2- 172.21.15.8:0/4034278528 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f98480c86b0 0x7f98480ae8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:42:15.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.177+0000 7f9844a00640 1 -- 172.21.15.8:0/4034278528 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947373197 0 0) 0x7f98480c5770 con 0x7f9848151000 2024-03-23T23:42:15.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.177+0000 7f9844a00640 1 -- 172.21.15.8:0/4034278528 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f982c003530 con 0x7f9848151000 2024-03-23T23:42:15.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.181+0000 7f9844a00640 1 -- 172.21.15.8:0/4034278528 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1372098181 0 0) 0x7f982c003530 con 0x7f9848151000 2024-03-23T23:42:15.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.181+0000 7f9844a00640 1 -- 172.21.15.8:0/4034278528 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f98480c86b0 msgr2=0x7f98480ae8c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:42:15.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.181+0000 7f9844a00640 1 --2- 172.21.15.8:0/4034278528 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f98480c86b0 0x7f98480ae8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:15.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.181+0000 7f9844a00640 1 -- 172.21.15.8:0/4034278528 >> v2:172.21.15.196:3300/0 conn(0x7f98480c4fb0 msgr2=0x7f98481542c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:42:15.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.181+0000 7f9844a00640 1 --2- 172.21.15.8:0/4034278528 >> v2:172.21.15.196:3300/0 conn(0x7f98480c4fb0 0x7f98481542c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:15.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.181+0000 7f9844a00640 1 -- 172.21.15.8:0/4034278528 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98480c5490 con 0x7f9848151000 2024-03-23T23:42:15.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.181+0000 7f9844a00640 1 -- 172.21.15.8:0/4034278528 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7f9838001680 con 0x7f9848151000 2024-03-23T23:42:15.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.181+0000 7f9844a00640 1 -- 172.21.15.8:0/4034278528 >> v1:172.21.15.196:6789/0 conn(0x7f9848151000 legacy=0x7f98480c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:15.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.181+0000 7f9844a00640 1 --2- 172.21.15.8:0/4034278528 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f98480c86b0 0x7f982c0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:15.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.181+0000 7f9844a00640 1 --2- 172.21.15.8:0/4034278528 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f982c004040 0x7f982c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:15.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.181+0000 7f9844a00640 1 --2- 172.21.15.8:0/4034278528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f982c004d50 0x7f982c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:15.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.181+0000 7f9844a00640 1 -- 172.21.15.8:0/4034278528 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98480c46a0 con 0x7f982c004d50 2024-03-23T23:42:15.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.181+0000 7f9844a00640 1 -- 172.21.15.8:0/4034278528 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c00bb60 con 0x7f982c004040 2024-03-23T23:42:15.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.181+0000 7f9844a00640 1 -- 172.21.15.8:0/4034278528 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982c00bd60 con 0x7f98480c86b0 2024-03-23T23:42:15.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.181+0000 7f9845e00640 1 --2- 172.21.15.8:0/4034278528 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f98480c86b0 0x7f982c0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:15.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.181+0000 7f9846800640 1 --2- 172.21.15.8:0/4034278528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f982c004d50 0x7f982c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:15.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.181+0000 7f9845400640 1 --2- 172.21.15.8:0/4034278528 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f982c004040 0x7f982c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:15.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.181+0000 7f9845e00640 1 -- 172.21.15.8:0/4034278528 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f982c004040 msgr2=0x7f982c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:15.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.181+0000 7f9845e00640 1 --2- 172.21.15.8:0/4034278528 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f982c004040 0x7f982c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:15.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.181+0000 7f9845e00640 1 -- 172.21.15.8:0/4034278528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f982c004d50 msgr2=0x7f982c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:15.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.181+0000 7f9845e00640 1 --2- 172.21.15.8:0/4034278528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f982c004d50 0x7f982c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:15.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.181+0000 7f9845e00640 1 -- 172.21.15.8:0/4034278528 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982c003530 con 0x7f98480c86b0 2024-03-23T23:42:15.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.181+0000 7f9846800640 1 --2- 172.21.15.8:0/4034278528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f982c004d50 0x7f982c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:42:15.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.185+0000 7f9845e00640 1 --2- 172.21.15.8:0/4034278528 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f98480c86b0 0x7f982c0039c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9838001060 tx=0x7f983801f330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2250193ee812ee0f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:15.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.185+0000 7f9844a00640 1 -- 172.21.15.8:0/4034278528 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9838007cb0 con 0x7f98480c86b0 2024-03-23T23:42:15.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.185+0000 7f9844a00640 1 -- 172.21.15.8:0/4034278528 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9838005ae0 con 0x7f98480c86b0 2024-03-23T23:42:15.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.185+0000 7f9844a00640 1 -- 172.21.15.8:0/4034278528 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9838007070 con 0x7f98480c86b0 2024-03-23T23:42:15.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.185+0000 7f984ce00640 1 -- 172.21.15.8:0/4034278528 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f98480c86b0 msgr2=0x7f982c0039c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:15.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.185+0000 7f984ce00640 1 --2- 172.21.15.8:0/4034278528 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f98480c86b0 0x7f982c0039c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9838001060 tx=0x7f983801f330 comp rx=0 tx=0).stop 2024-03-23T23:42:15.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.185+0000 7f9846800640 1 -- 172.21.15.8:0/4034278528 reap_dead start 2024-03-23T23:42:15.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.185+0000 7f984ce00640 1 -- 172.21.15.8:0/4034278528 shutdown_connections 2024-03-23T23:42:15.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.185+0000 7f984ce00640 1 -- 172.21.15.8:0/4034278528 >> 172.21.15.8:0/4034278528 conn(0x7f98480aad10 msgr2=0x7f98480ab120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:15.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.185+0000 7f984ce00640 1 -- 172.21.15.8:0/4034278528 shutdown_connections 2024-03-23T23:42:15.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.185+0000 7f984ce00640 1 -- 172.21.15.8:0/4034278528 wait complete. 2024-03-23T23:42:15.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.189+0000 7f984ce00640 1 Processor -- start 2024-03-23T23:42:15.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.189+0000 7f984ce00640 1 -- start start 2024-03-23T23:42:15.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.189+0000 7f984ce00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98480c86b0 0x7f98480ae260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:15.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.189+0000 7f984ce00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9848154a10 0x7f98481e9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:15.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.189+0000 7f984ce00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f98480aec60 0x7f98481ea0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:15.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.189+0000 7f984ce00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9848153da0 con 0x7f98480c86b0 2024-03-23T23:42:15.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.189+0000 7f984ce00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9848153ac0 con 0x7f9848154a10 2024-03-23T23:42:15.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.189+0000 7f984ce00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98480c7570 con 0x7f98480aec60 2024-03-23T23:42:15.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.189+0000 7f9845e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98480c86b0 0x7f98480ae260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:15.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.189+0000 7f9845400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9848154a10 0x7f98481e9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:15.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.189+0000 7f9845e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98480c86b0 0x7f98480ae260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47442/0 (socket says 172.21.15.8:47442) 2024-03-23T23:42:15.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.189+0000 7f9845e00640 1 -- 172.21.15.8:0/945563782 learned_addr learned my addr 172.21.15.8:0/945563782 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:15.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.189+0000 7f9846800640 1 --2- 172.21.15.8:0/945563782 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f98480aec60 0x7f98481ea0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:15.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.189+0000 7f9845400640 1 -- 172.21.15.8:0/945563782 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f98480aec60 msgr2=0x7f98481ea0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:15.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.189+0000 7f9845400640 1 --2- 172.21.15.8:0/945563782 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f98480aec60 0x7f98481ea0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:15.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.189+0000 7f9845400640 1 -- 172.21.15.8:0/945563782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98480c86b0 msgr2=0x7f98480ae260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:15.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.189+0000 7f9845400640 1 --2- 172.21.15.8:0/945563782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98480c86b0 0x7f98480ae260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:15.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.189+0000 7f9845400640 1 -- 172.21.15.8:0/945563782 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98481ea940 con 0x7f9848154a10 2024-03-23T23:42:15.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.189+0000 7f9845400640 1 --2- 172.21.15.8:0/945563782 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9848154a10 0x7f98481e9b90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9834011560 tx=0x7f9834011a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:15.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.189+0000 7f983e000640 1 -- 172.21.15.8:0/945563782 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9834019020 con 0x7f9848154a10 2024-03-23T23:42:15.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.189+0000 7f983e000640 1 -- 172.21.15.8:0/945563782 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9834003620 con 0x7f9848154a10 2024-03-23T23:42:15.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.189+0000 7f983e000640 1 -- 172.21.15.8:0/945563782 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983400f040 con 0x7f9848154a10 2024-03-23T23:42:15.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.189+0000 7f984ce00640 1 -- 172.21.15.8:0/945563782 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f984814bbc0 con 0x7f9848154a10 2024-03-23T23:42:15.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.189+0000 7f984ce00640 1 -- 172.21.15.8:0/945563782 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98481ea610 con 0x7f9848154a10 2024-03-23T23:42:15.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.193+0000 7f983e000640 1 -- 172.21.15.8:0/945563782 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f983401c020 con 0x7f9848154a10 2024-03-23T23:42:15.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.193+0000 7f983e000640 1 -- 172.21.15.8:0/945563782 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9834015d70 con 0x7f9848154a10 2024-03-23T23:42:15.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.193+0000 7f984ce00640 1 -- 172.21.15.8:0/945563782 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f984814c0e0 con 0x7f9848154a10 2024-03-23T23:42:15.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.209+0000 7f983e000640 1 -- 172.21.15.8:0/945563782 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f984814c0e0 con 0x7f9848154a10 2024-03-23T23:42:15.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.289+0000 7f984ce00640 1 -- 172.21.15.8:0/945563782 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f984804f410 con 0x7f9848154a10 2024-03-23T23:42:15.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.293+0000 7f983e000640 1 -- 172.21.15.8:0/945563782 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f9834023020 con 0x7f9848154a10 2024-03-23T23:42:15.296 INFO:teuthology.orchestra.run.smithi008.stderr:adjusted tunables profile to default 2024-03-23T23:42:15.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.297+0000 7f984ce00640 1 -- 172.21.15.8:0/945563782 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9848154a10 msgr2=0x7f98481e9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:15.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.297+0000 7f984ce00640 1 --2- 172.21.15.8:0/945563782 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9848154a10 0x7f98481e9b90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9834011560 tx=0x7f9834011a20 comp rx=0 tx=0).stop 2024-03-23T23:42:15.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.297+0000 7f984ce00640 1 -- 172.21.15.8:0/945563782 shutdown_connections 2024-03-23T23:42:15.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.297+0000 7f984ce00640 1 --2- 172.21.15.8:0/945563782 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f98480aec60 0x7f98481ea0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:15.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.297+0000 7f984ce00640 1 --2- 172.21.15.8:0/945563782 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9848154a10 0x7f98481e9b90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:15.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.297+0000 7f984ce00640 1 --2- 172.21.15.8:0/945563782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98480c86b0 0x7f98480ae260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:15.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.297+0000 7f984ce00640 1 -- 172.21.15.8:0/945563782 >> 172.21.15.8:0/945563782 conn(0x7f98480aad10 msgr2=0x7f9848151fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:15.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.297+0000 7f984ce00640 1 -- 172.21.15.8:0/945563782 shutdown_connections 2024-03-23T23:42:15.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:15.297+0000 7f984ce00640 1 -- 172.21.15.8:0/945563782 wait complete. 2024-03-23T23:42:15.323 INFO:tasks.ceph:check_enable_crimson: False 2024-03-23T23:42:15.323 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-23T23:42:15.323 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-23T23:42:15.324 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-23T23:42:15.344 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-23T23:42:15.344 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-23T23:42:15.404 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-23T23:42:15.404 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-23T23:42:15.412 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-23T23:42:15.414+0000 7fb72b62d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-23T23:42:15.415 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-03-23T23:42:15.413+0000 7f58a06db180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-23T23:42:15.435 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-23T23:42:15.435 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-23T23:42:15.496 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-23T23:42:15.496 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-23T23:42:15.517 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-23T23:42:15.517 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-23T23:42:15.580 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-23T23:42:15.580 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-23T23:42:15.644 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-23T23:42:15.644 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-23T23:42:15.707 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new e967bf31-21d6-4d11-bc3d-0df8177a1b72 0 2024-03-23T23:42:15.883 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.882+0000 7f29eb800640 1 Processor -- start 2024-03-23T23:42:15.884 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.882+0000 7f29eb800640 1 -- start start 2024-03-23T23:42:15.885 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.886+0000 7f29eb800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29e414f7e0 0x7f29e4156230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:15.885 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.886+0000 7f29eb800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f29e4156ca0 0x7f29e40c9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:15.885 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.886+0000 7f29eb800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f29e40c9d40 0x7f29e40c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:15.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.886+0000 7f29eb800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e4156770 con 0x7f29e40c9d40 2024-03-23T23:42:15.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.886+0000 7f29eb800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e406be20 con 0x7f29e4156ca0 2024-03-23T23:42:15.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.886+0000 7f29eb800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e406c0c0 con 0x7f29e414f7e0 2024-03-23T23:42:15.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.886+0000 7f29e3e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f29e4156ca0 0x7f29e40c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:15.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.886+0000 7f29e3e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f29e4156ca0 0x7f29e40c9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:50062/0 (socket says 172.21.15.196:50062) 2024-03-23T23:42:15.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.886+0000 7f29e3e00640 1 -- 172.21.15.196:0/1872734453 learned_addr learned my addr 172.21.15.196:0/1872734453 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-23T23:42:15.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.886+0000 7f29e8e00640 1 --2- 172.21.15.196:0/1872734453 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29e414f7e0 0x7f29e4156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:15.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.886+0000 7f29e9800640 1 --2- 172.21.15.196:0/1872734453 >> v2:172.21.15.8:3300/0 conn(0x7f29e40c9d40 0x7f29e40c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:15.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.886+0000 7f29e3e00640 1 -- 172.21.15.196:0/1872734453 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29e414f7e0 msgr2=0x7f29e4156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:15.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.886+0000 7f29e3e00640 1 --2- 172.21.15.196:0/1872734453 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29e414f7e0 0x7f29e4156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:15.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.886+0000 7f29e3e00640 1 -- 172.21.15.196:0/1872734453 >> v2:172.21.15.8:3300/0 conn(0x7f29e40c9d40 msgr2=0x7f29e40c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:15.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.886+0000 7f29e3e00640 1 --2- 172.21.15.196:0/1872734453 >> v2:172.21.15.8:3300/0 conn(0x7f29e40c9d40 0x7f29e40c7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:15.887 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.886+0000 7f29e3e00640 1 -- 172.21.15.196:0/1872734453 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e406c3a0 con 0x7f29e4156ca0 2024-03-23T23:42:15.888 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.890+0000 7f29e3e00640 1 --2- 172.21.15.196:0/1872734453 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f29e4156ca0 0x7f29e40c9800 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f29e40cc110 tx=0x7f29d001c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0f2701ed5775ab8 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:15.889 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.890+0000 7f29e3400640 1 -- 172.21.15.196:0/1872734453 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d00ab620 con 0x7f29e4156ca0 2024-03-23T23:42:15.889 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.890+0000 7f29e3400640 1 -- 172.21.15.196:0/1872734453 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d00b0070 con 0x7f29e4156ca0 2024-03-23T23:42:15.889 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.890+0000 7f29e3400640 1 -- 172.21.15.196:0/1872734453 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d00ab9e0 con 0x7f29e4156ca0 2024-03-23T23:42:15.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.890+0000 7f29eb800640 1 -- 172.21.15.196:0/1872734453 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f29e4156ca0 msgr2=0x7f29e40c9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:15.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.890+0000 7f29eb800640 1 --2- 172.21.15.196:0/1872734453 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f29e4156ca0 0x7f29e40c9800 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f29e40cc110 tx=0x7f29d001c460 comp rx=0 tx=0).stop 2024-03-23T23:42:15.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.890+0000 7f29eb800640 1 -- 172.21.15.196:0/1872734453 shutdown_connections 2024-03-23T23:42:15.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.890+0000 7f29eb800640 1 --2- 172.21.15.196:0/1872734453 >> v2:172.21.15.8:3300/0 conn(0x7f29e40c9d40 0x7f29e40c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:15.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.890+0000 7f29eb800640 1 --2- 172.21.15.196:0/1872734453 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f29e4156ca0 0x7f29e40c9800 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:15.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.890+0000 7f29eb800640 1 --2- 172.21.15.196:0/1872734453 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29e414f7e0 0x7f29e4156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:15.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.890+0000 7f29eb800640 1 -- 172.21.15.196:0/1872734453 >> 172.21.15.196:0/1872734453 conn(0x7f29e40ad090 msgr2=0x7f29e40ad4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:15.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.890+0000 7f29eb800640 1 -- 172.21.15.196:0/1872734453 shutdown_connections 2024-03-23T23:42:15.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.890+0000 7f29eb800640 1 -- 172.21.15.196:0/1872734453 wait complete. 2024-03-23T23:42:15.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.890+0000 7f29eb800640 1 Processor -- start 2024-03-23T23:42:15.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.890+0000 7f29eb800640 1 -- start start 2024-03-23T23:42:15.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.894+0000 7f29eb800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29e40c9d40 0x7f29e40abdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:15.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.894+0000 7f29eb800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f29e414f7e0 0x7f29e41ee0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:15.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.894+0000 7f29eb800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29e4156ca0 0x7f29e41ee620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:15.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.894+0000 7f29eb800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e40be870 con 0x7f29e4156ca0 2024-03-23T23:42:15.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.894+0000 7f29eb800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e414fbc0 con 0x7f29e414f7e0 2024-03-23T23:42:15.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.894+0000 7f29eb800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e40be9f0 con 0x7f29e40c9d40 2024-03-23T23:42:15.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.894+0000 7f29e8e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29e40c9d40 0x7f29e40abdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:15.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.894+0000 7f29e3e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f29e414f7e0 0x7f29e41ee0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:15.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.894+0000 7f29e8e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29e40c9d40 0x7f29e40abdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:36794/0 (socket says 172.21.15.196:36794) 2024-03-23T23:42:15.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.894+0000 7f29e8e00640 1 -- 172.21.15.196:0/1577963341 learned_addr learned my addr 172.21.15.196:0/1577963341 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-23T23:42:15.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.894+0000 7f29e9800640 1 --2- 172.21.15.196:0/1577963341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29e4156ca0 0x7f29e41ee620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:15.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.894+0000 7f29e8e00640 1 -- 172.21.15.196:0/1577963341 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f29e414f7e0 msgr2=0x7f29e41ee0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:15.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.894+0000 7f29e8e00640 1 --2- 172.21.15.196:0/1577963341 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f29e414f7e0 0x7f29e41ee0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:15.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.894+0000 7f29e8e00640 1 -- 172.21.15.196:0/1577963341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29e4156ca0 msgr2=0x7f29e41ee620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:15.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.894+0000 7f29e8e00640 1 --2- 172.21.15.196:0/1577963341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29e4156ca0 0x7f29e41ee620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:15.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.894+0000 7f29e8e00640 1 -- 172.21.15.196:0/1577963341 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e40c08f0 con 0x7f29e40c9d40 2024-03-23T23:42:15.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.894+0000 7f29e9800640 1 --2- 172.21.15.196:0/1577963341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29e4156ca0 0x7f29e41ee620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:42:15.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.894+0000 7f29e8e00640 1 --2- 172.21.15.196:0/1577963341 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29e40c9d40 0x7f29e40abdb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f29d800e870 tx=0x7f29d800ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:15.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.894+0000 7f29e0c00640 1 -- 172.21.15.196:0/1577963341 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d8017070 con 0x7f29e40c9d40 2024-03-23T23:42:15.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.894+0000 7f29e0c00640 1 -- 172.21.15.196:0/1577963341 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d800c940 con 0x7f29e40c9d40 2024-03-23T23:42:15.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.894+0000 7f29e0c00640 1 -- 172.21.15.196:0/1577963341 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d800ccf0 con 0x7f29e40c9d40 2024-03-23T23:42:15.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.894+0000 7f29eb800640 1 -- 172.21.15.196:0/1577963341 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e4152a70 con 0x7f29e40c9d40 2024-03-23T23:42:15.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.894+0000 7f29eb800640 1 -- 172.21.15.196:0/1577963341 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e40c05f0 con 0x7f29e40c9d40 2024-03-23T23:42:15.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.894+0000 7f29e0c00640 1 -- 172.21.15.196:0/1577963341 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f29d801a070 con 0x7f29e40c9d40 2024-03-23T23:42:15.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.894+0000 7f29e0c00640 1 -- 172.21.15.196:0/1577963341 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f29d8013470 con 0x7f29e40c9d40 2024-03-23T23:42:15.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.894+0000 7f29eb800640 1 -- 172.21.15.196:0/1577963341 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e404f410 con 0x7f29e40c9d40 2024-03-23T23:42:15.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.898+0000 7f29e0c00640 1 -- 172.21.15.196:0/1577963341 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f29d8006840 con 0x7f29e40c9d40 2024-03-23T23:42:15.951 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-23T23:42:15.950+0000 7fb72b62d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-23T23:42:15.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.966+0000 7f29eb800640 1 -- 172.21.15.196:0/1577963341 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e967bf31-21d6-4d11-bc3d-0df8177a1b72", "id": 0} v 0) v1 -- 0x7f29e414fe70 con 0x7f29e40c9d40 2024-03-23T23:42:15.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.970+0000 7f29e0c00640 1 -- 172.21.15.196:0/1577963341 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e967bf31-21d6-4d11-bc3d-0df8177a1b72", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f29d80059a0 con 0x7f29e40c9d40 2024-03-23T23:42:15.969 INFO:teuthology.orchestra.run.smithi196.stdout:0 2024-03-23T23:42:15.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.970+0000 7f29eb800640 1 -- 172.21.15.196:0/1577963341 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29e40c9d40 msgr2=0x7f29e40abdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:15.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.970+0000 7f29eb800640 1 --2- 172.21.15.196:0/1577963341 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29e40c9d40 0x7f29e40abdb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f29d800e870 tx=0x7f29d800ec70 comp rx=0 tx=0).stop 2024-03-23T23:42:15.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.970+0000 7f29eb800640 1 -- 172.21.15.196:0/1577963341 shutdown_connections 2024-03-23T23:42:15.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.970+0000 7f29eb800640 1 --2- 172.21.15.196:0/1577963341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29e4156ca0 0x7f29e41ee620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:15.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.970+0000 7f29eb800640 1 --2- 172.21.15.196:0/1577963341 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f29e414f7e0 0x7f29e41ee0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:15.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.970+0000 7f29eb800640 1 --2- 172.21.15.196:0/1577963341 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29e40c9d40 0x7f29e40abdb0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:15.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.970+0000 7f29eb800640 1 -- 172.21.15.196:0/1577963341 >> 172.21.15.196:0/1577963341 conn(0x7f29e40ad090 msgr2=0x7f29e40cb100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:15.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.970+0000 7f29eb800640 1 -- 172.21.15.196:0/1577963341 shutdown_connections 2024-03-23T23:42:15.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:15.970+0000 7f29eb800640 1 -- 172.21.15.196:0/1577963341 wait complete. 2024-03-23T23:42:15.988 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new c8e33701-7acd-4474-8402-d52461171fd0 1 2024-03-23T23:42:16.056 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-03-23T23:42:16.053+0000 7f58a06db180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-23T23:42:16.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.122+0000 7f8404e00640 1 Processor -- start 2024-03-23T23:42:16.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.122+0000 7f8404e00640 1 -- start start 2024-03-23T23:42:16.125 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.126+0000 7f8404e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8400159860 0x7f84000714f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:16.125 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.126+0000 7f8404e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f84000c2390 0x7f84000c2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:16.125 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.126+0000 7f8404e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8400159dd0 con 0x7f8400152ff0 2024-03-23T23:42:16.125 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.126+0000 7f8404e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84000701f0 con 0x7f84000c2390 2024-03-23T23:42:16.125 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.126+0000 7f8404e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84000704d0 con 0x7f8400159860 2024-03-23T23:42:16.125 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.126+0000 7f83fde00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f8400152ff0 0x7f840006ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:39008/0 (socket says 172.21.15.196:39008) 2024-03-23T23:42:16.125 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.126+0000 7f83fde00640 1 -- 172.21.15.196:0/3972692254 learned_addr learned my addr 172.21.15.196:0/3972692254 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-23T23:42:16.125 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.126+0000 7f83fd400640 1 --2- 172.21.15.196:0/3972692254 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8400159860 0x7f84000714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:16.125 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.126+0000 7f83fe800640 1 --2- 172.21.15.196:0/3972692254 >> v2:172.21.15.8:3300/0 conn(0x7f84000c2390 0x7f84000c2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:16.125 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.126+0000 7f83fca00640 1 -- 172.21.15.196:0/3972692254 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725375279 0 0) 0x7f8400159dd0 con 0x7f8400152ff0 2024-03-23T23:42:16.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.126+0000 7f83fca00640 1 -- 172.21.15.196:0/3972692254 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83e4003530 con 0x7f8400152ff0 2024-03-23T23:42:16.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.126+0000 7f83fd400640 1 -- 172.21.15.196:0/3972692254 >> v2:172.21.15.8:3300/0 conn(0x7f84000c2390 msgr2=0x7f84000c2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:16.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.126+0000 7f83fd400640 1 --2- 172.21.15.196:0/3972692254 >> v2:172.21.15.8:3300/0 conn(0x7f84000c2390 0x7f84000c2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:16.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.126+0000 7f83fd400640 1 -- 172.21.15.196:0/3972692254 >> v1:172.21.15.196:6789/0 conn(0x7f8400152ff0 legacy=0x7f840006ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:16.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.126+0000 7f83fd400640 1 -- 172.21.15.196:0/3972692254 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84000707b0 con 0x7f8400159860 2024-03-23T23:42:16.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.126+0000 7f83fd400640 1 --2- 172.21.15.196:0/3972692254 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8400159860 0x7f84000714f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f83ec0097c0 tx=0x7f83ec01c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9901b6f01b7279 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:16.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.130+0000 7f83fca00640 1 -- 172.21.15.196:0/3972692254 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec0b0070 con 0x7f8400159860 2024-03-23T23:42:16.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.130+0000 7f83fca00640 1 -- 172.21.15.196:0/3972692254 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ec0ab600 con 0x7f8400159860 2024-03-23T23:42:16.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.130+0000 7f83fca00640 1 -- 172.21.15.196:0/3972692254 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec0ab9d0 con 0x7f8400159860 2024-03-23T23:42:16.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.130+0000 7f8404e00640 1 -- 172.21.15.196:0/3972692254 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8400159860 msgr2=0x7f84000714f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:16.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.130+0000 7f8404e00640 1 --2- 172.21.15.196:0/3972692254 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8400159860 0x7f84000714f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f83ec0097c0 tx=0x7f83ec01c410 comp rx=0 tx=0).stop 2024-03-23T23:42:16.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.130+0000 7f8404e00640 1 -- 172.21.15.196:0/3972692254 shutdown_connections 2024-03-23T23:42:16.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.130+0000 7f8404e00640 1 --2- 172.21.15.196:0/3972692254 >> v2:172.21.15.8:3300/0 conn(0x7f84000c2390 0x7f84000c2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:16.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.130+0000 7f8404e00640 1 --2- 172.21.15.196:0/3972692254 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8400159860 0x7f84000714f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:16.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.130+0000 7f8404e00640 1 -- 172.21.15.196:0/3972692254 >> 172.21.15.196:0/3972692254 conn(0x7f84000aad10 msgr2=0x7f84000ab120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:16.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.130+0000 7f8404e00640 1 -- 172.21.15.196:0/3972692254 shutdown_connections 2024-03-23T23:42:16.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.130+0000 7f8404e00640 1 -- 172.21.15.196:0/3972692254 wait complete. 2024-03-23T23:42:16.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.130+0000 7f8404e00640 1 Processor -- start 2024-03-23T23:42:16.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.130+0000 7f8404e00640 1 -- start start 2024-03-23T23:42:16.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.130+0000 7f8404e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84000c2390 0x7f840014b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:16.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.130+0000 7f8404e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8400152ff0 0x7f840006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:16.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.130+0000 7f8404e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8400159860 0x7f840014cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:16.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.130+0000 7f8404e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84000c75a0 con 0x7f8400152ff0 2024-03-23T23:42:16.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.130+0000 7f8404e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84000c7420 con 0x7f84000c2390 2024-03-23T23:42:16.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.130+0000 7f8404e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8400162a00 con 0x7f8400159860 2024-03-23T23:42:16.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.130+0000 7f83fde00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84000c2390 0x7f840014b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:16.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.130+0000 7f83fe800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8400159860 0x7f840014cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:16.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.130+0000 7f83fe800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8400159860 0x7f840014cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:36814/0 (socket says 172.21.15.196:36814) 2024-03-23T23:42:16.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.130+0000 7f83fe800640 1 -- 172.21.15.196:0/2788650998 learned_addr learned my addr 172.21.15.196:0/2788650998 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-23T23:42:16.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.130+0000 7f83fde00640 1 --2- 172.21.15.196:0/2788650998 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84000c2390 0x7f840014b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:50076/0 (socket says 172.21.15.196:50076) 2024-03-23T23:42:16.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.130+0000 7f83fd400640 1 --2- 172.21.15.196:0/2788650998 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8400152ff0 0x7f840006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:16.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.134+0000 7f83fe800640 1 -- 172.21.15.196:0/2788650998 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84000c2390 msgr2=0x7f840014b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:16.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.134+0000 7f83fe800640 1 --2- 172.21.15.196:0/2788650998 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84000c2390 0x7f840014b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:16.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.134+0000 7f83fe800640 1 -- 172.21.15.196:0/2788650998 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8400152ff0 msgr2=0x7f840006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:16.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.134+0000 7f83fe800640 1 --2- 172.21.15.196:0/2788650998 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8400152ff0 0x7f840006cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:16.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.134+0000 7f83fe800640 1 -- 172.21.15.196:0/2788650998 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8400153900 con 0x7f8400159860 2024-03-23T23:42:16.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.134+0000 7f83fe800640 1 --2- 172.21.15.196:0/2788650998 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8400159860 0x7f840014cd60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f83f800efc0 tx=0x7f83f800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:16.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.134+0000 7f83f6000640 1 -- 172.21.15.196:0/2788650998 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f8018020 con 0x7f8400159860 2024-03-23T23:42:16.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.134+0000 7f83f6000640 1 -- 172.21.15.196:0/2788650998 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f8014480 con 0x7f8400159860 2024-03-23T23:42:16.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.134+0000 7f8404e00640 1 -- 172.21.15.196:0/2788650998 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f840014de80 con 0x7f8400159860 2024-03-23T23:42:16.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.134+0000 7f83f6000640 1 -- 172.21.15.196:0/2788650998 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f8014870 con 0x7f8400159860 2024-03-23T23:42:16.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.134+0000 7f8404e00640 1 -- 172.21.15.196:0/2788650998 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f840006c240 con 0x7f8400159860 2024-03-23T23:42:16.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.134+0000 7f83f6000640 1 -- 172.21.15.196:0/2788650998 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f83f801b020 con 0x7f8400159860 2024-03-23T23:42:16.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.134+0000 7f83f6000640 1 -- 172.21.15.196:0/2788650998 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f83f8013790 con 0x7f8400159860 2024-03-23T23:42:16.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.134+0000 7f8404e00640 1 -- 172.21.15.196:0/2788650998 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f840004f410 con 0x7f8400159860 2024-03-23T23:42:16.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.138+0000 7f83f6000640 1 -- 172.21.15.196:0/2788650998 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f83f8022070 con 0x7f8400159860 2024-03-23T23:42:16.166 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-23T23:42:16.166+0000 7fb72b62d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-23T23:42:16.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.206+0000 7f8404e00640 1 -- 172.21.15.196:0/2788650998 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c8e33701-7acd-4474-8402-d52461171fd0", "id": 1} v 0) v1 -- 0x7f84000c8d40 con 0x7f8400159860 2024-03-23T23:42:16.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.210+0000 7f83f6000640 1 -- 172.21.15.196:0/2788650998 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c8e33701-7acd-4474-8402-d52461171fd0", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f83f8010040 con 0x7f8400159860 2024-03-23T23:42:16.208 INFO:teuthology.orchestra.run.smithi196.stdout:1 2024-03-23T23:42:16.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.210+0000 7f8404e00640 1 -- 172.21.15.196:0/2788650998 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8400159860 msgr2=0x7f840014cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:16.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.210+0000 7f8404e00640 1 --2- 172.21.15.196:0/2788650998 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8400159860 0x7f840014cd60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f83f800efc0 tx=0x7f83f800c490 comp rx=0 tx=0).stop 2024-03-23T23:42:16.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.210+0000 7f8404e00640 1 -- 172.21.15.196:0/2788650998 shutdown_connections 2024-03-23T23:42:16.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.210+0000 7f8404e00640 1 --2- 172.21.15.196:0/2788650998 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8400159860 0x7f840014cd60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:16.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.210+0000 7f8404e00640 1 --2- 172.21.15.196:0/2788650998 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8400152ff0 0x7f840006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:16.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.210+0000 7f8404e00640 1 --2- 172.21.15.196:0/2788650998 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84000c2390 0x7f840014b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:16.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.210+0000 7f8404e00640 1 -- 172.21.15.196:0/2788650998 >> 172.21.15.196:0/2788650998 conn(0x7f84000aad10 msgr2=0x7f840015f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:16.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.210+0000 7f8404e00640 1 -- 172.21.15.196:0/2788650998 shutdown_connections 2024-03-23T23:42:16.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.210+0000 7f8404e00640 1 -- 172.21.15.196:0/2788650998 wait complete. 2024-03-23T23:42:16.227 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new ceebdbf7-4c2f-4757-b52d-fd8b20e77570 2 2024-03-23T23:42:16.270 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-03-23T23:42:16.269+0000 7f58a06db180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-23T23:42:16.362 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.362+0000 7ff9e1400640 1 Processor -- start 2024-03-23T23:42:16.363 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.362+0000 7ff9e1400640 1 -- start start 2024-03-23T23:42:16.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.362+0000 7ff9e1400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9dc14f550 0x7ff9dc152590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:16.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.362+0000 7ff9e1400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9dc071a90 con 0x7ff9dc06e680 2024-03-23T23:42:16.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.362+0000 7ff9e1400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9dc0c2320 con 0x7ff9dc06b730 2024-03-23T23:42:16.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.362+0000 7ff9e1400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc152ad0 con 0x7ff9dc14f550 2024-03-23T23:42:16.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.362+0000 7ff9d3400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9dc14f550 0x7ff9dc152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:16.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.366+0000 7ff9e0a00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7ff9dc06b730 0x7ff9dc06bb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:39018/0 (socket says 172.21.15.196:39018) 2024-03-23T23:42:16.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.366+0000 7ff9e0a00640 1 -- 172.21.15.196:0/1083446576 learned_addr learned my addr 172.21.15.196:0/1083446576 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-23T23:42:16.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.366+0000 7ff9d3400640 1 -- 172.21.15.196:0/1083446576 >> v1:172.21.15.196:6789/0 conn(0x7ff9dc06b730 legacy=0x7ff9dc06bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:16.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.366+0000 7ff9d3400640 1 -- 172.21.15.196:0/1083446576 >> v1:172.21.15.8:6789/0 conn(0x7ff9dc06e680 legacy=0x7ff9dc14ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:16.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.366+0000 7ff9db400640 1 -- 172.21.15.196:0/1083446576 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 284731705 0 0) 0x7ff9dc0c2320 con 0x7ff9dc06b730 2024-03-23T23:42:16.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.366+0000 7ff9d3400640 1 -- 172.21.15.196:0/1083446576 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9dc0c2600 con 0x7ff9dc14f550 2024-03-23T23:42:16.367 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.366+0000 7ff9d3400640 1 --2- 172.21.15.196:0/1083446576 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9dc14f550 0x7ff9dc152590 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400a990 tx=0x7ff9c401d390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14cf6aad278bb401 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:16.368 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.366+0000 7ff9db400640 1 -- 172.21.15.196:0/1083446576 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c40b2070 con 0x7ff9dc14f550 2024-03-23T23:42:16.368 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.366+0000 7ff9db400640 1 -- 172.21.15.196:0/1083446576 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c40a58d0 con 0x7ff9dc14f550 2024-03-23T23:42:16.368 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.366+0000 7ff9db400640 1 -- 172.21.15.196:0/1083446576 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c400b040 con 0x7ff9dc14f550 2024-03-23T23:42:16.369 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.370+0000 7ff9e1400640 1 -- 172.21.15.196:0/1083446576 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9dc14f550 msgr2=0x7ff9dc152590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:16.369 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.370+0000 7ff9e1400640 1 --2- 172.21.15.196:0/1083446576 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9dc14f550 0x7ff9dc152590 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400a990 tx=0x7ff9c401d390 comp rx=0 tx=0).stop 2024-03-23T23:42:16.369 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.370+0000 7ff9e1400640 1 -- 172.21.15.196:0/1083446576 shutdown_connections 2024-03-23T23:42:16.369 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.370+0000 7ff9e1400640 1 --2- 172.21.15.196:0/1083446576 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9dc14f550 0x7ff9dc152590 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:16.369 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.370+0000 7ff9e1400640 1 -- 172.21.15.196:0/1083446576 >> 172.21.15.196:0/1083446576 conn(0x7ff9dc0c76d0 msgr2=0x7ff9dc0c7ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:16.369 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.370+0000 7ff9e1400640 1 -- 172.21.15.196:0/1083446576 shutdown_connections 2024-03-23T23:42:16.369 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.370+0000 7ff9e1400640 1 -- 172.21.15.196:0/1083446576 wait complete. 2024-03-23T23:42:16.370 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.370+0000 7ff9e1400640 1 Processor -- start 2024-03-23T23:42:16.370 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.370+0000 7ff9e1400640 1 -- start start 2024-03-23T23:42:16.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.370+0000 7ff9e1400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9dc06b730 0x7ff9dc0a75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:16.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.370+0000 7ff9e1400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9dc06e680 0x7ff9dc0c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:16.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.370+0000 7ff9e1400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9dc14f550 0x7ff9dc0c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:16.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.370+0000 7ff9e1400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc074800 con 0x7ff9dc14f550 2024-03-23T23:42:16.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.370+0000 7ff9e1400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc06ecb0 con 0x7ff9dc06b730 2024-03-23T23:42:16.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.370+0000 7ff9e1400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc074980 con 0x7ff9dc06e680 2024-03-23T23:42:16.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.370+0000 7ff9d3400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9dc06e680 0x7ff9dc0c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:16.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.370+0000 7ff9dbe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9dc06b730 0x7ff9dc0a75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:16.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.370+0000 7ff9d3400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9dc06e680 0x7ff9dc0c6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:36824/0 (socket says 172.21.15.196:36824) 2024-03-23T23:42:16.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.370+0000 7ff9d3400640 1 -- 172.21.15.196:0/3496908492 learned_addr learned my addr 172.21.15.196:0/3496908492 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-23T23:42:16.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.370+0000 7ff9e0a00640 1 --2- 172.21.15.196:0/3496908492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9dc14f550 0x7ff9dc0c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:16.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.370+0000 7ff9d3400640 1 -- 172.21.15.196:0/3496908492 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9dc06b730 msgr2=0x7ff9dc0a75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:16.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.370+0000 7ff9d3400640 1 --2- 172.21.15.196:0/3496908492 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9dc06b730 0x7ff9dc0a75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:16.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.370+0000 7ff9d3400640 1 -- 172.21.15.196:0/3496908492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9dc14f550 msgr2=0x7ff9dc0c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:16.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.370+0000 7ff9d3400640 1 --2- 172.21.15.196:0/3496908492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9dc14f550 0x7ff9dc0c65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:16.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.370+0000 7ff9d3400640 1 -- 172.21.15.196:0/3496908492 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9dc147820 con 0x7ff9dc06e680 2024-03-23T23:42:16.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.370+0000 7ff9dbe00640 1 --2- 172.21.15.196:0/3496908492 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9dc06b730 0x7ff9dc0a75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:42:16.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.374+0000 7ff9d3400640 1 --2- 172.21.15.196:0/3496908492 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9dc06e680 0x7ff9dc0c6070 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400a990 tx=0x7ff9c401a450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:16.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.374+0000 7ff9d8c00640 1 -- 172.21.15.196:0/3496908492 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c40ba020 con 0x7ff9dc06e680 2024-03-23T23:42:16.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.374+0000 7ff9d8c00640 1 -- 172.21.15.196:0/3496908492 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c40ad660 con 0x7ff9dc06e680 2024-03-23T23:42:16.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.374+0000 7ff9e1400640 1 -- 172.21.15.196:0/3496908492 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9dc147580 con 0x7ff9dc06e680 2024-03-23T23:42:16.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.374+0000 7ff9d8c00640 1 -- 172.21.15.196:0/3496908492 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c40b2040 con 0x7ff9dc06e680 2024-03-23T23:42:16.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.374+0000 7ff9e1400640 1 -- 172.21.15.196:0/3496908492 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9dc0a9fd0 con 0x7ff9dc06e680 2024-03-23T23:42:16.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.374+0000 7ff9d8c00640 1 -- 172.21.15.196:0/3496908492 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7ff9c40bd020 con 0x7ff9dc06e680 2024-03-23T23:42:16.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.374+0000 7ff9d8c00640 1 -- 172.21.15.196:0/3496908492 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7ff9c40b63f0 con 0x7ff9dc06e680 2024-03-23T23:42:16.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.374+0000 7ff9e1400640 1 -- 172.21.15.196:0/3496908492 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9dc06cb90 con 0x7ff9dc06e680 2024-03-23T23:42:16.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.378+0000 7ff9d8c00640 1 -- 172.21.15.196:0/3496908492 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7ff9c40c4030 con 0x7ff9dc06e680 2024-03-23T23:42:16.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.442+0000 7ff9e1400640 1 -- 172.21.15.196:0/3496908492 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ceebdbf7-4c2f-4757-b52d-fd8b20e77570", "id": 2} v 0) v1 -- 0x7ff9dc075800 con 0x7ff9dc06e680 2024-03-23T23:42:16.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.450+0000 7ff9d8c00640 1 -- 172.21.15.196:0/3496908492 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ceebdbf7-4c2f-4757-b52d-fd8b20e77570", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff9c40173c0 con 0x7ff9dc06e680 2024-03-23T23:42:16.448 INFO:teuthology.orchestra.run.smithi196.stdout:2 2024-03-23T23:42:16.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.450+0000 7ff9e1400640 1 -- 172.21.15.196:0/3496908492 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9dc06e680 msgr2=0x7ff9dc0c6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:16.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.450+0000 7ff9e1400640 1 --2- 172.21.15.196:0/3496908492 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9dc06e680 0x7ff9dc0c6070 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400a990 tx=0x7ff9c401a450 comp rx=0 tx=0).stop 2024-03-23T23:42:16.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.450+0000 7ff9e1400640 1 -- 172.21.15.196:0/3496908492 shutdown_connections 2024-03-23T23:42:16.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.450+0000 7ff9e1400640 1 --2- 172.21.15.196:0/3496908492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9dc14f550 0x7ff9dc0c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:16.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.450+0000 7ff9e1400640 1 --2- 172.21.15.196:0/3496908492 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9dc06e680 0x7ff9dc0c6070 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:16.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.450+0000 7ff9e1400640 1 --2- 172.21.15.196:0/3496908492 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9dc06b730 0x7ff9dc0a75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:16.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.450+0000 7ff9e1400640 1 -- 172.21.15.196:0/3496908492 >> 172.21.15.196:0/3496908492 conn(0x7ff9dc0c76d0 msgr2=0x7ff9dc151380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:16.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.450+0000 7ff9e1400640 1 -- 172.21.15.196:0/3496908492 shutdown_connections 2024-03-23T23:42:16.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.450+0000 7ff9e1400640 1 -- 172.21.15.196:0/3496908492 wait complete. 2024-03-23T23:42:16.467 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 89e258da-5767-429e-8441-edf877d2f3cc 3 2024-03-23T23:42:16.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.602+0000 7f736be00640 1 Processor -- start 2024-03-23T23:42:16.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.602+0000 7f736be00640 1 -- start start 2024-03-23T23:42:16.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.606+0000 7f736be00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f73640c4fb0 0x7f73641542c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:16.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.606+0000 7f736be00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f73640c86b0 0x7f73640ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:16.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.606+0000 7f736be00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73640c5770 con 0x7f7364151000 2024-03-23T23:42:16.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.606+0000 7f736be00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73640c84a0 con 0x7f73640c86b0 2024-03-23T23:42:16.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.606+0000 7f736be00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73640c46a0 con 0x7f73640c4fb0 2024-03-23T23:42:16.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.606+0000 7f7368a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f73640c4fb0 0x7f73641542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:16.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.606+0000 7f7368a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f73640c4fb0 0x7f73641542c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:50096/0 (socket says 172.21.15.196:50096) 2024-03-23T23:42:16.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.606+0000 7f7368a00640 1 -- 172.21.15.196:0/3994799168 learned_addr learned my addr 172.21.15.196:0/3994799168 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-23T23:42:16.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.606+0000 7f7369e00640 1 --2- 172.21.15.196:0/3994799168 >> v2:172.21.15.8:3300/0 conn(0x7f73640c86b0 0x7f73640ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:16.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.606+0000 7f7368a00640 1 -- 172.21.15.196:0/3994799168 >> v2:172.21.15.8:3300/0 conn(0x7f73640c86b0 msgr2=0x7f73640ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:16.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.606+0000 7f7368a00640 1 --2- 172.21.15.196:0/3994799168 >> v2:172.21.15.8:3300/0 conn(0x7f73640c86b0 0x7f73640ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:16.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.606+0000 7f7368a00640 1 -- 172.21.15.196:0/3994799168 >> v1:172.21.15.8:6789/0 conn(0x7f7364151000 legacy=0x7f73640c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:16.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.606+0000 7f7368a00640 1 -- 172.21.15.196:0/3994799168 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73640c5490 con 0x7f73640c4fb0 2024-03-23T23:42:16.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.610+0000 7f7368a00640 1 --2- 172.21.15.196:0/3994799168 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73640c4fb0 0x7f73641542c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f73640ae680 tx=0x7f735001c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=605235f469611f93 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:16.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.610+0000 7f7363e00640 1 -- 172.21.15.196:0/3994799168 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73500b1070 con 0x7f73640c4fb0 2024-03-23T23:42:16.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.610+0000 7f7363e00640 1 -- 172.21.15.196:0/3994799168 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73500ac630 con 0x7f73640c4fb0 2024-03-23T23:42:16.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.610+0000 7f7363e00640 1 -- 172.21.15.196:0/3994799168 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73500a8050 con 0x7f73640c4fb0 2024-03-23T23:42:16.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.610+0000 7f736be00640 1 -- 172.21.15.196:0/3994799168 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73640c4fb0 msgr2=0x7f73641542c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:16.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.610+0000 7f736be00640 1 --2- 172.21.15.196:0/3994799168 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73640c4fb0 0x7f73641542c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f73640ae680 tx=0x7f735001c3d0 comp rx=0 tx=0).stop 2024-03-23T23:42:16.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.610+0000 7f736be00640 1 -- 172.21.15.196:0/3994799168 shutdown_connections 2024-03-23T23:42:16.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.610+0000 7f736be00640 1 --2- 172.21.15.196:0/3994799168 >> v2:172.21.15.8:3300/0 conn(0x7f73640c86b0 0x7f73640ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:16.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.610+0000 7f736be00640 1 --2- 172.21.15.196:0/3994799168 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73640c4fb0 0x7f73641542c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:16.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.610+0000 7f736be00640 1 -- 172.21.15.196:0/3994799168 >> 172.21.15.196:0/3994799168 conn(0x7f73640aad10 msgr2=0x7f73640ab120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:16.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.610+0000 7f736be00640 1 -- 172.21.15.196:0/3994799168 shutdown_connections 2024-03-23T23:42:16.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.610+0000 7f736be00640 1 -- 172.21.15.196:0/3994799168 wait complete. 2024-03-23T23:42:16.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.610+0000 7f736be00640 1 Processor -- start 2024-03-23T23:42:16.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.610+0000 7f736be00640 1 -- start start 2024-03-23T23:42:16.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.610+0000 7f736be00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73640c4fb0 0x7f7364151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:16.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.610+0000 7f736be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73640c86b0 0x7f7364145c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:16.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.610+0000 7f736be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7364151000 0x7f7364146170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:16.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.610+0000 7f736be00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73640c3490 con 0x7f7364151000 2024-03-23T23:42:16.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.610+0000 7f736be00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73640c7570 con 0x7f73640c4fb0 2024-03-23T23:42:16.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.610+0000 7f736be00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73640c3610 con 0x7f73640c86b0 2024-03-23T23:42:16.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.610+0000 7f7368a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73640c86b0 0x7f7364145c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:16.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.610+0000 7f7369400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73640c4fb0 0x7f7364151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:16.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.610+0000 7f7368a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73640c86b0 0x7f7364145c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:36836/0 (socket says 172.21.15.196:36836) 2024-03-23T23:42:16.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.610+0000 7f7368a00640 1 -- 172.21.15.196:0/2902121254 learned_addr learned my addr 172.21.15.196:0/2902121254 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-23T23:42:16.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.610+0000 7f7369e00640 1 --2- 172.21.15.196:0/2902121254 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7364151000 0x7f7364146170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:16.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.614+0000 7f7368a00640 1 -- 172.21.15.196:0/2902121254 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73640c4fb0 msgr2=0x7f7364151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:16.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.614+0000 7f7368a00640 1 --2- 172.21.15.196:0/2902121254 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73640c4fb0 0x7f7364151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:16.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.614+0000 7f7368a00640 1 -- 172.21.15.196:0/2902121254 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7364151000 msgr2=0x7f7364146170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:16.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.614+0000 7f7368a00640 1 --2- 172.21.15.196:0/2902121254 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7364151000 0x7f7364146170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:16.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.614+0000 7f7368a00640 1 -- 172.21.15.196:0/2902121254 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73641f0120 con 0x7f73640c86b0 2024-03-23T23:42:16.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.614+0000 7f7369e00640 1 --2- 172.21.15.196:0/2902121254 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7364151000 0x7f7364146170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:42:16.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.614+0000 7f7368a00640 1 --2- 172.21.15.196:0/2902121254 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73640c86b0 0x7f7364145c30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f73500af040 tx=0x7f7350019170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:16.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.614+0000 7f7361600640 1 -- 172.21.15.196:0/2902121254 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73500b1040 con 0x7f73640c86b0 2024-03-23T23:42:16.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.614+0000 7f7361600640 1 -- 172.21.15.196:0/2902121254 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73500b5420 con 0x7f73640c86b0 2024-03-23T23:42:16.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.614+0000 7f7361600640 1 -- 172.21.15.196:0/2902121254 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73500b5810 con 0x7f73640c86b0 2024-03-23T23:42:16.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.614+0000 7f736be00640 1 -- 172.21.15.196:0/2902121254 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73641f0400 con 0x7f73640c86b0 2024-03-23T23:42:16.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.614+0000 7f736be00640 1 -- 172.21.15.196:0/2902121254 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7364151eb0 con 0x7f73640c86b0 2024-03-23T23:42:16.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.614+0000 7f7361600640 1 -- 172.21.15.196:0/2902121254 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f73500ac4f0 con 0x7f73640c86b0 2024-03-23T23:42:16.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.614+0000 7f7361600640 1 -- 172.21.15.196:0/2902121254 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f73500be890 con 0x7f73640c86b0 2024-03-23T23:42:16.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.614+0000 7f736be00640 1 -- 172.21.15.196:0/2902121254 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f736404f410 con 0x7f73640c86b0 2024-03-23T23:42:16.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.618+0000 7f7361600640 1 -- 172.21.15.196:0/2902121254 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f73500c3020 con 0x7f73640c86b0 2024-03-23T23:42:16.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.682+0000 7f736be00640 1 -- 172.21.15.196:0/2902121254 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd new", "uuid": "89e258da-5767-429e-8441-edf877d2f3cc", "id": 3} v 0) v1 -- 0x7f73641454e0 con 0x7f73640c86b0 2024-03-23T23:42:16.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.686+0000 7f7361600640 1 -- 172.21.15.196:0/2902121254 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "89e258da-5767-429e-8441-edf877d2f3cc", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7350016110 con 0x7f73640c86b0 2024-03-23T23:42:16.686 INFO:teuthology.orchestra.run.smithi196.stdout:3 2024-03-23T23:42:16.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.686+0000 7f736be00640 1 -- 172.21.15.196:0/2902121254 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73640c86b0 msgr2=0x7f7364145c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:16.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.686+0000 7f736be00640 1 --2- 172.21.15.196:0/2902121254 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73640c86b0 0x7f7364145c30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f73500af040 tx=0x7f7350019170 comp rx=0 tx=0).stop 2024-03-23T23:42:16.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.686+0000 7f736be00640 1 -- 172.21.15.196:0/2902121254 shutdown_connections 2024-03-23T23:42:16.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.686+0000 7f736be00640 1 --2- 172.21.15.196:0/2902121254 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7364151000 0x7f7364146170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:16.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.686+0000 7f736be00640 1 --2- 172.21.15.196:0/2902121254 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73640c86b0 0x7f7364145c30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:16.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.686+0000 7f736be00640 1 --2- 172.21.15.196:0/2902121254 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73640c4fb0 0x7f7364151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:16.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.686+0000 7f736be00640 1 -- 172.21.15.196:0/2902121254 >> 172.21.15.196:0/2902121254 conn(0x7f73640aad10 msgr2=0x7f7364152900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:16.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.686+0000 7f736be00640 1 -- 172.21.15.196:0/2902121254 shutdown_connections 2024-03-23T23:42:16.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.686+0000 7f736be00640 1 -- 172.21.15.196:0/2902121254 wait complete. 2024-03-23T23:42:16.705 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 2b7451ae-ea16-4f0a-ae50-04fde75e45ea 4 2024-03-23T23:42:16.813 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-23T23:42:16.814+0000 7fb72b62d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-23T23:42:16.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.842+0000 7f11c7400640 1 Processor -- start 2024-03-23T23:42:16.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.842+0000 7f11c7400640 1 -- start start 2024-03-23T23:42:16.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.842+0000 7f11c7400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f11c014d9d0 0x7f11c0154030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:16.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.842+0000 7f11c7400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11c00701d0 0x7f11c015df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:16.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.842+0000 7f11c7400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c00c3700 con 0x7f11c006fd60 2024-03-23T23:42:16.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.842+0000 7f11c7400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c00c4830 con 0x7f11c014d9d0 2024-03-23T23:42:16.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.842+0000 7f11c7400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c0156d40 con 0x7f11c00701d0 2024-03-23T23:42:16.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.842+0000 7f11c4a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f11c014d9d0 0x7f11c0154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:16.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.842+0000 7f11c5400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11c00701d0 0x7f11c015df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:16.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.842+0000 7f11c4a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f11c014d9d0 0x7f11c0154030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:50108/0 (socket says 172.21.15.196:50108) 2024-03-23T23:42:16.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.842+0000 7f11c5400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11c00701d0 0x7f11c015df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:36846/0 (socket says 172.21.15.196:36846) 2024-03-23T23:42:16.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.842+0000 7f11c4a00640 1 -- 172.21.15.196:0/813523041 learned_addr learned my addr 172.21.15.196:0/813523041 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-23T23:42:16.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.842+0000 7f11bfe00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f11c006fd60 0x7f11c01571d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:39026/0 (socket says 172.21.15.196:39026) 2024-03-23T23:42:16.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.842+0000 7f11c4a00640 1 -- 172.21.15.196:0/813523041 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11c00701d0 msgr2=0x7f11c015df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:16.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.842+0000 7f11c4a00640 1 --2- 172.21.15.196:0/813523041 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11c00701d0 0x7f11c015df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:16.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.842+0000 7f11c4a00640 1 -- 172.21.15.196:0/813523041 >> v1:172.21.15.196:6789/0 conn(0x7f11c006fd60 legacy=0x7f11c01571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:16.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.842+0000 7f11c4a00640 1 -- 172.21.15.196:0/813523041 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c0154570 con 0x7f11c014d9d0 2024-03-23T23:42:16.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.842+0000 7f11bf400640 1 -- 172.21.15.196:0/813523041 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3446027427 0 0) 0x7f11c00c3700 con 0x7f11c006fd60 2024-03-23T23:42:16.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.846+0000 7f11c4a00640 1 --2- 172.21.15.196:0/813523041 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11c014d9d0 0x7f11c0154030 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f11b4009870 tx=0x7f11b401c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f2d8ba651a30073 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:16.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.846+0000 7f11bf400640 1 -- 172.21.15.196:0/813523041 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b40b0070 con 0x7f11c014d9d0 2024-03-23T23:42:16.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.846+0000 7f11bf400640 1 -- 172.21.15.196:0/813523041 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b40ab600 con 0x7f11c014d9d0 2024-03-23T23:42:16.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.846+0000 7f11bf400640 1 -- 172.21.15.196:0/813523041 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b40ab9d0 con 0x7f11c014d9d0 2024-03-23T23:42:16.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.846+0000 7f11c7400640 1 -- 172.21.15.196:0/813523041 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11c014d9d0 msgr2=0x7f11c0154030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:16.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.846+0000 7f11c7400640 1 --2- 172.21.15.196:0/813523041 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11c014d9d0 0x7f11c0154030 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f11b4009870 tx=0x7f11b401c440 comp rx=0 tx=0).stop 2024-03-23T23:42:16.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.846+0000 7f11c7400640 1 -- 172.21.15.196:0/813523041 shutdown_connections 2024-03-23T23:42:16.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.846+0000 7f11c7400640 1 --2- 172.21.15.196:0/813523041 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11c00701d0 0x7f11c015df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:16.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.846+0000 7f11c7400640 1 --2- 172.21.15.196:0/813523041 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11c014d9d0 0x7f11c0154030 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:16.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.846+0000 7f11c7400640 1 -- 172.21.15.196:0/813523041 >> 172.21.15.196:0/813523041 conn(0x7f11c00c4a70 msgr2=0x7f11c00c4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:16.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.846+0000 7f11c7400640 1 -- 172.21.15.196:0/813523041 shutdown_connections 2024-03-23T23:42:16.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.846+0000 7f11c7400640 1 -- 172.21.15.196:0/813523041 wait complete. 2024-03-23T23:42:16.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.850+0000 7f11c7400640 1 Processor -- start 2024-03-23T23:42:16.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.850+0000 7f11c7400640 1 -- start start 2024-03-23T23:42:16.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.850+0000 7f11c7400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11c006fd60 0x7f11c00c7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:16.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.850+0000 7f11c7400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11c00701d0 0x7f11c006eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:16.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.850+0000 7f11c7400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11c014d9d0 0x7f11c0147230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:16.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.850+0000 7f11c7400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c00a95f0 con 0x7f11c006fd60 2024-03-23T23:42:16.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.850+0000 7f11c7400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c00a9470 con 0x7f11c00701d0 2024-03-23T23:42:16.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.850+0000 7f11c7400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c00c3b60 con 0x7f11c014d9d0 2024-03-23T23:42:16.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.850+0000 7f11bfe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11c00701d0 0x7f11c006eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:16.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.850+0000 7f11c5400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11c014d9d0 0x7f11c0147230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:16.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.850+0000 7f11bfe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11c00701d0 0x7f11c006eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:50122/0 (socket says 172.21.15.196:50122) 2024-03-23T23:42:16.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.850+0000 7f11bfe00640 1 -- 172.21.15.196:0/4191533756 learned_addr learned my addr 172.21.15.196:0/4191533756 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-23T23:42:16.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.850+0000 7f11c4a00640 1 --2- 172.21.15.196:0/4191533756 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11c006fd60 0x7f11c00c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:16.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.850+0000 7f11c5400640 1 -- 172.21.15.196:0/4191533756 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11c00701d0 msgr2=0x7f11c006eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:16.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.850+0000 7f11c5400640 1 --2- 172.21.15.196:0/4191533756 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11c00701d0 0x7f11c006eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:16.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.850+0000 7f11c5400640 1 -- 172.21.15.196:0/4191533756 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11c006fd60 msgr2=0x7f11c00c7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:16.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.850+0000 7f11c5400640 1 --2- 172.21.15.196:0/4191533756 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11c006fd60 0x7f11c00c7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:16.852 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.850+0000 7f11c5400640 1 -- 172.21.15.196:0/4191533756 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c006dfe0 con 0x7f11c014d9d0 2024-03-23T23:42:16.852 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.850+0000 7f11c5400640 1 --2- 172.21.15.196:0/4191533756 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11c014d9d0 0x7f11c0147230 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f11b800efc0 tx=0x7f11b800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:16.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.850+0000 7f11bcc00640 1 -- 172.21.15.196:0/4191533756 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b8018020 con 0x7f11c014d9d0 2024-03-23T23:42:16.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.850+0000 7f11bcc00640 1 -- 172.21.15.196:0/4191533756 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b8014480 con 0x7f11c014d9d0 2024-03-23T23:42:16.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.850+0000 7f11bcc00640 1 -- 172.21.15.196:0/4191533756 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b8014870 con 0x7f11c014d9d0 2024-03-23T23:42:16.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.850+0000 7f11c7400640 1 -- 172.21.15.196:0/4191533756 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c006e2c0 con 0x7f11c014d9d0 2024-03-23T23:42:16.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.850+0000 7f11c7400640 1 -- 172.21.15.196:0/4191533756 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c006e880 con 0x7f11c014d9d0 2024-03-23T23:42:16.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.850+0000 7f11bcc00640 1 -- 172.21.15.196:0/4191533756 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f11b801b020 con 0x7f11c014d9d0 2024-03-23T23:42:16.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.850+0000 7f11bcc00640 1 -- 172.21.15.196:0/4191533756 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f11b8014da0 con 0x7f11c014d9d0 2024-03-23T23:42:16.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.854+0000 7f11c7400640 1 -- 172.21.15.196:0/4191533756 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c004f410 con 0x7f11c014d9d0 2024-03-23T23:42:16.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.854+0000 7f11bcc00640 1 -- 172.21.15.196:0/4191533756 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f11b8022030 con 0x7f11c014d9d0 2024-03-23T23:42:16.879 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-23T23:42:16.878+0000 7fb72b62d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-23T23:42:16.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.922+0000 7f11c7400640 1 -- 172.21.15.196:0/4191533756 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2b7451ae-ea16-4f0a-ae50-04fde75e45ea", "id": 4} v 0) v1 -- 0x7f11c00aabc0 con 0x7f11c014d9d0 2024-03-23T23:42:16.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.926+0000 7f11bcc00640 1 -- 172.21.15.196:0/4191533756 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2b7451ae-ea16-4f0a-ae50-04fde75e45ea", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f11b8010040 con 0x7f11c014d9d0 2024-03-23T23:42:16.925 INFO:teuthology.orchestra.run.smithi196.stdout:4 2024-03-23T23:42:16.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.926+0000 7f11c7400640 1 -- 172.21.15.196:0/4191533756 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11c014d9d0 msgr2=0x7f11c0147230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:16.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.926+0000 7f11c7400640 1 --2- 172.21.15.196:0/4191533756 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11c014d9d0 0x7f11c0147230 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f11b800efc0 tx=0x7f11b800c490 comp rx=0 tx=0).stop 2024-03-23T23:42:16.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.926+0000 7f11c7400640 1 -- 172.21.15.196:0/4191533756 shutdown_connections 2024-03-23T23:42:16.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.926+0000 7f11c7400640 1 --2- 172.21.15.196:0/4191533756 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11c014d9d0 0x7f11c0147230 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:16.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.926+0000 7f11c7400640 1 --2- 172.21.15.196:0/4191533756 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11c00701d0 0x7f11c006eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:16.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.926+0000 7f11c7400640 1 --2- 172.21.15.196:0/4191533756 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11c006fd60 0x7f11c00c7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:16.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.926+0000 7f11c7400640 1 -- 172.21.15.196:0/4191533756 >> 172.21.15.196:0/4191533756 conn(0x7f11c00c4a70 msgr2=0x7f11c00a9770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:16.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.926+0000 7f11c7400640 1 -- 172.21.15.196:0/4191533756 shutdown_connections 2024-03-23T23:42:16.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:16.926+0000 7f11c7400640 1 -- 172.21.15.196:0/4191533756 wait complete. 2024-03-23T23:42:16.942 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-23T23:42:16.942+0000 7fb72b62d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-23T23:42:16.944 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new e68a8914-e591-466a-bc9e-f2d7c67aac13 5 2024-03-23T23:42:17.017 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-03-23T23:42:17.017+0000 7f58a06db180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-23T23:42:17.033 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-23T23:42:17.034+0000 7fb72b62d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-23T23:42:17.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.078+0000 7fa3a4c00640 1 Processor -- start 2024-03-23T23:42:17.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.078+0000 7fa3a4c00640 1 -- start start 2024-03-23T23:42:17.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.082+0000 7fa3a4c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa3a0151000 0x7fa3a01542c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:17.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.082+0000 7fa3a4c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa3a00c86b0 0x7fa3a00ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:17.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.082+0000 7fa3a4c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a00c5770 con 0x7fa3a00c4fb0 2024-03-23T23:42:17.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.082+0000 7fa3a4c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a00c84a0 con 0x7fa3a0151000 2024-03-23T23:42:17.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.082+0000 7fa3a4c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a00c46a0 con 0x7fa3a00c86b0 2024-03-23T23:42:17.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.082+0000 7fa39e800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa3a00c86b0 0x7fa3a00ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:17.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.082+0000 7fa39de00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa3a0151000 0x7fa3a01542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:17.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.082+0000 7fa39e800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa3a00c86b0 0x7fa3a00ae8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:36866/0 (socket says 172.21.15.196:36866) 2024-03-23T23:42:17.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.082+0000 7fa397e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fa3a00c4fb0 0x7fa3a00c6e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:39042/0 (socket says 172.21.15.196:39042) 2024-03-23T23:42:17.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.082+0000 7fa39e800640 1 -- 172.21.15.196:0/1157491563 learned_addr learned my addr 172.21.15.196:0/1157491563 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-23T23:42:17.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.082+0000 7fa39e800640 1 -- 172.21.15.196:0/1157491563 >> v2:172.21.15.196:3300/0 conn(0x7fa3a0151000 msgr2=0x7fa3a01542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:17.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.082+0000 7fa39e800640 1 --2- 172.21.15.196:0/1157491563 >> v2:172.21.15.196:3300/0 conn(0x7fa3a0151000 0x7fa3a01542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.082+0000 7fa39e800640 1 -- 172.21.15.196:0/1157491563 >> v1:172.21.15.196:6789/0 conn(0x7fa3a00c4fb0 legacy=0x7fa3a00c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:17.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.082+0000 7fa39e800640 1 -- 172.21.15.196:0/1157491563 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a00c5490 con 0x7fa3a00c86b0 2024-03-23T23:42:17.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.082+0000 7fa39de00640 1 --2- 172.21.15.196:0/1157491563 >> v2:172.21.15.196:3300/0 conn(0x7fa3a0151000 0x7fa3a01542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:42:17.083 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-03-23T23:42:17.081+0000 7f58a06db180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-23T23:42:17.084 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.086+0000 7fa39e800640 1 --2- 172.21.15.196:0/1157491563 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa3a00c86b0 0x7fa3a00ae8c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa398009e50 tx=0x7fa39801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c49f521e5d39d46 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:17.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.086+0000 7fa39d400640 1 -- 172.21.15.196:0/1157491563 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3980a5830 con 0x7fa3a00c86b0 2024-03-23T23:42:17.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.086+0000 7fa39d400640 1 -- 172.21.15.196:0/1157491563 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3980a59d0 con 0x7fa3a00c86b0 2024-03-23T23:42:17.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.086+0000 7fa39d400640 1 -- 172.21.15.196:0/1157491563 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3980a5da0 con 0x7fa3a00c86b0 2024-03-23T23:42:17.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.086+0000 7fa3a4c00640 1 -- 172.21.15.196:0/1157491563 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa3a00c86b0 msgr2=0x7fa3a00ae8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:17.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.086+0000 7fa3a4c00640 1 --2- 172.21.15.196:0/1157491563 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa3a00c86b0 0x7fa3a00ae8c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa398009e50 tx=0x7fa39801c970 comp rx=0 tx=0).stop 2024-03-23T23:42:17.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.086+0000 7fa3a4c00640 1 -- 172.21.15.196:0/1157491563 shutdown_connections 2024-03-23T23:42:17.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.086+0000 7fa3a4c00640 1 --2- 172.21.15.196:0/1157491563 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa3a00c86b0 0x7fa3a00ae8c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.086+0000 7fa3a4c00640 1 --2- 172.21.15.196:0/1157491563 >> v2:172.21.15.196:3300/0 conn(0x7fa3a0151000 0x7fa3a01542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.086+0000 7fa3a4c00640 1 -- 172.21.15.196:0/1157491563 >> 172.21.15.196:0/1157491563 conn(0x7fa3a00aad10 msgr2=0x7fa3a00ab120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:17.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.086+0000 7fa3a4c00640 1 -- 172.21.15.196:0/1157491563 shutdown_connections 2024-03-23T23:42:17.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.086+0000 7fa3a4c00640 1 -- 172.21.15.196:0/1157491563 wait complete. 2024-03-23T23:42:17.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.086+0000 7fa3a4c00640 1 Processor -- start 2024-03-23T23:42:17.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.086+0000 7fa3a4c00640 1 -- start start 2024-03-23T23:42:17.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.090+0000 7fa3a4c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa3a00c4fb0 0x7fa3a00ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:17.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.090+0000 7fa3a4c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa3a00c86b0 0x7fa3a01efbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:17.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.090+0000 7fa3a4c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3a0151000 0x7fa3a00adca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:17.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.090+0000 7fa3a4c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a00c3490 con 0x7fa3a0151000 2024-03-23T23:42:17.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.090+0000 7fa3a4c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a00c7570 con 0x7fa3a00c86b0 2024-03-23T23:42:17.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.090+0000 7fa3a4c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a00c3610 con 0x7fa3a00c4fb0 2024-03-23T23:42:17.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.090+0000 7fa397e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa3a00c86b0 0x7fa3a01efbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:17.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.090+0000 7fa39de00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa3a00c4fb0 0x7fa3a00ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:17.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.090+0000 7fa397e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa3a00c86b0 0x7fa3a01efbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:50136/0 (socket says 172.21.15.196:50136) 2024-03-23T23:42:17.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.090+0000 7fa397e00640 1 -- 172.21.15.196:0/4005090663 learned_addr learned my addr 172.21.15.196:0/4005090663 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-23T23:42:17.091 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.090+0000 7fa39e800640 1 --2- 172.21.15.196:0/4005090663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3a0151000 0x7fa3a00adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:17.091 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.090+0000 7fa397e00640 1 -- 172.21.15.196:0/4005090663 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa3a00c4fb0 msgr2=0x7fa3a00ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:17.091 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.090+0000 7fa397e00640 1 --2- 172.21.15.196:0/4005090663 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa3a00c4fb0 0x7fa3a00ad0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.091 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.090+0000 7fa397e00640 1 -- 172.21.15.196:0/4005090663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3a0151000 msgr2=0x7fa3a00adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:17.091 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.090+0000 7fa397e00640 1 --2- 172.21.15.196:0/4005090663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3a0151000 0x7fa3a00adca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.091 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.090+0000 7fa397e00640 1 -- 172.21.15.196:0/4005090663 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a0155480 con 0x7fa3a00c86b0 2024-03-23T23:42:17.091 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.090+0000 7fa39e800640 1 --2- 172.21.15.196:0/4005090663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3a0151000 0x7fa3a00adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:42:17.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.090+0000 7fa39de00640 1 --2- 172.21.15.196:0/4005090663 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa3a00c4fb0 0x7fa3a00ad0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:42:17.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.090+0000 7fa397e00640 1 --2- 172.21.15.196:0/4005090663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa3a00c86b0 0x7fa3a01efbd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa38800c450 tx=0x7fa38800c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:17.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.090+0000 7fa396000640 1 -- 172.21.15.196:0/4005090663 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa388007070 con 0x7fa3a00c86b0 2024-03-23T23:42:17.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.090+0000 7fa396000640 1 -- 172.21.15.196:0/4005090663 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa388019070 con 0x7fa3a00c86b0 2024-03-23T23:42:17.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.090+0000 7fa3a4c00640 1 -- 172.21.15.196:0/4005090663 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a0154ec0 con 0x7fa3a00c86b0 2024-03-23T23:42:17.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.090+0000 7fa396000640 1 -- 172.21.15.196:0/4005090663 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa388007450 con 0x7fa3a00c86b0 2024-03-23T23:42:17.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.090+0000 7fa3a4c00640 1 -- 172.21.15.196:0/4005090663 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a01ebdb0 con 0x7fa3a00c86b0 2024-03-23T23:42:17.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.090+0000 7fa396000640 1 -- 172.21.15.196:0/4005090663 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fa38801b020 con 0x7fa3a00c86b0 2024-03-23T23:42:17.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.090+0000 7fa396000640 1 -- 172.21.15.196:0/4005090663 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fa3880075f0 con 0x7fa3a00c86b0 2024-03-23T23:42:17.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.090+0000 7fa3a4c00640 1 -- 172.21.15.196:0/4005090663 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a004f410 con 0x7fa3a00c86b0 2024-03-23T23:42:17.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.094+0000 7fa396000640 1 -- 172.21.15.196:0/4005090663 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fa38801e420 con 0x7fa3a00c86b0 2024-03-23T23:42:17.098 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-23T23:42:17.098+0000 7fb72b62d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-23T23:42:17.147 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-03-23T23:42:17.145+0000 7f58a06db180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-23T23:42:17.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.158+0000 7fa3a4c00640 1 -- 172.21.15.196:0/4005090663 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e68a8914-e591-466a-bc9e-f2d7c67aac13", "id": 5} v 0) v1 -- 0x7fa3a0151a30 con 0x7fa3a00c86b0 2024-03-23T23:42:17.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.162+0000 7fa396000640 1 -- 172.21.15.196:0/4005090663 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e68a8914-e591-466a-bc9e-f2d7c67aac13", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa388004b80 con 0x7fa3a00c86b0 2024-03-23T23:42:17.164 INFO:teuthology.orchestra.run.smithi196.stdout:5 2024-03-23T23:42:17.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.166+0000 7fa3a4c00640 1 -- 172.21.15.196:0/4005090663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa3a00c86b0 msgr2=0x7fa3a01efbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:17.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.166+0000 7fa3a4c00640 1 --2- 172.21.15.196:0/4005090663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa3a00c86b0 0x7fa3a01efbd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa38800c450 tx=0x7fa38800c910 comp rx=0 tx=0).stop 2024-03-23T23:42:17.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.166+0000 7fa3a4c00640 1 -- 172.21.15.196:0/4005090663 shutdown_connections 2024-03-23T23:42:17.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.166+0000 7fa3a4c00640 1 --2- 172.21.15.196:0/4005090663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3a0151000 0x7fa3a00adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.166+0000 7fa3a4c00640 1 --2- 172.21.15.196:0/4005090663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa3a00c86b0 0x7fa3a01efbd0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.166+0000 7fa3a4c00640 1 --2- 172.21.15.196:0/4005090663 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa3a00c4fb0 0x7fa3a00ad0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.166+0000 7fa3a4c00640 1 -- 172.21.15.196:0/4005090663 >> 172.21.15.196:0/4005090663 conn(0x7fa3a00aad10 msgr2=0x7fa3a0149530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:17.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.166+0000 7fa3a4c00640 1 -- 172.21.15.196:0/4005090663 shutdown_connections 2024-03-23T23:42:17.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.166+0000 7fa3a4c00640 1 -- 172.21.15.196:0/4005090663 wait complete. 2024-03-23T23:42:17.184 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new e47723c5-50a0-4cd8-92d9-01972072b422 6 2024-03-23T23:42:17.191 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-23T23:42:17.190+0000 7fb72b62d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-23T23:42:17.243 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-03-23T23:42:17.241+0000 7f58a06db180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-23T23:42:17.257 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-23T23:42:17.258+0000 7fb72b62d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-23T23:42:17.307 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-03-23T23:42:17.305+0000 7f58a06db180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-23T23:42:17.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.318+0000 7fa860a00640 1 Processor -- start 2024-03-23T23:42:17.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.318+0000 7fa860a00640 1 -- start start 2024-03-23T23:42:17.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.322+0000 7fa860a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa85c152cc0 0x7fa85c0ad880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:17.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.322+0000 7fa860a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa85c0c33a0 0x7fa85c158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:17.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.322+0000 7fa860a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa85c0addc0 0x7fa85c159420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:17.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.322+0000 7fa860a00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa85c0732a0 con 0x7fa85c0addc0 2024-03-23T23:42:17.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.322+0000 7fa860a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa85c06e4f0 con 0x7fa85c152cc0 2024-03-23T23:42:17.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.322+0000 7fa860a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c06e7d0 con 0x7fa85c0c33a0 2024-03-23T23:42:17.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.322+0000 7fa859e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa85c152cc0 0x7fa85c0ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:17.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.322+0000 7fa859400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa85c0c33a0 0x7fa85c158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:17.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.322+0000 7fa859e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa85c152cc0 0x7fa85c0ad880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:50142/0 (socket says 172.21.15.196:50142) 2024-03-23T23:42:17.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.322+0000 7fa859e00640 1 -- 172.21.15.196:0/3377240215 learned_addr learned my addr 172.21.15.196:0/3377240215 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-23T23:42:17.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.322+0000 7fa85a800640 1 --2- 172.21.15.196:0/3377240215 >> v2:172.21.15.8:3300/0 conn(0x7fa85c0addc0 0x7fa85c159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:17.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.322+0000 7fa859e00640 1 -- 172.21.15.196:0/3377240215 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa85c0c33a0 msgr2=0x7fa85c158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:17.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.322+0000 7fa859e00640 1 --2- 172.21.15.196:0/3377240215 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa85c0c33a0 0x7fa85c158ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.322+0000 7fa859e00640 1 -- 172.21.15.196:0/3377240215 >> v2:172.21.15.8:3300/0 conn(0x7fa85c0addc0 msgr2=0x7fa85c159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:17.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.322+0000 7fa859e00640 1 --2- 172.21.15.196:0/3377240215 >> v2:172.21.15.8:3300/0 conn(0x7fa85c0addc0 0x7fa85c159420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.322+0000 7fa859e00640 1 -- 172.21.15.196:0/3377240215 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa85c06eab0 con 0x7fa85c152cc0 2024-03-23T23:42:17.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.322+0000 7fa85a800640 1 --2- 172.21.15.196:0/3377240215 >> v2:172.21.15.8:3300/0 conn(0x7fa85c0addc0 0x7fa85c159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:42:17.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.322+0000 7fa859e00640 1 --2- 172.21.15.196:0/3377240215 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa85c152cc0 0x7fa85c0ad880 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa85c070b40 tx=0x7fa84c01c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2c27d4252545357 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:17.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.322+0000 7fa858a00640 1 -- 172.21.15.196:0/3377240215 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84c0ab620 con 0x7fa85c152cc0 2024-03-23T23:42:17.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.326+0000 7fa858a00640 1 -- 172.21.15.196:0/3377240215 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84c0b0070 con 0x7fa85c152cc0 2024-03-23T23:42:17.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.326+0000 7fa858a00640 1 -- 172.21.15.196:0/3377240215 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84c0ab9e0 con 0x7fa85c152cc0 2024-03-23T23:42:17.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.326+0000 7fa860a00640 1 -- 172.21.15.196:0/3377240215 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa85c152cc0 msgr2=0x7fa85c0ad880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:17.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.326+0000 7fa860a00640 1 --2- 172.21.15.196:0/3377240215 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa85c152cc0 0x7fa85c0ad880 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa85c070b40 tx=0x7fa84c01c460 comp rx=0 tx=0).stop 2024-03-23T23:42:17.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.326+0000 7fa860a00640 1 -- 172.21.15.196:0/3377240215 shutdown_connections 2024-03-23T23:42:17.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.326+0000 7fa860a00640 1 --2- 172.21.15.196:0/3377240215 >> v2:172.21.15.8:3300/0 conn(0x7fa85c0addc0 0x7fa85c159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.326+0000 7fa860a00640 1 --2- 172.21.15.196:0/3377240215 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa85c0c33a0 0x7fa85c158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.326+0000 7fa860a00640 1 --2- 172.21.15.196:0/3377240215 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa85c152cc0 0x7fa85c0ad880 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.326+0000 7fa860a00640 1 -- 172.21.15.196:0/3377240215 >> 172.21.15.196:0/3377240215 conn(0x7fa85c0c4a70 msgr2=0x7fa85c0c4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:17.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.326+0000 7fa860a00640 1 -- 172.21.15.196:0/3377240215 shutdown_connections 2024-03-23T23:42:17.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.326+0000 7fa860a00640 1 -- 172.21.15.196:0/3377240215 wait complete. 2024-03-23T23:42:17.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.326+0000 7fa860a00640 1 Processor -- start 2024-03-23T23:42:17.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.326+0000 7fa860a00640 1 -- start start 2024-03-23T23:42:17.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.326+0000 7fa860a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa85c0addc0 0x7fa85c0c7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:17.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.326+0000 7fa860a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa85c0c33a0 0x7fa85c1419e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:17.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.326+0000 7fa860a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa85c152cc0 0x7fa85c141f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:17.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.326+0000 7fa860a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c06bb00 con 0x7fa85c0addc0 2024-03-23T23:42:17.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.326+0000 7fa860a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c06b980 con 0x7fa85c152cc0 2024-03-23T23:42:17.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.326+0000 7fa860a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c06bc80 con 0x7fa85c0c33a0 2024-03-23T23:42:17.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.326+0000 7fa85a800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa85c152cc0 0x7fa85c141f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:17.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.326+0000 7fa859400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa85c0c33a0 0x7fa85c1419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:17.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.326+0000 7fa85a800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa85c152cc0 0x7fa85c141f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:50146/0 (socket says 172.21.15.196:50146) 2024-03-23T23:42:17.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.326+0000 7fa85a800640 1 -- 172.21.15.196:0/443721184 learned_addr learned my addr 172.21.15.196:0/443721184 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-23T23:42:17.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.326+0000 7fa859e00640 1 --2- 172.21.15.196:0/443721184 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa85c0addc0 0x7fa85c0c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:17.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.326+0000 7fa85a800640 1 -- 172.21.15.196:0/443721184 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa85c0c33a0 msgr2=0x7fa85c1419e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:17.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.326+0000 7fa85a800640 1 --2- 172.21.15.196:0/443721184 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa85c0c33a0 0x7fa85c1419e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.326+0000 7fa85a800640 1 -- 172.21.15.196:0/443721184 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa85c0addc0 msgr2=0x7fa85c0c7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:17.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.326+0000 7fa85a800640 1 --2- 172.21.15.196:0/443721184 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa85c0addc0 0x7fa85c0c7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.330+0000 7fa85a800640 1 -- 172.21.15.196:0/443721184 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa85c1f1ac0 con 0x7fa85c152cc0 2024-03-23T23:42:17.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.330+0000 7fa85a800640 1 --2- 172.21.15.196:0/443721184 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa85c152cc0 0x7fa85c141f20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa854007ef0 tx=0x7fa85400d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:17.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.330+0000 7fa852000640 1 -- 172.21.15.196:0/443721184 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85401a070 con 0x7fa85c152cc0 2024-03-23T23:42:17.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.330+0000 7fa852000640 1 -- 172.21.15.196:0/443721184 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa854003ba0 con 0x7fa85c152cc0 2024-03-23T23:42:17.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.330+0000 7fa860a00640 1 -- 172.21.15.196:0/443721184 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa85c1f1da0 con 0x7fa85c152cc0 2024-03-23T23:42:17.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.330+0000 7fa852000640 1 -- 172.21.15.196:0/443721184 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa854004030 con 0x7fa85c152cc0 2024-03-23T23:42:17.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.330+0000 7fa860a00640 1 -- 172.21.15.196:0/443721184 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa85c1f2360 con 0x7fa85c152cc0 2024-03-23T23:42:17.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.330+0000 7fa852000640 1 -- 172.21.15.196:0/443721184 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fa85401d070 con 0x7fa85c152cc0 2024-03-23T23:42:17.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.330+0000 7fa852000640 1 -- 172.21.15.196:0/443721184 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fa8540047c0 con 0x7fa85c152cc0 2024-03-23T23:42:17.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.330+0000 7fa860a00640 1 -- 172.21.15.196:0/443721184 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa85c04f410 con 0x7fa85c152cc0 2024-03-23T23:42:17.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.334+0000 7fa852000640 1 -- 172.21.15.196:0/443721184 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fa854010070 con 0x7fa85c152cc0 2024-03-23T23:42:17.400 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-03-23T23:42:17.401+0000 7f58a06db180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-23T23:42:17.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.418+0000 7fa860a00640 1 -- 172.21.15.196:0/443721184 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e47723c5-50a0-4cd8-92d9-01972072b422", "id": 6} v 0) v1 -- 0x7fa85c156910 con 0x7fa85c152cc0 2024-03-23T23:42:17.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.422+0000 7fa852000640 1 -- 172.21.15.196:0/443721184 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e47723c5-50a0-4cd8-92d9-01972072b422", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa8540041d0 con 0x7fa85c152cc0 2024-03-23T23:42:17.421 INFO:teuthology.orchestra.run.smithi196.stdout:6 2024-03-23T23:42:17.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.422+0000 7fa860a00640 1 -- 172.21.15.196:0/443721184 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa85c152cc0 msgr2=0x7fa85c141f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:17.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.422+0000 7fa860a00640 1 --2- 172.21.15.196:0/443721184 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa85c152cc0 0x7fa85c141f20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa854007ef0 tx=0x7fa85400d4a0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.422+0000 7fa860a00640 1 -- 172.21.15.196:0/443721184 shutdown_connections 2024-03-23T23:42:17.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.422+0000 7fa860a00640 1 --2- 172.21.15.196:0/443721184 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa85c152cc0 0x7fa85c141f20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.422+0000 7fa860a00640 1 --2- 172.21.15.196:0/443721184 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa85c0c33a0 0x7fa85c1419e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.422+0000 7fa860a00640 1 --2- 172.21.15.196:0/443721184 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa85c0addc0 0x7fa85c0c7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.422+0000 7fa860a00640 1 -- 172.21.15.196:0/443721184 >> 172.21.15.196:0/443721184 conn(0x7fa85c0c4a70 msgr2=0x7fa85c1515c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:17.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.422+0000 7fa860a00640 1 -- 172.21.15.196:0/443721184 shutdown_connections 2024-03-23T23:42:17.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.422+0000 7fa860a00640 1 -- 172.21.15.196:0/443721184 wait complete. 2024-03-23T23:42:17.442 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new e1e9113d-8005-47b3-9a75-9e701199f1cc 7 2024-03-23T23:42:17.445 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-23T23:42:17.446+0000 7fb72b62d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-23T23:42:17.468 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-03-23T23:42:17.465+0000 7f58a06db180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-23T23:42:17.520 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-23T23:42:17.522+0000 7fb72b62d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-23T23:42:17.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.578+0000 7fa722000640 1 Processor -- start 2024-03-23T23:42:17.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.578+0000 7fa722000640 1 -- start start 2024-03-23T23:42:17.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.582+0000 7fa722000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa71c0c5e30 0x7fa71c072540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:17.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.582+0000 7fa722000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa71c06b880 con 0x7fa71c0c6e80 2024-03-23T23:42:17.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.582+0000 7fa722000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa71c0c59b0 con 0x7fa71c153310 2024-03-23T23:42:17.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.582+0000 7fa722000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa71c0c27a0 con 0x7fa71c0c5e30 2024-03-23T23:42:17.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.582+0000 7fa71b400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fa71c153310 0x7fa71c06b170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:39058/0 (socket says 172.21.15.196:39058) 2024-03-23T23:42:17.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.582+0000 7fa71b400640 1 -- 172.21.15.196:0/2714186317 learned_addr learned my addr 172.21.15.196:0/2714186317 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-23T23:42:17.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.582+0000 7fa71be00640 1 --2- 172.21.15.196:0/2714186317 >> v2:172.21.15.8:3300/0 conn(0x7fa71c0c5e30 0x7fa71c072540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:17.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.582+0000 7fa71a000640 1 -- 172.21.15.196:0/2714186317 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1998032042 0 0) 0x7fa71c0c59b0 con 0x7fa71c153310 2024-03-23T23:42:17.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.582+0000 7fa71a000640 1 -- 172.21.15.196:0/2714186317 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa700003530 con 0x7fa71c153310 2024-03-23T23:42:17.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.582+0000 7fa71a000640 1 -- 172.21.15.196:0/2714186317 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 108314376 0 0) 0x7fa71c06b880 con 0x7fa71c0c6e80 2024-03-23T23:42:17.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.582+0000 7fa71a000640 1 -- 172.21.15.196:0/2714186317 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa71c0c59b0 con 0x7fa71c0c6e80 2024-03-23T23:42:17.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.582+0000 7fa71be00640 1 -- 172.21.15.196:0/2714186317 >> v1:172.21.15.196:6789/0 conn(0x7fa71c153310 legacy=0x7fa71c06b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:17.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.582+0000 7fa71a000640 1 -- 172.21.15.196:0/2714186317 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2345104959 0 0) 0x7fa700003530 con 0x7fa71c153310 2024-03-23T23:42:17.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.582+0000 7fa71be00640 1 -- 172.21.15.196:0/2714186317 >> v1:172.21.15.8:6789/0 conn(0x7fa71c0c6e80 legacy=0x7fa71c071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:17.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.582+0000 7fa71be00640 1 -- 172.21.15.196:0/2714186317 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa71c0730c0 con 0x7fa71c0c5e30 2024-03-23T23:42:17.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.586+0000 7fa71be00640 1 --2- 172.21.15.196:0/2714186317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa71c0c5e30 0x7fa71c072540 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa714009d90 tx=0x7fa71401c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb88d8851c6241f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:17.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.586+0000 7fa71a000640 1 -- 172.21.15.196:0/2714186317 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70c001680 con 0x7fa71c0c5e30 2024-03-23T23:42:17.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.586+0000 7fa71a000640 1 -- 172.21.15.196:0/2714186317 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7140af070 con 0x7fa71c0c5e30 2024-03-23T23:42:17.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.586+0000 7fa71a000640 1 -- 172.21.15.196:0/2714186317 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7140aa680 con 0x7fa71c0c5e30 2024-03-23T23:42:17.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.586+0000 7fa722000640 1 -- 172.21.15.196:0/2714186317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa71c0c5e30 msgr2=0x7fa71c072540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:17.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.586+0000 7fa722000640 1 --2- 172.21.15.196:0/2714186317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa71c0c5e30 0x7fa71c072540 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa714009d90 tx=0x7fa71401c790 comp rx=0 tx=0).stop 2024-03-23T23:42:17.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.586+0000 7fa722000640 1 -- 172.21.15.196:0/2714186317 shutdown_connections 2024-03-23T23:42:17.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.586+0000 7fa722000640 1 --2- 172.21.15.196:0/2714186317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa71c0c5e30 0x7fa71c072540 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.586+0000 7fa722000640 1 -- 172.21.15.196:0/2714186317 >> 172.21.15.196:0/2714186317 conn(0x7fa71c0a96b0 msgr2=0x7fa71c0a9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:17.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.586+0000 7fa722000640 1 -- 172.21.15.196:0/2714186317 shutdown_connections 2024-03-23T23:42:17.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.586+0000 7fa722000640 1 -- 172.21.15.196:0/2714186317 wait complete. 2024-03-23T23:42:17.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.586+0000 7fa722000640 1 Processor -- start 2024-03-23T23:42:17.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.586+0000 7fa722000640 1 -- start start 2024-03-23T23:42:17.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.590+0000 7fa722000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa71c0c5e30 0x7fa71c154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:17.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.590+0000 7fa722000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa71c0c6e80 0x7fa71c1eea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:17.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.590+0000 7fa722000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa71c153310 0x7fa71c14f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:17.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.590+0000 7fa722000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c06f2f0 con 0x7fa71c153310 2024-03-23T23:42:17.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.590+0000 7fa722000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c06f170 con 0x7fa71c0c5e30 2024-03-23T23:42:17.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.590+0000 7fa722000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c06f470 con 0x7fa71c0c6e80 2024-03-23T23:42:17.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.590+0000 7fa71b400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa71c0c5e30 0x7fa71c154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:17.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.590+0000 7fa71aa00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa71c0c6e80 0x7fa71c1eea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:17.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.590+0000 7fa71b400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa71c0c5e30 0x7fa71c154920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:50148/0 (socket says 172.21.15.196:50148) 2024-03-23T23:42:17.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.590+0000 7fa71b400640 1 -- 172.21.15.196:0/520715506 learned_addr learned my addr 172.21.15.196:0/520715506 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-23T23:42:17.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.590+0000 7fa71aa00640 1 --2- 172.21.15.196:0/520715506 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa71c0c6e80 0x7fa71c1eea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:36896/0 (socket says 172.21.15.196:36896) 2024-03-23T23:42:17.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.590+0000 7fa71be00640 1 --2- 172.21.15.196:0/520715506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa71c153310 0x7fa71c14f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:17.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.590+0000 7fa71aa00640 1 -- 172.21.15.196:0/520715506 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa71c0c5e30 msgr2=0x7fa71c154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:17.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.590+0000 7fa71aa00640 1 --2- 172.21.15.196:0/520715506 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa71c0c5e30 0x7fa71c154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.590+0000 7fa71aa00640 1 -- 172.21.15.196:0/520715506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa71c153310 msgr2=0x7fa71c14f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:17.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.590+0000 7fa71aa00640 1 --2- 172.21.15.196:0/520715506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa71c153310 0x7fa71c14f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.590+0000 7fa71aa00640 1 -- 172.21.15.196:0/520715506 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa71c1f2520 con 0x7fa71c0c6e80 2024-03-23T23:42:17.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.590+0000 7fa71b400640 1 --2- 172.21.15.196:0/520715506 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa71c0c5e30 0x7fa71c154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:42:17.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.590+0000 7fa71aa00640 1 --2- 172.21.15.196:0/520715506 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa71c0c6e80 0x7fa71c1eea10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa70800c3c0 tx=0x7fa70800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:17.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.590+0000 7fa713400640 1 -- 172.21.15.196:0/520715506 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa708017070 con 0x7fa71c0c6e80 2024-03-23T23:42:17.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.590+0000 7fa713400640 1 -- 172.21.15.196:0/520715506 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7080052d0 con 0x7fa71c0c6e80 2024-03-23T23:42:17.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.590+0000 7fa722000640 1 -- 172.21.15.196:0/520715506 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa71c1ee250 con 0x7fa71c0c6e80 2024-03-23T23:42:17.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.590+0000 7fa713400640 1 -- 172.21.15.196:0/520715506 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa708003840 con 0x7fa71c0c6e80 2024-03-23T23:42:17.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.590+0000 7fa722000640 1 -- 172.21.15.196:0/520715506 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa71c154e60 con 0x7fa71c0c6e80 2024-03-23T23:42:17.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.590+0000 7fa713400640 1 -- 172.21.15.196:0/520715506 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fa70801a070 con 0x7fa71c0c6e80 2024-03-23T23:42:17.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.590+0000 7fa713400640 1 -- 172.21.15.196:0/520715506 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fa708011590 con 0x7fa71c0c6e80 2024-03-23T23:42:17.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.590+0000 7fa722000640 1 -- 172.21.15.196:0/520715506 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa71c1ee050 con 0x7fa71c0c6e80 2024-03-23T23:42:17.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.594+0000 7fa713400640 1 -- 172.21.15.196:0/520715506 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fa708021080 con 0x7fa71c0c6e80 2024-03-23T23:42:17.643 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-03-23T23:42:17.641+0000 7f58a06db180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-23T23:42:17.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.658+0000 7fa722000640 1 -- 172.21.15.196:0/520715506 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e1e9113d-8005-47b3-9a75-9e701199f1cc", "id": 7} v 0) v1 -- 0x7fa71c04f410 con 0x7fa71c0c6e80 2024-03-23T23:42:17.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.666+0000 7fa713400640 1 -- 172.21.15.196:0/520715506 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e1e9113d-8005-47b3-9a75-9e701199f1cc", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa708005480 con 0x7fa71c0c6e80 2024-03-23T23:42:17.665 INFO:teuthology.orchestra.run.smithi196.stdout:7 2024-03-23T23:42:17.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.666+0000 7fa722000640 1 -- 172.21.15.196:0/520715506 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa71c0c6e80 msgr2=0x7fa71c1eea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:17.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.666+0000 7fa722000640 1 --2- 172.21.15.196:0/520715506 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa71c0c6e80 0x7fa71c1eea10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa70800c3c0 tx=0x7fa70800c880 comp rx=0 tx=0).stop 2024-03-23T23:42:17.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.666+0000 7fa722000640 1 -- 172.21.15.196:0/520715506 shutdown_connections 2024-03-23T23:42:17.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.666+0000 7fa722000640 1 --2- 172.21.15.196:0/520715506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa71c153310 0x7fa71c14f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.666+0000 7fa722000640 1 --2- 172.21.15.196:0/520715506 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa71c0c6e80 0x7fa71c1eea10 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.666+0000 7fa722000640 1 --2- 172.21.15.196:0/520715506 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa71c0c5e30 0x7fa71c154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.666+0000 7fa722000640 1 -- 172.21.15.196:0/520715506 >> 172.21.15.196:0/520715506 conn(0x7fa71c0a96b0 msgr2=0x7fa71c14fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:17.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.666+0000 7fa722000640 1 -- 172.21.15.196:0/520715506 shutdown_connections 2024-03-23T23:42:17.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-23T23:42:17.666+0000 7fa722000640 1 -- 172.21.15.196:0/520715506 wait complete. 2024-03-23T23:42:17.684 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-23T23:42:17.684 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-23T23:42:17.687 INFO:tasks.ceph.osd.0:Started 2024-03-23T23:42:17.687 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-23T23:42:17.687 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-23T23:42:17.690 INFO:tasks.ceph.osd.1:Started 2024-03-23T23:42:17.690 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-23T23:42:17.691 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-23T23:42:17.693 INFO:tasks.ceph.osd.2:Started 2024-03-23T23:42:17.694 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-23T23:42:17.694 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-23T23:42:17.698 INFO:tasks.ceph.osd.3:Started 2024-03-23T23:42:17.698 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-23T23:42:17.698 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-23T23:42:17.701 INFO:tasks.ceph.osd.4:Started 2024-03-23T23:42:17.701 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-23T23:42:17.701 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-23T23:42:17.704 INFO:tasks.ceph.osd.5:Started 2024-03-23T23:42:17.704 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-23T23:42:17.704 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-23T23:42:17.707 INFO:tasks.ceph.osd.6:Started 2024-03-23T23:42:17.707 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-23T23:42:17.707 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-23T23:42:17.710 INFO:tasks.ceph.osd.7:Started 2024-03-23T23:42:17.711 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:42:17.729 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-03-23T23:42:17.729+0000 7f58a06db180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-23T23:42:17.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.893+0000 7fb7c7400640 1 Processor -- start 2024-03-23T23:42:17.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.893+0000 7fb7c7400640 1 -- start start 2024-03-23T23:42:17.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.893+0000 7fb7c7400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb7c0070b50 0x7fb7c01541b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:17.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.893+0000 7fb7c7400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb7c00c5560 0x7fb7c006ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:17.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.893+0000 7fb7c7400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7c01546f0 con 0x7fb7c014d8b0 2024-03-23T23:42:17.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.893+0000 7fb7c7400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7c00c4830 con 0x7fb7c00c5560 2024-03-23T23:42:17.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.893+0000 7fb7c7400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7c00c50d0 con 0x7fb7c0070b50 2024-03-23T23:42:17.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.893+0000 7fb7c5400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb7c00c5560 0x7fb7c006ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:17.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.893+0000 7fb7c5400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb7c00c5560 0x7fb7c006ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47486/0 (socket says 172.21.15.8:47486) 2024-03-23T23:42:17.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.893+0000 7fb7c5400640 1 -- 172.21.15.8:0/2503365768 learned_addr learned my addr 172.21.15.8:0/2503365768 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:17.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.893+0000 7fb7b7e00640 1 --2- 172.21.15.8:0/2503365768 >> v2:172.21.15.196:3300/0 conn(0x7fb7c0070b50 0x7fb7c01541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:17.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.893+0000 7fb7c5400640 1 -- 172.21.15.8:0/2503365768 >> v2:172.21.15.196:3300/0 conn(0x7fb7c0070b50 msgr2=0x7fb7c01541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:17.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.893+0000 7fb7c5400640 1 --2- 172.21.15.8:0/2503365768 >> v2:172.21.15.196:3300/0 conn(0x7fb7c0070b50 0x7fb7c01541b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.893+0000 7fb7c5400640 1 -- 172.21.15.8:0/2503365768 >> v1:172.21.15.196:6789/0 conn(0x7fb7c014d8b0 legacy=0x7fb7c00c7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:17.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.897+0000 7fb7c5400640 1 -- 172.21.15.8:0/2503365768 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c00710e0 con 0x7fb7c00c5560 2024-03-23T23:42:17.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.897+0000 7fb7c5400640 1 --2- 172.21.15.8:0/2503365768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7c00c5560 0x7fb7c006ed00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0073ac0 tx=0x7fb7b801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b60aedac3908ed server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:17.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.897+0000 7fb7bfe00640 1 -- 172.21.15.8:0/2503365768 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b80a56c0 con 0x7fb7c00c5560 2024-03-23T23:42:17.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.897+0000 7fb7bfe00640 1 -- 172.21.15.8:0/2503365768 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b80a5860 con 0x7fb7c00c5560 2024-03-23T23:42:17.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.897+0000 7fb7bfe00640 1 -- 172.21.15.8:0/2503365768 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b80a5c30 con 0x7fb7c00c5560 2024-03-23T23:42:17.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.897+0000 7fb7c7400640 1 -- 172.21.15.8:0/2503365768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7c00c5560 msgr2=0x7fb7c006ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:17.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.897+0000 7fb7c7400640 1 --2- 172.21.15.8:0/2503365768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7c00c5560 0x7fb7c006ed00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0073ac0 tx=0x7fb7b801c9f0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.897+0000 7fb7c7400640 1 -- 172.21.15.8:0/2503365768 shutdown_connections 2024-03-23T23:42:17.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.897+0000 7fb7c7400640 1 --2- 172.21.15.8:0/2503365768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7c00c5560 0x7fb7c006ed00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.897+0000 7fb7c7400640 1 --2- 172.21.15.8:0/2503365768 >> v2:172.21.15.196:3300/0 conn(0x7fb7c0070b50 0x7fb7c01541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.897+0000 7fb7c7400640 1 -- 172.21.15.8:0/2503365768 >> 172.21.15.8:0/2503365768 conn(0x7fb7c00aafe0 msgr2=0x7fb7c00ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:17.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.901+0000 7fb7c7400640 1 -- 172.21.15.8:0/2503365768 shutdown_connections 2024-03-23T23:42:17.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.901+0000 7fb7c7400640 1 -- 172.21.15.8:0/2503365768 wait complete. 2024-03-23T23:42:17.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.901+0000 7fb7c7400640 1 Processor -- start 2024-03-23T23:42:17.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.901+0000 7fb7c7400640 1 -- start start 2024-03-23T23:42:17.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.901+0000 7fb7c7400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb7c0070b50 0x7fb7c01f2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:17.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.901+0000 7fb7c7400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7c00c5560 0x7fb7c01eeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:17.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.901+0000 7fb7c7400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb7c014d8b0 0x7fb7c01ef520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:17.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.901+0000 7fb7c7400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c0160a50 con 0x7fb7c00c5560 2024-03-23T23:42:17.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.901+0000 7fb7c7400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c01608d0 con 0x7fb7c0070b50 2024-03-23T23:42:17.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.901+0000 7fb7c7400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c0160bd0 con 0x7fb7c014d8b0 2024-03-23T23:42:17.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.901+0000 7fb7b7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7c00c5560 0x7fb7c01eeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:17.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.901+0000 7fb7b7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7c00c5560 0x7fb7c01eeac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47494/0 (socket says 172.21.15.8:47494) 2024-03-23T23:42:17.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.901+0000 7fb7b7e00640 1 -- 172.21.15.8:0/2690689451 learned_addr learned my addr 172.21.15.8:0/2690689451 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:17.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.901+0000 7fb7c5400640 1 --2- 172.21.15.8:0/2690689451 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb7c014d8b0 0x7fb7c01ef520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:17.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.901+0000 7fb7b7e00640 1 -- 172.21.15.8:0/2690689451 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb7c014d8b0 msgr2=0x7fb7c01ef520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:17.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.901+0000 7fb7b7e00640 1 --2- 172.21.15.8:0/2690689451 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb7c014d8b0 0x7fb7c01ef520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.901+0000 7fb7b7e00640 1 -- 172.21.15.8:0/2690689451 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb7c0070b50 msgr2=0x7fb7c01f2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:17.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.901+0000 7fb7b7e00640 1 --2- 172.21.15.8:0/2690689451 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb7c0070b50 0x7fb7c01f2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.901+0000 7fb7b7e00640 1 -- 172.21.15.8:0/2690689451 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c01ef000 con 0x7fb7c00c5560 2024-03-23T23:42:17.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.901+0000 7fb7b7e00640 1 --2- 172.21.15.8:0/2690689451 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7c00c5560 0x7fb7c01eeac0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb7a800d5f0 tx=0x7fb7a800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:17.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.901+0000 7fb7bd600640 1 -- 172.21.15.8:0/2690689451 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a80125f0 con 0x7fb7c00c5560 2024-03-23T23:42:17.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.901+0000 7fb7bd600640 1 -- 172.21.15.8:0/2690689451 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a8019070 con 0x7fb7c00c5560 2024-03-23T23:42:17.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.901+0000 7fb7c7400640 1 -- 172.21.15.8:0/2690689451 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c01efa60 con 0x7fb7c00c5560 2024-03-23T23:42:17.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.901+0000 7fb7bd600640 1 -- 172.21.15.8:0/2690689451 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a80129b0 con 0x7fb7c00c5560 2024-03-23T23:42:17.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.901+0000 7fb7c7400640 1 -- 172.21.15.8:0/2690689451 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c00aeef0 con 0x7fb7c00c5560 2024-03-23T23:42:17.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.905+0000 7fb7bd600640 1 -- 172.21.15.8:0/2690689451 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fb7a8012b50 con 0x7fb7c00c5560 2024-03-23T23:42:17.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.905+0000 7fb7bd600640 1 -- 172.21.15.8:0/2690689451 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fb7a801eb30 con 0x7fb7c00c5560 2024-03-23T23:42:17.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.905+0000 7fb7c7400640 1 -- 172.21.15.8:0/2690689451 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c0068270 con 0x7fb7c00c5560 2024-03-23T23:42:17.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.929+0000 7fb7bd600640 1 -- 172.21.15.8:0/2690689451 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fb7a801e460 con 0x7fb7c00c5560 2024-03-23T23:42:17.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.989+0000 7fb7c7400640 1 -- 172.21.15.8:0/2690689451 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7c0151220 con 0x7fb7c00c5560 2024-03-23T23:42:17.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.989+0000 7fb7bd600640 1 -- 172.21.15.8:0/2690689451 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fb7a801e640 con 0x7fb7c00c5560 2024-03-23T23:42:17.990 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:42:17.990 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":10,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","created":"2024-03-23T23:42:15.169430+0000","modified":"2024-03-23T23:42:17.662330+0000","last_up_change":"0.000000","last_in_change":"2024-03-23T23:42:17.662330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e967bf31-21d6-4d11-bc3d-0df8177a1b72","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c8e33701-7acd-4474-8402-d52461171fd0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ceebdbf7-4c2f-4757-b52d-fd8b20e77570","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"89e258da-5767-429e-8441-edf877d2f3cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2b7451ae-ea16-4f0a-ae50-04fde75e45ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e68a8914-e591-466a-bc9e-f2d7c67aac13","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e47723c5-50a0-4cd8-92d9-01972072b422","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e1e9113d-8005-47b3-9a75-9e701199f1cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:42:17.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.989+0000 7fb7c7400640 1 -- 172.21.15.8:0/2690689451 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7c00c5560 msgr2=0x7fb7c01eeac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:17.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.989+0000 7fb7c7400640 1 --2- 172.21.15.8:0/2690689451 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7c00c5560 0x7fb7c01eeac0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb7a800d5f0 tx=0x7fb7a800dab0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.989+0000 7fb7c7400640 1 -- 172.21.15.8:0/2690689451 shutdown_connections 2024-03-23T23:42:17.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.989+0000 7fb7c7400640 1 --2- 172.21.15.8:0/2690689451 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb7c014d8b0 0x7fb7c01ef520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.989+0000 7fb7c7400640 1 --2- 172.21.15.8:0/2690689451 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7c00c5560 0x7fb7c01eeac0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.989+0000 7fb7c7400640 1 --2- 172.21.15.8:0/2690689451 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb7c0070b50 0x7fb7c01f2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:17.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.989+0000 7fb7c7400640 1 -- 172.21.15.8:0/2690689451 >> 172.21.15.8:0/2690689451 conn(0x7fb7c00aafe0 msgr2=0x7fb7c0148650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:17.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.989+0000 7fb7c7400640 1 -- 172.21.15.8:0/2690689451 shutdown_connections 2024-03-23T23:42:17.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:17.989+0000 7fb7c7400640 1 -- 172.21.15.8:0/2690689451 wait complete. 2024-03-23T23:42:18.008 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-23T23:42:18.009 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-23T23:42:18.178 INFO:tasks.ceph.mgr.x.smithi196.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-03-23T23:42:18.178 INFO:tasks.ceph.mgr.x.smithi196.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-03-23T23:42:18.178 INFO:tasks.ceph.mgr.x.smithi196.stderr: from numpy import show_config as show_numpy_config 2024-03-23T23:42:18.221 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-23T23:42:18.222+0000 7fb72b62d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-23T23:42:18.353 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-03-23T23:42:18.354+0000 7f3d69a467c0 -1 Falling back to public interface 2024-03-23T23:42:18.354 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-03-23T23:42:18.354+0000 7f44daaa07c0 -1 Falling back to public interface 2024-03-23T23:42:18.354 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-03-23T23:42:18.354+0000 7f3d68600640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-03-23T23:42:18.357 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-03-23T23:42:18.358+0000 7f75fe8d07c0 -1 Falling back to public interface 2024-03-23T23:42:18.373 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-03-23T23:42:18.374+0000 7fd2021e17c0 -1 Falling back to public interface 2024-03-23T23:42:18.373 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-23T23:42:18.374+0000 7fb72b62d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-23T23:42:18.382 INFO:tasks.ceph.osd.2.smithi008.stderr:2024-03-23T23:42:18.381+0000 7fa9661c67c0 -1 Falling back to public interface 2024-03-23T23:42:18.393 INFO:tasks.ceph.osd.0.smithi008.stderr:2024-03-23T23:42:18.393+0000 7f9c617c07c0 -1 Falling back to public interface 2024-03-23T23:42:18.401 INFO:tasks.ceph.osd.1.smithi008.stderr:2024-03-23T23:42:18.401+0000 7fee4c8ed7c0 -1 Falling back to public interface 2024-03-23T23:42:18.402 INFO:tasks.ceph.osd.3.smithi008.stderr:2024-03-23T23:42:18.401+0000 7f159817c7c0 -1 Falling back to public interface 2024-03-23T23:42:18.421 INFO:tasks.ceph.mgr.y.smithi008.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-03-23T23:42:18.421 INFO:tasks.ceph.mgr.y.smithi008.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-03-23T23:42:18.421 INFO:tasks.ceph.mgr.y.smithi008.stderr: from numpy import show_config as show_numpy_config 2024-03-23T23:42:18.474 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-03-23T23:42:18.473+0000 7f58a06db180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-23T23:42:18.546 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-23T23:42:18.546+0000 7fb72b62d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-23T23:42:18.627 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-23T23:42:18.626+0000 7fb72b62d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-23T23:42:18.630 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-03-23T23:42:18.629+0000 7f58a06db180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-23T23:42:18.778 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-23T23:42:18.778+0000 7fb72b62d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-23T23:42:18.814 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-03-23T23:42:18.813+0000 7f58a06db180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-23T23:42:18.814 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-23T23:42:18.893 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-03-23T23:42:18.893+0000 7f58a06db180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-23T23:42:18.949 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.949+0000 7ffb6fe00640 1 Processor -- start 2024-03-23T23:42:18.949 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.949+0000 7ffb6fe00640 1 -- start start 2024-03-23T23:42:18.951 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.949+0000 7ffb6fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb680aa3b0 0x7ffb681540b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:18.951 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.949+0000 7ffb6fe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ffb68150dd0 0x7ffb68072730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:18.951 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.949+0000 7ffb6fe00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb68151220 con 0x7ffb68150970 2024-03-23T23:42:18.951 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.949+0000 7ffb6fe00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb680ac4c0 con 0x7ffb68150dd0 2024-03-23T23:42:18.951 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.949+0000 7ffb6fe00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb680ac7a0 con 0x7ffb680aa3b0 2024-03-23T23:42:18.951 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.949+0000 7ffb6de00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ffb68150dd0 0x7ffb68072730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:18.951 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.949+0000 7ffb6de00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ffb68150dd0 0x7ffb68072730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47508/0 (socket says 172.21.15.8:47508) 2024-03-23T23:42:18.951 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.949+0000 7ffb6de00640 1 -- 172.21.15.8:0/2452745057 learned_addr learned my addr 172.21.15.8:0/2452745057 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:18.951 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.949+0000 7ffb6d400640 1 --2- 172.21.15.8:0/2452745057 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb680aa3b0 0x7ffb681540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:18.951 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.949+0000 7ffb6de00640 1 -- 172.21.15.8:0/2452745057 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb680aa3b0 msgr2=0x7ffb681540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:18.951 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.949+0000 7ffb6de00640 1 --2- 172.21.15.8:0/2452745057 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb680aa3b0 0x7ffb681540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:18.951 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.949+0000 7ffb6de00640 1 -- 172.21.15.8:0/2452745057 >> v1:172.21.15.196:6789/0 conn(0x7ffb68150970 legacy=0x7ffb68072020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:18.952 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.949+0000 7ffb6de00640 1 -- 172.21.15.8:0/2452745057 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb680aca80 con 0x7ffb68150dd0 2024-03-23T23:42:18.954 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.953+0000 7ffb6de00640 1 --2- 172.21.15.8:0/2452745057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb68150dd0 0x7ffb68072730 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009e50 tx=0x7ffb6001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb0633f9bc66c14c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:18.954 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.953+0000 7ffb67e00640 1 -- 172.21.15.8:0/2452745057 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb600a57f0 con 0x7ffb68150dd0 2024-03-23T23:42:18.954 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.953+0000 7ffb67e00640 1 -- 172.21.15.8:0/2452745057 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb600a5990 con 0x7ffb68150dd0 2024-03-23T23:42:18.954 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.953+0000 7ffb67e00640 1 -- 172.21.15.8:0/2452745057 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb600a5d60 con 0x7ffb68150dd0 2024-03-23T23:42:18.955 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.953+0000 7ffb6fe00640 1 -- 172.21.15.8:0/2452745057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb68150dd0 msgr2=0x7ffb68072730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:18.955 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.953+0000 7ffb6fe00640 1 --2- 172.21.15.8:0/2452745057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb68150dd0 0x7ffb68072730 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009e50 tx=0x7ffb6001ca30 comp rx=0 tx=0).stop 2024-03-23T23:42:18.955 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.953+0000 7ffb6fe00640 1 -- 172.21.15.8:0/2452745057 shutdown_connections 2024-03-23T23:42:18.955 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.953+0000 7ffb6fe00640 1 --2- 172.21.15.8:0/2452745057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb68150dd0 0x7ffb68072730 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:18.955 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.953+0000 7ffb6fe00640 1 --2- 172.21.15.8:0/2452745057 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb680aa3b0 0x7ffb681540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:18.955 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.953+0000 7ffb6fe00640 1 -- 172.21.15.8:0/2452745057 >> 172.21.15.8:0/2452745057 conn(0x7ffb680c7030 msgr2=0x7ffb680c7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:18.955 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.953+0000 7ffb6fe00640 1 -- 172.21.15.8:0/2452745057 shutdown_connections 2024-03-23T23:42:18.955 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.953+0000 7ffb6fe00640 1 -- 172.21.15.8:0/2452745057 wait complete. 2024-03-23T23:42:18.956 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.953+0000 7ffb6fe00640 1 Processor -- start 2024-03-23T23:42:18.956 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.953+0000 7ffb6fe00640 1 -- start start 2024-03-23T23:42:18.957 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.957+0000 7ffb6fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb680aa3b0 0x7ffb6814ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:18.958 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.957+0000 7ffb6fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb68150970 0x7ffb6813d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:18.958 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.957+0000 7ffb6fe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb68150dd0 0x7ffb6813de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:18.958 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.957+0000 7ffb6fe00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb680aa790 con 0x7ffb68150970 2024-03-23T23:42:18.958 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.957+0000 7ffb6fe00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb68071130 con 0x7ffb68150dd0 2024-03-23T23:42:18.958 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.957+0000 7ffb6fe00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb680aa910 con 0x7ffb680aa3b0 2024-03-23T23:42:18.958 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.957+0000 7ffb6ca00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb68150970 0x7ffb6813d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:18.958 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.957+0000 7ffb6de00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb68150dd0 0x7ffb6813de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:18.958 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.957+0000 7ffb6ca00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb68150970 0x7ffb6813d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47518/0 (socket says 172.21.15.8:47518) 2024-03-23T23:42:18.958 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.957+0000 7ffb6ca00640 1 -- 172.21.15.8:0/2209135882 learned_addr learned my addr 172.21.15.8:0/2209135882 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:18.958 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.957+0000 7ffb6d400640 1 --2- 172.21.15.8:0/2209135882 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb680aa3b0 0x7ffb6814ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:18.960 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.957+0000 7ffb6de00640 1 -- 172.21.15.8:0/2209135882 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb680aa3b0 msgr2=0x7ffb6814ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:18.960 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.957+0000 7ffb6de00640 1 --2- 172.21.15.8:0/2209135882 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb680aa3b0 0x7ffb6814ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:18.960 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.957+0000 7ffb6de00640 1 -- 172.21.15.8:0/2209135882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb68150970 msgr2=0x7ffb6813d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:18.960 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.957+0000 7ffb6de00640 1 --2- 172.21.15.8:0/2209135882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb68150970 0x7ffb6813d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:18.960 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.957+0000 7ffb6de00640 1 -- 172.21.15.8:0/2209135882 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb68150190 con 0x7ffb68150dd0 2024-03-23T23:42:18.960 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.957+0000 7ffb6ca00640 1 --2- 172.21.15.8:0/2209135882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb68150970 0x7ffb6813d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:42:18.960 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.957+0000 7ffb6de00640 1 --2- 172.21.15.8:0/2209135882 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb68150dd0 0x7ffb6813de10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffb600ab000 tx=0x7ffb600197d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:18.960 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.957+0000 7ffb65600640 1 -- 172.21.15.8:0/2209135882 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb600bc030 con 0x7ffb68150dd0 2024-03-23T23:42:18.960 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.957+0000 7ffb65600640 1 -- 172.21.15.8:0/2209135882 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb600b8470 con 0x7ffb68150dd0 2024-03-23T23:42:18.960 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.957+0000 7ffb65600640 1 -- 172.21.15.8:0/2209135882 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb600b8860 con 0x7ffb68150dd0 2024-03-23T23:42:18.961 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.957+0000 7ffb6fe00640 1 -- 172.21.15.8:0/2209135882 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb681f1bc0 con 0x7ffb68150dd0 2024-03-23T23:42:18.961 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.957+0000 7ffb6fe00640 1 -- 172.21.15.8:0/2209135882 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb68155580 con 0x7ffb68150dd0 2024-03-23T23:42:18.961 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.957+0000 7ffb65600640 1 -- 172.21.15.8:0/2209135882 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7ffb600bf070 con 0x7ffb68150dd0 2024-03-23T23:42:18.961 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.957+0000 7ffb65600640 1 -- 172.21.15.8:0/2209135882 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7ffb600c1d10 con 0x7ffb68150dd0 2024-03-23T23:42:18.961 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.957+0000 7ffb6fe00640 1 -- 172.21.15.8:0/2209135882 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb68155370 con 0x7ffb68150dd0 2024-03-23T23:42:18.964 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:18.961+0000 7ffb65600640 1 -- 172.21.15.8:0/2209135882 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7ffb60016620 con 0x7ffb68150dd0 2024-03-23T23:42:19.023 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:19.021+0000 7ffb6fe00640 1 -- 172.21.15.8:0/2209135882 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb6804f410 con 0x7ffb68150dd0 2024-03-23T23:42:19.024 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:19.021+0000 7ffb65600640 1 -- 172.21.15.8:0/2209135882 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7ffb600b8a00 con 0x7ffb68150dd0 2024-03-23T23:42:19.025 INFO:teuthology.misc.health.smithi008.stdout: 2024-03-23T23:42:19.025 INFO:teuthology.misc.health.smithi008.stdout:{"epoch":10,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","created":"2024-03-23T23:42:15.169430+0000","modified":"2024-03-23T23:42:17.662330+0000","last_up_change":"0.000000","last_in_change":"2024-03-23T23:42:17.662330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e967bf31-21d6-4d11-bc3d-0df8177a1b72","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c8e33701-7acd-4474-8402-d52461171fd0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ceebdbf7-4c2f-4757-b52d-fd8b20e77570","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"89e258da-5767-429e-8441-edf877d2f3cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2b7451ae-ea16-4f0a-ae50-04fde75e45ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e68a8914-e591-466a-bc9e-f2d7c67aac13","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e47723c5-50a0-4cd8-92d9-01972072b422","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e1e9113d-8005-47b3-9a75-9e701199f1cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:42:19.026 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:19.025+0000 7ffb6fe00640 1 -- 172.21.15.8:0/2209135882 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb68150dd0 msgr2=0x7ffb6813de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:19.027 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:19.025+0000 7ffb6fe00640 1 --2- 172.21.15.8:0/2209135882 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb68150dd0 0x7ffb6813de10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffb600ab000 tx=0x7ffb600197d0 comp rx=0 tx=0).stop 2024-03-23T23:42:19.027 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:19.025+0000 7ffb6fe00640 1 -- 172.21.15.8:0/2209135882 shutdown_connections 2024-03-23T23:42:19.027 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:19.025+0000 7ffb6fe00640 1 --2- 172.21.15.8:0/2209135882 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb68150dd0 0x7ffb6813de10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:19.027 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:19.025+0000 7ffb6fe00640 1 --2- 172.21.15.8:0/2209135882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb68150970 0x7ffb6813d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:19.027 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:19.025+0000 7ffb6fe00640 1 --2- 172.21.15.8:0/2209135882 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb680aa3b0 0x7ffb6814ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:19.027 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:19.025+0000 7ffb6fe00640 1 -- 172.21.15.8:0/2209135882 >> 172.21.15.8:0/2209135882 conn(0x7ffb680c7030 msgr2=0x7ffb680c7410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:19.028 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:19.025+0000 7ffb6fe00640 1 -- 172.21.15.8:0/2209135882 shutdown_connections 2024-03-23T23:42:19.028 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:19.025+0000 7ffb6fe00640 1 -- 172.21.15.8:0/2209135882 wait complete. 2024-03-23T23:42:19.042 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-23T23:42:19.058 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-03-23T23:42:19.057+0000 7f58a06db180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-23T23:42:19.481 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-23T23:42:19.482+0000 7fb72b62d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-23T23:42:19.567 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-23T23:42:19.566+0000 7fb72b62d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-23T23:42:19.769 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-23T23:42:19.770+0000 7fb72b62d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-23T23:42:19.854 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-23T23:42:19.854+0000 7fb72b62d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-23T23:42:19.875 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-03-23T23:42:19.873+0000 7f58a06db180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-23T23:42:19.967 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-03-23T23:42:19.965+0000 7f58a06db180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-23T23:42:20.180 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-03-23T23:42:20.177+0000 7f58a06db180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-23T23:42:20.181 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-23T23:42:20.182+0000 7fb72b62d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-23T23:42:20.252 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-23T23:42:20.253+0000 7fb72b62d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-23T23:42:20.272 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-03-23T23:42:20.273+0000 7f58a06db180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-23T23:42:20.626 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-03-23T23:42:20.625+0000 7f58a06db180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-23T23:42:20.701 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-03-23T23:42:20.697+0000 7f58a06db180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-23T23:42:21.272 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-23T23:42:21.273+0000 7fb6d0800640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-23T23:42:21.273 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-23T23:42:21.273+0000 7fb6d0800640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-23T23:42:22.162 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-03-23T23:42:22.161+0000 7f75fe8d07c0 -1 osd.7 0 log_to_monitors true 2024-03-23T23:42:22.214 INFO:tasks.ceph.osd.2.smithi008.stderr:2024-03-23T23:42:22.213+0000 7fa9661c67c0 -1 osd.2 0 log_to_monitors true 2024-03-23T23:42:22.226 INFO:tasks.ceph.osd.0.smithi008.stderr:2024-03-23T23:42:22.225+0000 7f9c617c07c0 -1 osd.0 0 log_to_monitors true 2024-03-23T23:42:22.302 INFO:tasks.ceph.osd.1.smithi008.stderr:2024-03-23T23:42:22.301+0000 7fee4c8ed7c0 -1 osd.1 0 log_to_monitors true 2024-03-23T23:42:22.313 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-03-23T23:42:22.313+0000 7f3d69a467c0 -1 osd.6 0 log_to_monitors true 2024-03-23T23:42:22.335 INFO:tasks.ceph.osd.3.smithi008.stderr:2024-03-23T23:42:22.333+0000 7f159817c7c0 -1 osd.3 0 log_to_monitors true 2024-03-23T23:42:22.337 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-03-23T23:42:22.337+0000 7fd2021e17c0 -1 osd.4 0 log_to_monitors true 2024-03-23T23:42:22.378 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-03-23T23:42:22.377+0000 7f44daaa07c0 -1 osd.5 0 log_to_monitors true 2024-03-23T23:42:24.372 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-03-23T23:42:24.369+0000 7f75f9800640 -1 osd.7 0 waiting for initial osdmap 2024-03-23T23:42:24.528 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-03-23T23:42:24.525+0000 7f75ef800640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-23T23:42:24.720 INFO:tasks.ceph.osd.0.smithi008.stderr:2024-03-23T23:42:24.717+0000 7f9c5c600640 -1 osd.0 0 waiting for initial osdmap 2024-03-23T23:42:24.744 INFO:tasks.ceph.osd.1.smithi008.stderr:2024-03-23T23:42:24.741+0000 7fee47800640 -1 osd.1 0 waiting for initial osdmap 2024-03-23T23:42:24.747 INFO:tasks.ceph.osd.0.smithi008.stderr:2024-03-23T23:42:24.745+0000 7f9c52600640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-23T23:42:24.750 INFO:tasks.ceph.osd.2.smithi008.stderr:2024-03-23T23:42:24.749+0000 7fa961a00640 -1 osd.2 0 waiting for initial osdmap 2024-03-23T23:42:24.770 INFO:tasks.ceph.osd.1.smithi008.stderr:2024-03-23T23:42:24.769+0000 7fee3d800640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-23T23:42:24.786 INFO:tasks.ceph.osd.2.smithi008.stderr:2024-03-23T23:42:24.785+0000 7fa957000640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-23T23:42:25.505 INFO:tasks.ceph.osd.3.smithi008.stderr:2024-03-23T23:42:25.505+0000 7f1593000640 -1 osd.3 0 waiting for initial osdmap 2024-03-23T23:42:25.525 INFO:tasks.ceph.osd.3.smithi008.stderr:2024-03-23T23:42:25.525+0000 7f1589000640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-23T23:42:25.848 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-23T23:42:25.980 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.977+0000 7efc8e200640 1 Processor -- start 2024-03-23T23:42:25.980 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.977+0000 7efc8e200640 1 -- start start 2024-03-23T23:42:25.981 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.981+0000 7efc8e200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7efc881540b0 0x7efc88072020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:25.981 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.981+0000 7efc8e200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc88154540 con 0x7efc88072560 2024-03-23T23:42:25.981 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.981+0000 7efc8e200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc880ac4c0 con 0x7efc880aa3b0 2024-03-23T23:42:25.981 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.981+0000 7efc8e200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc880ac7a0 con 0x7efc881540b0 2024-03-23T23:42:25.981 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.981+0000 7efc7ea00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7efc881540b0 0x7efc88072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:25.981 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.981+0000 7efc87e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7efc88072560 0x7efc8815df40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42572/0 (socket says 172.21.15.8:42572) 2024-03-23T23:42:25.982 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.981+0000 7efc7ea00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7efc881540b0 0x7efc88072020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42418/0 (socket says 172.21.15.8:42418) 2024-03-23T23:42:25.982 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.981+0000 7efc87e00640 1 -- 172.21.15.8:0/3798945947 learned_addr learned my addr 172.21.15.8:0/3798945947 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:25.982 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.981+0000 7efc7ea00640 1 -- 172.21.15.8:0/3798945947 >> v1:172.21.15.196:6789/0 conn(0x7efc880aa3b0 legacy=0x7efc88150970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:25.982 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.981+0000 7efc7ea00640 1 -- 172.21.15.8:0/3798945947 >> v1:172.21.15.8:6789/0 conn(0x7efc88072560 legacy=0x7efc8815df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:25.982 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.981+0000 7efc7ea00640 1 -- 172.21.15.8:0/3798945947 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc880aca80 con 0x7efc881540b0 2024-03-23T23:42:25.985 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.985+0000 7efc7ea00640 1 --2- 172.21.15.8:0/3798945947 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc881540b0 0x7efc88072020 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efc700097c0 tx=0x7efc7001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=493ce884d6985585 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:25.985 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.985+0000 7efc86a00640 1 -- 172.21.15.8:0/3798945947 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc700b2070 con 0x7efc881540b0 2024-03-23T23:42:25.985 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.985+0000 7efc86a00640 1 -- 172.21.15.8:0/3798945947 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc700ad680 con 0x7efc881540b0 2024-03-23T23:42:25.985 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.985+0000 7efc86a00640 1 -- 172.21.15.8:0/3798945947 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc700ada50 con 0x7efc881540b0 2024-03-23T23:42:25.986 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.985+0000 7efc8e200640 1 -- 172.21.15.8:0/3798945947 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc881540b0 msgr2=0x7efc88072020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:25.986 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.985+0000 7efc8e200640 1 --2- 172.21.15.8:0/3798945947 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc881540b0 0x7efc88072020 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efc700097c0 tx=0x7efc7001c470 comp rx=0 tx=0).stop 2024-03-23T23:42:25.986 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.985+0000 7efc8e200640 1 -- 172.21.15.8:0/3798945947 shutdown_connections 2024-03-23T23:42:25.986 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.985+0000 7efc8e200640 1 --2- 172.21.15.8:0/3798945947 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc881540b0 0x7efc88072020 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:25.986 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.985+0000 7efc8e200640 1 -- 172.21.15.8:0/3798945947 >> 172.21.15.8:0/3798945947 conn(0x7efc880c7030 msgr2=0x7efc880c7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:25.986 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.985+0000 7efc8e200640 1 -- 172.21.15.8:0/3798945947 shutdown_connections 2024-03-23T23:42:25.986 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.985+0000 7efc8e200640 1 -- 172.21.15.8:0/3798945947 wait complete. 2024-03-23T23:42:25.987 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.985+0000 7efc8e200640 1 Processor -- start 2024-03-23T23:42:25.987 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.985+0000 7efc8e200640 1 -- start start 2024-03-23T23:42:25.989 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.985+0000 7efc8e200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc88072560 0x7efc881f00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:25.989 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.985+0000 7efc8e200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc880aa3b0 0x7efc881443f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:25.989 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.985+0000 7efc8e200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efc881540b0 0x7efc881461d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:25.989 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.985+0000 7efc8e200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc88151200 con 0x7efc880aa3b0 2024-03-23T23:42:25.989 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.985+0000 7efc8e200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc88151080 con 0x7efc88072560 2024-03-23T23:42:25.989 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.985+0000 7efc8e200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc880aa790 con 0x7efc881540b0 2024-03-23T23:42:25.989 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.985+0000 7efc7ea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc880aa3b0 0x7efc881443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:25.989 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.985+0000 7efc7ea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc880aa3b0 0x7efc881443f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42432/0 (socket says 172.21.15.8:42432) 2024-03-23T23:42:25.989 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.985+0000 7efc7ea00640 1 -- 172.21.15.8:0/2040905742 learned_addr learned my addr 172.21.15.8:0/2040905742 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:25.989 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.985+0000 7efc87400640 1 --2- 172.21.15.8:0/2040905742 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc88072560 0x7efc881f00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:25.990 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.989+0000 7efc87e00640 1 --2- 172.21.15.8:0/2040905742 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efc881540b0 0x7efc881461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:25.990 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.989+0000 7efc7ea00640 1 -- 172.21.15.8:0/2040905742 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efc881540b0 msgr2=0x7efc881461d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:25.990 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.989+0000 7efc7ea00640 1 --2- 172.21.15.8:0/2040905742 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efc881540b0 0x7efc881461d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:25.990 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.989+0000 7efc7ea00640 1 -- 172.21.15.8:0/2040905742 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc88072560 msgr2=0x7efc881f00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:25.990 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.989+0000 7efc7ea00640 1 --2- 172.21.15.8:0/2040905742 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc88072560 0x7efc881f00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:25.990 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.989+0000 7efc7ea00640 1 -- 172.21.15.8:0/2040905742 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc881557f0 con 0x7efc880aa3b0 2024-03-23T23:42:25.990 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.989+0000 7efc87e00640 1 --2- 172.21.15.8:0/2040905742 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efc881540b0 0x7efc881461d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:42:25.990 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.989+0000 7efc7ea00640 1 --2- 172.21.15.8:0/2040905742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc880aa3b0 0x7efc881443f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efc7001a0a0 tx=0x7efc7001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:25.991 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.989+0000 7efc7fe00640 1 -- 172.21.15.8:0/2040905742 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc700b2040 con 0x7efc880aa3b0 2024-03-23T23:42:25.992 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.989+0000 7efc7fe00640 1 -- 172.21.15.8:0/2040905742 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc700bd070 con 0x7efc880aa3b0 2024-03-23T23:42:25.992 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.989+0000 7efc7fe00640 1 -- 172.21.15.8:0/2040905742 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc700b8450 con 0x7efc880aa3b0 2024-03-23T23:42:25.992 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.989+0000 7efc8e200640 1 -- 172.21.15.8:0/2040905742 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc88155ad0 con 0x7efc880aa3b0 2024-03-23T23:42:25.992 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.989+0000 7efc8e200640 1 -- 172.21.15.8:0/2040905742 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc8814bd10 con 0x7efc880aa3b0 2024-03-23T23:42:25.992 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.989+0000 7efc8e200640 1 -- 172.21.15.8:0/2040905742 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc8804f410 con 0x7efc880aa3b0 2024-03-23T23:42:25.992 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.989+0000 7efc7fe00640 1 -- 172.21.15.8:0/2040905742 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 87027+0+0 (secure 0 0 0) 0x7efc700b85f0 con 0x7efc880aa3b0 2024-03-23T23:42:25.992 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.989+0000 7efc7fe00640 1 --2- 172.21.15.8:0/2040905742 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7efc640675d0 0x7efc64069a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:25.993 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.989+0000 7efc7fe00640 1 -- 172.21.15.8:0/2040905742 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3351+0+0 (secure 0 0 0) 0x7efc7011f270 con 0x7efc880aa3b0 2024-03-23T23:42:25.993 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.993+0000 7efc87400640 1 --2- 172.21.15.8:0/2040905742 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7efc640675d0 0x7efc64069a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:25.993 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.993+0000 7efc87400640 1 --2- 172.21.15.8:0/2040905742 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7efc640675d0 0x7efc64069a90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efc78001650 tx=0x7efc78009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:25.996 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:25.997+0000 7efc7fe00640 1 -- 172.21.15.8:0/2040905742 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7efc70016090 con 0x7efc880aa3b0 2024-03-23T23:42:26.125 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-03-23T23:42:26.125+0000 7f44d5a00640 -1 osd.5 0 waiting for initial osdmap 2024-03-23T23:42:26.151 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-03-23T23:42:26.149+0000 7f44cba00640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-23T23:42:26.159 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:26.157+0000 7efc8e200640 1 -- 172.21.15.8:0/2040905742 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc8815f440 con 0x7efc880aa3b0 2024-03-23T23:42:26.159 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:26.157+0000 7efc7fe00640 1 -- 172.21.15.8:0/2040905742 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+8941 (secure 0 0 0) 0x7efc700f08f0 con 0x7efc880aa3b0 2024-03-23T23:42:26.159 INFO:teuthology.misc.health.smithi008.stdout: 2024-03-23T23:42:26.160 INFO:teuthology.misc.health.smithi008.stdout:{"epoch":14,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","created":"2024-03-23T23:42:15.169430+0000","modified":"2024-03-23T23:42:25.388398+0000","last_up_change":"2024-03-23T23:42:25.388398+0000","last_in_change":"2024-03-23T23:42:17.662330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e967bf31-21d6-4d11-bc3d-0df8177a1b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6809","nonce":2187201732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6811","nonce":2187201732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6815","nonce":2187201732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6813","nonce":2187201732}]},"public_addr":"172.21.15.8:6809/2187201732","cluster_addr":"172.21.15.8:6811/2187201732","heartbeat_back_addr":"172.21.15.8:6815/2187201732","heartbeat_front_addr":"172.21.15.8:6813/2187201732","state":["exists","up"]},{"osd":1,"uuid":"c8e33701-7acd-4474-8402-d52461171fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6818","nonce":3205168010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6822","nonce":3205168010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6830","nonce":3205168010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6826","nonce":3205168010}]},"public_addr":"172.21.15.8:6818/3205168010","cluster_addr":"172.21.15.8:6822/3205168010","heartbeat_back_addr":"172.21.15.8:6830/3205168010","heartbeat_front_addr":"172.21.15.8:6826/3205168010","state":["exists","up"]},{"osd":2,"uuid":"ceebdbf7-4c2f-4757-b52d-fd8b20e77570","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6801","nonce":475463656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6803","nonce":475463656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6807","nonce":475463656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6805","nonce":475463656}]},"public_addr":"172.21.15.8:6801/475463656","cluster_addr":"172.21.15.8:6803/475463656","heartbeat_back_addr":"172.21.15.8:6807/475463656","heartbeat_front_addr":"172.21.15.8:6805/475463656","state":["exists","up"]},{"osd":3,"uuid":"89e258da-5767-429e-8441-edf877d2f3cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2b7451ae-ea16-4f0a-ae50-04fde75e45ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e68a8914-e591-466a-bc9e-f2d7c67aac13","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e47723c5-50a0-4cd8-92d9-01972072b422","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e1e9113d-8005-47b3-9a75-9e701199f1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6817","nonce":4151820349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6819","nonce":4151820349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6823","nonce":4151820349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6821","nonce":4151820349}]},"public_addr":"172.21.15.196:6817/4151820349","cluster_addr":"172.21.15.196:6819/4151820349","heartbeat_back_addr":"172.21.15.196:6823/4151820349","heartbeat_front_addr":"172.21.15.196:6821/4151820349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:42:26.162 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:26.161+0000 7efc8e200640 1 -- 172.21.15.8:0/2040905742 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7efc640675d0 msgr2=0x7efc64069a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:26.162 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:26.161+0000 7efc8e200640 1 --2- 172.21.15.8:0/2040905742 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7efc640675d0 0x7efc64069a90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efc78001650 tx=0x7efc78009040 comp rx=0 tx=0).stop 2024-03-23T23:42:26.162 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:26.161+0000 7efc8e200640 1 -- 172.21.15.8:0/2040905742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc880aa3b0 msgr2=0x7efc881443f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:26.162 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:26.161+0000 7efc8e200640 1 --2- 172.21.15.8:0/2040905742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc880aa3b0 0x7efc881443f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efc7001a0a0 tx=0x7efc7001acb0 comp rx=0 tx=0).stop 2024-03-23T23:42:26.162 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:26.161+0000 7efc8e200640 1 -- 172.21.15.8:0/2040905742 shutdown_connections 2024-03-23T23:42:26.162 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:26.161+0000 7efc8e200640 1 --2- 172.21.15.8:0/2040905742 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7efc640675d0 0x7efc64069a90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:26.162 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:26.161+0000 7efc8e200640 1 --2- 172.21.15.8:0/2040905742 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efc881540b0 0x7efc881461d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:26.162 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:26.161+0000 7efc8e200640 1 --2- 172.21.15.8:0/2040905742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc880aa3b0 0x7efc881443f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:26.162 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:26.161+0000 7efc8e200640 1 --2- 172.21.15.8:0/2040905742 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc88072560 0x7efc881f00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:26.162 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:26.161+0000 7efc8e200640 1 -- 172.21.15.8:0/2040905742 >> 172.21.15.8:0/2040905742 conn(0x7efc880c7030 msgr2=0x7efc880c6110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:26.162 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:26.161+0000 7efc8e200640 1 -- 172.21.15.8:0/2040905742 shutdown_connections 2024-03-23T23:42:26.163 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:26.161+0000 7efc8e200640 1 -- 172.21.15.8:0/2040905742 wait complete. 2024-03-23T23:42:26.167 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-03-23T23:42:26.165+0000 7f3d64a00640 -1 osd.6 0 waiting for initial osdmap 2024-03-23T23:42:26.181 DEBUG:teuthology.misc:4 of 8 OSDs are up 2024-03-23T23:42:26.195 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-03-23T23:42:26.193+0000 7fd1fd000640 -1 osd.4 0 waiting for initial osdmap 2024-03-23T23:42:26.213 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-03-23T23:42:26.213+0000 7f3d5aa00640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-23T23:42:26.226 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-03-23T23:42:26.225+0000 7fd1f3000640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-23T23:42:32.988 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-23T23:42:33.130 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.129+0000 7f1bc5400640 1 Processor -- start 2024-03-23T23:42:33.130 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.129+0000 7f1bc5400640 1 -- start start 2024-03-23T23:42:33.133 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.129+0000 7f1bc5400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1bc0071a50 0x7f1bc00721c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:33.133 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.129+0000 7f1bc5400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bc0072700 0x7f1bc015ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:33.133 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.129+0000 7f1bc5400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc014ff10 con 0x7f1bc014fb30 2024-03-23T23:42:33.133 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.129+0000 7f1bc5400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc0152650 con 0x7f1bc0071a50 2024-03-23T23:42:33.133 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.129+0000 7f1bc5400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc0071ee0 con 0x7f1bc0072700 2024-03-23T23:42:33.133 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.129+0000 7f1bbe800640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f1bc014fb30 0x7f1bc006ca50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42380/0 (socket says 172.21.15.8:42380) 2024-03-23T23:42:33.134 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.129+0000 7f1bbe800640 1 -- 172.21.15.8:0/517214831 learned_addr learned my addr 172.21.15.8:0/517214831 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:33.134 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.129+0000 7f1bb5e00640 1 --2- 172.21.15.8:0/517214831 >> v2:172.21.15.196:3300/0 conn(0x7f1bc0071a50 0x7f1bc00721c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:33.134 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.129+0000 7f1bbde00640 1 -- 172.21.15.8:0/517214831 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1131667448 0 0) 0x7f1bb0001120 con 0x7f1bc014fb30 2024-03-23T23:42:33.134 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.129+0000 7f1bbf200640 1 --2- 172.21.15.8:0/517214831 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bc0072700 0x7f1bc015ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:33.134 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.129+0000 7f1bbde00640 1 -- 172.21.15.8:0/517214831 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ba4003530 con 0x7f1bc014fb30 2024-03-23T23:42:33.134 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.129+0000 7f1bbde00640 1 -- 172.21.15.8:0/517214831 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1377846335 0 0) 0x7f1ba4003530 con 0x7f1bc014fb30 2024-03-23T23:42:33.134 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.129+0000 7f1bbde00640 1 -- 172.21.15.8:0/517214831 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bc0072700 msgr2=0x7f1bc015ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:33.134 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.129+0000 7f1bbde00640 1 --2- 172.21.15.8:0/517214831 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bc0072700 0x7f1bc015ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:33.134 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.129+0000 7f1bbde00640 1 -- 172.21.15.8:0/517214831 >> v2:172.21.15.196:3300/0 conn(0x7f1bc0071a50 msgr2=0x7f1bc00721c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:33.134 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.129+0000 7f1bbde00640 1 --2- 172.21.15.8:0/517214831 >> v2:172.21.15.196:3300/0 conn(0x7f1bc0071a50 0x7f1bc00721c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:33.134 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.129+0000 7f1bbde00640 1 -- 172.21.15.8:0/517214831 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc0070f70 con 0x7f1bc014fb30 2024-03-23T23:42:33.134 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.129+0000 7f1bbde00640 1 -- 172.21.15.8:0/517214831 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7f1bb0001870 con 0x7f1bc014fb30 2024-03-23T23:42:33.134 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.129+0000 7f1bbde00640 1 -- 172.21.15.8:0/517214831 >> v1:172.21.15.8:6789/0 conn(0x7f1bc014fb30 legacy=0x7f1bc006ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:33.135 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.129+0000 7f1bbde00640 1 --2- 172.21.15.8:0/517214831 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ba40039c0 0x7f1ba4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:33.135 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.129+0000 7f1bbde00640 1 --2- 172.21.15.8:0/517214831 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bc0072700 0x7f1ba4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:33.135 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.129+0000 7f1bbde00640 1 --2- 172.21.15.8:0/517214831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ba4004d50 0x7f1ba40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:33.135 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.129+0000 7f1bbde00640 1 -- 172.21.15.8:0/517214831 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc0152650 con 0x7f1ba4004d50 2024-03-23T23:42:33.135 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.129+0000 7f1bbde00640 1 -- 172.21.15.8:0/517214831 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc0071ee0 con 0x7f1ba40039c0 2024-03-23T23:42:33.135 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.129+0000 7f1bbde00640 1 -- 172.21.15.8:0/517214831 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba400ba80 con 0x7f1bc0072700 2024-03-23T23:42:33.135 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.133+0000 7f1bbf200640 1 --2- 172.21.15.8:0/517214831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ba4004d50 0x7f1ba40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:33.135 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.133+0000 7f1bbe800640 1 --2- 172.21.15.8:0/517214831 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ba40039c0 0x7f1ba4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:33.135 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.133+0000 7f1bb5e00640 1 --2- 172.21.15.8:0/517214831 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bc0072700 0x7f1ba4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:33.135 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.133+0000 7f1bbf200640 1 -- 172.21.15.8:0/517214831 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bc0072700 msgr2=0x7f1ba4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:33.135 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.133+0000 7f1bbf200640 1 --2- 172.21.15.8:0/517214831 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bc0072700 0x7f1ba4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:33.135 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.133+0000 7f1bbf200640 1 -- 172.21.15.8:0/517214831 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ba40039c0 msgr2=0x7f1ba4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:33.135 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.133+0000 7f1bbf200640 1 --2- 172.21.15.8:0/517214831 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ba40039c0 0x7f1ba4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:33.135 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.133+0000 7f1bbf200640 1 -- 172.21.15.8:0/517214831 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba4003530 con 0x7f1ba4004d50 2024-03-23T23:42:33.137 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.133+0000 7f1bbf200640 1 --2- 172.21.15.8:0/517214831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ba4004d50 0x7f1ba40051d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8009fc0 tx=0x7f1bb801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acdaf53e02cf704 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:33.137 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.133+0000 7f1bbde00640 1 -- 172.21.15.8:0/517214831 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb80b2070 con 0x7f1ba4004d50 2024-03-23T23:42:33.137 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.133+0000 7f1bbde00640 1 -- 172.21.15.8:0/517214831 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb80a5a70 con 0x7f1ba4004d50 2024-03-23T23:42:33.137 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.133+0000 7f1bbde00640 1 -- 172.21.15.8:0/517214831 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8009c10 con 0x7f1ba4004d50 2024-03-23T23:42:33.137 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.137+0000 7f1bc5400640 1 -- 172.21.15.8:0/517214831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ba4004d50 msgr2=0x7f1ba40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:33.137 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.137+0000 7f1bc5400640 1 --2- 172.21.15.8:0/517214831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ba4004d50 0x7f1ba40051d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8009fc0 tx=0x7f1bb801cc80 comp rx=0 tx=0).stop 2024-03-23T23:42:33.138 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.137+0000 7f1bbf200640 1 -- 172.21.15.8:0/517214831 reap_dead start 2024-03-23T23:42:33.138 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.137+0000 7f1bc5400640 1 -- 172.21.15.8:0/517214831 shutdown_connections 2024-03-23T23:42:33.138 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.137+0000 7f1bc5400640 1 -- 172.21.15.8:0/517214831 >> 172.21.15.8:0/517214831 conn(0x7f1bc00c7030 msgr2=0x7f1bc00c7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:33.138 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.137+0000 7f1bc5400640 1 -- 172.21.15.8:0/517214831 shutdown_connections 2024-03-23T23:42:33.138 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.137+0000 7f1bc5400640 1 -- 172.21.15.8:0/517214831 wait complete. 2024-03-23T23:42:33.139 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.137+0000 7f1bc5400640 1 Processor -- start 2024-03-23T23:42:33.139 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.137+0000 7f1bc5400640 1 -- start start 2024-03-23T23:42:33.140 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.137+0000 7f1bc5400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ba4004d50 0x7f1bc0154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:33.140 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.137+0000 7f1bc5400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bc0151710 0x7f1bc0144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:33.140 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.137+0000 7f1bc5400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bc0153670 0x7f1bc01450b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:33.140 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.137+0000 7f1bc5400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc00c15d0 con 0x7f1bc0153670 2024-03-23T23:42:33.140 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.137+0000 7f1bc5400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc00aa950 con 0x7f1ba4004d50 2024-03-23T23:42:33.141 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.137+0000 7f1bc5400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc00c1750 con 0x7f1bc0151710 2024-03-23T23:42:33.141 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.137+0000 7f1bbf200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bc0153670 0x7f1bc01450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:33.141 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.137+0000 7f1bbe800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ba4004d50 0x7f1bc0154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:33.141 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.137+0000 7f1bbf200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bc0153670 0x7f1bc01450b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57604/0 (socket says 172.21.15.8:57604) 2024-03-23T23:42:33.141 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.137+0000 7f1bbf200640 1 -- 172.21.15.8:0/523509382 learned_addr learned my addr 172.21.15.8:0/523509382 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:33.141 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.137+0000 7f1bb5e00640 1 --2- 172.21.15.8:0/523509382 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bc0151710 0x7f1bc0144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:33.141 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.137+0000 7f1bbf200640 1 -- 172.21.15.8:0/523509382 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bc0151710 msgr2=0x7f1bc0144b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:33.141 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.137+0000 7f1bbf200640 1 --2- 172.21.15.8:0/523509382 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bc0151710 0x7f1bc0144b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:33.141 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.137+0000 7f1bbf200640 1 -- 172.21.15.8:0/523509382 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ba4004d50 msgr2=0x7f1bc0154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:33.141 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.137+0000 7f1bbf200640 1 --2- 172.21.15.8:0/523509382 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ba4004d50 0x7f1bc0154060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:33.141 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.137+0000 7f1bbf200640 1 -- 172.21.15.8:0/523509382 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc01531c0 con 0x7f1bc0153670 2024-03-23T23:42:33.142 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.141+0000 7f1bbf200640 1 --2- 172.21.15.8:0/523509382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bc0153670 0x7f1bc01450b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80b0040 tx=0x7f1bb8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:33.142 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.141+0000 7f1bb7400640 1 -- 172.21.15.8:0/523509382 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb80bd070 con 0x7f1bc0153670 2024-03-23T23:42:33.142 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.141+0000 7f1bb7400640 1 -- 172.21.15.8:0/523509382 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb80a5870 con 0x7f1bc0153670 2024-03-23T23:42:33.142 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.141+0000 7f1bb7400640 1 -- 172.21.15.8:0/523509382 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb80b2040 con 0x7f1bc0153670 2024-03-23T23:42:33.142 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.141+0000 7f1bc5400640 1 -- 172.21.15.8:0/523509382 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc0151e80 con 0x7f1bc0153670 2024-03-23T23:42:33.142 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.141+0000 7f1bc5400640 1 -- 172.21.15.8:0/523509382 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc0150f10 con 0x7f1bc0153670 2024-03-23T23:42:33.143 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.141+0000 7f1bc5400640 1 -- 172.21.15.8:0/523509382 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc004f410 con 0x7f1bc0153670 2024-03-23T23:42:33.143 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.141+0000 7f1bb7400640 1 -- 172.21.15.8:0/523509382 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f1bb80c0070 con 0x7f1bc0153670 2024-03-23T23:42:33.144 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.141+0000 7f1bb7400640 1 --2- 172.21.15.8:0/523509382 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1b9c0675d0 0x7f1b9c069a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:33.144 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.145+0000 7f1bb7400640 1 -- 172.21.15.8:0/523509382 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1bb811f090 con 0x7f1bc0153670 2024-03-23T23:42:33.145 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.145+0000 7f1bbe800640 1 --2- 172.21.15.8:0/523509382 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1b9c0675d0 0x7f1b9c069a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:33.145 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.145+0000 7f1bbe800640 1 --2- 172.21.15.8:0/523509382 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1b9c0675d0 0x7f1b9c069a90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0007fd0 tx=0x7f1bb0007af0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:33.150 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.149+0000 7f1bb7400640 1 -- 172.21.15.8:0/523509382 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f1bb8016990 con 0x7f1bc0153670 2024-03-23T23:42:33.315 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.313+0000 7f1bc5400640 1 -- 172.21.15.8:0/523509382 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1bc00c1c50 con 0x7f1bc0153670 2024-03-23T23:42:33.316 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.313+0000 7f1bb7400640 1 -- 172.21.15.8:0/523509382 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12812 (secure 0 0 0) 0x7f1bb80efac0 con 0x7f1bc0153670 2024-03-23T23:42:33.316 INFO:teuthology.misc.health.smithi008.stdout: 2024-03-23T23:42:33.316 INFO:teuthology.misc.health.smithi008.stdout:{"epoch":17,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","created":"2024-03-23T23:42:15.169430+0000","modified":"2024-03-23T23:42:28.518488+0000","last_up_change":"2024-03-23T23:42:26.509742+0000","last_in_change":"2024-03-23T23:42:17.662330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:42:26.327445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e967bf31-21d6-4d11-bc3d-0df8177a1b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6809","nonce":2187201732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6811","nonce":2187201732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6815","nonce":2187201732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6813","nonce":2187201732}]},"public_addr":"172.21.15.8:6809/2187201732","cluster_addr":"172.21.15.8:6811/2187201732","heartbeat_back_addr":"172.21.15.8:6815/2187201732","heartbeat_front_addr":"172.21.15.8:6813/2187201732","state":["exists","up"]},{"osd":1,"uuid":"c8e33701-7acd-4474-8402-d52461171fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6818","nonce":3205168010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6822","nonce":3205168010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6830","nonce":3205168010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6826","nonce":3205168010}]},"public_addr":"172.21.15.8:6818/3205168010","cluster_addr":"172.21.15.8:6822/3205168010","heartbeat_back_addr":"172.21.15.8:6830/3205168010","heartbeat_front_addr":"172.21.15.8:6826/3205168010","state":["exists","up"]},{"osd":2,"uuid":"ceebdbf7-4c2f-4757-b52d-fd8b20e77570","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6801","nonce":475463656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6803","nonce":475463656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6807","nonce":475463656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6805","nonce":475463656}]},"public_addr":"172.21.15.8:6801/475463656","cluster_addr":"172.21.15.8:6803/475463656","heartbeat_back_addr":"172.21.15.8:6807/475463656","heartbeat_front_addr":"172.21.15.8:6805/475463656","state":["exists","up"]},{"osd":3,"uuid":"89e258da-5767-429e-8441-edf877d2f3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6819","nonce":1514082871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6821","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6823","nonce":1514082871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6829","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6831","nonce":1514082871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6825","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6827","nonce":1514082871}]},"public_addr":"172.21.15.8:6819/1514082871","cluster_addr":"172.21.15.8:6823/1514082871","heartbeat_back_addr":"172.21.15.8:6831/1514082871","heartbeat_front_addr":"172.21.15.8:6827/1514082871","state":["exists","up"]},{"osd":4,"uuid":"2b7451ae-ea16-4f0a-ae50-04fde75e45ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6825","nonce":3516578147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6827","nonce":3516578147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6831","nonce":3516578147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6829","nonce":3516578147}]},"public_addr":"172.21.15.196:6825/3516578147","cluster_addr":"172.21.15.196:6827/3516578147","heartbeat_back_addr":"172.21.15.196:6831/3516578147","heartbeat_front_addr":"172.21.15.196:6829/3516578147","state":["exists","up"]},{"osd":5,"uuid":"e68a8914-e591-466a-bc9e-f2d7c67aac13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6802","nonce":830595758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6806","nonce":830595758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6814","nonce":830595758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6810","nonce":830595758}]},"public_addr":"172.21.15.196:6802/830595758","cluster_addr":"172.21.15.196:6806/830595758","heartbeat_back_addr":"172.21.15.196:6814/830595758","heartbeat_front_addr":"172.21.15.196:6810/830595758","state":["exists","up"]},{"osd":6,"uuid":"e47723c5-50a0-4cd8-92d9-01972072b422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6801","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6803","nonce":472639906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6805","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6807","nonce":472639906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6815","nonce":472639906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6811","nonce":472639906}]},"public_addr":"172.21.15.196:6803/472639906","cluster_addr":"172.21.15.196:6807/472639906","heartbeat_back_addr":"172.21.15.196:6815/472639906","heartbeat_front_addr":"172.21.15.196:6811/472639906","state":["exists","up"]},{"osd":7,"uuid":"e1e9113d-8005-47b3-9a75-9e701199f1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6817","nonce":4151820349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6819","nonce":4151820349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6823","nonce":4151820349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6821","nonce":4151820349}]},"public_addr":"172.21.15.196:6817/4151820349","cluster_addr":"172.21.15.196:6819/4151820349","heartbeat_back_addr":"172.21.15.196:6823/4151820349","heartbeat_front_addr":"172.21.15.196:6821/4151820349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.221790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.265974+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.190319+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.376359+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.329657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.402958+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.300703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.133121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:42:33.318 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.317+0000 7f1bc5400640 1 -- 172.21.15.8:0/523509382 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1b9c0675d0 msgr2=0x7f1b9c069a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:33.318 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.317+0000 7f1bc5400640 1 --2- 172.21.15.8:0/523509382 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1b9c0675d0 0x7f1b9c069a90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0007fd0 tx=0x7f1bb0007af0 comp rx=0 tx=0).stop 2024-03-23T23:42:33.319 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.317+0000 7f1bc5400640 1 -- 172.21.15.8:0/523509382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bc0153670 msgr2=0x7f1bc01450b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:33.319 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.317+0000 7f1bc5400640 1 --2- 172.21.15.8:0/523509382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bc0153670 0x7f1bc01450b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80b0040 tx=0x7f1bb8009750 comp rx=0 tx=0).stop 2024-03-23T23:42:33.319 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.317+0000 7f1bc5400640 1 -- 172.21.15.8:0/523509382 shutdown_connections 2024-03-23T23:42:33.319 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.317+0000 7f1bc5400640 1 --2- 172.21.15.8:0/523509382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bc0153670 0x7f1bc01450b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:33.319 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.317+0000 7f1bc5400640 1 --2- 172.21.15.8:0/523509382 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1b9c0675d0 0x7f1b9c069a90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:33.319 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.317+0000 7f1bc5400640 1 --2- 172.21.15.8:0/523509382 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bc0151710 0x7f1bc0144b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:33.319 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.317+0000 7f1bc5400640 1 --2- 172.21.15.8:0/523509382 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ba4004d50 0x7f1bc0154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:33.319 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.317+0000 7f1bc5400640 1 -- 172.21.15.8:0/523509382 >> 172.21.15.8:0/523509382 conn(0x7f1bc00c7030 msgr2=0x7f1bc014ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:33.319 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.317+0000 7f1bc5400640 1 -- 172.21.15.8:0/523509382 shutdown_connections 2024-03-23T23:42:33.319 INFO:teuthology.misc.health.smithi008.stderr:2024-03-23T23:42:33.317+0000 7f1bc5400640 1 -- 172.21.15.8:0/523509382 wait complete. 2024-03-23T23:42:33.336 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-23T23:42:33.336 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-23T23:42:33.336 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-23T23:42:33.336 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-23T23:42:33.339 INFO:tasks.ceph.mds.a:Started 2024-03-23T23:42:33.339 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-23T23:42:33.339 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-23T23:42:33.342 INFO:tasks.ceph.mds.c:Started 2024-03-23T23:42:33.342 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-23T23:42:33.343 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-23T23:42:33.346 INFO:tasks.ceph.mds.b:Started 2024-03-23T23:42:33.346 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-23T23:42:33.346 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-23T23:42:33.349 INFO:tasks.ceph.mds.d:Started 2024-03-23T23:42:33.350 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-23T23:42:33.350 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:42:33.440 INFO:tasks.ceph.mds.c.smithi008.stdout:starting mds.c at 2024-03-23T23:42:33.441 INFO:tasks.ceph.mds.a.smithi008.stdout:starting mds.a at 2024-03-23T23:42:33.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.497+0000 7f8531c00640 1 Processor -- start 2024-03-23T23:42:33.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.497+0000 7f8531c00640 1 -- start start 2024-03-23T23:42:33.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.497+0000 7f8531c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f852c156ee0 0x7f852c073230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:33.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.497+0000 7f8531c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f852c0ac270 0x7f852c0ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:33.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.497+0000 7f8531c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f852c073770 con 0x7f852c149bd0 2024-03-23T23:42:33.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.497+0000 7f8531c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f852c0aa390 con 0x7f852c156ee0 2024-03-23T23:42:33.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.497+0000 7f8531c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f852c06e720 con 0x7f852c0ac270 2024-03-23T23:42:33.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.497+0000 7f852aa00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f852c156ee0 0x7f852c073230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:33.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.497+0000 7f852aa00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f852c156ee0 0x7f852c073230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:58860/0 (socket says 172.21.15.8:58860) 2024-03-23T23:42:33.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.497+0000 7f852b400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f852c0ac270 0x7f852c0ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:33.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.497+0000 7f852aa00640 1 -- 172.21.15.8:0/2267857889 learned_addr learned my addr 172.21.15.8:0/2267857889 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:33.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.497+0000 7f852b400640 1 -- 172.21.15.8:0/2267857889 >> v2:172.21.15.196:3300/0 conn(0x7f852c156ee0 msgr2=0x7f852c073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:33.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.497+0000 7f852b400640 1 --2- 172.21.15.8:0/2267857889 >> v2:172.21.15.196:3300/0 conn(0x7f852c156ee0 0x7f852c073230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:33.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.497+0000 7f852b400640 1 -- 172.21.15.8:0/2267857889 >> v1:172.21.15.196:6789/0 conn(0x7f852c149bd0 legacy=0x7f852c14a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:33.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.497+0000 7f852b400640 1 -- 172.21.15.8:0/2267857889 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852c06ea00 con 0x7f852c0ac270 2024-03-23T23:42:33.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.501+0000 7f852b400640 1 --2- 172.21.15.8:0/2267857889 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f852c0ac270 0x7f852c0ac6e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8524009d90 tx=0x7f852401c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18e3cd0643c3f290 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:33.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.501+0000 7f852a000640 1 -- 172.21.15.8:0/2267857889 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85240b2070 con 0x7f852c0ac270 2024-03-23T23:42:33.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.501+0000 7f852a000640 1 -- 172.21.15.8:0/2267857889 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85240a5970 con 0x7f852c0ac270 2024-03-23T23:42:33.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.501+0000 7f852a000640 1 -- 172.21.15.8:0/2267857889 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85240a5d40 con 0x7f852c0ac270 2024-03-23T23:42:33.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.501+0000 7f8531c00640 1 -- 172.21.15.8:0/2267857889 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f852c0ac270 msgr2=0x7f852c0ac6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:33.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.501+0000 7f8531c00640 1 --2- 172.21.15.8:0/2267857889 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f852c0ac270 0x7f852c0ac6e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8524009d90 tx=0x7f852401c8b0 comp rx=0 tx=0).stop 2024-03-23T23:42:33.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.501+0000 7f8531c00640 1 -- 172.21.15.8:0/2267857889 shutdown_connections 2024-03-23T23:42:33.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.501+0000 7f8531c00640 1 --2- 172.21.15.8:0/2267857889 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f852c0ac270 0x7f852c0ac6e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:33.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.501+0000 7f8531c00640 1 --2- 172.21.15.8:0/2267857889 >> v2:172.21.15.196:3300/0 conn(0x7f852c156ee0 0x7f852c073230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:33.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.501+0000 7f8531c00640 1 -- 172.21.15.8:0/2267857889 >> 172.21.15.8:0/2267857889 conn(0x7f852c06b170 msgr2=0x7f852c06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:33.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.501+0000 7f8531c00640 1 -- 172.21.15.8:0/2267857889 shutdown_connections 2024-03-23T23:42:33.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.501+0000 7f8531c00640 1 -- 172.21.15.8:0/2267857889 wait complete. 2024-03-23T23:42:33.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.505+0000 7f8531c00640 1 Processor -- start 2024-03-23T23:42:33.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.505+0000 7f8531c00640 1 -- start start 2024-03-23T23:42:33.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.505+0000 7f8531c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f852c0ac270 0x7f852c150450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:33.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.505+0000 7f8531c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f852c149bd0 0x7f852c0c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:33.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.505+0000 7f8531c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f852c156ee0 0x7f852c146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:33.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.505+0000 7f8531c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852c1579f0 con 0x7f852c149bd0 2024-03-23T23:42:33.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.505+0000 7f8531c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852c157870 con 0x7f852c156ee0 2024-03-23T23:42:33.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.505+0000 7f8531c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f852c1572c0 con 0x7f852c0ac270 2024-03-23T23:42:33.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.505+0000 7f8523e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f852c149bd0 0x7f852c0c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:33.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.505+0000 7f8523e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f852c149bd0 0x7f852c0c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57626/0 (socket says 172.21.15.8:57626) 2024-03-23T23:42:33.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.505+0000 7f8523e00640 1 -- 172.21.15.8:0/3385106540 learned_addr learned my addr 172.21.15.8:0/3385106540 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:33.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.505+0000 7f852b400640 1 --2- 172.21.15.8:0/3385106540 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f852c156ee0 0x7f852c146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:33.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.505+0000 7f852aa00640 1 --2- 172.21.15.8:0/3385106540 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f852c0ac270 0x7f852c150450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:33.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.505+0000 7f8523e00640 1 -- 172.21.15.8:0/3385106540 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f852c0ac270 msgr2=0x7f852c150450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:33.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.505+0000 7f8523e00640 1 --2- 172.21.15.8:0/3385106540 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f852c0ac270 0x7f852c150450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:33.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.505+0000 7f8523e00640 1 -- 172.21.15.8:0/3385106540 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f852c156ee0 msgr2=0x7f852c146f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:33.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.505+0000 7f8523e00640 1 --2- 172.21.15.8:0/3385106540 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f852c156ee0 0x7f852c146f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:33.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.505+0000 7f8523e00640 1 -- 172.21.15.8:0/3385106540 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852c141190 con 0x7f852c149bd0 2024-03-23T23:42:33.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.505+0000 7f8523e00640 1 --2- 172.21.15.8:0/3385106540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f852c149bd0 0x7f852c0c06d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f851400c420 tx=0x7f851400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:33.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.505+0000 7f8522a00640 1 -- 172.21.15.8:0/3385106540 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85140052d0 con 0x7f852c149bd0 2024-03-23T23:42:33.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.505+0000 7f8522a00640 1 -- 172.21.15.8:0/3385106540 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8514005470 con 0x7f852c149bd0 2024-03-23T23:42:33.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.505+0000 7f8522a00640 1 -- 172.21.15.8:0/3385106540 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8514007260 con 0x7f852c149bd0 2024-03-23T23:42:33.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.505+0000 7f8531c00640 1 -- 172.21.15.8:0/3385106540 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f852c0c0d40 con 0x7f852c149bd0 2024-03-23T23:42:33.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.505+0000 7f8531c00640 1 -- 172.21.15.8:0/3385106540 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f852c0729b0 con 0x7f852c149bd0 2024-03-23T23:42:33.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.505+0000 7f8531c00640 1 -- 172.21.15.8:0/3385106540 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f852c068270 con 0x7f852c149bd0 2024-03-23T23:42:33.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.509+0000 7f8522a00640 1 -- 172.21.15.8:0/3385106540 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f8514007400 con 0x7f852c149bd0 2024-03-23T23:42:33.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.509+0000 7f8522a00640 1 --2- 172.21.15.8:0/3385106540 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8508067660 0x7f8508069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:33.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.509+0000 7f8522a00640 1 -- 172.21.15.8:0/3385106540 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8514084990 con 0x7f852c149bd0 2024-03-23T23:42:33.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.509+0000 7f852aa00640 1 --2- 172.21.15.8:0/3385106540 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8508067660 0x7f8508069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:33.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.509+0000 7f852aa00640 1 --2- 172.21.15.8:0/3385106540 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8508067660 0x7f8508069b20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f851c009ab0 tx=0x7f851c009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:33.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.513+0000 7f8522a00640 1 -- 172.21.15.8:0/3385106540 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f8514055300 con 0x7f852c149bd0 2024-03-23T23:42:33.528 INFO:tasks.ceph.mds.b.smithi196.stdout:starting mds.b at 2024-03-23T23:42:33.529 INFO:tasks.ceph.mds.d.smithi196.stdout:starting mds.d at 2024-03-23T23:42:33.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.681+0000 7f8531c00640 1 -- 172.21.15.8:0/3385106540 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f852c0c1020 con 0x7f852c149bd0 2024-03-23T23:42:33.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.681+0000 7f8522a00640 1 -- 172.21.15.8:0/3385106540 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12812 (secure 0 0 0) 0x7f85140593a0 con 0x7f852c149bd0 2024-03-23T23:42:33.682 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:42:33.682 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":17,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","created":"2024-03-23T23:42:15.169430+0000","modified":"2024-03-23T23:42:28.518488+0000","last_up_change":"2024-03-23T23:42:26.509742+0000","last_in_change":"2024-03-23T23:42:17.662330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:42:26.327445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e967bf31-21d6-4d11-bc3d-0df8177a1b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6809","nonce":2187201732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6811","nonce":2187201732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6815","nonce":2187201732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6813","nonce":2187201732}]},"public_addr":"172.21.15.8:6809/2187201732","cluster_addr":"172.21.15.8:6811/2187201732","heartbeat_back_addr":"172.21.15.8:6815/2187201732","heartbeat_front_addr":"172.21.15.8:6813/2187201732","state":["exists","up"]},{"osd":1,"uuid":"c8e33701-7acd-4474-8402-d52461171fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6818","nonce":3205168010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6822","nonce":3205168010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6830","nonce":3205168010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6826","nonce":3205168010}]},"public_addr":"172.21.15.8:6818/3205168010","cluster_addr":"172.21.15.8:6822/3205168010","heartbeat_back_addr":"172.21.15.8:6830/3205168010","heartbeat_front_addr":"172.21.15.8:6826/3205168010","state":["exists","up"]},{"osd":2,"uuid":"ceebdbf7-4c2f-4757-b52d-fd8b20e77570","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6801","nonce":475463656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6803","nonce":475463656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6807","nonce":475463656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6805","nonce":475463656}]},"public_addr":"172.21.15.8:6801/475463656","cluster_addr":"172.21.15.8:6803/475463656","heartbeat_back_addr":"172.21.15.8:6807/475463656","heartbeat_front_addr":"172.21.15.8:6805/475463656","state":["exists","up"]},{"osd":3,"uuid":"89e258da-5767-429e-8441-edf877d2f3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6819","nonce":1514082871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6821","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6823","nonce":1514082871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6829","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6831","nonce":1514082871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6825","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6827","nonce":1514082871}]},"public_addr":"172.21.15.8:6819/1514082871","cluster_addr":"172.21.15.8:6823/1514082871","heartbeat_back_addr":"172.21.15.8:6831/1514082871","heartbeat_front_addr":"172.21.15.8:6827/1514082871","state":["exists","up"]},{"osd":4,"uuid":"2b7451ae-ea16-4f0a-ae50-04fde75e45ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6825","nonce":3516578147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6827","nonce":3516578147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6831","nonce":3516578147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6829","nonce":3516578147}]},"public_addr":"172.21.15.196:6825/3516578147","cluster_addr":"172.21.15.196:6827/3516578147","heartbeat_back_addr":"172.21.15.196:6831/3516578147","heartbeat_front_addr":"172.21.15.196:6829/3516578147","state":["exists","up"]},{"osd":5,"uuid":"e68a8914-e591-466a-bc9e-f2d7c67aac13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6802","nonce":830595758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6806","nonce":830595758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6814","nonce":830595758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6810","nonce":830595758}]},"public_addr":"172.21.15.196:6802/830595758","cluster_addr":"172.21.15.196:6806/830595758","heartbeat_back_addr":"172.21.15.196:6814/830595758","heartbeat_front_addr":"172.21.15.196:6810/830595758","state":["exists","up"]},{"osd":6,"uuid":"e47723c5-50a0-4cd8-92d9-01972072b422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6801","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6803","nonce":472639906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6805","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6807","nonce":472639906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6815","nonce":472639906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6811","nonce":472639906}]},"public_addr":"172.21.15.196:6803/472639906","cluster_addr":"172.21.15.196:6807/472639906","heartbeat_back_addr":"172.21.15.196:6815/472639906","heartbeat_front_addr":"172.21.15.196:6811/472639906","state":["exists","up"]},{"osd":7,"uuid":"e1e9113d-8005-47b3-9a75-9e701199f1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6817","nonce":4151820349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6819","nonce":4151820349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6823","nonce":4151820349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6821","nonce":4151820349}]},"public_addr":"172.21.15.196:6817/4151820349","cluster_addr":"172.21.15.196:6819/4151820349","heartbeat_back_addr":"172.21.15.196:6823/4151820349","heartbeat_front_addr":"172.21.15.196:6821/4151820349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.221790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.265974+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.190319+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.376359+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.329657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.402958+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.300703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.133121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:42:33.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.681+0000 7f8531c00640 1 -- 172.21.15.8:0/3385106540 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8508067660 msgr2=0x7f8508069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:33.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.681+0000 7f8531c00640 1 --2- 172.21.15.8:0/3385106540 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8508067660 0x7f8508069b20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f851c009ab0 tx=0x7f851c009240 comp rx=0 tx=0).stop 2024-03-23T23:42:33.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.681+0000 7f8531c00640 1 -- 172.21.15.8:0/3385106540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f852c149bd0 msgr2=0x7f852c0c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:33.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.681+0000 7f8531c00640 1 --2- 172.21.15.8:0/3385106540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f852c149bd0 0x7f852c0c06d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f851400c420 tx=0x7f851400c8e0 comp rx=0 tx=0).stop 2024-03-23T23:42:33.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.681+0000 7f8531c00640 1 -- 172.21.15.8:0/3385106540 shutdown_connections 2024-03-23T23:42:33.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.681+0000 7f8531c00640 1 --2- 172.21.15.8:0/3385106540 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f852c156ee0 0x7f852c146f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:33.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.681+0000 7f8531c00640 1 --2- 172.21.15.8:0/3385106540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f852c149bd0 0x7f852c0c06d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:33.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.681+0000 7f8531c00640 1 --2- 172.21.15.8:0/3385106540 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8508067660 0x7f8508069b20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:33.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.681+0000 7f8531c00640 1 --2- 172.21.15.8:0/3385106540 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f852c0ac270 0x7f852c150450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:33.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.681+0000 7f8531c00640 1 -- 172.21.15.8:0/3385106540 >> 172.21.15.8:0/3385106540 conn(0x7f852c06b170 msgr2=0x7f852c148e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:33.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.681+0000 7f8531c00640 1 -- 172.21.15.8:0/3385106540 shutdown_connections 2024-03-23T23:42:33.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.681+0000 7f8531c00640 1 -- 172.21.15.8:0/3385106540 wait complete. 2024-03-23T23:42:33.703 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-23T23:42:26.327445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-23T23:42:33.703 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-23T23:42:33.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.845+0000 7f0dcb400640 1 Processor -- start 2024-03-23T23:42:33.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.845+0000 7f0dcb400640 1 -- start start 2024-03-23T23:42:33.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.845+0000 7f0dcb400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0dc4152d60 0x7f0dc40c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:33.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.845+0000 7f0dcb400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0dc40c98f0 0x7f0dc41563f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:33.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.845+0000 7f0dcb400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc4155820 con 0x7f0dc4158e10 2024-03-23T23:42:33.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.845+0000 7f0dcb400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc40c77f0 con 0x7f0dc4152d60 2024-03-23T23:42:33.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.845+0000 7f0dcb400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc4159310 con 0x7f0dc40c98f0 2024-03-23T23:42:33.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.845+0000 7f0dc8a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0dc4152d60 0x7f0dc40c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:33.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.845+0000 7f0dc8a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0dc4152d60 0x7f0dc40c93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57642/0 (socket says 172.21.15.8:57642) 2024-03-23T23:42:33.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.845+0000 7f0dc8a00640 1 -- 172.21.15.8:0/2232062496 learned_addr learned my addr 172.21.15.8:0/2232062496 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:33.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.845+0000 7f0dc9400640 1 --2- 172.21.15.8:0/2232062496 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0dc40c98f0 0x7f0dc41563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:33.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.849+0000 7f0dc8a00640 1 -- 172.21.15.8:0/2232062496 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0dc40c98f0 msgr2=0x7f0dc41563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:33.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.849+0000 7f0dc8a00640 1 --2- 172.21.15.8:0/2232062496 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0dc40c98f0 0x7f0dc41563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:33.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.849+0000 7f0dc8a00640 1 -- 172.21.15.8:0/2232062496 >> v1:172.21.15.196:6789/0 conn(0x7f0dc4158e10 legacy=0x7f0dc4155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:33.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.849+0000 7f0dc8a00640 1 -- 172.21.15.8:0/2232062496 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc41595f0 con 0x7f0dc4152d60 2024-03-23T23:42:33.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.849+0000 7f0dc8a00640 1 --2- 172.21.15.8:0/2232062496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0dc4152d60 0x7f0dc40c93b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0db8009870 tx=0x7f0db801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeab0064fea48c8d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:33.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.849+0000 7f0dc3400640 1 -- 172.21.15.8:0/2232062496 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db80aa600 con 0x7f0dc4152d60 2024-03-23T23:42:33.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.849+0000 7f0dc3400640 1 -- 172.21.15.8:0/2232062496 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db80af070 con 0x7f0dc4152d60 2024-03-23T23:42:33.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.849+0000 7f0dc3400640 1 -- 172.21.15.8:0/2232062496 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db80aa9c0 con 0x7f0dc4152d60 2024-03-23T23:42:33.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.849+0000 7f0dcb400640 1 -- 172.21.15.8:0/2232062496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0dc4152d60 msgr2=0x7f0dc40c93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:33.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.849+0000 7f0dcb400640 1 --2- 172.21.15.8:0/2232062496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0dc4152d60 0x7f0dc40c93b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0db8009870 tx=0x7f0db801c4a0 comp rx=0 tx=0).stop 2024-03-23T23:42:33.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.849+0000 7f0dcb400640 1 -- 172.21.15.8:0/2232062496 shutdown_connections 2024-03-23T23:42:33.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.849+0000 7f0dcb400640 1 --2- 172.21.15.8:0/2232062496 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0dc40c98f0 0x7f0dc41563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:33.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.849+0000 7f0dcb400640 1 --2- 172.21.15.8:0/2232062496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0dc4152d60 0x7f0dc40c93b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:33.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.849+0000 7f0dcb400640 1 -- 172.21.15.8:0/2232062496 >> 172.21.15.8:0/2232062496 conn(0x7f0dc40747f0 msgr2=0x7f0dc4074c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:33.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.849+0000 7f0dcb400640 1 -- 172.21.15.8:0/2232062496 shutdown_connections 2024-03-23T23:42:33.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.849+0000 7f0dcb400640 1 -- 172.21.15.8:0/2232062496 wait complete. 2024-03-23T23:42:33.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.853+0000 7f0dcb400640 1 Processor -- start 2024-03-23T23:42:33.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.853+0000 7f0dcb400640 1 -- start start 2024-03-23T23:42:33.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.853+0000 7f0dcb400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0dc40c98f0 0x7f0dc414b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:33.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.853+0000 7f0dcb400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0dc4152d60 0x7f0dc4158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:33.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.853+0000 7f0dcb400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0dc4158e10 0x7f0dc414be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:33.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.853+0000 7f0dcb400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc4071580 con 0x7f0dc4158e10 2024-03-23T23:42:33.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.853+0000 7f0dcb400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc4071400 con 0x7f0dc40c98f0 2024-03-23T23:42:33.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.853+0000 7f0dcb400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc41629c0 con 0x7f0dc4152d60 2024-03-23T23:42:33.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.853+0000 7f0dc9400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0dc4158e10 0x7f0dc414be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:33.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.853+0000 7f0dc8a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0dc40c98f0 0x7f0dc414b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:33.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.853+0000 7f0dc9400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0dc4158e10 0x7f0dc414be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57654/0 (socket says 172.21.15.8:57654) 2024-03-23T23:42:33.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.853+0000 7f0dc9400640 1 -- 172.21.15.8:0/1416687534 learned_addr learned my addr 172.21.15.8:0/1416687534 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:33.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.853+0000 7f0dc3e00640 1 --2- 172.21.15.8:0/1416687534 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0dc4152d60 0x7f0dc4158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:33.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.853+0000 7f0dc9400640 1 -- 172.21.15.8:0/1416687534 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0dc4152d60 msgr2=0x7f0dc4158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:33.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.853+0000 7f0dc9400640 1 --2- 172.21.15.8:0/1416687534 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0dc4152d60 0x7f0dc4158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:33.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.853+0000 7f0dc9400640 1 -- 172.21.15.8:0/1416687534 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0dc40c98f0 msgr2=0x7f0dc414b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:33.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.853+0000 7f0dc9400640 1 --2- 172.21.15.8:0/1416687534 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0dc40c98f0 0x7f0dc414b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:33.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.853+0000 7f0dc9400640 1 -- 172.21.15.8:0/1416687534 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc406d250 con 0x7f0dc4158e10 2024-03-23T23:42:33.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.853+0000 7f0dc9400640 1 --2- 172.21.15.8:0/1416687534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0dc4158e10 0x7f0dc414be00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc007e60 tx=0x7f0dbc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:33.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.853+0000 7f0dc0c00640 1 -- 172.21.15.8:0/1416687534 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc014420 con 0x7f0dc4158e10 2024-03-23T23:42:33.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.853+0000 7f0dc0c00640 1 -- 172.21.15.8:0/1416687534 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dbc019070 con 0x7f0dc4158e10 2024-03-23T23:42:33.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.853+0000 7f0dc0c00640 1 -- 172.21.15.8:0/1416687534 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc014820 con 0x7f0dc4158e10 2024-03-23T23:42:33.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.853+0000 7f0dcb400640 1 -- 172.21.15.8:0/1416687534 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc406e120 con 0x7f0dc4158e10 2024-03-23T23:42:33.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.853+0000 7f0dcb400640 1 -- 172.21.15.8:0/1416687534 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc4158650 con 0x7f0dc4158e10 2024-03-23T23:42:33.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.857+0000 7f0dcb400640 1 -- 172.21.15.8:0/1416687534 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc404f410 con 0x7f0dc4158e10 2024-03-23T23:42:33.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.857+0000 7f0dc0c00640 1 -- 172.21.15.8:0/1416687534 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f0dbc0149c0 con 0x7f0dc4158e10 2024-03-23T23:42:33.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.857+0000 7f0dc0c00640 1 --2- 172.21.15.8:0/1416687534 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0da4067660 0x7f0da4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:33.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.857+0000 7f0dc0c00640 1 -- 172.21.15.8:0/1416687534 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0dbc085c50 con 0x7f0dc4158e10 2024-03-23T23:42:33.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.857+0000 7f0dc8a00640 1 --2- 172.21.15.8:0/1416687534 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0da4067660 0x7f0da4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:33.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.857+0000 7f0dc8a00640 1 --2- 172.21.15.8:0/1416687534 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0da4067660 0x7f0da4069b20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0db80ae000 tx=0x7f0db80a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:33.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:33.861+0000 7f0dc0c00640 1 -- 172.21.15.8:0/1416687534 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f0dbc0565c0 con 0x7f0dc4158e10 2024-03-23T23:42:34.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.025+0000 7f0dcb400640 1 -- 172.21.15.8:0/1416687534 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0dc4152520 con 0x7f0dc4158e10 2024-03-23T23:42:34.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.025+0000 7f0dc0c00640 1 -- 172.21.15.8:0/1416687534 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0dbc05a660 con 0x7f0dc4158e10 2024-03-23T23:42:34.028 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-03-23T23:42:34.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.029+0000 7f0dcb400640 1 -- 172.21.15.8:0/1416687534 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0da4067660 msgr2=0x7f0da4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:34.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.029+0000 7f0dcb400640 1 --2- 172.21.15.8:0/1416687534 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0da4067660 0x7f0da4069b20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0db80ae000 tx=0x7f0db80a7000 comp rx=0 tx=0).stop 2024-03-23T23:42:34.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.029+0000 7f0dcb400640 1 -- 172.21.15.8:0/1416687534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0dc4158e10 msgr2=0x7f0dc414be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:34.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.029+0000 7f0dcb400640 1 --2- 172.21.15.8:0/1416687534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0dc4158e10 0x7f0dc414be00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc007e60 tx=0x7f0dbc00e4b0 comp rx=0 tx=0).stop 2024-03-23T23:42:34.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.029+0000 7f0dcb400640 1 -- 172.21.15.8:0/1416687534 shutdown_connections 2024-03-23T23:42:34.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.029+0000 7f0dcb400640 1 --2- 172.21.15.8:0/1416687534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0dc4158e10 0x7f0dc414be00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:34.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.029+0000 7f0dcb400640 1 --2- 172.21.15.8:0/1416687534 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0da4067660 0x7f0da4069b20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:34.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.029+0000 7f0dcb400640 1 --2- 172.21.15.8:0/1416687534 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0dc4152d60 0x7f0dc4158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:34.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.029+0000 7f0dcb400640 1 --2- 172.21.15.8:0/1416687534 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0dc40c98f0 0x7f0dc414b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:34.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.029+0000 7f0dcb400640 1 -- 172.21.15.8:0/1416687534 >> 172.21.15.8:0/1416687534 conn(0x7f0dc40747f0 msgr2=0x7f0dc4155ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:34.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.029+0000 7f0dcb400640 1 -- 172.21.15.8:0/1416687534 shutdown_connections 2024-03-23T23:42:34.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.029+0000 7f0dcb400640 1 -- 172.21.15.8:0/1416687534 wait complete. 2024-03-23T23:42:34.049 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T23:42:34.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.189+0000 7f1722800640 1 Processor -- start 2024-03-23T23:42:34.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.189+0000 7f1722800640 1 -- start start 2024-03-23T23:42:34.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.189+0000 7f1722800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f171c14fc70 0x7f171c0c3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:34.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.189+0000 7f1722800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f171c0c4160 0x7f171c152f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:34.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.189+0000 7f1722800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f171c0c2f70 con 0x7f171c0c3d00 2024-03-23T23:42:34.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.189+0000 7f1722800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f171c0c36a0 con 0x7f171c0c4160 2024-03-23T23:42:34.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.189+0000 7f1722800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f171c155e70 con 0x7f171c14fc70 2024-03-23T23:42:34.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.189+0000 7f1712a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f171c0c3d00 0x7f171c152850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42418/0 (socket says 172.21.15.8:42418) 2024-03-23T23:42:34.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.189+0000 7f1712a00640 1 -- 172.21.15.8:0/227755350 learned_addr learned my addr 172.21.15.8:0/227755350 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:34.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.189+0000 7f171be00640 1 --2- 172.21.15.8:0/227755350 >> v2:172.21.15.196:3300/0 conn(0x7f171c0c4160 0x7f171c152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:34.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.189+0000 7f171b400640 1 --2- 172.21.15.8:0/227755350 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f171c14fc70 0x7f171c0c3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:34.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.189+0000 7f171aa00640 1 -- 172.21.15.8:0/227755350 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 252623 0 0) 0x7f171c0c2f70 con 0x7f171c0c3d00 2024-03-23T23:42:34.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.189+0000 7f171aa00640 1 -- 172.21.15.8:0/227755350 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1700003530 con 0x7f171c0c3d00 2024-03-23T23:42:34.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.193+0000 7f171aa00640 1 -- 172.21.15.8:0/227755350 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1916568161 0 0) 0x7f1700003530 con 0x7f171c0c3d00 2024-03-23T23:42:34.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.193+0000 7f171aa00640 1 -- 172.21.15.8:0/227755350 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f171c14fc70 msgr2=0x7f171c0c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:34.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.193+0000 7f171aa00640 1 --2- 172.21.15.8:0/227755350 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f171c14fc70 0x7f171c0c3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:34.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.193+0000 7f171aa00640 1 -- 172.21.15.8:0/227755350 >> v2:172.21.15.196:3300/0 conn(0x7f171c0c4160 msgr2=0x7f171c152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:34.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.193+0000 7f171aa00640 1 --2- 172.21.15.8:0/227755350 >> v2:172.21.15.196:3300/0 conn(0x7f171c0c4160 0x7f171c152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:34.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.193+0000 7f171aa00640 1 -- 172.21.15.8:0/227755350 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f171c156150 con 0x7f171c0c3d00 2024-03-23T23:42:34.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.193+0000 7f171aa00640 1 -- 172.21.15.8:0/227755350 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7f1704001680 con 0x7f171c0c3d00 2024-03-23T23:42:34.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.193+0000 7f171aa00640 1 -- 172.21.15.8:0/227755350 >> v1:172.21.15.8:6789/0 conn(0x7f171c0c3d00 legacy=0x7f171c152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:34.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.193+0000 7f171aa00640 1 --2- 172.21.15.8:0/227755350 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f171c14fc70 0x7f17000039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:34.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.193+0000 7f171aa00640 1 --2- 172.21.15.8:0/227755350 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1700003f90 0x7f1700004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:34.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.193+0000 7f171aa00640 1 --2- 172.21.15.8:0/227755350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1700004d50 0x7f17000051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:34.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.193+0000 7f171aa00640 1 -- 172.21.15.8:0/227755350 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171c0c36a0 con 0x7f1700004d50 2024-03-23T23:42:34.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.193+0000 7f171aa00640 1 -- 172.21.15.8:0/227755350 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171c155e70 con 0x7f1700003f90 2024-03-23T23:42:34.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.193+0000 7f171aa00640 1 -- 172.21.15.8:0/227755350 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170000ba80 con 0x7f171c14fc70 2024-03-23T23:42:34.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.193+0000 7f171be00640 1 --2- 172.21.15.8:0/227755350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1700004d50 0x7f17000051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:34.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.193+0000 7f171b400640 1 --2- 172.21.15.8:0/227755350 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f171c14fc70 0x7f17000039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:34.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.193+0000 7f1712a00640 1 --2- 172.21.15.8:0/227755350 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1700003f90 0x7f1700004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:34.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.193+0000 7f171be00640 1 -- 172.21.15.8:0/227755350 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f171c14fc70 msgr2=0x7f17000039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:34.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.193+0000 7f171be00640 1 --2- 172.21.15.8:0/227755350 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f171c14fc70 0x7f17000039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:34.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.193+0000 7f171be00640 1 -- 172.21.15.8:0/227755350 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1700003f90 msgr2=0x7f1700004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:34.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.193+0000 7f171be00640 1 --2- 172.21.15.8:0/227755350 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1700003f90 0x7f1700004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:34.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.193+0000 7f171be00640 1 -- 172.21.15.8:0/227755350 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1700003530 con 0x7f1700004d50 2024-03-23T23:42:34.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.193+0000 7f171be00640 1 --2- 172.21.15.8:0/227755350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1700004d50 0x7f17000051d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1714009fc0 tx=0x7f171401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fae78f850567312 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:34.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.197+0000 7f171aa00640 1 -- 172.21.15.8:0/227755350 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17140b2070 con 0x7f1700004d50 2024-03-23T23:42:34.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.197+0000 7f171aa00640 1 -- 172.21.15.8:0/227755350 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17140a5cd0 con 0x7f1700004d50 2024-03-23T23:42:34.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.197+0000 7f171aa00640 1 -- 172.21.15.8:0/227755350 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1714009c10 con 0x7f1700004d50 2024-03-23T23:42:34.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.197+0000 7f1722800640 1 -- 172.21.15.8:0/227755350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1700004d50 msgr2=0x7f17000051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:34.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.197+0000 7f1722800640 1 --2- 172.21.15.8:0/227755350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1700004d50 0x7f17000051d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1714009fc0 tx=0x7f171401ccc0 comp rx=0 tx=0).stop 2024-03-23T23:42:34.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.197+0000 7f171be00640 1 -- 172.21.15.8:0/227755350 reap_dead start 2024-03-23T23:42:34.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.197+0000 7f1722800640 1 -- 172.21.15.8:0/227755350 shutdown_connections 2024-03-23T23:42:34.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.197+0000 7f1722800640 1 -- 172.21.15.8:0/227755350 >> 172.21.15.8:0/227755350 conn(0x7f171c06b170 msgr2=0x7f171c06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:34.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.197+0000 7f1722800640 1 -- 172.21.15.8:0/227755350 shutdown_connections 2024-03-23T23:42:34.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.197+0000 7f1722800640 1 -- 172.21.15.8:0/227755350 wait complete. 2024-03-23T23:42:34.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.197+0000 7f1722800640 1 Processor -- start 2024-03-23T23:42:34.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.197+0000 7f1722800640 1 -- start start 2024-03-23T23:42:34.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.197+0000 7f1722800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1700004d50 0x7f171c1519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:34.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.197+0000 7f1722800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f171c1511d0 0x7f171c1eb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:34.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.197+0000 7f1722800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f171c154eb0 0x7f171c0ab410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:34.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.197+0000 7f1722800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171c1569f0 con 0x7f1700004d50 2024-03-23T23:42:34.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.197+0000 7f1722800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171c156710 con 0x7f171c154eb0 2024-03-23T23:42:34.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.197+0000 7f1722800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f171c1534a0 con 0x7f171c1511d0 2024-03-23T23:42:34.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.197+0000 7f171b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1700004d50 0x7f171c1519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:34.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.197+0000 7f171b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1700004d50 0x7f171c1519c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57686/0 (socket says 172.21.15.8:57686) 2024-03-23T23:42:34.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.197+0000 7f171b400640 1 -- 172.21.15.8:0/2377655074 learned_addr learned my addr 172.21.15.8:0/2377655074 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:34.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.197+0000 7f171be00640 1 --2- 172.21.15.8:0/2377655074 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f171c154eb0 0x7f171c0ab410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:34.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.197+0000 7f1712a00640 1 --2- 172.21.15.8:0/2377655074 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f171c1511d0 0x7f171c1eb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:34.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.201+0000 7f171b400640 1 -- 172.21.15.8:0/2377655074 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f171c1511d0 msgr2=0x7f171c1eb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:34.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.201+0000 7f171b400640 1 --2- 172.21.15.8:0/2377655074 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f171c1511d0 0x7f171c1eb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:34.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.201+0000 7f171b400640 1 -- 172.21.15.8:0/2377655074 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f171c154eb0 msgr2=0x7f171c0ab410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:34.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.201+0000 7f171b400640 1 --2- 172.21.15.8:0/2377655074 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f171c154eb0 0x7f171c0ab410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:34.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.201+0000 7f171b400640 1 -- 172.21.15.8:0/2377655074 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f171c1ebab0 con 0x7f1700004d50 2024-03-23T23:42:34.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.201+0000 7f171be00640 1 --2- 172.21.15.8:0/2377655074 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f171c154eb0 0x7f171c0ab410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:42:34.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.201+0000 7f171b400640 1 --2- 172.21.15.8:0/2377655074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1700004d50 0x7f171c1519c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f170c011a00 tx=0x7f170c011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:34.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.201+0000 7f1713e00640 1 -- 172.21.15.8:0/2377655074 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c00fa90 con 0x7f1700004d50 2024-03-23T23:42:34.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.201+0000 7f1713e00640 1 -- 172.21.15.8:0/2377655074 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170c00fc30 con 0x7f1700004d50 2024-03-23T23:42:34.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.201+0000 7f1713e00640 1 -- 172.21.15.8:0/2377655074 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c014440 con 0x7f1700004d50 2024-03-23T23:42:34.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.201+0000 7f1722800640 1 -- 172.21.15.8:0/2377655074 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f171c151fa0 con 0x7f1700004d50 2024-03-23T23:42:34.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.201+0000 7f1722800640 1 -- 172.21.15.8:0/2377655074 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f171c1509d0 con 0x7f1700004d50 2024-03-23T23:42:34.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.201+0000 7f1722800640 1 -- 172.21.15.8:0/2377655074 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f171c068270 con 0x7f1700004d50 2024-03-23T23:42:34.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.201+0000 7f1713e00640 1 -- 172.21.15.8:0/2377655074 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f170c012040 con 0x7f1700004d50 2024-03-23T23:42:34.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.201+0000 7f1713e00640 1 --2- 172.21.15.8:0/2377655074 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f16f8067690 0x7f16f8069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:34.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.201+0000 7f1713e00640 1 -- 172.21.15.8:0/2377655074 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f170c085a50 con 0x7f1700004d50 2024-03-23T23:42:34.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.201+0000 7f1712a00640 1 --2- 172.21.15.8:0/2377655074 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f16f8067690 0x7f16f8069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:34.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.205+0000 7f1712a00640 1 --2- 172.21.15.8:0/2377655074 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f16f8067690 0x7f16f8069b50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f171c14cfa0 tx=0x7f1704009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:34.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.205+0000 7f1713e00640 1 -- 172.21.15.8:0/2377655074 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f170c019030 con 0x7f1700004d50 2024-03-23T23:42:34.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.405+0000 7f1722800640 1 -- 172.21.15.8:0/2377655074 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f171c0c2ce0 con 0x7f1700004d50 2024-03-23T23:42:34.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.405+0000 7f1713e00640 1 -- 172.21.15.8:0/2377655074 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1321 (secure 0 0 0) 0x7f170c01c360 con 0x7f1700004d50 2024-03-23T23:42:34.407 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:42:34.407 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6833/1542162403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1542162403},{"type":"v1","addr":"172.21.15.8:6833","nonce":1542162403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-03-23T23:42:34.408 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 2 2024-03-23T23:42:34.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.409+0000 7f1722800640 1 -- 172.21.15.8:0/2377655074 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f16f8067690 msgr2=0x7f16f8069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:34.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.409+0000 7f1722800640 1 --2- 172.21.15.8:0/2377655074 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f16f8067690 0x7f16f8069b50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f171c14cfa0 tx=0x7f1704009040 comp rx=0 tx=0).stop 2024-03-23T23:42:34.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.409+0000 7f1722800640 1 -- 172.21.15.8:0/2377655074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1700004d50 msgr2=0x7f171c1519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:34.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.409+0000 7f1722800640 1 --2- 172.21.15.8:0/2377655074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1700004d50 0x7f171c1519c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f170c011a00 tx=0x7f170c011ec0 comp rx=0 tx=0).stop 2024-03-23T23:42:34.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.409+0000 7f1722800640 1 -- 172.21.15.8:0/2377655074 shutdown_connections 2024-03-23T23:42:34.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.409+0000 7f1722800640 1 --2- 172.21.15.8:0/2377655074 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f171c154eb0 0x7f171c0ab410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:34.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.409+0000 7f1722800640 1 --2- 172.21.15.8:0/2377655074 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f16f8067690 0x7f16f8069b50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:34.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.409+0000 7f1722800640 1 --2- 172.21.15.8:0/2377655074 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f171c1511d0 0x7f171c1eb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:34.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.409+0000 7f1722800640 1 --2- 172.21.15.8:0/2377655074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1700004d50 0x7f171c1519c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:34.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.409+0000 7f1722800640 1 -- 172.21.15.8:0/2377655074 >> 172.21.15.8:0/2377655074 conn(0x7f171c06b170 msgr2=0x7f171c149440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:34.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.409+0000 7f1722800640 1 -- 172.21.15.8:0/2377655074 shutdown_connections 2024-03-23T23:42:34.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:34.409+0000 7f1722800640 1 -- 172.21.15.8:0/2377655074 wait complete. 2024-03-23T23:42:36.429 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T23:42:36.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.581+0000 7f5eeda00640 1 Processor -- start 2024-03-23T23:42:36.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.581+0000 7f5eeda00640 1 -- start start 2024-03-23T23:42:36.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.581+0000 7f5eeda00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5ee80c6dd0 0x7f5ee81508e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:36.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.581+0000 7f5eeda00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5ee80c8a40 0x7f5ee8150e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:36.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.581+0000 7f5eeda00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee80c4670 con 0x7f5ee80711a0 2024-03-23T23:42:36.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.581+0000 7f5eeda00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee80c4940 con 0x7f5ee80c8a40 2024-03-23T23:42:36.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.581+0000 7f5eeda00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee8153830 con 0x7f5ee80c6dd0 2024-03-23T23:42:36.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.581+0000 7f5eed000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5ee80c8a40 0x7f5ee8150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:36.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.581+0000 7f5eed000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5ee80c8a40 0x7f5ee8150e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57696/0 (socket says 172.21.15.8:57696) 2024-03-23T23:42:36.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.581+0000 7f5eed000640 1 -- 172.21.15.8:0/3885324352 learned_addr learned my addr 172.21.15.8:0/3885324352 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:36.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.581+0000 7f5ee7400640 1 --2- 172.21.15.8:0/3885324352 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5ee80c6dd0 0x7f5ee81508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:36.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.581+0000 7f5eed000640 1 -- 172.21.15.8:0/3885324352 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5ee80c6dd0 msgr2=0x7f5ee81508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:36.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.581+0000 7f5eed000640 1 --2- 172.21.15.8:0/3885324352 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5ee80c6dd0 0x7f5ee81508e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:36.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.581+0000 7f5eed000640 1 -- 172.21.15.8:0/3885324352 >> v1:172.21.15.196:6789/0 conn(0x7f5ee80711a0 legacy=0x7f5ee8153cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:36.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.581+0000 7f5eed000640 1 -- 172.21.15.8:0/3885324352 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee80c4b90 con 0x7f5ee80c8a40 2024-03-23T23:42:36.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.585+0000 7f5eed000640 1 --2- 172.21.15.8:0/3885324352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ee80c8a40 0x7f5ee8150e20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0009e50 tx=0x7f5ee001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e3d49bd5a8a5be server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:36.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.585+0000 7f5ee6a00640 1 -- 172.21.15.8:0/3885324352 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee00a5550 con 0x7f5ee80c8a40 2024-03-23T23:42:36.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.585+0000 7f5ee6a00640 1 -- 172.21.15.8:0/3885324352 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee00a56f0 con 0x7f5ee80c8a40 2024-03-23T23:42:36.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.585+0000 7f5ee6a00640 1 -- 172.21.15.8:0/3885324352 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee00a5ac0 con 0x7f5ee80c8a40 2024-03-23T23:42:36.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.585+0000 7f5eeda00640 1 -- 172.21.15.8:0/3885324352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ee80c8a40 msgr2=0x7f5ee8150e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:36.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.585+0000 7f5eeda00640 1 --2- 172.21.15.8:0/3885324352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ee80c8a40 0x7f5ee8150e20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0009e50 tx=0x7f5ee001c9a0 comp rx=0 tx=0).stop 2024-03-23T23:42:36.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.585+0000 7f5eeda00640 1 -- 172.21.15.8:0/3885324352 shutdown_connections 2024-03-23T23:42:36.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.585+0000 7f5eeda00640 1 --2- 172.21.15.8:0/3885324352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ee80c8a40 0x7f5ee8150e20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:36.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.585+0000 7f5eeda00640 1 --2- 172.21.15.8:0/3885324352 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5ee80c6dd0 0x7f5ee81508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:36.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.585+0000 7f5eeda00640 1 -- 172.21.15.8:0/3885324352 >> 172.21.15.8:0/3885324352 conn(0x7f5ee80aac80 msgr2=0x7f5ee80ab090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:36.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.585+0000 7f5eeda00640 1 -- 172.21.15.8:0/3885324352 shutdown_connections 2024-03-23T23:42:36.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.585+0000 7f5eeda00640 1 -- 172.21.15.8:0/3885324352 wait complete. 2024-03-23T23:42:36.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.585+0000 7f5eeda00640 1 Processor -- start 2024-03-23T23:42:36.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.585+0000 7f5eeda00640 1 -- start start 2024-03-23T23:42:36.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.589+0000 7f5eeda00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5ee80711a0 0x7f5ee8149b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:36.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.589+0000 7f5eeda00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5ee80c6dd0 0x7f5ee814a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:36.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.589+0000 7f5eeda00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ee80c8a40 0x7f5ee81ef6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:36.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.589+0000 7f5eeda00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee8071700 con 0x7f5ee80c8a40 2024-03-23T23:42:36.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.589+0000 7f5eeda00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee8071580 con 0x7f5ee80711a0 2024-03-23T23:42:36.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.589+0000 7f5eeda00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee81606c0 con 0x7f5ee80c6dd0 2024-03-23T23:42:36.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.589+0000 7f5eed000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ee80c8a40 0x7f5ee81ef6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:36.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.589+0000 7f5eed000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ee80c8a40 0x7f5ee81ef6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57698/0 (socket says 172.21.15.8:57698) 2024-03-23T23:42:36.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.589+0000 7f5eed000640 1 -- 172.21.15.8:0/1199053354 learned_addr learned my addr 172.21.15.8:0/1199053354 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:36.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.589+0000 7f5ee7400640 1 --2- 172.21.15.8:0/1199053354 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5ee80c6dd0 0x7f5ee814a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:36.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.589+0000 7f5ee7e00640 1 --2- 172.21.15.8:0/1199053354 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5ee80711a0 0x7f5ee8149b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:36.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.589+0000 7f5eed000640 1 -- 172.21.15.8:0/1199053354 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5ee80c6dd0 msgr2=0x7f5ee814a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:36.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.589+0000 7f5eed000640 1 --2- 172.21.15.8:0/1199053354 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5ee80c6dd0 0x7f5ee814a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:36.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.589+0000 7f5eed000640 1 -- 172.21.15.8:0/1199053354 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5ee80711a0 msgr2=0x7f5ee8149b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:36.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.589+0000 7f5eed000640 1 --2- 172.21.15.8:0/1199053354 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5ee80711a0 0x7f5ee8149b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:36.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.589+0000 7f5eed000640 1 -- 172.21.15.8:0/1199053354 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee814a640 con 0x7f5ee80c8a40 2024-03-23T23:42:36.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.589+0000 7f5eed000640 1 --2- 172.21.15.8:0/1199053354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ee80c8a40 0x7f5ee81ef6b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5ee001a5d0 tx=0x7f5ee0019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:36.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.589+0000 7f5edfe00640 1 -- 172.21.15.8:0/1199053354 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee00bc020 con 0x7f5ee80c8a40 2024-03-23T23:42:36.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.589+0000 7f5edfe00640 1 -- 172.21.15.8:0/1199053354 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee00b8670 con 0x7f5ee80c8a40 2024-03-23T23:42:36.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.589+0000 7f5edfe00640 1 -- 172.21.15.8:0/1199053354 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee0009510 con 0x7f5ee80c8a40 2024-03-23T23:42:36.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.589+0000 7f5eeda00640 1 -- 172.21.15.8:0/1199053354 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee814a920 con 0x7f5ee80c8a40 2024-03-23T23:42:36.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.589+0000 7f5eeda00640 1 -- 172.21.15.8:0/1199053354 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee81518f0 con 0x7f5ee80c8a40 2024-03-23T23:42:36.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.589+0000 7f5eeda00640 1 -- 172.21.15.8:0/1199053354 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee804f410 con 0x7f5ee80c8a40 2024-03-23T23:42:36.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.593+0000 7f5edfe00640 1 -- 172.21.15.8:0/1199053354 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f5ee00bf020 con 0x7f5ee80c8a40 2024-03-23T23:42:36.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.593+0000 7f5edfe00640 1 --2- 172.21.15.8:0/1199053354 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5ec8067660 0x7f5ec8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:36.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.593+0000 7f5edfe00640 1 -- 172.21.15.8:0/1199053354 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5ee0120320 con 0x7f5ee80c8a40 2024-03-23T23:42:36.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.593+0000 7f5ee7e00640 1 --2- 172.21.15.8:0/1199053354 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5ec8067660 0x7f5ec8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:36.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.593+0000 7f5ee7e00640 1 --2- 172.21.15.8:0/1199053354 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5ec8067660 0x7f5ec8069b20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8001650 tx=0x7f5ed8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:36.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.597+0000 7f5edfe00640 1 -- 172.21.15.8:0/1199053354 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f5ee00c6030 con 0x7f5ee80c8a40 2024-03-23T23:42:36.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.793+0000 7f5eeda00640 1 -- 172.21.15.8:0/1199053354 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ee8151ac0 con 0x7f5ee80c8a40 2024-03-23T23:42:36.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.793+0000 7f5edfe00640 1 -- 172.21.15.8:0/1199053354 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3694 (secure 0 0 0) 0x7f5ee0016620 con 0x7f5ee80c8a40 2024-03-23T23:42:36.796 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:42:36.796 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6836/3149325777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3149325777},{"type":"v1","addr":"172.21.15.196:6836","nonce":3149325777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6833/1542162403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1542162403},{"type":"v1","addr":"172.21.15.8:6833","nonce":1542162403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3531853933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3531853933},{"type":"v1","addr":"172.21.15.8:6835","nonce":3531853933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/3402347550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":3402347550},{"type":"v1","addr":"172.21.15.196:6837","nonce":3402347550}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-03-23T23:42:36.796 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 3 2024-03-23T23:42:36.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.797+0000 7f5eeda00640 1 -- 172.21.15.8:0/1199053354 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5ec8067660 msgr2=0x7f5ec8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:36.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.797+0000 7f5eeda00640 1 --2- 172.21.15.8:0/1199053354 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5ec8067660 0x7f5ec8069b20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8001650 tx=0x7f5ed8009040 comp rx=0 tx=0).stop 2024-03-23T23:42:36.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.797+0000 7f5eeda00640 1 -- 172.21.15.8:0/1199053354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ee80c8a40 msgr2=0x7f5ee81ef6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:36.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.797+0000 7f5eeda00640 1 --2- 172.21.15.8:0/1199053354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ee80c8a40 0x7f5ee81ef6b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5ee001a5d0 tx=0x7f5ee0019740 comp rx=0 tx=0).stop 2024-03-23T23:42:36.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.797+0000 7f5eeda00640 1 -- 172.21.15.8:0/1199053354 shutdown_connections 2024-03-23T23:42:36.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.797+0000 7f5eeda00640 1 --2- 172.21.15.8:0/1199053354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ee80c8a40 0x7f5ee81ef6b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:36.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.797+0000 7f5eeda00640 1 --2- 172.21.15.8:0/1199053354 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5ec8067660 0x7f5ec8069b20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:36.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.797+0000 7f5eeda00640 1 --2- 172.21.15.8:0/1199053354 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5ee80c6dd0 0x7f5ee814a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:36.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.797+0000 7f5eeda00640 1 --2- 172.21.15.8:0/1199053354 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5ee80711a0 0x7f5ee8149b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:36.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.797+0000 7f5eeda00640 1 -- 172.21.15.8:0/1199053354 >> 172.21.15.8:0/1199053354 conn(0x7f5ee80aac80 msgr2=0x7f5ee814f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:36.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.797+0000 7f5eeda00640 1 -- 172.21.15.8:0/1199053354 shutdown_connections 2024-03-23T23:42:36.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.797+0000 7f5eeda00640 1 -- 172.21.15.8:0/1199053354 wait complete. 2024-03-23T23:42:36.817 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:42:36.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.957+0000 7f5fac400640 1 Processor -- start 2024-03-23T23:42:36.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.957+0000 7f5fac400640 1 -- start start 2024-03-23T23:42:36.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.957+0000 7f5fac400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5fa414fc70 0x7f5fa40c3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:36.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.957+0000 7f5fac400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5fa40c4160 0x7f5fa4152f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:36.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.957+0000 7f5fac400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fa40c2f70 con 0x7f5fa40c3d00 2024-03-23T23:42:36.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.957+0000 7f5fac400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fa40c4590 con 0x7f5fa414fc70 2024-03-23T23:42:36.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.957+0000 7f5fac400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fa40c36a0 con 0x7f5fa40c4160 2024-03-23T23:42:36.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.957+0000 7f5fa9a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5fa414fc70 0x7f5fa40c3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:36.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.957+0000 7f5fa9000640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f5fa40c3d00 0x7f5fa4152850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42428/0 (socket says 172.21.15.8:42428) 2024-03-23T23:42:36.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.957+0000 7f5fa9000640 1 -- 172.21.15.8:0/65970390 learned_addr learned my addr 172.21.15.8:0/65970390 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:36.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.957+0000 7f5faa400640 1 --2- 172.21.15.8:0/65970390 >> v2:172.21.15.196:3300/0 conn(0x7f5fa40c4160 0x7f5fa4152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:36.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.957+0000 7f5fa3e00640 1 -- 172.21.15.8:0/65970390 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1006431731 0 0) 0x7f5fa40c2f70 con 0x7f5fa40c3d00 2024-03-23T23:42:36.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.957+0000 7f5fa9a00640 1 -- 172.21.15.8:0/65970390 >> v2:172.21.15.196:3300/0 conn(0x7f5fa40c4160 msgr2=0x7f5fa4152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:36.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.957+0000 7f5fa9a00640 1 --2- 172.21.15.8:0/65970390 >> v2:172.21.15.196:3300/0 conn(0x7f5fa40c4160 0x7f5fa4152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:36.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.957+0000 7f5fa9a00640 1 -- 172.21.15.8:0/65970390 >> v1:172.21.15.8:6789/0 conn(0x7f5fa40c3d00 legacy=0x7f5fa4152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:36.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.957+0000 7f5fa9a00640 1 -- 172.21.15.8:0/65970390 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa4155e70 con 0x7f5fa414fc70 2024-03-23T23:42:36.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.961+0000 7f5fa9a00640 1 --2- 172.21.15.8:0/65970390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fa414fc70 0x7f5fa40c3160 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5fa406de30 tx=0x7f5f9801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6cc633b6ddff0fd server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:36.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.961+0000 7f5fa3e00640 1 -- 172.21.15.8:0/65970390 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f980b0070 con 0x7f5fa414fc70 2024-03-23T23:42:36.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.961+0000 7f5fa3e00640 1 -- 172.21.15.8:0/65970390 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f980ab600 con 0x7f5fa414fc70 2024-03-23T23:42:36.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.961+0000 7f5fa3e00640 1 -- 172.21.15.8:0/65970390 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f980ab9d0 con 0x7f5fa414fc70 2024-03-23T23:42:36.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.961+0000 7f5fac400640 1 -- 172.21.15.8:0/65970390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fa414fc70 msgr2=0x7f5fa40c3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:36.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.961+0000 7f5fac400640 1 --2- 172.21.15.8:0/65970390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fa414fc70 0x7f5fa40c3160 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5fa406de30 tx=0x7f5f9801c3f0 comp rx=0 tx=0).stop 2024-03-23T23:42:36.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.961+0000 7f5fac400640 1 -- 172.21.15.8:0/65970390 shutdown_connections 2024-03-23T23:42:36.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.961+0000 7f5fac400640 1 --2- 172.21.15.8:0/65970390 >> v2:172.21.15.196:3300/0 conn(0x7f5fa40c4160 0x7f5fa4152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:36.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.961+0000 7f5fac400640 1 --2- 172.21.15.8:0/65970390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fa414fc70 0x7f5fa40c3160 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:36.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.961+0000 7f5fac400640 1 -- 172.21.15.8:0/65970390 >> 172.21.15.8:0/65970390 conn(0x7f5fa406b170 msgr2=0x7f5fa406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:36.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.961+0000 7f5fac400640 1 -- 172.21.15.8:0/65970390 shutdown_connections 2024-03-23T23:42:36.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.961+0000 7f5fac400640 1 -- 172.21.15.8:0/65970390 wait complete. 2024-03-23T23:42:36.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.965+0000 7f5fac400640 1 Processor -- start 2024-03-23T23:42:36.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.965+0000 7f5fac400640 1 -- start start 2024-03-23T23:42:36.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.965+0000 7f5fac400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5fa40c3d00 0x7f5fa40ac330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:36.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.965+0000 7f5fac400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5fa40c4160 0x7f5fa4143970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:36.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.965+0000 7f5fac400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fa414fc70 0x7f5fa4143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:36.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.965+0000 7f5fac400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa41534a0 con 0x7f5fa414fc70 2024-03-23T23:42:36.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.965+0000 7f5fac400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa41569f0 con 0x7f5fa40c4160 2024-03-23T23:42:36.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.965+0000 7f5fac400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa40c18d0 con 0x7f5fa40c3d00 2024-03-23T23:42:36.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.965+0000 7f5faa400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fa414fc70 0x7f5fa4143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:36.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.965+0000 7f5faa400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fa414fc70 0x7f5fa4143eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57712/0 (socket says 172.21.15.8:57712) 2024-03-23T23:42:36.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.965+0000 7f5faa400640 1 -- 172.21.15.8:0/2932966423 learned_addr learned my addr 172.21.15.8:0/2932966423 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:36.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.965+0000 7f5fa9a00640 1 --2- 172.21.15.8:0/2932966423 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5fa40c3d00 0x7f5fa40ac330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:36.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.965+0000 7f5fa9000640 1 --2- 172.21.15.8:0/2932966423 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5fa40c4160 0x7f5fa4143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:36.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.965+0000 7f5faa400640 1 -- 172.21.15.8:0/2932966423 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5fa40c3d00 msgr2=0x7f5fa40ac330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:36.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.965+0000 7f5faa400640 1 --2- 172.21.15.8:0/2932966423 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5fa40c3d00 0x7f5fa40ac330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:36.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.965+0000 7f5faa400640 1 -- 172.21.15.8:0/2932966423 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5fa40c4160 msgr2=0x7f5fa4143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:36.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.965+0000 7f5faa400640 1 --2- 172.21.15.8:0/2932966423 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5fa40c4160 0x7f5fa4143970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:36.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.965+0000 7f5faa400640 1 -- 172.21.15.8:0/2932966423 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa40716a0 con 0x7f5fa414fc70 2024-03-23T23:42:36.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.965+0000 7f5fa9000640 1 --2- 172.21.15.8:0/2932966423 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5fa40c4160 0x7f5fa4143970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:42:36.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.965+0000 7f5faa400640 1 --2- 172.21.15.8:0/2932966423 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fa414fc70 0x7f5fa4143eb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c007e70 tx=0x7f5f9c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:36.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.965+0000 7f5fa1600640 1 -- 172.21.15.8:0/2932966423 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c014620 con 0x7f5fa414fc70 2024-03-23T23:42:36.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.965+0000 7f5fa1600640 1 -- 172.21.15.8:0/2932966423 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9c019070 con 0x7f5fa414fc70 2024-03-23T23:42:36.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.965+0000 7f5fa1600640 1 -- 172.21.15.8:0/2932966423 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c014a20 con 0x7f5fa414fc70 2024-03-23T23:42:36.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.965+0000 7f5fac400640 1 -- 172.21.15.8:0/2932966423 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fa41443f0 con 0x7f5fa414fc70 2024-03-23T23:42:36.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.965+0000 7f5fac400640 1 -- 172.21.15.8:0/2932966423 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fa4150830 con 0x7f5fa414fc70 2024-03-23T23:42:36.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.969+0000 7f5fac400640 1 -- 172.21.15.8:0/2932966423 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fa4068270 con 0x7f5fa414fc70 2024-03-23T23:42:36.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.969+0000 7f5fa1600640 1 -- 172.21.15.8:0/2932966423 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f5f9c014bc0 con 0x7f5fa414fc70 2024-03-23T23:42:36.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.969+0000 7f5fa1600640 1 --2- 172.21.15.8:0/2932966423 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5f84067690 0x7f5f84069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:36.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.969+0000 7f5fa1600640 1 -- 172.21.15.8:0/2932966423 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5f9c085da0 con 0x7f5fa414fc70 2024-03-23T23:42:36.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.969+0000 7f5fa9a00640 1 --2- 172.21.15.8:0/2932966423 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5f84067690 0x7f5f84069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:36.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.969+0000 7f5fa9a00640 1 --2- 172.21.15.8:0/2932966423 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5f84067690 0x7f5f84069b50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5f980ad000 tx=0x7f5f980a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:36.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:36.973+0000 7f5fa1600640 1 -- 172.21.15.8:0/2932966423 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f5f9c056d60 con 0x7f5fa414fc70 2024-03-23T23:42:37.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.141+0000 7f5fac400640 1 -- 172.21.15.8:0/2932966423 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5fa40c2ce0 con 0x7f5fa414fc70 2024-03-23T23:42:37.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.141+0000 7f5fa1600640 1 -- 172.21.15.8:0/2932966423 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12812 (secure 0 0 0) 0x7f5f9c056660 con 0x7f5fa414fc70 2024-03-23T23:42:37.142 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:42:37.142 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":17,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","created":"2024-03-23T23:42:15.169430+0000","modified":"2024-03-23T23:42:28.518488+0000","last_up_change":"2024-03-23T23:42:26.509742+0000","last_in_change":"2024-03-23T23:42:17.662330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:42:26.327445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e967bf31-21d6-4d11-bc3d-0df8177a1b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6809","nonce":2187201732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6811","nonce":2187201732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6815","nonce":2187201732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6813","nonce":2187201732}]},"public_addr":"172.21.15.8:6809/2187201732","cluster_addr":"172.21.15.8:6811/2187201732","heartbeat_back_addr":"172.21.15.8:6815/2187201732","heartbeat_front_addr":"172.21.15.8:6813/2187201732","state":["exists","up"]},{"osd":1,"uuid":"c8e33701-7acd-4474-8402-d52461171fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6818","nonce":3205168010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6822","nonce":3205168010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6830","nonce":3205168010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6826","nonce":3205168010}]},"public_addr":"172.21.15.8:6818/3205168010","cluster_addr":"172.21.15.8:6822/3205168010","heartbeat_back_addr":"172.21.15.8:6830/3205168010","heartbeat_front_addr":"172.21.15.8:6826/3205168010","state":["exists","up"]},{"osd":2,"uuid":"ceebdbf7-4c2f-4757-b52d-fd8b20e77570","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6801","nonce":475463656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6803","nonce":475463656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6807","nonce":475463656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6805","nonce":475463656}]},"public_addr":"172.21.15.8:6801/475463656","cluster_addr":"172.21.15.8:6803/475463656","heartbeat_back_addr":"172.21.15.8:6807/475463656","heartbeat_front_addr":"172.21.15.8:6805/475463656","state":["exists","up"]},{"osd":3,"uuid":"89e258da-5767-429e-8441-edf877d2f3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6819","nonce":1514082871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6821","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6823","nonce":1514082871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6829","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6831","nonce":1514082871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6825","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6827","nonce":1514082871}]},"public_addr":"172.21.15.8:6819/1514082871","cluster_addr":"172.21.15.8:6823/1514082871","heartbeat_back_addr":"172.21.15.8:6831/1514082871","heartbeat_front_addr":"172.21.15.8:6827/1514082871","state":["exists","up"]},{"osd":4,"uuid":"2b7451ae-ea16-4f0a-ae50-04fde75e45ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6825","nonce":3516578147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6827","nonce":3516578147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6831","nonce":3516578147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6829","nonce":3516578147}]},"public_addr":"172.21.15.196:6825/3516578147","cluster_addr":"172.21.15.196:6827/3516578147","heartbeat_back_addr":"172.21.15.196:6831/3516578147","heartbeat_front_addr":"172.21.15.196:6829/3516578147","state":["exists","up"]},{"osd":5,"uuid":"e68a8914-e591-466a-bc9e-f2d7c67aac13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6802","nonce":830595758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6806","nonce":830595758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6814","nonce":830595758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6810","nonce":830595758}]},"public_addr":"172.21.15.196:6802/830595758","cluster_addr":"172.21.15.196:6806/830595758","heartbeat_back_addr":"172.21.15.196:6814/830595758","heartbeat_front_addr":"172.21.15.196:6810/830595758","state":["exists","up"]},{"osd":6,"uuid":"e47723c5-50a0-4cd8-92d9-01972072b422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6801","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6803","nonce":472639906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6805","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6807","nonce":472639906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6815","nonce":472639906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6811","nonce":472639906}]},"public_addr":"172.21.15.196:6803/472639906","cluster_addr":"172.21.15.196:6807/472639906","heartbeat_back_addr":"172.21.15.196:6815/472639906","heartbeat_front_addr":"172.21.15.196:6811/472639906","state":["exists","up"]},{"osd":7,"uuid":"e1e9113d-8005-47b3-9a75-9e701199f1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6817","nonce":4151820349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6819","nonce":4151820349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6823","nonce":4151820349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6821","nonce":4151820349}]},"public_addr":"172.21.15.196:6817/4151820349","cluster_addr":"172.21.15.196:6819/4151820349","heartbeat_back_addr":"172.21.15.196:6823/4151820349","heartbeat_front_addr":"172.21.15.196:6821/4151820349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.221790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.265974+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.190319+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.376359+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.329657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.402958+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.300703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.133121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:42:37.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.141+0000 7f5fac400640 1 -- 172.21.15.8:0/2932966423 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5f84067690 msgr2=0x7f5f84069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:37.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.141+0000 7f5fac400640 1 --2- 172.21.15.8:0/2932966423 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5f84067690 0x7f5f84069b50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5f980ad000 tx=0x7f5f980a6000 comp rx=0 tx=0).stop 2024-03-23T23:42:37.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.141+0000 7f5fac400640 1 -- 172.21.15.8:0/2932966423 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fa414fc70 msgr2=0x7f5fa4143eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:37.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.141+0000 7f5fac400640 1 --2- 172.21.15.8:0/2932966423 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fa414fc70 0x7f5fa4143eb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c007e70 tx=0x7f5f9c00e4b0 comp rx=0 tx=0).stop 2024-03-23T23:42:37.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.141+0000 7f5fac400640 1 -- 172.21.15.8:0/2932966423 shutdown_connections 2024-03-23T23:42:37.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.141+0000 7f5fac400640 1 --2- 172.21.15.8:0/2932966423 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fa414fc70 0x7f5fa4143eb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:37.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.141+0000 7f5fac400640 1 --2- 172.21.15.8:0/2932966423 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5fa40c4160 0x7f5fa4143970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:37.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.141+0000 7f5fac400640 1 --2- 172.21.15.8:0/2932966423 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5f84067690 0x7f5f84069b50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:37.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.141+0000 7f5fac400640 1 --2- 172.21.15.8:0/2932966423 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5fa40c3d00 0x7f5fa40ac330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:37.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.141+0000 7f5fac400640 1 -- 172.21.15.8:0/2932966423 >> 172.21.15.8:0/2932966423 conn(0x7f5fa406b170 msgr2=0x7f5fa40725c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:37.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.141+0000 7f5fac400640 1 -- 172.21.15.8:0/2932966423 shutdown_connections 2024-03-23T23:42:37.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.141+0000 7f5fac400640 1 -- 172.21.15.8:0/2932966423 wait complete. 2024-03-23T23:42:37.162 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-23T23:42:26.327445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-23T23:42:37.163 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-23T23:42:37.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.305+0000 7fee6fc00640 1 Processor -- start 2024-03-23T23:42:37.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.305+0000 7fee6fc00640 1 -- start start 2024-03-23T23:42:37.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.305+0000 7fee6fc00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fee68158e10 0x7fee68155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:37.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.305+0000 7fee6fc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee680c31b0 0x7fee68156220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:37.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.305+0000 7fee6fc00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee68155820 con 0x7fee68152d60 2024-03-23T23:42:37.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.305+0000 7fee6fc00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee680c77f0 con 0x7fee68158e10 2024-03-23T23:42:37.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.305+0000 7fee6fc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee68159310 con 0x7fee680c31b0 2024-03-23T23:42:37.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.305+0000 7fee67e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fee68158e10 0x7fee68155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:37.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.305+0000 7fee67e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fee68158e10 0x7fee68155ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57714/0 (socket says 172.21.15.8:57714) 2024-03-23T23:42:37.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.305+0000 7fee67e00640 1 -- 172.21.15.8:0/929486767 learned_addr learned my addr 172.21.15.8:0/929486767 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:37.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.305+0000 7fee6d200640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fee68152d60 0x7fee680c93b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42436/0 (socket says 172.21.15.8:42436) 2024-03-23T23:42:37.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.305+0000 7fee6dc00640 1 --2- 172.21.15.8:0/929486767 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee680c31b0 0x7fee68156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:37.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.305+0000 7fee67e00640 1 -- 172.21.15.8:0/929486767 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee680c31b0 msgr2=0x7fee68156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:37.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.305+0000 7fee67e00640 1 --2- 172.21.15.8:0/929486767 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee680c31b0 0x7fee68156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:37.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.305+0000 7fee67e00640 1 -- 172.21.15.8:0/929486767 >> v1:172.21.15.8:6789/0 conn(0x7fee68152d60 legacy=0x7fee680c93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:37.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.305+0000 7fee67e00640 1 -- 172.21.15.8:0/929486767 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee681595f0 con 0x7fee68158e10 2024-03-23T23:42:37.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.309+0000 7fee67e00640 1 --2- 172.21.15.8:0/929486767 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee68158e10 0x7fee68155ce0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fee54009870 tx=0x7fee5401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b0f770e9c86bab server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:37.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.309+0000 7fee67400640 1 -- 172.21.15.8:0/929486767 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee540ab610 con 0x7fee68158e10 2024-03-23T23:42:37.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.309+0000 7fee67400640 1 -- 172.21.15.8:0/929486767 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee540b0070 con 0x7fee68158e10 2024-03-23T23:42:37.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.309+0000 7fee67400640 1 -- 172.21.15.8:0/929486767 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee540ab9d0 con 0x7fee68158e10 2024-03-23T23:42:37.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.309+0000 7fee6fc00640 1 -- 172.21.15.8:0/929486767 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee68158e10 msgr2=0x7fee68155ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:37.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.309+0000 7fee6fc00640 1 --2- 172.21.15.8:0/929486767 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee68158e10 0x7fee68155ce0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fee54009870 tx=0x7fee5401c410 comp rx=0 tx=0).stop 2024-03-23T23:42:37.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.309+0000 7fee6fc00640 1 -- 172.21.15.8:0/929486767 shutdown_connections 2024-03-23T23:42:37.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.309+0000 7fee6fc00640 1 --2- 172.21.15.8:0/929486767 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee680c31b0 0x7fee68156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:37.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.309+0000 7fee6fc00640 1 --2- 172.21.15.8:0/929486767 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee68158e10 0x7fee68155ce0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:37.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.309+0000 7fee6fc00640 1 -- 172.21.15.8:0/929486767 >> 172.21.15.8:0/929486767 conn(0x7fee680747f0 msgr2=0x7fee68074c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:37.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.309+0000 7fee6fc00640 1 -- 172.21.15.8:0/929486767 shutdown_connections 2024-03-23T23:42:37.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.309+0000 7fee6fc00640 1 -- 172.21.15.8:0/929486767 wait complete. 2024-03-23T23:42:37.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.313+0000 7fee6fc00640 1 Processor -- start 2024-03-23T23:42:37.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.313+0000 7fee6fc00640 1 -- start start 2024-03-23T23:42:37.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.313+0000 7fee6fc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee680c31b0 0x7fee68155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:37.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.313+0000 7fee6fc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee68152d60 0x7fee6806c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:37.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.313+0000 7fee6fc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee68158e10 0x7fee6806c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:37.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.313+0000 7fee6fc00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee680c9c40 con 0x7fee680c31b0 2024-03-23T23:42:37.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.313+0000 7fee6fc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee680c9ac0 con 0x7fee68152d60 2024-03-23T23:42:37.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.313+0000 7fee6fc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee68153140 con 0x7fee68158e10 2024-03-23T23:42:37.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.313+0000 7fee6d200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee680c31b0 0x7fee68155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:37.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.313+0000 7fee6d200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee680c31b0 0x7fee68155be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57722/0 (socket says 172.21.15.8:57722) 2024-03-23T23:42:37.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.313+0000 7fee6d200640 1 -- 172.21.15.8:0/3840213611 learned_addr learned my addr 172.21.15.8:0/3840213611 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:37.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.313+0000 7fee67e00640 1 --2- 172.21.15.8:0/3840213611 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee68152d60 0x7fee6806c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:37.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.313+0000 7fee6dc00640 1 --2- 172.21.15.8:0/3840213611 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee68158e10 0x7fee6806c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:37.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.313+0000 7fee6d200640 1 -- 172.21.15.8:0/3840213611 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee68158e10 msgr2=0x7fee6806c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:37.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.313+0000 7fee6d200640 1 --2- 172.21.15.8:0/3840213611 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee68158e10 0x7fee6806c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:37.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.313+0000 7fee6d200640 1 -- 172.21.15.8:0/3840213611 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee68152d60 msgr2=0x7fee6806c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:37.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.313+0000 7fee6d200640 1 --2- 172.21.15.8:0/3840213611 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee68152d60 0x7fee6806c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:37.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.313+0000 7fee6d200640 1 -- 172.21.15.8:0/3840213611 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6814b530 con 0x7fee680c31b0 2024-03-23T23:42:37.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.313+0000 7fee6d200640 1 --2- 172.21.15.8:0/3840213611 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee680c31b0 0x7fee68155be0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fee5c00c3a0 tx=0x7fee5c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:37.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.313+0000 7fee64c00640 1 -- 172.21.15.8:0/3840213611 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c0074e0 con 0x7fee680c31b0 2024-03-23T23:42:37.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.313+0000 7fee64c00640 1 -- 172.21.15.8:0/3840213611 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5c0076a0 con 0x7fee680c31b0 2024-03-23T23:42:37.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.313+0000 7fee64c00640 1 -- 172.21.15.8:0/3840213611 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c004a30 con 0x7fee680c31b0 2024-03-23T23:42:37.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.313+0000 7fee6fc00640 1 -- 172.21.15.8:0/3840213611 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee68070900 con 0x7fee680c31b0 2024-03-23T23:42:37.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.313+0000 7fee6fc00640 1 -- 172.21.15.8:0/3840213611 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee68070ba0 con 0x7fee680c31b0 2024-03-23T23:42:37.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.313+0000 7fee6fc00640 1 -- 172.21.15.8:0/3840213611 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee6804f410 con 0x7fee680c31b0 2024-03-23T23:42:37.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.317+0000 7fee64c00640 1 -- 172.21.15.8:0/3840213611 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fee5c01a020 con 0x7fee680c31b0 2024-03-23T23:42:37.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.317+0000 7fee64c00640 1 --2- 172.21.15.8:0/3840213611 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fee48067660 0x7fee48069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:37.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.317+0000 7fee64c00640 1 -- 172.21.15.8:0/3840213611 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fee5c084c30 con 0x7fee680c31b0 2024-03-23T23:42:37.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.317+0000 7fee67e00640 1 --2- 172.21.15.8:0/3840213611 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fee48067660 0x7fee48069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:37.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.317+0000 7fee67e00640 1 --2- 172.21.15.8:0/3840213611 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fee48067660 0x7fee48069b20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fee540af000 tx=0x7fee540a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:37.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.321+0000 7fee64c00640 1 -- 172.21.15.8:0/3840213611 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fee68155820 con 0x7fee680c31b0 2024-03-23T23:42:37.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.485+0000 7fee6fc00640 1 -- 172.21.15.8:0/3840213611 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fee680c6eb0 con 0x7fee680c31b0 2024-03-23T23:42:37.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.485+0000 7fee64c00640 1 -- 172.21.15.8:0/3840213611 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fee5c055bf0 con 0x7fee680c31b0 2024-03-23T23:42:37.485 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-03-23T23:42:37.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.485+0000 7fee6fc00640 1 -- 172.21.15.8:0/3840213611 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fee48067660 msgr2=0x7fee48069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:37.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.485+0000 7fee6fc00640 1 --2- 172.21.15.8:0/3840213611 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fee48067660 0x7fee48069b20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fee540af000 tx=0x7fee540a7000 comp rx=0 tx=0).stop 2024-03-23T23:42:37.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.485+0000 7fee6fc00640 1 -- 172.21.15.8:0/3840213611 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee680c31b0 msgr2=0x7fee68155be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:37.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.485+0000 7fee6fc00640 1 --2- 172.21.15.8:0/3840213611 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee680c31b0 0x7fee68155be0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fee5c00c3a0 tx=0x7fee5c00c860 comp rx=0 tx=0).stop 2024-03-23T23:42:37.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.485+0000 7fee6fc00640 1 -- 172.21.15.8:0/3840213611 shutdown_connections 2024-03-23T23:42:37.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.485+0000 7fee6fc00640 1 --2- 172.21.15.8:0/3840213611 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fee48067660 0x7fee48069b20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:37.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.485+0000 7fee6fc00640 1 --2- 172.21.15.8:0/3840213611 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee68158e10 0x7fee6806c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:37.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.485+0000 7fee6fc00640 1 --2- 172.21.15.8:0/3840213611 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee68152d60 0x7fee6806c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:37.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.485+0000 7fee6fc00640 1 --2- 172.21.15.8:0/3840213611 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee680c31b0 0x7fee68155be0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:37.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.485+0000 7fee6fc00640 1 -- 172.21.15.8:0/3840213611 >> 172.21.15.8:0/3840213611 conn(0x7fee680747f0 msgr2=0x7fee680c9380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:37.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.485+0000 7fee6fc00640 1 -- 172.21.15.8:0/3840213611 shutdown_connections 2024-03-23T23:42:37.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.485+0000 7fee6fc00640 1 -- 172.21.15.8:0/3840213611 wait complete. 2024-03-23T23:42:37.506 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-23T23:42:37.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.645+0000 7fd8c1400640 1 Processor -- start 2024-03-23T23:42:37.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.645+0000 7fd8c1400640 1 -- start start 2024-03-23T23:42:37.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.649+0000 7fd8c1400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd8bc06ee90 0x7fd8bc072130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:37.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.649+0000 7fd8c1400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8bc072670 0x7fd8bc15e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:37.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.649+0000 7fd8c1400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8bc1541b0 con 0x7fd8bc150da0 2024-03-23T23:42:37.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.649+0000 7fd8c1400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8bc0a9750 con 0x7fd8bc06ee90 2024-03-23T23:42:37.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.649+0000 7fd8c1400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc0a9470 con 0x7fd8bc072670 2024-03-23T23:42:37.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.649+0000 7fd8b9e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd8bc06ee90 0x7fd8bc072130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:37.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.649+0000 7fd8ba800640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd8bc150da0 0x7fd8bc06b170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42450/0 (socket says 172.21.15.8:42450) 2024-03-23T23:42:37.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.649+0000 7fd8ba800640 1 -- 172.21.15.8:0/1206664201 learned_addr learned my addr 172.21.15.8:0/1206664201 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:37.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.649+0000 7fd8bb200640 1 --2- 172.21.15.8:0/1206664201 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8bc072670 0x7fd8bc15e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:37.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.649+0000 7fd8b9e00640 1 -- 172.21.15.8:0/1206664201 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8bc072670 msgr2=0x7fd8bc15e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:37.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.649+0000 7fd8b9e00640 1 --2- 172.21.15.8:0/1206664201 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8bc072670 0x7fd8bc15e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:37.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.649+0000 7fd8b9e00640 1 -- 172.21.15.8:0/1206664201 >> v1:172.21.15.8:6789/0 conn(0x7fd8bc150da0 legacy=0x7fd8bc06b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:37.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.649+0000 7fd8b9e00640 1 -- 172.21.15.8:0/1206664201 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8bc06bc20 con 0x7fd8bc06ee90 2024-03-23T23:42:37.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.649+0000 7fd8b9400640 1 -- 172.21.15.8:0/1206664201 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3212726042 0 0) 0x7fd8bc1541b0 con 0x7fd8bc150da0 2024-03-23T23:42:37.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.649+0000 7fd8b9e00640 1 --2- 172.21.15.8:0/1206664201 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8bc06ee90 0x7fd8bc072130 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd8a80097c0 tx=0x7fd8a801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8b4c6a485f57b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:37.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.653+0000 7fd8b9400640 1 -- 172.21.15.8:0/1206664201 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a80b0070 con 0x7fd8bc06ee90 2024-03-23T23:42:37.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.653+0000 7fd8b9400640 1 -- 172.21.15.8:0/1206664201 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a80ab600 con 0x7fd8bc06ee90 2024-03-23T23:42:37.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.653+0000 7fd8b9400640 1 -- 172.21.15.8:0/1206664201 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a80ab9d0 con 0x7fd8bc06ee90 2024-03-23T23:42:37.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.653+0000 7fd8c1400640 1 -- 172.21.15.8:0/1206664201 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8bc06ee90 msgr2=0x7fd8bc072130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:37.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.653+0000 7fd8c1400640 1 --2- 172.21.15.8:0/1206664201 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8bc06ee90 0x7fd8bc072130 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd8a80097c0 tx=0x7fd8a801c410 comp rx=0 tx=0).stop 2024-03-23T23:42:37.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.653+0000 7fd8c1400640 1 -- 172.21.15.8:0/1206664201 shutdown_connections 2024-03-23T23:42:37.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.653+0000 7fd8c1400640 1 --2- 172.21.15.8:0/1206664201 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8bc072670 0x7fd8bc15e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:37.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.653+0000 7fd8c1400640 1 --2- 172.21.15.8:0/1206664201 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8bc06ee90 0x7fd8bc072130 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:37.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.653+0000 7fd8c1400640 1 -- 172.21.15.8:0/1206664201 >> 172.21.15.8:0/1206664201 conn(0x7fd8bc06c280 msgr2=0x7fd8bc06c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:37.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.653+0000 7fd8c1400640 1 -- 172.21.15.8:0/1206664201 shutdown_connections 2024-03-23T23:42:37.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.653+0000 7fd8c1400640 1 -- 172.21.15.8:0/1206664201 wait complete. 2024-03-23T23:42:37.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.653+0000 7fd8c1400640 1 Processor -- start 2024-03-23T23:42:37.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.653+0000 7fd8c1400640 1 -- start start 2024-03-23T23:42:37.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.653+0000 7fd8c1400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8bc06ee90 0x7fd8bc1ef730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:37.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.653+0000 7fd8c1400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8bc072670 0x7fd8bc1efc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:37.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.653+0000 7fd8c1400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8bc150da0 0x7fd8bc1455d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:37.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.653+0000 7fd8c1400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc06ba00 con 0x7fd8bc072670 2024-03-23T23:42:37.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.653+0000 7fd8c1400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc06b880 con 0x7fd8bc06ee90 2024-03-23T23:42:37.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.653+0000 7fd8c1400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc06ff50 con 0x7fd8bc150da0 2024-03-23T23:42:37.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.653+0000 7fd8b9e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8bc072670 0x7fd8bc1efc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:37.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.653+0000 7fd8b9e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8bc072670 0x7fd8bc1efc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57728/0 (socket says 172.21.15.8:57728) 2024-03-23T23:42:37.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.653+0000 7fd8b9e00640 1 -- 172.21.15.8:0/542520456 learned_addr learned my addr 172.21.15.8:0/542520456 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:37.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.653+0000 7fd8bb200640 1 --2- 172.21.15.8:0/542520456 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8bc150da0 0x7fd8bc1455d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:37.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.653+0000 7fd8ba800640 1 --2- 172.21.15.8:0/542520456 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8bc06ee90 0x7fd8bc1ef730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:37.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.653+0000 7fd8b9e00640 1 -- 172.21.15.8:0/542520456 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8bc150da0 msgr2=0x7fd8bc1455d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:37.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.653+0000 7fd8b9e00640 1 --2- 172.21.15.8:0/542520456 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8bc150da0 0x7fd8bc1455d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:37.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.653+0000 7fd8b9e00640 1 -- 172.21.15.8:0/542520456 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8bc06ee90 msgr2=0x7fd8bc1ef730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:37.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.653+0000 7fd8b9e00640 1 --2- 172.21.15.8:0/542520456 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8bc06ee90 0x7fd8bc1ef730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:37.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.653+0000 7fd8b9e00640 1 -- 172.21.15.8:0/542520456 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8bc0c68b0 con 0x7fd8bc072670 2024-03-23T23:42:37.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.657+0000 7fd8ba800640 1 --2- 172.21.15.8:0/542520456 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8bc06ee90 0x7fd8bc1ef730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:42:37.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.657+0000 7fd8b9e00640 1 --2- 172.21.15.8:0/542520456 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8bc072670 0x7fd8bc1efc70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd8a801a040 tx=0x7fd8a801ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:37.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.657+0000 7fd8b2a00640 1 -- 172.21.15.8:0/542520456 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a80b0050 con 0x7fd8bc072670 2024-03-23T23:42:37.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.657+0000 7fd8b2a00640 1 -- 172.21.15.8:0/542520456 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a80bc070 con 0x7fd8bc072670 2024-03-23T23:42:37.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.657+0000 7fd8b2a00640 1 -- 172.21.15.8:0/542520456 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a80b5830 con 0x7fd8bc072670 2024-03-23T23:42:37.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.657+0000 7fd8c1400640 1 -- 172.21.15.8:0/542520456 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8bc0c6b90 con 0x7fd8bc072670 2024-03-23T23:42:37.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.657+0000 7fd8c1400640 1 -- 172.21.15.8:0/542520456 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8bc14d850 con 0x7fd8bc072670 2024-03-23T23:42:37.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.657+0000 7fd8c1400640 1 -- 172.21.15.8:0/542520456 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8bc068270 con 0x7fd8bc072670 2024-03-23T23:42:37.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.657+0000 7fd8b2a00640 1 -- 172.21.15.8:0/542520456 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd8a80b59d0 con 0x7fd8bc072670 2024-03-23T23:42:37.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.657+0000 7fd8b2a00640 1 --2- 172.21.15.8:0/542520456 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd89c067660 0x7fd89c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:37.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.657+0000 7fd8b2a00640 1 -- 172.21.15.8:0/542520456 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd8a811fbb0 con 0x7fd8bc072670 2024-03-23T23:42:37.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.661+0000 7fd8ba800640 1 --2- 172.21.15.8:0/542520456 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd89c067660 0x7fd89c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:37.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.661+0000 7fd8ba800640 1 --2- 172.21.15.8:0/542520456 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd89c067660 0x7fd89c069b20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac007fd0 tx=0x7fd8ac007c20 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:37.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.661+0000 7fd8b2a00640 1 -- 172.21.15.8:0/542520456 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fd8a8016090 con 0x7fd8bc072670 2024-03-23T23:42:37.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.825+0000 7fd8c1400640 1 -- 172.21.15.8:0/542520456 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd8bc06f7b0 con 0x7fd8bc072670 2024-03-23T23:42:37.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.825+0000 7fd8b2a00640 1 -- 172.21.15.8:0/542520456 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7fd8a80f0b70 con 0x7fd8bc072670 2024-03-23T23:42:37.828 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:42:37.828 INFO:teuthology.orchestra.run.smithi008.stdout:[ 2024-03-23T23:42:37.828 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:42:37.828 INFO:teuthology.orchestra.run.smithi008.stdout: "poolnum": 1, 2024-03-23T23:42:37.828 INFO:teuthology.orchestra.run.smithi008.stdout: "poolname": ".mgr" 2024-03-23T23:42:37.828 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:42:37.829 INFO:teuthology.orchestra.run.smithi008.stdout:] 2024-03-23T23:42:37.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.829+0000 7fd8c1400640 1 -- 172.21.15.8:0/542520456 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd89c067660 msgr2=0x7fd89c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:37.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.829+0000 7fd8c1400640 1 --2- 172.21.15.8:0/542520456 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd89c067660 0x7fd89c069b20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac007fd0 tx=0x7fd8ac007c20 comp rx=0 tx=0).stop 2024-03-23T23:42:37.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.829+0000 7fd8c1400640 1 -- 172.21.15.8:0/542520456 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8bc072670 msgr2=0x7fd8bc1efc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:37.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.829+0000 7fd8c1400640 1 --2- 172.21.15.8:0/542520456 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8bc072670 0x7fd8bc1efc70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd8a801a040 tx=0x7fd8a801ac50 comp rx=0 tx=0).stop 2024-03-23T23:42:37.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.829+0000 7fd8c1400640 1 -- 172.21.15.8:0/542520456 shutdown_connections 2024-03-23T23:42:37.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.829+0000 7fd8c1400640 1 --2- 172.21.15.8:0/542520456 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd89c067660 0x7fd89c069b20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:37.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.829+0000 7fd8c1400640 1 --2- 172.21.15.8:0/542520456 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8bc150da0 0x7fd8bc1455d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:37.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.829+0000 7fd8c1400640 1 --2- 172.21.15.8:0/542520456 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8bc072670 0x7fd8bc1efc70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:37.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.829+0000 7fd8c1400640 1 --2- 172.21.15.8:0/542520456 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8bc06ee90 0x7fd8bc1ef730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:37.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.829+0000 7fd8c1400640 1 -- 172.21.15.8:0/542520456 >> 172.21.15.8:0/542520456 conn(0x7fd8bc06c280 msgr2=0x7fd8bc06c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:37.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.829+0000 7fd8c1400640 1 -- 172.21.15.8:0/542520456 shutdown_connections 2024-03-23T23:42:37.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.829+0000 7fd8c1400640 1 -- 172.21.15.8:0/542520456 wait complete. 2024-03-23T23:42:37.849 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'a' 2024-03-23T23:42:37.849 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create a_metadata --pg_num_min 64 2024-03-23T23:42:37.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.993+0000 7f6e70600640 1 Processor -- start 2024-03-23T23:42:37.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.993+0000 7f6e70600640 1 -- start start 2024-03-23T23:42:37.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.993+0000 7f6e70600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6e68150da0 0x7f6e6806d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:37.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.993+0000 7f6e70600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6e6806e2c0 0x7f6e681572b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:37.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.993+0000 7f6e70600640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e68154480 con 0x7f6e6806de30 2024-03-23T23:42:37.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.993+0000 7f6e70600640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e680aa180 con 0x7f6e6806e2c0 2024-03-23T23:42:37.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.993+0000 7f6e70600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e680aa460 con 0x7f6e68150da0 2024-03-23T23:42:37.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.993+0000 7f6e6e600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6e6806e2c0 0x7f6e681572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:37.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.993+0000 7f6e6e600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6e6806e2c0 0x7f6e681572b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57740/0 (socket says 172.21.15.8:57740) 2024-03-23T23:42:37.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.993+0000 7f6e6e600640 1 -- 172.21.15.8:0/3952467263 learned_addr learned my addr 172.21.15.8:0/3952467263 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:37.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.993+0000 7f6e6d200640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f6e6806de30 0x7f6e68156ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42462/0 (socket says 172.21.15.8:42462) 2024-03-23T23:42:37.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.993+0000 7f6e6dc00640 1 --2- 172.21.15.8:0/3952467263 >> v2:172.21.15.196:3300/0 conn(0x7f6e68150da0 0x7f6e6806d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:37.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.993+0000 7f6e6e600640 1 -- 172.21.15.8:0/3952467263 >> v2:172.21.15.196:3300/0 conn(0x7f6e68150da0 msgr2=0x7f6e6806d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:37.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.993+0000 7f6e6e600640 1 --2- 172.21.15.8:0/3952467263 >> v2:172.21.15.196:3300/0 conn(0x7f6e68150da0 0x7f6e6806d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:37.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.993+0000 7f6e6e600640 1 -- 172.21.15.8:0/3952467263 >> v1:172.21.15.8:6789/0 conn(0x7f6e6806de30 legacy=0x7f6e68156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:37.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.993+0000 7f6e6e600640 1 -- 172.21.15.8:0/3952467263 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e680aa740 con 0x7f6e6806e2c0 2024-03-23T23:42:37.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.993+0000 7f6e67e00640 1 -- 172.21.15.8:0/3952467263 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3194968140 0 0) 0x7f6e68154480 con 0x7f6e6806de30 2024-03-23T23:42:37.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.997+0000 7f6e6e600640 1 --2- 172.21.15.8:0/3952467263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e6806e2c0 0x7f6e681572b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6e680c4bb0 tx=0x7f6e6001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b80b0762da1499 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:37.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.997+0000 7f6e67e00640 1 -- 172.21.15.8:0/3952467263 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e600a5740 con 0x7f6e6806e2c0 2024-03-23T23:42:37.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.997+0000 7f6e67e00640 1 -- 172.21.15.8:0/3952467263 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e600a58e0 con 0x7f6e6806e2c0 2024-03-23T23:42:37.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.997+0000 7f6e67e00640 1 -- 172.21.15.8:0/3952467263 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e600a5cb0 con 0x7f6e6806e2c0 2024-03-23T23:42:37.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.997+0000 7f6e70600640 1 -- 172.21.15.8:0/3952467263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e6806e2c0 msgr2=0x7f6e681572b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:37.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.997+0000 7f6e70600640 1 --2- 172.21.15.8:0/3952467263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e6806e2c0 0x7f6e681572b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6e680c4bb0 tx=0x7f6e6001c9f0 comp rx=0 tx=0).stop 2024-03-23T23:42:37.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.997+0000 7f6e70600640 1 -- 172.21.15.8:0/3952467263 shutdown_connections 2024-03-23T23:42:37.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.997+0000 7f6e70600640 1 --2- 172.21.15.8:0/3952467263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e6806e2c0 0x7f6e681572b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:37.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.997+0000 7f6e70600640 1 --2- 172.21.15.8:0/3952467263 >> v2:172.21.15.196:3300/0 conn(0x7f6e68150da0 0x7f6e6806d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:37.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.997+0000 7f6e70600640 1 -- 172.21.15.8:0/3952467263 >> 172.21.15.8:0/3952467263 conn(0x7f6e680c7060 msgr2=0x7f6e680c7470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:37.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.997+0000 7f6e70600640 1 -- 172.21.15.8:0/3952467263 shutdown_connections 2024-03-23T23:42:37.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.997+0000 7f6e70600640 1 -- 172.21.15.8:0/3952467263 wait complete. 2024-03-23T23:42:38.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:37.997+0000 7f6e70600640 1 Processor -- start 2024-03-23T23:42:38.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.001+0000 7f6e70600640 1 -- start start 2024-03-23T23:42:38.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.001+0000 7f6e70600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e6806de30 0x7f6e680c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:38.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.001+0000 7f6e70600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e6806e2c0 0x7f6e680c19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:38.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.001+0000 7f6e70600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6e68150da0 0x7f6e681f1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:38.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.001+0000 7f6e70600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e681541b0 con 0x7f6e6806e2c0 2024-03-23T23:42:38.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.001+0000 7f6e70600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e68154030 con 0x7f6e68150da0 2024-03-23T23:42:38.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.001+0000 7f6e70600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e681577f0 con 0x7f6e6806de30 2024-03-23T23:42:38.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.001+0000 7f6e6d200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e6806e2c0 0x7f6e680c19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:38.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.001+0000 7f6e6d200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e6806e2c0 0x7f6e680c19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57748/0 (socket says 172.21.15.8:57748) 2024-03-23T23:42:38.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.001+0000 7f6e6d200640 1 -- 172.21.15.8:0/1507565401 learned_addr learned my addr 172.21.15.8:0/1507565401 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:38.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.001+0000 7f6e6e600640 1 --2- 172.21.15.8:0/1507565401 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6e68150da0 0x7f6e681f1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:38.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.001+0000 7f6e6dc00640 1 --2- 172.21.15.8:0/1507565401 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e6806de30 0x7f6e680c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:38.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.001+0000 7f6e6d200640 1 -- 172.21.15.8:0/1507565401 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e6806de30 msgr2=0x7f6e680c40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:38.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.001+0000 7f6e6d200640 1 --2- 172.21.15.8:0/1507565401 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e6806de30 0x7f6e680c40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:38.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.001+0000 7f6e6d200640 1 -- 172.21.15.8:0/1507565401 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6e68150da0 msgr2=0x7f6e681f1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:38.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.001+0000 7f6e6d200640 1 --2- 172.21.15.8:0/1507565401 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6e68150da0 0x7f6e681f1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:38.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.001+0000 7f6e6d200640 1 -- 172.21.15.8:0/1507565401 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e68153540 con 0x7f6e6806e2c0 2024-03-23T23:42:38.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.001+0000 7f6e6e600640 1 --2- 172.21.15.8:0/1507565401 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6e68150da0 0x7f6e681f1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:42:38.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.001+0000 7f6e6d200640 1 --2- 172.21.15.8:0/1507565401 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e6806e2c0 0x7f6e680c19b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6e540011f0 tx=0x7f6e5400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:38.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.001+0000 7f6e65600640 1 -- 172.21.15.8:0/1507565401 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e54018070 con 0x7f6e6806e2c0 2024-03-23T23:42:38.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.001+0000 7f6e65600640 1 -- 172.21.15.8:0/1507565401 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e540074e0 con 0x7f6e6806e2c0 2024-03-23T23:42:38.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.001+0000 7f6e65600640 1 -- 172.21.15.8:0/1507565401 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e54004a10 con 0x7f6e6806e2c0 2024-03-23T23:42:38.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.001+0000 7f6e70600640 1 -- 172.21.15.8:0/1507565401 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e68153820 con 0x7f6e6806e2c0 2024-03-23T23:42:38.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.001+0000 7f6e70600640 1 -- 172.21.15.8:0/1507565401 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e681f15c0 con 0x7f6e6806e2c0 2024-03-23T23:42:38.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.001+0000 7f6e70600640 1 -- 172.21.15.8:0/1507565401 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e6804f480 con 0x7f6e6806e2c0 2024-03-23T23:42:38.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.005+0000 7f6e65600640 1 -- 172.21.15.8:0/1507565401 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f6e5401b070 con 0x7f6e6806e2c0 2024-03-23T23:42:38.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.005+0000 7f6e65600640 1 --2- 172.21.15.8:0/1507565401 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6e48067660 0x7f6e48069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:38.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.005+0000 7f6e65600640 1 -- 172.21.15.8:0/1507565401 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6e54084900 con 0x7f6e6806e2c0 2024-03-23T23:42:38.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.005+0000 7f6e6dc00640 1 --2- 172.21.15.8:0/1507565401 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6e48067660 0x7f6e48069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:38.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.005+0000 7f6e6dc00640 1 --2- 172.21.15.8:0/1507565401 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6e48067660 0x7f6e48069b20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c009a50 tx=0x7f6e5c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:38.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.009+0000 7f6e65600640 1 -- 172.21.15.8:0/1507565401 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f6e540558c0 con 0x7f6e6806e2c0 2024-03-23T23:42:38.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.169+0000 7f6e70600640 1 -- 172.21.15.8:0/1507565401 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "a_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6e681505b0 con 0x7f6e6806e2c0 2024-03-23T23:42:38.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.649+0000 7f6e65600640 1 -- 172.21.15.8:0/1507565401 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "a_metadata", "pg_num_min": 64}]=0 pool 'a_metadata' created v18) v1 ==== 128+0+0 (secure 0 0 0) 0x7f6e540551c0 con 0x7f6e6806e2c0 2024-03-23T23:42:38.650 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'a_metadata' created 2024-03-23T23:42:38.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.653+0000 7f6e70600640 1 -- 172.21.15.8:0/1507565401 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6e48067660 msgr2=0x7f6e48069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:38.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.653+0000 7f6e70600640 1 --2- 172.21.15.8:0/1507565401 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6e48067660 0x7f6e48069b20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c009a50 tx=0x7f6e5c008040 comp rx=0 tx=0).stop 2024-03-23T23:42:38.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.653+0000 7f6e70600640 1 -- 172.21.15.8:0/1507565401 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e6806e2c0 msgr2=0x7f6e680c19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:38.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.653+0000 7f6e70600640 1 --2- 172.21.15.8:0/1507565401 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e6806e2c0 0x7f6e680c19b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6e540011f0 tx=0x7f6e5400c9b0 comp rx=0 tx=0).stop 2024-03-23T23:42:38.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.653+0000 7f6e70600640 1 -- 172.21.15.8:0/1507565401 shutdown_connections 2024-03-23T23:42:38.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.653+0000 7f6e70600640 1 --2- 172.21.15.8:0/1507565401 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6e68150da0 0x7f6e681f1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:38.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.653+0000 7f6e70600640 1 --2- 172.21.15.8:0/1507565401 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e6806e2c0 0x7f6e680c19b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:38.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.653+0000 7f6e70600640 1 --2- 172.21.15.8:0/1507565401 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6e48067660 0x7f6e48069b20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:38.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.653+0000 7f6e70600640 1 --2- 172.21.15.8:0/1507565401 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e6806de30 0x7f6e680c40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:38.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.653+0000 7f6e70600640 1 -- 172.21.15.8:0/1507565401 >> 172.21.15.8:0/1507565401 conn(0x7f6e680c7060 msgr2=0x7f6e6814fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:38.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.653+0000 7f6e70600640 1 -- 172.21.15.8:0/1507565401 shutdown_connections 2024-03-23T23:42:38.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.653+0000 7f6e70600640 1 -- 172.21.15.8:0/1507565401 wait complete. 2024-03-23T23:42:38.679 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create a_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-23T23:42:38.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.825+0000 7fb132200640 1 Processor -- start 2024-03-23T23:42:38.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.825+0000 7fb132200640 1 -- start start 2024-03-23T23:42:38.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.825+0000 7fb132200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb12c06d300 0x7fb12c14f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:38.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.829+0000 7fb132200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb12c06e940 con 0x7fb12c0aab90 2024-03-23T23:42:38.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.829+0000 7fb132200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb12c06ec20 con 0x7fb12c06dab0 2024-03-23T23:42:38.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.829+0000 7fb132200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb12c06e6f0 con 0x7fb12c06d300 2024-03-23T23:42:38.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.829+0000 7fb12be00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb12c06d300 0x7fb12c14f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:38.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.829+0000 7fb12be00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb12c06d300 0x7fb12c14f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57752/0 (socket says 172.21.15.8:57752) 2024-03-23T23:42:38.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.829+0000 7fb12be00640 1 -- 172.21.15.8:0/2693045484 learned_addr learned my addr 172.21.15.8:0/2693045484 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:38.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.829+0000 7fb123e00640 1 --1- 172.21.15.8:0/2693045484 >> v1:172.21.15.8:6789/0 conn(0x7fb12c0aab90 0x7fb12c152670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42466/0 (socket says 172.21.15.8:42466) 2024-03-23T23:42:38.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.829+0000 7fb12be00640 1 -- 172.21.15.8:0/2693045484 >> v1:172.21.15.196:6789/0 conn(0x7fb12c06dab0 legacy=0x7fb12c156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:38.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.829+0000 7fb12be00640 1 -- 172.21.15.8:0/2693045484 >> v1:172.21.15.8:6789/0 conn(0x7fb12c0aab90 legacy=0x7fb12c152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:38.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.829+0000 7fb12be00640 1 -- 172.21.15.8:0/2693045484 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12c155d80 con 0x7fb12c06d300 2024-03-23T23:42:38.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.829+0000 7fb12aa00640 1 -- 172.21.15.8:0/2693045484 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4089799368 0 0) 0x7fb12c06e940 con 0x7fb12c0aab90 2024-03-23T23:42:38.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.829+0000 7fb12be00640 1 --2- 172.21.15.8:0/2693045484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb12c06d300 0x7fb12c14f8b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb124009e50 tx=0x7fb12401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b525b606a9325d9 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:38.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.829+0000 7fb12aa00640 1 -- 172.21.15.8:0/2693045484 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1240a5810 con 0x7fb12c06d300 2024-03-23T23:42:38.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.829+0000 7fb12aa00640 1 -- 172.21.15.8:0/2693045484 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1240a59b0 con 0x7fb12c06d300 2024-03-23T23:42:38.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.829+0000 7fb12aa00640 1 -- 172.21.15.8:0/2693045484 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1240a5d80 con 0x7fb12c06d300 2024-03-23T23:42:38.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.833+0000 7fb132200640 1 -- 172.21.15.8:0/2693045484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb12c06d300 msgr2=0x7fb12c14f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:38.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.833+0000 7fb132200640 1 --2- 172.21.15.8:0/2693045484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb12c06d300 0x7fb12c14f8b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb124009e50 tx=0x7fb12401ca30 comp rx=0 tx=0).stop 2024-03-23T23:42:38.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.833+0000 7fb132200640 1 -- 172.21.15.8:0/2693045484 shutdown_connections 2024-03-23T23:42:38.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.833+0000 7fb132200640 1 --2- 172.21.15.8:0/2693045484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb12c06d300 0x7fb12c14f8b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:38.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.833+0000 7fb132200640 1 -- 172.21.15.8:0/2693045484 >> 172.21.15.8:0/2693045484 conn(0x7fb12c06b170 msgr2=0x7fb12c06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:38.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.833+0000 7fb132200640 1 -- 172.21.15.8:0/2693045484 shutdown_connections 2024-03-23T23:42:38.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.833+0000 7fb132200640 1 -- 172.21.15.8:0/2693045484 wait complete. 2024-03-23T23:42:38.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.833+0000 7fb132200640 1 Processor -- start 2024-03-23T23:42:38.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.833+0000 7fb132200640 1 -- start start 2024-03-23T23:42:38.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.833+0000 7fb132200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb12c06d300 0x7fb12c1f2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:38.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.833+0000 7fb132200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb12c06dab0 0x7fb12c1eea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:38.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.833+0000 7fb132200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb12c0aab90 0x7fb12c1549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:38.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.833+0000 7fb132200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c0c1be0 con 0x7fb12c06dab0 2024-03-23T23:42:38.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.833+0000 7fb132200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c0c1a60 con 0x7fb12c0aab90 2024-03-23T23:42:38.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.833+0000 7fb132200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c0c1d60 con 0x7fb12c06d300 2024-03-23T23:42:38.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.833+0000 7fb123e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb12c06dab0 0x7fb12c1eea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:38.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.833+0000 7fb123e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb12c06dab0 0x7fb12c1eea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57762/0 (socket says 172.21.15.8:57762) 2024-03-23T23:42:38.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.833+0000 7fb123e00640 1 -- 172.21.15.8:0/2292752288 learned_addr learned my addr 172.21.15.8:0/2292752288 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:38.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.833+0000 7fb12be00640 1 --2- 172.21.15.8:0/2292752288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb12c0aab90 0x7fb12c1549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:38.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.833+0000 7fb12b400640 1 --2- 172.21.15.8:0/2292752288 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb12c06d300 0x7fb12c1f2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:38.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.833+0000 7fb123e00640 1 -- 172.21.15.8:0/2292752288 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb12c06d300 msgr2=0x7fb12c1f2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:38.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.833+0000 7fb123e00640 1 --2- 172.21.15.8:0/2292752288 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb12c06d300 0x7fb12c1f2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:38.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.833+0000 7fb123e00640 1 -- 172.21.15.8:0/2292752288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb12c0aab90 msgr2=0x7fb12c1549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:38.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.833+0000 7fb123e00640 1 --2- 172.21.15.8:0/2292752288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb12c0aab90 0x7fb12c1549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:38.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.833+0000 7fb123e00640 1 -- 172.21.15.8:0/2292752288 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12c072ad0 con 0x7fb12c06dab0 2024-03-23T23:42:38.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.833+0000 7fb12be00640 1 --2- 172.21.15.8:0/2292752288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb12c0aab90 0x7fb12c1549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:42:38.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.837+0000 7fb123e00640 1 --2- 172.21.15.8:0/2292752288 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb12c06dab0 0x7fb12c1eea40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb11400c410 tx=0x7fb11400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:38.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.837+0000 7fb123400640 1 -- 172.21.15.8:0/2292752288 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1140074e0 con 0x7fb12c06dab0 2024-03-23T23:42:38.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.837+0000 7fb123400640 1 -- 172.21.15.8:0/2292752288 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1140047f0 con 0x7fb12c06dab0 2024-03-23T23:42:38.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.837+0000 7fb123400640 1 -- 172.21.15.8:0/2292752288 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb114007680 con 0x7fb12c06dab0 2024-03-23T23:42:38.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.837+0000 7fb132200640 1 -- 172.21.15.8:0/2292752288 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb12c072db0 con 0x7fb12c06dab0 2024-03-23T23:42:38.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.837+0000 7fb132200640 1 -- 172.21.15.8:0/2292752288 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb12c1f1550 con 0x7fb12c06dab0 2024-03-23T23:42:38.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.837+0000 7fb132200640 1 -- 172.21.15.8:0/2292752288 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb12c04f410 con 0x7fb12c06dab0 2024-03-23T23:42:38.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.837+0000 7fb123400640 1 -- 172.21.15.8:0/2292752288 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb114011070 con 0x7fb12c06dab0 2024-03-23T23:42:38.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.837+0000 7fb123400640 1 --2- 172.21.15.8:0/2292752288 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb108067660 0x7fb108069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:38.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.841+0000 7fb123400640 1 -- 172.21.15.8:0/2292752288 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5222+0+0 (secure 0 0 0) 0x7fb114085860 con 0x7fb12c06dab0 2024-03-23T23:42:38.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.841+0000 7fb12b400640 1 --2- 172.21.15.8:0/2292752288 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb108067660 0x7fb108069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:38.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.841+0000 7fb12b400640 1 --2- 172.21.15.8:0/2292752288 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb108067660 0x7fb108069b20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb11c000f70 tx=0x7fb11c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:38.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:38.841+0000 7fb123400640 1 -- 172.21.15.8:0/2292752288 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fb1140567a0 con 0x7fb12c06dab0 2024-03-23T23:42:39.007 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.005+0000 7fb132200640 1 -- 172.21.15.8:0/2292752288 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "a_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb12c06d0e0 con 0x7fb12c06dab0 2024-03-23T23:42:39.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.657+0000 7fb123400640 1 -- 172.21.15.8:0/2292752288 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "a_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'a_data' created v19) v1 ==== 160+0+0 (secure 0 0 0) 0x7fb1140560a0 con 0x7fb12c06dab0 2024-03-23T23:42:39.657 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'a_data' created 2024-03-23T23:42:39.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.657+0000 7fb132200640 1 -- 172.21.15.8:0/2292752288 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb108067660 msgr2=0x7fb108069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:39.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.657+0000 7fb132200640 1 --2- 172.21.15.8:0/2292752288 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb108067660 0x7fb108069b20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb11c000f70 tx=0x7fb11c009040 comp rx=0 tx=0).stop 2024-03-23T23:42:39.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.657+0000 7fb132200640 1 -- 172.21.15.8:0/2292752288 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb12c06dab0 msgr2=0x7fb12c1eea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:39.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.657+0000 7fb132200640 1 --2- 172.21.15.8:0/2292752288 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb12c06dab0 0x7fb12c1eea40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb11400c410 tx=0x7fb11400c8d0 comp rx=0 tx=0).stop 2024-03-23T23:42:39.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.657+0000 7fb132200640 1 -- 172.21.15.8:0/2292752288 shutdown_connections 2024-03-23T23:42:39.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.657+0000 7fb132200640 1 --2- 172.21.15.8:0/2292752288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb12c0aab90 0x7fb12c1549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:39.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.657+0000 7fb132200640 1 --2- 172.21.15.8:0/2292752288 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb12c06dab0 0x7fb12c1eea40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:39.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.657+0000 7fb132200640 1 --2- 172.21.15.8:0/2292752288 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb108067660 0x7fb108069b20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:39.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.657+0000 7fb132200640 1 --2- 172.21.15.8:0/2292752288 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb12c06d300 0x7fb12c1f2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:39.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.661+0000 7fb132200640 1 -- 172.21.15.8:0/2292752288 >> 172.21.15.8:0/2292752288 conn(0x7fb12c06b170 msgr2=0x7fb12c06b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:39.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.661+0000 7fb132200640 1 -- 172.21.15.8:0/2292752288 shutdown_connections 2024-03-23T23:42:39.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.661+0000 7fb132200640 1 -- 172.21.15.8:0/2292752288 wait complete. 2024-03-23T23:42:39.705 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new a a_metadata a_data 2024-03-23T23:42:39.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f0902c00640 1 Processor -- start 2024-03-23T23:42:39.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f0902c00640 1 -- start start 2024-03-23T23:42:39.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f0902c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f08fc0aab90 0x7f08fc152670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:39.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f0902c00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08fc06e940 con 0x7f08fc06d300 2024-03-23T23:42:39.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f0902c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08fc06ec20 con 0x7f08fc06dab0 2024-03-23T23:42:39.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f0902c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08fc06e6f0 con 0x7f08fc0aab90 2024-03-23T23:42:39.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f0900c00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f08fc06d300 0x7f08fc14f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42480/0 (socket says 172.21.15.8:42480) 2024-03-23T23:42:39.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f0900c00640 1 -- 172.21.15.8:0/3432504118 learned_addr learned my addr 172.21.15.8:0/3432504118 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:39.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f08f3e00640 1 --2- 172.21.15.8:0/3432504118 >> v2:172.21.15.196:3300/0 conn(0x7f08fc0aab90 0x7f08fc152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:39.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f08fb400640 1 -- 172.21.15.8:0/3432504118 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3468664860 0 0) 0x7f08fc06e940 con 0x7f08fc06d300 2024-03-23T23:42:39.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f08fb400640 1 -- 172.21.15.8:0/3432504118 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08e0003530 con 0x7f08fc06d300 2024-03-23T23:42:39.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f08fb400640 1 -- 172.21.15.8:0/3432504118 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 608777125 0 0) 0x7f08fc06ec20 con 0x7f08fc06dab0 2024-03-23T23:42:39.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f08fb400640 1 -- 172.21.15.8:0/3432504118 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08fc06e940 con 0x7f08fc06dab0 2024-03-23T23:42:39.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f08fb400640 1 -- 172.21.15.8:0/3432504118 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1732046997 0 0) 0x7f08e0003530 con 0x7f08fc06d300 2024-03-23T23:42:39.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f08fb400640 1 -- 172.21.15.8:0/3432504118 >> v2:172.21.15.196:3300/0 conn(0x7f08fc0aab90 msgr2=0x7f08fc152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:39.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f08fb400640 1 --2- 172.21.15.8:0/3432504118 >> v2:172.21.15.196:3300/0 conn(0x7f08fc0aab90 0x7f08fc152670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:39.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f08fb400640 1 -- 172.21.15.8:0/3432504118 >> v1:172.21.15.196:6789/0 conn(0x7f08fc06dab0 legacy=0x7f08fc156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:39.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f08fb400640 1 -- 172.21.15.8:0/3432504118 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc155d80 con 0x7f08fc06d300 2024-03-23T23:42:39.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f08fb400640 1 -- 172.21.15.8:0/3432504118 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7f08f4001a00 con 0x7f08fc06d300 2024-03-23T23:42:39.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f08f3e00640 1 --2- 172.21.15.8:0/3432504118 >> v2:172.21.15.196:3300/0 conn(0x7f08fc0aab90 0x7f08fc152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:42:39.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f08fb400640 1 -- 172.21.15.8:0/3432504118 >> v1:172.21.15.8:6789/0 conn(0x7f08fc06d300 legacy=0x7f08fc14f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:39.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f08fb400640 1 --2- 172.21.15.8:0/3432504118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08e0003b50 0x7f08e0003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:39.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f08fb400640 1 --2- 172.21.15.8:0/3432504118 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08e0004810 0x7f08e0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:39.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f08fb400640 1 --2- 172.21.15.8:0/3432504118 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08e00051d0 0x7f08e000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:39.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f08fb400640 1 -- 172.21.15.8:0/3432504118 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc06e6f0 con 0x7f08e0003b50 2024-03-23T23:42:39.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f08fb400640 1 -- 172.21.15.8:0/3432504118 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e000c050 con 0x7f08e0004810 2024-03-23T23:42:39.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f08fb400640 1 -- 172.21.15.8:0/3432504118 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e000c250 con 0x7f08e00051d0 2024-03-23T23:42:39.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f08fbe00640 1 --2- 172.21.15.8:0/3432504118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08e0003b50 0x7f08e0003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:39.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f08f3e00640 1 --2- 172.21.15.8:0/3432504118 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08e0004810 0x7f08e0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:39.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f0900c00640 1 --2- 172.21.15.8:0/3432504118 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08e00051d0 0x7f08e000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:39.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f08fbe00640 1 -- 172.21.15.8:0/3432504118 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08e00051d0 msgr2=0x7f08e000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:39.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f08fbe00640 1 --2- 172.21.15.8:0/3432504118 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08e00051d0 0x7f08e000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:39.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f08fbe00640 1 -- 172.21.15.8:0/3432504118 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08e0004810 msgr2=0x7f08e0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:39.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f08fbe00640 1 --2- 172.21.15.8:0/3432504118 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08e0004810 0x7f08e0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:39.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.849+0000 7f08fbe00640 1 -- 172.21.15.8:0/3432504118 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e0003530 con 0x7f08e0003b50 2024-03-23T23:42:39.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.853+0000 7f0900c00640 1 -- 172.21.15.8:0/3432504118 reap_dead start 2024-03-23T23:42:39.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.853+0000 7f08fbe00640 1 --2- 172.21.15.8:0/3432504118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08e0003b50 0x7f08e0003f50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f08ec0018d0 tx=0x7f08ec01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33595bd891d50e0d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:39.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.853+0000 7f08fb400640 1 -- 172.21.15.8:0/3432504118 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec001520 con 0x7f08e0003b50 2024-03-23T23:42:39.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.853+0000 7f08fb400640 1 -- 172.21.15.8:0/3432504118 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ec0052f0 con 0x7f08e0003b50 2024-03-23T23:42:39.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.853+0000 7f08fb400640 1 -- 172.21.15.8:0/3432504118 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec003840 con 0x7f08e0003b50 2024-03-23T23:42:39.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.853+0000 7f0902c00640 1 -- 172.21.15.8:0/3432504118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08e0003b50 msgr2=0x7f08e0003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:39.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.853+0000 7f0902c00640 1 --2- 172.21.15.8:0/3432504118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08e0003b50 0x7f08e0003f50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f08ec0018d0 tx=0x7f08ec01c560 comp rx=0 tx=0).stop 2024-03-23T23:42:39.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.853+0000 7f0902c00640 1 -- 172.21.15.8:0/3432504118 shutdown_connections 2024-03-23T23:42:39.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.853+0000 7f0902c00640 1 --2- 172.21.15.8:0/3432504118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08e0003b50 0x7f08e0003f50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:39.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.853+0000 7f0902c00640 1 -- 172.21.15.8:0/3432504118 >> 172.21.15.8:0/3432504118 conn(0x7f08fc06b170 msgr2=0x7f08fc06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:39.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.853+0000 7f0902c00640 1 -- 172.21.15.8:0/3432504118 shutdown_connections 2024-03-23T23:42:39.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.853+0000 7f0902c00640 1 -- 172.21.15.8:0/3432504118 wait complete. 2024-03-23T23:42:39.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.857+0000 7f0902c00640 1 Processor -- start 2024-03-23T23:42:39.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.857+0000 7f0902c00640 1 -- start start 2024-03-23T23:42:39.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.857+0000 7f0902c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08e0003b50 0x7f08fc1eeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:39.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.857+0000 7f0902c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08fc155610 0x7f08fc1e2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:39.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.857+0000 7f0902c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08fc1f2830 0x7f08fc147910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:39.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.857+0000 7f0902c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc152c00 con 0x7f08fc155610 2024-03-23T23:42:39.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.857+0000 7f0902c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc152a80 con 0x7f08e0003b50 2024-03-23T23:42:39.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.857+0000 7f0902c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc06de90 con 0x7f08fc1f2830 2024-03-23T23:42:39.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.857+0000 7f08f3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08fc155610 0x7f08fc1e2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:39.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.857+0000 7f08f3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08fc155610 0x7f08fc1e2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57786/0 (socket says 172.21.15.8:57786) 2024-03-23T23:42:39.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.857+0000 7f08f3e00640 1 -- 172.21.15.8:0/3614405081 learned_addr learned my addr 172.21.15.8:0/3614405081 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:39.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.857+0000 7f08fbe00640 1 --2- 172.21.15.8:0/3614405081 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08e0003b50 0x7f08fc1eeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:39.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.857+0000 7f0900c00640 1 --2- 172.21.15.8:0/3614405081 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08fc1f2830 0x7f08fc147910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:39.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.857+0000 7f08fbe00640 1 -- 172.21.15.8:0/3614405081 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08fc1f2830 msgr2=0x7f08fc147910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:39.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.857+0000 7f08fbe00640 1 --2- 172.21.15.8:0/3614405081 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08fc1f2830 0x7f08fc147910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:39.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.857+0000 7f08fbe00640 1 -- 172.21.15.8:0/3614405081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08fc155610 msgr2=0x7f08fc1e2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:39.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.857+0000 7f08fbe00640 1 --2- 172.21.15.8:0/3614405081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08fc155610 0x7f08fc1e2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:39.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.857+0000 7f08fbe00640 1 -- 172.21.15.8:0/3614405081 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc154710 con 0x7f08e0003b50 2024-03-23T23:42:39.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.857+0000 7f08fbe00640 1 --2- 172.21.15.8:0/3614405081 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08e0003b50 0x7f08fc1eeb50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f08e000c020 tx=0x7f08e0005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:39.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.857+0000 7f08f8c00640 1 -- 172.21.15.8:0/3614405081 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec001500 con 0x7f08e0003b50 2024-03-23T23:42:39.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.857+0000 7f08f8c00640 1 -- 172.21.15.8:0/3614405081 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ec003b80 con 0x7f08e0003b50 2024-03-23T23:42:39.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.857+0000 7f08f8c00640 1 -- 172.21.15.8:0/3614405081 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec0067e0 con 0x7f08e0003b50 2024-03-23T23:42:39.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.857+0000 7f0902c00640 1 -- 172.21.15.8:0/3614405081 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08fc1549f0 con 0x7f08e0003b50 2024-03-23T23:42:39.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.857+0000 7f0902c00640 1 -- 172.21.15.8:0/3614405081 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08fc1f2310 con 0x7f08e0003b50 2024-03-23T23:42:39.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.861+0000 7f0902c00640 1 -- 172.21.15.8:0/3614405081 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08fc04f410 con 0x7f08e0003b50 2024-03-23T23:42:39.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.861+0000 7f08f8c00640 1 -- 172.21.15.8:0/3614405081 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f08ec006980 con 0x7f08e0003b50 2024-03-23T23:42:39.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.861+0000 7f08f8c00640 1 --2- 172.21.15.8:0/3614405081 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f08d8067660 0x7f08d8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:39.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.861+0000 7f08f8c00640 1 -- 172.21.15.8:0/3614405081 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5599+0+0 (secure 0 0 0) 0x7f08ec11f960 con 0x7f08e0003b50 2024-03-23T23:42:39.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.861+0000 7f08f3e00640 1 --2- 172.21.15.8:0/3614405081 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f08d8067660 0x7f08d8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:39.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.861+0000 7f08f3e00640 1 --2- 172.21.15.8:0/3614405081 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f08d8067660 0x7f08d8069b20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f08fc148760 tx=0x7f08e4009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:39.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:39.865+0000 7f08f8c00640 1 -- 172.21.15.8:0/3614405081 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f08ec0b8020 con 0x7f08e0003b50 2024-03-23T23:42:40.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.065+0000 7f0902c00640 1 -- 172.21.15.8:0/3614405081 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "a", "metadata": "a_metadata", "data": "a_data"} v 0) v1 -- 0x7f08fc151120 con 0x7f08e0003b50 2024-03-23T23:42:40.449 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:42:40.453 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:42:40.686 INFO:teuthology.orchestra.run.smithi008.stderr:new fs with metadata pool 2 and data pool 3 2024-03-23T23:42:40.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.685+0000 7f08f8c00640 1 -- 172.21.15.8:0/3614405081 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "a", "metadata": "a_metadata", "data": "a_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 157+0+0 (secure 0 0 0) 0x7f08ec016270 con 0x7f08e0003b50 2024-03-23T23:42:40.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.689+0000 7f0902c00640 1 -- 172.21.15.8:0/3614405081 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f08d8067660 msgr2=0x7f08d8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:40.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.689+0000 7f0902c00640 1 --2- 172.21.15.8:0/3614405081 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f08d8067660 0x7f08d8069b20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f08fc148760 tx=0x7f08e4009190 comp rx=0 tx=0).stop 2024-03-23T23:42:40.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.689+0000 7f0902c00640 1 -- 172.21.15.8:0/3614405081 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08e0003b50 msgr2=0x7f08fc1eeb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:40.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.689+0000 7f0902c00640 1 --2- 172.21.15.8:0/3614405081 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08e0003b50 0x7f08fc1eeb50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f08e000c020 tx=0x7f08e0005840 comp rx=0 tx=0).stop 2024-03-23T23:42:40.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.689+0000 7f0902c00640 1 -- 172.21.15.8:0/3614405081 shutdown_connections 2024-03-23T23:42:40.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.689+0000 7f0902c00640 1 --2- 172.21.15.8:0/3614405081 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f08d8067660 0x7f08d8069b20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:40.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.689+0000 7f0902c00640 1 --2- 172.21.15.8:0/3614405081 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08fc1f2830 0x7f08fc147910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:40.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.689+0000 7f0902c00640 1 --2- 172.21.15.8:0/3614405081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08fc155610 0x7f08fc1e2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:40.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.689+0000 7f0902c00640 1 --2- 172.21.15.8:0/3614405081 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08e0003b50 0x7f08fc1eeb50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:40.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.689+0000 7f0902c00640 1 -- 172.21.15.8:0/3614405081 >> 172.21.15.8:0/3614405081 conn(0x7f08fc06b170 msgr2=0x7f08fc14d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:40.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.689+0000 7f0902c00640 1 -- 172.21.15.8:0/3614405081 shutdown_connections 2024-03-23T23:42:40.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.689+0000 7f0902c00640 1 -- 172.21.15.8:0/3614405081 wait complete. 2024-03-23T23:42:40.718 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:42:40.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.865+0000 7f1ae8a00640 1 Processor -- start 2024-03-23T23:42:40.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.865+0000 7f1ae8a00640 1 -- start start 2024-03-23T23:42:40.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.865+0000 7f1ae8a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1ae406c050 0x7f1ae40733d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:40.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.865+0000 7f1ae8a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ae4158f20 con 0x7f1ae4155900 2024-03-23T23:42:40.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.865+0000 7f1ae8a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ae4159200 con 0x7f1ae406f7e0 2024-03-23T23:42:40.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.865+0000 7f1ae8a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ae406c880 con 0x7f1ae406c050 2024-03-23T23:42:40.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.865+0000 7f1ae3e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f1ae4155900 0x7f1ae4155d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42492/0 (socket says 172.21.15.8:42492) 2024-03-23T23:42:40.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.865+0000 7f1ae3e00640 1 -- 172.21.15.8:0/2271733256 learned_addr learned my addr 172.21.15.8:0/2271733256 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:40.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.865+0000 7f1adbe00640 1 --2- 172.21.15.8:0/2271733256 >> v2:172.21.15.196:3300/0 conn(0x7f1ae406c050 0x7f1ae40733d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:40.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.865+0000 7f1ae2a00640 1 -- 172.21.15.8:0/2271733256 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4225886367 0 0) 0x7f1ae4158f20 con 0x7f1ae4155900 2024-03-23T23:42:40.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.865+0000 7f1ae2a00640 1 -- 172.21.15.8:0/2271733256 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ac8003530 con 0x7f1ae4155900 2024-03-23T23:42:40.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.865+0000 7f1ae2a00640 1 -- 172.21.15.8:0/2271733256 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1906733481 0 0) 0x7f1ae4159200 con 0x7f1ae406f7e0 2024-03-23T23:42:40.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.865+0000 7f1ae2a00640 1 -- 172.21.15.8:0/2271733256 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ae4158f20 con 0x7f1ae406f7e0 2024-03-23T23:42:40.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.865+0000 7f1adbe00640 1 -- 172.21.15.8:0/2271733256 >> v1:172.21.15.196:6789/0 conn(0x7f1ae406f7e0 legacy=0x7f1ae4152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:40.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.865+0000 7f1adbe00640 1 -- 172.21.15.8:0/2271733256 >> v1:172.21.15.8:6789/0 conn(0x7f1ae4155900 legacy=0x7f1ae4155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:40.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.865+0000 7f1adbe00640 1 -- 172.21.15.8:0/2271733256 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae41594e0 con 0x7f1ae406c050 2024-03-23T23:42:40.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.869+0000 7f1adbe00640 1 --2- 172.21.15.8:0/2271733256 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ae406c050 0x7f1ae40733d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1acc0097c0 tx=0x7f1acc01c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5fd2b044834d6bb server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:40.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.869+0000 7f1ae2a00640 1 -- 172.21.15.8:0/2271733256 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc0b0070 con 0x7f1ae406c050 2024-03-23T23:42:40.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.869+0000 7f1ae2a00640 1 -- 172.21.15.8:0/2271733256 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1acc0ab600 con 0x7f1ae406c050 2024-03-23T23:42:40.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.869+0000 7f1ae2a00640 1 -- 172.21.15.8:0/2271733256 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc0ab9d0 con 0x7f1ae406c050 2024-03-23T23:42:40.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.869+0000 7f1ae8a00640 1 -- 172.21.15.8:0/2271733256 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ae406c050 msgr2=0x7f1ae40733d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:40.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.869+0000 7f1ae8a00640 1 --2- 172.21.15.8:0/2271733256 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ae406c050 0x7f1ae40733d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1acc0097c0 tx=0x7f1acc01c380 comp rx=0 tx=0).stop 2024-03-23T23:42:40.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.869+0000 7f1ae8a00640 1 -- 172.21.15.8:0/2271733256 shutdown_connections 2024-03-23T23:42:40.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.869+0000 7f1ae8a00640 1 --2- 172.21.15.8:0/2271733256 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ae406c050 0x7f1ae40733d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:40.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.869+0000 7f1ae8a00640 1 -- 172.21.15.8:0/2271733256 >> 172.21.15.8:0/2271733256 conn(0x7f1ae406b170 msgr2=0x7f1ae406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:40.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.869+0000 7f1ae8a00640 1 -- 172.21.15.8:0/2271733256 shutdown_connections 2024-03-23T23:42:40.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.869+0000 7f1ae8a00640 1 -- 172.21.15.8:0/2271733256 wait complete. 2024-03-23T23:42:40.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.869+0000 7f1ae8a00640 1 Processor -- start 2024-03-23T23:42:40.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.873+0000 7f1ae8a00640 1 -- start start 2024-03-23T23:42:40.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.873+0000 7f1ae8a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ae406c050 0x7f1ae41f1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:40.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.873+0000 7f1ae8a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ae406f7e0 0x7f1ae41f15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:40.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.873+0000 7f1ae8a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ae4155900 0x7f1ae41544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:40.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.873+0000 7f1ae8a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae406fd40 con 0x7f1ae406f7e0 2024-03-23T23:42:40.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.873+0000 7f1ae8a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae406fbc0 con 0x7f1ae4155900 2024-03-23T23:42:40.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.873+0000 7f1ae8a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae4163940 con 0x7f1ae406c050 2024-03-23T23:42:40.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.873+0000 7f1adbe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ae406f7e0 0x7f1ae41f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:40.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.873+0000 7f1adbe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ae406f7e0 0x7f1ae41f15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57794/0 (socket says 172.21.15.8:57794) 2024-03-23T23:42:40.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.873+0000 7f1adbe00640 1 -- 172.21.15.8:0/2592230823 learned_addr learned my addr 172.21.15.8:0/2592230823 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:40.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.873+0000 7f1ae3400640 1 --2- 172.21.15.8:0/2592230823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ae406c050 0x7f1ae41f1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:40.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.873+0000 7f1adbe00640 1 -- 172.21.15.8:0/2592230823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ae406c050 msgr2=0x7f1ae41f1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:40.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.873+0000 7f1ae3e00640 1 --2- 172.21.15.8:0/2592230823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ae4155900 0x7f1ae41544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:40.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.873+0000 7f1adbe00640 1 --2- 172.21.15.8:0/2592230823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ae406c050 0x7f1ae41f1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:40.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.873+0000 7f1adbe00640 1 -- 172.21.15.8:0/2592230823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ae4155900 msgr2=0x7f1ae41544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:40.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.873+0000 7f1adbe00640 1 --2- 172.21.15.8:0/2592230823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ae4155900 0x7f1ae41544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:40.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.873+0000 7f1adbe00640 1 -- 172.21.15.8:0/2592230823 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae4147470 con 0x7f1ae406f7e0 2024-03-23T23:42:40.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.873+0000 7f1ae3400640 1 --2- 172.21.15.8:0/2592230823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ae406c050 0x7f1ae41f1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:42:40.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.873+0000 7f1ae3e00640 1 --2- 172.21.15.8:0/2592230823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ae4155900 0x7f1ae41544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:42:40.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.873+0000 7f1adbe00640 1 --2- 172.21.15.8:0/2592230823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ae406f7e0 0x7f1ae41f15c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1acc018f90 tx=0x7f1acc019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:40.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.873+0000 7f1adb400640 1 -- 172.21.15.8:0/2592230823 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc0b8020 con 0x7f1ae406f7e0 2024-03-23T23:42:40.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.873+0000 7f1adb400640 1 -- 172.21.15.8:0/2592230823 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1acc0b4410 con 0x7f1ae406f7e0 2024-03-23T23:42:40.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.873+0000 7f1adb400640 1 -- 172.21.15.8:0/2592230823 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc0b0040 con 0x7f1ae406f7e0 2024-03-23T23:42:40.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.873+0000 7f1ae8a00640 1 -- 172.21.15.8:0/2592230823 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae4145030 con 0x7f1ae406f7e0 2024-03-23T23:42:40.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.873+0000 7f1ae8a00640 1 -- 172.21.15.8:0/2592230823 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ae41555e0 con 0x7f1ae406f7e0 2024-03-23T23:42:40.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.873+0000 7f1ae8a00640 1 -- 172.21.15.8:0/2592230823 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ae404f410 con 0x7f1ae406f7e0 2024-03-23T23:42:40.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.877+0000 7f1adb400640 1 -- 172.21.15.8:0/2592230823 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f1acc0bb020 con 0x7f1ae406f7e0 2024-03-23T23:42:40.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.877+0000 7f1adb400640 1 --2- 172.21.15.8:0/2592230823 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1ac0067690 0x7f1ac0069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:40.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.877+0000 7f1adb400640 1 -- 172.21.15.8:0/2592230823 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5689+0+0 (secure 0 0 0) 0x7f1acc11f040 con 0x7f1ae406f7e0 2024-03-23T23:42:40.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.877+0000 7f1ae3400640 1 --2- 172.21.15.8:0/2592230823 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1ac0067690 0x7f1ac0069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:40.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.877+0000 7f1ae3400640 1 --2- 172.21.15.8:0/2592230823 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1ac0067690 0x7f1ac0069b50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1ad40011f0 tx=0x7f1ad4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:40.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:40.881+0000 7f1adb400640 1 -- 172.21.15.8:0/2592230823 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f1acc0c2070 con 0x7f1ae406f7e0 2024-03-23T23:42:41.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.045+0000 7f1ae8a00640 1 -- 172.21.15.8:0/2592230823 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ae4150060 con 0x7f1ae406f7e0 2024-03-23T23:42:41.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.045+0000 7f1adb400640 1 -- 172.21.15.8:0/2592230823 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16526 (secure 0 0 0) 0x7f1acc016090 con 0x7f1ae406f7e0 2024-03-23T23:42:41.050 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:42:41.050 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":20,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","created":"2024-03-23T23:42:15.169430+0000","modified":"2024-03-23T23:42:40.070433+0000","last_up_change":"2024-03-23T23:42:26.509742+0000","last_in_change":"2024-03-23T23:42:17.662330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:42:26.327445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-23T23:42:38.218800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-23T23:42:39.054195+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e967bf31-21d6-4d11-bc3d-0df8177a1b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6809","nonce":2187201732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6811","nonce":2187201732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6815","nonce":2187201732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6813","nonce":2187201732}]},"public_addr":"172.21.15.8:6809/2187201732","cluster_addr":"172.21.15.8:6811/2187201732","heartbeat_back_addr":"172.21.15.8:6815/2187201732","heartbeat_front_addr":"172.21.15.8:6813/2187201732","state":["exists","up"]},{"osd":1,"uuid":"c8e33701-7acd-4474-8402-d52461171fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6818","nonce":3205168010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6822","nonce":3205168010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6830","nonce":3205168010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6826","nonce":3205168010}]},"public_addr":"172.21.15.8:6818/3205168010","cluster_addr":"172.21.15.8:6822/3205168010","heartbeat_back_addr":"172.21.15.8:6830/3205168010","heartbeat_front_addr":"172.21.15.8:6826/3205168010","state":["exists","up"]},{"osd":2,"uuid":"ceebdbf7-4c2f-4757-b52d-fd8b20e77570","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6801","nonce":475463656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6803","nonce":475463656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6807","nonce":475463656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6805","nonce":475463656}]},"public_addr":"172.21.15.8:6801/475463656","cluster_addr":"172.21.15.8:6803/475463656","heartbeat_back_addr":"172.21.15.8:6807/475463656","heartbeat_front_addr":"172.21.15.8:6805/475463656","state":["exists","up"]},{"osd":3,"uuid":"89e258da-5767-429e-8441-edf877d2f3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6819","nonce":1514082871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6821","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6823","nonce":1514082871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6829","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6831","nonce":1514082871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6825","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6827","nonce":1514082871}]},"public_addr":"172.21.15.8:6819/1514082871","cluster_addr":"172.21.15.8:6823/1514082871","heartbeat_back_addr":"172.21.15.8:6831/1514082871","heartbeat_front_addr":"172.21.15.8:6827/1514082871","state":["exists","up"]},{"osd":4,"uuid":"2b7451ae-ea16-4f0a-ae50-04fde75e45ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6825","nonce":3516578147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6827","nonce":3516578147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6831","nonce":3516578147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6829","nonce":3516578147}]},"public_addr":"172.21.15.196:6825/3516578147","cluster_addr":"172.21.15.196:6827/3516578147","heartbeat_back_addr":"172.21.15.196:6831/3516578147","heartbeat_front_addr":"172.21.15.196:6829/3516578147","state":["exists","up"]},{"osd":5,"uuid":"e68a8914-e591-466a-bc9e-f2d7c67aac13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6802","nonce":830595758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6806","nonce":830595758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6814","nonce":830595758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6810","nonce":830595758}]},"public_addr":"172.21.15.196:6802/830595758","cluster_addr":"172.21.15.196:6806/830595758","heartbeat_back_addr":"172.21.15.196:6814/830595758","heartbeat_front_addr":"172.21.15.196:6810/830595758","state":["exists","up"]},{"osd":6,"uuid":"e47723c5-50a0-4cd8-92d9-01972072b422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6801","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6803","nonce":472639906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6805","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6807","nonce":472639906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6815","nonce":472639906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6811","nonce":472639906}]},"public_addr":"172.21.15.196:6803/472639906","cluster_addr":"172.21.15.196:6807/472639906","heartbeat_back_addr":"172.21.15.196:6815/472639906","heartbeat_front_addr":"172.21.15.196:6811/472639906","state":["exists","up"]},{"osd":7,"uuid":"e1e9113d-8005-47b3-9a75-9e701199f1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6817","nonce":4151820349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6819","nonce":4151820349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6823","nonce":4151820349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6821","nonce":4151820349}]},"public_addr":"172.21.15.196:6817/4151820349","cluster_addr":"172.21.15.196:6819/4151820349","heartbeat_back_addr":"172.21.15.196:6823/4151820349","heartbeat_front_addr":"172.21.15.196:6821/4151820349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.221790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.265974+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.190319+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.376359+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.329657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.402958+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.300703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.133121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:42:41.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.045+0000 7f1ae8a00640 1 -- 172.21.15.8:0/2592230823 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1ac0067690 msgr2=0x7f1ac0069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:41.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.049+0000 7f1ae8a00640 1 --2- 172.21.15.8:0/2592230823 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1ac0067690 0x7f1ac0069b50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1ad40011f0 tx=0x7f1ad4009040 comp rx=0 tx=0).stop 2024-03-23T23:42:41.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.049+0000 7f1ae8a00640 1 -- 172.21.15.8:0/2592230823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ae406f7e0 msgr2=0x7f1ae41f15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:41.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.049+0000 7f1ae8a00640 1 --2- 172.21.15.8:0/2592230823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ae406f7e0 0x7f1ae41f15c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1acc018f90 tx=0x7f1acc019120 comp rx=0 tx=0).stop 2024-03-23T23:42:41.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.049+0000 7f1ae8a00640 1 -- 172.21.15.8:0/2592230823 shutdown_connections 2024-03-23T23:42:41.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.049+0000 7f1ae8a00640 1 --2- 172.21.15.8:0/2592230823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ae4155900 0x7f1ae41544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:41.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.049+0000 7f1ae8a00640 1 --2- 172.21.15.8:0/2592230823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ae406f7e0 0x7f1ae41f15c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:41.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.049+0000 7f1ae8a00640 1 --2- 172.21.15.8:0/2592230823 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1ac0067690 0x7f1ac0069b50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:41.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.049+0000 7f1ae8a00640 1 --2- 172.21.15.8:0/2592230823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ae406c050 0x7f1ae41f1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:41.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.049+0000 7f1ae8a00640 1 -- 172.21.15.8:0/2592230823 >> 172.21.15.8:0/2592230823 conn(0x7f1ae406b170 msgr2=0x7f1ae4152910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:41.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.049+0000 7f1ae8a00640 1 -- 172.21.15.8:0/2592230823 shutdown_connections 2024-03-23T23:42:41.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.049+0000 7f1ae8a00640 1 -- 172.21.15.8:0/2592230823 wait complete. 2024-03-23T23:42:41.074 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:42:41.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.217+0000 7f359d600640 1 Processor -- start 2024-03-23T23:42:41.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.217+0000 7f359d600640 1 -- start start 2024-03-23T23:42:41.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.217+0000 7f359d600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f35980711a0 0x7f3598153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:41.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.217+0000 7f359d600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f35980c6dd0 0x7f3598154200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:41.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.221+0000 7f359d600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35980c4670 con 0x7f35980c8a40 2024-03-23T23:42:41.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.221+0000 7f359d600640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35980c4940 con 0x7f35980711a0 2024-03-23T23:42:41.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.221+0000 7f359d600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3598153830 con 0x7f35980c6dd0 2024-03-23T23:42:41.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.221+0000 7f3597e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f35980711a0 0x7f3598153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:41.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.221+0000 7f3597e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f35980711a0 0x7f3598153cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57806/0 (socket says 172.21.15.8:57806) 2024-03-23T23:42:41.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.221+0000 7f3597e00640 1 -- 172.21.15.8:0/1296559632 learned_addr learned my addr 172.21.15.8:0/1296559632 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:41.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.221+0000 7f358f400640 1 --2- 172.21.15.8:0/1296559632 >> v2:172.21.15.196:3300/0 conn(0x7f35980c6dd0 0x7f3598154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:41.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.221+0000 7f3597e00640 1 -- 172.21.15.8:0/1296559632 >> v2:172.21.15.196:3300/0 conn(0x7f35980c6dd0 msgr2=0x7f3598154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:41.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.221+0000 7f3597e00640 1 --2- 172.21.15.8:0/1296559632 >> v2:172.21.15.196:3300/0 conn(0x7f35980c6dd0 0x7f3598154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:41.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.221+0000 7f3597e00640 1 -- 172.21.15.8:0/1296559632 >> v1:172.21.15.196:6789/0 conn(0x7f35980c8a40 legacy=0x7f35981508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:41.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.221+0000 7f3597e00640 1 -- 172.21.15.8:0/1296559632 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35980c4b90 con 0x7f35980711a0 2024-03-23T23:42:41.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.221+0000 7f3597e00640 1 --2- 172.21.15.8:0/1296559632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35980711a0 0x7f3598153cc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f359806c1b0 tx=0x7f358801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7dca86a4ffa9c32 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:41.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.221+0000 7f3597400640 1 -- 172.21.15.8:0/1296559632 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35880b0070 con 0x7f35980711a0 2024-03-23T23:42:41.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.221+0000 7f3597400640 1 -- 172.21.15.8:0/1296559632 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35880ab600 con 0x7f35980711a0 2024-03-23T23:42:41.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.221+0000 7f3597400640 1 -- 172.21.15.8:0/1296559632 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35880ab9d0 con 0x7f35980711a0 2024-03-23T23:42:41.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.225+0000 7f359d600640 1 -- 172.21.15.8:0/1296559632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35980711a0 msgr2=0x7f3598153cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:41.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.225+0000 7f359d600640 1 --2- 172.21.15.8:0/1296559632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35980711a0 0x7f3598153cc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f359806c1b0 tx=0x7f358801c450 comp rx=0 tx=0).stop 2024-03-23T23:42:41.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.225+0000 7f359d600640 1 -- 172.21.15.8:0/1296559632 shutdown_connections 2024-03-23T23:42:41.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.225+0000 7f359d600640 1 --2- 172.21.15.8:0/1296559632 >> v2:172.21.15.196:3300/0 conn(0x7f35980c6dd0 0x7f3598154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:41.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.225+0000 7f359d600640 1 --2- 172.21.15.8:0/1296559632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35980711a0 0x7f3598153cc0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:41.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.225+0000 7f359d600640 1 -- 172.21.15.8:0/1296559632 >> 172.21.15.8:0/1296559632 conn(0x7f35980aac80 msgr2=0x7f35980ab090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:41.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.225+0000 7f359d600640 1 -- 172.21.15.8:0/1296559632 shutdown_connections 2024-03-23T23:42:41.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.225+0000 7f359d600640 1 -- 172.21.15.8:0/1296559632 wait complete. 2024-03-23T23:42:41.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.225+0000 7f359d600640 1 Processor -- start 2024-03-23T23:42:41.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.225+0000 7f359d600640 1 -- start start 2024-03-23T23:42:41.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.225+0000 7f359d600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f35980711a0 0x7f35981461d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:41.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.225+0000 7f359d600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35980c6dd0 0x7f359813fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:41.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.225+0000 7f359d600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f35980c8a40 0x7f3598140430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:41.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.225+0000 7f359d600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35981606c0 con 0x7f35980c6dd0 2024-03-23T23:42:41.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.225+0000 7f359d600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3598071790 con 0x7f35980711a0 2024-03-23T23:42:41.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.225+0000 7f359d600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3598160840 con 0x7f35980c8a40 2024-03-23T23:42:41.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.225+0000 7f358f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35980c6dd0 0x7f359813fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:41.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.225+0000 7f358f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35980c6dd0 0x7f359813fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57814/0 (socket says 172.21.15.8:57814) 2024-03-23T23:42:41.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.225+0000 7f358f400640 1 -- 172.21.15.8:0/2037536317 learned_addr learned my addr 172.21.15.8:0/2037536317 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:41.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.225+0000 7f3597e00640 1 --2- 172.21.15.8:0/2037536317 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f35980711a0 0x7f35981461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:41.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.225+0000 7f359cc00640 1 --2- 172.21.15.8:0/2037536317 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f35980c8a40 0x7f3598140430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:41.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.225+0000 7f358f400640 1 -- 172.21.15.8:0/2037536317 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f35980c8a40 msgr2=0x7f3598140430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:41.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.225+0000 7f358f400640 1 --2- 172.21.15.8:0/2037536317 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f35980c8a40 0x7f3598140430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:41.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.225+0000 7f358f400640 1 -- 172.21.15.8:0/2037536317 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f35980711a0 msgr2=0x7f35981461d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:41.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.225+0000 7f358f400640 1 --2- 172.21.15.8:0/2037536317 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f35980711a0 0x7f35981461d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:41.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.225+0000 7f358f400640 1 -- 172.21.15.8:0/2037536317 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35981533d0 con 0x7f35980c6dd0 2024-03-23T23:42:41.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.225+0000 7f359cc00640 1 --2- 172.21.15.8:0/2037536317 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f35980c8a40 0x7f3598140430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:42:41.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.229+0000 7f358f400640 1 --2- 172.21.15.8:0/2037536317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35980c6dd0 0x7f359813fef0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3580009fd0 tx=0x7f358000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:41.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.229+0000 7f3594c00640 1 -- 172.21.15.8:0/2037536317 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3580014620 con 0x7f35980c6dd0 2024-03-23T23:42:41.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.229+0000 7f3594c00640 1 -- 172.21.15.8:0/2037536317 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3580019070 con 0x7f35980c6dd0 2024-03-23T23:42:41.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.229+0000 7f3594c00640 1 -- 172.21.15.8:0/2037536317 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3580014a00 con 0x7f35980c6dd0 2024-03-23T23:42:41.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.229+0000 7f359d600640 1 -- 172.21.15.8:0/2037536317 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35981530f0 con 0x7f35980c6dd0 2024-03-23T23:42:41.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.229+0000 7f359d600640 1 -- 172.21.15.8:0/2037536317 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35981423d0 con 0x7f35980c6dd0 2024-03-23T23:42:41.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.229+0000 7f359d600640 1 -- 172.21.15.8:0/2037536317 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f359804f410 con 0x7f35980c6dd0 2024-03-23T23:42:41.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.229+0000 7f3594c00640 1 -- 172.21.15.8:0/2037536317 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3580014ba0 con 0x7f35980c6dd0 2024-03-23T23:42:41.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.229+0000 7f3594c00640 1 --2- 172.21.15.8:0/2037536317 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3574067660 0x7f3574069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:41.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.229+0000 7f3594c00640 1 -- 172.21.15.8:0/2037536317 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5689+0+0 (secure 0 0 0) 0x7f35800860e0 con 0x7f35980c6dd0 2024-03-23T23:42:41.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.229+0000 7f3597e00640 1 --2- 172.21.15.8:0/2037536317 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3574067660 0x7f3574069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:41.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.233+0000 7f3597e00640 1 --2- 172.21.15.8:0/2037536317 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3574067660 0x7f3574069b20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f35880ad000 tx=0x7f35880a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:41.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.233+0000 7f3594c00640 1 -- 172.21.15.8:0/2037536317 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f3580056d60 con 0x7f35980c6dd0 2024-03-23T23:42:41.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.397+0000 7f359d600640 1 -- 172.21.15.8:0/2037536317 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35980c2920 con 0x7f35980c6dd0 2024-03-23T23:42:41.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.397+0000 7f3594c00640 1 -- 172.21.15.8:0/2037536317 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16526 (secure 0 0 0) 0x7f3580056660 con 0x7f35980c6dd0 2024-03-23T23:42:41.400 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:42:41.401 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":20,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","created":"2024-03-23T23:42:15.169430+0000","modified":"2024-03-23T23:42:40.070433+0000","last_up_change":"2024-03-23T23:42:26.509742+0000","last_in_change":"2024-03-23T23:42:17.662330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:42:26.327445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-23T23:42:38.218800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-23T23:42:39.054195+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e967bf31-21d6-4d11-bc3d-0df8177a1b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6809","nonce":2187201732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6811","nonce":2187201732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6815","nonce":2187201732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6813","nonce":2187201732}]},"public_addr":"172.21.15.8:6809/2187201732","cluster_addr":"172.21.15.8:6811/2187201732","heartbeat_back_addr":"172.21.15.8:6815/2187201732","heartbeat_front_addr":"172.21.15.8:6813/2187201732","state":["exists","up"]},{"osd":1,"uuid":"c8e33701-7acd-4474-8402-d52461171fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6818","nonce":3205168010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6822","nonce":3205168010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6830","nonce":3205168010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6826","nonce":3205168010}]},"public_addr":"172.21.15.8:6818/3205168010","cluster_addr":"172.21.15.8:6822/3205168010","heartbeat_back_addr":"172.21.15.8:6830/3205168010","heartbeat_front_addr":"172.21.15.8:6826/3205168010","state":["exists","up"]},{"osd":2,"uuid":"ceebdbf7-4c2f-4757-b52d-fd8b20e77570","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6801","nonce":475463656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6803","nonce":475463656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6807","nonce":475463656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6805","nonce":475463656}]},"public_addr":"172.21.15.8:6801/475463656","cluster_addr":"172.21.15.8:6803/475463656","heartbeat_back_addr":"172.21.15.8:6807/475463656","heartbeat_front_addr":"172.21.15.8:6805/475463656","state":["exists","up"]},{"osd":3,"uuid":"89e258da-5767-429e-8441-edf877d2f3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6819","nonce":1514082871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6821","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6823","nonce":1514082871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6829","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6831","nonce":1514082871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6825","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6827","nonce":1514082871}]},"public_addr":"172.21.15.8:6819/1514082871","cluster_addr":"172.21.15.8:6823/1514082871","heartbeat_back_addr":"172.21.15.8:6831/1514082871","heartbeat_front_addr":"172.21.15.8:6827/1514082871","state":["exists","up"]},{"osd":4,"uuid":"2b7451ae-ea16-4f0a-ae50-04fde75e45ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6825","nonce":3516578147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6827","nonce":3516578147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6831","nonce":3516578147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6829","nonce":3516578147}]},"public_addr":"172.21.15.196:6825/3516578147","cluster_addr":"172.21.15.196:6827/3516578147","heartbeat_back_addr":"172.21.15.196:6831/3516578147","heartbeat_front_addr":"172.21.15.196:6829/3516578147","state":["exists","up"]},{"osd":5,"uuid":"e68a8914-e591-466a-bc9e-f2d7c67aac13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6802","nonce":830595758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6806","nonce":830595758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6814","nonce":830595758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6810","nonce":830595758}]},"public_addr":"172.21.15.196:6802/830595758","cluster_addr":"172.21.15.196:6806/830595758","heartbeat_back_addr":"172.21.15.196:6814/830595758","heartbeat_front_addr":"172.21.15.196:6810/830595758","state":["exists","up"]},{"osd":6,"uuid":"e47723c5-50a0-4cd8-92d9-01972072b422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6801","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6803","nonce":472639906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6805","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6807","nonce":472639906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6815","nonce":472639906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6811","nonce":472639906}]},"public_addr":"172.21.15.196:6803/472639906","cluster_addr":"172.21.15.196:6807/472639906","heartbeat_back_addr":"172.21.15.196:6815/472639906","heartbeat_front_addr":"172.21.15.196:6811/472639906","state":["exists","up"]},{"osd":7,"uuid":"e1e9113d-8005-47b3-9a75-9e701199f1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6817","nonce":4151820349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6819","nonce":4151820349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6823","nonce":4151820349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6821","nonce":4151820349}]},"public_addr":"172.21.15.196:6817/4151820349","cluster_addr":"172.21.15.196:6819/4151820349","heartbeat_back_addr":"172.21.15.196:6823/4151820349","heartbeat_front_addr":"172.21.15.196:6821/4151820349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.221790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.265974+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.190319+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.376359+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.329657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.402958+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.300703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.133121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:42:41.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.401+0000 7f359d600640 1 -- 172.21.15.8:0/2037536317 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3574067660 msgr2=0x7f3574069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:41.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.401+0000 7f359d600640 1 --2- 172.21.15.8:0/2037536317 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3574067660 0x7f3574069b20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f35880ad000 tx=0x7f35880a6000 comp rx=0 tx=0).stop 2024-03-23T23:42:41.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.401+0000 7f359d600640 1 -- 172.21.15.8:0/2037536317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35980c6dd0 msgr2=0x7f359813fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:41.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.401+0000 7f359d600640 1 --2- 172.21.15.8:0/2037536317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35980c6dd0 0x7f359813fef0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3580009fd0 tx=0x7f358000e4b0 comp rx=0 tx=0).stop 2024-03-23T23:42:41.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.401+0000 7f359d600640 1 -- 172.21.15.8:0/2037536317 shutdown_connections 2024-03-23T23:42:41.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.401+0000 7f359d600640 1 --2- 172.21.15.8:0/2037536317 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3574067660 0x7f3574069b20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:41.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.401+0000 7f359d600640 1 --2- 172.21.15.8:0/2037536317 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f35980c8a40 0x7f3598140430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:41.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.401+0000 7f359d600640 1 --2- 172.21.15.8:0/2037536317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35980c6dd0 0x7f359813fef0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:41.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.401+0000 7f359d600640 1 --2- 172.21.15.8:0/2037536317 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f35980711a0 0x7f35981461d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:41.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.401+0000 7f359d600640 1 -- 172.21.15.8:0/2037536317 >> 172.21.15.8:0/2037536317 conn(0x7f35980aac80 msgr2=0x7f35980c7250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:41.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.401+0000 7f359d600640 1 -- 172.21.15.8:0/2037536317 shutdown_connections 2024-03-23T23:42:41.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.401+0000 7f359d600640 1 -- 172.21.15.8:0/2037536317 wait complete. 2024-03-23T23:42:41.421 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a standby_count_wanted 0 2024-03-23T23:42:41.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa59ae00640 1 Processor -- start 2024-03-23T23:42:41.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa59ae00640 1 -- start start 2024-03-23T23:42:41.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa59ae00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa594152ff0 0x7fa5940714f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:41.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa59ae00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa594159860 0x7fa59406ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:41.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa59ae00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa594159dd0 con 0x7fa59406f190 2024-03-23T23:42:41.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa59ae00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5940701f0 con 0x7fa594159860 2024-03-23T23:42:41.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa59ae00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5940704d0 con 0x7fa594152ff0 2024-03-23T23:42:41.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa598e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fa59406f190 0x7fa5940c2390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42504/0 (socket says 172.21.15.8:42504) 2024-03-23T23:42:41.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa598e00640 1 -- 172.21.15.8:0/3817703853 learned_addr learned my addr 172.21.15.8:0/3817703853 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:41.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa593e00640 1 --2- 172.21.15.8:0/3817703853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa594152ff0 0x7fa5940714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:41.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa58b400640 1 --2- 172.21.15.8:0/3817703853 >> v2:172.21.15.196:3300/0 conn(0x7fa594159860 0x7fa59406ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:41.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa593400640 1 -- 172.21.15.8:0/3817703853 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1321500105 0 0) 0x7fa594159dd0 con 0x7fa59406f190 2024-03-23T23:42:41.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa593400640 1 -- 172.21.15.8:0/3817703853 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa578003530 con 0x7fa59406f190 2024-03-23T23:42:41.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa593400640 1 -- 172.21.15.8:0/3817703853 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3168616632 0 0) 0x7fa578003530 con 0x7fa59406f190 2024-03-23T23:42:41.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa593400640 1 -- 172.21.15.8:0/3817703853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa594152ff0 msgr2=0x7fa5940714f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:41.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa593400640 1 --2- 172.21.15.8:0/3817703853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa594152ff0 0x7fa5940714f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:41.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa593400640 1 -- 172.21.15.8:0/3817703853 >> v2:172.21.15.196:3300/0 conn(0x7fa594159860 msgr2=0x7fa59406ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:41.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa593400640 1 --2- 172.21.15.8:0/3817703853 >> v2:172.21.15.196:3300/0 conn(0x7fa594159860 0x7fa59406ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:41.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa593400640 1 -- 172.21.15.8:0/3817703853 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5940707b0 con 0x7fa59406f190 2024-03-23T23:42:41.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa593400640 1 -- 172.21.15.8:0/3817703853 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7fa58c001a00 con 0x7fa59406f190 2024-03-23T23:42:41.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa593400640 1 -- 172.21.15.8:0/3817703853 >> v1:172.21.15.8:6789/0 conn(0x7fa59406f190 legacy=0x7fa5940c2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:41.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa593400640 1 --2- 172.21.15.8:0/3817703853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa594152ff0 0x7fa5780039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:41.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa593400640 1 --2- 172.21.15.8:0/3817703853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa578003f40 0x7fa578004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:41.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa593400640 1 --2- 172.21.15.8:0/3817703853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa578004d50 0x7fa5780051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:41.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa593400640 1 -- 172.21.15.8:0/3817703853 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5940701f0 con 0x7fa578003f40 2024-03-23T23:42:41.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa593400640 1 -- 172.21.15.8:0/3817703853 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5940704d0 con 0x7fa578004d50 2024-03-23T23:42:41.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa593400640 1 -- 172.21.15.8:0/3817703853 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa57800ba20 con 0x7fa594152ff0 2024-03-23T23:42:41.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa58b400640 1 --2- 172.21.15.8:0/3817703853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa578003f40 0x7fa578004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:41.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa593e00640 1 --2- 172.21.15.8:0/3817703853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa594152ff0 0x7fa5780039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:41.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa598e00640 1 --2- 172.21.15.8:0/3817703853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa578004d50 0x7fa5780051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:41.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa58b400640 1 -- 172.21.15.8:0/3817703853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa594152ff0 msgr2=0x7fa5780039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:41.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa58b400640 1 --2- 172.21.15.8:0/3817703853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa594152ff0 0x7fa5780039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:41.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa58b400640 1 -- 172.21.15.8:0/3817703853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa578004d50 msgr2=0x7fa5780051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:41.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa58b400640 1 --2- 172.21.15.8:0/3817703853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa578004d50 0x7fa5780051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:41.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.565+0000 7fa58b400640 1 -- 172.21.15.8:0/3817703853 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa578003530 con 0x7fa578003f40 2024-03-23T23:42:41.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.569+0000 7fa58b400640 1 --2- 172.21.15.8:0/3817703853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa578003f40 0x7fa578004810 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa57c009b10 tx=0x7fa57c01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1633e6d5fa209449 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:41.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.569+0000 7fa593400640 1 -- 172.21.15.8:0/3817703853 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c0096b0 con 0x7fa578003f40 2024-03-23T23:42:41.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.569+0000 7fa593400640 1 -- 172.21.15.8:0/3817703853 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57c0a9480 con 0x7fa578003f40 2024-03-23T23:42:41.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.569+0000 7fa593400640 1 -- 172.21.15.8:0/3817703853 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c0a9870 con 0x7fa578003f40 2024-03-23T23:42:41.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.569+0000 7fa59ae00640 1 -- 172.21.15.8:0/3817703853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa578003f40 msgr2=0x7fa578004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:41.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.569+0000 7fa59ae00640 1 --2- 172.21.15.8:0/3817703853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa578003f40 0x7fa578004810 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa57c009b10 tx=0x7fa57c01cab0 comp rx=0 tx=0).stop 2024-03-23T23:42:41.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.569+0000 7fa598e00640 1 -- 172.21.15.8:0/3817703853 reap_dead start 2024-03-23T23:42:41.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.569+0000 7fa59ae00640 1 -- 172.21.15.8:0/3817703853 shutdown_connections 2024-03-23T23:42:41.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.569+0000 7fa59ae00640 1 -- 172.21.15.8:0/3817703853 >> 172.21.15.8:0/3817703853 conn(0x7fa5940aad10 msgr2=0x7fa5940ab120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:41.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.569+0000 7fa59ae00640 1 -- 172.21.15.8:0/3817703853 shutdown_connections 2024-03-23T23:42:41.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.569+0000 7fa59ae00640 1 -- 172.21.15.8:0/3817703853 wait complete. 2024-03-23T23:42:41.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.573+0000 7fa59ae00640 1 Processor -- start 2024-03-23T23:42:41.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.573+0000 7fa59ae00640 1 -- start start 2024-03-23T23:42:41.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.573+0000 7fa59ae00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa578003f40 0x7fa5940c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:41.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.573+0000 7fa59ae00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa5941554f0 0x7fa5941f1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:41.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.573+0000 7fa59ae00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa59414f780 0x7fa5941f24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:41.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.573+0000 7fa59ae00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5940c75a0 con 0x7fa59414f780 2024-03-23T23:42:41.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.573+0000 7fa59ae00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5940c7420 con 0x7fa5941554f0 2024-03-23T23:42:41.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.573+0000 7fa59ae00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5941609f0 con 0x7fa578003f40 2024-03-23T23:42:41.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.573+0000 7fa598e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa59414f780 0x7fa5941f24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:41.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.573+0000 7fa598e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa59414f780 0x7fa5941f24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57834/0 (socket says 172.21.15.8:57834) 2024-03-23T23:42:41.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.573+0000 7fa598e00640 1 -- 172.21.15.8:0/1196588493 learned_addr learned my addr 172.21.15.8:0/1196588493 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:41.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.573+0000 7fa58b400640 1 --2- 172.21.15.8:0/1196588493 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa5941554f0 0x7fa5941f1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:41.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.573+0000 7fa593e00640 1 --2- 172.21.15.8:0/1196588493 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa578003f40 0x7fa5940c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:41.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.573+0000 7fa598e00640 1 -- 172.21.15.8:0/1196588493 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa578003f40 msgr2=0x7fa5940c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:41.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.573+0000 7fa598e00640 1 --2- 172.21.15.8:0/1196588493 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa578003f40 0x7fa5940c5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:41.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.573+0000 7fa598e00640 1 -- 172.21.15.8:0/1196588493 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa5941554f0 msgr2=0x7fa5941f1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:41.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.573+0000 7fa598e00640 1 --2- 172.21.15.8:0/1196588493 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa5941554f0 0x7fa5941f1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:41.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.573+0000 7fa598e00640 1 -- 172.21.15.8:0/1196588493 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5941ee4b0 con 0x7fa59414f780 2024-03-23T23:42:41.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.573+0000 7fa58b400640 1 --2- 172.21.15.8:0/1196588493 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa5941554f0 0x7fa5941f1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:42:41.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.573+0000 7fa593e00640 1 --2- 172.21.15.8:0/1196588493 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa578003f40 0x7fa5940c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:42:41.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.573+0000 7fa598e00640 1 --2- 172.21.15.8:0/1196588493 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa59414f780 0x7fa5941f24c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa5940ab970 tx=0x7fa58c007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:41.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.573+0000 7fa590c00640 1 -- 172.21.15.8:0/1196588493 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c00ab50 con 0x7fa59414f780 2024-03-23T23:42:41.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.573+0000 7fa590c00640 1 -- 172.21.15.8:0/1196588493 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58c018070 con 0x7fa59414f780 2024-03-23T23:42:41.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.573+0000 7fa590c00640 1 -- 172.21.15.8:0/1196588493 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c0133f0 con 0x7fa59414f780 2024-03-23T23:42:41.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.573+0000 7fa59ae00640 1 -- 172.21.15.8:0/1196588493 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5941f2a00 con 0x7fa59414f780 2024-03-23T23:42:41.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.573+0000 7fa59ae00640 1 -- 172.21.15.8:0/1196588493 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa594155a10 con 0x7fa59414f780 2024-03-23T23:42:41.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.573+0000 7fa59ae00640 1 -- 172.21.15.8:0/1196588493 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa59404f410 con 0x7fa59414f780 2024-03-23T23:42:41.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.577+0000 7fa590c00640 1 -- 172.21.15.8:0/1196588493 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fa58c013590 con 0x7fa59414f780 2024-03-23T23:42:41.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.577+0000 7fa590c00640 1 --2- 172.21.15.8:0/1196588493 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa570067690 0x7fa570069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:41.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.577+0000 7fa590c00640 1 -- 172.21.15.8:0/1196588493 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5689+0+0 (secure 0 0 0) 0x7fa58c085e50 con 0x7fa59414f780 2024-03-23T23:42:41.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.577+0000 7fa593e00640 1 --2- 172.21.15.8:0/1196588493 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa570067690 0x7fa570069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:41.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.577+0000 7fa593e00640 1 --2- 172.21.15.8:0/1196588493 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa570067690 0x7fa570069b50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa584009a00 tx=0x7fa584008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:41.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.581+0000 7fa590c00640 1 -- 172.21.15.8:0/1196588493 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fa5941ee4b0 con 0x7fa59414f780 2024-03-23T23:42:41.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:41.781+0000 7fa59ae00640 1 -- 172.21.15.8:0/1196588493 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa5940c8d40 con 0x7fa59414f780 2024-03-23T23:42:42.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.681+0000 7fa590c00640 1 -- 172.21.15.8:0/1196588493 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 113+0+0 (secure 0 0 0) 0x7fa58c056a40 con 0x7fa59414f780 2024-03-23T23:42:42.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.681+0000 7fa59ae00640 1 -- 172.21.15.8:0/1196588493 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa570067690 msgr2=0x7fa570069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:42.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.681+0000 7fa59ae00640 1 --2- 172.21.15.8:0/1196588493 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa570067690 0x7fa570069b50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa584009a00 tx=0x7fa584008040 comp rx=0 tx=0).stop 2024-03-23T23:42:42.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.681+0000 7fa59ae00640 1 -- 172.21.15.8:0/1196588493 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa59414f780 msgr2=0x7fa5941f24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:42.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.681+0000 7fa59ae00640 1 --2- 172.21.15.8:0/1196588493 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa59414f780 0x7fa5941f24c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa5940ab970 tx=0x7fa58c007b00 comp rx=0 tx=0).stop 2024-03-23T23:42:42.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.681+0000 7fa59ae00640 1 -- 172.21.15.8:0/1196588493 shutdown_connections 2024-03-23T23:42:42.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.685+0000 7fa59ae00640 1 --2- 172.21.15.8:0/1196588493 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa59414f780 0x7fa5941f24c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:42.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.685+0000 7fa59ae00640 1 --2- 172.21.15.8:0/1196588493 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa5941554f0 0x7fa5941f1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:42.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.685+0000 7fa59ae00640 1 --2- 172.21.15.8:0/1196588493 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa570067690 0x7fa570069b50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:42.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.685+0000 7fa59ae00640 1 --2- 172.21.15.8:0/1196588493 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa578003f40 0x7fa5940c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:42.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.685+0000 7fa59ae00640 1 -- 172.21.15.8:0/1196588493 >> 172.21.15.8:0/1196588493 conn(0x7fa5940aad10 msgr2=0x7fa594152830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:42.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.685+0000 7fa59ae00640 1 -- 172.21.15.8:0/1196588493 shutdown_connections 2024-03-23T23:42:42.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.685+0000 7fa59ae00640 1 -- 172.21.15.8:0/1196588493 wait complete. 2024-03-23T23:42:42.708 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-03-23T23:42:42.708 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a allow_standby_replay false 2024-03-23T23:42:42.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.857+0000 7fe626200640 1 Processor -- start 2024-03-23T23:42:42.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.857+0000 7fe626200640 1 -- start start 2024-03-23T23:42:42.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.861+0000 7fe626200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6200c2e70 0x7fe6200c1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:42.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.861+0000 7fe626200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe620072470 0x7fe6200728e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:42.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.861+0000 7fe626200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6201546c0 con 0x7fe62014a230 2024-03-23T23:42:42.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.861+0000 7fe626200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe620071fe0 con 0x7fe620072470 2024-03-23T23:42:42.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.861+0000 7fe626200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe62014a610 con 0x7fe6200c2e70 2024-03-23T23:42:42.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.861+0000 7fe61fe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe620072470 0x7fe6200728e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:42.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.861+0000 7fe61fe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe620072470 0x7fe6200728e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51668/0 (socket says 172.21.15.8:51668) 2024-03-23T23:42:42.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.861+0000 7fe61f400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe62014a230 0x7fe6200c3990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:55952/0 (socket says 172.21.15.8:55952) 2024-03-23T23:42:42.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.861+0000 7fe61fe00640 1 -- 172.21.15.8:0/1234653760 learned_addr learned my addr 172.21.15.8:0/1234653760 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:42.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.861+0000 7fe617e00640 1 --2- 172.21.15.8:0/1234653760 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6200c2e70 0x7fe6200c1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:42.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.861+0000 7fe61fe00640 1 -- 172.21.15.8:0/1234653760 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6200c2e70 msgr2=0x7fe6200c1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:42.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.861+0000 7fe61fe00640 1 --2- 172.21.15.8:0/1234653760 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6200c2e70 0x7fe6200c1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:42.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.861+0000 7fe61fe00640 1 -- 172.21.15.8:0/1234653760 >> v1:172.21.15.8:6789/0 conn(0x7fe62014a230 legacy=0x7fe6200c3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:42.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.861+0000 7fe61fe00640 1 -- 172.21.15.8:0/1234653760 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6200c20f0 con 0x7fe620072470 2024-03-23T23:42:42.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.861+0000 7fe61fe00640 1 --2- 172.21.15.8:0/1234653760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe620072470 0x7fe6200728e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe618009e50 tx=0x7fe61801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea272389368322eb server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:42.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.861+0000 7fe61ea00640 1 -- 172.21.15.8:0/1234653760 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6180a56c0 con 0x7fe620072470 2024-03-23T23:42:42.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.861+0000 7fe61ea00640 1 -- 172.21.15.8:0/1234653760 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6180a5860 con 0x7fe620072470 2024-03-23T23:42:42.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.865+0000 7fe61ea00640 1 -- 172.21.15.8:0/1234653760 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6180a5c30 con 0x7fe620072470 2024-03-23T23:42:42.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.865+0000 7fe626200640 1 -- 172.21.15.8:0/1234653760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe620072470 msgr2=0x7fe6200728e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:42.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.865+0000 7fe626200640 1 --2- 172.21.15.8:0/1234653760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe620072470 0x7fe6200728e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe618009e50 tx=0x7fe61801c910 comp rx=0 tx=0).stop 2024-03-23T23:42:42.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.865+0000 7fe626200640 1 -- 172.21.15.8:0/1234653760 shutdown_connections 2024-03-23T23:42:42.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.865+0000 7fe626200640 1 --2- 172.21.15.8:0/1234653760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe620072470 0x7fe6200728e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:42.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.865+0000 7fe626200640 1 --2- 172.21.15.8:0/1234653760 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6200c2e70 0x7fe6200c1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:42.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.865+0000 7fe626200640 1 -- 172.21.15.8:0/1234653760 >> 172.21.15.8:0/1234653760 conn(0x7fe62006b170 msgr2=0x7fe62006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:42.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.865+0000 7fe626200640 1 -- 172.21.15.8:0/1234653760 shutdown_connections 2024-03-23T23:42:42.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.865+0000 7fe626200640 1 -- 172.21.15.8:0/1234653760 wait complete. 2024-03-23T23:42:42.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.865+0000 7fe626200640 1 Processor -- start 2024-03-23T23:42:42.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.865+0000 7fe626200640 1 -- start start 2024-03-23T23:42:42.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.865+0000 7fe626200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe620072470 0x7fe6201f20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:42.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.865+0000 7fe626200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6200c2e70 0x7fe62015c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:42.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.865+0000 7fe626200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe62014a230 0x7fe620155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:42.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.865+0000 7fe626200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6200c4220 con 0x7fe6200c2e70 2024-03-23T23:42:42.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.865+0000 7fe626200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6200c40a0 con 0x7fe620072470 2024-03-23T23:42:42.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.865+0000 7fe626200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6201608c0 con 0x7fe62014a230 2024-03-23T23:42:42.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.865+0000 7fe617e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6200c2e70 0x7fe62015c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:42.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.865+0000 7fe617e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6200c2e70 0x7fe62015c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51670/0 (socket says 172.21.15.8:51670) 2024-03-23T23:42:42.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.865+0000 7fe617e00640 1 -- 172.21.15.8:0/3319225282 learned_addr learned my addr 172.21.15.8:0/3319225282 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:42.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.865+0000 7fe61f400640 1 --2- 172.21.15.8:0/3319225282 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe620072470 0x7fe6201f20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:42.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.865+0000 7fe61fe00640 1 --2- 172.21.15.8:0/3319225282 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe62014a230 0x7fe620155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:42.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.865+0000 7fe617e00640 1 -- 172.21.15.8:0/3319225282 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe62014a230 msgr2=0x7fe620155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:42.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.865+0000 7fe617e00640 1 --2- 172.21.15.8:0/3319225282 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe62014a230 0x7fe620155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:42.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.865+0000 7fe617e00640 1 -- 172.21.15.8:0/3319225282 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe620072470 msgr2=0x7fe6201f20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:42.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.865+0000 7fe617e00640 1 --2- 172.21.15.8:0/3319225282 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe620072470 0x7fe6201f20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:42.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.865+0000 7fe617e00640 1 -- 172.21.15.8:0/3319225282 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6200ab9e0 con 0x7fe6200c2e70 2024-03-23T23:42:42.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.869+0000 7fe617e00640 1 --2- 172.21.15.8:0/3319225282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6200c2e70 0x7fe62015c930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe60800e870 tx=0x7fe60800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:42.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.869+0000 7fe617400640 1 -- 172.21.15.8:0/3319225282 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe608017070 con 0x7fe6200c2e70 2024-03-23T23:42:42.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.869+0000 7fe617400640 1 -- 172.21.15.8:0/3319225282 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60800c940 con 0x7fe6200c2e70 2024-03-23T23:42:42.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.869+0000 7fe626200640 1 -- 172.21.15.8:0/3319225282 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6200abcc0 con 0x7fe6200c2e70 2024-03-23T23:42:42.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.869+0000 7fe617400640 1 -- 172.21.15.8:0/3319225282 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60800ccf0 con 0x7fe6200c2e70 2024-03-23T23:42:42.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.869+0000 7fe626200640 1 -- 172.21.15.8:0/3319225282 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6201f1bd0 con 0x7fe6200c2e70 2024-03-23T23:42:42.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.869+0000 7fe626200640 1 -- 172.21.15.8:0/3319225282 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe62004f410 con 0x7fe6200c2e70 2024-03-23T23:42:42.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.869+0000 7fe617400640 1 -- 172.21.15.8:0/3319225282 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fe60801a070 con 0x7fe6200c2e70 2024-03-23T23:42:42.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.869+0000 7fe617400640 1 --2- 172.21.15.8:0/3319225282 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe5fc067660 0x7fe5fc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:42.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.869+0000 7fe617400640 1 -- 172.21.15.8:0/3319225282 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5689+0+0 (secure 0 0 0) 0x7fe608085b00 con 0x7fe6200c2e70 2024-03-23T23:42:42.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.869+0000 7fe61f400640 1 --2- 172.21.15.8:0/3319225282 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe5fc067660 0x7fe5fc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:42.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.873+0000 7fe61f400640 1 --2- 172.21.15.8:0/3319225282 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe5fc067660 0x7fe5fc069b20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe610000f70 tx=0x7fe610007e90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:42.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:42.873+0000 7fe617400640 1 -- 172.21.15.8:0/3319225282 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fe6080560a0 con 0x7fe6200c2e70 2024-03-23T23:42:43.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.077+0000 7fe626200640 1 -- 172.21.15.8:0/3319225282 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe6200c2c50 con 0x7fe6200c2e70 2024-03-23T23:42:43.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.685+0000 7fe617400640 1 -- 172.21.15.8:0/3319225282 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 117+0+0 (secure 0 0 0) 0x7fe60805a140 con 0x7fe6200c2e70 2024-03-23T23:42:43.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.689+0000 7fe626200640 1 -- 172.21.15.8:0/3319225282 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe5fc067660 msgr2=0x7fe5fc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:43.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.689+0000 7fe626200640 1 --2- 172.21.15.8:0/3319225282 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe5fc067660 0x7fe5fc069b20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe610000f70 tx=0x7fe610007e90 comp rx=0 tx=0).stop 2024-03-23T23:42:43.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.689+0000 7fe626200640 1 -- 172.21.15.8:0/3319225282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6200c2e70 msgr2=0x7fe62015c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:43.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.689+0000 7fe626200640 1 --2- 172.21.15.8:0/3319225282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6200c2e70 0x7fe62015c930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe60800e870 tx=0x7fe60800ec70 comp rx=0 tx=0).stop 2024-03-23T23:42:43.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.689+0000 7fe626200640 1 -- 172.21.15.8:0/3319225282 shutdown_connections 2024-03-23T23:42:43.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.689+0000 7fe626200640 1 --2- 172.21.15.8:0/3319225282 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe5fc067660 0x7fe5fc069b20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:43.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.689+0000 7fe626200640 1 --2- 172.21.15.8:0/3319225282 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe62014a230 0x7fe620155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:43.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.689+0000 7fe626200640 1 --2- 172.21.15.8:0/3319225282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6200c2e70 0x7fe62015c930 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:43.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.689+0000 7fe626200640 1 --2- 172.21.15.8:0/3319225282 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe620072470 0x7fe6201f20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:43.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.689+0000 7fe626200640 1 -- 172.21.15.8:0/3319225282 >> 172.21.15.8:0/3319225282 conn(0x7fe62006b170 msgr2=0x7fe62015d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:43.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.689+0000 7fe626200640 1 -- 172.21.15.8:0/3319225282 shutdown_connections 2024-03-23T23:42:43.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.689+0000 7fe626200640 1 -- 172.21.15.8:0/3319225282 wait complete. 2024-03-23T23:42:43.712 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a session_timeout 300 2024-03-23T23:42:43.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.857+0000 7f22d0a00640 1 Processor -- start 2024-03-23T23:42:43.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.857+0000 7f22d0a00640 1 -- start start 2024-03-23T23:42:43.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.857+0000 7f22d0a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22cc0ad810 0x7f22cc071e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:43.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.861+0000 7f22d0a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f22cc06eeb0 0x7f22cc150890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:43.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.861+0000 7f22d0a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22cc154290 con 0x7f22cc0a9470 2024-03-23T23:42:43.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.861+0000 7f22d0a00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22cc154570 con 0x7f22cc06eeb0 2024-03-23T23:42:43.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.861+0000 7f22d0a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc156cd0 con 0x7f22cc0ad810 2024-03-23T23:42:43.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.861+0000 7f22ca800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f22cc06eeb0 0x7f22cc150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:43.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.861+0000 7f22c1400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f22cc0a9470 0x7f22cc1574d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:55956/0 (socket says 172.21.15.8:55956) 2024-03-23T23:42:43.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.861+0000 7f22c1400640 1 -- 172.21.15.8:0/3899151578 learned_addr learned my addr 172.21.15.8:0/3899151578 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:43.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.861+0000 7f22c9e00640 1 --2- 172.21.15.8:0/3899151578 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22cc0ad810 0x7f22cc071e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:43.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.861+0000 7f22ca800640 1 -- 172.21.15.8:0/3899151578 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22cc0ad810 msgr2=0x7f22cc071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:43.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.861+0000 7f22ca800640 1 --2- 172.21.15.8:0/3899151578 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22cc0ad810 0x7f22cc071e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:43.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.861+0000 7f22ca800640 1 -- 172.21.15.8:0/3899151578 >> v1:172.21.15.8:6789/0 conn(0x7f22cc0a9470 legacy=0x7f22cc1574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:43.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.861+0000 7f22c9400640 1 -- 172.21.15.8:0/3899151578 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 610159953 0 0) 0x7f22cc154290 con 0x7f22cc0a9470 2024-03-23T23:42:43.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.861+0000 7f22ca800640 1 -- 172.21.15.8:0/3899151578 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22cc156fb0 con 0x7f22cc06eeb0 2024-03-23T23:42:43.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.861+0000 7f22ca800640 1 --2- 172.21.15.8:0/3899151578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22cc06eeb0 0x7f22cc150890 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f22c40097c0 tx=0x7f22c401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a99de17cd2085e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:43.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.861+0000 7f22c9400640 1 -- 172.21.15.8:0/3899151578 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c40b0070 con 0x7f22cc06eeb0 2024-03-23T23:42:43.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.865+0000 7f22c9400640 1 -- 172.21.15.8:0/3899151578 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c40ab600 con 0x7f22cc06eeb0 2024-03-23T23:42:43.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.865+0000 7f22c9400640 1 -- 172.21.15.8:0/3899151578 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c40ab9d0 con 0x7f22cc06eeb0 2024-03-23T23:42:43.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.865+0000 7f22d0a00640 1 -- 172.21.15.8:0/3899151578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22cc06eeb0 msgr2=0x7f22cc150890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:43.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.865+0000 7f22d0a00640 1 --2- 172.21.15.8:0/3899151578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22cc06eeb0 0x7f22cc150890 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f22c40097c0 tx=0x7f22c401c380 comp rx=0 tx=0).stop 2024-03-23T23:42:43.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.865+0000 7f22d0a00640 1 -- 172.21.15.8:0/3899151578 shutdown_connections 2024-03-23T23:42:43.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.865+0000 7f22d0a00640 1 --2- 172.21.15.8:0/3899151578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22cc06eeb0 0x7f22cc150890 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:43.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.865+0000 7f22d0a00640 1 --2- 172.21.15.8:0/3899151578 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22cc0ad810 0x7f22cc071e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:43.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.865+0000 7f22d0a00640 1 -- 172.21.15.8:0/3899151578 >> 172.21.15.8:0/3899151578 conn(0x7f22cc0c4c80 msgr2=0x7f22cc0c5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:43.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.865+0000 7f22d0a00640 1 -- 172.21.15.8:0/3899151578 shutdown_connections 2024-03-23T23:42:43.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.865+0000 7f22d0a00640 1 -- 172.21.15.8:0/3899151578 wait complete. 2024-03-23T23:42:43.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.865+0000 7f22d0a00640 1 Processor -- start 2024-03-23T23:42:43.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.865+0000 7f22d0a00640 1 -- start start 2024-03-23T23:42:43.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.865+0000 7f22d0a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22cc06eeb0 0x7f22cc146080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:43.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.865+0000 7f22d0a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22cc0ad810 0x7f22cc1eebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:43.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.865+0000 7f22d0a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22cc140940 0x7f22cc1ef110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:43.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.865+0000 7f22d0a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc0add70 con 0x7f22cc140940 2024-03-23T23:42:43.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.865+0000 7f22d0a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc0adbf0 con 0x7f22cc06eeb0 2024-03-23T23:42:43.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.865+0000 7f22d0a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc160880 con 0x7f22cc0ad810 2024-03-23T23:42:43.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.865+0000 7f22ca800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22cc140940 0x7f22cc1ef110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:43.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.865+0000 7f22c1400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22cc0ad810 0x7f22cc1eebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:43.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.865+0000 7f22c9e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22cc06eeb0 0x7f22cc146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:43.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.865+0000 7f22ca800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22cc140940 0x7f22cc1ef110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51690/0 (socket says 172.21.15.8:51690) 2024-03-23T23:42:43.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.865+0000 7f22ca800640 1 -- 172.21.15.8:0/2394758382 learned_addr learned my addr 172.21.15.8:0/2394758382 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:43.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.869+0000 7f22ca800640 1 -- 172.21.15.8:0/2394758382 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22cc0ad810 msgr2=0x7f22cc1eebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:43.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.869+0000 7f22ca800640 1 --2- 172.21.15.8:0/2394758382 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22cc0ad810 0x7f22cc1eebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:43.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.869+0000 7f22ca800640 1 -- 172.21.15.8:0/2394758382 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22cc06eeb0 msgr2=0x7f22cc146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:43.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.869+0000 7f22ca800640 1 --2- 172.21.15.8:0/2394758382 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22cc06eeb0 0x7f22cc146080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:43.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.869+0000 7f22ca800640 1 -- 172.21.15.8:0/2394758382 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22cc0c4ab0 con 0x7f22cc140940 2024-03-23T23:42:43.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.869+0000 7f22ca800640 1 --2- 172.21.15.8:0/2394758382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22cc140940 0x7f22cc1ef110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f22c4019fb0 tx=0x7f22c4019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:43.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.869+0000 7f22c2a00640 1 -- 172.21.15.8:0/2394758382 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c40b0040 con 0x7f22cc140940 2024-03-23T23:42:43.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.869+0000 7f22c2a00640 1 -- 172.21.15.8:0/2394758382 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c40b9070 con 0x7f22cc140940 2024-03-23T23:42:43.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.869+0000 7f22d0a00640 1 -- 172.21.15.8:0/2394758382 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22cc0c2b00 con 0x7f22cc140940 2024-03-23T23:42:43.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.869+0000 7f22c2a00640 1 -- 172.21.15.8:0/2394758382 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c40b4650 con 0x7f22cc140940 2024-03-23T23:42:43.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.869+0000 7f22d0a00640 1 -- 172.21.15.8:0/2394758382 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22cc0c47d0 con 0x7f22cc140940 2024-03-23T23:42:43.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.869+0000 7f22d0a00640 1 -- 172.21.15.8:0/2394758382 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22cc04f410 con 0x7f22cc140940 2024-03-23T23:42:43.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.869+0000 7f22c2a00640 1 -- 172.21.15.8:0/2394758382 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f22c40b47f0 con 0x7f22cc140940 2024-03-23T23:42:43.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.869+0000 7f22c2a00640 1 --2- 172.21.15.8:0/2394758382 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f22a8067690 0x7f22a8069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:43.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.869+0000 7f22c2a00640 1 -- 172.21.15.8:0/2394758382 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5689+0+0 (secure 0 0 0) 0x7f22c411f280 con 0x7f22cc140940 2024-03-23T23:42:43.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.869+0000 7f22c9e00640 1 --2- 172.21.15.8:0/2394758382 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f22a8067690 0x7f22a8069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:43.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.873+0000 7f22c9e00640 1 --2- 172.21.15.8:0/2394758382 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f22a8067690 0x7f22a8069b50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f22cc1447c0 tx=0x7f22bc00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:43.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:43.873+0000 7f22c2a00640 1 -- 172.21.15.8:0/2394758382 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f22c4016090 con 0x7f22cc140940 2024-03-23T23:42:44.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.077+0000 7f22d0a00640 1 -- 172.21.15.8:0/2394758382 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f22cc070620 con 0x7f22cc140940 2024-03-23T23:42:44.460 INFO:tasks.ceph.mds.d.smithi196.stderr:2024-03-23T23:42:44.460+0000 7f4f90c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-23T23:42:44.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.693+0000 7f22c2a00640 1 -- 172.21.15.8:0/2394758382 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "session_timeout", "val": "300"}]=0 v9) v1 ==== 110+0+0 (secure 0 0 0) 0x7f22c40ef940 con 0x7f22cc140940 2024-03-23T23:42:44.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.697+0000 7f22d0a00640 1 -- 172.21.15.8:0/2394758382 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f22a8067690 msgr2=0x7f22a8069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:44.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.697+0000 7f22d0a00640 1 --2- 172.21.15.8:0/2394758382 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f22a8067690 0x7f22a8069b50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f22cc1447c0 tx=0x7f22bc00b040 comp rx=0 tx=0).stop 2024-03-23T23:42:44.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.697+0000 7f22d0a00640 1 -- 172.21.15.8:0/2394758382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22cc140940 msgr2=0x7f22cc1ef110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:44.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.697+0000 7f22d0a00640 1 --2- 172.21.15.8:0/2394758382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22cc140940 0x7f22cc1ef110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f22c4019fb0 tx=0x7f22c4019120 comp rx=0 tx=0).stop 2024-03-23T23:42:44.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.697+0000 7f22d0a00640 1 -- 172.21.15.8:0/2394758382 shutdown_connections 2024-03-23T23:42:44.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.697+0000 7f22d0a00640 1 --2- 172.21.15.8:0/2394758382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22cc140940 0x7f22cc1ef110 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:44.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.697+0000 7f22d0a00640 1 --2- 172.21.15.8:0/2394758382 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f22a8067690 0x7f22a8069b50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:44.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.697+0000 7f22d0a00640 1 --2- 172.21.15.8:0/2394758382 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22cc0ad810 0x7f22cc1eebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:44.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.697+0000 7f22d0a00640 1 --2- 172.21.15.8:0/2394758382 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22cc06eeb0 0x7f22cc146080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:44.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.697+0000 7f22d0a00640 1 -- 172.21.15.8:0/2394758382 >> 172.21.15.8:0/2394758382 conn(0x7f22cc0c4c80 msgr2=0x7f22cc15d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:44.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.697+0000 7f22d0a00640 1 -- 172.21.15.8:0/2394758382 shutdown_connections 2024-03-23T23:42:44.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.697+0000 7f22d0a00640 1 -- 172.21.15.8:0/2394758382 wait complete. 2024-03-23T23:42:44.718 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'a' 2024-03-23T23:42:44.718 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T23:42:44.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.857+0000 7f5270a00640 1 Processor -- start 2024-03-23T23:42:44.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.857+0000 7f5270a00640 1 -- start start 2024-03-23T23:42:44.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.861+0000 7f5270a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f526c0c4250 0x7f526c152b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:44.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.861+0000 7f5270a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f526c153080 0x7f526c158f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:44.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.861+0000 7f5270a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f526c0c4790 con 0x7f526c0c2f10 2024-03-23T23:42:44.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.861+0000 7f5270a00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f526c0c07d0 con 0x7f526c153080 2024-03-23T23:42:44.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.861+0000 7f5270a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f526c0c0ab0 con 0x7f526c0c4250 2024-03-23T23:42:44.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.861+0000 7f526a800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f526c153080 0x7f526c158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:44.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.861+0000 7f5263e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f526c0c4250 0x7f526c152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:44.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.861+0000 7f526a800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f526c153080 0x7f526c158f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51692/0 (socket says 172.21.15.8:51692) 2024-03-23T23:42:44.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.861+0000 7f526a800640 1 -- 172.21.15.8:0/3678363806 learned_addr learned my addr 172.21.15.8:0/3678363806 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:44.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.861+0000 7f526a800640 1 -- 172.21.15.8:0/3678363806 >> v2:172.21.15.196:3300/0 conn(0x7f526c0c4250 msgr2=0x7f526c152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:44.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.861+0000 7f526a800640 1 --2- 172.21.15.8:0/3678363806 >> v2:172.21.15.196:3300/0 conn(0x7f526c0c4250 0x7f526c152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:44.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.861+0000 7f526a800640 1 -- 172.21.15.8:0/3678363806 >> v1:172.21.15.196:6789/0 conn(0x7f526c0c2f10 legacy=0x7f526c0c3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:44.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.861+0000 7f526a800640 1 -- 172.21.15.8:0/3678363806 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526c0c0d90 con 0x7f526c153080 2024-03-23T23:42:44.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.865+0000 7f526a800640 1 --2- 172.21.15.8:0/3678363806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f526c153080 0x7f526c158f00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f526c0709a0 tx=0x7f526401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa1c5189a9eba9ed server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:44.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.865+0000 7f5269400640 1 -- 172.21.15.8:0/3678363806 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52640a5640 con 0x7f526c153080 2024-03-23T23:42:44.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.865+0000 7f5269400640 1 -- 172.21.15.8:0/3678363806 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52640a57e0 con 0x7f526c153080 2024-03-23T23:42:44.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.865+0000 7f5269400640 1 -- 172.21.15.8:0/3678363806 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52640a5bb0 con 0x7f526c153080 2024-03-23T23:42:44.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.865+0000 7f5270a00640 1 -- 172.21.15.8:0/3678363806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f526c153080 msgr2=0x7f526c158f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:44.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.865+0000 7f5270a00640 1 --2- 172.21.15.8:0/3678363806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f526c153080 0x7f526c158f00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f526c0709a0 tx=0x7f526401c8d0 comp rx=0 tx=0).stop 2024-03-23T23:42:44.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.865+0000 7f5270a00640 1 -- 172.21.15.8:0/3678363806 shutdown_connections 2024-03-23T23:42:44.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.865+0000 7f5270a00640 1 --2- 172.21.15.8:0/3678363806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f526c153080 0x7f526c158f00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:44.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.865+0000 7f5270a00640 1 --2- 172.21.15.8:0/3678363806 >> v2:172.21.15.196:3300/0 conn(0x7f526c0c4250 0x7f526c152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:44.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.865+0000 7f5270a00640 1 -- 172.21.15.8:0/3678363806 >> 172.21.15.8:0/3678363806 conn(0x7f526c06b170 msgr2=0x7f526c06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:44.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.865+0000 7f5270a00640 1 -- 172.21.15.8:0/3678363806 shutdown_connections 2024-03-23T23:42:44.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.865+0000 7f5270a00640 1 -- 172.21.15.8:0/3678363806 wait complete. 2024-03-23T23:42:44.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.865+0000 7f5270a00640 1 Processor -- start 2024-03-23T23:42:44.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.865+0000 7f5270a00640 1 -- start start 2024-03-23T23:42:44.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.865+0000 7f5270a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f526c0c2f10 0x7f526c0ad280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:44.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.865+0000 7f5270a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f526c0c4250 0x7f526c149010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:44.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.865+0000 7f5270a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f526c153080 0x7f526c14f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:44.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.865+0000 7f5270a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526c159850 con 0x7f526c153080 2024-03-23T23:42:44.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.865+0000 7f5270a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526c0c32f0 con 0x7f526c0c4250 2024-03-23T23:42:44.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.865+0000 7f5270a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f526c1501d0 con 0x7f526c0c2f10 2024-03-23T23:42:44.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.869+0000 7f526a800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f526c153080 0x7f526c14f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:44.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.869+0000 7f5269e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f526c0c2f10 0x7f526c0ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:44.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.869+0000 7f5263e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f526c0c4250 0x7f526c149010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:44.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.869+0000 7f5269e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f526c0c2f10 0x7f526c0ad280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:42934/0 (socket says 172.21.15.8:42934) 2024-03-23T23:42:44.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.869+0000 7f5269e00640 1 -- 172.21.15.8:0/3111916126 learned_addr learned my addr 172.21.15.8:0/3111916126 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:44.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.869+0000 7f5269e00640 1 -- 172.21.15.8:0/3111916126 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f526c0c4250 msgr2=0x7f526c149010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:44.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.869+0000 7f5269e00640 1 --2- 172.21.15.8:0/3111916126 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f526c0c4250 0x7f526c149010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:44.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.869+0000 7f5269e00640 1 -- 172.21.15.8:0/3111916126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f526c153080 msgr2=0x7f526c14f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:44.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.869+0000 7f5269e00640 1 --2- 172.21.15.8:0/3111916126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f526c153080 0x7f526c14f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:44.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.869+0000 7f5269e00640 1 -- 172.21.15.8:0/3111916126 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526c14dc70 con 0x7f526c0c2f10 2024-03-23T23:42:44.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.869+0000 7f526a800640 1 --2- 172.21.15.8:0/3111916126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f526c153080 0x7f526c14f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:42:44.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.869+0000 7f5269e00640 1 --2- 172.21.15.8:0/3111916126 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f526c0c2f10 0x7f526c0ad280 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f525c00c450 tx=0x7f525c00c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:44.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.869+0000 7f5262000640 1 -- 172.21.15.8:0/3111916126 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c016020 con 0x7f526c0c2f10 2024-03-23T23:42:44.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.869+0000 7f5262000640 1 -- 172.21.15.8:0/3111916126 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525c0052d0 con 0x7f526c0c2f10 2024-03-23T23:42:44.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.869+0000 7f5270a00640 1 -- 172.21.15.8:0/3111916126 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f526c14df50 con 0x7f526c0c2f10 2024-03-23T23:42:44.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.869+0000 7f5262000640 1 -- 172.21.15.8:0/3111916126 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c007260 con 0x7f526c0c2f10 2024-03-23T23:42:44.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.869+0000 7f5270a00640 1 -- 172.21.15.8:0/3111916126 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f526c149550 con 0x7f526c0c2f10 2024-03-23T23:42:44.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.869+0000 7f5270a00640 1 -- 172.21.15.8:0/3111916126 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f526c068270 con 0x7f526c0c2f10 2024-03-23T23:42:44.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.869+0000 7f5262000640 1 -- 172.21.15.8:0/3111916126 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f525c007400 con 0x7f526c0c2f10 2024-03-23T23:42:44.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.873+0000 7f5262000640 1 --2- 172.21.15.8:0/3111916126 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5248067690 0x7f5248069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:44.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.873+0000 7f5262000640 1 -- 172.21.15.8:0/3111916126 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5689+0+0 (secure 0 0 0) 0x7f525c085110 con 0x7f526c0c2f10 2024-03-23T23:42:44.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.873+0000 7f5263e00640 1 --2- 172.21.15.8:0/3111916126 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5248067690 0x7f5248069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:44.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.873+0000 7f5263e00640 1 --2- 172.21.15.8:0/3111916126 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5248067690 0x7f5248069b50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f526c14e760 tx=0x7f5254009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:44.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:44.877+0000 7f5262000640 1 -- 172.21.15.8:0/3111916126 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f525c020020 con 0x7f526c0c2f10 2024-03-23T23:42:45.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.077+0000 7f5270a00640 1 -- 172.21.15.8:0/3111916126 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f526c072410 con 0x7f526c0c2f10 2024-03-23T23:42:45.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.077+0000 7f5262000640 1 -- 172.21.15.8:0/3111916126 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4967 (secure 0 0 0) 0x7f525c005480 con 0x7f526c0c2f10 2024-03-23T23:42:45.078 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:42:45.078 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6836/3149325777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3149325777},{"type":"v1","addr":"172.21.15.196:6836","nonce":3149325777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6833/1542162403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1542162403},{"type":"v1","addr":"172.21.15.8:6833","nonce":1542162403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3531853933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3531853933},{"type":"v1","addr":"172.21.15.8:6835","nonce":3531853933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T23:42:40.070799+0000","modified":"2024-03-23T23:42:44.080269+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6837/3402347550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":3402347550},{"type":"v1","addr":"172.21.15.196:6837","nonce":3402347550}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-03-23T23:42:45.079 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 9 2024-03-23T23:42:45.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.077+0000 7f5270a00640 1 -- 172.21.15.8:0/3111916126 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5248067690 msgr2=0x7f5248069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:45.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.077+0000 7f5270a00640 1 --2- 172.21.15.8:0/3111916126 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5248067690 0x7f5248069b50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f526c14e760 tx=0x7f5254009190 comp rx=0 tx=0).stop 2024-03-23T23:42:45.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.077+0000 7f5270a00640 1 -- 172.21.15.8:0/3111916126 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f526c0c2f10 msgr2=0x7f526c0ad280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:45.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.077+0000 7f5270a00640 1 --2- 172.21.15.8:0/3111916126 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f526c0c2f10 0x7f526c0ad280 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f525c00c450 tx=0x7f525c00c910 comp rx=0 tx=0).stop 2024-03-23T23:42:45.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.077+0000 7f5270a00640 1 -- 172.21.15.8:0/3111916126 shutdown_connections 2024-03-23T23:42:45.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.077+0000 7f5270a00640 1 --2- 172.21.15.8:0/3111916126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f526c153080 0x7f526c14f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:45.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.077+0000 7f5270a00640 1 --2- 172.21.15.8:0/3111916126 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f526c0c4250 0x7f526c149010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:45.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.077+0000 7f5270a00640 1 --2- 172.21.15.8:0/3111916126 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5248067690 0x7f5248069b50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:45.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.077+0000 7f5270a00640 1 --2- 172.21.15.8:0/3111916126 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f526c0c2f10 0x7f526c0ad280 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:45.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.077+0000 7f5270a00640 1 -- 172.21.15.8:0/3111916126 >> 172.21.15.8:0/3111916126 conn(0x7f526c06b170 msgr2=0x7f526c0c2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:45.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.077+0000 7f5270a00640 1 -- 172.21.15.8:0/3111916126 shutdown_connections 2024-03-23T23:42:45.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.077+0000 7f5270a00640 1 -- 172.21.15.8:0/3111916126 wait complete. 2024-03-23T23:42:45.100 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:42:45.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.237+0000 7ff675600640 1 Processor -- start 2024-03-23T23:42:45.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.241+0000 7ff675600640 1 -- start start 2024-03-23T23:42:45.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.241+0000 7ff675600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff67014f920 0x7ff670152e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:45.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.241+0000 7ff675600640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6700c3930 con 0x7ff6700c2bb0 2024-03-23T23:42:45.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.241+0000 7ff675600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6700c1df0 con 0x7ff6700c3bc0 2024-03-23T23:42:45.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.241+0000 7ff675600640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff670071760 con 0x7ff67014f920 2024-03-23T23:42:45.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.241+0000 7ff66fe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff67014f920 0x7ff670152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:45.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.241+0000 7ff66f400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff6700c2bb0 0x7ff670071050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:55960/0 (socket says 172.21.15.8:55960) 2024-03-23T23:42:45.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.241+0000 7ff66f400640 1 -- 172.21.15.8:0/3250868557 learned_addr learned my addr 172.21.15.8:0/3250868557 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:45.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.241+0000 7ff66fe00640 1 -- 172.21.15.8:0/3250868557 >> v1:172.21.15.196:6789/0 conn(0x7ff6700c3bc0 legacy=0x7ff6700c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:45.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.241+0000 7ff66fe00640 1 -- 172.21.15.8:0/3250868557 >> v1:172.21.15.8:6789/0 conn(0x7ff6700c2bb0 legacy=0x7ff670071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:45.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.241+0000 7ff66ea00640 1 -- 172.21.15.8:0/3250868557 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1554794791 0 0) 0x7ff6700c3930 con 0x7ff6700c2bb0 2024-03-23T23:42:45.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.241+0000 7ff66fe00640 1 -- 172.21.15.8:0/3250868557 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6700c20d0 con 0x7ff67014f920 2024-03-23T23:42:45.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.245+0000 7ff66fe00640 1 --2- 172.21.15.8:0/3250868557 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff67014f920 0x7ff670152e00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff6600097c0 tx=0x7ff66001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=152fb18607a13a1e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:45.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.245+0000 7ff66ea00640 1 -- 172.21.15.8:0/3250868557 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6600b0070 con 0x7ff67014f920 2024-03-23T23:42:45.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.245+0000 7ff66ea00640 1 -- 172.21.15.8:0/3250868557 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6600ab600 con 0x7ff67014f920 2024-03-23T23:42:45.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.245+0000 7ff66ea00640 1 -- 172.21.15.8:0/3250868557 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6600ab9d0 con 0x7ff67014f920 2024-03-23T23:42:45.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.245+0000 7ff675600640 1 -- 172.21.15.8:0/3250868557 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff67014f920 msgr2=0x7ff670152e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:45.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.245+0000 7ff675600640 1 --2- 172.21.15.8:0/3250868557 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff67014f920 0x7ff670152e00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff6600097c0 tx=0x7ff66001c380 comp rx=0 tx=0).stop 2024-03-23T23:42:45.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.245+0000 7ff675600640 1 -- 172.21.15.8:0/3250868557 shutdown_connections 2024-03-23T23:42:45.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.245+0000 7ff675600640 1 --2- 172.21.15.8:0/3250868557 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff67014f920 0x7ff670152e00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:45.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.245+0000 7ff675600640 1 -- 172.21.15.8:0/3250868557 >> 172.21.15.8:0/3250868557 conn(0x7ff6700c7270 msgr2=0x7ff6700c7680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:45.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.245+0000 7ff675600640 1 -- 172.21.15.8:0/3250868557 shutdown_connections 2024-03-23T23:42:45.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.245+0000 7ff675600640 1 -- 172.21.15.8:0/3250868557 wait complete. 2024-03-23T23:42:45.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.245+0000 7ff675600640 1 Processor -- start 2024-03-23T23:42:45.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.245+0000 7ff675600640 1 -- start start 2024-03-23T23:42:45.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.249+0000 7ff675600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff6700c2bb0 0x7ff670154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:45.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.249+0000 7ff675600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff6700c3bc0 0x7ff67013e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:45.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.249+0000 7ff675600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff67014f920 0x7ff6701ebcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:45.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.249+0000 7ff675600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff670160530 con 0x7ff67014f920 2024-03-23T23:42:45.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.249+0000 7ff675600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6700c3000 con 0x7ff6700c2bb0 2024-03-23T23:42:45.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.249+0000 7ff675600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6701606b0 con 0x7ff6700c3bc0 2024-03-23T23:42:45.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.249+0000 7ff66fe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff6700c2bb0 0x7ff670154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:45.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.249+0000 7ff66f400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff6700c3bc0 0x7ff67013e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:45.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.249+0000 7ff674c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff67014f920 0x7ff6701ebcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:45.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.249+0000 7ff66fe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff6700c2bb0 0x7ff670154c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:60478/0 (socket says 172.21.15.8:60478) 2024-03-23T23:42:45.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.249+0000 7ff66fe00640 1 -- 172.21.15.8:0/87696939 learned_addr learned my addr 172.21.15.8:0/87696939 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:45.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.249+0000 7ff66f400640 1 -- 172.21.15.8:0/87696939 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff6700c2bb0 msgr2=0x7ff670154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:45.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.249+0000 7ff66f400640 1 --2- 172.21.15.8:0/87696939 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff6700c2bb0 0x7ff670154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:45.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.249+0000 7ff66f400640 1 -- 172.21.15.8:0/87696939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff67014f920 msgr2=0x7ff6701ebcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:45.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.249+0000 7ff66f400640 1 --2- 172.21.15.8:0/87696939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff67014f920 0x7ff6701ebcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:45.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.249+0000 7ff66f400640 1 -- 172.21.15.8:0/87696939 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6701f0130 con 0x7ff6700c3bc0 2024-03-23T23:42:45.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.249+0000 7ff674c00640 1 --2- 172.21.15.8:0/87696939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff67014f920 0x7ff6701ebcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:42:45.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.249+0000 7ff66fe00640 1 --2- 172.21.15.8:0/87696939 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff6700c2bb0 0x7ff670154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:42:45.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.249+0000 7ff66f400640 1 --2- 172.21.15.8:0/87696939 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff6700c3bc0 0x7ff67013e5d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff65c00c3e0 tx=0x7ff65c00c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:45.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.249+0000 7ff667e00640 1 -- 172.21.15.8:0/87696939 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c0074e0 con 0x7ff6700c3bc0 2024-03-23T23:42:45.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.249+0000 7ff667e00640 1 -- 172.21.15.8:0/87696939 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65c0047f0 con 0x7ff6700c3bc0 2024-03-23T23:42:45.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.249+0000 7ff675600640 1 -- 172.21.15.8:0/87696939 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff670146820 con 0x7ff6700c3bc0 2024-03-23T23:42:45.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.249+0000 7ff667e00640 1 -- 172.21.15.8:0/87696939 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c007680 con 0x7ff6700c3bc0 2024-03-23T23:42:45.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.249+0000 7ff675600640 1 -- 172.21.15.8:0/87696939 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff670143f20 con 0x7ff6700c3bc0 2024-03-23T23:42:45.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.249+0000 7ff675600640 1 -- 172.21.15.8:0/87696939 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6701efc70 con 0x7ff6700c3bc0 2024-03-23T23:42:45.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.249+0000 7ff667e00640 1 -- 172.21.15.8:0/87696939 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff65c011070 con 0x7ff6700c3bc0 2024-03-23T23:42:45.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.253+0000 7ff667e00640 1 --2- 172.21.15.8:0/87696939 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff650067660 0x7ff650069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:45.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.253+0000 7ff667e00640 1 -- 172.21.15.8:0/87696939 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5689+0+0 (secure 0 0 0) 0x7ff65c085290 con 0x7ff6700c3bc0 2024-03-23T23:42:45.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.253+0000 7ff66fe00640 1 --2- 172.21.15.8:0/87696939 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff650067660 0x7ff650069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:45.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.253+0000 7ff66fe00640 1 --2- 172.21.15.8:0/87696939 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff650067660 0x7ff650069b20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff660018f90 tx=0x7ff6600a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:45.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.261+0000 7ff667e00640 1 -- 172.21.15.8:0/87696939 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7ff6701efc70 con 0x7ff6700c3bc0 2024-03-23T23:42:45.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.425+0000 7ff675600640 1 -- 172.21.15.8:0/87696939 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff67004f410 con 0x7ff6700c3bc0 2024-03-23T23:42:45.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.425+0000 7ff667e00640 1 -- 172.21.15.8:0/87696939 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16513 (secure 0 0 0) 0x7ff65c0558c0 con 0x7ff6700c3bc0 2024-03-23T23:42:45.428 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:42:45.428 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":21,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","created":"2024-03-23T23:42:15.169430+0000","modified":"2024-03-23T23:42:41.661787+0000","last_up_change":"2024-03-23T23:42:26.509742+0000","last_in_change":"2024-03-23T23:42:17.662330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:42:26.327445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-23T23:42:38.218800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-23T23:42:39.054195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e967bf31-21d6-4d11-bc3d-0df8177a1b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6809","nonce":2187201732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6811","nonce":2187201732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6815","nonce":2187201732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6813","nonce":2187201732}]},"public_addr":"172.21.15.8:6809/2187201732","cluster_addr":"172.21.15.8:6811/2187201732","heartbeat_back_addr":"172.21.15.8:6815/2187201732","heartbeat_front_addr":"172.21.15.8:6813/2187201732","state":["exists","up"]},{"osd":1,"uuid":"c8e33701-7acd-4474-8402-d52461171fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6818","nonce":3205168010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6822","nonce":3205168010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6830","nonce":3205168010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6826","nonce":3205168010}]},"public_addr":"172.21.15.8:6818/3205168010","cluster_addr":"172.21.15.8:6822/3205168010","heartbeat_back_addr":"172.21.15.8:6830/3205168010","heartbeat_front_addr":"172.21.15.8:6826/3205168010","state":["exists","up"]},{"osd":2,"uuid":"ceebdbf7-4c2f-4757-b52d-fd8b20e77570","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6801","nonce":475463656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6803","nonce":475463656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6807","nonce":475463656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6805","nonce":475463656}]},"public_addr":"172.21.15.8:6801/475463656","cluster_addr":"172.21.15.8:6803/475463656","heartbeat_back_addr":"172.21.15.8:6807/475463656","heartbeat_front_addr":"172.21.15.8:6805/475463656","state":["exists","up"]},{"osd":3,"uuid":"89e258da-5767-429e-8441-edf877d2f3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6819","nonce":1514082871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6821","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6823","nonce":1514082871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6829","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6831","nonce":1514082871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6825","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6827","nonce":1514082871}]},"public_addr":"172.21.15.8:6819/1514082871","cluster_addr":"172.21.15.8:6823/1514082871","heartbeat_back_addr":"172.21.15.8:6831/1514082871","heartbeat_front_addr":"172.21.15.8:6827/1514082871","state":["exists","up"]},{"osd":4,"uuid":"2b7451ae-ea16-4f0a-ae50-04fde75e45ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6825","nonce":3516578147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6827","nonce":3516578147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6831","nonce":3516578147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6829","nonce":3516578147}]},"public_addr":"172.21.15.196:6825/3516578147","cluster_addr":"172.21.15.196:6827/3516578147","heartbeat_back_addr":"172.21.15.196:6831/3516578147","heartbeat_front_addr":"172.21.15.196:6829/3516578147","state":["exists","up"]},{"osd":5,"uuid":"e68a8914-e591-466a-bc9e-f2d7c67aac13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6802","nonce":830595758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6806","nonce":830595758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6814","nonce":830595758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6810","nonce":830595758}]},"public_addr":"172.21.15.196:6802/830595758","cluster_addr":"172.21.15.196:6806/830595758","heartbeat_back_addr":"172.21.15.196:6814/830595758","heartbeat_front_addr":"172.21.15.196:6810/830595758","state":["exists","up"]},{"osd":6,"uuid":"e47723c5-50a0-4cd8-92d9-01972072b422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6801","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6803","nonce":472639906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6805","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6807","nonce":472639906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6815","nonce":472639906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6811","nonce":472639906}]},"public_addr":"172.21.15.196:6803/472639906","cluster_addr":"172.21.15.196:6807/472639906","heartbeat_back_addr":"172.21.15.196:6815/472639906","heartbeat_front_addr":"172.21.15.196:6811/472639906","state":["exists","up"]},{"osd":7,"uuid":"e1e9113d-8005-47b3-9a75-9e701199f1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6817","nonce":4151820349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6819","nonce":4151820349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6823","nonce":4151820349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6821","nonce":4151820349}]},"public_addr":"172.21.15.196:6817/4151820349","cluster_addr":"172.21.15.196:6819/4151820349","heartbeat_back_addr":"172.21.15.196:6823/4151820349","heartbeat_front_addr":"172.21.15.196:6821/4151820349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.221790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.265974+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.190319+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.376359+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.329657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.402958+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.300703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.133121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:42:45.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.429+0000 7ff675600640 1 -- 172.21.15.8:0/87696939 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff650067660 msgr2=0x7ff650069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:45.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.429+0000 7ff675600640 1 --2- 172.21.15.8:0/87696939 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff650067660 0x7ff650069b20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff660018f90 tx=0x7ff6600a6000 comp rx=0 tx=0).stop 2024-03-23T23:42:45.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.429+0000 7ff675600640 1 -- 172.21.15.8:0/87696939 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff6700c3bc0 msgr2=0x7ff67013e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:45.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.429+0000 7ff675600640 1 --2- 172.21.15.8:0/87696939 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff6700c3bc0 0x7ff67013e5d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff65c00c3e0 tx=0x7ff65c00c8a0 comp rx=0 tx=0).stop 2024-03-23T23:42:45.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.429+0000 7ff675600640 1 -- 172.21.15.8:0/87696939 shutdown_connections 2024-03-23T23:42:45.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.429+0000 7ff675600640 1 --2- 172.21.15.8:0/87696939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff67014f920 0x7ff6701ebcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:45.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.429+0000 7ff675600640 1 --2- 172.21.15.8:0/87696939 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff650067660 0x7ff650069b20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:45.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.429+0000 7ff675600640 1 --2- 172.21.15.8:0/87696939 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff6700c3bc0 0x7ff67013e5d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:45.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.429+0000 7ff675600640 1 --2- 172.21.15.8:0/87696939 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff6700c2bb0 0x7ff670154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:45.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.429+0000 7ff675600640 1 -- 172.21.15.8:0/87696939 >> 172.21.15.8:0/87696939 conn(0x7ff6700c7270 msgr2=0x7ff6701523f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:45.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.429+0000 7ff675600640 1 -- 172.21.15.8:0/87696939 shutdown_connections 2024-03-23T23:42:45.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.429+0000 7ff675600640 1 -- 172.21.15.8:0/87696939 wait complete. 2024-03-23T23:42:45.450 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-23T23:42:45.450 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T23:42:45.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.589+0000 7ff3cb200640 1 Processor -- start 2024-03-23T23:42:45.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.589+0000 7ff3cb200640 1 -- start start 2024-03-23T23:42:45.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.589+0000 7ff3cb200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff3c40c7000 0x7ff3c40c2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:45.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.589+0000 7ff3cb200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c40c8100 con 0x7ff3c4152f00 2024-03-23T23:42:45.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.589+0000 7ff3cb200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c4158f60 con 0x7ff3c40c4510 2024-03-23T23:42:45.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.589+0000 7ff3cb200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c4159e70 con 0x7ff3c40c7000 2024-03-23T23:42:45.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.589+0000 7ff3c3e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff3c4152f00 0x7ff3c4159760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:55970/0 (socket says 172.21.15.8:55970) 2024-03-23T23:42:45.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.589+0000 7ff3c3e00640 1 -- 172.21.15.8:0/841339927 learned_addr learned my addr 172.21.15.8:0/841339927 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:45.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.589+0000 7ff3c9200640 1 --2- 172.21.15.8:0/841339927 >> v2:172.21.15.8:3300/0 conn(0x7ff3c40c7000 0x7ff3c40c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:45.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.589+0000 7ff3c3400640 1 -- 172.21.15.8:0/841339927 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046707594 0 0) 0x7ff3c40c8100 con 0x7ff3c4152f00 2024-03-23T23:42:45.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.589+0000 7ff3c9200640 1 -- 172.21.15.8:0/841339927 >> v1:172.21.15.196:6789/0 conn(0x7ff3c40c4510 legacy=0x7ff3c40c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:45.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.589+0000 7ff3c9200640 1 -- 172.21.15.8:0/841339927 >> v1:172.21.15.8:6789/0 conn(0x7ff3c4152f00 legacy=0x7ff3c4159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:45.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.589+0000 7ff3c9200640 1 -- 172.21.15.8:0/841339927 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c4159240 con 0x7ff3c40c7000 2024-03-23T23:42:45.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.593+0000 7ff3c9200640 1 --2- 172.21.15.8:0/841339927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3c40c7000 0x7ff3c40c2530 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc009d90 tx=0x7ff3bc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dcd16b9cfea8275 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:45.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.593+0000 7ff3c3400640 1 -- 172.21.15.8:0/841339927 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc0b1070 con 0x7ff3c40c7000 2024-03-23T23:42:45.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.593+0000 7ff3c3400640 1 -- 172.21.15.8:0/841339927 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3bc0a4b40 con 0x7ff3c40c7000 2024-03-23T23:42:45.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.593+0000 7ff3c3400640 1 -- 172.21.15.8:0/841339927 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc0ac440 con 0x7ff3c40c7000 2024-03-23T23:42:45.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.593+0000 7ff3cb200640 1 -- 172.21.15.8:0/841339927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3c40c7000 msgr2=0x7ff3c40c2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:45.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.593+0000 7ff3cb200640 1 --2- 172.21.15.8:0/841339927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3c40c7000 0x7ff3c40c2530 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc009d90 tx=0x7ff3bc01c470 comp rx=0 tx=0).stop 2024-03-23T23:42:45.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.593+0000 7ff3cb200640 1 -- 172.21.15.8:0/841339927 shutdown_connections 2024-03-23T23:42:45.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.593+0000 7ff3cb200640 1 --2- 172.21.15.8:0/841339927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3c40c7000 0x7ff3c40c2530 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:45.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.593+0000 7ff3cb200640 1 -- 172.21.15.8:0/841339927 >> 172.21.15.8:0/841339927 conn(0x7ff3c40c9100 msgr2=0x7ff3c40c9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:45.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.593+0000 7ff3cb200640 1 -- 172.21.15.8:0/841339927 shutdown_connections 2024-03-23T23:42:45.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.593+0000 7ff3cb200640 1 -- 172.21.15.8:0/841339927 wait complete. 2024-03-23T23:42:45.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.597+0000 7ff3cb200640 1 Processor -- start 2024-03-23T23:42:45.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.597+0000 7ff3cb200640 1 -- start start 2024-03-23T23:42:45.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.597+0000 7ff3cb200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff3c40c4510 0x7ff3c406fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:45.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.597+0000 7ff3cb200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3c40c7000 0x7ff3c4151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:45.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.597+0000 7ff3cb200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3c4152f00 0x7ff3c414ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:45.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.597+0000 7ff3cb200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c4164e20 con 0x7ff3c40c7000 2024-03-23T23:42:45.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.597+0000 7ff3cb200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c4164ca0 con 0x7ff3c4152f00 2024-03-23T23:42:45.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.597+0000 7ff3cb200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c4164fa0 con 0x7ff3c40c4510 2024-03-23T23:42:45.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.597+0000 7ff3bbe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3c40c7000 0x7ff3c4151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:45.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.597+0000 7ff3c3e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff3c40c4510 0x7ff3c406fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:45.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.597+0000 7ff3bbe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3c40c7000 0x7ff3c4151370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51750/0 (socket says 172.21.15.8:51750) 2024-03-23T23:42:45.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.597+0000 7ff3bbe00640 1 -- 172.21.15.8:0/1939125042 learned_addr learned my addr 172.21.15.8:0/1939125042 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:45.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.597+0000 7ff3c9200640 1 --2- 172.21.15.8:0/1939125042 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3c4152f00 0x7ff3c414ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:45.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.597+0000 7ff3c3e00640 1 -- 172.21.15.8:0/1939125042 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3c4152f00 msgr2=0x7ff3c414ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:45.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.597+0000 7ff3c3e00640 1 --2- 172.21.15.8:0/1939125042 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3c4152f00 0x7ff3c414ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:45.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.597+0000 7ff3c3e00640 1 -- 172.21.15.8:0/1939125042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3c40c7000 msgr2=0x7ff3c4151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:45.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.597+0000 7ff3c3e00640 1 --2- 172.21.15.8:0/1939125042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3c40c7000 0x7ff3c4151370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:45.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.597+0000 7ff3c3e00640 1 -- 172.21.15.8:0/1939125042 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c4145120 con 0x7ff3c40c4510 2024-03-23T23:42:45.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.597+0000 7ff3bbe00640 1 --2- 172.21.15.8:0/1939125042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3c40c7000 0x7ff3c4151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:42:45.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.597+0000 7ff3c3e00640 1 --2- 172.21.15.8:0/1939125042 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff3c40c4510 0x7ff3c406fc40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff3b400c410 tx=0x7ff3b400c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:45.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.597+0000 7ff3c0c00640 1 -- 172.21.15.8:0/1939125042 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b40074e0 con 0x7ff3c40c4510 2024-03-23T23:42:45.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.597+0000 7ff3c0c00640 1 -- 172.21.15.8:0/1939125042 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b40047f0 con 0x7ff3c40c4510 2024-03-23T23:42:45.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.597+0000 7ff3c0c00640 1 -- 172.21.15.8:0/1939125042 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4007680 con 0x7ff3c40c4510 2024-03-23T23:42:45.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.597+0000 7ff3cb200640 1 -- 172.21.15.8:0/1939125042 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c40ab960 con 0x7ff3c40c4510 2024-03-23T23:42:45.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.597+0000 7ff3cb200640 1 -- 172.21.15.8:0/1939125042 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c40aab00 con 0x7ff3c40c4510 2024-03-23T23:42:45.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.601+0000 7ff3cb200640 1 -- 172.21.15.8:0/1939125042 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c4068270 con 0x7ff3c40c4510 2024-03-23T23:42:45.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.601+0000 7ff3c0c00640 1 -- 172.21.15.8:0/1939125042 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff3b4011070 con 0x7ff3c40c4510 2024-03-23T23:42:45.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.601+0000 7ff3c0c00640 1 --2- 172.21.15.8:0/1939125042 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff3a0067690 0x7ff3a0069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:45.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.601+0000 7ff3c0c00640 1 -- 172.21.15.8:0/1939125042 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5689+0+0 (secure 0 0 0) 0x7ff3b4085270 con 0x7ff3c40c4510 2024-03-23T23:42:45.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.601+0000 7ff3bbe00640 1 --2- 172.21.15.8:0/1939125042 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff3a0067690 0x7ff3a0069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:45.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.601+0000 7ff3bbe00640 1 --2- 172.21.15.8:0/1939125042 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff3a0067690 0x7ff3a0069b50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40706c0 tx=0x7ff3ac009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:45.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.609+0000 7ff3c0c00640 1 -- 172.21.15.8:0/1939125042 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7ff3c40ab960 con 0x7ff3c40c4510 2024-03-23T23:42:45.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.769+0000 7ff3cb200640 1 -- 172.21.15.8:0/1939125042 --> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff3c41588d0 con 0x7ff3a0067690 2024-03-23T23:42:45.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.777+0000 7ff3c0c00640 1 -- 172.21.15.8:0/1939125042 <== mgr.4098 v2:172.21.15.196:6832/1295060067 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251916 (secure 0 0 0) 0x7ff3c41588d0 con 0x7ff3a0067690 2024-03-23T23:42:45.781 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:42:45.784 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-03-23T23:42:45.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.781+0000 7ff3cb200640 1 -- 172.21.15.8:0/1939125042 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff3a0067690 msgr2=0x7ff3a0069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:45.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.781+0000 7ff3cb200640 1 --2- 172.21.15.8:0/1939125042 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff3a0067690 0x7ff3a0069b50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40706c0 tx=0x7ff3ac009040 comp rx=0 tx=0).stop 2024-03-23T23:42:45.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.781+0000 7ff3cb200640 1 -- 172.21.15.8:0/1939125042 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff3c40c4510 msgr2=0x7ff3c406fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:45.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.781+0000 7ff3cb200640 1 --2- 172.21.15.8:0/1939125042 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff3c40c4510 0x7ff3c406fc40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff3b400c410 tx=0x7ff3b400c8d0 comp rx=0 tx=0).stop 2024-03-23T23:42:45.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.781+0000 7ff3cb200640 1 -- 172.21.15.8:0/1939125042 shutdown_connections 2024-03-23T23:42:45.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.781+0000 7ff3cb200640 1 --2- 172.21.15.8:0/1939125042 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3c4152f00 0x7ff3c414ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:45.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.781+0000 7ff3cb200640 1 --2- 172.21.15.8:0/1939125042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3c40c7000 0x7ff3c4151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:45.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.781+0000 7ff3cb200640 1 --2- 172.21.15.8:0/1939125042 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff3a0067690 0x7ff3a0069b50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:45.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.781+0000 7ff3cb200640 1 --2- 172.21.15.8:0/1939125042 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff3c40c4510 0x7ff3c406fc40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:45.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.781+0000 7ff3cb200640 1 -- 172.21.15.8:0/1939125042 >> 172.21.15.8:0/1939125042 conn(0x7ff3c40c9100 msgr2=0x7ff3c40c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:45.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.781+0000 7ff3cb200640 1 -- 172.21.15.8:0/1939125042 shutdown_connections 2024-03-23T23:42:45.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.781+0000 7ff3cb200640 1 -- 172.21.15.8:0/1939125042 wait complete. 2024-03-23T23:42:45.803 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-03-23T23:42:44.273223+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":144,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239760,"kb_used_data":2776,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734960,"statfs":{"total":773094113280,"available":772848599040,"internally_reserved":0,"allocated":2842624,"data_stored":1729796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.619000"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.710732+0000","last_change":"2024-03-23T23:42:40.701959+0000","last_active":"2024-03-23T23:42:40.710732+0000","last_peered":"2024-03-23T23:42:40.710732+0000","last_clean":"2024-03-23T23:42:40.710732+0000","last_became_active":"2024-03-23T23:42:40.700855+0000","last_became_peered":"2024-03-23T23:42:40.700855+0000","last_unstale":"2024-03-23T23:42:40.710732+0000","last_undegraded":"2024-03-23T23:42:40.710732+0000","last_fullsized":"2024-03-23T23:42:40.710732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:51:30.695597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.684959+0000","last_change":"2024-03-23T23:42:40.678622+0000","last_active":"2024-03-23T23:42:40.684959+0000","last_peered":"2024-03-23T23:42:40.684959+0000","last_clean":"2024-03-23T23:42:40.684959+0000","last_became_active":"2024-03-23T23:42:40.678325+0000","last_became_peered":"2024-03-23T23:42:40.678325+0000","last_unstale":"2024-03-23T23:42:40.684959+0000","last_undegraded":"2024-03-23T23:42:40.684959+0000","last_fullsized":"2024-03-23T23:42:40.684959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:31:34.412092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.687411+0000","last_change":"2024-03-23T23:42:40.683983+0000","last_active":"2024-03-23T23:42:40.687411+0000","last_peered":"2024-03-23T23:42:40.687411+0000","last_clean":"2024-03-23T23:42:40.687411+0000","last_became_active":"2024-03-23T23:42:40.683711+0000","last_became_peered":"2024-03-23T23:42:40.683711+0000","last_unstale":"2024-03-23T23:42:40.687411+0000","last_undegraded":"2024-03-23T23:42:40.687411+0000","last_fullsized":"2024-03-23T23:42:40.687411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:56.763759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027841+0000","last_change":"2024-03-23T23:42:40.700631+0000","last_active":"2024-03-23T23:42:42.027841+0000","last_peered":"2024-03-23T23:42:42.027841+0000","last_clean":"2024-03-23T23:42:42.027841+0000","last_became_active":"2024-03-23T23:42:40.697932+0000","last_became_peered":"2024-03-23T23:42:40.697932+0000","last_unstale":"2024-03-23T23:42:42.027841+0000","last_undegraded":"2024-03-23T23:42:42.027841+0000","last_fullsized":"2024-03-23T23:42:42.027841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:05:17.694245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.705226+0000","last_change":"2024-03-23T23:42:40.698407+0000","last_active":"2024-03-23T23:42:40.705226+0000","last_peered":"2024-03-23T23:42:40.705226+0000","last_clean":"2024-03-23T23:42:40.705226+0000","last_became_active":"2024-03-23T23:42:40.698092+0000","last_became_peered":"2024-03-23T23:42:40.698092+0000","last_unstale":"2024-03-23T23:42:40.705226+0000","last_undegraded":"2024-03-23T23:42:40.705226+0000","last_fullsized":"2024-03-23T23:42:40.705226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:53:46.437114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027649+0000","last_change":"2024-03-23T23:42:40.698234+0000","last_active":"2024-03-23T23:42:42.027649+0000","last_peered":"2024-03-23T23:42:42.027649+0000","last_clean":"2024-03-23T23:42:42.027649+0000","last_became_active":"2024-03-23T23:42:40.695978+0000","last_became_peered":"2024-03-23T23:42:40.695978+0000","last_unstale":"2024-03-23T23:42:42.027649+0000","last_undegraded":"2024-03-23T23:42:42.027649+0000","last_fullsized":"2024-03-23T23:42:42.027649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:04.633288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.701092+0000","last_change":"2024-03-23T23:42:40.689380+0000","last_active":"2024-03-23T23:42:40.701092+0000","last_peered":"2024-03-23T23:42:40.701092+0000","last_clean":"2024-03-23T23:42:40.701092+0000","last_became_active":"2024-03-23T23:42:40.689023+0000","last_became_peered":"2024-03-23T23:42:40.689023+0000","last_unstale":"2024-03-23T23:42:40.701092+0000","last_undegraded":"2024-03-23T23:42:40.701092+0000","last_fullsized":"2024-03-23T23:42:40.701092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:57:21.400582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027564+0000","last_change":"2024-03-23T23:42:40.710655+0000","last_active":"2024-03-23T23:42:42.027564+0000","last_peered":"2024-03-23T23:42:42.027564+0000","last_clean":"2024-03-23T23:42:42.027564+0000","last_became_active":"2024-03-23T23:42:40.710362+0000","last_became_peered":"2024-03-23T23:42:40.710362+0000","last_unstale":"2024-03-23T23:42:42.027564+0000","last_undegraded":"2024-03-23T23:42:42.027564+0000","last_fullsized":"2024-03-23T23:42:42.027564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:12:14.359173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.715038+0000","last_change":"2024-03-23T23:42:40.714331+0000","last_active":"2024-03-23T23:42:40.715038+0000","last_peered":"2024-03-23T23:42:40.715038+0000","last_clean":"2024-03-23T23:42:40.715038+0000","last_became_active":"2024-03-23T23:42:40.713737+0000","last_became_peered":"2024-03-23T23:42:40.713737+0000","last_unstale":"2024-03-23T23:42:40.715038+0000","last_undegraded":"2024-03-23T23:42:40.715038+0000","last_fullsized":"2024-03-23T23:42:40.715038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:42:14.952953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.670921+0000","last_change":"2024-03-23T23:42:40.703254+0000","last_active":"2024-03-23T23:42:41.670921+0000","last_peered":"2024-03-23T23:42:41.670921+0000","last_clean":"2024-03-23T23:42:41.670921+0000","last_became_active":"2024-03-23T23:42:40.702447+0000","last_became_peered":"2024-03-23T23:42:40.702447+0000","last_unstale":"2024-03-23T23:42:41.670921+0000","last_undegraded":"2024-03-23T23:42:41.670921+0000","last_fullsized":"2024-03-23T23:42:41.670921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:59:45.154553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.671340+0000","last_change":"2024-03-23T23:42:40.702089+0000","last_active":"2024-03-23T23:42:41.671340+0000","last_peered":"2024-03-23T23:42:41.671340+0000","last_clean":"2024-03-23T23:42:41.671340+0000","last_became_active":"2024-03-23T23:42:40.701874+0000","last_became_peered":"2024-03-23T23:42:40.701874+0000","last_unstale":"2024-03-23T23:42:41.671340+0000","last_undegraded":"2024-03-23T23:42:41.671340+0000","last_fullsized":"2024-03-23T23:42:41.671340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.670823+0000","last_change":"2024-03-23T23:42:40.682523+0000","last_active":"2024-03-23T23:42:41.670823+0000","last_peered":"2024-03-23T23:42:41.670823+0000","last_clean":"2024-03-23T23:42:41.670823+0000","last_became_active":"2024-03-23T23:42:40.682155+0000","last_became_peered":"2024-03-23T23:42:40.682155+0000","last_unstale":"2024-03-23T23:42:41.670823+0000","last_undegraded":"2024-03-23T23:42:41.670823+0000","last_fullsized":"2024-03-23T23:42:41.670823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:33.260151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027597+0000","last_change":"2024-03-23T23:42:40.682736+0000","last_active":"2024-03-23T23:42:42.027597+0000","last_peered":"2024-03-23T23:42:42.027597+0000","last_clean":"2024-03-23T23:42:42.027597+0000","last_became_active":"2024-03-23T23:42:40.682410+0000","last_became_peered":"2024-03-23T23:42:40.682410+0000","last_unstale":"2024-03-23T23:42:42.027597+0000","last_undegraded":"2024-03-23T23:42:42.027597+0000","last_fullsized":"2024-03-23T23:42:42.027597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:01:06.338641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.683026+0000","last_change":"2024-03-23T23:42:40.680934+0000","last_active":"2024-03-23T23:42:40.683026+0000","last_peered":"2024-03-23T23:42:40.683026+0000","last_clean":"2024-03-23T23:42:40.683026+0000","last_became_active":"2024-03-23T23:42:40.680643+0000","last_became_peered":"2024-03-23T23:42:40.680643+0000","last_unstale":"2024-03-23T23:42:40.683026+0000","last_undegraded":"2024-03-23T23:42:40.683026+0000","last_fullsized":"2024-03-23T23:42:40.683026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:42:38.708772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.686456+0000","last_change":"2024-03-23T23:42:40.681928+0000","last_active":"2024-03-23T23:42:40.686456+0000","last_peered":"2024-03-23T23:42:40.686456+0000","last_clean":"2024-03-23T23:42:40.686456+0000","last_became_active":"2024-03-23T23:42:40.681337+0000","last_became_peered":"2024-03-23T23:42:40.681337+0000","last_unstale":"2024-03-23T23:42:40.686456+0000","last_undegraded":"2024-03-23T23:42:40.686456+0000","last_fullsized":"2024-03-23T23:42:40.686456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:34.630671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027447+0000","last_change":"2024-03-23T23:42:40.697920+0000","last_active":"2024-03-23T23:42:42.027447+0000","last_peered":"2024-03-23T23:42:42.027447+0000","last_clean":"2024-03-23T23:42:42.027447+0000","last_became_active":"2024-03-23T23:42:40.697694+0000","last_became_peered":"2024-03-23T23:42:40.697694+0000","last_unstale":"2024-03-23T23:42:42.027447+0000","last_undegraded":"2024-03-23T23:42:42.027447+0000","last_fullsized":"2024-03-23T23:42:42.027447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.028222+0000","last_change":"2024-03-23T23:42:40.708540+0000","last_active":"2024-03-23T23:42:42.028222+0000","last_peered":"2024-03-23T23:42:42.028222+0000","last_clean":"2024-03-23T23:42:42.028222+0000","last_became_active":"2024-03-23T23:42:40.708031+0000","last_became_peered":"2024-03-23T23:42:40.708031+0000","last_unstale":"2024-03-23T23:42:42.028222+0000","last_undegraded":"2024-03-23T23:42:42.028222+0000","last_fullsized":"2024-03-23T23:42:42.028222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:44:03.386124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.691975+0000","last_change":"2024-03-23T23:42:40.690961+0000","last_active":"2024-03-23T23:42:40.691975+0000","last_peered":"2024-03-23T23:42:40.691975+0000","last_clean":"2024-03-23T23:42:40.691975+0000","last_became_active":"2024-03-23T23:42:40.690690+0000","last_became_peered":"2024-03-23T23:42:40.690690+0000","last_unstale":"2024-03-23T23:42:40.691975+0000","last_undegraded":"2024-03-23T23:42:40.691975+0000","last_fullsized":"2024-03-23T23:42:40.691975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:02.613636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.705051+0000","last_change":"2024-03-23T23:42:40.689769+0000","last_active":"2024-03-23T23:42:40.705051+0000","last_peered":"2024-03-23T23:42:40.705051+0000","last_clean":"2024-03-23T23:42:40.705051+0000","last_became_active":"2024-03-23T23:42:40.689111+0000","last_became_peered":"2024-03-23T23:42:40.689111+0000","last_unstale":"2024-03-23T23:42:40.705051+0000","last_undegraded":"2024-03-23T23:42:40.705051+0000","last_fullsized":"2024-03-23T23:42:40.705051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:43:47.212917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.671615+0000","last_change":"2024-03-23T23:42:40.683701+0000","last_active":"2024-03-23T23:42:41.671615+0000","last_peered":"2024-03-23T23:42:41.671615+0000","last_clean":"2024-03-23T23:42:41.671615+0000","last_became_active":"2024-03-23T23:42:40.683377+0000","last_became_peered":"2024-03-23T23:42:40.683377+0000","last_unstale":"2024-03-23T23:42:41.671615+0000","last_undegraded":"2024-03-23T23:42:41.671615+0000","last_fullsized":"2024-03-23T23:42:41.671615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.689896+0000","last_change":"2024-03-23T23:42:40.689122+0000","last_active":"2024-03-23T23:42:40.689896+0000","last_peered":"2024-03-23T23:42:40.689896+0000","last_clean":"2024-03-23T23:42:40.689896+0000","last_became_active":"2024-03-23T23:42:40.688875+0000","last_became_peered":"2024-03-23T23:42:40.688875+0000","last_unstale":"2024-03-23T23:42:40.689896+0000","last_undegraded":"2024-03-23T23:42:40.689896+0000","last_fullsized":"2024-03-23T23:42:40.689896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:57:21.400582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.028208+0000","last_change":"2024-03-23T23:42:40.707800+0000","last_active":"2024-03-23T23:42:42.028208+0000","last_peered":"2024-03-23T23:42:42.028208+0000","last_clean":"2024-03-23T23:42:42.028208+0000","last_became_active":"2024-03-23T23:42:40.707528+0000","last_became_peered":"2024-03-23T23:42:40.707528+0000","last_unstale":"2024-03-23T23:42:42.028208+0000","last_undegraded":"2024-03-23T23:42:42.028208+0000","last_fullsized":"2024-03-23T23:42:42.028208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:03:24.275154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027954+0000","last_change":"2024-03-23T23:42:40.684899+0000","last_active":"2024-03-23T23:42:42.027954+0000","last_peered":"2024-03-23T23:42:42.027954+0000","last_clean":"2024-03-23T23:42:42.027954+0000","last_became_active":"2024-03-23T23:42:40.684603+0000","last_became_peered":"2024-03-23T23:42:40.684603+0000","last_unstale":"2024-03-23T23:42:42.027954+0000","last_undegraded":"2024-03-23T23:42:42.027954+0000","last_fullsized":"2024-03-23T23:42:42.027954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:54.557634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027546+0000","last_change":"2024-03-23T23:42:40.701852+0000","last_active":"2024-03-23T23:42:42.027546+0000","last_peered":"2024-03-23T23:42:42.027546+0000","last_clean":"2024-03-23T23:42:42.027546+0000","last_became_active":"2024-03-23T23:42:40.701566+0000","last_became_peered":"2024-03-23T23:42:40.701566+0000","last_unstale":"2024-03-23T23:42:42.027546+0000","last_undegraded":"2024-03-23T23:42:42.027546+0000","last_fullsized":"2024-03-23T23:42:42.027546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.028822+0000","last_change":"2024-03-23T23:42:40.685177+0000","last_active":"2024-03-23T23:42:42.028822+0000","last_peered":"2024-03-23T23:42:42.028822+0000","last_clean":"2024-03-23T23:42:42.028822+0000","last_became_active":"2024-03-23T23:42:40.684495+0000","last_became_peered":"2024-03-23T23:42:40.684495+0000","last_unstale":"2024-03-23T23:42:42.028822+0000","last_undegraded":"2024-03-23T23:42:42.028822+0000","last_fullsized":"2024-03-23T23:42:42.028822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:27.675824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.671063+0000","last_change":"2024-03-23T23:42:40.694420+0000","last_active":"2024-03-23T23:42:41.671063+0000","last_peered":"2024-03-23T23:42:41.671063+0000","last_clean":"2024-03-23T23:42:41.671063+0000","last_became_active":"2024-03-23T23:42:40.693867+0000","last_became_peered":"2024-03-23T23:42:40.693867+0000","last_unstale":"2024-03-23T23:42:41.671063+0000","last_undegraded":"2024-03-23T23:42:41.671063+0000","last_fullsized":"2024-03-23T23:42:41.671063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:54.557634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.678494+0000","last_change":"2024-03-23T23:42:40.677168+0000","last_active":"2024-03-23T23:42:40.678494+0000","last_peered":"2024-03-23T23:42:40.678494+0000","last_clean":"2024-03-23T23:42:40.678494+0000","last_became_active":"2024-03-23T23:42:40.676912+0000","last_became_peered":"2024-03-23T23:42:40.676912+0000","last_unstale":"2024-03-23T23:42:40.678494+0000","last_undegraded":"2024-03-23T23:42:40.678494+0000","last_fullsized":"2024-03-23T23:42:40.678494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:45:44.558757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027957+0000","last_change":"2024-03-23T23:42:40.685370+0000","last_active":"2024-03-23T23:42:42.027957+0000","last_peered":"2024-03-23T23:42:42.027957+0000","last_clean":"2024-03-23T23:42:42.027957+0000","last_became_active":"2024-03-23T23:42:40.685120+0000","last_became_peered":"2024-03-23T23:42:40.685120+0000","last_unstale":"2024-03-23T23:42:42.027957+0000","last_undegraded":"2024-03-23T23:42:42.027957+0000","last_fullsized":"2024-03-23T23:42:42.027957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.675111+0000","last_change":"2024-03-23T23:42:40.673293+0000","last_active":"2024-03-23T23:42:40.675111+0000","last_peered":"2024-03-23T23:42:40.675111+0000","last_clean":"2024-03-23T23:42:40.675111+0000","last_became_active":"2024-03-23T23:42:40.672910+0000","last_became_peered":"2024-03-23T23:42:40.672910+0000","last_unstale":"2024-03-23T23:42:40.675111+0000","last_undegraded":"2024-03-23T23:42:40.675111+0000","last_fullsized":"2024-03-23T23:42:40.675111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:47:28.098925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.028339+0000","last_change":"2024-03-23T23:42:40.698519+0000","last_active":"2024-03-23T23:42:42.028339+0000","last_peered":"2024-03-23T23:42:42.028339+0000","last_clean":"2024-03-23T23:42:42.028339+0000","last_became_active":"2024-03-23T23:42:40.695218+0000","last_became_peered":"2024-03-23T23:42:40.695218+0000","last_unstale":"2024-03-23T23:42:42.028339+0000","last_undegraded":"2024-03-23T23:42:42.028339+0000","last_fullsized":"2024-03-23T23:42:42.028339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:00:54.983365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.704217+0000","last_change":"2024-03-23T23:42:40.702411+0000","last_active":"2024-03-23T23:42:40.704217+0000","last_peered":"2024-03-23T23:42:40.704217+0000","last_clean":"2024-03-23T23:42:40.704217+0000","last_became_active":"2024-03-23T23:42:40.701398+0000","last_became_peered":"2024-03-23T23:42:40.701398+0000","last_unstale":"2024-03-23T23:42:40.704217+0000","last_undegraded":"2024-03-23T23:42:40.704217+0000","last_fullsized":"2024-03-23T23:42:40.704217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:42:38.708772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.670372+0000","last_change":"2024-03-23T23:42:40.679042+0000","last_active":"2024-03-23T23:42:41.670372+0000","last_peered":"2024-03-23T23:42:41.670372+0000","last_clean":"2024-03-23T23:42:41.670372+0000","last_became_active":"2024-03-23T23:42:40.678518+0000","last_became_peered":"2024-03-23T23:42:40.678518+0000","last_unstale":"2024-03-23T23:42:41.670372+0000","last_undegraded":"2024-03-23T23:42:41.670372+0000","last_fullsized":"2024-03-23T23:42:41.670372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:12:14.359173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.671475+0000","last_change":"2024-03-23T23:42:40.680801+0000","last_active":"2024-03-23T23:42:41.671475+0000","last_peered":"2024-03-23T23:42:41.671475+0000","last_clean":"2024-03-23T23:42:41.671475+0000","last_became_active":"2024-03-23T23:42:40.680511+0000","last_became_peered":"2024-03-23T23:42:40.680511+0000","last_unstale":"2024-03-23T23:42:41.671475+0000","last_undegraded":"2024-03-23T23:42:41.671475+0000","last_fullsized":"2024-03-23T23:42:41.671475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:27:42.392714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027705+0000","last_change":"2024-03-23T23:42:39.688422+0000","last_active":"2024-03-23T23:42:42.027705+0000","last_peered":"2024-03-23T23:42:42.027705+0000","last_clean":"2024-03-23T23:42:42.027705+0000","last_became_active":"2024-03-23T23:42:39.687423+0000","last_became_peered":"2024-03-23T23:42:39.687423+0000","last_unstale":"2024-03-23T23:42:42.027705+0000","last_undegraded":"2024-03-23T23:42:42.027705+0000","last_fullsized":"2024-03-23T23:42:42.027705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:20:38.456655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.680387+0000","last_change":"2024-03-23T23:42:40.676571+0000","last_active":"2024-03-23T23:42:40.680387+0000","last_peered":"2024-03-23T23:42:40.680387+0000","last_clean":"2024-03-23T23:42:40.680387+0000","last_became_active":"2024-03-23T23:42:40.675877+0000","last_became_peered":"2024-03-23T23:42:40.675877+0000","last_unstale":"2024-03-23T23:42:40.680387+0000","last_undegraded":"2024-03-23T23:42:40.680387+0000","last_fullsized":"2024-03-23T23:42:40.680387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:02.613636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.670866+0000","last_change":"2024-03-23T23:42:39.681458+0000","last_active":"2024-03-23T23:42:41.670866+0000","last_peered":"2024-03-23T23:42:41.670866+0000","last_clean":"2024-03-23T23:42:41.670866+0000","last_became_active":"2024-03-23T23:42:39.681158+0000","last_became_peered":"2024-03-23T23:42:39.681158+0000","last_unstale":"2024-03-23T23:42:41.670866+0000","last_undegraded":"2024-03-23T23:42:41.670866+0000","last_fullsized":"2024-03-23T23:42:41.670866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:08:03.578884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027432+0000","last_change":"2024-03-23T23:42:39.688646+0000","last_active":"2024-03-23T23:42:42.027432+0000","last_peered":"2024-03-23T23:42:42.027432+0000","last_clean":"2024-03-23T23:42:42.027432+0000","last_became_active":"2024-03-23T23:42:39.687489+0000","last_became_peered":"2024-03-23T23:42:39.687489+0000","last_unstale":"2024-03-23T23:42:42.027432+0000","last_undegraded":"2024-03-23T23:42:42.027432+0000","last_fullsized":"2024-03-23T23:42:42.027432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:07:12.649156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.028590+0000","last_change":"2024-03-23T23:42:40.674605+0000","last_active":"2024-03-23T23:42:42.028590+0000","last_peered":"2024-03-23T23:42:42.028590+0000","last_clean":"2024-03-23T23:42:42.028590+0000","last_became_active":"2024-03-23T23:42:40.674366+0000","last_became_peered":"2024-03-23T23:42:40.674366+0000","last_unstale":"2024-03-23T23:42:42.028590+0000","last_undegraded":"2024-03-23T23:42:42.028590+0000","last_fullsized":"2024-03-23T23:42:42.028590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027554+0000","last_change":"2024-03-23T23:42:39.682839+0000","last_active":"2024-03-23T23:42:42.027554+0000","last_peered":"2024-03-23T23:42:42.027554+0000","last_clean":"2024-03-23T23:42:42.027554+0000","last_became_active":"2024-03-23T23:42:39.682584+0000","last_became_peered":"2024-03-23T23:42:39.682584+0000","last_unstale":"2024-03-23T23:42:42.027554+0000","last_undegraded":"2024-03-23T23:42:42.027554+0000","last_fullsized":"2024-03-23T23:42:42.027554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:19.914926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.686435+0000","last_change":"2024-03-23T23:42:40.679384+0000","last_active":"2024-03-23T23:42:40.686435+0000","last_peered":"2024-03-23T23:42:40.686435+0000","last_clean":"2024-03-23T23:42:40.686435+0000","last_became_active":"2024-03-23T23:42:40.679070+0000","last_became_peered":"2024-03-23T23:42:40.679070+0000","last_unstale":"2024-03-23T23:42:40.686435+0000","last_undegraded":"2024-03-23T23:42:40.686435+0000","last_fullsized":"2024-03-23T23:42:40.686435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:53:46.437114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.670696+0000","last_change":"2024-03-23T23:42:39.684669+0000","last_active":"2024-03-23T23:42:41.670696+0000","last_peered":"2024-03-23T23:42:41.670696+0000","last_clean":"2024-03-23T23:42:41.670696+0000","last_became_active":"2024-03-23T23:42:39.684360+0000","last_became_peered":"2024-03-23T23:42:39.684360+0000","last_unstale":"2024-03-23T23:42:41.670696+0000","last_undegraded":"2024-03-23T23:42:41.670696+0000","last_fullsized":"2024-03-23T23:42:41.670696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:19.914926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027862+0000","last_change":"2024-03-23T23:42:40.708795+0000","last_active":"2024-03-23T23:42:42.027862+0000","last_peered":"2024-03-23T23:42:42.027862+0000","last_clean":"2024-03-23T23:42:42.027862+0000","last_became_active":"2024-03-23T23:42:40.708199+0000","last_became_peered":"2024-03-23T23:42:40.708199+0000","last_unstale":"2024-03-23T23:42:42.027862+0000","last_undegraded":"2024-03-23T23:42:42.027862+0000","last_fullsized":"2024-03-23T23:42:42.027862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:53.782430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027953+0000","last_change":"2024-03-23T23:42:39.691092+0000","last_active":"2024-03-23T23:42:42.027953+0000","last_peered":"2024-03-23T23:42:42.027953+0000","last_clean":"2024-03-23T23:42:42.027953+0000","last_became_active":"2024-03-23T23:42:39.687473+0000","last_became_peered":"2024-03-23T23:42:39.687473+0000","last_unstale":"2024-03-23T23:42:42.027953+0000","last_undegraded":"2024-03-23T23:42:42.027953+0000","last_fullsized":"2024-03-23T23:42:42.027953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:08:03.578884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.703216+0000","last_change":"2024-03-23T23:42:40.700381+0000","last_active":"2024-03-23T23:42:40.703216+0000","last_peered":"2024-03-23T23:42:40.703216+0000","last_clean":"2024-03-23T23:42:40.703216+0000","last_became_active":"2024-03-23T23:42:40.698428+0000","last_became_peered":"2024-03-23T23:42:40.698428+0000","last_unstale":"2024-03-23T23:42:40.703216+0000","last_undegraded":"2024-03-23T23:42:40.703216+0000","last_fullsized":"2024-03-23T23:42:40.703216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:45:44.558757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.713003+0000","last_change":"2024-03-23T23:42:39.681675+0000","last_active":"2024-03-23T23:42:40.713003+0000","last_peered":"2024-03-23T23:42:40.713003+0000","last_clean":"2024-03-23T23:42:40.713003+0000","last_became_active":"2024-03-23T23:42:39.681364+0000","last_became_peered":"2024-03-23T23:42:39.681364+0000","last_unstale":"2024-03-23T23:42:40.713003+0000","last_undegraded":"2024-03-23T23:42:40.713003+0000","last_fullsized":"2024-03-23T23:42:40.713003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:42:37.702720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.670880+0000","last_change":"2024-03-23T23:42:40.683025+0000","last_active":"2024-03-23T23:42:41.670880+0000","last_peered":"2024-03-23T23:42:41.670880+0000","last_clean":"2024-03-23T23:42:41.670880+0000","last_became_active":"2024-03-23T23:42:40.682798+0000","last_became_peered":"2024-03-23T23:42:40.682798+0000","last_unstale":"2024-03-23T23:42:41.670880+0000","last_undegraded":"2024-03-23T23:42:41.670880+0000","last_fullsized":"2024-03-23T23:42:41.670880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:51.565112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.671470+0000","last_change":"2024-03-23T23:42:39.689429+0000","last_active":"2024-03-23T23:42:41.671470+0000","last_peered":"2024-03-23T23:42:41.671470+0000","last_clean":"2024-03-23T23:42:41.671470+0000","last_became_active":"2024-03-23T23:42:39.688066+0000","last_became_peered":"2024-03-23T23:42:39.688066+0000","last_unstale":"2024-03-23T23:42:41.671470+0000","last_undegraded":"2024-03-23T23:42:41.671470+0000","last_fullsized":"2024-03-23T23:42:41.671470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:32.254099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.705079+0000","last_change":"2024-03-23T23:42:40.689988+0000","last_active":"2024-03-23T23:42:40.705079+0000","last_peered":"2024-03-23T23:42:40.705079+0000","last_clean":"2024-03-23T23:42:40.705079+0000","last_became_active":"2024-03-23T23:42:40.689477+0000","last_became_peered":"2024-03-23T23:42:40.689477+0000","last_unstale":"2024-03-23T23:42:40.705079+0000","last_undegraded":"2024-03-23T23:42:40.705079+0000","last_fullsized":"2024-03-23T23:42:40.705079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:45:44.558757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.703411+0000","last_change":"2024-03-23T23:42:39.681926+0000","last_active":"2024-03-23T23:42:40.703411+0000","last_peered":"2024-03-23T23:42:40.703411+0000","last_clean":"2024-03-23T23:42:40.703411+0000","last_became_active":"2024-03-23T23:42:39.681028+0000","last_became_peered":"2024-03-23T23:42:39.681028+0000","last_unstale":"2024-03-23T23:42:40.703411+0000","last_undegraded":"2024-03-23T23:42:40.703411+0000","last_fullsized":"2024-03-23T23:42:40.703411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:24:11.933075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.689872+0000","last_change":"2024-03-23T23:42:40.688909+0000","last_active":"2024-03-23T23:42:40.689872+0000","last_peered":"2024-03-23T23:42:40.689872+0000","last_clean":"2024-03-23T23:42:40.689872+0000","last_became_active":"2024-03-23T23:42:40.688636+0000","last_became_peered":"2024-03-23T23:42:40.688636+0000","last_unstale":"2024-03-23T23:42:40.689872+0000","last_undegraded":"2024-03-23T23:42:40.689872+0000","last_fullsized":"2024-03-23T23:42:40.689872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:03.196963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.028420+0000","last_change":"2024-03-23T23:42:39.688483+0000","last_active":"2024-03-23T23:42:42.028420+0000","last_peered":"2024-03-23T23:42:42.028420+0000","last_clean":"2024-03-23T23:42:42.028420+0000","last_became_active":"2024-03-23T23:42:39.688141+0000","last_became_peered":"2024-03-23T23:42:39.688141+0000","last_unstale":"2024-03-23T23:42:42.028420+0000","last_undegraded":"2024-03-23T23:42:42.028420+0000","last_fullsized":"2024-03-23T23:42:42.028420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:32.254099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.710870+0000","last_change":"2024-03-23T23:42:40.704046+0000","last_active":"2024-03-23T23:42:40.710870+0000","last_peered":"2024-03-23T23:42:40.710870+0000","last_clean":"2024-03-23T23:42:40.710870+0000","last_became_active":"2024-03-23T23:42:40.703787+0000","last_became_peered":"2024-03-23T23:42:40.703787+0000","last_unstale":"2024-03-23T23:42:40.710870+0000","last_undegraded":"2024-03-23T23:42:40.710870+0000","last_fullsized":"2024-03-23T23:42:40.710870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:07:29.242921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.670377+0000","last_change":"2024-03-23T23:42:39.681827+0000","last_active":"2024-03-23T23:42:41.670377+0000","last_peered":"2024-03-23T23:42:41.670377+0000","last_clean":"2024-03-23T23:42:41.670377+0000","last_became_active":"2024-03-23T23:42:39.681418+0000","last_became_peered":"2024-03-23T23:42:39.681418+0000","last_unstale":"2024-03-23T23:42:41.670377+0000","last_undegraded":"2024-03-23T23:42:41.670377+0000","last_fullsized":"2024-03-23T23:42:41.670377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:50.559059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.670541+0000","last_change":"2024-03-23T23:42:40.677314+0000","last_active":"2024-03-23T23:42:41.670541+0000","last_peered":"2024-03-23T23:42:41.670541+0000","last_clean":"2024-03-23T23:42:41.670541+0000","last_became_active":"2024-03-23T23:42:40.675416+0000","last_became_peered":"2024-03-23T23:42:40.675416+0000","last_unstale":"2024-03-23T23:42:41.670541+0000","last_undegraded":"2024-03-23T23:42:41.670541+0000","last_fullsized":"2024-03-23T23:42:41.670541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:01:06.338641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.705608+0000","last_change":"2024-03-23T23:42:39.676075+0000","last_active":"2024-03-23T23:42:40.705608+0000","last_peered":"2024-03-23T23:42:40.705608+0000","last_clean":"2024-03-23T23:42:40.705608+0000","last_became_active":"2024-03-23T23:42:39.675770+0000","last_became_peered":"2024-03-23T23:42:39.675770+0000","last_unstale":"2024-03-23T23:42:40.705608+0000","last_undegraded":"2024-03-23T23:42:40.705608+0000","last_fullsized":"2024-03-23T23:42:40.705608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:24:11.933075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.707662+0000","last_change":"2024-03-23T23:42:40.700961+0000","last_active":"2024-03-23T23:42:40.707662+0000","last_peered":"2024-03-23T23:42:40.707662+0000","last_clean":"2024-03-23T23:42:40.707662+0000","last_became_active":"2024-03-23T23:42:40.700800+0000","last_became_peered":"2024-03-23T23:42:40.700800+0000","last_unstale":"2024-03-23T23:42:40.707662+0000","last_undegraded":"2024-03-23T23:42:40.707662+0000","last_fullsized":"2024-03-23T23:42:40.707662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:34.630671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.670743+0000","last_change":"2024-03-23T23:42:39.686863+0000","last_active":"2024-03-23T23:42:41.670743+0000","last_peered":"2024-03-23T23:42:41.670743+0000","last_clean":"2024-03-23T23:42:41.670743+0000","last_became_active":"2024-03-23T23:42:39.686491+0000","last_became_peered":"2024-03-23T23:42:39.686491+0000","last_unstale":"2024-03-23T23:42:41.670743+0000","last_undegraded":"2024-03-23T23:42:41.670743+0000","last_fullsized":"2024-03-23T23:42:41.670743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:38:13.752628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.705190+0000","last_change":"2024-03-23T23:42:40.696584+0000","last_active":"2024-03-23T23:42:40.705190+0000","last_peered":"2024-03-23T23:42:40.705190+0000","last_clean":"2024-03-23T23:42:40.705190+0000","last_became_active":"2024-03-23T23:42:40.696141+0000","last_became_peered":"2024-03-23T23:42:40.696141+0000","last_unstale":"2024-03-23T23:42:40.705190+0000","last_undegraded":"2024-03-23T23:42:40.705190+0000","last_fullsized":"2024-03-23T23:42:40.705190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:31:34.412092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.701817+0000","last_change":"2024-03-23T23:42:39.681906+0000","last_active":"2024-03-23T23:42:40.701817+0000","last_peered":"2024-03-23T23:42:40.701817+0000","last_clean":"2024-03-23T23:42:40.701817+0000","last_became_active":"2024-03-23T23:42:39.680506+0000","last_became_peered":"2024-03-23T23:42:39.680506+0000","last_unstale":"2024-03-23T23:42:40.701817+0000","last_undegraded":"2024-03-23T23:42:40.701817+0000","last_fullsized":"2024-03-23T23:42:40.701817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:44:07.213123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.712259+0000","last_change":"2024-03-23T23:42:40.706713+0000","last_active":"2024-03-23T23:42:40.712259+0000","last_peered":"2024-03-23T23:42:40.712259+0000","last_clean":"2024-03-23T23:42:40.712259+0000","last_became_active":"2024-03-23T23:42:40.704328+0000","last_became_peered":"2024-03-23T23:42:40.704328+0000","last_unstale":"2024-03-23T23:42:40.712259+0000","last_undegraded":"2024-03-23T23:42:40.712259+0000","last_fullsized":"2024-03-23T23:42:40.712259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:27:03.132032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.710811+0000","last_change":"2024-03-23T23:42:39.681013+0000","last_active":"2024-03-23T23:42:40.710811+0000","last_peered":"2024-03-23T23:42:40.710811+0000","last_clean":"2024-03-23T23:42:40.710811+0000","last_became_active":"2024-03-23T23:42:39.680669+0000","last_became_peered":"2024-03-23T23:42:39.680669+0000","last_unstale":"2024-03-23T23:42:40.710811+0000","last_undegraded":"2024-03-23T23:42:40.710811+0000","last_fullsized":"2024-03-23T23:42:40.710811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:58:07.880313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.028112+0000","last_change":"2024-03-23T23:42:40.700124+0000","last_active":"2024-03-23T23:42:42.028112+0000","last_peered":"2024-03-23T23:42:42.028112+0000","last_clean":"2024-03-23T23:42:42.028112+0000","last_became_active":"2024-03-23T23:42:40.697369+0000","last_became_peered":"2024-03-23T23:42:40.697369+0000","last_unstale":"2024-03-23T23:42:42.028112+0000","last_undegraded":"2024-03-23T23:42:42.028112+0000","last_fullsized":"2024-03-23T23:42:42.028112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:20.981139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.679966+0000","last_change":"2024-03-23T23:42:39.684163+0000","last_active":"2024-03-23T23:42:40.679966+0000","last_peered":"2024-03-23T23:42:40.679966+0000","last_clean":"2024-03-23T23:42:40.679966+0000","last_became_active":"2024-03-23T23:42:39.683211+0000","last_became_peered":"2024-03-23T23:42:39.683211+0000","last_unstale":"2024-03-23T23:42:40.679966+0000","last_undegraded":"2024-03-23T23:42:40.679966+0000","last_fullsized":"2024-03-23T23:42:40.679966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:47:27.092873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.712923+0000","last_change":"2024-03-23T23:42:40.711591+0000","last_active":"2024-03-23T23:42:40.712923+0000","last_peered":"2024-03-23T23:42:40.712923+0000","last_clean":"2024-03-23T23:42:40.712923+0000","last_became_active":"2024-03-23T23:42:40.711306+0000","last_became_peered":"2024-03-23T23:42:40.711306+0000","last_unstale":"2024-03-23T23:42:40.712923+0000","last_undegraded":"2024-03-23T23:42:40.712923+0000","last_fullsized":"2024-03-23T23:42:40.712923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:26:16.171920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.679064+0000","last_change":"2024-03-23T23:42:27.940270+0000","last_active":"2024-03-23T23:42:40.679064+0000","last_peered":"2024-03-23T23:42:40.679064+0000","last_clean":"2024-03-23T23:42:40.679064+0000","last_became_active":"2024-03-23T23:42:27.939061+0000","last_became_peered":"2024-03-23T23:42:27.939061+0000","last_unstale":"2024-03-23T23:42:40.679064+0000","last_undegraded":"2024-03-23T23:42:40.679064+0000","last_fullsized":"2024-03-23T23:42:40.679064+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:26.509742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:26.509742+0000","last_clean_scrub_stamp":"2024-03-23T23:42:26.509742+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:49.258623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027475+0000","last_change":"2024-03-23T23:42:39.687712+0000","last_active":"2024-03-23T23:42:42.027475+0000","last_peered":"2024-03-23T23:42:42.027475+0000","last_clean":"2024-03-23T23:42:42.027475+0000","last_became_active":"2024-03-23T23:42:39.687378+0000","last_became_peered":"2024-03-23T23:42:39.687378+0000","last_unstale":"2024-03-23T23:42:42.027475+0000","last_undegraded":"2024-03-23T23:42:42.027475+0000","last_fullsized":"2024-03-23T23:42:42.027475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:20:38.456655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027483+0000","last_change":"2024-03-23T23:42:40.700998+0000","last_active":"2024-03-23T23:42:42.027483+0000","last_peered":"2024-03-23T23:42:42.027483+0000","last_clean":"2024-03-23T23:42:42.027483+0000","last_became_active":"2024-03-23T23:42:40.700788+0000","last_became_peered":"2024-03-23T23:42:40.700788+0000","last_unstale":"2024-03-23T23:42:42.027483+0000","last_undegraded":"2024-03-23T23:42:42.027483+0000","last_fullsized":"2024-03-23T23:42:42.027483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:14:44.739525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.679050+0000","last_change":"2024-03-23T23:42:39.690057+0000","last_active":"2024-03-23T23:42:40.679050+0000","last_peered":"2024-03-23T23:42:40.679050+0000","last_clean":"2024-03-23T23:42:40.679050+0000","last_became_active":"2024-03-23T23:42:39.689763+0000","last_became_peered":"2024-03-23T23:42:39.689763+0000","last_unstale":"2024-03-23T23:42:40.679050+0000","last_undegraded":"2024-03-23T23:42:40.679050+0000","last_fullsized":"2024-03-23T23:42:40.679050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:01.607584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.680529+0000","last_change":"2024-03-23T23:42:40.675570+0000","last_active":"2024-03-23T23:42:40.680529+0000","last_peered":"2024-03-23T23:42:40.680529+0000","last_clean":"2024-03-23T23:42:40.680529+0000","last_became_active":"2024-03-23T23:42:40.674390+0000","last_became_peered":"2024-03-23T23:42:40.674390+0000","last_unstale":"2024-03-23T23:42:40.680529+0000","last_undegraded":"2024-03-23T23:42:40.680529+0000","last_fullsized":"2024-03-23T23:42:40.680529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:58.293972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.680640+0000","last_change":"2024-03-23T23:42:39.680763+0000","last_active":"2024-03-23T23:42:40.680640+0000","last_peered":"2024-03-23T23:42:40.680640+0000","last_clean":"2024-03-23T23:42:40.680640+0000","last_became_active":"2024-03-23T23:42:39.680494+0000","last_became_peered":"2024-03-23T23:42:39.680494+0000","last_unstale":"2024-03-23T23:42:40.680640+0000","last_undegraded":"2024-03-23T23:42:40.680640+0000","last_fullsized":"2024-03-23T23:42:40.680640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:57.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.685752+0000","last_change":"2024-03-23T23:42:40.682840+0000","last_active":"2024-03-23T23:42:40.685752+0000","last_peered":"2024-03-23T23:42:40.685752+0000","last_clean":"2024-03-23T23:42:40.685752+0000","last_became_active":"2024-03-23T23:42:40.682391+0000","last_became_peered":"2024-03-23T23:42:40.682391+0000","last_unstale":"2024-03-23T23:42:40.685752+0000","last_undegraded":"2024-03-23T23:42:40.685752+0000","last_fullsized":"2024-03-23T23:42:40.685752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:51:30.695597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.028496+0000","last_change":"2024-03-23T23:42:39.679741+0000","last_active":"2024-03-23T23:42:42.028496+0000","last_peered":"2024-03-23T23:42:42.028496+0000","last_clean":"2024-03-23T23:42:42.028496+0000","last_became_active":"2024-03-23T23:42:39.678864+0000","last_became_peered":"2024-03-23T23:42:39.678864+0000","last_unstale":"2024-03-23T23:42:42.028496+0000","last_undegraded":"2024-03-23T23:42:42.028496+0000","last_fullsized":"2024-03-23T23:42:42.028496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:50.559059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.671555+0000","last_change":"2024-03-23T23:42:40.679988+0000","last_active":"2024-03-23T23:42:41.671555+0000","last_peered":"2024-03-23T23:42:41.671555+0000","last_clean":"2024-03-23T23:42:41.671555+0000","last_became_active":"2024-03-23T23:42:40.679488+0000","last_became_peered":"2024-03-23T23:42:40.679488+0000","last_unstale":"2024-03-23T23:42:41.671555+0000","last_undegraded":"2024-03-23T23:42:41.671555+0000","last_fullsized":"2024-03-23T23:42:41.671555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:10:32.251287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.673707+0000","last_change":"2024-03-23T23:42:39.686509+0000","last_active":"2024-03-23T23:42:40.673707+0000","last_peered":"2024-03-23T23:42:40.673707+0000","last_clean":"2024-03-23T23:42:40.673707+0000","last_became_active":"2024-03-23T23:42:39.686094+0000","last_became_peered":"2024-03-23T23:42:39.686094+0000","last_unstale":"2024-03-23T23:42:40.673707+0000","last_undegraded":"2024-03-23T23:42:40.673707+0000","last_fullsized":"2024-03-23T23:42:40.673707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:57:20.394530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027956+0000","last_change":"2024-03-23T23:42:40.700610+0000","last_active":"2024-03-23T23:42:42.027956+0000","last_peered":"2024-03-23T23:42:42.027956+0000","last_clean":"2024-03-23T23:42:42.027956+0000","last_became_active":"2024-03-23T23:42:40.700112+0000","last_became_peered":"2024-03-23T23:42:40.700112+0000","last_unstale":"2024-03-23T23:42:42.027956+0000","last_undegraded":"2024-03-23T23:42:42.027956+0000","last_fullsized":"2024-03-23T23:42:42.027956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:07:49.169416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.681543+0000","last_change":"2024-03-23T23:42:39.695099+0000","last_active":"2024-03-23T23:42:40.681543+0000","last_peered":"2024-03-23T23:42:40.681543+0000","last_clean":"2024-03-23T23:42:40.681543+0000","last_became_active":"2024-03-23T23:42:39.694720+0000","last_became_peered":"2024-03-23T23:42:39.694720+0000","last_unstale":"2024-03-23T23:42:40.681543+0000","last_undegraded":"2024-03-23T23:42:40.681543+0000","last_fullsized":"2024-03-23T23:42:40.681543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:58:07.880313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.688244+0000","last_change":"2024-03-23T23:42:40.686486+0000","last_active":"2024-03-23T23:42:40.688244+0000","last_peered":"2024-03-23T23:42:40.688244+0000","last_clean":"2024-03-23T23:42:40.688244+0000","last_became_active":"2024-03-23T23:42:40.686186+0000","last_became_peered":"2024-03-23T23:42:40.686186+0000","last_unstale":"2024-03-23T23:42:40.688244+0000","last_undegraded":"2024-03-23T23:42:40.688244+0000","last_fullsized":"2024-03-23T23:42:40.688244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:07:29.242921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.677155+0000","last_change":"2024-03-23T23:42:39.678962+0000","last_active":"2024-03-23T23:42:40.677155+0000","last_peered":"2024-03-23T23:42:40.677155+0000","last_clean":"2024-03-23T23:42:40.677155+0000","last_became_active":"2024-03-23T23:42:39.678603+0000","last_became_peered":"2024-03-23T23:42:39.678603+0000","last_unstale":"2024-03-23T23:42:40.677155+0000","last_undegraded":"2024-03-23T23:42:40.677155+0000","last_fullsized":"2024-03-23T23:42:40.677155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:43:46.206865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.028942+0000","last_change":"2024-03-23T23:42:40.686865+0000","last_active":"2024-03-23T23:42:42.028942+0000","last_peered":"2024-03-23T23:42:42.028942+0000","last_clean":"2024-03-23T23:42:42.028942+0000","last_became_active":"2024-03-23T23:42:40.686582+0000","last_became_peered":"2024-03-23T23:42:40.686582+0000","last_unstale":"2024-03-23T23:42:42.028942+0000","last_undegraded":"2024-03-23T23:42:42.028942+0000","last_fullsized":"2024-03-23T23:42:42.028942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:05:17.694245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.671492+0000","last_change":"2024-03-23T23:42:39.691813+0000","last_active":"2024-03-23T23:42:41.671492+0000","last_peered":"2024-03-23T23:42:41.671492+0000","last_clean":"2024-03-23T23:42:41.671492+0000","last_became_active":"2024-03-23T23:42:39.691519+0000","last_became_peered":"2024-03-23T23:42:39.691519+0000","last_unstale":"2024-03-23T23:42:41.671492+0000","last_undegraded":"2024-03-23T23:42:41.671492+0000","last_fullsized":"2024-03-23T23:42:41.671492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:27:41.386662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.684136+0000","last_change":"2024-03-23T23:42:40.680963+0000","last_active":"2024-03-23T23:42:40.684136+0000","last_peered":"2024-03-23T23:42:40.684136+0000","last_clean":"2024-03-23T23:42:40.684136+0000","last_became_active":"2024-03-23T23:42:40.680744+0000","last_became_peered":"2024-03-23T23:42:40.680744+0000","last_unstale":"2024-03-23T23:42:40.684136+0000","last_undegraded":"2024-03-23T23:42:40.684136+0000","last_fullsized":"2024-03-23T23:42:40.684136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:58:08.886365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.678997+0000","last_change":"2024-03-23T23:42:39.695253+0000","last_active":"2024-03-23T23:42:40.678997+0000","last_peered":"2024-03-23T23:42:40.678997+0000","last_clean":"2024-03-23T23:42:40.678997+0000","last_became_active":"2024-03-23T23:42:39.694746+0000","last_became_peered":"2024-03-23T23:42:39.694746+0000","last_unstale":"2024-03-23T23:42:40.678997+0000","last_undegraded":"2024-03-23T23:42:40.678997+0000","last_fullsized":"2024-03-23T23:42:40.678997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:57.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.671241+0000","last_change":"2024-03-23T23:42:40.685051+0000","last_active":"2024-03-23T23:42:41.671241+0000","last_peered":"2024-03-23T23:42:41.671241+0000","last_clean":"2024-03-23T23:42:41.671241+0000","last_became_active":"2024-03-23T23:42:40.684677+0000","last_became_peered":"2024-03-23T23:42:40.684677+0000","last_unstale":"2024-03-23T23:42:41.671241+0000","last_undegraded":"2024-03-23T23:42:41.671241+0000","last_fullsized":"2024-03-23T23:42:41.671241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:20.920978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.669786+0000","last_change":"2024-03-23T23:42:39.691470+0000","last_active":"2024-03-23T23:42:40.669786+0000","last_peered":"2024-03-23T23:42:40.669786+0000","last_clean":"2024-03-23T23:42:40.669786+0000","last_became_active":"2024-03-23T23:42:39.691124+0000","last_became_peered":"2024-03-23T23:42:39.691124+0000","last_unstale":"2024-03-23T23:42:40.669786+0000","last_undegraded":"2024-03-23T23:42:40.669786+0000","last_fullsized":"2024-03-23T23:42:40.669786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:55.757707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027746+0000","last_change":"2024-03-23T23:42:40.682999+0000","last_active":"2024-03-23T23:42:42.027746+0000","last_peered":"2024-03-23T23:42:42.027746+0000","last_clean":"2024-03-23T23:42:42.027746+0000","last_became_active":"2024-03-23T23:42:40.682672+0000","last_became_peered":"2024-03-23T23:42:40.682672+0000","last_unstale":"2024-03-23T23:42:42.027746+0000","last_undegraded":"2024-03-23T23:42:42.027746+0000","last_fullsized":"2024-03-23T23:42:42.027746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:59:45.154553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.672422+0000","last_change":"2024-03-23T23:42:39.683165+0000","last_active":"2024-03-23T23:42:40.672422+0000","last_peered":"2024-03-23T23:42:40.672422+0000","last_clean":"2024-03-23T23:42:40.672422+0000","last_became_active":"2024-03-23T23:42:39.680121+0000","last_became_peered":"2024-03-23T23:42:39.680121+0000","last_unstale":"2024-03-23T23:42:40.672422+0000","last_undegraded":"2024-03-23T23:42:40.672422+0000","last_fullsized":"2024-03-23T23:42:40.672422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:02.190910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027694+0000","last_change":"2024-03-23T23:42:40.674574+0000","last_active":"2024-03-23T23:42:42.027694+0000","last_peered":"2024-03-23T23:42:42.027694+0000","last_clean":"2024-03-23T23:42:42.027694+0000","last_became_active":"2024-03-23T23:42:40.674293+0000","last_became_peered":"2024-03-23T23:42:40.674293+0000","last_unstale":"2024-03-23T23:42:42.027694+0000","last_undegraded":"2024-03-23T23:42:42.027694+0000","last_fullsized":"2024-03-23T23:42:42.027694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:37:24.839568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.712874+0000","last_change":"2024-03-23T23:42:39.696528+0000","last_active":"2024-03-23T23:42:40.712874+0000","last_peered":"2024-03-23T23:42:40.712874+0000","last_clean":"2024-03-23T23:42:40.712874+0000","last_became_active":"2024-03-23T23:42:39.696207+0000","last_became_peered":"2024-03-23T23:42:39.696207+0000","last_unstale":"2024-03-23T23:42:40.712874+0000","last_undegraded":"2024-03-23T23:42:40.712874+0000","last_fullsized":"2024-03-23T23:42:40.712874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:02.190910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.670776+0000","last_change":"2024-03-23T23:42:40.682467+0000","last_active":"2024-03-23T23:42:41.670776+0000","last_peered":"2024-03-23T23:42:41.670776+0000","last_clean":"2024-03-23T23:42:41.670776+0000","last_became_active":"2024-03-23T23:42:40.682192+0000","last_became_peered":"2024-03-23T23:42:40.682192+0000","last_unstale":"2024-03-23T23:42:41.670776+0000","last_undegraded":"2024-03-23T23:42:41.670776+0000","last_fullsized":"2024-03-23T23:42:41.670776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:37:24.839568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027814+0000","last_change":"2024-03-23T23:42:40.700389+0000","last_active":"2024-03-23T23:42:42.027814+0000","last_peered":"2024-03-23T23:42:42.027814+0000","last_clean":"2024-03-23T23:42:42.027814+0000","last_became_active":"2024-03-23T23:42:40.699770+0000","last_became_peered":"2024-03-23T23:42:40.699770+0000","last_unstale":"2024-03-23T23:42:42.027814+0000","last_undegraded":"2024-03-23T23:42:42.027814+0000","last_fullsized":"2024-03-23T23:42:42.027814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:27.675824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.714743+0000","last_change":"2024-03-23T23:42:39.696707+0000","last_active":"2024-03-23T23:42:40.714743+0000","last_peered":"2024-03-23T23:42:40.714743+0000","last_clean":"2024-03-23T23:42:40.714743+0000","last_became_active":"2024-03-23T23:42:39.696401+0000","last_became_peered":"2024-03-23T23:42:39.696401+0000","last_unstale":"2024-03-23T23:42:40.714743+0000","last_undegraded":"2024-03-23T23:42:40.714743+0000","last_fullsized":"2024-03-23T23:42:40.714743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:55.757707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027976+0000","last_change":"2024-03-23T23:42:40.700355+0000","last_active":"2024-03-23T23:42:42.027976+0000","last_peered":"2024-03-23T23:42:42.027976+0000","last_clean":"2024-03-23T23:42:42.027976+0000","last_became_active":"2024-03-23T23:42:40.697668+0000","last_became_peered":"2024-03-23T23:42:40.697668+0000","last_unstale":"2024-03-23T23:42:42.027976+0000","last_undegraded":"2024-03-23T23:42:42.027976+0000","last_fullsized":"2024-03-23T23:42:42.027976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:23:43.515519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.712024+0000","last_change":"2024-03-23T23:42:39.696690+0000","last_active":"2024-03-23T23:42:40.712024+0000","last_peered":"2024-03-23T23:42:40.712024+0000","last_clean":"2024-03-23T23:42:40.712024+0000","last_became_active":"2024-03-23T23:42:39.696342+0000","last_became_peered":"2024-03-23T23:42:39.696342+0000","last_unstale":"2024-03-23T23:42:40.712024+0000","last_undegraded":"2024-03-23T23:42:40.712024+0000","last_fullsized":"2024-03-23T23:42:40.712024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:42:37.702720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.702002+0000","last_change":"2024-03-23T23:42:40.698746+0000","last_active":"2024-03-23T23:42:40.702002+0000","last_peered":"2024-03-23T23:42:40.702002+0000","last_clean":"2024-03-23T23:42:40.702002+0000","last_became_active":"2024-03-23T23:42:40.698003+0000","last_became_peered":"2024-03-23T23:42:40.698003+0000","last_unstale":"2024-03-23T23:42:40.702002+0000","last_undegraded":"2024-03-23T23:42:40.702002+0000","last_fullsized":"2024-03-23T23:42:40.702002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:43:47.212917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.028810+0000","last_change":"2024-03-23T23:42:39.687108+0000","last_active":"2024-03-23T23:42:42.028810+0000","last_peered":"2024-03-23T23:42:42.028810+0000","last_clean":"2024-03-23T23:42:42.028810+0000","last_became_active":"2024-03-23T23:42:39.686875+0000","last_became_peered":"2024-03-23T23:42:39.686875+0000","last_unstale":"2024-03-23T23:42:42.028810+0000","last_undegraded":"2024-03-23T23:42:42.028810+0000","last_fullsized":"2024-03-23T23:42:42.028810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:05:52.079172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.028817+0000","last_change":"2024-03-23T23:42:40.685708+0000","last_active":"2024-03-23T23:42:42.028817+0000","last_peered":"2024-03-23T23:42:42.028817+0000","last_clean":"2024-03-23T23:42:42.028817+0000","last_became_active":"2024-03-23T23:42:40.682755+0000","last_became_peered":"2024-03-23T23:42:40.682755+0000","last_unstale":"2024-03-23T23:42:42.028817+0000","last_undegraded":"2024-03-23T23:42:42.028817+0000","last_fullsized":"2024-03-23T23:42:42.028817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:04.633288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.711880+0000","last_change":"2024-03-23T23:42:39.693858+0000","last_active":"2024-03-23T23:42:40.711880+0000","last_peered":"2024-03-23T23:42:40.711880+0000","last_clean":"2024-03-23T23:42:40.711880+0000","last_became_active":"2024-03-23T23:42:39.693636+0000","last_became_peered":"2024-03-23T23:42:39.693636+0000","last_unstale":"2024-03-23T23:42:40.711880+0000","last_undegraded":"2024-03-23T23:42:40.711880+0000","last_fullsized":"2024-03-23T23:42:40.711880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:44:07.213123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":74427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":66630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":72941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":221184,"data_stored":74427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":794624,"data_stored":657490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":196608,"data_stored":66540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":184320,"data_stored":59795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":802816,"data_stored":657546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T23:42:45.808 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T23:42:45.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.981+0000 7f6ae2800640 1 Processor -- start 2024-03-23T23:42:45.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.981+0000 7f6ae2800640 1 -- start start 2024-03-23T23:42:45.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.985+0000 7f6ae2800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6adc1530f0 0x7f6adc0720a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:45.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.985+0000 7f6ae2800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6adc0725e0 0x7f6adc1560a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:45.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.985+0000 7f6ae2800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6adc0aa1f0 con 0x7f6adc072d80 2024-03-23T23:42:45.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.985+0000 7f6ae2800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6adc073260 con 0x7f6adc0725e0 2024-03-23T23:42:45.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.985+0000 7f6ae2800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc0734b0 con 0x7f6adc1530f0 2024-03-23T23:42:45.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.985+0000 7f6adbe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6adc0725e0 0x7f6adc1560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:45.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.985+0000 7f6adb400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6adc1530f0 0x7f6adc0720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:45.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.985+0000 7f6adb400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6adc1530f0 0x7f6adc0720a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:42972/0 (socket says 172.21.15.8:42972) 2024-03-23T23:42:45.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.985+0000 7f6adb400640 1 -- 172.21.15.8:0/3302590236 learned_addr learned my addr 172.21.15.8:0/3302590236 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:45.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.985+0000 7f6adbe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6adc0725e0 0x7f6adc1560a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51766/0 (socket says 172.21.15.8:51766) 2024-03-23T23:42:45.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.985+0000 7f6adb400640 1 -- 172.21.15.8:0/3302590236 >> v2:172.21.15.8:3300/0 conn(0x7f6adc0725e0 msgr2=0x7f6adc1560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:45.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.985+0000 7f6adb400640 1 --2- 172.21.15.8:0/3302590236 >> v2:172.21.15.8:3300/0 conn(0x7f6adc0725e0 0x7f6adc1560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:45.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.985+0000 7f6adb400640 1 -- 172.21.15.8:0/3302590236 >> v1:172.21.15.196:6789/0 conn(0x7f6adc072d80 legacy=0x7f6adc155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:45.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.985+0000 7f6adb400640 1 -- 172.21.15.8:0/3302590236 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc06bcb0 con 0x7f6adc1530f0 2024-03-23T23:42:45.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.985+0000 7f6adaa00640 1 -- 172.21.15.8:0/3302590236 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1872774390 0 0) 0x7f6adc0aa1f0 con 0x7f6adc072d80 2024-03-23T23:42:45.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.989+0000 7f6adb400640 1 --2- 172.21.15.8:0/3302590236 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6adc1530f0 0x7f6adc0720a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6acc009870 tx=0x7f6acc01c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d973b8cf93090a05 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:45.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.989+0000 7f6adaa00640 1 -- 172.21.15.8:0/3302590236 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc0b0070 con 0x7f6adc1530f0 2024-03-23T23:42:45.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.989+0000 7f6adaa00640 1 -- 172.21.15.8:0/3302590236 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6acc0ab600 con 0x7f6adc1530f0 2024-03-23T23:42:45.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.989+0000 7f6adaa00640 1 -- 172.21.15.8:0/3302590236 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc0ab9d0 con 0x7f6adc1530f0 2024-03-23T23:42:45.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.989+0000 7f6ae2800640 1 -- 172.21.15.8:0/3302590236 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6adc1530f0 msgr2=0x7f6adc0720a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:45.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.989+0000 7f6ae2800640 1 --2- 172.21.15.8:0/3302590236 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6adc1530f0 0x7f6adc0720a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6acc009870 tx=0x7f6acc01c4d0 comp rx=0 tx=0).stop 2024-03-23T23:42:45.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.989+0000 7f6ae2800640 1 -- 172.21.15.8:0/3302590236 shutdown_connections 2024-03-23T23:42:45.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.989+0000 7f6ae2800640 1 --2- 172.21.15.8:0/3302590236 >> v2:172.21.15.8:3300/0 conn(0x7f6adc0725e0 0x7f6adc1560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:45.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.989+0000 7f6ae2800640 1 --2- 172.21.15.8:0/3302590236 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6adc1530f0 0x7f6adc0720a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:45.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.989+0000 7f6ae2800640 1 -- 172.21.15.8:0/3302590236 >> 172.21.15.8:0/3302590236 conn(0x7f6adc0c4d80 msgr2=0x7f6adc0c5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:45.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.989+0000 7f6ae2800640 1 -- 172.21.15.8:0/3302590236 shutdown_connections 2024-03-23T23:42:45.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.989+0000 7f6ae2800640 1 -- 172.21.15.8:0/3302590236 wait complete. 2024-03-23T23:42:45.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.989+0000 7f6ae2800640 1 Processor -- start 2024-03-23T23:42:45.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.989+0000 7f6ae2800640 1 -- start start 2024-03-23T23:42:45.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.989+0000 7f6ae2800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6adc0725e0 0x7f6adc155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:45.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.989+0000 7f6ae2800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6adc072d80 0x7f6adc14a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:45.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.989+0000 7f6ae2800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6adc1530f0 0x7f6adc142b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:45.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.989+0000 7f6ae2800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc153650 con 0x7f6adc1530f0 2024-03-23T23:42:45.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.989+0000 7f6ae2800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc1534d0 con 0x7f6adc0725e0 2024-03-23T23:42:45.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.989+0000 7f6ae2800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc162a50 con 0x7f6adc072d80 2024-03-23T23:42:45.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.989+0000 7f6adb400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6adc0725e0 0x7f6adc155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:45.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.989+0000 7f6adbe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6adc1530f0 0x7f6adc142b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:45.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.989+0000 7f6ad3e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6adc072d80 0x7f6adc14a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:45.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.989+0000 7f6adbe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6adc1530f0 0x7f6adc142b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51768/0 (socket says 172.21.15.8:51768) 2024-03-23T23:42:45.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.989+0000 7f6adb400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6adc0725e0 0x7f6adc155240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:60506/0 (socket says 172.21.15.8:60506) 2024-03-23T23:42:45.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.989+0000 7f6adbe00640 1 -- 172.21.15.8:0/705511810 learned_addr learned my addr 172.21.15.8:0/705511810 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:45.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.993+0000 7f6adbe00640 1 -- 172.21.15.8:0/705511810 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6adc072d80 msgr2=0x7f6adc14a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:45.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.993+0000 7f6adbe00640 1 --2- 172.21.15.8:0/705511810 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6adc072d80 0x7f6adc14a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:45.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.993+0000 7f6adbe00640 1 -- 172.21.15.8:0/705511810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6adc0725e0 msgr2=0x7f6adc155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:45.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.993+0000 7f6adbe00640 1 --2- 172.21.15.8:0/705511810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6adc0725e0 0x7f6adc155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:45.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.993+0000 7f6adbe00640 1 -- 172.21.15.8:0/705511810 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc0ad380 con 0x7f6adc1530f0 2024-03-23T23:42:45.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.993+0000 7f6adbe00640 1 --2- 172.21.15.8:0/705511810 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6adc1530f0 0x7f6adc142b60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4009d30 tx=0x7f6ad400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:45.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.993+0000 7f6ad3400640 1 -- 172.21.15.8:0/705511810 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4018020 con 0x7f6adc1530f0 2024-03-23T23:42:45.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.993+0000 7f6ad3400640 1 -- 172.21.15.8:0/705511810 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad4014480 con 0x7f6adc1530f0 2024-03-23T23:42:45.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.993+0000 7f6ad3400640 1 -- 172.21.15.8:0/705511810 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4014870 con 0x7f6adc1530f0 2024-03-23T23:42:45.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.993+0000 7f6ae2800640 1 -- 172.21.15.8:0/705511810 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6adc154920 con 0x7f6adc1530f0 2024-03-23T23:42:45.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.993+0000 7f6ae2800640 1 -- 172.21.15.8:0/705511810 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6adc154360 con 0x7f6adc1530f0 2024-03-23T23:42:45.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.993+0000 7f6ae2800640 1 -- 172.21.15.8:0/705511810 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6adc068270 con 0x7f6adc1530f0 2024-03-23T23:42:45.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.993+0000 7f6ad3400640 1 -- 172.21.15.8:0/705511810 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f6ad401b020 con 0x7f6adc1530f0 2024-03-23T23:42:45.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.997+0000 7f6ad3400640 1 --2- 172.21.15.8:0/705511810 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6ab8067660 0x7f6ab8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:45.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.997+0000 7f6ad3400640 1 -- 172.21.15.8:0/705511810 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5689+0+0 (secure 0 0 0) 0x7f6ad40860d0 con 0x7f6adc1530f0 2024-03-23T23:42:45.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.997+0000 7f6adb400640 1 --2- 172.21.15.8:0/705511810 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6ab8067660 0x7f6ab8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:45.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:45.997+0000 7f6adb400640 1 --2- 172.21.15.8:0/705511810 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6ab8067660 0x7f6ab8069b20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6acc0ad000 tx=0x7f6acc0a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:46.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.001+0000 7f6ad3400640 1 -- 172.21.15.8:0/705511810 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f6ad4022070 con 0x7f6adc1530f0 2024-03-23T23:42:46.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.157+0000 7f6ae2800640 1 -- 172.21.15.8:0/705511810 --> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6adc0ad810 con 0x7f6ab8067660 2024-03-23T23:42:46.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.169+0000 7f6ad3400640 1 -- 172.21.15.8:0/705511810 <== mgr.4098 v2:172.21.15.196:6832/1295060067 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251916 (secure 0 0 0) 0x7f6adc0ad810 con 0x7f6ab8067660 2024-03-23T23:42:46.170 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:42:46.171 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-03-23T23:42:46.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.169+0000 7f6ae2800640 1 -- 172.21.15.8:0/705511810 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6ab8067660 msgr2=0x7f6ab8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:46.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.169+0000 7f6ae2800640 1 --2- 172.21.15.8:0/705511810 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6ab8067660 0x7f6ab8069b20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6acc0ad000 tx=0x7f6acc0a6000 comp rx=0 tx=0).stop 2024-03-23T23:42:46.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.169+0000 7f6ae2800640 1 -- 172.21.15.8:0/705511810 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6adc1530f0 msgr2=0x7f6adc142b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:46.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.169+0000 7f6ae2800640 1 --2- 172.21.15.8:0/705511810 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6adc1530f0 0x7f6adc142b60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4009d30 tx=0x7f6ad400c490 comp rx=0 tx=0).stop 2024-03-23T23:42:46.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.169+0000 7f6ae2800640 1 -- 172.21.15.8:0/705511810 shutdown_connections 2024-03-23T23:42:46.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.169+0000 7f6ae2800640 1 --2- 172.21.15.8:0/705511810 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6adc1530f0 0x7f6adc142b60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:46.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.169+0000 7f6ae2800640 1 --2- 172.21.15.8:0/705511810 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6ab8067660 0x7f6ab8069b20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:46.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.169+0000 7f6ae2800640 1 --2- 172.21.15.8:0/705511810 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6adc072d80 0x7f6adc14a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:46.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.169+0000 7f6ae2800640 1 --2- 172.21.15.8:0/705511810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6adc0725e0 0x7f6adc155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:46.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.169+0000 7f6ae2800640 1 -- 172.21.15.8:0/705511810 >> 172.21.15.8:0/705511810 conn(0x7f6adc0c4d80 msgr2=0x7f6adc0c3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:46.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.169+0000 7f6ae2800640 1 -- 172.21.15.8:0/705511810 shutdown_connections 2024-03-23T23:42:46.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.169+0000 7f6ae2800640 1 -- 172.21.15.8:0/705511810 wait complete. 2024-03-23T23:42:46.189 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-03-23T23:42:44.273223+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":144,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239760,"kb_used_data":2776,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734960,"statfs":{"total":773094113280,"available":772848599040,"internally_reserved":0,"allocated":2842624,"data_stored":1729796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.619000"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.710732+0000","last_change":"2024-03-23T23:42:40.701959+0000","last_active":"2024-03-23T23:42:40.710732+0000","last_peered":"2024-03-23T23:42:40.710732+0000","last_clean":"2024-03-23T23:42:40.710732+0000","last_became_active":"2024-03-23T23:42:40.700855+0000","last_became_peered":"2024-03-23T23:42:40.700855+0000","last_unstale":"2024-03-23T23:42:40.710732+0000","last_undegraded":"2024-03-23T23:42:40.710732+0000","last_fullsized":"2024-03-23T23:42:40.710732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:51:30.695597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.684959+0000","last_change":"2024-03-23T23:42:40.678622+0000","last_active":"2024-03-23T23:42:40.684959+0000","last_peered":"2024-03-23T23:42:40.684959+0000","last_clean":"2024-03-23T23:42:40.684959+0000","last_became_active":"2024-03-23T23:42:40.678325+0000","last_became_peered":"2024-03-23T23:42:40.678325+0000","last_unstale":"2024-03-23T23:42:40.684959+0000","last_undegraded":"2024-03-23T23:42:40.684959+0000","last_fullsized":"2024-03-23T23:42:40.684959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:31:34.412092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.687411+0000","last_change":"2024-03-23T23:42:40.683983+0000","last_active":"2024-03-23T23:42:40.687411+0000","last_peered":"2024-03-23T23:42:40.687411+0000","last_clean":"2024-03-23T23:42:40.687411+0000","last_became_active":"2024-03-23T23:42:40.683711+0000","last_became_peered":"2024-03-23T23:42:40.683711+0000","last_unstale":"2024-03-23T23:42:40.687411+0000","last_undegraded":"2024-03-23T23:42:40.687411+0000","last_fullsized":"2024-03-23T23:42:40.687411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:56.763759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027841+0000","last_change":"2024-03-23T23:42:40.700631+0000","last_active":"2024-03-23T23:42:42.027841+0000","last_peered":"2024-03-23T23:42:42.027841+0000","last_clean":"2024-03-23T23:42:42.027841+0000","last_became_active":"2024-03-23T23:42:40.697932+0000","last_became_peered":"2024-03-23T23:42:40.697932+0000","last_unstale":"2024-03-23T23:42:42.027841+0000","last_undegraded":"2024-03-23T23:42:42.027841+0000","last_fullsized":"2024-03-23T23:42:42.027841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:05:17.694245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.705226+0000","last_change":"2024-03-23T23:42:40.698407+0000","last_active":"2024-03-23T23:42:40.705226+0000","last_peered":"2024-03-23T23:42:40.705226+0000","last_clean":"2024-03-23T23:42:40.705226+0000","last_became_active":"2024-03-23T23:42:40.698092+0000","last_became_peered":"2024-03-23T23:42:40.698092+0000","last_unstale":"2024-03-23T23:42:40.705226+0000","last_undegraded":"2024-03-23T23:42:40.705226+0000","last_fullsized":"2024-03-23T23:42:40.705226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:53:46.437114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027649+0000","last_change":"2024-03-23T23:42:40.698234+0000","last_active":"2024-03-23T23:42:42.027649+0000","last_peered":"2024-03-23T23:42:42.027649+0000","last_clean":"2024-03-23T23:42:42.027649+0000","last_became_active":"2024-03-23T23:42:40.695978+0000","last_became_peered":"2024-03-23T23:42:40.695978+0000","last_unstale":"2024-03-23T23:42:42.027649+0000","last_undegraded":"2024-03-23T23:42:42.027649+0000","last_fullsized":"2024-03-23T23:42:42.027649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:04.633288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.701092+0000","last_change":"2024-03-23T23:42:40.689380+0000","last_active":"2024-03-23T23:42:40.701092+0000","last_peered":"2024-03-23T23:42:40.701092+0000","last_clean":"2024-03-23T23:42:40.701092+0000","last_became_active":"2024-03-23T23:42:40.689023+0000","last_became_peered":"2024-03-23T23:42:40.689023+0000","last_unstale":"2024-03-23T23:42:40.701092+0000","last_undegraded":"2024-03-23T23:42:40.701092+0000","last_fullsized":"2024-03-23T23:42:40.701092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:57:21.400582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027564+0000","last_change":"2024-03-23T23:42:40.710655+0000","last_active":"2024-03-23T23:42:42.027564+0000","last_peered":"2024-03-23T23:42:42.027564+0000","last_clean":"2024-03-23T23:42:42.027564+0000","last_became_active":"2024-03-23T23:42:40.710362+0000","last_became_peered":"2024-03-23T23:42:40.710362+0000","last_unstale":"2024-03-23T23:42:42.027564+0000","last_undegraded":"2024-03-23T23:42:42.027564+0000","last_fullsized":"2024-03-23T23:42:42.027564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:12:14.359173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.715038+0000","last_change":"2024-03-23T23:42:40.714331+0000","last_active":"2024-03-23T23:42:40.715038+0000","last_peered":"2024-03-23T23:42:40.715038+0000","last_clean":"2024-03-23T23:42:40.715038+0000","last_became_active":"2024-03-23T23:42:40.713737+0000","last_became_peered":"2024-03-23T23:42:40.713737+0000","last_unstale":"2024-03-23T23:42:40.715038+0000","last_undegraded":"2024-03-23T23:42:40.715038+0000","last_fullsized":"2024-03-23T23:42:40.715038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:42:14.952953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.670921+0000","last_change":"2024-03-23T23:42:40.703254+0000","last_active":"2024-03-23T23:42:41.670921+0000","last_peered":"2024-03-23T23:42:41.670921+0000","last_clean":"2024-03-23T23:42:41.670921+0000","last_became_active":"2024-03-23T23:42:40.702447+0000","last_became_peered":"2024-03-23T23:42:40.702447+0000","last_unstale":"2024-03-23T23:42:41.670921+0000","last_undegraded":"2024-03-23T23:42:41.670921+0000","last_fullsized":"2024-03-23T23:42:41.670921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:59:45.154553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.671340+0000","last_change":"2024-03-23T23:42:40.702089+0000","last_active":"2024-03-23T23:42:41.671340+0000","last_peered":"2024-03-23T23:42:41.671340+0000","last_clean":"2024-03-23T23:42:41.671340+0000","last_became_active":"2024-03-23T23:42:40.701874+0000","last_became_peered":"2024-03-23T23:42:40.701874+0000","last_unstale":"2024-03-23T23:42:41.671340+0000","last_undegraded":"2024-03-23T23:42:41.671340+0000","last_fullsized":"2024-03-23T23:42:41.671340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.670823+0000","last_change":"2024-03-23T23:42:40.682523+0000","last_active":"2024-03-23T23:42:41.670823+0000","last_peered":"2024-03-23T23:42:41.670823+0000","last_clean":"2024-03-23T23:42:41.670823+0000","last_became_active":"2024-03-23T23:42:40.682155+0000","last_became_peered":"2024-03-23T23:42:40.682155+0000","last_unstale":"2024-03-23T23:42:41.670823+0000","last_undegraded":"2024-03-23T23:42:41.670823+0000","last_fullsized":"2024-03-23T23:42:41.670823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:33.260151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027597+0000","last_change":"2024-03-23T23:42:40.682736+0000","last_active":"2024-03-23T23:42:42.027597+0000","last_peered":"2024-03-23T23:42:42.027597+0000","last_clean":"2024-03-23T23:42:42.027597+0000","last_became_active":"2024-03-23T23:42:40.682410+0000","last_became_peered":"2024-03-23T23:42:40.682410+0000","last_unstale":"2024-03-23T23:42:42.027597+0000","last_undegraded":"2024-03-23T23:42:42.027597+0000","last_fullsized":"2024-03-23T23:42:42.027597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:01:06.338641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.683026+0000","last_change":"2024-03-23T23:42:40.680934+0000","last_active":"2024-03-23T23:42:40.683026+0000","last_peered":"2024-03-23T23:42:40.683026+0000","last_clean":"2024-03-23T23:42:40.683026+0000","last_became_active":"2024-03-23T23:42:40.680643+0000","last_became_peered":"2024-03-23T23:42:40.680643+0000","last_unstale":"2024-03-23T23:42:40.683026+0000","last_undegraded":"2024-03-23T23:42:40.683026+0000","last_fullsized":"2024-03-23T23:42:40.683026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:42:38.708772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.686456+0000","last_change":"2024-03-23T23:42:40.681928+0000","last_active":"2024-03-23T23:42:40.686456+0000","last_peered":"2024-03-23T23:42:40.686456+0000","last_clean":"2024-03-23T23:42:40.686456+0000","last_became_active":"2024-03-23T23:42:40.681337+0000","last_became_peered":"2024-03-23T23:42:40.681337+0000","last_unstale":"2024-03-23T23:42:40.686456+0000","last_undegraded":"2024-03-23T23:42:40.686456+0000","last_fullsized":"2024-03-23T23:42:40.686456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:34.630671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027447+0000","last_change":"2024-03-23T23:42:40.697920+0000","last_active":"2024-03-23T23:42:42.027447+0000","last_peered":"2024-03-23T23:42:42.027447+0000","last_clean":"2024-03-23T23:42:42.027447+0000","last_became_active":"2024-03-23T23:42:40.697694+0000","last_became_peered":"2024-03-23T23:42:40.697694+0000","last_unstale":"2024-03-23T23:42:42.027447+0000","last_undegraded":"2024-03-23T23:42:42.027447+0000","last_fullsized":"2024-03-23T23:42:42.027447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.028222+0000","last_change":"2024-03-23T23:42:40.708540+0000","last_active":"2024-03-23T23:42:42.028222+0000","last_peered":"2024-03-23T23:42:42.028222+0000","last_clean":"2024-03-23T23:42:42.028222+0000","last_became_active":"2024-03-23T23:42:40.708031+0000","last_became_peered":"2024-03-23T23:42:40.708031+0000","last_unstale":"2024-03-23T23:42:42.028222+0000","last_undegraded":"2024-03-23T23:42:42.028222+0000","last_fullsized":"2024-03-23T23:42:42.028222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:44:03.386124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.691975+0000","last_change":"2024-03-23T23:42:40.690961+0000","last_active":"2024-03-23T23:42:40.691975+0000","last_peered":"2024-03-23T23:42:40.691975+0000","last_clean":"2024-03-23T23:42:40.691975+0000","last_became_active":"2024-03-23T23:42:40.690690+0000","last_became_peered":"2024-03-23T23:42:40.690690+0000","last_unstale":"2024-03-23T23:42:40.691975+0000","last_undegraded":"2024-03-23T23:42:40.691975+0000","last_fullsized":"2024-03-23T23:42:40.691975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:02.613636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.705051+0000","last_change":"2024-03-23T23:42:40.689769+0000","last_active":"2024-03-23T23:42:40.705051+0000","last_peered":"2024-03-23T23:42:40.705051+0000","last_clean":"2024-03-23T23:42:40.705051+0000","last_became_active":"2024-03-23T23:42:40.689111+0000","last_became_peered":"2024-03-23T23:42:40.689111+0000","last_unstale":"2024-03-23T23:42:40.705051+0000","last_undegraded":"2024-03-23T23:42:40.705051+0000","last_fullsized":"2024-03-23T23:42:40.705051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:43:47.212917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.671615+0000","last_change":"2024-03-23T23:42:40.683701+0000","last_active":"2024-03-23T23:42:41.671615+0000","last_peered":"2024-03-23T23:42:41.671615+0000","last_clean":"2024-03-23T23:42:41.671615+0000","last_became_active":"2024-03-23T23:42:40.683377+0000","last_became_peered":"2024-03-23T23:42:40.683377+0000","last_unstale":"2024-03-23T23:42:41.671615+0000","last_undegraded":"2024-03-23T23:42:41.671615+0000","last_fullsized":"2024-03-23T23:42:41.671615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.689896+0000","last_change":"2024-03-23T23:42:40.689122+0000","last_active":"2024-03-23T23:42:40.689896+0000","last_peered":"2024-03-23T23:42:40.689896+0000","last_clean":"2024-03-23T23:42:40.689896+0000","last_became_active":"2024-03-23T23:42:40.688875+0000","last_became_peered":"2024-03-23T23:42:40.688875+0000","last_unstale":"2024-03-23T23:42:40.689896+0000","last_undegraded":"2024-03-23T23:42:40.689896+0000","last_fullsized":"2024-03-23T23:42:40.689896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:57:21.400582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.028208+0000","last_change":"2024-03-23T23:42:40.707800+0000","last_active":"2024-03-23T23:42:42.028208+0000","last_peered":"2024-03-23T23:42:42.028208+0000","last_clean":"2024-03-23T23:42:42.028208+0000","last_became_active":"2024-03-23T23:42:40.707528+0000","last_became_peered":"2024-03-23T23:42:40.707528+0000","last_unstale":"2024-03-23T23:42:42.028208+0000","last_undegraded":"2024-03-23T23:42:42.028208+0000","last_fullsized":"2024-03-23T23:42:42.028208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:03:24.275154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027954+0000","last_change":"2024-03-23T23:42:40.684899+0000","last_active":"2024-03-23T23:42:42.027954+0000","last_peered":"2024-03-23T23:42:42.027954+0000","last_clean":"2024-03-23T23:42:42.027954+0000","last_became_active":"2024-03-23T23:42:40.684603+0000","last_became_peered":"2024-03-23T23:42:40.684603+0000","last_unstale":"2024-03-23T23:42:42.027954+0000","last_undegraded":"2024-03-23T23:42:42.027954+0000","last_fullsized":"2024-03-23T23:42:42.027954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:54.557634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027546+0000","last_change":"2024-03-23T23:42:40.701852+0000","last_active":"2024-03-23T23:42:42.027546+0000","last_peered":"2024-03-23T23:42:42.027546+0000","last_clean":"2024-03-23T23:42:42.027546+0000","last_became_active":"2024-03-23T23:42:40.701566+0000","last_became_peered":"2024-03-23T23:42:40.701566+0000","last_unstale":"2024-03-23T23:42:42.027546+0000","last_undegraded":"2024-03-23T23:42:42.027546+0000","last_fullsized":"2024-03-23T23:42:42.027546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.028822+0000","last_change":"2024-03-23T23:42:40.685177+0000","last_active":"2024-03-23T23:42:42.028822+0000","last_peered":"2024-03-23T23:42:42.028822+0000","last_clean":"2024-03-23T23:42:42.028822+0000","last_became_active":"2024-03-23T23:42:40.684495+0000","last_became_peered":"2024-03-23T23:42:40.684495+0000","last_unstale":"2024-03-23T23:42:42.028822+0000","last_undegraded":"2024-03-23T23:42:42.028822+0000","last_fullsized":"2024-03-23T23:42:42.028822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:27.675824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.671063+0000","last_change":"2024-03-23T23:42:40.694420+0000","last_active":"2024-03-23T23:42:41.671063+0000","last_peered":"2024-03-23T23:42:41.671063+0000","last_clean":"2024-03-23T23:42:41.671063+0000","last_became_active":"2024-03-23T23:42:40.693867+0000","last_became_peered":"2024-03-23T23:42:40.693867+0000","last_unstale":"2024-03-23T23:42:41.671063+0000","last_undegraded":"2024-03-23T23:42:41.671063+0000","last_fullsized":"2024-03-23T23:42:41.671063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:54.557634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.678494+0000","last_change":"2024-03-23T23:42:40.677168+0000","last_active":"2024-03-23T23:42:40.678494+0000","last_peered":"2024-03-23T23:42:40.678494+0000","last_clean":"2024-03-23T23:42:40.678494+0000","last_became_active":"2024-03-23T23:42:40.676912+0000","last_became_peered":"2024-03-23T23:42:40.676912+0000","last_unstale":"2024-03-23T23:42:40.678494+0000","last_undegraded":"2024-03-23T23:42:40.678494+0000","last_fullsized":"2024-03-23T23:42:40.678494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:45:44.558757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027957+0000","last_change":"2024-03-23T23:42:40.685370+0000","last_active":"2024-03-23T23:42:42.027957+0000","last_peered":"2024-03-23T23:42:42.027957+0000","last_clean":"2024-03-23T23:42:42.027957+0000","last_became_active":"2024-03-23T23:42:40.685120+0000","last_became_peered":"2024-03-23T23:42:40.685120+0000","last_unstale":"2024-03-23T23:42:42.027957+0000","last_undegraded":"2024-03-23T23:42:42.027957+0000","last_fullsized":"2024-03-23T23:42:42.027957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.675111+0000","last_change":"2024-03-23T23:42:40.673293+0000","last_active":"2024-03-23T23:42:40.675111+0000","last_peered":"2024-03-23T23:42:40.675111+0000","last_clean":"2024-03-23T23:42:40.675111+0000","last_became_active":"2024-03-23T23:42:40.672910+0000","last_became_peered":"2024-03-23T23:42:40.672910+0000","last_unstale":"2024-03-23T23:42:40.675111+0000","last_undegraded":"2024-03-23T23:42:40.675111+0000","last_fullsized":"2024-03-23T23:42:40.675111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:47:28.098925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.028339+0000","last_change":"2024-03-23T23:42:40.698519+0000","last_active":"2024-03-23T23:42:42.028339+0000","last_peered":"2024-03-23T23:42:42.028339+0000","last_clean":"2024-03-23T23:42:42.028339+0000","last_became_active":"2024-03-23T23:42:40.695218+0000","last_became_peered":"2024-03-23T23:42:40.695218+0000","last_unstale":"2024-03-23T23:42:42.028339+0000","last_undegraded":"2024-03-23T23:42:42.028339+0000","last_fullsized":"2024-03-23T23:42:42.028339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:00:54.983365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.704217+0000","last_change":"2024-03-23T23:42:40.702411+0000","last_active":"2024-03-23T23:42:40.704217+0000","last_peered":"2024-03-23T23:42:40.704217+0000","last_clean":"2024-03-23T23:42:40.704217+0000","last_became_active":"2024-03-23T23:42:40.701398+0000","last_became_peered":"2024-03-23T23:42:40.701398+0000","last_unstale":"2024-03-23T23:42:40.704217+0000","last_undegraded":"2024-03-23T23:42:40.704217+0000","last_fullsized":"2024-03-23T23:42:40.704217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:42:38.708772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.670372+0000","last_change":"2024-03-23T23:42:40.679042+0000","last_active":"2024-03-23T23:42:41.670372+0000","last_peered":"2024-03-23T23:42:41.670372+0000","last_clean":"2024-03-23T23:42:41.670372+0000","last_became_active":"2024-03-23T23:42:40.678518+0000","last_became_peered":"2024-03-23T23:42:40.678518+0000","last_unstale":"2024-03-23T23:42:41.670372+0000","last_undegraded":"2024-03-23T23:42:41.670372+0000","last_fullsized":"2024-03-23T23:42:41.670372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:12:14.359173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.671475+0000","last_change":"2024-03-23T23:42:40.680801+0000","last_active":"2024-03-23T23:42:41.671475+0000","last_peered":"2024-03-23T23:42:41.671475+0000","last_clean":"2024-03-23T23:42:41.671475+0000","last_became_active":"2024-03-23T23:42:40.680511+0000","last_became_peered":"2024-03-23T23:42:40.680511+0000","last_unstale":"2024-03-23T23:42:41.671475+0000","last_undegraded":"2024-03-23T23:42:41.671475+0000","last_fullsized":"2024-03-23T23:42:41.671475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:27:42.392714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027705+0000","last_change":"2024-03-23T23:42:39.688422+0000","last_active":"2024-03-23T23:42:42.027705+0000","last_peered":"2024-03-23T23:42:42.027705+0000","last_clean":"2024-03-23T23:42:42.027705+0000","last_became_active":"2024-03-23T23:42:39.687423+0000","last_became_peered":"2024-03-23T23:42:39.687423+0000","last_unstale":"2024-03-23T23:42:42.027705+0000","last_undegraded":"2024-03-23T23:42:42.027705+0000","last_fullsized":"2024-03-23T23:42:42.027705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:20:38.456655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.680387+0000","last_change":"2024-03-23T23:42:40.676571+0000","last_active":"2024-03-23T23:42:40.680387+0000","last_peered":"2024-03-23T23:42:40.680387+0000","last_clean":"2024-03-23T23:42:40.680387+0000","last_became_active":"2024-03-23T23:42:40.675877+0000","last_became_peered":"2024-03-23T23:42:40.675877+0000","last_unstale":"2024-03-23T23:42:40.680387+0000","last_undegraded":"2024-03-23T23:42:40.680387+0000","last_fullsized":"2024-03-23T23:42:40.680387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:02.613636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.670866+0000","last_change":"2024-03-23T23:42:39.681458+0000","last_active":"2024-03-23T23:42:41.670866+0000","last_peered":"2024-03-23T23:42:41.670866+0000","last_clean":"2024-03-23T23:42:41.670866+0000","last_became_active":"2024-03-23T23:42:39.681158+0000","last_became_peered":"2024-03-23T23:42:39.681158+0000","last_unstale":"2024-03-23T23:42:41.670866+0000","last_undegraded":"2024-03-23T23:42:41.670866+0000","last_fullsized":"2024-03-23T23:42:41.670866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:08:03.578884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027432+0000","last_change":"2024-03-23T23:42:39.688646+0000","last_active":"2024-03-23T23:42:42.027432+0000","last_peered":"2024-03-23T23:42:42.027432+0000","last_clean":"2024-03-23T23:42:42.027432+0000","last_became_active":"2024-03-23T23:42:39.687489+0000","last_became_peered":"2024-03-23T23:42:39.687489+0000","last_unstale":"2024-03-23T23:42:42.027432+0000","last_undegraded":"2024-03-23T23:42:42.027432+0000","last_fullsized":"2024-03-23T23:42:42.027432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:07:12.649156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.028590+0000","last_change":"2024-03-23T23:42:40.674605+0000","last_active":"2024-03-23T23:42:42.028590+0000","last_peered":"2024-03-23T23:42:42.028590+0000","last_clean":"2024-03-23T23:42:42.028590+0000","last_became_active":"2024-03-23T23:42:40.674366+0000","last_became_peered":"2024-03-23T23:42:40.674366+0000","last_unstale":"2024-03-23T23:42:42.028590+0000","last_undegraded":"2024-03-23T23:42:42.028590+0000","last_fullsized":"2024-03-23T23:42:42.028590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027554+0000","last_change":"2024-03-23T23:42:39.682839+0000","last_active":"2024-03-23T23:42:42.027554+0000","last_peered":"2024-03-23T23:42:42.027554+0000","last_clean":"2024-03-23T23:42:42.027554+0000","last_became_active":"2024-03-23T23:42:39.682584+0000","last_became_peered":"2024-03-23T23:42:39.682584+0000","last_unstale":"2024-03-23T23:42:42.027554+0000","last_undegraded":"2024-03-23T23:42:42.027554+0000","last_fullsized":"2024-03-23T23:42:42.027554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:19.914926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.686435+0000","last_change":"2024-03-23T23:42:40.679384+0000","last_active":"2024-03-23T23:42:40.686435+0000","last_peered":"2024-03-23T23:42:40.686435+0000","last_clean":"2024-03-23T23:42:40.686435+0000","last_became_active":"2024-03-23T23:42:40.679070+0000","last_became_peered":"2024-03-23T23:42:40.679070+0000","last_unstale":"2024-03-23T23:42:40.686435+0000","last_undegraded":"2024-03-23T23:42:40.686435+0000","last_fullsized":"2024-03-23T23:42:40.686435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:53:46.437114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.670696+0000","last_change":"2024-03-23T23:42:39.684669+0000","last_active":"2024-03-23T23:42:41.670696+0000","last_peered":"2024-03-23T23:42:41.670696+0000","last_clean":"2024-03-23T23:42:41.670696+0000","last_became_active":"2024-03-23T23:42:39.684360+0000","last_became_peered":"2024-03-23T23:42:39.684360+0000","last_unstale":"2024-03-23T23:42:41.670696+0000","last_undegraded":"2024-03-23T23:42:41.670696+0000","last_fullsized":"2024-03-23T23:42:41.670696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:19.914926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027862+0000","last_change":"2024-03-23T23:42:40.708795+0000","last_active":"2024-03-23T23:42:42.027862+0000","last_peered":"2024-03-23T23:42:42.027862+0000","last_clean":"2024-03-23T23:42:42.027862+0000","last_became_active":"2024-03-23T23:42:40.708199+0000","last_became_peered":"2024-03-23T23:42:40.708199+0000","last_unstale":"2024-03-23T23:42:42.027862+0000","last_undegraded":"2024-03-23T23:42:42.027862+0000","last_fullsized":"2024-03-23T23:42:42.027862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:53.782430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027953+0000","last_change":"2024-03-23T23:42:39.691092+0000","last_active":"2024-03-23T23:42:42.027953+0000","last_peered":"2024-03-23T23:42:42.027953+0000","last_clean":"2024-03-23T23:42:42.027953+0000","last_became_active":"2024-03-23T23:42:39.687473+0000","last_became_peered":"2024-03-23T23:42:39.687473+0000","last_unstale":"2024-03-23T23:42:42.027953+0000","last_undegraded":"2024-03-23T23:42:42.027953+0000","last_fullsized":"2024-03-23T23:42:42.027953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:08:03.578884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.703216+0000","last_change":"2024-03-23T23:42:40.700381+0000","last_active":"2024-03-23T23:42:40.703216+0000","last_peered":"2024-03-23T23:42:40.703216+0000","last_clean":"2024-03-23T23:42:40.703216+0000","last_became_active":"2024-03-23T23:42:40.698428+0000","last_became_peered":"2024-03-23T23:42:40.698428+0000","last_unstale":"2024-03-23T23:42:40.703216+0000","last_undegraded":"2024-03-23T23:42:40.703216+0000","last_fullsized":"2024-03-23T23:42:40.703216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:45:44.558757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.713003+0000","last_change":"2024-03-23T23:42:39.681675+0000","last_active":"2024-03-23T23:42:40.713003+0000","last_peered":"2024-03-23T23:42:40.713003+0000","last_clean":"2024-03-23T23:42:40.713003+0000","last_became_active":"2024-03-23T23:42:39.681364+0000","last_became_peered":"2024-03-23T23:42:39.681364+0000","last_unstale":"2024-03-23T23:42:40.713003+0000","last_undegraded":"2024-03-23T23:42:40.713003+0000","last_fullsized":"2024-03-23T23:42:40.713003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:42:37.702720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.670880+0000","last_change":"2024-03-23T23:42:40.683025+0000","last_active":"2024-03-23T23:42:41.670880+0000","last_peered":"2024-03-23T23:42:41.670880+0000","last_clean":"2024-03-23T23:42:41.670880+0000","last_became_active":"2024-03-23T23:42:40.682798+0000","last_became_peered":"2024-03-23T23:42:40.682798+0000","last_unstale":"2024-03-23T23:42:41.670880+0000","last_undegraded":"2024-03-23T23:42:41.670880+0000","last_fullsized":"2024-03-23T23:42:41.670880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:51.565112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.671470+0000","last_change":"2024-03-23T23:42:39.689429+0000","last_active":"2024-03-23T23:42:41.671470+0000","last_peered":"2024-03-23T23:42:41.671470+0000","last_clean":"2024-03-23T23:42:41.671470+0000","last_became_active":"2024-03-23T23:42:39.688066+0000","last_became_peered":"2024-03-23T23:42:39.688066+0000","last_unstale":"2024-03-23T23:42:41.671470+0000","last_undegraded":"2024-03-23T23:42:41.671470+0000","last_fullsized":"2024-03-23T23:42:41.671470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:32.254099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.705079+0000","last_change":"2024-03-23T23:42:40.689988+0000","last_active":"2024-03-23T23:42:40.705079+0000","last_peered":"2024-03-23T23:42:40.705079+0000","last_clean":"2024-03-23T23:42:40.705079+0000","last_became_active":"2024-03-23T23:42:40.689477+0000","last_became_peered":"2024-03-23T23:42:40.689477+0000","last_unstale":"2024-03-23T23:42:40.705079+0000","last_undegraded":"2024-03-23T23:42:40.705079+0000","last_fullsized":"2024-03-23T23:42:40.705079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:45:44.558757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.703411+0000","last_change":"2024-03-23T23:42:39.681926+0000","last_active":"2024-03-23T23:42:40.703411+0000","last_peered":"2024-03-23T23:42:40.703411+0000","last_clean":"2024-03-23T23:42:40.703411+0000","last_became_active":"2024-03-23T23:42:39.681028+0000","last_became_peered":"2024-03-23T23:42:39.681028+0000","last_unstale":"2024-03-23T23:42:40.703411+0000","last_undegraded":"2024-03-23T23:42:40.703411+0000","last_fullsized":"2024-03-23T23:42:40.703411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:24:11.933075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.689872+0000","last_change":"2024-03-23T23:42:40.688909+0000","last_active":"2024-03-23T23:42:40.689872+0000","last_peered":"2024-03-23T23:42:40.689872+0000","last_clean":"2024-03-23T23:42:40.689872+0000","last_became_active":"2024-03-23T23:42:40.688636+0000","last_became_peered":"2024-03-23T23:42:40.688636+0000","last_unstale":"2024-03-23T23:42:40.689872+0000","last_undegraded":"2024-03-23T23:42:40.689872+0000","last_fullsized":"2024-03-23T23:42:40.689872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:03.196963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.028420+0000","last_change":"2024-03-23T23:42:39.688483+0000","last_active":"2024-03-23T23:42:42.028420+0000","last_peered":"2024-03-23T23:42:42.028420+0000","last_clean":"2024-03-23T23:42:42.028420+0000","last_became_active":"2024-03-23T23:42:39.688141+0000","last_became_peered":"2024-03-23T23:42:39.688141+0000","last_unstale":"2024-03-23T23:42:42.028420+0000","last_undegraded":"2024-03-23T23:42:42.028420+0000","last_fullsized":"2024-03-23T23:42:42.028420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:32.254099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.710870+0000","last_change":"2024-03-23T23:42:40.704046+0000","last_active":"2024-03-23T23:42:40.710870+0000","last_peered":"2024-03-23T23:42:40.710870+0000","last_clean":"2024-03-23T23:42:40.710870+0000","last_became_active":"2024-03-23T23:42:40.703787+0000","last_became_peered":"2024-03-23T23:42:40.703787+0000","last_unstale":"2024-03-23T23:42:40.710870+0000","last_undegraded":"2024-03-23T23:42:40.710870+0000","last_fullsized":"2024-03-23T23:42:40.710870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:07:29.242921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.670377+0000","last_change":"2024-03-23T23:42:39.681827+0000","last_active":"2024-03-23T23:42:41.670377+0000","last_peered":"2024-03-23T23:42:41.670377+0000","last_clean":"2024-03-23T23:42:41.670377+0000","last_became_active":"2024-03-23T23:42:39.681418+0000","last_became_peered":"2024-03-23T23:42:39.681418+0000","last_unstale":"2024-03-23T23:42:41.670377+0000","last_undegraded":"2024-03-23T23:42:41.670377+0000","last_fullsized":"2024-03-23T23:42:41.670377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:50.559059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.670541+0000","last_change":"2024-03-23T23:42:40.677314+0000","last_active":"2024-03-23T23:42:41.670541+0000","last_peered":"2024-03-23T23:42:41.670541+0000","last_clean":"2024-03-23T23:42:41.670541+0000","last_became_active":"2024-03-23T23:42:40.675416+0000","last_became_peered":"2024-03-23T23:42:40.675416+0000","last_unstale":"2024-03-23T23:42:41.670541+0000","last_undegraded":"2024-03-23T23:42:41.670541+0000","last_fullsized":"2024-03-23T23:42:41.670541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:01:06.338641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.705608+0000","last_change":"2024-03-23T23:42:39.676075+0000","last_active":"2024-03-23T23:42:40.705608+0000","last_peered":"2024-03-23T23:42:40.705608+0000","last_clean":"2024-03-23T23:42:40.705608+0000","last_became_active":"2024-03-23T23:42:39.675770+0000","last_became_peered":"2024-03-23T23:42:39.675770+0000","last_unstale":"2024-03-23T23:42:40.705608+0000","last_undegraded":"2024-03-23T23:42:40.705608+0000","last_fullsized":"2024-03-23T23:42:40.705608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:24:11.933075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.707662+0000","last_change":"2024-03-23T23:42:40.700961+0000","last_active":"2024-03-23T23:42:40.707662+0000","last_peered":"2024-03-23T23:42:40.707662+0000","last_clean":"2024-03-23T23:42:40.707662+0000","last_became_active":"2024-03-23T23:42:40.700800+0000","last_became_peered":"2024-03-23T23:42:40.700800+0000","last_unstale":"2024-03-23T23:42:40.707662+0000","last_undegraded":"2024-03-23T23:42:40.707662+0000","last_fullsized":"2024-03-23T23:42:40.707662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:34.630671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.670743+0000","last_change":"2024-03-23T23:42:39.686863+0000","last_active":"2024-03-23T23:42:41.670743+0000","last_peered":"2024-03-23T23:42:41.670743+0000","last_clean":"2024-03-23T23:42:41.670743+0000","last_became_active":"2024-03-23T23:42:39.686491+0000","last_became_peered":"2024-03-23T23:42:39.686491+0000","last_unstale":"2024-03-23T23:42:41.670743+0000","last_undegraded":"2024-03-23T23:42:41.670743+0000","last_fullsized":"2024-03-23T23:42:41.670743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:38:13.752628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.705190+0000","last_change":"2024-03-23T23:42:40.696584+0000","last_active":"2024-03-23T23:42:40.705190+0000","last_peered":"2024-03-23T23:42:40.705190+0000","last_clean":"2024-03-23T23:42:40.705190+0000","last_became_active":"2024-03-23T23:42:40.696141+0000","last_became_peered":"2024-03-23T23:42:40.696141+0000","last_unstale":"2024-03-23T23:42:40.705190+0000","last_undegraded":"2024-03-23T23:42:40.705190+0000","last_fullsized":"2024-03-23T23:42:40.705190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:31:34.412092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.701817+0000","last_change":"2024-03-23T23:42:39.681906+0000","last_active":"2024-03-23T23:42:40.701817+0000","last_peered":"2024-03-23T23:42:40.701817+0000","last_clean":"2024-03-23T23:42:40.701817+0000","last_became_active":"2024-03-23T23:42:39.680506+0000","last_became_peered":"2024-03-23T23:42:39.680506+0000","last_unstale":"2024-03-23T23:42:40.701817+0000","last_undegraded":"2024-03-23T23:42:40.701817+0000","last_fullsized":"2024-03-23T23:42:40.701817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:44:07.213123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.712259+0000","last_change":"2024-03-23T23:42:40.706713+0000","last_active":"2024-03-23T23:42:40.712259+0000","last_peered":"2024-03-23T23:42:40.712259+0000","last_clean":"2024-03-23T23:42:40.712259+0000","last_became_active":"2024-03-23T23:42:40.704328+0000","last_became_peered":"2024-03-23T23:42:40.704328+0000","last_unstale":"2024-03-23T23:42:40.712259+0000","last_undegraded":"2024-03-23T23:42:40.712259+0000","last_fullsized":"2024-03-23T23:42:40.712259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:27:03.132032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.710811+0000","last_change":"2024-03-23T23:42:39.681013+0000","last_active":"2024-03-23T23:42:40.710811+0000","last_peered":"2024-03-23T23:42:40.710811+0000","last_clean":"2024-03-23T23:42:40.710811+0000","last_became_active":"2024-03-23T23:42:39.680669+0000","last_became_peered":"2024-03-23T23:42:39.680669+0000","last_unstale":"2024-03-23T23:42:40.710811+0000","last_undegraded":"2024-03-23T23:42:40.710811+0000","last_fullsized":"2024-03-23T23:42:40.710811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:58:07.880313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.028112+0000","last_change":"2024-03-23T23:42:40.700124+0000","last_active":"2024-03-23T23:42:42.028112+0000","last_peered":"2024-03-23T23:42:42.028112+0000","last_clean":"2024-03-23T23:42:42.028112+0000","last_became_active":"2024-03-23T23:42:40.697369+0000","last_became_peered":"2024-03-23T23:42:40.697369+0000","last_unstale":"2024-03-23T23:42:42.028112+0000","last_undegraded":"2024-03-23T23:42:42.028112+0000","last_fullsized":"2024-03-23T23:42:42.028112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:20.981139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.679966+0000","last_change":"2024-03-23T23:42:39.684163+0000","last_active":"2024-03-23T23:42:40.679966+0000","last_peered":"2024-03-23T23:42:40.679966+0000","last_clean":"2024-03-23T23:42:40.679966+0000","last_became_active":"2024-03-23T23:42:39.683211+0000","last_became_peered":"2024-03-23T23:42:39.683211+0000","last_unstale":"2024-03-23T23:42:40.679966+0000","last_undegraded":"2024-03-23T23:42:40.679966+0000","last_fullsized":"2024-03-23T23:42:40.679966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:47:27.092873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.712923+0000","last_change":"2024-03-23T23:42:40.711591+0000","last_active":"2024-03-23T23:42:40.712923+0000","last_peered":"2024-03-23T23:42:40.712923+0000","last_clean":"2024-03-23T23:42:40.712923+0000","last_became_active":"2024-03-23T23:42:40.711306+0000","last_became_peered":"2024-03-23T23:42:40.711306+0000","last_unstale":"2024-03-23T23:42:40.712923+0000","last_undegraded":"2024-03-23T23:42:40.712923+0000","last_fullsized":"2024-03-23T23:42:40.712923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:26:16.171920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.679064+0000","last_change":"2024-03-23T23:42:27.940270+0000","last_active":"2024-03-23T23:42:40.679064+0000","last_peered":"2024-03-23T23:42:40.679064+0000","last_clean":"2024-03-23T23:42:40.679064+0000","last_became_active":"2024-03-23T23:42:27.939061+0000","last_became_peered":"2024-03-23T23:42:27.939061+0000","last_unstale":"2024-03-23T23:42:40.679064+0000","last_undegraded":"2024-03-23T23:42:40.679064+0000","last_fullsized":"2024-03-23T23:42:40.679064+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:26.509742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:26.509742+0000","last_clean_scrub_stamp":"2024-03-23T23:42:26.509742+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:49.258623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027475+0000","last_change":"2024-03-23T23:42:39.687712+0000","last_active":"2024-03-23T23:42:42.027475+0000","last_peered":"2024-03-23T23:42:42.027475+0000","last_clean":"2024-03-23T23:42:42.027475+0000","last_became_active":"2024-03-23T23:42:39.687378+0000","last_became_peered":"2024-03-23T23:42:39.687378+0000","last_unstale":"2024-03-23T23:42:42.027475+0000","last_undegraded":"2024-03-23T23:42:42.027475+0000","last_fullsized":"2024-03-23T23:42:42.027475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:20:38.456655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027483+0000","last_change":"2024-03-23T23:42:40.700998+0000","last_active":"2024-03-23T23:42:42.027483+0000","last_peered":"2024-03-23T23:42:42.027483+0000","last_clean":"2024-03-23T23:42:42.027483+0000","last_became_active":"2024-03-23T23:42:40.700788+0000","last_became_peered":"2024-03-23T23:42:40.700788+0000","last_unstale":"2024-03-23T23:42:42.027483+0000","last_undegraded":"2024-03-23T23:42:42.027483+0000","last_fullsized":"2024-03-23T23:42:42.027483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:14:44.739525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.679050+0000","last_change":"2024-03-23T23:42:39.690057+0000","last_active":"2024-03-23T23:42:40.679050+0000","last_peered":"2024-03-23T23:42:40.679050+0000","last_clean":"2024-03-23T23:42:40.679050+0000","last_became_active":"2024-03-23T23:42:39.689763+0000","last_became_peered":"2024-03-23T23:42:39.689763+0000","last_unstale":"2024-03-23T23:42:40.679050+0000","last_undegraded":"2024-03-23T23:42:40.679050+0000","last_fullsized":"2024-03-23T23:42:40.679050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:01.607584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.680529+0000","last_change":"2024-03-23T23:42:40.675570+0000","last_active":"2024-03-23T23:42:40.680529+0000","last_peered":"2024-03-23T23:42:40.680529+0000","last_clean":"2024-03-23T23:42:40.680529+0000","last_became_active":"2024-03-23T23:42:40.674390+0000","last_became_peered":"2024-03-23T23:42:40.674390+0000","last_unstale":"2024-03-23T23:42:40.680529+0000","last_undegraded":"2024-03-23T23:42:40.680529+0000","last_fullsized":"2024-03-23T23:42:40.680529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:58.293972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.680640+0000","last_change":"2024-03-23T23:42:39.680763+0000","last_active":"2024-03-23T23:42:40.680640+0000","last_peered":"2024-03-23T23:42:40.680640+0000","last_clean":"2024-03-23T23:42:40.680640+0000","last_became_active":"2024-03-23T23:42:39.680494+0000","last_became_peered":"2024-03-23T23:42:39.680494+0000","last_unstale":"2024-03-23T23:42:40.680640+0000","last_undegraded":"2024-03-23T23:42:40.680640+0000","last_fullsized":"2024-03-23T23:42:40.680640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:57.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.685752+0000","last_change":"2024-03-23T23:42:40.682840+0000","last_active":"2024-03-23T23:42:40.685752+0000","last_peered":"2024-03-23T23:42:40.685752+0000","last_clean":"2024-03-23T23:42:40.685752+0000","last_became_active":"2024-03-23T23:42:40.682391+0000","last_became_peered":"2024-03-23T23:42:40.682391+0000","last_unstale":"2024-03-23T23:42:40.685752+0000","last_undegraded":"2024-03-23T23:42:40.685752+0000","last_fullsized":"2024-03-23T23:42:40.685752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:51:30.695597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.028496+0000","last_change":"2024-03-23T23:42:39.679741+0000","last_active":"2024-03-23T23:42:42.028496+0000","last_peered":"2024-03-23T23:42:42.028496+0000","last_clean":"2024-03-23T23:42:42.028496+0000","last_became_active":"2024-03-23T23:42:39.678864+0000","last_became_peered":"2024-03-23T23:42:39.678864+0000","last_unstale":"2024-03-23T23:42:42.028496+0000","last_undegraded":"2024-03-23T23:42:42.028496+0000","last_fullsized":"2024-03-23T23:42:42.028496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:50.559059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.671555+0000","last_change":"2024-03-23T23:42:40.679988+0000","last_active":"2024-03-23T23:42:41.671555+0000","last_peered":"2024-03-23T23:42:41.671555+0000","last_clean":"2024-03-23T23:42:41.671555+0000","last_became_active":"2024-03-23T23:42:40.679488+0000","last_became_peered":"2024-03-23T23:42:40.679488+0000","last_unstale":"2024-03-23T23:42:41.671555+0000","last_undegraded":"2024-03-23T23:42:41.671555+0000","last_fullsized":"2024-03-23T23:42:41.671555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:10:32.251287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.673707+0000","last_change":"2024-03-23T23:42:39.686509+0000","last_active":"2024-03-23T23:42:40.673707+0000","last_peered":"2024-03-23T23:42:40.673707+0000","last_clean":"2024-03-23T23:42:40.673707+0000","last_became_active":"2024-03-23T23:42:39.686094+0000","last_became_peered":"2024-03-23T23:42:39.686094+0000","last_unstale":"2024-03-23T23:42:40.673707+0000","last_undegraded":"2024-03-23T23:42:40.673707+0000","last_fullsized":"2024-03-23T23:42:40.673707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:57:20.394530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027956+0000","last_change":"2024-03-23T23:42:40.700610+0000","last_active":"2024-03-23T23:42:42.027956+0000","last_peered":"2024-03-23T23:42:42.027956+0000","last_clean":"2024-03-23T23:42:42.027956+0000","last_became_active":"2024-03-23T23:42:40.700112+0000","last_became_peered":"2024-03-23T23:42:40.700112+0000","last_unstale":"2024-03-23T23:42:42.027956+0000","last_undegraded":"2024-03-23T23:42:42.027956+0000","last_fullsized":"2024-03-23T23:42:42.027956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:07:49.169416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.681543+0000","last_change":"2024-03-23T23:42:39.695099+0000","last_active":"2024-03-23T23:42:40.681543+0000","last_peered":"2024-03-23T23:42:40.681543+0000","last_clean":"2024-03-23T23:42:40.681543+0000","last_became_active":"2024-03-23T23:42:39.694720+0000","last_became_peered":"2024-03-23T23:42:39.694720+0000","last_unstale":"2024-03-23T23:42:40.681543+0000","last_undegraded":"2024-03-23T23:42:40.681543+0000","last_fullsized":"2024-03-23T23:42:40.681543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:58:07.880313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.688244+0000","last_change":"2024-03-23T23:42:40.686486+0000","last_active":"2024-03-23T23:42:40.688244+0000","last_peered":"2024-03-23T23:42:40.688244+0000","last_clean":"2024-03-23T23:42:40.688244+0000","last_became_active":"2024-03-23T23:42:40.686186+0000","last_became_peered":"2024-03-23T23:42:40.686186+0000","last_unstale":"2024-03-23T23:42:40.688244+0000","last_undegraded":"2024-03-23T23:42:40.688244+0000","last_fullsized":"2024-03-23T23:42:40.688244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:07:29.242921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.677155+0000","last_change":"2024-03-23T23:42:39.678962+0000","last_active":"2024-03-23T23:42:40.677155+0000","last_peered":"2024-03-23T23:42:40.677155+0000","last_clean":"2024-03-23T23:42:40.677155+0000","last_became_active":"2024-03-23T23:42:39.678603+0000","last_became_peered":"2024-03-23T23:42:39.678603+0000","last_unstale":"2024-03-23T23:42:40.677155+0000","last_undegraded":"2024-03-23T23:42:40.677155+0000","last_fullsized":"2024-03-23T23:42:40.677155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:43:46.206865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.028942+0000","last_change":"2024-03-23T23:42:40.686865+0000","last_active":"2024-03-23T23:42:42.028942+0000","last_peered":"2024-03-23T23:42:42.028942+0000","last_clean":"2024-03-23T23:42:42.028942+0000","last_became_active":"2024-03-23T23:42:40.686582+0000","last_became_peered":"2024-03-23T23:42:40.686582+0000","last_unstale":"2024-03-23T23:42:42.028942+0000","last_undegraded":"2024-03-23T23:42:42.028942+0000","last_fullsized":"2024-03-23T23:42:42.028942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:05:17.694245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.671492+0000","last_change":"2024-03-23T23:42:39.691813+0000","last_active":"2024-03-23T23:42:41.671492+0000","last_peered":"2024-03-23T23:42:41.671492+0000","last_clean":"2024-03-23T23:42:41.671492+0000","last_became_active":"2024-03-23T23:42:39.691519+0000","last_became_peered":"2024-03-23T23:42:39.691519+0000","last_unstale":"2024-03-23T23:42:41.671492+0000","last_undegraded":"2024-03-23T23:42:41.671492+0000","last_fullsized":"2024-03-23T23:42:41.671492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:27:41.386662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.684136+0000","last_change":"2024-03-23T23:42:40.680963+0000","last_active":"2024-03-23T23:42:40.684136+0000","last_peered":"2024-03-23T23:42:40.684136+0000","last_clean":"2024-03-23T23:42:40.684136+0000","last_became_active":"2024-03-23T23:42:40.680744+0000","last_became_peered":"2024-03-23T23:42:40.680744+0000","last_unstale":"2024-03-23T23:42:40.684136+0000","last_undegraded":"2024-03-23T23:42:40.684136+0000","last_fullsized":"2024-03-23T23:42:40.684136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:58:08.886365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.678997+0000","last_change":"2024-03-23T23:42:39.695253+0000","last_active":"2024-03-23T23:42:40.678997+0000","last_peered":"2024-03-23T23:42:40.678997+0000","last_clean":"2024-03-23T23:42:40.678997+0000","last_became_active":"2024-03-23T23:42:39.694746+0000","last_became_peered":"2024-03-23T23:42:39.694746+0000","last_unstale":"2024-03-23T23:42:40.678997+0000","last_undegraded":"2024-03-23T23:42:40.678997+0000","last_fullsized":"2024-03-23T23:42:40.678997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:57.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.671241+0000","last_change":"2024-03-23T23:42:40.685051+0000","last_active":"2024-03-23T23:42:41.671241+0000","last_peered":"2024-03-23T23:42:41.671241+0000","last_clean":"2024-03-23T23:42:41.671241+0000","last_became_active":"2024-03-23T23:42:40.684677+0000","last_became_peered":"2024-03-23T23:42:40.684677+0000","last_unstale":"2024-03-23T23:42:41.671241+0000","last_undegraded":"2024-03-23T23:42:41.671241+0000","last_fullsized":"2024-03-23T23:42:41.671241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:20.920978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.669786+0000","last_change":"2024-03-23T23:42:39.691470+0000","last_active":"2024-03-23T23:42:40.669786+0000","last_peered":"2024-03-23T23:42:40.669786+0000","last_clean":"2024-03-23T23:42:40.669786+0000","last_became_active":"2024-03-23T23:42:39.691124+0000","last_became_peered":"2024-03-23T23:42:39.691124+0000","last_unstale":"2024-03-23T23:42:40.669786+0000","last_undegraded":"2024-03-23T23:42:40.669786+0000","last_fullsized":"2024-03-23T23:42:40.669786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:55.757707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027746+0000","last_change":"2024-03-23T23:42:40.682999+0000","last_active":"2024-03-23T23:42:42.027746+0000","last_peered":"2024-03-23T23:42:42.027746+0000","last_clean":"2024-03-23T23:42:42.027746+0000","last_became_active":"2024-03-23T23:42:40.682672+0000","last_became_peered":"2024-03-23T23:42:40.682672+0000","last_unstale":"2024-03-23T23:42:42.027746+0000","last_undegraded":"2024-03-23T23:42:42.027746+0000","last_fullsized":"2024-03-23T23:42:42.027746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:59:45.154553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.672422+0000","last_change":"2024-03-23T23:42:39.683165+0000","last_active":"2024-03-23T23:42:40.672422+0000","last_peered":"2024-03-23T23:42:40.672422+0000","last_clean":"2024-03-23T23:42:40.672422+0000","last_became_active":"2024-03-23T23:42:39.680121+0000","last_became_peered":"2024-03-23T23:42:39.680121+0000","last_unstale":"2024-03-23T23:42:40.672422+0000","last_undegraded":"2024-03-23T23:42:40.672422+0000","last_fullsized":"2024-03-23T23:42:40.672422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:02.190910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027694+0000","last_change":"2024-03-23T23:42:40.674574+0000","last_active":"2024-03-23T23:42:42.027694+0000","last_peered":"2024-03-23T23:42:42.027694+0000","last_clean":"2024-03-23T23:42:42.027694+0000","last_became_active":"2024-03-23T23:42:40.674293+0000","last_became_peered":"2024-03-23T23:42:40.674293+0000","last_unstale":"2024-03-23T23:42:42.027694+0000","last_undegraded":"2024-03-23T23:42:42.027694+0000","last_fullsized":"2024-03-23T23:42:42.027694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:37:24.839568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.712874+0000","last_change":"2024-03-23T23:42:39.696528+0000","last_active":"2024-03-23T23:42:40.712874+0000","last_peered":"2024-03-23T23:42:40.712874+0000","last_clean":"2024-03-23T23:42:40.712874+0000","last_became_active":"2024-03-23T23:42:39.696207+0000","last_became_peered":"2024-03-23T23:42:39.696207+0000","last_unstale":"2024-03-23T23:42:40.712874+0000","last_undegraded":"2024-03-23T23:42:40.712874+0000","last_fullsized":"2024-03-23T23:42:40.712874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:02.190910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:41.670776+0000","last_change":"2024-03-23T23:42:40.682467+0000","last_active":"2024-03-23T23:42:41.670776+0000","last_peered":"2024-03-23T23:42:41.670776+0000","last_clean":"2024-03-23T23:42:41.670776+0000","last_became_active":"2024-03-23T23:42:40.682192+0000","last_became_peered":"2024-03-23T23:42:40.682192+0000","last_unstale":"2024-03-23T23:42:41.670776+0000","last_undegraded":"2024-03-23T23:42:41.670776+0000","last_fullsized":"2024-03-23T23:42:41.670776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:37:24.839568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027814+0000","last_change":"2024-03-23T23:42:40.700389+0000","last_active":"2024-03-23T23:42:42.027814+0000","last_peered":"2024-03-23T23:42:42.027814+0000","last_clean":"2024-03-23T23:42:42.027814+0000","last_became_active":"2024-03-23T23:42:40.699770+0000","last_became_peered":"2024-03-23T23:42:40.699770+0000","last_unstale":"2024-03-23T23:42:42.027814+0000","last_undegraded":"2024-03-23T23:42:42.027814+0000","last_fullsized":"2024-03-23T23:42:42.027814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:27.675824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.714743+0000","last_change":"2024-03-23T23:42:39.696707+0000","last_active":"2024-03-23T23:42:40.714743+0000","last_peered":"2024-03-23T23:42:40.714743+0000","last_clean":"2024-03-23T23:42:40.714743+0000","last_became_active":"2024-03-23T23:42:39.696401+0000","last_became_peered":"2024-03-23T23:42:39.696401+0000","last_unstale":"2024-03-23T23:42:40.714743+0000","last_undegraded":"2024-03-23T23:42:40.714743+0000","last_fullsized":"2024-03-23T23:42:40.714743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:55.757707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.027976+0000","last_change":"2024-03-23T23:42:40.700355+0000","last_active":"2024-03-23T23:42:42.027976+0000","last_peered":"2024-03-23T23:42:42.027976+0000","last_clean":"2024-03-23T23:42:42.027976+0000","last_became_active":"2024-03-23T23:42:40.697668+0000","last_became_peered":"2024-03-23T23:42:40.697668+0000","last_unstale":"2024-03-23T23:42:42.027976+0000","last_undegraded":"2024-03-23T23:42:42.027976+0000","last_fullsized":"2024-03-23T23:42:42.027976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:23:43.515519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.712024+0000","last_change":"2024-03-23T23:42:39.696690+0000","last_active":"2024-03-23T23:42:40.712024+0000","last_peered":"2024-03-23T23:42:40.712024+0000","last_clean":"2024-03-23T23:42:40.712024+0000","last_became_active":"2024-03-23T23:42:39.696342+0000","last_became_peered":"2024-03-23T23:42:39.696342+0000","last_unstale":"2024-03-23T23:42:40.712024+0000","last_undegraded":"2024-03-23T23:42:40.712024+0000","last_fullsized":"2024-03-23T23:42:40.712024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:42:37.702720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.702002+0000","last_change":"2024-03-23T23:42:40.698746+0000","last_active":"2024-03-23T23:42:40.702002+0000","last_peered":"2024-03-23T23:42:40.702002+0000","last_clean":"2024-03-23T23:42:40.702002+0000","last_became_active":"2024-03-23T23:42:40.698003+0000","last_became_peered":"2024-03-23T23:42:40.698003+0000","last_unstale":"2024-03-23T23:42:40.702002+0000","last_undegraded":"2024-03-23T23:42:40.702002+0000","last_fullsized":"2024-03-23T23:42:40.702002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:43:47.212917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.028810+0000","last_change":"2024-03-23T23:42:39.687108+0000","last_active":"2024-03-23T23:42:42.028810+0000","last_peered":"2024-03-23T23:42:42.028810+0000","last_clean":"2024-03-23T23:42:42.028810+0000","last_became_active":"2024-03-23T23:42:39.686875+0000","last_became_peered":"2024-03-23T23:42:39.686875+0000","last_unstale":"2024-03-23T23:42:42.028810+0000","last_undegraded":"2024-03-23T23:42:42.028810+0000","last_fullsized":"2024-03-23T23:42:42.028810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:05:52.079172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:42:42.028817+0000","last_change":"2024-03-23T23:42:40.685708+0000","last_active":"2024-03-23T23:42:42.028817+0000","last_peered":"2024-03-23T23:42:42.028817+0000","last_clean":"2024-03-23T23:42:42.028817+0000","last_became_active":"2024-03-23T23:42:40.682755+0000","last_became_peered":"2024-03-23T23:42:40.682755+0000","last_unstale":"2024-03-23T23:42:42.028817+0000","last_undegraded":"2024-03-23T23:42:42.028817+0000","last_fullsized":"2024-03-23T23:42:42.028817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:04.633288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-23T23:42:40.711880+0000","last_change":"2024-03-23T23:42:39.693858+0000","last_active":"2024-03-23T23:42:40.711880+0000","last_peered":"2024-03-23T23:42:40.711880+0000","last_clean":"2024-03-23T23:42:40.711880+0000","last_became_active":"2024-03-23T23:42:39.693636+0000","last_became_peered":"2024-03-23T23:42:39.693636+0000","last_unstale":"2024-03-23T23:42:40.711880+0000","last_undegraded":"2024-03-23T23:42:40.711880+0000","last_fullsized":"2024-03-23T23:42:40.711880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:44:07.213123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":74427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":66630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":72941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":221184,"data_stored":74427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":794624,"data_stored":657490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":196608,"data_stored":66540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":184320,"data_stored":59795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":802816,"data_stored":657546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T23:42:46.193 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-23T23:42:46.194 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:42:46.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.373+0000 7f163ba00640 1 Processor -- start 2024-03-23T23:42:46.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.373+0000 7f163ba00640 1 -- start start 2024-03-23T23:42:46.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.373+0000 7f163ba00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f163414d8b0 0x7f16340c7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:46.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.373+0000 7f163ba00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f16340c5560 0x7f163406ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:46.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.373+0000 7f163ba00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16340c7670 con 0x7f1634070b50 2024-03-23T23:42:46.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.373+0000 7f163ba00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16340c4830 con 0x7f163414d8b0 2024-03-23T23:42:46.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.373+0000 7f163ba00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16340c50d0 con 0x7f16340c5560 2024-03-23T23:42:46.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.373+0000 7f1639000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f163414d8b0 0x7f16340c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:46.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.373+0000 7f1639000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f163414d8b0 0x7f16340c7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51780/0 (socket says 172.21.15.8:51780) 2024-03-23T23:42:46.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.373+0000 7f1639000640 1 -- 172.21.15.8:0/1752345319 learned_addr learned my addr 172.21.15.8:0/1752345319 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:46.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.373+0000 7f1639a00640 1 --2- 172.21.15.8:0/1752345319 >> v2:172.21.15.196:3300/0 conn(0x7f16340c5560 0x7f163406ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:46.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.373+0000 7f1639000640 1 -- 172.21.15.8:0/1752345319 >> v2:172.21.15.196:3300/0 conn(0x7f16340c5560 msgr2=0x7f163406ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:46.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.373+0000 7f1639000640 1 --2- 172.21.15.8:0/1752345319 >> v2:172.21.15.196:3300/0 conn(0x7f16340c5560 0x7f163406ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:46.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.373+0000 7f1639000640 1 -- 172.21.15.8:0/1752345319 >> v1:172.21.15.196:6789/0 conn(0x7f1634070b50 legacy=0x7f16341541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:46.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.373+0000 7f1639000640 1 -- 172.21.15.8:0/1752345319 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16340710e0 con 0x7f163414d8b0 2024-03-23T23:42:46.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.377+0000 7f1639000640 1 --2- 172.21.15.8:0/1752345319 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f163414d8b0 0x7f16340c7130 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1634067920 tx=0x7f162801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b17f2b39e1e3f006 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:46.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.377+0000 7f1633400640 1 -- 172.21.15.8:0/1752345319 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16280b0070 con 0x7f163414d8b0 2024-03-23T23:42:46.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.377+0000 7f1633400640 1 -- 172.21.15.8:0/1752345319 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16280ab600 con 0x7f163414d8b0 2024-03-23T23:42:46.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.377+0000 7f1633400640 1 -- 172.21.15.8:0/1752345319 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16280ab9d0 con 0x7f163414d8b0 2024-03-23T23:42:46.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.377+0000 7f163ba00640 1 -- 172.21.15.8:0/1752345319 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f163414d8b0 msgr2=0x7f16340c7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:46.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.377+0000 7f163ba00640 1 --2- 172.21.15.8:0/1752345319 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f163414d8b0 0x7f16340c7130 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1634067920 tx=0x7f162801c520 comp rx=0 tx=0).stop 2024-03-23T23:42:46.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.377+0000 7f163ba00640 1 -- 172.21.15.8:0/1752345319 shutdown_connections 2024-03-23T23:42:46.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.377+0000 7f163ba00640 1 --2- 172.21.15.8:0/1752345319 >> v2:172.21.15.196:3300/0 conn(0x7f16340c5560 0x7f163406ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:46.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.377+0000 7f163ba00640 1 --2- 172.21.15.8:0/1752345319 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f163414d8b0 0x7f16340c7130 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:46.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.377+0000 7f163ba00640 1 -- 172.21.15.8:0/1752345319 >> 172.21.15.8:0/1752345319 conn(0x7f16340aafe0 msgr2=0x7f16340ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:46.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.377+0000 7f163ba00640 1 -- 172.21.15.8:0/1752345319 shutdown_connections 2024-03-23T23:42:46.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.377+0000 7f163ba00640 1 -- 172.21.15.8:0/1752345319 wait complete. 2024-03-23T23:42:46.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.377+0000 7f163ba00640 1 Processor -- start 2024-03-23T23:42:46.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.381+0000 7f163ba00640 1 -- start start 2024-03-23T23:42:46.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.381+0000 7f163ba00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1634070b50 0x7f163414bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:46.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.381+0000 7f163ba00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f16340c5560 0x7f16341f1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:46.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.381+0000 7f163ba00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f163414d8b0 0x7f16341f2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:46.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.381+0000 7f163ba00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1634160a50 con 0x7f163414d8b0 2024-03-23T23:42:46.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.381+0000 7f163ba00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16341608d0 con 0x7f1634070b50 2024-03-23T23:42:46.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.381+0000 7f163ba00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1634160bd0 con 0x7f16340c5560 2024-03-23T23:42:46.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.381+0000 7f1639a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f163414d8b0 0x7f16341f2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:46.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.381+0000 7f1639a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f163414d8b0 0x7f16341f2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51786/0 (socket says 172.21.15.8:51786) 2024-03-23T23:42:46.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.381+0000 7f1639a00640 1 -- 172.21.15.8:0/3970144591 learned_addr learned my addr 172.21.15.8:0/3970144591 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:46.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.381+0000 7f1639000640 1 --2- 172.21.15.8:0/3970144591 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1634070b50 0x7f163414bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:46.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.381+0000 7f1633e00640 1 --2- 172.21.15.8:0/3970144591 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f16340c5560 0x7f16341f1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:46.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.381+0000 7f1639a00640 1 -- 172.21.15.8:0/3970144591 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f16340c5560 msgr2=0x7f16341f1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:46.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.381+0000 7f1639a00640 1 --2- 172.21.15.8:0/3970144591 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f16340c5560 0x7f16341f1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:46.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.381+0000 7f1639a00640 1 -- 172.21.15.8:0/3970144591 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1634070b50 msgr2=0x7f163414bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:46.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.381+0000 7f1639a00640 1 --2- 172.21.15.8:0/3970144591 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1634070b50 0x7f163414bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:46.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.381+0000 7f1639a00640 1 -- 172.21.15.8:0/3970144591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163414d130 con 0x7f163414d8b0 2024-03-23T23:42:46.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.381+0000 7f1639a00640 1 --2- 172.21.15.8:0/3970144591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f163414d8b0 0x7f16341f2240 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f162c00efc0 tx=0x7f162c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:46.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.381+0000 7f1630c00640 1 -- 172.21.15.8:0/3970144591 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162c018020 con 0x7f163414d8b0 2024-03-23T23:42:46.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.381+0000 7f1630c00640 1 -- 172.21.15.8:0/3970144591 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162c014480 con 0x7f163414d8b0 2024-03-23T23:42:46.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.381+0000 7f163ba00640 1 -- 172.21.15.8:0/3970144591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f163406e2c0 con 0x7f163414d8b0 2024-03-23T23:42:46.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.381+0000 7f1630c00640 1 -- 172.21.15.8:0/3970144591 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162c014870 con 0x7f163414d8b0 2024-03-23T23:42:46.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.381+0000 7f163ba00640 1 -- 172.21.15.8:0/3970144591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16341ef320 con 0x7f163414d8b0 2024-03-23T23:42:46.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.381+0000 7f163ba00640 1 -- 172.21.15.8:0/3970144591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16340aeba0 con 0x7f163414d8b0 2024-03-23T23:42:46.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.385+0000 7f1630c00640 1 -- 172.21.15.8:0/3970144591 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f162c01b020 con 0x7f163414d8b0 2024-03-23T23:42:46.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.385+0000 7f1630c00640 1 --2- 172.21.15.8:0/3970144591 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1614067660 0x7f1614069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:46.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.385+0000 7f1630c00640 1 -- 172.21.15.8:0/3970144591 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5689+0+0 (secure 0 0 0) 0x7f162c0861b0 con 0x7f163414d8b0 2024-03-23T23:42:46.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.385+0000 7f1639000640 1 --2- 172.21.15.8:0/3970144591 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1614067660 0x7f1614069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:46.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.385+0000 7f1639000640 1 --2- 172.21.15.8:0/3970144591 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1614067660 0x7f1614069b20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f16280ad000 tx=0x7f16280a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:46.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.389+0000 7f1630c00640 1 -- 172.21.15.8:0/3970144591 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f162c022070 con 0x7f163414d8b0 2024-03-23T23:42:46.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.553+0000 7f163ba00640 1 -- 172.21.15.8:0/3970144591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1634068270 con 0x7f163414d8b0 2024-03-23T23:42:46.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.553+0000 7f1630c00640 1 -- 172.21.15.8:0/3970144591 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16513 (secure 0 0 0) 0x7f162c010040 con 0x7f163414d8b0 2024-03-23T23:42:46.555 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:42:46.555 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":21,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","created":"2024-03-23T23:42:15.169430+0000","modified":"2024-03-23T23:42:41.661787+0000","last_up_change":"2024-03-23T23:42:26.509742+0000","last_in_change":"2024-03-23T23:42:17.662330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:42:26.327445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-23T23:42:38.218800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-23T23:42:39.054195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e967bf31-21d6-4d11-bc3d-0df8177a1b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6809","nonce":2187201732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6811","nonce":2187201732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6815","nonce":2187201732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6813","nonce":2187201732}]},"public_addr":"172.21.15.8:6809/2187201732","cluster_addr":"172.21.15.8:6811/2187201732","heartbeat_back_addr":"172.21.15.8:6815/2187201732","heartbeat_front_addr":"172.21.15.8:6813/2187201732","state":["exists","up"]},{"osd":1,"uuid":"c8e33701-7acd-4474-8402-d52461171fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6818","nonce":3205168010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6822","nonce":3205168010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6830","nonce":3205168010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6826","nonce":3205168010}]},"public_addr":"172.21.15.8:6818/3205168010","cluster_addr":"172.21.15.8:6822/3205168010","heartbeat_back_addr":"172.21.15.8:6830/3205168010","heartbeat_front_addr":"172.21.15.8:6826/3205168010","state":["exists","up"]},{"osd":2,"uuid":"ceebdbf7-4c2f-4757-b52d-fd8b20e77570","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6801","nonce":475463656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6803","nonce":475463656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6807","nonce":475463656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6805","nonce":475463656}]},"public_addr":"172.21.15.8:6801/475463656","cluster_addr":"172.21.15.8:6803/475463656","heartbeat_back_addr":"172.21.15.8:6807/475463656","heartbeat_front_addr":"172.21.15.8:6805/475463656","state":["exists","up"]},{"osd":3,"uuid":"89e258da-5767-429e-8441-edf877d2f3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6819","nonce":1514082871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6821","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6823","nonce":1514082871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6829","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6831","nonce":1514082871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6825","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6827","nonce":1514082871}]},"public_addr":"172.21.15.8:6819/1514082871","cluster_addr":"172.21.15.8:6823/1514082871","heartbeat_back_addr":"172.21.15.8:6831/1514082871","heartbeat_front_addr":"172.21.15.8:6827/1514082871","state":["exists","up"]},{"osd":4,"uuid":"2b7451ae-ea16-4f0a-ae50-04fde75e45ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6825","nonce":3516578147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6827","nonce":3516578147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6831","nonce":3516578147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6829","nonce":3516578147}]},"public_addr":"172.21.15.196:6825/3516578147","cluster_addr":"172.21.15.196:6827/3516578147","heartbeat_back_addr":"172.21.15.196:6831/3516578147","heartbeat_front_addr":"172.21.15.196:6829/3516578147","state":["exists","up"]},{"osd":5,"uuid":"e68a8914-e591-466a-bc9e-f2d7c67aac13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6802","nonce":830595758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6806","nonce":830595758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6814","nonce":830595758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6810","nonce":830595758}]},"public_addr":"172.21.15.196:6802/830595758","cluster_addr":"172.21.15.196:6806/830595758","heartbeat_back_addr":"172.21.15.196:6814/830595758","heartbeat_front_addr":"172.21.15.196:6810/830595758","state":["exists","up"]},{"osd":6,"uuid":"e47723c5-50a0-4cd8-92d9-01972072b422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6801","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6803","nonce":472639906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6805","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6807","nonce":472639906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6815","nonce":472639906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6811","nonce":472639906}]},"public_addr":"172.21.15.196:6803/472639906","cluster_addr":"172.21.15.196:6807/472639906","heartbeat_back_addr":"172.21.15.196:6815/472639906","heartbeat_front_addr":"172.21.15.196:6811/472639906","state":["exists","up"]},{"osd":7,"uuid":"e1e9113d-8005-47b3-9a75-9e701199f1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6817","nonce":4151820349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6819","nonce":4151820349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6823","nonce":4151820349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6821","nonce":4151820349}]},"public_addr":"172.21.15.196:6817/4151820349","cluster_addr":"172.21.15.196:6819/4151820349","heartbeat_back_addr":"172.21.15.196:6823/4151820349","heartbeat_front_addr":"172.21.15.196:6821/4151820349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.221790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.265974+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.190319+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.376359+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.329657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.402958+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.300703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.133121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:42:46.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.557+0000 7f163ba00640 1 -- 172.21.15.8:0/3970144591 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1614067660 msgr2=0x7f1614069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:46.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.557+0000 7f163ba00640 1 --2- 172.21.15.8:0/3970144591 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1614067660 0x7f1614069b20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f16280ad000 tx=0x7f16280a6000 comp rx=0 tx=0).stop 2024-03-23T23:42:46.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.557+0000 7f163ba00640 1 -- 172.21.15.8:0/3970144591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f163414d8b0 msgr2=0x7f16341f2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:46.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.557+0000 7f163ba00640 1 --2- 172.21.15.8:0/3970144591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f163414d8b0 0x7f16341f2240 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f162c00efc0 tx=0x7f162c00c490 comp rx=0 tx=0).stop 2024-03-23T23:42:46.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.557+0000 7f163ba00640 1 -- 172.21.15.8:0/3970144591 shutdown_connections 2024-03-23T23:42:46.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.557+0000 7f163ba00640 1 --2- 172.21.15.8:0/3970144591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f163414d8b0 0x7f16341f2240 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:46.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.557+0000 7f163ba00640 1 --2- 172.21.15.8:0/3970144591 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1614067660 0x7f1614069b20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:46.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.557+0000 7f163ba00640 1 --2- 172.21.15.8:0/3970144591 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f16340c5560 0x7f16341f1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:46.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.557+0000 7f163ba00640 1 --2- 172.21.15.8:0/3970144591 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1634070b50 0x7f163414bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:46.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.557+0000 7f163ba00640 1 -- 172.21.15.8:0/3970144591 >> 172.21.15.8:0/3970144591 conn(0x7f16340aafe0 msgr2=0x7f163414ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:46.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.557+0000 7f163ba00640 1 -- 172.21.15.8:0/3970144591 shutdown_connections 2024-03-23T23:42:46.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.557+0000 7f163ba00640 1 -- 172.21.15.8:0/3970144591 wait complete. 2024-03-23T23:42:46.577 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-23T23:42:26.327445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-03-23T23:42:38.218800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-03-23T23:42:39.054195+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-23T23:42:46.578 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-23T23:42:46.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.721+0000 7fab57200640 1 Processor -- start 2024-03-23T23:42:46.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.721+0000 7fab57200640 1 -- start start 2024-03-23T23:42:46.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.725+0000 7fab57200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fab5006dab0 0x7fab50156580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:46.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.725+0000 7fab57200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fab500aab90 0x7fab50152670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:46.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.725+0000 7fab57200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab50156ac0 con 0x7fab5006d300 2024-03-23T23:42:46.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.725+0000 7fab57200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab5006e6f0 con 0x7fab500aab90 2024-03-23T23:42:46.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.725+0000 7fab57200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab501560f0 con 0x7fab5006dab0 2024-03-23T23:42:46.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.725+0000 7fab47400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fab500aab90 0x7fab50152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:46.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.725+0000 7fab55200640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fab5006d300 0x7fab5014f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:55986/0 (socket says 172.21.15.8:55986) 2024-03-23T23:42:46.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.725+0000 7fab55200640 1 -- 172.21.15.8:0/2275679955 learned_addr learned my addr 172.21.15.8:0/2275679955 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:46.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.725+0000 7fab47400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fab500aab90 0x7fab50152670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51796/0 (socket says 172.21.15.8:51796) 2024-03-23T23:42:46.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.725+0000 7fab4fe00640 1 --2- 172.21.15.8:0/2275679955 >> v2:172.21.15.196:3300/0 conn(0x7fab5006dab0 0x7fab50156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:46.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.725+0000 7fab47400640 1 -- 172.21.15.8:0/2275679955 >> v2:172.21.15.196:3300/0 conn(0x7fab5006dab0 msgr2=0x7fab50156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:46.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.725+0000 7fab47400640 1 --2- 172.21.15.8:0/2275679955 >> v2:172.21.15.196:3300/0 conn(0x7fab5006dab0 0x7fab50156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:46.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.725+0000 7fab47400640 1 -- 172.21.15.8:0/2275679955 >> v1:172.21.15.8:6789/0 conn(0x7fab5006d300 legacy=0x7fab5014f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:46.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.725+0000 7fab47400640 1 -- 172.21.15.8:0/2275679955 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5006e940 con 0x7fab500aab90 2024-03-23T23:42:46.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.725+0000 7fab4f400640 1 -- 172.21.15.8:0/2275679955 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2468220683 0 0) 0x7fab50156ac0 con 0x7fab5006d300 2024-03-23T23:42:46.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.729+0000 7fab47400640 1 --2- 172.21.15.8:0/2275679955 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab500aab90 0x7fab50152670 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fab5006f4f0 tx=0x7fab3801eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a9bfcc8e373403b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:46.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.729+0000 7fab4f400640 1 -- 172.21.15.8:0/2275679955 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab380b4070 con 0x7fab500aab90 2024-03-23T23:42:46.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.729+0000 7fab4f400640 1 -- 172.21.15.8:0/2275679955 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab380a7af0 con 0x7fab500aab90 2024-03-23T23:42:46.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.729+0000 7fab4f400640 1 -- 172.21.15.8:0/2275679955 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab380af440 con 0x7fab500aab90 2024-03-23T23:42:46.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.729+0000 7fab57200640 1 -- 172.21.15.8:0/2275679955 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab500aab90 msgr2=0x7fab50152670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:46.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.729+0000 7fab57200640 1 --2- 172.21.15.8:0/2275679955 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab500aab90 0x7fab50152670 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fab5006f4f0 tx=0x7fab3801eb20 comp rx=0 tx=0).stop 2024-03-23T23:42:46.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.729+0000 7fab57200640 1 -- 172.21.15.8:0/2275679955 shutdown_connections 2024-03-23T23:42:46.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.729+0000 7fab57200640 1 --2- 172.21.15.8:0/2275679955 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab500aab90 0x7fab50152670 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:46.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.729+0000 7fab57200640 1 --2- 172.21.15.8:0/2275679955 >> v2:172.21.15.196:3300/0 conn(0x7fab5006dab0 0x7fab50156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:46.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.729+0000 7fab57200640 1 -- 172.21.15.8:0/2275679955 >> 172.21.15.8:0/2275679955 conn(0x7fab5006b170 msgr2=0x7fab5006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:46.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.729+0000 7fab57200640 1 -- 172.21.15.8:0/2275679955 shutdown_connections 2024-03-23T23:42:46.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.729+0000 7fab57200640 1 -- 172.21.15.8:0/2275679955 wait complete. 2024-03-23T23:42:46.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.729+0000 7fab57200640 1 Processor -- start 2024-03-23T23:42:46.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.729+0000 7fab57200640 1 -- start start 2024-03-23T23:42:46.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.729+0000 7fab57200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab5006d300 0x7fab5014e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:46.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.729+0000 7fab57200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fab5006dab0 0x7fab50147f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:46.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.729+0000 7fab57200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fab500aab90 0x7fab501484d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:46.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.729+0000 7fab57200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5014ffc0 con 0x7fab5006d300 2024-03-23T23:42:46.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.729+0000 7fab57200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab50152bb0 con 0x7fab5006dab0 2024-03-23T23:42:46.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.729+0000 7fab57200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5014f350 con 0x7fab500aab90 2024-03-23T23:42:46.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.729+0000 7fab4fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab5006d300 0x7fab5014e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:46.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.733+0000 7fab4fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab5006d300 0x7fab5014e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51810/0 (socket says 172.21.15.8:51810) 2024-03-23T23:42:46.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.733+0000 7fab4fe00640 1 -- 172.21.15.8:0/279664449 learned_addr learned my addr 172.21.15.8:0/279664449 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:46.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.733+0000 7fab47400640 1 --2- 172.21.15.8:0/279664449 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fab5006dab0 0x7fab50147f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:46.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.733+0000 7fab55200640 1 --2- 172.21.15.8:0/279664449 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fab500aab90 0x7fab501484d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:46.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.733+0000 7fab4fe00640 1 -- 172.21.15.8:0/279664449 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fab500aab90 msgr2=0x7fab501484d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:46.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.733+0000 7fab4fe00640 1 --2- 172.21.15.8:0/279664449 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fab500aab90 0x7fab501484d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:46.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.733+0000 7fab4fe00640 1 -- 172.21.15.8:0/279664449 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fab5006dab0 msgr2=0x7fab50147f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:46.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.733+0000 7fab4fe00640 1 --2- 172.21.15.8:0/279664449 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fab5006dab0 0x7fab50147f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:46.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.733+0000 7fab4fe00640 1 -- 172.21.15.8:0/279664449 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab501518a0 con 0x7fab5006d300 2024-03-23T23:42:46.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.733+0000 7fab4fe00640 1 --2- 172.21.15.8:0/279664449 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab5006d300 0x7fab5014e1e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fab4000e930 tx=0x7fab4000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:46.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.733+0000 7fab4cc00640 1 -- 172.21.15.8:0/279664449 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab40017070 con 0x7fab5006d300 2024-03-23T23:42:46.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.733+0000 7fab4cc00640 1 -- 172.21.15.8:0/279664449 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4000ca00 con 0x7fab5006d300 2024-03-23T23:42:46.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.733+0000 7fab4cc00640 1 -- 172.21.15.8:0/279664449 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4000cdb0 con 0x7fab5006d300 2024-03-23T23:42:46.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.733+0000 7fab57200640 1 -- 172.21.15.8:0/279664449 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab501edde0 con 0x7fab5006d300 2024-03-23T23:42:46.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.733+0000 7fab57200640 1 -- 172.21.15.8:0/279664449 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab50148ec0 con 0x7fab5006d300 2024-03-23T23:42:46.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.733+0000 7fab57200640 1 -- 172.21.15.8:0/279664449 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab5004f410 con 0x7fab5006d300 2024-03-23T23:42:46.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.733+0000 7fab4cc00640 1 -- 172.21.15.8:0/279664449 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fab4001a070 con 0x7fab5006d300 2024-03-23T23:42:46.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.733+0000 7fab4cc00640 1 --2- 172.21.15.8:0/279664449 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fab2c067660 0x7fab2c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:46.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.733+0000 7fab4cc00640 1 -- 172.21.15.8:0/279664449 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5689+0+0 (secure 0 0 0) 0x7fab40085790 con 0x7fab5006d300 2024-03-23T23:42:46.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.737+0000 7fab47400640 1 --2- 172.21.15.8:0/279664449 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fab2c067660 0x7fab2c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:46.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.737+0000 7fab47400640 1 --2- 172.21.15.8:0/279664449 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fab2c067660 0x7fab2c069b20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fab380b1000 tx=0x7fab380a9070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:46.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.737+0000 7fab4cc00640 1 -- 172.21.15.8:0/279664449 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fab40055f20 con 0x7fab5006d300 2024-03-23T23:42:46.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.901+0000 7fab57200640 1 -- 172.21.15.8:0/279664449 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fab5006d0e0 con 0x7fab5006d300 2024-03-23T23:42:46.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.901+0000 7fab4cc00640 1 -- 172.21.15.8:0/279664449 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fab40059fc0 con 0x7fab5006d300 2024-03-23T23:42:46.904 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-03-23T23:42:46.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.905+0000 7fab57200640 1 -- 172.21.15.8:0/279664449 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fab2c067660 msgr2=0x7fab2c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:46.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.905+0000 7fab57200640 1 --2- 172.21.15.8:0/279664449 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fab2c067660 0x7fab2c069b20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fab380b1000 tx=0x7fab380a9070 comp rx=0 tx=0).stop 2024-03-23T23:42:46.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.905+0000 7fab57200640 1 -- 172.21.15.8:0/279664449 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab5006d300 msgr2=0x7fab5014e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:46.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.905+0000 7fab57200640 1 --2- 172.21.15.8:0/279664449 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab5006d300 0x7fab5014e1e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fab4000e930 tx=0x7fab4000edf0 comp rx=0 tx=0).stop 2024-03-23T23:42:46.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.905+0000 7fab57200640 1 -- 172.21.15.8:0/279664449 shutdown_connections 2024-03-23T23:42:46.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.905+0000 7fab57200640 1 --2- 172.21.15.8:0/279664449 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fab2c067660 0x7fab2c069b20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:46.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.905+0000 7fab57200640 1 --2- 172.21.15.8:0/279664449 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fab500aab90 0x7fab501484d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:46.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.905+0000 7fab57200640 1 --2- 172.21.15.8:0/279664449 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fab5006dab0 0x7fab50147f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:46.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.905+0000 7fab57200640 1 --2- 172.21.15.8:0/279664449 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab5006d300 0x7fab5014e1e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:46.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.905+0000 7fab57200640 1 -- 172.21.15.8:0/279664449 >> 172.21.15.8:0/279664449 conn(0x7fab5006b170 msgr2=0x7fab50156580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:46.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.905+0000 7fab57200640 1 -- 172.21.15.8:0/279664449 shutdown_connections 2024-03-23T23:42:46.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:46.905+0000 7fab57200640 1 -- 172.21.15.8:0/279664449 wait complete. 2024-03-23T23:42:46.924 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-03-23T23:42:47.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.065+0000 7fd011e00640 1 Processor -- start 2024-03-23T23:42:47.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.065+0000 7fd011e00640 1 -- start start 2024-03-23T23:42:47.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.065+0000 7fd011e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd00c14a230 0x7fd00c0c1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:47.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.065+0000 7fd011e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd00c1546c0 con 0x7fd00c072470 2024-03-23T23:42:47.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.065+0000 7fd011e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd00c14a610 con 0x7fd00c0c2e70 2024-03-23T23:42:47.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.065+0000 7fd011e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c071fe0 con 0x7fd00c14a230 2024-03-23T23:42:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.065+0000 7fd00b400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd00c072470 0x7fd00c0728e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:55988/0 (socket says 172.21.15.8:55988) 2024-03-23T23:42:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.065+0000 7fd00b400640 1 -- 172.21.15.8:0/1923543700 learned_addr learned my addr 172.21.15.8:0/1923543700 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.065+0000 7fd00aa00640 1 --2- 172.21.15.8:0/1923543700 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd00c14a230 0x7fd00c0c1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.069+0000 7fd00a000640 1 -- 172.21.15.8:0/1923543700 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3709717432 0 0) 0x7fd00c14a610 con 0x7fd00c0c2e70 2024-03-23T23:42:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.069+0000 7fd00a000640 1 -- 172.21.15.8:0/1923543700 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcff0003530 con 0x7fd00c0c2e70 2024-03-23T23:42:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.069+0000 7fd00a000640 1 -- 172.21.15.8:0/1923543700 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 550400694 0 0) 0x7fd00c1546c0 con 0x7fd00c072470 2024-03-23T23:42:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.069+0000 7fd00aa00640 1 -- 172.21.15.8:0/1923543700 >> v1:172.21.15.196:6789/0 conn(0x7fd00c0c2e70 legacy=0x7fd00c0c3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.069+0000 7fd00aa00640 1 -- 172.21.15.8:0/1923543700 >> v1:172.21.15.8:6789/0 conn(0x7fd00c072470 legacy=0x7fd00c0728e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.069+0000 7fd00aa00640 1 -- 172.21.15.8:0/1923543700 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00c0c20f0 con 0x7fd00c14a230 2024-03-23T23:42:47.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.069+0000 7fd00aa00640 1 --2- 172.21.15.8:0/1923543700 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd00c14a230 0x7fd00c0c1a60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcffc0097f0 tx=0x7fcffc01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5904447cea862d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:47.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.069+0000 7fd00a000640 1 -- 172.21.15.8:0/1923543700 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc0b0070 con 0x7fd00c14a230 2024-03-23T23:42:47.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.069+0000 7fd00a000640 1 -- 172.21.15.8:0/1923543700 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcffc0ab600 con 0x7fd00c14a230 2024-03-23T23:42:47.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.069+0000 7fd00a000640 1 -- 172.21.15.8:0/1923543700 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc0ab9d0 con 0x7fd00c14a230 2024-03-23T23:42:47.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.073+0000 7fd011e00640 1 -- 172.21.15.8:0/1923543700 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd00c14a230 msgr2=0x7fd00c0c1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:47.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.073+0000 7fd011e00640 1 --2- 172.21.15.8:0/1923543700 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd00c14a230 0x7fd00c0c1a60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcffc0097f0 tx=0x7fcffc01c3c0 comp rx=0 tx=0).stop 2024-03-23T23:42:47.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.073+0000 7fd011e00640 1 -- 172.21.15.8:0/1923543700 shutdown_connections 2024-03-23T23:42:47.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.073+0000 7fd011e00640 1 --2- 172.21.15.8:0/1923543700 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd00c14a230 0x7fd00c0c1a60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:47.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.073+0000 7fd011e00640 1 -- 172.21.15.8:0/1923543700 >> 172.21.15.8:0/1923543700 conn(0x7fd00c06b170 msgr2=0x7fd00c06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:47.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.073+0000 7fd011e00640 1 -- 172.21.15.8:0/1923543700 shutdown_connections 2024-03-23T23:42:47.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.073+0000 7fd011e00640 1 -- 172.21.15.8:0/1923543700 wait complete. 2024-03-23T23:42:47.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.073+0000 7fd011e00640 1 Processor -- start 2024-03-23T23:42:47.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.073+0000 7fd011e00640 1 -- start start 2024-03-23T23:42:47.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.073+0000 7fd011e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd00c072470 0x7fd00c1ee940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.073+0000 7fd011e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd00c0c2e70 0x7fd00c1f1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.073+0000 7fd011e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd00c14a230 0x7fd00c152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.073+0000 7fd011e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c0c4220 con 0x7fd00c0c2e70 2024-03-23T23:42:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.073+0000 7fd011e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c0c40a0 con 0x7fd00c072470 2024-03-23T23:42:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.073+0000 7fd011e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c072ff0 con 0x7fd00c14a230 2024-03-23T23:42:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.073+0000 7fd002000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd00c0c2e70 0x7fd00c1f1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.073+0000 7fd002000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd00c0c2e70 0x7fd00c1f1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51822/0 (socket says 172.21.15.8:51822) 2024-03-23T23:42:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.073+0000 7fd002000640 1 -- 172.21.15.8:0/894855850 learned_addr learned my addr 172.21.15.8:0/894855850 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.073+0000 7fd00aa00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd00c072470 0x7fd00c1ee940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.073+0000 7fd00b400640 1 --2- 172.21.15.8:0/894855850 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd00c14a230 0x7fd00c152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.073+0000 7fd002000640 1 -- 172.21.15.8:0/894855850 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd00c14a230 msgr2=0x7fd00c152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.073+0000 7fd002000640 1 --2- 172.21.15.8:0/894855850 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd00c14a230 0x7fd00c152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.073+0000 7fd002000640 1 -- 172.21.15.8:0/894855850 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd00c072470 msgr2=0x7fd00c1ee940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:47.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.073+0000 7fd002000640 1 --2- 172.21.15.8:0/894855850 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd00c072470 0x7fd00c1ee940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:47.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.073+0000 7fd002000640 1 -- 172.21.15.8:0/894855850 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00c148520 con 0x7fd00c0c2e70 2024-03-23T23:42:47.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.073+0000 7fd00aa00640 1 --2- 172.21.15.8:0/894855850 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd00c072470 0x7fd00c1ee940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:42:47.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.073+0000 7fd002000640 1 --2- 172.21.15.8:0/894855850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd00c0c2e70 0x7fd00c1f1db0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcff400c430 tx=0x7fcff400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:47.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.077+0000 7fd003e00640 1 -- 172.21.15.8:0/894855850 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff4017070 con 0x7fd00c0c2e70 2024-03-23T23:42:47.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.077+0000 7fd003e00640 1 -- 172.21.15.8:0/894855850 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff40052f0 con 0x7fd00c0c2e70 2024-03-23T23:42:47.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.077+0000 7fd011e00640 1 -- 172.21.15.8:0/894855850 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd00c148800 con 0x7fd00c0c2e70 2024-03-23T23:42:47.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.077+0000 7fd003e00640 1 -- 172.21.15.8:0/894855850 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff4003840 con 0x7fd00c0c2e70 2024-03-23T23:42:47.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.077+0000 7fd011e00640 1 -- 172.21.15.8:0/894855850 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd00c1ee140 con 0x7fd00c0c2e70 2024-03-23T23:42:47.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.077+0000 7fd011e00640 1 -- 172.21.15.8:0/894855850 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd00c04f410 con 0x7fd00c0c2e70 2024-03-23T23:42:47.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.077+0000 7fd003e00640 1 -- 172.21.15.8:0/894855850 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fcff401a070 con 0x7fd00c0c2e70 2024-03-23T23:42:47.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.077+0000 7fd003e00640 1 --2- 172.21.15.8:0/894855850 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcfe8067660 0x7fcfe8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:47.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.077+0000 7fd003e00640 1 -- 172.21.15.8:0/894855850 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5689+0+0 (secure 0 0 0) 0x7fcff4084bc0 con 0x7fd00c0c2e70 2024-03-23T23:42:47.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.077+0000 7fd00aa00640 1 --2- 172.21.15.8:0/894855850 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcfe8067660 0x7fcfe8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:47.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.077+0000 7fd00aa00640 1 --2- 172.21.15.8:0/894855850 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcfe8067660 0x7fcfe8069b20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcffc0ad000 tx=0x7fcffc0a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:47.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.081+0000 7fd003e00640 1 -- 172.21.15.8:0/894855850 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fcff40551f0 con 0x7fd00c0c2e70 2024-03-23T23:42:47.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.241+0000 7fd011e00640 1 -- 172.21.15.8:0/894855850 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd00c0c6640 con 0x7fd00c0c2e70 2024-03-23T23:42:47.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.245+0000 7fd003e00640 1 -- 172.21.15.8:0/894855850 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v21) v1 ==== 99+0+11 (secure 0 0 0) 0x7fcff405b020 con 0x7fd00c0c2e70 2024-03-23T23:42:47.245 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-03-23T23:42:47.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.245+0000 7fd011e00640 1 -- 172.21.15.8:0/894855850 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcfe8067660 msgr2=0x7fcfe8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:47.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.245+0000 7fd011e00640 1 --2- 172.21.15.8:0/894855850 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcfe8067660 0x7fcfe8069b20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcffc0ad000 tx=0x7fcffc0a6000 comp rx=0 tx=0).stop 2024-03-23T23:42:47.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.245+0000 7fd011e00640 1 -- 172.21.15.8:0/894855850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd00c0c2e70 msgr2=0x7fd00c1f1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:47.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.245+0000 7fd011e00640 1 --2- 172.21.15.8:0/894855850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd00c0c2e70 0x7fd00c1f1db0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcff400c430 tx=0x7fcff400c8f0 comp rx=0 tx=0).stop 2024-03-23T23:42:47.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.245+0000 7fd011e00640 1 -- 172.21.15.8:0/894855850 shutdown_connections 2024-03-23T23:42:47.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.245+0000 7fd011e00640 1 --2- 172.21.15.8:0/894855850 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcfe8067660 0x7fcfe8069b20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:47.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.245+0000 7fd011e00640 1 --2- 172.21.15.8:0/894855850 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd00c14a230 0x7fd00c152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:47.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.245+0000 7fd011e00640 1 --2- 172.21.15.8:0/894855850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd00c0c2e70 0x7fd00c1f1db0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:47.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.245+0000 7fd011e00640 1 --2- 172.21.15.8:0/894855850 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd00c072470 0x7fd00c1ee940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:47.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.245+0000 7fd011e00640 1 -- 172.21.15.8:0/894855850 >> 172.21.15.8:0/894855850 conn(0x7fd00c06b170 msgr2=0x7fd00c15e730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:47.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.245+0000 7fd011e00640 1 -- 172.21.15.8:0/894855850 shutdown_connections 2024-03-23T23:42:47.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.245+0000 7fd011e00640 1 -- 172.21.15.8:0/894855850 wait complete. 2024-03-23T23:42:47.266 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-03-23T23:42:47.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.409+0000 7efe9e800640 1 Processor -- start 2024-03-23T23:42:47.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.409+0000 7efe9e800640 1 -- start start 2024-03-23T23:42:47.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.409+0000 7efe9e800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7efe9814a230 0x7efe980c1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:47.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.409+0000 7efe9e800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe981546c0 con 0x7efe98072470 2024-03-23T23:42:47.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.409+0000 7efe9e800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe9814a610 con 0x7efe980c2e70 2024-03-23T23:42:47.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.409+0000 7efe9e800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe98071fe0 con 0x7efe9814a230 2024-03-23T23:42:47.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.409+0000 7efe97e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7efe98072470 0x7efe980728a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:56004/0 (socket says 172.21.15.8:56004) 2024-03-23T23:42:47.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.409+0000 7efe97e00640 1 -- 172.21.15.8:0/1424523141 learned_addr learned my addr 172.21.15.8:0/1424523141 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:47.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.409+0000 7efe97400640 1 --2- 172.21.15.8:0/1424523141 >> v2:172.21.15.196:3300/0 conn(0x7efe9814a230 0x7efe980c1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:47.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.409+0000 7efe97400640 1 -- 172.21.15.8:0/1424523141 >> v1:172.21.15.196:6789/0 conn(0x7efe980c2e70 legacy=0x7efe980c3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:47.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.409+0000 7efe96000640 1 -- 172.21.15.8:0/1424523141 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79681607 0 0) 0x7efe9814a610 con 0x7efe980c2e70 2024-03-23T23:42:47.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.409+0000 7efe97400640 1 -- 172.21.15.8:0/1424523141 >> v1:172.21.15.8:6789/0 conn(0x7efe98072470 legacy=0x7efe980728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:47.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.409+0000 7efe97400640 1 -- 172.21.15.8:0/1424523141 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe980c20f0 con 0x7efe9814a230 2024-03-23T23:42:47.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.413+0000 7efe97400640 1 --2- 172.21.15.8:0/1424523141 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe9814a230 0x7efe980c1a60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efe880097c0 tx=0x7efe8801c2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5986c3a95715aded server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:47.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.413+0000 7efe96000640 1 -- 172.21.15.8:0/1424523141 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe880b0070 con 0x7efe9814a230 2024-03-23T23:42:47.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.413+0000 7efe96000640 1 -- 172.21.15.8:0/1424523141 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe880ab600 con 0x7efe9814a230 2024-03-23T23:42:47.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.413+0000 7efe96000640 1 -- 172.21.15.8:0/1424523141 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe880ab9d0 con 0x7efe9814a230 2024-03-23T23:42:47.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.413+0000 7efe9e800640 1 -- 172.21.15.8:0/1424523141 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe9814a230 msgr2=0x7efe980c1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:47.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.413+0000 7efe9e800640 1 --2- 172.21.15.8:0/1424523141 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe9814a230 0x7efe980c1a60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efe880097c0 tx=0x7efe8801c2a0 comp rx=0 tx=0).stop 2024-03-23T23:42:47.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.413+0000 7efe9e800640 1 -- 172.21.15.8:0/1424523141 shutdown_connections 2024-03-23T23:42:47.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.413+0000 7efe9e800640 1 --2- 172.21.15.8:0/1424523141 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe9814a230 0x7efe980c1a60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:47.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.413+0000 7efe9e800640 1 -- 172.21.15.8:0/1424523141 >> 172.21.15.8:0/1424523141 conn(0x7efe9806b170 msgr2=0x7efe9806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:47.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.413+0000 7efe9e800640 1 -- 172.21.15.8:0/1424523141 shutdown_connections 2024-03-23T23:42:47.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.413+0000 7efe9e800640 1 -- 172.21.15.8:0/1424523141 wait complete. 2024-03-23T23:42:47.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.413+0000 7efe9e800640 1 Processor -- start 2024-03-23T23:42:47.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.417+0000 7efe9e800640 1 -- start start 2024-03-23T23:42:47.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.417+0000 7efe9e800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe98072470 0x7efe981ef270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:47.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.417+0000 7efe9e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe980c2e70 0x7efe9814a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:47.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.417+0000 7efe9e800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe9814a230 0x7efe9814cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:47.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.417+0000 7efe9e800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe980c2990 con 0x7efe980c2e70 2024-03-23T23:42:47.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.417+0000 7efe9e800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe980c26b0 con 0x7efe98072470 2024-03-23T23:42:47.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.417+0000 7efe9e800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe980c40a0 con 0x7efe9814a230 2024-03-23T23:42:47.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.417+0000 7efe96a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe980c2e70 0x7efe9814a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:47.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.417+0000 7efe97400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe98072470 0x7efe981ef270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:47.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.417+0000 7efe97400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe98072470 0x7efe981ef270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:60558/0 (socket says 172.21.15.8:60558) 2024-03-23T23:42:47.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.417+0000 7efe97400640 1 -- 172.21.15.8:0/1423287280 learned_addr learned my addr 172.21.15.8:0/1423287280 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:47.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.417+0000 7efe97e00640 1 --2- 172.21.15.8:0/1423287280 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe9814a230 0x7efe9814cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:47.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.417+0000 7efe97400640 1 -- 172.21.15.8:0/1423287280 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe9814a230 msgr2=0x7efe9814cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:47.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.417+0000 7efe97400640 1 --2- 172.21.15.8:0/1423287280 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe9814a230 0x7efe9814cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:47.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.417+0000 7efe97400640 1 -- 172.21.15.8:0/1423287280 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe980c2e70 msgr2=0x7efe9814a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:47.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.417+0000 7efe97400640 1 --2- 172.21.15.8:0/1423287280 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe980c2e70 0x7efe9814a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:47.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.417+0000 7efe97400640 1 -- 172.21.15.8:0/1423287280 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe98156660 con 0x7efe98072470 2024-03-23T23:42:47.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.417+0000 7efe97400640 1 --2- 172.21.15.8:0/1423287280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe98072470 0x7efe981ef270 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efe880ae040 tx=0x7efe8801aae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:47.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.417+0000 7efe8f400640 1 -- 172.21.15.8:0/1423287280 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe880b0040 con 0x7efe98072470 2024-03-23T23:42:47.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.417+0000 7efe8f400640 1 -- 172.21.15.8:0/1423287280 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe88004030 con 0x7efe98072470 2024-03-23T23:42:47.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.417+0000 7efe9e800640 1 -- 172.21.15.8:0/1423287280 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe981556c0 con 0x7efe98072470 2024-03-23T23:42:47.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.417+0000 7efe8f400640 1 -- 172.21.15.8:0/1423287280 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe88004420 con 0x7efe98072470 2024-03-23T23:42:47.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.417+0000 7efe9e800640 1 -- 172.21.15.8:0/1423287280 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe98155960 con 0x7efe98072470 2024-03-23T23:42:47.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.417+0000 7efe9e800640 1 -- 172.21.15.8:0/1423287280 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe9814ca20 con 0x7efe98072470 2024-03-23T23:42:47.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.421+0000 7efe8f400640 1 -- 172.21.15.8:0/1423287280 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7efe880aa750 con 0x7efe98072470 2024-03-23T23:42:47.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.421+0000 7efe8f400640 1 --2- 172.21.15.8:0/1423287280 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7efe78067660 0x7efe78069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:47.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.421+0000 7efe8f400640 1 -- 172.21.15.8:0/1423287280 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5689+0+0 (secure 0 0 0) 0x7efe881208c0 con 0x7efe98072470 2024-03-23T23:42:47.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.421+0000 7efe96a00640 1 --2- 172.21.15.8:0/1423287280 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7efe78067660 0x7efe78069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:47.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.421+0000 7efe96a00640 1 --2- 172.21.15.8:0/1423287280 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7efe78067660 0x7efe78069b20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efe98071a40 tx=0x7efe84009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:47.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.425+0000 7efe8f400640 1 -- 172.21.15.8:0/1423287280 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7efe98156660 con 0x7efe98072470 2024-03-23T23:42:47.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.589+0000 7efe9e800640 1 -- 172.21.15.8:0/1423287280 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7efe9814c640 con 0x7efe98072470 2024-03-23T23:42:47.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.589+0000 7efe8f400640 1 -- 172.21.15.8:0/1423287280 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v21) v1 ==== 95+0+11 (secure 0 0 0) 0x7efe88015fb0 con 0x7efe98072470 2024-03-23T23:42:47.589 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-03-23T23:42:47.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.589+0000 7efe9e800640 1 -- 172.21.15.8:0/1423287280 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7efe78067660 msgr2=0x7efe78069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:47.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.589+0000 7efe9e800640 1 --2- 172.21.15.8:0/1423287280 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7efe78067660 0x7efe78069b20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efe98071a40 tx=0x7efe84009040 comp rx=0 tx=0).stop 2024-03-23T23:42:47.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.589+0000 7efe9e800640 1 -- 172.21.15.8:0/1423287280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe98072470 msgr2=0x7efe981ef270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:47.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.589+0000 7efe9e800640 1 --2- 172.21.15.8:0/1423287280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe98072470 0x7efe981ef270 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efe880ae040 tx=0x7efe8801aae0 comp rx=0 tx=0).stop 2024-03-23T23:42:47.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.589+0000 7efe9e800640 1 -- 172.21.15.8:0/1423287280 shutdown_connections 2024-03-23T23:42:47.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.589+0000 7efe9e800640 1 --2- 172.21.15.8:0/1423287280 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7efe78067660 0x7efe78069b20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:47.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.589+0000 7efe9e800640 1 --2- 172.21.15.8:0/1423287280 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe9814a230 0x7efe9814cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:47.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.589+0000 7efe9e800640 1 --2- 172.21.15.8:0/1423287280 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe980c2e70 0x7efe9814a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:47.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.589+0000 7efe9e800640 1 --2- 172.21.15.8:0/1423287280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe98072470 0x7efe981ef270 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:47.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.589+0000 7efe9e800640 1 -- 172.21.15.8:0/1423287280 >> 172.21.15.8:0/1423287280 conn(0x7efe9806b170 msgr2=0x7efe98153030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:47.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.589+0000 7efe9e800640 1 -- 172.21.15.8:0/1423287280 shutdown_connections 2024-03-23T23:42:47.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.589+0000 7efe9e800640 1 -- 172.21.15.8:0/1423287280 wait complete. 2024-03-23T23:42:47.610 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-23T23:42:47.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.753+0000 7f04ce400640 1 Processor -- start 2024-03-23T23:42:47.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.753+0000 7f04ce400640 1 -- start start 2024-03-23T23:42:47.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.753+0000 7f04ce400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f04c8156400 0x7f04c8072490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:47.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.753+0000 7f04ce400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f04c8073470 0x7f04c80a9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:47.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.753+0000 7f04ce400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04c806ff70 con 0x7f04c814fc50 2024-03-23T23:42:47.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.753+0000 7f04ce400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c81568a0 con 0x7f04c8073470 2024-03-23T23:42:47.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.753+0000 7f04ce400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c806f9b0 con 0x7f04c8156400 2024-03-23T23:42:47.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.753+0000 7f04c7400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f04c814fc50 0x7f04c8155cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:56014/0 (socket says 172.21.15.8:56014) 2024-03-23T23:42:47.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.753+0000 7f04c7400640 1 -- 172.21.15.8:0/3792413310 learned_addr learned my addr 172.21.15.8:0/3792413310 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:47.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.753+0000 7f04c6a00640 1 --2- 172.21.15.8:0/3792413310 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f04c8156400 0x7f04c8072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:47.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.753+0000 7f04c7e00640 1 --2- 172.21.15.8:0/3792413310 >> v2:172.21.15.196:3300/0 conn(0x7f04c8073470 0x7f04c80a9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:47.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.753+0000 7f04c6000640 1 -- 172.21.15.8:0/3792413310 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4188416858 0 0) 0x7f04c806ff70 con 0x7f04c814fc50 2024-03-23T23:42:47.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.753+0000 7f04c6000640 1 -- 172.21.15.8:0/3792413310 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04ac003530 con 0x7f04c814fc50 2024-03-23T23:42:47.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.753+0000 7f04c6a00640 1 -- 172.21.15.8:0/3792413310 >> v2:172.21.15.196:3300/0 conn(0x7f04c8073470 msgr2=0x7f04c80a9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:47.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.753+0000 7f04c6a00640 1 --2- 172.21.15.8:0/3792413310 >> v2:172.21.15.196:3300/0 conn(0x7f04c8073470 0x7f04c80a9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:47.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.753+0000 7f04c6a00640 1 -- 172.21.15.8:0/3792413310 >> v1:172.21.15.8:6789/0 conn(0x7f04c814fc50 legacy=0x7f04c8155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:47.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.753+0000 7f04c6a00640 1 -- 172.21.15.8:0/3792413310 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c806fc90 con 0x7f04c8156400 2024-03-23T23:42:47.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.757+0000 7f04c6a00640 1 --2- 172.21.15.8:0/3792413310 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f04c8156400 0x7f04c8072490 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f04b40097c0 tx=0x7f04b401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b1182d4090413c3 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:47.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.757+0000 7f04c6000640 1 -- 172.21.15.8:0/3792413310 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b40b0070 con 0x7f04c8156400 2024-03-23T23:42:47.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.757+0000 7f04c6000640 1 -- 172.21.15.8:0/3792413310 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b40ab600 con 0x7f04c8156400 2024-03-23T23:42:47.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.757+0000 7f04c6000640 1 -- 172.21.15.8:0/3792413310 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b40ab9d0 con 0x7f04c8156400 2024-03-23T23:42:47.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.757+0000 7f04ce400640 1 -- 172.21.15.8:0/3792413310 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f04c8156400 msgr2=0x7f04c8072490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:47.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.757+0000 7f04ce400640 1 --2- 172.21.15.8:0/3792413310 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f04c8156400 0x7f04c8072490 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f04b40097c0 tx=0x7f04b401c410 comp rx=0 tx=0).stop 2024-03-23T23:42:47.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.757+0000 7f04ce400640 1 -- 172.21.15.8:0/3792413310 shutdown_connections 2024-03-23T23:42:47.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.757+0000 7f04ce400640 1 --2- 172.21.15.8:0/3792413310 >> v2:172.21.15.196:3300/0 conn(0x7f04c8073470 0x7f04c80a9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:47.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.757+0000 7f04ce400640 1 --2- 172.21.15.8:0/3792413310 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f04c8156400 0x7f04c8072490 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:47.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.757+0000 7f04ce400640 1 -- 172.21.15.8:0/3792413310 >> 172.21.15.8:0/3792413310 conn(0x7f04c806e740 msgr2=0x7f04c806c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:47.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.757+0000 7f04ce400640 1 -- 172.21.15.8:0/3792413310 shutdown_connections 2024-03-23T23:42:47.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.757+0000 7f04ce400640 1 -- 172.21.15.8:0/3792413310 wait complete. 2024-03-23T23:42:47.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.757+0000 7f04ce400640 1 Processor -- start 2024-03-23T23:42:47.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.757+0000 7f04ce400640 1 -- start start 2024-03-23T23:42:47.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.761+0000 7f04ce400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f04c8073470 0x7f04c80c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:47.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.761+0000 7f04ce400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f04c814fc50 0x7f04c815aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:47.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.761+0000 7f04ce400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04c8156400 0x7f04c815b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:47.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.761+0000 7f04ce400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c815f420 con 0x7f04c8156400 2024-03-23T23:42:47.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.761+0000 7f04ce400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c815f2a0 con 0x7f04c814fc50 2024-03-23T23:42:47.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.761+0000 7f04ce400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c815f5a0 con 0x7f04c8073470 2024-03-23T23:42:47.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.761+0000 7f04c7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04c8156400 0x7f04c815b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:47.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.761+0000 7f04c7400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f04c8073470 0x7f04c80c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:47.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.761+0000 7f04c7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04c8156400 0x7f04c815b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51848/0 (socket says 172.21.15.8:51848) 2024-03-23T23:42:47.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.761+0000 7f04c7e00640 1 -- 172.21.15.8:0/2001494628 learned_addr learned my addr 172.21.15.8:0/2001494628 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:47.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.761+0000 7f04c6a00640 1 --2- 172.21.15.8:0/2001494628 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f04c814fc50 0x7f04c815aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:47.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.761+0000 7f04c7e00640 1 -- 172.21.15.8:0/2001494628 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f04c8073470 msgr2=0x7f04c80c71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:47.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.761+0000 7f04c7e00640 1 --2- 172.21.15.8:0/2001494628 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f04c8073470 0x7f04c80c71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:47.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.761+0000 7f04c7e00640 1 -- 172.21.15.8:0/2001494628 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f04c814fc50 msgr2=0x7f04c815aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:47.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.761+0000 7f04c7e00640 1 --2- 172.21.15.8:0/2001494628 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f04c814fc50 0x7f04c815aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:47.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.761+0000 7f04c7e00640 1 -- 172.21.15.8:0/2001494628 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c80c7c10 con 0x7f04c8156400 2024-03-23T23:42:47.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.761+0000 7f04c7e00640 1 --2- 172.21.15.8:0/2001494628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04c8156400 0x7f04c815b020 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f04c0009e30 tx=0x7f04c000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:47.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.761+0000 7f04bf400640 1 -- 172.21.15.8:0/2001494628 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c0018020 con 0x7f04c8156400 2024-03-23T23:42:47.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.761+0000 7f04bf400640 1 -- 172.21.15.8:0/2001494628 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c0014480 con 0x7f04c8156400 2024-03-23T23:42:47.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.761+0000 7f04bf400640 1 -- 172.21.15.8:0/2001494628 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c0014870 con 0x7f04c8156400 2024-03-23T23:42:47.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.761+0000 7f04ce400640 1 -- 172.21.15.8:0/2001494628 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c81ee430 con 0x7f04c8156400 2024-03-23T23:42:47.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.761+0000 7f04ce400640 1 -- 172.21.15.8:0/2001494628 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c81ee9f0 con 0x7f04c8156400 2024-03-23T23:42:47.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.761+0000 7f04ce400640 1 -- 172.21.15.8:0/2001494628 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c8068270 con 0x7f04c8156400 2024-03-23T23:42:47.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.761+0000 7f04bf400640 1 -- 172.21.15.8:0/2001494628 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f04c001b020 con 0x7f04c8156400 2024-03-23T23:42:47.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.765+0000 7f04bf400640 1 --2- 172.21.15.8:0/2001494628 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f04a8067660 0x7f04a8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:47.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.765+0000 7f04bf400640 1 -- 172.21.15.8:0/2001494628 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5689+0+0 (secure 0 0 0) 0x7f04c0086530 con 0x7f04c8156400 2024-03-23T23:42:47.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.765+0000 7f04c7400640 1 --2- 172.21.15.8:0/2001494628 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f04a8067660 0x7f04a8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:47.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.765+0000 7f04c7400640 1 --2- 172.21.15.8:0/2001494628 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f04a8067660 0x7f04a8069b20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f04b8007fd0 tx=0x7f04b8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:47.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.769+0000 7f04bf400640 1 -- 172.21.15.8:0/2001494628 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f04c0022030 con 0x7f04c8156400 2024-03-23T23:42:47.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.933+0000 7f04ce400640 1 -- 172.21.15.8:0/2001494628 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f04c80ad8f0 con 0x7f04c8156400 2024-03-23T23:42:47.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.933+0000 7f04bf400640 1 -- 172.21.15.8:0/2001494628 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v21) v1 ==== 84+0+197 (secure 0 0 0) 0x7f04c0010040 con 0x7f04c8156400 2024-03-23T23:42:47.936 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:42:47.936 INFO:teuthology.orchestra.run.smithi008.stdout:[ 2024-03-23T23:42:47.936 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:42:47.936 INFO:teuthology.orchestra.run.smithi008.stdout: "poolnum": 1, 2024-03-23T23:42:47.936 INFO:teuthology.orchestra.run.smithi008.stdout: "poolname": ".mgr" 2024-03-23T23:42:47.936 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:42:47.936 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:42:47.936 INFO:teuthology.orchestra.run.smithi008.stdout: "poolnum": 2, 2024-03-23T23:42:47.936 INFO:teuthology.orchestra.run.smithi008.stdout: "poolname": "a_metadata" 2024-03-23T23:42:47.936 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:42:47.936 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:42:47.937 INFO:teuthology.orchestra.run.smithi008.stdout: "poolnum": 3, 2024-03-23T23:42:47.937 INFO:teuthology.orchestra.run.smithi008.stdout: "poolname": "a_data" 2024-03-23T23:42:47.937 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:42:47.937 INFO:teuthology.orchestra.run.smithi008.stdout:] 2024-03-23T23:42:47.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.937+0000 7f04ce400640 1 -- 172.21.15.8:0/2001494628 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f04a8067660 msgr2=0x7f04a8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:47.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.937+0000 7f04ce400640 1 --2- 172.21.15.8:0/2001494628 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f04a8067660 0x7f04a8069b20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f04b8007fd0 tx=0x7f04b8009040 comp rx=0 tx=0).stop 2024-03-23T23:42:47.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.937+0000 7f04ce400640 1 -- 172.21.15.8:0/2001494628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04c8156400 msgr2=0x7f04c815b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:47.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.937+0000 7f04ce400640 1 --2- 172.21.15.8:0/2001494628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04c8156400 0x7f04c815b020 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f04c0009e30 tx=0x7f04c000c490 comp rx=0 tx=0).stop 2024-03-23T23:42:47.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.937+0000 7f04ce400640 1 -- 172.21.15.8:0/2001494628 shutdown_connections 2024-03-23T23:42:47.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.937+0000 7f04ce400640 1 --2- 172.21.15.8:0/2001494628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04c8156400 0x7f04c815b020 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:47.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.937+0000 7f04ce400640 1 --2- 172.21.15.8:0/2001494628 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f04c814fc50 0x7f04c815aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:47.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.937+0000 7f04ce400640 1 --2- 172.21.15.8:0/2001494628 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f04a8067660 0x7f04a8069b20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:47.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.937+0000 7f04ce400640 1 --2- 172.21.15.8:0/2001494628 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f04c8073470 0x7f04c80c71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:47.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.937+0000 7f04ce400640 1 -- 172.21.15.8:0/2001494628 >> 172.21.15.8:0/2001494628 conn(0x7f04c806e740 msgr2=0x7f04c80c1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:47.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.937+0000 7f04ce400640 1 -- 172.21.15.8:0/2001494628 shutdown_connections 2024-03-23T23:42:47.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:47.937+0000 7f04ce400640 1 -- 172.21.15.8:0/2001494628 wait complete. 2024-03-23T23:42:47.956 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'b' 2024-03-23T23:42:47.956 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create b_metadata --pg_num_min 64 2024-03-23T23:42:48.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.097+0000 7f76cee00640 1 Processor -- start 2024-03-23T23:42:48.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.097+0000 7f76cee00640 1 -- start start 2024-03-23T23:42:48.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.101+0000 7f76cee00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f76c8150da0 0x7f76c806d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:48.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.101+0000 7f76cee00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f76c806e2c0 0x7f76c81572b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:48.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.101+0000 7f76cee00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76c8154480 con 0x7f76c806de30 2024-03-23T23:42:48.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.101+0000 7f76cee00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76c80aa180 con 0x7f76c8150da0 2024-03-23T23:42:48.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.101+0000 7f76cee00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76c80aa460 con 0x7f76c806e2c0 2024-03-23T23:42:48.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.101+0000 7f76c7e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f76c8150da0 0x7f76c806d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:48.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.101+0000 7f76bfe00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f76c806de30 0x7f76c8156ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:56026/0 (socket says 172.21.15.8:56026) 2024-03-23T23:42:48.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.101+0000 7f76c7e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f76c8150da0 0x7f76c806d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51850/0 (socket says 172.21.15.8:51850) 2024-03-23T23:42:48.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.101+0000 7f76bfe00640 1 -- 172.21.15.8:0/904726156 learned_addr learned my addr 172.21.15.8:0/904726156 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:48.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.101+0000 7f76cce00640 1 --2- 172.21.15.8:0/904726156 >> v2:172.21.15.196:3300/0 conn(0x7f76c806e2c0 0x7f76c81572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:48.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.101+0000 7f76c7e00640 1 -- 172.21.15.8:0/904726156 >> v2:172.21.15.196:3300/0 conn(0x7f76c806e2c0 msgr2=0x7f76c81572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:48.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.101+0000 7f76c7e00640 1 --2- 172.21.15.8:0/904726156 >> v2:172.21.15.196:3300/0 conn(0x7f76c806e2c0 0x7f76c81572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:48.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.101+0000 7f76c7400640 1 -- 172.21.15.8:0/904726156 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2807049628 0 0) 0x7f76c8154480 con 0x7f76c806de30 2024-03-23T23:42:48.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.101+0000 7f76c7e00640 1 -- 172.21.15.8:0/904726156 >> v1:172.21.15.8:6789/0 conn(0x7f76c806de30 legacy=0x7f76c8156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:48.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.101+0000 7f76c7e00640 1 -- 172.21.15.8:0/904726156 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c80aa740 con 0x7f76c8150da0 2024-03-23T23:42:48.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.101+0000 7f76cce00640 1 --2- 172.21.15.8:0/904726156 >> v2:172.21.15.196:3300/0 conn(0x7f76c806e2c0 0x7f76c81572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:42:48.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.105+0000 7f76c7e00640 1 --2- 172.21.15.8:0/904726156 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76c8150da0 0x7f76c806d8f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f76c80751c0 tx=0x7f76b801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=660d8acf6df3ff68 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:48.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.105+0000 7f76c7400640 1 -- 172.21.15.8:0/904726156 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b80b0070 con 0x7f76c8150da0 2024-03-23T23:42:48.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.105+0000 7f76c7400640 1 -- 172.21.15.8:0/904726156 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b80ab600 con 0x7f76c8150da0 2024-03-23T23:42:48.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.105+0000 7f76c7400640 1 -- 172.21.15.8:0/904726156 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b80ab9d0 con 0x7f76c8150da0 2024-03-23T23:42:48.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.105+0000 7f76cee00640 1 -- 172.21.15.8:0/904726156 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76c8150da0 msgr2=0x7f76c806d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:48.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.105+0000 7f76cee00640 1 --2- 172.21.15.8:0/904726156 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76c8150da0 0x7f76c806d8f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f76c80751c0 tx=0x7f76b801c480 comp rx=0 tx=0).stop 2024-03-23T23:42:48.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.105+0000 7f76cee00640 1 -- 172.21.15.8:0/904726156 shutdown_connections 2024-03-23T23:42:48.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.105+0000 7f76cee00640 1 --2- 172.21.15.8:0/904726156 >> v2:172.21.15.196:3300/0 conn(0x7f76c806e2c0 0x7f76c81572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:48.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.105+0000 7f76cee00640 1 --2- 172.21.15.8:0/904726156 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76c8150da0 0x7f76c806d8f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:48.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.105+0000 7f76cee00640 1 -- 172.21.15.8:0/904726156 >> 172.21.15.8:0/904726156 conn(0x7f76c80c7060 msgr2=0x7f76c80c7470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:48.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.105+0000 7f76cee00640 1 -- 172.21.15.8:0/904726156 shutdown_connections 2024-03-23T23:42:48.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.105+0000 7f76cee00640 1 -- 172.21.15.8:0/904726156 wait complete. 2024-03-23T23:42:48.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.105+0000 7f76cee00640 1 Processor -- start 2024-03-23T23:42:48.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.105+0000 7f76cee00640 1 -- start start 2024-03-23T23:42:48.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.105+0000 7f76cee00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f76c806de30 0x7f76c8150060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:48.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.105+0000 7f76cee00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f76c806e2c0 0x7f76c80c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:48.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.105+0000 7f76cee00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76c8150da0 0x7f76c81562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:48.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.105+0000 7f76cee00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c81541b0 con 0x7f76c8150da0 2024-03-23T23:42:48.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.105+0000 7f76cee00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c8154030 con 0x7f76c806de30 2024-03-23T23:42:48.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.105+0000 7f76cee00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c81577f0 con 0x7f76c806e2c0 2024-03-23T23:42:48.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.109+0000 7f76cce00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76c8150da0 0x7f76c81562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:48.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.109+0000 7f76cce00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76c8150da0 0x7f76c81562a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51852/0 (socket says 172.21.15.8:51852) 2024-03-23T23:42:48.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.109+0000 7f76c7e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f76c806de30 0x7f76c8150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:48.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.109+0000 7f76cce00640 1 -- 172.21.15.8:0/576758406 learned_addr learned my addr 172.21.15.8:0/576758406 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:48.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.109+0000 7f76bfe00640 1 --2- 172.21.15.8:0/576758406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f76c806e2c0 0x7f76c80c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:48.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.109+0000 7f76cce00640 1 -- 172.21.15.8:0/576758406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f76c806e2c0 msgr2=0x7f76c80c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:48.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.109+0000 7f76cce00640 1 --2- 172.21.15.8:0/576758406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f76c806e2c0 0x7f76c80c60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:48.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.109+0000 7f76cce00640 1 -- 172.21.15.8:0/576758406 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f76c806de30 msgr2=0x7f76c8150060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:48.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.109+0000 7f76cce00640 1 --2- 172.21.15.8:0/576758406 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f76c806de30 0x7f76c8150060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:48.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.109+0000 7f76cce00640 1 -- 172.21.15.8:0/576758406 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c81505a0 con 0x7f76c8150da0 2024-03-23T23:42:48.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.109+0000 7f76cce00640 1 --2- 172.21.15.8:0/576758406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76c8150da0 0x7f76c81562a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f76c000efc0 tx=0x7f76c0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:48.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.109+0000 7f76c4c00640 1 -- 172.21.15.8:0/576758406 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c0018030 con 0x7f76c8150da0 2024-03-23T23:42:48.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.109+0000 7f76c4c00640 1 -- 172.21.15.8:0/576758406 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c000cde0 con 0x7f76c8150da0 2024-03-23T23:42:48.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.109+0000 7f76c4c00640 1 -- 172.21.15.8:0/576758406 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c0003bc0 con 0x7f76c8150da0 2024-03-23T23:42:48.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.109+0000 7f76cee00640 1 -- 172.21.15.8:0/576758406 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c80c6d80 con 0x7f76c8150da0 2024-03-23T23:42:48.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.109+0000 7f76cee00640 1 -- 172.21.15.8:0/576758406 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c8140b60 con 0x7f76c8150da0 2024-03-23T23:42:48.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.109+0000 7f76cee00640 1 -- 172.21.15.8:0/576758406 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c804f480 con 0x7f76c8150da0 2024-03-23T23:42:48.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.109+0000 7f76c4c00640 1 -- 172.21.15.8:0/576758406 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f76c001b070 con 0x7f76c8150da0 2024-03-23T23:42:48.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.109+0000 7f76c4c00640 1 --2- 172.21.15.8:0/576758406 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f76a4067660 0x7f76a4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:48.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.113+0000 7f76c4c00640 1 -- 172.21.15.8:0/576758406 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5689+0+0 (secure 0 0 0) 0x7f76c0086280 con 0x7f76c8150da0 2024-03-23T23:42:48.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.113+0000 7f76c7e00640 1 --2- 172.21.15.8:0/576758406 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f76a4067660 0x7f76a4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:48.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.113+0000 7f76c7e00640 1 --2- 172.21.15.8:0/576758406 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f76a4067660 0x7f76a4069b20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f76b80ad000 tx=0x7f76b80a4f90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:48.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.113+0000 7f76c4c00640 1 -- 172.21.15.8:0/576758406 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f76c0022070 con 0x7f76c8150da0 2024-03-23T23:42:48.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.277+0000 7f76cee00640 1 -- 172.21.15.8:0/576758406 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "b_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f76c80c6610 con 0x7f76c8150da0 2024-03-23T23:42:48.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.705+0000 7f76c4c00640 1 -- 172.21.15.8:0/576758406 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "b_metadata", "pg_num_min": 64}]=0 pool 'b_metadata' created v22) v1 ==== 128+0+0 (secure 0 0 0) 0x7f76c0010040 con 0x7f76c8150da0 2024-03-23T23:42:48.708 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'b_metadata' created 2024-03-23T23:42:48.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.709+0000 7f76cee00640 1 -- 172.21.15.8:0/576758406 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f76a4067660 msgr2=0x7f76a4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:48.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.709+0000 7f76cee00640 1 --2- 172.21.15.8:0/576758406 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f76a4067660 0x7f76a4069b20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f76b80ad000 tx=0x7f76b80a4f90 comp rx=0 tx=0).stop 2024-03-23T23:42:48.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.709+0000 7f76cee00640 1 -- 172.21.15.8:0/576758406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76c8150da0 msgr2=0x7f76c81562a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:48.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.709+0000 7f76cee00640 1 --2- 172.21.15.8:0/576758406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76c8150da0 0x7f76c81562a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f76c000efc0 tx=0x7f76c0009f90 comp rx=0 tx=0).stop 2024-03-23T23:42:48.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.709+0000 7f76cee00640 1 -- 172.21.15.8:0/576758406 shutdown_connections 2024-03-23T23:42:48.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.709+0000 7f76cee00640 1 --2- 172.21.15.8:0/576758406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76c8150da0 0x7f76c81562a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:48.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.709+0000 7f76cee00640 1 --2- 172.21.15.8:0/576758406 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f76a4067660 0x7f76a4069b20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:48.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.709+0000 7f76cee00640 1 --2- 172.21.15.8:0/576758406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f76c806e2c0 0x7f76c80c60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:48.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.709+0000 7f76cee00640 1 --2- 172.21.15.8:0/576758406 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f76c806de30 0x7f76c8150060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:48.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.709+0000 7f76cee00640 1 -- 172.21.15.8:0/576758406 >> 172.21.15.8:0/576758406 conn(0x7f76c80c7060 msgr2=0x7f76c814d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:48.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.709+0000 7f76cee00640 1 -- 172.21.15.8:0/576758406 shutdown_connections 2024-03-23T23:42:48.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.709+0000 7f76cee00640 1 -- 172.21.15.8:0/576758406 wait complete. 2024-03-23T23:42:48.736 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create b_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-23T23:42:48.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.881+0000 7fda45a00640 1 Processor -- start 2024-03-23T23:42:48.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.881+0000 7fda45a00640 1 -- start start 2024-03-23T23:42:48.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.885+0000 7fda45a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fda4006dab0 0x7fda40156580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:48.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.885+0000 7fda45a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fda4006d300 0x7fda4014f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:48.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.885+0000 7fda45a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda40156ac0 con 0x7fda400aab90 2024-03-23T23:42:48.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.885+0000 7fda45a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda4006e6f0 con 0x7fda4006d300 2024-03-23T23:42:48.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.885+0000 7fda45a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda401560f0 con 0x7fda4006dab0 2024-03-23T23:42:48.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.885+0000 7fda36000640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fda400aab90 0x7fda40152670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:56032/0 (socket says 172.21.15.8:56032) 2024-03-23T23:42:48.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.885+0000 7fda36000640 1 -- 172.21.15.8:0/3001779877 learned_addr learned my addr 172.21.15.8:0/3001779877 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:48.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.885+0000 7fda3ea00640 1 --2- 172.21.15.8:0/3001779877 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fda4006dab0 0x7fda40156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:48.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.885+0000 7fda3f400640 1 --2- 172.21.15.8:0/3001779877 >> v2:172.21.15.196:3300/0 conn(0x7fda4006d300 0x7fda4014f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:48.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.885+0000 7fda3e000640 1 -- 172.21.15.8:0/3001779877 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2035578996 0 0) 0x7fda40156ac0 con 0x7fda400aab90 2024-03-23T23:42:48.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.885+0000 7fda3e000640 1 -- 172.21.15.8:0/3001779877 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda24003530 con 0x7fda400aab90 2024-03-23T23:42:48.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.885+0000 7fda3ea00640 1 -- 172.21.15.8:0/3001779877 >> v2:172.21.15.196:3300/0 conn(0x7fda4006d300 msgr2=0x7fda4014f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:48.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.885+0000 7fda3ea00640 1 --2- 172.21.15.8:0/3001779877 >> v2:172.21.15.196:3300/0 conn(0x7fda4006d300 0x7fda4014f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:48.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.885+0000 7fda3ea00640 1 -- 172.21.15.8:0/3001779877 >> v1:172.21.15.8:6789/0 conn(0x7fda400aab90 legacy=0x7fda40152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:48.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.885+0000 7fda3ea00640 1 -- 172.21.15.8:0/3001779877 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4006e940 con 0x7fda4006dab0 2024-03-23T23:42:48.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.885+0000 7fda3f400640 1 --2- 172.21.15.8:0/3001779877 >> v2:172.21.15.196:3300/0 conn(0x7fda4006d300 0x7fda4014f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:42:48.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.889+0000 7fda3ea00640 1 --2- 172.21.15.8:0/3001779877 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fda4006dab0 0x7fda40156580 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fda30009d90 tx=0x7fda3001c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd4258f248b4eefc server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:48.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.889+0000 7fda3e000640 1 -- 172.21.15.8:0/3001779877 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda300b2070 con 0x7fda4006dab0 2024-03-23T23:42:48.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.889+0000 7fda3e000640 1 -- 172.21.15.8:0/3001779877 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda300a5a00 con 0x7fda4006dab0 2024-03-23T23:42:48.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.889+0000 7fda3e000640 1 -- 172.21.15.8:0/3001779877 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda300a5dd0 con 0x7fda4006dab0 2024-03-23T23:42:48.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.889+0000 7fda45a00640 1 -- 172.21.15.8:0/3001779877 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fda4006dab0 msgr2=0x7fda40156580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:48.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.889+0000 7fda45a00640 1 --2- 172.21.15.8:0/3001779877 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fda4006dab0 0x7fda40156580 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fda30009d90 tx=0x7fda3001c940 comp rx=0 tx=0).stop 2024-03-23T23:42:48.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.889+0000 7fda45a00640 1 -- 172.21.15.8:0/3001779877 shutdown_connections 2024-03-23T23:42:48.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.889+0000 7fda45a00640 1 --2- 172.21.15.8:0/3001779877 >> v2:172.21.15.196:3300/0 conn(0x7fda4006d300 0x7fda4014f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:48.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.889+0000 7fda45a00640 1 --2- 172.21.15.8:0/3001779877 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fda4006dab0 0x7fda40156580 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:48.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.889+0000 7fda45a00640 1 -- 172.21.15.8:0/3001779877 >> 172.21.15.8:0/3001779877 conn(0x7fda4006b170 msgr2=0x7fda4006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:48.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.889+0000 7fda45a00640 1 -- 172.21.15.8:0/3001779877 shutdown_connections 2024-03-23T23:42:48.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.889+0000 7fda45a00640 1 -- 172.21.15.8:0/3001779877 wait complete. 2024-03-23T23:42:48.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.889+0000 7fda45a00640 1 Processor -- start 2024-03-23T23:42:48.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.889+0000 7fda45a00640 1 -- start start 2024-03-23T23:42:48.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.889+0000 7fda45a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fda4006d300 0x7fda401eeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:48.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.889+0000 7fda45a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda4006dab0 0x7fda4015b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:48.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.889+0000 7fda45a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fda400aab90 0x7fda40159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:48.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.889+0000 7fda45a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4006e010 con 0x7fda4006dab0 2024-03-23T23:42:48.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.889+0000 7fda45a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4006de90 con 0x7fda400aab90 2024-03-23T23:42:48.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.889+0000 7fda45a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4015f750 con 0x7fda4006d300 2024-03-23T23:42:48.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.893+0000 7fda36000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda4006dab0 0x7fda4015b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:48.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.893+0000 7fda3ea00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fda4006d300 0x7fda401eeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:48.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.893+0000 7fda36000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda4006dab0 0x7fda4015b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51856/0 (socket says 172.21.15.8:51856) 2024-03-23T23:42:48.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.893+0000 7fda36000640 1 -- 172.21.15.8:0/2307062375 learned_addr learned my addr 172.21.15.8:0/2307062375 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:48.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.893+0000 7fda3f400640 1 --2- 172.21.15.8:0/2307062375 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fda400aab90 0x7fda40159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:48.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.893+0000 7fda36000640 1 -- 172.21.15.8:0/2307062375 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fda4006d300 msgr2=0x7fda401eeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:48.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.893+0000 7fda36000640 1 --2- 172.21.15.8:0/2307062375 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fda4006d300 0x7fda401eeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:48.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.893+0000 7fda36000640 1 -- 172.21.15.8:0/2307062375 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fda400aab90 msgr2=0x7fda40159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:48.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.893+0000 7fda36000640 1 --2- 172.21.15.8:0/2307062375 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fda400aab90 0x7fda40159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:48.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.893+0000 7fda36000640 1 -- 172.21.15.8:0/2307062375 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda401575f0 con 0x7fda4006dab0 2024-03-23T23:42:48.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.893+0000 7fda36000640 1 --2- 172.21.15.8:0/2307062375 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda4006dab0 0x7fda4015b970 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fda2800c3c0 tx=0x7fda2800c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:48.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.893+0000 7fda37400640 1 -- 172.21.15.8:0/2307062375 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda28017070 con 0x7fda4006dab0 2024-03-23T23:42:48.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.893+0000 7fda37400640 1 -- 172.21.15.8:0/2307062375 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda28005db0 con 0x7fda4006dab0 2024-03-23T23:42:48.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.893+0000 7fda45a00640 1 -- 172.21.15.8:0/2307062375 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda401578d0 con 0x7fda4006dab0 2024-03-23T23:42:48.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.893+0000 7fda37400640 1 -- 172.21.15.8:0/2307062375 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda280072f0 con 0x7fda4006dab0 2024-03-23T23:42:48.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.893+0000 7fda45a00640 1 -- 172.21.15.8:0/2307062375 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda401514c0 con 0x7fda4006dab0 2024-03-23T23:42:48.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.893+0000 7fda45a00640 1 -- 172.21.15.8:0/2307062375 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda401512e0 con 0x7fda4006dab0 2024-03-23T23:42:48.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.893+0000 7fda37400640 1 -- 172.21.15.8:0/2307062375 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fda2801a070 con 0x7fda4006dab0 2024-03-23T23:42:48.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.897+0000 7fda37400640 1 --2- 172.21.15.8:0/2307062375 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fda1c067660 0x7fda1c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:48.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.897+0000 7fda37400640 1 -- 172.21.15.8:0/2307062375 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6054+0+0 (secure 0 0 0) 0x7fda28084d90 con 0x7fda4006dab0 2024-03-23T23:42:48.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.897+0000 7fda3ea00640 1 --2- 172.21.15.8:0/2307062375 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fda1c067660 0x7fda1c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:48.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.897+0000 7fda3ea00640 1 --2- 172.21.15.8:0/2307062375 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fda1c067660 0x7fda1c069b20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fda300af000 tx=0x7fda300a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:48.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:48.901+0000 7fda37400640 1 -- 172.21.15.8:0/2307062375 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fda401512e0 con 0x7fda4006dab0 2024-03-23T23:42:49.065 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.065+0000 7fda45a00640 1 -- 172.21.15.8:0/2307062375 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "b_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fda4004f410 con 0x7fda4006dab0 2024-03-23T23:42:49.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.709+0000 7fda37400640 1 -- 172.21.15.8:0/2307062375 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "b_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'b_data' created v23) v1 ==== 160+0+0 (secure 0 0 0) 0x7fda28055250 con 0x7fda4006dab0 2024-03-23T23:42:49.711 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'b_data' created 2024-03-23T23:42:49.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.713+0000 7fda45a00640 1 -- 172.21.15.8:0/2307062375 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fda1c067660 msgr2=0x7fda1c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:49.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.713+0000 7fda45a00640 1 --2- 172.21.15.8:0/2307062375 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fda1c067660 0x7fda1c069b20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fda300af000 tx=0x7fda300a7070 comp rx=0 tx=0).stop 2024-03-23T23:42:49.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.713+0000 7fda45a00640 1 -- 172.21.15.8:0/2307062375 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda4006dab0 msgr2=0x7fda4015b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:49.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.713+0000 7fda45a00640 1 --2- 172.21.15.8:0/2307062375 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda4006dab0 0x7fda4015b970 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fda2800c3c0 tx=0x7fda2800c7c0 comp rx=0 tx=0).stop 2024-03-23T23:42:49.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.713+0000 7fda45a00640 1 -- 172.21.15.8:0/2307062375 shutdown_connections 2024-03-23T23:42:49.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.713+0000 7fda45a00640 1 --2- 172.21.15.8:0/2307062375 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fda400aab90 0x7fda40159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:49.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.713+0000 7fda45a00640 1 --2- 172.21.15.8:0/2307062375 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda4006dab0 0x7fda4015b970 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:49.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.713+0000 7fda45a00640 1 --2- 172.21.15.8:0/2307062375 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fda1c067660 0x7fda1c069b20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:49.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.713+0000 7fda45a00640 1 --2- 172.21.15.8:0/2307062375 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fda4006d300 0x7fda401eeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:49.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.713+0000 7fda45a00640 1 -- 172.21.15.8:0/2307062375 >> 172.21.15.8:0/2307062375 conn(0x7fda4006b170 msgr2=0x7fda400c0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:49.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.713+0000 7fda45a00640 1 -- 172.21.15.8:0/2307062375 shutdown_connections 2024-03-23T23:42:49.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.713+0000 7fda45a00640 1 -- 172.21.15.8:0/2307062375 wait complete. 2024-03-23T23:42:49.751 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new b b_metadata b_data 2024-03-23T23:42:49.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.893+0000 7f8c42000640 1 Processor -- start 2024-03-23T23:42:49.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.893+0000 7f8c42000640 1 -- start start 2024-03-23T23:42:49.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.897+0000 7f8c42000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8c3c152ff0 0x7f8c3c0714f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:49.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.897+0000 7f8c42000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c3c159dd0 con 0x7f8c3c159860 2024-03-23T23:42:49.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.897+0000 7f8c42000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c3c0701f0 con 0x7f8c3c0c2390 2024-03-23T23:42:49.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.897+0000 7f8c42000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c3c0704d0 con 0x7f8c3c152ff0 2024-03-23T23:42:49.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.897+0000 7f8c33e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f8c3c159860 0x7f8c3c06ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:56038/0 (socket says 172.21.15.8:56038) 2024-03-23T23:42:49.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.897+0000 7f8c33e00640 1 -- 172.21.15.8:0/1753335854 learned_addr learned my addr 172.21.15.8:0/1753335854 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:49.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.897+0000 7f8c3b400640 1 --2- 172.21.15.8:0/1753335854 >> v2:172.21.15.196:3300/0 conn(0x7f8c3c152ff0 0x7f8c3c0714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:49.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.897+0000 7f8c3aa00640 1 -- 172.21.15.8:0/1753335854 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 772511102 0 0) 0x7f8c3c159dd0 con 0x7f8c3c159860 2024-03-23T23:42:49.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.897+0000 7f8c3aa00640 1 -- 172.21.15.8:0/1753335854 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c20003530 con 0x7f8c3c159860 2024-03-23T23:42:49.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.897+0000 7f8c3b400640 1 -- 172.21.15.8:0/1753335854 >> v1:172.21.15.196:6789/0 conn(0x7f8c3c0c2390 legacy=0x7f8c3c1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:49.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.897+0000 7f8c3aa00640 1 -- 172.21.15.8:0/1753335854 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2961254782 0 0) 0x7f8c3c0701f0 con 0x7f8c3c0c2390 2024-03-23T23:42:49.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.897+0000 7f8c3b400640 1 -- 172.21.15.8:0/1753335854 >> v1:172.21.15.8:6789/0 conn(0x7f8c3c159860 legacy=0x7f8c3c06ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:49.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.897+0000 7f8c3b400640 1 -- 172.21.15.8:0/1753335854 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3c0707b0 con 0x7f8c3c152ff0 2024-03-23T23:42:49.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.901+0000 7f8c3b400640 1 --2- 172.21.15.8:0/1753335854 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c3c152ff0 0x7f8c3c0714f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c0097c0 tx=0x7f8c2c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b423911e45a6b78 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:49.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.901+0000 7f8c3aa00640 1 -- 172.21.15.8:0/1753335854 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c0b0070 con 0x7f8c3c152ff0 2024-03-23T23:42:49.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.901+0000 7f8c3aa00640 1 -- 172.21.15.8:0/1753335854 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2c0ab600 con 0x7f8c3c152ff0 2024-03-23T23:42:49.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.901+0000 7f8c3aa00640 1 -- 172.21.15.8:0/1753335854 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c0ab9d0 con 0x7f8c3c152ff0 2024-03-23T23:42:49.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.901+0000 7f8c42000640 1 -- 172.21.15.8:0/1753335854 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c3c152ff0 msgr2=0x7f8c3c0714f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:49.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.901+0000 7f8c42000640 1 --2- 172.21.15.8:0/1753335854 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c3c152ff0 0x7f8c3c0714f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c0097c0 tx=0x7f8c2c01c410 comp rx=0 tx=0).stop 2024-03-23T23:42:49.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.901+0000 7f8c42000640 1 -- 172.21.15.8:0/1753335854 shutdown_connections 2024-03-23T23:42:49.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.901+0000 7f8c42000640 1 --2- 172.21.15.8:0/1753335854 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c3c152ff0 0x7f8c3c0714f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:49.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.901+0000 7f8c42000640 1 -- 172.21.15.8:0/1753335854 >> 172.21.15.8:0/1753335854 conn(0x7f8c3c0aad10 msgr2=0x7f8c3c0ab120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:49.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.901+0000 7f8c42000640 1 -- 172.21.15.8:0/1753335854 shutdown_connections 2024-03-23T23:42:49.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.901+0000 7f8c42000640 1 -- 172.21.15.8:0/1753335854 wait complete. 2024-03-23T23:42:49.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.901+0000 7f8c42000640 1 Processor -- start 2024-03-23T23:42:49.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.901+0000 7f8c42000640 1 -- start start 2024-03-23T23:42:49.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.905+0000 7f8c42000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c3c0c2390 0x7f8c3c0ade80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:49.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.905+0000 7f8c42000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c3c152ff0 0x7f8c3c0ae3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:49.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.905+0000 7f8c42000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c3c159860 0x7f8c3c14d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:49.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.905+0000 7f8c42000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c06f4e0 con 0x7f8c3c0c2390 2024-03-23T23:42:49.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.905+0000 7f8c42000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c06f360 con 0x7f8c3c152ff0 2024-03-23T23:42:49.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.905+0000 7f8c42000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c0c7420 con 0x7f8c3c159860 2024-03-23T23:42:49.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.905+0000 7f8c3b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c3c0c2390 0x7f8c3c0ade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:49.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.905+0000 7f8c33e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c3c152ff0 0x7f8c3c0ae3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:49.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.905+0000 7f8c3b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c3c0c2390 0x7f8c3c0ade80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51872/0 (socket says 172.21.15.8:51872) 2024-03-23T23:42:49.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.905+0000 7f8c3b400640 1 -- 172.21.15.8:0/710488225 learned_addr learned my addr 172.21.15.8:0/710488225 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:49.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.905+0000 7f8c3be00640 1 --2- 172.21.15.8:0/710488225 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c3c159860 0x7f8c3c14d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:49.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.905+0000 7f8c3b400640 1 -- 172.21.15.8:0/710488225 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c3c159860 msgr2=0x7f8c3c14d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:49.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.905+0000 7f8c3b400640 1 --2- 172.21.15.8:0/710488225 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c3c159860 0x7f8c3c14d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:49.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.905+0000 7f8c3b400640 1 -- 172.21.15.8:0/710488225 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c3c152ff0 msgr2=0x7f8c3c0ae3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:49.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.905+0000 7f8c3b400640 1 --2- 172.21.15.8:0/710488225 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c3c152ff0 0x7f8c3c0ae3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:49.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.905+0000 7f8c3b400640 1 -- 172.21.15.8:0/710488225 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3c1ef460 con 0x7f8c3c0c2390 2024-03-23T23:42:49.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.905+0000 7f8c33e00640 1 --2- 172.21.15.8:0/710488225 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c3c152ff0 0x7f8c3c0ae3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:42:49.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.905+0000 7f8c3b400640 1 --2- 172.21.15.8:0/710488225 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c3c0c2390 0x7f8c3c0ade80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c0097c0 tx=0x7f8c2c01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:49.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.905+0000 7f8c33400640 1 -- 172.21.15.8:0/710488225 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c0b0050 con 0x7f8c3c0c2390 2024-03-23T23:42:49.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.905+0000 7f8c33400640 1 -- 172.21.15.8:0/710488225 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2c0b1040 con 0x7f8c3c0c2390 2024-03-23T23:42:49.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.905+0000 7f8c33400640 1 -- 172.21.15.8:0/710488225 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c006e20 con 0x7f8c3c0c2390 2024-03-23T23:42:49.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.905+0000 7f8c42000640 1 -- 172.21.15.8:0/710488225 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c3c1ef740 con 0x7f8c3c0c2390 2024-03-23T23:42:49.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.905+0000 7f8c42000640 1 -- 172.21.15.8:0/710488225 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c3c0ac260 con 0x7f8c3c0c2390 2024-03-23T23:42:49.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.905+0000 7f8c42000640 1 -- 172.21.15.8:0/710488225 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c3c0abd80 con 0x7f8c3c0c2390 2024-03-23T23:42:49.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.905+0000 7f8c33400640 1 -- 172.21.15.8:0/710488225 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f8c2c0be020 con 0x7f8c3c0c2390 2024-03-23T23:42:49.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.909+0000 7f8c33400640 1 --2- 172.21.15.8:0/710488225 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8c18067660 0x7f8c18069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:49.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.909+0000 7f8c33400640 1 -- 172.21.15.8:0/710488225 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f8c2c1200a0 con 0x7f8c3c0c2390 2024-03-23T23:42:49.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.909+0000 7f8c33e00640 1 --2- 172.21.15.8:0/710488225 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8c18067660 0x7f8c18069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:49.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.909+0000 7f8c33e00640 1 --2- 172.21.15.8:0/710488225 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8c18067660 0x7f8c18069b20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c068510 tx=0x7f8c24009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:49.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:49.913+0000 7f8c33400640 1 -- 172.21.15.8:0/710488225 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f8c2c0c5020 con 0x7f8c3c0c2390 2024-03-23T23:42:50.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.109+0000 7f8c42000640 1 -- 172.21.15.8:0/710488225 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "b", "metadata": "b_metadata", "data": "b_data"} v 0) v1 -- 0x7f8c3c04f410 con 0x7f8c3c0c2390 2024-03-23T23:42:50.741 INFO:teuthology.orchestra.run.smithi008.stderr:new fs with metadata pool 4 and data pool 5 2024-03-23T23:42:50.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.737+0000 7f8c33400640 1 -- 172.21.15.8:0/710488225 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "b", "metadata": "b_metadata", "data": "b_data"}]=0 new fs with metadata pool 4 and data pool 5 v10) v1 ==== 157+0+0 (secure 0 0 0) 0x7f8c2c016090 con 0x7f8c3c0c2390 2024-03-23T23:42:50.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.741+0000 7f8c42000640 1 -- 172.21.15.8:0/710488225 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8c18067660 msgr2=0x7f8c18069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:50.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.741+0000 7f8c42000640 1 --2- 172.21.15.8:0/710488225 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8c18067660 0x7f8c18069b20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c068510 tx=0x7f8c24009040 comp rx=0 tx=0).stop 2024-03-23T23:42:50.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.741+0000 7f8c42000640 1 -- 172.21.15.8:0/710488225 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c3c0c2390 msgr2=0x7f8c3c0ade80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:50.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.741+0000 7f8c42000640 1 --2- 172.21.15.8:0/710488225 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c3c0c2390 0x7f8c3c0ade80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c0097c0 tx=0x7f8c2c01ac50 comp rx=0 tx=0).stop 2024-03-23T23:42:50.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.741+0000 7f8c42000640 1 -- 172.21.15.8:0/710488225 shutdown_connections 2024-03-23T23:42:50.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.741+0000 7f8c42000640 1 --2- 172.21.15.8:0/710488225 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8c18067660 0x7f8c18069b20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:50.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.741+0000 7f8c42000640 1 --2- 172.21.15.8:0/710488225 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c3c159860 0x7f8c3c14d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:50.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.741+0000 7f8c42000640 1 --2- 172.21.15.8:0/710488225 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c3c152ff0 0x7f8c3c0ae3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:50.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.741+0000 7f8c42000640 1 --2- 172.21.15.8:0/710488225 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c3c0c2390 0x7f8c3c0ade80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:50.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.741+0000 7f8c42000640 1 -- 172.21.15.8:0/710488225 >> 172.21.15.8:0/710488225 conn(0x7f8c3c0aad10 msgr2=0x7f8c3c158c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:50.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.745+0000 7f8c42000640 1 -- 172.21.15.8:0/710488225 shutdown_connections 2024-03-23T23:42:50.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.745+0000 7f8c42000640 1 -- 172.21.15.8:0/710488225 wait complete. 2024-03-23T23:42:50.794 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:42:50.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.933+0000 7fe47ca00640 1 Processor -- start 2024-03-23T23:42:50.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.933+0000 7fe47ca00640 1 -- start start 2024-03-23T23:42:50.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.933+0000 7fe47ca00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe47814fc70 0x7fe4780c3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:50.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.933+0000 7fe47ca00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4780c4160 0x7fe478152f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:50.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.933+0000 7fe47ca00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4780c2f70 con 0x7fe4780c3d00 2024-03-23T23:42:50.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.933+0000 7fe47ca00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4780c36a0 con 0x7fe47814fc70 2024-03-23T23:42:50.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.933+0000 7fe47ca00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe478155e70 con 0x7fe4780c4160 2024-03-23T23:42:50.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.933+0000 7fe46fe00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe4780c3d00 0x7fe478152850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:56046/0 (socket says 172.21.15.8:56046) 2024-03-23T23:42:50.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.933+0000 7fe46fe00640 1 -- 172.21.15.8:0/3409748022 learned_addr learned my addr 172.21.15.8:0/3409748022 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:50.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.933+0000 7fe476800640 1 --2- 172.21.15.8:0/3409748022 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4780c4160 0x7fe478152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:50.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.933+0000 7fe475e00640 1 --2- 172.21.15.8:0/3409748022 >> v2:172.21.15.196:3300/0 conn(0x7fe47814fc70 0x7fe4780c3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:50.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.937+0000 7fe475400640 1 -- 172.21.15.8:0/3409748022 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243089696 0 0) 0x7fe4780c2f70 con 0x7fe4780c3d00 2024-03-23T23:42:50.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.937+0000 7fe475400640 1 -- 172.21.15.8:0/3409748022 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe45c005740 con 0x7fe4780c3d00 2024-03-23T23:42:50.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.937+0000 7fe476800640 1 -- 172.21.15.8:0/3409748022 >> v2:172.21.15.196:3300/0 conn(0x7fe47814fc70 msgr2=0x7fe4780c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:50.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.937+0000 7fe476800640 1 --2- 172.21.15.8:0/3409748022 >> v2:172.21.15.196:3300/0 conn(0x7fe47814fc70 0x7fe4780c3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:50.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.937+0000 7fe476800640 1 -- 172.21.15.8:0/3409748022 >> v1:172.21.15.8:6789/0 conn(0x7fe4780c3d00 legacy=0x7fe478152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:50.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.937+0000 7fe476800640 1 -- 172.21.15.8:0/3409748022 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe478156150 con 0x7fe4780c4160 2024-03-23T23:42:50.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.937+0000 7fe476800640 1 --2- 172.21.15.8:0/3409748022 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4780c4160 0x7fe478152f60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe470009d90 tx=0x7fe47001c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bc108d34d5125c2 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:50.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.937+0000 7fe475400640 1 -- 172.21.15.8:0/3409748022 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4700a66b0 con 0x7fe4780c4160 2024-03-23T23:42:50.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.937+0000 7fe475400640 1 -- 172.21.15.8:0/3409748022 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4700a6850 con 0x7fe4780c4160 2024-03-23T23:42:50.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.937+0000 7fe475400640 1 -- 172.21.15.8:0/3409748022 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4700a6c00 con 0x7fe4780c4160 2024-03-23T23:42:50.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.937+0000 7fe47ca00640 1 -- 172.21.15.8:0/3409748022 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4780c4160 msgr2=0x7fe478152f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:50.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.937+0000 7fe47ca00640 1 --2- 172.21.15.8:0/3409748022 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4780c4160 0x7fe478152f60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe470009d90 tx=0x7fe47001c8e0 comp rx=0 tx=0).stop 2024-03-23T23:42:50.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.937+0000 7fe47ca00640 1 -- 172.21.15.8:0/3409748022 shutdown_connections 2024-03-23T23:42:50.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.937+0000 7fe47ca00640 1 --2- 172.21.15.8:0/3409748022 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4780c4160 0x7fe478152f60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:50.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.937+0000 7fe47ca00640 1 --2- 172.21.15.8:0/3409748022 >> v2:172.21.15.196:3300/0 conn(0x7fe47814fc70 0x7fe4780c3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:50.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.941+0000 7fe47ca00640 1 -- 172.21.15.8:0/3409748022 >> 172.21.15.8:0/3409748022 conn(0x7fe47806b170 msgr2=0x7fe47806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:50.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.941+0000 7fe47ca00640 1 -- 172.21.15.8:0/3409748022 shutdown_connections 2024-03-23T23:42:50.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.941+0000 7fe47ca00640 1 -- 172.21.15.8:0/3409748022 wait complete. 2024-03-23T23:42:50.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.941+0000 7fe47ca00640 1 Processor -- start 2024-03-23T23:42:50.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.941+0000 7fe47ca00640 1 -- start start 2024-03-23T23:42:50.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.941+0000 7fe47ca00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4780c3d00 0x7fe4781ea960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:50.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.941+0000 7fe47ca00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4780c4160 0x7fe47814c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:50.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.941+0000 7fe47ca00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe47814fc70 0x7fe47814b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:50.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.941+0000 7fe47ca00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4780c18d0 con 0x7fe4780c3d00 2024-03-23T23:42:50.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.941+0000 7fe47ca00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4781534a0 con 0x7fe47814fc70 2024-03-23T23:42:50.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.941+0000 7fe47ca00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe478150050 con 0x7fe4780c4160 2024-03-23T23:42:50.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.941+0000 7fe475e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4780c3d00 0x7fe4781ea960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:50.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.941+0000 7fe475e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4780c3d00 0x7fe4781ea960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51888/0 (socket says 172.21.15.8:51888) 2024-03-23T23:42:50.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.941+0000 7fe475e00640 1 -- 172.21.15.8:0/1551223369 learned_addr learned my addr 172.21.15.8:0/1551223369 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:50.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.941+0000 7fe476800640 1 --2- 172.21.15.8:0/1551223369 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe47814fc70 0x7fe47814b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:50.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.941+0000 7fe46fe00640 1 --2- 172.21.15.8:0/1551223369 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4780c4160 0x7fe47814c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:50.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.941+0000 7fe475e00640 1 -- 172.21.15.8:0/1551223369 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4780c4160 msgr2=0x7fe47814c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:50.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.941+0000 7fe475e00640 1 --2- 172.21.15.8:0/1551223369 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4780c4160 0x7fe47814c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:50.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.941+0000 7fe475e00640 1 -- 172.21.15.8:0/1551223369 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe47814fc70 msgr2=0x7fe47814b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:50.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.941+0000 7fe475e00640 1 --2- 172.21.15.8:0/1551223369 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe47814fc70 0x7fe47814b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:50.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.941+0000 7fe475e00640 1 -- 172.21.15.8:0/1551223369 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe478152200 con 0x7fe4780c3d00 2024-03-23T23:42:50.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.941+0000 7fe46fe00640 1 --2- 172.21.15.8:0/1551223369 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4780c4160 0x7fe47814c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:42:50.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.941+0000 7fe475e00640 1 --2- 172.21.15.8:0/1551223369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4780c3d00 0x7fe4781ea960 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe46800e870 tx=0x7fe46800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:50.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.941+0000 7fe46e000640 1 -- 172.21.15.8:0/1551223369 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe468017070 con 0x7fe4780c3d00 2024-03-23T23:42:50.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.941+0000 7fe46e000640 1 -- 172.21.15.8:0/1551223369 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46800c940 con 0x7fe4780c3d00 2024-03-23T23:42:50.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.941+0000 7fe47ca00640 1 -- 172.21.15.8:0/1551223369 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe478149fc0 con 0x7fe4780c3d00 2024-03-23T23:42:50.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.941+0000 7fe46e000640 1 -- 172.21.15.8:0/1551223369 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46800ccf0 con 0x7fe4780c3d00 2024-03-23T23:42:50.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.941+0000 7fe47ca00640 1 -- 172.21.15.8:0/1551223369 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe47814a580 con 0x7fe4780c3d00 2024-03-23T23:42:50.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.945+0000 7fe47ca00640 1 -- 172.21.15.8:0/1551223369 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe478068270 con 0x7fe4780c3d00 2024-03-23T23:42:50.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.945+0000 7fe46e000640 1 -- 172.21.15.8:0/1551223369 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fe46801a070 con 0x7fe4780c3d00 2024-03-23T23:42:50.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.945+0000 7fe46e000640 1 --2- 172.21.15.8:0/1551223369 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe454067660 0x7fe454069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:50.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.945+0000 7fe46e000640 1 -- 172.21.15.8:0/1551223369 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fe468085a20 con 0x7fe4780c3d00 2024-03-23T23:42:50.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.945+0000 7fe46fe00640 1 --2- 172.21.15.8:0/1551223369 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe454067660 0x7fe454069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:50.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.945+0000 7fe46fe00640 1 --2- 172.21.15.8:0/1551223369 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe454067660 0x7fe454069b20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe4780c8250 tx=0x7fe460009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:50.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:50.949+0000 7fe46e000640 1 -- 172.21.15.8:0/1551223369 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fe478152200 con 0x7fe4780c3d00 2024-03-23T23:42:51.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.113+0000 7fe47ca00640 1 -- 172.21.15.8:0/1551223369 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4780722a0 con 0x7fe4780c3d00 2024-03-23T23:42:51.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.117+0000 7fe46e000640 1 -- 172.21.15.8:0/1551223369 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20284 (secure 0 0 0) 0x7fe468055d10 con 0x7fe4780c3d00 2024-03-23T23:42:51.118 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:42:51.118 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":24,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","created":"2024-03-23T23:42:15.169430+0000","modified":"2024-03-23T23:42:50.113586+0000","last_up_change":"2024-03-23T23:42:26.509742+0000","last_in_change":"2024-03-23T23:42:17.662330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:42:26.327445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-23T23:42:38.218800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-23T23:42:39.054195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-23T23:42:48.327799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-23T23:42:49.113061+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e967bf31-21d6-4d11-bc3d-0df8177a1b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6809","nonce":2187201732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6811","nonce":2187201732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6815","nonce":2187201732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6813","nonce":2187201732}]},"public_addr":"172.21.15.8:6809/2187201732","cluster_addr":"172.21.15.8:6811/2187201732","heartbeat_back_addr":"172.21.15.8:6815/2187201732","heartbeat_front_addr":"172.21.15.8:6813/2187201732","state":["exists","up"]},{"osd":1,"uuid":"c8e33701-7acd-4474-8402-d52461171fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6818","nonce":3205168010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6822","nonce":3205168010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6830","nonce":3205168010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6826","nonce":3205168010}]},"public_addr":"172.21.15.8:6818/3205168010","cluster_addr":"172.21.15.8:6822/3205168010","heartbeat_back_addr":"172.21.15.8:6830/3205168010","heartbeat_front_addr":"172.21.15.8:6826/3205168010","state":["exists","up"]},{"osd":2,"uuid":"ceebdbf7-4c2f-4757-b52d-fd8b20e77570","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6801","nonce":475463656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6803","nonce":475463656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6807","nonce":475463656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6805","nonce":475463656}]},"public_addr":"172.21.15.8:6801/475463656","cluster_addr":"172.21.15.8:6803/475463656","heartbeat_back_addr":"172.21.15.8:6807/475463656","heartbeat_front_addr":"172.21.15.8:6805/475463656","state":["exists","up"]},{"osd":3,"uuid":"89e258da-5767-429e-8441-edf877d2f3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6819","nonce":1514082871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6821","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6823","nonce":1514082871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6829","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6831","nonce":1514082871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6825","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6827","nonce":1514082871}]},"public_addr":"172.21.15.8:6819/1514082871","cluster_addr":"172.21.15.8:6823/1514082871","heartbeat_back_addr":"172.21.15.8:6831/1514082871","heartbeat_front_addr":"172.21.15.8:6827/1514082871","state":["exists","up"]},{"osd":4,"uuid":"2b7451ae-ea16-4f0a-ae50-04fde75e45ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6825","nonce":3516578147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6827","nonce":3516578147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6831","nonce":3516578147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6829","nonce":3516578147}]},"public_addr":"172.21.15.196:6825/3516578147","cluster_addr":"172.21.15.196:6827/3516578147","heartbeat_back_addr":"172.21.15.196:6831/3516578147","heartbeat_front_addr":"172.21.15.196:6829/3516578147","state":["exists","up"]},{"osd":5,"uuid":"e68a8914-e591-466a-bc9e-f2d7c67aac13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6802","nonce":830595758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6806","nonce":830595758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6814","nonce":830595758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6810","nonce":830595758}]},"public_addr":"172.21.15.196:6802/830595758","cluster_addr":"172.21.15.196:6806/830595758","heartbeat_back_addr":"172.21.15.196:6814/830595758","heartbeat_front_addr":"172.21.15.196:6810/830595758","state":["exists","up"]},{"osd":6,"uuid":"e47723c5-50a0-4cd8-92d9-01972072b422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6801","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6803","nonce":472639906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6805","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6807","nonce":472639906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6815","nonce":472639906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6811","nonce":472639906}]},"public_addr":"172.21.15.196:6803/472639906","cluster_addr":"172.21.15.196:6807/472639906","heartbeat_back_addr":"172.21.15.196:6815/472639906","heartbeat_front_addr":"172.21.15.196:6811/472639906","state":["exists","up"]},{"osd":7,"uuid":"e1e9113d-8005-47b3-9a75-9e701199f1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6817","nonce":4151820349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6819","nonce":4151820349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6823","nonce":4151820349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6821","nonce":4151820349}]},"public_addr":"172.21.15.196:6817/4151820349","cluster_addr":"172.21.15.196:6819/4151820349","heartbeat_back_addr":"172.21.15.196:6823/4151820349","heartbeat_front_addr":"172.21.15.196:6821/4151820349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.221790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.265974+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.190319+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.376359+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.329657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.402958+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.300703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.133121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:42:51.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.117+0000 7fe47ca00640 1 -- 172.21.15.8:0/1551223369 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe454067660 msgr2=0x7fe454069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:51.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.117+0000 7fe47ca00640 1 --2- 172.21.15.8:0/1551223369 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe454067660 0x7fe454069b20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe4780c8250 tx=0x7fe460009040 comp rx=0 tx=0).stop 2024-03-23T23:42:51.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.117+0000 7fe47ca00640 1 -- 172.21.15.8:0/1551223369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4780c3d00 msgr2=0x7fe4781ea960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:51.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.117+0000 7fe47ca00640 1 --2- 172.21.15.8:0/1551223369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4780c3d00 0x7fe4781ea960 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe46800e870 tx=0x7fe46800ec70 comp rx=0 tx=0).stop 2024-03-23T23:42:51.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.117+0000 7fe47ca00640 1 -- 172.21.15.8:0/1551223369 shutdown_connections 2024-03-23T23:42:51.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.117+0000 7fe47ca00640 1 --2- 172.21.15.8:0/1551223369 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe47814fc70 0x7fe47814b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:51.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.117+0000 7fe47ca00640 1 --2- 172.21.15.8:0/1551223369 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe454067660 0x7fe454069b20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:51.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.117+0000 7fe47ca00640 1 --2- 172.21.15.8:0/1551223369 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4780c4160 0x7fe47814c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:51.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.117+0000 7fe47ca00640 1 --2- 172.21.15.8:0/1551223369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4780c3d00 0x7fe4781ea960 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:51.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.117+0000 7fe47ca00640 1 -- 172.21.15.8:0/1551223369 >> 172.21.15.8:0/1551223369 conn(0x7fe47806b170 msgr2=0x7fe4780725c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:51.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.117+0000 7fe47ca00640 1 -- 172.21.15.8:0/1551223369 shutdown_connections 2024-03-23T23:42:51.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.117+0000 7fe47ca00640 1 -- 172.21.15.8:0/1551223369 wait complete. 2024-03-23T23:42:51.139 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:42:51.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.277+0000 7fe4adc00640 1 Processor -- start 2024-03-23T23:42:51.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.277+0000 7fe4adc00640 1 -- start start 2024-03-23T23:42:51.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.277+0000 7fe4adc00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe4a80c4250 0x7fe4a8152b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:51.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.277+0000 7fe4adc00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe4a8153080 0x7fe4a8158f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:51.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.277+0000 7fe4adc00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a80c4790 con 0x7fe4a80c2f10 2024-03-23T23:42:51.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.281+0000 7fe4adc00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a80c07d0 con 0x7fe4a8153080 2024-03-23T23:42:51.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.281+0000 7fe4adc00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a80c0ab0 con 0x7fe4a80c4250 2024-03-23T23:42:51.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.281+0000 7fe4a7400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe4a8153080 0x7fe4a8158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:51.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.281+0000 7fe4a7400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe4a8153080 0x7fe4a8158f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51892/0 (socket says 172.21.15.8:51892) 2024-03-23T23:42:51.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.281+0000 7fe4a6a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe4a80c2f10 0x7fe4a80c3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:56048/0 (socket says 172.21.15.8:56048) 2024-03-23T23:42:51.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.281+0000 7fe4a7400640 1 -- 172.21.15.8:0/1603188490 learned_addr learned my addr 172.21.15.8:0/1603188490 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:51.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.281+0000 7fe49e000640 1 --2- 172.21.15.8:0/1603188490 >> v2:172.21.15.196:3300/0 conn(0x7fe4a80c4250 0x7fe4a8152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:51.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.281+0000 7fe4a7400640 1 -- 172.21.15.8:0/1603188490 >> v2:172.21.15.196:3300/0 conn(0x7fe4a80c4250 msgr2=0x7fe4a8152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:51.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.281+0000 7fe4a7400640 1 --2- 172.21.15.8:0/1603188490 >> v2:172.21.15.196:3300/0 conn(0x7fe4a80c4250 0x7fe4a8152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:51.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.281+0000 7fe4a7400640 1 -- 172.21.15.8:0/1603188490 >> v1:172.21.15.8:6789/0 conn(0x7fe4a80c2f10 legacy=0x7fe4a80c3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:51.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.281+0000 7fe4a7400640 1 -- 172.21.15.8:0/1603188490 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a80c0d90 con 0x7fe4a8153080 2024-03-23T23:42:51.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.281+0000 7fe4a6000640 1 -- 172.21.15.8:0/1603188490 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1016456588 0 0) 0x7fe4a80c4790 con 0x7fe4a80c2f10 2024-03-23T23:42:51.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.281+0000 7fe4a7400640 1 --2- 172.21.15.8:0/1603188490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4a8153080 0x7fe4a8158f00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe4a80709a0 tx=0x7fe4a001c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbff5a860326915b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:51.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.281+0000 7fe4a6000640 1 -- 172.21.15.8:0/1603188490 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a00a5640 con 0x7fe4a8153080 2024-03-23T23:42:51.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.281+0000 7fe4a6000640 1 -- 172.21.15.8:0/1603188490 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a00a57e0 con 0x7fe4a8153080 2024-03-23T23:42:51.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.281+0000 7fe4a6000640 1 -- 172.21.15.8:0/1603188490 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a00a5bb0 con 0x7fe4a8153080 2024-03-23T23:42:51.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.285+0000 7fe4adc00640 1 -- 172.21.15.8:0/1603188490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4a8153080 msgr2=0x7fe4a8158f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:51.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.285+0000 7fe4adc00640 1 --2- 172.21.15.8:0/1603188490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4a8153080 0x7fe4a8158f00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe4a80709a0 tx=0x7fe4a001c8d0 comp rx=0 tx=0).stop 2024-03-23T23:42:51.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.285+0000 7fe4adc00640 1 -- 172.21.15.8:0/1603188490 shutdown_connections 2024-03-23T23:42:51.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.285+0000 7fe4adc00640 1 --2- 172.21.15.8:0/1603188490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4a8153080 0x7fe4a8158f00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:51.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.285+0000 7fe4adc00640 1 --2- 172.21.15.8:0/1603188490 >> v2:172.21.15.196:3300/0 conn(0x7fe4a80c4250 0x7fe4a8152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:51.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.285+0000 7fe4adc00640 1 -- 172.21.15.8:0/1603188490 >> 172.21.15.8:0/1603188490 conn(0x7fe4a806b170 msgr2=0x7fe4a806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:51.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.285+0000 7fe4adc00640 1 -- 172.21.15.8:0/1603188490 shutdown_connections 2024-03-23T23:42:51.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.285+0000 7fe4adc00640 1 -- 172.21.15.8:0/1603188490 wait complete. 2024-03-23T23:42:51.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.285+0000 7fe4adc00640 1 Processor -- start 2024-03-23T23:42:51.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.285+0000 7fe4adc00640 1 -- start start 2024-03-23T23:42:51.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.285+0000 7fe4adc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4a80c2f10 0x7fe4a8145fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:51.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.285+0000 7fe4adc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe4a80c4250 0x7fe4a81edb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:51.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.285+0000 7fe4adc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4a8153080 0x7fe4a814dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:51.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.285+0000 7fe4adc00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a8159850 con 0x7fe4a80c2f10 2024-03-23T23:42:51.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.285+0000 7fe4adc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a80c32f0 con 0x7fe4a80c4250 2024-03-23T23:42:51.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.285+0000 7fe4adc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a80aa630 con 0x7fe4a8153080 2024-03-23T23:42:51.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.285+0000 7fe4a6a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4a80c2f10 0x7fe4a8145fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:51.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.285+0000 7fe4a6a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4a80c2f10 0x7fe4a8145fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51900/0 (socket says 172.21.15.8:51900) 2024-03-23T23:42:51.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.285+0000 7fe4a6a00640 1 -- 172.21.15.8:0/411756321 learned_addr learned my addr 172.21.15.8:0/411756321 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:51.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.285+0000 7fe49e000640 1 --2- 172.21.15.8:0/411756321 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe4a80c4250 0x7fe4a81edb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:51.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.285+0000 7fe4a7400640 1 --2- 172.21.15.8:0/411756321 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4a8153080 0x7fe4a814dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:51.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.285+0000 7fe4a6a00640 1 -- 172.21.15.8:0/411756321 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4a8153080 msgr2=0x7fe4a814dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:51.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.285+0000 7fe4a6a00640 1 --2- 172.21.15.8:0/411756321 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4a8153080 0x7fe4a814dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:51.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.285+0000 7fe4a6a00640 1 -- 172.21.15.8:0/411756321 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe4a80c4250 msgr2=0x7fe4a81edb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:51.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.285+0000 7fe4a6a00640 1 --2- 172.21.15.8:0/411756321 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe4a80c4250 0x7fe4a81edb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:51.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.285+0000 7fe4a6a00640 1 -- 172.21.15.8:0/411756321 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a81ee070 con 0x7fe4a80c2f10 2024-03-23T23:42:51.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.289+0000 7fe4a6a00640 1 --2- 172.21.15.8:0/411756321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4a80c2f10 0x7fe4a8145fe0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe4980011f0 tx=0x7fe49800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:51.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.289+0000 7fe49f400640 1 -- 172.21.15.8:0/411756321 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe498018070 con 0x7fe4a80c2f10 2024-03-23T23:42:51.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.289+0000 7fe49f400640 1 -- 172.21.15.8:0/411756321 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4980074e0 con 0x7fe4a80c2f10 2024-03-23T23:42:51.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.289+0000 7fe49f400640 1 -- 172.21.15.8:0/411756321 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe498004a10 con 0x7fe4a80c2f10 2024-03-23T23:42:51.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.289+0000 7fe4adc00640 1 -- 172.21.15.8:0/411756321 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a81ee310 con 0x7fe4a80c2f10 2024-03-23T23:42:51.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.289+0000 7fe4adc00640 1 -- 172.21.15.8:0/411756321 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a81ee8d0 con 0x7fe4a80c2f10 2024-03-23T23:42:51.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.289+0000 7fe4adc00640 1 -- 172.21.15.8:0/411756321 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a8068270 con 0x7fe4a80c2f10 2024-03-23T23:42:51.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.289+0000 7fe49f400640 1 -- 172.21.15.8:0/411756321 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fe498004bb0 con 0x7fe4a80c2f10 2024-03-23T23:42:51.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.289+0000 7fe49f400640 1 --2- 172.21.15.8:0/411756321 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe484067660 0x7fe484069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:51.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.289+0000 7fe49f400640 1 -- 172.21.15.8:0/411756321 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fe498084e60 con 0x7fe4a80c2f10 2024-03-23T23:42:51.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.289+0000 7fe49e000640 1 --2- 172.21.15.8:0/411756321 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe484067660 0x7fe484069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:51.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.289+0000 7fe49e000640 1 --2- 172.21.15.8:0/411756321 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe484067660 0x7fe484069b20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe4a80c8250 tx=0x7fe490009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:51.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.293+0000 7fe49f400640 1 -- 172.21.15.8:0/411756321 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fe4980551f0 con 0x7fe4a80c2f10 2024-03-23T23:42:51.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.457+0000 7fe4adc00640 1 -- 172.21.15.8:0/411756321 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4a8073100 con 0x7fe4a80c2f10 2024-03-23T23:42:51.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.461+0000 7fe49f400640 1 -- 172.21.15.8:0/411756321 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20284 (secure 0 0 0) 0x7fe49805b020 con 0x7fe4a80c2f10 2024-03-23T23:42:51.461 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:42:51.461 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":24,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","created":"2024-03-23T23:42:15.169430+0000","modified":"2024-03-23T23:42:50.113586+0000","last_up_change":"2024-03-23T23:42:26.509742+0000","last_in_change":"2024-03-23T23:42:17.662330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:42:26.327445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-23T23:42:38.218800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-23T23:42:39.054195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-23T23:42:48.327799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-23T23:42:49.113061+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e967bf31-21d6-4d11-bc3d-0df8177a1b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6809","nonce":2187201732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6811","nonce":2187201732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6815","nonce":2187201732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6813","nonce":2187201732}]},"public_addr":"172.21.15.8:6809/2187201732","cluster_addr":"172.21.15.8:6811/2187201732","heartbeat_back_addr":"172.21.15.8:6815/2187201732","heartbeat_front_addr":"172.21.15.8:6813/2187201732","state":["exists","up"]},{"osd":1,"uuid":"c8e33701-7acd-4474-8402-d52461171fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6818","nonce":3205168010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6822","nonce":3205168010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6830","nonce":3205168010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6826","nonce":3205168010}]},"public_addr":"172.21.15.8:6818/3205168010","cluster_addr":"172.21.15.8:6822/3205168010","heartbeat_back_addr":"172.21.15.8:6830/3205168010","heartbeat_front_addr":"172.21.15.8:6826/3205168010","state":["exists","up"]},{"osd":2,"uuid":"ceebdbf7-4c2f-4757-b52d-fd8b20e77570","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6801","nonce":475463656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6803","nonce":475463656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6807","nonce":475463656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6805","nonce":475463656}]},"public_addr":"172.21.15.8:6801/475463656","cluster_addr":"172.21.15.8:6803/475463656","heartbeat_back_addr":"172.21.15.8:6807/475463656","heartbeat_front_addr":"172.21.15.8:6805/475463656","state":["exists","up"]},{"osd":3,"uuid":"89e258da-5767-429e-8441-edf877d2f3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6819","nonce":1514082871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6821","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6823","nonce":1514082871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6829","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6831","nonce":1514082871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6825","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6827","nonce":1514082871}]},"public_addr":"172.21.15.8:6819/1514082871","cluster_addr":"172.21.15.8:6823/1514082871","heartbeat_back_addr":"172.21.15.8:6831/1514082871","heartbeat_front_addr":"172.21.15.8:6827/1514082871","state":["exists","up"]},{"osd":4,"uuid":"2b7451ae-ea16-4f0a-ae50-04fde75e45ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6825","nonce":3516578147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6827","nonce":3516578147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6831","nonce":3516578147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6829","nonce":3516578147}]},"public_addr":"172.21.15.196:6825/3516578147","cluster_addr":"172.21.15.196:6827/3516578147","heartbeat_back_addr":"172.21.15.196:6831/3516578147","heartbeat_front_addr":"172.21.15.196:6829/3516578147","state":["exists","up"]},{"osd":5,"uuid":"e68a8914-e591-466a-bc9e-f2d7c67aac13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6802","nonce":830595758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6806","nonce":830595758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6814","nonce":830595758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6810","nonce":830595758}]},"public_addr":"172.21.15.196:6802/830595758","cluster_addr":"172.21.15.196:6806/830595758","heartbeat_back_addr":"172.21.15.196:6814/830595758","heartbeat_front_addr":"172.21.15.196:6810/830595758","state":["exists","up"]},{"osd":6,"uuid":"e47723c5-50a0-4cd8-92d9-01972072b422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6801","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6803","nonce":472639906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6805","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6807","nonce":472639906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6815","nonce":472639906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6811","nonce":472639906}]},"public_addr":"172.21.15.196:6803/472639906","cluster_addr":"172.21.15.196:6807/472639906","heartbeat_back_addr":"172.21.15.196:6815/472639906","heartbeat_front_addr":"172.21.15.196:6811/472639906","state":["exists","up"]},{"osd":7,"uuid":"e1e9113d-8005-47b3-9a75-9e701199f1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6817","nonce":4151820349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6819","nonce":4151820349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6823","nonce":4151820349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6821","nonce":4151820349}]},"public_addr":"172.21.15.196:6817/4151820349","cluster_addr":"172.21.15.196:6819/4151820349","heartbeat_back_addr":"172.21.15.196:6823/4151820349","heartbeat_front_addr":"172.21.15.196:6821/4151820349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.221790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.265974+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.190319+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.376359+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.329657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.402958+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.300703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.133121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:42:51.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.461+0000 7fe4adc00640 1 -- 172.21.15.8:0/411756321 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe484067660 msgr2=0x7fe484069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:51.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.461+0000 7fe4adc00640 1 --2- 172.21.15.8:0/411756321 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe484067660 0x7fe484069b20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe4a80c8250 tx=0x7fe490009190 comp rx=0 tx=0).stop 2024-03-23T23:42:51.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.461+0000 7fe4adc00640 1 -- 172.21.15.8:0/411756321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4a80c2f10 msgr2=0x7fe4a8145fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:51.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.461+0000 7fe4adc00640 1 --2- 172.21.15.8:0/411756321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4a80c2f10 0x7fe4a8145fe0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe4980011f0 tx=0x7fe49800c9b0 comp rx=0 tx=0).stop 2024-03-23T23:42:51.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.461+0000 7fe4adc00640 1 -- 172.21.15.8:0/411756321 shutdown_connections 2024-03-23T23:42:51.464 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.461+0000 7fe4adc00640 1 --2- 172.21.15.8:0/411756321 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe484067660 0x7fe484069b20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:51.464 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.461+0000 7fe4adc00640 1 --2- 172.21.15.8:0/411756321 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4a8153080 0x7fe4a814dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:51.464 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.461+0000 7fe4adc00640 1 --2- 172.21.15.8:0/411756321 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe4a80c4250 0x7fe4a81edb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:51.464 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.461+0000 7fe4adc00640 1 --2- 172.21.15.8:0/411756321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4a80c2f10 0x7fe4a8145fe0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:51.464 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.461+0000 7fe4adc00640 1 -- 172.21.15.8:0/411756321 >> 172.21.15.8:0/411756321 conn(0x7fe4a806b170 msgr2=0x7fe4a80720b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:51.464 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.461+0000 7fe4adc00640 1 -- 172.21.15.8:0/411756321 shutdown_connections 2024-03-23T23:42:51.464 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.461+0000 7fe4adc00640 1 -- 172.21.15.8:0/411756321 wait complete. 2024-03-23T23:42:51.483 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b standby_count_wanted 0 2024-03-23T23:42:51.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.625+0000 7f3206200640 1 Processor -- start 2024-03-23T23:42:51.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.625+0000 7f3206200640 1 -- start start 2024-03-23T23:42:51.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.625+0000 7f3206200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f320006dab0 0x7f3200156580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:51.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.625+0000 7f3206200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f32000aab90 0x7f3200152670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:51.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.625+0000 7f3206200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f320006d300 0x7f320014f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:51.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.625+0000 7f3206200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f320006e6f0 con 0x7f320006dab0 2024-03-23T23:42:51.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.625+0000 7f3206200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32001560f0 con 0x7f320006d300 2024-03-23T23:42:51.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.625+0000 7f3206200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3200156ac0 con 0x7f32000aab90 2024-03-23T23:42:51.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.625+0000 7f31ff400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f320006dab0 0x7f3200156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:51.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.625+0000 7f31ff400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f320006dab0 0x7f3200156580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51902/0 (socket says 172.21.15.8:51902) 2024-03-23T23:42:51.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.625+0000 7f31ff400640 1 -- 172.21.15.8:0/3213548865 learned_addr learned my addr 172.21.15.8:0/3213548865 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:51.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.625+0000 7f31f6a00640 1 --2- 172.21.15.8:0/3213548865 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f32000aab90 0x7f3200152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:51.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.625+0000 7f31ffe00640 1 --2- 172.21.15.8:0/3213548865 >> v2:172.21.15.196:3300/0 conn(0x7f320006d300 0x7f320014f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:51.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.629+0000 7f31ff400640 1 -- 172.21.15.8:0/3213548865 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f32000aab90 msgr2=0x7f3200152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:51.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.629+0000 7f31ff400640 1 --2- 172.21.15.8:0/3213548865 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f32000aab90 0x7f3200152670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:51.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.629+0000 7f31ff400640 1 -- 172.21.15.8:0/3213548865 >> v2:172.21.15.196:3300/0 conn(0x7f320006d300 msgr2=0x7f320014f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:51.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.629+0000 7f31ff400640 1 --2- 172.21.15.8:0/3213548865 >> v2:172.21.15.196:3300/0 conn(0x7f320006d300 0x7f320014f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:51.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.629+0000 7f31ff400640 1 -- 172.21.15.8:0/3213548865 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f320006e940 con 0x7f320006dab0 2024-03-23T23:42:51.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.629+0000 7f31ff400640 1 --2- 172.21.15.8:0/3213548865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f320006dab0 0x7f3200156580 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f32000734e0 tx=0x7f31f001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=375f9a22ed833337 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:51.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.629+0000 7f31fea00640 1 -- 172.21.15.8:0/3213548865 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f00aa610 con 0x7f320006dab0 2024-03-23T23:42:51.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.629+0000 7f31fea00640 1 -- 172.21.15.8:0/3213548865 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f00af070 con 0x7f320006dab0 2024-03-23T23:42:51.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.629+0000 7f31fea00640 1 -- 172.21.15.8:0/3213548865 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f00aa9d0 con 0x7f320006dab0 2024-03-23T23:42:51.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.629+0000 7f3206200640 1 -- 172.21.15.8:0/3213548865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f320006dab0 msgr2=0x7f3200156580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:51.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.629+0000 7f3206200640 1 --2- 172.21.15.8:0/3213548865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f320006dab0 0x7f3200156580 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f32000734e0 tx=0x7f31f001c4f0 comp rx=0 tx=0).stop 2024-03-23T23:42:51.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.629+0000 7f3206200640 1 -- 172.21.15.8:0/3213548865 shutdown_connections 2024-03-23T23:42:51.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.629+0000 7f3206200640 1 --2- 172.21.15.8:0/3213548865 >> v2:172.21.15.196:3300/0 conn(0x7f320006d300 0x7f320014f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:51.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.629+0000 7f3206200640 1 --2- 172.21.15.8:0/3213548865 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f32000aab90 0x7f3200152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:51.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.629+0000 7f3206200640 1 --2- 172.21.15.8:0/3213548865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f320006dab0 0x7f3200156580 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:51.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.629+0000 7f3206200640 1 -- 172.21.15.8:0/3213548865 >> 172.21.15.8:0/3213548865 conn(0x7f320006b170 msgr2=0x7f320006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:51.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.629+0000 7f3206200640 1 -- 172.21.15.8:0/3213548865 shutdown_connections 2024-03-23T23:42:51.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.629+0000 7f3206200640 1 -- 172.21.15.8:0/3213548865 wait complete. 2024-03-23T23:42:51.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.633+0000 7f3206200640 1 Processor -- start 2024-03-23T23:42:51.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.633+0000 7f3206200640 1 -- start start 2024-03-23T23:42:51.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.633+0000 7f3206200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f320006d300 0x7f32001f36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:51.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.633+0000 7f3206200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f320006dab0 0x7f32001f3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:51.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.633+0000 7f3206200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32000aab90 0x7f32001f5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:51.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.633+0000 7f3206200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320006de90 con 0x7f32000aab90 2024-03-23T23:42:51.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.633+0000 7f3206200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3200152bb0 con 0x7f320006d300 2024-03-23T23:42:51.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.633+0000 7f3206200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f320006e010 con 0x7f320006dab0 2024-03-23T23:42:51.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.633+0000 7f31ffe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32000aab90 0x7f32001f5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:51.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.633+0000 7f31ff400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f320006d300 0x7f32001f36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:51.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.633+0000 7f31ff400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f320006d300 0x7f32001f36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:60674/0 (socket says 172.21.15.8:60674) 2024-03-23T23:42:51.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.633+0000 7f31ff400640 1 -- 172.21.15.8:0/3136495371 learned_addr learned my addr 172.21.15.8:0/3136495371 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:51.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.633+0000 7f31f6a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f320006dab0 0x7f32001f3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:51.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.633+0000 7f31ffe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32000aab90 0x7f32001f5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51904/0 (socket says 172.21.15.8:51904) 2024-03-23T23:42:51.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.633+0000 7f31ff400640 1 -- 172.21.15.8:0/3136495371 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f320006dab0 msgr2=0x7f32001f3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:51.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.633+0000 7f31ff400640 1 --2- 172.21.15.8:0/3136495371 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f320006dab0 0x7f32001f3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:51.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.633+0000 7f31ff400640 1 -- 172.21.15.8:0/3136495371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32000aab90 msgr2=0x7f32001f5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:51.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.633+0000 7f31ff400640 1 --2- 172.21.15.8:0/3136495371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32000aab90 0x7f32001f5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:51.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.633+0000 7f31ff400640 1 -- 172.21.15.8:0/3136495371 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32000719b0 con 0x7f320006d300 2024-03-23T23:42:51.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.633+0000 7f31f6a00640 1 --2- 172.21.15.8:0/3136495371 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f320006dab0 0x7f32001f3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:42:51.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.633+0000 7f31ffe00640 1 --2- 172.21.15.8:0/3136495371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32000aab90 0x7f32001f5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:42:51.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.633+0000 7f31ff400640 1 --2- 172.21.15.8:0/3136495371 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f320006d300 0x7f32001f36e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f31f001aba0 tx=0x7f31f001ad30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:51.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.633+0000 7f31f7e00640 1 -- 172.21.15.8:0/3136495371 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f00bd3f0 con 0x7f320006d300 2024-03-23T23:42:51.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.633+0000 7f31f7e00640 1 -- 172.21.15.8:0/3136495371 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f00bd590 con 0x7f320006d300 2024-03-23T23:42:51.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.633+0000 7f31f7e00640 1 -- 172.21.15.8:0/3136495371 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f00bd960 con 0x7f320006d300 2024-03-23T23:42:51.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.633+0000 7f3206200640 1 -- 172.21.15.8:0/3136495371 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3200147460 con 0x7f320006d300 2024-03-23T23:42:51.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.633+0000 7f3206200640 1 -- 172.21.15.8:0/3136495371 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3200148690 con 0x7f320006d300 2024-03-23T23:42:51.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.637+0000 7f3206200640 1 -- 172.21.15.8:0/3136495371 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f320004f410 con 0x7f320006d300 2024-03-23T23:42:51.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.637+0000 7f31f7e00640 1 -- 172.21.15.8:0/3136495371 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f31f00c63f0 con 0x7f320006d300 2024-03-23T23:42:51.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.637+0000 7f31f7e00640 1 --2- 172.21.15.8:0/3136495371 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f31dc067660 0x7f31dc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:51.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.637+0000 7f31f7e00640 1 -- 172.21.15.8:0/3136495371 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f31f0120440 con 0x7f320006d300 2024-03-23T23:42:51.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.637+0000 7f31f6a00640 1 --2- 172.21.15.8:0/3136495371 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f31dc067660 0x7f31dc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:51.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.637+0000 7f31f6a00640 1 --2- 172.21.15.8:0/3136495371 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f31dc067660 0x7f31dc069b20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f32001f5740 tx=0x7f31e8009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:51.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.645+0000 7f31f7e00640 1 -- 172.21.15.8:0/3136495371 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f31f00a7070 con 0x7f320006d300 2024-03-23T23:42:51.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:51.869+0000 7f3206200640 1 -- 172.21.15.8:0/3136495371 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f320006d0e0 con 0x7f320006d300 2024-03-23T23:42:52.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.761+0000 7f31f7e00640 1 -- 172.21.15.8:0/3136495371 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "standby_count_wanted", "val": "0"}]=0 v13) v1 ==== 113+0+0 (secure 0 0 0) 0x7f31f0016110 con 0x7f320006d300 2024-03-23T23:42:52.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.761+0000 7f3206200640 1 -- 172.21.15.8:0/3136495371 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f31dc067660 msgr2=0x7f31dc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:52.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.761+0000 7f3206200640 1 --2- 172.21.15.8:0/3136495371 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f31dc067660 0x7f31dc069b20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f32001f5740 tx=0x7f31e8009190 comp rx=0 tx=0).stop 2024-03-23T23:42:52.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.761+0000 7f3206200640 1 -- 172.21.15.8:0/3136495371 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f320006d300 msgr2=0x7f32001f36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:52.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.761+0000 7f3206200640 1 --2- 172.21.15.8:0/3136495371 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f320006d300 0x7f32001f36e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f31f001aba0 tx=0x7f31f001ad30 comp rx=0 tx=0).stop 2024-03-23T23:42:52.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.761+0000 7f3206200640 1 -- 172.21.15.8:0/3136495371 shutdown_connections 2024-03-23T23:42:52.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.761+0000 7f3206200640 1 --2- 172.21.15.8:0/3136495371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32000aab90 0x7f32001f5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:52.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.761+0000 7f3206200640 1 --2- 172.21.15.8:0/3136495371 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f31dc067660 0x7f31dc069b20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:52.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.761+0000 7f3206200640 1 --2- 172.21.15.8:0/3136495371 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f320006dab0 0x7f32001f3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:52.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.761+0000 7f3206200640 1 --2- 172.21.15.8:0/3136495371 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f320006d300 0x7f32001f36e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:52.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.761+0000 7f3206200640 1 -- 172.21.15.8:0/3136495371 >> 172.21.15.8:0/3136495371 conn(0x7f320006b170 msgr2=0x7f320006b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:52.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.761+0000 7f3206200640 1 -- 172.21.15.8:0/3136495371 shutdown_connections 2024-03-23T23:42:52.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.761+0000 7f3206200640 1 -- 172.21.15.8:0/3136495371 wait complete. 2024-03-23T23:42:52.783 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-03-23T23:42:52.783 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b allow_standby_replay false 2024-03-23T23:42:52.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.925+0000 7ff59dc00640 1 Processor -- start 2024-03-23T23:42:52.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.925+0000 7ff59dc00640 1 -- start start 2024-03-23T23:42:52.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.925+0000 7ff59dc00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff5980c4fb0 0x7ff5981542c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:52.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.925+0000 7ff59dc00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5980c5770 con 0x7ff598151000 2024-03-23T23:42:52.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.925+0000 7ff59dc00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5980c5490 con 0x7ff5980c86b0 2024-03-23T23:42:52.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.925+0000 7ff59dc00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5980c84a0 con 0x7ff5980c4fb0 2024-03-23T23:42:52.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.925+0000 7ff58fe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff5980c4fb0 0x7ff5981542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:52.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.925+0000 7ff596a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff598151000 0x7ff5980c6e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:44842/0 (socket says 172.21.15.8:44842) 2024-03-23T23:42:52.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.925+0000 7ff596a00640 1 -- 172.21.15.8:0/2474212215 learned_addr learned my addr 172.21.15.8:0/2474212215 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:52.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.925+0000 7ff58fe00640 1 -- 172.21.15.8:0/2474212215 >> v1:172.21.15.196:6789/0 conn(0x7ff5980c86b0 legacy=0x7ff5980ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:52.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.925+0000 7ff58fe00640 1 -- 172.21.15.8:0/2474212215 >> v1:172.21.15.8:6789/0 conn(0x7ff598151000 legacy=0x7ff5980c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:52.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.925+0000 7ff58fe00640 1 -- 172.21.15.8:0/2474212215 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5981537e0 con 0x7ff5980c4fb0 2024-03-23T23:42:52.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.925+0000 7ff596000640 1 -- 172.21.15.8:0/2474212215 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1720996601 0 0) 0x7ff5980c5490 con 0x7ff5980c86b0 2024-03-23T23:42:52.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.929+0000 7ff58fe00640 1 --2- 172.21.15.8:0/2474212215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5980c4fb0 0x7ff5981542c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff5800097c0 tx=0x7ff58001bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a6f56e71de4b8e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:52.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.929+0000 7ff596000640 1 -- 172.21.15.8:0/2474212215 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5800ab070 con 0x7ff5980c4fb0 2024-03-23T23:42:52.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.929+0000 7ff596000640 1 -- 172.21.15.8:0/2474212215 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5800a5630 con 0x7ff5980c4fb0 2024-03-23T23:42:52.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.929+0000 7ff596000640 1 -- 172.21.15.8:0/2474212215 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5800a5a00 con 0x7ff5980c4fb0 2024-03-23T23:42:52.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.929+0000 7ff59dc00640 1 -- 172.21.15.8:0/2474212215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5980c4fb0 msgr2=0x7ff5981542c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:52.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.929+0000 7ff59dc00640 1 --2- 172.21.15.8:0/2474212215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5980c4fb0 0x7ff5981542c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff5800097c0 tx=0x7ff58001bf50 comp rx=0 tx=0).stop 2024-03-23T23:42:52.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.929+0000 7ff59dc00640 1 -- 172.21.15.8:0/2474212215 shutdown_connections 2024-03-23T23:42:52.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.929+0000 7ff59dc00640 1 --2- 172.21.15.8:0/2474212215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5980c4fb0 0x7ff5981542c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:52.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.929+0000 7ff59dc00640 1 -- 172.21.15.8:0/2474212215 >> 172.21.15.8:0/2474212215 conn(0x7ff5980aad10 msgr2=0x7ff5980ab120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:52.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.929+0000 7ff59dc00640 1 -- 172.21.15.8:0/2474212215 shutdown_connections 2024-03-23T23:42:52.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.929+0000 7ff59dc00640 1 -- 172.21.15.8:0/2474212215 wait complete. 2024-03-23T23:42:52.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.933+0000 7ff59dc00640 1 Processor -- start 2024-03-23T23:42:52.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.933+0000 7ff59dc00640 1 -- start start 2024-03-23T23:42:52.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.933+0000 7ff59dc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5980c4fb0 0x7ff5981efb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:52.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.933+0000 7ff59dc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5980c86b0 0x7ff59806d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:52.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.933+0000 7ff59dc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff598151000 0x7ff5981427f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:52.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.933+0000 7ff59dc00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5981625a0 con 0x7ff5980c86b0 2024-03-23T23:42:52.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.933+0000 7ff59dc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff598162420 con 0x7ff598151000 2024-03-23T23:42:52.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.933+0000 7ff59dc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff598162720 con 0x7ff5980c4fb0 2024-03-23T23:42:52.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.933+0000 7ff58fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5980c86b0 0x7ff59806d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:52.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.933+0000 7ff596a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5980c4fb0 0x7ff5981efb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:52.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.933+0000 7ff58fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5980c86b0 0x7ff59806d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41882/0 (socket says 172.21.15.8:41882) 2024-03-23T23:42:52.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.933+0000 7ff58fe00640 1 -- 172.21.15.8:0/2873136844 learned_addr learned my addr 172.21.15.8:0/2873136844 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:52.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.933+0000 7ff597400640 1 --2- 172.21.15.8:0/2873136844 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff598151000 0x7ff5981427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:52.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.933+0000 7ff596a00640 1 -- 172.21.15.8:0/2873136844 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff598151000 msgr2=0x7ff5981427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:52.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.933+0000 7ff596a00640 1 --2- 172.21.15.8:0/2873136844 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff598151000 0x7ff5981427f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:52.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.933+0000 7ff596a00640 1 -- 172.21.15.8:0/2873136844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5980c86b0 msgr2=0x7ff59806d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:52.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.933+0000 7ff596a00640 1 --2- 172.21.15.8:0/2873136844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5980c86b0 0x7ff59806d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:52.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.933+0000 7ff596a00640 1 -- 172.21.15.8:0/2873136844 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5981ef0d0 con 0x7ff5980c4fb0 2024-03-23T23:42:52.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.933+0000 7ff596a00640 1 --2- 172.21.15.8:0/2873136844 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5980c4fb0 0x7ff5981efb70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff58800c530 tx=0x7ff58800c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:52.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.933+0000 7ff58ea00640 1 -- 172.21.15.8:0/2873136844 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff588018070 con 0x7ff5980c4fb0 2024-03-23T23:42:52.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.933+0000 7ff58ea00640 1 -- 172.21.15.8:0/2873136844 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5880074e0 con 0x7ff5980c4fb0 2024-03-23T23:42:52.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.933+0000 7ff58ea00640 1 -- 172.21.15.8:0/2873136844 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff588004a10 con 0x7ff5980c4fb0 2024-03-23T23:42:52.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.933+0000 7ff59dc00640 1 -- 172.21.15.8:0/2873136844 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff59806de10 con 0x7ff5980c4fb0 2024-03-23T23:42:52.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.933+0000 7ff59dc00640 1 -- 172.21.15.8:0/2873136844 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5981ef650 con 0x7ff5980c4fb0 2024-03-23T23:42:52.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.937+0000 7ff59dc00640 1 -- 172.21.15.8:0/2873136844 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff59804f410 con 0x7ff5980c4fb0 2024-03-23T23:42:52.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.937+0000 7ff58ea00640 1 -- 172.21.15.8:0/2873136844 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff588004bb0 con 0x7ff5980c4fb0 2024-03-23T23:42:52.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.937+0000 7ff58ea00640 1 --2- 172.21.15.8:0/2873136844 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff574067660 0x7ff574069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:52.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.937+0000 7ff58ea00640 1 -- 172.21.15.8:0/2873136844 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7ff588084f00 con 0x7ff5980c4fb0 2024-03-23T23:42:52.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.937+0000 7ff58fe00640 1 --2- 172.21.15.8:0/2873136844 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff574067660 0x7ff574069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:52.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.937+0000 7ff58fe00640 1 --2- 172.21.15.8:0/2873136844 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff574067660 0x7ff574069b20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff580019dc0 tx=0x7ff5800b2040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:52.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:52.941+0000 7ff58ea00640 1 -- 172.21.15.8:0/2873136844 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7ff5880551f0 con 0x7ff5980c4fb0 2024-03-23T23:42:53.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.153+0000 7ff59dc00640 1 -- 172.21.15.8:0/2873136844 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff59806efd0 con 0x7ff5980c4fb0 2024-03-23T23:42:53.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.761+0000 7ff58ea00640 1 -- 172.21.15.8:0/2873136844 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "allow_standby_replay", "val": "false"}]=0 v14) v1 ==== 117+0+0 (secure 0 0 0) 0x7ff58805b020 con 0x7ff5980c4fb0 2024-03-23T23:42:53.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.761+0000 7ff59dc00640 1 -- 172.21.15.8:0/2873136844 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff574067660 msgr2=0x7ff574069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:53.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.761+0000 7ff59dc00640 1 --2- 172.21.15.8:0/2873136844 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff574067660 0x7ff574069b20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff580019dc0 tx=0x7ff5800b2040 comp rx=0 tx=0).stop 2024-03-23T23:42:53.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.761+0000 7ff59dc00640 1 -- 172.21.15.8:0/2873136844 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5980c4fb0 msgr2=0x7ff5981efb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:53.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.761+0000 7ff59dc00640 1 --2- 172.21.15.8:0/2873136844 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5980c4fb0 0x7ff5981efb70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff58800c530 tx=0x7ff58800c9f0 comp rx=0 tx=0).stop 2024-03-23T23:42:53.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.761+0000 7ff59dc00640 1 -- 172.21.15.8:0/2873136844 shutdown_connections 2024-03-23T23:42:53.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.761+0000 7ff59dc00640 1 --2- 172.21.15.8:0/2873136844 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff598151000 0x7ff5981427f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:53.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.761+0000 7ff59dc00640 1 --2- 172.21.15.8:0/2873136844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5980c86b0 0x7ff59806d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:53.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.761+0000 7ff59dc00640 1 --2- 172.21.15.8:0/2873136844 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff574067660 0x7ff574069b20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:53.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.761+0000 7ff59dc00640 1 --2- 172.21.15.8:0/2873136844 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5980c4fb0 0x7ff5981efb70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:53.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.761+0000 7ff59dc00640 1 -- 172.21.15.8:0/2873136844 >> 172.21.15.8:0/2873136844 conn(0x7ff5980aad10 msgr2=0x7ff598152fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:53.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.761+0000 7ff59dc00640 1 -- 172.21.15.8:0/2873136844 shutdown_connections 2024-03-23T23:42:53.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.761+0000 7ff59dc00640 1 -- 172.21.15.8:0/2873136844 wait complete. 2024-03-23T23:42:53.783 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b session_timeout 300 2024-03-23T23:42:53.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.925+0000 7f0e5f800640 1 Processor -- start 2024-03-23T23:42:53.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.925+0000 7f0e5f800640 1 -- start start 2024-03-23T23:42:53.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.925+0000 7f0e5f800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0e58159860 0x7f0e580714f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:53.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.925+0000 7f0e5f800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e580c2390 0x7f0e580c2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:53.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.925+0000 7f0e5f800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e58159dd0 con 0x7f0e58152ff0 2024-03-23T23:42:53.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.925+0000 7f0e5f800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e580701f0 con 0x7f0e58159860 2024-03-23T23:42:53.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.925+0000 7f0e5f800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e580704d0 con 0x7f0e580c2390 2024-03-23T23:42:53.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.925+0000 7f0e57e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0e58159860 0x7f0e580714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:53.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.925+0000 7f0e5ce00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f0e58152ff0 0x7f0e5806ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:46134/0 (socket says 172.21.15.8:46134) 2024-03-23T23:42:53.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.925+0000 7f0e5ce00640 1 -- 172.21.15.8:0/4048398970 learned_addr learned my addr 172.21.15.8:0/4048398970 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:53.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.925+0000 7f0e5d800640 1 --2- 172.21.15.8:0/4048398970 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e580c2390 0x7f0e580c2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:53.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.925+0000 7f0e57e00640 1 -- 172.21.15.8:0/4048398970 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e580c2390 msgr2=0x7f0e580c2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:53.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.925+0000 7f0e57e00640 1 --2- 172.21.15.8:0/4048398970 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e580c2390 0x7f0e580c2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:53.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.925+0000 7f0e57e00640 1 -- 172.21.15.8:0/4048398970 >> v1:172.21.15.196:6789/0 conn(0x7f0e58152ff0 legacy=0x7f0e5806ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:53.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.925+0000 7f0e57e00640 1 -- 172.21.15.8:0/4048398970 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e580707b0 con 0x7f0e58159860 2024-03-23T23:42:53.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.925+0000 7f0e57400640 1 -- 172.21.15.8:0/4048398970 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3439126543 0 0) 0x7f0e58159dd0 con 0x7f0e58152ff0 2024-03-23T23:42:53.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.929+0000 7f0e57e00640 1 --2- 172.21.15.8:0/4048398970 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e58159860 0x7f0e580714f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0e440097c0 tx=0x7f0e4401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3a7f0107e672f74 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:53.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.929+0000 7f0e57400640 1 -- 172.21.15.8:0/4048398970 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e440b0070 con 0x7f0e58159860 2024-03-23T23:42:53.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.929+0000 7f0e57400640 1 -- 172.21.15.8:0/4048398970 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e440ab600 con 0x7f0e58159860 2024-03-23T23:42:53.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.929+0000 7f0e57400640 1 -- 172.21.15.8:0/4048398970 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e440ab9d0 con 0x7f0e58159860 2024-03-23T23:42:53.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.929+0000 7f0e5f800640 1 -- 172.21.15.8:0/4048398970 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e58159860 msgr2=0x7f0e580714f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:53.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.929+0000 7f0e5f800640 1 --2- 172.21.15.8:0/4048398970 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e58159860 0x7f0e580714f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0e440097c0 tx=0x7f0e4401c410 comp rx=0 tx=0).stop 2024-03-23T23:42:53.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.929+0000 7f0e5f800640 1 -- 172.21.15.8:0/4048398970 shutdown_connections 2024-03-23T23:42:53.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.929+0000 7f0e5f800640 1 --2- 172.21.15.8:0/4048398970 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e580c2390 0x7f0e580c2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:53.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.929+0000 7f0e5f800640 1 --2- 172.21.15.8:0/4048398970 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e58159860 0x7f0e580714f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:53.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.929+0000 7f0e5f800640 1 -- 172.21.15.8:0/4048398970 >> 172.21.15.8:0/4048398970 conn(0x7f0e580aad10 msgr2=0x7f0e580ab120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:53.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.929+0000 7f0e5f800640 1 -- 172.21.15.8:0/4048398970 shutdown_connections 2024-03-23T23:42:53.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.929+0000 7f0e5f800640 1 -- 172.21.15.8:0/4048398970 wait complete. 2024-03-23T23:42:53.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.933+0000 7f0e5f800640 1 Processor -- start 2024-03-23T23:42:53.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.933+0000 7f0e5f800640 1 -- start start 2024-03-23T23:42:53.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.933+0000 7f0e5f800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e580c2390 0x7f0e5814b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:53.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.933+0000 7f0e5f800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e58152ff0 0x7f0e5814a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:53.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.933+0000 7f0e5f800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e58159860 0x7f0e58150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:53.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.933+0000 7f0e5f800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e580c75a0 con 0x7f0e58152ff0 2024-03-23T23:42:53.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.933+0000 7f0e5f800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e580c7420 con 0x7f0e58159860 2024-03-23T23:42:53.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.933+0000 7f0e5f800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e58162a00 con 0x7f0e580c2390 2024-03-23T23:42:53.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.933+0000 7f0e5ce00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e580c2390 0x7f0e5814b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:53.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.933+0000 7f0e57e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e58152ff0 0x7f0e5814a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:53.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.933+0000 7f0e5ce00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e580c2390 0x7f0e5814b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:49348/0 (socket says 172.21.15.8:49348) 2024-03-23T23:42:53.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.933+0000 7f0e5ce00640 1 -- 172.21.15.8:0/3938645410 learned_addr learned my addr 172.21.15.8:0/3938645410 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:53.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.933+0000 7f0e5d800640 1 --2- 172.21.15.8:0/3938645410 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e58159860 0x7f0e58150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:53.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.933+0000 7f0e5ce00640 1 -- 172.21.15.8:0/3938645410 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e58159860 msgr2=0x7f0e58150c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:53.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.933+0000 7f0e5ce00640 1 --2- 172.21.15.8:0/3938645410 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e58159860 0x7f0e58150c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:53.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.933+0000 7f0e5ce00640 1 -- 172.21.15.8:0/3938645410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e58152ff0 msgr2=0x7f0e5814a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:53.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.933+0000 7f0e5ce00640 1 --2- 172.21.15.8:0/3938645410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e58152ff0 0x7f0e5814a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:53.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.933+0000 7f0e5ce00640 1 -- 172.21.15.8:0/3938645410 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5814ad70 con 0x7f0e580c2390 2024-03-23T23:42:53.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.933+0000 7f0e5ce00640 1 --2- 172.21.15.8:0/3938645410 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e580c2390 0x7f0e5814b600 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c0011f0 tx=0x7f0e4c00c9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:53.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.933+0000 7f0e54c00640 1 -- 172.21.15.8:0/3938645410 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c018070 con 0x7f0e580c2390 2024-03-23T23:42:53.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.933+0000 7f0e54c00640 1 -- 172.21.15.8:0/3938645410 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4c0074e0 con 0x7f0e580c2390 2024-03-23T23:42:53.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.933+0000 7f0e54c00640 1 -- 172.21.15.8:0/3938645410 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c004a10 con 0x7f0e580c2390 2024-03-23T23:42:53.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.933+0000 7f0e5f800640 1 -- 172.21.15.8:0/3938645410 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e5806cae0 con 0x7f0e580c2390 2024-03-23T23:42:53.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.933+0000 7f0e5f800640 1 -- 172.21.15.8:0/3938645410 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e5806c490 con 0x7f0e580c2390 2024-03-23T23:42:53.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.937+0000 7f0e5f800640 1 -- 172.21.15.8:0/3938645410 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e5804f410 con 0x7f0e580c2390 2024-03-23T23:42:53.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.937+0000 7f0e54c00640 1 -- 172.21.15.8:0/3938645410 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f0e4c004bb0 con 0x7f0e580c2390 2024-03-23T23:42:53.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.937+0000 7f0e54c00640 1 --2- 172.21.15.8:0/3938645410 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0e38067690 0x7f0e38069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:53.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.937+0000 7f0e54c00640 1 -- 172.21.15.8:0/3938645410 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f0e4c084dc0 con 0x7f0e580c2390 2024-03-23T23:42:53.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.937+0000 7f0e57e00640 1 --2- 172.21.15.8:0/3938645410 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0e38067690 0x7f0e38069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:53.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.937+0000 7f0e57e00640 1 --2- 172.21.15.8:0/3938645410 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0e38067690 0x7f0e38069b50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0e440ad000 tx=0x7f0e440a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:53.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:53.945+0000 7f0e54c00640 1 -- 172.21.15.8:0/3938645410 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f0e4c0550b0 con 0x7f0e580c2390 2024-03-23T23:42:54.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.149+0000 7f0e5f800640 1 -- 172.21.15.8:0/3938645410 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f0e580c8d40 con 0x7f0e580c2390 2024-03-23T23:42:54.458 INFO:tasks.ceph.mds.a.smithi008.stderr:2024-03-23T23:42:54.457+0000 7fa2e9400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-23T23:42:54.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.761+0000 7f0e54c00640 1 -- 172.21.15.8:0/3938645410 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "session_timeout", "val": "300"}]=0 v15) v1 ==== 110+0+0 (secure 0 0 0) 0x7f0e4c059150 con 0x7f0e580c2390 2024-03-23T23:42:54.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.765+0000 7f0e5f800640 1 -- 172.21.15.8:0/3938645410 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0e38067690 msgr2=0x7f0e38069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:54.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.765+0000 7f0e5f800640 1 --2- 172.21.15.8:0/3938645410 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0e38067690 0x7f0e38069b50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0e440ad000 tx=0x7f0e440a6000 comp rx=0 tx=0).stop 2024-03-23T23:42:54.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.765+0000 7f0e5f800640 1 -- 172.21.15.8:0/3938645410 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e580c2390 msgr2=0x7f0e5814b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:54.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.765+0000 7f0e5f800640 1 --2- 172.21.15.8:0/3938645410 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e580c2390 0x7f0e5814b600 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c0011f0 tx=0x7f0e4c00c9b0 comp rx=0 tx=0).stop 2024-03-23T23:42:54.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.765+0000 7f0e5f800640 1 -- 172.21.15.8:0/3938645410 shutdown_connections 2024-03-23T23:42:54.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.765+0000 7f0e5f800640 1 --2- 172.21.15.8:0/3938645410 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e58159860 0x7f0e58150c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:54.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.765+0000 7f0e5f800640 1 --2- 172.21.15.8:0/3938645410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e58152ff0 0x7f0e5814a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:54.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.765+0000 7f0e5f800640 1 --2- 172.21.15.8:0/3938645410 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0e38067690 0x7f0e38069b50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:54.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.765+0000 7f0e5f800640 1 --2- 172.21.15.8:0/3938645410 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e580c2390 0x7f0e5814b600 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:54.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.765+0000 7f0e5f800640 1 -- 172.21.15.8:0/3938645410 >> 172.21.15.8:0/3938645410 conn(0x7f0e580aad10 msgr2=0x7f0e58071050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:54.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.765+0000 7f0e5f800640 1 -- 172.21.15.8:0/3938645410 shutdown_connections 2024-03-23T23:42:54.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.765+0000 7f0e5f800640 1 -- 172.21.15.8:0/3938645410 wait complete. 2024-03-23T23:42:54.786 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'b' 2024-03-23T23:42:54.786 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T23:42:54.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.925+0000 7f6db1c00640 1 Processor -- start 2024-03-23T23:42:54.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.925+0000 7f6db1c00640 1 -- start start 2024-03-23T23:42:54.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.925+0000 7f6db1c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6dac154410 0x7f6dac0c6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:54.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.925+0000 7f6db1c00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dac0c7a20 con 0x7f6dac0c3bc0 2024-03-23T23:42:54.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.925+0000 7f6db1c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dac0c4080 con 0x7f6dac153810 2024-03-23T23:42:54.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.925+0000 7f6db1c00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dac1547f0 con 0x7f6dac154410 2024-03-23T23:42:54.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.925+0000 7f6daaa00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6dac154410 0x7f6dac0c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:54.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.925+0000 7f6da2000640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f6dac0c3bc0 0x7f6dac0c4a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:44854/0 (socket says 172.21.15.8:44854) 2024-03-23T23:42:54.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.925+0000 7f6daaa00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6dac154410 0x7f6dac0c6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41896/0 (socket says 172.21.15.8:41896) 2024-03-23T23:42:54.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.925+0000 7f6da2000640 1 -- 172.21.15.8:0/960191609 learned_addr learned my addr 172.21.15.8:0/960191609 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:54.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.925+0000 7f6daaa00640 1 -- 172.21.15.8:0/960191609 >> v1:172.21.15.196:6789/0 conn(0x7f6dac153810 legacy=0x7f6dac157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:54.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.925+0000 7f6daaa00640 1 -- 172.21.15.8:0/960191609 >> v1:172.21.15.8:6789/0 conn(0x7f6dac0c3bc0 legacy=0x7f6dac0c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:54.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.925+0000 7f6daaa00640 1 -- 172.21.15.8:0/960191609 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac0c4360 con 0x7f6dac154410 2024-03-23T23:42:54.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.925+0000 7f6daa000640 1 -- 172.21.15.8:0/960191609 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1922713928 0 0) 0x7f6dac0c7a20 con 0x7f6dac0c3bc0 2024-03-23T23:42:54.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.933+0000 7f6daaa00640 1 --2- 172.21.15.8:0/960191609 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6dac154410 0x7f6dac0c6620 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c0097c0 tx=0x7f6d9c01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b083ecf689cb14 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:54.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.933+0000 7f6daa000640 1 -- 172.21.15.8:0/960191609 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c0b0070 con 0x7f6dac154410 2024-03-23T23:42:54.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.933+0000 7f6daa000640 1 -- 172.21.15.8:0/960191609 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9c0ab600 con 0x7f6dac154410 2024-03-23T23:42:54.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.933+0000 7f6daa000640 1 -- 172.21.15.8:0/960191609 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c0ab9d0 con 0x7f6dac154410 2024-03-23T23:42:54.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.933+0000 7f6db1c00640 1 -- 172.21.15.8:0/960191609 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6dac154410 msgr2=0x7f6dac0c6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:54.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.933+0000 7f6db1c00640 1 --2- 172.21.15.8:0/960191609 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6dac154410 0x7f6dac0c6620 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c0097c0 tx=0x7f6d9c01c380 comp rx=0 tx=0).stop 2024-03-23T23:42:54.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.933+0000 7f6db1c00640 1 -- 172.21.15.8:0/960191609 shutdown_connections 2024-03-23T23:42:54.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.933+0000 7f6db1c00640 1 --2- 172.21.15.8:0/960191609 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6dac154410 0x7f6dac0c6620 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:54.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.933+0000 7f6db1c00640 1 -- 172.21.15.8:0/960191609 >> 172.21.15.8:0/960191609 conn(0x7f6dac0743f0 msgr2=0x7f6dac074800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:54.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.933+0000 7f6db1c00640 1 -- 172.21.15.8:0/960191609 shutdown_connections 2024-03-23T23:42:54.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.933+0000 7f6db1c00640 1 -- 172.21.15.8:0/960191609 wait complete. 2024-03-23T23:42:54.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.933+0000 7f6db1c00640 1 Processor -- start 2024-03-23T23:42:54.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.933+0000 7f6db1c00640 1 -- start start 2024-03-23T23:42:54.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.933+0000 7f6db1c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6dac0c3bc0 0x7f6dac0a8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:54.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.933+0000 7f6db1c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6dac153810 0x7f6dac15e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:54.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.933+0000 7f6db1c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6dac154410 0x7f6dac14f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:54.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.933+0000 7f6db1c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac161a60 con 0x7f6dac0c3bc0 2024-03-23T23:42:54.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.933+0000 7f6db1c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac1618e0 con 0x7f6dac154410 2024-03-23T23:42:54.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.933+0000 7f6db1c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac161be0 con 0x7f6dac153810 2024-03-23T23:42:54.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.933+0000 7f6daaa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6dac0c3bc0 0x7f6dac0a8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:54.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.933+0000 7f6daaa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6dac0c3bc0 0x7f6dac0a8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41908/0 (socket says 172.21.15.8:41908) 2024-03-23T23:42:54.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.933+0000 7f6daaa00640 1 -- 172.21.15.8:0/1092935735 learned_addr learned my addr 172.21.15.8:0/1092935735 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:54.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.933+0000 7f6da2000640 1 --2- 172.21.15.8:0/1092935735 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6dac153810 0x7f6dac15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:54.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.933+0000 7f6dab400640 1 --2- 172.21.15.8:0/1092935735 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6dac154410 0x7f6dac14f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:54.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.937+0000 7f6daaa00640 1 -- 172.21.15.8:0/1092935735 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6dac153810 msgr2=0x7f6dac15e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:54.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.937+0000 7f6daaa00640 1 --2- 172.21.15.8:0/1092935735 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6dac153810 0x7f6dac15e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:54.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.937+0000 7f6daaa00640 1 -- 172.21.15.8:0/1092935735 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6dac154410 msgr2=0x7f6dac14f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:54.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.937+0000 7f6daaa00640 1 --2- 172.21.15.8:0/1092935735 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6dac154410 0x7f6dac14f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:54.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.937+0000 7f6daaa00640 1 -- 172.21.15.8:0/1092935735 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac15d4e0 con 0x7f6dac0c3bc0 2024-03-23T23:42:54.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.937+0000 7f6daaa00640 1 --2- 172.21.15.8:0/1092935735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6dac0c3bc0 0x7f6dac0a8ee0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c018f90 tx=0x7f6d9c01abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:54.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.937+0000 7f6da3400640 1 -- 172.21.15.8:0/1092935735 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c0b0050 con 0x7f6dac0c3bc0 2024-03-23T23:42:54.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.937+0000 7f6da3400640 1 -- 172.21.15.8:0/1092935735 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9c0bc070 con 0x7f6dac0c3bc0 2024-03-23T23:42:54.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.937+0000 7f6da3400640 1 -- 172.21.15.8:0/1092935735 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c0b5a30 con 0x7f6dac0c3bc0 2024-03-23T23:42:54.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.937+0000 7f6db1c00640 1 -- 172.21.15.8:0/1092935735 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dac15d7c0 con 0x7f6dac0c3bc0 2024-03-23T23:42:54.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.937+0000 7f6db1c00640 1 -- 172.21.15.8:0/1092935735 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dac14fd20 con 0x7f6dac0c3bc0 2024-03-23T23:42:54.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.937+0000 7f6db1c00640 1 -- 172.21.15.8:0/1092935735 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dac068270 con 0x7f6dac0c3bc0 2024-03-23T23:42:54.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.937+0000 7f6da3400640 1 -- 172.21.15.8:0/1092935735 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f6d9c0ab4c0 con 0x7f6dac0c3bc0 2024-03-23T23:42:54.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.941+0000 7f6da3400640 1 --2- 172.21.15.8:0/1092935735 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6d88067660 0x7f6d88069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:54.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.941+0000 7f6da3400640 1 -- 172.21.15.8:0/1092935735 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f6d9c120320 con 0x7f6dac0c3bc0 2024-03-23T23:42:54.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.941+0000 7f6da2000640 1 --2- 172.21.15.8:0/1092935735 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6d88067660 0x7f6d88069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:54.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.941+0000 7f6da2000640 1 --2- 172.21.15.8:0/1092935735 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6d88067660 0x7f6d88069b20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0ca090 tx=0x7f6d94007240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:54.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:54.945+0000 7f6da3400640 1 -- 172.21.15.8:0/1092935735 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f6d9c016090 con 0x7f6dac0c3bc0 2024-03-23T23:42:55.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.141+0000 7f6db1c00640 1 -- 172.21.15.8:0/1092935735 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6dac0c7c30 con 0x7f6dac0c3bc0 2024-03-23T23:42:55.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.141+0000 7f6da3400640 1 -- 172.21.15.8:0/1092935735 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6245 (secure 0 0 0) 0x7f6d9c0f0730 con 0x7f6dac0c3bc0 2024-03-23T23:42:55.142 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:42:55.142 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6836/3149325777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3149325777},{"type":"v1","addr":"172.21.15.196:6836","nonce":3149325777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6833/1542162403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1542162403},{"type":"v1","addr":"172.21.15.8:6833","nonce":1542162403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T23:42:40.070799+0000","modified":"2024-03-23T23:42:44.080269+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6837/3402347550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":3402347550},{"type":"v1","addr":"172.21.15.196:6837","nonce":3402347550}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T23:42:50.113972+0000","modified":"2024-03-23T23:42:54.152778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.8:6835/3531853933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3531853933},{"type":"v1","addr":"172.21.15.8:6835","nonce":3531853933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4269,"qdb_cluster":[4269]},"id":2}]} 2024-03-23T23:42:55.142 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 15 2024-03-23T23:42:55.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.141+0000 7f6db1c00640 1 -- 172.21.15.8:0/1092935735 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6d88067660 msgr2=0x7f6d88069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:55.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.141+0000 7f6db1c00640 1 --2- 172.21.15.8:0/1092935735 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6d88067660 0x7f6d88069b20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0ca090 tx=0x7f6d94007240 comp rx=0 tx=0).stop 2024-03-23T23:42:55.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.141+0000 7f6db1c00640 1 -- 172.21.15.8:0/1092935735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6dac0c3bc0 msgr2=0x7f6dac0a8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:55.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.141+0000 7f6db1c00640 1 --2- 172.21.15.8:0/1092935735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6dac0c3bc0 0x7f6dac0a8ee0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c018f90 tx=0x7f6d9c01abc0 comp rx=0 tx=0).stop 2024-03-23T23:42:55.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.141+0000 7f6db1c00640 1 -- 172.21.15.8:0/1092935735 shutdown_connections 2024-03-23T23:42:55.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.141+0000 7f6db1c00640 1 --2- 172.21.15.8:0/1092935735 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6dac154410 0x7f6dac14f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:55.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.141+0000 7f6db1c00640 1 --2- 172.21.15.8:0/1092935735 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6d88067660 0x7f6d88069b20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:55.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.141+0000 7f6db1c00640 1 --2- 172.21.15.8:0/1092935735 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6dac153810 0x7f6dac15e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:55.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.141+0000 7f6db1c00640 1 --2- 172.21.15.8:0/1092935735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6dac0c3bc0 0x7f6dac0a8ee0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:55.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.141+0000 7f6db1c00640 1 -- 172.21.15.8:0/1092935735 >> 172.21.15.8:0/1092935735 conn(0x7f6dac0743f0 msgr2=0x7f6dac0c34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:55.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.141+0000 7f6db1c00640 1 -- 172.21.15.8:0/1092935735 shutdown_connections 2024-03-23T23:42:55.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.141+0000 7f6db1c00640 1 -- 172.21.15.8:0/1092935735 wait complete. 2024-03-23T23:42:55.163 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:42:55.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.301+0000 7fa6bf200640 1 Processor -- start 2024-03-23T23:42:55.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.301+0000 7fa6bf200640 1 -- start start 2024-03-23T23:42:55.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.301+0000 7fa6bf200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa6b80b09b0 0x7fa6b80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:55.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.301+0000 7fa6bf200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa6b80cbeb0 0x7fa6b81598e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:55.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.301+0000 7fa6bf200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6b80c63f0 con 0x7fa6b80c9160 2024-03-23T23:42:55.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.301+0000 7fa6bf200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b80c9880 con 0x7fa6b80b09b0 2024-03-23T23:42:55.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.301+0000 7fa6bf200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b80c5be0 con 0x7fa6b80cbeb0 2024-03-23T23:42:55.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.301+0000 7fa6b7e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa6b80b09b0 0x7fa6b80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:55.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.301+0000 7fa6afe00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fa6b80c9160 0x7fa6b81591d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:44866/0 (socket says 172.21.15.8:44866) 2024-03-23T23:42:55.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.301+0000 7fa6afe00640 1 -- 172.21.15.8:0/4288697496 learned_addr learned my addr 172.21.15.8:0/4288697496 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:55.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.301+0000 7fa6bd200640 1 --2- 172.21.15.8:0/4288697496 >> v2:172.21.15.196:3300/0 conn(0x7fa6b80cbeb0 0x7fa6b81598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:55.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.305+0000 7fa6b7e00640 1 -- 172.21.15.8:0/4288697496 >> v2:172.21.15.196:3300/0 conn(0x7fa6b80cbeb0 msgr2=0x7fa6b81598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:55.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.305+0000 7fa6b7e00640 1 --2- 172.21.15.8:0/4288697496 >> v2:172.21.15.196:3300/0 conn(0x7fa6b80cbeb0 0x7fa6b81598e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:55.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.305+0000 7fa6b7e00640 1 -- 172.21.15.8:0/4288697496 >> v1:172.21.15.8:6789/0 conn(0x7fa6b80c9160 legacy=0x7fa6b81591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:55.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.305+0000 7fa6b7e00640 1 -- 172.21.15.8:0/4288697496 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b8156640 con 0x7fa6b80b09b0 2024-03-23T23:42:55.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.305+0000 7fa6b7400640 1 -- 172.21.15.8:0/4288697496 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1557234939 0 0) 0x7fa6a0001120 con 0x7fa6b80c9160 2024-03-23T23:42:55.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.305+0000 7fa6b7e00640 1 --2- 172.21.15.8:0/4288697496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6b80b09b0 0x7fa6b80cb970 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa6b808cd70 tx=0x7fa6a801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a8065993d45875 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:55.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.305+0000 7fa6b7400640 1 -- 172.21.15.8:0/4288697496 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a80b0070 con 0x7fa6b80b09b0 2024-03-23T23:42:55.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.305+0000 7fa6b7400640 1 -- 172.21.15.8:0/4288697496 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a80ab600 con 0x7fa6b80b09b0 2024-03-23T23:42:55.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.305+0000 7fa6b7400640 1 -- 172.21.15.8:0/4288697496 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a80ab9d0 con 0x7fa6b80b09b0 2024-03-23T23:42:55.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.305+0000 7fa6bf200640 1 -- 172.21.15.8:0/4288697496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6b80b09b0 msgr2=0x7fa6b80cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:55.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.305+0000 7fa6bf200640 1 --2- 172.21.15.8:0/4288697496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6b80b09b0 0x7fa6b80cb970 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa6b808cd70 tx=0x7fa6a801c3f0 comp rx=0 tx=0).stop 2024-03-23T23:42:55.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.305+0000 7fa6bf200640 1 -- 172.21.15.8:0/4288697496 shutdown_connections 2024-03-23T23:42:55.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.305+0000 7fa6bf200640 1 --2- 172.21.15.8:0/4288697496 >> v2:172.21.15.196:3300/0 conn(0x7fa6b80cbeb0 0x7fa6b81598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:55.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.305+0000 7fa6bf200640 1 --2- 172.21.15.8:0/4288697496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6b80b09b0 0x7fa6b80cb970 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:55.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.305+0000 7fa6bf200640 1 -- 172.21.15.8:0/4288697496 >> 172.21.15.8:0/4288697496 conn(0x7fa6b80ad450 msgr2=0x7fa6b80cb260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:55.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.309+0000 7fa6bf200640 1 -- 172.21.15.8:0/4288697496 shutdown_connections 2024-03-23T23:42:55.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.309+0000 7fa6bf200640 1 -- 172.21.15.8:0/4288697496 wait complete. 2024-03-23T23:42:55.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.309+0000 7fa6bf200640 1 Processor -- start 2024-03-23T23:42:55.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.309+0000 7fa6bf200640 1 -- start start 2024-03-23T23:42:55.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.309+0000 7fa6bf200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6b80b09b0 0x7fa6b8151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:55.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.309+0000 7fa6bf200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa6b80c9160 0x7fa6b8149a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:55.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.309+0000 7fa6bf200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa6b80cbeb0 0x7fa6b8149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:55.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.309+0000 7fa6bf200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b8162b20 con 0x7fa6b80b09b0 2024-03-23T23:42:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.309+0000 7fa6bf200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b81629a0 con 0x7fa6b80cbeb0 2024-03-23T23:42:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.309+0000 7fa6bf200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b8162ca0 con 0x7fa6b80c9160 2024-03-23T23:42:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.309+0000 7fa6b7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6b80b09b0 0x7fa6b8151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.309+0000 7fa6afe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa6b80c9160 0x7fa6b8149a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.309+0000 7fa6b7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6b80b09b0 0x7fa6b8151a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41930/0 (socket says 172.21.15.8:41930) 2024-03-23T23:42:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.309+0000 7fa6b7e00640 1 -- 172.21.15.8:0/2662216015 learned_addr learned my addr 172.21.15.8:0/2662216015 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.309+0000 7fa6bd200640 1 --2- 172.21.15.8:0/2662216015 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa6b80cbeb0 0x7fa6b8149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.309+0000 7fa6b7e00640 1 -- 172.21.15.8:0/2662216015 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa6b80c9160 msgr2=0x7fa6b8149a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.309+0000 7fa6b7e00640 1 --2- 172.21.15.8:0/2662216015 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa6b80c9160 0x7fa6b8149a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.309+0000 7fa6b7e00640 1 -- 172.21.15.8:0/2662216015 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa6b80cbeb0 msgr2=0x7fa6b8149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:55.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.309+0000 7fa6b7e00640 1 --2- 172.21.15.8:0/2662216015 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa6b80cbeb0 0x7fa6b8149f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:55.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.309+0000 7fa6b7e00640 1 -- 172.21.15.8:0/2662216015 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b814c360 con 0x7fa6b80b09b0 2024-03-23T23:42:55.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.309+0000 7fa6bd200640 1 --2- 172.21.15.8:0/2662216015 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa6b80cbeb0 0x7fa6b8149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:42:55.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.309+0000 7fa6b7e00640 1 --2- 172.21.15.8:0/2662216015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6b80b09b0 0x7fa6b8151a70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa6a80ae040 tx=0x7fa6a8019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:55.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.309+0000 7fa6b4c00640 1 -- 172.21.15.8:0/2662216015 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a80b0040 con 0x7fa6b80b09b0 2024-03-23T23:42:55.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.309+0000 7fa6b4c00640 1 -- 172.21.15.8:0/2662216015 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a80b9070 con 0x7fa6b80b09b0 2024-03-23T23:42:55.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.309+0000 7fa6bf200640 1 -- 172.21.15.8:0/2662216015 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b8155440 con 0x7fa6b80b09b0 2024-03-23T23:42:55.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.309+0000 7fa6b4c00640 1 -- 172.21.15.8:0/2662216015 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a80b4690 con 0x7fa6b80b09b0 2024-03-23T23:42:55.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.309+0000 7fa6bf200640 1 -- 172.21.15.8:0/2662216015 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b8151fb0 con 0x7fa6b80b09b0 2024-03-23T23:42:55.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.313+0000 7fa6bf200640 1 -- 172.21.15.8:0/2662216015 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b8068270 con 0x7fa6b80b09b0 2024-03-23T23:42:55.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.313+0000 7fa6b4c00640 1 -- 172.21.15.8:0/2662216015 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fa6a80b4830 con 0x7fa6b80b09b0 2024-03-23T23:42:55.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.313+0000 7fa6b4c00640 1 --2- 172.21.15.8:0/2662216015 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa694067690 0x7fa694069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:55.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.313+0000 7fa6b4c00640 1 -- 172.21.15.8:0/2662216015 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fa6a8120340 con 0x7fa6b80b09b0 2024-03-23T23:42:55.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.313+0000 7fa6afe00640 1 --2- 172.21.15.8:0/2662216015 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa694067690 0x7fa694069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:55.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.313+0000 7fa6afe00640 1 --2- 172.21.15.8:0/2662216015 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa694067690 0x7fa694069b50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa6b80ab490 tx=0x7fa6a0007b60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:55.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.321+0000 7fa6b4c00640 1 -- 172.21.15.8:0/2662216015 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fa6a8016070 con 0x7fa6b80b09b0 2024-03-23T23:42:55.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.485+0000 7fa6bf200640 1 -- 172.21.15.8:0/2662216015 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6b806dd10 con 0x7fa6b80b09b0 2024-03-23T23:42:55.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.489+0000 7fa6b4c00640 1 -- 172.21.15.8:0/2662216015 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20271 (secure 0 0 0) 0x7fa6a80f0e20 con 0x7fa6b80b09b0 2024-03-23T23:42:55.489 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:42:55.489 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":25,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","created":"2024-03-23T23:42:15.169430+0000","modified":"2024-03-23T23:42:51.739271+0000","last_up_change":"2024-03-23T23:42:26.509742+0000","last_in_change":"2024-03-23T23:42:17.662330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:42:26.327445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-23T23:42:38.218800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-23T23:42:39.054195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-23T23:42:48.327799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-23T23:42:49.113061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e967bf31-21d6-4d11-bc3d-0df8177a1b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6809","nonce":2187201732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6811","nonce":2187201732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6815","nonce":2187201732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6813","nonce":2187201732}]},"public_addr":"172.21.15.8:6809/2187201732","cluster_addr":"172.21.15.8:6811/2187201732","heartbeat_back_addr":"172.21.15.8:6815/2187201732","heartbeat_front_addr":"172.21.15.8:6813/2187201732","state":["exists","up"]},{"osd":1,"uuid":"c8e33701-7acd-4474-8402-d52461171fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6818","nonce":3205168010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6822","nonce":3205168010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6830","nonce":3205168010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6826","nonce":3205168010}]},"public_addr":"172.21.15.8:6818/3205168010","cluster_addr":"172.21.15.8:6822/3205168010","heartbeat_back_addr":"172.21.15.8:6830/3205168010","heartbeat_front_addr":"172.21.15.8:6826/3205168010","state":["exists","up"]},{"osd":2,"uuid":"ceebdbf7-4c2f-4757-b52d-fd8b20e77570","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6801","nonce":475463656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6803","nonce":475463656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6807","nonce":475463656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6805","nonce":475463656}]},"public_addr":"172.21.15.8:6801/475463656","cluster_addr":"172.21.15.8:6803/475463656","heartbeat_back_addr":"172.21.15.8:6807/475463656","heartbeat_front_addr":"172.21.15.8:6805/475463656","state":["exists","up"]},{"osd":3,"uuid":"89e258da-5767-429e-8441-edf877d2f3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6819","nonce":1514082871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6821","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6823","nonce":1514082871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6829","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6831","nonce":1514082871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6825","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6827","nonce":1514082871}]},"public_addr":"172.21.15.8:6819/1514082871","cluster_addr":"172.21.15.8:6823/1514082871","heartbeat_back_addr":"172.21.15.8:6831/1514082871","heartbeat_front_addr":"172.21.15.8:6827/1514082871","state":["exists","up"]},{"osd":4,"uuid":"2b7451ae-ea16-4f0a-ae50-04fde75e45ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6825","nonce":3516578147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6827","nonce":3516578147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6831","nonce":3516578147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6829","nonce":3516578147}]},"public_addr":"172.21.15.196:6825/3516578147","cluster_addr":"172.21.15.196:6827/3516578147","heartbeat_back_addr":"172.21.15.196:6831/3516578147","heartbeat_front_addr":"172.21.15.196:6829/3516578147","state":["exists","up"]},{"osd":5,"uuid":"e68a8914-e591-466a-bc9e-f2d7c67aac13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6802","nonce":830595758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6806","nonce":830595758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6814","nonce":830595758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6810","nonce":830595758}]},"public_addr":"172.21.15.196:6802/830595758","cluster_addr":"172.21.15.196:6806/830595758","heartbeat_back_addr":"172.21.15.196:6814/830595758","heartbeat_front_addr":"172.21.15.196:6810/830595758","state":["exists","up"]},{"osd":6,"uuid":"e47723c5-50a0-4cd8-92d9-01972072b422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6801","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6803","nonce":472639906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6805","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6807","nonce":472639906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6815","nonce":472639906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6811","nonce":472639906}]},"public_addr":"172.21.15.196:6803/472639906","cluster_addr":"172.21.15.196:6807/472639906","heartbeat_back_addr":"172.21.15.196:6815/472639906","heartbeat_front_addr":"172.21.15.196:6811/472639906","state":["exists","up"]},{"osd":7,"uuid":"e1e9113d-8005-47b3-9a75-9e701199f1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6817","nonce":4151820349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6819","nonce":4151820349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6823","nonce":4151820349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6821","nonce":4151820349}]},"public_addr":"172.21.15.196:6817/4151820349","cluster_addr":"172.21.15.196:6819/4151820349","heartbeat_back_addr":"172.21.15.196:6823/4151820349","heartbeat_front_addr":"172.21.15.196:6821/4151820349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.221790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.265974+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.190319+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.376359+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.329657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.402958+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.300703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.133121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:42:55.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.489+0000 7fa6bf200640 1 -- 172.21.15.8:0/2662216015 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa694067690 msgr2=0x7fa694069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:55.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.489+0000 7fa6bf200640 1 --2- 172.21.15.8:0/2662216015 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa694067690 0x7fa694069b50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa6b80ab490 tx=0x7fa6a0007b60 comp rx=0 tx=0).stop 2024-03-23T23:42:55.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.489+0000 7fa6bf200640 1 -- 172.21.15.8:0/2662216015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6b80b09b0 msgr2=0x7fa6b8151a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:55.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.489+0000 7fa6bf200640 1 --2- 172.21.15.8:0/2662216015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6b80b09b0 0x7fa6b8151a70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa6a80ae040 tx=0x7fa6a8019190 comp rx=0 tx=0).stop 2024-03-23T23:42:55.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.489+0000 7fa6bf200640 1 -- 172.21.15.8:0/2662216015 shutdown_connections 2024-03-23T23:42:55.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.489+0000 7fa6bf200640 1 --2- 172.21.15.8:0/2662216015 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa6b80cbeb0 0x7fa6b8149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:55.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.489+0000 7fa6bf200640 1 --2- 172.21.15.8:0/2662216015 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa694067690 0x7fa694069b50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:55.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.489+0000 7fa6bf200640 1 --2- 172.21.15.8:0/2662216015 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa6b80c9160 0x7fa6b8149a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:55.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.489+0000 7fa6bf200640 1 --2- 172.21.15.8:0/2662216015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6b80b09b0 0x7fa6b8151a70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:55.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.489+0000 7fa6bf200640 1 -- 172.21.15.8:0/2662216015 >> 172.21.15.8:0/2662216015 conn(0x7fa6b80ad450 msgr2=0x7fa6b80ac640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:55.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.489+0000 7fa6bf200640 1 -- 172.21.15.8:0/2662216015 shutdown_connections 2024-03-23T23:42:55.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.489+0000 7fa6bf200640 1 -- 172.21.15.8:0/2662216015 wait complete. 2024-03-23T23:42:55.510 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-23T23:42:55.510 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T23:42:55.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.653+0000 7f6e63000640 1 Processor -- start 2024-03-23T23:42:55.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.653+0000 7f6e63000640 1 -- start start 2024-03-23T23:42:55.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.653+0000 7f6e63000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e5c152f80 0x7f6e5c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:55.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.653+0000 7f6e63000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e5c153360 con 0x7f6e5c06ed90 2024-03-23T23:42:55.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.653+0000 7f6e63000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e5c159e00 con 0x7f6e5c155920 2024-03-23T23:42:55.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.653+0000 7f6e63000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c072bd0 con 0x7f6e5c152f80 2024-03-23T23:42:55.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.653+0000 7f6e53400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f6e5c06ed90 0x7f6e5c071fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:44872/0 (socket says 172.21.15.8:44872) 2024-03-23T23:42:55.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.653+0000 7f6e53400640 1 -- 172.21.15.8:0/185219209 learned_addr learned my addr 172.21.15.8:0/185219209 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:55.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.653+0000 7f6e5be00640 1 --2- 172.21.15.8:0/185219209 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e5c152f80 0x7f6e5c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:55.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.653+0000 7f6e5be00640 1 -- 172.21.15.8:0/185219209 >> v1:172.21.15.196:6789/0 conn(0x7f6e5c155920 legacy=0x7f6e5c155dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:55.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.653+0000 7f6e5b400640 1 -- 172.21.15.8:0/185219209 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 732207150 0 0) 0x7f6e5c159e00 con 0x7f6e5c155920 2024-03-23T23:42:55.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.653+0000 7f6e5be00640 1 -- 172.21.15.8:0/185219209 >> v1:172.21.15.8:6789/0 conn(0x7f6e5c06ed90 legacy=0x7f6e5c071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:55.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.653+0000 7f6e5be00640 1 -- 172.21.15.8:0/185219209 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5c159040 con 0x7f6e5c152f80 2024-03-23T23:42:55.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.657+0000 7f6e5be00640 1 --2- 172.21.15.8:0/185219209 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e5c152f80 0x7f6e5c06fd60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c0097f0 tx=0x7f6e4c01bfc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe2dc17fe34245dc server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:55.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.657+0000 7f6e5b400640 1 -- 172.21.15.8:0/185219209 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c0b1070 con 0x7f6e5c152f80 2024-03-23T23:42:55.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.657+0000 7f6e5b400640 1 -- 172.21.15.8:0/185219209 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4c0ac640 con 0x7f6e5c152f80 2024-03-23T23:42:55.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.657+0000 7f6e5b400640 1 -- 172.21.15.8:0/185219209 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c0aca10 con 0x7f6e5c152f80 2024-03-23T23:42:55.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.657+0000 7f6e63000640 1 -- 172.21.15.8:0/185219209 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e5c152f80 msgr2=0x7f6e5c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:55.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.657+0000 7f6e63000640 1 --2- 172.21.15.8:0/185219209 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e5c152f80 0x7f6e5c06fd60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c0097f0 tx=0x7f6e4c01bfc0 comp rx=0 tx=0).stop 2024-03-23T23:42:55.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.657+0000 7f6e63000640 1 -- 172.21.15.8:0/185219209 shutdown_connections 2024-03-23T23:42:55.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.657+0000 7f6e63000640 1 --2- 172.21.15.8:0/185219209 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e5c152f80 0x7f6e5c06fd60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:55.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.657+0000 7f6e63000640 1 -- 172.21.15.8:0/185219209 >> 172.21.15.8:0/185219209 conn(0x7f6e5c06c280 msgr2=0x7f6e5c06c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:55.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.657+0000 7f6e63000640 1 -- 172.21.15.8:0/185219209 shutdown_connections 2024-03-23T23:42:55.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.657+0000 7f6e63000640 1 -- 172.21.15.8:0/185219209 wait complete. 2024-03-23T23:42:55.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.661+0000 7f6e63000640 1 Processor -- start 2024-03-23T23:42:55.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.661+0000 7f6e63000640 1 -- start start 2024-03-23T23:42:55.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.661+0000 7f6e63000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e5c06ed90 0x7f6e5c0c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:55.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.661+0000 7f6e63000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e5c152f80 0x7f6e5c1f2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:55.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.661+0000 7f6e63000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6e5c155920 0x7f6e5c1f29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:55.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.661+0000 7f6e63000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c1648f0 con 0x7f6e5c152f80 2024-03-23T23:42:55.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.661+0000 7f6e63000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c0c21c0 con 0x7f6e5c155920 2024-03-23T23:42:55.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.661+0000 7f6e63000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c164a70 con 0x7f6e5c06ed90 2024-03-23T23:42:55.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.661+0000 7f6e53400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e5c152f80 0x7f6e5c1f2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:55.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.661+0000 7f6e5be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e5c06ed90 0x7f6e5c0c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:55.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.661+0000 7f6e53400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e5c152f80 0x7f6e5c1f2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41946/0 (socket says 172.21.15.8:41946) 2024-03-23T23:42:55.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.661+0000 7f6e5be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e5c06ed90 0x7f6e5c0c71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:49388/0 (socket says 172.21.15.8:49388) 2024-03-23T23:42:55.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.661+0000 7f6e61000640 1 --2- 172.21.15.8:0/3825732800 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6e5c155920 0x7f6e5c1f29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:55.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.661+0000 7f6e53400640 1 -- 172.21.15.8:0/3825732800 learned_addr learned my addr 172.21.15.8:0/3825732800 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:55.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.661+0000 7f6e5be00640 1 -- 172.21.15.8:0/3825732800 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6e5c155920 msgr2=0x7f6e5c1f29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:55.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.661+0000 7f6e5be00640 1 --2- 172.21.15.8:0/3825732800 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6e5c155920 0x7f6e5c1f29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:55.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.661+0000 7f6e5be00640 1 -- 172.21.15.8:0/3825732800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e5c152f80 msgr2=0x7f6e5c1f2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:55.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.661+0000 7f6e5be00640 1 --2- 172.21.15.8:0/3825732800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e5c152f80 0x7f6e5c1f2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:55.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.661+0000 7f6e5be00640 1 -- 172.21.15.8:0/3825732800 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5c1ef9a0 con 0x7f6e5c06ed90 2024-03-23T23:42:55.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.661+0000 7f6e53400640 1 --2- 172.21.15.8:0/3825732800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e5c152f80 0x7f6e5c1f2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:42:55.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.665+0000 7f6e5be00640 1 --2- 172.21.15.8:0/3825732800 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e5c06ed90 0x7f6e5c0c71e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c0ab000 tx=0x7f6e4c019080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:55.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.665+0000 7f6e58c00640 1 -- 172.21.15.8:0/3825732800 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c0b1040 con 0x7f6e5c06ed90 2024-03-23T23:42:55.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.665+0000 7f6e58c00640 1 -- 172.21.15.8:0/3825732800 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4c004220 con 0x7f6e5c06ed90 2024-03-23T23:42:55.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.665+0000 7f6e58c00640 1 -- 172.21.15.8:0/3825732800 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c003620 con 0x7f6e5c06ed90 2024-03-23T23:42:55.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.665+0000 7f6e63000640 1 -- 172.21.15.8:0/3825732800 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e5c157ef0 con 0x7f6e5c06ed90 2024-03-23T23:42:55.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.665+0000 7f6e63000640 1 -- 172.21.15.8:0/3825732800 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5c1584b0 con 0x7f6e5c06ed90 2024-03-23T23:42:55.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.665+0000 7f6e63000640 1 -- 172.21.15.8:0/3825732800 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e5c068270 con 0x7f6e5c06ed90 2024-03-23T23:42:55.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.665+0000 7f6e58c00640 1 -- 172.21.15.8:0/3825732800 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f6e4c0ac500 con 0x7f6e5c06ed90 2024-03-23T23:42:55.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.665+0000 7f6e58c00640 1 --2- 172.21.15.8:0/3825732800 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6e38067660 0x7f6e38069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:55.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.665+0000 7f6e58c00640 1 -- 172.21.15.8:0/3825732800 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f6e4c11edd0 con 0x7f6e5c06ed90 2024-03-23T23:42:55.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.665+0000 7f6e53400640 1 --2- 172.21.15.8:0/3825732800 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6e38067660 0x7f6e38069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:55.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.669+0000 7f6e53400640 1 --2- 172.21.15.8:0/3825732800 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6e38067660 0x7f6e38069b20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c14ca10 tx=0x7f6e44007ed0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:55.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.673+0000 7f6e58c00640 1 -- 172.21.15.8:0/3825732800 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f6e4c0c2030 con 0x7f6e5c06ed90 2024-03-23T23:42:55.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.837+0000 7f6e63000640 1 -- 172.21.15.8:0/3825732800 --> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6e5c1ef750 con 0x7f6e38067660 2024-03-23T23:42:55.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.849+0000 7f6e58c00640 1 -- 172.21.15.8:0/3825732800 <== mgr.4098 v2:172.21.15.196:6832/1295060067 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+490382 (secure 0 0 0) 0x7f6e5c1ef750 con 0x7f6e38067660 2024-03-23T23:42:55.857 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:42:55.860 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-03-23T23:42:55.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.857+0000 7f6e63000640 1 -- 172.21.15.8:0/3825732800 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6e38067660 msgr2=0x7f6e38069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:55.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.857+0000 7f6e63000640 1 --2- 172.21.15.8:0/3825732800 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6e38067660 0x7f6e38069b20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c14ca10 tx=0x7f6e44007ed0 comp rx=0 tx=0).stop 2024-03-23T23:42:55.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.857+0000 7f6e63000640 1 -- 172.21.15.8:0/3825732800 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e5c06ed90 msgr2=0x7f6e5c0c71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:55.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.857+0000 7f6e63000640 1 --2- 172.21.15.8:0/3825732800 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e5c06ed90 0x7f6e5c0c71e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c0ab000 tx=0x7f6e4c019080 comp rx=0 tx=0).stop 2024-03-23T23:42:55.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.857+0000 7f6e63000640 1 -- 172.21.15.8:0/3825732800 shutdown_connections 2024-03-23T23:42:55.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.857+0000 7f6e63000640 1 --2- 172.21.15.8:0/3825732800 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6e5c155920 0x7f6e5c1f29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:55.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.857+0000 7f6e63000640 1 --2- 172.21.15.8:0/3825732800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e5c152f80 0x7f6e5c1f2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:55.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.857+0000 7f6e63000640 1 --2- 172.21.15.8:0/3825732800 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6e38067660 0x7f6e38069b20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:55.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.857+0000 7f6e63000640 1 --2- 172.21.15.8:0/3825732800 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e5c06ed90 0x7f6e5c0c71e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:55.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.857+0000 7f6e63000640 1 -- 172.21.15.8:0/3825732800 >> 172.21.15.8:0/3825732800 conn(0x7f6e5c06c280 msgr2=0x7f6e5c071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:55.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.857+0000 7f6e63000640 1 -- 172.21.15.8:0/3825732800 shutdown_connections 2024-03-23T23:42:55.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:55.857+0000 7f6e63000640 1 -- 172.21.15.8:0/3825732800 wait complete. 2024-03-23T23:42:55.876 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-03-23T23:42:54.275208+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":248,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":194,"ondisk_log_size":194,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":284,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240200,"kb_used_data":3192,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734520,"statfs":{"total":773094113280,"available":772848148480,"internally_reserved":0,"allocated":3268608,"data_stored":1941192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.563749"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750876+0000","last_change":"2024-03-23T23:42:50.736219+0000","last_active":"2024-03-23T23:42:51.750876+0000","last_peered":"2024-03-23T23:42:51.750876+0000","last_clean":"2024-03-23T23:42:51.750876+0000","last_became_active":"2024-03-23T23:42:50.735940+0000","last_became_peered":"2024-03-23T23:42:50.735940+0000","last_unstale":"2024-03-23T23:42:51.750876+0000","last_undegraded":"2024-03-23T23:42:51.750876+0000","last_fullsized":"2024-03-23T23:42:51.750876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:11:44.111477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.752139+0000","last_change":"2024-03-23T23:42:39.693858+0000","last_active":"2024-03-23T23:42:50.752139+0000","last_peered":"2024-03-23T23:42:50.752139+0000","last_clean":"2024-03-23T23:42:50.752139+0000","last_became_active":"2024-03-23T23:42:39.693636+0000","last_became_peered":"2024-03-23T23:42:39.693636+0000","last_unstale":"2024-03-23T23:42:50.752139+0000","last_undegraded":"2024-03-23T23:42:50.752139+0000","last_fullsized":"2024-03-23T23:42:50.752139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:44:07.213123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328567+0000","last_change":"2024-03-23T23:42:40.685708+0000","last_active":"2024-03-23T23:42:52.328567+0000","last_peered":"2024-03-23T23:42:52.328567+0000","last_clean":"2024-03-23T23:42:52.328567+0000","last_became_active":"2024-03-23T23:42:40.682755+0000","last_became_peered":"2024-03-23T23:42:40.682755+0000","last_unstale":"2024-03-23T23:42:52.328567+0000","last_undegraded":"2024-03-23T23:42:52.328567+0000","last_fullsized":"2024-03-23T23:42:52.328567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:04.633288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327590+0000","last_change":"2024-03-23T23:42:49.750108+0000","last_active":"2024-03-23T23:42:52.327590+0000","last_peered":"2024-03-23T23:42:52.327590+0000","last_clean":"2024-03-23T23:42:52.327590+0000","last_became_active":"2024-03-23T23:42:49.749634+0000","last_became_peered":"2024-03-23T23:42:49.749634+0000","last_unstale":"2024-03-23T23:42:52.327590+0000","last_undegraded":"2024-03-23T23:42:52.327590+0000","last_fullsized":"2024-03-23T23:42:52.327590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:49:16.758908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.761082+0000","last_change":"2024-03-23T23:42:50.752450+0000","last_active":"2024-03-23T23:42:50.761082+0000","last_peered":"2024-03-23T23:42:50.761082+0000","last_clean":"2024-03-23T23:42:50.761082+0000","last_became_active":"2024-03-23T23:42:50.752078+0000","last_became_peered":"2024-03-23T23:42:50.752078+0000","last_unstale":"2024-03-23T23:42:50.761082+0000","last_undegraded":"2024-03-23T23:42:50.761082+0000","last_fullsized":"2024-03-23T23:42:50.761082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:48:24.982671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328677+0000","last_change":"2024-03-23T23:42:39.687108+0000","last_active":"2024-03-23T23:42:52.328677+0000","last_peered":"2024-03-23T23:42:52.328677+0000","last_clean":"2024-03-23T23:42:52.328677+0000","last_became_active":"2024-03-23T23:42:39.686875+0000","last_became_peered":"2024-03-23T23:42:39.686875+0000","last_unstale":"2024-03-23T23:42:52.328677+0000","last_undegraded":"2024-03-23T23:42:52.328677+0000","last_fullsized":"2024-03-23T23:42:52.328677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:05:52.079172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.751937+0000","last_change":"2024-03-23T23:42:40.698746+0000","last_active":"2024-03-23T23:42:50.751937+0000","last_peered":"2024-03-23T23:42:50.751937+0000","last_clean":"2024-03-23T23:42:50.751937+0000","last_became_active":"2024-03-23T23:42:40.698003+0000","last_became_peered":"2024-03-23T23:42:40.698003+0000","last_unstale":"2024-03-23T23:42:50.751937+0000","last_undegraded":"2024-03-23T23:42:50.751937+0000","last_fullsized":"2024-03-23T23:42:50.751937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:53:46.437114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751376+0000","last_change":"2024-03-23T23:42:49.728923+0000","last_active":"2024-03-23T23:42:51.751376+0000","last_peered":"2024-03-23T23:42:51.751376+0000","last_clean":"2024-03-23T23:42:51.751376+0000","last_became_active":"2024-03-23T23:42:49.728261+0000","last_became_peered":"2024-03-23T23:42:49.728261+0000","last_unstale":"2024-03-23T23:42:51.751376+0000","last_undegraded":"2024-03-23T23:42:51.751376+0000","last_fullsized":"2024-03-23T23:42:51.751376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:22.375891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.757222+0000","last_change":"2024-03-23T23:42:50.755852+0000","last_active":"2024-03-23T23:42:50.757222+0000","last_peered":"2024-03-23T23:42:50.757222+0000","last_clean":"2024-03-23T23:42:50.757222+0000","last_became_active":"2024-03-23T23:42:50.755600+0000","last_became_peered":"2024-03-23T23:42:50.755600+0000","last_unstale":"2024-03-23T23:42:50.757222+0000","last_undegraded":"2024-03-23T23:42:50.757222+0000","last_fullsized":"2024-03-23T23:42:50.757222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:49:43.793847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.742583+0000","last_change":"2024-03-23T23:42:39.696690+0000","last_active":"2024-03-23T23:42:50.742583+0000","last_peered":"2024-03-23T23:42:50.742583+0000","last_clean":"2024-03-23T23:42:50.742583+0000","last_became_active":"2024-03-23T23:42:39.696342+0000","last_became_peered":"2024-03-23T23:42:39.696342+0000","last_unstale":"2024-03-23T23:42:50.742583+0000","last_undegraded":"2024-03-23T23:42:50.742583+0000","last_fullsized":"2024-03-23T23:42:50.742583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:42:37.702720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328460+0000","last_change":"2024-03-23T23:42:40.700355+0000","last_active":"2024-03-23T23:42:52.328460+0000","last_peered":"2024-03-23T23:42:52.328460+0000","last_clean":"2024-03-23T23:42:52.328460+0000","last_became_active":"2024-03-23T23:42:40.697668+0000","last_became_peered":"2024-03-23T23:42:40.697668+0000","last_unstale":"2024-03-23T23:42:52.328460+0000","last_undegraded":"2024-03-23T23:42:52.328460+0000","last_fullsized":"2024-03-23T23:42:52.328460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:23:43.515519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751380+0000","last_change":"2024-03-23T23:42:49.744792+0000","last_active":"2024-03-23T23:42:51.751380+0000","last_peered":"2024-03-23T23:42:51.751380+0000","last_clean":"2024-03-23T23:42:51.751380+0000","last_became_active":"2024-03-23T23:42:49.744561+0000","last_became_peered":"2024-03-23T23:42:49.744561+0000","last_unstale":"2024-03-23T23:42:51.751380+0000","last_undegraded":"2024-03-23T23:42:51.751380+0000","last_fullsized":"2024-03-23T23:42:51.751380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:07:58.222020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328699+0000","last_change":"2024-03-23T23:42:50.755575+0000","last_active":"2024-03-23T23:42:52.328699+0000","last_peered":"2024-03-23T23:42:52.328699+0000","last_clean":"2024-03-23T23:42:52.328699+0000","last_became_active":"2024-03-23T23:42:50.755337+0000","last_became_peered":"2024-03-23T23:42:50.755337+0000","last_unstale":"2024-03-23T23:42:52.328699+0000","last_undegraded":"2024-03-23T23:42:52.328699+0000","last_fullsized":"2024-03-23T23:42:52.328699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:13.911327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.743741+0000","last_change":"2024-03-23T23:42:39.696707+0000","last_active":"2024-03-23T23:42:50.743741+0000","last_peered":"2024-03-23T23:42:50.743741+0000","last_clean":"2024-03-23T23:42:50.743741+0000","last_became_active":"2024-03-23T23:42:39.696401+0000","last_became_peered":"2024-03-23T23:42:39.696401+0000","last_unstale":"2024-03-23T23:42:50.743741+0000","last_undegraded":"2024-03-23T23:42:50.743741+0000","last_fullsized":"2024-03-23T23:42:50.743741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:55.757707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328921+0000","last_change":"2024-03-23T23:42:40.700389+0000","last_active":"2024-03-23T23:42:52.328921+0000","last_peered":"2024-03-23T23:42:52.328921+0000","last_clean":"2024-03-23T23:42:52.328921+0000","last_became_active":"2024-03-23T23:42:40.699770+0000","last_became_peered":"2024-03-23T23:42:40.699770+0000","last_unstale":"2024-03-23T23:42:52.328921+0000","last_undegraded":"2024-03-23T23:42:52.328921+0000","last_fullsized":"2024-03-23T23:42:52.328921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:27.675824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751083+0000","last_change":"2024-03-23T23:42:49.745710+0000","last_active":"2024-03-23T23:42:51.751083+0000","last_peered":"2024-03-23T23:42:51.751083+0000","last_clean":"2024-03-23T23:42:51.751083+0000","last_became_active":"2024-03-23T23:42:49.745526+0000","last_became_peered":"2024-03-23T23:42:49.745526+0000","last_unstale":"2024-03-23T23:42:51.751083+0000","last_undegraded":"2024-03-23T23:42:51.751083+0000","last_fullsized":"2024-03-23T23:42:51.751083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:05:26.746849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.760661+0000","last_change":"2024-03-23T23:42:50.747274+0000","last_active":"2024-03-23T23:42:50.760661+0000","last_peered":"2024-03-23T23:42:50.760661+0000","last_clean":"2024-03-23T23:42:50.760661+0000","last_became_active":"2024-03-23T23:42:50.746937+0000","last_became_peered":"2024-03-23T23:42:50.746937+0000","last_unstale":"2024-03-23T23:42:50.760661+0000","last_undegraded":"2024-03-23T23:42:50.760661+0000","last_fullsized":"2024-03-23T23:42:50.760661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:52:58.565591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751450+0000","last_change":"2024-03-23T23:42:40.682467+0000","last_active":"2024-03-23T23:42:51.751450+0000","last_peered":"2024-03-23T23:42:51.751450+0000","last_clean":"2024-03-23T23:42:51.751450+0000","last_became_active":"2024-03-23T23:42:40.682192+0000","last_became_peered":"2024-03-23T23:42:40.682192+0000","last_unstale":"2024-03-23T23:42:51.751450+0000","last_undegraded":"2024-03-23T23:42:51.751450+0000","last_fullsized":"2024-03-23T23:42:51.751450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:37:24.839568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.740154+0000","last_change":"2024-03-23T23:42:39.696528+0000","last_active":"2024-03-23T23:42:50.740154+0000","last_peered":"2024-03-23T23:42:50.740154+0000","last_clean":"2024-03-23T23:42:50.740154+0000","last_became_active":"2024-03-23T23:42:39.696207+0000","last_became_peered":"2024-03-23T23:42:39.696207+0000","last_unstale":"2024-03-23T23:42:50.740154+0000","last_undegraded":"2024-03-23T23:42:50.740154+0000","last_fullsized":"2024-03-23T23:42:50.740154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:02.190910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751687+0000","last_change":"2024-03-23T23:42:49.734156+0000","last_active":"2024-03-23T23:42:51.751687+0000","last_peered":"2024-03-23T23:42:51.751687+0000","last_clean":"2024-03-23T23:42:51.751687+0000","last_became_active":"2024-03-23T23:42:49.733888+0000","last_became_peered":"2024-03-23T23:42:49.733888+0000","last_unstale":"2024-03-23T23:42:51.751687+0000","last_undegraded":"2024-03-23T23:42:51.751687+0000","last_fullsized":"2024-03-23T23:42:51.751687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:23:52.568123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.768274+0000","last_change":"2024-03-23T23:42:50.759749+0000","last_active":"2024-03-23T23:42:50.768274+0000","last_peered":"2024-03-23T23:42:50.768274+0000","last_clean":"2024-03-23T23:42:50.768274+0000","last_became_active":"2024-03-23T23:42:50.758670+0000","last_became_peered":"2024-03-23T23:42:50.758670+0000","last_unstale":"2024-03-23T23:42:50.768274+0000","last_undegraded":"2024-03-23T23:42:50.768274+0000","last_fullsized":"2024-03-23T23:42:50.768274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:17:29.318261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327985+0000","last_change":"2024-03-23T23:42:40.674574+0000","last_active":"2024-03-23T23:42:52.327985+0000","last_peered":"2024-03-23T23:42:52.327985+0000","last_clean":"2024-03-23T23:42:52.327985+0000","last_became_active":"2024-03-23T23:42:40.674293+0000","last_became_peered":"2024-03-23T23:42:40.674293+0000","last_unstale":"2024-03-23T23:42:52.327985+0000","last_undegraded":"2024-03-23T23:42:52.327985+0000","last_fullsized":"2024-03-23T23:42:52.327985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:37:24.839568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.741025+0000","last_change":"2024-03-23T23:42:39.683165+0000","last_active":"2024-03-23T23:42:50.741025+0000","last_peered":"2024-03-23T23:42:50.741025+0000","last_clean":"2024-03-23T23:42:50.741025+0000","last_became_active":"2024-03-23T23:42:39.680121+0000","last_became_peered":"2024-03-23T23:42:39.680121+0000","last_unstale":"2024-03-23T23:42:50.741025+0000","last_undegraded":"2024-03-23T23:42:50.741025+0000","last_fullsized":"2024-03-23T23:42:50.741025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:02.190910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752029+0000","last_change":"2024-03-23T23:42:49.745016+0000","last_active":"2024-03-23T23:42:51.752029+0000","last_peered":"2024-03-23T23:42:51.752029+0000","last_clean":"2024-03-23T23:42:51.752029+0000","last_became_active":"2024-03-23T23:42:49.744742+0000","last_became_peered":"2024-03-23T23:42:49.744742+0000","last_unstale":"2024-03-23T23:42:51.752029+0000","last_undegraded":"2024-03-23T23:42:51.752029+0000","last_fullsized":"2024-03-23T23:42:51.752029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:30.033743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751217+0000","last_change":"2024-03-23T23:42:50.749792+0000","last_active":"2024-03-23T23:42:51.751217+0000","last_peered":"2024-03-23T23:42:51.751217+0000","last_clean":"2024-03-23T23:42:51.751217+0000","last_became_active":"2024-03-23T23:42:50.749491+0000","last_became_peered":"2024-03-23T23:42:50.749491+0000","last_unstale":"2024-03-23T23:42:51.751217+0000","last_undegraded":"2024-03-23T23:42:51.751217+0000","last_fullsized":"2024-03-23T23:42:51.751217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:25:44.894505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327680+0000","last_change":"2024-03-23T23:42:40.682999+0000","last_active":"2024-03-23T23:42:52.327680+0000","last_peered":"2024-03-23T23:42:52.327680+0000","last_clean":"2024-03-23T23:42:52.327680+0000","last_became_active":"2024-03-23T23:42:40.682672+0000","last_became_peered":"2024-03-23T23:42:40.682672+0000","last_unstale":"2024-03-23T23:42:52.327680+0000","last_undegraded":"2024-03-23T23:42:52.327680+0000","last_fullsized":"2024-03-23T23:42:52.327680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:59:45.154553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.740401+0000","last_change":"2024-03-23T23:42:39.691470+0000","last_active":"2024-03-23T23:42:50.740401+0000","last_peered":"2024-03-23T23:42:50.740401+0000","last_clean":"2024-03-23T23:42:50.740401+0000","last_became_active":"2024-03-23T23:42:39.691124+0000","last_became_peered":"2024-03-23T23:42:39.691124+0000","last_unstale":"2024-03-23T23:42:50.740401+0000","last_undegraded":"2024-03-23T23:42:50.740401+0000","last_fullsized":"2024-03-23T23:42:50.740401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:55.757707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.773676+0000","last_change":"2024-03-23T23:42:49.750016+0000","last_active":"2024-03-23T23:42:50.773676+0000","last_peered":"2024-03-23T23:42:50.773676+0000","last_clean":"2024-03-23T23:42:50.773676+0000","last_became_active":"2024-03-23T23:42:49.749279+0000","last_became_peered":"2024-03-23T23:42:49.749279+0000","last_unstale":"2024-03-23T23:42:50.773676+0000","last_undegraded":"2024-03-23T23:42:50.773676+0000","last_fullsized":"2024-03-23T23:42:50.773676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:41:14.671834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328693+0000","last_change":"2024-03-23T23:42:50.753669+0000","last_active":"2024-03-23T23:42:52.328693+0000","last_peered":"2024-03-23T23:42:52.328693+0000","last_clean":"2024-03-23T23:42:52.328693+0000","last_became_active":"2024-03-23T23:42:50.752674+0000","last_became_peered":"2024-03-23T23:42:50.752674+0000","last_unstale":"2024-03-23T23:42:52.328693+0000","last_undegraded":"2024-03-23T23:42:52.328693+0000","last_fullsized":"2024-03-23T23:42:52.328693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:39:04.727316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751477+0000","last_change":"2024-03-23T23:42:40.685051+0000","last_active":"2024-03-23T23:42:51.751477+0000","last_peered":"2024-03-23T23:42:51.751477+0000","last_clean":"2024-03-23T23:42:51.751477+0000","last_became_active":"2024-03-23T23:42:40.684677+0000","last_became_peered":"2024-03-23T23:42:40.684677+0000","last_unstale":"2024-03-23T23:42:51.751477+0000","last_undegraded":"2024-03-23T23:42:51.751477+0000","last_fullsized":"2024-03-23T23:42:51.751477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:20.920978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.741549+0000","last_change":"2024-03-23T23:42:39.695253+0000","last_active":"2024-03-23T23:42:50.741549+0000","last_peered":"2024-03-23T23:42:50.741549+0000","last_clean":"2024-03-23T23:42:50.741549+0000","last_became_active":"2024-03-23T23:42:39.694746+0000","last_became_peered":"2024-03-23T23:42:39.694746+0000","last_unstale":"2024-03-23T23:42:50.741549+0000","last_undegraded":"2024-03-23T23:42:50.741549+0000","last_fullsized":"2024-03-23T23:42:50.741549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:57.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752459+0000","last_change":"2024-03-23T23:42:49.724285+0000","last_active":"2024-03-23T23:42:51.752459+0000","last_peered":"2024-03-23T23:42:51.752459+0000","last_clean":"2024-03-23T23:42:51.752459+0000","last_became_active":"2024-03-23T23:42:49.724009+0000","last_became_peered":"2024-03-23T23:42:49.724009+0000","last_unstale":"2024-03-23T23:42:51.752459+0000","last_undegraded":"2024-03-23T23:42:51.752459+0000","last_fullsized":"2024-03-23T23:42:51.752459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:01:04.035970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327444+0000","last_change":"2024-03-23T23:42:50.746737+0000","last_active":"2024-03-23T23:42:52.327444+0000","last_peered":"2024-03-23T23:42:52.327444+0000","last_clean":"2024-03-23T23:42:52.327444+0000","last_became_active":"2024-03-23T23:42:50.746492+0000","last_became_peered":"2024-03-23T23:42:50.746492+0000","last_unstale":"2024-03-23T23:42:52.327444+0000","last_undegraded":"2024-03-23T23:42:52.327444+0000","last_fullsized":"2024-03-23T23:42:52.327444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:50.597847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.752429+0000","last_change":"2024-03-23T23:42:40.680963+0000","last_active":"2024-03-23T23:42:50.752429+0000","last_peered":"2024-03-23T23:42:50.752429+0000","last_clean":"2024-03-23T23:42:50.752429+0000","last_became_active":"2024-03-23T23:42:40.680744+0000","last_became_peered":"2024-03-23T23:42:40.680744+0000","last_unstale":"2024-03-23T23:42:50.752429+0000","last_undegraded":"2024-03-23T23:42:50.752429+0000","last_fullsized":"2024-03-23T23:42:50.752429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:17:19.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.753179+0000","last_change":"2024-03-23T23:42:39.691813+0000","last_active":"2024-03-23T23:42:51.753179+0000","last_peered":"2024-03-23T23:42:51.753179+0000","last_clean":"2024-03-23T23:42:51.753179+0000","last_became_active":"2024-03-23T23:42:39.691519+0000","last_became_peered":"2024-03-23T23:42:39.691519+0000","last_unstale":"2024-03-23T23:42:51.753179+0000","last_undegraded":"2024-03-23T23:42:51.753179+0000","last_fullsized":"2024-03-23T23:42:51.753179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:27:41.386662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751110+0000","last_change":"2024-03-23T23:42:49.734197+0000","last_active":"2024-03-23T23:42:51.751110+0000","last_peered":"2024-03-23T23:42:51.751110+0000","last_clean":"2024-03-23T23:42:51.751110+0000","last_became_active":"2024-03-23T23:42:49.733715+0000","last_became_peered":"2024-03-23T23:42:49.733715+0000","last_unstale":"2024-03-23T23:42:51.751110+0000","last_undegraded":"2024-03-23T23:42:51.751110+0000","last_fullsized":"2024-03-23T23:42:51.751110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:36.728428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750902+0000","last_change":"2024-03-23T23:42:50.739957+0000","last_active":"2024-03-23T23:42:51.750902+0000","last_peered":"2024-03-23T23:42:51.750902+0000","last_clean":"2024-03-23T23:42:51.750902+0000","last_became_active":"2024-03-23T23:42:50.739706+0000","last_became_peered":"2024-03-23T23:42:50.739706+0000","last_unstale":"2024-03-23T23:42:51.750902+0000","last_undegraded":"2024-03-23T23:42:51.750902+0000","last_fullsized":"2024-03-23T23:42:51.750902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:49:17.763463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328339+0000","last_change":"2024-03-23T23:42:40.686865+0000","last_active":"2024-03-23T23:42:52.328339+0000","last_peered":"2024-03-23T23:42:52.328339+0000","last_clean":"2024-03-23T23:42:52.328339+0000","last_became_active":"2024-03-23T23:42:40.686582+0000","last_became_peered":"2024-03-23T23:42:40.686582+0000","last_unstale":"2024-03-23T23:42:52.328339+0000","last_undegraded":"2024-03-23T23:42:52.328339+0000","last_fullsized":"2024-03-23T23:42:52.328339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:05:17.694245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.750857+0000","last_change":"2024-03-23T23:42:39.678962+0000","last_active":"2024-03-23T23:42:50.750857+0000","last_peered":"2024-03-23T23:42:50.750857+0000","last_clean":"2024-03-23T23:42:50.750857+0000","last_became_active":"2024-03-23T23:42:39.678603+0000","last_became_peered":"2024-03-23T23:42:39.678603+0000","last_unstale":"2024-03-23T23:42:50.750857+0000","last_undegraded":"2024-03-23T23:42:50.750857+0000","last_fullsized":"2024-03-23T23:42:50.750857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:43:46.206865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327329+0000","last_change":"2024-03-23T23:42:49.740561+0000","last_active":"2024-03-23T23:42:52.327329+0000","last_peered":"2024-03-23T23:42:52.327329+0000","last_clean":"2024-03-23T23:42:52.327329+0000","last_became_active":"2024-03-23T23:42:49.740290+0000","last_became_peered":"2024-03-23T23:42:49.740290+0000","last_unstale":"2024-03-23T23:42:52.327329+0000","last_undegraded":"2024-03-23T23:42:52.327329+0000","last_fullsized":"2024-03-23T23:42:52.327329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:21:24.160603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751249+0000","last_change":"2024-03-23T23:42:50.751107+0000","last_active":"2024-03-23T23:42:51.751249+0000","last_peered":"2024-03-23T23:42:51.751249+0000","last_clean":"2024-03-23T23:42:51.751249+0000","last_became_active":"2024-03-23T23:42:50.750859+0000","last_became_peered":"2024-03-23T23:42:50.750859+0000","last_unstale":"2024-03-23T23:42:51.751249+0000","last_undegraded":"2024-03-23T23:42:51.751249+0000","last_fullsized":"2024-03-23T23:42:51.751249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:49:17.763463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.740588+0000","last_change":"2024-03-23T23:42:40.686486+0000","last_active":"2024-03-23T23:42:50.740588+0000","last_peered":"2024-03-23T23:42:50.740588+0000","last_clean":"2024-03-23T23:42:50.740588+0000","last_became_active":"2024-03-23T23:42:40.686186+0000","last_became_peered":"2024-03-23T23:42:40.686186+0000","last_unstale":"2024-03-23T23:42:50.740588+0000","last_undegraded":"2024-03-23T23:42:50.740588+0000","last_fullsized":"2024-03-23T23:42:50.740588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:46:30.427072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.742762+0000","last_change":"2024-03-23T23:42:39.695099+0000","last_active":"2024-03-23T23:42:50.742762+0000","last_peered":"2024-03-23T23:42:50.742762+0000","last_clean":"2024-03-23T23:42:50.742762+0000","last_became_active":"2024-03-23T23:42:39.694720+0000","last_became_peered":"2024-03-23T23:42:39.694720+0000","last_unstale":"2024-03-23T23:42:50.742762+0000","last_undegraded":"2024-03-23T23:42:50.742762+0000","last_fullsized":"2024-03-23T23:42:50.742762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:58:07.880313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.749444+0000","last_change":"2024-03-23T23:42:49.739099+0000","last_active":"2024-03-23T23:42:50.749444+0000","last_peered":"2024-03-23T23:42:50.749444+0000","last_clean":"2024-03-23T23:42:50.749444+0000","last_became_active":"2024-03-23T23:42:49.738198+0000","last_became_peered":"2024-03-23T23:42:49.738198+0000","last_unstale":"2024-03-23T23:42:50.749444+0000","last_undegraded":"2024-03-23T23:42:50.749444+0000","last_fullsized":"2024-03-23T23:42:50.749444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:57:34.600362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.756247+0000","last_change":"2024-03-23T23:42:50.754941+0000","last_active":"2024-03-23T23:42:50.756247+0000","last_peered":"2024-03-23T23:42:50.756247+0000","last_clean":"2024-03-23T23:42:50.756247+0000","last_became_active":"2024-03-23T23:42:50.754585+0000","last_became_peered":"2024-03-23T23:42:50.754585+0000","last_unstale":"2024-03-23T23:42:50.756247+0000","last_undegraded":"2024-03-23T23:42:50.756247+0000","last_fullsized":"2024-03-23T23:42:50.756247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:33:43.235051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328954+0000","last_change":"2024-03-23T23:42:40.700610+0000","last_active":"2024-03-23T23:42:52.328954+0000","last_peered":"2024-03-23T23:42:52.328954+0000","last_clean":"2024-03-23T23:42:52.328954+0000","last_became_active":"2024-03-23T23:42:40.700112+0000","last_became_peered":"2024-03-23T23:42:40.700112+0000","last_unstale":"2024-03-23T23:42:52.328954+0000","last_undegraded":"2024-03-23T23:42:52.328954+0000","last_fullsized":"2024-03-23T23:42:52.328954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:07:49.169416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.740681+0000","last_change":"2024-03-23T23:42:39.686509+0000","last_active":"2024-03-23T23:42:50.740681+0000","last_peered":"2024-03-23T23:42:50.740681+0000","last_clean":"2024-03-23T23:42:50.740681+0000","last_became_active":"2024-03-23T23:42:39.686094+0000","last_became_peered":"2024-03-23T23:42:39.686094+0000","last_unstale":"2024-03-23T23:42:50.740681+0000","last_undegraded":"2024-03-23T23:42:50.740681+0000","last_fullsized":"2024-03-23T23:42:50.740681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:57:20.394530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.740810+0000","last_change":"2024-03-23T23:42:49.738274+0000","last_active":"2024-03-23T23:42:50.740810+0000","last_peered":"2024-03-23T23:42:50.740810+0000","last_clean":"2024-03-23T23:42:50.740810+0000","last_became_active":"2024-03-23T23:42:49.737916+0000","last_became_peered":"2024-03-23T23:42:49.737916+0000","last_unstale":"2024-03-23T23:42:50.740810+0000","last_undegraded":"2024-03-23T23:42:50.740810+0000","last_fullsized":"2024-03-23T23:42:50.740810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:18:12.997092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.771896+0000","last_change":"2024-03-23T23:42:50.764148+0000","last_active":"2024-03-23T23:42:50.771896+0000","last_peered":"2024-03-23T23:42:50.771896+0000","last_clean":"2024-03-23T23:42:50.771896+0000","last_became_active":"2024-03-23T23:42:50.763768+0000","last_became_peered":"2024-03-23T23:42:50.763768+0000","last_unstale":"2024-03-23T23:42:50.771896+0000","last_undegraded":"2024-03-23T23:42:50.771896+0000","last_fullsized":"2024-03-23T23:42:50.771896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:41:15.676389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751565+0000","last_change":"2024-03-23T23:42:40.679988+0000","last_active":"2024-03-23T23:42:51.751565+0000","last_peered":"2024-03-23T23:42:51.751565+0000","last_clean":"2024-03-23T23:42:51.751565+0000","last_became_active":"2024-03-23T23:42:40.679488+0000","last_became_peered":"2024-03-23T23:42:40.679488+0000","last_unstale":"2024-03-23T23:42:51.751565+0000","last_undegraded":"2024-03-23T23:42:51.751565+0000","last_fullsized":"2024-03-23T23:42:51.751565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:10:32.251287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328493+0000","last_change":"2024-03-23T23:42:39.679741+0000","last_active":"2024-03-23T23:42:52.328493+0000","last_peered":"2024-03-23T23:42:52.328493+0000","last_clean":"2024-03-23T23:42:52.328493+0000","last_became_active":"2024-03-23T23:42:39.678864+0000","last_became_peered":"2024-03-23T23:42:39.678864+0000","last_unstale":"2024-03-23T23:42:52.328493+0000","last_undegraded":"2024-03-23T23:42:52.328493+0000","last_fullsized":"2024-03-23T23:42:52.328493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:50.559059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.740540+0000","last_change":"2024-03-23T23:42:49.739837+0000","last_active":"2024-03-23T23:42:50.740540+0000","last_peered":"2024-03-23T23:42:50.740540+0000","last_clean":"2024-03-23T23:42:50.740540+0000","last_became_active":"2024-03-23T23:42:49.739570+0000","last_became_peered":"2024-03-23T23:42:49.739570+0000","last_unstale":"2024-03-23T23:42:50.740540+0000","last_undegraded":"2024-03-23T23:42:50.740540+0000","last_fullsized":"2024-03-23T23:42:50.740540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:57:34.600362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.765628+0000","last_change":"2024-03-23T23:42:50.753912+0000","last_active":"2024-03-23T23:42:50.765628+0000","last_peered":"2024-03-23T23:42:50.765628+0000","last_clean":"2024-03-23T23:42:50.765628+0000","last_became_active":"2024-03-23T23:42:50.753629+0000","last_became_peered":"2024-03-23T23:42:50.753629+0000","last_unstale":"2024-03-23T23:42:50.765628+0000","last_undegraded":"2024-03-23T23:42:50.765628+0000","last_fullsized":"2024-03-23T23:42:50.765628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:26:26.229079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.740091+0000","last_change":"2024-03-23T23:42:40.682840+0000","last_active":"2024-03-23T23:42:50.740091+0000","last_peered":"2024-03-23T23:42:50.740091+0000","last_clean":"2024-03-23T23:42:50.740091+0000","last_became_active":"2024-03-23T23:42:40.682391+0000","last_became_peered":"2024-03-23T23:42:40.682391+0000","last_unstale":"2024-03-23T23:42:50.740091+0000","last_undegraded":"2024-03-23T23:42:50.740091+0000","last_fullsized":"2024-03-23T23:42:50.740091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:42:14.952953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.739077+0000","last_change":"2024-03-23T23:42:39.680763+0000","last_active":"2024-03-23T23:42:50.739077+0000","last_peered":"2024-03-23T23:42:50.739077+0000","last_clean":"2024-03-23T23:42:50.739077+0000","last_became_active":"2024-03-23T23:42:39.680494+0000","last_became_peered":"2024-03-23T23:42:39.680494+0000","last_unstale":"2024-03-23T23:42:50.739077+0000","last_undegraded":"2024-03-23T23:42:50.739077+0000","last_fullsized":"2024-03-23T23:42:50.739077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:57.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.768993+0000","last_change":"2024-03-23T23:42:49.737456+0000","last_active":"2024-03-23T23:42:50.768993+0000","last_peered":"2024-03-23T23:42:50.768993+0000","last_clean":"2024-03-23T23:42:50.768993+0000","last_became_active":"2024-03-23T23:42:49.737196+0000","last_became_peered":"2024-03-23T23:42:49.737196+0000","last_unstale":"2024-03-23T23:42:50.768993+0000","last_undegraded":"2024-03-23T23:42:50.768993+0000","last_fullsized":"2024-03-23T23:42:50.768993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:49:42.789292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.329037+0000","last_change":"2024-03-23T23:42:50.763308+0000","last_active":"2024-03-23T23:42:52.329037+0000","last_peered":"2024-03-23T23:42:52.329037+0000","last_clean":"2024-03-23T23:42:52.329037+0000","last_became_active":"2024-03-23T23:42:50.763007+0000","last_became_peered":"2024-03-23T23:42:50.763007+0000","last_unstale":"2024-03-23T23:42:52.329037+0000","last_undegraded":"2024-03-23T23:42:52.329037+0000","last_fullsized":"2024-03-23T23:42:52.329037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:32:46.055472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.741840+0000","last_change":"2024-03-23T23:42:40.675570+0000","last_active":"2024-03-23T23:42:50.741840+0000","last_peered":"2024-03-23T23:42:50.741840+0000","last_clean":"2024-03-23T23:42:50.741840+0000","last_became_active":"2024-03-23T23:42:40.674390+0000","last_became_peered":"2024-03-23T23:42:40.674390+0000","last_unstale":"2024-03-23T23:42:50.741840+0000","last_undegraded":"2024-03-23T23:42:50.741840+0000","last_fullsized":"2024-03-23T23:42:50.741840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:31:34.412092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.741639+0000","last_change":"2024-03-23T23:42:39.690057+0000","last_active":"2024-03-23T23:42:50.741639+0000","last_peered":"2024-03-23T23:42:50.741639+0000","last_clean":"2024-03-23T23:42:50.741639+0000","last_became_active":"2024-03-23T23:42:39.689763+0000","last_became_peered":"2024-03-23T23:42:39.689763+0000","last_unstale":"2024-03-23T23:42:50.741639+0000","last_undegraded":"2024-03-23T23:42:50.741639+0000","last_fullsized":"2024-03-23T23:42:50.741639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:01.607584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.752173+0000","last_change":"2024-03-23T23:42:49.734213+0000","last_active":"2024-03-23T23:42:50.752173+0000","last_peered":"2024-03-23T23:42:50.752173+0000","last_clean":"2024-03-23T23:42:50.752173+0000","last_became_active":"2024-03-23T23:42:49.733115+0000","last_became_peered":"2024-03-23T23:42:49.733115+0000","last_unstale":"2024-03-23T23:42:50.752173+0000","last_undegraded":"2024-03-23T23:42:50.752173+0000","last_fullsized":"2024-03-23T23:42:50.752173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:18:12.997092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.764790+0000","last_change":"2024-03-23T23:42:50.759000+0000","last_active":"2024-03-23T23:42:50.764790+0000","last_peered":"2024-03-23T23:42:50.764790+0000","last_clean":"2024-03-23T23:42:50.764790+0000","last_became_active":"2024-03-23T23:42:50.758552+0000","last_became_peered":"2024-03-23T23:42:50.758552+0000","last_unstale":"2024-03-23T23:42:50.764790+0000","last_undegraded":"2024-03-23T23:42:50.764790+0000","last_fullsized":"2024-03-23T23:42:50.764790+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:42:23.236324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327764+0000","last_change":"2024-03-23T23:42:40.700998+0000","last_active":"2024-03-23T23:42:52.327764+0000","last_peered":"2024-03-23T23:42:52.327764+0000","last_clean":"2024-03-23T23:42:52.327764+0000","last_became_active":"2024-03-23T23:42:40.700788+0000","last_became_peered":"2024-03-23T23:42:40.700788+0000","last_unstale":"2024-03-23T23:42:52.327764+0000","last_undegraded":"2024-03-23T23:42:52.327764+0000","last_fullsized":"2024-03-23T23:42:52.327764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:14:44.739525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328524+0000","last_change":"2024-03-23T23:42:39.687712+0000","last_active":"2024-03-23T23:42:52.328524+0000","last_peered":"2024-03-23T23:42:52.328524+0000","last_clean":"2024-03-23T23:42:52.328524+0000","last_became_active":"2024-03-23T23:42:39.687378+0000","last_became_peered":"2024-03-23T23:42:39.687378+0000","last_unstale":"2024-03-23T23:42:52.328524+0000","last_undegraded":"2024-03-23T23:42:52.328524+0000","last_fullsized":"2024-03-23T23:42:52.328524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:20:38.456655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":176,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.741726+0000","last_change":"2024-03-23T23:42:27.940270+0000","last_active":"2024-03-23T23:42:50.741726+0000","last_peered":"2024-03-23T23:42:50.741726+0000","last_clean":"2024-03-23T23:42:50.741726+0000","last_became_active":"2024-03-23T23:42:27.939061+0000","last_became_peered":"2024-03-23T23:42:27.939061+0000","last_unstale":"2024-03-23T23:42:50.741726+0000","last_undegraded":"2024-03-23T23:42:50.741726+0000","last_fullsized":"2024-03-23T23:42:50.741726+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:26.509742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:26.509742+0000","last_clean_scrub_stamp":"2024-03-23T23:42:26.509742+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:49.258623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752132+0000","last_change":"2024-03-23T23:42:49.729231+0000","last_active":"2024-03-23T23:42:51.752132+0000","last_peered":"2024-03-23T23:42:51.752132+0000","last_clean":"2024-03-23T23:42:51.752132+0000","last_became_active":"2024-03-23T23:42:49.728990+0000","last_became_peered":"2024-03-23T23:42:49.728990+0000","last_unstale":"2024-03-23T23:42:51.752132+0000","last_undegraded":"2024-03-23T23:42:51.752132+0000","last_fullsized":"2024-03-23T23:42:51.752132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:01:04.035970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.768448+0000","last_change":"2024-03-23T23:42:50.757668+0000","last_active":"2024-03-23T23:42:50.768448+0000","last_peered":"2024-03-23T23:42:50.768448+0000","last_clean":"2024-03-23T23:42:50.768448+0000","last_became_active":"2024-03-23T23:42:50.756900+0000","last_became_peered":"2024-03-23T23:42:50.756900+0000","last_unstale":"2024-03-23T23:42:50.768448+0000","last_undegraded":"2024-03-23T23:42:50.768448+0000","last_fullsized":"2024-03-23T23:42:50.768448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:39:02.277570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.742497+0000","last_change":"2024-03-23T23:42:40.711591+0000","last_active":"2024-03-23T23:42:50.742497+0000","last_peered":"2024-03-23T23:42:50.742497+0000","last_clean":"2024-03-23T23:42:50.742497+0000","last_became_active":"2024-03-23T23:42:40.711306+0000","last_became_peered":"2024-03-23T23:42:40.711306+0000","last_unstale":"2024-03-23T23:42:50.742497+0000","last_undegraded":"2024-03-23T23:42:50.742497+0000","last_fullsized":"2024-03-23T23:42:50.742497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:34:16.693372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.743754+0000","last_change":"2024-03-23T23:42:39.684163+0000","last_active":"2024-03-23T23:42:50.743754+0000","last_peered":"2024-03-23T23:42:50.743754+0000","last_clean":"2024-03-23T23:42:50.743754+0000","last_became_active":"2024-03-23T23:42:39.683211+0000","last_became_peered":"2024-03-23T23:42:39.683211+0000","last_unstale":"2024-03-23T23:42:50.743754+0000","last_undegraded":"2024-03-23T23:42:50.743754+0000","last_fullsized":"2024-03-23T23:42:50.743754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:47:27.092873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751343+0000","last_change":"2024-03-23T23:42:49.735824+0000","last_active":"2024-03-23T23:42:51.751343+0000","last_peered":"2024-03-23T23:42:51.751343+0000","last_clean":"2024-03-23T23:42:51.751343+0000","last_became_active":"2024-03-23T23:42:49.735473+0000","last_became_peered":"2024-03-23T23:42:49.735473+0000","last_unstale":"2024-03-23T23:42:51.751343+0000","last_undegraded":"2024-03-23T23:42:51.751343+0000","last_fullsized":"2024-03-23T23:42:51.751343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:44:12.438729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.758361+0000","last_change":"2024-03-23T23:42:50.745563+0000","last_active":"2024-03-23T23:42:50.758361+0000","last_peered":"2024-03-23T23:42:50.758361+0000","last_clean":"2024-03-23T23:42:50.758361+0000","last_became_active":"2024-03-23T23:42:50.745256+0000","last_became_peered":"2024-03-23T23:42:50.745256+0000","last_unstale":"2024-03-23T23:42:50.758361+0000","last_undegraded":"2024-03-23T23:42:50.758361+0000","last_fullsized":"2024-03-23T23:42:50.758361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:51:40.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328628+0000","last_change":"2024-03-23T23:42:40.700124+0000","last_active":"2024-03-23T23:42:52.328628+0000","last_peered":"2024-03-23T23:42:52.328628+0000","last_clean":"2024-03-23T23:42:52.328628+0000","last_became_active":"2024-03-23T23:42:40.697369+0000","last_became_peered":"2024-03-23T23:42:40.697369+0000","last_unstale":"2024-03-23T23:42:52.328628+0000","last_undegraded":"2024-03-23T23:42:52.328628+0000","last_fullsized":"2024-03-23T23:42:52.328628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:20.981139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.742387+0000","last_change":"2024-03-23T23:42:39.681013+0000","last_active":"2024-03-23T23:42:50.742387+0000","last_peered":"2024-03-23T23:42:50.742387+0000","last_clean":"2024-03-23T23:42:50.742387+0000","last_became_active":"2024-03-23T23:42:39.680669+0000","last_became_peered":"2024-03-23T23:42:39.680669+0000","last_unstale":"2024-03-23T23:42:50.742387+0000","last_undegraded":"2024-03-23T23:42:50.742387+0000","last_fullsized":"2024-03-23T23:42:50.742387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:58:07.880313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.773188+0000","last_change":"2024-03-23T23:42:49.736747+0000","last_active":"2024-03-23T23:42:50.773188+0000","last_peered":"2024-03-23T23:42:50.773188+0000","last_clean":"2024-03-23T23:42:50.773188+0000","last_became_active":"2024-03-23T23:42:49.734508+0000","last_became_peered":"2024-03-23T23:42:49.734508+0000","last_unstale":"2024-03-23T23:42:50.773188+0000","last_undegraded":"2024-03-23T23:42:50.773188+0000","last_fullsized":"2024-03-23T23:42:50.773188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:54.356082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.756623+0000","last_change":"2024-03-23T23:42:50.751141+0000","last_active":"2024-03-23T23:42:50.756623+0000","last_peered":"2024-03-23T23:42:50.756623+0000","last_clean":"2024-03-23T23:42:50.756623+0000","last_became_active":"2024-03-23T23:42:50.750269+0000","last_became_peered":"2024-03-23T23:42:50.750269+0000","last_unstale":"2024-03-23T23:42:50.756623+0000","last_undegraded":"2024-03-23T23:42:50.756623+0000","last_fullsized":"2024-03-23T23:42:50.756623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:41:15.676389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.744768+0000","last_change":"2024-03-23T23:42:40.706713+0000","last_active":"2024-03-23T23:42:50.744768+0000","last_peered":"2024-03-23T23:42:50.744768+0000","last_clean":"2024-03-23T23:42:50.744768+0000","last_became_active":"2024-03-23T23:42:40.704328+0000","last_became_peered":"2024-03-23T23:42:40.704328+0000","last_unstale":"2024-03-23T23:42:50.744768+0000","last_undegraded":"2024-03-23T23:42:50.744768+0000","last_fullsized":"2024-03-23T23:42:50.744768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:15:52.261572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.743478+0000","last_change":"2024-03-23T23:42:39.681906+0000","last_active":"2024-03-23T23:42:50.743478+0000","last_peered":"2024-03-23T23:42:50.743478+0000","last_clean":"2024-03-23T23:42:50.743478+0000","last_became_active":"2024-03-23T23:42:39.680506+0000","last_became_peered":"2024-03-23T23:42:39.680506+0000","last_unstale":"2024-03-23T23:42:50.743478+0000","last_undegraded":"2024-03-23T23:42:50.743478+0000","last_fullsized":"2024-03-23T23:42:50.743478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:44:07.213123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328020+0000","last_change":"2024-03-23T23:42:49.737735+0000","last_active":"2024-03-23T23:42:52.328020+0000","last_peered":"2024-03-23T23:42:52.328020+0000","last_clean":"2024-03-23T23:42:52.328020+0000","last_became_active":"2024-03-23T23:42:49.737434+0000","last_became_peered":"2024-03-23T23:42:49.737434+0000","last_unstale":"2024-03-23T23:42:52.328020+0000","last_undegraded":"2024-03-23T23:42:52.328020+0000","last_fullsized":"2024-03-23T23:42:52.328020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:58:10.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.758816+0000","last_change":"2024-03-23T23:42:50.746922+0000","last_active":"2024-03-23T23:42:50.758816+0000","last_peered":"2024-03-23T23:42:50.758816+0000","last_clean":"2024-03-23T23:42:50.758816+0000","last_became_active":"2024-03-23T23:42:50.746105+0000","last_became_peered":"2024-03-23T23:42:50.746105+0000","last_unstale":"2024-03-23T23:42:50.758816+0000","last_undegraded":"2024-03-23T23:42:50.758816+0000","last_fullsized":"2024-03-23T23:42:50.758816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:27:13.189191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.741515+0000","last_change":"2024-03-23T23:42:40.696584+0000","last_active":"2024-03-23T23:42:50.741515+0000","last_peered":"2024-03-23T23:42:50.741515+0000","last_clean":"2024-03-23T23:42:50.741515+0000","last_became_active":"2024-03-23T23:42:40.696141+0000","last_became_peered":"2024-03-23T23:42:40.696141+0000","last_unstale":"2024-03-23T23:42:50.741515+0000","last_undegraded":"2024-03-23T23:42:50.741515+0000","last_fullsized":"2024-03-23T23:42:50.741515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:45.303477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752716+0000","last_change":"2024-03-23T23:42:39.686863+0000","last_active":"2024-03-23T23:42:51.752716+0000","last_peered":"2024-03-23T23:42:51.752716+0000","last_clean":"2024-03-23T23:42:51.752716+0000","last_became_active":"2024-03-23T23:42:39.686491+0000","last_became_peered":"2024-03-23T23:42:39.686491+0000","last_unstale":"2024-03-23T23:42:51.752716+0000","last_undegraded":"2024-03-23T23:42:51.752716+0000","last_fullsized":"2024-03-23T23:42:51.752716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:38:13.752628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751016+0000","last_change":"2024-03-23T23:42:49.733982+0000","last_active":"2024-03-23T23:42:51.751016+0000","last_peered":"2024-03-23T23:42:51.751016+0000","last_clean":"2024-03-23T23:42:51.751016+0000","last_became_active":"2024-03-23T23:42:49.733389+0000","last_became_peered":"2024-03-23T23:42:49.733389+0000","last_unstale":"2024-03-23T23:42:51.751016+0000","last_undegraded":"2024-03-23T23:42:51.751016+0000","last_fullsized":"2024-03-23T23:42:51.751016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:13.685893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328287+0000","last_change":"2024-03-23T23:42:50.764083+0000","last_active":"2024-03-23T23:42:52.328287+0000","last_peered":"2024-03-23T23:42:52.328287+0000","last_clean":"2024-03-23T23:42:52.328287+0000","last_became_active":"2024-03-23T23:42:50.763871+0000","last_became_peered":"2024-03-23T23:42:50.763871+0000","last_unstale":"2024-03-23T23:42:52.328287+0000","last_undegraded":"2024-03-23T23:42:52.328287+0000","last_fullsized":"2024-03-23T23:42:52.328287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:32:46.055472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.743006+0000","last_change":"2024-03-23T23:42:40.700961+0000","last_active":"2024-03-23T23:42:50.743006+0000","last_peered":"2024-03-23T23:42:50.743006+0000","last_clean":"2024-03-23T23:42:50.743006+0000","last_became_active":"2024-03-23T23:42:40.700800+0000","last_became_peered":"2024-03-23T23:42:40.700800+0000","last_unstale":"2024-03-23T23:42:50.743006+0000","last_undegraded":"2024-03-23T23:42:50.743006+0000","last_fullsized":"2024-03-23T23:42:50.743006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:54:27.641281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.738856+0000","last_change":"2024-03-23T23:42:39.676075+0000","last_active":"2024-03-23T23:42:50.738856+0000","last_peered":"2024-03-23T23:42:50.738856+0000","last_clean":"2024-03-23T23:42:50.738856+0000","last_became_active":"2024-03-23T23:42:39.675770+0000","last_became_peered":"2024-03-23T23:42:39.675770+0000","last_unstale":"2024-03-23T23:42:50.738856+0000","last_undegraded":"2024-03-23T23:42:50.738856+0000","last_fullsized":"2024-03-23T23:42:50.738856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:24:11.933075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.752384+0000","last_change":"2024-03-23T23:42:49.739529+0000","last_active":"2024-03-23T23:42:50.752384+0000","last_peered":"2024-03-23T23:42:50.752384+0000","last_clean":"2024-03-23T23:42:50.752384+0000","last_became_active":"2024-03-23T23:42:49.738053+0000","last_became_peered":"2024-03-23T23:42:49.738053+0000","last_unstale":"2024-03-23T23:42:50.752384+0000","last_undegraded":"2024-03-23T23:42:50.752384+0000","last_fullsized":"2024-03-23T23:42:50.752384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:52:57.561036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328637+0000","last_change":"2024-03-23T23:42:50.771347+0000","last_active":"2024-03-23T23:42:52.328637+0000","last_peered":"2024-03-23T23:42:52.328637+0000","last_clean":"2024-03-23T23:42:52.328637+0000","last_became_active":"2024-03-23T23:42:50.770998+0000","last_became_peered":"2024-03-23T23:42:50.770998+0000","last_unstale":"2024-03-23T23:42:52.328637+0000","last_undegraded":"2024-03-23T23:42:52.328637+0000","last_fullsized":"2024-03-23T23:42:52.328637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:57:04.394872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750921+0000","last_change":"2024-03-23T23:42:40.677314+0000","last_active":"2024-03-23T23:42:51.750921+0000","last_peered":"2024-03-23T23:42:51.750921+0000","last_clean":"2024-03-23T23:42:51.750921+0000","last_became_active":"2024-03-23T23:42:40.675416+0000","last_became_peered":"2024-03-23T23:42:40.675416+0000","last_unstale":"2024-03-23T23:42:51.750921+0000","last_undegraded":"2024-03-23T23:42:51.750921+0000","last_fullsized":"2024-03-23T23:42:51.750921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:01:06.338641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751663+0000","last_change":"2024-03-23T23:42:39.681827+0000","last_active":"2024-03-23T23:42:51.751663+0000","last_peered":"2024-03-23T23:42:51.751663+0000","last_clean":"2024-03-23T23:42:51.751663+0000","last_became_active":"2024-03-23T23:42:39.681418+0000","last_became_peered":"2024-03-23T23:42:39.681418+0000","last_unstale":"2024-03-23T23:42:51.751663+0000","last_undegraded":"2024-03-23T23:42:51.751663+0000","last_fullsized":"2024-03-23T23:42:51.751663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:50.559059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328221+0000","last_change":"2024-03-23T23:42:49.744708+0000","last_active":"2024-03-23T23:42:52.328221+0000","last_peered":"2024-03-23T23:42:52.328221+0000","last_clean":"2024-03-23T23:42:52.328221+0000","last_became_active":"2024-03-23T23:42:49.744422+0000","last_became_peered":"2024-03-23T23:42:49.744422+0000","last_unstale":"2024-03-23T23:42:52.328221+0000","last_undegraded":"2024-03-23T23:42:52.328221+0000","last_fullsized":"2024-03-23T23:42:52.328221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:25:43.889950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328641+0000","last_change":"2024-03-23T23:42:50.753064+0000","last_active":"2024-03-23T23:42:52.328641+0000","last_peered":"2024-03-23T23:42:52.328641+0000","last_clean":"2024-03-23T23:42:52.328641+0000","last_became_active":"2024-03-23T23:42:50.752783+0000","last_became_peered":"2024-03-23T23:42:50.752783+0000","last_unstale":"2024-03-23T23:42:52.328641+0000","last_undegraded":"2024-03-23T23:42:52.328641+0000","last_fullsized":"2024-03-23T23:42:52.328641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:39:49.888359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.740061+0000","last_change":"2024-03-23T23:42:40.704046+0000","last_active":"2024-03-23T23:42:50.740061+0000","last_peered":"2024-03-23T23:42:50.740061+0000","last_clean":"2024-03-23T23:42:50.740061+0000","last_became_active":"2024-03-23T23:42:40.703787+0000","last_became_peered":"2024-03-23T23:42:40.703787+0000","last_unstale":"2024-03-23T23:42:50.740061+0000","last_undegraded":"2024-03-23T23:42:50.740061+0000","last_fullsized":"2024-03-23T23:42:50.740061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:16:16.737284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328439+0000","last_change":"2024-03-23T23:42:39.688483+0000","last_active":"2024-03-23T23:42:52.328439+0000","last_peered":"2024-03-23T23:42:52.328439+0000","last_clean":"2024-03-23T23:42:52.328439+0000","last_became_active":"2024-03-23T23:42:39.688141+0000","last_became_peered":"2024-03-23T23:42:39.688141+0000","last_unstale":"2024-03-23T23:42:52.328439+0000","last_undegraded":"2024-03-23T23:42:52.328439+0000","last_fullsized":"2024-03-23T23:42:52.328439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:32.254099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"24'6","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328127+0000","last_change":"2024-03-23T23:42:49.749027+0000","last_active":"2024-03-23T23:42:52.328127+0000","last_peered":"2024-03-23T23:42:52.328127+0000","last_clean":"2024-03-23T23:42:52.328127+0000","last_became_active":"2024-03-23T23:42:49.748687+0000","last_became_peered":"2024-03-23T23:42:49.748687+0000","last_unstale":"2024-03-23T23:42:52.328127+0000","last_undegraded":"2024-03-23T23:42:52.328127+0000","last_fullsized":"2024-03-23T23:42:52.328127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:27.818117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328083+0000","last_change":"2024-03-23T23:42:50.752273+0000","last_active":"2024-03-23T23:42:52.328083+0000","last_peered":"2024-03-23T23:42:52.328083+0000","last_clean":"2024-03-23T23:42:52.328083+0000","last_became_active":"2024-03-23T23:42:50.751874+0000","last_became_peered":"2024-03-23T23:42:50.751874+0000","last_unstale":"2024-03-23T23:42:52.328083+0000","last_undegraded":"2024-03-23T23:42:52.328083+0000","last_fullsized":"2024-03-23T23:42:52.328083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:20:53.750917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.742403+0000","last_change":"2024-03-23T23:42:40.688909+0000","last_active":"2024-03-23T23:42:50.742403+0000","last_peered":"2024-03-23T23:42:50.742403+0000","last_clean":"2024-03-23T23:42:50.742403+0000","last_became_active":"2024-03-23T23:42:40.688636+0000","last_became_peered":"2024-03-23T23:42:40.688636+0000","last_unstale":"2024-03-23T23:42:50.742403+0000","last_undegraded":"2024-03-23T23:42:50.742403+0000","last_fullsized":"2024-03-23T23:42:50.742403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:26:16.171920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.749902+0000","last_change":"2024-03-23T23:42:39.681926+0000","last_active":"2024-03-23T23:42:50.749902+0000","last_peered":"2024-03-23T23:42:50.749902+0000","last_clean":"2024-03-23T23:42:50.749902+0000","last_became_active":"2024-03-23T23:42:39.681028+0000","last_became_peered":"2024-03-23T23:42:39.681028+0000","last_unstale":"2024-03-23T23:42:50.749902+0000","last_undegraded":"2024-03-23T23:42:50.749902+0000","last_fullsized":"2024-03-23T23:42:50.749902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:24:11.933075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328871+0000","last_change":"2024-03-23T23:42:49.741915+0000","last_active":"2024-03-23T23:42:52.328871+0000","last_peered":"2024-03-23T23:42:52.328871+0000","last_clean":"2024-03-23T23:42:52.328871+0000","last_became_active":"2024-03-23T23:42:49.741650+0000","last_became_peered":"2024-03-23T23:42:49.741650+0000","last_unstale":"2024-03-23T23:42:52.328871+0000","last_undegraded":"2024-03-23T23:42:52.328871+0000","last_fullsized":"2024-03-23T23:42:52.328871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:11:43.106922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327956+0000","last_change":"2024-03-23T23:42:50.752979+0000","last_active":"2024-03-23T23:42:52.327956+0000","last_peered":"2024-03-23T23:42:52.327956+0000","last_clean":"2024-03-23T23:42:52.327956+0000","last_became_active":"2024-03-23T23:42:50.751848+0000","last_became_peered":"2024-03-23T23:42:50.751848+0000","last_unstale":"2024-03-23T23:42:52.327956+0000","last_undegraded":"2024-03-23T23:42:52.327956+0000","last_fullsized":"2024-03-23T23:42:52.327956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:39:04.727316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.742414+0000","last_change":"2024-03-23T23:42:40.689988+0000","last_active":"2024-03-23T23:42:50.742414+0000","last_peered":"2024-03-23T23:42:50.742414+0000","last_clean":"2024-03-23T23:42:50.742414+0000","last_became_active":"2024-03-23T23:42:40.689477+0000","last_became_peered":"2024-03-23T23:42:40.689477+0000","last_unstale":"2024-03-23T23:42:50.742414+0000","last_undegraded":"2024-03-23T23:42:50.742414+0000","last_fullsized":"2024-03-23T23:42:50.742414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:46:30.427072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752122+0000","last_change":"2024-03-23T23:42:39.689429+0000","last_active":"2024-03-23T23:42:51.752122+0000","last_peered":"2024-03-23T23:42:51.752122+0000","last_clean":"2024-03-23T23:42:51.752122+0000","last_became_active":"2024-03-23T23:42:39.688066+0000","last_became_peered":"2024-03-23T23:42:39.688066+0000","last_unstale":"2024-03-23T23:42:51.752122+0000","last_undegraded":"2024-03-23T23:42:51.752122+0000","last_fullsized":"2024-03-23T23:42:51.752122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:32.254099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.740679+0000","last_change":"2024-03-23T23:42:49.733543+0000","last_active":"2024-03-23T23:42:50.740679+0000","last_peered":"2024-03-23T23:42:50.740679+0000","last_clean":"2024-03-23T23:42:50.740679+0000","last_became_active":"2024-03-23T23:42:49.733197+0000","last_became_peered":"2024-03-23T23:42:49.733197+0000","last_unstale":"2024-03-23T23:42:50.740679+0000","last_undegraded":"2024-03-23T23:42:50.740679+0000","last_fullsized":"2024-03-23T23:42:50.740679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:45:20.189501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.762064+0000","last_change":"2024-03-23T23:42:50.756687+0000","last_active":"2024-03-23T23:42:50.762064+0000","last_peered":"2024-03-23T23:42:50.762064+0000","last_clean":"2024-03-23T23:42:50.762064+0000","last_became_active":"2024-03-23T23:42:50.756371+0000","last_became_peered":"2024-03-23T23:42:50.756371+0000","last_unstale":"2024-03-23T23:42:50.762064+0000","last_undegraded":"2024-03-23T23:42:50.762064+0000","last_fullsized":"2024-03-23T23:42:50.762064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:52:48.699642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752229+0000","last_change":"2024-03-23T23:42:40.683025+0000","last_active":"2024-03-23T23:42:51.752229+0000","last_peered":"2024-03-23T23:42:51.752229+0000","last_clean":"2024-03-23T23:42:51.752229+0000","last_became_active":"2024-03-23T23:42:40.682798+0000","last_became_peered":"2024-03-23T23:42:40.682798+0000","last_unstale":"2024-03-23T23:42:51.752229+0000","last_undegraded":"2024-03-23T23:42:51.752229+0000","last_fullsized":"2024-03-23T23:42:51.752229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:51.565112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.742281+0000","last_change":"2024-03-23T23:42:39.681675+0000","last_active":"2024-03-23T23:42:50.742281+0000","last_peered":"2024-03-23T23:42:50.742281+0000","last_clean":"2024-03-23T23:42:50.742281+0000","last_became_active":"2024-03-23T23:42:39.681364+0000","last_became_peered":"2024-03-23T23:42:39.681364+0000","last_unstale":"2024-03-23T23:42:50.742281+0000","last_undegraded":"2024-03-23T23:42:50.742281+0000","last_fullsized":"2024-03-23T23:42:50.742281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:42:37.702720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751398+0000","last_change":"2024-03-23T23:42:49.723350+0000","last_active":"2024-03-23T23:42:51.751398+0000","last_peered":"2024-03-23T23:42:51.751398+0000","last_clean":"2024-03-23T23:42:51.751398+0000","last_became_active":"2024-03-23T23:42:49.723058+0000","last_became_peered":"2024-03-23T23:42:49.723058+0000","last_unstale":"2024-03-23T23:42:51.751398+0000","last_undegraded":"2024-03-23T23:42:51.751398+0000","last_fullsized":"2024-03-23T23:42:51.751398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:43:02.835034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751554+0000","last_change":"2024-03-23T23:42:50.746422+0000","last_active":"2024-03-23T23:42:51.751554+0000","last_peered":"2024-03-23T23:42:51.751554+0000","last_clean":"2024-03-23T23:42:51.751554+0000","last_became_active":"2024-03-23T23:42:50.746104+0000","last_became_peered":"2024-03-23T23:42:50.746104+0000","last_unstale":"2024-03-23T23:42:51.751554+0000","last_undegraded":"2024-03-23T23:42:51.751554+0000","last_fullsized":"2024-03-23T23:42:51.751554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:40:34.077584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.752039+0000","last_change":"2024-03-23T23:42:40.700381+0000","last_active":"2024-03-23T23:42:50.752039+0000","last_peered":"2024-03-23T23:42:50.752039+0000","last_clean":"2024-03-23T23:42:50.752039+0000","last_became_active":"2024-03-23T23:42:40.698428+0000","last_became_peered":"2024-03-23T23:42:40.698428+0000","last_unstale":"2024-03-23T23:42:50.752039+0000","last_undegraded":"2024-03-23T23:42:50.752039+0000","last_fullsized":"2024-03-23T23:42:50.752039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:07:29.242921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328837+0000","last_change":"2024-03-23T23:42:39.691092+0000","last_active":"2024-03-23T23:42:52.328837+0000","last_peered":"2024-03-23T23:42:52.328837+0000","last_clean":"2024-03-23T23:42:52.328837+0000","last_became_active":"2024-03-23T23:42:39.687473+0000","last_became_peered":"2024-03-23T23:42:39.687473+0000","last_unstale":"2024-03-23T23:42:52.328837+0000","last_undegraded":"2024-03-23T23:42:52.328837+0000","last_fullsized":"2024-03-23T23:42:52.328837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:08:03.578884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327476+0000","last_change":"2024-03-23T23:42:49.748693+0000","last_active":"2024-03-23T23:42:52.327476+0000","last_peered":"2024-03-23T23:42:52.327476+0000","last_clean":"2024-03-23T23:42:52.327476+0000","last_became_active":"2024-03-23T23:42:49.748389+0000","last_became_peered":"2024-03-23T23:42:49.748389+0000","last_unstale":"2024-03-23T23:42:52.327476+0000","last_undegraded":"2024-03-23T23:42:52.327476+0000","last_fullsized":"2024-03-23T23:42:52.327476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:58:10.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.754875+0000","last_change":"2024-03-23T23:42:50.749547+0000","last_active":"2024-03-23T23:42:50.754875+0000","last_peered":"2024-03-23T23:42:50.754875+0000","last_clean":"2024-03-23T23:42:50.754875+0000","last_became_active":"2024-03-23T23:42:50.749066+0000","last_became_peered":"2024-03-23T23:42:50.749066+0000","last_unstale":"2024-03-23T23:42:50.754875+0000","last_undegraded":"2024-03-23T23:42:50.754875+0000","last_fullsized":"2024-03-23T23:42:50.754875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:52:58.565591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328727+0000","last_change":"2024-03-23T23:42:40.708795+0000","last_active":"2024-03-23T23:42:52.328727+0000","last_peered":"2024-03-23T23:42:52.328727+0000","last_clean":"2024-03-23T23:42:52.328727+0000","last_became_active":"2024-03-23T23:42:40.708199+0000","last_became_peered":"2024-03-23T23:42:40.708199+0000","last_unstale":"2024-03-23T23:42:52.328727+0000","last_undegraded":"2024-03-23T23:42:52.328727+0000","last_fullsized":"2024-03-23T23:42:52.328727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:53.782430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.753135+0000","last_change":"2024-03-23T23:42:39.684669+0000","last_active":"2024-03-23T23:42:51.753135+0000","last_peered":"2024-03-23T23:42:51.753135+0000","last_clean":"2024-03-23T23:42:51.753135+0000","last_became_active":"2024-03-23T23:42:39.684360+0000","last_became_peered":"2024-03-23T23:42:39.684360+0000","last_unstale":"2024-03-23T23:42:51.753135+0000","last_undegraded":"2024-03-23T23:42:51.753135+0000","last_fullsized":"2024-03-23T23:42:51.753135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:19.914926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327466+0000","last_change":"2024-03-23T23:42:49.741577+0000","last_active":"2024-03-23T23:42:52.327466+0000","last_peered":"2024-03-23T23:42:52.327466+0000","last_clean":"2024-03-23T23:42:52.327466+0000","last_became_active":"2024-03-23T23:42:49.741270+0000","last_became_peered":"2024-03-23T23:42:49.741270+0000","last_unstale":"2024-03-23T23:42:52.327466+0000","last_undegraded":"2024-03-23T23:42:52.327466+0000","last_fullsized":"2024-03-23T23:42:52.327466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:11:43.106922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.753001+0000","last_change":"2024-03-23T23:42:50.751992+0000","last_active":"2024-03-23T23:42:51.753001+0000","last_peered":"2024-03-23T23:42:51.753001+0000","last_clean":"2024-03-23T23:42:51.753001+0000","last_became_active":"2024-03-23T23:42:50.748281+0000","last_became_peered":"2024-03-23T23:42:50.748281+0000","last_unstale":"2024-03-23T23:42:51.753001+0000","last_undegraded":"2024-03-23T23:42:51.753001+0000","last_fullsized":"2024-03-23T23:42:51.753001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:57.968968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.772193+0000","last_change":"2024-03-23T23:42:49.741658+0000","last_active":"2024-03-23T23:42:50.772193+0000","last_peered":"2024-03-23T23:42:50.772193+0000","last_clean":"2024-03-23T23:42:50.772193+0000","last_became_active":"2024-03-23T23:42:49.740899+0000","last_became_peered":"2024-03-23T23:42:49.740899+0000","last_unstale":"2024-03-23T23:42:50.772193+0000","last_undegraded":"2024-03-23T23:42:50.772193+0000","last_fullsized":"2024-03-23T23:42:50.772193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:45:20.189501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.740195+0000","last_change":"2024-03-23T23:42:40.679384+0000","last_active":"2024-03-23T23:42:50.740195+0000","last_peered":"2024-03-23T23:42:50.740195+0000","last_clean":"2024-03-23T23:42:50.740195+0000","last_became_active":"2024-03-23T23:42:40.679070+0000","last_became_peered":"2024-03-23T23:42:40.679070+0000","last_unstale":"2024-03-23T23:42:50.740195+0000","last_undegraded":"2024-03-23T23:42:50.740195+0000","last_fullsized":"2024-03-23T23:42:50.740195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:26:16.171920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328187+0000","last_change":"2024-03-23T23:42:39.682839+0000","last_active":"2024-03-23T23:42:52.328187+0000","last_peered":"2024-03-23T23:42:52.328187+0000","last_clean":"2024-03-23T23:42:52.328187+0000","last_became_active":"2024-03-23T23:42:39.682584+0000","last_became_peered":"2024-03-23T23:42:39.682584+0000","last_unstale":"2024-03-23T23:42:52.328187+0000","last_undegraded":"2024-03-23T23:42:52.328187+0000","last_fullsized":"2024-03-23T23:42:52.328187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:19.914926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.754651+0000","last_change":"2024-03-23T23:42:50.752596+0000","last_active":"2024-03-23T23:42:50.754651+0000","last_peered":"2024-03-23T23:42:50.754651+0000","last_clean":"2024-03-23T23:42:50.754651+0000","last_became_active":"2024-03-23T23:42:50.751598+0000","last_became_peered":"2024-03-23T23:42:50.751598+0000","last_unstale":"2024-03-23T23:42:50.754651+0000","last_undegraded":"2024-03-23T23:42:50.754651+0000","last_fullsized":"2024-03-23T23:42:50.754651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:45:20.249866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.753080+0000","last_change":"2024-03-23T23:42:49.734629+0000","last_active":"2024-03-23T23:42:51.753080+0000","last_peered":"2024-03-23T23:42:51.753080+0000","last_clean":"2024-03-23T23:42:51.753080+0000","last_became_active":"2024-03-23T23:42:49.734309+0000","last_became_peered":"2024-03-23T23:42:49.734309+0000","last_unstale":"2024-03-23T23:42:51.753080+0000","last_undegraded":"2024-03-23T23:42:51.753080+0000","last_fullsized":"2024-03-23T23:42:51.753080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:46.760020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327687+0000","last_change":"2024-03-23T23:42:40.674605+0000","last_active":"2024-03-23T23:42:52.327687+0000","last_peered":"2024-03-23T23:42:52.327687+0000","last_clean":"2024-03-23T23:42:52.327687+0000","last_became_active":"2024-03-23T23:42:40.674366+0000","last_became_peered":"2024-03-23T23:42:40.674366+0000","last_unstale":"2024-03-23T23:42:52.327687+0000","last_undegraded":"2024-03-23T23:42:52.327687+0000","last_fullsized":"2024-03-23T23:42:52.327687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327666+0000","last_change":"2024-03-23T23:42:39.688646+0000","last_active":"2024-03-23T23:42:52.327666+0000","last_peered":"2024-03-23T23:42:52.327666+0000","last_clean":"2024-03-23T23:42:52.327666+0000","last_became_active":"2024-03-23T23:42:39.687489+0000","last_became_peered":"2024-03-23T23:42:39.687489+0000","last_unstale":"2024-03-23T23:42:52.327666+0000","last_undegraded":"2024-03-23T23:42:52.327666+0000","last_fullsized":"2024-03-23T23:42:52.327666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:07:12.649156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.760829+0000","last_change":"2024-03-23T23:42:50.748511+0000","last_active":"2024-03-23T23:42:50.760829+0000","last_peered":"2024-03-23T23:42:50.760829+0000","last_clean":"2024-03-23T23:42:50.760829+0000","last_became_active":"2024-03-23T23:42:50.747154+0000","last_became_peered":"2024-03-23T23:42:50.747154+0000","last_unstale":"2024-03-23T23:42:50.760829+0000","last_undegraded":"2024-03-23T23:42:50.760829+0000","last_fullsized":"2024-03-23T23:42:50.760829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:45:20.249866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751549+0000","last_change":"2024-03-23T23:42:39.681458+0000","last_active":"2024-03-23T23:42:51.751549+0000","last_peered":"2024-03-23T23:42:51.751549+0000","last_clean":"2024-03-23T23:42:51.751549+0000","last_became_active":"2024-03-23T23:42:39.681158+0000","last_became_peered":"2024-03-23T23:42:39.681158+0000","last_unstale":"2024-03-23T23:42:51.751549+0000","last_undegraded":"2024-03-23T23:42:51.751549+0000","last_fullsized":"2024-03-23T23:42:51.751549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:08:03.578884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.749806+0000","last_change":"2024-03-23T23:42:40.676571+0000","last_active":"2024-03-23T23:42:50.749806+0000","last_peered":"2024-03-23T23:42:50.749806+0000","last_clean":"2024-03-23T23:42:50.749806+0000","last_became_active":"2024-03-23T23:42:40.675877+0000","last_became_peered":"2024-03-23T23:42:40.675877+0000","last_unstale":"2024-03-23T23:42:50.749806+0000","last_undegraded":"2024-03-23T23:42:50.749806+0000","last_fullsized":"2024-03-23T23:42:50.749806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:52.220411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.773575+0000","last_change":"2024-03-23T23:42:49.734208+0000","last_active":"2024-03-23T23:42:50.773575+0000","last_peered":"2024-03-23T23:42:50.773575+0000","last_clean":"2024-03-23T23:42:50.773575+0000","last_became_active":"2024-03-23T23:42:49.732943+0000","last_became_peered":"2024-03-23T23:42:49.732943+0000","last_unstale":"2024-03-23T23:42:50.773575+0000","last_undegraded":"2024-03-23T23:42:50.773575+0000","last_fullsized":"2024-03-23T23:42:50.773575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:43.683275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751832+0000","last_change":"2024-03-23T23:42:50.752722+0000","last_active":"2024-03-23T23:42:51.751832+0000","last_peered":"2024-03-23T23:42:51.751832+0000","last_clean":"2024-03-23T23:42:51.751832+0000","last_became_active":"2024-03-23T23:42:50.749400+0000","last_became_peered":"2024-03-23T23:42:50.749400+0000","last_unstale":"2024-03-23T23:42:51.751832+0000","last_undegraded":"2024-03-23T23:42:51.751832+0000","last_fullsized":"2024-03-23T23:42:51.751832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:16:44.027189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328094+0000","last_change":"2024-03-23T23:42:39.688422+0000","last_active":"2024-03-23T23:42:52.328094+0000","last_peered":"2024-03-23T23:42:52.328094+0000","last_clean":"2024-03-23T23:42:52.328094+0000","last_became_active":"2024-03-23T23:42:39.687423+0000","last_became_peered":"2024-03-23T23:42:39.687423+0000","last_unstale":"2024-03-23T23:42:52.328094+0000","last_undegraded":"2024-03-23T23:42:52.328094+0000","last_fullsized":"2024-03-23T23:42:52.328094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:20:38.456655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751184+0000","last_change":"2024-03-23T23:42:40.680801+0000","last_active":"2024-03-23T23:42:51.751184+0000","last_peered":"2024-03-23T23:42:51.751184+0000","last_clean":"2024-03-23T23:42:51.751184+0000","last_became_active":"2024-03-23T23:42:40.680511+0000","last_became_peered":"2024-03-23T23:42:40.680511+0000","last_unstale":"2024-03-23T23:42:51.751184+0000","last_undegraded":"2024-03-23T23:42:51.751184+0000","last_fullsized":"2024-03-23T23:42:51.751184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:27:42.392714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328321+0000","last_change":"2024-03-23T23:42:49.751291+0000","last_active":"2024-03-23T23:42:52.328321+0000","last_peered":"2024-03-23T23:42:52.328321+0000","last_clean":"2024-03-23T23:42:52.328321+0000","last_became_active":"2024-03-23T23:42:49.749695+0000","last_became_peered":"2024-03-23T23:42:49.749695+0000","last_unstale":"2024-03-23T23:42:52.328321+0000","last_undegraded":"2024-03-23T23:42:52.328321+0000","last_fullsized":"2024-03-23T23:42:52.328321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:40:33.073029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328522+0000","last_change":"2024-03-23T23:42:50.752672+0000","last_active":"2024-03-23T23:42:52.328522+0000","last_peered":"2024-03-23T23:42:52.328522+0000","last_clean":"2024-03-23T23:42:52.328522+0000","last_became_active":"2024-03-23T23:42:50.752394+0000","last_became_peered":"2024-03-23T23:42:50.752394+0000","last_unstale":"2024-03-23T23:42:52.328522+0000","last_undegraded":"2024-03-23T23:42:52.328522+0000","last_fullsized":"2024-03-23T23:42:52.328522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:51:01.385876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750919+0000","last_change":"2024-03-23T23:42:40.679042+0000","last_active":"2024-03-23T23:42:51.750919+0000","last_peered":"2024-03-23T23:42:51.750919+0000","last_clean":"2024-03-23T23:42:51.750919+0000","last_became_active":"2024-03-23T23:42:40.678518+0000","last_became_peered":"2024-03-23T23:42:40.678518+0000","last_unstale":"2024-03-23T23:42:51.750919+0000","last_undegraded":"2024-03-23T23:42:51.750919+0000","last_fullsized":"2024-03-23T23:42:51.750919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:12:14.359173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.761949+0000","last_change":"2024-03-23T23:42:50.757132+0000","last_active":"2024-03-23T23:42:50.761949+0000","last_peered":"2024-03-23T23:42:50.761949+0000","last_clean":"2024-03-23T23:42:50.761949+0000","last_became_active":"2024-03-23T23:42:50.756813+0000","last_became_peered":"2024-03-23T23:42:50.756813+0000","last_unstale":"2024-03-23T23:42:50.761949+0000","last_undegraded":"2024-03-23T23:42:50.761949+0000","last_fullsized":"2024-03-23T23:42:50.761949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:37:19.741781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.739000+0000","last_change":"2024-03-23T23:42:40.702411+0000","last_active":"2024-03-23T23:42:50.739000+0000","last_peered":"2024-03-23T23:42:50.739000+0000","last_clean":"2024-03-23T23:42:50.739000+0000","last_became_active":"2024-03-23T23:42:40.701398+0000","last_became_peered":"2024-03-23T23:42:40.701398+0000","last_unstale":"2024-03-23T23:42:50.739000+0000","last_undegraded":"2024-03-23T23:42:50.739000+0000","last_fullsized":"2024-03-23T23:42:50.739000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:03.196963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328386+0000","last_change":"2024-03-23T23:42:50.756769+0000","last_active":"2024-03-23T23:42:52.328386+0000","last_peered":"2024-03-23T23:42:52.328386+0000","last_clean":"2024-03-23T23:42:52.328386+0000","last_became_active":"2024-03-23T23:42:50.756503+0000","last_became_peered":"2024-03-23T23:42:50.756503+0000","last_unstale":"2024-03-23T23:42:52.328386+0000","last_undegraded":"2024-03-23T23:42:52.328386+0000","last_fullsized":"2024-03-23T23:42:52.328386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:50.597847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328394+0000","last_change":"2024-03-23T23:42:40.698519+0000","last_active":"2024-03-23T23:42:52.328394+0000","last_peered":"2024-03-23T23:42:52.328394+0000","last_clean":"2024-03-23T23:42:52.328394+0000","last_became_active":"2024-03-23T23:42:40.695218+0000","last_became_peered":"2024-03-23T23:42:40.695218+0000","last_unstale":"2024-03-23T23:42:52.328394+0000","last_undegraded":"2024-03-23T23:42:52.328394+0000","last_fullsized":"2024-03-23T23:42:52.328394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:00:54.983365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.760851+0000","last_change":"2024-03-23T23:42:50.748726+0000","last_active":"2024-03-23T23:42:50.760851+0000","last_peered":"2024-03-23T23:42:50.760851+0000","last_clean":"2024-03-23T23:42:50.760851+0000","last_became_active":"2024-03-23T23:42:50.748105+0000","last_became_peered":"2024-03-23T23:42:50.748105+0000","last_unstale":"2024-03-23T23:42:50.760851+0000","last_undegraded":"2024-03-23T23:42:50.760851+0000","last_fullsized":"2024-03-23T23:42:50.760851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:33:43.235051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.749718+0000","last_change":"2024-03-23T23:42:40.673293+0000","last_active":"2024-03-23T23:42:50.749718+0000","last_peered":"2024-03-23T23:42:50.749718+0000","last_clean":"2024-03-23T23:42:50.749718+0000","last_became_active":"2024-03-23T23:42:40.672910+0000","last_became_peered":"2024-03-23T23:42:40.672910+0000","last_unstale":"2024-03-23T23:42:50.749718+0000","last_undegraded":"2024-03-23T23:42:50.749718+0000","last_fullsized":"2024-03-23T23:42:50.749718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:42:14.952953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.756995+0000","last_change":"2024-03-23T23:42:50.750291+0000","last_active":"2024-03-23T23:42:50.756995+0000","last_peered":"2024-03-23T23:42:50.756995+0000","last_clean":"2024-03-23T23:42:50.756995+0000","last_became_active":"2024-03-23T23:42:50.749908+0000","last_became_peered":"2024-03-23T23:42:50.749908+0000","last_unstale":"2024-03-23T23:42:50.756995+0000","last_undegraded":"2024-03-23T23:42:50.756995+0000","last_fullsized":"2024-03-23T23:42:50.756995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:45:20.249866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328216+0000","last_change":"2024-03-23T23:42:40.685370+0000","last_active":"2024-03-23T23:42:52.328216+0000","last_peered":"2024-03-23T23:42:52.328216+0000","last_clean":"2024-03-23T23:42:52.328216+0000","last_became_active":"2024-03-23T23:42:40.685120+0000","last_became_peered":"2024-03-23T23:42:40.685120+0000","last_unstale":"2024-03-23T23:42:52.328216+0000","last_undegraded":"2024-03-23T23:42:52.328216+0000","last_fullsized":"2024-03-23T23:42:52.328216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751268+0000","last_change":"2024-03-23T23:42:50.747361+0000","last_active":"2024-03-23T23:42:51.751268+0000","last_peered":"2024-03-23T23:42:51.751268+0000","last_clean":"2024-03-23T23:42:51.751268+0000","last_became_active":"2024-03-23T23:42:50.746310+0000","last_became_peered":"2024-03-23T23:42:50.746310+0000","last_unstale":"2024-03-23T23:42:51.751268+0000","last_undegraded":"2024-03-23T23:42:51.751268+0000","last_fullsized":"2024-03-23T23:42:51.751268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:57.968968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.742173+0000","last_change":"2024-03-23T23:42:40.677168+0000","last_active":"2024-03-23T23:42:50.742173+0000","last_peered":"2024-03-23T23:42:50.742173+0000","last_clean":"2024-03-23T23:42:50.742173+0000","last_became_active":"2024-03-23T23:42:40.676912+0000","last_became_peered":"2024-03-23T23:42:40.676912+0000","last_unstale":"2024-03-23T23:42:50.742173+0000","last_undegraded":"2024-03-23T23:42:50.742173+0000","last_fullsized":"2024-03-23T23:42:50.742173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:17:19.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.754854+0000","last_change":"2024-03-23T23:42:50.749305+0000","last_active":"2024-03-23T23:42:50.754854+0000","last_peered":"2024-03-23T23:42:50.754854+0000","last_clean":"2024-03-23T23:42:50.754854+0000","last_became_active":"2024-03-23T23:42:50.748798+0000","last_became_peered":"2024-03-23T23:42:50.748798+0000","last_unstale":"2024-03-23T23:42:50.754854+0000","last_undegraded":"2024-03-23T23:42:50.754854+0000","last_fullsized":"2024-03-23T23:42:50.754854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:18:14.001647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752528+0000","last_change":"2024-03-23T23:42:40.694420+0000","last_active":"2024-03-23T23:42:51.752528+0000","last_peered":"2024-03-23T23:42:51.752528+0000","last_clean":"2024-03-23T23:42:51.752528+0000","last_became_active":"2024-03-23T23:42:40.693867+0000","last_became_peered":"2024-03-23T23:42:40.693867+0000","last_unstale":"2024-03-23T23:42:51.752528+0000","last_undegraded":"2024-03-23T23:42:51.752528+0000","last_fullsized":"2024-03-23T23:42:51.752528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:54.557634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751411+0000","last_change":"2024-03-23T23:42:50.754149+0000","last_active":"2024-03-23T23:42:51.751411+0000","last_peered":"2024-03-23T23:42:51.751411+0000","last_clean":"2024-03-23T23:42:51.751411+0000","last_became_active":"2024-03-23T23:42:50.753471+0000","last_became_peered":"2024-03-23T23:42:50.753471+0000","last_unstale":"2024-03-23T23:42:51.751411+0000","last_undegraded":"2024-03-23T23:42:51.751411+0000","last_fullsized":"2024-03-23T23:42:51.751411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:28.822672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328282+0000","last_change":"2024-03-23T23:42:40.685177+0000","last_active":"2024-03-23T23:42:52.328282+0000","last_peered":"2024-03-23T23:42:52.328282+0000","last_clean":"2024-03-23T23:42:52.328282+0000","last_became_active":"2024-03-23T23:42:40.684495+0000","last_became_peered":"2024-03-23T23:42:40.684495+0000","last_unstale":"2024-03-23T23:42:52.328282+0000","last_undegraded":"2024-03-23T23:42:52.328282+0000","last_fullsized":"2024-03-23T23:42:52.328282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:27.675824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328493+0000","last_change":"2024-03-23T23:42:50.746438+0000","last_active":"2024-03-23T23:42:52.328493+0000","last_peered":"2024-03-23T23:42:52.328493+0000","last_clean":"2024-03-23T23:42:52.328493+0000","last_became_active":"2024-03-23T23:42:50.745771+0000","last_became_peered":"2024-03-23T23:42:50.745771+0000","last_unstale":"2024-03-23T23:42:52.328493+0000","last_undegraded":"2024-03-23T23:42:52.328493+0000","last_fullsized":"2024-03-23T23:42:52.328493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:22:17.484059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328084+0000","last_change":"2024-03-23T23:42:40.701852+0000","last_active":"2024-03-23T23:42:52.328084+0000","last_peered":"2024-03-23T23:42:52.328084+0000","last_clean":"2024-03-23T23:42:52.328084+0000","last_became_active":"2024-03-23T23:42:40.701566+0000","last_became_peered":"2024-03-23T23:42:40.701566+0000","last_unstale":"2024-03-23T23:42:52.328084+0000","last_undegraded":"2024-03-23T23:42:52.328084+0000","last_fullsized":"2024-03-23T23:42:52.328084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.764721+0000","last_change":"2024-03-23T23:42:50.758879+0000","last_active":"2024-03-23T23:42:50.764721+0000","last_peered":"2024-03-23T23:42:50.764721+0000","last_clean":"2024-03-23T23:42:50.764721+0000","last_became_active":"2024-03-23T23:42:50.758564+0000","last_became_peered":"2024-03-23T23:42:50.758564+0000","last_unstale":"2024-03-23T23:42:50.764721+0000","last_undegraded":"2024-03-23T23:42:50.764721+0000","last_fullsized":"2024-03-23T23:42:50.764721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:48:24.982671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327548+0000","last_change":"2024-03-23T23:42:40.684899+0000","last_active":"2024-03-23T23:42:52.327548+0000","last_peered":"2024-03-23T23:42:52.327548+0000","last_clean":"2024-03-23T23:42:52.327548+0000","last_became_active":"2024-03-23T23:42:40.684603+0000","last_became_peered":"2024-03-23T23:42:40.684603+0000","last_unstale":"2024-03-23T23:42:52.327548+0000","last_undegraded":"2024-03-23T23:42:52.327548+0000","last_fullsized":"2024-03-23T23:42:52.327548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:54.557634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.768920+0000","last_change":"2024-03-23T23:42:50.754096+0000","last_active":"2024-03-23T23:42:50.768920+0000","last_peered":"2024-03-23T23:42:50.768920+0000","last_clean":"2024-03-23T23:42:50.768920+0000","last_became_active":"2024-03-23T23:42:50.753602+0000","last_became_peered":"2024-03-23T23:42:50.753602+0000","last_unstale":"2024-03-23T23:42:50.768920+0000","last_undegraded":"2024-03-23T23:42:50.768920+0000","last_fullsized":"2024-03-23T23:42:50.768920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:42:25.010112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328338+0000","last_change":"2024-03-23T23:42:40.707800+0000","last_active":"2024-03-23T23:42:52.328338+0000","last_peered":"2024-03-23T23:42:52.328338+0000","last_clean":"2024-03-23T23:42:52.328338+0000","last_became_active":"2024-03-23T23:42:40.707528+0000","last_became_peered":"2024-03-23T23:42:40.707528+0000","last_unstale":"2024-03-23T23:42:52.328338+0000","last_undegraded":"2024-03-23T23:42:52.328338+0000","last_fullsized":"2024-03-23T23:42:52.328338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:03:24.275154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328659+0000","last_change":"2024-03-23T23:42:50.741324+0000","last_active":"2024-03-23T23:42:52.328659+0000","last_peered":"2024-03-23T23:42:52.328659+0000","last_clean":"2024-03-23T23:42:52.328659+0000","last_became_active":"2024-03-23T23:42:50.741065+0000","last_became_peered":"2024-03-23T23:42:50.741065+0000","last_unstale":"2024-03-23T23:42:52.328659+0000","last_undegraded":"2024-03-23T23:42:52.328659+0000","last_fullsized":"2024-03-23T23:42:52.328659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:13.911327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.749612+0000","last_change":"2024-03-23T23:42:40.689122+0000","last_active":"2024-03-23T23:42:50.749612+0000","last_peered":"2024-03-23T23:42:50.749612+0000","last_clean":"2024-03-23T23:42:50.749612+0000","last_became_active":"2024-03-23T23:42:40.688875+0000","last_became_peered":"2024-03-23T23:42:40.688875+0000","last_unstale":"2024-03-23T23:42:50.749612+0000","last_undegraded":"2024-03-23T23:42:50.749612+0000","last_fullsized":"2024-03-23T23:42:50.749612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:27:03.132032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750979+0000","last_change":"2024-03-23T23:42:50.762055+0000","last_active":"2024-03-23T23:42:51.750979+0000","last_peered":"2024-03-23T23:42:51.750979+0000","last_clean":"2024-03-23T23:42:51.750979+0000","last_became_active":"2024-03-23T23:42:50.761762+0000","last_became_peered":"2024-03-23T23:42:50.761762+0000","last_unstale":"2024-03-23T23:42:51.750979+0000","last_undegraded":"2024-03-23T23:42:51.750979+0000","last_fullsized":"2024-03-23T23:42:51.750979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:28.822672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752195+0000","last_change":"2024-03-23T23:42:40.683701+0000","last_active":"2024-03-23T23:42:51.752195+0000","last_peered":"2024-03-23T23:42:51.752195+0000","last_clean":"2024-03-23T23:42:51.752195+0000","last_became_active":"2024-03-23T23:42:40.683377+0000","last_became_peered":"2024-03-23T23:42:40.683377+0000","last_unstale":"2024-03-23T23:42:51.752195+0000","last_undegraded":"2024-03-23T23:42:51.752195+0000","last_fullsized":"2024-03-23T23:42:51.752195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751120+0000","last_change":"2024-03-23T23:42:50.754372+0000","last_active":"2024-03-23T23:42:51.751120+0000","last_peered":"2024-03-23T23:42:51.751120+0000","last_clean":"2024-03-23T23:42:51.751120+0000","last_became_active":"2024-03-23T23:42:50.754072+0000","last_became_peered":"2024-03-23T23:42:50.754072+0000","last_unstale":"2024-03-23T23:42:51.751120+0000","last_undegraded":"2024-03-23T23:42:51.751120+0000","last_fullsized":"2024-03-23T23:42:51.751120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:40:34.077584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.742679+0000","last_change":"2024-03-23T23:42:40.689769+0000","last_active":"2024-03-23T23:42:50.742679+0000","last_peered":"2024-03-23T23:42:50.742679+0000","last_clean":"2024-03-23T23:42:50.742679+0000","last_became_active":"2024-03-23T23:42:40.689111+0000","last_became_peered":"2024-03-23T23:42:40.689111+0000","last_unstale":"2024-03-23T23:42:50.742679+0000","last_undegraded":"2024-03-23T23:42:50.742679+0000","last_fullsized":"2024-03-23T23:42:50.742679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:40:22.690954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328020+0000","last_change":"2024-03-23T23:42:50.759792+0000","last_active":"2024-03-23T23:42:52.328020+0000","last_peered":"2024-03-23T23:42:52.328020+0000","last_clean":"2024-03-23T23:42:52.328020+0000","last_became_active":"2024-03-23T23:42:50.759604+0000","last_became_peered":"2024-03-23T23:42:50.759604+0000","last_unstale":"2024-03-23T23:42:52.328020+0000","last_undegraded":"2024-03-23T23:42:52.328020+0000","last_fullsized":"2024-03-23T23:42:52.328020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:15:25.617521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.743589+0000","last_change":"2024-03-23T23:42:40.690961+0000","last_active":"2024-03-23T23:42:50.743589+0000","last_peered":"2024-03-23T23:42:50.743589+0000","last_clean":"2024-03-23T23:42:50.743589+0000","last_became_active":"2024-03-23T23:42:40.690690+0000","last_became_peered":"2024-03-23T23:42:40.690690+0000","last_unstale":"2024-03-23T23:42:50.743589+0000","last_undegraded":"2024-03-23T23:42:50.743589+0000","last_fullsized":"2024-03-23T23:42:50.743589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:56.763759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.771958+0000","last_change":"2024-03-23T23:42:50.764821+0000","last_active":"2024-03-23T23:42:50.771958+0000","last_peered":"2024-03-23T23:42:50.771958+0000","last_clean":"2024-03-23T23:42:50.771958+0000","last_became_active":"2024-03-23T23:42:50.764563+0000","last_became_peered":"2024-03-23T23:42:50.764563+0000","last_unstale":"2024-03-23T23:42:50.771958+0000","last_undegraded":"2024-03-23T23:42:50.771958+0000","last_fullsized":"2024-03-23T23:42:50.771958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:49:43.793847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.329026+0000","last_change":"2024-03-23T23:42:40.708540+0000","last_active":"2024-03-23T23:42:52.329026+0000","last_peered":"2024-03-23T23:42:52.329026+0000","last_clean":"2024-03-23T23:42:52.329026+0000","last_became_active":"2024-03-23T23:42:40.708031+0000","last_became_peered":"2024-03-23T23:42:40.708031+0000","last_unstale":"2024-03-23T23:42:52.329026+0000","last_undegraded":"2024-03-23T23:42:52.329026+0000","last_fullsized":"2024-03-23T23:42:52.329026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:44:03.386124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.772911+0000","last_change":"2024-03-23T23:42:50.771062+0000","last_active":"2024-03-23T23:42:50.772911+0000","last_peered":"2024-03-23T23:42:50.772911+0000","last_clean":"2024-03-23T23:42:50.772911+0000","last_became_active":"2024-03-23T23:42:50.770790+0000","last_became_peered":"2024-03-23T23:42:50.770790+0000","last_unstale":"2024-03-23T23:42:50.772911+0000","last_undegraded":"2024-03-23T23:42:50.772911+0000","last_fullsized":"2024-03-23T23:42:50.772911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:53:30.020477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328080+0000","last_change":"2024-03-23T23:42:40.697920+0000","last_active":"2024-03-23T23:42:52.328080+0000","last_peered":"2024-03-23T23:42:52.328080+0000","last_clean":"2024-03-23T23:42:52.328080+0000","last_became_active":"2024-03-23T23:42:40.697694+0000","last_became_peered":"2024-03-23T23:42:40.697694+0000","last_unstale":"2024-03-23T23:42:52.328080+0000","last_undegraded":"2024-03-23T23:42:52.328080+0000","last_fullsized":"2024-03-23T23:42:52.328080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752567+0000","last_change":"2024-03-23T23:42:50.751694+0000","last_active":"2024-03-23T23:42:51.752567+0000","last_peered":"2024-03-23T23:42:51.752567+0000","last_clean":"2024-03-23T23:42:51.752567+0000","last_became_active":"2024-03-23T23:42:50.751452+0000","last_became_peered":"2024-03-23T23:42:50.751452+0000","last_unstale":"2024-03-23T23:42:51.752567+0000","last_undegraded":"2024-03-23T23:42:51.752567+0000","last_fullsized":"2024-03-23T23:42:51.752567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:57:49.981068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.740303+0000","last_change":"2024-03-23T23:42:40.681928+0000","last_active":"2024-03-23T23:42:50.740303+0000","last_peered":"2024-03-23T23:42:50.740303+0000","last_clean":"2024-03-23T23:42:50.740303+0000","last_became_active":"2024-03-23T23:42:40.681337+0000","last_became_peered":"2024-03-23T23:42:40.681337+0000","last_unstale":"2024-03-23T23:42:50.740303+0000","last_undegraded":"2024-03-23T23:42:50.740303+0000","last_fullsized":"2024-03-23T23:42:50.740303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:52.220411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328332+0000","last_change":"2024-03-23T23:42:50.769003+0000","last_active":"2024-03-23T23:42:52.328332+0000","last_peered":"2024-03-23T23:42:52.328332+0000","last_clean":"2024-03-23T23:42:52.328332+0000","last_became_active":"2024-03-23T23:42:50.768695+0000","last_became_peered":"2024-03-23T23:42:50.768695+0000","last_unstale":"2024-03-23T23:42:52.328332+0000","last_undegraded":"2024-03-23T23:42:52.328332+0000","last_fullsized":"2024-03-23T23:42:52.328332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:17:11.847056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.742400+0000","last_change":"2024-03-23T23:42:40.680934+0000","last_active":"2024-03-23T23:42:50.742400+0000","last_peered":"2024-03-23T23:42:50.742400+0000","last_clean":"2024-03-23T23:42:50.742400+0000","last_became_active":"2024-03-23T23:42:40.680643+0000","last_became_peered":"2024-03-23T23:42:40.680643+0000","last_unstale":"2024-03-23T23:42:50.742400+0000","last_undegraded":"2024-03-23T23:42:50.742400+0000","last_fullsized":"2024-03-23T23:42:50.742400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:34.630671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.769267+0000","last_change":"2024-03-23T23:42:50.762401+0000","last_active":"2024-03-23T23:42:50.769267+0000","last_peered":"2024-03-23T23:42:50.769267+0000","last_clean":"2024-03-23T23:42:50.769267+0000","last_became_active":"2024-03-23T23:42:50.762183+0000","last_became_peered":"2024-03-23T23:42:50.762183+0000","last_unstale":"2024-03-23T23:42:50.769267+0000","last_undegraded":"2024-03-23T23:42:50.769267+0000","last_fullsized":"2024-03-23T23:42:50.769267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:52:48.699642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327888+0000","last_change":"2024-03-23T23:42:40.682736+0000","last_active":"2024-03-23T23:42:52.327888+0000","last_peered":"2024-03-23T23:42:52.327888+0000","last_clean":"2024-03-23T23:42:52.327888+0000","last_became_active":"2024-03-23T23:42:40.682410+0000","last_became_peered":"2024-03-23T23:42:40.682410+0000","last_unstale":"2024-03-23T23:42:52.327888+0000","last_undegraded":"2024-03-23T23:42:52.327888+0000","last_fullsized":"2024-03-23T23:42:52.327888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:01:06.338641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327793+0000","last_change":"2024-03-23T23:42:50.749204+0000","last_active":"2024-03-23T23:42:52.327793+0000","last_peered":"2024-03-23T23:42:52.327793+0000","last_clean":"2024-03-23T23:42:52.327793+0000","last_became_active":"2024-03-23T23:42:50.748809+0000","last_became_peered":"2024-03-23T23:42:50.748809+0000","last_unstale":"2024-03-23T23:42:52.327793+0000","last_undegraded":"2024-03-23T23:42:52.327793+0000","last_fullsized":"2024-03-23T23:42:52.327793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:39:49.888359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752151+0000","last_change":"2024-03-23T23:42:40.682523+0000","last_active":"2024-03-23T23:42:51.752151+0000","last_peered":"2024-03-23T23:42:51.752151+0000","last_clean":"2024-03-23T23:42:51.752151+0000","last_became_active":"2024-03-23T23:42:40.682155+0000","last_became_peered":"2024-03-23T23:42:40.682155+0000","last_unstale":"2024-03-23T23:42:51.752151+0000","last_undegraded":"2024-03-23T23:42:51.752151+0000","last_fullsized":"2024-03-23T23:42:51.752151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:33.260151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.758828+0000","last_change":"2024-03-23T23:42:50.746115+0000","last_active":"2024-03-23T23:42:50.758828+0000","last_peered":"2024-03-23T23:42:50.758828+0000","last_clean":"2024-03-23T23:42:50.758828+0000","last_became_active":"2024-03-23T23:42:50.745858+0000","last_became_peered":"2024-03-23T23:42:50.745858+0000","last_unstale":"2024-03-23T23:42:50.758828+0000","last_undegraded":"2024-03-23T23:42:50.758828+0000","last_fullsized":"2024-03-23T23:42:50.758828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:07:39.300081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752280+0000","last_change":"2024-03-23T23:42:40.702089+0000","last_active":"2024-03-23T23:42:51.752280+0000","last_peered":"2024-03-23T23:42:51.752280+0000","last_clean":"2024-03-23T23:42:51.752280+0000","last_became_active":"2024-03-23T23:42:40.701874+0000","last_became_peered":"2024-03-23T23:42:40.701874+0000","last_unstale":"2024-03-23T23:42:51.752280+0000","last_undegraded":"2024-03-23T23:42:51.752280+0000","last_fullsized":"2024-03-23T23:42:51.752280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.777180+0000","last_change":"2024-03-23T23:42:50.773115+0000","last_active":"2024-03-23T23:42:50.777180+0000","last_peered":"2024-03-23T23:42:50.777180+0000","last_clean":"2024-03-23T23:42:50.777180+0000","last_became_active":"2024-03-23T23:42:50.772849+0000","last_became_peered":"2024-03-23T23:42:50.772849+0000","last_unstale":"2024-03-23T23:42:50.777180+0000","last_undegraded":"2024-03-23T23:42:50.777180+0000","last_fullsized":"2024-03-23T23:42:50.777180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:53:30.020477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752487+0000","last_change":"2024-03-23T23:42:40.703254+0000","last_active":"2024-03-23T23:42:51.752487+0000","last_peered":"2024-03-23T23:42:51.752487+0000","last_clean":"2024-03-23T23:42:51.752487+0000","last_became_active":"2024-03-23T23:42:40.702447+0000","last_became_peered":"2024-03-23T23:42:40.702447+0000","last_unstale":"2024-03-23T23:42:51.752487+0000","last_undegraded":"2024-03-23T23:42:51.752487+0000","last_fullsized":"2024-03-23T23:42:51.752487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:59:45.154553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328157+0000","last_change":"2024-03-23T23:42:50.748946+0000","last_active":"2024-03-23T23:42:52.328157+0000","last_peered":"2024-03-23T23:42:52.328157+0000","last_clean":"2024-03-23T23:42:52.328157+0000","last_became_active":"2024-03-23T23:42:50.745205+0000","last_became_peered":"2024-03-23T23:42:50.745205+0000","last_unstale":"2024-03-23T23:42:52.328157+0000","last_undegraded":"2024-03-23T23:42:52.328157+0000","last_fullsized":"2024-03-23T23:42:52.328157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:58:16.372010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.744079+0000","last_change":"2024-03-23T23:42:40.714331+0000","last_active":"2024-03-23T23:42:50.744079+0000","last_peered":"2024-03-23T23:42:50.744079+0000","last_clean":"2024-03-23T23:42:50.744079+0000","last_became_active":"2024-03-23T23:42:40.713737+0000","last_became_peered":"2024-03-23T23:42:40.713737+0000","last_unstale":"2024-03-23T23:42:50.744079+0000","last_undegraded":"2024-03-23T23:42:50.744079+0000","last_fullsized":"2024-03-23T23:42:50.744079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:24:43.902129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328361+0000","last_change":"2024-03-23T23:42:50.746666+0000","last_active":"2024-03-23T23:42:52.328361+0000","last_peered":"2024-03-23T23:42:52.328361+0000","last_clean":"2024-03-23T23:42:52.328361+0000","last_became_active":"2024-03-23T23:42:50.746149+0000","last_became_peered":"2024-03-23T23:42:50.746149+0000","last_unstale":"2024-03-23T23:42:52.328361+0000","last_undegraded":"2024-03-23T23:42:52.328361+0000","last_fullsized":"2024-03-23T23:42:52.328361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:42:58.533499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327499+0000","last_change":"2024-03-23T23:42:40.710655+0000","last_active":"2024-03-23T23:42:52.327499+0000","last_peered":"2024-03-23T23:42:52.327499+0000","last_clean":"2024-03-23T23:42:52.327499+0000","last_became_active":"2024-03-23T23:42:40.710362+0000","last_became_peered":"2024-03-23T23:42:40.710362+0000","last_unstale":"2024-03-23T23:42:52.327499+0000","last_undegraded":"2024-03-23T23:42:52.327499+0000","last_fullsized":"2024-03-23T23:42:52.327499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:12:14.359173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752890+0000","last_change":"2024-03-23T23:42:50.753397+0000","last_active":"2024-03-23T23:42:51.752890+0000","last_peered":"2024-03-23T23:42:51.752890+0000","last_clean":"2024-03-23T23:42:51.752890+0000","last_became_active":"2024-03-23T23:42:50.753085+0000","last_became_peered":"2024-03-23T23:42:50.753085+0000","last_unstale":"2024-03-23T23:42:51.752890+0000","last_undegraded":"2024-03-23T23:42:51.752890+0000","last_fullsized":"2024-03-23T23:42:51.752890+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:25:44.894505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.742920+0000","last_change":"2024-03-23T23:42:40.689380+0000","last_active":"2024-03-23T23:42:50.742920+0000","last_peered":"2024-03-23T23:42:50.742920+0000","last_clean":"2024-03-23T23:42:50.742920+0000","last_became_active":"2024-03-23T23:42:40.689023+0000","last_became_peered":"2024-03-23T23:42:40.689023+0000","last_unstale":"2024-03-23T23:42:50.742920+0000","last_undegraded":"2024-03-23T23:42:50.742920+0000","last_fullsized":"2024-03-23T23:42:50.742920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:17:19.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.761431+0000","last_change":"2024-03-23T23:42:50.756133+0000","last_active":"2024-03-23T23:42:50.761431+0000","last_peered":"2024-03-23T23:42:50.761431+0000","last_clean":"2024-03-23T23:42:50.761431+0000","last_became_active":"2024-03-23T23:42:50.755405+0000","last_became_peered":"2024-03-23T23:42:50.755405+0000","last_unstale":"2024-03-23T23:42:50.761431+0000","last_undegraded":"2024-03-23T23:42:50.761431+0000","last_fullsized":"2024-03-23T23:42:50.761431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:42:23.236324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328292+0000","last_change":"2024-03-23T23:42:40.698234+0000","last_active":"2024-03-23T23:42:52.328292+0000","last_peered":"2024-03-23T23:42:52.328292+0000","last_clean":"2024-03-23T23:42:52.328292+0000","last_became_active":"2024-03-23T23:42:40.695978+0000","last_became_peered":"2024-03-23T23:42:40.695978+0000","last_unstale":"2024-03-23T23:42:52.328292+0000","last_undegraded":"2024-03-23T23:42:52.328292+0000","last_fullsized":"2024-03-23T23:42:52.328292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:04.633288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328907+0000","last_change":"2024-03-23T23:42:50.752051+0000","last_active":"2024-03-23T23:42:52.328907+0000","last_peered":"2024-03-23T23:42:52.328907+0000","last_clean":"2024-03-23T23:42:52.328907+0000","last_became_active":"2024-03-23T23:42:50.751738+0000","last_became_peered":"2024-03-23T23:42:50.751738+0000","last_unstale":"2024-03-23T23:42:52.328907+0000","last_undegraded":"2024-03-23T23:42:52.328907+0000","last_fullsized":"2024-03-23T23:42:52.328907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:20:53.750917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.739964+0000","last_change":"2024-03-23T23:42:40.698407+0000","last_active":"2024-03-23T23:42:50.739964+0000","last_peered":"2024-03-23T23:42:50.739964+0000","last_clean":"2024-03-23T23:42:50.739964+0000","last_became_active":"2024-03-23T23:42:40.698092+0000","last_became_peered":"2024-03-23T23:42:40.698092+0000","last_unstale":"2024-03-23T23:42:50.739964+0000","last_undegraded":"2024-03-23T23:42:50.739964+0000","last_fullsized":"2024-03-23T23:42:50.739964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:00:33.261296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327627+0000","last_change":"2024-03-23T23:42:50.753000+0000","last_active":"2024-03-23T23:42:52.327627+0000","last_peered":"2024-03-23T23:42:52.327627+0000","last_clean":"2024-03-23T23:42:52.327627+0000","last_became_active":"2024-03-23T23:42:50.752614+0000","last_became_peered":"2024-03-23T23:42:50.752614+0000","last_unstale":"2024-03-23T23:42:52.327627+0000","last_undegraded":"2024-03-23T23:42:52.327627+0000","last_fullsized":"2024-03-23T23:42:52.327627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:57:04.394872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328439+0000","last_change":"2024-03-23T23:42:40.700631+0000","last_active":"2024-03-23T23:42:52.328439+0000","last_peered":"2024-03-23T23:42:52.328439+0000","last_clean":"2024-03-23T23:42:52.328439+0000","last_became_active":"2024-03-23T23:42:40.697932+0000","last_became_peered":"2024-03-23T23:42:40.697932+0000","last_unstale":"2024-03-23T23:42:52.328439+0000","last_undegraded":"2024-03-23T23:42:52.328439+0000","last_fullsized":"2024-03-23T23:42:52.328439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:05:17.694245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.770285+0000","last_change":"2024-03-23T23:42:50.765991+0000","last_active":"2024-03-23T23:42:50.770285+0000","last_peered":"2024-03-23T23:42:50.770285+0000","last_clean":"2024-03-23T23:42:50.770285+0000","last_became_active":"2024-03-23T23:42:50.765716+0000","last_became_peered":"2024-03-23T23:42:50.765716+0000","last_unstale":"2024-03-23T23:42:50.770285+0000","last_undegraded":"2024-03-23T23:42:50.770285+0000","last_fullsized":"2024-03-23T23:42:50.770285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:54:37.698441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.753232+0000","last_change":"2024-03-23T23:42:40.683983+0000","last_active":"2024-03-23T23:42:50.753232+0000","last_peered":"2024-03-23T23:42:50.753232+0000","last_clean":"2024-03-23T23:42:50.753232+0000","last_became_active":"2024-03-23T23:42:40.683711+0000","last_became_peered":"2024-03-23T23:42:40.683711+0000","last_unstale":"2024-03-23T23:42:50.753232+0000","last_undegraded":"2024-03-23T23:42:50.753232+0000","last_fullsized":"2024-03-23T23:42:50.753232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:51:30.695597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.772087+0000","last_change":"2024-03-23T23:42:50.766544+0000","last_active":"2024-03-23T23:42:50.772087+0000","last_peered":"2024-03-23T23:42:50.772087+0000","last_clean":"2024-03-23T23:42:50.772087+0000","last_became_active":"2024-03-23T23:42:50.766328+0000","last_became_peered":"2024-03-23T23:42:50.766328+0000","last_unstale":"2024-03-23T23:42:50.772087+0000","last_undegraded":"2024-03-23T23:42:50.772087+0000","last_fullsized":"2024-03-23T23:42:50.772087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:37:19.741781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.750736+0000","last_change":"2024-03-23T23:42:40.678622+0000","last_active":"2024-03-23T23:42:50.750736+0000","last_peered":"2024-03-23T23:42:50.750736+0000","last_clean":"2024-03-23T23:42:50.750736+0000","last_became_active":"2024-03-23T23:42:40.678325+0000","last_became_peered":"2024-03-23T23:42:40.678325+0000","last_unstale":"2024-03-23T23:42:50.750736+0000","last_undegraded":"2024-03-23T23:42:50.750736+0000","last_fullsized":"2024-03-23T23:42:50.750736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:54:27.641281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.756601+0000","last_change":"2024-03-23T23:42:50.750690+0000","last_active":"2024-03-23T23:42:50.756601+0000","last_peered":"2024-03-23T23:42:50.756601+0000","last_clean":"2024-03-23T23:42:50.756601+0000","last_became_active":"2024-03-23T23:42:50.750466+0000","last_became_peered":"2024-03-23T23:42:50.750466+0000","last_unstale":"2024-03-23T23:42:50.756601+0000","last_undegraded":"2024-03-23T23:42:50.756601+0000","last_fullsized":"2024-03-23T23:42:50.756601+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:33:43.235051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.743976+0000","last_change":"2024-03-23T23:42:40.701959+0000","last_active":"2024-03-23T23:42:50.743976+0000","last_peered":"2024-03-23T23:42:50.743976+0000","last_clean":"2024-03-23T23:42:50.743976+0000","last_became_active":"2024-03-23T23:42:40.700855+0000","last_became_peered":"2024-03-23T23:42:40.700855+0000","last_unstale":"2024-03-23T23:42:50.743976+0000","last_undegraded":"2024-03-23T23:42:50.743976+0000","last_fullsized":"2024-03-23T23:42:50.743976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:49:42.009983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":96343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":94877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":101452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":274432,"data_stored":97361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":847872,"data_stored":685155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":249856,"data_stored":94185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":241664,"data_stored":86698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":851968,"data_stored":685121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T23:42:55.885 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T23:42:56.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.061+0000 7f08e5000640 1 Processor -- start 2024-03-23T23:42:56.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.061+0000 7f08e5000640 1 -- start start 2024-03-23T23:42:56.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.061+0000 7f08e5000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f08e014fbc0 0x7f08e00c5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:56.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.061+0000 7f08e5000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e0159100 con 0x7f08e0159ba0 2024-03-23T23:42:56.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.061+0000 7f08e5000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e00c3df0 con 0x7f08e00c2f70 2024-03-23T23:42:56.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.061+0000 7f08e5000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e0159710 con 0x7f08e014fbc0 2024-03-23T23:42:56.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.061+0000 7f08de800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f08e014fbc0 0x7f08e00c5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:56.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.061+0000 7f08d5400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f08e0159ba0 0x7f08e014f4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:44882/0 (socket says 172.21.15.8:44882) 2024-03-23T23:42:56.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.061+0000 7f08de800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f08e014fbc0 0x7f08e00c5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41952/0 (socket says 172.21.15.8:41952) 2024-03-23T23:42:56.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.061+0000 7f08d5400640 1 -- 172.21.15.8:0/3643966451 learned_addr learned my addr 172.21.15.8:0/3643966451 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:56.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.061+0000 7f08dde00640 1 --1- 172.21.15.8:0/3643966451 >> v1:172.21.15.196:6789/0 conn(0x7f08e00c2f70 0x7f08e0156ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:46168/0 (socket says 172.21.15.8:46168) 2024-03-23T23:42:56.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.061+0000 7f08de800640 1 -- 172.21.15.8:0/3643966451 >> v1:172.21.15.196:6789/0 conn(0x7f08e00c2f70 legacy=0x7f08e0156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:56.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.061+0000 7f08de800640 1 -- 172.21.15.8:0/3643966451 >> v1:172.21.15.8:6789/0 conn(0x7f08e0159ba0 legacy=0x7f08e014f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:56.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.061+0000 7f08de800640 1 -- 172.21.15.8:0/3643966451 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e01593a0 con 0x7f08e014fbc0 2024-03-23T23:42:56.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.065+0000 7f08de800640 1 --2- 172.21.15.8:0/3643966451 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08e014fbc0 0x7f08e00c5650 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f08d8009d90 tx=0x7f08d801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a3ebae8cfc7af56 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:56.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.065+0000 7f08dd400640 1 -- 172.21.15.8:0/3643966451 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d80b2070 con 0x7f08e014fbc0 2024-03-23T23:42:56.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.065+0000 7f08dd400640 1 -- 172.21.15.8:0/3643966451 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d80a59c0 con 0x7f08e014fbc0 2024-03-23T23:42:56.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.065+0000 7f08dd400640 1 -- 172.21.15.8:0/3643966451 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d80a5d90 con 0x7f08e014fbc0 2024-03-23T23:42:56.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.065+0000 7f08e5000640 1 -- 172.21.15.8:0/3643966451 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08e014fbc0 msgr2=0x7f08e00c5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:56.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.065+0000 7f08e5000640 1 --2- 172.21.15.8:0/3643966451 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08e014fbc0 0x7f08e00c5650 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f08d8009d90 tx=0x7f08d801c8e0 comp rx=0 tx=0).stop 2024-03-23T23:42:56.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.065+0000 7f08e5000640 1 -- 172.21.15.8:0/3643966451 shutdown_connections 2024-03-23T23:42:56.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.065+0000 7f08e5000640 1 --2- 172.21.15.8:0/3643966451 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08e014fbc0 0x7f08e00c5650 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:56.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.065+0000 7f08e5000640 1 -- 172.21.15.8:0/3643966451 >> 172.21.15.8:0/3643966451 conn(0x7f08e00743f0 msgr2=0x7f08e0074800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:56.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.065+0000 7f08e5000640 1 -- 172.21.15.8:0/3643966451 shutdown_connections 2024-03-23T23:42:56.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.065+0000 7f08e5000640 1 -- 172.21.15.8:0/3643966451 wait complete. 2024-03-23T23:42:56.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.069+0000 7f08e5000640 1 Processor -- start 2024-03-23T23:42:56.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.069+0000 7f08e5000640 1 -- start start 2024-03-23T23:42:56.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.069+0000 7f08e5000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08e00c2f70 0x7f08e0147c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:56.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.069+0000 7f08e5000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08e014fbc0 0x7f08e01f1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:56.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.069+0000 7f08e5000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08e0159ba0 0x7f08e00ac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:56.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.069+0000 7f08e5000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e00c34d0 con 0x7f08e00c2f70 2024-03-23T23:42:56.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.069+0000 7f08e5000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e00c3350 con 0x7f08e0159ba0 2024-03-23T23:42:56.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.069+0000 7f08e5000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e0163b90 con 0x7f08e014fbc0 2024-03-23T23:42:56.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.069+0000 7f08dde00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08e00c2f70 0x7f08e0147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:56.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.069+0000 7f08dde00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08e00c2f70 0x7f08e0147c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41966/0 (socket says 172.21.15.8:41966) 2024-03-23T23:42:56.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.069+0000 7f08dde00640 1 -- 172.21.15.8:0/3644864408 learned_addr learned my addr 172.21.15.8:0/3644864408 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:56.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.069+0000 7f08de800640 1 --2- 172.21.15.8:0/3644864408 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08e0159ba0 0x7f08e00ac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:56.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.069+0000 7f08d5400640 1 --2- 172.21.15.8:0/3644864408 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08e014fbc0 0x7f08e01f1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:56.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.069+0000 7f08dde00640 1 -- 172.21.15.8:0/3644864408 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08e014fbc0 msgr2=0x7f08e01f1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:56.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.069+0000 7f08dde00640 1 --2- 172.21.15.8:0/3644864408 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08e014fbc0 0x7f08e01f1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:56.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.069+0000 7f08dde00640 1 -- 172.21.15.8:0/3644864408 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08e0159ba0 msgr2=0x7f08e00ac2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:56.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.069+0000 7f08dde00640 1 --2- 172.21.15.8:0/3644864408 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08e0159ba0 0x7f08e00ac2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:56.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.069+0000 7f08dde00640 1 -- 172.21.15.8:0/3644864408 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e01f2980 con 0x7f08e00c2f70 2024-03-23T23:42:56.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.069+0000 7f08dde00640 1 --2- 172.21.15.8:0/3644864408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08e00c2f70 0x7f08e0147c60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f08d000c490 tx=0x7f08d000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:56.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.069+0000 7f08d6a00640 1 -- 172.21.15.8:0/3644864408 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d00074e0 con 0x7f08e00c2f70 2024-03-23T23:42:56.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.069+0000 7f08d6a00640 1 -- 172.21.15.8:0/3644864408 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d0007680 con 0x7f08e00c2f70 2024-03-23T23:42:56.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.069+0000 7f08e5000640 1 -- 172.21.15.8:0/3644864408 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e0070e50 con 0x7f08e00c2f70 2024-03-23T23:42:56.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.069+0000 7f08d6a00640 1 -- 172.21.15.8:0/3644864408 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d00049f0 con 0x7f08e00c2f70 2024-03-23T23:42:56.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.069+0000 7f08e5000640 1 -- 172.21.15.8:0/3644864408 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e0145fa0 con 0x7f08e00c2f70 2024-03-23T23:42:56.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.073+0000 7f08e5000640 1 -- 172.21.15.8:0/3644864408 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e0068270 con 0x7f08e00c2f70 2024-03-23T23:42:56.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.073+0000 7f08d6a00640 1 -- 172.21.15.8:0/3644864408 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f08d001a020 con 0x7f08e00c2f70 2024-03-23T23:42:56.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.073+0000 7f08d6a00640 1 --2- 172.21.15.8:0/3644864408 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f08bc067660 0x7f08bc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:56.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.073+0000 7f08d6a00640 1 -- 172.21.15.8:0/3644864408 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f08d0085260 con 0x7f08e00c2f70 2024-03-23T23:42:56.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.073+0000 7f08d5400640 1 --2- 172.21.15.8:0/3644864408 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f08bc067660 0x7f08bc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:56.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.073+0000 7f08d5400640 1 --2- 172.21.15.8:0/3644864408 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f08bc067660 0x7f08bc069b20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f08e01481a0 tx=0x7f08c8007e90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:56.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.077+0000 7f08d6a00640 1 -- 172.21.15.8:0/3644864408 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f08d00555f0 con 0x7f08e00c2f70 2024-03-23T23:42:56.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.257+0000 7f08e5000640 1 -- 172.21.15.8:0/3644864408 --> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f08e0161150 con 0x7f08bc067660 2024-03-23T23:42:56.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.269+0000 7f08d6a00640 1 -- 172.21.15.8:0/3644864408 <== mgr.4098 v2:172.21.15.196:6832/1295060067 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+490382 (secure 0 0 0) 0x7f08e0161150 con 0x7f08bc067660 2024-03-23T23:42:56.276 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:42:56.279 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-03-23T23:42:56.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.273+0000 7f08e5000640 1 -- 172.21.15.8:0/3644864408 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f08bc067660 msgr2=0x7f08bc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:56.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.273+0000 7f08e5000640 1 --2- 172.21.15.8:0/3644864408 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f08bc067660 0x7f08bc069b20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f08e01481a0 tx=0x7f08c8007e90 comp rx=0 tx=0).stop 2024-03-23T23:42:56.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.273+0000 7f08e5000640 1 -- 172.21.15.8:0/3644864408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08e00c2f70 msgr2=0x7f08e0147c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:56.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.273+0000 7f08e5000640 1 --2- 172.21.15.8:0/3644864408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08e00c2f70 0x7f08e0147c60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f08d000c490 tx=0x7f08d000c950 comp rx=0 tx=0).stop 2024-03-23T23:42:56.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.273+0000 7f08e5000640 1 -- 172.21.15.8:0/3644864408 shutdown_connections 2024-03-23T23:42:56.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.273+0000 7f08e5000640 1 --2- 172.21.15.8:0/3644864408 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08e0159ba0 0x7f08e00ac2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:56.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.273+0000 7f08e5000640 1 --2- 172.21.15.8:0/3644864408 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f08bc067660 0x7f08bc069b20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:56.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.273+0000 7f08e5000640 1 --2- 172.21.15.8:0/3644864408 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08e014fbc0 0x7f08e01f1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:56.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.273+0000 7f08e5000640 1 --2- 172.21.15.8:0/3644864408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08e00c2f70 0x7f08e0147c60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:56.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.273+0000 7f08e5000640 1 -- 172.21.15.8:0/3644864408 >> 172.21.15.8:0/3644864408 conn(0x7f08e00743f0 msgr2=0x7f08e00c7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:56.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.273+0000 7f08e5000640 1 -- 172.21.15.8:0/3644864408 shutdown_connections 2024-03-23T23:42:56.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.273+0000 7f08e5000640 1 -- 172.21.15.8:0/3644864408 wait complete. 2024-03-23T23:42:56.296 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-03-23T23:42:54.275208+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":248,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":194,"ondisk_log_size":194,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":284,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240200,"kb_used_data":3192,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734520,"statfs":{"total":773094113280,"available":772848148480,"internally_reserved":0,"allocated":3268608,"data_stored":1941192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.563749"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750876+0000","last_change":"2024-03-23T23:42:50.736219+0000","last_active":"2024-03-23T23:42:51.750876+0000","last_peered":"2024-03-23T23:42:51.750876+0000","last_clean":"2024-03-23T23:42:51.750876+0000","last_became_active":"2024-03-23T23:42:50.735940+0000","last_became_peered":"2024-03-23T23:42:50.735940+0000","last_unstale":"2024-03-23T23:42:51.750876+0000","last_undegraded":"2024-03-23T23:42:51.750876+0000","last_fullsized":"2024-03-23T23:42:51.750876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:11:44.111477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.752139+0000","last_change":"2024-03-23T23:42:39.693858+0000","last_active":"2024-03-23T23:42:50.752139+0000","last_peered":"2024-03-23T23:42:50.752139+0000","last_clean":"2024-03-23T23:42:50.752139+0000","last_became_active":"2024-03-23T23:42:39.693636+0000","last_became_peered":"2024-03-23T23:42:39.693636+0000","last_unstale":"2024-03-23T23:42:50.752139+0000","last_undegraded":"2024-03-23T23:42:50.752139+0000","last_fullsized":"2024-03-23T23:42:50.752139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:44:07.213123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328567+0000","last_change":"2024-03-23T23:42:40.685708+0000","last_active":"2024-03-23T23:42:52.328567+0000","last_peered":"2024-03-23T23:42:52.328567+0000","last_clean":"2024-03-23T23:42:52.328567+0000","last_became_active":"2024-03-23T23:42:40.682755+0000","last_became_peered":"2024-03-23T23:42:40.682755+0000","last_unstale":"2024-03-23T23:42:52.328567+0000","last_undegraded":"2024-03-23T23:42:52.328567+0000","last_fullsized":"2024-03-23T23:42:52.328567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:04.633288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327590+0000","last_change":"2024-03-23T23:42:49.750108+0000","last_active":"2024-03-23T23:42:52.327590+0000","last_peered":"2024-03-23T23:42:52.327590+0000","last_clean":"2024-03-23T23:42:52.327590+0000","last_became_active":"2024-03-23T23:42:49.749634+0000","last_became_peered":"2024-03-23T23:42:49.749634+0000","last_unstale":"2024-03-23T23:42:52.327590+0000","last_undegraded":"2024-03-23T23:42:52.327590+0000","last_fullsized":"2024-03-23T23:42:52.327590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:49:16.758908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.761082+0000","last_change":"2024-03-23T23:42:50.752450+0000","last_active":"2024-03-23T23:42:50.761082+0000","last_peered":"2024-03-23T23:42:50.761082+0000","last_clean":"2024-03-23T23:42:50.761082+0000","last_became_active":"2024-03-23T23:42:50.752078+0000","last_became_peered":"2024-03-23T23:42:50.752078+0000","last_unstale":"2024-03-23T23:42:50.761082+0000","last_undegraded":"2024-03-23T23:42:50.761082+0000","last_fullsized":"2024-03-23T23:42:50.761082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:48:24.982671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328677+0000","last_change":"2024-03-23T23:42:39.687108+0000","last_active":"2024-03-23T23:42:52.328677+0000","last_peered":"2024-03-23T23:42:52.328677+0000","last_clean":"2024-03-23T23:42:52.328677+0000","last_became_active":"2024-03-23T23:42:39.686875+0000","last_became_peered":"2024-03-23T23:42:39.686875+0000","last_unstale":"2024-03-23T23:42:52.328677+0000","last_undegraded":"2024-03-23T23:42:52.328677+0000","last_fullsized":"2024-03-23T23:42:52.328677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:05:52.079172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.751937+0000","last_change":"2024-03-23T23:42:40.698746+0000","last_active":"2024-03-23T23:42:50.751937+0000","last_peered":"2024-03-23T23:42:50.751937+0000","last_clean":"2024-03-23T23:42:50.751937+0000","last_became_active":"2024-03-23T23:42:40.698003+0000","last_became_peered":"2024-03-23T23:42:40.698003+0000","last_unstale":"2024-03-23T23:42:50.751937+0000","last_undegraded":"2024-03-23T23:42:50.751937+0000","last_fullsized":"2024-03-23T23:42:50.751937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:53:46.437114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751376+0000","last_change":"2024-03-23T23:42:49.728923+0000","last_active":"2024-03-23T23:42:51.751376+0000","last_peered":"2024-03-23T23:42:51.751376+0000","last_clean":"2024-03-23T23:42:51.751376+0000","last_became_active":"2024-03-23T23:42:49.728261+0000","last_became_peered":"2024-03-23T23:42:49.728261+0000","last_unstale":"2024-03-23T23:42:51.751376+0000","last_undegraded":"2024-03-23T23:42:51.751376+0000","last_fullsized":"2024-03-23T23:42:51.751376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:22.375891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.757222+0000","last_change":"2024-03-23T23:42:50.755852+0000","last_active":"2024-03-23T23:42:50.757222+0000","last_peered":"2024-03-23T23:42:50.757222+0000","last_clean":"2024-03-23T23:42:50.757222+0000","last_became_active":"2024-03-23T23:42:50.755600+0000","last_became_peered":"2024-03-23T23:42:50.755600+0000","last_unstale":"2024-03-23T23:42:50.757222+0000","last_undegraded":"2024-03-23T23:42:50.757222+0000","last_fullsized":"2024-03-23T23:42:50.757222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:49:43.793847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.742583+0000","last_change":"2024-03-23T23:42:39.696690+0000","last_active":"2024-03-23T23:42:50.742583+0000","last_peered":"2024-03-23T23:42:50.742583+0000","last_clean":"2024-03-23T23:42:50.742583+0000","last_became_active":"2024-03-23T23:42:39.696342+0000","last_became_peered":"2024-03-23T23:42:39.696342+0000","last_unstale":"2024-03-23T23:42:50.742583+0000","last_undegraded":"2024-03-23T23:42:50.742583+0000","last_fullsized":"2024-03-23T23:42:50.742583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:42:37.702720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328460+0000","last_change":"2024-03-23T23:42:40.700355+0000","last_active":"2024-03-23T23:42:52.328460+0000","last_peered":"2024-03-23T23:42:52.328460+0000","last_clean":"2024-03-23T23:42:52.328460+0000","last_became_active":"2024-03-23T23:42:40.697668+0000","last_became_peered":"2024-03-23T23:42:40.697668+0000","last_unstale":"2024-03-23T23:42:52.328460+0000","last_undegraded":"2024-03-23T23:42:52.328460+0000","last_fullsized":"2024-03-23T23:42:52.328460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:23:43.515519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751380+0000","last_change":"2024-03-23T23:42:49.744792+0000","last_active":"2024-03-23T23:42:51.751380+0000","last_peered":"2024-03-23T23:42:51.751380+0000","last_clean":"2024-03-23T23:42:51.751380+0000","last_became_active":"2024-03-23T23:42:49.744561+0000","last_became_peered":"2024-03-23T23:42:49.744561+0000","last_unstale":"2024-03-23T23:42:51.751380+0000","last_undegraded":"2024-03-23T23:42:51.751380+0000","last_fullsized":"2024-03-23T23:42:51.751380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:07:58.222020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328699+0000","last_change":"2024-03-23T23:42:50.755575+0000","last_active":"2024-03-23T23:42:52.328699+0000","last_peered":"2024-03-23T23:42:52.328699+0000","last_clean":"2024-03-23T23:42:52.328699+0000","last_became_active":"2024-03-23T23:42:50.755337+0000","last_became_peered":"2024-03-23T23:42:50.755337+0000","last_unstale":"2024-03-23T23:42:52.328699+0000","last_undegraded":"2024-03-23T23:42:52.328699+0000","last_fullsized":"2024-03-23T23:42:52.328699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:13.911327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.743741+0000","last_change":"2024-03-23T23:42:39.696707+0000","last_active":"2024-03-23T23:42:50.743741+0000","last_peered":"2024-03-23T23:42:50.743741+0000","last_clean":"2024-03-23T23:42:50.743741+0000","last_became_active":"2024-03-23T23:42:39.696401+0000","last_became_peered":"2024-03-23T23:42:39.696401+0000","last_unstale":"2024-03-23T23:42:50.743741+0000","last_undegraded":"2024-03-23T23:42:50.743741+0000","last_fullsized":"2024-03-23T23:42:50.743741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:55.757707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328921+0000","last_change":"2024-03-23T23:42:40.700389+0000","last_active":"2024-03-23T23:42:52.328921+0000","last_peered":"2024-03-23T23:42:52.328921+0000","last_clean":"2024-03-23T23:42:52.328921+0000","last_became_active":"2024-03-23T23:42:40.699770+0000","last_became_peered":"2024-03-23T23:42:40.699770+0000","last_unstale":"2024-03-23T23:42:52.328921+0000","last_undegraded":"2024-03-23T23:42:52.328921+0000","last_fullsized":"2024-03-23T23:42:52.328921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:27.675824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751083+0000","last_change":"2024-03-23T23:42:49.745710+0000","last_active":"2024-03-23T23:42:51.751083+0000","last_peered":"2024-03-23T23:42:51.751083+0000","last_clean":"2024-03-23T23:42:51.751083+0000","last_became_active":"2024-03-23T23:42:49.745526+0000","last_became_peered":"2024-03-23T23:42:49.745526+0000","last_unstale":"2024-03-23T23:42:51.751083+0000","last_undegraded":"2024-03-23T23:42:51.751083+0000","last_fullsized":"2024-03-23T23:42:51.751083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:05:26.746849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.760661+0000","last_change":"2024-03-23T23:42:50.747274+0000","last_active":"2024-03-23T23:42:50.760661+0000","last_peered":"2024-03-23T23:42:50.760661+0000","last_clean":"2024-03-23T23:42:50.760661+0000","last_became_active":"2024-03-23T23:42:50.746937+0000","last_became_peered":"2024-03-23T23:42:50.746937+0000","last_unstale":"2024-03-23T23:42:50.760661+0000","last_undegraded":"2024-03-23T23:42:50.760661+0000","last_fullsized":"2024-03-23T23:42:50.760661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:52:58.565591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751450+0000","last_change":"2024-03-23T23:42:40.682467+0000","last_active":"2024-03-23T23:42:51.751450+0000","last_peered":"2024-03-23T23:42:51.751450+0000","last_clean":"2024-03-23T23:42:51.751450+0000","last_became_active":"2024-03-23T23:42:40.682192+0000","last_became_peered":"2024-03-23T23:42:40.682192+0000","last_unstale":"2024-03-23T23:42:51.751450+0000","last_undegraded":"2024-03-23T23:42:51.751450+0000","last_fullsized":"2024-03-23T23:42:51.751450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:37:24.839568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.740154+0000","last_change":"2024-03-23T23:42:39.696528+0000","last_active":"2024-03-23T23:42:50.740154+0000","last_peered":"2024-03-23T23:42:50.740154+0000","last_clean":"2024-03-23T23:42:50.740154+0000","last_became_active":"2024-03-23T23:42:39.696207+0000","last_became_peered":"2024-03-23T23:42:39.696207+0000","last_unstale":"2024-03-23T23:42:50.740154+0000","last_undegraded":"2024-03-23T23:42:50.740154+0000","last_fullsized":"2024-03-23T23:42:50.740154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:02.190910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751687+0000","last_change":"2024-03-23T23:42:49.734156+0000","last_active":"2024-03-23T23:42:51.751687+0000","last_peered":"2024-03-23T23:42:51.751687+0000","last_clean":"2024-03-23T23:42:51.751687+0000","last_became_active":"2024-03-23T23:42:49.733888+0000","last_became_peered":"2024-03-23T23:42:49.733888+0000","last_unstale":"2024-03-23T23:42:51.751687+0000","last_undegraded":"2024-03-23T23:42:51.751687+0000","last_fullsized":"2024-03-23T23:42:51.751687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:23:52.568123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.768274+0000","last_change":"2024-03-23T23:42:50.759749+0000","last_active":"2024-03-23T23:42:50.768274+0000","last_peered":"2024-03-23T23:42:50.768274+0000","last_clean":"2024-03-23T23:42:50.768274+0000","last_became_active":"2024-03-23T23:42:50.758670+0000","last_became_peered":"2024-03-23T23:42:50.758670+0000","last_unstale":"2024-03-23T23:42:50.768274+0000","last_undegraded":"2024-03-23T23:42:50.768274+0000","last_fullsized":"2024-03-23T23:42:50.768274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:17:29.318261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327985+0000","last_change":"2024-03-23T23:42:40.674574+0000","last_active":"2024-03-23T23:42:52.327985+0000","last_peered":"2024-03-23T23:42:52.327985+0000","last_clean":"2024-03-23T23:42:52.327985+0000","last_became_active":"2024-03-23T23:42:40.674293+0000","last_became_peered":"2024-03-23T23:42:40.674293+0000","last_unstale":"2024-03-23T23:42:52.327985+0000","last_undegraded":"2024-03-23T23:42:52.327985+0000","last_fullsized":"2024-03-23T23:42:52.327985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:37:24.839568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.741025+0000","last_change":"2024-03-23T23:42:39.683165+0000","last_active":"2024-03-23T23:42:50.741025+0000","last_peered":"2024-03-23T23:42:50.741025+0000","last_clean":"2024-03-23T23:42:50.741025+0000","last_became_active":"2024-03-23T23:42:39.680121+0000","last_became_peered":"2024-03-23T23:42:39.680121+0000","last_unstale":"2024-03-23T23:42:50.741025+0000","last_undegraded":"2024-03-23T23:42:50.741025+0000","last_fullsized":"2024-03-23T23:42:50.741025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:02.190910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752029+0000","last_change":"2024-03-23T23:42:49.745016+0000","last_active":"2024-03-23T23:42:51.752029+0000","last_peered":"2024-03-23T23:42:51.752029+0000","last_clean":"2024-03-23T23:42:51.752029+0000","last_became_active":"2024-03-23T23:42:49.744742+0000","last_became_peered":"2024-03-23T23:42:49.744742+0000","last_unstale":"2024-03-23T23:42:51.752029+0000","last_undegraded":"2024-03-23T23:42:51.752029+0000","last_fullsized":"2024-03-23T23:42:51.752029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:30.033743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751217+0000","last_change":"2024-03-23T23:42:50.749792+0000","last_active":"2024-03-23T23:42:51.751217+0000","last_peered":"2024-03-23T23:42:51.751217+0000","last_clean":"2024-03-23T23:42:51.751217+0000","last_became_active":"2024-03-23T23:42:50.749491+0000","last_became_peered":"2024-03-23T23:42:50.749491+0000","last_unstale":"2024-03-23T23:42:51.751217+0000","last_undegraded":"2024-03-23T23:42:51.751217+0000","last_fullsized":"2024-03-23T23:42:51.751217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:25:44.894505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327680+0000","last_change":"2024-03-23T23:42:40.682999+0000","last_active":"2024-03-23T23:42:52.327680+0000","last_peered":"2024-03-23T23:42:52.327680+0000","last_clean":"2024-03-23T23:42:52.327680+0000","last_became_active":"2024-03-23T23:42:40.682672+0000","last_became_peered":"2024-03-23T23:42:40.682672+0000","last_unstale":"2024-03-23T23:42:52.327680+0000","last_undegraded":"2024-03-23T23:42:52.327680+0000","last_fullsized":"2024-03-23T23:42:52.327680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:59:45.154553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.740401+0000","last_change":"2024-03-23T23:42:39.691470+0000","last_active":"2024-03-23T23:42:50.740401+0000","last_peered":"2024-03-23T23:42:50.740401+0000","last_clean":"2024-03-23T23:42:50.740401+0000","last_became_active":"2024-03-23T23:42:39.691124+0000","last_became_peered":"2024-03-23T23:42:39.691124+0000","last_unstale":"2024-03-23T23:42:50.740401+0000","last_undegraded":"2024-03-23T23:42:50.740401+0000","last_fullsized":"2024-03-23T23:42:50.740401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:55.757707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.773676+0000","last_change":"2024-03-23T23:42:49.750016+0000","last_active":"2024-03-23T23:42:50.773676+0000","last_peered":"2024-03-23T23:42:50.773676+0000","last_clean":"2024-03-23T23:42:50.773676+0000","last_became_active":"2024-03-23T23:42:49.749279+0000","last_became_peered":"2024-03-23T23:42:49.749279+0000","last_unstale":"2024-03-23T23:42:50.773676+0000","last_undegraded":"2024-03-23T23:42:50.773676+0000","last_fullsized":"2024-03-23T23:42:50.773676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:41:14.671834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328693+0000","last_change":"2024-03-23T23:42:50.753669+0000","last_active":"2024-03-23T23:42:52.328693+0000","last_peered":"2024-03-23T23:42:52.328693+0000","last_clean":"2024-03-23T23:42:52.328693+0000","last_became_active":"2024-03-23T23:42:50.752674+0000","last_became_peered":"2024-03-23T23:42:50.752674+0000","last_unstale":"2024-03-23T23:42:52.328693+0000","last_undegraded":"2024-03-23T23:42:52.328693+0000","last_fullsized":"2024-03-23T23:42:52.328693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:39:04.727316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751477+0000","last_change":"2024-03-23T23:42:40.685051+0000","last_active":"2024-03-23T23:42:51.751477+0000","last_peered":"2024-03-23T23:42:51.751477+0000","last_clean":"2024-03-23T23:42:51.751477+0000","last_became_active":"2024-03-23T23:42:40.684677+0000","last_became_peered":"2024-03-23T23:42:40.684677+0000","last_unstale":"2024-03-23T23:42:51.751477+0000","last_undegraded":"2024-03-23T23:42:51.751477+0000","last_fullsized":"2024-03-23T23:42:51.751477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:20.920978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.741549+0000","last_change":"2024-03-23T23:42:39.695253+0000","last_active":"2024-03-23T23:42:50.741549+0000","last_peered":"2024-03-23T23:42:50.741549+0000","last_clean":"2024-03-23T23:42:50.741549+0000","last_became_active":"2024-03-23T23:42:39.694746+0000","last_became_peered":"2024-03-23T23:42:39.694746+0000","last_unstale":"2024-03-23T23:42:50.741549+0000","last_undegraded":"2024-03-23T23:42:50.741549+0000","last_fullsized":"2024-03-23T23:42:50.741549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:57.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752459+0000","last_change":"2024-03-23T23:42:49.724285+0000","last_active":"2024-03-23T23:42:51.752459+0000","last_peered":"2024-03-23T23:42:51.752459+0000","last_clean":"2024-03-23T23:42:51.752459+0000","last_became_active":"2024-03-23T23:42:49.724009+0000","last_became_peered":"2024-03-23T23:42:49.724009+0000","last_unstale":"2024-03-23T23:42:51.752459+0000","last_undegraded":"2024-03-23T23:42:51.752459+0000","last_fullsized":"2024-03-23T23:42:51.752459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:01:04.035970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327444+0000","last_change":"2024-03-23T23:42:50.746737+0000","last_active":"2024-03-23T23:42:52.327444+0000","last_peered":"2024-03-23T23:42:52.327444+0000","last_clean":"2024-03-23T23:42:52.327444+0000","last_became_active":"2024-03-23T23:42:50.746492+0000","last_became_peered":"2024-03-23T23:42:50.746492+0000","last_unstale":"2024-03-23T23:42:52.327444+0000","last_undegraded":"2024-03-23T23:42:52.327444+0000","last_fullsized":"2024-03-23T23:42:52.327444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:50.597847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.752429+0000","last_change":"2024-03-23T23:42:40.680963+0000","last_active":"2024-03-23T23:42:50.752429+0000","last_peered":"2024-03-23T23:42:50.752429+0000","last_clean":"2024-03-23T23:42:50.752429+0000","last_became_active":"2024-03-23T23:42:40.680744+0000","last_became_peered":"2024-03-23T23:42:40.680744+0000","last_unstale":"2024-03-23T23:42:50.752429+0000","last_undegraded":"2024-03-23T23:42:50.752429+0000","last_fullsized":"2024-03-23T23:42:50.752429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:17:19.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.753179+0000","last_change":"2024-03-23T23:42:39.691813+0000","last_active":"2024-03-23T23:42:51.753179+0000","last_peered":"2024-03-23T23:42:51.753179+0000","last_clean":"2024-03-23T23:42:51.753179+0000","last_became_active":"2024-03-23T23:42:39.691519+0000","last_became_peered":"2024-03-23T23:42:39.691519+0000","last_unstale":"2024-03-23T23:42:51.753179+0000","last_undegraded":"2024-03-23T23:42:51.753179+0000","last_fullsized":"2024-03-23T23:42:51.753179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:27:41.386662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751110+0000","last_change":"2024-03-23T23:42:49.734197+0000","last_active":"2024-03-23T23:42:51.751110+0000","last_peered":"2024-03-23T23:42:51.751110+0000","last_clean":"2024-03-23T23:42:51.751110+0000","last_became_active":"2024-03-23T23:42:49.733715+0000","last_became_peered":"2024-03-23T23:42:49.733715+0000","last_unstale":"2024-03-23T23:42:51.751110+0000","last_undegraded":"2024-03-23T23:42:51.751110+0000","last_fullsized":"2024-03-23T23:42:51.751110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:36.728428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750902+0000","last_change":"2024-03-23T23:42:50.739957+0000","last_active":"2024-03-23T23:42:51.750902+0000","last_peered":"2024-03-23T23:42:51.750902+0000","last_clean":"2024-03-23T23:42:51.750902+0000","last_became_active":"2024-03-23T23:42:50.739706+0000","last_became_peered":"2024-03-23T23:42:50.739706+0000","last_unstale":"2024-03-23T23:42:51.750902+0000","last_undegraded":"2024-03-23T23:42:51.750902+0000","last_fullsized":"2024-03-23T23:42:51.750902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:49:17.763463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328339+0000","last_change":"2024-03-23T23:42:40.686865+0000","last_active":"2024-03-23T23:42:52.328339+0000","last_peered":"2024-03-23T23:42:52.328339+0000","last_clean":"2024-03-23T23:42:52.328339+0000","last_became_active":"2024-03-23T23:42:40.686582+0000","last_became_peered":"2024-03-23T23:42:40.686582+0000","last_unstale":"2024-03-23T23:42:52.328339+0000","last_undegraded":"2024-03-23T23:42:52.328339+0000","last_fullsized":"2024-03-23T23:42:52.328339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:05:17.694245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.750857+0000","last_change":"2024-03-23T23:42:39.678962+0000","last_active":"2024-03-23T23:42:50.750857+0000","last_peered":"2024-03-23T23:42:50.750857+0000","last_clean":"2024-03-23T23:42:50.750857+0000","last_became_active":"2024-03-23T23:42:39.678603+0000","last_became_peered":"2024-03-23T23:42:39.678603+0000","last_unstale":"2024-03-23T23:42:50.750857+0000","last_undegraded":"2024-03-23T23:42:50.750857+0000","last_fullsized":"2024-03-23T23:42:50.750857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:43:46.206865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327329+0000","last_change":"2024-03-23T23:42:49.740561+0000","last_active":"2024-03-23T23:42:52.327329+0000","last_peered":"2024-03-23T23:42:52.327329+0000","last_clean":"2024-03-23T23:42:52.327329+0000","last_became_active":"2024-03-23T23:42:49.740290+0000","last_became_peered":"2024-03-23T23:42:49.740290+0000","last_unstale":"2024-03-23T23:42:52.327329+0000","last_undegraded":"2024-03-23T23:42:52.327329+0000","last_fullsized":"2024-03-23T23:42:52.327329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:21:24.160603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751249+0000","last_change":"2024-03-23T23:42:50.751107+0000","last_active":"2024-03-23T23:42:51.751249+0000","last_peered":"2024-03-23T23:42:51.751249+0000","last_clean":"2024-03-23T23:42:51.751249+0000","last_became_active":"2024-03-23T23:42:50.750859+0000","last_became_peered":"2024-03-23T23:42:50.750859+0000","last_unstale":"2024-03-23T23:42:51.751249+0000","last_undegraded":"2024-03-23T23:42:51.751249+0000","last_fullsized":"2024-03-23T23:42:51.751249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:49:17.763463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.740588+0000","last_change":"2024-03-23T23:42:40.686486+0000","last_active":"2024-03-23T23:42:50.740588+0000","last_peered":"2024-03-23T23:42:50.740588+0000","last_clean":"2024-03-23T23:42:50.740588+0000","last_became_active":"2024-03-23T23:42:40.686186+0000","last_became_peered":"2024-03-23T23:42:40.686186+0000","last_unstale":"2024-03-23T23:42:50.740588+0000","last_undegraded":"2024-03-23T23:42:50.740588+0000","last_fullsized":"2024-03-23T23:42:50.740588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:46:30.427072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.742762+0000","last_change":"2024-03-23T23:42:39.695099+0000","last_active":"2024-03-23T23:42:50.742762+0000","last_peered":"2024-03-23T23:42:50.742762+0000","last_clean":"2024-03-23T23:42:50.742762+0000","last_became_active":"2024-03-23T23:42:39.694720+0000","last_became_peered":"2024-03-23T23:42:39.694720+0000","last_unstale":"2024-03-23T23:42:50.742762+0000","last_undegraded":"2024-03-23T23:42:50.742762+0000","last_fullsized":"2024-03-23T23:42:50.742762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:58:07.880313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.749444+0000","last_change":"2024-03-23T23:42:49.739099+0000","last_active":"2024-03-23T23:42:50.749444+0000","last_peered":"2024-03-23T23:42:50.749444+0000","last_clean":"2024-03-23T23:42:50.749444+0000","last_became_active":"2024-03-23T23:42:49.738198+0000","last_became_peered":"2024-03-23T23:42:49.738198+0000","last_unstale":"2024-03-23T23:42:50.749444+0000","last_undegraded":"2024-03-23T23:42:50.749444+0000","last_fullsized":"2024-03-23T23:42:50.749444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:57:34.600362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.756247+0000","last_change":"2024-03-23T23:42:50.754941+0000","last_active":"2024-03-23T23:42:50.756247+0000","last_peered":"2024-03-23T23:42:50.756247+0000","last_clean":"2024-03-23T23:42:50.756247+0000","last_became_active":"2024-03-23T23:42:50.754585+0000","last_became_peered":"2024-03-23T23:42:50.754585+0000","last_unstale":"2024-03-23T23:42:50.756247+0000","last_undegraded":"2024-03-23T23:42:50.756247+0000","last_fullsized":"2024-03-23T23:42:50.756247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:33:43.235051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328954+0000","last_change":"2024-03-23T23:42:40.700610+0000","last_active":"2024-03-23T23:42:52.328954+0000","last_peered":"2024-03-23T23:42:52.328954+0000","last_clean":"2024-03-23T23:42:52.328954+0000","last_became_active":"2024-03-23T23:42:40.700112+0000","last_became_peered":"2024-03-23T23:42:40.700112+0000","last_unstale":"2024-03-23T23:42:52.328954+0000","last_undegraded":"2024-03-23T23:42:52.328954+0000","last_fullsized":"2024-03-23T23:42:52.328954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:07:49.169416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.740681+0000","last_change":"2024-03-23T23:42:39.686509+0000","last_active":"2024-03-23T23:42:50.740681+0000","last_peered":"2024-03-23T23:42:50.740681+0000","last_clean":"2024-03-23T23:42:50.740681+0000","last_became_active":"2024-03-23T23:42:39.686094+0000","last_became_peered":"2024-03-23T23:42:39.686094+0000","last_unstale":"2024-03-23T23:42:50.740681+0000","last_undegraded":"2024-03-23T23:42:50.740681+0000","last_fullsized":"2024-03-23T23:42:50.740681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:57:20.394530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.740810+0000","last_change":"2024-03-23T23:42:49.738274+0000","last_active":"2024-03-23T23:42:50.740810+0000","last_peered":"2024-03-23T23:42:50.740810+0000","last_clean":"2024-03-23T23:42:50.740810+0000","last_became_active":"2024-03-23T23:42:49.737916+0000","last_became_peered":"2024-03-23T23:42:49.737916+0000","last_unstale":"2024-03-23T23:42:50.740810+0000","last_undegraded":"2024-03-23T23:42:50.740810+0000","last_fullsized":"2024-03-23T23:42:50.740810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:18:12.997092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.771896+0000","last_change":"2024-03-23T23:42:50.764148+0000","last_active":"2024-03-23T23:42:50.771896+0000","last_peered":"2024-03-23T23:42:50.771896+0000","last_clean":"2024-03-23T23:42:50.771896+0000","last_became_active":"2024-03-23T23:42:50.763768+0000","last_became_peered":"2024-03-23T23:42:50.763768+0000","last_unstale":"2024-03-23T23:42:50.771896+0000","last_undegraded":"2024-03-23T23:42:50.771896+0000","last_fullsized":"2024-03-23T23:42:50.771896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:41:15.676389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751565+0000","last_change":"2024-03-23T23:42:40.679988+0000","last_active":"2024-03-23T23:42:51.751565+0000","last_peered":"2024-03-23T23:42:51.751565+0000","last_clean":"2024-03-23T23:42:51.751565+0000","last_became_active":"2024-03-23T23:42:40.679488+0000","last_became_peered":"2024-03-23T23:42:40.679488+0000","last_unstale":"2024-03-23T23:42:51.751565+0000","last_undegraded":"2024-03-23T23:42:51.751565+0000","last_fullsized":"2024-03-23T23:42:51.751565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:10:32.251287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328493+0000","last_change":"2024-03-23T23:42:39.679741+0000","last_active":"2024-03-23T23:42:52.328493+0000","last_peered":"2024-03-23T23:42:52.328493+0000","last_clean":"2024-03-23T23:42:52.328493+0000","last_became_active":"2024-03-23T23:42:39.678864+0000","last_became_peered":"2024-03-23T23:42:39.678864+0000","last_unstale":"2024-03-23T23:42:52.328493+0000","last_undegraded":"2024-03-23T23:42:52.328493+0000","last_fullsized":"2024-03-23T23:42:52.328493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:50.559059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.740540+0000","last_change":"2024-03-23T23:42:49.739837+0000","last_active":"2024-03-23T23:42:50.740540+0000","last_peered":"2024-03-23T23:42:50.740540+0000","last_clean":"2024-03-23T23:42:50.740540+0000","last_became_active":"2024-03-23T23:42:49.739570+0000","last_became_peered":"2024-03-23T23:42:49.739570+0000","last_unstale":"2024-03-23T23:42:50.740540+0000","last_undegraded":"2024-03-23T23:42:50.740540+0000","last_fullsized":"2024-03-23T23:42:50.740540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:57:34.600362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.765628+0000","last_change":"2024-03-23T23:42:50.753912+0000","last_active":"2024-03-23T23:42:50.765628+0000","last_peered":"2024-03-23T23:42:50.765628+0000","last_clean":"2024-03-23T23:42:50.765628+0000","last_became_active":"2024-03-23T23:42:50.753629+0000","last_became_peered":"2024-03-23T23:42:50.753629+0000","last_unstale":"2024-03-23T23:42:50.765628+0000","last_undegraded":"2024-03-23T23:42:50.765628+0000","last_fullsized":"2024-03-23T23:42:50.765628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:26:26.229079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.740091+0000","last_change":"2024-03-23T23:42:40.682840+0000","last_active":"2024-03-23T23:42:50.740091+0000","last_peered":"2024-03-23T23:42:50.740091+0000","last_clean":"2024-03-23T23:42:50.740091+0000","last_became_active":"2024-03-23T23:42:40.682391+0000","last_became_peered":"2024-03-23T23:42:40.682391+0000","last_unstale":"2024-03-23T23:42:50.740091+0000","last_undegraded":"2024-03-23T23:42:50.740091+0000","last_fullsized":"2024-03-23T23:42:50.740091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:42:14.952953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.739077+0000","last_change":"2024-03-23T23:42:39.680763+0000","last_active":"2024-03-23T23:42:50.739077+0000","last_peered":"2024-03-23T23:42:50.739077+0000","last_clean":"2024-03-23T23:42:50.739077+0000","last_became_active":"2024-03-23T23:42:39.680494+0000","last_became_peered":"2024-03-23T23:42:39.680494+0000","last_unstale":"2024-03-23T23:42:50.739077+0000","last_undegraded":"2024-03-23T23:42:50.739077+0000","last_fullsized":"2024-03-23T23:42:50.739077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:57.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.768993+0000","last_change":"2024-03-23T23:42:49.737456+0000","last_active":"2024-03-23T23:42:50.768993+0000","last_peered":"2024-03-23T23:42:50.768993+0000","last_clean":"2024-03-23T23:42:50.768993+0000","last_became_active":"2024-03-23T23:42:49.737196+0000","last_became_peered":"2024-03-23T23:42:49.737196+0000","last_unstale":"2024-03-23T23:42:50.768993+0000","last_undegraded":"2024-03-23T23:42:50.768993+0000","last_fullsized":"2024-03-23T23:42:50.768993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:49:42.789292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.329037+0000","last_change":"2024-03-23T23:42:50.763308+0000","last_active":"2024-03-23T23:42:52.329037+0000","last_peered":"2024-03-23T23:42:52.329037+0000","last_clean":"2024-03-23T23:42:52.329037+0000","last_became_active":"2024-03-23T23:42:50.763007+0000","last_became_peered":"2024-03-23T23:42:50.763007+0000","last_unstale":"2024-03-23T23:42:52.329037+0000","last_undegraded":"2024-03-23T23:42:52.329037+0000","last_fullsized":"2024-03-23T23:42:52.329037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:32:46.055472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.741840+0000","last_change":"2024-03-23T23:42:40.675570+0000","last_active":"2024-03-23T23:42:50.741840+0000","last_peered":"2024-03-23T23:42:50.741840+0000","last_clean":"2024-03-23T23:42:50.741840+0000","last_became_active":"2024-03-23T23:42:40.674390+0000","last_became_peered":"2024-03-23T23:42:40.674390+0000","last_unstale":"2024-03-23T23:42:50.741840+0000","last_undegraded":"2024-03-23T23:42:50.741840+0000","last_fullsized":"2024-03-23T23:42:50.741840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:31:34.412092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.741639+0000","last_change":"2024-03-23T23:42:39.690057+0000","last_active":"2024-03-23T23:42:50.741639+0000","last_peered":"2024-03-23T23:42:50.741639+0000","last_clean":"2024-03-23T23:42:50.741639+0000","last_became_active":"2024-03-23T23:42:39.689763+0000","last_became_peered":"2024-03-23T23:42:39.689763+0000","last_unstale":"2024-03-23T23:42:50.741639+0000","last_undegraded":"2024-03-23T23:42:50.741639+0000","last_fullsized":"2024-03-23T23:42:50.741639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:01.607584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.752173+0000","last_change":"2024-03-23T23:42:49.734213+0000","last_active":"2024-03-23T23:42:50.752173+0000","last_peered":"2024-03-23T23:42:50.752173+0000","last_clean":"2024-03-23T23:42:50.752173+0000","last_became_active":"2024-03-23T23:42:49.733115+0000","last_became_peered":"2024-03-23T23:42:49.733115+0000","last_unstale":"2024-03-23T23:42:50.752173+0000","last_undegraded":"2024-03-23T23:42:50.752173+0000","last_fullsized":"2024-03-23T23:42:50.752173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:18:12.997092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.764790+0000","last_change":"2024-03-23T23:42:50.759000+0000","last_active":"2024-03-23T23:42:50.764790+0000","last_peered":"2024-03-23T23:42:50.764790+0000","last_clean":"2024-03-23T23:42:50.764790+0000","last_became_active":"2024-03-23T23:42:50.758552+0000","last_became_peered":"2024-03-23T23:42:50.758552+0000","last_unstale":"2024-03-23T23:42:50.764790+0000","last_undegraded":"2024-03-23T23:42:50.764790+0000","last_fullsized":"2024-03-23T23:42:50.764790+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:42:23.236324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327764+0000","last_change":"2024-03-23T23:42:40.700998+0000","last_active":"2024-03-23T23:42:52.327764+0000","last_peered":"2024-03-23T23:42:52.327764+0000","last_clean":"2024-03-23T23:42:52.327764+0000","last_became_active":"2024-03-23T23:42:40.700788+0000","last_became_peered":"2024-03-23T23:42:40.700788+0000","last_unstale":"2024-03-23T23:42:52.327764+0000","last_undegraded":"2024-03-23T23:42:52.327764+0000","last_fullsized":"2024-03-23T23:42:52.327764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:14:44.739525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328524+0000","last_change":"2024-03-23T23:42:39.687712+0000","last_active":"2024-03-23T23:42:52.328524+0000","last_peered":"2024-03-23T23:42:52.328524+0000","last_clean":"2024-03-23T23:42:52.328524+0000","last_became_active":"2024-03-23T23:42:39.687378+0000","last_became_peered":"2024-03-23T23:42:39.687378+0000","last_unstale":"2024-03-23T23:42:52.328524+0000","last_undegraded":"2024-03-23T23:42:52.328524+0000","last_fullsized":"2024-03-23T23:42:52.328524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:20:38.456655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":176,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.741726+0000","last_change":"2024-03-23T23:42:27.940270+0000","last_active":"2024-03-23T23:42:50.741726+0000","last_peered":"2024-03-23T23:42:50.741726+0000","last_clean":"2024-03-23T23:42:50.741726+0000","last_became_active":"2024-03-23T23:42:27.939061+0000","last_became_peered":"2024-03-23T23:42:27.939061+0000","last_unstale":"2024-03-23T23:42:50.741726+0000","last_undegraded":"2024-03-23T23:42:50.741726+0000","last_fullsized":"2024-03-23T23:42:50.741726+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:26.509742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:26.509742+0000","last_clean_scrub_stamp":"2024-03-23T23:42:26.509742+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:49.258623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752132+0000","last_change":"2024-03-23T23:42:49.729231+0000","last_active":"2024-03-23T23:42:51.752132+0000","last_peered":"2024-03-23T23:42:51.752132+0000","last_clean":"2024-03-23T23:42:51.752132+0000","last_became_active":"2024-03-23T23:42:49.728990+0000","last_became_peered":"2024-03-23T23:42:49.728990+0000","last_unstale":"2024-03-23T23:42:51.752132+0000","last_undegraded":"2024-03-23T23:42:51.752132+0000","last_fullsized":"2024-03-23T23:42:51.752132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:01:04.035970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.768448+0000","last_change":"2024-03-23T23:42:50.757668+0000","last_active":"2024-03-23T23:42:50.768448+0000","last_peered":"2024-03-23T23:42:50.768448+0000","last_clean":"2024-03-23T23:42:50.768448+0000","last_became_active":"2024-03-23T23:42:50.756900+0000","last_became_peered":"2024-03-23T23:42:50.756900+0000","last_unstale":"2024-03-23T23:42:50.768448+0000","last_undegraded":"2024-03-23T23:42:50.768448+0000","last_fullsized":"2024-03-23T23:42:50.768448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:39:02.277570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.742497+0000","last_change":"2024-03-23T23:42:40.711591+0000","last_active":"2024-03-23T23:42:50.742497+0000","last_peered":"2024-03-23T23:42:50.742497+0000","last_clean":"2024-03-23T23:42:50.742497+0000","last_became_active":"2024-03-23T23:42:40.711306+0000","last_became_peered":"2024-03-23T23:42:40.711306+0000","last_unstale":"2024-03-23T23:42:50.742497+0000","last_undegraded":"2024-03-23T23:42:50.742497+0000","last_fullsized":"2024-03-23T23:42:50.742497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:34:16.693372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.743754+0000","last_change":"2024-03-23T23:42:39.684163+0000","last_active":"2024-03-23T23:42:50.743754+0000","last_peered":"2024-03-23T23:42:50.743754+0000","last_clean":"2024-03-23T23:42:50.743754+0000","last_became_active":"2024-03-23T23:42:39.683211+0000","last_became_peered":"2024-03-23T23:42:39.683211+0000","last_unstale":"2024-03-23T23:42:50.743754+0000","last_undegraded":"2024-03-23T23:42:50.743754+0000","last_fullsized":"2024-03-23T23:42:50.743754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:47:27.092873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751343+0000","last_change":"2024-03-23T23:42:49.735824+0000","last_active":"2024-03-23T23:42:51.751343+0000","last_peered":"2024-03-23T23:42:51.751343+0000","last_clean":"2024-03-23T23:42:51.751343+0000","last_became_active":"2024-03-23T23:42:49.735473+0000","last_became_peered":"2024-03-23T23:42:49.735473+0000","last_unstale":"2024-03-23T23:42:51.751343+0000","last_undegraded":"2024-03-23T23:42:51.751343+0000","last_fullsized":"2024-03-23T23:42:51.751343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:44:12.438729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.758361+0000","last_change":"2024-03-23T23:42:50.745563+0000","last_active":"2024-03-23T23:42:50.758361+0000","last_peered":"2024-03-23T23:42:50.758361+0000","last_clean":"2024-03-23T23:42:50.758361+0000","last_became_active":"2024-03-23T23:42:50.745256+0000","last_became_peered":"2024-03-23T23:42:50.745256+0000","last_unstale":"2024-03-23T23:42:50.758361+0000","last_undegraded":"2024-03-23T23:42:50.758361+0000","last_fullsized":"2024-03-23T23:42:50.758361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:51:40.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328628+0000","last_change":"2024-03-23T23:42:40.700124+0000","last_active":"2024-03-23T23:42:52.328628+0000","last_peered":"2024-03-23T23:42:52.328628+0000","last_clean":"2024-03-23T23:42:52.328628+0000","last_became_active":"2024-03-23T23:42:40.697369+0000","last_became_peered":"2024-03-23T23:42:40.697369+0000","last_unstale":"2024-03-23T23:42:52.328628+0000","last_undegraded":"2024-03-23T23:42:52.328628+0000","last_fullsized":"2024-03-23T23:42:52.328628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:20.981139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.742387+0000","last_change":"2024-03-23T23:42:39.681013+0000","last_active":"2024-03-23T23:42:50.742387+0000","last_peered":"2024-03-23T23:42:50.742387+0000","last_clean":"2024-03-23T23:42:50.742387+0000","last_became_active":"2024-03-23T23:42:39.680669+0000","last_became_peered":"2024-03-23T23:42:39.680669+0000","last_unstale":"2024-03-23T23:42:50.742387+0000","last_undegraded":"2024-03-23T23:42:50.742387+0000","last_fullsized":"2024-03-23T23:42:50.742387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:58:07.880313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.773188+0000","last_change":"2024-03-23T23:42:49.736747+0000","last_active":"2024-03-23T23:42:50.773188+0000","last_peered":"2024-03-23T23:42:50.773188+0000","last_clean":"2024-03-23T23:42:50.773188+0000","last_became_active":"2024-03-23T23:42:49.734508+0000","last_became_peered":"2024-03-23T23:42:49.734508+0000","last_unstale":"2024-03-23T23:42:50.773188+0000","last_undegraded":"2024-03-23T23:42:50.773188+0000","last_fullsized":"2024-03-23T23:42:50.773188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:54.356082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.756623+0000","last_change":"2024-03-23T23:42:50.751141+0000","last_active":"2024-03-23T23:42:50.756623+0000","last_peered":"2024-03-23T23:42:50.756623+0000","last_clean":"2024-03-23T23:42:50.756623+0000","last_became_active":"2024-03-23T23:42:50.750269+0000","last_became_peered":"2024-03-23T23:42:50.750269+0000","last_unstale":"2024-03-23T23:42:50.756623+0000","last_undegraded":"2024-03-23T23:42:50.756623+0000","last_fullsized":"2024-03-23T23:42:50.756623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:41:15.676389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.744768+0000","last_change":"2024-03-23T23:42:40.706713+0000","last_active":"2024-03-23T23:42:50.744768+0000","last_peered":"2024-03-23T23:42:50.744768+0000","last_clean":"2024-03-23T23:42:50.744768+0000","last_became_active":"2024-03-23T23:42:40.704328+0000","last_became_peered":"2024-03-23T23:42:40.704328+0000","last_unstale":"2024-03-23T23:42:50.744768+0000","last_undegraded":"2024-03-23T23:42:50.744768+0000","last_fullsized":"2024-03-23T23:42:50.744768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:15:52.261572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.743478+0000","last_change":"2024-03-23T23:42:39.681906+0000","last_active":"2024-03-23T23:42:50.743478+0000","last_peered":"2024-03-23T23:42:50.743478+0000","last_clean":"2024-03-23T23:42:50.743478+0000","last_became_active":"2024-03-23T23:42:39.680506+0000","last_became_peered":"2024-03-23T23:42:39.680506+0000","last_unstale":"2024-03-23T23:42:50.743478+0000","last_undegraded":"2024-03-23T23:42:50.743478+0000","last_fullsized":"2024-03-23T23:42:50.743478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:44:07.213123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328020+0000","last_change":"2024-03-23T23:42:49.737735+0000","last_active":"2024-03-23T23:42:52.328020+0000","last_peered":"2024-03-23T23:42:52.328020+0000","last_clean":"2024-03-23T23:42:52.328020+0000","last_became_active":"2024-03-23T23:42:49.737434+0000","last_became_peered":"2024-03-23T23:42:49.737434+0000","last_unstale":"2024-03-23T23:42:52.328020+0000","last_undegraded":"2024-03-23T23:42:52.328020+0000","last_fullsized":"2024-03-23T23:42:52.328020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:58:10.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.758816+0000","last_change":"2024-03-23T23:42:50.746922+0000","last_active":"2024-03-23T23:42:50.758816+0000","last_peered":"2024-03-23T23:42:50.758816+0000","last_clean":"2024-03-23T23:42:50.758816+0000","last_became_active":"2024-03-23T23:42:50.746105+0000","last_became_peered":"2024-03-23T23:42:50.746105+0000","last_unstale":"2024-03-23T23:42:50.758816+0000","last_undegraded":"2024-03-23T23:42:50.758816+0000","last_fullsized":"2024-03-23T23:42:50.758816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:27:13.189191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.741515+0000","last_change":"2024-03-23T23:42:40.696584+0000","last_active":"2024-03-23T23:42:50.741515+0000","last_peered":"2024-03-23T23:42:50.741515+0000","last_clean":"2024-03-23T23:42:50.741515+0000","last_became_active":"2024-03-23T23:42:40.696141+0000","last_became_peered":"2024-03-23T23:42:40.696141+0000","last_unstale":"2024-03-23T23:42:50.741515+0000","last_undegraded":"2024-03-23T23:42:50.741515+0000","last_fullsized":"2024-03-23T23:42:50.741515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:45.303477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752716+0000","last_change":"2024-03-23T23:42:39.686863+0000","last_active":"2024-03-23T23:42:51.752716+0000","last_peered":"2024-03-23T23:42:51.752716+0000","last_clean":"2024-03-23T23:42:51.752716+0000","last_became_active":"2024-03-23T23:42:39.686491+0000","last_became_peered":"2024-03-23T23:42:39.686491+0000","last_unstale":"2024-03-23T23:42:51.752716+0000","last_undegraded":"2024-03-23T23:42:51.752716+0000","last_fullsized":"2024-03-23T23:42:51.752716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:38:13.752628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751016+0000","last_change":"2024-03-23T23:42:49.733982+0000","last_active":"2024-03-23T23:42:51.751016+0000","last_peered":"2024-03-23T23:42:51.751016+0000","last_clean":"2024-03-23T23:42:51.751016+0000","last_became_active":"2024-03-23T23:42:49.733389+0000","last_became_peered":"2024-03-23T23:42:49.733389+0000","last_unstale":"2024-03-23T23:42:51.751016+0000","last_undegraded":"2024-03-23T23:42:51.751016+0000","last_fullsized":"2024-03-23T23:42:51.751016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:13.685893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328287+0000","last_change":"2024-03-23T23:42:50.764083+0000","last_active":"2024-03-23T23:42:52.328287+0000","last_peered":"2024-03-23T23:42:52.328287+0000","last_clean":"2024-03-23T23:42:52.328287+0000","last_became_active":"2024-03-23T23:42:50.763871+0000","last_became_peered":"2024-03-23T23:42:50.763871+0000","last_unstale":"2024-03-23T23:42:52.328287+0000","last_undegraded":"2024-03-23T23:42:52.328287+0000","last_fullsized":"2024-03-23T23:42:52.328287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:32:46.055472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.743006+0000","last_change":"2024-03-23T23:42:40.700961+0000","last_active":"2024-03-23T23:42:50.743006+0000","last_peered":"2024-03-23T23:42:50.743006+0000","last_clean":"2024-03-23T23:42:50.743006+0000","last_became_active":"2024-03-23T23:42:40.700800+0000","last_became_peered":"2024-03-23T23:42:40.700800+0000","last_unstale":"2024-03-23T23:42:50.743006+0000","last_undegraded":"2024-03-23T23:42:50.743006+0000","last_fullsized":"2024-03-23T23:42:50.743006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:54:27.641281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.738856+0000","last_change":"2024-03-23T23:42:39.676075+0000","last_active":"2024-03-23T23:42:50.738856+0000","last_peered":"2024-03-23T23:42:50.738856+0000","last_clean":"2024-03-23T23:42:50.738856+0000","last_became_active":"2024-03-23T23:42:39.675770+0000","last_became_peered":"2024-03-23T23:42:39.675770+0000","last_unstale":"2024-03-23T23:42:50.738856+0000","last_undegraded":"2024-03-23T23:42:50.738856+0000","last_fullsized":"2024-03-23T23:42:50.738856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:24:11.933075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.752384+0000","last_change":"2024-03-23T23:42:49.739529+0000","last_active":"2024-03-23T23:42:50.752384+0000","last_peered":"2024-03-23T23:42:50.752384+0000","last_clean":"2024-03-23T23:42:50.752384+0000","last_became_active":"2024-03-23T23:42:49.738053+0000","last_became_peered":"2024-03-23T23:42:49.738053+0000","last_unstale":"2024-03-23T23:42:50.752384+0000","last_undegraded":"2024-03-23T23:42:50.752384+0000","last_fullsized":"2024-03-23T23:42:50.752384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:52:57.561036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328637+0000","last_change":"2024-03-23T23:42:50.771347+0000","last_active":"2024-03-23T23:42:52.328637+0000","last_peered":"2024-03-23T23:42:52.328637+0000","last_clean":"2024-03-23T23:42:52.328637+0000","last_became_active":"2024-03-23T23:42:50.770998+0000","last_became_peered":"2024-03-23T23:42:50.770998+0000","last_unstale":"2024-03-23T23:42:52.328637+0000","last_undegraded":"2024-03-23T23:42:52.328637+0000","last_fullsized":"2024-03-23T23:42:52.328637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:57:04.394872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750921+0000","last_change":"2024-03-23T23:42:40.677314+0000","last_active":"2024-03-23T23:42:51.750921+0000","last_peered":"2024-03-23T23:42:51.750921+0000","last_clean":"2024-03-23T23:42:51.750921+0000","last_became_active":"2024-03-23T23:42:40.675416+0000","last_became_peered":"2024-03-23T23:42:40.675416+0000","last_unstale":"2024-03-23T23:42:51.750921+0000","last_undegraded":"2024-03-23T23:42:51.750921+0000","last_fullsized":"2024-03-23T23:42:51.750921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:01:06.338641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751663+0000","last_change":"2024-03-23T23:42:39.681827+0000","last_active":"2024-03-23T23:42:51.751663+0000","last_peered":"2024-03-23T23:42:51.751663+0000","last_clean":"2024-03-23T23:42:51.751663+0000","last_became_active":"2024-03-23T23:42:39.681418+0000","last_became_peered":"2024-03-23T23:42:39.681418+0000","last_unstale":"2024-03-23T23:42:51.751663+0000","last_undegraded":"2024-03-23T23:42:51.751663+0000","last_fullsized":"2024-03-23T23:42:51.751663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:50.559059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328221+0000","last_change":"2024-03-23T23:42:49.744708+0000","last_active":"2024-03-23T23:42:52.328221+0000","last_peered":"2024-03-23T23:42:52.328221+0000","last_clean":"2024-03-23T23:42:52.328221+0000","last_became_active":"2024-03-23T23:42:49.744422+0000","last_became_peered":"2024-03-23T23:42:49.744422+0000","last_unstale":"2024-03-23T23:42:52.328221+0000","last_undegraded":"2024-03-23T23:42:52.328221+0000","last_fullsized":"2024-03-23T23:42:52.328221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:25:43.889950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328641+0000","last_change":"2024-03-23T23:42:50.753064+0000","last_active":"2024-03-23T23:42:52.328641+0000","last_peered":"2024-03-23T23:42:52.328641+0000","last_clean":"2024-03-23T23:42:52.328641+0000","last_became_active":"2024-03-23T23:42:50.752783+0000","last_became_peered":"2024-03-23T23:42:50.752783+0000","last_unstale":"2024-03-23T23:42:52.328641+0000","last_undegraded":"2024-03-23T23:42:52.328641+0000","last_fullsized":"2024-03-23T23:42:52.328641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:39:49.888359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.740061+0000","last_change":"2024-03-23T23:42:40.704046+0000","last_active":"2024-03-23T23:42:50.740061+0000","last_peered":"2024-03-23T23:42:50.740061+0000","last_clean":"2024-03-23T23:42:50.740061+0000","last_became_active":"2024-03-23T23:42:40.703787+0000","last_became_peered":"2024-03-23T23:42:40.703787+0000","last_unstale":"2024-03-23T23:42:50.740061+0000","last_undegraded":"2024-03-23T23:42:50.740061+0000","last_fullsized":"2024-03-23T23:42:50.740061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:16:16.737284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328439+0000","last_change":"2024-03-23T23:42:39.688483+0000","last_active":"2024-03-23T23:42:52.328439+0000","last_peered":"2024-03-23T23:42:52.328439+0000","last_clean":"2024-03-23T23:42:52.328439+0000","last_became_active":"2024-03-23T23:42:39.688141+0000","last_became_peered":"2024-03-23T23:42:39.688141+0000","last_unstale":"2024-03-23T23:42:52.328439+0000","last_undegraded":"2024-03-23T23:42:52.328439+0000","last_fullsized":"2024-03-23T23:42:52.328439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:32.254099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"24'6","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328127+0000","last_change":"2024-03-23T23:42:49.749027+0000","last_active":"2024-03-23T23:42:52.328127+0000","last_peered":"2024-03-23T23:42:52.328127+0000","last_clean":"2024-03-23T23:42:52.328127+0000","last_became_active":"2024-03-23T23:42:49.748687+0000","last_became_peered":"2024-03-23T23:42:49.748687+0000","last_unstale":"2024-03-23T23:42:52.328127+0000","last_undegraded":"2024-03-23T23:42:52.328127+0000","last_fullsized":"2024-03-23T23:42:52.328127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:27.818117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328083+0000","last_change":"2024-03-23T23:42:50.752273+0000","last_active":"2024-03-23T23:42:52.328083+0000","last_peered":"2024-03-23T23:42:52.328083+0000","last_clean":"2024-03-23T23:42:52.328083+0000","last_became_active":"2024-03-23T23:42:50.751874+0000","last_became_peered":"2024-03-23T23:42:50.751874+0000","last_unstale":"2024-03-23T23:42:52.328083+0000","last_undegraded":"2024-03-23T23:42:52.328083+0000","last_fullsized":"2024-03-23T23:42:52.328083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:20:53.750917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.742403+0000","last_change":"2024-03-23T23:42:40.688909+0000","last_active":"2024-03-23T23:42:50.742403+0000","last_peered":"2024-03-23T23:42:50.742403+0000","last_clean":"2024-03-23T23:42:50.742403+0000","last_became_active":"2024-03-23T23:42:40.688636+0000","last_became_peered":"2024-03-23T23:42:40.688636+0000","last_unstale":"2024-03-23T23:42:50.742403+0000","last_undegraded":"2024-03-23T23:42:50.742403+0000","last_fullsized":"2024-03-23T23:42:50.742403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:26:16.171920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.749902+0000","last_change":"2024-03-23T23:42:39.681926+0000","last_active":"2024-03-23T23:42:50.749902+0000","last_peered":"2024-03-23T23:42:50.749902+0000","last_clean":"2024-03-23T23:42:50.749902+0000","last_became_active":"2024-03-23T23:42:39.681028+0000","last_became_peered":"2024-03-23T23:42:39.681028+0000","last_unstale":"2024-03-23T23:42:50.749902+0000","last_undegraded":"2024-03-23T23:42:50.749902+0000","last_fullsized":"2024-03-23T23:42:50.749902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:24:11.933075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328871+0000","last_change":"2024-03-23T23:42:49.741915+0000","last_active":"2024-03-23T23:42:52.328871+0000","last_peered":"2024-03-23T23:42:52.328871+0000","last_clean":"2024-03-23T23:42:52.328871+0000","last_became_active":"2024-03-23T23:42:49.741650+0000","last_became_peered":"2024-03-23T23:42:49.741650+0000","last_unstale":"2024-03-23T23:42:52.328871+0000","last_undegraded":"2024-03-23T23:42:52.328871+0000","last_fullsized":"2024-03-23T23:42:52.328871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:11:43.106922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327956+0000","last_change":"2024-03-23T23:42:50.752979+0000","last_active":"2024-03-23T23:42:52.327956+0000","last_peered":"2024-03-23T23:42:52.327956+0000","last_clean":"2024-03-23T23:42:52.327956+0000","last_became_active":"2024-03-23T23:42:50.751848+0000","last_became_peered":"2024-03-23T23:42:50.751848+0000","last_unstale":"2024-03-23T23:42:52.327956+0000","last_undegraded":"2024-03-23T23:42:52.327956+0000","last_fullsized":"2024-03-23T23:42:52.327956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:39:04.727316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.742414+0000","last_change":"2024-03-23T23:42:40.689988+0000","last_active":"2024-03-23T23:42:50.742414+0000","last_peered":"2024-03-23T23:42:50.742414+0000","last_clean":"2024-03-23T23:42:50.742414+0000","last_became_active":"2024-03-23T23:42:40.689477+0000","last_became_peered":"2024-03-23T23:42:40.689477+0000","last_unstale":"2024-03-23T23:42:50.742414+0000","last_undegraded":"2024-03-23T23:42:50.742414+0000","last_fullsized":"2024-03-23T23:42:50.742414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:46:30.427072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752122+0000","last_change":"2024-03-23T23:42:39.689429+0000","last_active":"2024-03-23T23:42:51.752122+0000","last_peered":"2024-03-23T23:42:51.752122+0000","last_clean":"2024-03-23T23:42:51.752122+0000","last_became_active":"2024-03-23T23:42:39.688066+0000","last_became_peered":"2024-03-23T23:42:39.688066+0000","last_unstale":"2024-03-23T23:42:51.752122+0000","last_undegraded":"2024-03-23T23:42:51.752122+0000","last_fullsized":"2024-03-23T23:42:51.752122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:32.254099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.740679+0000","last_change":"2024-03-23T23:42:49.733543+0000","last_active":"2024-03-23T23:42:50.740679+0000","last_peered":"2024-03-23T23:42:50.740679+0000","last_clean":"2024-03-23T23:42:50.740679+0000","last_became_active":"2024-03-23T23:42:49.733197+0000","last_became_peered":"2024-03-23T23:42:49.733197+0000","last_unstale":"2024-03-23T23:42:50.740679+0000","last_undegraded":"2024-03-23T23:42:50.740679+0000","last_fullsized":"2024-03-23T23:42:50.740679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:45:20.189501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.762064+0000","last_change":"2024-03-23T23:42:50.756687+0000","last_active":"2024-03-23T23:42:50.762064+0000","last_peered":"2024-03-23T23:42:50.762064+0000","last_clean":"2024-03-23T23:42:50.762064+0000","last_became_active":"2024-03-23T23:42:50.756371+0000","last_became_peered":"2024-03-23T23:42:50.756371+0000","last_unstale":"2024-03-23T23:42:50.762064+0000","last_undegraded":"2024-03-23T23:42:50.762064+0000","last_fullsized":"2024-03-23T23:42:50.762064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:52:48.699642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752229+0000","last_change":"2024-03-23T23:42:40.683025+0000","last_active":"2024-03-23T23:42:51.752229+0000","last_peered":"2024-03-23T23:42:51.752229+0000","last_clean":"2024-03-23T23:42:51.752229+0000","last_became_active":"2024-03-23T23:42:40.682798+0000","last_became_peered":"2024-03-23T23:42:40.682798+0000","last_unstale":"2024-03-23T23:42:51.752229+0000","last_undegraded":"2024-03-23T23:42:51.752229+0000","last_fullsized":"2024-03-23T23:42:51.752229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:51.565112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.742281+0000","last_change":"2024-03-23T23:42:39.681675+0000","last_active":"2024-03-23T23:42:50.742281+0000","last_peered":"2024-03-23T23:42:50.742281+0000","last_clean":"2024-03-23T23:42:50.742281+0000","last_became_active":"2024-03-23T23:42:39.681364+0000","last_became_peered":"2024-03-23T23:42:39.681364+0000","last_unstale":"2024-03-23T23:42:50.742281+0000","last_undegraded":"2024-03-23T23:42:50.742281+0000","last_fullsized":"2024-03-23T23:42:50.742281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:42:37.702720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751398+0000","last_change":"2024-03-23T23:42:49.723350+0000","last_active":"2024-03-23T23:42:51.751398+0000","last_peered":"2024-03-23T23:42:51.751398+0000","last_clean":"2024-03-23T23:42:51.751398+0000","last_became_active":"2024-03-23T23:42:49.723058+0000","last_became_peered":"2024-03-23T23:42:49.723058+0000","last_unstale":"2024-03-23T23:42:51.751398+0000","last_undegraded":"2024-03-23T23:42:51.751398+0000","last_fullsized":"2024-03-23T23:42:51.751398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:43:02.835034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751554+0000","last_change":"2024-03-23T23:42:50.746422+0000","last_active":"2024-03-23T23:42:51.751554+0000","last_peered":"2024-03-23T23:42:51.751554+0000","last_clean":"2024-03-23T23:42:51.751554+0000","last_became_active":"2024-03-23T23:42:50.746104+0000","last_became_peered":"2024-03-23T23:42:50.746104+0000","last_unstale":"2024-03-23T23:42:51.751554+0000","last_undegraded":"2024-03-23T23:42:51.751554+0000","last_fullsized":"2024-03-23T23:42:51.751554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:40:34.077584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.752039+0000","last_change":"2024-03-23T23:42:40.700381+0000","last_active":"2024-03-23T23:42:50.752039+0000","last_peered":"2024-03-23T23:42:50.752039+0000","last_clean":"2024-03-23T23:42:50.752039+0000","last_became_active":"2024-03-23T23:42:40.698428+0000","last_became_peered":"2024-03-23T23:42:40.698428+0000","last_unstale":"2024-03-23T23:42:50.752039+0000","last_undegraded":"2024-03-23T23:42:50.752039+0000","last_fullsized":"2024-03-23T23:42:50.752039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:07:29.242921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328837+0000","last_change":"2024-03-23T23:42:39.691092+0000","last_active":"2024-03-23T23:42:52.328837+0000","last_peered":"2024-03-23T23:42:52.328837+0000","last_clean":"2024-03-23T23:42:52.328837+0000","last_became_active":"2024-03-23T23:42:39.687473+0000","last_became_peered":"2024-03-23T23:42:39.687473+0000","last_unstale":"2024-03-23T23:42:52.328837+0000","last_undegraded":"2024-03-23T23:42:52.328837+0000","last_fullsized":"2024-03-23T23:42:52.328837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:08:03.578884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327476+0000","last_change":"2024-03-23T23:42:49.748693+0000","last_active":"2024-03-23T23:42:52.327476+0000","last_peered":"2024-03-23T23:42:52.327476+0000","last_clean":"2024-03-23T23:42:52.327476+0000","last_became_active":"2024-03-23T23:42:49.748389+0000","last_became_peered":"2024-03-23T23:42:49.748389+0000","last_unstale":"2024-03-23T23:42:52.327476+0000","last_undegraded":"2024-03-23T23:42:52.327476+0000","last_fullsized":"2024-03-23T23:42:52.327476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:58:10.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.754875+0000","last_change":"2024-03-23T23:42:50.749547+0000","last_active":"2024-03-23T23:42:50.754875+0000","last_peered":"2024-03-23T23:42:50.754875+0000","last_clean":"2024-03-23T23:42:50.754875+0000","last_became_active":"2024-03-23T23:42:50.749066+0000","last_became_peered":"2024-03-23T23:42:50.749066+0000","last_unstale":"2024-03-23T23:42:50.754875+0000","last_undegraded":"2024-03-23T23:42:50.754875+0000","last_fullsized":"2024-03-23T23:42:50.754875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:52:58.565591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328727+0000","last_change":"2024-03-23T23:42:40.708795+0000","last_active":"2024-03-23T23:42:52.328727+0000","last_peered":"2024-03-23T23:42:52.328727+0000","last_clean":"2024-03-23T23:42:52.328727+0000","last_became_active":"2024-03-23T23:42:40.708199+0000","last_became_peered":"2024-03-23T23:42:40.708199+0000","last_unstale":"2024-03-23T23:42:52.328727+0000","last_undegraded":"2024-03-23T23:42:52.328727+0000","last_fullsized":"2024-03-23T23:42:52.328727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:53.782430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.753135+0000","last_change":"2024-03-23T23:42:39.684669+0000","last_active":"2024-03-23T23:42:51.753135+0000","last_peered":"2024-03-23T23:42:51.753135+0000","last_clean":"2024-03-23T23:42:51.753135+0000","last_became_active":"2024-03-23T23:42:39.684360+0000","last_became_peered":"2024-03-23T23:42:39.684360+0000","last_unstale":"2024-03-23T23:42:51.753135+0000","last_undegraded":"2024-03-23T23:42:51.753135+0000","last_fullsized":"2024-03-23T23:42:51.753135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:19.914926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327466+0000","last_change":"2024-03-23T23:42:49.741577+0000","last_active":"2024-03-23T23:42:52.327466+0000","last_peered":"2024-03-23T23:42:52.327466+0000","last_clean":"2024-03-23T23:42:52.327466+0000","last_became_active":"2024-03-23T23:42:49.741270+0000","last_became_peered":"2024-03-23T23:42:49.741270+0000","last_unstale":"2024-03-23T23:42:52.327466+0000","last_undegraded":"2024-03-23T23:42:52.327466+0000","last_fullsized":"2024-03-23T23:42:52.327466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:11:43.106922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.753001+0000","last_change":"2024-03-23T23:42:50.751992+0000","last_active":"2024-03-23T23:42:51.753001+0000","last_peered":"2024-03-23T23:42:51.753001+0000","last_clean":"2024-03-23T23:42:51.753001+0000","last_became_active":"2024-03-23T23:42:50.748281+0000","last_became_peered":"2024-03-23T23:42:50.748281+0000","last_unstale":"2024-03-23T23:42:51.753001+0000","last_undegraded":"2024-03-23T23:42:51.753001+0000","last_fullsized":"2024-03-23T23:42:51.753001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:57.968968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.772193+0000","last_change":"2024-03-23T23:42:49.741658+0000","last_active":"2024-03-23T23:42:50.772193+0000","last_peered":"2024-03-23T23:42:50.772193+0000","last_clean":"2024-03-23T23:42:50.772193+0000","last_became_active":"2024-03-23T23:42:49.740899+0000","last_became_peered":"2024-03-23T23:42:49.740899+0000","last_unstale":"2024-03-23T23:42:50.772193+0000","last_undegraded":"2024-03-23T23:42:50.772193+0000","last_fullsized":"2024-03-23T23:42:50.772193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:45:20.189501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.740195+0000","last_change":"2024-03-23T23:42:40.679384+0000","last_active":"2024-03-23T23:42:50.740195+0000","last_peered":"2024-03-23T23:42:50.740195+0000","last_clean":"2024-03-23T23:42:50.740195+0000","last_became_active":"2024-03-23T23:42:40.679070+0000","last_became_peered":"2024-03-23T23:42:40.679070+0000","last_unstale":"2024-03-23T23:42:50.740195+0000","last_undegraded":"2024-03-23T23:42:50.740195+0000","last_fullsized":"2024-03-23T23:42:50.740195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:26:16.171920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328187+0000","last_change":"2024-03-23T23:42:39.682839+0000","last_active":"2024-03-23T23:42:52.328187+0000","last_peered":"2024-03-23T23:42:52.328187+0000","last_clean":"2024-03-23T23:42:52.328187+0000","last_became_active":"2024-03-23T23:42:39.682584+0000","last_became_peered":"2024-03-23T23:42:39.682584+0000","last_unstale":"2024-03-23T23:42:52.328187+0000","last_undegraded":"2024-03-23T23:42:52.328187+0000","last_fullsized":"2024-03-23T23:42:52.328187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:19.914926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.754651+0000","last_change":"2024-03-23T23:42:50.752596+0000","last_active":"2024-03-23T23:42:50.754651+0000","last_peered":"2024-03-23T23:42:50.754651+0000","last_clean":"2024-03-23T23:42:50.754651+0000","last_became_active":"2024-03-23T23:42:50.751598+0000","last_became_peered":"2024-03-23T23:42:50.751598+0000","last_unstale":"2024-03-23T23:42:50.754651+0000","last_undegraded":"2024-03-23T23:42:50.754651+0000","last_fullsized":"2024-03-23T23:42:50.754651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:45:20.249866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.753080+0000","last_change":"2024-03-23T23:42:49.734629+0000","last_active":"2024-03-23T23:42:51.753080+0000","last_peered":"2024-03-23T23:42:51.753080+0000","last_clean":"2024-03-23T23:42:51.753080+0000","last_became_active":"2024-03-23T23:42:49.734309+0000","last_became_peered":"2024-03-23T23:42:49.734309+0000","last_unstale":"2024-03-23T23:42:51.753080+0000","last_undegraded":"2024-03-23T23:42:51.753080+0000","last_fullsized":"2024-03-23T23:42:51.753080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:46.760020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327687+0000","last_change":"2024-03-23T23:42:40.674605+0000","last_active":"2024-03-23T23:42:52.327687+0000","last_peered":"2024-03-23T23:42:52.327687+0000","last_clean":"2024-03-23T23:42:52.327687+0000","last_became_active":"2024-03-23T23:42:40.674366+0000","last_became_peered":"2024-03-23T23:42:40.674366+0000","last_unstale":"2024-03-23T23:42:52.327687+0000","last_undegraded":"2024-03-23T23:42:52.327687+0000","last_fullsized":"2024-03-23T23:42:52.327687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327666+0000","last_change":"2024-03-23T23:42:39.688646+0000","last_active":"2024-03-23T23:42:52.327666+0000","last_peered":"2024-03-23T23:42:52.327666+0000","last_clean":"2024-03-23T23:42:52.327666+0000","last_became_active":"2024-03-23T23:42:39.687489+0000","last_became_peered":"2024-03-23T23:42:39.687489+0000","last_unstale":"2024-03-23T23:42:52.327666+0000","last_undegraded":"2024-03-23T23:42:52.327666+0000","last_fullsized":"2024-03-23T23:42:52.327666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:07:12.649156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.760829+0000","last_change":"2024-03-23T23:42:50.748511+0000","last_active":"2024-03-23T23:42:50.760829+0000","last_peered":"2024-03-23T23:42:50.760829+0000","last_clean":"2024-03-23T23:42:50.760829+0000","last_became_active":"2024-03-23T23:42:50.747154+0000","last_became_peered":"2024-03-23T23:42:50.747154+0000","last_unstale":"2024-03-23T23:42:50.760829+0000","last_undegraded":"2024-03-23T23:42:50.760829+0000","last_fullsized":"2024-03-23T23:42:50.760829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:45:20.249866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751549+0000","last_change":"2024-03-23T23:42:39.681458+0000","last_active":"2024-03-23T23:42:51.751549+0000","last_peered":"2024-03-23T23:42:51.751549+0000","last_clean":"2024-03-23T23:42:51.751549+0000","last_became_active":"2024-03-23T23:42:39.681158+0000","last_became_peered":"2024-03-23T23:42:39.681158+0000","last_unstale":"2024-03-23T23:42:51.751549+0000","last_undegraded":"2024-03-23T23:42:51.751549+0000","last_fullsized":"2024-03-23T23:42:51.751549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:08:03.578884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.749806+0000","last_change":"2024-03-23T23:42:40.676571+0000","last_active":"2024-03-23T23:42:50.749806+0000","last_peered":"2024-03-23T23:42:50.749806+0000","last_clean":"2024-03-23T23:42:50.749806+0000","last_became_active":"2024-03-23T23:42:40.675877+0000","last_became_peered":"2024-03-23T23:42:40.675877+0000","last_unstale":"2024-03-23T23:42:50.749806+0000","last_undegraded":"2024-03-23T23:42:50.749806+0000","last_fullsized":"2024-03-23T23:42:50.749806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:52.220411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.773575+0000","last_change":"2024-03-23T23:42:49.734208+0000","last_active":"2024-03-23T23:42:50.773575+0000","last_peered":"2024-03-23T23:42:50.773575+0000","last_clean":"2024-03-23T23:42:50.773575+0000","last_became_active":"2024-03-23T23:42:49.732943+0000","last_became_peered":"2024-03-23T23:42:49.732943+0000","last_unstale":"2024-03-23T23:42:50.773575+0000","last_undegraded":"2024-03-23T23:42:50.773575+0000","last_fullsized":"2024-03-23T23:42:50.773575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:43.683275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751832+0000","last_change":"2024-03-23T23:42:50.752722+0000","last_active":"2024-03-23T23:42:51.751832+0000","last_peered":"2024-03-23T23:42:51.751832+0000","last_clean":"2024-03-23T23:42:51.751832+0000","last_became_active":"2024-03-23T23:42:50.749400+0000","last_became_peered":"2024-03-23T23:42:50.749400+0000","last_unstale":"2024-03-23T23:42:51.751832+0000","last_undegraded":"2024-03-23T23:42:51.751832+0000","last_fullsized":"2024-03-23T23:42:51.751832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:16:44.027189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328094+0000","last_change":"2024-03-23T23:42:39.688422+0000","last_active":"2024-03-23T23:42:52.328094+0000","last_peered":"2024-03-23T23:42:52.328094+0000","last_clean":"2024-03-23T23:42:52.328094+0000","last_became_active":"2024-03-23T23:42:39.687423+0000","last_became_peered":"2024-03-23T23:42:39.687423+0000","last_unstale":"2024-03-23T23:42:52.328094+0000","last_undegraded":"2024-03-23T23:42:52.328094+0000","last_fullsized":"2024-03-23T23:42:52.328094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:20:38.456655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751184+0000","last_change":"2024-03-23T23:42:40.680801+0000","last_active":"2024-03-23T23:42:51.751184+0000","last_peered":"2024-03-23T23:42:51.751184+0000","last_clean":"2024-03-23T23:42:51.751184+0000","last_became_active":"2024-03-23T23:42:40.680511+0000","last_became_peered":"2024-03-23T23:42:40.680511+0000","last_unstale":"2024-03-23T23:42:51.751184+0000","last_undegraded":"2024-03-23T23:42:51.751184+0000","last_fullsized":"2024-03-23T23:42:51.751184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:27:42.392714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328321+0000","last_change":"2024-03-23T23:42:49.751291+0000","last_active":"2024-03-23T23:42:52.328321+0000","last_peered":"2024-03-23T23:42:52.328321+0000","last_clean":"2024-03-23T23:42:52.328321+0000","last_became_active":"2024-03-23T23:42:49.749695+0000","last_became_peered":"2024-03-23T23:42:49.749695+0000","last_unstale":"2024-03-23T23:42:52.328321+0000","last_undegraded":"2024-03-23T23:42:52.328321+0000","last_fullsized":"2024-03-23T23:42:52.328321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:40:33.073029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328522+0000","last_change":"2024-03-23T23:42:50.752672+0000","last_active":"2024-03-23T23:42:52.328522+0000","last_peered":"2024-03-23T23:42:52.328522+0000","last_clean":"2024-03-23T23:42:52.328522+0000","last_became_active":"2024-03-23T23:42:50.752394+0000","last_became_peered":"2024-03-23T23:42:50.752394+0000","last_unstale":"2024-03-23T23:42:52.328522+0000","last_undegraded":"2024-03-23T23:42:52.328522+0000","last_fullsized":"2024-03-23T23:42:52.328522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:51:01.385876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750919+0000","last_change":"2024-03-23T23:42:40.679042+0000","last_active":"2024-03-23T23:42:51.750919+0000","last_peered":"2024-03-23T23:42:51.750919+0000","last_clean":"2024-03-23T23:42:51.750919+0000","last_became_active":"2024-03-23T23:42:40.678518+0000","last_became_peered":"2024-03-23T23:42:40.678518+0000","last_unstale":"2024-03-23T23:42:51.750919+0000","last_undegraded":"2024-03-23T23:42:51.750919+0000","last_fullsized":"2024-03-23T23:42:51.750919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:12:14.359173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.761949+0000","last_change":"2024-03-23T23:42:50.757132+0000","last_active":"2024-03-23T23:42:50.761949+0000","last_peered":"2024-03-23T23:42:50.761949+0000","last_clean":"2024-03-23T23:42:50.761949+0000","last_became_active":"2024-03-23T23:42:50.756813+0000","last_became_peered":"2024-03-23T23:42:50.756813+0000","last_unstale":"2024-03-23T23:42:50.761949+0000","last_undegraded":"2024-03-23T23:42:50.761949+0000","last_fullsized":"2024-03-23T23:42:50.761949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:37:19.741781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.739000+0000","last_change":"2024-03-23T23:42:40.702411+0000","last_active":"2024-03-23T23:42:50.739000+0000","last_peered":"2024-03-23T23:42:50.739000+0000","last_clean":"2024-03-23T23:42:50.739000+0000","last_became_active":"2024-03-23T23:42:40.701398+0000","last_became_peered":"2024-03-23T23:42:40.701398+0000","last_unstale":"2024-03-23T23:42:50.739000+0000","last_undegraded":"2024-03-23T23:42:50.739000+0000","last_fullsized":"2024-03-23T23:42:50.739000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:03.196963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328386+0000","last_change":"2024-03-23T23:42:50.756769+0000","last_active":"2024-03-23T23:42:52.328386+0000","last_peered":"2024-03-23T23:42:52.328386+0000","last_clean":"2024-03-23T23:42:52.328386+0000","last_became_active":"2024-03-23T23:42:50.756503+0000","last_became_peered":"2024-03-23T23:42:50.756503+0000","last_unstale":"2024-03-23T23:42:52.328386+0000","last_undegraded":"2024-03-23T23:42:52.328386+0000","last_fullsized":"2024-03-23T23:42:52.328386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:50.597847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328394+0000","last_change":"2024-03-23T23:42:40.698519+0000","last_active":"2024-03-23T23:42:52.328394+0000","last_peered":"2024-03-23T23:42:52.328394+0000","last_clean":"2024-03-23T23:42:52.328394+0000","last_became_active":"2024-03-23T23:42:40.695218+0000","last_became_peered":"2024-03-23T23:42:40.695218+0000","last_unstale":"2024-03-23T23:42:52.328394+0000","last_undegraded":"2024-03-23T23:42:52.328394+0000","last_fullsized":"2024-03-23T23:42:52.328394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:00:54.983365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.760851+0000","last_change":"2024-03-23T23:42:50.748726+0000","last_active":"2024-03-23T23:42:50.760851+0000","last_peered":"2024-03-23T23:42:50.760851+0000","last_clean":"2024-03-23T23:42:50.760851+0000","last_became_active":"2024-03-23T23:42:50.748105+0000","last_became_peered":"2024-03-23T23:42:50.748105+0000","last_unstale":"2024-03-23T23:42:50.760851+0000","last_undegraded":"2024-03-23T23:42:50.760851+0000","last_fullsized":"2024-03-23T23:42:50.760851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:33:43.235051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.749718+0000","last_change":"2024-03-23T23:42:40.673293+0000","last_active":"2024-03-23T23:42:50.749718+0000","last_peered":"2024-03-23T23:42:50.749718+0000","last_clean":"2024-03-23T23:42:50.749718+0000","last_became_active":"2024-03-23T23:42:40.672910+0000","last_became_peered":"2024-03-23T23:42:40.672910+0000","last_unstale":"2024-03-23T23:42:50.749718+0000","last_undegraded":"2024-03-23T23:42:50.749718+0000","last_fullsized":"2024-03-23T23:42:50.749718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:42:14.952953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.756995+0000","last_change":"2024-03-23T23:42:50.750291+0000","last_active":"2024-03-23T23:42:50.756995+0000","last_peered":"2024-03-23T23:42:50.756995+0000","last_clean":"2024-03-23T23:42:50.756995+0000","last_became_active":"2024-03-23T23:42:50.749908+0000","last_became_peered":"2024-03-23T23:42:50.749908+0000","last_unstale":"2024-03-23T23:42:50.756995+0000","last_undegraded":"2024-03-23T23:42:50.756995+0000","last_fullsized":"2024-03-23T23:42:50.756995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:45:20.249866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328216+0000","last_change":"2024-03-23T23:42:40.685370+0000","last_active":"2024-03-23T23:42:52.328216+0000","last_peered":"2024-03-23T23:42:52.328216+0000","last_clean":"2024-03-23T23:42:52.328216+0000","last_became_active":"2024-03-23T23:42:40.685120+0000","last_became_peered":"2024-03-23T23:42:40.685120+0000","last_unstale":"2024-03-23T23:42:52.328216+0000","last_undegraded":"2024-03-23T23:42:52.328216+0000","last_fullsized":"2024-03-23T23:42:52.328216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751268+0000","last_change":"2024-03-23T23:42:50.747361+0000","last_active":"2024-03-23T23:42:51.751268+0000","last_peered":"2024-03-23T23:42:51.751268+0000","last_clean":"2024-03-23T23:42:51.751268+0000","last_became_active":"2024-03-23T23:42:50.746310+0000","last_became_peered":"2024-03-23T23:42:50.746310+0000","last_unstale":"2024-03-23T23:42:51.751268+0000","last_undegraded":"2024-03-23T23:42:51.751268+0000","last_fullsized":"2024-03-23T23:42:51.751268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:57.968968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.742173+0000","last_change":"2024-03-23T23:42:40.677168+0000","last_active":"2024-03-23T23:42:50.742173+0000","last_peered":"2024-03-23T23:42:50.742173+0000","last_clean":"2024-03-23T23:42:50.742173+0000","last_became_active":"2024-03-23T23:42:40.676912+0000","last_became_peered":"2024-03-23T23:42:40.676912+0000","last_unstale":"2024-03-23T23:42:50.742173+0000","last_undegraded":"2024-03-23T23:42:50.742173+0000","last_fullsized":"2024-03-23T23:42:50.742173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:17:19.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.754854+0000","last_change":"2024-03-23T23:42:50.749305+0000","last_active":"2024-03-23T23:42:50.754854+0000","last_peered":"2024-03-23T23:42:50.754854+0000","last_clean":"2024-03-23T23:42:50.754854+0000","last_became_active":"2024-03-23T23:42:50.748798+0000","last_became_peered":"2024-03-23T23:42:50.748798+0000","last_unstale":"2024-03-23T23:42:50.754854+0000","last_undegraded":"2024-03-23T23:42:50.754854+0000","last_fullsized":"2024-03-23T23:42:50.754854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:18:14.001647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752528+0000","last_change":"2024-03-23T23:42:40.694420+0000","last_active":"2024-03-23T23:42:51.752528+0000","last_peered":"2024-03-23T23:42:51.752528+0000","last_clean":"2024-03-23T23:42:51.752528+0000","last_became_active":"2024-03-23T23:42:40.693867+0000","last_became_peered":"2024-03-23T23:42:40.693867+0000","last_unstale":"2024-03-23T23:42:51.752528+0000","last_undegraded":"2024-03-23T23:42:51.752528+0000","last_fullsized":"2024-03-23T23:42:51.752528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:54.557634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751411+0000","last_change":"2024-03-23T23:42:50.754149+0000","last_active":"2024-03-23T23:42:51.751411+0000","last_peered":"2024-03-23T23:42:51.751411+0000","last_clean":"2024-03-23T23:42:51.751411+0000","last_became_active":"2024-03-23T23:42:50.753471+0000","last_became_peered":"2024-03-23T23:42:50.753471+0000","last_unstale":"2024-03-23T23:42:51.751411+0000","last_undegraded":"2024-03-23T23:42:51.751411+0000","last_fullsized":"2024-03-23T23:42:51.751411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:28.822672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328282+0000","last_change":"2024-03-23T23:42:40.685177+0000","last_active":"2024-03-23T23:42:52.328282+0000","last_peered":"2024-03-23T23:42:52.328282+0000","last_clean":"2024-03-23T23:42:52.328282+0000","last_became_active":"2024-03-23T23:42:40.684495+0000","last_became_peered":"2024-03-23T23:42:40.684495+0000","last_unstale":"2024-03-23T23:42:52.328282+0000","last_undegraded":"2024-03-23T23:42:52.328282+0000","last_fullsized":"2024-03-23T23:42:52.328282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:27.675824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328493+0000","last_change":"2024-03-23T23:42:50.746438+0000","last_active":"2024-03-23T23:42:52.328493+0000","last_peered":"2024-03-23T23:42:52.328493+0000","last_clean":"2024-03-23T23:42:52.328493+0000","last_became_active":"2024-03-23T23:42:50.745771+0000","last_became_peered":"2024-03-23T23:42:50.745771+0000","last_unstale":"2024-03-23T23:42:52.328493+0000","last_undegraded":"2024-03-23T23:42:52.328493+0000","last_fullsized":"2024-03-23T23:42:52.328493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:22:17.484059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328084+0000","last_change":"2024-03-23T23:42:40.701852+0000","last_active":"2024-03-23T23:42:52.328084+0000","last_peered":"2024-03-23T23:42:52.328084+0000","last_clean":"2024-03-23T23:42:52.328084+0000","last_became_active":"2024-03-23T23:42:40.701566+0000","last_became_peered":"2024-03-23T23:42:40.701566+0000","last_unstale":"2024-03-23T23:42:52.328084+0000","last_undegraded":"2024-03-23T23:42:52.328084+0000","last_fullsized":"2024-03-23T23:42:52.328084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.764721+0000","last_change":"2024-03-23T23:42:50.758879+0000","last_active":"2024-03-23T23:42:50.764721+0000","last_peered":"2024-03-23T23:42:50.764721+0000","last_clean":"2024-03-23T23:42:50.764721+0000","last_became_active":"2024-03-23T23:42:50.758564+0000","last_became_peered":"2024-03-23T23:42:50.758564+0000","last_unstale":"2024-03-23T23:42:50.764721+0000","last_undegraded":"2024-03-23T23:42:50.764721+0000","last_fullsized":"2024-03-23T23:42:50.764721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:48:24.982671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327548+0000","last_change":"2024-03-23T23:42:40.684899+0000","last_active":"2024-03-23T23:42:52.327548+0000","last_peered":"2024-03-23T23:42:52.327548+0000","last_clean":"2024-03-23T23:42:52.327548+0000","last_became_active":"2024-03-23T23:42:40.684603+0000","last_became_peered":"2024-03-23T23:42:40.684603+0000","last_unstale":"2024-03-23T23:42:52.327548+0000","last_undegraded":"2024-03-23T23:42:52.327548+0000","last_fullsized":"2024-03-23T23:42:52.327548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:54.557634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.768920+0000","last_change":"2024-03-23T23:42:50.754096+0000","last_active":"2024-03-23T23:42:50.768920+0000","last_peered":"2024-03-23T23:42:50.768920+0000","last_clean":"2024-03-23T23:42:50.768920+0000","last_became_active":"2024-03-23T23:42:50.753602+0000","last_became_peered":"2024-03-23T23:42:50.753602+0000","last_unstale":"2024-03-23T23:42:50.768920+0000","last_undegraded":"2024-03-23T23:42:50.768920+0000","last_fullsized":"2024-03-23T23:42:50.768920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:42:25.010112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328338+0000","last_change":"2024-03-23T23:42:40.707800+0000","last_active":"2024-03-23T23:42:52.328338+0000","last_peered":"2024-03-23T23:42:52.328338+0000","last_clean":"2024-03-23T23:42:52.328338+0000","last_became_active":"2024-03-23T23:42:40.707528+0000","last_became_peered":"2024-03-23T23:42:40.707528+0000","last_unstale":"2024-03-23T23:42:52.328338+0000","last_undegraded":"2024-03-23T23:42:52.328338+0000","last_fullsized":"2024-03-23T23:42:52.328338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:03:24.275154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328659+0000","last_change":"2024-03-23T23:42:50.741324+0000","last_active":"2024-03-23T23:42:52.328659+0000","last_peered":"2024-03-23T23:42:52.328659+0000","last_clean":"2024-03-23T23:42:52.328659+0000","last_became_active":"2024-03-23T23:42:50.741065+0000","last_became_peered":"2024-03-23T23:42:50.741065+0000","last_unstale":"2024-03-23T23:42:52.328659+0000","last_undegraded":"2024-03-23T23:42:52.328659+0000","last_fullsized":"2024-03-23T23:42:52.328659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:13.911327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.749612+0000","last_change":"2024-03-23T23:42:40.689122+0000","last_active":"2024-03-23T23:42:50.749612+0000","last_peered":"2024-03-23T23:42:50.749612+0000","last_clean":"2024-03-23T23:42:50.749612+0000","last_became_active":"2024-03-23T23:42:40.688875+0000","last_became_peered":"2024-03-23T23:42:40.688875+0000","last_unstale":"2024-03-23T23:42:50.749612+0000","last_undegraded":"2024-03-23T23:42:50.749612+0000","last_fullsized":"2024-03-23T23:42:50.749612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:27:03.132032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750979+0000","last_change":"2024-03-23T23:42:50.762055+0000","last_active":"2024-03-23T23:42:51.750979+0000","last_peered":"2024-03-23T23:42:51.750979+0000","last_clean":"2024-03-23T23:42:51.750979+0000","last_became_active":"2024-03-23T23:42:50.761762+0000","last_became_peered":"2024-03-23T23:42:50.761762+0000","last_unstale":"2024-03-23T23:42:51.750979+0000","last_undegraded":"2024-03-23T23:42:51.750979+0000","last_fullsized":"2024-03-23T23:42:51.750979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:28.822672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752195+0000","last_change":"2024-03-23T23:42:40.683701+0000","last_active":"2024-03-23T23:42:51.752195+0000","last_peered":"2024-03-23T23:42:51.752195+0000","last_clean":"2024-03-23T23:42:51.752195+0000","last_became_active":"2024-03-23T23:42:40.683377+0000","last_became_peered":"2024-03-23T23:42:40.683377+0000","last_unstale":"2024-03-23T23:42:51.752195+0000","last_undegraded":"2024-03-23T23:42:51.752195+0000","last_fullsized":"2024-03-23T23:42:51.752195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751120+0000","last_change":"2024-03-23T23:42:50.754372+0000","last_active":"2024-03-23T23:42:51.751120+0000","last_peered":"2024-03-23T23:42:51.751120+0000","last_clean":"2024-03-23T23:42:51.751120+0000","last_became_active":"2024-03-23T23:42:50.754072+0000","last_became_peered":"2024-03-23T23:42:50.754072+0000","last_unstale":"2024-03-23T23:42:51.751120+0000","last_undegraded":"2024-03-23T23:42:51.751120+0000","last_fullsized":"2024-03-23T23:42:51.751120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:40:34.077584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.742679+0000","last_change":"2024-03-23T23:42:40.689769+0000","last_active":"2024-03-23T23:42:50.742679+0000","last_peered":"2024-03-23T23:42:50.742679+0000","last_clean":"2024-03-23T23:42:50.742679+0000","last_became_active":"2024-03-23T23:42:40.689111+0000","last_became_peered":"2024-03-23T23:42:40.689111+0000","last_unstale":"2024-03-23T23:42:50.742679+0000","last_undegraded":"2024-03-23T23:42:50.742679+0000","last_fullsized":"2024-03-23T23:42:50.742679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:40:22.690954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328020+0000","last_change":"2024-03-23T23:42:50.759792+0000","last_active":"2024-03-23T23:42:52.328020+0000","last_peered":"2024-03-23T23:42:52.328020+0000","last_clean":"2024-03-23T23:42:52.328020+0000","last_became_active":"2024-03-23T23:42:50.759604+0000","last_became_peered":"2024-03-23T23:42:50.759604+0000","last_unstale":"2024-03-23T23:42:52.328020+0000","last_undegraded":"2024-03-23T23:42:52.328020+0000","last_fullsized":"2024-03-23T23:42:52.328020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:15:25.617521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.743589+0000","last_change":"2024-03-23T23:42:40.690961+0000","last_active":"2024-03-23T23:42:50.743589+0000","last_peered":"2024-03-23T23:42:50.743589+0000","last_clean":"2024-03-23T23:42:50.743589+0000","last_became_active":"2024-03-23T23:42:40.690690+0000","last_became_peered":"2024-03-23T23:42:40.690690+0000","last_unstale":"2024-03-23T23:42:50.743589+0000","last_undegraded":"2024-03-23T23:42:50.743589+0000","last_fullsized":"2024-03-23T23:42:50.743589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:56.763759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.771958+0000","last_change":"2024-03-23T23:42:50.764821+0000","last_active":"2024-03-23T23:42:50.771958+0000","last_peered":"2024-03-23T23:42:50.771958+0000","last_clean":"2024-03-23T23:42:50.771958+0000","last_became_active":"2024-03-23T23:42:50.764563+0000","last_became_peered":"2024-03-23T23:42:50.764563+0000","last_unstale":"2024-03-23T23:42:50.771958+0000","last_undegraded":"2024-03-23T23:42:50.771958+0000","last_fullsized":"2024-03-23T23:42:50.771958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:49:43.793847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.329026+0000","last_change":"2024-03-23T23:42:40.708540+0000","last_active":"2024-03-23T23:42:52.329026+0000","last_peered":"2024-03-23T23:42:52.329026+0000","last_clean":"2024-03-23T23:42:52.329026+0000","last_became_active":"2024-03-23T23:42:40.708031+0000","last_became_peered":"2024-03-23T23:42:40.708031+0000","last_unstale":"2024-03-23T23:42:52.329026+0000","last_undegraded":"2024-03-23T23:42:52.329026+0000","last_fullsized":"2024-03-23T23:42:52.329026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:44:03.386124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.772911+0000","last_change":"2024-03-23T23:42:50.771062+0000","last_active":"2024-03-23T23:42:50.772911+0000","last_peered":"2024-03-23T23:42:50.772911+0000","last_clean":"2024-03-23T23:42:50.772911+0000","last_became_active":"2024-03-23T23:42:50.770790+0000","last_became_peered":"2024-03-23T23:42:50.770790+0000","last_unstale":"2024-03-23T23:42:50.772911+0000","last_undegraded":"2024-03-23T23:42:50.772911+0000","last_fullsized":"2024-03-23T23:42:50.772911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:53:30.020477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328080+0000","last_change":"2024-03-23T23:42:40.697920+0000","last_active":"2024-03-23T23:42:52.328080+0000","last_peered":"2024-03-23T23:42:52.328080+0000","last_clean":"2024-03-23T23:42:52.328080+0000","last_became_active":"2024-03-23T23:42:40.697694+0000","last_became_peered":"2024-03-23T23:42:40.697694+0000","last_unstale":"2024-03-23T23:42:52.328080+0000","last_undegraded":"2024-03-23T23:42:52.328080+0000","last_fullsized":"2024-03-23T23:42:52.328080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752567+0000","last_change":"2024-03-23T23:42:50.751694+0000","last_active":"2024-03-23T23:42:51.752567+0000","last_peered":"2024-03-23T23:42:51.752567+0000","last_clean":"2024-03-23T23:42:51.752567+0000","last_became_active":"2024-03-23T23:42:50.751452+0000","last_became_peered":"2024-03-23T23:42:50.751452+0000","last_unstale":"2024-03-23T23:42:51.752567+0000","last_undegraded":"2024-03-23T23:42:51.752567+0000","last_fullsized":"2024-03-23T23:42:51.752567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:57:49.981068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.740303+0000","last_change":"2024-03-23T23:42:40.681928+0000","last_active":"2024-03-23T23:42:50.740303+0000","last_peered":"2024-03-23T23:42:50.740303+0000","last_clean":"2024-03-23T23:42:50.740303+0000","last_became_active":"2024-03-23T23:42:40.681337+0000","last_became_peered":"2024-03-23T23:42:40.681337+0000","last_unstale":"2024-03-23T23:42:50.740303+0000","last_undegraded":"2024-03-23T23:42:50.740303+0000","last_fullsized":"2024-03-23T23:42:50.740303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:52.220411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328332+0000","last_change":"2024-03-23T23:42:50.769003+0000","last_active":"2024-03-23T23:42:52.328332+0000","last_peered":"2024-03-23T23:42:52.328332+0000","last_clean":"2024-03-23T23:42:52.328332+0000","last_became_active":"2024-03-23T23:42:50.768695+0000","last_became_peered":"2024-03-23T23:42:50.768695+0000","last_unstale":"2024-03-23T23:42:52.328332+0000","last_undegraded":"2024-03-23T23:42:52.328332+0000","last_fullsized":"2024-03-23T23:42:52.328332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:17:11.847056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.742400+0000","last_change":"2024-03-23T23:42:40.680934+0000","last_active":"2024-03-23T23:42:50.742400+0000","last_peered":"2024-03-23T23:42:50.742400+0000","last_clean":"2024-03-23T23:42:50.742400+0000","last_became_active":"2024-03-23T23:42:40.680643+0000","last_became_peered":"2024-03-23T23:42:40.680643+0000","last_unstale":"2024-03-23T23:42:50.742400+0000","last_undegraded":"2024-03-23T23:42:50.742400+0000","last_fullsized":"2024-03-23T23:42:50.742400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:34.630671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.769267+0000","last_change":"2024-03-23T23:42:50.762401+0000","last_active":"2024-03-23T23:42:50.769267+0000","last_peered":"2024-03-23T23:42:50.769267+0000","last_clean":"2024-03-23T23:42:50.769267+0000","last_became_active":"2024-03-23T23:42:50.762183+0000","last_became_peered":"2024-03-23T23:42:50.762183+0000","last_unstale":"2024-03-23T23:42:50.769267+0000","last_undegraded":"2024-03-23T23:42:50.769267+0000","last_fullsized":"2024-03-23T23:42:50.769267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:52:48.699642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327888+0000","last_change":"2024-03-23T23:42:40.682736+0000","last_active":"2024-03-23T23:42:52.327888+0000","last_peered":"2024-03-23T23:42:52.327888+0000","last_clean":"2024-03-23T23:42:52.327888+0000","last_became_active":"2024-03-23T23:42:40.682410+0000","last_became_peered":"2024-03-23T23:42:40.682410+0000","last_unstale":"2024-03-23T23:42:52.327888+0000","last_undegraded":"2024-03-23T23:42:52.327888+0000","last_fullsized":"2024-03-23T23:42:52.327888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:01:06.338641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327793+0000","last_change":"2024-03-23T23:42:50.749204+0000","last_active":"2024-03-23T23:42:52.327793+0000","last_peered":"2024-03-23T23:42:52.327793+0000","last_clean":"2024-03-23T23:42:52.327793+0000","last_became_active":"2024-03-23T23:42:50.748809+0000","last_became_peered":"2024-03-23T23:42:50.748809+0000","last_unstale":"2024-03-23T23:42:52.327793+0000","last_undegraded":"2024-03-23T23:42:52.327793+0000","last_fullsized":"2024-03-23T23:42:52.327793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:39:49.888359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752151+0000","last_change":"2024-03-23T23:42:40.682523+0000","last_active":"2024-03-23T23:42:51.752151+0000","last_peered":"2024-03-23T23:42:51.752151+0000","last_clean":"2024-03-23T23:42:51.752151+0000","last_became_active":"2024-03-23T23:42:40.682155+0000","last_became_peered":"2024-03-23T23:42:40.682155+0000","last_unstale":"2024-03-23T23:42:51.752151+0000","last_undegraded":"2024-03-23T23:42:51.752151+0000","last_fullsized":"2024-03-23T23:42:51.752151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:33.260151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.758828+0000","last_change":"2024-03-23T23:42:50.746115+0000","last_active":"2024-03-23T23:42:50.758828+0000","last_peered":"2024-03-23T23:42:50.758828+0000","last_clean":"2024-03-23T23:42:50.758828+0000","last_became_active":"2024-03-23T23:42:50.745858+0000","last_became_peered":"2024-03-23T23:42:50.745858+0000","last_unstale":"2024-03-23T23:42:50.758828+0000","last_undegraded":"2024-03-23T23:42:50.758828+0000","last_fullsized":"2024-03-23T23:42:50.758828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:07:39.300081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752280+0000","last_change":"2024-03-23T23:42:40.702089+0000","last_active":"2024-03-23T23:42:51.752280+0000","last_peered":"2024-03-23T23:42:51.752280+0000","last_clean":"2024-03-23T23:42:51.752280+0000","last_became_active":"2024-03-23T23:42:40.701874+0000","last_became_peered":"2024-03-23T23:42:40.701874+0000","last_unstale":"2024-03-23T23:42:51.752280+0000","last_undegraded":"2024-03-23T23:42:51.752280+0000","last_fullsized":"2024-03-23T23:42:51.752280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.777180+0000","last_change":"2024-03-23T23:42:50.773115+0000","last_active":"2024-03-23T23:42:50.777180+0000","last_peered":"2024-03-23T23:42:50.777180+0000","last_clean":"2024-03-23T23:42:50.777180+0000","last_became_active":"2024-03-23T23:42:50.772849+0000","last_became_peered":"2024-03-23T23:42:50.772849+0000","last_unstale":"2024-03-23T23:42:50.777180+0000","last_undegraded":"2024-03-23T23:42:50.777180+0000","last_fullsized":"2024-03-23T23:42:50.777180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:53:30.020477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752487+0000","last_change":"2024-03-23T23:42:40.703254+0000","last_active":"2024-03-23T23:42:51.752487+0000","last_peered":"2024-03-23T23:42:51.752487+0000","last_clean":"2024-03-23T23:42:51.752487+0000","last_became_active":"2024-03-23T23:42:40.702447+0000","last_became_peered":"2024-03-23T23:42:40.702447+0000","last_unstale":"2024-03-23T23:42:51.752487+0000","last_undegraded":"2024-03-23T23:42:51.752487+0000","last_fullsized":"2024-03-23T23:42:51.752487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:59:45.154553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328157+0000","last_change":"2024-03-23T23:42:50.748946+0000","last_active":"2024-03-23T23:42:52.328157+0000","last_peered":"2024-03-23T23:42:52.328157+0000","last_clean":"2024-03-23T23:42:52.328157+0000","last_became_active":"2024-03-23T23:42:50.745205+0000","last_became_peered":"2024-03-23T23:42:50.745205+0000","last_unstale":"2024-03-23T23:42:52.328157+0000","last_undegraded":"2024-03-23T23:42:52.328157+0000","last_fullsized":"2024-03-23T23:42:52.328157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:58:16.372010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.744079+0000","last_change":"2024-03-23T23:42:40.714331+0000","last_active":"2024-03-23T23:42:50.744079+0000","last_peered":"2024-03-23T23:42:50.744079+0000","last_clean":"2024-03-23T23:42:50.744079+0000","last_became_active":"2024-03-23T23:42:40.713737+0000","last_became_peered":"2024-03-23T23:42:40.713737+0000","last_unstale":"2024-03-23T23:42:50.744079+0000","last_undegraded":"2024-03-23T23:42:50.744079+0000","last_fullsized":"2024-03-23T23:42:50.744079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:24:43.902129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328361+0000","last_change":"2024-03-23T23:42:50.746666+0000","last_active":"2024-03-23T23:42:52.328361+0000","last_peered":"2024-03-23T23:42:52.328361+0000","last_clean":"2024-03-23T23:42:52.328361+0000","last_became_active":"2024-03-23T23:42:50.746149+0000","last_became_peered":"2024-03-23T23:42:50.746149+0000","last_unstale":"2024-03-23T23:42:52.328361+0000","last_undegraded":"2024-03-23T23:42:52.328361+0000","last_fullsized":"2024-03-23T23:42:52.328361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:42:58.533499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327499+0000","last_change":"2024-03-23T23:42:40.710655+0000","last_active":"2024-03-23T23:42:52.327499+0000","last_peered":"2024-03-23T23:42:52.327499+0000","last_clean":"2024-03-23T23:42:52.327499+0000","last_became_active":"2024-03-23T23:42:40.710362+0000","last_became_peered":"2024-03-23T23:42:40.710362+0000","last_unstale":"2024-03-23T23:42:52.327499+0000","last_undegraded":"2024-03-23T23:42:52.327499+0000","last_fullsized":"2024-03-23T23:42:52.327499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:12:14.359173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752890+0000","last_change":"2024-03-23T23:42:50.753397+0000","last_active":"2024-03-23T23:42:51.752890+0000","last_peered":"2024-03-23T23:42:51.752890+0000","last_clean":"2024-03-23T23:42:51.752890+0000","last_became_active":"2024-03-23T23:42:50.753085+0000","last_became_peered":"2024-03-23T23:42:50.753085+0000","last_unstale":"2024-03-23T23:42:51.752890+0000","last_undegraded":"2024-03-23T23:42:51.752890+0000","last_fullsized":"2024-03-23T23:42:51.752890+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:25:44.894505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.742920+0000","last_change":"2024-03-23T23:42:40.689380+0000","last_active":"2024-03-23T23:42:50.742920+0000","last_peered":"2024-03-23T23:42:50.742920+0000","last_clean":"2024-03-23T23:42:50.742920+0000","last_became_active":"2024-03-23T23:42:40.689023+0000","last_became_peered":"2024-03-23T23:42:40.689023+0000","last_unstale":"2024-03-23T23:42:50.742920+0000","last_undegraded":"2024-03-23T23:42:50.742920+0000","last_fullsized":"2024-03-23T23:42:50.742920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:17:19.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.761431+0000","last_change":"2024-03-23T23:42:50.756133+0000","last_active":"2024-03-23T23:42:50.761431+0000","last_peered":"2024-03-23T23:42:50.761431+0000","last_clean":"2024-03-23T23:42:50.761431+0000","last_became_active":"2024-03-23T23:42:50.755405+0000","last_became_peered":"2024-03-23T23:42:50.755405+0000","last_unstale":"2024-03-23T23:42:50.761431+0000","last_undegraded":"2024-03-23T23:42:50.761431+0000","last_fullsized":"2024-03-23T23:42:50.761431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:42:23.236324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328292+0000","last_change":"2024-03-23T23:42:40.698234+0000","last_active":"2024-03-23T23:42:52.328292+0000","last_peered":"2024-03-23T23:42:52.328292+0000","last_clean":"2024-03-23T23:42:52.328292+0000","last_became_active":"2024-03-23T23:42:40.695978+0000","last_became_peered":"2024-03-23T23:42:40.695978+0000","last_unstale":"2024-03-23T23:42:52.328292+0000","last_undegraded":"2024-03-23T23:42:52.328292+0000","last_fullsized":"2024-03-23T23:42:52.328292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:04.633288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328907+0000","last_change":"2024-03-23T23:42:50.752051+0000","last_active":"2024-03-23T23:42:52.328907+0000","last_peered":"2024-03-23T23:42:52.328907+0000","last_clean":"2024-03-23T23:42:52.328907+0000","last_became_active":"2024-03-23T23:42:50.751738+0000","last_became_peered":"2024-03-23T23:42:50.751738+0000","last_unstale":"2024-03-23T23:42:52.328907+0000","last_undegraded":"2024-03-23T23:42:52.328907+0000","last_fullsized":"2024-03-23T23:42:52.328907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:20:53.750917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.739964+0000","last_change":"2024-03-23T23:42:40.698407+0000","last_active":"2024-03-23T23:42:50.739964+0000","last_peered":"2024-03-23T23:42:50.739964+0000","last_clean":"2024-03-23T23:42:50.739964+0000","last_became_active":"2024-03-23T23:42:40.698092+0000","last_became_peered":"2024-03-23T23:42:40.698092+0000","last_unstale":"2024-03-23T23:42:50.739964+0000","last_undegraded":"2024-03-23T23:42:50.739964+0000","last_fullsized":"2024-03-23T23:42:50.739964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:00:33.261296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327627+0000","last_change":"2024-03-23T23:42:50.753000+0000","last_active":"2024-03-23T23:42:52.327627+0000","last_peered":"2024-03-23T23:42:52.327627+0000","last_clean":"2024-03-23T23:42:52.327627+0000","last_became_active":"2024-03-23T23:42:50.752614+0000","last_became_peered":"2024-03-23T23:42:50.752614+0000","last_unstale":"2024-03-23T23:42:52.327627+0000","last_undegraded":"2024-03-23T23:42:52.327627+0000","last_fullsized":"2024-03-23T23:42:52.327627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:57:04.394872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328439+0000","last_change":"2024-03-23T23:42:40.700631+0000","last_active":"2024-03-23T23:42:52.328439+0000","last_peered":"2024-03-23T23:42:52.328439+0000","last_clean":"2024-03-23T23:42:52.328439+0000","last_became_active":"2024-03-23T23:42:40.697932+0000","last_became_peered":"2024-03-23T23:42:40.697932+0000","last_unstale":"2024-03-23T23:42:52.328439+0000","last_undegraded":"2024-03-23T23:42:52.328439+0000","last_fullsized":"2024-03-23T23:42:52.328439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:05:17.694245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.770285+0000","last_change":"2024-03-23T23:42:50.765991+0000","last_active":"2024-03-23T23:42:50.770285+0000","last_peered":"2024-03-23T23:42:50.770285+0000","last_clean":"2024-03-23T23:42:50.770285+0000","last_became_active":"2024-03-23T23:42:50.765716+0000","last_became_peered":"2024-03-23T23:42:50.765716+0000","last_unstale":"2024-03-23T23:42:50.770285+0000","last_undegraded":"2024-03-23T23:42:50.770285+0000","last_fullsized":"2024-03-23T23:42:50.770285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:54:37.698441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.753232+0000","last_change":"2024-03-23T23:42:40.683983+0000","last_active":"2024-03-23T23:42:50.753232+0000","last_peered":"2024-03-23T23:42:50.753232+0000","last_clean":"2024-03-23T23:42:50.753232+0000","last_became_active":"2024-03-23T23:42:40.683711+0000","last_became_peered":"2024-03-23T23:42:40.683711+0000","last_unstale":"2024-03-23T23:42:50.753232+0000","last_undegraded":"2024-03-23T23:42:50.753232+0000","last_fullsized":"2024-03-23T23:42:50.753232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:51:30.695597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.772087+0000","last_change":"2024-03-23T23:42:50.766544+0000","last_active":"2024-03-23T23:42:50.772087+0000","last_peered":"2024-03-23T23:42:50.772087+0000","last_clean":"2024-03-23T23:42:50.772087+0000","last_became_active":"2024-03-23T23:42:50.766328+0000","last_became_peered":"2024-03-23T23:42:50.766328+0000","last_unstale":"2024-03-23T23:42:50.772087+0000","last_undegraded":"2024-03-23T23:42:50.772087+0000","last_fullsized":"2024-03-23T23:42:50.772087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:37:19.741781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.750736+0000","last_change":"2024-03-23T23:42:40.678622+0000","last_active":"2024-03-23T23:42:50.750736+0000","last_peered":"2024-03-23T23:42:50.750736+0000","last_clean":"2024-03-23T23:42:50.750736+0000","last_became_active":"2024-03-23T23:42:40.678325+0000","last_became_peered":"2024-03-23T23:42:40.678325+0000","last_unstale":"2024-03-23T23:42:50.750736+0000","last_undegraded":"2024-03-23T23:42:50.750736+0000","last_fullsized":"2024-03-23T23:42:50.750736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:54:27.641281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.756601+0000","last_change":"2024-03-23T23:42:50.750690+0000","last_active":"2024-03-23T23:42:50.756601+0000","last_peered":"2024-03-23T23:42:50.756601+0000","last_clean":"2024-03-23T23:42:50.756601+0000","last_became_active":"2024-03-23T23:42:50.750466+0000","last_became_peered":"2024-03-23T23:42:50.750466+0000","last_unstale":"2024-03-23T23:42:50.756601+0000","last_undegraded":"2024-03-23T23:42:50.756601+0000","last_fullsized":"2024-03-23T23:42:50.756601+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:33:43.235051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:42:50.743976+0000","last_change":"2024-03-23T23:42:40.701959+0000","last_active":"2024-03-23T23:42:50.743976+0000","last_peered":"2024-03-23T23:42:50.743976+0000","last_clean":"2024-03-23T23:42:50.743976+0000","last_became_active":"2024-03-23T23:42:40.700855+0000","last_became_peered":"2024-03-23T23:42:40.700855+0000","last_unstale":"2024-03-23T23:42:50.743976+0000","last_undegraded":"2024-03-23T23:42:50.743976+0000","last_fullsized":"2024-03-23T23:42:50.743976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:49:42.009983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":96343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":94877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":101452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":274432,"data_stored":97361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":847872,"data_stored":685155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":249856,"data_stored":94185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":241664,"data_stored":86698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":851968,"data_stored":685121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T23:42:56.303 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-23T23:42:56.303 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-23T23:42:56.303 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-23T23:42:56.303 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-23T23:42:56.304 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-23T23:42:56.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.473+0000 7fbe25600640 1 Processor -- start 2024-03-23T23:42:56.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.473+0000 7fbe25600640 1 -- start start 2024-03-23T23:42:56.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.477+0000 7fbe25600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbe20156ee0 0x7fbe20073230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:56.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.477+0000 7fbe25600640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe20073770 con 0x7fbe20149bd0 2024-03-23T23:42:56.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.477+0000 7fbe25600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe200aa390 con 0x7fbe200ac270 2024-03-23T23:42:56.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.477+0000 7fbe25600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe2006e720 con 0x7fbe20156ee0 2024-03-23T23:42:56.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.477+0000 7fbe1e000640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fbe20149bd0 0x7fbe2014a060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:44890/0 (socket says 172.21.15.8:44890) 2024-03-23T23:42:56.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.477+0000 7fbe1e000640 1 -- 172.21.15.8:0/3198931300 learned_addr learned my addr 172.21.15.8:0/3198931300 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:56.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.477+0000 7fbe1ea00640 1 --2- 172.21.15.8:0/3198931300 >> v2:172.21.15.196:3300/0 conn(0x7fbe20156ee0 0x7fbe20073230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:56.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.477+0000 7fbe1d600640 1 -- 172.21.15.8:0/3198931300 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304504028 0 0) 0x7fbe20073770 con 0x7fbe20149bd0 2024-03-23T23:42:56.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.477+0000 7fbe1d600640 1 -- 172.21.15.8:0/3198931300 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe04003530 con 0x7fbe20149bd0 2024-03-23T23:42:56.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.477+0000 7fbe1ea00640 1 -- 172.21.15.8:0/3198931300 >> v1:172.21.15.196:6789/0 conn(0x7fbe200ac270 legacy=0x7fbe200ac6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:56.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.477+0000 7fbe1d600640 1 -- 172.21.15.8:0/3198931300 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 127195314 0 0) 0x7fbe200aa390 con 0x7fbe200ac270 2024-03-23T23:42:56.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.477+0000 7fbe1ea00640 1 -- 172.21.15.8:0/3198931300 >> v1:172.21.15.8:6789/0 conn(0x7fbe20149bd0 legacy=0x7fbe2014a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:56.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.477+0000 7fbe1ea00640 1 -- 172.21.15.8:0/3198931300 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe2006ea00 con 0x7fbe20156ee0 2024-03-23T23:42:56.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.481+0000 7fbe1ea00640 1 --2- 172.21.15.8:0/3198931300 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe20156ee0 0x7fbe20073230 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbe100097c0 tx=0x7fbe1001c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d24d675a665744 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:56.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.481+0000 7fbe1d600640 1 -- 172.21.15.8:0/3198931300 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe100b1070 con 0x7fbe20156ee0 2024-03-23T23:42:56.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.481+0000 7fbe1d600640 1 -- 172.21.15.8:0/3198931300 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe100a8050 con 0x7fbe20156ee0 2024-03-23T23:42:56.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.481+0000 7fbe1d600640 1 -- 172.21.15.8:0/3198931300 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe100ac860 con 0x7fbe20156ee0 2024-03-23T23:42:56.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.481+0000 7fbe25600640 1 -- 172.21.15.8:0/3198931300 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe20156ee0 msgr2=0x7fbe20073230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:56.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.481+0000 7fbe25600640 1 --2- 172.21.15.8:0/3198931300 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe20156ee0 0x7fbe20073230 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbe100097c0 tx=0x7fbe1001c3e0 comp rx=0 tx=0).stop 2024-03-23T23:42:56.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.481+0000 7fbe25600640 1 -- 172.21.15.8:0/3198931300 shutdown_connections 2024-03-23T23:42:56.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.481+0000 7fbe25600640 1 --2- 172.21.15.8:0/3198931300 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe20156ee0 0x7fbe20073230 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:56.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.481+0000 7fbe25600640 1 -- 172.21.15.8:0/3198931300 >> 172.21.15.8:0/3198931300 conn(0x7fbe2006b170 msgr2=0x7fbe2006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:56.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.481+0000 7fbe25600640 1 -- 172.21.15.8:0/3198931300 shutdown_connections 2024-03-23T23:42:56.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.481+0000 7fbe25600640 1 -- 172.21.15.8:0/3198931300 wait complete. 2024-03-23T23:42:56.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.481+0000 7fbe25600640 1 Processor -- start 2024-03-23T23:42:56.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.481+0000 7fbe25600640 1 -- start start 2024-03-23T23:42:56.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.485+0000 7fbe25600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe200ac270 0x7fbe201ee7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:56.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.485+0000 7fbe25600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe20149bd0 0x7fbe20155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:56.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.485+0000 7fbe25600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe20156ee0 0x7fbe200c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:56.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.485+0000 7fbe25600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe201579f0 con 0x7fbe20149bd0 2024-03-23T23:42:56.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.485+0000 7fbe25600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe20157870 con 0x7fbe200ac270 2024-03-23T23:42:56.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.485+0000 7fbe25600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe200acdf0 con 0x7fbe20156ee0 2024-03-23T23:42:56.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.485+0000 7fbe1ea00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe200ac270 0x7fbe201ee7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:56.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.485+0000 7fbe1e000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe20149bd0 0x7fbe20155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:56.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.485+0000 7fbe1ea00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe200ac270 0x7fbe201ee7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:45836/0 (socket says 172.21.15.8:45836) 2024-03-23T23:42:56.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.485+0000 7fbe1ea00640 1 -- 172.21.15.8:0/606012722 learned_addr learned my addr 172.21.15.8:0/606012722 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:56.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.485+0000 7fbe1f400640 1 --2- 172.21.15.8:0/606012722 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe20156ee0 0x7fbe200c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:56.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.485+0000 7fbe1ea00640 1 -- 172.21.15.8:0/606012722 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe20156ee0 msgr2=0x7fbe200c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:56.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.485+0000 7fbe1ea00640 1 --2- 172.21.15.8:0/606012722 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe20156ee0 0x7fbe200c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:56.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.485+0000 7fbe1ea00640 1 -- 172.21.15.8:0/606012722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe20149bd0 msgr2=0x7fbe20155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:56.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.485+0000 7fbe1ea00640 1 --2- 172.21.15.8:0/606012722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe20149bd0 0x7fbe20155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:56.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.485+0000 7fbe1ea00640 1 -- 172.21.15.8:0/606012722 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe200c59c0 con 0x7fbe200ac270 2024-03-23T23:42:56.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.485+0000 7fbe1ea00640 1 --2- 172.21.15.8:0/606012722 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe200ac270 0x7fbe201ee7b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbe100097c0 tx=0x7fbe1001ac20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:56.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.485+0000 7fbe16a00640 1 -- 172.21.15.8:0/606012722 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe100b1050 con 0x7fbe200ac270 2024-03-23T23:42:56.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.485+0000 7fbe16a00640 1 -- 172.21.15.8:0/606012722 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe100b2040 con 0x7fbe200ac270 2024-03-23T23:42:56.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.485+0000 7fbe16a00640 1 -- 172.21.15.8:0/606012722 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe100b8450 con 0x7fbe200ac270 2024-03-23T23:42:56.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.485+0000 7fbe25600640 1 -- 172.21.15.8:0/606012722 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe201eecf0 con 0x7fbe200ac270 2024-03-23T23:42:56.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.485+0000 7fbe25600640 1 -- 172.21.15.8:0/606012722 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe200c56e0 con 0x7fbe200ac270 2024-03-23T23:42:56.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.485+0000 7fbe25600640 1 -- 172.21.15.8:0/606012722 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe20068270 con 0x7fbe200ac270 2024-03-23T23:42:56.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.485+0000 7fbe16a00640 1 -- 172.21.15.8:0/606012722 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fbe100bf030 con 0x7fbe200ac270 2024-03-23T23:42:56.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.489+0000 7fbe16a00640 1 --2- 172.21.15.8:0/606012722 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbe00067660 0x7fbe00069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:56.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.489+0000 7fbe16a00640 1 -- 172.21.15.8:0/606012722 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fbe1011f710 con 0x7fbe200ac270 2024-03-23T23:42:56.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.489+0000 7fbe1e000640 1 --2- 172.21.15.8:0/606012722 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbe00067660 0x7fbe00069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:56.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.489+0000 7fbe1e000640 1 --2- 172.21.15.8:0/606012722 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbe00067660 0x7fbe00069b20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c007fd0 tx=0x7fbe0c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:56.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.493+0000 7fbe16a00640 1 -- 172.21.15.8:0/606012722 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fbe100c6060 con 0x7fbe200ac270 2024-03-23T23:42:56.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.697+0000 7fbe25600640 1 -- 172.21.15.8:0/606012722 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fbe200ad570 con 0x7fbe200ac270 2024-03-23T23:42:56.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.701+0000 7fbe16a00640 1 -- 172.21.15.8:0/606012722 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+166533 (secure 0 0 0) 0x7fbe10016090 con 0x7fbe200ac270 2024-03-23T23:42:56.705 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:42:56.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.705+0000 7fbe25600640 1 -- 172.21.15.8:0/606012722 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbe00067660 msgr2=0x7fbe00069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:56.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.705+0000 7fbe25600640 1 --2- 172.21.15.8:0/606012722 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbe00067660 0x7fbe00069b20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c007fd0 tx=0x7fbe0c009040 comp rx=0 tx=0).stop 2024-03-23T23:42:56.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.705+0000 7fbe25600640 1 -- 172.21.15.8:0/606012722 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe200ac270 msgr2=0x7fbe201ee7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:56.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.705+0000 7fbe25600640 1 --2- 172.21.15.8:0/606012722 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe200ac270 0x7fbe201ee7b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbe100097c0 tx=0x7fbe1001ac20 comp rx=0 tx=0).stop 2024-03-23T23:42:56.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.705+0000 7fbe25600640 1 -- 172.21.15.8:0/606012722 shutdown_connections 2024-03-23T23:42:56.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.705+0000 7fbe25600640 1 --2- 172.21.15.8:0/606012722 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbe00067660 0x7fbe00069b20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:56.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.705+0000 7fbe25600640 1 --2- 172.21.15.8:0/606012722 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe20156ee0 0x7fbe200c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:56.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.705+0000 7fbe25600640 1 --2- 172.21.15.8:0/606012722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe20149bd0 0x7fbe20155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:56.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.705+0000 7fbe25600640 1 --2- 172.21.15.8:0/606012722 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe200ac270 0x7fbe201ee7b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:56.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.705+0000 7fbe25600640 1 -- 172.21.15.8:0/606012722 >> 172.21.15.8:0/606012722 conn(0x7fbe2006b170 msgr2=0x7fbe200c29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:56.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.705+0000 7fbe25600640 1 -- 172.21.15.8:0/606012722 shutdown_connections 2024-03-23T23:42:56.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.705+0000 7fbe25600640 1 -- 172.21.15.8:0/606012722 wait complete. 2024-03-23T23:42:56.734 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":5,"flags":0,"active_gid":4098,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":1295060067},{"type":"v1","addr":"172.21.15.196:6833","nonce":1295060067}]},"active_addr":"172.21.15.196:6833/1295060067","active_change":"2024-03-23T23:42:20.256748+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4101,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":472073354}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":2112281819}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":1066225132}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":1478334548}]}]} 2024-03-23T23:42:56.739 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-23T23:42:56.739 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-23T23:42:56.739 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:42:56.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.881+0000 7fb453800640 1 Processor -- start 2024-03-23T23:42:56.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.881+0000 7fb453800640 1 -- start start 2024-03-23T23:42:56.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.881+0000 7fb453800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb44c06d6e0 0x7fb44c155a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:56.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.881+0000 7fb453800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb44c0c4340 con 0x7fb44c0c8a50 2024-03-23T23:42:56.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.881+0000 7fb453800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb44c0c4060 con 0x7fb44c0c4e40 2024-03-23T23:42:56.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.881+0000 7fb453800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c0c4740 con 0x7fb44c06d6e0 2024-03-23T23:42:56.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.885+0000 7fb450e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fb44c0c8a50 0x7fb44c0c2660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:44896/0 (socket says 172.21.15.8:44896) 2024-03-23T23:42:56.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.885+0000 7fb450e00640 1 -- 172.21.15.8:0/3083007750 learned_addr learned my addr 172.21.15.8:0/3083007750 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:56.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.885+0000 7fb44be00640 1 --2- 172.21.15.8:0/3083007750 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb44c06d6e0 0x7fb44c155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:56.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.885+0000 7fb44b400640 1 -- 172.21.15.8:0/3083007750 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357230486 0 0) 0x7fb44c0c4060 con 0x7fb44c0c4e40 2024-03-23T23:42:56.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.885+0000 7fb44b400640 1 -- 172.21.15.8:0/3083007750 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb434003530 con 0x7fb44c0c4e40 2024-03-23T23:42:56.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.885+0000 7fb44b400640 1 -- 172.21.15.8:0/3083007750 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2210370202 0 0) 0x7fb44c0c4340 con 0x7fb44c0c8a50 2024-03-23T23:42:56.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.885+0000 7fb44b400640 1 -- 172.21.15.8:0/3083007750 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb44c0c4060 con 0x7fb44c0c8a50 2024-03-23T23:42:56.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.885+0000 7fb44be00640 1 -- 172.21.15.8:0/3083007750 >> v1:172.21.15.196:6789/0 conn(0x7fb44c0c4e40 legacy=0x7fb44c160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:56.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.885+0000 7fb44be00640 1 -- 172.21.15.8:0/3083007750 >> v1:172.21.15.8:6789/0 conn(0x7fb44c0c8a50 legacy=0x7fb44c0c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:56.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.885+0000 7fb44be00640 1 -- 172.21.15.8:0/3083007750 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c0c3570 con 0x7fb44c06d6e0 2024-03-23T23:42:56.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.885+0000 7fb44be00640 1 --2- 172.21.15.8:0/3083007750 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb44c06d6e0 0x7fb44c155a60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb4380097f0 tx=0x7fb43801c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea89e2a3dad9321f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:56.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.885+0000 7fb44b400640 1 -- 172.21.15.8:0/3083007750 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4380b0070 con 0x7fb44c06d6e0 2024-03-23T23:42:56.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.885+0000 7fb44b400640 1 -- 172.21.15.8:0/3083007750 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4380ab600 con 0x7fb44c06d6e0 2024-03-23T23:42:56.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.885+0000 7fb44b400640 1 -- 172.21.15.8:0/3083007750 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4380ab9d0 con 0x7fb44c06d6e0 2024-03-23T23:42:56.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.889+0000 7fb453800640 1 -- 172.21.15.8:0/3083007750 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb44c06d6e0 msgr2=0x7fb44c155a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:56.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.889+0000 7fb453800640 1 --2- 172.21.15.8:0/3083007750 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb44c06d6e0 0x7fb44c155a60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb4380097f0 tx=0x7fb43801c420 comp rx=0 tx=0).stop 2024-03-23T23:42:56.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.889+0000 7fb453800640 1 -- 172.21.15.8:0/3083007750 shutdown_connections 2024-03-23T23:42:56.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.889+0000 7fb453800640 1 --2- 172.21.15.8:0/3083007750 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb44c06d6e0 0x7fb44c155a60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:56.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.889+0000 7fb453800640 1 -- 172.21.15.8:0/3083007750 >> 172.21.15.8:0/3083007750 conn(0x7fb44c0aafe0 msgr2=0x7fb44c0ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:56.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.889+0000 7fb453800640 1 -- 172.21.15.8:0/3083007750 shutdown_connections 2024-03-23T23:42:56.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.889+0000 7fb453800640 1 -- 172.21.15.8:0/3083007750 wait complete. 2024-03-23T23:42:56.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.889+0000 7fb453800640 1 Processor -- start 2024-03-23T23:42:56.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.889+0000 7fb453800640 1 -- start start 2024-03-23T23:42:56.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.889+0000 7fb453800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb44c0c4e40 0x7fb44c1efcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:56.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.889+0000 7fb453800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb44c0c8a50 0x7fb44c1491c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:56.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.889+0000 7fb453800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb44c149df0 0x7fb44c149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:56.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.889+0000 7fb453800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c0c8e30 con 0x7fb44c0c8a50 2024-03-23T23:42:56.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.889+0000 7fb453800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c06e1e0 con 0x7fb44c0c4e40 2024-03-23T23:42:56.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.889+0000 7fb453800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c149c40 con 0x7fb44c149df0 2024-03-23T23:42:56.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.889+0000 7fb44be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb44c0c8a50 0x7fb44c1491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:56.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.889+0000 7fb44be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb44c0c8a50 0x7fb44c1491c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41982/0 (socket says 172.21.15.8:41982) 2024-03-23T23:42:56.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.889+0000 7fb44be00640 1 -- 172.21.15.8:0/1530041795 learned_addr learned my addr 172.21.15.8:0/1530041795 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:56.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.889+0000 7fb450e00640 1 --2- 172.21.15.8:0/1530041795 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb44c0c4e40 0x7fb44c1efcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:56.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.889+0000 7fb451800640 1 --2- 172.21.15.8:0/1530041795 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb44c149df0 0x7fb44c149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:56.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.889+0000 7fb44be00640 1 -- 172.21.15.8:0/1530041795 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb44c149df0 msgr2=0x7fb44c149700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:56.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.889+0000 7fb44be00640 1 --2- 172.21.15.8:0/1530041795 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb44c149df0 0x7fb44c149700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:56.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.889+0000 7fb44be00640 1 -- 172.21.15.8:0/1530041795 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb44c0c4e40 msgr2=0x7fb44c1efcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:56.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.889+0000 7fb44be00640 1 --2- 172.21.15.8:0/1530041795 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb44c0c4e40 0x7fb44c1efcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:56.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.889+0000 7fb44be00640 1 -- 172.21.15.8:0/1530041795 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c159790 con 0x7fb44c0c8a50 2024-03-23T23:42:56.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.893+0000 7fb44be00640 1 --2- 172.21.15.8:0/1530041795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb44c0c8a50 0x7fb44c1491c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb4380097f0 tx=0x7fb43801ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:56.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.893+0000 7fb448c00640 1 -- 172.21.15.8:0/1530041795 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4380bc070 con 0x7fb44c0c8a50 2024-03-23T23:42:56.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.893+0000 7fb448c00640 1 -- 172.21.15.8:0/1530041795 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4380b1040 con 0x7fb44c0c8a50 2024-03-23T23:42:56.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.893+0000 7fb453800640 1 -- 172.21.15.8:0/1530041795 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb44c0c2760 con 0x7fb44c0c8a50 2024-03-23T23:42:56.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.893+0000 7fb448c00640 1 -- 172.21.15.8:0/1530041795 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4380b0050 con 0x7fb44c0c8a50 2024-03-23T23:42:56.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.893+0000 7fb453800640 1 -- 172.21.15.8:0/1530041795 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb44c1589d0 con 0x7fb44c0c8a50 2024-03-23T23:42:56.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.893+0000 7fb453800640 1 -- 172.21.15.8:0/1530041795 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb44c068270 con 0x7fb44c0c8a50 2024-03-23T23:42:56.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.893+0000 7fb448c00640 1 -- 172.21.15.8:0/1530041795 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb4380bf070 con 0x7fb44c0c8a50 2024-03-23T23:42:56.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.893+0000 7fb448c00640 1 --2- 172.21.15.8:0/1530041795 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb42c067660 0x7fb42c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:56.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.893+0000 7fb448c00640 1 -- 172.21.15.8:0/1530041795 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fb43811f430 con 0x7fb44c0c8a50 2024-03-23T23:42:56.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.897+0000 7fb450e00640 1 --2- 172.21.15.8:0/1530041795 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb42c067660 0x7fb42c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:56.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.897+0000 7fb450e00640 1 --2- 172.21.15.8:0/1530041795 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb42c067660 0x7fb42c069b20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb440007fd0 tx=0x7fb440009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:56.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:56.897+0000 7fb448c00640 1 -- 172.21.15.8:0/1530041795 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fb4380160d0 con 0x7fb44c0c8a50 2024-03-23T23:42:57.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.173+0000 7fb453800640 1 -- 172.21.15.8:0/1530041795 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb44c0c32b0 con 0x7fb44c0c8a50 2024-03-23T23:42:57.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.177+0000 7fb448c00640 1 -- 172.21.15.8:0/1530041795 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20271 (secure 0 0 0) 0x7fb4380ef720 con 0x7fb44c0c8a50 2024-03-23T23:42:57.177 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:42:57.177 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":25,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","created":"2024-03-23T23:42:15.169430+0000","modified":"2024-03-23T23:42:51.739271+0000","last_up_change":"2024-03-23T23:42:26.509742+0000","last_in_change":"2024-03-23T23:42:17.662330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:42:26.327445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-23T23:42:38.218800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-23T23:42:39.054195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-23T23:42:48.327799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-23T23:42:49.113061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e967bf31-21d6-4d11-bc3d-0df8177a1b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6809","nonce":2187201732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6811","nonce":2187201732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6815","nonce":2187201732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6813","nonce":2187201732}]},"public_addr":"172.21.15.8:6809/2187201732","cluster_addr":"172.21.15.8:6811/2187201732","heartbeat_back_addr":"172.21.15.8:6815/2187201732","heartbeat_front_addr":"172.21.15.8:6813/2187201732","state":["exists","up"]},{"osd":1,"uuid":"c8e33701-7acd-4474-8402-d52461171fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6818","nonce":3205168010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6822","nonce":3205168010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6830","nonce":3205168010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6826","nonce":3205168010}]},"public_addr":"172.21.15.8:6818/3205168010","cluster_addr":"172.21.15.8:6822/3205168010","heartbeat_back_addr":"172.21.15.8:6830/3205168010","heartbeat_front_addr":"172.21.15.8:6826/3205168010","state":["exists","up"]},{"osd":2,"uuid":"ceebdbf7-4c2f-4757-b52d-fd8b20e77570","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6801","nonce":475463656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6803","nonce":475463656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6807","nonce":475463656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6805","nonce":475463656}]},"public_addr":"172.21.15.8:6801/475463656","cluster_addr":"172.21.15.8:6803/475463656","heartbeat_back_addr":"172.21.15.8:6807/475463656","heartbeat_front_addr":"172.21.15.8:6805/475463656","state":["exists","up"]},{"osd":3,"uuid":"89e258da-5767-429e-8441-edf877d2f3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6819","nonce":1514082871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6821","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6823","nonce":1514082871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6829","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6831","nonce":1514082871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6825","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6827","nonce":1514082871}]},"public_addr":"172.21.15.8:6819/1514082871","cluster_addr":"172.21.15.8:6823/1514082871","heartbeat_back_addr":"172.21.15.8:6831/1514082871","heartbeat_front_addr":"172.21.15.8:6827/1514082871","state":["exists","up"]},{"osd":4,"uuid":"2b7451ae-ea16-4f0a-ae50-04fde75e45ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6825","nonce":3516578147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6827","nonce":3516578147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6831","nonce":3516578147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6829","nonce":3516578147}]},"public_addr":"172.21.15.196:6825/3516578147","cluster_addr":"172.21.15.196:6827/3516578147","heartbeat_back_addr":"172.21.15.196:6831/3516578147","heartbeat_front_addr":"172.21.15.196:6829/3516578147","state":["exists","up"]},{"osd":5,"uuid":"e68a8914-e591-466a-bc9e-f2d7c67aac13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6802","nonce":830595758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6806","nonce":830595758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6814","nonce":830595758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6810","nonce":830595758}]},"public_addr":"172.21.15.196:6802/830595758","cluster_addr":"172.21.15.196:6806/830595758","heartbeat_back_addr":"172.21.15.196:6814/830595758","heartbeat_front_addr":"172.21.15.196:6810/830595758","state":["exists","up"]},{"osd":6,"uuid":"e47723c5-50a0-4cd8-92d9-01972072b422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6801","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6803","nonce":472639906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6805","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6807","nonce":472639906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6815","nonce":472639906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6811","nonce":472639906}]},"public_addr":"172.21.15.196:6803/472639906","cluster_addr":"172.21.15.196:6807/472639906","heartbeat_back_addr":"172.21.15.196:6815/472639906","heartbeat_front_addr":"172.21.15.196:6811/472639906","state":["exists","up"]},{"osd":7,"uuid":"e1e9113d-8005-47b3-9a75-9e701199f1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6817","nonce":4151820349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6819","nonce":4151820349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6823","nonce":4151820349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6821","nonce":4151820349}]},"public_addr":"172.21.15.196:6817/4151820349","cluster_addr":"172.21.15.196:6819/4151820349","heartbeat_back_addr":"172.21.15.196:6823/4151820349","heartbeat_front_addr":"172.21.15.196:6821/4151820349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.221790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.265974+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.190319+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.376359+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.329657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.402958+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.300703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.133121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:42:57.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.177+0000 7fb453800640 1 -- 172.21.15.8:0/1530041795 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb42c067660 msgr2=0x7fb42c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.177+0000 7fb453800640 1 --2- 172.21.15.8:0/1530041795 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb42c067660 0x7fb42c069b20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb440007fd0 tx=0x7fb440009040 comp rx=0 tx=0).stop 2024-03-23T23:42:57.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.177+0000 7fb453800640 1 -- 172.21.15.8:0/1530041795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb44c0c8a50 msgr2=0x7fb44c1491c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.177+0000 7fb453800640 1 --2- 172.21.15.8:0/1530041795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb44c0c8a50 0x7fb44c1491c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb4380097f0 tx=0x7fb43801ac60 comp rx=0 tx=0).stop 2024-03-23T23:42:57.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.177+0000 7fb453800640 1 -- 172.21.15.8:0/1530041795 shutdown_connections 2024-03-23T23:42:57.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.177+0000 7fb453800640 1 --2- 172.21.15.8:0/1530041795 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb42c067660 0x7fb42c069b20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.177+0000 7fb453800640 1 --2- 172.21.15.8:0/1530041795 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb44c149df0 0x7fb44c149700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.177+0000 7fb453800640 1 --2- 172.21.15.8:0/1530041795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb44c0c8a50 0x7fb44c1491c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.177+0000 7fb453800640 1 --2- 172.21.15.8:0/1530041795 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb44c0c4e40 0x7fb44c1efcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.177+0000 7fb453800640 1 -- 172.21.15.8:0/1530041795 >> 172.21.15.8:0/1530041795 conn(0x7fb44c0aafe0 msgr2=0x7fb44c06f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:57.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.177+0000 7fb453800640 1 -- 172.21.15.8:0/1530041795 shutdown_connections 2024-03-23T23:42:57.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.177+0000 7fb453800640 1 -- 172.21.15.8:0/1530041795 wait complete. 2024-03-23T23:42:57.199 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-23T23:42:57.199 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:42:57.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.337+0000 7f4ed1200640 1 Processor -- start 2024-03-23T23:42:57.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.337+0000 7f4ed1200640 1 -- start start 2024-03-23T23:42:57.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.341+0000 7f4ed1200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4ecc070b50 0x7f4ecc1541b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.341+0000 7f4ed1200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ecc0c5560 0x7f4ecc06ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.341+0000 7f4ed1200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ecc1546f0 con 0x7f4ecc14d8b0 2024-03-23T23:42:57.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.341+0000 7f4ed1200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ecc0c4830 con 0x7f4ecc070b50 2024-03-23T23:42:57.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.341+0000 7f4ed1200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc0c50d0 con 0x7f4ecc0c5560 2024-03-23T23:42:57.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.341+0000 7f4ec9400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4ecc070b50 0x7f4ecc1541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.341+0000 7f4ec9400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4ecc070b50 0x7f4ecc1541b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41994/0 (socket says 172.21.15.8:41994) 2024-03-23T23:42:57.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.341+0000 7f4ec9400640 1 -- 172.21.15.8:0/3136855757 learned_addr learned my addr 172.21.15.8:0/3136855757 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:57.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.341+0000 7f4ec9e00640 1 --1- 172.21.15.8:0/3136855757 >> v1:172.21.15.8:6789/0 conn(0x7f4ecc14d8b0 0x7f4ecc0c7130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:44904/0 (socket says 172.21.15.8:44904) 2024-03-23T23:42:57.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.341+0000 7f4eca800640 1 --2- 172.21.15.8:0/3136855757 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ecc0c5560 0x7f4ecc06ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.341+0000 7f4ec9400640 1 -- 172.21.15.8:0/3136855757 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ecc0c5560 msgr2=0x7f4ecc06ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:57.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.341+0000 7f4ec9400640 1 --2- 172.21.15.8:0/3136855757 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ecc0c5560 0x7f4ecc06ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.341+0000 7f4ec9400640 1 -- 172.21.15.8:0/3136855757 >> v1:172.21.15.8:6789/0 conn(0x7f4ecc14d8b0 legacy=0x7f4ecc0c7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.341+0000 7f4ec9400640 1 -- 172.21.15.8:0/3136855757 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ecc0710e0 con 0x7f4ecc070b50 2024-03-23T23:42:57.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.341+0000 7f4eca800640 1 --2- 172.21.15.8:0/3136855757 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ecc0c5560 0x7f4ecc06ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:42:57.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.345+0000 7f4ec9400640 1 --2- 172.21.15.8:0/3136855757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ecc070b50 0x7f4ecc1541b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8009870 tx=0x7f4eb801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f0f0c66edb30ed server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.345+0000 7f4ec8a00640 1 -- 172.21.15.8:0/3136855757 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb80b2070 con 0x7f4ecc070b50 2024-03-23T23:42:57.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.345+0000 7f4ec8a00640 1 -- 172.21.15.8:0/3136855757 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb80a9070 con 0x7f4ecc070b50 2024-03-23T23:42:57.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.345+0000 7f4ec8a00640 1 -- 172.21.15.8:0/3136855757 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb80ad880 con 0x7f4ecc070b50 2024-03-23T23:42:57.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.345+0000 7f4ed1200640 1 -- 172.21.15.8:0/3136855757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ecc070b50 msgr2=0x7f4ecc1541b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.345+0000 7f4ed1200640 1 --2- 172.21.15.8:0/3136855757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ecc070b50 0x7f4ecc1541b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8009870 tx=0x7f4eb801c560 comp rx=0 tx=0).stop 2024-03-23T23:42:57.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.345+0000 7f4ed1200640 1 -- 172.21.15.8:0/3136855757 shutdown_connections 2024-03-23T23:42:57.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.345+0000 7f4ed1200640 1 --2- 172.21.15.8:0/3136855757 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ecc0c5560 0x7f4ecc06ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.345+0000 7f4ed1200640 1 --2- 172.21.15.8:0/3136855757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ecc070b50 0x7f4ecc1541b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.345+0000 7f4ed1200640 1 -- 172.21.15.8:0/3136855757 >> 172.21.15.8:0/3136855757 conn(0x7f4ecc0aafe0 msgr2=0x7f4ecc0ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:57.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.345+0000 7f4ed1200640 1 -- 172.21.15.8:0/3136855757 shutdown_connections 2024-03-23T23:42:57.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.345+0000 7f4ed1200640 1 -- 172.21.15.8:0/3136855757 wait complete. 2024-03-23T23:42:57.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.349+0000 7f4ed1200640 1 Processor -- start 2024-03-23T23:42:57.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.349+0000 7f4ed1200640 1 -- start start 2024-03-23T23:42:57.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.349+0000 7f4ed1200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ecc070b50 0x7f4ecc1480a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.349+0000 7f4ed1200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ecc0c5560 0x7f4ecc156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.349+0000 7f4ed1200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ecc14d8b0 0x7f4ecc156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.349+0000 7f4ed1200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc160a50 con 0x7f4ecc070b50 2024-03-23T23:42:57.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.349+0000 7f4ed1200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc1608d0 con 0x7f4ecc14d8b0 2024-03-23T23:42:57.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.349+0000 7f4ed1200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc160bd0 con 0x7f4ecc0c5560 2024-03-23T23:42:57.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.349+0000 7f4ec9e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ecc070b50 0x7f4ecc1480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.349+0000 7f4ec9e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ecc070b50 0x7f4ecc1480a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42004/0 (socket says 172.21.15.8:42004) 2024-03-23T23:42:57.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.349+0000 7f4ec9e00640 1 -- 172.21.15.8:0/936558875 learned_addr learned my addr 172.21.15.8:0/936558875 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:57.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.349+0000 7f4eca800640 1 --2- 172.21.15.8:0/936558875 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ecc14d8b0 0x7f4ecc156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.349+0000 7f4ec9400640 1 --2- 172.21.15.8:0/936558875 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ecc0c5560 0x7f4ecc156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.349+0000 7f4ec9e00640 1 -- 172.21.15.8:0/936558875 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ecc0c5560 msgr2=0x7f4ecc156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.349+0000 7f4ec9e00640 1 --2- 172.21.15.8:0/936558875 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ecc0c5560 0x7f4ecc156770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.349+0000 7f4ec9e00640 1 -- 172.21.15.8:0/936558875 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ecc14d8b0 msgr2=0x7f4ecc156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.349+0000 7f4ec9e00640 1 --2- 172.21.15.8:0/936558875 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ecc14d8b0 0x7f4ecc156cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.349+0000 7f4ec9e00640 1 -- 172.21.15.8:0/936558875 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ecc0ae030 con 0x7f4ecc070b50 2024-03-23T23:42:57.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.349+0000 7f4eca800640 1 --2- 172.21.15.8:0/936558875 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ecc14d8b0 0x7f4ecc156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:42:57.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.349+0000 7f4ec9400640 1 --2- 172.21.15.8:0/936558875 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ecc0c5560 0x7f4ecc156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:42:57.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.349+0000 7f4ec9e00640 1 --2- 172.21.15.8:0/936558875 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ecc070b50 0x7f4ecc1480a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc00c420 tx=0x7f4ebc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.349+0000 7f4ec2000640 1 -- 172.21.15.8:0/936558875 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc0074e0 con 0x7f4ecc070b50 2024-03-23T23:42:57.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.349+0000 7f4ec2000640 1 -- 172.21.15.8:0/936558875 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ebc007680 con 0x7f4ecc070b50 2024-03-23T23:42:57.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.349+0000 7f4ec2000640 1 -- 172.21.15.8:0/936558875 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc004a30 con 0x7f4ecc070b50 2024-03-23T23:42:57.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.349+0000 7f4ed1200640 1 -- 172.21.15.8:0/936558875 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ecc1511e0 con 0x7f4ecc070b50 2024-03-23T23:42:57.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.349+0000 7f4ed1200640 1 -- 172.21.15.8:0/936558875 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ecc155f70 con 0x7f4ecc070b50 2024-03-23T23:42:57.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.353+0000 7f4ed1200640 1 -- 172.21.15.8:0/936558875 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ecc068270 con 0x7f4ecc070b50 2024-03-23T23:42:57.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.353+0000 7f4ec2000640 1 -- 172.21.15.8:0/936558875 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f4ebc01a020 con 0x7f4ecc070b50 2024-03-23T23:42:57.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.353+0000 7f4ec2000640 1 --2- 172.21.15.8:0/936558875 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4eac067690 0x7f4eac069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.353+0000 7f4ec2000640 1 -- 172.21.15.8:0/936558875 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f4ebc085250 con 0x7f4ecc070b50 2024-03-23T23:42:57.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.353+0000 7f4ec9400640 1 --2- 172.21.15.8:0/936558875 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4eac067690 0x7f4eac069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.353+0000 7f4ec9400640 1 --2- 172.21.15.8:0/936558875 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4eac067690 0x7f4eac069b50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4eb80af000 tx=0x7f4eb8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.357+0000 7f4ec2000640 1 -- 172.21.15.8:0/936558875 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f4ecc1546f0 con 0x7f4ecc070b50 2024-03-23T23:42:57.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.521+0000 7f4ed1200640 1 -- 172.21.15.8:0/936558875 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ecc0c3c30 con 0x7f4ecc070b50 2024-03-23T23:42:57.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.521+0000 7f4ec2000640 1 -- 172.21.15.8:0/936558875 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20271 (secure 0 0 0) 0x7f4ebc0555e0 con 0x7f4ecc070b50 2024-03-23T23:42:57.524 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:42:57.524 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":25,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","created":"2024-03-23T23:42:15.169430+0000","modified":"2024-03-23T23:42:51.739271+0000","last_up_change":"2024-03-23T23:42:26.509742+0000","last_in_change":"2024-03-23T23:42:17.662330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:42:26.327445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-23T23:42:38.218800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-23T23:42:39.054195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-23T23:42:48.327799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-23T23:42:49.113061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e967bf31-21d6-4d11-bc3d-0df8177a1b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6809","nonce":2187201732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6811","nonce":2187201732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6815","nonce":2187201732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6813","nonce":2187201732}]},"public_addr":"172.21.15.8:6809/2187201732","cluster_addr":"172.21.15.8:6811/2187201732","heartbeat_back_addr":"172.21.15.8:6815/2187201732","heartbeat_front_addr":"172.21.15.8:6813/2187201732","state":["exists","up"]},{"osd":1,"uuid":"c8e33701-7acd-4474-8402-d52461171fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6818","nonce":3205168010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6822","nonce":3205168010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6830","nonce":3205168010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6826","nonce":3205168010}]},"public_addr":"172.21.15.8:6818/3205168010","cluster_addr":"172.21.15.8:6822/3205168010","heartbeat_back_addr":"172.21.15.8:6830/3205168010","heartbeat_front_addr":"172.21.15.8:6826/3205168010","state":["exists","up"]},{"osd":2,"uuid":"ceebdbf7-4c2f-4757-b52d-fd8b20e77570","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6801","nonce":475463656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6803","nonce":475463656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6807","nonce":475463656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6805","nonce":475463656}]},"public_addr":"172.21.15.8:6801/475463656","cluster_addr":"172.21.15.8:6803/475463656","heartbeat_back_addr":"172.21.15.8:6807/475463656","heartbeat_front_addr":"172.21.15.8:6805/475463656","state":["exists","up"]},{"osd":3,"uuid":"89e258da-5767-429e-8441-edf877d2f3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6819","nonce":1514082871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6821","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6823","nonce":1514082871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6829","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6831","nonce":1514082871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6825","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6827","nonce":1514082871}]},"public_addr":"172.21.15.8:6819/1514082871","cluster_addr":"172.21.15.8:6823/1514082871","heartbeat_back_addr":"172.21.15.8:6831/1514082871","heartbeat_front_addr":"172.21.15.8:6827/1514082871","state":["exists","up"]},{"osd":4,"uuid":"2b7451ae-ea16-4f0a-ae50-04fde75e45ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6825","nonce":3516578147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6827","nonce":3516578147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6831","nonce":3516578147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6829","nonce":3516578147}]},"public_addr":"172.21.15.196:6825/3516578147","cluster_addr":"172.21.15.196:6827/3516578147","heartbeat_back_addr":"172.21.15.196:6831/3516578147","heartbeat_front_addr":"172.21.15.196:6829/3516578147","state":["exists","up"]},{"osd":5,"uuid":"e68a8914-e591-466a-bc9e-f2d7c67aac13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6802","nonce":830595758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6806","nonce":830595758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6814","nonce":830595758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6810","nonce":830595758}]},"public_addr":"172.21.15.196:6802/830595758","cluster_addr":"172.21.15.196:6806/830595758","heartbeat_back_addr":"172.21.15.196:6814/830595758","heartbeat_front_addr":"172.21.15.196:6810/830595758","state":["exists","up"]},{"osd":6,"uuid":"e47723c5-50a0-4cd8-92d9-01972072b422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6801","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6803","nonce":472639906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6805","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6807","nonce":472639906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6815","nonce":472639906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6811","nonce":472639906}]},"public_addr":"172.21.15.196:6803/472639906","cluster_addr":"172.21.15.196:6807/472639906","heartbeat_back_addr":"172.21.15.196:6815/472639906","heartbeat_front_addr":"172.21.15.196:6811/472639906","state":["exists","up"]},{"osd":7,"uuid":"e1e9113d-8005-47b3-9a75-9e701199f1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6817","nonce":4151820349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6819","nonce":4151820349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6823","nonce":4151820349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6821","nonce":4151820349}]},"public_addr":"172.21.15.196:6817/4151820349","cluster_addr":"172.21.15.196:6819/4151820349","heartbeat_back_addr":"172.21.15.196:6823/4151820349","heartbeat_front_addr":"172.21.15.196:6821/4151820349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.221790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.265974+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.190319+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.376359+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.329657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.402958+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.300703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.133121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:42:57.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.525+0000 7f4ed1200640 1 -- 172.21.15.8:0/936558875 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4eac067690 msgr2=0x7f4eac069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.525+0000 7f4ed1200640 1 --2- 172.21.15.8:0/936558875 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4eac067690 0x7f4eac069b50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4eb80af000 tx=0x7f4eb8008040 comp rx=0 tx=0).stop 2024-03-23T23:42:57.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.525+0000 7f4ed1200640 1 -- 172.21.15.8:0/936558875 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ecc070b50 msgr2=0x7f4ecc1480a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.525+0000 7f4ed1200640 1 --2- 172.21.15.8:0/936558875 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ecc070b50 0x7f4ecc1480a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc00c420 tx=0x7f4ebc00c8e0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.525+0000 7f4ed1200640 1 -- 172.21.15.8:0/936558875 shutdown_connections 2024-03-23T23:42:57.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.525+0000 7f4ed1200640 1 --2- 172.21.15.8:0/936558875 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ecc14d8b0 0x7f4ecc156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.525+0000 7f4ed1200640 1 --2- 172.21.15.8:0/936558875 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4eac067690 0x7f4eac069b50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.525+0000 7f4ed1200640 1 --2- 172.21.15.8:0/936558875 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ecc0c5560 0x7f4ecc156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.525+0000 7f4ed1200640 1 --2- 172.21.15.8:0/936558875 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ecc070b50 0x7f4ecc1480a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.525+0000 7f4ed1200640 1 -- 172.21.15.8:0/936558875 >> 172.21.15.8:0/936558875 conn(0x7f4ecc0aafe0 msgr2=0x7f4ecc143140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:57.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.525+0000 7f4ed1200640 1 -- 172.21.15.8:0/936558875 shutdown_connections 2024-03-23T23:42:57.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.525+0000 7f4ed1200640 1 -- 172.21.15.8:0/936558875 wait complete. 2024-03-23T23:42:57.546 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-23T23:42:57.546 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-23T23:42:57.547 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-23T23:42:57.547 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-23T23:42:57.547 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-23T23:42:57.548 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-23T23:42:57.548 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-23T23:42:57.548 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-23T23:42:57.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.797+0000 7f0cbd400640 1 Processor -- start 2024-03-23T23:42:57.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.797+0000 7f0cbd400640 1 -- start start 2024-03-23T23:42:57.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.797+0000 7f0cbd400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0cb814f910 0x7f0cb80c2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.797+0000 7f0cbd400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb80c3200 con 0x7f0cb806de70 2024-03-23T23:42:57.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.797+0000 7f0cbd400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb8070220 con 0x7f0cb80c2dd0 2024-03-23T23:42:57.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.797+0000 7f0cbd400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cb806f5c0 con 0x7f0cb814f910 2024-03-23T23:42:57.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.797+0000 7f0cb7400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f0cb806de70 0x7f0cb8155940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:44918/0 (socket says 172.21.15.8:44918) 2024-03-23T23:42:57.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.797+0000 7f0cb7400640 1 -- 172.21.15.8:0/1404641188 learned_addr learned my addr 172.21.15.8:0/1404641188 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:57.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.797+0000 7f0cb7e00640 1 --2- 172.21.15.8:0/1404641188 >> v2:172.21.15.196:3300/0 conn(0x7f0cb814f910 0x7f0cb80c2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.797+0000 7f0cb6a00640 1 -- 172.21.15.8:0/1404641188 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082980266 0 0) 0x7f0cb8070220 con 0x7f0cb80c2dd0 2024-03-23T23:42:57.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.801+0000 7f0cb6a00640 1 -- 172.21.15.8:0/1404641188 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c9c003530 con 0x7f0cb80c2dd0 2024-03-23T23:42:57.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.801+0000 7f0cb6a00640 1 -- 172.21.15.8:0/1404641188 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2630040433 0 0) 0x7f0cb80c3200 con 0x7f0cb806de70 2024-03-23T23:42:57.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.801+0000 7f0cb7e00640 1 -- 172.21.15.8:0/1404641188 >> v1:172.21.15.196:6789/0 conn(0x7f0cb80c2dd0 legacy=0x7f0cb8156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.801+0000 7f0cb7e00640 1 -- 172.21.15.8:0/1404641188 >> v1:172.21.15.8:6789/0 conn(0x7f0cb806de70 legacy=0x7f0cb8155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.801+0000 7f0cb7e00640 1 -- 172.21.15.8:0/1404641188 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb8070500 con 0x7f0cb814f910 2024-03-23T23:42:57.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.801+0000 7f0cb7e00640 1 --2- 172.21.15.8:0/1404641188 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0cb814f910 0x7f0cb80c2890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0ca80097c0 tx=0x7f0ca801c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c14e95651752226 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.801+0000 7f4263800640 1 Processor -- start 2024-03-23T23:42:57.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.805+0000 7f0cb6a00640 1 -- 172.21.15.8:0/1404641188 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca80b0070 con 0x7f0cb814f910 2024-03-23T23:42:57.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.805+0000 7f0cb6a00640 1 -- 172.21.15.8:0/1404641188 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca80ab600 con 0x7f0cb814f910 2024-03-23T23:42:57.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.805+0000 7f0cb6a00640 1 -- 172.21.15.8:0/1404641188 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca80ab9d0 con 0x7f0cb814f910 2024-03-23T23:42:57.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.801+0000 7f4263800640 1 -- start start 2024-03-23T23:42:57.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.805+0000 7f4263800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f425c0c9160 0x7f425c1591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.805+0000 7f4263800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f425c0c63f0 con 0x7f425c0b09b0 2024-03-23T23:42:57.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.805+0000 7f4263800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f425c156640 con 0x7f425c06df90 2024-03-23T23:42:57.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.805+0000 7f4263800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f425c0c9880 con 0x7f425c0c9160 2024-03-23T23:42:57.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.805+0000 7f8013e00640 1 Processor -- start 2024-03-23T23:42:57.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.805+0000 7f425be00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f425c0c9160 0x7f425c1591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.805+0000 7f425be00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f425c0c9160 0x7f425c1591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:45858/0 (socket says 172.21.15.8:45858) 2024-03-23T23:42:57.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.805+0000 7f425be00640 1 -- 172.21.15.8:0/3381616107 learned_addr learned my addr 172.21.15.8:0/3381616107 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:57.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.805+0000 7f425be00640 1 -- 172.21.15.8:0/3381616107 >> v1:172.21.15.196:6789/0 conn(0x7f425c06df90 legacy=0x7f425c159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.805+0000 7f8013e00640 1 -- start start 2024-03-23T23:42:57.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.809+0000 7f425b400640 1 -- 172.21.15.8:0/3381616107 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020658955 0 0) 0x7f425c156640 con 0x7f425c06df90 2024-03-23T23:42:57.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.809+0000 7f425be00640 1 -- 172.21.15.8:0/3381616107 >> v1:172.21.15.8:6789/0 conn(0x7f425c0b09b0 legacy=0x7f425c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.809+0000 7f0cbd400640 1 -- 172.21.15.8:0/1404641188 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0cb814f910 msgr2=0x7f0cb80c2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.809+0000 7f0cbd400640 1 --2- 172.21.15.8:0/1404641188 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0cb814f910 0x7f0cb80c2890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0ca80097c0 tx=0x7f0ca801c430 comp rx=0 tx=0).stop 2024-03-23T23:42:57.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.809+0000 7f0cbd400640 1 -- 172.21.15.8:0/1404641188 shutdown_connections 2024-03-23T23:42:57.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.809+0000 7f0cbd400640 1 --2- 172.21.15.8:0/1404641188 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0cb814f910 0x7f0cb80c2890 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.809+0000 7f0cbd400640 1 -- 172.21.15.8:0/1404641188 >> 172.21.15.8:0/1404641188 conn(0x7f0cb80c4990 msgr2=0x7f0cb80c4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:57.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.809+0000 7f425be00640 1 -- 172.21.15.8:0/3381616107 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f425c0c5e30 con 0x7f425c0c9160 2024-03-23T23:42:57.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.809+0000 7f2673c00640 1 Processor -- start 2024-03-23T23:42:57.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.809+0000 7f8013e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f801406dcb0 0x7f80141517b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.809+0000 7f8013e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f801406e1d0 con 0x7f801414ef10 2024-03-23T23:42:57.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.809+0000 7f8013e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f801406d940 con 0x7f8014072ff0 2024-03-23T23:42:57.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.809+0000 7f8013e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8014152510 con 0x7f801406dcb0 2024-03-23T23:42:57.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.809+0000 7f8013400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f8014072ff0 0x7f8014151cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:46200/0 (socket says 172.21.15.8:46200) 2024-03-23T23:42:57.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.809+0000 7f8013400640 1 -- 172.21.15.8:0/3745639677 learned_addr learned my addr 172.21.15.8:0/3745639677 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:57.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.813+0000 7f0cbd400640 1 -- 172.21.15.8:0/1404641188 shutdown_connections 2024-03-23T23:42:57.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.813+0000 7f0cbd400640 1 -- 172.21.15.8:0/1404641188 wait complete. 2024-03-23T23:42:57.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.813+0000 7f8012000640 1 -- 172.21.15.8:0/3745639677 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3234255042 0 0) 0x7f801406d940 con 0x7f8014072ff0 2024-03-23T23:42:57.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.813+0000 7f800be00640 1 --2- 172.21.15.8:0/3745639677 >> v2:172.21.15.8:3300/0 conn(0x7f801406dcb0 0x7f80141517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.813+0000 7f8012000640 1 -- 172.21.15.8:0/3745639677 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ff8004640 con 0x7f8014072ff0 2024-03-23T23:42:57.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.813+0000 7f800be00640 1 -- 172.21.15.8:0/3745639677 >> v1:172.21.15.196:6789/0 conn(0x7f8014072ff0 legacy=0x7f8014151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.813+0000 7f800be00640 1 -- 172.21.15.8:0/3745639677 >> v1:172.21.15.8:6789/0 conn(0x7f801414ef10 legacy=0x7f80140c1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:57.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.813+0000 7f800be00640 1 -- 172.21.15.8:0/3745639677 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801406d180 con 0x7f801406dcb0 2024-03-23T23:42:57.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.809+0000 7f2673c00640 1 -- start start 2024-03-23T23:42:57.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.813+0000 7f2673c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f266c0c7fe0 0x7f266c0c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.813+0000 7f2673c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f266c0b0fd0 0x7f266c0b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.813+0000 7f2673c00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f266c06d860 con 0x7f266c1598c0 2024-03-23T23:42:57.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.813+0000 7f2673c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f266c06db00 con 0x7f266c0b0fd0 2024-03-23T23:42:57.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.813+0000 7f2673c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f266c06dde0 con 0x7f266c0c7fe0 2024-03-23T23:42:57.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.813+0000 7f2671200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f266c0c7fe0 0x7f266c0c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.813+0000 7f2671c00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f266c1598c0 0x7f266c1558f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:44962/0 (socket says 172.21.15.8:44962) 2024-03-23T23:42:57.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.813+0000 7f2671c00640 1 -- 172.21.15.8:0/3823904682 learned_addr learned my addr 172.21.15.8:0/3823904682 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:57.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.813+0000 7fbe27000640 1 Processor -- start 2024-03-23T23:42:57.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.813+0000 7f425be00640 1 --2- 172.21.15.8:0/3381616107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f425c0c9160 0x7f425c1591d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4254009e50 tx=0x7f425401c6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d185e14912fee182 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.813+0000 7f425b400640 1 -- 172.21.15.8:0/3381616107 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42540ac070 con 0x7f425c0c9160 2024-03-23T23:42:57.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.813+0000 7f425b400640 1 -- 172.21.15.8:0/3381616107 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42540a8420 con 0x7f425c0c9160 2024-03-23T23:42:57.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.813+0000 7f425b400640 1 -- 172.21.15.8:0/3381616107 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42540a87f0 con 0x7f425c0c9160 2024-03-23T23:42:57.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f4263800640 1 -- 172.21.15.8:0/3381616107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f425c0c9160 msgr2=0x7f425c1591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f4263800640 1 --2- 172.21.15.8:0/3381616107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f425c0c9160 0x7f425c1591d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4254009e50 tx=0x7f425401c6f0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f4263800640 1 -- 172.21.15.8:0/3381616107 shutdown_connections 2024-03-23T23:42:57.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f4263800640 1 --2- 172.21.15.8:0/3381616107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f425c0c9160 0x7f425c1591d0 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4254009e50 tx=0x7f425401c6f0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f4263800640 1 -- 172.21.15.8:0/3381616107 >> 172.21.15.8:0/3381616107 conn(0x7f425c0ad450 msgr2=0x7f425c0cb260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:57.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f0cbd400640 1 Processor -- start 2024-03-23T23:42:57.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f0cbd400640 1 -- start start 2024-03-23T23:42:57.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f0cbd400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0cb806de70 0x7f0cb8147280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f0cbd400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0cb80c2dd0 0x7f0cb80aaf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f0cbd400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0cb814f910 0x7f0cb81f5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f0cbd400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb806feb0 con 0x7f0cb806de70 2024-03-23T23:42:57.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f0cbd400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb806fd30 con 0x7f0cb80c2dd0 2024-03-23T23:42:57.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f0cbd400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb806b170 con 0x7f0cb814f910 2024-03-23T23:42:57.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f0cb7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0cb806de70 0x7f0cb8147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f0cb7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0cb806de70 0x7f0cb8147280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42016/0 (socket says 172.21.15.8:42016) 2024-03-23T23:42:57.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f0cb7e00640 1 -- 172.21.15.8:0/2339692016 learned_addr learned my addr 172.21.15.8:0/2339692016 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:57.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f0cbca00640 1 --2- 172.21.15.8:0/2339692016 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0cb814f910 0x7f0cb81f5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f0cb7400640 1 --2- 172.21.15.8:0/2339692016 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0cb80c2dd0 0x7f0cb80aaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f0cbca00640 1 -- 172.21.15.8:0/2339692016 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0cb80c2dd0 msgr2=0x7f0cb80aaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f0cbca00640 1 --2- 172.21.15.8:0/2339692016 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0cb80c2dd0 0x7f0cb80aaf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f0cbca00640 1 -- 172.21.15.8:0/2339692016 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0cb806de70 msgr2=0x7f0cb8147280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f0cbca00640 1 --2- 172.21.15.8:0/2339692016 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0cb806de70 0x7f0cb8147280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f0cbca00640 1 -- 172.21.15.8:0/2339692016 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb81479f0 con 0x7f0cb814f910 2024-03-23T23:42:57.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f4263800640 1 -- 172.21.15.8:0/3381616107 shutdown_connections 2024-03-23T23:42:57.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f4263800640 1 -- 172.21.15.8:0/3381616107 wait complete. 2024-03-23T23:42:57.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f4263800640 1 Processor -- start 2024-03-23T23:42:57.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f800be00640 1 --2- 172.21.15.8:0/3745639677 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f801406dcb0 0x7f80141517b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00c850 tx=0x7f7ffc021160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec9878a869db06a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.813+0000 7f266b400640 1 -- 172.21.15.8:0/3823904682 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 406199270 0 0) 0x7f266c06d860 con 0x7f266c1598c0 2024-03-23T23:42:57.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f266b400640 1 -- 172.21.15.8:0/3823904682 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2654003530 con 0x7f266c1598c0 2024-03-23T23:42:57.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.813+0000 7fbe27000640 1 -- start start 2024-03-23T23:42:57.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7fbe27000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe20151bb0 0x7fbe200c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7fbe27000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbe20151f90 0x7fbe2006e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7fbe27000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe200c21f0 con 0x7fbe201523d0 2024-03-23T23:42:57.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7fbe27000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe20071b60 con 0x7fbe20151f90 2024-03-23T23:42:57.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7fbe27000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe20071e40 con 0x7fbe20151bb0 2024-03-23T23:42:57.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f0cbca00640 1 --2- 172.21.15.8:0/2339692016 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0cb814f910 0x7f0cb81f5620 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0cb000c700 tx=0x7f0cb000cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.821+0000 7f8012000640 1 -- 172.21.15.8:0/3745639677 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc00b680 con 0x7f801406dcb0 2024-03-23T23:42:57.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.821+0000 7f0cafe00640 1 -- 172.21.15.8:0/2339692016 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0003b80 con 0x7f0cb814f910 2024-03-23T23:42:57.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.821+0000 7f0cafe00640 1 -- 172.21.15.8:0/2339692016 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb0003d20 con 0x7f0cb814f910 2024-03-23T23:42:57.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.821+0000 7f0cafe00640 1 -- 172.21.15.8:0/2339692016 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb000aa70 con 0x7f0cb814f910 2024-03-23T23:42:57.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.821+0000 7f0cbd400640 1 -- 172.21.15.8:0/2339692016 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb8147cd0 con 0x7f0cb814f910 2024-03-23T23:42:57.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.821+0000 7f0cbd400640 1 -- 172.21.15.8:0/2339692016 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb80ab4d0 con 0x7f0cb814f910 2024-03-23T23:42:57.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.821+0000 7f8012000640 1 -- 172.21.15.8:0/3745639677 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ffc00b820 con 0x7f801406dcb0 2024-03-23T23:42:57.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.821+0000 7f8012000640 1 -- 172.21.15.8:0/3745639677 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc00bc10 con 0x7f801406dcb0 2024-03-23T23:42:57.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.821+0000 7f0cbd400640 1 -- 172.21.15.8:0/2339692016 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0cb8147f10 con 0x7f0cb814f910 2024-03-23T23:42:57.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.821+0000 7f8013e00640 1 -- 172.21.15.8:0/3745639677 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f801406dcb0 msgr2=0x7f80141517b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.821+0000 7f8013e00640 1 --2- 172.21.15.8:0/3745639677 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f801406dcb0 0x7f80141517b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00c850 tx=0x7f7ffc021160 comp rx=0 tx=0).stop 2024-03-23T23:42:57.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.821+0000 7f62b5800640 1 Processor -- start 2024-03-23T23:42:57.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f2671200640 1 -- 172.21.15.8:0/3823904682 >> v2:172.21.15.196:3300/0 conn(0x7f266c0b0fd0 msgr2=0x7f266c0b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:57.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f2671200640 1 --2- 172.21.15.8:0/3823904682 >> v2:172.21.15.196:3300/0 conn(0x7f266c0b0fd0 0x7f266c0b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f2671200640 1 -- 172.21.15.8:0/3823904682 >> v1:172.21.15.8:6789/0 conn(0x7f266c1598c0 legacy=0x7f266c1558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.817+0000 7f2671200640 1 -- 172.21.15.8:0/3823904682 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266c0c5c10 con 0x7f266c0c7fe0 2024-03-23T23:42:57.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.821+0000 7fbe1fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe20151bb0 0x7fbe200c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.821+0000 7fbe1fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe20151bb0 0x7fbe200c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:49462/0 (socket says 172.21.15.8:49462) 2024-03-23T23:42:57.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.821+0000 7fbe1fe00640 1 -- 172.21.15.8:0/349068023 learned_addr learned my addr 172.21.15.8:0/349068023 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:57.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.821+0000 7fbe17e00640 1 --2- 172.21.15.8:0/349068023 >> v2:172.21.15.196:3300/0 conn(0x7fbe20151f90 0x7fbe2006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.821+0000 7f0cafe00640 1 -- 172.21.15.8:0/2339692016 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f0cb000ac10 con 0x7f0cb814f910 2024-03-23T23:42:57.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f0cafe00640 1 --2- 172.21.15.8:0/2339692016 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0c980676e0 0x7f0c98069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f0cafe00640 1 -- 172.21.15.8:0/2339692016 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f0cb00858b0 con 0x7f0cb814f910 2024-03-23T23:42:57.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f0cafe00640 1 --2- 172.21.15.8:0/2339692016 >> [v2:172.21.15.8:6808/2187201732,v1:172.21.15.8:6809/2187201732] conn(0x7f0c98071f00 0x7f0c98074320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f0cafe00640 1 -- 172.21.15.8:0/2339692016 --> [v2:172.21.15.8:6808/2187201732,v1:172.21.15.8:6809/2187201732] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0cb0010e50 con 0x7f0c98071f00 2024-03-23T23:42:57.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f0cafe00640 1 -- 172.21.15.8:0/2339692016 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0cb0051e30 con 0x7f0cb814f910 2024-03-23T23:42:57.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f0cb7400640 1 --2- 172.21.15.8:0/2339692016 >> [v2:172.21.15.8:6808/2187201732,v1:172.21.15.8:6809/2187201732] conn(0x7f0c98071f00 0x7f0c98074320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f0cb7e00640 1 --2- 172.21.15.8:0/2339692016 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0c980676e0 0x7f0c98069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f0cb7400640 1 --2- 172.21.15.8:0/2339692016 >> [v2:172.21.15.8:6808/2187201732,v1:172.21.15.8:6809/2187201732] conn(0x7f0c98071f00 0x7f0c98074320 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.821+0000 7f4263800640 1 -- start start 2024-03-23T23:42:57.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f4263800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f425c06df90 0x7f425c157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f4263800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f425c0b09b0 0x7f425c14f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f4263800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f425c14f5a0 0x7f425c1ee1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f4263800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425c163b30 con 0x7f425c14f5a0 2024-03-23T23:42:57.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f4263800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425c1639b0 con 0x7f425c06df90 2024-03-23T23:42:57.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f4263800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f425c163cb0 con 0x7f425c0b09b0 2024-03-23T23:42:57.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f4261800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f425c14f5a0 0x7f425c1ee1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f4261800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f425c14f5a0 0x7f425c1ee1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42032/0 (socket says 172.21.15.8:42032) 2024-03-23T23:42:57.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f4261800640 1 -- 172.21.15.8:0/4251939893 learned_addr learned my addr 172.21.15.8:0/4251939893 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:57.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f425be00640 1 --2- 172.21.15.8:0/4251939893 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f425c0b09b0 0x7f425c14f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f4261800640 1 -- 172.21.15.8:0/4251939893 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f425c0b09b0 msgr2=0x7f425c14f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f4261800640 1 --2- 172.21.15.8:0/4251939893 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f425c0b09b0 0x7f425c14f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f4261800640 1 -- 172.21.15.8:0/4251939893 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f425c06df90 msgr2=0x7f425c157bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:42:57.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f4261800640 1 --2- 172.21.15.8:0/4251939893 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f425c06df90 0x7f425c157bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f4261800640 1 -- 172.21.15.8:0/4251939893 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f425c0c5450 con 0x7f425c14f5a0 2024-03-23T23:42:57.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f8013e00640 1 -- 172.21.15.8:0/3745639677 shutdown_connections 2024-03-23T23:42:57.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f8013e00640 1 --2- 172.21.15.8:0/3745639677 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f801406dcb0 0x7f80141517b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f8013e00640 1 -- 172.21.15.8:0/3745639677 >> 172.21.15.8:0/3745639677 conn(0x7f801406b170 msgr2=0x7f801406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:57.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f8013e00640 1 -- 172.21.15.8:0/3745639677 shutdown_connections 2024-03-23T23:42:57.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f8013e00640 1 -- 172.21.15.8:0/3745639677 wait complete. 2024-03-23T23:42:57.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.821+0000 7f62b5800640 1 -- start start 2024-03-23T23:42:57.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f62afe00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f62b0152eb0 0x7f62b00c8e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:44972/0 (socket says 172.21.15.8:44972) 2024-03-23T23:42:57.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f62b5800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f62b00c58d0 0x7f62b00c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f62afe00640 1 -- 172.21.15.8:0/2616865369 learned_addr learned my addr 172.21.15.8:0/2616865369 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:57.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f62af400640 1 --2- 172.21.15.8:0/2616865369 >> v2:172.21.15.8:3300/0 conn(0x7f62b00c58d0 0x7f62b00c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f62b5800640 1 --2- 172.21.15.8:0/2616865369 >> v2:172.21.15.196:3300/0 conn(0x7f62b0158c60 0x7f62b0159090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f62b4e00640 1 --2- 172.21.15.8:0/2616865369 >> v2:172.21.15.196:3300/0 conn(0x7f62b0158c60 0x7f62b0159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f62b5800640 1 -- 172.21.15.8:0/2616865369 --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62b01557c0 con 0x7f62b0152eb0 2024-03-23T23:42:57.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f62b5800640 1 -- 172.21.15.8:0/2616865369 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62b0155aa0 con 0x7f62b00c58d0 2024-03-23T23:42:57.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f62b5800640 1 -- 172.21.15.8:0/2616865369 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62b0155d80 con 0x7f62b0158c60 2024-03-23T23:42:57.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f62b4e00640 1 -- 172.21.15.8:0/2616865369 >> v2:172.21.15.8:3300/0 conn(0x7f62b00c58d0 msgr2=0x7f62b00c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:57.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.821+0000 7fbe1fe00640 1 -- 172.21.15.8:0/349068023 >> v2:172.21.15.196:3300/0 conn(0x7fbe20151f90 msgr2=0x7fbe2006e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:57.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.821+0000 7fbe1fe00640 1 --2- 172.21.15.8:0/349068023 >> v2:172.21.15.196:3300/0 conn(0x7fbe20151f90 0x7fbe2006e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.821+0000 7fbe1fe00640 1 -- 172.21.15.8:0/349068023 >> v1:172.21.15.196:6789/0 conn(0x7fbe201523d0 legacy=0x7fbe2014eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:57.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.821+0000 7fbe1fe00640 1 -- 172.21.15.8:0/349068023 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe20072120 con 0x7fbe20151bb0 2024-03-23T23:42:57.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f62b4e00640 1 --2- 172.21.15.8:0/2616865369 >> v2:172.21.15.8:3300/0 conn(0x7f62b00c58d0 0x7f62b00c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f62b4e00640 1 -- 172.21.15.8:0/2616865369 >> v1:172.21.15.8:6789/0 conn(0x7f62b0152eb0 legacy=0x7f62b00c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.825+0000 7f62b4e00640 1 -- 172.21.15.8:0/2616865369 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b0156060 con 0x7f62b0158c60 2024-03-23T23:42:57.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.829+0000 7f62af400640 1 --2- 172.21.15.8:0/2616865369 >> v2:172.21.15.8:3300/0 conn(0x7f62b00c58d0 0x7f62b00c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:42:57.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.829+0000 7f0cafe00640 1 -- 172.21.15.8:0/2339692016 <== osd.0 v2:172.21.15.8:6808/2187201732 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0cb0010e50 con 0x7f0c98071f00 2024-03-23T23:42:57.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.829+0000 7f2671200640 1 --2- 172.21.15.8:0/3823904682 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f266c0c7fe0 0x7f266c0c83c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f26580097c0 tx=0x7f265801c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e5fcc568d42596e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.829+0000 7fbe1fe00640 1 --2- 172.21.15.8:0/349068023 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe20151bb0 0x7fbe200c1cb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbe1000a910 tx=0x7fbe1001c580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d078ad9103b6c53e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.829+0000 7f266b400640 1 -- 172.21.15.8:0/3823904682 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c0c6340 con 0x7f266c0c7fe0 2024-03-23T23:42:57.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.829+0000 7f266b400640 1 -- 172.21.15.8:0/3823904682 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26580b0070 con 0x7f266c0c7fe0 2024-03-23T23:42:57.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.829+0000 7f266b400640 1 -- 172.21.15.8:0/3823904682 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26580ab650 con 0x7f266c0c7fe0 2024-03-23T23:42:57.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.829+0000 7fbe1f400640 1 -- 172.21.15.8:0/349068023 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe100ab070 con 0x7fbe20151bb0 2024-03-23T23:42:57.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.829+0000 7f8013e00640 1 Processor -- start 2024-03-23T23:42:57.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.829+0000 7fbe1f400640 1 -- 172.21.15.8:0/349068023 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe100af600 con 0x7fbe20151bb0 2024-03-23T23:42:57.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.829+0000 7fbe1f400640 1 -- 172.21.15.8:0/349068023 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe100af9d0 con 0x7fbe20151bb0 2024-03-23T23:42:57.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.829+0000 7f2673c00640 1 -- 172.21.15.8:0/3823904682 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f266c0c7fe0 msgr2=0x7f266c0c83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.829+0000 7f2673c00640 1 --2- 172.21.15.8:0/3823904682 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f266c0c7fe0 0x7f266c0c83c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f26580097c0 tx=0x7f265801c430 comp rx=0 tx=0).stop 2024-03-23T23:42:57.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.829+0000 7f2673c00640 1 -- 172.21.15.8:0/3823904682 shutdown_connections 2024-03-23T23:42:57.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.829+0000 7f2673c00640 1 --2- 172.21.15.8:0/3823904682 >> v2:172.21.15.196:3300/0 conn(0x7f266c0b0fd0 0x7f266c0b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.829+0000 7f2673c00640 1 --2- 172.21.15.8:0/3823904682 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f266c0c7fe0 0x7f266c0c83c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.829+0000 7f2673c00640 1 -- 172.21.15.8:0/3823904682 >> 172.21.15.8:0/3823904682 conn(0x7f266c0745c0 msgr2=0x7f266c0749d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:57.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.829+0000 7f4261800640 1 --2- 172.21.15.8:0/4251939893 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f425c14f5a0 0x7f425c1ee1f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4248012f90 tx=0x7f4248014050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.829+0000 7f0cb7e00640 1 --2- 172.21.15.8:0/2339692016 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0c980676e0 0x7f0c98069ba0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8000c10 tx=0x7f0ca8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.829+0000 7f4258c00640 1 -- 172.21.15.8:0/4251939893 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42480052e0 con 0x7f425c14f5a0 2024-03-23T23:42:57.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.829+0000 7f4258c00640 1 -- 172.21.15.8:0/4251939893 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4248005480 con 0x7f425c14f5a0 2024-03-23T23:42:57.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.829+0000 7f4258c00640 1 -- 172.21.15.8:0/4251939893 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4248012360 con 0x7f425c14f5a0 2024-03-23T23:42:57.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.833+0000 7f62b4e00640 1 --2- 172.21.15.8:0/2616865369 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62b0158c60 0x7f62b0159090 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f62b006d2d0 tx=0x7f62a001c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30b59db68434af84 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.833+0000 7f62aea00640 1 -- 172.21.15.8:0/2616865369 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a00b0070 con 0x7f62b0158c60 2024-03-23T23:42:57.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.833+0000 7fbe27000640 1 -- 172.21.15.8:0/349068023 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe20151bb0 msgr2=0x7fbe200c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.833+0000 7fbe27000640 1 --2- 172.21.15.8:0/349068023 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe20151bb0 0x7fbe200c1cb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbe1000a910 tx=0x7fbe1001c580 comp rx=0 tx=0).stop 2024-03-23T23:42:57.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.829+0000 7f2673c00640 1 -- 172.21.15.8:0/3823904682 shutdown_connections 2024-03-23T23:42:57.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.829+0000 7f2673c00640 1 -- 172.21.15.8:0/3823904682 wait complete. 2024-03-23T23:42:57.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.833+0000 7fbe27000640 1 -- 172.21.15.8:0/349068023 shutdown_connections 2024-03-23T23:42:57.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.833+0000 7fbe27000640 1 --2- 172.21.15.8:0/349068023 >> v2:172.21.15.196:3300/0 conn(0x7fbe20151f90 0x7fbe2006e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.833+0000 7fbe27000640 1 --2- 172.21.15.8:0/349068023 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe20151bb0 0x7fbe200c1cb0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.833+0000 7fbe27000640 1 -- 172.21.15.8:0/349068023 >> 172.21.15.8:0/349068023 conn(0x7fbe200a9870 msgr2=0x7fbe2006b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:57.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.833+0000 7f62aea00640 1 -- 172.21.15.8:0/2616865369 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a00ab600 con 0x7f62b0158c60 2024-03-23T23:42:57.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.833+0000 7f4263800640 1 -- 172.21.15.8:0/4251939893 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f425c152ca0 con 0x7f425c14f5a0 2024-03-23T23:42:57.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.833+0000 7f4263800640 1 -- 172.21.15.8:0/4251939893 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f425c0c3030 con 0x7f425c14f5a0 2024-03-23T23:42:57.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.833+0000 7fbe27000640 1 -- 172.21.15.8:0/349068023 shutdown_connections 2024-03-23T23:42:57.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.833+0000 7f62aea00640 1 -- 172.21.15.8:0/2616865369 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a00ab9d0 con 0x7f62b0158c60 2024-03-23T23:42:57.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.833+0000 7f62b5800640 1 -- 172.21.15.8:0/2616865369 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62b0158c60 msgr2=0x7f62b0159090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.833+0000 7f62b5800640 1 --2- 172.21.15.8:0/2616865369 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62b0158c60 0x7f62b0159090 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f62b006d2d0 tx=0x7f62a001c360 comp rx=0 tx=0).stop 2024-03-23T23:42:57.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.833+0000 7fbe27000640 1 -- 172.21.15.8:0/349068023 wait complete. 2024-03-23T23:42:57.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.833+0000 7f4263800640 1 -- 172.21.15.8:0/4251939893 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f425c1eddf0 con 0x7f425c14f5a0 2024-03-23T23:42:57.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.833+0000 7f2673c00640 1 Processor -- start 2024-03-23T23:42:57.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.833+0000 7f62b5800640 1 -- 172.21.15.8:0/2616865369 shutdown_connections 2024-03-23T23:42:57.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.833+0000 7f62b5800640 1 --2- 172.21.15.8:0/2616865369 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62b0158c60 0x7f62b0159090 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.833+0000 7f2673c00640 1 -- start start 2024-03-23T23:42:57.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.833+0000 7f62b5800640 1 --2- 172.21.15.8:0/2616865369 >> v2:172.21.15.8:3300/0 conn(0x7f62b00c58d0 0x7f62b00c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.833+0000 7f62b5800640 1 -- 172.21.15.8:0/2616865369 >> 172.21.15.8:0/2616865369 conn(0x7f62b0072a70 msgr2=0x7f62b0072e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:57.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7f62b5800640 1 -- 172.21.15.8:0/2616865369 shutdown_connections 2024-03-23T23:42:57.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7fbe27000640 1 Processor -- start 2024-03-23T23:42:57.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7f62b5800640 1 -- 172.21.15.8:0/2616865369 wait complete. 2024-03-23T23:42:57.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7f2673c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f266c0b0fd0 0x7f266c151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7f4258c00640 1 -- 172.21.15.8:0/4251939893 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f4248012500 con 0x7f425c14f5a0 2024-03-23T23:42:57.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7f2671200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f266c0b0fd0 0x7f266c151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7f2671200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f266c0b0fd0 0x7f266c151d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42058/0 (socket says 172.21.15.8:42058) 2024-03-23T23:42:57.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7f2671200640 1 -- 172.21.15.8:0/632351364 learned_addr learned my addr 172.21.15.8:0/632351364 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:57.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7f2673c00640 1 --2- 172.21.15.8:0/632351364 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f266c0c7fe0 0x7f266c14a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7f2673c00640 1 --2- 172.21.15.8:0/632351364 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f266c1598c0 0x7f266c14a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7fbe27000640 1 -- start start 2024-03-23T23:42:57.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7f4258c00640 1 --2- 172.21.15.8:0/4251939893 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f423c0676b0 0x7f423c069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7f8013e00640 1 -- start start 2024-03-23T23:42:57.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7f8013e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f801406dcb0 0x7f8014141c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7f8013e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8014072ff0 0x7f80141ed6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7f266be00640 1 --2- 172.21.15.8:0/632351364 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f266c0c7fe0 0x7f266c14a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7fbe27000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe20151bb0 0x7fbe201418c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7f2673c00640 1 -- 172.21.15.8:0/632351364 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266c162a90 con 0x7f266c0b0fd0 2024-03-23T23:42:57.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7fbe27000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe20151f90 0x7fbe200c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7f2671c00640 1 --2- 172.21.15.8:0/632351364 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f266c1598c0 0x7f266c14a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7f4258c00640 1 -- 172.21.15.8:0/4251939893 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f4248096530 con 0x7f425c14f5a0 2024-03-23T23:42:57.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7fbe1fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe20151bb0 0x7fbe201418c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7fbe1fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe20151bb0 0x7fbe201418c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:49496/0 (socket says 172.21.15.8:49496) 2024-03-23T23:42:57.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7fbe1fe00640 1 -- 172.21.15.8:0/448548471 learned_addr learned my addr 172.21.15.8:0/448548471 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:57.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7f2673c00640 1 -- 172.21.15.8:0/632351364 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266c0b0ae0 con 0x7f266c1598c0 2024-03-23T23:42:57.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7f2673c00640 1 -- 172.21.15.8:0/632351364 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f266c162c10 con 0x7f266c0c7fe0 2024-03-23T23:42:57.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7f4258c00640 1 --2- 172.21.15.8:0/4251939893 >> [v2:172.21.15.8:6816/3205168010,v1:172.21.15.8:6818/3205168010] conn(0x7f423c071f40 0x7f423c074360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7f4258c00640 1 -- 172.21.15.8:0/4251939893 --> [v2:172.21.15.8:6816/3205168010,v1:172.21.15.8:6818/3205168010] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f423c074a10 con 0x7f423c071f40 2024-03-23T23:42:57.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7f4258c00640 1 -- 172.21.15.8:0/4251939893 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42480968e0 con 0x7f425c14f5a0 2024-03-23T23:42:57.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7f8012a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f801406dcb0 0x7f8014141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7f8012a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f801406dcb0 0x7f8014141c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:49506/0 (socket says 172.21.15.8:49506) 2024-03-23T23:42:57.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7fbe27000640 1 --2- 172.21.15.8:0/448548471 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe201523d0 0x7fbe20143df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7fbe27000640 1 -- 172.21.15.8:0/448548471 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2006ec10 con 0x7fbe20151f90 2024-03-23T23:42:57.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7fbe27000640 1 -- 172.21.15.8:0/448548471 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2006ea90 con 0x7fbe201523d0 2024-03-23T23:42:57.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7fbe27000640 1 -- 172.21.15.8:0/448548471 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2015ea20 con 0x7fbe20151bb0 2024-03-23T23:42:57.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7f266be00640 1 -- 172.21.15.8:0/632351364 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f266c1598c0 msgr2=0x7f266c14a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7f266be00640 1 --2- 172.21.15.8:0/632351364 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f266c1598c0 0x7f266c14a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7f266be00640 1 -- 172.21.15.8:0/632351364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f266c0b0fd0 msgr2=0x7f266c151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7f266be00640 1 --2- 172.21.15.8:0/632351364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f266c0b0fd0 0x7f266c151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.837+0000 7f266be00640 1 -- 172.21.15.8:0/632351364 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266c0b06c0 con 0x7f266c0c7fe0 2024-03-23T23:42:57.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7fbe17e00640 1 --2- 172.21.15.8:0/448548471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe20151f90 0x7fbe200c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7f4260e00640 1 --2- 172.21.15.8:0/4251939893 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f423c0676b0 0x7f423c069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7f266be00640 1 --2- 172.21.15.8:0/632351364 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f266c0c7fe0 0x7f266c14a400 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f266000b410 tx=0x7f266000b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7fbe25000640 1 --2- 172.21.15.8:0/448548471 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe201523d0 0x7fbe20143df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7f425be00640 1 --2- 172.21.15.8:0/4251939893 >> [v2:172.21.15.8:6816/3205168010,v1:172.21.15.8:6818/3205168010] conn(0x7f423c071f40 0x7f423c074360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7f62b5800640 1 Processor -- start 2024-03-23T23:42:57.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7f2671c00640 1 --2- 172.21.15.8:0/632351364 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f266c1598c0 0x7f266c14a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:42:57.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7f2668c00640 1 -- 172.21.15.8:0/632351364 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2660015020 con 0x7f266c0c7fe0 2024-03-23T23:42:57.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7f2668c00640 1 -- 172.21.15.8:0/632351364 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2660011830 con 0x7f266c0c7fe0 2024-03-23T23:42:57.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7f2668c00640 1 -- 172.21.15.8:0/632351364 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2660011c00 con 0x7f266c0c7fe0 2024-03-23T23:42:57.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7fbe25000640 1 -- 172.21.15.8:0/448548471 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe20151bb0 msgr2=0x7fbe201418c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7f8012a00640 1 -- 172.21.15.8:0/3601003530 learned_addr learned my addr 172.21.15.8:0/3601003530 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:57.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7fbe25000640 1 --2- 172.21.15.8:0/448548471 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe20151bb0 0x7fbe201418c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7f800be00640 1 --2- 172.21.15.8:0/3601003530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8014072ff0 0x7f80141ed6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7f4260e00640 1 --2- 172.21.15.8:0/4251939893 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f423c0676b0 0x7f423c069b70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f424c001500 tx=0x7f424c0079c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7fbe25000640 1 -- 172.21.15.8:0/448548471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe20151f90 msgr2=0x7fbe200c5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7fbe25000640 1 --2- 172.21.15.8:0/448548471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe20151f90 0x7fbe200c5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7f2673c00640 1 -- 172.21.15.8:0/632351364 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f266c153ab0 con 0x7f266c0c7fe0 2024-03-23T23:42:57.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7fbe25000640 1 -- 172.21.15.8:0/448548471 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe201f3280 con 0x7fbe201523d0 2024-03-23T23:42:57.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7f8013e00640 1 --2- 172.21.15.8:0/3601003530 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f801414ef10 0x7f80141edbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7f8013e00640 1 -- 172.21.15.8:0/3601003530 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801415fc50 con 0x7f8014072ff0 2024-03-23T23:42:57.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7f8013e00640 1 -- 172.21.15.8:0/3601003530 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801415fad0 con 0x7f801414ef10 2024-03-23T23:42:57.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7f8013e00640 1 -- 172.21.15.8:0/3601003530 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801415fdd0 con 0x7f801406dcb0 2024-03-23T23:42:57.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7f8013400640 1 --2- 172.21.15.8:0/3601003530 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f801414ef10 0x7f80141edbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7f2673c00640 1 -- 172.21.15.8:0/632351364 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f266c154070 con 0x7f266c0c7fe0 2024-03-23T23:42:57.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7fbe1fe00640 1 --2- 172.21.15.8:0/448548471 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe20151bb0 0x7fbe201418c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:42:57.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7fbe17e00640 1 --2- 172.21.15.8:0/448548471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe20151f90 0x7fbe200c5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:42:57.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7fbe25000640 1 --2- 172.21.15.8:0/448548471 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe201523d0 0x7fbe20143df0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbe1800be00 tx=0x7fbe1800bef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7f8013400640 1 -- 172.21.15.8:0/3601003530 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f801406dcb0 msgr2=0x7f8014141c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7f8013400640 1 --2- 172.21.15.8:0/3601003530 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f801406dcb0 0x7f8014141c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7f8013400640 1 -- 172.21.15.8:0/3601003530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8014072ff0 msgr2=0x7f80141ed6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7f8013400640 1 --2- 172.21.15.8:0/3601003530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8014072ff0 0x7f80141ed6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7f8013400640 1 -- 172.21.15.8:0/3601003530 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8014141250 con 0x7f801414ef10 2024-03-23T23:42:57.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7f425be00640 1 --2- 172.21.15.8:0/4251939893 >> [v2:172.21.15.8:6816/3205168010,v1:172.21.15.8:6818/3205168010] conn(0x7f423c071f40 0x7f423c074360 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7f8013400640 1 --2- 172.21.15.8:0/3601003530 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f801414ef10 0x7f80141edbe0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f800c00c310 tx=0x7f800c00c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.845+0000 7f800b400640 1 -- 172.21.15.8:0/3601003530 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c017070 con 0x7f801414ef10 2024-03-23T23:42:57.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.845+0000 7f800b400640 1 -- 172.21.15.8:0/3601003530 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800c005cf0 con 0x7f801414ef10 2024-03-23T23:42:57.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.845+0000 7f800b400640 1 -- 172.21.15.8:0/3601003530 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c0072d0 con 0x7f801414ef10 2024-03-23T23:42:57.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.845+0000 7f8013e00640 1 -- 172.21.15.8:0/3601003530 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80141414f0 con 0x7f801414ef10 2024-03-23T23:42:57.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.845+0000 7f8013e00640 1 -- 172.21.15.8:0/3601003530 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f801414fa30 con 0x7f801414ef10 2024-03-23T23:42:57.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7f62b5800640 1 -- start start 2024-03-23T23:42:57.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7f265e000640 1 -- 172.21.15.8:0/632351364 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2640001040 con 0x7f266c0c7fe0 2024-03-23T23:42:57.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7fbe1cc00640 1 -- 172.21.15.8:0/448548471 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe18003980 con 0x7fbe201523d0 2024-03-23T23:42:57.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7fbe27000640 1 -- 172.21.15.8:0/448548471 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe201f3560 con 0x7fbe201523d0 2024-03-23T23:42:57.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.841+0000 7fbe27000640 1 -- 172.21.15.8:0/448548471 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe201f3b20 con 0x7fbe201523d0 2024-03-23T23:42:57.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.845+0000 7f8013e00640 1 -- 172.21.15.8:0/3601003530 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7fec001040 con 0x7f801414ef10 2024-03-23T23:42:57.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.845+0000 7f62b5800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62b00c58d0 0x7f62b01518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.845+0000 7f62b5800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f62b0152eb0 0x7f62b014f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.845+0000 7f62b5800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62b0158c60 0x7f62b014f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.845+0000 7f62b5800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b0162ba0 con 0x7f62b0158c60 2024-03-23T23:42:57.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.845+0000 7f62b5800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b0162a20 con 0x7f62b00c58d0 2024-03-23T23:42:57.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.845+0000 7f62b5800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b0162d20 con 0x7f62b0152eb0 2024-03-23T23:42:57.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.845+0000 7f62af400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f62b0152eb0 0x7f62b014f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.845+0000 7f62af400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f62b0152eb0 0x7f62b014f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:49516/0 (socket says 172.21.15.8:49516) 2024-03-23T23:42:57.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.845+0000 7f62af400640 1 -- 172.21.15.8:0/2088666164 learned_addr learned my addr 172.21.15.8:0/2088666164 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:57.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.845+0000 7f2668c00640 1 -- 172.21.15.8:0/632351364 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f2660018020 con 0x7f266c0c7fe0 2024-03-23T23:42:57.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.845+0000 7fbe1cc00640 1 -- 172.21.15.8:0/448548471 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe18003b20 con 0x7fbe201523d0 2024-03-23T23:42:57.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.845+0000 7fbe1cc00640 1 -- 172.21.15.8:0/448548471 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe18003980 con 0x7fbe201523d0 2024-03-23T23:42:57.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.845+0000 7fbe27000640 1 -- 172.21.15.8:0/448548471 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbe20068270 con 0x7fbe201523d0 2024-03-23T23:42:57.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.845+0000 7f62afe00640 1 --2- 172.21.15.8:0/2088666164 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62b00c58d0 0x7f62b01518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.845+0000 7f2668c00640 1 --2- 172.21.15.8:0/632351364 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f264c067690 0x7f264c069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7f2668c00640 1 -- 172.21.15.8:0/632351364 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f2660052fd0 con 0x7f266c0c7fe0 2024-03-23T23:42:57.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7f62af400640 1 -- 172.21.15.8:0/2088666164 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62b00c58d0 msgr2=0x7f62b01518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7f62b4e00640 1 --2- 172.21.15.8:0/2088666164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62b0158c60 0x7f62b014f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7f62af400640 1 --2- 172.21.15.8:0/2088666164 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62b00c58d0 0x7f62b01518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7f62af400640 1 -- 172.21.15.8:0/2088666164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62b0158c60 msgr2=0x7f62b014f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7f62af400640 1 --2- 172.21.15.8:0/2088666164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62b0158c60 0x7f62b014f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7f62af400640 1 -- 172.21.15.8:0/2088666164 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b014fb40 con 0x7f62b0152eb0 2024-03-23T23:42:57.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7f2668c00640 1 --2- 172.21.15.8:0/632351364 >> [v2:172.21.15.196:6824/3516578147,v1:172.21.15.196:6825/3516578147] conn(0x7f264c071e30 0x7f264c074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7f2668c00640 1 -- 172.21.15.8:0/632351364 --> [v2:172.21.15.196:6824/3516578147,v1:172.21.15.196:6825/3516578147] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f266000de50 con 0x7f264c071e30 2024-03-23T23:42:57.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7f2668c00640 1 -- 172.21.15.8:0/632351364 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f266008a060 con 0x7f266c0c7fe0 2024-03-23T23:42:57.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7f2671200640 1 --2- 172.21.15.8:0/632351364 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f264c067690 0x7f264c069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7f62b4e00640 1 --2- 172.21.15.8:0/2088666164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62b0158c60 0x7f62b014f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:42:57.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7f62afe00640 1 --2- 172.21.15.8:0/2088666164 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62b00c58d0 0x7f62b01518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:42:57.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7f2671c00640 1 --2- 172.21.15.8:0/632351364 >> [v2:172.21.15.196:6824/3516578147,v1:172.21.15.196:6825/3516578147] conn(0x7f264c071e30 0x7f264c074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7f62af400640 1 --2- 172.21.15.8:0/2088666164 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f62b0152eb0 0x7f62b014f0c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f62a8007f20 tx=0x7f62a800d560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.845+0000 7f800b400640 1 -- 172.21.15.8:0/3601003530 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f800c01a070 con 0x7f801414ef10 2024-03-23T23:42:57.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7f800b400640 1 --2- 172.21.15.8:0/3601003530 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7ff0067660 0x7f7ff0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7f800b400640 1 -- 172.21.15.8:0/3601003530 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f800c084d20 con 0x7f801414ef10 2024-03-23T23:42:57.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7f8012a00640 1 --2- 172.21.15.8:0/3601003530 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7ff0067660 0x7f7ff0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7f800b400640 1 --2- 172.21.15.8:0/3601003530 >> [v2:172.21.15.8:6800/475463656,v1:172.21.15.8:6801/475463656] conn(0x7f7ff0071df0 0x7f7ff0074210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7f800b400640 1 -- 172.21.15.8:0/3601003530 --> [v2:172.21.15.8:6800/475463656,v1:172.21.15.8:6801/475463656] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f800c010e50 con 0x7f7ff0071df0 2024-03-23T23:42:57.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7f2671c00640 1 --2- 172.21.15.8:0/632351364 >> [v2:172.21.15.196:6824/3516578147,v1:172.21.15.196:6825/3516578147] conn(0x7f264c071e30 0x7f264c074250 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7f2671200640 1 --2- 172.21.15.8:0/632351364 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f264c067690 0x7f264c069b50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f265801aae0 tx=0x7f2658008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7f62a7e00640 1 -- 172.21.15.8:0/2088666164 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a801a070 con 0x7f62b0152eb0 2024-03-23T23:42:57.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7f2668c00640 1 -- 172.21.15.8:0/632351364 <== osd.4 v2:172.21.15.196:6824/3516578147 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f266000de50 con 0x7f264c071e30 2024-03-23T23:42:57.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7f62a7e00640 1 -- 172.21.15.8:0/2088666164 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a8003ba0 con 0x7f62b0152eb0 2024-03-23T23:42:57.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7f62a7e00640 1 -- 172.21.15.8:0/2088666164 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a8004030 con 0x7f62b0152eb0 2024-03-23T23:42:57.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7f62b5800640 1 -- 172.21.15.8:0/2088666164 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b0150ac0 con 0x7f62b0152eb0 2024-03-23T23:42:57.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.853+0000 7f62b5800640 1 -- 172.21.15.8:0/2088666164 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b0148ba0 con 0x7f62b0152eb0 2024-03-23T23:42:57.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7fbe1cc00640 1 -- 172.21.15.8:0/448548471 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fbe18006d10 con 0x7fbe201523d0 2024-03-23T23:42:57.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7fbe1cc00640 1 --2- 172.21.15.8:0/448548471 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbdfc067860 0x7fbdfc069d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.853+0000 7fbe1cc00640 1 -- 172.21.15.8:0/448548471 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fbe180855b0 con 0x7fbe201523d0 2024-03-23T23:42:57.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.853+0000 7fbe1cc00640 1 --2- 172.21.15.8:0/448548471 >> [v2:172.21.15.196:6801/472639906,v1:172.21.15.196:6803/472639906] conn(0x7fbdfc072070 0x7fbdfc074490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.853+0000 7fbe1cc00640 1 -- 172.21.15.8:0/448548471 --> [v2:172.21.15.196:6801/472639906,v1:172.21.15.196:6803/472639906] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbdfc074b40 con 0x7fbdfc072070 2024-03-23T23:42:57.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7f800be00640 1 --2- 172.21.15.8:0/3601003530 >> [v2:172.21.15.8:6800/475463656,v1:172.21.15.8:6801/475463656] conn(0x7f7ff0071df0 0x7f7ff0074210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7f8012a00640 1 --2- 172.21.15.8:0/3601003530 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7ff0067660 0x7f7ff0069b20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8004009fd0 tx=0x7f800400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7f800b400640 1 -- 172.21.15.8:0/3601003530 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f800c051350 con 0x7f801414ef10 2024-03-23T23:42:57.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.849+0000 7f800be00640 1 --2- 172.21.15.8:0/3601003530 >> [v2:172.21.15.8:6800/475463656,v1:172.21.15.8:6801/475463656] conn(0x7f7ff0071df0 0x7f7ff0074210 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.853+0000 7f4258c00640 1 -- 172.21.15.8:0/4251939893 <== osd.1 v2:172.21.15.8:6816/3205168010 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f423c074a10 con 0x7f423c071f40 2024-03-23T23:42:57.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.853+0000 7f62b5800640 1 -- 172.21.15.8:0/2088666164 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f62b0150870 con 0x7f62b0152eb0 2024-03-23T23:42:57.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.853+0000 7fbe1fe00640 1 --2- 172.21.15.8:0/448548471 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbdfc067860 0x7fbdfc069d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.853+0000 7fbe17e00640 1 --2- 172.21.15.8:0/448548471 >> [v2:172.21.15.196:6801/472639906,v1:172.21.15.196:6803/472639906] conn(0x7fbdfc072070 0x7fbdfc074490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.853+0000 7f800b400640 1 -- 172.21.15.8:0/3601003530 <== osd.2 v2:172.21.15.8:6800/475463656 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f800c010e50 con 0x7f7ff0071df0 2024-03-23T23:42:57.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.853+0000 7fbe1fe00640 1 --2- 172.21.15.8:0/448548471 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbdfc067860 0x7fbdfc069d20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbe1001c5c0 tx=0x7fbe10004740 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.853+0000 7f0cbd400640 1 -- 172.21.15.8:0/2339692016 --> [v2:172.21.15.8:6808/2187201732,v1:172.21.15.8:6809/2187201732] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0cb804f410 con 0x7f0c98071f00 2024-03-23T23:42:57.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.857+0000 7f0cafe00640 1 -- 172.21.15.8:0/2339692016 <== osd.0 v2:172.21.15.8:6808/2187201732 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0cb804f410 con 0x7f0c98071f00 2024-03-23T23:42:57.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.853+0000 7fbe1cc00640 1 -- 172.21.15.8:0/448548471 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe1808c050 con 0x7fbe201523d0 2024-03-23T23:42:57.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.853+0000 7fbe17e00640 1 --2- 172.21.15.8:0/448548471 >> [v2:172.21.15.196:6801/472639906,v1:172.21.15.196:6803/472639906] conn(0x7fbdfc072070 0x7fbdfc074490 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.853+0000 7fbe1cc00640 1 -- 172.21.15.8:0/448548471 <== osd.6 v2:172.21.15.196:6801/472639906 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fbdfc074b40 con 0x7fbdfc072070 2024-03-23T23:42:57.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.857+0000 7f0cbd400640 1 -- 172.21.15.8:0/2339692016 >> [v2:172.21.15.8:6808/2187201732,v1:172.21.15.8:6809/2187201732] conn(0x7f0c98071f00 msgr2=0x7f0c98074320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.857+0000 7f0cbd400640 1 --2- 172.21.15.8:0/2339692016 >> [v2:172.21.15.8:6808/2187201732,v1:172.21.15.8:6809/2187201732] conn(0x7f0c98071f00 0x7f0c98074320 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.857+0000 7f0cbd400640 1 -- 172.21.15.8:0/2339692016 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0c980676e0 msgr2=0x7f0c98069ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.857+0000 7f0cbd400640 1 --2- 172.21.15.8:0/2339692016 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0c980676e0 0x7f0c98069ba0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8000c10 tx=0x7f0ca8008040 comp rx=0 tx=0).stop 2024-03-23T23:42:57.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.857+0000 7f0cbd400640 1 -- 172.21.15.8:0/2339692016 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0cb814f910 msgr2=0x7f0cb81f5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.857+0000 7f0cbd400640 1 --2- 172.21.15.8:0/2339692016 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0cb814f910 0x7f0cb81f5620 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0cb000c700 tx=0x7f0cb000cbc0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.857+0000 7f0cbca00640 1 -- 172.21.15.8:0/2339692016 reap_dead start 2024-03-23T23:42:57.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.857+0000 7f0cbd400640 1 -- 172.21.15.8:0/2339692016 shutdown_connections 2024-03-23T23:42:57.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.857+0000 7f0cbd400640 1 -- 172.21.15.8:0/2339692016 >> 172.21.15.8:0/2339692016 conn(0x7f0cb80c4990 msgr2=0x7f0cb814d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:57.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.857+0000 7f62a7e00640 1 -- 172.21.15.8:0/2088666164 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f62a801d070 con 0x7f62b0152eb0 2024-03-23T23:42:57.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.857+0000 7f62a7e00640 1 --2- 172.21.15.8:0/2088666164 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f62900676e0 0x7f6290069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.857+0000 7f62a7e00640 1 -- 172.21.15.8:0/2088666164 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f62a8086840 con 0x7f62b0152eb0 2024-03-23T23:42:57.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.857+0000 7f62a7e00640 1 --2- 172.21.15.8:0/2088666164 >> [v2:172.21.15.8:6817/1514082871,v1:172.21.15.8:6819/1514082871] conn(0x7f6290071f80 0x7f62900743a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.857+0000 7f62a7e00640 1 -- 172.21.15.8:0/2088666164 --> [v2:172.21.15.8:6817/1514082871,v1:172.21.15.8:6819/1514082871] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f62a8011e50 con 0x7f6290071f80 2024-03-23T23:42:57.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.857+0000 7f62a7e00640 1 -- 172.21.15.8:0/2088666164 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62a8086bf0 con 0x7f62b0152eb0 2024-03-23T23:42:57.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.861+0000 7f0cbd400640 1 -- 172.21.15.8:0/2339692016 shutdown_connections 2024-03-23T23:42:57.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.861+0000 7f0cbd400640 1 -- 172.21.15.8:0/2339692016 wait complete. 2024-03-23T23:42:57.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.861+0000 7f62afe00640 1 --2- 172.21.15.8:0/2088666164 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f62900676e0 0x7f6290069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.861+0000 7f62afe00640 1 --2- 172.21.15.8:0/2088666164 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f62900676e0 0x7f6290069ba0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f629c005890 tx=0x7f629c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.861+0000 7f62b4e00640 1 --2- 172.21.15.8:0/2088666164 >> [v2:172.21.15.8:6817/1514082871,v1:172.21.15.8:6819/1514082871] conn(0x7f6290071f80 0x7f62900743a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.865+0000 7f62b4e00640 1 --2- 172.21.15.8:0/2088666164 >> [v2:172.21.15.8:6817/1514082871,v1:172.21.15.8:6819/1514082871] conn(0x7f6290071f80 0x7f62900743a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.865+0000 7f62a7e00640 1 -- 172.21.15.8:0/2088666164 <== osd.3 v2:172.21.15.8:6817/1514082871 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f62a8011e50 con 0x7f6290071f80 2024-03-23T23:42:57.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.873+0000 7fbe27000640 1 -- 172.21.15.8:0/448548471 --> [v2:172.21.15.196:6801/472639906,v1:172.21.15.196:6803/472639906] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbe2013f550 con 0x7fbdfc072070 2024-03-23T23:42:57.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.873+0000 7fbe1cc00640 1 -- 172.21.15.8:0/448548471 <== osd.6 v2:172.21.15.196:6801/472639906 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbe0800d280 con 0x7fbdfc072070 2024-03-23T23:42:57.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.881+0000 7fbe27000640 1 -- 172.21.15.8:0/448548471 >> [v2:172.21.15.196:6801/472639906,v1:172.21.15.196:6803/472639906] conn(0x7fbdfc072070 msgr2=0x7fbdfc074490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.881+0000 7fbe27000640 1 --2- 172.21.15.8:0/448548471 >> [v2:172.21.15.196:6801/472639906,v1:172.21.15.196:6803/472639906] conn(0x7fbdfc072070 0x7fbdfc074490 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.881+0000 7fbe27000640 1 -- 172.21.15.8:0/448548471 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbdfc067860 msgr2=0x7fbdfc069d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.881+0000 7fbe27000640 1 --2- 172.21.15.8:0/448548471 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbdfc067860 0x7fbdfc069d20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbe1001c5c0 tx=0x7fbe10004740 comp rx=0 tx=0).stop 2024-03-23T23:42:57.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.881+0000 7fbe27000640 1 -- 172.21.15.8:0/448548471 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe201523d0 msgr2=0x7fbe20143df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.881+0000 7fbe27000640 1 --2- 172.21.15.8:0/448548471 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe201523d0 0x7fbe20143df0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbe1800be00 tx=0x7fbe1800bef0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.881+0000 7fbe25000640 1 -- 172.21.15.8:0/448548471 reap_dead start 2024-03-23T23:42:57.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.881+0000 7fbe27000640 1 -- 172.21.15.8:0/448548471 shutdown_connections 2024-03-23T23:42:57.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.881+0000 7fbe27000640 1 -- 172.21.15.8:0/448548471 >> 172.21.15.8:0/448548471 conn(0x7fbe200a9870 msgr2=0x7fbe2014d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:57.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.881+0000 7fbe27000640 1 -- 172.21.15.8:0/448548471 shutdown_connections 2024-03-23T23:42:57.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.881+0000 7fbe27000640 1 -- 172.21.15.8:0/448548471 wait complete. 2024-03-23T23:42:57.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.881+0000 7f265e000640 1 -- 172.21.15.8:0/632351364 --> [v2:172.21.15.196:6824/3516578147,v1:172.21.15.196:6825/3516578147] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2640002de0 con 0x7f264c071e30 2024-03-23T23:42:57.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.885+0000 7f2668c00640 1 -- 172.21.15.8:0/632351364 <== osd.4 v2:172.21.15.196:6824/3516578147 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2640002de0 con 0x7f264c071e30 2024-03-23T23:42:57.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.889+0000 7f265e000640 1 -- 172.21.15.8:0/632351364 >> [v2:172.21.15.196:6824/3516578147,v1:172.21.15.196:6825/3516578147] conn(0x7f264c071e30 msgr2=0x7f264c074250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.889+0000 7f265e000640 1 --2- 172.21.15.8:0/632351364 >> [v2:172.21.15.196:6824/3516578147,v1:172.21.15.196:6825/3516578147] conn(0x7f264c071e30 0x7f264c074250 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.889+0000 7f265e000640 1 -- 172.21.15.8:0/632351364 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f264c067690 msgr2=0x7f264c069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.889+0000 7f265e000640 1 --2- 172.21.15.8:0/632351364 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f264c067690 0x7f264c069b50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f265801aae0 tx=0x7f2658008040 comp rx=0 tx=0).stop 2024-03-23T23:42:57.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.889+0000 7f265e000640 1 -- 172.21.15.8:0/632351364 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f266c0c7fe0 msgr2=0x7f266c14a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.889+0000 7f265e000640 1 --2- 172.21.15.8:0/632351364 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f266c0c7fe0 0x7f266c14a400 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f266000b410 tx=0x7f266000b810 comp rx=0 tx=0).stop 2024-03-23T23:42:57.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.889+0000 7f2671c00640 1 -- 172.21.15.8:0/632351364 reap_dead start 2024-03-23T23:42:57.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.889+0000 7f265e000640 1 -- 172.21.15.8:0/632351364 shutdown_connections 2024-03-23T23:42:57.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.889+0000 7f265e000640 1 -- 172.21.15.8:0/632351364 >> 172.21.15.8:0/632351364 conn(0x7f266c0745c0 msgr2=0x7f266c158bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:57.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.889+0000 7f265e000640 1 -- 172.21.15.8:0/632351364 shutdown_connections 2024-03-23T23:42:57.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.889+0000 7f265e000640 1 -- 172.21.15.8:0/632351364 wait complete. 2024-03-23T23:42:57.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.893+0000 7f8013e00640 1 -- 172.21.15.8:0/3601003530 --> [v2:172.21.15.8:6800/475463656,v1:172.21.15.8:6801/475463656] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7fec002de0 con 0x7f7ff0071df0 2024-03-23T23:42:57.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.893+0000 7f800b400640 1 -- 172.21.15.8:0/3601003530 <== osd.2 v2:172.21.15.8:6800/475463656 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7fec002de0 con 0x7f7ff0071df0 2024-03-23T23:42:57.897 INFO:teuthology.orchestra.run.smithi008.stdout:60129542153 2024-03-23T23:42:57.898 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-23T23:42:57.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.901+0000 7f8013e00640 1 -- 172.21.15.8:0/3601003530 >> [v2:172.21.15.8:6800/475463656,v1:172.21.15.8:6801/475463656] conn(0x7f7ff0071df0 msgr2=0x7f7ff0074210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.901+0000 7f8013e00640 1 --2- 172.21.15.8:0/3601003530 >> [v2:172.21.15.8:6800/475463656,v1:172.21.15.8:6801/475463656] conn(0x7f7ff0071df0 0x7f7ff0074210 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.901+0000 7f62b5800640 1 -- 172.21.15.8:0/2088666164 --> [v2:172.21.15.8:6817/1514082871,v1:172.21.15.8:6819/1514082871] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f62b004f410 con 0x7f6290071f80 2024-03-23T23:42:57.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.901+0000 7f8013e00640 1 -- 172.21.15.8:0/3601003530 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7ff0067660 msgr2=0x7f7ff0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.901+0000 7f8013e00640 1 --2- 172.21.15.8:0/3601003530 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7ff0067660 0x7f7ff0069b20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8004009fd0 tx=0x7f800400b040 comp rx=0 tx=0).stop 2024-03-23T23:42:57.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.901+0000 7f8013e00640 1 -- 172.21.15.8:0/3601003530 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f801414ef10 msgr2=0x7f80141edbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.901+0000 7f8013e00640 1 --2- 172.21.15.8:0/3601003530 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f801414ef10 0x7f80141edbe0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f800c00c310 tx=0x7f800c00c7d0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.901+0000 7f8013400640 1 -- 172.21.15.8:0/3601003530 reap_dead start 2024-03-23T23:42:57.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.901+0000 7f8013e00640 1 -- 172.21.15.8:0/3601003530 shutdown_connections 2024-03-23T23:42:57.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.901+0000 7f8013e00640 1 -- 172.21.15.8:0/3601003530 >> 172.21.15.8:0/3601003530 conn(0x7f801406b170 msgr2=0x7f801414b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:57.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.901+0000 7f8013e00640 1 -- 172.21.15.8:0/3601003530 shutdown_connections 2024-03-23T23:42:57.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.901+0000 7f8013e00640 1 -- 172.21.15.8:0/3601003530 wait complete. 2024-03-23T23:42:57.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.901+0000 7f4263800640 1 -- 172.21.15.8:0/4251939893 --> [v2:172.21.15.8:6816/3205168010,v1:172.21.15.8:6818/3205168010] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f425c068270 con 0x7f423c071f40 2024-03-23T23:42:57.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.901+0000 7f4258c00640 1 -- 172.21.15.8:0/4251939893 <== osd.1 v2:172.21.15.8:6816/3205168010 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f425c068270 con 0x7f423c071f40 2024-03-23T23:42:57.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.905+0000 7f4263800640 1 -- 172.21.15.8:0/4251939893 >> [v2:172.21.15.8:6816/3205168010,v1:172.21.15.8:6818/3205168010] conn(0x7f423c071f40 msgr2=0x7f423c074360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.905+0000 7f4263800640 1 --2- 172.21.15.8:0/4251939893 >> [v2:172.21.15.8:6816/3205168010,v1:172.21.15.8:6818/3205168010] conn(0x7f423c071f40 0x7f423c074360 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.905+0000 7f4263800640 1 -- 172.21.15.8:0/4251939893 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f423c0676b0 msgr2=0x7f423c069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.905+0000 7f4263800640 1 --2- 172.21.15.8:0/4251939893 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f423c0676b0 0x7f423c069b70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f424c001500 tx=0x7f424c0079c0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.905+0000 7f62a7e00640 1 -- 172.21.15.8:0/2088666164 <== osd.3 v2:172.21.15.8:6817/1514082871 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f62b004f410 con 0x7f6290071f80 2024-03-23T23:42:57.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.905+0000 7f4263800640 1 -- 172.21.15.8:0/4251939893 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f425c14f5a0 msgr2=0x7f425c1ee1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.905+0000 7f4263800640 1 --2- 172.21.15.8:0/4251939893 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f425c14f5a0 0x7f425c1ee1f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4248012f90 tx=0x7f4248014050 comp rx=0 tx=0).stop 2024-03-23T23:42:57.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.905+0000 7f4261800640 1 -- 172.21.15.8:0/4251939893 reap_dead start 2024-03-23T23:42:57.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.905+0000 7f4263800640 1 -- 172.21.15.8:0/4251939893 shutdown_connections 2024-03-23T23:42:57.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.905+0000 7f4263800640 1 -- 172.21.15.8:0/4251939893 >> 172.21.15.8:0/4251939893 conn(0x7f425c0ad450 msgr2=0x7f425c0cb970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:57.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.905+0000 7f4263800640 1 -- 172.21.15.8:0/4251939893 shutdown_connections 2024-03-23T23:42:57.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.905+0000 7f4263800640 1 -- 172.21.15.8:0/4251939893 wait complete. 2024-03-23T23:42:57.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.905+0000 7f2eeac00640 1 Processor -- start 2024-03-23T23:42:57.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.905+0000 7f2eeac00640 1 -- start start 2024-03-23T23:42:57.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.905+0000 7f62b5800640 1 -- 172.21.15.8:0/2088666164 >> [v2:172.21.15.8:6817/1514082871,v1:172.21.15.8:6819/1514082871] conn(0x7f6290071f80 msgr2=0x7f62900743a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.905+0000 7f62b5800640 1 --2- 172.21.15.8:0/2088666164 >> [v2:172.21.15.8:6817/1514082871,v1:172.21.15.8:6819/1514082871] conn(0x7f6290071f80 0x7f62900743a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.905+0000 7f62b5800640 1 -- 172.21.15.8:0/2088666164 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f62900676e0 msgr2=0x7f6290069ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.905+0000 7f62b5800640 1 --2- 172.21.15.8:0/2088666164 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f62900676e0 0x7f6290069ba0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f629c005890 tx=0x7f629c009040 comp rx=0 tx=0).stop 2024-03-23T23:42:57.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.905+0000 7f62b5800640 1 -- 172.21.15.8:0/2088666164 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f62b0152eb0 msgr2=0x7f62b014f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.905+0000 7f62b5800640 1 --2- 172.21.15.8:0/2088666164 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f62b0152eb0 0x7f62b014f0c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f62a8007f20 tx=0x7f62a800d560 comp rx=0 tx=0).stop 2024-03-23T23:42:57.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.905+0000 7f62b4e00640 1 -- 172.21.15.8:0/2088666164 reap_dead start 2024-03-23T23:42:57.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.909+0000 7f62b5800640 1 -- 172.21.15.8:0/2088666164 shutdown_connections 2024-03-23T23:42:57.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.909+0000 7f62b5800640 1 -- 172.21.15.8:0/2088666164 >> 172.21.15.8:0/2088666164 conn(0x7f62b0072a70 msgr2=0x7f62b00abf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:57.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.909+0000 7f2eeac00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2ee4155930 0x7f2ee4155d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.909+0000 7f2eeac00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2ee406ef50 0x7f2ee415ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.909+0000 7f2eeac00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee40c33d0 con 0x7f2ee4156250 2024-03-23T23:42:57.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.909+0000 7f2eeac00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee4156700 con 0x7f2ee4155930 2024-03-23T23:42:57.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.909+0000 7f2eeac00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee40c36b0 con 0x7f2ee406ef50 2024-03-23T23:42:57.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.909+0000 7f2ee8e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f2ee4156250 0x7f2ee406e840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:46206/0 (socket says 172.21.15.8:46206) 2024-03-23T23:42:57.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.909+0000 7f2ee8e00640 1 -- 172.21.15.8:0/3373139670 learned_addr learned my addr 172.21.15.8:0/3373139670 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:57.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.909+0000 7f2eea200640 1 --2- 172.21.15.8:0/3373139670 >> v2:172.21.15.196:3300/0 conn(0x7f2ee406ef50 0x7f2ee415ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.909+0000 7f2eea200640 1 -- 172.21.15.8:0/3373139670 >> v2:172.21.15.8:3300/0 conn(0x7f2ee4155930 msgr2=0x7f2ee4155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:57.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.909+0000 7f2eea200640 1 --2- 172.21.15.8:0/3373139670 >> v2:172.21.15.8:3300/0 conn(0x7f2ee4155930 0x7f2ee4155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.909+0000 7f2eea200640 1 -- 172.21.15.8:0/3373139670 >> v1:172.21.15.196:6789/0 conn(0x7f2ee4156250 legacy=0x7f2ee406e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.913+0000 7f62b5800640 1 -- 172.21.15.8:0/2088666164 shutdown_connections 2024-03-23T23:42:57.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.913+0000 7f62b5800640 1 -- 172.21.15.8:0/2088666164 wait complete. 2024-03-23T23:42:57.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.909+0000 7f2eea200640 1 -- 172.21.15.8:0/3373139670 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee40c3990 con 0x7f2ee406ef50 2024-03-23T23:42:57.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.917+0000 7fae1b800640 1 Processor -- start 2024-03-23T23:42:57.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.917+0000 7fae1b800640 1 -- start start 2024-03-23T23:42:57.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.917+0000 7f2eea200640 1 --2- 172.21.15.8:0/3373139670 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ee406ef50 0x7f2ee415ccc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2ee40736e0 tx=0x7f2ed001e680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=898632ceecccf572 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.917+0000 7f2ee3e00640 1 -- 172.21.15.8:0/3373139670 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed00aa620 con 0x7f2ee406ef50 2024-03-23T23:42:57.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.917+0000 7f2ee3e00640 1 -- 172.21.15.8:0/3373139670 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed00aa7c0 con 0x7f2ee406ef50 2024-03-23T23:42:57.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.917+0000 7f2ee3e00640 1 -- 172.21.15.8:0/3373139670 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed00aab90 con 0x7f2ee406ef50 2024-03-23T23:42:57.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.917+0000 7fae1b800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fae1406f420 0x7fae140c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.917+0000 7f2eeac00640 1 -- 172.21.15.8:0/3373139670 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ee406ef50 msgr2=0x7f2ee415ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.917+0000 7f2eeac00640 1 --2- 172.21.15.8:0/3373139670 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ee406ef50 0x7f2ee415ccc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2ee40736e0 tx=0x7f2ed001e680 comp rx=0 tx=0).stop 2024-03-23T23:42:57.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.921+0000 7fae13e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fae140c29e0 0x7fae14150b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:44976/0 (socket says 172.21.15.8:44976) 2024-03-23T23:42:57.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.921+0000 7fae1b800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae140702a0 con 0x7fae140c29e0 2024-03-23T23:42:57.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.921+0000 7fae1b800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae1406b4a0 con 0x7fae14153780 2024-03-23T23:42:57.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.921+0000 7fae1b800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae1406d230 con 0x7fae1406f420 2024-03-23T23:42:57.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.921+0000 7fae13e00640 1 -- 172.21.15.8:0/289368809 learned_addr learned my addr 172.21.15.8:0/289368809 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:57.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.921+0000 7fae18e00640 1 --2- 172.21.15.8:0/289368809 >> v2:172.21.15.196:3300/0 conn(0x7fae1406f420 0x7fae140c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.917+0000 7f2eeac00640 1 -- 172.21.15.8:0/3373139670 shutdown_connections 2024-03-23T23:42:57.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.917+0000 7f2eeac00640 1 --2- 172.21.15.8:0/3373139670 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ee406ef50 0x7f2ee415ccc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.917+0000 7f2eeac00640 1 --2- 172.21.15.8:0/3373139670 >> v2:172.21.15.8:3300/0 conn(0x7f2ee4155930 0x7f2ee4155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.917+0000 7f2eeac00640 1 -- 172.21.15.8:0/3373139670 >> 172.21.15.8:0/3373139670 conn(0x7f2ee40c4920 msgr2=0x7f2ee40c4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:57.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.921+0000 7f2eeac00640 1 -- 172.21.15.8:0/3373139670 shutdown_connections 2024-03-23T23:42:57.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.921+0000 7f2eeac00640 1 -- 172.21.15.8:0/3373139670 wait complete. 2024-03-23T23:42:57.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.921+0000 7fae13400640 1 -- 172.21.15.8:0/289368809 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1619477251 0 0) 0x7fae1406b4a0 con 0x7fae14153780 2024-03-23T23:42:57.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.921+0000 7fae13400640 1 -- 172.21.15.8:0/289368809 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadf8003530 con 0x7fae14153780 2024-03-23T23:42:57.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.921+0000 7fae18e00640 1 -- 172.21.15.8:0/289368809 >> v1:172.21.15.196:6789/0 conn(0x7fae14153780 legacy=0x7fae1415e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.921+0000 7fae18e00640 1 -- 172.21.15.8:0/289368809 >> v1:172.21.15.8:6789/0 conn(0x7fae140c29e0 legacy=0x7fae14150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.921+0000 7fae18e00640 1 -- 172.21.15.8:0/289368809 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae14157780 con 0x7fae1406f420 2024-03-23T23:42:57.925 INFO:teuthology.orchestra.run.smithi008.stdout:64424509449 2024-03-23T23:42:57.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.921+0000 7f2eeac00640 1 Processor -- start 2024-03-23T23:42:57.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.921+0000 7f2eeac00640 1 -- start start 2024-03-23T23:42:57.926 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-23T23:42:57.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.925+0000 7f2eeac00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ee406ef50 0x7f2ee40ad320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.925+0000 7f2eeac00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ee4155930 0x7f2ee40c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.925+0000 7f2eeac00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ee4156250 0x7f2ee40c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.925+0000 7f2eeac00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee40a9470 con 0x7f2ee4156250 2024-03-23T23:42:57.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.925+0000 7f2eeac00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee406e020 con 0x7f2ee406ef50 2024-03-23T23:42:57.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.925+0000 7f2eeac00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee406f3a0 con 0x7f2ee4155930 2024-03-23T23:42:57.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.925+0000 7f2ee9800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ee406ef50 0x7f2ee40ad320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.925+0000 7f2ee8e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ee4155930 0x7f2ee40c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.925+0000 7f2ee9800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ee406ef50 0x7f2ee40ad320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:45956/0 (socket says 172.21.15.8:45956) 2024-03-23T23:42:57.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.925+0000 7f2ee9800640 1 -- 172.21.15.8:0/3919411545 learned_addr learned my addr 172.21.15.8:0/3919411545 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:57.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.925+0000 7f2eea200640 1 --2- 172.21.15.8:0/3919411545 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ee4156250 0x7f2ee40c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.925+0000 7f2ee8e00640 1 -- 172.21.15.8:0/3919411545 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ee406ef50 msgr2=0x7f2ee40ad320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.925+0000 7f2ee8e00640 1 --2- 172.21.15.8:0/3919411545 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ee406ef50 0x7f2ee40ad320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.925+0000 7f2ee8e00640 1 -- 172.21.15.8:0/3919411545 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ee4156250 msgr2=0x7f2ee40c6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.925+0000 7f2ee8e00640 1 --2- 172.21.15.8:0/3919411545 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ee4156250 0x7f2ee40c6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.925+0000 7f2ee8e00640 1 -- 172.21.15.8:0/3919411545 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee4142890 con 0x7f2ee4155930 2024-03-23T23:42:57.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.925+0000 7f2ee9800640 1 --2- 172.21.15.8:0/3919411545 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ee406ef50 0x7f2ee40ad320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:42:57.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.925+0000 7f2ee8e00640 1 --2- 172.21.15.8:0/3919411545 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ee4155930 0x7f2ee40c6900 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2ed800c4e0 tx=0x7f2ed800c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.925+0000 7f2ee1600640 1 -- 172.21.15.8:0/3919411545 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8018070 con 0x7f2ee4155930 2024-03-23T23:42:57.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.925+0000 7f2ee1600640 1 -- 172.21.15.8:0/3919411545 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed80074e0 con 0x7f2ee4155930 2024-03-23T23:42:57.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.925+0000 7f2ee1600640 1 -- 172.21.15.8:0/3919411545 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8004a10 con 0x7f2ee4155930 2024-03-23T23:42:57.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.929+0000 7f2eeac00640 1 -- 172.21.15.8:0/3919411545 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee4139f60 con 0x7f2ee4155930 2024-03-23T23:42:57.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.929+0000 7f2eeac00640 1 -- 172.21.15.8:0/3919411545 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee4142e10 con 0x7f2ee4155930 2024-03-23T23:42:57.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.929+0000 7f2eeac00640 1 -- 172.21.15.8:0/3919411545 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2ee404f410 con 0x7f2ee4155930 2024-03-23T23:42:57.932 INFO:teuthology.orchestra.run.smithi008.stdout:64424509450 2024-03-23T23:42:57.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.929+0000 7fae18e00640 1 --2- 172.21.15.8:0/289368809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae1406f420 0x7fae140c8be0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009d90 tx=0x7fae0c01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb1c75c90683aa67 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.929+0000 7fae13400640 1 -- 172.21.15.8:0/289368809 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c0b2070 con 0x7fae1406f420 2024-03-23T23:42:57.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.929+0000 7fae13400640 1 -- 172.21.15.8:0/289368809 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0c0a5830 con 0x7fae1406f420 2024-03-23T23:42:57.933 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-23T23:42:57.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.929+0000 7fae13400640 1 -- 172.21.15.8:0/289368809 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c0a5c00 con 0x7fae1406f420 2024-03-23T23:42:57.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.929+0000 7fae1b800640 1 -- 172.21.15.8:0/289368809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae1406f420 msgr2=0x7fae140c8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.929+0000 7fae1b800640 1 --2- 172.21.15.8:0/289368809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae1406f420 0x7fae140c8be0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009d90 tx=0x7fae0c01c970 comp rx=0 tx=0).stop 2024-03-23T23:42:57.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.929+0000 7f2ee1600640 1 -- 172.21.15.8:0/3919411545 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f2ed801b070 con 0x7f2ee4155930 2024-03-23T23:42:57.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.933+0000 7f2ee1600640 1 --2- 172.21.15.8:0/3919411545 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2ec40676b0 0x7f2ec4069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.933+0000 7f2ee1600640 1 -- 172.21.15.8:0/3919411545 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f2ed8084e30 con 0x7f2ee4155930 2024-03-23T23:42:57.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.933+0000 7f2ee1600640 1 --2- 172.21.15.8:0/3919411545 >> [v2:172.21.15.196:6800/830595758,v1:172.21.15.196:6802/830595758] conn(0x7f2ec4071f40 0x7f2ec4074360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.933+0000 7f2ee1600640 1 -- 172.21.15.8:0/3919411545 --> [v2:172.21.15.196:6800/830595758,v1:172.21.15.196:6802/830595758] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2ed8007690 con 0x7f2ec4071f40 2024-03-23T23:42:57.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.933+0000 7f2ee1600640 1 -- 172.21.15.8:0/3919411545 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ed8087580 con 0x7f2ee4155930 2024-03-23T23:42:57.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.933+0000 7f2ee9800640 1 --2- 172.21.15.8:0/3919411545 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2ec40676b0 0x7f2ec4069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.933+0000 7f2eea200640 1 --2- 172.21.15.8:0/3919411545 >> [v2:172.21.15.196:6800/830595758,v1:172.21.15.196:6802/830595758] conn(0x7f2ec4071f40 0x7f2ec4074360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.933+0000 7f2ee9800640 1 --2- 172.21.15.8:0/3919411545 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2ec40676b0 0x7f2ec4069b70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2edc00c530 tx=0x7f2edc00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.933+0000 7f2eea200640 1 --2- 172.21.15.8:0/3919411545 >> [v2:172.21.15.196:6800/830595758,v1:172.21.15.196:6802/830595758] conn(0x7f2ec4071f40 0x7f2ec4074360 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.933+0000 7f2ee1600640 1 -- 172.21.15.8:0/3919411545 <== osd.5 v2:172.21.15.196:6800/830595758 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2ed8007690 con 0x7f2ec4071f40 2024-03-23T23:42:57.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.933+0000 7fae1b800640 1 -- 172.21.15.8:0/289368809 shutdown_connections 2024-03-23T23:42:57.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.933+0000 7fae1b800640 1 --2- 172.21.15.8:0/289368809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae1406f420 0x7fae140c8be0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.933+0000 7fae1b800640 1 -- 172.21.15.8:0/289368809 >> 172.21.15.8:0/289368809 conn(0x7fae140745c0 msgr2=0x7fae140c84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:57.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.933+0000 7fae1b800640 1 -- 172.21.15.8:0/289368809 shutdown_connections 2024-03-23T23:42:57.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.937+0000 7fae1b800640 1 -- 172.21.15.8:0/289368809 wait complete. 2024-03-23T23:42:57.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.937+0000 7fae1b800640 1 Processor -- start 2024-03-23T23:42:57.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.941+0000 7fae1b800640 1 -- start start 2024-03-23T23:42:57.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.941+0000 7fae1b800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae1406f420 0x7fae141563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.941+0000 7fae1b800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae14153780 0x7fae14155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.941+0000 7fae1b800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fae14146800 0x7fae14146cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.941+0000 7fae1b800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae140c9120 con 0x7fae1406f420 2024-03-23T23:42:57.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.941+0000 7fae1b800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae14157d40 con 0x7fae14153780 2024-03-23T23:42:57.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.941+0000 7fae1b800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae140c92a0 con 0x7fae14146800 2024-03-23T23:42:57.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.941+0000 7fae18e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae1406f420 0x7fae141563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.941+0000 7fae18e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae1406f420 0x7fae141563b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42106/0 (socket says 172.21.15.8:42106) 2024-03-23T23:42:57.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.941+0000 7fae18e00640 1 -- 172.21.15.8:0/3487526547 learned_addr learned my addr 172.21.15.8:0/3487526547 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:57.947 INFO:teuthology.orchestra.run.smithi008.stdout:60129542153 2024-03-23T23:42:57.947 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-23T23:42:57.948 INFO:teuthology.orchestra.run.smithi008.stdout:60129542153 2024-03-23T23:42:57.948 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-23T23:42:57.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.945+0000 7fae18e00640 1 -- 172.21.15.8:0/3487526547 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fae14146800 msgr2=0x7fae14146cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:42:57.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.945+0000 7fae18e00640 1 --2- 172.21.15.8:0/3487526547 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fae14146800 0x7fae14146cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.945+0000 7fae18e00640 1 -- 172.21.15.8:0/3487526547 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae14153780 msgr2=0x7fae14155090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:42:57.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.945+0000 7fae18e00640 1 --2- 172.21.15.8:0/3487526547 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae14153780 0x7fae14155090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.945+0000 7fae18e00640 1 -- 172.21.15.8:0/3487526547 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae141568f0 con 0x7fae1406f420 2024-03-23T23:42:57.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.945+0000 7fae18e00640 1 --2- 172.21.15.8:0/3487526547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae1406f420 0x7fae141563b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fae0c01a5a0 tx=0x7fae0c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.945+0000 7fae10c00640 1 -- 172.21.15.8:0/3487526547 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c0bb020 con 0x7fae1406f420 2024-03-23T23:42:57.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.945+0000 7fae10c00640 1 -- 172.21.15.8:0/3487526547 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0c0ad440 con 0x7fae1406f420 2024-03-23T23:42:57.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.945+0000 7fae1b800640 1 -- 172.21.15.8:0/3487526547 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae141fb210 con 0x7fae1406f420 2024-03-23T23:42:57.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.945+0000 7fae10c00640 1 -- 172.21.15.8:0/3487526547 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c0b2040 con 0x7fae1406f420 2024-03-23T23:42:57.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.945+0000 7fae1b800640 1 -- 172.21.15.8:0/3487526547 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae140c6590 con 0x7fae1406f420 2024-03-23T23:42:57.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.949+0000 7fae1b800640 1 -- 172.21.15.8:0/3487526547 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fae14068980 con 0x7fae1406f420 2024-03-23T23:42:57.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.949+0000 7fae10c00640 1 -- 172.21.15.8:0/3487526547 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fae0c0be020 con 0x7fae1406f420 2024-03-23T23:42:57.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.953+0000 7fae10c00640 1 --2- 172.21.15.8:0/3487526547 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fadf4067690 0x7fadf4069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.953+0000 7fae10c00640 1 -- 172.21.15.8:0/3487526547 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fae0c120980 con 0x7fae1406f420 2024-03-23T23:42:57.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.953+0000 7fae10c00640 1 --2- 172.21.15.8:0/3487526547 >> [v2:172.21.15.196:6816/4151820349,v1:172.21.15.196:6817/4151820349] conn(0x7fadf4071f20 0x7fadf4074340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:57.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.953+0000 7fae10c00640 1 -- 172.21.15.8:0/3487526547 --> [v2:172.21.15.196:6816/4151820349,v1:172.21.15.196:6817/4151820349] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fae0c0c2e50 con 0x7fadf4071f20 2024-03-23T23:42:57.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.953+0000 7fae10c00640 1 -- 172.21.15.8:0/3487526547 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae0c120d70 con 0x7fae1406f420 2024-03-23T23:42:57.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.953+0000 7fae13e00640 1 --2- 172.21.15.8:0/3487526547 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fadf4067690 0x7fadf4069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.953+0000 7fae19800640 1 --2- 172.21.15.8:0/3487526547 >> [v2:172.21.15.196:6816/4151820349,v1:172.21.15.196:6817/4151820349] conn(0x7fadf4071f20 0x7fadf4074340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:57.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.953+0000 7fae13e00640 1 --2- 172.21.15.8:0/3487526547 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fadf4067690 0x7fadf4069b50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fae00000f70 tx=0x7fae00007a10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.953+0000 7fae19800640 1 --2- 172.21.15.8:0/3487526547 >> [v2:172.21.15.196:6816/4151820349,v1:172.21.15.196:6817/4151820349] conn(0x7fadf4071f20 0x7fadf4074340 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:57.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.957+0000 7fae10c00640 1 -- 172.21.15.8:0/3487526547 <== osd.7 v2:172.21.15.196:6816/4151820349 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fae0c0c2e50 con 0x7fadf4071f20 2024-03-23T23:42:57.963 INFO:teuthology.orchestra.run.smithi008.stdout:64424509450 2024-03-23T23:42:57.964 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-23T23:42:57.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.969+0000 7f2eeac00640 1 -- 172.21.15.8:0/3919411545 --> [v2:172.21.15.196:6800/830595758,v1:172.21.15.196:6802/830595758] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2ee40c2f50 con 0x7f2ec4071f40 2024-03-23T23:42:57.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.969+0000 7f2ee1600640 1 -- 172.21.15.8:0/3919411545 <== osd.5 v2:172.21.15.196:6800/830595758 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2ee40c2f50 con 0x7f2ec4071f40 2024-03-23T23:42:57.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.973+0000 7f2eeac00640 1 -- 172.21.15.8:0/3919411545 >> [v2:172.21.15.196:6800/830595758,v1:172.21.15.196:6802/830595758] conn(0x7f2ec4071f40 msgr2=0x7f2ec4074360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.973+0000 7f2eeac00640 1 --2- 172.21.15.8:0/3919411545 >> [v2:172.21.15.196:6800/830595758,v1:172.21.15.196:6802/830595758] conn(0x7f2ec4071f40 0x7f2ec4074360 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.973+0000 7f2eeac00640 1 -- 172.21.15.8:0/3919411545 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2ec40676b0 msgr2=0x7f2ec4069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.973+0000 7f2eeac00640 1 --2- 172.21.15.8:0/3919411545 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2ec40676b0 0x7f2ec4069b70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2edc00c530 tx=0x7f2edc00b040 comp rx=0 tx=0).stop 2024-03-23T23:42:57.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.973+0000 7f2eeac00640 1 -- 172.21.15.8:0/3919411545 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ee4155930 msgr2=0x7f2ee40c6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.973+0000 7f2eeac00640 1 --2- 172.21.15.8:0/3919411545 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ee4155930 0x7f2ee40c6900 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2ed800c4e0 tx=0x7f2ed800c9a0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.973+0000 7f2eea200640 1 -- 172.21.15.8:0/3919411545 reap_dead start 2024-03-23T23:42:57.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.973+0000 7f2eeac00640 1 -- 172.21.15.8:0/3919411545 shutdown_connections 2024-03-23T23:42:57.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.973+0000 7f2eeac00640 1 -- 172.21.15.8:0/3919411545 >> 172.21.15.8:0/3919411545 conn(0x7f2ee40c4920 msgr2=0x7f2ee40c2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:57.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.977+0000 7f2eeac00640 1 -- 172.21.15.8:0/3919411545 shutdown_connections 2024-03-23T23:42:57.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.977+0000 7f2eeac00640 1 -- 172.21.15.8:0/3919411545 wait complete. 2024-03-23T23:42:57.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.989+0000 7fae1b800640 1 -- 172.21.15.8:0/3487526547 --> [v2:172.21.15.196:6816/4151820349,v1:172.21.15.196:6817/4151820349] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fae140c87f0 con 0x7fadf4071f20 2024-03-23T23:42:57.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.989+0000 7fae10c00640 1 -- 172.21.15.8:0/3487526547 <== osd.7 v2:172.21.15.196:6816/4151820349 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fae140c87f0 con 0x7fadf4071f20 2024-03-23T23:42:57.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.993+0000 7fae1b800640 1 -- 172.21.15.8:0/3487526547 >> [v2:172.21.15.196:6816/4151820349,v1:172.21.15.196:6817/4151820349] conn(0x7fadf4071f20 msgr2=0x7fadf4074340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.993+0000 7fae1b800640 1 --2- 172.21.15.8:0/3487526547 >> [v2:172.21.15.196:6816/4151820349,v1:172.21.15.196:6817/4151820349] conn(0x7fadf4071f20 0x7fadf4074340 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:57.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.997+0000 7fae1b800640 1 -- 172.21.15.8:0/3487526547 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fadf4067690 msgr2=0x7fadf4069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.997+0000 7fae1b800640 1 --2- 172.21.15.8:0/3487526547 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fadf4067690 0x7fadf4069b50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fae00000f70 tx=0x7fae00007a10 comp rx=0 tx=0).stop 2024-03-23T23:42:57.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.997+0000 7fae1b800640 1 -- 172.21.15.8:0/3487526547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae1406f420 msgr2=0x7fae141563b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:57.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.997+0000 7fae1b800640 1 --2- 172.21.15.8:0/3487526547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae1406f420 0x7fae141563b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fae0c01a5a0 tx=0x7fae0c019710 comp rx=0 tx=0).stop 2024-03-23T23:42:57.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:57.997+0000 7fae19800640 1 -- 172.21.15.8:0/3487526547 reap_dead start 2024-03-23T23:42:58.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.001+0000 7fae1b800640 1 -- 172.21.15.8:0/3487526547 shutdown_connections 2024-03-23T23:42:58.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.001+0000 7fae1b800640 1 -- 172.21.15.8:0/3487526547 >> 172.21.15.8:0/3487526547 conn(0x7fae140745c0 msgr2=0x7fae141438b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:58.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.001+0000 7fae1b800640 1 -- 172.21.15.8:0/3487526547 shutdown_connections 2024-03-23T23:42:58.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.001+0000 7fae1b800640 1 -- 172.21.15.8:0/3487526547 wait complete. 2024-03-23T23:42:58.011 INFO:teuthology.orchestra.run.smithi008.stdout:64424509450 2024-03-23T23:42:58.011 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-23T23:42:58.042 INFO:teuthology.orchestra.run.smithi008.stdout:60129542153 2024-03-23T23:42:58.042 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-23T23:42:58.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.169+0000 7f03e1400640 1 Processor -- start 2024-03-23T23:42:58.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.169+0000 7f03e1400640 1 -- start start 2024-03-23T23:42:58.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.169+0000 7f03e1400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f03dc1509e0 0x7f03dc071d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.169+0000 7f03db400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f03dc0ad080 0x7f03dc072280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:44978/0 (socket says 172.21.15.8:44978) 2024-03-23T23:42:58.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.169+0000 7f03db400640 1 -- 172.21.15.8:0/3134161229 learned_addr learned my addr 172.21.15.8:0/3134161229 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:58.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.169+0000 7f03e1400640 1 -- 172.21.15.8:0/3134161229 --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03dc153f80 con 0x7f03dc0ad080 2024-03-23T23:42:58.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.169+0000 7f03e1400640 1 -- 172.21.15.8:0/3134161229 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03dc154260 con 0x7f03dc0aa180 2024-03-23T23:42:58.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.169+0000 7f03e1400640 1 -- 172.21.15.8:0/3134161229 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03dc070e00 con 0x7f03dc1509e0 2024-03-23T23:42:58.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.169+0000 7f03dbe00640 1 --2- 172.21.15.8:0/3134161229 >> v2:172.21.15.196:3300/0 conn(0x7f03dc1509e0 0x7f03dc071d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.169+0000 7f03daa00640 1 -- 172.21.15.8:0/3134161229 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3396994408 0 0) 0x7f03dc154260 con 0x7f03dc0aa180 2024-03-23T23:42:58.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.173+0000 7f03daa00640 1 -- 172.21.15.8:0/3134161229 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03c0003530 con 0x7f03dc0aa180 2024-03-23T23:42:58.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.173+0000 7f03daa00640 1 -- 172.21.15.8:0/3134161229 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1385846525 0 0) 0x7f03dc153f80 con 0x7f03dc0ad080 2024-03-23T23:42:58.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.173+0000 7f03daa00640 1 -- 172.21.15.8:0/3134161229 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03dc154260 con 0x7f03dc0ad080 2024-03-23T23:42:58.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.173+0000 7f03daa00640 1 -- 172.21.15.8:0/3134161229 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2957192537 0 0) 0x7f03c0003530 con 0x7f03dc0aa180 2024-03-23T23:42:58.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.173+0000 7f03daa00640 1 -- 172.21.15.8:0/3134161229 >> v2:172.21.15.196:3300/0 conn(0x7f03dc1509e0 msgr2=0x7f03dc071d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:58.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.173+0000 7f03daa00640 1 --2- 172.21.15.8:0/3134161229 >> v2:172.21.15.196:3300/0 conn(0x7f03dc1509e0 0x7f03dc071d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.173+0000 7f03daa00640 1 -- 172.21.15.8:0/3134161229 >> v1:172.21.15.8:6789/0 conn(0x7f03dc0ad080 legacy=0x7f03dc072280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.173+0000 7f03daa00640 1 -- 172.21.15.8:0/3134161229 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03dc071050 con 0x7f03dc0aa180 2024-03-23T23:42:58.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.173+0000 7f03daa00640 1 -- 172.21.15.8:0/3134161229 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7f03c4001680 con 0x7f03dc0aa180 2024-03-23T23:42:58.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.173+0000 7f03daa00640 1 -- 172.21.15.8:0/3134161229 >> v1:172.21.15.196:6789/0 conn(0x7f03dc0aa180 legacy=0x7f03dc0abc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.173+0000 7f03daa00640 1 --2- 172.21.15.8:0/3134161229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03c0003ba0 0x7f03c0003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.173+0000 7f03daa00640 1 --2- 172.21.15.8:0/3134161229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03c0004810 0x7f03c0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.173+0000 7f03daa00640 1 --2- 172.21.15.8:0/3134161229 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f03c00051d0 0x7f03c00145d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.173+0000 7f03daa00640 1 -- 172.21.15.8:0/3134161229 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc070e00 con 0x7f03c0003ba0 2024-03-23T23:42:58.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.173+0000 7f03daa00640 1 -- 172.21.15.8:0/3134161229 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c0014b10 con 0x7f03c00051d0 2024-03-23T23:42:58.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.173+0000 7f03daa00640 1 -- 172.21.15.8:0/3134161229 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c0014c90 con 0x7f03c0004810 2024-03-23T23:42:58.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.173+0000 7f03db400640 1 --2- 172.21.15.8:0/3134161229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03c0004810 0x7f03c0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.173+0000 7f03e0a00640 1 --2- 172.21.15.8:0/3134161229 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f03c00051d0 0x7f03c00145d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.173+0000 7f03dbe00640 1 --2- 172.21.15.8:0/3134161229 >> v2:172.21.15.196:3300/0 conn(0x7f03dc1509e0 0x7f03dc071d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:42:58.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.173+0000 7f03db400640 1 -- 172.21.15.8:0/3134161229 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f03c00051d0 msgr2=0x7f03c00145d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.173+0000 7f03db400640 1 --2- 172.21.15.8:0/3134161229 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f03c00051d0 0x7f03c00145d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.173+0000 7f03db400640 1 -- 172.21.15.8:0/3134161229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03c0003ba0 msgr2=0x7f03c0003fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:42:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.173+0000 7f03db400640 1 --2- 172.21.15.8:0/3134161229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03c0003ba0 0x7f03c0003fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.173+0000 7f03db400640 1 -- 172.21.15.8:0/3134161229 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c0003530 con 0x7f03c0004810 2024-03-23T23:42:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.173+0000 7f03e0a00640 1 -- 172.21.15.8:0/3134161229 reap_dead start 2024-03-23T23:42:58.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.181+0000 7f03db400640 1 --2- 172.21.15.8:0/3134161229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03c0004810 0x7f03c0004c90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f03cc0019e0 tx=0x7f03cc01c600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ac474c2c48bf3aa server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:58.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.181+0000 7f03daa00640 1 -- 172.21.15.8:0/3134161229 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc001600 con 0x7f03c0004810 2024-03-23T23:42:58.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.181+0000 7f03daa00640 1 -- 172.21.15.8:0/3134161229 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03cc004ab0 con 0x7f03c0004810 2024-03-23T23:42:58.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.181+0000 7f03daa00640 1 -- 172.21.15.8:0/3134161229 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc001600 con 0x7f03c0004810 2024-03-23T23:42:58.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.181+0000 7f03e1400640 1 -- 172.21.15.8:0/3134161229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03c0004810 msgr2=0x7f03c0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.181+0000 7f03e1400640 1 --2- 172.21.15.8:0/3134161229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03c0004810 0x7f03c0004c90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f03cc0019e0 tx=0x7f03cc01c600 comp rx=0 tx=0).stop 2024-03-23T23:42:58.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.181+0000 7f03e1400640 1 -- 172.21.15.8:0/3134161229 shutdown_connections 2024-03-23T23:42:58.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.181+0000 7f03e1400640 1 --2- 172.21.15.8:0/3134161229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03c0004810 0x7f03c0004c90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.181+0000 7f03e1400640 1 -- 172.21.15.8:0/3134161229 >> 172.21.15.8:0/3134161229 conn(0x7f03dc06b170 msgr2=0x7f03dc06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:58.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.181+0000 7f03e1400640 1 -- 172.21.15.8:0/3134161229 shutdown_connections 2024-03-23T23:42:58.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.181+0000 7f03e1400640 1 -- 172.21.15.8:0/3134161229 wait complete. 2024-03-23T23:42:58.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.185+0000 7f03e1400640 1 Processor -- start 2024-03-23T23:42:58.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.185+0000 7f03e1400640 1 -- start start 2024-03-23T23:42:58.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.185+0000 7f03e1400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f03c0004810 0x7f03dc0be920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.185+0000 7f03e1400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03dc1eaa70 0x7f03dc0bee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.185+0000 7f03e1400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03dc14b5b0 0x7f03dc0c0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.189+0000 7f03e1400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc0728c0 con 0x7f03dc1eaa70 2024-03-23T23:42:58.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.189+0000 7f03e1400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc072740 con 0x7f03c0004810 2024-03-23T23:42:58.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.189+0000 7f03e1400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc0abc30 con 0x7f03dc14b5b0 2024-03-23T23:42:58.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.189+0000 7f03e0a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03dc14b5b0 0x7f03dc0c0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.189+0000 7f03e0a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03dc14b5b0 0x7f03dc0c0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:49564/0 (socket says 172.21.15.8:49564) 2024-03-23T23:42:58.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.189+0000 7f03e0a00640 1 -- 172.21.15.8:0/1966335854 learned_addr learned my addr 172.21.15.8:0/1966335854 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:58.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.189+0000 7f03dbe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f03c0004810 0x7f03dc0be920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.189+0000 7f03e0a00640 1 -- 172.21.15.8:0/1966335854 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f03c0004810 msgr2=0x7f03dc0be920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.189+0000 7f03e0a00640 1 --2- 172.21.15.8:0/1966335854 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f03c0004810 0x7f03dc0be920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.189+0000 7f03e0a00640 1 -- 172.21.15.8:0/1966335854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03dc1eaa70 msgr2=0x7f03dc0bee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.189+0000 7f03e0a00640 1 --2- 172.21.15.8:0/1966335854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03dc1eaa70 0x7f03dc0bee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.189+0000 7f03e0a00640 1 -- 172.21.15.8:0/1966335854 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03dc0bc3b0 con 0x7f03dc14b5b0 2024-03-23T23:42:58.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.189+0000 7f03e0a00640 1 --2- 172.21.15.8:0/1966335854 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03dc14b5b0 0x7f03dc0c0800 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f03dc067ef0 tx=0x7f03c400fc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:58.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.193+0000 7f03d3e00640 1 -- 172.21.15.8:0/1966335854 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c40050d0 con 0x7f03dc14b5b0 2024-03-23T23:42:58.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.193+0000 7f03d3e00640 1 -- 172.21.15.8:0/1966335854 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c4018070 con 0x7f03dc14b5b0 2024-03-23T23:42:58.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.193+0000 7f03d3e00640 1 -- 172.21.15.8:0/1966335854 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c4003600 con 0x7f03dc14b5b0 2024-03-23T23:42:58.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.193+0000 7f03e1400640 1 -- 172.21.15.8:0/1966335854 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03dc0bc690 con 0x7f03dc14b5b0 2024-03-23T23:42:58.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.193+0000 7f03e1400640 1 -- 172.21.15.8:0/1966335854 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03dc0c0d40 con 0x7f03dc14b5b0 2024-03-23T23:42:58.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.197+0000 7f03e1400640 1 -- 172.21.15.8:0/1966335854 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03dc04f410 con 0x7f03dc14b5b0 2024-03-23T23:42:58.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.197+0000 7f03d3e00640 1 -- 172.21.15.8:0/1966335854 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f03c40037a0 con 0x7f03dc14b5b0 2024-03-23T23:42:58.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.197+0000 7f03d3e00640 1 --2- 172.21.15.8:0/1966335854 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f03b80676b0 0x7f03b8069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.201+0000 7f03d3e00640 1 -- 172.21.15.8:0/1966335854 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f03c4085660 con 0x7f03dc14b5b0 2024-03-23T23:42:58.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.201+0000 7f03dbe00640 1 --2- 172.21.15.8:0/1966335854 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f03b80676b0 0x7f03b8069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.201+0000 7f21d6200640 1 Processor -- start 2024-03-23T23:42:58.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.201+0000 7f21d6200640 1 -- start start 2024-03-23T23:42:58.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.201+0000 7ff6b5000640 1 Processor -- start 2024-03-23T23:42:58.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.201+0000 7ff6b5000640 1 -- start start 2024-03-23T23:42:58.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.201+0000 7f03d3e00640 1 -- 172.21.15.8:0/1966335854 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f03c4056120 con 0x7f03dc14b5b0 2024-03-23T23:42:58.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.205+0000 7f03dbe00640 1 --2- 172.21.15.8:0/1966335854 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f03b80676b0 0x7f03b8069b70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f03d4007300 tx=0x7f03d4007290 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:58.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.205+0000 7f21d6200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f21d0151f90 0x7f21d006e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.205+0000 7ff6b5000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff6b014fc90 0x7ff6b00c4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.205+0000 7f21cf400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f21d0151bb0 0x7f21d00c1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:46240/0 (socket says 172.21.15.8:46240) 2024-03-23T23:42:58.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.205+0000 7f21cf400640 1 -- 172.21.15.8:0/1700673547 learned_addr learned my addr 172.21.15.8:0/1700673547 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:58.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.205+0000 7ff6b5000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b0156610 con 0x7ff6b0155fc0 2024-03-23T23:42:58.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.205+0000 7ff6b5000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b01568f0 con 0x7ff6b0155b60 2024-03-23T23:42:58.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.205+0000 7ff6b5000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b00c4000 con 0x7ff6b014fc90 2024-03-23T23:42:58.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.205+0000 7f21d6200640 1 --2- 172.21.15.8:0/1700673547 >> v2:172.21.15.8:3300/0 conn(0x7f21d0152400 0x7f21d006e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.205+0000 7f21d6200640 1 -- 172.21.15.8:0/1700673547 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d0071b60 con 0x7f21d0151bb0 2024-03-23T23:42:58.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.205+0000 7ff6ae800640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff6b0155fc0 0x7ff6b015cef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:44992/0 (socket says 172.21.15.8:44992) 2024-03-23T23:42:58.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.205+0000 7ff6ae800640 1 -- 172.21.15.8:0/3776070446 learned_addr learned my addr 172.21.15.8:0/3776070446 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:58.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.205+0000 7f21d6200640 1 -- 172.21.15.8:0/1700673547 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d0071e40 con 0x7f21d0152400 2024-03-23T23:42:58.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.205+0000 7f21d6200640 1 -- 172.21.15.8:0/1700673547 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d0072120 con 0x7f21d0151f90 2024-03-23T23:42:58.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.205+0000 7f21ce000640 1 -- 172.21.15.8:0/1700673547 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 355104692 0 0) 0x7f21d0071b60 con 0x7f21d0151bb0 2024-03-23T23:42:58.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.205+0000 7f21ce000640 1 -- 172.21.15.8:0/1700673547 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21b4007940 con 0x7f21d0151bb0 2024-03-23T23:42:58.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.205+0000 7f21cea00640 1 --2- 172.21.15.8:0/1700673547 >> v2:172.21.15.196:3300/0 conn(0x7f21d0151f90 0x7f21d006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.205+0000 7ff6ade00640 1 --2- 172.21.15.8:0/3776070446 >> v2:172.21.15.8:3300/0 conn(0x7ff6b014fc90 0x7ff6b00c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.205+0000 7f21ce000640 1 -- 172.21.15.8:0/1700673547 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2642474031 0 0) 0x7f21b4007940 con 0x7f21d0151bb0 2024-03-23T23:42:58.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7f21ce000640 1 -- 172.21.15.8:0/1700673547 >> v2:172.21.15.196:3300/0 conn(0x7f21d0151f90 msgr2=0x7f21d006e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:58.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7f21ce000640 1 --2- 172.21.15.8:0/1700673547 >> v2:172.21.15.196:3300/0 conn(0x7f21d0151f90 0x7f21d006e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7f21ce000640 1 -- 172.21.15.8:0/1700673547 >> v2:172.21.15.8:3300/0 conn(0x7f21d0152400 msgr2=0x7f21d006e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:58.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7f21ce000640 1 --2- 172.21.15.8:0/1700673547 >> v2:172.21.15.8:3300/0 conn(0x7f21d0152400 0x7f21d006e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7f21ce000640 1 -- 172.21.15.8:0/1700673547 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d00c3590 con 0x7f21d0151bb0 2024-03-23T23:42:58.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7f21ce000640 1 -- 172.21.15.8:0/1700673547 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7f21bc001680 con 0x7f21d0151bb0 2024-03-23T23:42:58.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7f21ce000640 1 -- 172.21.15.8:0/1700673547 >> v1:172.21.15.196:6789/0 conn(0x7f21d0151bb0 legacy=0x7f21d00c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7f21ce000640 1 --2- 172.21.15.8:0/1700673547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21b4007dd0 0x7f21b40081f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7f21ce000640 1 --2- 172.21.15.8:0/1700673547 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f21b4008c20 0x7f21b40090a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7f21ce000640 1 --2- 172.21.15.8:0/1700673547 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21b40095e0 0x7f21b40145d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7f21ce000640 1 -- 172.21.15.8:0/1700673547 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d0071e40 con 0x7f21b4007dd0 2024-03-23T23:42:58.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7f21ce000640 1 -- 172.21.15.8:0/1700673547 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d0072120 con 0x7f21b40095e0 2024-03-23T23:42:58.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7f21ce000640 1 -- 172.21.15.8:0/1700673547 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b4009db0 con 0x7f21b4008c20 2024-03-23T23:42:58.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7ff6ad400640 1 -- 172.21.15.8:0/3776070446 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758528553 0 0) 0x7ff6b0156610 con 0x7ff6b0155fc0 2024-03-23T23:42:58.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7ff6ad400640 1 -- 172.21.15.8:0/3776070446 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff694003530 con 0x7ff6b0155fc0 2024-03-23T23:42:58.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7ff6ad400640 1 -- 172.21.15.8:0/3776070446 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244500214 0 0) 0x7ff6b01568f0 con 0x7ff6b0155b60 2024-03-23T23:42:58.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7ff6ad400640 1 -- 172.21.15.8:0/3776070446 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6b0156610 con 0x7ff6b0155b60 2024-03-23T23:42:58.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7f17e9200640 1 Processor -- start 2024-03-23T23:42:58.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7f21cea00640 1 --2- 172.21.15.8:0/1700673547 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f21b4008c20 0x7f21b40090a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7ff6ad400640 1 -- 172.21.15.8:0/3776070446 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3825501347 0 0) 0x7ff6b0156610 con 0x7ff6b0155b60 2024-03-23T23:42:58.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7ff6ad400640 1 -- 172.21.15.8:0/3776070446 >> v2:172.21.15.8:3300/0 conn(0x7ff6b014fc90 msgr2=0x7ff6b00c4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:58.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7ff6ad400640 1 --2- 172.21.15.8:0/3776070446 >> v2:172.21.15.8:3300/0 conn(0x7ff6b014fc90 0x7ff6b00c4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7ff6ad400640 1 -- 172.21.15.8:0/3776070446 >> v1:172.21.15.8:6789/0 conn(0x7ff6b0155fc0 legacy=0x7ff6b015cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7ff6ad400640 1 -- 172.21.15.8:0/3776070446 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b006ee40 con 0x7ff6b0155b60 2024-03-23T23:42:58.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7ff6ad400640 1 -- 172.21.15.8:0/3776070446 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7ff698001680 con 0x7ff6b0155b60 2024-03-23T23:42:58.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7ff6ad400640 1 -- 172.21.15.8:0/3776070446 >> v1:172.21.15.196:6789/0 conn(0x7ff6b0155b60 legacy=0x7ff6b00aa760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7ff6ad400640 1 --2- 172.21.15.8:0/3776070446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff694004c00 0x7ff694005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7ff6ad400640 1 --2- 172.21.15.8:0/3776070446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6940037b0 0x7ff694003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7ff6ade00640 1 --2- 172.21.15.8:0/3776070446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff694004c00 0x7ff694005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7ff6a5400640 1 --2- 172.21.15.8:0/3776070446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6940037b0 0x7ff694003c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7ff6ad400640 1 --2- 172.21.15.8:0/3776070446 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff694004170 0x7ff69400ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7ff6ad400640 1 -- 172.21.15.8:0/3776070446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6940106b0 con 0x7ff6940037b0 2024-03-23T23:42:58.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7ff6ad400640 1 -- 172.21.15.8:0/3776070446 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff694010830 con 0x7ff694004c00 2024-03-23T23:42:58.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7ff6ad400640 1 -- 172.21.15.8:0/3776070446 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff694010a30 con 0x7ff694004170 2024-03-23T23:42:58.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.213+0000 7ff6ae800640 1 --2- 172.21.15.8:0/3776070446 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff694004170 0x7ff69400ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.209+0000 7f17e9200640 1 -- start start 2024-03-23T23:42:58.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.213+0000 7f17e9200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f17e414ede0 0x7f17e4072b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.213+0000 7f17e9200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f17e40c2820 0x7f17e40c2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.213+0000 7f17e9200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17e4151ba0 0x7f17e4151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.213+0000 7f17e9200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e40c3760 con 0x7f17e40c2820 2024-03-23T23:42:58.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.213+0000 7f17e9200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e4151710 con 0x7f17e414ede0 2024-03-23T23:42:58.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.213+0000 7f17e9200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e406ccc0 con 0x7f17e4151ba0 2024-03-23T23:42:58.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.213+0000 7f17e3e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17e4151ba0 0x7f17e4151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.213+0000 7f17e3e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17e4151ba0 0x7f17e4151fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:49578/0 (socket says 172.21.15.8:49578) 2024-03-23T23:42:58.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.213+0000 7f17e3e00640 1 -- 172.21.15.8:0/2339370678 learned_addr learned my addr 172.21.15.8:0/2339370678 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:58.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.213+0000 7f17e3e00640 1 -- 172.21.15.8:0/2339370678 >> v2:172.21.15.196:3300/0 conn(0x7f17e414ede0 msgr2=0x7f17e4072b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:58.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.213+0000 7f17e3400640 1 --2- 172.21.15.8:0/2339370678 >> v2:172.21.15.196:3300/0 conn(0x7f17e414ede0 0x7f17e4072b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.213+0000 7f17e2a00640 1 --2- 172.21.15.8:0/2339370678 >> v2:172.21.15.8:3300/0 conn(0x7f17e40c2820 0x7f17e40c2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.213+0000 7f17e3e00640 1 --2- 172.21.15.8:0/2339370678 >> v2:172.21.15.196:3300/0 conn(0x7f17e414ede0 0x7f17e4072b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.213+0000 7f17e3e00640 1 -- 172.21.15.8:0/2339370678 >> v2:172.21.15.8:3300/0 conn(0x7f17e40c2820 msgr2=0x7f17e40c2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:58.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.213+0000 7f17e3e00640 1 --2- 172.21.15.8:0/2339370678 >> v2:172.21.15.8:3300/0 conn(0x7f17e40c2820 0x7f17e40c2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.213+0000 7f17e3e00640 1 -- 172.21.15.8:0/2339370678 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e406cfa0 con 0x7f17e4151ba0 2024-03-23T23:42:58.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.213+0000 7f9493600640 1 Processor -- start 2024-03-23T23:42:58.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.213+0000 7f21cfe00640 1 --2- 172.21.15.8:0/1700673547 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21b40095e0 0x7f21b40145d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.213+0000 7f21cfe00640 1 -- 172.21.15.8:0/1700673547 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f21b4008c20 msgr2=0x7f21b40090a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:58.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.213+0000 7f21cfe00640 1 --2- 172.21.15.8:0/1700673547 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f21b4008c20 0x7f21b40090a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.213+0000 7f21cfe00640 1 -- 172.21.15.8:0/1700673547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21b4007dd0 msgr2=0x7f21b40081f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:58.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.213+0000 7f21cfe00640 1 --2- 172.21.15.8:0/1700673547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21b4007dd0 0x7f21b40081f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.213+0000 7f21cfe00640 1 -- 172.21.15.8:0/1700673547 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d00c3590 con 0x7f21b40095e0 2024-03-23T23:42:58.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.213+0000 7ff6ade00640 1 -- 172.21.15.8:0/3776070446 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff694004170 msgr2=0x7ff69400ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:58.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.213+0000 7ff6ade00640 1 --2- 172.21.15.8:0/3776070446 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff694004170 0x7ff69400ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.213+0000 7ff6ade00640 1 -- 172.21.15.8:0/3776070446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6940037b0 msgr2=0x7ff694003c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:58.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.213+0000 7ff6ade00640 1 --2- 172.21.15.8:0/3776070446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6940037b0 0x7ff694003c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.213+0000 7ff6ade00640 1 -- 172.21.15.8:0/3776070446 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b0156610 con 0x7ff694004c00 2024-03-23T23:42:58.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.213+0000 7ff6ae800640 1 -- 172.21.15.8:0/3776070446 reap_dead start 2024-03-23T23:42:58.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.213+0000 7f9493600640 1 -- start start 2024-03-23T23:42:58.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.217+0000 7f9493600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f948c0c3f60 0x7f948c071a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.217+0000 7f21cfe00640 1 -- 172.21.15.8:0/1700673547 reap_dead start 2024-03-23T23:42:58.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.217+0000 7f21cfe00640 1 --2- 172.21.15.8:0/1700673547 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21b40095e0 0x7f21b40145d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f21c8009ca0 tx=0x7f21c801cc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa00b894a2ad6ca6 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:58.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.217+0000 7f9493600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f948c0c2380 0x7f948c156c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.217+0000 7f9493600640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948c15acc0 con 0x7f948c0c3600 2024-03-23T23:42:58.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.213+0000 7f17e3400640 1 --2- 172.21.15.8:0/2339370678 >> v2:172.21.15.196:3300/0 conn(0x7f17e414ede0 0x7f17e4072b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:42:58.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.217+0000 7f17e2a00640 1 --2- 172.21.15.8:0/2339370678 >> v2:172.21.15.8:3300/0 conn(0x7f17e40c2820 0x7f17e40c2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:42:58.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.217+0000 7f9493600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f948c15a830 con 0x7f948c0c3f60 2024-03-23T23:42:58.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.217+0000 7f9493600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948c159f00 con 0x7f948c0c2380 2024-03-23T23:42:58.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.217+0000 7f9491600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f948c0c2380 0x7f948c156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.217+0000 7f21ce000640 1 -- 172.21.15.8:0/1700673547 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c8006e60 con 0x7f21b40095e0 2024-03-23T23:42:58.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.217+0000 7f21ce000640 1 -- 172.21.15.8:0/1700673547 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c8003bc0 con 0x7f21b40095e0 2024-03-23T23:42:58.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.217+0000 7f17e3e00640 1 --2- 172.21.15.8:0/2339370678 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17e4151ba0 0x7f17e4151fb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f17e4073380 tx=0x7f17dc01ea70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93f0c89c7a447608 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:58.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.217+0000 7f9491600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f948c0c2380 0x7f948c156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:49590/0 (socket says 172.21.15.8:49590) 2024-03-23T23:42:58.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.217+0000 7f9491600640 1 -- 172.21.15.8:0/1476665945 learned_addr learned my addr 172.21.15.8:0/1476665945 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:58.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.217+0000 7f21ce000640 1 -- 172.21.15.8:0/1700673547 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c8004020 con 0x7f21b40095e0 2024-03-23T23:42:58.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.221+0000 7f17e2000640 1 -- 172.21.15.8:0/2339370678 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc0ad070 con 0x7f17e4151ba0 2024-03-23T23:42:58.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.221+0000 7f17e2000640 1 -- 172.21.15.8:0/2339370678 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17dc0a78c0 con 0x7f17e4151ba0 2024-03-23T23:42:58.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.221+0000 7f17e2000640 1 -- 172.21.15.8:0/2339370678 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc0a7c90 con 0x7f17e4151ba0 2024-03-23T23:42:58.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.217+0000 7f9491600640 1 -- 172.21.15.8:0/1476665945 >> v2:172.21.15.196:3300/0 conn(0x7f948c0c3f60 msgr2=0x7f948c071a30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-23T23:42:58.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.217+0000 7f9491600640 1 --2- 172.21.15.8:0/1476665945 >> v2:172.21.15.196:3300/0 conn(0x7f948c0c3f60 0x7f948c071a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.217+0000 7f9491600640 1 -- 172.21.15.8:0/1476665945 >> v1:172.21.15.8:6789/0 conn(0x7f948c0c3600 legacy=0x7f948c0c1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:58.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.217+0000 7f9491600640 1 -- 172.21.15.8:0/1476665945 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c15a1e0 con 0x7f948c0c2380 2024-03-23T23:42:58.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.221+0000 7f21d6200640 1 -- 172.21.15.8:0/1700673547 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21b40095e0 msgr2=0x7f21b40145d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.221+0000 7f21d6200640 1 --2- 172.21.15.8:0/1700673547 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21b40095e0 0x7f21b40145d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f21c8009ca0 tx=0x7f21c801cc50 comp rx=0 tx=0).stop 2024-03-23T23:42:58.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.221+0000 7f17e9200640 1 -- 172.21.15.8:0/2339370678 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17e4151ba0 msgr2=0x7f17e4151fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.221+0000 7f17e9200640 1 --2- 172.21.15.8:0/2339370678 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17e4151ba0 0x7f17e4151fb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f17e4073380 tx=0x7f17dc01ea70 comp rx=0 tx=0).stop 2024-03-23T23:42:58.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.221+0000 7f17e9200640 1 -- 172.21.15.8:0/2339370678 shutdown_connections 2024-03-23T23:42:58.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.221+0000 7f17e9200640 1 --2- 172.21.15.8:0/2339370678 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17e4151ba0 0x7f17e4151fb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.221+0000 7f17e9200640 1 --2- 172.21.15.8:0/2339370678 >> v2:172.21.15.8:3300/0 conn(0x7f17e40c2820 0x7f17e40c2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.221+0000 7f17e9200640 1 --2- 172.21.15.8:0/2339370678 >> v2:172.21.15.196:3300/0 conn(0x7f17e414ede0 0x7f17e4072b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.221+0000 7ff6ade00640 1 --2- 172.21.15.8:0/3776070446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff694004c00 0x7ff694005000 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0007360 tx=0x7ff6a001ce40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3451e0ec85c4c2d4 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:58.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.221+0000 7f17e9200640 1 -- 172.21.15.8:0/2339370678 >> 172.21.15.8:0/2339370678 conn(0x7f17e40c3910 msgr2=0x7f17e40c3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:58.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.221+0000 7f17e9200640 1 -- 172.21.15.8:0/2339370678 shutdown_connections 2024-03-23T23:42:58.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.221+0000 7f17e9200640 1 -- 172.21.15.8:0/2339370678 wait complete. 2024-03-23T23:42:58.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.221+0000 7ff6ad400640 1 -- 172.21.15.8:0/3776070446 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a00b2070 con 0x7ff694004c00 2024-03-23T23:42:58.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.221+0000 7ff6ad400640 1 -- 172.21.15.8:0/3776070446 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a00a5b20 con 0x7ff694004c00 2024-03-23T23:42:58.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.221+0000 7ff6b5000640 1 -- 172.21.15.8:0/3776070446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff694004c00 msgr2=0x7ff694005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.221+0000 7ff6b5000640 1 --2- 172.21.15.8:0/3776070446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff694004c00 0x7ff694005000 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0007360 tx=0x7ff6a001ce40 comp rx=0 tx=0).stop 2024-03-23T23:42:58.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.225+0000 7ff6b5000640 1 -- 172.21.15.8:0/3776070446 shutdown_connections 2024-03-23T23:42:58.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.225+0000 7ff6b5000640 1 --2- 172.21.15.8:0/3776070446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff694004c00 0x7ff694005000 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.225+0000 7ff6b5000640 1 -- 172.21.15.8:0/3776070446 >> 172.21.15.8:0/3776070446 conn(0x7ff6b006c280 msgr2=0x7ff6b006c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:58.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.225+0000 7ff6b5000640 1 -- 172.21.15.8:0/3776070446 shutdown_connections 2024-03-23T23:42:58.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.225+0000 7f17e9200640 1 Processor -- start 2024-03-23T23:42:58.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.225+0000 7f21d6200640 1 -- 172.21.15.8:0/1700673547 shutdown_connections 2024-03-23T23:42:58.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.225+0000 7f21d6200640 1 --2- 172.21.15.8:0/1700673547 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21b40095e0 0x7f21b40145d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.225+0000 7f21d6200640 1 -- 172.21.15.8:0/1700673547 >> 172.21.15.8:0/1700673547 conn(0x7f21d00a9870 msgr2=0x7f21d006b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:58.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.225+0000 7f21d6200640 1 -- 172.21.15.8:0/1700673547 shutdown_connections 2024-03-23T23:42:58.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.225+0000 7f21d6200640 1 -- 172.21.15.8:0/1700673547 wait complete. 2024-03-23T23:42:58.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.225+0000 7ff6b5000640 1 -- 172.21.15.8:0/3776070446 wait complete. 2024-03-23T23:42:58.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.225+0000 7ff6b5000640 1 Processor -- start 2024-03-23T23:42:58.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f21d6200640 1 Processor -- start 2024-03-23T23:42:58.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f9491600640 1 --2- 172.21.15.8:0/1476665945 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f948c0c2380 0x7f948c156c30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f948c15a9b0 tx=0x7f947c01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8236062448c48383 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:58.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f21d6200640 1 -- start start 2024-03-23T23:42:58.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f948b400640 1 -- 172.21.15.8:0/1476665945 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c0b0070 con 0x7f948c0c2380 2024-03-23T23:42:58.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f948b400640 1 -- 172.21.15.8:0/1476665945 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947c0ab600 con 0x7f948c0c2380 2024-03-23T23:42:58.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f948b400640 1 -- 172.21.15.8:0/1476665945 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c0ab9d0 con 0x7f948c0c2380 2024-03-23T23:42:58.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f9493600640 1 -- 172.21.15.8:0/1476665945 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f948c0c2380 msgr2=0x7f948c156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f9493600640 1 --2- 172.21.15.8:0/1476665945 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f948c0c2380 0x7f948c156c30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f948c15a9b0 tx=0x7f947c01c490 comp rx=0 tx=0).stop 2024-03-23T23:42:58.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f21d6200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21b40095e0 0x7f21d01ed400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f21d6200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21d01ed940 0x7f21d013e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f21cf400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21b40095e0 0x7f21d01ed400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f21d6200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f21d013e8f0 0x7f21d00ac150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f21d6200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d00c2040 con 0x7f21d01ed940 2024-03-23T23:42:58.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f21d6200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d00c1ec0 con 0x7f21b40095e0 2024-03-23T23:42:58.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f21d6200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d00c21c0 con 0x7f21d013e8f0 2024-03-23T23:42:58.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f21cf400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21b40095e0 0x7f21d01ed400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:46034/0 (socket says 172.21.15.8:46034) 2024-03-23T23:42:58.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f21cf400640 1 -- 172.21.15.8:0/4119505737 learned_addr learned my addr 172.21.15.8:0/4119505737 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:58.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f21cea00640 1 --2- 172.21.15.8:0/4119505737 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21d01ed940 0x7f21d013e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f9493600640 1 -- 172.21.15.8:0/1476665945 shutdown_connections 2024-03-23T23:42:58.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f9493600640 1 --2- 172.21.15.8:0/1476665945 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f948c0c2380 0x7f948c156c30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f9493600640 1 --2- 172.21.15.8:0/1476665945 >> v2:172.21.15.196:3300/0 conn(0x7f948c0c3f60 0x7f948c071a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f9493600640 1 -- 172.21.15.8:0/1476665945 >> 172.21.15.8:0/1476665945 conn(0x7f948c06b170 msgr2=0x7f948c06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:58.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f21cfe00640 1 --2- 172.21.15.8:0/4119505737 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f21d013e8f0 0x7f21d00ac150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f21cf400640 1 -- 172.21.15.8:0/4119505737 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f21d013e8f0 msgr2=0x7f21d00ac150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f21cf400640 1 --2- 172.21.15.8:0/4119505737 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f21d013e8f0 0x7f21d00ac150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f21cf400640 1 -- 172.21.15.8:0/4119505737 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21d01ed940 msgr2=0x7f21d013e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f21cf400640 1 --2- 172.21.15.8:0/4119505737 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21d01ed940 0x7f21d013e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f21cf400640 1 -- 172.21.15.8:0/4119505737 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d0149220 con 0x7f21b40095e0 2024-03-23T23:42:58.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.225+0000 7f17e9200640 1 -- start start 2024-03-23T23:42:58.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f17e9200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17e40c2820 0x7f17e4145410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f17e9200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17e414ede0 0x7f17e41e4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f17e3400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17e40c2820 0x7f17e4145410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f17e3400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17e40c2820 0x7f17e4145410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:49602/0 (socket says 172.21.15.8:49602) 2024-03-23T23:42:58.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f17e3400640 1 -- 172.21.15.8:0/2803172302 learned_addr learned my addr 172.21.15.8:0/2803172302 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:58.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f17e9200640 1 --2- 172.21.15.8:0/2803172302 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17e4151ba0 0x7f17e40c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f17e9200640 1 -- 172.21.15.8:0/2803172302 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e41524f0 con 0x7f17e414ede0 2024-03-23T23:42:58.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f17e9200640 1 -- 172.21.15.8:0/2803172302 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e4070be0 con 0x7f17e4151ba0 2024-03-23T23:42:58.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f17e9200640 1 -- 172.21.15.8:0/2803172302 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e406c940 con 0x7f17e40c2820 2024-03-23T23:42:58.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f21cf400640 1 --2- 172.21.15.8:0/4119505737 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21b40095e0 0x7f21d01ed400 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00c730 tx=0x7f21bc00cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:58.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7ff6b5000640 1 -- start start 2024-03-23T23:42:58.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7ff6b5000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff694004c00 0x7ff6b01ee6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f21c7400640 1 -- 172.21.15.8:0/4119505737 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc018070 con 0x7f21b40095e0 2024-03-23T23:42:58.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f21c7400640 1 -- 172.21.15.8:0/4119505737 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21bc0072f0 con 0x7f21b40095e0 2024-03-23T23:42:58.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f21c7400640 1 -- 172.21.15.8:0/4119505737 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc0047f0 con 0x7f21b40095e0 2024-03-23T23:42:58.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f21d6200640 1 -- 172.21.15.8:0/4119505737 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d0149500 con 0x7f21b40095e0 2024-03-23T23:42:58.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7ff6b5000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6b00c5f80 0x7ff6b014c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f17e3400640 1 -- 172.21.15.8:0/2803172302 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17e4151ba0 msgr2=0x7f17e40c5810 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-23T23:42:58.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f17e3400640 1 --2- 172.21.15.8:0/2803172302 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17e4151ba0 0x7f17e40c5810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f17e3400640 1 -- 172.21.15.8:0/2803172302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17e414ede0 msgr2=0x7f17e41e4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f17e3400640 1 --2- 172.21.15.8:0/2803172302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17e414ede0 0x7f17e41e4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.229+0000 7f17e3400640 1 -- 172.21.15.8:0/2803172302 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e40c6620 con 0x7f17e40c2820 2024-03-23T23:42:58.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.233+0000 7f17e3400640 1 --2- 172.21.15.8:0/2803172302 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17e40c2820 0x7f17e4145410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f17d400cf90 tx=0x7f17d400a7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:58.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.233+0000 7f21d6200640 1 -- 172.21.15.8:0/4119505737 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d00ab950 con 0x7f21b40095e0 2024-03-23T23:42:58.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.233+0000 7ff6ade00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff694004c00 0x7ff6b01ee6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.233+0000 7ff6ade00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff694004c00 0x7ff6b01ee6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:49606/0 (socket says 172.21.15.8:49606) 2024-03-23T23:42:58.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.233+0000 7ff6a5400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6b00c5f80 0x7ff6b014c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.233+0000 7ff6ade00640 1 -- 172.21.15.8:0/3632974465 learned_addr learned my addr 172.21.15.8:0/3632974465 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:58.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.233+0000 7ff6b5000640 1 --2- 172.21.15.8:0/3632974465 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff6b014c8f0 0x7ff6b014d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.233+0000 7ff6b5000640 1 -- 172.21.15.8:0/3632974465 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b0072fd0 con 0x7ff6b00c5f80 2024-03-23T23:42:58.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.233+0000 7ff6b5000640 1 -- 172.21.15.8:0/3632974465 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b01563d0 con 0x7ff6b014c8f0 2024-03-23T23:42:58.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.233+0000 7ff6ae800640 1 --2- 172.21.15.8:0/3632974465 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff6b014c8f0 0x7ff6b014d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.233+0000 7ff6b5000640 1 -- 172.21.15.8:0/3632974465 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b0073720 con 0x7ff694004c00 2024-03-23T23:42:58.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.233+0000 7f17db400640 1 -- 172.21.15.8:0/2803172302 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d401a070 con 0x7f17e40c2820 2024-03-23T23:42:58.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.233+0000 7f17db400640 1 -- 172.21.15.8:0/2803172302 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d400d840 con 0x7f17e40c2820 2024-03-23T23:42:58.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.233+0000 7f17db400640 1 -- 172.21.15.8:0/2803172302 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d400dbf0 con 0x7f17e40c2820 2024-03-23T23:42:58.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.233+0000 7ff6ae800640 1 -- 172.21.15.8:0/3632974465 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff694004c00 msgr2=0x7ff6b01ee6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.233+0000 7f17e9200640 1 -- 172.21.15.8:0/2803172302 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e40abf00 con 0x7f17e40c2820 2024-03-23T23:42:58.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.233+0000 7ff6ae800640 1 --2- 172.21.15.8:0/3632974465 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff694004c00 0x7ff6b01ee6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.233+0000 7ff6ae800640 1 -- 172.21.15.8:0/3632974465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6b00c5f80 msgr2=0x7ff6b014c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.233+0000 7ff6ae800640 1 --2- 172.21.15.8:0/3632974465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6b00c5f80 0x7ff6b014c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.233+0000 7ff6ae800640 1 -- 172.21.15.8:0/3632974465 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b006d250 con 0x7ff6b014c8f0 2024-03-23T23:42:58.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.233+0000 7ff6ade00640 1 --2- 172.21.15.8:0/3632974465 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff694004c00 0x7ff6b01ee6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:42:58.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.233+0000 7f17e9200640 1 -- 172.21.15.8:0/2803172302 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e40c52f0 con 0x7f17e40c2820 2024-03-23T23:42:58.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.233+0000 7f21c7400640 1 -- 172.21.15.8:0/4119505737 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f21bc004ba0 con 0x7f21b40095e0 2024-03-23T23:42:58.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.233+0000 7f9493600640 1 -- 172.21.15.8:0/1476665945 shutdown_connections 2024-03-23T23:42:58.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.233+0000 7f9493600640 1 -- 172.21.15.8:0/1476665945 wait complete. 2024-03-23T23:42:58.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.237+0000 7f21d6200640 1 -- 172.21.15.8:0/4119505737 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d0068270 con 0x7f21b40095e0 2024-03-23T23:42:58.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.237+0000 7ff6ae800640 1 --2- 172.21.15.8:0/3632974465 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff6b014c8f0 0x7ff6b014d9f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff6b006dc20 tx=0x7ff6a8001ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:58.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.233+0000 7f17e9200640 1 -- 172.21.15.8:0/2803172302 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17e40c54f0 con 0x7f17e40c2820 2024-03-23T23:42:58.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.237+0000 7f21c7400640 1 --2- 172.21.15.8:0/4119505737 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f21b0067690 0x7f21b0069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.237+0000 7f21c7400640 1 -- 172.21.15.8:0/4119505737 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f21bc085270 con 0x7f21b40095e0 2024-03-23T23:42:58.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.237+0000 7f21cea00640 1 --2- 172.21.15.8:0/4119505737 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f21b0067690 0x7f21b0069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.237+0000 7f21cea00640 1 --2- 172.21.15.8:0/4119505737 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f21b0067690 0x7f21b0069b50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f21d00c4c60 tx=0x7f21c0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:58.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.237+0000 7ff6a6a00640 1 -- 172.21.15.8:0/3632974465 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a8007740 con 0x7ff6b014c8f0 2024-03-23T23:42:58.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.237+0000 7ff6a6a00640 1 -- 172.21.15.8:0/3632974465 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a8018070 con 0x7ff6b014c8f0 2024-03-23T23:42:58.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.237+0000 7ff6a6a00640 1 -- 172.21.15.8:0/3632974465 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a800f940 con 0x7ff6b014c8f0 2024-03-23T23:42:58.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.237+0000 7ff6b5000640 1 -- 172.21.15.8:0/3632974465 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b0155710 con 0x7ff6b014c8f0 2024-03-23T23:42:58.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.237+0000 7ff6b5000640 1 -- 172.21.15.8:0/3632974465 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b01ef080 con 0x7ff6b014c8f0 2024-03-23T23:42:58.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.237+0000 7ff6b5000640 1 -- 172.21.15.8:0/3632974465 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6880052a0 con 0x7ff6b014c8f0 2024-03-23T23:42:58.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.241+0000 7f9493600640 1 Processor -- start 2024-03-23T23:42:58.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.241+0000 7f9493600640 1 -- start start 2024-03-23T23:42:58.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.241+0000 7f9493600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f948c0c2380 0x7f948c14cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.241+0000 7f9493600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f948c0c3600 0x7f948c0acbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.241+0000 7f9493600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f948c0c3f60 0x7f948c1f6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.237+0000 7f17db400640 1 -- 172.21.15.8:0/2803172302 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f17d401d070 con 0x7f17e40c2820 2024-03-23T23:42:58.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.241+0000 7f17db400640 1 --2- 172.21.15.8:0/2803172302 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f17c4067730 0x7f17c4069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.241+0000 7f17db400640 1 -- 172.21.15.8:0/2803172302 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f17d4086340 con 0x7f17e40c2820 2024-03-23T23:42:58.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.241+0000 7f17e2a00640 1 --2- 172.21.15.8:0/2803172302 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f17c4067730 0x7f17c4069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.241+0000 7f948be00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f948c0c3600 0x7f948c0acbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.241+0000 7f948be00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f948c0c3600 0x7f948c0acbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:46064/0 (socket says 172.21.15.8:46064) 2024-03-23T23:42:58.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.245+0000 7f9490c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f948c0c2380 0x7f948c14cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.245+0000 7f9490c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f948c0c2380 0x7f948c14cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:49620/0 (socket says 172.21.15.8:49620) 2024-03-23T23:42:58.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.245+0000 7f948be00640 1 -- 172.21.15.8:0/1363539535 learned_addr learned my addr 172.21.15.8:0/1363539535 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:58.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.245+0000 7f9493600640 1 -- 172.21.15.8:0/1363539535 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c0c4340 con 0x7f948c0c3f60 2024-03-23T23:42:58.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.245+0000 7f9493600640 1 -- 172.21.15.8:0/1363539535 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c157790 con 0x7f948c0c3600 2024-03-23T23:42:58.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.245+0000 7f9493600640 1 -- 172.21.15.8:0/1363539535 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948c0c44c0 con 0x7f948c0c2380 2024-03-23T23:42:58.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.241+0000 7f21c7400640 1 -- 172.21.15.8:0/4119505737 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f21bc055b50 con 0x7f21b40095e0 2024-03-23T23:42:58.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.241+0000 7ff6a6a00640 1 -- 172.21.15.8:0/3632974465 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff6a800fcf0 con 0x7ff6b014c8f0 2024-03-23T23:42:58.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.241+0000 7ff6a6a00640 1 --2- 172.21.15.8:0/3632974465 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff68c067730 0x7ff68c069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.241+0000 7ff6a6a00640 1 -- 172.21.15.8:0/3632974465 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7ff6a8085830 con 0x7ff6b014c8f0 2024-03-23T23:42:58.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.241+0000 7ff6ade00640 1 --2- 172.21.15.8:0/3632974465 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff68c067730 0x7ff68c069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.245+0000 7f17db400640 1 -- 172.21.15.8:0/2803172302 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f17e40c54f0 con 0x7f17e40c2820 2024-03-23T23:42:58.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.245+0000 7f9491600640 1 --2- 172.21.15.8:0/1363539535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f948c0c3f60 0x7f948c1f6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.245+0000 7f948be00640 1 -- 172.21.15.8:0/1363539535 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f948c0c2380 msgr2=0x7f948c14cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.245+0000 7f948be00640 1 --2- 172.21.15.8:0/1363539535 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f948c0c2380 0x7f948c14cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.245+0000 7f17e2a00640 1 --2- 172.21.15.8:0/2803172302 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f17c4067730 0x7f17c4069bf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f17e40c4140 tx=0x7f17d0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:58.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.245+0000 7f948be00640 1 -- 172.21.15.8:0/1363539535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f948c0c3f60 msgr2=0x7f948c1f6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.245+0000 7ff6ade00640 1 --2- 172.21.15.8:0/3632974465 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff68c067730 0x7ff68c069bf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff6a001ce80 tx=0x7ff6a000b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:58.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.245+0000 7f948be00640 1 --2- 172.21.15.8:0/1363539535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f948c0c3f60 0x7f948c1f6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.245+0000 7f948be00640 1 -- 172.21.15.8:0/1363539535 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c150050 con 0x7f948c0c3600 2024-03-23T23:42:58.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.245+0000 7f948be00640 1 --2- 172.21.15.8:0/1363539535 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f948c0c3600 0x7f948c0acbd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f947800c490 tx=0x7f9478001e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:58.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.245+0000 7f9488c00640 1 -- 172.21.15.8:0/1363539535 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9478017070 con 0x7f948c0c3600 2024-03-23T23:42:58.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.245+0000 7f9488c00640 1 -- 172.21.15.8:0/1363539535 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9478003600 con 0x7f948c0c3600 2024-03-23T23:42:58.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.245+0000 7f9488c00640 1 -- 172.21.15.8:0/1363539535 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9478003a30 con 0x7f948c0c3600 2024-03-23T23:42:58.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.249+0000 7f9493600640 1 -- 172.21.15.8:0/1363539535 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f948c150330 con 0x7f948c0c3600 2024-03-23T23:42:58.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.249+0000 7f9493600640 1 -- 172.21.15.8:0/1363539535 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f948c1508f0 con 0x7f948c0c3600 2024-03-23T23:42:58.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.249+0000 7f9493600640 1 -- 172.21.15.8:0/1363539535 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f948c150af0 con 0x7f948c0c3600 2024-03-23T23:42:58.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.253+0000 7ff6a6a00640 1 -- 172.21.15.8:0/3632974465 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7ff6a8055b10 con 0x7ff6b014c8f0 2024-03-23T23:42:58.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.253+0000 7f9488c00640 1 -- 172.21.15.8:0/1363539535 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f947801a070 con 0x7f948c0c3600 2024-03-23T23:42:58.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.253+0000 7f9488c00640 1 --2- 172.21.15.8:0/1363539535 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f946c067760 0x7f946c069c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.253+0000 7f9490c00640 1 --2- 172.21.15.8:0/1363539535 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f946c067760 0x7f946c069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.253+0000 7f9488c00640 1 -- 172.21.15.8:0/1363539535 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f9478084fa0 con 0x7f948c0c3600 2024-03-23T23:42:58.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.253+0000 7f9490c00640 1 --2- 172.21.15.8:0/1363539535 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f946c067760 0x7f946c069c20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9484009fd0 tx=0x7f948400d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:58.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.257+0000 7f9488c00640 1 -- 172.21.15.8:0/1363539535 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f948c150af0 con 0x7f948c0c3600 2024-03-23T23:42:58.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.269+0000 7fdac0800640 1 Processor -- start 2024-03-23T23:42:58.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.269+0000 7fdac0800640 1 -- start start 2024-03-23T23:42:58.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.269+0000 7fdac0800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdab8151bb0 0x7fdab80c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.269+0000 7fdac0800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fdab8151f90 0x7fdab806e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.269+0000 7fdac0800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fdab81523d0 0x7fdab806e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.269+0000 7fdac0800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab80c21f0 con 0x7fdab8151f90 2024-03-23T23:42:58.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.269+0000 7fdac0800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab8071b60 con 0x7fdab81523d0 2024-03-23T23:42:58.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.269+0000 7fdac0800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab8071e40 con 0x7fdab8151bb0 2024-03-23T23:42:58.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.269+0000 7fdabde00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdab8151bb0 0x7fdab80c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.269+0000 7fdabde00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdab8151bb0 0x7fdab80c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:49630/0 (socket says 172.21.15.8:49630) 2024-03-23T23:42:58.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.269+0000 7fdabde00640 1 -- 172.21.15.8:0/306602984 learned_addr learned my addr 172.21.15.8:0/306602984 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:58.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.269+0000 7fdabd400640 1 --2- 172.21.15.8:0/306602984 >> v2:172.21.15.8:3300/0 conn(0x7fdab8151f90 0x7fdab806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.269+0000 7fdabde00640 1 -- 172.21.15.8:0/306602984 >> v2:172.21.15.196:3300/0 conn(0x7fdab81523d0 msgr2=0x7fdab806e880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:42:58.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.269+0000 7fdabde00640 1 --2- 172.21.15.8:0/306602984 >> v2:172.21.15.196:3300/0 conn(0x7fdab81523d0 0x7fdab806e880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.269+0000 7fdabde00640 1 -- 172.21.15.8:0/306602984 >> v2:172.21.15.8:3300/0 conn(0x7fdab8151f90 msgr2=0x7fdab806e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:58.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.269+0000 7fdabde00640 1 --2- 172.21.15.8:0/306602984 >> v2:172.21.15.8:3300/0 conn(0x7fdab8151f90 0x7fdab806e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.269+0000 7fdabde00640 1 -- 172.21.15.8:0/306602984 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab8072120 con 0x7fdab8151bb0 2024-03-23T23:42:58.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.281+0000 7fdabde00640 1 --2- 172.21.15.8:0/306602984 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdab8151bb0 0x7fdab80c1cb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdab80ad5c0 tx=0x7fdaa801e930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79bd1d7676bfecdf server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:58.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.281+0000 7fdabca00640 1 -- 172.21.15.8:0/306602984 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa80b4070 con 0x7fdab8151bb0 2024-03-23T23:42:58.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.281+0000 7fdabca00640 1 -- 172.21.15.8:0/306602984 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa80af610 con 0x7fdab8151bb0 2024-03-23T23:42:58.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.281+0000 7fdabca00640 1 -- 172.21.15.8:0/306602984 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa80af9e0 con 0x7fdab8151bb0 2024-03-23T23:42:58.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.285+0000 7fdac0800640 1 -- 172.21.15.8:0/306602984 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdab8151bb0 msgr2=0x7fdab80c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.285+0000 7fdac0800640 1 --2- 172.21.15.8:0/306602984 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdab8151bb0 0x7fdab80c1cb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdab80ad5c0 tx=0x7fdaa801e930 comp rx=0 tx=0).stop 2024-03-23T23:42:58.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.285+0000 7fdac0800640 1 -- 172.21.15.8:0/306602984 shutdown_connections 2024-03-23T23:42:58.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.285+0000 7fdac0800640 1 --2- 172.21.15.8:0/306602984 >> v2:172.21.15.196:3300/0 conn(0x7fdab81523d0 0x7fdab806e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.285+0000 7fdac0800640 1 --2- 172.21.15.8:0/306602984 >> v2:172.21.15.8:3300/0 conn(0x7fdab8151f90 0x7fdab806e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.285+0000 7fdac0800640 1 --2- 172.21.15.8:0/306602984 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdab8151bb0 0x7fdab80c1cb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.285+0000 7fdac0800640 1 -- 172.21.15.8:0/306602984 >> 172.21.15.8:0/306602984 conn(0x7fdab80a9870 msgr2=0x7fdab806b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:58.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.285+0000 7fdac0800640 1 -- 172.21.15.8:0/306602984 shutdown_connections 2024-03-23T23:42:58.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.285+0000 7fdac0800640 1 -- 172.21.15.8:0/306602984 wait complete. 2024-03-23T23:42:58.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.289+0000 7fdac0800640 1 Processor -- start 2024-03-23T23:42:58.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.293+0000 7fdac0800640 1 -- start start 2024-03-23T23:42:58.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.293+0000 7fdac0800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdab8151bb0 0x7fdab81f41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.293+0000 7fdac0800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdab8151f90 0x7fdab81f6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.293+0000 7fdabde00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdab8151bb0 0x7fdab81f41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.293+0000 7fdabd400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdab8151f90 0x7fdab81f6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.293+0000 7fdabde00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdab8151bb0 0x7fdab81f41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:46076/0 (socket says 172.21.15.8:46076) 2024-03-23T23:42:58.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.293+0000 7fdabd400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdab8151f90 0x7fdab81f6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42186/0 (socket says 172.21.15.8:42186) 2024-03-23T23:42:58.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.293+0000 7fdabde00640 1 -- 172.21.15.8:0/3722130351 learned_addr learned my addr 172.21.15.8:0/3722130351 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:58.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.293+0000 7fdac0800640 1 --2- 172.21.15.8:0/3722130351 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdab81523d0 0x7fdab814a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.293+0000 7fdac0800640 1 -- 172.21.15.8:0/3722130351 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab8155200 con 0x7fdab8151f90 2024-03-23T23:42:58.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.293+0000 7fdac0800640 1 -- 172.21.15.8:0/3722130351 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab8155080 con 0x7fdab8151bb0 2024-03-23T23:42:58.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.293+0000 7fdac0800640 1 -- 172.21.15.8:0/3722130351 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab8155380 con 0x7fdab81523d0 2024-03-23T23:42:58.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.293+0000 7fdabe800640 1 --2- 172.21.15.8:0/3722130351 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdab81523d0 0x7fdab814a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.293+0000 7fdabde00640 1 -- 172.21.15.8:0/3722130351 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdab81523d0 msgr2=0x7fdab814a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.293+0000 7fdabde00640 1 --2- 172.21.15.8:0/3722130351 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdab81523d0 0x7fdab814a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.293+0000 7fdabde00640 1 -- 172.21.15.8:0/3722130351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdab8151f90 msgr2=0x7fdab81f6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.293+0000 7fdabde00640 1 --2- 172.21.15.8:0/3722130351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdab8151f90 0x7fdab81f6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.293+0000 7fdabde00640 1 -- 172.21.15.8:0/3722130351 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab81f6e50 con 0x7fdab8151bb0 2024-03-23T23:42:58.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.293+0000 7fdabde00640 1 --2- 172.21.15.8:0/3722130351 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdab8151bb0 0x7fdab81f41c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80b2040 tx=0x7fdaa801d170 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:58.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.297+0000 7fdabd400640 1 --2- 172.21.15.8:0/3722130351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdab8151f90 0x7fdab81f6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:42:58.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.301+0000 7fdab2000640 1 -- 172.21.15.8:0/3722130351 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa80afbd0 con 0x7fdab8151bb0 2024-03-23T23:42:58.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.301+0000 7fdab2000640 1 -- 172.21.15.8:0/3722130351 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa80c5070 con 0x7fdab8151bb0 2024-03-23T23:42:58.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.301+0000 7fdac0800640 1 -- 172.21.15.8:0/3722130351 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab81f7130 con 0x7fdab8151bb0 2024-03-23T23:42:58.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.301+0000 7fdab2000640 1 -- 172.21.15.8:0/3722130351 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa800b150 con 0x7fdab8151bb0 2024-03-23T23:42:58.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.301+0000 7fdac0800640 1 -- 172.21.15.8:0/3722130351 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab80c5020 con 0x7fdab8151bb0 2024-03-23T23:42:58.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.301+0000 7fdac0800640 1 -- 172.21.15.8:0/3722130351 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdab8068270 con 0x7fdab8151bb0 2024-03-23T23:42:58.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.301+0000 7fdab2000640 1 -- 172.21.15.8:0/3722130351 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fdaa800b2f0 con 0x7fdab8151bb0 2024-03-23T23:42:58.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.305+0000 7fdab2000640 1 --2- 172.21.15.8:0/3722130351 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fda9c0676b0 0x7fda9c069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.305+0000 7fdab2000640 1 -- 172.21.15.8:0/3722130351 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fdaa8130350 con 0x7fdab8151bb0 2024-03-23T23:42:58.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.305+0000 7fdabd400640 1 --2- 172.21.15.8:0/3722130351 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fda9c0676b0 0x7fda9c069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.305+0000 7fdabd400640 1 --2- 172.21.15.8:0/3722130351 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fda9c0676b0 0x7fda9c069b70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdab81f6220 tx=0x7fdab40098d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:58.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.309+0000 7fdab2000640 1 -- 172.21.15.8:0/3722130351 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fdaa8018640 con 0x7fdab8151bb0 2024-03-23T23:42:58.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.317+0000 7fa47ba00640 1 Processor -- start 2024-03-23T23:42:58.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.317+0000 7fa47ba00640 1 -- start start 2024-03-23T23:42:58.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.317+0000 7fa47ba00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa4740a8260 0x7fa474159d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.317+0000 7fa479000640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fa4741574f0 0x7fa4740c3e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:46264/0 (socket says 172.21.15.8:46264) 2024-03-23T23:42:58.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.317+0000 7fa479000640 1 -- 172.21.15.8:0/2986095997 learned_addr learned my addr 172.21.15.8:0/2986095997 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:58.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.317+0000 7fa47ba00640 1 -- 172.21.15.8:0/2986095997 --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa47415a330 con 0x7fa4740a87d0 2024-03-23T23:42:58.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.317+0000 7fa47ba00640 1 -- 172.21.15.8:0/2986095997 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa47415a610 con 0x7fa4741574f0 2024-03-23T23:42:58.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.317+0000 7fa47ba00640 1 -- 172.21.15.8:0/2986095997 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa47415a8f0 con 0x7fa4740a8260 2024-03-23T23:42:58.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.317+0000 7fa479a00640 1 --2- 172.21.15.8:0/2986095997 >> v2:172.21.15.8:3300/0 conn(0x7fa4740a8260 0x7fa474159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.321+0000 7fa479a00640 1 -- 172.21.15.8:0/2986095997 >> v1:172.21.15.196:6789/0 conn(0x7fa4741574f0 legacy=0x7fa4740c3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:58.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.321+0000 7fa479a00640 1 -- 172.21.15.8:0/2986095997 >> v1:172.21.15.8:6789/0 conn(0x7fa4740a87d0 legacy=0x7fa4740a7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.321+0000 7fa473400640 1 -- 172.21.15.8:0/2986095997 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3273078192 0 0) 0x7fa47415a330 con 0x7fa4740a87d0 2024-03-23T23:42:58.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.321+0000 7fa479a00640 1 -- 172.21.15.8:0/2986095997 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47415abd0 con 0x7fa4740a8260 2024-03-23T23:42:58.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.325+0000 7fa479a00640 1 --2- 172.21.15.8:0/2986095997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4740a8260 0x7fa474159d50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa46c00b050 tx=0x7fa46c01cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80022d981df844c9 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:58.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.325+0000 7fa473400640 1 -- 172.21.15.8:0/2986095997 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c0b2070 con 0x7fa4740a8260 2024-03-23T23:42:58.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.325+0000 7fa473400640 1 -- 172.21.15.8:0/2986095997 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46c0a5c50 con 0x7fa4740a8260 2024-03-23T23:42:58.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.325+0000 7fa473400640 1 -- 172.21.15.8:0/2986095997 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c0ad440 con 0x7fa4740a8260 2024-03-23T23:42:58.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.329+0000 7fa47ba00640 1 -- 172.21.15.8:0/2986095997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4740a8260 msgr2=0x7fa474159d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.329+0000 7fa47ba00640 1 --2- 172.21.15.8:0/2986095997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4740a8260 0x7fa474159d50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa46c00b050 tx=0x7fa46c01cb60 comp rx=0 tx=0).stop 2024-03-23T23:42:58.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.329+0000 7fa47ba00640 1 -- 172.21.15.8:0/2986095997 shutdown_connections 2024-03-23T23:42:58.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.329+0000 7fa47ba00640 1 --2- 172.21.15.8:0/2986095997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4740a8260 0x7fa474159d50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.329+0000 7fa47ba00640 1 -- 172.21.15.8:0/2986095997 >> 172.21.15.8:0/2986095997 conn(0x7fa4740c7430 msgr2=0x7fa4740c7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:58.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.329+0000 7fa47ba00640 1 -- 172.21.15.8:0/2986095997 shutdown_connections 2024-03-23T23:42:58.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.329+0000 7fa47ba00640 1 -- 172.21.15.8:0/2986095997 wait complete. 2024-03-23T23:42:58.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.333+0000 7fa47ba00640 1 Processor -- start 2024-03-23T23:42:58.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.333+0000 7fa47ba00640 1 -- start start 2024-03-23T23:42:58.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.333+0000 7fa47ba00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4740a8260 0x7fa4740c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.333+0000 7fa47ba00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa4740a87d0 0x7fa474150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.333+0000 7fa479000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4740a8260 0x7fa4740c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.333+0000 7fa47ba00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4741574f0 0x7fa474150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.333+0000 7fa47ba00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4740c4710 con 0x7fa4740a8260 2024-03-23T23:42:58.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.333+0000 7fa47ba00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4740c4590 con 0x7fa4741574f0 2024-03-23T23:42:58.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.333+0000 7fa47ba00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa474167e80 con 0x7fa4740a87d0 2024-03-23T23:42:58.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.333+0000 7fa479000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4740a8260 0x7fa4740c62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42204/0 (socket says 172.21.15.8:42204) 2024-03-23T23:42:58.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.333+0000 7fa479000640 1 -- 172.21.15.8:0/4088148894 learned_addr learned my addr 172.21.15.8:0/4088148894 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:58.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.337+0000 7fa473e00640 1 --2- 172.21.15.8:0/4088148894 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa4740a87d0 0x7fa474150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.337+0000 7fa479a00640 1 --2- 172.21.15.8:0/4088148894 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4741574f0 0x7fa474150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.337+0000 7fa479a00640 1 -- 172.21.15.8:0/4088148894 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa4740a87d0 msgr2=0x7fa474150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.337+0000 7fa479a00640 1 --2- 172.21.15.8:0/4088148894 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa4740a87d0 0x7fa474150700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.337+0000 7fa479a00640 1 -- 172.21.15.8:0/4088148894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4740a8260 msgr2=0x7fa4740c62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.337+0000 7fa479a00640 1 --2- 172.21.15.8:0/4088148894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4740a8260 0x7fa4740c62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.337+0000 7fa479a00640 1 -- 172.21.15.8:0/4088148894 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa474072e60 con 0x7fa4741574f0 2024-03-23T23:42:58.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.337+0000 7fa479a00640 1 --2- 172.21.15.8:0/4088148894 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4741574f0 0x7fa474150c40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0ac000 tx=0x7fa46c019900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:58.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.337+0000 7fa470c00640 1 -- 172.21.15.8:0/4088148894 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c0bd070 con 0x7fa4741574f0 2024-03-23T23:42:58.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.337+0000 7fa47ba00640 1 -- 172.21.15.8:0/4088148894 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa474155750 con 0x7fa4741574f0 2024-03-23T23:42:58.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.337+0000 7fa47ba00640 1 -- 172.21.15.8:0/4088148894 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa474155cd0 con 0x7fa4741574f0 2024-03-23T23:42:58.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.337+0000 7fa470c00640 1 -- 172.21.15.8:0/4088148894 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46c0b3040 con 0x7fa4741574f0 2024-03-23T23:42:58.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.337+0000 7fa47ba00640 1 -- 172.21.15.8:0/4088148894 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa474068270 con 0x7fa4741574f0 2024-03-23T23:42:58.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.337+0000 7fa470c00640 1 -- 172.21.15.8:0/4088148894 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c0b2070 con 0x7fa4741574f0 2024-03-23T23:42:58.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.341+0000 7fa470c00640 1 -- 172.21.15.8:0/4088148894 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fa46c004240 con 0x7fa4741574f0 2024-03-23T23:42:58.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.341+0000 7fa470c00640 1 --2- 172.21.15.8:0/4088148894 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa4580676b0 0x7fa458069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.341+0000 7fa470c00640 1 -- 172.21.15.8:0/4088148894 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fa46c0ef620 con 0x7fa4741574f0 2024-03-23T23:42:58.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.341+0000 7fa479000640 1 --2- 172.21.15.8:0/4088148894 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa4580676b0 0x7fa458069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.345+0000 7fa479000640 1 --2- 172.21.15.8:0/4088148894 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa4580676b0 0x7fa458069b70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa464007d60 tx=0x7fa464007cb0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:58.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.349+0000 7fa470c00640 1 -- 172.21.15.8:0/4088148894 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fa46c016780 con 0x7fa4741574f0 2024-03-23T23:42:58.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.361+0000 7f705ac00640 1 Processor -- start 2024-03-23T23:42:58.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.361+0000 7f705ac00640 1 -- start start 2024-03-23T23:42:58.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.361+0000 7f705ac00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f70540c0490 0x7f70540c0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.361+0000 7f705ac00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7054071490 0x7f7054155740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.365+0000 7f7059800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f70540c0490 0x7f70540c0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.365+0000 7f7059800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f70540c0490 0x7f70540c0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:49654/0 (socket says 172.21.15.8:49654) 2024-03-23T23:42:58.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.365+0000 7f7059800640 1 -- 172.21.15.8:0/948496615 learned_addr learned my addr 172.21.15.8:0/948496615 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:58.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.365+0000 7f7058e00640 1 --2- 172.21.15.8:0/948496615 >> v2:172.21.15.196:3300/0 conn(0x7f7054071490 0x7f7054155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.365+0000 7f705ac00640 1 -- 172.21.15.8:0/948496615 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70540acb50 con 0x7f7054155c80 2024-03-23T23:42:58.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.365+0000 7f705ac00640 1 -- 172.21.15.8:0/948496615 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70540725a0 con 0x7f7054071490 2024-03-23T23:42:58.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.365+0000 7f705ac00640 1 -- 172.21.15.8:0/948496615 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70540c3870 con 0x7f70540c0490 2024-03-23T23:42:58.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.369+0000 7f7053e00640 1 -- 172.21.15.8:0/948496615 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919392484 0 0) 0x7f704c001120 con 0x7f7054155c80 2024-03-23T23:42:58.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.369+0000 7f7053e00640 1 -- 172.21.15.8:0/948496615 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7038003530 con 0x7f7054155c80 2024-03-23T23:42:58.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.369+0000 7f7058e00640 1 -- 172.21.15.8:0/948496615 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f70540c0490 msgr2=0x7f70540c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:58.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.369+0000 7f7058e00640 1 --2- 172.21.15.8:0/948496615 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f70540c0490 0x7f70540c0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.369+0000 7f7058e00640 1 -- 172.21.15.8:0/948496615 >> v1:172.21.15.196:6789/0 conn(0x7f7054155c80 legacy=0x7f7054158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.369+0000 7f7058e00640 1 -- 172.21.15.8:0/948496615 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7054070f50 con 0x7f7054071490 2024-03-23T23:42:58.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.377+0000 7f7058e00640 1 --2- 172.21.15.8:0/948496615 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7054071490 0x7f7054155740 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7044009d90 tx=0x7f704401c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d6e20e45cacdc94 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:58.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.377+0000 7f7053e00640 1 -- 172.21.15.8:0/948496615 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70440b2070 con 0x7f7054071490 2024-03-23T23:42:58.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.377+0000 7f7053e00640 1 -- 172.21.15.8:0/948496615 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70440a5720 con 0x7f7054071490 2024-03-23T23:42:58.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.377+0000 7f7053e00640 1 -- 172.21.15.8:0/948496615 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70440a5af0 con 0x7f7054071490 2024-03-23T23:42:58.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.377+0000 7f705ac00640 1 -- 172.21.15.8:0/948496615 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7054071490 msgr2=0x7f7054155740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.377+0000 7f705ac00640 1 --2- 172.21.15.8:0/948496615 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7054071490 0x7f7054155740 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7044009d90 tx=0x7f704401c870 comp rx=0 tx=0).stop 2024-03-23T23:42:58.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.377+0000 7f705ac00640 1 -- 172.21.15.8:0/948496615 shutdown_connections 2024-03-23T23:42:58.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.377+0000 7f705ac00640 1 --2- 172.21.15.8:0/948496615 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7054071490 0x7f7054155740 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.377+0000 7f705ac00640 1 --2- 172.21.15.8:0/948496615 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f70540c0490 0x7f70540c0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.377+0000 7f705ac00640 1 -- 172.21.15.8:0/948496615 >> 172.21.15.8:0/948496615 conn(0x7f70540c3b60 msgr2=0x7f70540c3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:58.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.377+0000 7f705ac00640 1 -- 172.21.15.8:0/948496615 shutdown_connections 2024-03-23T23:42:58.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.377+0000 7f705ac00640 1 -- 172.21.15.8:0/948496615 wait complete. 2024-03-23T23:42:58.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.385+0000 7f705ac00640 1 Processor -- start 2024-03-23T23:42:58.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.389+0000 7f705ac00640 1 -- start start 2024-03-23T23:42:58.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.393+0000 7f705ac00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7054071490 0x7f70541f21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.393+0000 7f705ac00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70540c0490 0x7f70541f2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.393+0000 7f705ac00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7054155c80 0x7f705406d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.393+0000 7f705ac00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705414fb80 con 0x7f70540c0490 2024-03-23T23:42:58.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.393+0000 7f705ac00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70540c1270 con 0x7f7054155c80 2024-03-23T23:42:58.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.393+0000 7f705ac00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70540c4900 con 0x7f7054071490 2024-03-23T23:42:58.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.393+0000 7f7059800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7054071490 0x7f70541f21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.393+0000 7f7059800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7054071490 0x7f70541f21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:49660/0 (socket says 172.21.15.8:49660) 2024-03-23T23:42:58.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.397+0000 7f7059800640 1 -- 172.21.15.8:0/1813209476 learned_addr learned my addr 172.21.15.8:0/1813209476 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:58.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.397+0000 7f705a200640 1 --2- 172.21.15.8:0/1813209476 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7054155c80 0x7f705406d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.397+0000 7f7059800640 1 -- 172.21.15.8:0/1813209476 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7054155c80 msgr2=0x7f705406d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.397+0000 7f7059800640 1 --2- 172.21.15.8:0/1813209476 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7054155c80 0x7f705406d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.397+0000 7f7059800640 1 -- 172.21.15.8:0/1813209476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70540c0490 msgr2=0x7f70541f2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.397+0000 7f7059800640 1 --2- 172.21.15.8:0/1813209476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70540c0490 0x7f70541f2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.397+0000 7f7059800640 1 -- 172.21.15.8:0/1813209476 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70540abdb0 con 0x7f7054071490 2024-03-23T23:42:58.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.397+0000 7f705a200640 1 --2- 172.21.15.8:0/1813209476 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7054155c80 0x7f705406d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:42:58.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.397+0000 7f7059800640 1 --2- 172.21.15.8:0/1813209476 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7054071490 0x7f70541f21d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f703c00e820 tx=0x7f703c00ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:58.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.397+0000 7f7051600640 1 -- 172.21.15.8:0/1813209476 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c017070 con 0x7f7054071490 2024-03-23T23:42:58.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.397+0000 7f7051600640 1 -- 172.21.15.8:0/1813209476 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703c00c940 con 0x7f7054071490 2024-03-23T23:42:58.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.397+0000 7f7051600640 1 -- 172.21.15.8:0/1813209476 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c00cd30 con 0x7f7054071490 2024-03-23T23:42:58.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.397+0000 7f705ac00640 1 -- 172.21.15.8:0/1813209476 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7054067be0 con 0x7f7054071490 2024-03-23T23:42:58.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.397+0000 7f705ac00640 1 -- 172.21.15.8:0/1813209476 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7054153ed0 con 0x7f7054071490 2024-03-23T23:42:58.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.401+0000 7f705ac00640 1 -- 172.21.15.8:0/1813209476 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f705404f410 con 0x7f7054071490 2024-03-23T23:42:58.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.405+0000 7f7051600640 1 -- 172.21.15.8:0/1813209476 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f703c01a070 con 0x7f7054071490 2024-03-23T23:42:58.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.405+0000 7f7051600640 1 --2- 172.21.15.8:0/1813209476 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7030067660 0x7f7030069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:58.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.405+0000 7f7051600640 1 -- 172.21.15.8:0/1813209476 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f703c0859c0 con 0x7f7054071490 2024-03-23T23:42:58.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.405+0000 7f7058e00640 1 --2- 172.21.15.8:0/1813209476 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7030067660 0x7f7030069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:58.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.409+0000 7f7058e00640 1 --2- 172.21.15.8:0/1813209476 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7030067660 0x7f7030069b20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f70440af000 tx=0x7f7044004ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:58.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.413+0000 7f7051600640 1 -- 172.21.15.8:0/1813209476 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f703c087e20 con 0x7f7054071490 2024-03-23T23:42:58.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.561+0000 7f03e1400640 1 -- 172.21.15.8:0/1966335854 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f03dc0ab7a0 con 0x7f03dc14b5b0 2024-03-23T23:42:58.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.561+0000 7f03d3e00640 1 -- 172.21.15.8:0/1966335854 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f03c4056120 con 0x7f03dc14b5b0 2024-03-23T23:42:58.564 INFO:teuthology.orchestra.run.smithi008.stdout:60129542151 2024-03-23T23:42:58.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.565+0000 7f03e1400640 1 -- 172.21.15.8:0/1966335854 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f03b80676b0 msgr2=0x7f03b8069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.565+0000 7f03e1400640 1 --2- 172.21.15.8:0/1966335854 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f03b80676b0 0x7f03b8069b70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f03d4007300 tx=0x7f03d4007290 comp rx=0 tx=0).stop 2024-03-23T23:42:58.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.565+0000 7f03e1400640 1 -- 172.21.15.8:0/1966335854 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03dc14b5b0 msgr2=0x7f03dc0c0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.565+0000 7f03e1400640 1 --2- 172.21.15.8:0/1966335854 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03dc14b5b0 0x7f03dc0c0800 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f03dc067ef0 tx=0x7f03c400fc00 comp rx=0 tx=0).stop 2024-03-23T23:42:58.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.565+0000 7f03e1400640 1 -- 172.21.15.8:0/1966335854 shutdown_connections 2024-03-23T23:42:58.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.565+0000 7f03e1400640 1 --2- 172.21.15.8:0/1966335854 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f03b80676b0 0x7f03b8069b70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.565+0000 7f03e1400640 1 --2- 172.21.15.8:0/1966335854 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03dc14b5b0 0x7f03dc0c0800 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.565+0000 7f03e1400640 1 --2- 172.21.15.8:0/1966335854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03dc1eaa70 0x7f03dc0bee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.565+0000 7f03e1400640 1 --2- 172.21.15.8:0/1966335854 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f03c0004810 0x7f03dc0be920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.565+0000 7f03e1400640 1 -- 172.21.15.8:0/1966335854 >> 172.21.15.8:0/1966335854 conn(0x7f03dc06b170 msgr2=0x7f03dc0ac510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:58.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.565+0000 7f03e1400640 1 -- 172.21.15.8:0/1966335854 shutdown_connections 2024-03-23T23:42:58.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.565+0000 7f03e1400640 1 -- 172.21.15.8:0/1966335854 wait complete. 2024-03-23T23:42:58.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.601+0000 7f17e9200640 1 -- 172.21.15.8:0/2803172302 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f17e40ac420 con 0x7f17e40c2820 2024-03-23T23:42:58.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.609+0000 7f17db400640 1 -- 172.21.15.8:0/2803172302 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f17d40566b0 con 0x7f17e40c2820 2024-03-23T23:42:58.613 INFO:teuthology.orchestra.run.smithi008.stdout:60129542151 2024-03-23T23:42:58.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.617+0000 7f17e9200640 1 -- 172.21.15.8:0/2803172302 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f17c4067730 msgr2=0x7f17c4069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.617+0000 7f17e9200640 1 --2- 172.21.15.8:0/2803172302 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f17c4067730 0x7f17c4069bf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f17e40c4140 tx=0x7f17d0008040 comp rx=0 tx=0).stop 2024-03-23T23:42:58.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.617+0000 7f17e9200640 1 -- 172.21.15.8:0/2803172302 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17e40c2820 msgr2=0x7f17e4145410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.617+0000 7f17e9200640 1 --2- 172.21.15.8:0/2803172302 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17e40c2820 0x7f17e4145410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f17d400cf90 tx=0x7f17d400a7d0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.617+0000 7f17e9200640 1 -- 172.21.15.8:0/2803172302 shutdown_connections 2024-03-23T23:42:58.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.617+0000 7f17e9200640 1 --2- 172.21.15.8:0/2803172302 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17e4151ba0 0x7f17e40c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.617+0000 7f17e9200640 1 --2- 172.21.15.8:0/2803172302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17e414ede0 0x7f17e41e4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.617+0000 7f17e9200640 1 --2- 172.21.15.8:0/2803172302 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f17c4067730 0x7f17c4069bf0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.617+0000 7f17e9200640 1 --2- 172.21.15.8:0/2803172302 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17e40c2820 0x7f17e4145410 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.617+0000 7f17e9200640 1 -- 172.21.15.8:0/2803172302 >> 172.21.15.8:0/2803172302 conn(0x7f17e40c3910 msgr2=0x7f17e415b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:58.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.617+0000 7f17e9200640 1 -- 172.21.15.8:0/2803172302 shutdown_connections 2024-03-23T23:42:58.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.617+0000 7f17e9200640 1 -- 172.21.15.8:0/2803172302 wait complete. 2024-03-23T23:42:58.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.621+0000 7f9493600640 1 -- 172.21.15.8:0/1363539535 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f948c068270 con 0x7f948c0c3600 2024-03-23T23:42:58.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.621+0000 7f9488c00640 1 -- 172.21.15.8:0/1363539535 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9478055280 con 0x7f948c0c3600 2024-03-23T23:42:58.624 INFO:teuthology.orchestra.run.smithi008.stdout:60129542151 2024-03-23T23:42:58.625 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542151 for osd.0 2024-03-23T23:42:58.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.625+0000 7f9493600640 1 -- 172.21.15.8:0/1363539535 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f946c067760 msgr2=0x7f946c069c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.625+0000 7f9493600640 1 --2- 172.21.15.8:0/1363539535 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f946c067760 0x7f946c069c20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9484009fd0 tx=0x7f948400d040 comp rx=0 tx=0).stop 2024-03-23T23:42:58.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.625+0000 7f9493600640 1 -- 172.21.15.8:0/1363539535 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f948c0c3600 msgr2=0x7f948c0acbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.625+0000 7f9493600640 1 --2- 172.21.15.8:0/1363539535 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f948c0c3600 0x7f948c0acbd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f947800c490 tx=0x7f9478001e80 comp rx=0 tx=0).stop 2024-03-23T23:42:58.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.625+0000 7f9493600640 1 -- 172.21.15.8:0/1363539535 shutdown_connections 2024-03-23T23:42:58.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.625+0000 7f9493600640 1 --2- 172.21.15.8:0/1363539535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f948c0c3f60 0x7f948c1f6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.625+0000 7f9493600640 1 --2- 172.21.15.8:0/1363539535 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f948c0c3600 0x7f948c0acbd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.625+0000 7f9493600640 1 --2- 172.21.15.8:0/1363539535 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f946c067760 0x7f946c069c20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.625+0000 7f9493600640 1 --2- 172.21.15.8:0/1363539535 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f948c0c2380 0x7f948c14cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.625+0000 7f9493600640 1 -- 172.21.15.8:0/1363539535 >> 172.21.15.8:0/1363539535 conn(0x7f948c06b170 msgr2=0x7f948c06e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:58.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.629+0000 7f9493600640 1 -- 172.21.15.8:0/1363539535 shutdown_connections 2024-03-23T23:42:58.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.629+0000 7f9493600640 1 -- 172.21.15.8:0/1363539535 wait complete. 2024-03-23T23:42:58.648 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542151 for osd.1 2024-03-23T23:42:58.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542151 for osd.2 2024-03-23T23:42:58.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.661+0000 7fdac0800640 1 -- 172.21.15.8:0/3722130351 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdab806e9b0 con 0x7fdab8151bb0 2024-03-23T23:42:58.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.665+0000 7fdab2000640 1 -- 172.21.15.8:0/3722130351 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdaa8100d20 con 0x7fdab8151bb0 2024-03-23T23:42:58.665 INFO:teuthology.orchestra.run.smithi008.stdout:64424509448 2024-03-23T23:42:58.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.665+0000 7fdac0800640 1 -- 172.21.15.8:0/3722130351 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fda9c0676b0 msgr2=0x7fda9c069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.665+0000 7fdac0800640 1 --2- 172.21.15.8:0/3722130351 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fda9c0676b0 0x7fda9c069b70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdab81f6220 tx=0x7fdab40098d0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.665+0000 7fdac0800640 1 -- 172.21.15.8:0/3722130351 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdab8151bb0 msgr2=0x7fdab81f41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.665+0000 7fdac0800640 1 --2- 172.21.15.8:0/3722130351 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdab8151bb0 0x7fdab81f41c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80b2040 tx=0x7fdaa801d170 comp rx=0 tx=0).stop 2024-03-23T23:42:58.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.665+0000 7fdac0800640 1 -- 172.21.15.8:0/3722130351 shutdown_connections 2024-03-23T23:42:58.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.665+0000 7fdac0800640 1 --2- 172.21.15.8:0/3722130351 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fda9c0676b0 0x7fda9c069b70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.665+0000 7fdac0800640 1 --2- 172.21.15.8:0/3722130351 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdab81523d0 0x7fdab814a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.665+0000 7fdac0800640 1 --2- 172.21.15.8:0/3722130351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdab8151f90 0x7fdab81f6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.665+0000 7fdac0800640 1 --2- 172.21.15.8:0/3722130351 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdab8151bb0 0x7fdab81f41c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.665+0000 7fdac0800640 1 -- 172.21.15.8:0/3722130351 >> 172.21.15.8:0/3722130351 conn(0x7fdab80a9870 msgr2=0x7fdab80c2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:58.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.665+0000 7fdac0800640 1 -- 172.21.15.8:0/3722130351 shutdown_connections 2024-03-23T23:42:58.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.665+0000 7fdac0800640 1 -- 172.21.15.8:0/3722130351 wait complete. 2024-03-23T23:42:58.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.677+0000 7f21d6200640 1 -- 172.21.15.8:0/4119505737 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f21d014d040 con 0x7f21b40095e0 2024-03-23T23:42:58.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.677+0000 7f21c7400640 1 -- 172.21.15.8:0/4119505737 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f21bc055450 con 0x7f21b40095e0 2024-03-23T23:42:58.680 INFO:teuthology.orchestra.run.smithi008.stdout:64424509447 2024-03-23T23:42:58.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.677+0000 7ff6b5000640 1 -- 172.21.15.8:0/3632974465 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ff688005590 con 0x7ff6b014c8f0 2024-03-23T23:42:58.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.681+0000 7ff6a6a00640 1 -- 172.21.15.8:0/3632974465 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff6a8059bb0 con 0x7ff6b014c8f0 2024-03-23T23:42:58.681 INFO:teuthology.orchestra.run.smithi008.stdout:64424509448 2024-03-23T23:42:58.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.681+0000 7f21d6200640 1 -- 172.21.15.8:0/4119505737 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f21b0067690 msgr2=0x7f21b0069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.681+0000 7f21d6200640 1 --2- 172.21.15.8:0/4119505737 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f21b0067690 0x7f21b0069b50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f21d00c4c60 tx=0x7f21c0008040 comp rx=0 tx=0).stop 2024-03-23T23:42:58.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.681+0000 7f21d6200640 1 -- 172.21.15.8:0/4119505737 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21b40095e0 msgr2=0x7f21d01ed400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.681+0000 7f21d6200640 1 --2- 172.21.15.8:0/4119505737 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21b40095e0 0x7f21d01ed400 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00c730 tx=0x7f21bc00cbf0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.681+0000 7f21d6200640 1 -- 172.21.15.8:0/4119505737 shutdown_connections 2024-03-23T23:42:58.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.681+0000 7f21d6200640 1 --2- 172.21.15.8:0/4119505737 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f21b0067690 0x7f21b0069b50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.681+0000 7f21d6200640 1 --2- 172.21.15.8:0/4119505737 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f21d013e8f0 0x7f21d00ac150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.681+0000 7f21d6200640 1 --2- 172.21.15.8:0/4119505737 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21d01ed940 0x7f21d013e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.681+0000 7f21d6200640 1 --2- 172.21.15.8:0/4119505737 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21b40095e0 0x7f21d01ed400 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.681+0000 7f21d6200640 1 -- 172.21.15.8:0/4119505737 >> 172.21.15.8:0/4119505737 conn(0x7f21d00a9870 msgr2=0x7f21d006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:58.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.681+0000 7f21d6200640 1 -- 172.21.15.8:0/4119505737 shutdown_connections 2024-03-23T23:42:58.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.681+0000 7f21d6200640 1 -- 172.21.15.8:0/4119505737 wait complete. 2024-03-23T23:42:58.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.681+0000 7ff6b5000640 1 -- 172.21.15.8:0/3632974465 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff68c067730 msgr2=0x7ff68c069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.681+0000 7ff6b5000640 1 --2- 172.21.15.8:0/3632974465 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff68c067730 0x7ff68c069bf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff6a001ce80 tx=0x7ff6a000b040 comp rx=0 tx=0).stop 2024-03-23T23:42:58.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.681+0000 7ff6b5000640 1 -- 172.21.15.8:0/3632974465 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff6b014c8f0 msgr2=0x7ff6b014d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.681+0000 7ff6b5000640 1 --2- 172.21.15.8:0/3632974465 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff6b014c8f0 0x7ff6b014d9f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff6b006dc20 tx=0x7ff6a8001ba0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.681+0000 7ff6b5000640 1 -- 172.21.15.8:0/3632974465 shutdown_connections 2024-03-23T23:42:58.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.681+0000 7ff6b5000640 1 --2- 172.21.15.8:0/3632974465 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff6b014c8f0 0x7ff6b014d9f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.681+0000 7ff6b5000640 1 --2- 172.21.15.8:0/3632974465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6b00c5f80 0x7ff6b014c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.681+0000 7ff6b5000640 1 --2- 172.21.15.8:0/3632974465 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff68c067730 0x7ff68c069bf0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.681+0000 7ff6b5000640 1 --2- 172.21.15.8:0/3632974465 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff694004c00 0x7ff6b01ee6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.681+0000 7ff6b5000640 1 -- 172.21.15.8:0/3632974465 >> 172.21.15.8:0/3632974465 conn(0x7ff6b006c280 msgr2=0x7ff6b006fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:58.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.681+0000 7ff6b5000640 1 -- 172.21.15.8:0/3632974465 shutdown_connections 2024-03-23T23:42:58.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.681+0000 7ff6b5000640 1 -- 172.21.15.8:0/3632974465 wait complete. 2024-03-23T23:42:58.691 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509448 for osd.3 2024-03-23T23:42:58.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.709+0000 7fa47ba00640 1 -- 172.21.15.8:0/4088148894 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa4740c1b10 con 0x7fa4741574f0 2024-03-23T23:42:58.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.709+0000 7fa470c00640 1 -- 172.21.15.8:0/4088148894 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa46c0f1c80 con 0x7fa4741574f0 2024-03-23T23:42:58.712 INFO:teuthology.orchestra.run.smithi008.stdout:64424509448 2024-03-23T23:42:58.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.713+0000 7fa47ba00640 1 -- 172.21.15.8:0/4088148894 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa4580676b0 msgr2=0x7fa458069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.713+0000 7fa47ba00640 1 --2- 172.21.15.8:0/4088148894 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa4580676b0 0x7fa458069b70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa464007d60 tx=0x7fa464007cb0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.713+0000 7fa47ba00640 1 -- 172.21.15.8:0/4088148894 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4741574f0 msgr2=0x7fa474150c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.713+0000 7fa47ba00640 1 --2- 172.21.15.8:0/4088148894 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4741574f0 0x7fa474150c40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0ac000 tx=0x7fa46c019900 comp rx=0 tx=0).stop 2024-03-23T23:42:58.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.713+0000 7fa47ba00640 1 -- 172.21.15.8:0/4088148894 shutdown_connections 2024-03-23T23:42:58.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.713+0000 7fa47ba00640 1 --2- 172.21.15.8:0/4088148894 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4741574f0 0x7fa474150c40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.713+0000 7fa47ba00640 1 --2- 172.21.15.8:0/4088148894 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa4580676b0 0x7fa458069b70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.713+0000 7fa47ba00640 1 --2- 172.21.15.8:0/4088148894 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa4740a87d0 0x7fa474150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.713+0000 7fa47ba00640 1 --2- 172.21.15.8:0/4088148894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4740a8260 0x7fa4740c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.713+0000 7fa47ba00640 1 -- 172.21.15.8:0/4088148894 >> 172.21.15.8:0/4088148894 conn(0x7fa4740c7430 msgr2=0x7fa47415c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:58.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.713+0000 7fa47ba00640 1 -- 172.21.15.8:0/4088148894 shutdown_connections 2024-03-23T23:42:58.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.713+0000 7fa47ba00640 1 -- 172.21.15.8:0/4088148894 wait complete. 2024-03-23T23:42:58.717 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509447 for osd.4 2024-03-23T23:42:58.718 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509448 for osd.6 2024-03-23T23:42:58.743 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509448 for osd.5 2024-03-23T23:42:58.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.753+0000 7f705ac00640 1 -- 172.21.15.8:0/1813209476 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f70540c1050 con 0x7f7054071490 2024-03-23T23:42:58.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.753+0000 7f7051600640 1 -- 172.21.15.8:0/1813209476 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f703c055d50 con 0x7f7054071490 2024-03-23T23:42:58.756 INFO:teuthology.orchestra.run.smithi008.stdout:60129542151 2024-03-23T23:42:58.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.757+0000 7f705ac00640 1 -- 172.21.15.8:0/1813209476 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7030067660 msgr2=0x7f7030069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.757+0000 7f705ac00640 1 --2- 172.21.15.8:0/1813209476 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7030067660 0x7f7030069b20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f70440af000 tx=0x7f7044004ac0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.757+0000 7f705ac00640 1 -- 172.21.15.8:0/1813209476 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7054071490 msgr2=0x7f70541f21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:58.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.757+0000 7f705ac00640 1 --2- 172.21.15.8:0/1813209476 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7054071490 0x7f70541f21d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f703c00e820 tx=0x7f703c00ece0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.757+0000 7f705ac00640 1 -- 172.21.15.8:0/1813209476 shutdown_connections 2024-03-23T23:42:58.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.757+0000 7f705ac00640 1 --2- 172.21.15.8:0/1813209476 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7054155c80 0x7f705406d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.757+0000 7f705ac00640 1 --2- 172.21.15.8:0/1813209476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70540c0490 0x7f70541f2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.757+0000 7f705ac00640 1 --2- 172.21.15.8:0/1813209476 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7030067660 0x7f7030069b20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.757+0000 7f705ac00640 1 --2- 172.21.15.8:0/1813209476 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7054071490 0x7f70541f21d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:58.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.757+0000 7f705ac00640 1 -- 172.21.15.8:0/1813209476 >> 172.21.15.8:0/1813209476 conn(0x7f70540c3b60 msgr2=0x7f70540c6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:58.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.757+0000 7f705ac00640 1 -- 172.21.15.8:0/1813209476 shutdown_connections 2024-03-23T23:42:58.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:58.757+0000 7f705ac00640 1 -- 172.21.15.8:0/1813209476 wait complete. 2024-03-23T23:42:58.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542151 for osd.7 2024-03-23T23:42:59.625 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-23T23:42:59.650 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-23T23:42:59.659 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-23T23:42:59.693 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-23T23:42:59.718 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-23T23:42:59.719 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-23T23:42:59.743 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-23T23:42:59.779 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-23T23:42:59.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.817+0000 7ff92b200640 1 Processor -- start 2024-03-23T23:42:59.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.817+0000 7ff92b200640 1 -- start start 2024-03-23T23:42:59.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.817+0000 7ff92b200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff924152ce0 0x7ff92406f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:59.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.817+0000 7ff92b200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff9241596e0 0x7ff9240c3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:59.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.817+0000 7ff92b200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9240c4420 0x7ff924071a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:59.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.817+0000 7ff92b200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff924155840 con 0x7ff924152ce0 2024-03-23T23:42:59.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.817+0000 7ff92b200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff924155ab0 con 0x7ff9241596e0 2024-03-23T23:42:59.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.817+0000 7ff92b200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff924155d90 con 0x7ff9240c4420 2024-03-23T23:42:59.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.817+0000 7ff923400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff9241596e0 0x7ff9240c3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:59.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.817+0000 7ff923400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff9241596e0 0x7ff9240c3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:46122/0 (socket says 172.21.15.8:46122) 2024-03-23T23:42:59.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.817+0000 7ff923400640 1 -- 172.21.15.8:0/993719186 learned_addr learned my addr 172.21.15.8:0/993719186 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:59.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.817+0000 7ff929200640 1 --2- 172.21.15.8:0/993719186 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9240c4420 0x7ff924071a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:59.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.821+0000 7ff923e00640 1 --2- 172.21.15.8:0/993719186 >> v2:172.21.15.8:3300/0 conn(0x7ff924152ce0 0x7ff92406f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:59.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.821+0000 7ff923400640 1 -- 172.21.15.8:0/993719186 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9240c4420 msgr2=0x7ff924071a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:59.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.821+0000 7ff923400640 1 --2- 172.21.15.8:0/993719186 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9240c4420 0x7ff924071a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:59.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.821+0000 7ff923400640 1 -- 172.21.15.8:0/993719186 >> v2:172.21.15.8:3300/0 conn(0x7ff924152ce0 msgr2=0x7ff92406f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:59.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.821+0000 7ff923400640 1 --2- 172.21.15.8:0/993719186 >> v2:172.21.15.8:3300/0 conn(0x7ff924152ce0 0x7ff92406f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:59.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.821+0000 7ff923400640 1 -- 172.21.15.8:0/993719186 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff924156070 con 0x7ff9241596e0 2024-03-23T23:42:59.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.821+0000 7ff929200640 1 --2- 172.21.15.8:0/993719186 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9240c4420 0x7ff924071a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:42:59.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.825+0000 7ff923400640 1 --2- 172.21.15.8:0/993719186 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9241596e0 0x7ff9240c3ee0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff9240c6ec0 tx=0x7ff91001c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b85bc2963f1c0d4d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:59.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.825+0000 7ff922a00640 1 -- 172.21.15.8:0/993719186 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9100aa660 con 0x7ff9241596e0 2024-03-23T23:42:59.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.825+0000 7ff922a00640 1 -- 172.21.15.8:0/993719186 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9100af070 con 0x7ff9241596e0 2024-03-23T23:42:59.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.825+0000 7ff922a00640 1 -- 172.21.15.8:0/993719186 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9100aaa20 con 0x7ff9241596e0 2024-03-23T23:42:59.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.825+0000 7ff92b200640 1 -- 172.21.15.8:0/993719186 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9241596e0 msgr2=0x7ff9240c3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:59.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.829+0000 7ff92b200640 1 --2- 172.21.15.8:0/993719186 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9241596e0 0x7ff9240c3ee0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff9240c6ec0 tx=0x7ff91001c520 comp rx=0 tx=0).stop 2024-03-23T23:42:59.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.829+0000 7ff92b200640 1 -- 172.21.15.8:0/993719186 shutdown_connections 2024-03-23T23:42:59.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.829+0000 7ff92b200640 1 --2- 172.21.15.8:0/993719186 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9240c4420 0x7ff924071a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:59.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.829+0000 7ff92b200640 1 --2- 172.21.15.8:0/993719186 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9241596e0 0x7ff9240c3ee0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:59.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.829+0000 7ff92b200640 1 --2- 172.21.15.8:0/993719186 >> v2:172.21.15.8:3300/0 conn(0x7ff924152ce0 0x7ff92406f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:59.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.829+0000 7ff92b200640 1 -- 172.21.15.8:0/993719186 >> 172.21.15.8:0/993719186 conn(0x7ff92406b170 msgr2=0x7ff92406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:59.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.829+0000 7ff92b200640 1 -- 172.21.15.8:0/993719186 shutdown_connections 2024-03-23T23:42:59.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.829+0000 7ff92b200640 1 -- 172.21.15.8:0/993719186 wait complete. 2024-03-23T23:42:59.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.829+0000 7ff92b200640 1 Processor -- start 2024-03-23T23:42:59.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.829+0000 7ff92b200640 1 -- start start 2024-03-23T23:42:59.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.833+0000 7ff92b200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9240c4420 0x7ff924154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:59.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.833+0000 7ff92b200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff924152ce0 0x7ff92413e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:59.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.833+0000 7ff92b200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9241596e0 0x7ff92413ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:59.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.833+0000 7ff92b200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff924156590 con 0x7ff9241596e0 2024-03-23T23:42:59.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.833+0000 7ff92b200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92406e660 con 0x7ff924152ce0 2024-03-23T23:42:59.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.833+0000 7ff923400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff924152ce0 0x7ff92413e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:59.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.833+0000 7ff923e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9240c4420 0x7ff924154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:59.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.833+0000 7ff92b200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9241568f0 con 0x7ff9240c4420 2024-03-23T23:42:59.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.833+0000 7ff929200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9241596e0 0x7ff92413ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:59.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.833+0000 7ff929200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9241596e0 0x7ff92413ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42220/0 (socket says 172.21.15.8:42220) 2024-03-23T23:42:59.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.833+0000 7ff929200640 1 -- 172.21.15.8:0/804954876 learned_addr learned my addr 172.21.15.8:0/804954876 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:59.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.837+0000 7ff929200640 1 -- 172.21.15.8:0/804954876 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9240c4420 msgr2=0x7ff924154c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:59.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.837+0000 7ff929200640 1 --2- 172.21.15.8:0/804954876 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9240c4420 0x7ff924154c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:59.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.837+0000 7ff929200640 1 -- 172.21.15.8:0/804954876 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff924152ce0 msgr2=0x7ff92413e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:59.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.837+0000 7ff929200640 1 --2- 172.21.15.8:0/804954876 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff924152ce0 0x7ff92413e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:59.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.837+0000 7ff929200640 1 -- 172.21.15.8:0/804954876 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92414cae0 con 0x7ff9241596e0 2024-03-23T23:42:59.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.837+0000 7ff929200640 1 --2- 172.21.15.8:0/804954876 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9241596e0 0x7ff92413ed50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff91400e890 tx=0x7ff91400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:59.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.837+0000 7ff91be00640 1 -- 172.21.15.8:0/804954876 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff914017070 con 0x7ff9241596e0 2024-03-23T23:42:59.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.837+0000 7ff91be00640 1 -- 172.21.15.8:0/804954876 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff914004020 con 0x7ff9241596e0 2024-03-23T23:42:59.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.837+0000 7ff91be00640 1 -- 172.21.15.8:0/804954876 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9140043f0 con 0x7ff9241596e0 2024-03-23T23:42:59.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.837+0000 7ff92b200640 1 -- 172.21.15.8:0/804954876 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff924158600 con 0x7ff9241596e0 2024-03-23T23:42:59.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.837+0000 7ff92b200640 1 -- 172.21.15.8:0/804954876 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9241ef180 con 0x7ff9241596e0 2024-03-23T23:42:59.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.845+0000 7ff92b200640 1 -- 172.21.15.8:0/804954876 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff92404f410 con 0x7ff9241596e0 2024-03-23T23:42:59.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.845+0000 7ff91be00640 1 -- 172.21.15.8:0/804954876 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff91400c940 con 0x7ff9241596e0 2024-03-23T23:42:59.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.849+0000 7ff91be00640 1 --2- 172.21.15.8:0/804954876 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff904067730 0x7ff904069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:59.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.849+0000 7ff91be00640 1 -- 172.21.15.8:0/804954876 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7ff914085d00 con 0x7ff9241596e0 2024-03-23T23:42:59.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.849+0000 7ff923e00640 1 --2- 172.21.15.8:0/804954876 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff904067730 0x7ff904069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:59.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.849+0000 7ff923e00640 1 --2- 172.21.15.8:0/804954876 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff904067730 0x7ff904069bf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff92415efb0 tx=0x7ff91c00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:59.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.857+0000 7ff91be00640 1 -- 172.21.15.8:0/804954876 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7ff914056630 con 0x7ff9241596e0 2024-03-23T23:42:59.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.897+0000 7f3d10a00640 1 Processor -- start 2024-03-23T23:42:59.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.897+0000 7f3d10a00640 1 -- start start 2024-03-23T23:42:59.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.897+0000 7f3d10a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3d0c0a9c80 0x7f3d0c0c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:59.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.897+0000 7f3d10a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d0c14f280 0x7f3d0c06e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:59.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.901+0000 7f3d10a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d0c0c21f0 con 0x7f3d0c06e340 2024-03-23T23:42:59.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.901+0000 7f3d0a800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d0c14f280 0x7f3d0c06e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:59.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.901+0000 7f3d0a800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d0c14f280 0x7f3d0c06e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:49682/0 (socket says 172.21.15.8:49682) 2024-03-23T23:42:59.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.901+0000 7f3d0a800640 1 -- 172.21.15.8:0/940645609 learned_addr learned my addr 172.21.15.8:0/940645609 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:59.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.901+0000 7f3d10a00640 1 -- 172.21.15.8:0/940645609 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d0c06ecf0 con 0x7f3d0c0a9c80 2024-03-23T23:42:59.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.901+0000 7f3d10a00640 1 -- 172.21.15.8:0/940645609 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c071e40 con 0x7f3d0c14f280 2024-03-23T23:42:59.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.905+0000 7f3d09e00640 1 --2- 172.21.15.8:0/940645609 >> v2:172.21.15.196:3300/0 conn(0x7f3d0c0a9c80 0x7f3d0c0c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:59.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.905+0000 7f3d0a800640 1 -- 172.21.15.8:0/940645609 >> v2:172.21.15.196:3300/0 conn(0x7f3d0c0a9c80 msgr2=0x7f3d0c0c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:59.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.905+0000 7f3d0a800640 1 --2- 172.21.15.8:0/940645609 >> v2:172.21.15.196:3300/0 conn(0x7f3d0c0a9c80 0x7f3d0c0c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:59.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.905+0000 7f3d0a800640 1 -- 172.21.15.8:0/940645609 >> v1:172.21.15.8:6789/0 conn(0x7f3d0c06e340 legacy=0x7f3d0c14eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:59.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.905+0000 7f3d0a800640 1 -- 172.21.15.8:0/940645609 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0c072120 con 0x7f3d0c14f280 2024-03-23T23:42:59.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.913+0000 7f3d0a800640 1 --2- 172.21.15.8:0/940645609 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d0c14f280 0x7f3d0c06e7b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8009870 tx=0x7f3cf801c2b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15b31e336e3b6d4c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:59.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.913+0000 7f3d08a00640 1 -- 172.21.15.8:0/940645609 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf80b0070 con 0x7f3d0c14f280 2024-03-23T23:42:59.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.913+0000 7f3d08a00640 1 -- 172.21.15.8:0/940645609 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf80ab600 con 0x7f3d0c14f280 2024-03-23T23:42:59.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.913+0000 7f3d08a00640 1 -- 172.21.15.8:0/940645609 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf80ab9d0 con 0x7f3d0c14f280 2024-03-23T23:42:59.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.913+0000 7f3d10a00640 1 -- 172.21.15.8:0/940645609 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d0c14f280 msgr2=0x7f3d0c06e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:59.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.913+0000 7f3d10a00640 1 --2- 172.21.15.8:0/940645609 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d0c14f280 0x7f3d0c06e7b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8009870 tx=0x7f3cf801c2b0 comp rx=0 tx=0).stop 2024-03-23T23:42:59.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.913+0000 7f3d10a00640 1 -- 172.21.15.8:0/940645609 shutdown_connections 2024-03-23T23:42:59.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.913+0000 7f3d10a00640 1 --2- 172.21.15.8:0/940645609 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d0c14f280 0x7f3d0c06e7b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:59.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.913+0000 7f3d10a00640 1 --2- 172.21.15.8:0/940645609 >> v2:172.21.15.196:3300/0 conn(0x7f3d0c0a9c80 0x7f3d0c0c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:59.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.913+0000 7f3d10a00640 1 -- 172.21.15.8:0/940645609 >> 172.21.15.8:0/940645609 conn(0x7f3d0c0a9870 msgr2=0x7f3d0c06b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:59.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.913+0000 7f3d10a00640 1 -- 172.21.15.8:0/940645609 shutdown_connections 2024-03-23T23:42:59.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.913+0000 7f3d10a00640 1 -- 172.21.15.8:0/940645609 wait complete. 2024-03-23T23:42:59.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.917+0000 7f3d10a00640 1 Processor -- start 2024-03-23T23:42:59.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.917+0000 7f3d10a00640 1 -- start start 2024-03-23T23:42:59.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.921+0000 7ff279a00640 1 Processor -- start 2024-03-23T23:42:59.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.921+0000 7f3d10a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d0c06e340 0x7f3d0c14bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:59.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.921+0000 7f3d10a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d0c0a9c80 0x7f3d0c140e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:59.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.921+0000 7ff279a00640 1 -- start start 2024-03-23T23:42:59.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.921+0000 7f3d10a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d0c14f280 0x7f3d0c146840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:59.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.921+0000 7f3d10a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c152480 con 0x7f3d0c06e340 2024-03-23T23:42:59.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.921+0000 7f3d0a800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d0c14f280 0x7f3d0c146840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:59.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.921+0000 7f3d0a800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d0c14f280 0x7f3d0c146840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:49692/0 (socket says 172.21.15.8:49692) 2024-03-23T23:42:59.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.921+0000 7f3d0a800640 1 -- 172.21.15.8:0/3563406276 learned_addr learned my addr 172.21.15.8:0/3563406276 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:59.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.921+0000 7f3d09400640 1 --2- 172.21.15.8:0/3563406276 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d0c0a9c80 0x7f3d0c140e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:59.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.921+0000 7f3d10a00640 1 -- 172.21.15.8:0/3563406276 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c152300 con 0x7f3d0c0a9c80 2024-03-23T23:42:59.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.921+0000 7f3d10a00640 1 -- 172.21.15.8:0/3563406276 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c152600 con 0x7f3d0c14f280 2024-03-23T23:42:59.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.921+0000 7f3d09e00640 1 --2- 172.21.15.8:0/3563406276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d0c06e340 0x7f3d0c14bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:59.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.921+0000 7ff279a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff26c0db900 0x7ff26c0dbd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:59.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.921+0000 7ff279a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff26c00bb30 con 0x7ff26c0d7b90 2024-03-23T23:42:59.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.921+0000 7ff279a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff26c007440 con 0x7ff26c0e2d80 2024-03-23T23:42:59.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.921+0000 7ff273400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7ff26c0e2d80 0x7ff26c0e5170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:46290/0 (socket says 172.21.15.8:46290) 2024-03-23T23:42:59.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.921+0000 7ff273400640 1 -- 172.21.15.8:0/236975960 learned_addr learned my addr 172.21.15.8:0/236975960 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:59.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.921+0000 7ff272000640 1 --2- 172.21.15.8:0/236975960 >> v2:172.21.15.196:3300/0 conn(0x7ff26c0db900 0x7ff26c0dbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:59.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.921+0000 7ff279a00640 1 -- 172.21.15.8:0/236975960 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff26c007160 con 0x7ff26c0db900 2024-03-23T23:42:59.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.921+0000 7f3d0a800640 1 -- 172.21.15.8:0/3563406276 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d0c0a9c80 msgr2=0x7f3d0c140e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:59.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.921+0000 7f3d0a800640 1 --2- 172.21.15.8:0/3563406276 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d0c0a9c80 0x7f3d0c140e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:59.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.921+0000 7f3d0a800640 1 -- 172.21.15.8:0/3563406276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d0c06e340 msgr2=0x7f3d0c14bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:59.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.921+0000 7f3d0a800640 1 --2- 172.21.15.8:0/3563406276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d0c06e340 0x7f3d0c14bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:59.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.921+0000 7f3d0a800640 1 -- 172.21.15.8:0/3563406276 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0c148b30 con 0x7f3d0c14f280 2024-03-23T23:42:59.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.925+0000 7ff271600640 1 -- 172.21.15.8:0/236975960 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2173602950 0 0) 0x7ff26c007440 con 0x7ff26c0e2d80 2024-03-23T23:42:59.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.925+0000 7ff271600640 1 -- 172.21.15.8:0/236975960 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff258003530 con 0x7ff26c0e2d80 2024-03-23T23:42:59.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.925+0000 7ff272000640 1 -- 172.21.15.8:0/236975960 >> v1:172.21.15.196:6789/0 conn(0x7ff26c0e2d80 legacy=0x7ff26c0e5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:59.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.925+0000 7ff271600640 1 -- 172.21.15.8:0/236975960 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3279500631 0 0) 0x7ff258003530 con 0x7ff26c0e2d80 2024-03-23T23:42:59.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.925+0000 7f3d0a800640 1 --2- 172.21.15.8:0/3563406276 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d0c14f280 0x7f3d0c146840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8019ee0 tx=0x7f3cf8019050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:59.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.925+0000 7ff272000640 1 -- 172.21.15.8:0/236975960 >> v1:172.21.15.8:6789/0 conn(0x7ff26c0d7b90 legacy=0x7ff26c046190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:59.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.925+0000 7f3d02000640 1 -- 172.21.15.8:0/3563406276 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf80ba070 con 0x7f3d0c14f280 2024-03-23T23:42:59.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.925+0000 7f3d02000640 1 -- 172.21.15.8:0/3563406276 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf80b1040 con 0x7f3d0c14f280 2024-03-23T23:42:59.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.925+0000 7f3d02000640 1 -- 172.21.15.8:0/3563406276 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf80b0050 con 0x7f3d0c14f280 2024-03-23T23:42:59.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.925+0000 7f3d10a00640 1 -- 172.21.15.8:0/3563406276 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d0c146080 con 0x7f3d0c14f280 2024-03-23T23:42:59.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.925+0000 7f3d10a00640 1 -- 172.21.15.8:0/3563406276 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d0c14bff0 con 0x7f3d0c14f280 2024-03-23T23:42:59.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.925+0000 7ff272000640 1 -- 172.21.15.8:0/236975960 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26c0da520 con 0x7ff26c0db900 2024-03-23T23:42:59.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.933+0000 7f3d02000640 1 -- 172.21.15.8:0/3563406276 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3cf80ab4c0 con 0x7f3d0c14f280 2024-03-23T23:42:59.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.933+0000 7f3d10a00640 1 -- 172.21.15.8:0/3563406276 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce40052a0 con 0x7f3d0c14f280 2024-03-23T23:42:59.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.933+0000 7f3d02000640 1 --2- 172.21.15.8:0/3563406276 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3cec067730 0x7f3cec069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:59.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.933+0000 7f3d02000640 1 -- 172.21.15.8:0/3563406276 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f3cf811f160 con 0x7f3d0c14f280 2024-03-23T23:42:59.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.933+0000 7f3d09e00640 1 --2- 172.21.15.8:0/3563406276 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3cec067730 0x7f3cec069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:59.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.937+0000 7ff272000640 1 --2- 172.21.15.8:0/236975960 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff26c0db900 0x7ff26c0dbd60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff2740695d0 tx=0x7ff2740981d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6b52feac7e887a8 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:59.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.937+0000 7f3d09e00640 1 --2- 172.21.15.8:0/3563406276 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3cec067730 0x7f3cec069bf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c14e400 tx=0x7f3d0400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:59.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.937+0000 7ff271600640 1 -- 172.21.15.8:0/236975960 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27412c070 con 0x7ff26c0db900 2024-03-23T23:42:59.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.937+0000 7ff271600640 1 -- 172.21.15.8:0/236975960 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff274127400 con 0x7ff26c0db900 2024-03-23T23:42:59.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.937+0000 7ff271600640 1 -- 172.21.15.8:0/236975960 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff260001680 con 0x7ff26c0db900 2024-03-23T23:42:59.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.937+0000 7ff279a00640 1 -- 172.21.15.8:0/236975960 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff26c0db900 msgr2=0x7ff26c0dbd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:59.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.937+0000 7ff279a00640 1 --2- 172.21.15.8:0/236975960 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff26c0db900 0x7ff26c0dbd60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff2740695d0 tx=0x7ff2740981d0 comp rx=0 tx=0).stop 2024-03-23T23:42:59.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.937+0000 7ff279a00640 1 -- 172.21.15.8:0/236975960 shutdown_connections 2024-03-23T23:42:59.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.937+0000 7ff279a00640 1 --2- 172.21.15.8:0/236975960 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff26c0db900 0x7ff26c0dbd60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:59.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.937+0000 7ff279a00640 1 -- 172.21.15.8:0/236975960 >> 172.21.15.8:0/236975960 conn(0x7ff26c005f20 msgr2=0x7ff26c006330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:42:59.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.937+0000 7ff279a00640 1 -- 172.21.15.8:0/236975960 shutdown_connections 2024-03-23T23:42:59.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.937+0000 7ff279a00640 1 -- 172.21.15.8:0/236975960 wait complete. 2024-03-23T23:42:59.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.941+0000 7ff279a00640 1 Processor -- start 2024-03-23T23:42:59.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.941+0000 7ff279a00640 1 -- start start 2024-03-23T23:42:59.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.941+0000 7ff279a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff26c0d7b90 0x7ff26c0d6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:59.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.945+0000 7ff279a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff26c0db900 0x7ff26c0d9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:59.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.945+0000 7ff279a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff26c0e2d80 0x7ff26c0cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:59.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.945+0000 7ff279a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c006c60 con 0x7ff26c0d7b90 2024-03-23T23:42:59.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.945+0000 7ff279a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c0dc2a0 con 0x7ff26c0db900 2024-03-23T23:42:59.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.945+0000 7ff279a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c045b20 con 0x7ff26c0e2d80 2024-03-23T23:42:59.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.945+0000 7ff273400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff26c0e2d80 0x7ff26c0cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:59.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.945+0000 7f3d02000640 1 -- 172.21.15.8:0/3563406276 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f3d0c0c21f0 con 0x7f3d0c14f280 2024-03-23T23:42:59.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.945+0000 7ff273400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff26c0e2d80 0x7ff26c0cdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:49698/0 (socket says 172.21.15.8:49698) 2024-03-23T23:42:59.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.945+0000 7ff273400640 1 -- 172.21.15.8:0/2259634016 learned_addr learned my addr 172.21.15.8:0/2259634016 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:42:59.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.945+0000 7ff272a00640 1 --2- 172.21.15.8:0/2259634016 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff26c0d7b90 0x7ff26c0d6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:59.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.945+0000 7ff273400640 1 -- 172.21.15.8:0/2259634016 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff26c0db900 msgr2=0x7ff26c0d9bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:42:59.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.945+0000 7ff273400640 1 --2- 172.21.15.8:0/2259634016 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff26c0db900 0x7ff26c0d9bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:59.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.945+0000 7ff273400640 1 -- 172.21.15.8:0/2259634016 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff26c0d7b90 msgr2=0x7ff26c0d6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:59.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.945+0000 7ff273400640 1 --2- 172.21.15.8:0/2259634016 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff26c0d7b90 0x7ff26c0d6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:59.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.945+0000 7ff273400640 1 -- 172.21.15.8:0/2259634016 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26c0d6d30 con 0x7ff26c0e2d80 2024-03-23T23:42:59.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.945+0000 7ff272a00640 1 --2- 172.21.15.8:0/2259634016 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff26c0d7b90 0x7ff26c0d6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:42:59.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.945+0000 7ff273400640 1 --2- 172.21.15.8:0/2259634016 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff26c0e2d80 0x7ff26c0cdb40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff26000c4b0 tx=0x7ff26000c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:59.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.945+0000 7ff26aa00640 1 -- 172.21.15.8:0/2259634016 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff260018070 con 0x7ff26c0e2d80 2024-03-23T23:42:59.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.945+0000 7ff26aa00640 1 -- 172.21.15.8:0/2259634016 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2600074e0 con 0x7ff26c0e2d80 2024-03-23T23:42:59.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.945+0000 7ff26aa00640 1 -- 172.21.15.8:0/2259634016 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff260004a10 con 0x7ff26c0e2d80 2024-03-23T23:42:59.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.945+0000 7ff279a00640 1 -- 172.21.15.8:0/2259634016 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff26c0d6a80 con 0x7ff26c0e2d80 2024-03-23T23:42:59.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.945+0000 7ff279a00640 1 -- 172.21.15.8:0/2259634016 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff26c0cebd0 con 0x7ff26c0e2d80 2024-03-23T23:42:59.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.953+0000 7ff279a00640 1 -- 172.21.15.8:0/2259634016 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff26c0ce9c0 con 0x7ff26c0e2d80 2024-03-23T23:42:59.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.957+0000 7ff26aa00640 1 -- 172.21.15.8:0/2259634016 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff26001b070 con 0x7ff26c0e2d80 2024-03-23T23:42:59.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.957+0000 7ff26aa00640 1 --2- 172.21.15.8:0/2259634016 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff254067730 0x7ff254069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:59.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.957+0000 7ff26aa00640 1 -- 172.21.15.8:0/2259634016 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7ff260084ff0 con 0x7ff26c0e2d80 2024-03-23T23:42:59.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.957+0000 7ff272a00640 1 --2- 172.21.15.8:0/2259634016 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff254067730 0x7ff254069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:59.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.965+0000 7ff272a00640 1 --2- 172.21.15.8:0/2259634016 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff254067730 0x7ff254069bf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff264000f70 tx=0x7ff264009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:59.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.965+0000 7ff26aa00640 1 -- 172.21.15.8:0/2259634016 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7ff2600559b0 con 0x7ff26c0e2d80 2024-03-23T23:42:59.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.981+0000 7f2686c00640 1 Processor -- start 2024-03-23T23:42:59.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.981+0000 7f2686c00640 1 -- start start 2024-03-23T23:42:59.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.981+0000 7fcf0ca00640 1 Processor -- start 2024-03-23T23:42:59.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.981+0000 7fcf0ca00640 1 -- start start 2024-03-23T23:42:59.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.985+0000 7f2686c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26800c4430 0x7f268014eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:59.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.985+0000 7f2686c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2680072b30 0x7f26800c2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:59.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.985+0000 7f2686c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f268006cfa0 con 0x7f26800c2d60 2024-03-23T23:42:59.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.985+0000 7f2686c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26800c3760 con 0x7f2680072b30 2024-03-23T23:42:59.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.985+0000 7f2686c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2680151710 con 0x7f26800c4430 2024-03-23T23:42:59.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.985+0000 7f2686200640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f26800c2d60 0x7f2680151ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:46304/0 (socket says 172.21.15.8:46304) 2024-03-23T23:42:59.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.985+0000 7f2686200640 1 -- 172.21.15.8:0/328407517 learned_addr learned my addr 172.21.15.8:0/328407517 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:59.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.985+0000 7f2685800640 1 --2- 172.21.15.8:0/328407517 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26800c4430 0x7f268014eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:59.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.985+0000 7fcf0ca00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fcf0814f280 0x7fcf0806e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:59.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.985+0000 7f2684e00640 1 --2- 172.21.15.8:0/328407517 >> v2:172.21.15.196:3300/0 conn(0x7f2680072b30 0x7f26800c2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:59.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.985+0000 7f267fe00640 1 -- 172.21.15.8:0/328407517 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 808781962 0 0) 0x7f268006cfa0 con 0x7f26800c2d60 2024-03-23T23:42:59.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.985+0000 7f267fe00640 1 -- 172.21.15.8:0/328407517 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2668003530 con 0x7f26800c2d60 2024-03-23T23:42:59.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.985+0000 7fcf0ca00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf08071e40 con 0x7fcf080a9c80 2024-03-23T23:42:59.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.985+0000 7fcf0ca00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf08072120 con 0x7fcf0806e340 2024-03-23T23:42:59.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.985+0000 7fcf0ca00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf0806ecf0 con 0x7fcf0814f280 2024-03-23T23:42:59.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.985+0000 7f2685800640 1 -- 172.21.15.8:0/328407517 >> v2:172.21.15.196:3300/0 conn(0x7f2680072b30 msgr2=0x7f26800c2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:42:59.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.985+0000 7f2685800640 1 --2- 172.21.15.8:0/328407517 >> v2:172.21.15.196:3300/0 conn(0x7f2680072b30 0x7f26800c2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:42:59.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.985+0000 7f2685800640 1 -- 172.21.15.8:0/328407517 >> v1:172.21.15.196:6789/0 conn(0x7f26800c2d60 legacy=0x7f2680151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:59.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.985+0000 7f2685800640 1 -- 172.21.15.8:0/328407517 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f268006d280 con 0x7f26800c4430 2024-03-23T23:42:59.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.985+0000 7fcf05e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fcf080a9c80 0x7fcf080c1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:45046/0 (socket says 172.21.15.8:45046) 2024-03-23T23:42:59.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.985+0000 7fcf05e00640 1 -- 172.21.15.8:0/4259146641 learned_addr learned my addr 172.21.15.8:0/4259146641 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:42:59.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.985+0000 7fcf06800640 1 --2- 172.21.15.8:0/4259146641 >> v2:172.21.15.196:3300/0 conn(0x7fcf0814f280 0x7fcf0806e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:59.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.989+0000 7fcf06800640 1 -- 172.21.15.8:0/4259146641 >> v1:172.21.15.196:6789/0 conn(0x7fcf0806e340 legacy=0x7fcf0814eb70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-23T23:42:59.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.989+0000 7fcf06800640 1 -- 172.21.15.8:0/4259146641 >> v1:172.21.15.8:6789/0 conn(0x7fcf080a9c80 legacy=0x7fcf080c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:59.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.989+0000 7fcf06800640 1 -- 172.21.15.8:0/4259146641 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf08159200 con 0x7fcf0814f280 2024-03-23T23:42:59.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.989+0000 7f2685800640 1 --2- 172.21.15.8:0/328407517 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26800c4430 0x7f268014eb80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f266c0097c0 tx=0x7f266c01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf2e91f33828ee3f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:59.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.993+0000 7f267fe00640 1 -- 172.21.15.8:0/328407517 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c0b5070 con 0x7f26800c4430 2024-03-23T23:42:59.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.993+0000 7f267fe00640 1 -- 172.21.15.8:0/328407517 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266c0a8990 con 0x7f26800c4430 2024-03-23T23:42:59.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.993+0000 7f267fe00640 1 -- 172.21.15.8:0/328407517 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c0b5070 con 0x7f26800c4430 2024-03-23T23:42:59.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.993+0000 7fcf06800640 1 --2- 172.21.15.8:0/4259146641 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf0814f280 0x7fcf0806e7b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcef00097c0 tx=0x7fcef001c260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=245ce8760dd03cb5 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:42:59.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.993+0000 7fcf04a00640 1 -- 172.21.15.8:0/4259146641 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef00b0070 con 0x7fcf0814f280 2024-03-23T23:42:59.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.993+0000 7f2686c00640 1 -- 172.21.15.8:0/328407517 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26800c4430 msgr2=0x7f268014eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:42:59.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.993+0000 7f2686c00640 1 --2- 172.21.15.8:0/328407517 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26800c4430 0x7f268014eb80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f266c0097c0 tx=0x7f266c01ec90 comp rx=0 tx=0).stop 2024-03-23T23:42:59.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.993+0000 7f37f9200640 1 Processor -- start 2024-03-23T23:42:59.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.993+0000 7f37f9200640 1 -- start start 2024-03-23T23:42:59.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.993+0000 7f37f9200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f37f4157180 0x7f37f415a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:59.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.993+0000 7f37f9200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37f4071040 0x7f37f4164380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:42:59.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.993+0000 7f37f9200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37f4159b90 con 0x7f37f4070be0 2024-03-23T23:42:59.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.993+0000 7f37f9200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37f4157560 con 0x7f37f4157180 2024-03-23T23:42:59.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.993+0000 7f37f9200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f406ccf0 con 0x7f37f4071040 2024-03-23T23:42:59.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.993+0000 7f37f3e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37f4071040 0x7f37f4164380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:42:59.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.993+0000 7f37f3e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37f4071040 0x7f37f4164380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:49716/0 (socket says 172.21.15.8:49716) 2024-03-23T23:42:59.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.993+0000 7f37f3e00640 1 -- 172.21.15.8:0/1016939735 learned_addr learned my addr 172.21.15.8:0/1016939735 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:00.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.993+0000 7f2686c00640 1 -- 172.21.15.8:0/328407517 shutdown_connections 2024-03-23T23:43:00.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.993+0000 7f2686c00640 1 --2- 172.21.15.8:0/328407517 >> v2:172.21.15.196:3300/0 conn(0x7f2680072b30 0x7f26800c2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.993+0000 7f2686c00640 1 --2- 172.21.15.8:0/328407517 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26800c4430 0x7f268014eb80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.993+0000 7f2686c00640 1 -- 172.21.15.8:0/328407517 >> 172.21.15.8:0/328407517 conn(0x7f26800c3910 msgr2=0x7f26800c3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:00.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.993+0000 7f2686c00640 1 -- 172.21.15.8:0/328407517 shutdown_connections 2024-03-23T23:43:00.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.993+0000 7fcf04a00640 1 -- 172.21.15.8:0/4259146641 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef00ab600 con 0x7fcf0814f280 2024-03-23T23:43:00.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.993+0000 7fcf0ca00640 1 -- 172.21.15.8:0/4259146641 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf0814f280 msgr2=0x7fcf0806e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.993+0000 7fcf04a00640 1 -- 172.21.15.8:0/4259146641 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef00b0070 con 0x7fcf0814f280 2024-03-23T23:43:00.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.993+0000 7fcf0ca00640 1 --2- 172.21.15.8:0/4259146641 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf0814f280 0x7fcf0806e7b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcef00097c0 tx=0x7fcef001c260 comp rx=0 tx=0).stop 2024-03-23T23:43:00.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.993+0000 7f37f3400640 1 --2- 172.21.15.8:0/1016939735 >> v2:172.21.15.196:3300/0 conn(0x7f37f4157180 0x7f37f415a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:00.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.993+0000 7fcf0ca00640 1 -- 172.21.15.8:0/4259146641 shutdown_connections 2024-03-23T23:43:00.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.993+0000 7fcf0ca00640 1 --2- 172.21.15.8:0/4259146641 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf0814f280 0x7fcf0806e7b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.993+0000 7fcf0ca00640 1 -- 172.21.15.8:0/4259146641 >> 172.21.15.8:0/4259146641 conn(0x7fcf080a9870 msgr2=0x7fcf0806b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:00.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.997+0000 7fcf0ca00640 1 -- 172.21.15.8:0/4259146641 shutdown_connections 2024-03-23T23:43:00.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.997+0000 7f37f3400640 1 -- 172.21.15.8:0/1016939735 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37f4071040 msgr2=0x7f37f4164380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:00.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.997+0000 7fcf0ca00640 1 -- 172.21.15.8:0/4259146641 wait complete. 2024-03-23T23:43:00.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.997+0000 7f37f3400640 1 --2- 172.21.15.8:0/1016939735 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37f4071040 0x7f37f4164380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.997+0000 7f37f3400640 1 -- 172.21.15.8:0/1016939735 >> v1:172.21.15.8:6789/0 conn(0x7f37f4070be0 legacy=0x7f37f40c2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:00.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.997+0000 7f37f3400640 1 -- 172.21.15.8:0/1016939735 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f4159e70 con 0x7f37f4157180 2024-03-23T23:43:00.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.993+0000 7f2686c00640 1 -- 172.21.15.8:0/328407517 wait complete. 2024-03-23T23:43:00.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.997+0000 7f2686c00640 1 Processor -- start 2024-03-23T23:43:00.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.997+0000 7fcf0ca00640 1 Processor -- start 2024-03-23T23:43:00.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.997+0000 7f2686c00640 1 -- start start 2024-03-23T23:43:00.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.997+0000 7f2686c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2680072b30 0x7f26801fb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:00.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.997+0000 7f2686c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26800c2d60 0x7f2680169310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:00.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.997+0000 7f2686c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26800c4430 0x7f26800bd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:00.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.997+0000 7f2686c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268006c940 con 0x7f2680072b30 2024-03-23T23:43:00.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.997+0000 7f2686c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2680070be0 con 0x7f26800c4430 2024-03-23T23:43:00.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:42:59.997+0000 7f2686c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2680072f50 con 0x7f26800c2d60 2024-03-23T23:43:00.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.001+0000 7fcf0ca00640 1 -- start start 2024-03-23T23:43:00.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.001+0000 7fcf0ca00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf0806e340 0x7fcf0814b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:00.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.001+0000 7fcf0ca00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf080a9c80 0x7fcf0814a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:00.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.001+0000 7fcf0ca00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf0814f280 0x7fcf0814a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:00.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.001+0000 7f2685800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2680072b30 0x7f26801fb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:00.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.001+0000 7fcf05400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf080a9c80 0x7fcf0814a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:00.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.001+0000 7fcf05400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf080a9c80 0x7fcf0814a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:46226/0 (socket says 172.21.15.8:46226) 2024-03-23T23:43:00.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.001+0000 7fcf05e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf0806e340 0x7fcf0814b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:00.007 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.001+0000 7fcf05e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf0806e340 0x7fcf0814b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:49744/0 (socket says 172.21.15.8:49744) 2024-03-23T23:43:00.007 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.001+0000 7fcf05400640 1 -- 172.21.15.8:0/3862142962 learned_addr learned my addr 172.21.15.8:0/3862142962 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:00.007 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.001+0000 7fcf0ca00640 1 -- 172.21.15.8:0/3862142962 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf081524c0 con 0x7fcf0814f280 2024-03-23T23:43:00.007 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.001+0000 7fcf0ca00640 1 -- 172.21.15.8:0/3862142962 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf08152340 con 0x7fcf080a9c80 2024-03-23T23:43:00.007 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.001+0000 7fcf0ca00640 1 -- 172.21.15.8:0/3862142962 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf08152640 con 0x7fcf0806e340 2024-03-23T23:43:00.007 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.001+0000 7f2685800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2680072b30 0x7f26801fb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42260/0 (socket says 172.21.15.8:42260) 2024-03-23T23:43:00.007 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.001+0000 7f2685800640 1 -- 172.21.15.8:0/1099394648 learned_addr learned my addr 172.21.15.8:0/1099394648 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:00.007 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.001+0000 7fcf06800640 1 --2- 172.21.15.8:0/3862142962 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf0814f280 0x7fcf0814a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:00.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.005+0000 7f2686200640 1 --2- 172.21.15.8:0/1099394648 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26800c4430 0x7f26800bd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:00.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.005+0000 7f2684e00640 1 --2- 172.21.15.8:0/1099394648 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26800c2d60 0x7f2680169310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:00.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.005+0000 7f2686200640 1 -- 172.21.15.8:0/1099394648 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26800c2d60 msgr2=0x7f2680169310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.005+0000 7f2686200640 1 --2- 172.21.15.8:0/1099394648 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26800c2d60 0x7f2680169310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.005+0000 7f2686200640 1 -- 172.21.15.8:0/1099394648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2680072b30 msgr2=0x7f26801fb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.005+0000 7f2686200640 1 --2- 172.21.15.8:0/1099394648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2680072b30 0x7f26801fb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.005+0000 7f2686200640 1 -- 172.21.15.8:0/1099394648 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26801fbad0 con 0x7f26800c4430 2024-03-23T23:43:00.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.005+0000 7fcf05400640 1 -- 172.21.15.8:0/3862142962 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf0806e340 msgr2=0x7fcf0814b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.005+0000 7fcf05400640 1 --2- 172.21.15.8:0/3862142962 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf0806e340 0x7fcf0814b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.005+0000 7fcf05400640 1 -- 172.21.15.8:0/3862142962 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf0814f280 msgr2=0x7fcf0814a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.005+0000 7fcf05400640 1 --2- 172.21.15.8:0/3862142962 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf0814f280 0x7fcf0814a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.005+0000 7fcf05400640 1 -- 172.21.15.8:0/3862142962 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf080c80b0 con 0x7fcf080a9c80 2024-03-23T23:43:00.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.005+0000 7fcf05400640 1 --2- 172.21.15.8:0/3862142962 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf080a9c80 0x7fcf0814a300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcf0000b3e0 tx=0x7fcf0000b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:00.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.005+0000 7fcefe000640 1 -- 172.21.15.8:0/3862142962 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf00015020 con 0x7fcf080a9c80 2024-03-23T23:43:00.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.005+0000 7fcefe000640 1 -- 172.21.15.8:0/3862142962 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf00011850 con 0x7fcf080a9c80 2024-03-23T23:43:00.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.005+0000 7fcefe000640 1 -- 172.21.15.8:0/3862142962 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf00011c40 con 0x7fcf080a9c80 2024-03-23T23:43:00.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.005+0000 7f2686200640 1 --2- 172.21.15.8:0/1099394648 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26800c4430 0x7f26800bd770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f267400c310 tx=0x7f267400c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:00.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.005+0000 7f267d600640 1 -- 172.21.15.8:0/1099394648 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2674017070 con 0x7f26800c4430 2024-03-23T23:43:00.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.005+0000 7f267d600640 1 -- 172.21.15.8:0/1099394648 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2674005cf0 con 0x7f26800c4430 2024-03-23T23:43:00.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.005+0000 7f2686c00640 1 -- 172.21.15.8:0/1099394648 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26800abd90 con 0x7f26800c4430 2024-03-23T23:43:00.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.005+0000 7f267d600640 1 -- 172.21.15.8:0/1099394648 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26740072f0 con 0x7f26800c4430 2024-03-23T23:43:00.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.005+0000 7f2686c00640 1 -- 172.21.15.8:0/1099394648 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26800a9610 con 0x7f26800c4430 2024-03-23T23:43:00.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.005+0000 7f37f3400640 1 --2- 172.21.15.8:0/1016939735 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f37f4157180 0x7f37f415a670 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f37e00097c0 tx=0x7f37e001c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=653b86c9392f812f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:00.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.005+0000 7fcf0ca00640 1 -- 172.21.15.8:0/3862142962 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf080c7dd0 con 0x7fcf080a9c80 2024-03-23T23:43:00.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.005+0000 7fcf0ca00640 1 -- 172.21.15.8:0/3862142962 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf080c5250 con 0x7fcf080a9c80 2024-03-23T23:43:00.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.005+0000 7f2686c00640 1 -- 172.21.15.8:0/1099394648 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f268004f410 con 0x7f26800c4430 2024-03-23T23:43:00.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.005+0000 7fcf0ca00640 1 -- 172.21.15.8:0/3862142962 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf081ee920 con 0x7fcf080a9c80 2024-03-23T23:43:00.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.005+0000 7f37f2000640 1 -- 172.21.15.8:0/1016939735 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e00b0070 con 0x7f37f4157180 2024-03-23T23:43:00.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.005+0000 7f37f2000640 1 -- 172.21.15.8:0/1016939735 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e00ab600 con 0x7f37f4157180 2024-03-23T23:43:00.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.005+0000 7f37f2000640 1 -- 172.21.15.8:0/1016939735 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e00ab9d0 con 0x7f37f4157180 2024-03-23T23:43:00.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.009+0000 7f37f9200640 1 -- 172.21.15.8:0/1016939735 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f37f4157180 msgr2=0x7f37f415a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.009+0000 7f37f9200640 1 --2- 172.21.15.8:0/1016939735 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f37f4157180 0x7f37f415a670 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f37e00097c0 tx=0x7f37e001c460 comp rx=0 tx=0).stop 2024-03-23T23:43:00.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.009+0000 7fcefe000640 1 -- 172.21.15.8:0/3862142962 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fcf00018020 con 0x7fcf080a9c80 2024-03-23T23:43:00.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.009+0000 7f37f9200640 1 -- 172.21.15.8:0/1016939735 shutdown_connections 2024-03-23T23:43:00.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.009+0000 7f37f9200640 1 --2- 172.21.15.8:0/1016939735 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37f4071040 0x7f37f4164380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.009+0000 7f37f9200640 1 --2- 172.21.15.8:0/1016939735 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f37f4157180 0x7f37f415a670 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.009+0000 7f37f9200640 1 -- 172.21.15.8:0/1016939735 >> 172.21.15.8:0/1016939735 conn(0x7f37f40c3910 msgr2=0x7f37f40c3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:00.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.009+0000 7f267d600640 1 -- 172.21.15.8:0/1099394648 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f267401a070 con 0x7f26800c4430 2024-03-23T23:43:00.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.009+0000 7fcefe000640 1 --2- 172.21.15.8:0/3862142962 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcee4067730 0x7fcee4069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:00.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.013+0000 7fcefe000640 1 -- 172.21.15.8:0/3862142962 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fcf00086140 con 0x7fcf080a9c80 2024-03-23T23:43:00.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.013+0000 7f267d600640 1 --2- 172.21.15.8:0/1099394648 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2660067730 0x7f2660069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:00.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.013+0000 7f37f9200640 1 -- 172.21.15.8:0/1016939735 shutdown_connections 2024-03-23T23:43:00.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.013+0000 7fcf05e00640 1 --2- 172.21.15.8:0/3862142962 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcee4067730 0x7fcee4069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:00.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.013+0000 7f37f9200640 1 -- 172.21.15.8:0/1016939735 wait complete. 2024-03-23T23:43:00.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.013+0000 7f2685800640 1 --2- 172.21.15.8:0/1099394648 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2660067730 0x7f2660069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:00.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.013+0000 7f267d600640 1 -- 172.21.15.8:0/1099394648 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f2674084e30 con 0x7f26800c4430 2024-03-23T23:43:00.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.013+0000 7f2685800640 1 --2- 172.21.15.8:0/1099394648 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2660067730 0x7f2660069bf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f266c0097c0 tx=0x7f266c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:00.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.013+0000 7fcf05e00640 1 --2- 172.21.15.8:0/3862142962 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcee4067730 0x7fcee4069bf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcef80012f0 tx=0x7fcef8001820 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:00.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.013+0000 7f37f9200640 1 Processor -- start 2024-03-23T23:43:00.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.013+0000 7f37f9200640 1 -- start start 2024-03-23T23:43:00.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.017+0000 7f37f9200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37f4070be0 0x7f37f415cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:00.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.017+0000 7f37f9200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37f4071040 0x7f37f415d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:00.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.017+0000 7f37f9200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f37f4157180 0x7f37f41578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:00.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.017+0000 7f37f9200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f406f440 con 0x7f37f4070be0 2024-03-23T23:43:00.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.017+0000 7f37f9200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f415a1e0 con 0x7f37f4157180 2024-03-23T23:43:00.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.017+0000 7f37f9200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f406f5c0 con 0x7f37f4071040 2024-03-23T23:43:00.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.017+0000 7f37f2a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37f4071040 0x7f37f415d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:00.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.017+0000 7f37f3e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f37f4157180 0x7f37f41578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:00.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.017+0000 7f37f2a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37f4071040 0x7f37f415d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:49752/0 (socket says 172.21.15.8:49752) 2024-03-23T23:43:00.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.017+0000 7f37f2a00640 1 -- 172.21.15.8:0/3083160137 learned_addr learned my addr 172.21.15.8:0/3083160137 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:00.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.017+0000 7f37f3400640 1 --2- 172.21.15.8:0/3083160137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37f4070be0 0x7f37f415cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:00.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.017+0000 7f37f2a00640 1 -- 172.21.15.8:0/3083160137 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f37f4157180 msgr2=0x7f37f41578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.017+0000 7f37f2a00640 1 --2- 172.21.15.8:0/3083160137 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f37f4157180 0x7f37f41578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.017+0000 7f37f2a00640 1 -- 172.21.15.8:0/3083160137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37f4070be0 msgr2=0x7f37f415cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.017+0000 7f37f2a00640 1 --2- 172.21.15.8:0/3083160137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37f4070be0 0x7f37f415cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.017+0000 7f37f2a00640 1 -- 172.21.15.8:0/3083160137 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f415b490 con 0x7f37f4071040 2024-03-23T23:43:00.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.017+0000 7f37f2a00640 1 --2- 172.21.15.8:0/3083160137 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37f4071040 0x7f37f415d290 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f37ec00ba80 tx=0x7f37ec00bf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:00.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.017+0000 7f37eb400640 1 -- 172.21.15.8:0/3083160137 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ec00cc00 con 0x7f37f4071040 2024-03-23T23:43:00.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.017+0000 7f37eb400640 1 -- 172.21.15.8:0/3083160137 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37ec00cda0 con 0x7f37f4071040 2024-03-23T23:43:00.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.017+0000 7f37eb400640 1 -- 172.21.15.8:0/3083160137 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ec003bc0 con 0x7f37f4071040 2024-03-23T23:43:00.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.017+0000 7f37f9200640 1 -- 172.21.15.8:0/3083160137 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37f40c12e0 con 0x7f37f4071040 2024-03-23T23:43:00.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.017+0000 7f37f9200640 1 -- 172.21.15.8:0/3083160137 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f4142510 con 0x7f37f4071040 2024-03-23T23:43:00.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.021+0000 7f37f9200640 1 -- 172.21.15.8:0/3083160137 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37f4142710 con 0x7f37f4071040 2024-03-23T23:43:00.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.021+0000 7fcefe000640 1 -- 172.21.15.8:0/3862142962 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fcf081ee920 con 0x7fcf080a9c80 2024-03-23T23:43:00.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.021+0000 7f1795c00640 1 Processor -- start 2024-03-23T23:43:00.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.021+0000 7f37eb400640 1 -- 172.21.15.8:0/3083160137 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f37ec006d10 con 0x7f37f4071040 2024-03-23T23:43:00.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.021+0000 7f1795c00640 1 -- start start 2024-03-23T23:43:00.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.025+0000 7f1795c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f178800dac0 0x7f17880d80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:00.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.025+0000 7f1795c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f178804b950 0x7f17880d8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:00.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.025+0000 7f1795c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17880334e0 con 0x7f1788033100 2024-03-23T23:43:00.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.025+0000 7f1795c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17880dc390 con 0x7f178804b950 2024-03-23T23:43:00.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.025+0000 7f1795c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17880db780 con 0x7f178800dac0 2024-03-23T23:43:00.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.025+0000 7f37eb400640 1 --2- 172.21.15.8:0/3083160137 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f37d4067660 0x7f37d4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:00.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.025+0000 7f37eb400640 1 -- 172.21.15.8:0/3083160137 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f37ec085750 con 0x7f37f4071040 2024-03-23T23:43:00.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.025+0000 7f178e000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f178800dac0 0x7f17880d80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:00.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.025+0000 7f178ea00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f1788033100 0x7f17880483d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:46324/0 (socket says 172.21.15.8:46324) 2024-03-23T23:43:00.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.025+0000 7f178ea00640 1 -- 172.21.15.8:0/581605050 learned_addr learned my addr 172.21.15.8:0/581605050 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:43:00.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.025+0000 7f178e000640 1 -- 172.21.15.8:0/581605050 >> v2:172.21.15.196:3300/0 conn(0x7f178804b950 msgr2=0x7f17880d8630 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-23T23:43:00.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.025+0000 7f178e000640 1 --2- 172.21.15.8:0/581605050 >> v2:172.21.15.196:3300/0 conn(0x7f178804b950 0x7f17880d8630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.025+0000 7f178e000640 1 -- 172.21.15.8:0/581605050 >> v1:172.21.15.196:6789/0 conn(0x7f1788033100 legacy=0x7f17880483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.025+0000 7f178e000640 1 -- 172.21.15.8:0/581605050 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17880dba60 con 0x7f178800dac0 2024-03-23T23:43:00.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.029+0000 7f37f3400640 1 --2- 172.21.15.8:0/3083160137 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f37d4067660 0x7f37d4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:00.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.029+0000 7f37f3400640 1 --2- 172.21.15.8:0/3083160137 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f37d4067660 0x7f37d4069b20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f37e00ad000 tx=0x7f37e0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:00.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.029+0000 7f178e000640 1 --2- 172.21.15.8:0/581605050 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f178800dac0 0x7f17880d80f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f177c0097c0 tx=0x7f177c01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a752b715319b63e4 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:00.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.029+0000 7f178d600640 1 -- 172.21.15.8:0/581605050 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c0b0070 con 0x7f178800dac0 2024-03-23T23:43:00.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.029+0000 7f37eb400640 1 -- 172.21.15.8:0/3083160137 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f37ec055a40 con 0x7f37f4071040 2024-03-23T23:43:00.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.029+0000 7f178d600640 1 -- 172.21.15.8:0/581605050 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177c0ab600 con 0x7f178800dac0 2024-03-23T23:43:00.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.029+0000 7f178d600640 1 -- 172.21.15.8:0/581605050 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c0ab9d0 con 0x7f178800dac0 2024-03-23T23:43:00.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.029+0000 7f1795c00640 1 -- 172.21.15.8:0/581605050 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f178800dac0 msgr2=0x7f17880d80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.029+0000 7f267d600640 1 -- 172.21.15.8:0/1099394648 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f26801fbad0 con 0x7f26800c4430 2024-03-23T23:43:00.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.029+0000 7f1795c00640 1 --2- 172.21.15.8:0/581605050 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f178800dac0 0x7f17880d80f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f177c0097c0 tx=0x7f177c01c400 comp rx=0 tx=0).stop 2024-03-23T23:43:00.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.033+0000 7f1795c00640 1 -- 172.21.15.8:0/581605050 shutdown_connections 2024-03-23T23:43:00.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.033+0000 7f1795c00640 1 --2- 172.21.15.8:0/581605050 >> v2:172.21.15.196:3300/0 conn(0x7f178804b950 0x7f17880d8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.033+0000 7f1795c00640 1 --2- 172.21.15.8:0/581605050 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f178800dac0 0x7f17880d80f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.033+0000 7f1795c00640 1 -- 172.21.15.8:0/581605050 >> 172.21.15.8:0/581605050 conn(0x7f178800a250 msgr2=0x7f178800a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:00.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.037+0000 7f1795c00640 1 -- 172.21.15.8:0/581605050 shutdown_connections 2024-03-23T23:43:00.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.041+0000 7f1795c00640 1 -- 172.21.15.8:0/581605050 wait complete. 2024-03-23T23:43:00.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.041+0000 7f1795c00640 1 Processor -- start 2024-03-23T23:43:00.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.041+0000 7f1795c00640 1 -- start start 2024-03-23T23:43:00.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.045+0000 7f1795c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f178800dac0 0x7f17880437b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:00.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.045+0000 7f1795c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1788033100 0x7f1788041580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:00.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.045+0000 7f1795c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f178804b950 0x7f1788041ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:00.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.045+0000 7f1795c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1788041360 con 0x7f1788033100 2024-03-23T23:43:00.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.045+0000 7f1795c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17880411e0 con 0x7f178800dac0 2024-03-23T23:43:00.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.045+0000 7f1795c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17880e3280 con 0x7f178804b950 2024-03-23T23:43:00.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.045+0000 7f178f400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f178804b950 0x7f1788041ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:00.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.045+0000 7f178f400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f178804b950 0x7f1788041ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:49770/0 (socket says 172.21.15.8:49770) 2024-03-23T23:43:00.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.045+0000 7f178f400640 1 -- 172.21.15.8:0/2947720291 learned_addr learned my addr 172.21.15.8:0/2947720291 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:00.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.045+0000 7f178e000640 1 --2- 172.21.15.8:0/2947720291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1788033100 0x7f1788041580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:00.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.045+0000 7f178f400640 1 -- 172.21.15.8:0/2947720291 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f178800dac0 msgr2=0x7f17880437b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:43:00.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.045+0000 7f178f400640 1 --2- 172.21.15.8:0/2947720291 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f178800dac0 0x7f17880437b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.045+0000 7f178f400640 1 -- 172.21.15.8:0/2947720291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1788033100 msgr2=0x7f1788041580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.045+0000 7f178f400640 1 --2- 172.21.15.8:0/2947720291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1788033100 0x7f1788041580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.045+0000 7f178f400640 1 -- 172.21.15.8:0/2947720291 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17880d7f50 con 0x7f178804b950 2024-03-23T23:43:00.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.045+0000 7f178f400640 1 --2- 172.21.15.8:0/2947720291 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f178804b950 0x7f1788041ac0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1790069fd0 tx=0x7f1790073410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:00.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.045+0000 7f1786a00640 1 -- 172.21.15.8:0/2947720291 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179004f980 con 0x7f178804b950 2024-03-23T23:43:00.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.045+0000 7f1786a00640 1 -- 172.21.15.8:0/2947720291 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179008f020 con 0x7f178804b950 2024-03-23T23:43:00.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.045+0000 7f1786a00640 1 -- 172.21.15.8:0/2947720291 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1790075440 con 0x7f178804b950 2024-03-23T23:43:00.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.045+0000 7f1795c00640 1 -- 172.21.15.8:0/2947720291 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17880d7c70 con 0x7f178804b950 2024-03-23T23:43:00.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.049+0000 7f1795c00640 1 -- 172.21.15.8:0/2947720291 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1788174040 con 0x7f178804b950 2024-03-23T23:43:00.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.053+0000 7f1786a00640 1 -- 172.21.15.8:0/2947720291 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f1790071400 con 0x7f178804b950 2024-03-23T23:43:00.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.053+0000 7f1795c00640 1 -- 172.21.15.8:0/2947720291 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1788005720 con 0x7f178804b950 2024-03-23T23:43:00.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.053+0000 7f1786a00640 1 --2- 172.21.15.8:0/2947720291 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1770067650 0x7f1770069b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:00.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.053+0000 7f1786a00640 1 -- 172.21.15.8:0/2947720291 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f1790100d60 con 0x7f178804b950 2024-03-23T23:43:00.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.053+0000 7f178ea00640 1 --2- 172.21.15.8:0/2947720291 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1770067650 0x7f1770069b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:00.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.053+0000 7f178ea00640 1 --2- 172.21.15.8:0/2947720291 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1770067650 0x7f1770069b10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1788042300 tx=0x7f1780007a50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:00.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.057+0000 7f1786a00640 1 -- 172.21.15.8:0/2947720291 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f1790099030 con 0x7f178804b950 2024-03-23T23:43:00.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.081+0000 7f0031800640 1 Processor -- start 2024-03-23T23:43:00.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.081+0000 7f0031800640 1 -- start start 2024-03-23T23:43:00.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.081+0000 7f0031800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f002c06d4d0 0x7f002c159560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:00.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.081+0000 7f0031800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f002c070be0 0x7f002c155660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:00.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.081+0000 7f0031800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f002c06e220 con 0x7f002c0c2a80 2024-03-23T23:43:00.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.081+0000 7f0031800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f002c06e500 con 0x7f002c06d4d0 2024-03-23T23:43:00.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.081+0000 7f0031800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f002c06e7e0 con 0x7f002c070be0 2024-03-23T23:43:00.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.081+0000 7f0030e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f002c070be0 0x7f002c155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:00.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.081+0000 7f0030e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f002c070be0 0x7f002c155660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:46262/0 (socket says 172.21.15.8:46262) 2024-03-23T23:43:00.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.081+0000 7f0030e00640 1 -- 172.21.15.8:0/2841906641 learned_addr learned my addr 172.21.15.8:0/2841906641 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:00.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.081+0000 7f0030e00640 1 -- 172.21.15.8:0/2841906641 >> v2:172.21.15.8:3300/0 conn(0x7f002c06d4d0 msgr2=0x7f002c159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:00.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.081+0000 7f0030e00640 1 --2- 172.21.15.8:0/2841906641 >> v2:172.21.15.8:3300/0 conn(0x7f002c06d4d0 0x7f002c159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.081+0000 7f0030e00640 1 -- 172.21.15.8:0/2841906641 >> v1:172.21.15.8:6789/0 conn(0x7f002c0c2a80 legacy=0x7f002c158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:00.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.081+0000 7f0030e00640 1 -- 172.21.15.8:0/2841906641 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002c06eac0 con 0x7f002c070be0 2024-03-23T23:43:00.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.093+0000 7f0030e00640 1 --2- 172.21.15.8:0/2841906641 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f002c070be0 0x7f002c155660 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f002c06d0e0 tx=0x7f001c01c4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b15c774615c60f5a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:00.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.093+0000 7f002aa00640 1 -- 172.21.15.8:0/2841906641 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c0ab640 con 0x7f002c070be0 2024-03-23T23:43:00.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.093+0000 7f002aa00640 1 -- 172.21.15.8:0/2841906641 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001c0b0070 con 0x7f002c070be0 2024-03-23T23:43:00.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.093+0000 7f002aa00640 1 -- 172.21.15.8:0/2841906641 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c0aba00 con 0x7f002c070be0 2024-03-23T23:43:00.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.101+0000 7f0031800640 1 -- 172.21.15.8:0/2841906641 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f002c070be0 msgr2=0x7f002c155660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.101+0000 7f0031800640 1 --2- 172.21.15.8:0/2841906641 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f002c070be0 0x7f002c155660 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f002c06d0e0 tx=0x7f001c01c4e0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.101+0000 7f0031800640 1 -- 172.21.15.8:0/2841906641 shutdown_connections 2024-03-23T23:43:00.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.101+0000 7f0031800640 1 --2- 172.21.15.8:0/2841906641 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f002c070be0 0x7f002c155660 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.101+0000 7f0031800640 1 --2- 172.21.15.8:0/2841906641 >> v2:172.21.15.8:3300/0 conn(0x7f002c06d4d0 0x7f002c159560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.101+0000 7f0031800640 1 -- 172.21.15.8:0/2841906641 >> 172.21.15.8:0/2841906641 conn(0x7f002c0c3910 msgr2=0x7f002c0c3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:00.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.101+0000 7f0031800640 1 -- 172.21.15.8:0/2841906641 shutdown_connections 2024-03-23T23:43:00.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.101+0000 7f0031800640 1 -- 172.21.15.8:0/2841906641 wait complete. 2024-03-23T23:43:00.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.105+0000 7f0031800640 1 Processor -- start 2024-03-23T23:43:00.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.105+0000 7f0031800640 1 -- start start 2024-03-23T23:43:00.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.105+0000 7f0031800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f002c06d4d0 0x7f002c157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:00.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.105+0000 7f0031800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f002c070be0 0x7f002c0aa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:00.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.105+0000 7f0031800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f002c0c2a80 0x7f002c174cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:00.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.105+0000 7f0031800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002c13d610 con 0x7f002c0c2a80 2024-03-23T23:43:00.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.105+0000 7f0031800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002c0c30b0 con 0x7f002c070be0 2024-03-23T23:43:00.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.105+0000 7f0031800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002c13d790 con 0x7f002c06d4d0 2024-03-23T23:43:00.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.105+0000 7f002be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f002c06d4d0 0x7f002c157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:00.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.105+0000 7f002be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f002c06d4d0 0x7f002c157cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:49772/0 (socket says 172.21.15.8:49772) 2024-03-23T23:43:00.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.105+0000 7f002be00640 1 -- 172.21.15.8:0/1261383995 learned_addr learned my addr 172.21.15.8:0/1261383995 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:00.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.105+0000 7f0030e00640 1 --2- 172.21.15.8:0/1261383995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f002c0c2a80 0x7f002c174cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:00.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.105+0000 7f002be00640 1 -- 172.21.15.8:0/1261383995 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f002c070be0 msgr2=0x7f002c0aa7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.105+0000 7f002be00640 1 --2- 172.21.15.8:0/1261383995 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f002c070be0 0x7f002c0aa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.105+0000 7f002be00640 1 -- 172.21.15.8:0/1261383995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f002c0c2a80 msgr2=0x7f002c174cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.105+0000 7f002be00640 1 --2- 172.21.15.8:0/1261383995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f002c0c2a80 0x7f002c174cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.105+0000 7f002be00640 1 -- 172.21.15.8:0/1261383995 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002c148a40 con 0x7f002c06d4d0 2024-03-23T23:43:00.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.105+0000 7f002be00640 1 --2- 172.21.15.8:0/1261383995 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f002c06d4d0 0x7f002c157cc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f001400b3e0 tx=0x7f001400b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:00.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.113+0000 7f0023e00640 1 -- 172.21.15.8:0/1261383995 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0014015020 con 0x7f002c06d4d0 2024-03-23T23:43:00.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.113+0000 7f0023e00640 1 -- 172.21.15.8:0/1261383995 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0014011850 con 0x7f002c06d4d0 2024-03-23T23:43:00.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.113+0000 7f0023e00640 1 -- 172.21.15.8:0/1261383995 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0014011c40 con 0x7f002c06d4d0 2024-03-23T23:43:00.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.113+0000 7f0031800640 1 -- 172.21.15.8:0/1261383995 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f002c134590 con 0x7f002c06d4d0 2024-03-23T23:43:00.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.113+0000 7f0031800640 1 -- 172.21.15.8:0/1261383995 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f002c0ab780 con 0x7f002c06d4d0 2024-03-23T23:43:00.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.121+0000 7f0023e00640 1 -- 172.21.15.8:0/1261383995 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f0014018020 con 0x7f002c06d4d0 2024-03-23T23:43:00.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.121+0000 7f0031800640 1 -- 172.21.15.8:0/1261383995 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00040052a0 con 0x7f002c06d4d0 2024-03-23T23:43:00.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.121+0000 7f0023e00640 1 --2- 172.21.15.8:0/1261383995 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0008067730 0x7f0008069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:00.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.121+0000 7f0023e00640 1 -- 172.21.15.8:0/1261383995 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f00140859e0 con 0x7f002c06d4d0 2024-03-23T23:43:00.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.121+0000 7f002b400640 1 --2- 172.21.15.8:0/1261383995 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0008067730 0x7f0008069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:00.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.125+0000 7f0023e00640 1 -- 172.21.15.8:0/1261383995 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f001401f020 con 0x7f002c06d4d0 2024-03-23T23:43:00.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.129+0000 7f002b400640 1 --2- 172.21.15.8:0/1261383995 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0008067730 0x7f0008069bf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f002c13b0e0 tx=0x7f0024009250 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:00.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.229+0000 7ff92b200640 1 -- 172.21.15.8:0/804954876 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff92415f300 con 0x7ff9241596e0 2024-03-23T23:43:00.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.229+0000 7ff91be00640 1 -- 172.21.15.8:0/804954876 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff914056630 con 0x7ff9241596e0 2024-03-23T23:43:00.236 INFO:teuthology.orchestra.run.smithi008.stdout:60129542153 2024-03-23T23:43:00.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.245+0000 7ff92b200640 1 -- 172.21.15.8:0/804954876 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff904067730 msgr2=0x7ff904069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.245+0000 7ff92b200640 1 --2- 172.21.15.8:0/804954876 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff904067730 0x7ff904069bf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff92415efb0 tx=0x7ff91c00b040 comp rx=0 tx=0).stop 2024-03-23T23:43:00.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.245+0000 7ff92b200640 1 -- 172.21.15.8:0/804954876 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9241596e0 msgr2=0x7ff92413ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.245+0000 7ff92b200640 1 --2- 172.21.15.8:0/804954876 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9241596e0 0x7ff92413ed50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff91400e890 tx=0x7ff91400ed50 comp rx=0 tx=0).stop 2024-03-23T23:43:00.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.245+0000 7ff92b200640 1 -- 172.21.15.8:0/804954876 shutdown_connections 2024-03-23T23:43:00.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.245+0000 7ff92b200640 1 --2- 172.21.15.8:0/804954876 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9241596e0 0x7ff92413ed50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.245+0000 7ff92b200640 1 --2- 172.21.15.8:0/804954876 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff924152ce0 0x7ff92413e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.245+0000 7ff92b200640 1 --2- 172.21.15.8:0/804954876 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff904067730 0x7ff904069bf0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.245+0000 7ff92b200640 1 --2- 172.21.15.8:0/804954876 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9240c4420 0x7ff924154c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.245+0000 7ff92b200640 1 -- 172.21.15.8:0/804954876 >> 172.21.15.8:0/804954876 conn(0x7ff92406b170 msgr2=0x7ff9240c4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:00.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.245+0000 7ff92b200640 1 -- 172.21.15.8:0/804954876 shutdown_connections 2024-03-23T23:43:00.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.245+0000 7ff92b200640 1 -- 172.21.15.8:0/804954876 wait complete. 2024-03-23T23:43:00.300 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.0 2024-03-23T23:43:00.300 DEBUG:teuthology.parallel:result is None 2024-03-23T23:43:00.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.329+0000 7f3d10a00640 1 -- 172.21.15.8:0/3563406276 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3ce4005590 con 0x7f3d0c14f280 2024-03-23T23:43:00.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.333+0000 7f3d02000640 1 -- 172.21.15.8:0/3563406276 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3cf80ef4d0 con 0x7f3d0c14f280 2024-03-23T23:43:00.335 INFO:teuthology.orchestra.run.smithi008.stdout:60129542153 2024-03-23T23:43:00.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.333+0000 7f3d10a00640 1 -- 172.21.15.8:0/3563406276 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3cec067730 msgr2=0x7f3cec069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.333+0000 7f3d10a00640 1 --2- 172.21.15.8:0/3563406276 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3cec067730 0x7f3cec069bf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c14e400 tx=0x7f3d0400b040 comp rx=0 tx=0).stop 2024-03-23T23:43:00.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.333+0000 7f3d10a00640 1 -- 172.21.15.8:0/3563406276 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d0c14f280 msgr2=0x7f3d0c146840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.333+0000 7f3d10a00640 1 --2- 172.21.15.8:0/3563406276 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d0c14f280 0x7f3d0c146840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8019ee0 tx=0x7f3cf8019050 comp rx=0 tx=0).stop 2024-03-23T23:43:00.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.333+0000 7f3d10a00640 1 -- 172.21.15.8:0/3563406276 shutdown_connections 2024-03-23T23:43:00.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.333+0000 7f3d10a00640 1 --2- 172.21.15.8:0/3563406276 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3cec067730 0x7f3cec069bf0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.333+0000 7f3d10a00640 1 --2- 172.21.15.8:0/3563406276 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d0c14f280 0x7f3d0c146840 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.333+0000 7f3d10a00640 1 --2- 172.21.15.8:0/3563406276 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d0c0a9c80 0x7f3d0c140e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.333+0000 7f3d10a00640 1 --2- 172.21.15.8:0/3563406276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d0c06e340 0x7f3d0c14bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.333+0000 7f3d10a00640 1 -- 172.21.15.8:0/3563406276 >> 172.21.15.8:0/3563406276 conn(0x7f3d0c0a9870 msgr2=0x7f3d0c0c37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:00.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.337+0000 7f3d10a00640 1 -- 172.21.15.8:0/3563406276 shutdown_connections 2024-03-23T23:43:00.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.337+0000 7f3d10a00640 1 -- 172.21.15.8:0/3563406276 wait complete. 2024-03-23T23:43:00.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.369+0000 7ff279a00640 1 -- 172.21.15.8:0/2259634016 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff26c006a40 con 0x7ff26c0e2d80 2024-03-23T23:43:00.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.369+0000 7ff26aa00640 1 -- 172.21.15.8:0/2259634016 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff2600552b0 con 0x7ff26c0e2d80 2024-03-23T23:43:00.372 INFO:teuthology.orchestra.run.smithi008.stdout:60129542153 2024-03-23T23:43:00.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.1 2024-03-23T23:43:00.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.373+0000 7fcf0ca00640 1 -- 172.21.15.8:0/3862142962 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fcf0814c000 con 0x7fcf080a9c80 2024-03-23T23:43:00.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.373+0000 7f37f9200640 1 -- 172.21.15.8:0/3083160137 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f37f404f410 con 0x7f37f4071040 2024-03-23T23:43:00.374 DEBUG:teuthology.parallel:result is None 2024-03-23T23:43:00.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.373+0000 7fcefe000640 1 -- 172.21.15.8:0/3862142962 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcf0001f020 con 0x7fcf080a9c80 2024-03-23T23:43:00.374 INFO:teuthology.orchestra.run.smithi008.stdout:64424509450 2024-03-23T23:43:00.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.373+0000 7f37eb400640 1 -- 172.21.15.8:0/3083160137 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f37ec059ae0 con 0x7f37f4071040 2024-03-23T23:43:00.375 INFO:teuthology.orchestra.run.smithi008.stdout:64424509450 2024-03-23T23:43:00.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.373+0000 7ff279a00640 1 -- 172.21.15.8:0/2259634016 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff254067730 msgr2=0x7ff254069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.373+0000 7ff279a00640 1 --2- 172.21.15.8:0/2259634016 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff254067730 0x7ff254069bf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff264000f70 tx=0x7ff264009040 comp rx=0 tx=0).stop 2024-03-23T23:43:00.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.373+0000 7ff279a00640 1 -- 172.21.15.8:0/2259634016 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff26c0e2d80 msgr2=0x7ff26c0cdb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.373+0000 7ff279a00640 1 --2- 172.21.15.8:0/2259634016 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff26c0e2d80 0x7ff26c0cdb40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff26000c4b0 tx=0x7ff26000c970 comp rx=0 tx=0).stop 2024-03-23T23:43:00.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.373+0000 7ff279a00640 1 -- 172.21.15.8:0/2259634016 shutdown_connections 2024-03-23T23:43:00.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.373+0000 7ff279a00640 1 --2- 172.21.15.8:0/2259634016 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff254067730 0x7ff254069bf0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.373+0000 7ff279a00640 1 --2- 172.21.15.8:0/2259634016 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff26c0e2d80 0x7ff26c0cdb40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.373+0000 7ff279a00640 1 --2- 172.21.15.8:0/2259634016 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff26c0db900 0x7ff26c0d9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.373+0000 7ff279a00640 1 --2- 172.21.15.8:0/2259634016 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff26c0d7b90 0x7ff26c0d6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.373+0000 7ff279a00640 1 -- 172.21.15.8:0/2259634016 >> 172.21.15.8:0/2259634016 conn(0x7ff26c005f20 msgr2=0x7ff26c02c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:00.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.373+0000 7ff279a00640 1 -- 172.21.15.8:0/2259634016 shutdown_connections 2024-03-23T23:43:00.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.373+0000 7ff279a00640 1 -- 172.21.15.8:0/2259634016 wait complete. 2024-03-23T23:43:00.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.377+0000 7fcf0ca00640 1 -- 172.21.15.8:0/3862142962 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcee4067730 msgr2=0x7fcee4069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.377+0000 7f37f9200640 1 -- 172.21.15.8:0/3083160137 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f37d4067660 msgr2=0x7f37d4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.377+0000 7f37f9200640 1 --2- 172.21.15.8:0/3083160137 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f37d4067660 0x7f37d4069b20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f37e00ad000 tx=0x7f37e0008040 comp rx=0 tx=0).stop 2024-03-23T23:43:00.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.377+0000 7f37f9200640 1 -- 172.21.15.8:0/3083160137 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37f4071040 msgr2=0x7f37f415d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.377+0000 7f37f9200640 1 --2- 172.21.15.8:0/3083160137 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37f4071040 0x7f37f415d290 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f37ec00ba80 tx=0x7f37ec00bf40 comp rx=0 tx=0).stop 2024-03-23T23:43:00.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.377+0000 7f37f9200640 1 -- 172.21.15.8:0/3083160137 shutdown_connections 2024-03-23T23:43:00.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.377+0000 7f37f9200640 1 --2- 172.21.15.8:0/3083160137 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f37f4157180 0x7f37f41578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.377+0000 7f37f9200640 1 --2- 172.21.15.8:0/3083160137 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f37d4067660 0x7f37d4069b20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.377+0000 7f37f9200640 1 --2- 172.21.15.8:0/3083160137 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37f4071040 0x7f37f415d290 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f37ec00ba80 tx=0x7f37ec00bf40 comp rx=0 tx=0).stop 2024-03-23T23:43:00.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.377+0000 7f37f9200640 1 --2- 172.21.15.8:0/3083160137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37f4070be0 0x7f37f415cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.377+0000 7f37f9200640 1 -- 172.21.15.8:0/3083160137 >> 172.21.15.8:0/3083160137 conn(0x7f37f40c3910 msgr2=0x7f37f40c2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:00.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.377+0000 7fcf0ca00640 1 --2- 172.21.15.8:0/3862142962 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcee4067730 0x7fcee4069bf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcef80012f0 tx=0x7fcef8001820 comp rx=0 tx=0).stop 2024-03-23T23:43:00.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.377+0000 7fcf0ca00640 1 -- 172.21.15.8:0/3862142962 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf080a9c80 msgr2=0x7fcf0814a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.377+0000 7fcf0ca00640 1 --2- 172.21.15.8:0/3862142962 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf080a9c80 0x7fcf0814a300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcf0000b3e0 tx=0x7fcf0000b8a0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.377+0000 7fcf0ca00640 1 -- 172.21.15.8:0/3862142962 shutdown_connections 2024-03-23T23:43:00.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.377+0000 7fcf0ca00640 1 --2- 172.21.15.8:0/3862142962 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf0814f280 0x7fcf0814a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.377+0000 7fcf0ca00640 1 --2- 172.21.15.8:0/3862142962 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf080a9c80 0x7fcf0814a300 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.377+0000 7fcf0ca00640 1 --2- 172.21.15.8:0/3862142962 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcee4067730 0x7fcee4069bf0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.377+0000 7fcf0ca00640 1 --2- 172.21.15.8:0/3862142962 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf0806e340 0x7fcf0814b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.377+0000 7fcf0ca00640 1 -- 172.21.15.8:0/3862142962 >> 172.21.15.8:0/3862142962 conn(0x7fcf080a9870 msgr2=0x7fcf0814ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:00.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.377+0000 7f37f9200640 1 -- 172.21.15.8:0/3083160137 shutdown_connections 2024-03-23T23:43:00.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.377+0000 7f37f9200640 1 -- 172.21.15.8:0/3083160137 wait complete. 2024-03-23T23:43:00.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.377+0000 7fcf0ca00640 1 -- 172.21.15.8:0/3862142962 shutdown_connections 2024-03-23T23:43:00.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.377+0000 7fcf0ca00640 1 -- 172.21.15.8:0/3862142962 wait complete. 2024-03-23T23:43:00.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.397+0000 7f1795c00640 1 -- 172.21.15.8:0/2947720291 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f17880e2850 con 0x7f178804b950 2024-03-23T23:43:00.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.401+0000 7f1786a00640 1 -- 172.21.15.8:0/2947720291 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f179006c2f0 con 0x7f178804b950 2024-03-23T23:43:00.401 INFO:teuthology.orchestra.run.smithi008.stdout:60129542153 2024-03-23T23:43:00.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.401+0000 7f1795c00640 1 -- 172.21.15.8:0/2947720291 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1770067650 msgr2=0x7f1770069b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.401+0000 7f1795c00640 1 --2- 172.21.15.8:0/2947720291 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1770067650 0x7f1770069b10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1788042300 tx=0x7f1780007a50 comp rx=0 tx=0).stop 2024-03-23T23:43:00.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.401+0000 7f1795c00640 1 -- 172.21.15.8:0/2947720291 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f178804b950 msgr2=0x7f1788041ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.401+0000 7f1795c00640 1 --2- 172.21.15.8:0/2947720291 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f178804b950 0x7f1788041ac0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1790069fd0 tx=0x7f1790073410 comp rx=0 tx=0).stop 2024-03-23T23:43:00.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.401+0000 7f1795c00640 1 -- 172.21.15.8:0/2947720291 shutdown_connections 2024-03-23T23:43:00.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.401+0000 7f1795c00640 1 --2- 172.21.15.8:0/2947720291 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1770067650 0x7f1770069b10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.401+0000 7f1795c00640 1 --2- 172.21.15.8:0/2947720291 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f178804b950 0x7f1788041ac0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.401+0000 7f1795c00640 1 --2- 172.21.15.8:0/2947720291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1788033100 0x7f1788041580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.401+0000 7f1795c00640 1 --2- 172.21.15.8:0/2947720291 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f178800dac0 0x7f17880437b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.401+0000 7f1795c00640 1 -- 172.21.15.8:0/2947720291 >> 172.21.15.8:0/2947720291 conn(0x7f178800a250 msgr2=0x7f17880d2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:00.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.401+0000 7f1795c00640 1 -- 172.21.15.8:0/2947720291 shutdown_connections 2024-03-23T23:43:00.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.401+0000 7f1795c00640 1 -- 172.21.15.8:0/2947720291 wait complete. 2024-03-23T23:43:00.412 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.3 2024-03-23T23:43:00.412 DEBUG:teuthology.parallel:result is None 2024-03-23T23:43:00.414 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.2 2024-03-23T23:43:00.414 DEBUG:teuthology.parallel:result is None 2024-03-23T23:43:00.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.6 2024-03-23T23:43:00.415 DEBUG:teuthology.parallel:result is None 2024-03-23T23:43:00.424 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.7 2024-03-23T23:43:00.424 DEBUG:teuthology.parallel:result is None 2024-03-23T23:43:00.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.445+0000 7f2686c00640 1 -- 172.21.15.8:0/1099394648 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f2680071d30 con 0x7f26800c4430 2024-03-23T23:43:00.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.445+0000 7f267d600640 1 -- 172.21.15.8:0/1099394648 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f26740551a0 con 0x7f26800c4430 2024-03-23T23:43:00.446 INFO:teuthology.orchestra.run.smithi008.stdout:64424509449 2024-03-23T23:43:00.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.449+0000 7f2686c00640 1 -- 172.21.15.8:0/1099394648 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2660067730 msgr2=0x7f2660069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.449+0000 7f2686c00640 1 --2- 172.21.15.8:0/1099394648 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2660067730 0x7f2660069bf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f266c0097c0 tx=0x7f266c008040 comp rx=0 tx=0).stop 2024-03-23T23:43:00.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.449+0000 7f2686c00640 1 -- 172.21.15.8:0/1099394648 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26800c4430 msgr2=0x7f26800bd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.449+0000 7f2686c00640 1 --2- 172.21.15.8:0/1099394648 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26800c4430 0x7f26800bd770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f267400c310 tx=0x7f267400c7d0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.449+0000 7f2686c00640 1 -- 172.21.15.8:0/1099394648 shutdown_connections 2024-03-23T23:43:00.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.449+0000 7f2686c00640 1 --2- 172.21.15.8:0/1099394648 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26800c4430 0x7f26800bd770 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.449+0000 7f2686c00640 1 --2- 172.21.15.8:0/1099394648 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2660067730 0x7f2660069bf0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.449+0000 7f2686c00640 1 --2- 172.21.15.8:0/1099394648 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26800c2d60 0x7f2680169310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.449+0000 7f2686c00640 1 --2- 172.21.15.8:0/1099394648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2680072b30 0x7f26801fb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.449+0000 7f2686c00640 1 -- 172.21.15.8:0/1099394648 >> 172.21.15.8:0/1099394648 conn(0x7f26800c3910 msgr2=0x7f2680070d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:00.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.449+0000 7f2686c00640 1 -- 172.21.15.8:0/1099394648 shutdown_connections 2024-03-23T23:43:00.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.449+0000 7f2686c00640 1 -- 172.21.15.8:0/1099394648 wait complete. 2024-03-23T23:43:00.476 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.4 2024-03-23T23:43:00.476 DEBUG:teuthology.parallel:result is None 2024-03-23T23:43:00.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.485+0000 7f0031800640 1 -- 172.21.15.8:0/1261383995 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f0004005590 con 0x7f002c06d4d0 2024-03-23T23:43:00.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.485+0000 7f0023e00640 1 -- 172.21.15.8:0/1261383995 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f00140172c0 con 0x7f002c06d4d0 2024-03-23T23:43:00.487 INFO:teuthology.orchestra.run.smithi008.stdout:64424509450 2024-03-23T23:43:00.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.489+0000 7f0031800640 1 -- 172.21.15.8:0/1261383995 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0008067730 msgr2=0x7f0008069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.489+0000 7f0031800640 1 --2- 172.21.15.8:0/1261383995 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0008067730 0x7f0008069bf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f002c13b0e0 tx=0x7f0024009250 comp rx=0 tx=0).stop 2024-03-23T23:43:00.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.489+0000 7f0031800640 1 -- 172.21.15.8:0/1261383995 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f002c06d4d0 msgr2=0x7f002c157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.489+0000 7f0031800640 1 --2- 172.21.15.8:0/1261383995 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f002c06d4d0 0x7f002c157cc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f001400b3e0 tx=0x7f001400b8a0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.489+0000 7f0031800640 1 -- 172.21.15.8:0/1261383995 shutdown_connections 2024-03-23T23:43:00.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.489+0000 7f0031800640 1 --2- 172.21.15.8:0/1261383995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f002c0c2a80 0x7f002c174cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.489+0000 7f0031800640 1 --2- 172.21.15.8:0/1261383995 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f002c070be0 0x7f002c0aa7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.489+0000 7f0031800640 1 --2- 172.21.15.8:0/1261383995 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0008067730 0x7f0008069bf0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.489+0000 7f0031800640 1 --2- 172.21.15.8:0/1261383995 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f002c06d4d0 0x7f002c157cc0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.489+0000 7f0031800640 1 -- 172.21.15.8:0/1261383995 >> 172.21.15.8:0/1261383995 conn(0x7f002c0c3910 msgr2=0x7f002c0c3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:00.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.489+0000 7f0031800640 1 -- 172.21.15.8:0/1261383995 shutdown_connections 2024-03-23T23:43:00.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.489+0000 7f0031800640 1 -- 172.21.15.8:0/1261383995 wait complete. 2024-03-23T23:43:00.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.5 2024-03-23T23:43:00.509 DEBUG:teuthology.parallel:result is None 2024-03-23T23:43:00.509 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-23T23:43:00.510 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T23:43:00.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.689+0000 7f76f2800640 1 Processor -- start 2024-03-23T23:43:00.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.689+0000 7f76f2800640 1 -- start start 2024-03-23T23:43:00.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.693+0000 7f76f2800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f76ec0c4e40 0x7f76ec161310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:00.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.693+0000 7f76f2800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76ec0c4340 con 0x7f76ec06d6e0 2024-03-23T23:43:00.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.693+0000 7f76f2800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76ec0c4060 con 0x7f76ec0c8a50 2024-03-23T23:43:00.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.693+0000 7f76f2800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76ec0c4740 con 0x7f76ec0c4e40 2024-03-23T23:43:00.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.693+0000 7f76ebe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f76ec0c4e40 0x7f76ec161310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:00.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.693+0000 7f76ebe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f76ec0c4e40 0x7f76ec161310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42304/0 (socket says 172.21.15.8:42304) 2024-03-23T23:43:00.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.693+0000 7f76e3e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f76ec06d6e0 0x7f76ec155a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:45080/0 (socket says 172.21.15.8:45080) 2024-03-23T23:43:00.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.693+0000 7f76ebe00640 1 -- 172.21.15.8:0/4225892521 learned_addr learned my addr 172.21.15.8:0/4225892521 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:00.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.693+0000 7f76ebe00640 1 -- 172.21.15.8:0/4225892521 >> v1:172.21.15.196:6789/0 conn(0x7f76ec0c8a50 legacy=0x7f76ec0c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.693+0000 7f76ebe00640 1 -- 172.21.15.8:0/4225892521 >> v1:172.21.15.8:6789/0 conn(0x7f76ec06d6e0 legacy=0x7f76ec155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.693+0000 7f76ebe00640 1 -- 172.21.15.8:0/4225892521 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ec0c3570 con 0x7f76ec0c4e40 2024-03-23T23:43:00.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.693+0000 7f76ebe00640 1 --2- 172.21.15.8:0/4225892521 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76ec0c4e40 0x7f76ec161310 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f76e4009e50 tx=0x7f76e401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516a789c04800b34 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:00.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.697+0000 7f76eaa00640 1 -- 172.21.15.8:0/4225892521 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e40a57a0 con 0x7f76ec0c4e40 2024-03-23T23:43:00.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.697+0000 7f76eaa00640 1 -- 172.21.15.8:0/4225892521 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e40a5940 con 0x7f76ec0c4e40 2024-03-23T23:43:00.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.697+0000 7f76eaa00640 1 -- 172.21.15.8:0/4225892521 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e40a5d10 con 0x7f76ec0c4e40 2024-03-23T23:43:00.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.697+0000 7f76f2800640 1 -- 172.21.15.8:0/4225892521 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76ec0c4e40 msgr2=0x7f76ec161310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.697+0000 7f76f2800640 1 --2- 172.21.15.8:0/4225892521 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76ec0c4e40 0x7f76ec161310 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f76e4009e50 tx=0x7f76e401c8e0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.697+0000 7f76f2800640 1 -- 172.21.15.8:0/4225892521 shutdown_connections 2024-03-23T23:43:00.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.697+0000 7f76f2800640 1 --2- 172.21.15.8:0/4225892521 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76ec0c4e40 0x7f76ec161310 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.697+0000 7f76f2800640 1 -- 172.21.15.8:0/4225892521 >> 172.21.15.8:0/4225892521 conn(0x7f76ec0aafe0 msgr2=0x7f76ec0ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:00.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.697+0000 7f76f2800640 1 -- 172.21.15.8:0/4225892521 shutdown_connections 2024-03-23T23:43:00.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.697+0000 7f76f2800640 1 -- 172.21.15.8:0/4225892521 wait complete. 2024-03-23T23:43:00.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.697+0000 7f76f2800640 1 Processor -- start 2024-03-23T23:43:00.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.697+0000 7f76f2800640 1 -- start start 2024-03-23T23:43:00.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.701+0000 7f76f2800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f76ec0c4e40 0x7f76ec141110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:00.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.701+0000 7f76f2800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76ec0c8a50 0x7f76ec154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:00.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.701+0000 7f76f2800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f76ec154ec0 0x7f76ec141e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:00.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.701+0000 7f76f2800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec0c8e30 con 0x7f76ec0c8a50 2024-03-23T23:43:00.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.701+0000 7f76f2800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec06e1e0 con 0x7f76ec0c4e40 2024-03-23T23:43:00.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.701+0000 7f76f2800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec143da0 con 0x7f76ec154ec0 2024-03-23T23:43:00.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.701+0000 7f76e3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76ec0c8a50 0x7f76ec154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:00.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.701+0000 7f76eb400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f76ec0c4e40 0x7f76ec141110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:00.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.701+0000 7f76eb400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f76ec0c4e40 0x7f76ec141110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:46286/0 (socket says 172.21.15.8:46286) 2024-03-23T23:43:00.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.701+0000 7f76eb400640 1 -- 172.21.15.8:0/1293964046 learned_addr learned my addr 172.21.15.8:0/1293964046 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:00.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.701+0000 7f76ebe00640 1 --2- 172.21.15.8:0/1293964046 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f76ec154ec0 0x7f76ec141e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:00.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.701+0000 7f76e3e00640 1 -- 172.21.15.8:0/1293964046 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f76ec154ec0 msgr2=0x7f76ec141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.701+0000 7f76e3e00640 1 --2- 172.21.15.8:0/1293964046 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f76ec154ec0 0x7f76ec141e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.701+0000 7f76e3e00640 1 -- 172.21.15.8:0/1293964046 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f76ec0c4e40 msgr2=0x7f76ec141110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.701+0000 7f76e3e00640 1 --2- 172.21.15.8:0/1293964046 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f76ec0c4e40 0x7f76ec141110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.701+0000 7f76e3e00640 1 -- 172.21.15.8:0/1293964046 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ec13fc20 con 0x7f76ec0c8a50 2024-03-23T23:43:00.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.701+0000 7f76eb400640 1 --2- 172.21.15.8:0/1293964046 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f76ec0c4e40 0x7f76ec141110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:43:00.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.701+0000 7f76e3e00640 1 --2- 172.21.15.8:0/1293964046 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76ec0c8a50 0x7f76ec154980 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f76d400c390 tx=0x7f76d400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:00.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.701+0000 7f76e3400640 1 -- 172.21.15.8:0/1293964046 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d40074e0 con 0x7f76ec0c8a50 2024-03-23T23:43:00.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.701+0000 7f76e3400640 1 -- 172.21.15.8:0/1293964046 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d4007680 con 0x7f76ec0c8a50 2024-03-23T23:43:00.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.701+0000 7f76e3400640 1 -- 172.21.15.8:0/1293964046 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d4004a10 con 0x7f76ec0c8a50 2024-03-23T23:43:00.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.701+0000 7f76f2800640 1 -- 172.21.15.8:0/1293964046 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76ec13ff00 con 0x7f76ec0c8a50 2024-03-23T23:43:00.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.701+0000 7f76f2800640 1 -- 172.21.15.8:0/1293964046 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76ec1430a0 con 0x7f76ec0c8a50 2024-03-23T23:43:00.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.701+0000 7f76f2800640 1 -- 172.21.15.8:0/1293964046 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76ec068270 con 0x7f76ec0c8a50 2024-03-23T23:43:00.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.705+0000 7f76e3400640 1 -- 172.21.15.8:0/1293964046 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f76d401a020 con 0x7f76ec0c8a50 2024-03-23T23:43:00.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.705+0000 7f76e3400640 1 --2- 172.21.15.8:0/1293964046 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f76c8067690 0x7f76c8069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:00.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.705+0000 7f76e3400640 1 -- 172.21.15.8:0/1293964046 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f76d4085230 con 0x7f76ec0c8a50 2024-03-23T23:43:00.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.705+0000 7f76eb400640 1 --2- 172.21.15.8:0/1293964046 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f76c8067690 0x7f76c8069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:00.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.705+0000 7f76eb400640 1 --2- 172.21.15.8:0/1293964046 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f76c8067690 0x7f76c8069b50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f76dc001c40 tx=0x7f76dc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:00.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.709+0000 7f76e3400640 1 -- 172.21.15.8:0/1293964046 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f76d4055520 con 0x7f76ec0c8a50 2024-03-23T23:43:00.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.873+0000 7f76f2800640 1 -- 172.21.15.8:0/1293964046 --> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f76ec13f5e0 con 0x7f76c8067690 2024-03-23T23:43:00.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.885+0000 7f76e3400640 1 -- 172.21.15.8:0/1293964046 <== mgr.4098 v2:172.21.15.196:6832/1295060067 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+490307 (secure 0 0 0) 0x7f76dc0018e0 con 0x7f76c8067690 2024-03-23T23:43:00.892 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:43:00.896 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-03-23T23:43:00.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.889+0000 7f76f2800640 1 -- 172.21.15.8:0/1293964046 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f76c8067690 msgr2=0x7f76c8069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.889+0000 7f76f2800640 1 --2- 172.21.15.8:0/1293964046 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f76c8067690 0x7f76c8069b50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f76dc001c40 tx=0x7f76dc009040 comp rx=0 tx=0).stop 2024-03-23T23:43:00.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.889+0000 7f76f2800640 1 -- 172.21.15.8:0/1293964046 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76ec0c8a50 msgr2=0x7f76ec154980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:00.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.889+0000 7f76f2800640 1 --2- 172.21.15.8:0/1293964046 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76ec0c8a50 0x7f76ec154980 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f76d400c390 tx=0x7f76d400c850 comp rx=0 tx=0).stop 2024-03-23T23:43:00.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.889+0000 7f76f2800640 1 -- 172.21.15.8:0/1293964046 shutdown_connections 2024-03-23T23:43:00.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.889+0000 7f76f2800640 1 --2- 172.21.15.8:0/1293964046 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f76c8067690 0x7f76c8069b50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.889+0000 7f76f2800640 1 --2- 172.21.15.8:0/1293964046 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f76ec154ec0 0x7f76ec141e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.889+0000 7f76f2800640 1 --2- 172.21.15.8:0/1293964046 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76ec0c8a50 0x7f76ec154980 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.889+0000 7f76f2800640 1 --2- 172.21.15.8:0/1293964046 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f76ec0c4e40 0x7f76ec141110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:00.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.889+0000 7f76f2800640 1 -- 172.21.15.8:0/1293964046 >> 172.21.15.8:0/1293964046 conn(0x7f76ec0aafe0 msgr2=0x7f76ec14a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:00.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.889+0000 7f76f2800640 1 -- 172.21.15.8:0/1293964046 shutdown_connections 2024-03-23T23:43:00.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:00.889+0000 7f76f2800640 1 -- 172.21.15.8:0/1293964046 wait complete. 2024-03-23T23:43:00.913 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-03-23T23:43:00.276639+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":249,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240296,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734424,"statfs":{"total":773094113280,"available":772848050176,"internally_reserved":0,"allocated":3383296,"data_stored":2000152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.547812"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750876+0000","last_change":"2024-03-23T23:42:50.736219+0000","last_active":"2024-03-23T23:42:51.750876+0000","last_peered":"2024-03-23T23:42:51.750876+0000","last_clean":"2024-03-23T23:42:51.750876+0000","last_became_active":"2024-03-23T23:42:50.735940+0000","last_became_peered":"2024-03-23T23:42:50.735940+0000","last_unstale":"2024-03-23T23:42:51.750876+0000","last_undegraded":"2024-03-23T23:42:51.750876+0000","last_fullsized":"2024-03-23T23:42:51.750876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:11:44.111477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763488+0000","last_change":"2024-03-23T23:42:39.693858+0000","last_active":"2024-03-23T23:42:51.763488+0000","last_peered":"2024-03-23T23:42:51.763488+0000","last_clean":"2024-03-23T23:42:51.763488+0000","last_became_active":"2024-03-23T23:42:39.693636+0000","last_became_peered":"2024-03-23T23:42:39.693636+0000","last_unstale":"2024-03-23T23:42:51.763488+0000","last_undegraded":"2024-03-23T23:42:51.763488+0000","last_fullsized":"2024-03-23T23:42:51.763488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:44:07.213123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328567+0000","last_change":"2024-03-23T23:42:40.685708+0000","last_active":"2024-03-23T23:42:52.328567+0000","last_peered":"2024-03-23T23:42:52.328567+0000","last_clean":"2024-03-23T23:42:52.328567+0000","last_became_active":"2024-03-23T23:42:40.682755+0000","last_became_peered":"2024-03-23T23:42:40.682755+0000","last_unstale":"2024-03-23T23:42:52.328567+0000","last_undegraded":"2024-03-23T23:42:52.328567+0000","last_fullsized":"2024-03-23T23:42:52.328567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:04.633288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327590+0000","last_change":"2024-03-23T23:42:49.750108+0000","last_active":"2024-03-23T23:42:52.327590+0000","last_peered":"2024-03-23T23:42:52.327590+0000","last_clean":"2024-03-23T23:42:52.327590+0000","last_became_active":"2024-03-23T23:42:49.749634+0000","last_became_peered":"2024-03-23T23:42:49.749634+0000","last_unstale":"2024-03-23T23:42:52.327590+0000","last_undegraded":"2024-03-23T23:42:52.327590+0000","last_fullsized":"2024-03-23T23:42:52.327590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:49:16.758908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766376+0000","last_change":"2024-03-23T23:42:50.752450+0000","last_active":"2024-03-23T23:42:51.766376+0000","last_peered":"2024-03-23T23:42:51.766376+0000","last_clean":"2024-03-23T23:42:51.766376+0000","last_became_active":"2024-03-23T23:42:50.752078+0000","last_became_peered":"2024-03-23T23:42:50.752078+0000","last_unstale":"2024-03-23T23:42:51.766376+0000","last_undegraded":"2024-03-23T23:42:51.766376+0000","last_fullsized":"2024-03-23T23:42:51.766376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:28:43.677331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328677+0000","last_change":"2024-03-23T23:42:39.687108+0000","last_active":"2024-03-23T23:42:52.328677+0000","last_peered":"2024-03-23T23:42:52.328677+0000","last_clean":"2024-03-23T23:42:52.328677+0000","last_became_active":"2024-03-23T23:42:39.686875+0000","last_became_peered":"2024-03-23T23:42:39.686875+0000","last_unstale":"2024-03-23T23:42:52.328677+0000","last_undegraded":"2024-03-23T23:42:52.328677+0000","last_fullsized":"2024-03-23T23:42:52.328677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:05:52.079172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763410+0000","last_change":"2024-03-23T23:42:40.698746+0000","last_active":"2024-03-23T23:42:51.763410+0000","last_peered":"2024-03-23T23:42:51.763410+0000","last_clean":"2024-03-23T23:42:51.763410+0000","last_became_active":"2024-03-23T23:42:40.698003+0000","last_became_peered":"2024-03-23T23:42:40.698003+0000","last_unstale":"2024-03-23T23:42:51.763410+0000","last_undegraded":"2024-03-23T23:42:51.763410+0000","last_fullsized":"2024-03-23T23:42:51.763410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:53:46.437114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751376+0000","last_change":"2024-03-23T23:42:49.728923+0000","last_active":"2024-03-23T23:42:51.751376+0000","last_peered":"2024-03-23T23:42:51.751376+0000","last_clean":"2024-03-23T23:42:51.751376+0000","last_became_active":"2024-03-23T23:42:49.728261+0000","last_became_peered":"2024-03-23T23:42:49.728261+0000","last_unstale":"2024-03-23T23:42:51.751376+0000","last_undegraded":"2024-03-23T23:42:51.751376+0000","last_fullsized":"2024-03-23T23:42:51.751376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:22.375891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189476+0000","last_change":"2024-03-23T23:42:50.755852+0000","last_active":"2024-03-23T23:42:52.189476+0000","last_peered":"2024-03-23T23:42:52.189476+0000","last_clean":"2024-03-23T23:42:52.189476+0000","last_became_active":"2024-03-23T23:42:50.755600+0000","last_became_peered":"2024-03-23T23:42:50.755600+0000","last_unstale":"2024-03-23T23:42:52.189476+0000","last_undegraded":"2024-03-23T23:42:52.189476+0000","last_fullsized":"2024-03-23T23:42:52.189476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:29:47.303374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190128+0000","last_change":"2024-03-23T23:42:39.696690+0000","last_active":"2024-03-23T23:42:52.190128+0000","last_peered":"2024-03-23T23:42:52.190128+0000","last_clean":"2024-03-23T23:42:52.190128+0000","last_became_active":"2024-03-23T23:42:39.696342+0000","last_became_peered":"2024-03-23T23:42:39.696342+0000","last_unstale":"2024-03-23T23:42:52.190128+0000","last_undegraded":"2024-03-23T23:42:52.190128+0000","last_fullsized":"2024-03-23T23:42:52.190128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:42:37.702720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328460+0000","last_change":"2024-03-23T23:42:40.700355+0000","last_active":"2024-03-23T23:42:52.328460+0000","last_peered":"2024-03-23T23:42:52.328460+0000","last_clean":"2024-03-23T23:42:52.328460+0000","last_became_active":"2024-03-23T23:42:40.697668+0000","last_became_peered":"2024-03-23T23:42:40.697668+0000","last_unstale":"2024-03-23T23:42:52.328460+0000","last_undegraded":"2024-03-23T23:42:52.328460+0000","last_fullsized":"2024-03-23T23:42:52.328460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:23:43.515519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751380+0000","last_change":"2024-03-23T23:42:49.744792+0000","last_active":"2024-03-23T23:42:51.751380+0000","last_peered":"2024-03-23T23:42:51.751380+0000","last_clean":"2024-03-23T23:42:51.751380+0000","last_became_active":"2024-03-23T23:42:49.744561+0000","last_became_peered":"2024-03-23T23:42:49.744561+0000","last_unstale":"2024-03-23T23:42:51.751380+0000","last_undegraded":"2024-03-23T23:42:51.751380+0000","last_fullsized":"2024-03-23T23:42:51.751380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:07:58.222020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328699+0000","last_change":"2024-03-23T23:42:50.755575+0000","last_active":"2024-03-23T23:42:52.328699+0000","last_peered":"2024-03-23T23:42:52.328699+0000","last_clean":"2024-03-23T23:42:52.328699+0000","last_became_active":"2024-03-23T23:42:50.755337+0000","last_became_peered":"2024-03-23T23:42:50.755337+0000","last_unstale":"2024-03-23T23:42:52.328699+0000","last_undegraded":"2024-03-23T23:42:52.328699+0000","last_fullsized":"2024-03-23T23:42:52.328699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:13.911327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189958+0000","last_change":"2024-03-23T23:42:39.696707+0000","last_active":"2024-03-23T23:42:52.189958+0000","last_peered":"2024-03-23T23:42:52.189958+0000","last_clean":"2024-03-23T23:42:52.189958+0000","last_became_active":"2024-03-23T23:42:39.696401+0000","last_became_peered":"2024-03-23T23:42:39.696401+0000","last_unstale":"2024-03-23T23:42:52.189958+0000","last_undegraded":"2024-03-23T23:42:52.189958+0000","last_fullsized":"2024-03-23T23:42:52.189958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:55.757707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328921+0000","last_change":"2024-03-23T23:42:40.700389+0000","last_active":"2024-03-23T23:42:52.328921+0000","last_peered":"2024-03-23T23:42:52.328921+0000","last_clean":"2024-03-23T23:42:52.328921+0000","last_became_active":"2024-03-23T23:42:40.699770+0000","last_became_peered":"2024-03-23T23:42:40.699770+0000","last_unstale":"2024-03-23T23:42:52.328921+0000","last_undegraded":"2024-03-23T23:42:52.328921+0000","last_fullsized":"2024-03-23T23:42:52.328921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:27.675824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751083+0000","last_change":"2024-03-23T23:42:49.745710+0000","last_active":"2024-03-23T23:42:51.751083+0000","last_peered":"2024-03-23T23:42:51.751083+0000","last_clean":"2024-03-23T23:42:51.751083+0000","last_became_active":"2024-03-23T23:42:49.745526+0000","last_became_peered":"2024-03-23T23:42:49.745526+0000","last_unstale":"2024-03-23T23:42:51.751083+0000","last_undegraded":"2024-03-23T23:42:51.751083+0000","last_fullsized":"2024-03-23T23:42:51.751083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:05:26.746849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766631+0000","last_change":"2024-03-23T23:42:50.747274+0000","last_active":"2024-03-23T23:42:51.766631+0000","last_peered":"2024-03-23T23:42:51.766631+0000","last_clean":"2024-03-23T23:42:51.766631+0000","last_became_active":"2024-03-23T23:42:50.746937+0000","last_became_peered":"2024-03-23T23:42:50.746937+0000","last_unstale":"2024-03-23T23:42:51.766631+0000","last_undegraded":"2024-03-23T23:42:51.766631+0000","last_fullsized":"2024-03-23T23:42:51.766631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:19.610436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751450+0000","last_change":"2024-03-23T23:42:40.682467+0000","last_active":"2024-03-23T23:42:51.751450+0000","last_peered":"2024-03-23T23:42:51.751450+0000","last_clean":"2024-03-23T23:42:51.751450+0000","last_became_active":"2024-03-23T23:42:40.682192+0000","last_became_peered":"2024-03-23T23:42:40.682192+0000","last_unstale":"2024-03-23T23:42:51.751450+0000","last_undegraded":"2024-03-23T23:42:51.751450+0000","last_fullsized":"2024-03-23T23:42:51.751450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:37:24.839568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189778+0000","last_change":"2024-03-23T23:42:39.696528+0000","last_active":"2024-03-23T23:42:52.189778+0000","last_peered":"2024-03-23T23:42:52.189778+0000","last_clean":"2024-03-23T23:42:52.189778+0000","last_became_active":"2024-03-23T23:42:39.696207+0000","last_became_peered":"2024-03-23T23:42:39.696207+0000","last_unstale":"2024-03-23T23:42:52.189778+0000","last_undegraded":"2024-03-23T23:42:52.189778+0000","last_fullsized":"2024-03-23T23:42:52.189778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:02.190910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751687+0000","last_change":"2024-03-23T23:42:49.734156+0000","last_active":"2024-03-23T23:42:51.751687+0000","last_peered":"2024-03-23T23:42:51.751687+0000","last_clean":"2024-03-23T23:42:51.751687+0000","last_became_active":"2024-03-23T23:42:49.733888+0000","last_became_peered":"2024-03-23T23:42:49.733888+0000","last_unstale":"2024-03-23T23:42:51.751687+0000","last_undegraded":"2024-03-23T23:42:51.751687+0000","last_fullsized":"2024-03-23T23:42:51.751687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:23:52.568123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749858+0000","last_change":"2024-03-23T23:42:50.759749+0000","last_active":"2024-03-23T23:42:51.749858+0000","last_peered":"2024-03-23T23:42:51.749858+0000","last_clean":"2024-03-23T23:42:51.749858+0000","last_became_active":"2024-03-23T23:42:50.758670+0000","last_became_peered":"2024-03-23T23:42:50.758670+0000","last_unstale":"2024-03-23T23:42:51.749858+0000","last_undegraded":"2024-03-23T23:42:51.749858+0000","last_fullsized":"2024-03-23T23:42:51.749858+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:16:02.318732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327985+0000","last_change":"2024-03-23T23:42:40.674574+0000","last_active":"2024-03-23T23:42:52.327985+0000","last_peered":"2024-03-23T23:42:52.327985+0000","last_clean":"2024-03-23T23:42:52.327985+0000","last_became_active":"2024-03-23T23:42:40.674293+0000","last_became_peered":"2024-03-23T23:42:40.674293+0000","last_unstale":"2024-03-23T23:42:52.327985+0000","last_undegraded":"2024-03-23T23:42:52.327985+0000","last_fullsized":"2024-03-23T23:42:52.327985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:37:24.839568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767035+0000","last_change":"2024-03-23T23:42:39.683165+0000","last_active":"2024-03-23T23:42:51.767035+0000","last_peered":"2024-03-23T23:42:51.767035+0000","last_clean":"2024-03-23T23:42:51.767035+0000","last_became_active":"2024-03-23T23:42:39.680121+0000","last_became_peered":"2024-03-23T23:42:39.680121+0000","last_unstale":"2024-03-23T23:42:51.767035+0000","last_undegraded":"2024-03-23T23:42:51.767035+0000","last_fullsized":"2024-03-23T23:42:51.767035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:02.190910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752029+0000","last_change":"2024-03-23T23:42:49.745016+0000","last_active":"2024-03-23T23:42:51.752029+0000","last_peered":"2024-03-23T23:42:51.752029+0000","last_clean":"2024-03-23T23:42:51.752029+0000","last_became_active":"2024-03-23T23:42:49.744742+0000","last_became_peered":"2024-03-23T23:42:49.744742+0000","last_unstale":"2024-03-23T23:42:51.752029+0000","last_undegraded":"2024-03-23T23:42:51.752029+0000","last_fullsized":"2024-03-23T23:42:51.752029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:30.033743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751217+0000","last_change":"2024-03-23T23:42:50.749792+0000","last_active":"2024-03-23T23:42:51.751217+0000","last_peered":"2024-03-23T23:42:51.751217+0000","last_clean":"2024-03-23T23:42:51.751217+0000","last_became_active":"2024-03-23T23:42:50.749491+0000","last_became_peered":"2024-03-23T23:42:50.749491+0000","last_unstale":"2024-03-23T23:42:51.751217+0000","last_undegraded":"2024-03-23T23:42:51.751217+0000","last_fullsized":"2024-03-23T23:42:51.751217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:25:44.894505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327680+0000","last_change":"2024-03-23T23:42:40.682999+0000","last_active":"2024-03-23T23:42:52.327680+0000","last_peered":"2024-03-23T23:42:52.327680+0000","last_clean":"2024-03-23T23:42:52.327680+0000","last_became_active":"2024-03-23T23:42:40.682672+0000","last_became_peered":"2024-03-23T23:42:40.682672+0000","last_unstale":"2024-03-23T23:42:52.327680+0000","last_undegraded":"2024-03-23T23:42:52.327680+0000","last_fullsized":"2024-03-23T23:42:52.327680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:59:45.154553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767148+0000","last_change":"2024-03-23T23:42:39.691470+0000","last_active":"2024-03-23T23:42:51.767148+0000","last_peered":"2024-03-23T23:42:51.767148+0000","last_clean":"2024-03-23T23:42:51.767148+0000","last_became_active":"2024-03-23T23:42:39.691124+0000","last_became_peered":"2024-03-23T23:42:39.691124+0000","last_unstale":"2024-03-23T23:42:51.767148+0000","last_undegraded":"2024-03-23T23:42:51.767148+0000","last_fullsized":"2024-03-23T23:42:51.767148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:55.757707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767321+0000","last_change":"2024-03-23T23:42:49.750016+0000","last_active":"2024-03-23T23:42:51.767321+0000","last_peered":"2024-03-23T23:42:51.767321+0000","last_clean":"2024-03-23T23:42:51.767321+0000","last_became_active":"2024-03-23T23:42:49.749279+0000","last_became_peered":"2024-03-23T23:42:49.749279+0000","last_unstale":"2024-03-23T23:42:51.767321+0000","last_undegraded":"2024-03-23T23:42:51.767321+0000","last_fullsized":"2024-03-23T23:42:51.767321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:41:14.671834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328693+0000","last_change":"2024-03-23T23:42:50.753669+0000","last_active":"2024-03-23T23:42:52.328693+0000","last_peered":"2024-03-23T23:42:52.328693+0000","last_clean":"2024-03-23T23:42:52.328693+0000","last_became_active":"2024-03-23T23:42:50.752674+0000","last_became_peered":"2024-03-23T23:42:50.752674+0000","last_unstale":"2024-03-23T23:42:52.328693+0000","last_undegraded":"2024-03-23T23:42:52.328693+0000","last_fullsized":"2024-03-23T23:42:52.328693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:39:04.727316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751477+0000","last_change":"2024-03-23T23:42:40.685051+0000","last_active":"2024-03-23T23:42:51.751477+0000","last_peered":"2024-03-23T23:42:51.751477+0000","last_clean":"2024-03-23T23:42:51.751477+0000","last_became_active":"2024-03-23T23:42:40.684677+0000","last_became_peered":"2024-03-23T23:42:40.684677+0000","last_unstale":"2024-03-23T23:42:51.751477+0000","last_undegraded":"2024-03-23T23:42:51.751477+0000","last_fullsized":"2024-03-23T23:42:51.751477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:20.920978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189995+0000","last_change":"2024-03-23T23:42:39.695253+0000","last_active":"2024-03-23T23:42:52.189995+0000","last_peered":"2024-03-23T23:42:52.189995+0000","last_clean":"2024-03-23T23:42:52.189995+0000","last_became_active":"2024-03-23T23:42:39.694746+0000","last_became_peered":"2024-03-23T23:42:39.694746+0000","last_unstale":"2024-03-23T23:42:52.189995+0000","last_undegraded":"2024-03-23T23:42:52.189995+0000","last_fullsized":"2024-03-23T23:42:52.189995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:57.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752459+0000","last_change":"2024-03-23T23:42:49.724285+0000","last_active":"2024-03-23T23:42:51.752459+0000","last_peered":"2024-03-23T23:42:51.752459+0000","last_clean":"2024-03-23T23:42:51.752459+0000","last_became_active":"2024-03-23T23:42:49.724009+0000","last_became_peered":"2024-03-23T23:42:49.724009+0000","last_unstale":"2024-03-23T23:42:51.752459+0000","last_undegraded":"2024-03-23T23:42:51.752459+0000","last_fullsized":"2024-03-23T23:42:51.752459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:01:04.035970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327444+0000","last_change":"2024-03-23T23:42:50.746737+0000","last_active":"2024-03-23T23:42:52.327444+0000","last_peered":"2024-03-23T23:42:52.327444+0000","last_clean":"2024-03-23T23:42:52.327444+0000","last_became_active":"2024-03-23T23:42:50.746492+0000","last_became_peered":"2024-03-23T23:42:50.746492+0000","last_unstale":"2024-03-23T23:42:52.327444+0000","last_undegraded":"2024-03-23T23:42:52.327444+0000","last_fullsized":"2024-03-23T23:42:52.327444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:50.597847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763599+0000","last_change":"2024-03-23T23:42:40.680963+0000","last_active":"2024-03-23T23:42:51.763599+0000","last_peered":"2024-03-23T23:42:51.763599+0000","last_clean":"2024-03-23T23:42:51.763599+0000","last_became_active":"2024-03-23T23:42:40.680744+0000","last_became_peered":"2024-03-23T23:42:40.680744+0000","last_unstale":"2024-03-23T23:42:51.763599+0000","last_undegraded":"2024-03-23T23:42:51.763599+0000","last_fullsized":"2024-03-23T23:42:51.763599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:17:19.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.753179+0000","last_change":"2024-03-23T23:42:39.691813+0000","last_active":"2024-03-23T23:42:51.753179+0000","last_peered":"2024-03-23T23:42:51.753179+0000","last_clean":"2024-03-23T23:42:51.753179+0000","last_became_active":"2024-03-23T23:42:39.691519+0000","last_became_peered":"2024-03-23T23:42:39.691519+0000","last_unstale":"2024-03-23T23:42:51.753179+0000","last_undegraded":"2024-03-23T23:42:51.753179+0000","last_fullsized":"2024-03-23T23:42:51.753179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:27:41.386662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751110+0000","last_change":"2024-03-23T23:42:49.734197+0000","last_active":"2024-03-23T23:42:51.751110+0000","last_peered":"2024-03-23T23:42:51.751110+0000","last_clean":"2024-03-23T23:42:51.751110+0000","last_became_active":"2024-03-23T23:42:49.733715+0000","last_became_peered":"2024-03-23T23:42:49.733715+0000","last_unstale":"2024-03-23T23:42:51.751110+0000","last_undegraded":"2024-03-23T23:42:51.751110+0000","last_fullsized":"2024-03-23T23:42:51.751110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:36.728428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750902+0000","last_change":"2024-03-23T23:42:50.739957+0000","last_active":"2024-03-23T23:42:51.750902+0000","last_peered":"2024-03-23T23:42:51.750902+0000","last_clean":"2024-03-23T23:42:51.750902+0000","last_became_active":"2024-03-23T23:42:50.739706+0000","last_became_peered":"2024-03-23T23:42:50.739706+0000","last_unstale":"2024-03-23T23:42:51.750902+0000","last_undegraded":"2024-03-23T23:42:51.750902+0000","last_fullsized":"2024-03-23T23:42:51.750902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:49:17.763463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328339+0000","last_change":"2024-03-23T23:42:40.686865+0000","last_active":"2024-03-23T23:42:52.328339+0000","last_peered":"2024-03-23T23:42:52.328339+0000","last_clean":"2024-03-23T23:42:52.328339+0000","last_became_active":"2024-03-23T23:42:40.686582+0000","last_became_peered":"2024-03-23T23:42:40.686582+0000","last_unstale":"2024-03-23T23:42:52.328339+0000","last_undegraded":"2024-03-23T23:42:52.328339+0000","last_fullsized":"2024-03-23T23:42:52.328339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:05:17.694245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767041+0000","last_change":"2024-03-23T23:42:39.678962+0000","last_active":"2024-03-23T23:42:51.767041+0000","last_peered":"2024-03-23T23:42:51.767041+0000","last_clean":"2024-03-23T23:42:51.767041+0000","last_became_active":"2024-03-23T23:42:39.678603+0000","last_became_peered":"2024-03-23T23:42:39.678603+0000","last_unstale":"2024-03-23T23:42:51.767041+0000","last_undegraded":"2024-03-23T23:42:51.767041+0000","last_fullsized":"2024-03-23T23:42:51.767041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:43:46.206865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327329+0000","last_change":"2024-03-23T23:42:49.740561+0000","last_active":"2024-03-23T23:42:52.327329+0000","last_peered":"2024-03-23T23:42:52.327329+0000","last_clean":"2024-03-23T23:42:52.327329+0000","last_became_active":"2024-03-23T23:42:49.740290+0000","last_became_peered":"2024-03-23T23:42:49.740290+0000","last_unstale":"2024-03-23T23:42:52.327329+0000","last_undegraded":"2024-03-23T23:42:52.327329+0000","last_fullsized":"2024-03-23T23:42:52.327329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:21:24.160603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751249+0000","last_change":"2024-03-23T23:42:50.751107+0000","last_active":"2024-03-23T23:42:51.751249+0000","last_peered":"2024-03-23T23:42:51.751249+0000","last_clean":"2024-03-23T23:42:51.751249+0000","last_became_active":"2024-03-23T23:42:50.750859+0000","last_became_peered":"2024-03-23T23:42:50.750859+0000","last_unstale":"2024-03-23T23:42:51.751249+0000","last_undegraded":"2024-03-23T23:42:51.751249+0000","last_fullsized":"2024-03-23T23:42:51.751249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:49:17.763463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766837+0000","last_change":"2024-03-23T23:42:40.686486+0000","last_active":"2024-03-23T23:42:51.766837+0000","last_peered":"2024-03-23T23:42:51.766837+0000","last_clean":"2024-03-23T23:42:51.766837+0000","last_became_active":"2024-03-23T23:42:40.686186+0000","last_became_peered":"2024-03-23T23:42:40.686186+0000","last_unstale":"2024-03-23T23:42:51.766837+0000","last_undegraded":"2024-03-23T23:42:51.766837+0000","last_fullsized":"2024-03-23T23:42:51.766837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:46:30.427072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190217+0000","last_change":"2024-03-23T23:42:39.695099+0000","last_active":"2024-03-23T23:42:52.190217+0000","last_peered":"2024-03-23T23:42:52.190217+0000","last_clean":"2024-03-23T23:42:52.190217+0000","last_became_active":"2024-03-23T23:42:39.694720+0000","last_became_peered":"2024-03-23T23:42:39.694720+0000","last_unstale":"2024-03-23T23:42:52.190217+0000","last_undegraded":"2024-03-23T23:42:52.190217+0000","last_fullsized":"2024-03-23T23:42:52.190217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:58:07.880313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.762762+0000","last_change":"2024-03-23T23:42:49.739099+0000","last_active":"2024-03-23T23:42:51.762762+0000","last_peered":"2024-03-23T23:42:51.762762+0000","last_clean":"2024-03-23T23:42:51.762762+0000","last_became_active":"2024-03-23T23:42:49.738198+0000","last_became_peered":"2024-03-23T23:42:49.738198+0000","last_unstale":"2024-03-23T23:42:51.762762+0000","last_undegraded":"2024-03-23T23:42:51.762762+0000","last_fullsized":"2024-03-23T23:42:51.762762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:57:34.600362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.762957+0000","last_change":"2024-03-23T23:42:50.754941+0000","last_active":"2024-03-23T23:42:51.762957+0000","last_peered":"2024-03-23T23:42:51.762957+0000","last_clean":"2024-03-23T23:42:51.762957+0000","last_became_active":"2024-03-23T23:42:50.754585+0000","last_became_peered":"2024-03-23T23:42:50.754585+0000","last_unstale":"2024-03-23T23:42:51.762957+0000","last_undegraded":"2024-03-23T23:42:51.762957+0000","last_fullsized":"2024-03-23T23:42:51.762957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:42:23.236324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328954+0000","last_change":"2024-03-23T23:42:40.700610+0000","last_active":"2024-03-23T23:42:52.328954+0000","last_peered":"2024-03-23T23:42:52.328954+0000","last_clean":"2024-03-23T23:42:52.328954+0000","last_became_active":"2024-03-23T23:42:40.700112+0000","last_became_peered":"2024-03-23T23:42:40.700112+0000","last_unstale":"2024-03-23T23:42:52.328954+0000","last_undegraded":"2024-03-23T23:42:52.328954+0000","last_fullsized":"2024-03-23T23:42:52.328954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:07:49.169416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766866+0000","last_change":"2024-03-23T23:42:39.686509+0000","last_active":"2024-03-23T23:42:51.766866+0000","last_peered":"2024-03-23T23:42:51.766866+0000","last_clean":"2024-03-23T23:42:51.766866+0000","last_became_active":"2024-03-23T23:42:39.686094+0000","last_became_peered":"2024-03-23T23:42:39.686094+0000","last_unstale":"2024-03-23T23:42:51.766866+0000","last_undegraded":"2024-03-23T23:42:51.766866+0000","last_fullsized":"2024-03-23T23:42:51.766866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:57:20.394530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766601+0000","last_change":"2024-03-23T23:42:49.738274+0000","last_active":"2024-03-23T23:42:51.766601+0000","last_peered":"2024-03-23T23:42:51.766601+0000","last_clean":"2024-03-23T23:42:51.766601+0000","last_became_active":"2024-03-23T23:42:49.737916+0000","last_became_peered":"2024-03-23T23:42:49.737916+0000","last_unstale":"2024-03-23T23:42:51.766601+0000","last_undegraded":"2024-03-23T23:42:51.766601+0000","last_fullsized":"2024-03-23T23:42:51.766601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:18:12.997092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763279+0000","last_change":"2024-03-23T23:42:50.764148+0000","last_active":"2024-03-23T23:42:51.763279+0000","last_peered":"2024-03-23T23:42:51.763279+0000","last_clean":"2024-03-23T23:42:51.763279+0000","last_became_active":"2024-03-23T23:42:50.763768+0000","last_became_peered":"2024-03-23T23:42:50.763768+0000","last_unstale":"2024-03-23T23:42:51.763279+0000","last_undegraded":"2024-03-23T23:42:51.763279+0000","last_fullsized":"2024-03-23T23:42:51.763279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:52:48.699642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751565+0000","last_change":"2024-03-23T23:42:40.679988+0000","last_active":"2024-03-23T23:42:51.751565+0000","last_peered":"2024-03-23T23:42:51.751565+0000","last_clean":"2024-03-23T23:42:51.751565+0000","last_became_active":"2024-03-23T23:42:40.679488+0000","last_became_peered":"2024-03-23T23:42:40.679488+0000","last_unstale":"2024-03-23T23:42:51.751565+0000","last_undegraded":"2024-03-23T23:42:51.751565+0000","last_fullsized":"2024-03-23T23:42:51.751565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:10:32.251287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328493+0000","last_change":"2024-03-23T23:42:39.679741+0000","last_active":"2024-03-23T23:42:52.328493+0000","last_peered":"2024-03-23T23:42:52.328493+0000","last_clean":"2024-03-23T23:42:52.328493+0000","last_became_active":"2024-03-23T23:42:39.678864+0000","last_became_peered":"2024-03-23T23:42:39.678864+0000","last_unstale":"2024-03-23T23:42:52.328493+0000","last_undegraded":"2024-03-23T23:42:52.328493+0000","last_fullsized":"2024-03-23T23:42:52.328493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:50.559059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766763+0000","last_change":"2024-03-23T23:42:49.739837+0000","last_active":"2024-03-23T23:42:51.766763+0000","last_peered":"2024-03-23T23:42:51.766763+0000","last_clean":"2024-03-23T23:42:51.766763+0000","last_became_active":"2024-03-23T23:42:49.739570+0000","last_became_peered":"2024-03-23T23:42:49.739570+0000","last_unstale":"2024-03-23T23:42:51.766763+0000","last_undegraded":"2024-03-23T23:42:51.766763+0000","last_fullsized":"2024-03-23T23:42:51.766763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:57:34.600362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749980+0000","last_change":"2024-03-23T23:42:50.753912+0000","last_active":"2024-03-23T23:42:51.749980+0000","last_peered":"2024-03-23T23:42:51.749980+0000","last_clean":"2024-03-23T23:42:51.749980+0000","last_became_active":"2024-03-23T23:42:50.753629+0000","last_became_peered":"2024-03-23T23:42:50.753629+0000","last_unstale":"2024-03-23T23:42:51.749980+0000","last_undegraded":"2024-03-23T23:42:51.749980+0000","last_fullsized":"2024-03-23T23:42:51.749980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:40:32.748113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766326+0000","last_change":"2024-03-23T23:42:40.682840+0000","last_active":"2024-03-23T23:42:51.766326+0000","last_peered":"2024-03-23T23:42:51.766326+0000","last_clean":"2024-03-23T23:42:51.766326+0000","last_became_active":"2024-03-23T23:42:40.682391+0000","last_became_peered":"2024-03-23T23:42:40.682391+0000","last_unstale":"2024-03-23T23:42:51.766326+0000","last_undegraded":"2024-03-23T23:42:51.766326+0000","last_fullsized":"2024-03-23T23:42:51.766326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:42:14.952953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749558+0000","last_change":"2024-03-23T23:42:39.680763+0000","last_active":"2024-03-23T23:42:51.749558+0000","last_peered":"2024-03-23T23:42:51.749558+0000","last_clean":"2024-03-23T23:42:51.749558+0000","last_became_active":"2024-03-23T23:42:39.680494+0000","last_became_peered":"2024-03-23T23:42:39.680494+0000","last_unstale":"2024-03-23T23:42:51.749558+0000","last_undegraded":"2024-03-23T23:42:51.749558+0000","last_fullsized":"2024-03-23T23:42:51.749558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:57.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767406+0000","last_change":"2024-03-23T23:42:49.737456+0000","last_active":"2024-03-23T23:42:51.767406+0000","last_peered":"2024-03-23T23:42:51.767406+0000","last_clean":"2024-03-23T23:42:51.767406+0000","last_became_active":"2024-03-23T23:42:49.737196+0000","last_became_peered":"2024-03-23T23:42:49.737196+0000","last_unstale":"2024-03-23T23:42:51.767406+0000","last_undegraded":"2024-03-23T23:42:51.767406+0000","last_fullsized":"2024-03-23T23:42:51.767406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:49:42.789292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.329037+0000","last_change":"2024-03-23T23:42:50.763308+0000","last_active":"2024-03-23T23:42:52.329037+0000","last_peered":"2024-03-23T23:42:52.329037+0000","last_clean":"2024-03-23T23:42:52.329037+0000","last_became_active":"2024-03-23T23:42:50.763007+0000","last_became_peered":"2024-03-23T23:42:50.763007+0000","last_unstale":"2024-03-23T23:42:52.329037+0000","last_undegraded":"2024-03-23T23:42:52.329037+0000","last_fullsized":"2024-03-23T23:42:52.329037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:32:46.055472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.762549+0000","last_change":"2024-03-23T23:42:40.675570+0000","last_active":"2024-03-23T23:42:51.762549+0000","last_peered":"2024-03-23T23:42:51.762549+0000","last_clean":"2024-03-23T23:42:51.762549+0000","last_became_active":"2024-03-23T23:42:40.674390+0000","last_became_peered":"2024-03-23T23:42:40.674390+0000","last_unstale":"2024-03-23T23:42:51.762549+0000","last_undegraded":"2024-03-23T23:42:51.762549+0000","last_fullsized":"2024-03-23T23:42:51.762549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:31:34.412092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189672+0000","last_change":"2024-03-23T23:42:39.690057+0000","last_active":"2024-03-23T23:42:52.189672+0000","last_peered":"2024-03-23T23:42:52.189672+0000","last_clean":"2024-03-23T23:42:52.189672+0000","last_became_active":"2024-03-23T23:42:39.689763+0000","last_became_peered":"2024-03-23T23:42:39.689763+0000","last_unstale":"2024-03-23T23:42:52.189672+0000","last_undegraded":"2024-03-23T23:42:52.189672+0000","last_fullsized":"2024-03-23T23:42:52.189672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:01.607584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763516+0000","last_change":"2024-03-23T23:42:49.734213+0000","last_active":"2024-03-23T23:42:51.763516+0000","last_peered":"2024-03-23T23:42:51.763516+0000","last_clean":"2024-03-23T23:42:51.763516+0000","last_became_active":"2024-03-23T23:42:49.733115+0000","last_became_peered":"2024-03-23T23:42:49.733115+0000","last_unstale":"2024-03-23T23:42:51.763516+0000","last_undegraded":"2024-03-23T23:42:51.763516+0000","last_fullsized":"2024-03-23T23:42:51.763516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:18:12.997092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189689+0000","last_change":"2024-03-23T23:42:50.759000+0000","last_active":"2024-03-23T23:42:52.189689+0000","last_peered":"2024-03-23T23:42:52.189689+0000","last_clean":"2024-03-23T23:42:52.189689+0000","last_became_active":"2024-03-23T23:42:50.758552+0000","last_became_peered":"2024-03-23T23:42:50.758552+0000","last_unstale":"2024-03-23T23:42:52.189689+0000","last_undegraded":"2024-03-23T23:42:52.189689+0000","last_fullsized":"2024-03-23T23:42:52.189689+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:04:26.911514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327764+0000","last_change":"2024-03-23T23:42:40.700998+0000","last_active":"2024-03-23T23:42:52.327764+0000","last_peered":"2024-03-23T23:42:52.327764+0000","last_clean":"2024-03-23T23:42:52.327764+0000","last_became_active":"2024-03-23T23:42:40.700788+0000","last_became_peered":"2024-03-23T23:42:40.700788+0000","last_unstale":"2024-03-23T23:42:52.327764+0000","last_undegraded":"2024-03-23T23:42:52.327764+0000","last_fullsized":"2024-03-23T23:42:52.327764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:14:44.739525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328524+0000","last_change":"2024-03-23T23:42:39.687712+0000","last_active":"2024-03-23T23:42:52.328524+0000","last_peered":"2024-03-23T23:42:52.328524+0000","last_clean":"2024-03-23T23:42:52.328524+0000","last_became_active":"2024-03-23T23:42:39.687378+0000","last_became_peered":"2024-03-23T23:42:39.687378+0000","last_unstale":"2024-03-23T23:42:52.328524+0000","last_undegraded":"2024-03-23T23:42:52.328524+0000","last_fullsized":"2024-03-23T23:42:52.328524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:20:38.456655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189176+0000","last_change":"2024-03-23T23:42:27.940270+0000","last_active":"2024-03-23T23:42:52.189176+0000","last_peered":"2024-03-23T23:42:52.189176+0000","last_clean":"2024-03-23T23:42:52.189176+0000","last_became_active":"2024-03-23T23:42:27.939061+0000","last_became_peered":"2024-03-23T23:42:27.939061+0000","last_unstale":"2024-03-23T23:42:52.189176+0000","last_undegraded":"2024-03-23T23:42:52.189176+0000","last_fullsized":"2024-03-23T23:42:52.189176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:26.509742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:26.509742+0000","last_clean_scrub_stamp":"2024-03-23T23:42:26.509742+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:49.258623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752132+0000","last_change":"2024-03-23T23:42:49.729231+0000","last_active":"2024-03-23T23:42:51.752132+0000","last_peered":"2024-03-23T23:42:51.752132+0000","last_clean":"2024-03-23T23:42:51.752132+0000","last_became_active":"2024-03-23T23:42:49.728990+0000","last_became_peered":"2024-03-23T23:42:49.728990+0000","last_unstale":"2024-03-23T23:42:51.752132+0000","last_undegraded":"2024-03-23T23:42:51.752132+0000","last_fullsized":"2024-03-23T23:42:51.752132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:01:04.035970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749662+0000","last_change":"2024-03-23T23:42:50.757668+0000","last_active":"2024-03-23T23:42:51.749662+0000","last_peered":"2024-03-23T23:42:51.749662+0000","last_clean":"2024-03-23T23:42:51.749662+0000","last_became_active":"2024-03-23T23:42:50.756900+0000","last_became_peered":"2024-03-23T23:42:50.756900+0000","last_unstale":"2024-03-23T23:42:51.749662+0000","last_undegraded":"2024-03-23T23:42:51.749662+0000","last_fullsized":"2024-03-23T23:42:51.749662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:24:53.959288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190056+0000","last_change":"2024-03-23T23:42:40.711591+0000","last_active":"2024-03-23T23:42:52.190056+0000","last_peered":"2024-03-23T23:42:52.190056+0000","last_clean":"2024-03-23T23:42:52.190056+0000","last_became_active":"2024-03-23T23:42:40.711306+0000","last_became_peered":"2024-03-23T23:42:40.711306+0000","last_unstale":"2024-03-23T23:42:52.190056+0000","last_undegraded":"2024-03-23T23:42:52.190056+0000","last_fullsized":"2024-03-23T23:42:52.190056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:34:16.693372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749901+0000","last_change":"2024-03-23T23:42:39.684163+0000","last_active":"2024-03-23T23:42:51.749901+0000","last_peered":"2024-03-23T23:42:51.749901+0000","last_clean":"2024-03-23T23:42:51.749901+0000","last_became_active":"2024-03-23T23:42:39.683211+0000","last_became_peered":"2024-03-23T23:42:39.683211+0000","last_unstale":"2024-03-23T23:42:51.749901+0000","last_undegraded":"2024-03-23T23:42:51.749901+0000","last_fullsized":"2024-03-23T23:42:51.749901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:47:27.092873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751343+0000","last_change":"2024-03-23T23:42:49.735824+0000","last_active":"2024-03-23T23:42:51.751343+0000","last_peered":"2024-03-23T23:42:51.751343+0000","last_clean":"2024-03-23T23:42:51.751343+0000","last_became_active":"2024-03-23T23:42:49.735473+0000","last_became_peered":"2024-03-23T23:42:49.735473+0000","last_unstale":"2024-03-23T23:42:51.751343+0000","last_undegraded":"2024-03-23T23:42:51.751343+0000","last_fullsized":"2024-03-23T23:42:51.751343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:44:12.438729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749471+0000","last_change":"2024-03-23T23:42:50.745563+0000","last_active":"2024-03-23T23:42:51.749471+0000","last_peered":"2024-03-23T23:42:51.749471+0000","last_clean":"2024-03-23T23:42:51.749471+0000","last_became_active":"2024-03-23T23:42:50.745256+0000","last_became_peered":"2024-03-23T23:42:50.745256+0000","last_unstale":"2024-03-23T23:42:51.749471+0000","last_undegraded":"2024-03-23T23:42:51.749471+0000","last_fullsized":"2024-03-23T23:42:51.749471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:34:26.750531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328628+0000","last_change":"2024-03-23T23:42:40.700124+0000","last_active":"2024-03-23T23:42:52.328628+0000","last_peered":"2024-03-23T23:42:52.328628+0000","last_clean":"2024-03-23T23:42:52.328628+0000","last_became_active":"2024-03-23T23:42:40.697369+0000","last_became_peered":"2024-03-23T23:42:40.697369+0000","last_unstale":"2024-03-23T23:42:52.328628+0000","last_undegraded":"2024-03-23T23:42:52.328628+0000","last_fullsized":"2024-03-23T23:42:52.328628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:20.981139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767558+0000","last_change":"2024-03-23T23:42:39.681013+0000","last_active":"2024-03-23T23:42:51.767558+0000","last_peered":"2024-03-23T23:42:51.767558+0000","last_clean":"2024-03-23T23:42:51.767558+0000","last_became_active":"2024-03-23T23:42:39.680669+0000","last_became_peered":"2024-03-23T23:42:39.680669+0000","last_unstale":"2024-03-23T23:42:51.767558+0000","last_undegraded":"2024-03-23T23:42:51.767558+0000","last_fullsized":"2024-03-23T23:42:51.767558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:58:07.880313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.762672+0000","last_change":"2024-03-23T23:42:49.736747+0000","last_active":"2024-03-23T23:42:51.762672+0000","last_peered":"2024-03-23T23:42:51.762672+0000","last_clean":"2024-03-23T23:42:51.762672+0000","last_became_active":"2024-03-23T23:42:49.734508+0000","last_became_peered":"2024-03-23T23:42:49.734508+0000","last_unstale":"2024-03-23T23:42:51.762672+0000","last_undegraded":"2024-03-23T23:42:51.762672+0000","last_fullsized":"2024-03-23T23:42:51.762672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:54.356082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189347+0000","last_change":"2024-03-23T23:42:50.751141+0000","last_active":"2024-03-23T23:42:52.189347+0000","last_peered":"2024-03-23T23:42:52.189347+0000","last_clean":"2024-03-23T23:42:52.189347+0000","last_became_active":"2024-03-23T23:42:50.750269+0000","last_became_peered":"2024-03-23T23:42:50.750269+0000","last_unstale":"2024-03-23T23:42:52.189347+0000","last_undegraded":"2024-03-23T23:42:52.189347+0000","last_fullsized":"2024-03-23T23:42:52.189347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:46:10.784416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190299+0000","last_change":"2024-03-23T23:42:40.706713+0000","last_active":"2024-03-23T23:42:52.190299+0000","last_peered":"2024-03-23T23:42:52.190299+0000","last_clean":"2024-03-23T23:42:52.190299+0000","last_became_active":"2024-03-23T23:42:40.704328+0000","last_became_peered":"2024-03-23T23:42:40.704328+0000","last_unstale":"2024-03-23T23:42:52.190299+0000","last_undegraded":"2024-03-23T23:42:52.190299+0000","last_fullsized":"2024-03-23T23:42:52.190299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:15:52.261572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750011+0000","last_change":"2024-03-23T23:42:39.681906+0000","last_active":"2024-03-23T23:42:51.750011+0000","last_peered":"2024-03-23T23:42:51.750011+0000","last_clean":"2024-03-23T23:42:51.750011+0000","last_became_active":"2024-03-23T23:42:39.680506+0000","last_became_peered":"2024-03-23T23:42:39.680506+0000","last_unstale":"2024-03-23T23:42:51.750011+0000","last_undegraded":"2024-03-23T23:42:51.750011+0000","last_fullsized":"2024-03-23T23:42:51.750011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:44:07.213123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328020+0000","last_change":"2024-03-23T23:42:49.737735+0000","last_active":"2024-03-23T23:42:52.328020+0000","last_peered":"2024-03-23T23:42:52.328020+0000","last_clean":"2024-03-23T23:42:52.328020+0000","last_became_active":"2024-03-23T23:42:49.737434+0000","last_became_peered":"2024-03-23T23:42:49.737434+0000","last_unstale":"2024-03-23T23:42:52.328020+0000","last_undegraded":"2024-03-23T23:42:52.328020+0000","last_fullsized":"2024-03-23T23:42:52.328020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:58:10.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749338+0000","last_change":"2024-03-23T23:42:50.746922+0000","last_active":"2024-03-23T23:42:51.749338+0000","last_peered":"2024-03-23T23:42:51.749338+0000","last_clean":"2024-03-23T23:42:51.749338+0000","last_became_active":"2024-03-23T23:42:50.746105+0000","last_became_peered":"2024-03-23T23:42:50.746105+0000","last_unstale":"2024-03-23T23:42:51.749338+0000","last_undegraded":"2024-03-23T23:42:51.749338+0000","last_fullsized":"2024-03-23T23:42:51.749338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:46:40.484231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189958+0000","last_change":"2024-03-23T23:42:40.696584+0000","last_active":"2024-03-23T23:42:52.189958+0000","last_peered":"2024-03-23T23:42:52.189958+0000","last_clean":"2024-03-23T23:42:52.189958+0000","last_became_active":"2024-03-23T23:42:40.696141+0000","last_became_peered":"2024-03-23T23:42:40.696141+0000","last_unstale":"2024-03-23T23:42:52.189958+0000","last_undegraded":"2024-03-23T23:42:52.189958+0000","last_fullsized":"2024-03-23T23:42:52.189958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:45.303477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752716+0000","last_change":"2024-03-23T23:42:39.686863+0000","last_active":"2024-03-23T23:42:51.752716+0000","last_peered":"2024-03-23T23:42:51.752716+0000","last_clean":"2024-03-23T23:42:51.752716+0000","last_became_active":"2024-03-23T23:42:39.686491+0000","last_became_peered":"2024-03-23T23:42:39.686491+0000","last_unstale":"2024-03-23T23:42:51.752716+0000","last_undegraded":"2024-03-23T23:42:51.752716+0000","last_fullsized":"2024-03-23T23:42:51.752716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:38:13.752628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751016+0000","last_change":"2024-03-23T23:42:49.733982+0000","last_active":"2024-03-23T23:42:51.751016+0000","last_peered":"2024-03-23T23:42:51.751016+0000","last_clean":"2024-03-23T23:42:51.751016+0000","last_became_active":"2024-03-23T23:42:49.733389+0000","last_became_peered":"2024-03-23T23:42:49.733389+0000","last_unstale":"2024-03-23T23:42:51.751016+0000","last_undegraded":"2024-03-23T23:42:51.751016+0000","last_fullsized":"2024-03-23T23:42:51.751016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:13.685893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328287+0000","last_change":"2024-03-23T23:42:50.764083+0000","last_active":"2024-03-23T23:42:52.328287+0000","last_peered":"2024-03-23T23:42:52.328287+0000","last_clean":"2024-03-23T23:42:52.328287+0000","last_became_active":"2024-03-23T23:42:50.763871+0000","last_became_peered":"2024-03-23T23:42:50.763871+0000","last_unstale":"2024-03-23T23:42:52.328287+0000","last_undegraded":"2024-03-23T23:42:52.328287+0000","last_fullsized":"2024-03-23T23:42:52.328287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:32:46.055472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189656+0000","last_change":"2024-03-23T23:42:40.700961+0000","last_active":"2024-03-23T23:42:52.189656+0000","last_peered":"2024-03-23T23:42:52.189656+0000","last_clean":"2024-03-23T23:42:52.189656+0000","last_became_active":"2024-03-23T23:42:40.700800+0000","last_became_peered":"2024-03-23T23:42:40.700800+0000","last_unstale":"2024-03-23T23:42:52.189656+0000","last_undegraded":"2024-03-23T23:42:52.189656+0000","last_fullsized":"2024-03-23T23:42:52.189656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:54:27.641281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749328+0000","last_change":"2024-03-23T23:42:39.676075+0000","last_active":"2024-03-23T23:42:51.749328+0000","last_peered":"2024-03-23T23:42:51.749328+0000","last_clean":"2024-03-23T23:42:51.749328+0000","last_became_active":"2024-03-23T23:42:39.675770+0000","last_became_peered":"2024-03-23T23:42:39.675770+0000","last_unstale":"2024-03-23T23:42:51.749328+0000","last_undegraded":"2024-03-23T23:42:51.749328+0000","last_fullsized":"2024-03-23T23:42:51.749328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:24:11.933075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763597+0000","last_change":"2024-03-23T23:42:49.739529+0000","last_active":"2024-03-23T23:42:51.763597+0000","last_peered":"2024-03-23T23:42:51.763597+0000","last_clean":"2024-03-23T23:42:51.763597+0000","last_became_active":"2024-03-23T23:42:49.738053+0000","last_became_peered":"2024-03-23T23:42:49.738053+0000","last_unstale":"2024-03-23T23:42:51.763597+0000","last_undegraded":"2024-03-23T23:42:51.763597+0000","last_fullsized":"2024-03-23T23:42:51.763597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:52:57.561036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328637+0000","last_change":"2024-03-23T23:42:50.771347+0000","last_active":"2024-03-23T23:42:52.328637+0000","last_peered":"2024-03-23T23:42:52.328637+0000","last_clean":"2024-03-23T23:42:52.328637+0000","last_became_active":"2024-03-23T23:42:50.770998+0000","last_became_peered":"2024-03-23T23:42:50.770998+0000","last_unstale":"2024-03-23T23:42:52.328637+0000","last_undegraded":"2024-03-23T23:42:52.328637+0000","last_fullsized":"2024-03-23T23:42:52.328637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:57:04.394872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750921+0000","last_change":"2024-03-23T23:42:40.677314+0000","last_active":"2024-03-23T23:42:51.750921+0000","last_peered":"2024-03-23T23:42:51.750921+0000","last_clean":"2024-03-23T23:42:51.750921+0000","last_became_active":"2024-03-23T23:42:40.675416+0000","last_became_peered":"2024-03-23T23:42:40.675416+0000","last_unstale":"2024-03-23T23:42:51.750921+0000","last_undegraded":"2024-03-23T23:42:51.750921+0000","last_fullsized":"2024-03-23T23:42:51.750921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:01:06.338641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751663+0000","last_change":"2024-03-23T23:42:39.681827+0000","last_active":"2024-03-23T23:42:51.751663+0000","last_peered":"2024-03-23T23:42:51.751663+0000","last_clean":"2024-03-23T23:42:51.751663+0000","last_became_active":"2024-03-23T23:42:39.681418+0000","last_became_peered":"2024-03-23T23:42:39.681418+0000","last_unstale":"2024-03-23T23:42:51.751663+0000","last_undegraded":"2024-03-23T23:42:51.751663+0000","last_fullsized":"2024-03-23T23:42:51.751663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:50.559059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328221+0000","last_change":"2024-03-23T23:42:49.744708+0000","last_active":"2024-03-23T23:42:52.328221+0000","last_peered":"2024-03-23T23:42:52.328221+0000","last_clean":"2024-03-23T23:42:52.328221+0000","last_became_active":"2024-03-23T23:42:49.744422+0000","last_became_peered":"2024-03-23T23:42:49.744422+0000","last_unstale":"2024-03-23T23:42:52.328221+0000","last_undegraded":"2024-03-23T23:42:52.328221+0000","last_fullsized":"2024-03-23T23:42:52.328221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:25:43.889950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328641+0000","last_change":"2024-03-23T23:42:50.753064+0000","last_active":"2024-03-23T23:42:52.328641+0000","last_peered":"2024-03-23T23:42:52.328641+0000","last_clean":"2024-03-23T23:42:52.328641+0000","last_became_active":"2024-03-23T23:42:50.752783+0000","last_became_peered":"2024-03-23T23:42:50.752783+0000","last_unstale":"2024-03-23T23:42:52.328641+0000","last_undegraded":"2024-03-23T23:42:52.328641+0000","last_fullsized":"2024-03-23T23:42:52.328641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:39:49.888359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189741+0000","last_change":"2024-03-23T23:42:40.704046+0000","last_active":"2024-03-23T23:42:52.189741+0000","last_peered":"2024-03-23T23:42:52.189741+0000","last_clean":"2024-03-23T23:42:52.189741+0000","last_became_active":"2024-03-23T23:42:40.703787+0000","last_became_peered":"2024-03-23T23:42:40.703787+0000","last_unstale":"2024-03-23T23:42:52.189741+0000","last_undegraded":"2024-03-23T23:42:52.189741+0000","last_fullsized":"2024-03-23T23:42:52.189741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:16:16.737284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328439+0000","last_change":"2024-03-23T23:42:39.688483+0000","last_active":"2024-03-23T23:42:52.328439+0000","last_peered":"2024-03-23T23:42:52.328439+0000","last_clean":"2024-03-23T23:42:52.328439+0000","last_became_active":"2024-03-23T23:42:39.688141+0000","last_became_peered":"2024-03-23T23:42:39.688141+0000","last_unstale":"2024-03-23T23:42:52.328439+0000","last_undegraded":"2024-03-23T23:42:52.328439+0000","last_fullsized":"2024-03-23T23:42:52.328439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:32.254099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"24'6","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328127+0000","last_change":"2024-03-23T23:42:49.749027+0000","last_active":"2024-03-23T23:42:52.328127+0000","last_peered":"2024-03-23T23:42:52.328127+0000","last_clean":"2024-03-23T23:42:52.328127+0000","last_became_active":"2024-03-23T23:42:49.748687+0000","last_became_peered":"2024-03-23T23:42:49.748687+0000","last_unstale":"2024-03-23T23:42:52.328127+0000","last_undegraded":"2024-03-23T23:42:52.328127+0000","last_fullsized":"2024-03-23T23:42:52.328127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:27.818117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328083+0000","last_change":"2024-03-23T23:42:50.752273+0000","last_active":"2024-03-23T23:42:52.328083+0000","last_peered":"2024-03-23T23:42:52.328083+0000","last_clean":"2024-03-23T23:42:52.328083+0000","last_became_active":"2024-03-23T23:42:50.751874+0000","last_became_peered":"2024-03-23T23:42:50.751874+0000","last_unstale":"2024-03-23T23:42:52.328083+0000","last_undegraded":"2024-03-23T23:42:52.328083+0000","last_fullsized":"2024-03-23T23:42:52.328083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:20:53.750917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.762660+0000","last_change":"2024-03-23T23:42:40.688909+0000","last_active":"2024-03-23T23:42:51.762660+0000","last_peered":"2024-03-23T23:42:51.762660+0000","last_clean":"2024-03-23T23:42:51.762660+0000","last_became_active":"2024-03-23T23:42:40.688636+0000","last_became_peered":"2024-03-23T23:42:40.688636+0000","last_unstale":"2024-03-23T23:42:51.762660+0000","last_undegraded":"2024-03-23T23:42:51.762660+0000","last_fullsized":"2024-03-23T23:42:51.762660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:26:16.171920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763113+0000","last_change":"2024-03-23T23:42:39.681926+0000","last_active":"2024-03-23T23:42:51.763113+0000","last_peered":"2024-03-23T23:42:51.763113+0000","last_clean":"2024-03-23T23:42:51.763113+0000","last_became_active":"2024-03-23T23:42:39.681028+0000","last_became_peered":"2024-03-23T23:42:39.681028+0000","last_unstale":"2024-03-23T23:42:51.763113+0000","last_undegraded":"2024-03-23T23:42:51.763113+0000","last_fullsized":"2024-03-23T23:42:51.763113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:24:11.933075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328871+0000","last_change":"2024-03-23T23:42:49.741915+0000","last_active":"2024-03-23T23:42:52.328871+0000","last_peered":"2024-03-23T23:42:52.328871+0000","last_clean":"2024-03-23T23:42:52.328871+0000","last_became_active":"2024-03-23T23:42:49.741650+0000","last_became_peered":"2024-03-23T23:42:49.741650+0000","last_unstale":"2024-03-23T23:42:52.328871+0000","last_undegraded":"2024-03-23T23:42:52.328871+0000","last_fullsized":"2024-03-23T23:42:52.328871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:11:43.106922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327956+0000","last_change":"2024-03-23T23:42:50.752979+0000","last_active":"2024-03-23T23:42:52.327956+0000","last_peered":"2024-03-23T23:42:52.327956+0000","last_clean":"2024-03-23T23:42:52.327956+0000","last_became_active":"2024-03-23T23:42:50.751848+0000","last_became_peered":"2024-03-23T23:42:50.751848+0000","last_unstale":"2024-03-23T23:42:52.327956+0000","last_undegraded":"2024-03-23T23:42:52.327956+0000","last_fullsized":"2024-03-23T23:42:52.327956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:39:04.727316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190024+0000","last_change":"2024-03-23T23:42:40.689988+0000","last_active":"2024-03-23T23:42:52.190024+0000","last_peered":"2024-03-23T23:42:52.190024+0000","last_clean":"2024-03-23T23:42:52.190024+0000","last_became_active":"2024-03-23T23:42:40.689477+0000","last_became_peered":"2024-03-23T23:42:40.689477+0000","last_unstale":"2024-03-23T23:42:52.190024+0000","last_undegraded":"2024-03-23T23:42:52.190024+0000","last_fullsized":"2024-03-23T23:42:52.190024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:46:30.427072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752122+0000","last_change":"2024-03-23T23:42:39.689429+0000","last_active":"2024-03-23T23:42:51.752122+0000","last_peered":"2024-03-23T23:42:51.752122+0000","last_clean":"2024-03-23T23:42:51.752122+0000","last_became_active":"2024-03-23T23:42:39.688066+0000","last_became_peered":"2024-03-23T23:42:39.688066+0000","last_unstale":"2024-03-23T23:42:51.752122+0000","last_undegraded":"2024-03-23T23:42:51.752122+0000","last_fullsized":"2024-03-23T23:42:51.752122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:32.254099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766492+0000","last_change":"2024-03-23T23:42:49.733543+0000","last_active":"2024-03-23T23:42:51.766492+0000","last_peered":"2024-03-23T23:42:51.766492+0000","last_clean":"2024-03-23T23:42:51.766492+0000","last_became_active":"2024-03-23T23:42:49.733197+0000","last_became_peered":"2024-03-23T23:42:49.733197+0000","last_unstale":"2024-03-23T23:42:51.766492+0000","last_undegraded":"2024-03-23T23:42:51.766492+0000","last_fullsized":"2024-03-23T23:42:51.766492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:45:20.189501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766823+0000","last_change":"2024-03-23T23:42:50.756687+0000","last_active":"2024-03-23T23:42:51.766823+0000","last_peered":"2024-03-23T23:42:51.766823+0000","last_clean":"2024-03-23T23:42:51.766823+0000","last_became_active":"2024-03-23T23:42:50.756371+0000","last_became_peered":"2024-03-23T23:42:50.756371+0000","last_unstale":"2024-03-23T23:42:51.766823+0000","last_undegraded":"2024-03-23T23:42:51.766823+0000","last_fullsized":"2024-03-23T23:42:51.766823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:29:47.303374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752229+0000","last_change":"2024-03-23T23:42:40.683025+0000","last_active":"2024-03-23T23:42:51.752229+0000","last_peered":"2024-03-23T23:42:51.752229+0000","last_clean":"2024-03-23T23:42:51.752229+0000","last_became_active":"2024-03-23T23:42:40.682798+0000","last_became_peered":"2024-03-23T23:42:40.682798+0000","last_unstale":"2024-03-23T23:42:51.752229+0000","last_undegraded":"2024-03-23T23:42:51.752229+0000","last_fullsized":"2024-03-23T23:42:51.752229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:51.565112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767463+0000","last_change":"2024-03-23T23:42:39.681675+0000","last_active":"2024-03-23T23:42:51.767463+0000","last_peered":"2024-03-23T23:42:51.767463+0000","last_clean":"2024-03-23T23:42:51.767463+0000","last_became_active":"2024-03-23T23:42:39.681364+0000","last_became_peered":"2024-03-23T23:42:39.681364+0000","last_unstale":"2024-03-23T23:42:51.767463+0000","last_undegraded":"2024-03-23T23:42:51.767463+0000","last_fullsized":"2024-03-23T23:42:51.767463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:42:37.702720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751398+0000","last_change":"2024-03-23T23:42:49.723350+0000","last_active":"2024-03-23T23:42:51.751398+0000","last_peered":"2024-03-23T23:42:51.751398+0000","last_clean":"2024-03-23T23:42:51.751398+0000","last_became_active":"2024-03-23T23:42:49.723058+0000","last_became_peered":"2024-03-23T23:42:49.723058+0000","last_unstale":"2024-03-23T23:42:51.751398+0000","last_undegraded":"2024-03-23T23:42:51.751398+0000","last_fullsized":"2024-03-23T23:42:51.751398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:43:02.835034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751554+0000","last_change":"2024-03-23T23:42:50.746422+0000","last_active":"2024-03-23T23:42:51.751554+0000","last_peered":"2024-03-23T23:42:51.751554+0000","last_clean":"2024-03-23T23:42:51.751554+0000","last_became_active":"2024-03-23T23:42:50.746104+0000","last_became_peered":"2024-03-23T23:42:50.746104+0000","last_unstale":"2024-03-23T23:42:51.751554+0000","last_undegraded":"2024-03-23T23:42:51.751554+0000","last_fullsized":"2024-03-23T23:42:51.751554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:40:34.077584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763417+0000","last_change":"2024-03-23T23:42:40.700381+0000","last_active":"2024-03-23T23:42:51.763417+0000","last_peered":"2024-03-23T23:42:51.763417+0000","last_clean":"2024-03-23T23:42:51.763417+0000","last_became_active":"2024-03-23T23:42:40.698428+0000","last_became_peered":"2024-03-23T23:42:40.698428+0000","last_unstale":"2024-03-23T23:42:51.763417+0000","last_undegraded":"2024-03-23T23:42:51.763417+0000","last_fullsized":"2024-03-23T23:42:51.763417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:07:29.242921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328837+0000","last_change":"2024-03-23T23:42:39.691092+0000","last_active":"2024-03-23T23:42:52.328837+0000","last_peered":"2024-03-23T23:42:52.328837+0000","last_clean":"2024-03-23T23:42:52.328837+0000","last_became_active":"2024-03-23T23:42:39.687473+0000","last_became_peered":"2024-03-23T23:42:39.687473+0000","last_unstale":"2024-03-23T23:42:52.328837+0000","last_undegraded":"2024-03-23T23:42:52.328837+0000","last_fullsized":"2024-03-23T23:42:52.328837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:08:03.578884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327476+0000","last_change":"2024-03-23T23:42:49.748693+0000","last_active":"2024-03-23T23:42:52.327476+0000","last_peered":"2024-03-23T23:42:52.327476+0000","last_clean":"2024-03-23T23:42:52.327476+0000","last_became_active":"2024-03-23T23:42:49.748389+0000","last_became_peered":"2024-03-23T23:42:49.748389+0000","last_unstale":"2024-03-23T23:42:52.327476+0000","last_undegraded":"2024-03-23T23:42:52.327476+0000","last_fullsized":"2024-03-23T23:42:52.327476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:58:10.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189491+0000","last_change":"2024-03-23T23:42:50.749547+0000","last_active":"2024-03-23T23:42:52.189491+0000","last_peered":"2024-03-23T23:42:52.189491+0000","last_clean":"2024-03-23T23:42:52.189491+0000","last_became_active":"2024-03-23T23:42:50.749066+0000","last_became_peered":"2024-03-23T23:42:50.749066+0000","last_unstale":"2024-03-23T23:42:52.189491+0000","last_undegraded":"2024-03-23T23:42:52.189491+0000","last_fullsized":"2024-03-23T23:42:52.189491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:09:19.723830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328727+0000","last_change":"2024-03-23T23:42:40.708795+0000","last_active":"2024-03-23T23:42:52.328727+0000","last_peered":"2024-03-23T23:42:52.328727+0000","last_clean":"2024-03-23T23:42:52.328727+0000","last_became_active":"2024-03-23T23:42:40.708199+0000","last_became_peered":"2024-03-23T23:42:40.708199+0000","last_unstale":"2024-03-23T23:42:52.328727+0000","last_undegraded":"2024-03-23T23:42:52.328727+0000","last_fullsized":"2024-03-23T23:42:52.328727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:53.782430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.753135+0000","last_change":"2024-03-23T23:42:39.684669+0000","last_active":"2024-03-23T23:42:51.753135+0000","last_peered":"2024-03-23T23:42:51.753135+0000","last_clean":"2024-03-23T23:42:51.753135+0000","last_became_active":"2024-03-23T23:42:39.684360+0000","last_became_peered":"2024-03-23T23:42:39.684360+0000","last_unstale":"2024-03-23T23:42:51.753135+0000","last_undegraded":"2024-03-23T23:42:51.753135+0000","last_fullsized":"2024-03-23T23:42:51.753135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:19.914926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327466+0000","last_change":"2024-03-23T23:42:49.741577+0000","last_active":"2024-03-23T23:42:52.327466+0000","last_peered":"2024-03-23T23:42:52.327466+0000","last_clean":"2024-03-23T23:42:52.327466+0000","last_became_active":"2024-03-23T23:42:49.741270+0000","last_became_peered":"2024-03-23T23:42:49.741270+0000","last_unstale":"2024-03-23T23:42:52.327466+0000","last_undegraded":"2024-03-23T23:42:52.327466+0000","last_fullsized":"2024-03-23T23:42:52.327466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:11:43.106922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.753001+0000","last_change":"2024-03-23T23:42:50.751992+0000","last_active":"2024-03-23T23:42:51.753001+0000","last_peered":"2024-03-23T23:42:51.753001+0000","last_clean":"2024-03-23T23:42:51.753001+0000","last_became_active":"2024-03-23T23:42:50.748281+0000","last_became_peered":"2024-03-23T23:42:50.748281+0000","last_unstale":"2024-03-23T23:42:51.753001+0000","last_undegraded":"2024-03-23T23:42:51.753001+0000","last_fullsized":"2024-03-23T23:42:51.753001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:57.968968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763361+0000","last_change":"2024-03-23T23:42:49.741658+0000","last_active":"2024-03-23T23:42:51.763361+0000","last_peered":"2024-03-23T23:42:51.763361+0000","last_clean":"2024-03-23T23:42:51.763361+0000","last_became_active":"2024-03-23T23:42:49.740899+0000","last_became_peered":"2024-03-23T23:42:49.740899+0000","last_unstale":"2024-03-23T23:42:51.763361+0000","last_undegraded":"2024-03-23T23:42:51.763361+0000","last_fullsized":"2024-03-23T23:42:51.763361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:45:20.189501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766424+0000","last_change":"2024-03-23T23:42:40.679384+0000","last_active":"2024-03-23T23:42:51.766424+0000","last_peered":"2024-03-23T23:42:51.766424+0000","last_clean":"2024-03-23T23:42:51.766424+0000","last_became_active":"2024-03-23T23:42:40.679070+0000","last_became_peered":"2024-03-23T23:42:40.679070+0000","last_unstale":"2024-03-23T23:42:51.766424+0000","last_undegraded":"2024-03-23T23:42:51.766424+0000","last_fullsized":"2024-03-23T23:42:51.766424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:26:16.171920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328187+0000","last_change":"2024-03-23T23:42:39.682839+0000","last_active":"2024-03-23T23:42:52.328187+0000","last_peered":"2024-03-23T23:42:52.328187+0000","last_clean":"2024-03-23T23:42:52.328187+0000","last_became_active":"2024-03-23T23:42:39.682584+0000","last_became_peered":"2024-03-23T23:42:39.682584+0000","last_unstale":"2024-03-23T23:42:52.328187+0000","last_undegraded":"2024-03-23T23:42:52.328187+0000","last_fullsized":"2024-03-23T23:42:52.328187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:19.914926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763311+0000","last_change":"2024-03-23T23:42:50.752596+0000","last_active":"2024-03-23T23:42:51.763311+0000","last_peered":"2024-03-23T23:42:51.763311+0000","last_clean":"2024-03-23T23:42:51.763311+0000","last_became_active":"2024-03-23T23:42:50.751598+0000","last_became_peered":"2024-03-23T23:42:50.751598+0000","last_unstale":"2024-03-23T23:42:51.763311+0000","last_undegraded":"2024-03-23T23:42:51.763311+0000","last_fullsized":"2024-03-23T23:42:51.763311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:37:19.741781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.753080+0000","last_change":"2024-03-23T23:42:49.734629+0000","last_active":"2024-03-23T23:42:51.753080+0000","last_peered":"2024-03-23T23:42:51.753080+0000","last_clean":"2024-03-23T23:42:51.753080+0000","last_became_active":"2024-03-23T23:42:49.734309+0000","last_became_peered":"2024-03-23T23:42:49.734309+0000","last_unstale":"2024-03-23T23:42:51.753080+0000","last_undegraded":"2024-03-23T23:42:51.753080+0000","last_fullsized":"2024-03-23T23:42:51.753080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:46.760020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327687+0000","last_change":"2024-03-23T23:42:40.674605+0000","last_active":"2024-03-23T23:42:52.327687+0000","last_peered":"2024-03-23T23:42:52.327687+0000","last_clean":"2024-03-23T23:42:52.327687+0000","last_became_active":"2024-03-23T23:42:40.674366+0000","last_became_peered":"2024-03-23T23:42:40.674366+0000","last_unstale":"2024-03-23T23:42:52.327687+0000","last_undegraded":"2024-03-23T23:42:52.327687+0000","last_fullsized":"2024-03-23T23:42:52.327687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327666+0000","last_change":"2024-03-23T23:42:39.688646+0000","last_active":"2024-03-23T23:42:52.327666+0000","last_peered":"2024-03-23T23:42:52.327666+0000","last_clean":"2024-03-23T23:42:52.327666+0000","last_became_active":"2024-03-23T23:42:39.687489+0000","last_became_peered":"2024-03-23T23:42:39.687489+0000","last_unstale":"2024-03-23T23:42:52.327666+0000","last_undegraded":"2024-03-23T23:42:52.327666+0000","last_fullsized":"2024-03-23T23:42:52.327666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:07:12.649156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767201+0000","last_change":"2024-03-23T23:42:50.748511+0000","last_active":"2024-03-23T23:42:51.767201+0000","last_peered":"2024-03-23T23:42:51.767201+0000","last_clean":"2024-03-23T23:42:51.767201+0000","last_became_active":"2024-03-23T23:42:50.747154+0000","last_became_peered":"2024-03-23T23:42:50.747154+0000","last_unstale":"2024-03-23T23:42:51.767201+0000","last_undegraded":"2024-03-23T23:42:51.767201+0000","last_fullsized":"2024-03-23T23:42:51.767201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:09:19.723830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751549+0000","last_change":"2024-03-23T23:42:39.681458+0000","last_active":"2024-03-23T23:42:51.751549+0000","last_peered":"2024-03-23T23:42:51.751549+0000","last_clean":"2024-03-23T23:42:51.751549+0000","last_became_active":"2024-03-23T23:42:39.681158+0000","last_became_peered":"2024-03-23T23:42:39.681158+0000","last_unstale":"2024-03-23T23:42:51.751549+0000","last_undegraded":"2024-03-23T23:42:51.751549+0000","last_fullsized":"2024-03-23T23:42:51.751549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:08:03.578884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763042+0000","last_change":"2024-03-23T23:42:40.676571+0000","last_active":"2024-03-23T23:42:51.763042+0000","last_peered":"2024-03-23T23:42:51.763042+0000","last_clean":"2024-03-23T23:42:51.763042+0000","last_became_active":"2024-03-23T23:42:40.675877+0000","last_became_peered":"2024-03-23T23:42:40.675877+0000","last_unstale":"2024-03-23T23:42:51.763042+0000","last_undegraded":"2024-03-23T23:42:51.763042+0000","last_fullsized":"2024-03-23T23:42:51.763042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:52.220411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749759+0000","last_change":"2024-03-23T23:42:49.734208+0000","last_active":"2024-03-23T23:42:51.749759+0000","last_peered":"2024-03-23T23:42:51.749759+0000","last_clean":"2024-03-23T23:42:51.749759+0000","last_became_active":"2024-03-23T23:42:49.732943+0000","last_became_peered":"2024-03-23T23:42:49.732943+0000","last_unstale":"2024-03-23T23:42:51.749759+0000","last_undegraded":"2024-03-23T23:42:51.749759+0000","last_fullsized":"2024-03-23T23:42:51.749759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:43.683275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751832+0000","last_change":"2024-03-23T23:42:50.752722+0000","last_active":"2024-03-23T23:42:51.751832+0000","last_peered":"2024-03-23T23:42:51.751832+0000","last_clean":"2024-03-23T23:42:51.751832+0000","last_became_active":"2024-03-23T23:42:50.749400+0000","last_became_peered":"2024-03-23T23:42:50.749400+0000","last_unstale":"2024-03-23T23:42:51.751832+0000","last_undegraded":"2024-03-23T23:42:51.751832+0000","last_fullsized":"2024-03-23T23:42:51.751832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:16:44.027189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328094+0000","last_change":"2024-03-23T23:42:39.688422+0000","last_active":"2024-03-23T23:42:52.328094+0000","last_peered":"2024-03-23T23:42:52.328094+0000","last_clean":"2024-03-23T23:42:52.328094+0000","last_became_active":"2024-03-23T23:42:39.687423+0000","last_became_peered":"2024-03-23T23:42:39.687423+0000","last_unstale":"2024-03-23T23:42:52.328094+0000","last_undegraded":"2024-03-23T23:42:52.328094+0000","last_fullsized":"2024-03-23T23:42:52.328094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:20:38.456655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751184+0000","last_change":"2024-03-23T23:42:40.680801+0000","last_active":"2024-03-23T23:42:51.751184+0000","last_peered":"2024-03-23T23:42:51.751184+0000","last_clean":"2024-03-23T23:42:51.751184+0000","last_became_active":"2024-03-23T23:42:40.680511+0000","last_became_peered":"2024-03-23T23:42:40.680511+0000","last_unstale":"2024-03-23T23:42:51.751184+0000","last_undegraded":"2024-03-23T23:42:51.751184+0000","last_fullsized":"2024-03-23T23:42:51.751184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:27:42.392714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328321+0000","last_change":"2024-03-23T23:42:49.751291+0000","last_active":"2024-03-23T23:42:52.328321+0000","last_peered":"2024-03-23T23:42:52.328321+0000","last_clean":"2024-03-23T23:42:52.328321+0000","last_became_active":"2024-03-23T23:42:49.749695+0000","last_became_peered":"2024-03-23T23:42:49.749695+0000","last_unstale":"2024-03-23T23:42:52.328321+0000","last_undegraded":"2024-03-23T23:42:52.328321+0000","last_fullsized":"2024-03-23T23:42:52.328321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:40:33.073029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328522+0000","last_change":"2024-03-23T23:42:50.752672+0000","last_active":"2024-03-23T23:42:52.328522+0000","last_peered":"2024-03-23T23:42:52.328522+0000","last_clean":"2024-03-23T23:42:52.328522+0000","last_became_active":"2024-03-23T23:42:50.752394+0000","last_became_peered":"2024-03-23T23:42:50.752394+0000","last_unstale":"2024-03-23T23:42:52.328522+0000","last_undegraded":"2024-03-23T23:42:52.328522+0000","last_fullsized":"2024-03-23T23:42:52.328522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:51:01.385876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750919+0000","last_change":"2024-03-23T23:42:40.679042+0000","last_active":"2024-03-23T23:42:51.750919+0000","last_peered":"2024-03-23T23:42:51.750919+0000","last_clean":"2024-03-23T23:42:51.750919+0000","last_became_active":"2024-03-23T23:42:40.678518+0000","last_became_peered":"2024-03-23T23:42:40.678518+0000","last_unstale":"2024-03-23T23:42:51.750919+0000","last_undegraded":"2024-03-23T23:42:51.750919+0000","last_fullsized":"2024-03-23T23:42:51.750919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:12:14.359173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767231+0000","last_change":"2024-03-23T23:42:50.757132+0000","last_active":"2024-03-23T23:42:51.767231+0000","last_peered":"2024-03-23T23:42:51.767231+0000","last_clean":"2024-03-23T23:42:51.767231+0000","last_became_active":"2024-03-23T23:42:50.756813+0000","last_became_peered":"2024-03-23T23:42:50.756813+0000","last_unstale":"2024-03-23T23:42:51.767231+0000","last_undegraded":"2024-03-23T23:42:51.767231+0000","last_fullsized":"2024-03-23T23:42:51.767231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:04:26.911514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749494+0000","last_change":"2024-03-23T23:42:40.702411+0000","last_active":"2024-03-23T23:42:51.749494+0000","last_peered":"2024-03-23T23:42:51.749494+0000","last_clean":"2024-03-23T23:42:51.749494+0000","last_became_active":"2024-03-23T23:42:40.701398+0000","last_became_peered":"2024-03-23T23:42:40.701398+0000","last_unstale":"2024-03-23T23:42:51.749494+0000","last_undegraded":"2024-03-23T23:42:51.749494+0000","last_fullsized":"2024-03-23T23:42:51.749494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:03.196963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328386+0000","last_change":"2024-03-23T23:42:50.756769+0000","last_active":"2024-03-23T23:42:52.328386+0000","last_peered":"2024-03-23T23:42:52.328386+0000","last_clean":"2024-03-23T23:42:52.328386+0000","last_became_active":"2024-03-23T23:42:50.756503+0000","last_became_peered":"2024-03-23T23:42:50.756503+0000","last_unstale":"2024-03-23T23:42:52.328386+0000","last_undegraded":"2024-03-23T23:42:52.328386+0000","last_fullsized":"2024-03-23T23:42:52.328386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:50.597847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328394+0000","last_change":"2024-03-23T23:42:40.698519+0000","last_active":"2024-03-23T23:42:52.328394+0000","last_peered":"2024-03-23T23:42:52.328394+0000","last_clean":"2024-03-23T23:42:52.328394+0000","last_became_active":"2024-03-23T23:42:40.695218+0000","last_became_peered":"2024-03-23T23:42:40.695218+0000","last_unstale":"2024-03-23T23:42:52.328394+0000","last_undegraded":"2024-03-23T23:42:52.328394+0000","last_fullsized":"2024-03-23T23:42:52.328394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:00:54.983365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767039+0000","last_change":"2024-03-23T23:42:50.748726+0000","last_active":"2024-03-23T23:42:51.767039+0000","last_peered":"2024-03-23T23:42:51.767039+0000","last_clean":"2024-03-23T23:42:51.767039+0000","last_became_active":"2024-03-23T23:42:50.748105+0000","last_became_peered":"2024-03-23T23:42:50.748105+0000","last_unstale":"2024-03-23T23:42:51.767039+0000","last_undegraded":"2024-03-23T23:42:51.767039+0000","last_fullsized":"2024-03-23T23:42:51.767039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:54.910408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763001+0000","last_change":"2024-03-23T23:42:40.673293+0000","last_active":"2024-03-23T23:42:51.763001+0000","last_peered":"2024-03-23T23:42:51.763001+0000","last_clean":"2024-03-23T23:42:51.763001+0000","last_became_active":"2024-03-23T23:42:40.672910+0000","last_became_peered":"2024-03-23T23:42:40.672910+0000","last_unstale":"2024-03-23T23:42:51.763001+0000","last_undegraded":"2024-03-23T23:42:51.763001+0000","last_fullsized":"2024-03-23T23:42:51.763001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:42:14.952953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189476+0000","last_change":"2024-03-23T23:42:50.750291+0000","last_active":"2024-03-23T23:42:52.189476+0000","last_peered":"2024-03-23T23:42:52.189476+0000","last_clean":"2024-03-23T23:42:52.189476+0000","last_became_active":"2024-03-23T23:42:50.749908+0000","last_became_peered":"2024-03-23T23:42:50.749908+0000","last_unstale":"2024-03-23T23:42:52.189476+0000","last_undegraded":"2024-03-23T23:42:52.189476+0000","last_fullsized":"2024-03-23T23:42:52.189476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:54.910408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328216+0000","last_change":"2024-03-23T23:42:40.685370+0000","last_active":"2024-03-23T23:42:52.328216+0000","last_peered":"2024-03-23T23:42:52.328216+0000","last_clean":"2024-03-23T23:42:52.328216+0000","last_became_active":"2024-03-23T23:42:40.685120+0000","last_became_peered":"2024-03-23T23:42:40.685120+0000","last_unstale":"2024-03-23T23:42:52.328216+0000","last_undegraded":"2024-03-23T23:42:52.328216+0000","last_fullsized":"2024-03-23T23:42:52.328216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751268+0000","last_change":"2024-03-23T23:42:50.747361+0000","last_active":"2024-03-23T23:42:51.751268+0000","last_peered":"2024-03-23T23:42:51.751268+0000","last_clean":"2024-03-23T23:42:51.751268+0000","last_became_active":"2024-03-23T23:42:50.746310+0000","last_became_peered":"2024-03-23T23:42:50.746310+0000","last_unstale":"2024-03-23T23:42:51.751268+0000","last_undegraded":"2024-03-23T23:42:51.751268+0000","last_fullsized":"2024-03-23T23:42:51.751268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:57.968968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767365+0000","last_change":"2024-03-23T23:42:40.677168+0000","last_active":"2024-03-23T23:42:51.767365+0000","last_peered":"2024-03-23T23:42:51.767365+0000","last_clean":"2024-03-23T23:42:51.767365+0000","last_became_active":"2024-03-23T23:42:40.676912+0000","last_became_peered":"2024-03-23T23:42:40.676912+0000","last_unstale":"2024-03-23T23:42:51.767365+0000","last_undegraded":"2024-03-23T23:42:51.767365+0000","last_fullsized":"2024-03-23T23:42:51.767365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:17:19.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189346+0000","last_change":"2024-03-23T23:42:50.749305+0000","last_active":"2024-03-23T23:42:52.189346+0000","last_peered":"2024-03-23T23:42:52.189346+0000","last_clean":"2024-03-23T23:42:52.189346+0000","last_became_active":"2024-03-23T23:42:50.748798+0000","last_became_peered":"2024-03-23T23:42:50.748798+0000","last_unstale":"2024-03-23T23:42:52.189346+0000","last_undegraded":"2024-03-23T23:42:52.189346+0000","last_fullsized":"2024-03-23T23:42:52.189346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:19.610436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752528+0000","last_change":"2024-03-23T23:42:40.694420+0000","last_active":"2024-03-23T23:42:51.752528+0000","last_peered":"2024-03-23T23:42:51.752528+0000","last_clean":"2024-03-23T23:42:51.752528+0000","last_became_active":"2024-03-23T23:42:40.693867+0000","last_became_peered":"2024-03-23T23:42:40.693867+0000","last_unstale":"2024-03-23T23:42:51.752528+0000","last_undegraded":"2024-03-23T23:42:51.752528+0000","last_fullsized":"2024-03-23T23:42:51.752528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:54.557634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751411+0000","last_change":"2024-03-23T23:42:50.754149+0000","last_active":"2024-03-23T23:42:51.751411+0000","last_peered":"2024-03-23T23:42:51.751411+0000","last_clean":"2024-03-23T23:42:51.751411+0000","last_became_active":"2024-03-23T23:42:50.753471+0000","last_became_peered":"2024-03-23T23:42:50.753471+0000","last_unstale":"2024-03-23T23:42:51.751411+0000","last_undegraded":"2024-03-23T23:42:51.751411+0000","last_fullsized":"2024-03-23T23:42:51.751411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:28.822672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328282+0000","last_change":"2024-03-23T23:42:40.685177+0000","last_active":"2024-03-23T23:42:52.328282+0000","last_peered":"2024-03-23T23:42:52.328282+0000","last_clean":"2024-03-23T23:42:52.328282+0000","last_became_active":"2024-03-23T23:42:40.684495+0000","last_became_peered":"2024-03-23T23:42:40.684495+0000","last_unstale":"2024-03-23T23:42:52.328282+0000","last_undegraded":"2024-03-23T23:42:52.328282+0000","last_fullsized":"2024-03-23T23:42:52.328282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:27.675824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328493+0000","last_change":"2024-03-23T23:42:50.746438+0000","last_active":"2024-03-23T23:42:52.328493+0000","last_peered":"2024-03-23T23:42:52.328493+0000","last_clean":"2024-03-23T23:42:52.328493+0000","last_became_active":"2024-03-23T23:42:50.745771+0000","last_became_peered":"2024-03-23T23:42:50.745771+0000","last_unstale":"2024-03-23T23:42:52.328493+0000","last_undegraded":"2024-03-23T23:42:52.328493+0000","last_fullsized":"2024-03-23T23:42:52.328493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:22:17.484059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328084+0000","last_change":"2024-03-23T23:42:40.701852+0000","last_active":"2024-03-23T23:42:52.328084+0000","last_peered":"2024-03-23T23:42:52.328084+0000","last_clean":"2024-03-23T23:42:52.328084+0000","last_became_active":"2024-03-23T23:42:40.701566+0000","last_became_peered":"2024-03-23T23:42:40.701566+0000","last_unstale":"2024-03-23T23:42:52.328084+0000","last_undegraded":"2024-03-23T23:42:52.328084+0000","last_fullsized":"2024-03-23T23:42:52.328084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190034+0000","last_change":"2024-03-23T23:42:50.758879+0000","last_active":"2024-03-23T23:42:52.190034+0000","last_peered":"2024-03-23T23:42:52.190034+0000","last_clean":"2024-03-23T23:42:52.190034+0000","last_became_active":"2024-03-23T23:42:50.758564+0000","last_became_peered":"2024-03-23T23:42:50.758564+0000","last_unstale":"2024-03-23T23:42:52.190034+0000","last_undegraded":"2024-03-23T23:42:52.190034+0000","last_fullsized":"2024-03-23T23:42:52.190034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:11:29.268536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327548+0000","last_change":"2024-03-23T23:42:40.684899+0000","last_active":"2024-03-23T23:42:52.327548+0000","last_peered":"2024-03-23T23:42:52.327548+0000","last_clean":"2024-03-23T23:42:52.327548+0000","last_became_active":"2024-03-23T23:42:40.684603+0000","last_became_peered":"2024-03-23T23:42:40.684603+0000","last_unstale":"2024-03-23T23:42:52.327548+0000","last_undegraded":"2024-03-23T23:42:52.327548+0000","last_fullsized":"2024-03-23T23:42:52.327548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:54.557634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749737+0000","last_change":"2024-03-23T23:42:50.754096+0000","last_active":"2024-03-23T23:42:51.749737+0000","last_peered":"2024-03-23T23:42:51.749737+0000","last_clean":"2024-03-23T23:42:51.749737+0000","last_became_active":"2024-03-23T23:42:50.753602+0000","last_became_peered":"2024-03-23T23:42:50.753602+0000","last_unstale":"2024-03-23T23:42:51.749737+0000","last_undegraded":"2024-03-23T23:42:51.749737+0000","last_fullsized":"2024-03-23T23:42:51.749737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:16:26.794444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328338+0000","last_change":"2024-03-23T23:42:40.707800+0000","last_active":"2024-03-23T23:42:52.328338+0000","last_peered":"2024-03-23T23:42:52.328338+0000","last_clean":"2024-03-23T23:42:52.328338+0000","last_became_active":"2024-03-23T23:42:40.707528+0000","last_became_peered":"2024-03-23T23:42:40.707528+0000","last_unstale":"2024-03-23T23:42:52.328338+0000","last_undegraded":"2024-03-23T23:42:52.328338+0000","last_fullsized":"2024-03-23T23:42:52.328338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:03:24.275154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328659+0000","last_change":"2024-03-23T23:42:50.741324+0000","last_active":"2024-03-23T23:42:52.328659+0000","last_peered":"2024-03-23T23:42:52.328659+0000","last_clean":"2024-03-23T23:42:52.328659+0000","last_became_active":"2024-03-23T23:42:50.741065+0000","last_became_peered":"2024-03-23T23:42:50.741065+0000","last_unstale":"2024-03-23T23:42:52.328659+0000","last_undegraded":"2024-03-23T23:42:52.328659+0000","last_fullsized":"2024-03-23T23:42:52.328659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:13.911327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.762890+0000","last_change":"2024-03-23T23:42:40.689122+0000","last_active":"2024-03-23T23:42:51.762890+0000","last_peered":"2024-03-23T23:42:51.762890+0000","last_clean":"2024-03-23T23:42:51.762890+0000","last_became_active":"2024-03-23T23:42:40.688875+0000","last_became_peered":"2024-03-23T23:42:40.688875+0000","last_unstale":"2024-03-23T23:42:51.762890+0000","last_undegraded":"2024-03-23T23:42:51.762890+0000","last_fullsized":"2024-03-23T23:42:51.762890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:27:03.132032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750979+0000","last_change":"2024-03-23T23:42:50.762055+0000","last_active":"2024-03-23T23:42:51.750979+0000","last_peered":"2024-03-23T23:42:51.750979+0000","last_clean":"2024-03-23T23:42:51.750979+0000","last_became_active":"2024-03-23T23:42:50.761762+0000","last_became_peered":"2024-03-23T23:42:50.761762+0000","last_unstale":"2024-03-23T23:42:51.750979+0000","last_undegraded":"2024-03-23T23:42:51.750979+0000","last_fullsized":"2024-03-23T23:42:51.750979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:28.822672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752195+0000","last_change":"2024-03-23T23:42:40.683701+0000","last_active":"2024-03-23T23:42:51.752195+0000","last_peered":"2024-03-23T23:42:51.752195+0000","last_clean":"2024-03-23T23:42:51.752195+0000","last_became_active":"2024-03-23T23:42:40.683377+0000","last_became_peered":"2024-03-23T23:42:40.683377+0000","last_unstale":"2024-03-23T23:42:51.752195+0000","last_undegraded":"2024-03-23T23:42:51.752195+0000","last_fullsized":"2024-03-23T23:42:51.752195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751120+0000","last_change":"2024-03-23T23:42:50.754372+0000","last_active":"2024-03-23T23:42:51.751120+0000","last_peered":"2024-03-23T23:42:51.751120+0000","last_clean":"2024-03-23T23:42:51.751120+0000","last_became_active":"2024-03-23T23:42:50.754072+0000","last_became_peered":"2024-03-23T23:42:50.754072+0000","last_unstale":"2024-03-23T23:42:51.751120+0000","last_undegraded":"2024-03-23T23:42:51.751120+0000","last_fullsized":"2024-03-23T23:42:51.751120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:40:34.077584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190143+0000","last_change":"2024-03-23T23:42:40.689769+0000","last_active":"2024-03-23T23:42:52.190143+0000","last_peered":"2024-03-23T23:42:52.190143+0000","last_clean":"2024-03-23T23:42:52.190143+0000","last_became_active":"2024-03-23T23:42:40.689111+0000","last_became_peered":"2024-03-23T23:42:40.689111+0000","last_unstale":"2024-03-23T23:42:52.190143+0000","last_undegraded":"2024-03-23T23:42:52.190143+0000","last_fullsized":"2024-03-23T23:42:52.190143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:40:22.690954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328020+0000","last_change":"2024-03-23T23:42:50.759792+0000","last_active":"2024-03-23T23:42:52.328020+0000","last_peered":"2024-03-23T23:42:52.328020+0000","last_clean":"2024-03-23T23:42:52.328020+0000","last_became_active":"2024-03-23T23:42:50.759604+0000","last_became_peered":"2024-03-23T23:42:50.759604+0000","last_unstale":"2024-03-23T23:42:52.328020+0000","last_undegraded":"2024-03-23T23:42:52.328020+0000","last_fullsized":"2024-03-23T23:42:52.328020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:15:25.617521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749937+0000","last_change":"2024-03-23T23:42:40.690961+0000","last_active":"2024-03-23T23:42:51.749937+0000","last_peered":"2024-03-23T23:42:51.749937+0000","last_clean":"2024-03-23T23:42:51.749937+0000","last_became_active":"2024-03-23T23:42:40.690690+0000","last_became_peered":"2024-03-23T23:42:40.690690+0000","last_unstale":"2024-03-23T23:42:51.749937+0000","last_undegraded":"2024-03-23T23:42:51.749937+0000","last_fullsized":"2024-03-23T23:42:51.749937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:56.763759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.762557+0000","last_change":"2024-03-23T23:42:50.764821+0000","last_active":"2024-03-23T23:42:51.762557+0000","last_peered":"2024-03-23T23:42:51.762557+0000","last_clean":"2024-03-23T23:42:51.762557+0000","last_became_active":"2024-03-23T23:42:50.764563+0000","last_became_peered":"2024-03-23T23:42:50.764563+0000","last_unstale":"2024-03-23T23:42:51.762557+0000","last_undegraded":"2024-03-23T23:42:51.762557+0000","last_fullsized":"2024-03-23T23:42:51.762557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:48:24.982671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.329026+0000","last_change":"2024-03-23T23:42:40.708540+0000","last_active":"2024-03-23T23:42:52.329026+0000","last_peered":"2024-03-23T23:42:52.329026+0000","last_clean":"2024-03-23T23:42:52.329026+0000","last_became_active":"2024-03-23T23:42:40.708031+0000","last_became_peered":"2024-03-23T23:42:40.708031+0000","last_unstale":"2024-03-23T23:42:52.329026+0000","last_undegraded":"2024-03-23T23:42:52.329026+0000","last_fullsized":"2024-03-23T23:42:52.329026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:44:03.386124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766736+0000","last_change":"2024-03-23T23:42:50.771062+0000","last_active":"2024-03-23T23:42:51.766736+0000","last_peered":"2024-03-23T23:42:51.766736+0000","last_clean":"2024-03-23T23:42:51.766736+0000","last_became_active":"2024-03-23T23:42:50.770790+0000","last_became_peered":"2024-03-23T23:42:50.770790+0000","last_unstale":"2024-03-23T23:42:51.766736+0000","last_undegraded":"2024-03-23T23:42:51.766736+0000","last_fullsized":"2024-03-23T23:42:51.766736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:13:07.156401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328080+0000","last_change":"2024-03-23T23:42:40.697920+0000","last_active":"2024-03-23T23:42:52.328080+0000","last_peered":"2024-03-23T23:42:52.328080+0000","last_clean":"2024-03-23T23:42:52.328080+0000","last_became_active":"2024-03-23T23:42:40.697694+0000","last_became_peered":"2024-03-23T23:42:40.697694+0000","last_unstale":"2024-03-23T23:42:52.328080+0000","last_undegraded":"2024-03-23T23:42:52.328080+0000","last_fullsized":"2024-03-23T23:42:52.328080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752567+0000","last_change":"2024-03-23T23:42:50.751694+0000","last_active":"2024-03-23T23:42:51.752567+0000","last_peered":"2024-03-23T23:42:51.752567+0000","last_clean":"2024-03-23T23:42:51.752567+0000","last_became_active":"2024-03-23T23:42:50.751452+0000","last_became_peered":"2024-03-23T23:42:50.751452+0000","last_unstale":"2024-03-23T23:42:51.752567+0000","last_undegraded":"2024-03-23T23:42:51.752567+0000","last_fullsized":"2024-03-23T23:42:51.752567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:57:49.981068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767129+0000","last_change":"2024-03-23T23:42:40.681928+0000","last_active":"2024-03-23T23:42:51.767129+0000","last_peered":"2024-03-23T23:42:51.767129+0000","last_clean":"2024-03-23T23:42:51.767129+0000","last_became_active":"2024-03-23T23:42:40.681337+0000","last_became_peered":"2024-03-23T23:42:40.681337+0000","last_unstale":"2024-03-23T23:42:51.767129+0000","last_undegraded":"2024-03-23T23:42:51.767129+0000","last_fullsized":"2024-03-23T23:42:51.767129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:52.220411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328332+0000","last_change":"2024-03-23T23:42:50.769003+0000","last_active":"2024-03-23T23:42:52.328332+0000","last_peered":"2024-03-23T23:42:52.328332+0000","last_clean":"2024-03-23T23:42:52.328332+0000","last_became_active":"2024-03-23T23:42:50.768695+0000","last_became_peered":"2024-03-23T23:42:50.768695+0000","last_unstale":"2024-03-23T23:42:52.328332+0000","last_undegraded":"2024-03-23T23:42:52.328332+0000","last_fullsized":"2024-03-23T23:42:52.328332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:17:11.847056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.762577+0000","last_change":"2024-03-23T23:42:40.680934+0000","last_active":"2024-03-23T23:42:51.762577+0000","last_peered":"2024-03-23T23:42:51.762577+0000","last_clean":"2024-03-23T23:42:51.762577+0000","last_became_active":"2024-03-23T23:42:40.680643+0000","last_became_peered":"2024-03-23T23:42:40.680643+0000","last_unstale":"2024-03-23T23:42:51.762577+0000","last_undegraded":"2024-03-23T23:42:51.762577+0000","last_fullsized":"2024-03-23T23:42:51.762577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:34.630671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189908+0000","last_change":"2024-03-23T23:42:50.762401+0000","last_active":"2024-03-23T23:42:52.189908+0000","last_peered":"2024-03-23T23:42:52.189908+0000","last_clean":"2024-03-23T23:42:52.189908+0000","last_became_active":"2024-03-23T23:42:50.762183+0000","last_became_peered":"2024-03-23T23:42:50.762183+0000","last_unstale":"2024-03-23T23:42:52.189908+0000","last_undegraded":"2024-03-23T23:42:52.189908+0000","last_fullsized":"2024-03-23T23:42:52.189908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:13:10.497921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327888+0000","last_change":"2024-03-23T23:42:40.682736+0000","last_active":"2024-03-23T23:42:52.327888+0000","last_peered":"2024-03-23T23:42:52.327888+0000","last_clean":"2024-03-23T23:42:52.327888+0000","last_became_active":"2024-03-23T23:42:40.682410+0000","last_became_peered":"2024-03-23T23:42:40.682410+0000","last_unstale":"2024-03-23T23:42:52.327888+0000","last_undegraded":"2024-03-23T23:42:52.327888+0000","last_fullsized":"2024-03-23T23:42:52.327888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:01:06.338641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327793+0000","last_change":"2024-03-23T23:42:50.749204+0000","last_active":"2024-03-23T23:42:52.327793+0000","last_peered":"2024-03-23T23:42:52.327793+0000","last_clean":"2024-03-23T23:42:52.327793+0000","last_became_active":"2024-03-23T23:42:50.748809+0000","last_became_peered":"2024-03-23T23:42:50.748809+0000","last_unstale":"2024-03-23T23:42:52.327793+0000","last_undegraded":"2024-03-23T23:42:52.327793+0000","last_fullsized":"2024-03-23T23:42:52.327793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:39:49.888359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752151+0000","last_change":"2024-03-23T23:42:40.682523+0000","last_active":"2024-03-23T23:42:51.752151+0000","last_peered":"2024-03-23T23:42:51.752151+0000","last_clean":"2024-03-23T23:42:51.752151+0000","last_became_active":"2024-03-23T23:42:40.682155+0000","last_became_peered":"2024-03-23T23:42:40.682155+0000","last_unstale":"2024-03-23T23:42:51.752151+0000","last_undegraded":"2024-03-23T23:42:51.752151+0000","last_fullsized":"2024-03-23T23:42:51.752151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:33.260151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749469+0000","last_change":"2024-03-23T23:42:50.746115+0000","last_active":"2024-03-23T23:42:51.749469+0000","last_peered":"2024-03-23T23:42:51.749469+0000","last_clean":"2024-03-23T23:42:51.749469+0000","last_became_active":"2024-03-23T23:42:50.745858+0000","last_became_peered":"2024-03-23T23:42:50.745858+0000","last_unstale":"2024-03-23T23:42:51.749469+0000","last_undegraded":"2024-03-23T23:42:51.749469+0000","last_fullsized":"2024-03-23T23:42:51.749469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:00:43.318455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752280+0000","last_change":"2024-03-23T23:42:40.702089+0000","last_active":"2024-03-23T23:42:51.752280+0000","last_peered":"2024-03-23T23:42:51.752280+0000","last_clean":"2024-03-23T23:42:51.752280+0000","last_became_active":"2024-03-23T23:42:40.701874+0000","last_became_peered":"2024-03-23T23:42:40.701874+0000","last_unstale":"2024-03-23T23:42:51.752280+0000","last_undegraded":"2024-03-23T23:42:51.752280+0000","last_fullsized":"2024-03-23T23:42:51.752280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189853+0000","last_change":"2024-03-23T23:42:50.773115+0000","last_active":"2024-03-23T23:42:52.189853+0000","last_peered":"2024-03-23T23:42:52.189853+0000","last_clean":"2024-03-23T23:42:52.189853+0000","last_became_active":"2024-03-23T23:42:50.772849+0000","last_became_peered":"2024-03-23T23:42:50.772849+0000","last_unstale":"2024-03-23T23:42:52.189853+0000","last_undegraded":"2024-03-23T23:42:52.189853+0000","last_fullsized":"2024-03-23T23:42:52.189853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:29:42.898728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752487+0000","last_change":"2024-03-23T23:42:40.703254+0000","last_active":"2024-03-23T23:42:51.752487+0000","last_peered":"2024-03-23T23:42:51.752487+0000","last_clean":"2024-03-23T23:42:51.752487+0000","last_became_active":"2024-03-23T23:42:40.702447+0000","last_became_peered":"2024-03-23T23:42:40.702447+0000","last_unstale":"2024-03-23T23:42:51.752487+0000","last_undegraded":"2024-03-23T23:42:51.752487+0000","last_fullsized":"2024-03-23T23:42:51.752487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:59:45.154553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328157+0000","last_change":"2024-03-23T23:42:50.748946+0000","last_active":"2024-03-23T23:42:52.328157+0000","last_peered":"2024-03-23T23:42:52.328157+0000","last_clean":"2024-03-23T23:42:52.328157+0000","last_became_active":"2024-03-23T23:42:50.745205+0000","last_became_peered":"2024-03-23T23:42:50.745205+0000","last_unstale":"2024-03-23T23:42:52.328157+0000","last_undegraded":"2024-03-23T23:42:52.328157+0000","last_fullsized":"2024-03-23T23:42:52.328157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:58:16.372010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190250+0000","last_change":"2024-03-23T23:42:40.714331+0000","last_active":"2024-03-23T23:42:52.190250+0000","last_peered":"2024-03-23T23:42:52.190250+0000","last_clean":"2024-03-23T23:42:52.190250+0000","last_became_active":"2024-03-23T23:42:40.713737+0000","last_became_peered":"2024-03-23T23:42:40.713737+0000","last_unstale":"2024-03-23T23:42:52.190250+0000","last_undegraded":"2024-03-23T23:42:52.190250+0000","last_fullsized":"2024-03-23T23:42:52.190250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:24:43.902129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328361+0000","last_change":"2024-03-23T23:42:50.746666+0000","last_active":"2024-03-23T23:42:52.328361+0000","last_peered":"2024-03-23T23:42:52.328361+0000","last_clean":"2024-03-23T23:42:52.328361+0000","last_became_active":"2024-03-23T23:42:50.746149+0000","last_became_peered":"2024-03-23T23:42:50.746149+0000","last_unstale":"2024-03-23T23:42:52.328361+0000","last_undegraded":"2024-03-23T23:42:52.328361+0000","last_fullsized":"2024-03-23T23:42:52.328361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:42:58.533499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327499+0000","last_change":"2024-03-23T23:42:40.710655+0000","last_active":"2024-03-23T23:42:52.327499+0000","last_peered":"2024-03-23T23:42:52.327499+0000","last_clean":"2024-03-23T23:42:52.327499+0000","last_became_active":"2024-03-23T23:42:40.710362+0000","last_became_peered":"2024-03-23T23:42:40.710362+0000","last_unstale":"2024-03-23T23:42:52.327499+0000","last_undegraded":"2024-03-23T23:42:52.327499+0000","last_fullsized":"2024-03-23T23:42:52.327499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:12:14.359173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752890+0000","last_change":"2024-03-23T23:42:50.753397+0000","last_active":"2024-03-23T23:42:51.752890+0000","last_peered":"2024-03-23T23:42:51.752890+0000","last_clean":"2024-03-23T23:42:51.752890+0000","last_became_active":"2024-03-23T23:42:50.753085+0000","last_became_peered":"2024-03-23T23:42:50.753085+0000","last_unstale":"2024-03-23T23:42:51.752890+0000","last_undegraded":"2024-03-23T23:42:51.752890+0000","last_fullsized":"2024-03-23T23:42:51.752890+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:25:44.894505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189509+0000","last_change":"2024-03-23T23:42:40.689380+0000","last_active":"2024-03-23T23:42:52.189509+0000","last_peered":"2024-03-23T23:42:52.189509+0000","last_clean":"2024-03-23T23:42:52.189509+0000","last_became_active":"2024-03-23T23:42:40.689023+0000","last_became_peered":"2024-03-23T23:42:40.689023+0000","last_unstale":"2024-03-23T23:42:52.189509+0000","last_undegraded":"2024-03-23T23:42:52.189509+0000","last_fullsized":"2024-03-23T23:42:52.189509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:17:19.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766610+0000","last_change":"2024-03-23T23:42:50.756133+0000","last_active":"2024-03-23T23:42:51.766610+0000","last_peered":"2024-03-23T23:42:51.766610+0000","last_clean":"2024-03-23T23:42:51.766610+0000","last_became_active":"2024-03-23T23:42:50.755405+0000","last_became_peered":"2024-03-23T23:42:50.755405+0000","last_unstale":"2024-03-23T23:42:51.766610+0000","last_undegraded":"2024-03-23T23:42:51.766610+0000","last_fullsized":"2024-03-23T23:42:51.766610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:46:10.784416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328292+0000","last_change":"2024-03-23T23:42:40.698234+0000","last_active":"2024-03-23T23:42:52.328292+0000","last_peered":"2024-03-23T23:42:52.328292+0000","last_clean":"2024-03-23T23:42:52.328292+0000","last_became_active":"2024-03-23T23:42:40.695978+0000","last_became_peered":"2024-03-23T23:42:40.695978+0000","last_unstale":"2024-03-23T23:42:52.328292+0000","last_undegraded":"2024-03-23T23:42:52.328292+0000","last_fullsized":"2024-03-23T23:42:52.328292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:04.633288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328907+0000","last_change":"2024-03-23T23:42:50.752051+0000","last_active":"2024-03-23T23:42:52.328907+0000","last_peered":"2024-03-23T23:42:52.328907+0000","last_clean":"2024-03-23T23:42:52.328907+0000","last_became_active":"2024-03-23T23:42:50.751738+0000","last_became_peered":"2024-03-23T23:42:50.751738+0000","last_unstale":"2024-03-23T23:42:52.328907+0000","last_undegraded":"2024-03-23T23:42:52.328907+0000","last_fullsized":"2024-03-23T23:42:52.328907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:20:53.750917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189626+0000","last_change":"2024-03-23T23:42:40.698407+0000","last_active":"2024-03-23T23:42:52.189626+0000","last_peered":"2024-03-23T23:42:52.189626+0000","last_clean":"2024-03-23T23:42:52.189626+0000","last_became_active":"2024-03-23T23:42:40.698092+0000","last_became_peered":"2024-03-23T23:42:40.698092+0000","last_unstale":"2024-03-23T23:42:52.189626+0000","last_undegraded":"2024-03-23T23:42:52.189626+0000","last_fullsized":"2024-03-23T23:42:52.189626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:00:33.261296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327627+0000","last_change":"2024-03-23T23:42:50.753000+0000","last_active":"2024-03-23T23:42:52.327627+0000","last_peered":"2024-03-23T23:42:52.327627+0000","last_clean":"2024-03-23T23:42:52.327627+0000","last_became_active":"2024-03-23T23:42:50.752614+0000","last_became_peered":"2024-03-23T23:42:50.752614+0000","last_unstale":"2024-03-23T23:42:52.327627+0000","last_undegraded":"2024-03-23T23:42:52.327627+0000","last_fullsized":"2024-03-23T23:42:52.327627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:57:04.394872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328439+0000","last_change":"2024-03-23T23:42:40.700631+0000","last_active":"2024-03-23T23:42:52.328439+0000","last_peered":"2024-03-23T23:42:52.328439+0000","last_clean":"2024-03-23T23:42:52.328439+0000","last_became_active":"2024-03-23T23:42:40.697932+0000","last_became_peered":"2024-03-23T23:42:40.697932+0000","last_unstale":"2024-03-23T23:42:52.328439+0000","last_undegraded":"2024-03-23T23:42:52.328439+0000","last_fullsized":"2024-03-23T23:42:52.328439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:05:17.694245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749336+0000","last_change":"2024-03-23T23:42:50.765991+0000","last_active":"2024-03-23T23:42:51.749336+0000","last_peered":"2024-03-23T23:42:51.749336+0000","last_clean":"2024-03-23T23:42:51.749336+0000","last_became_active":"2024-03-23T23:42:50.765716+0000","last_became_peered":"2024-03-23T23:42:50.765716+0000","last_unstale":"2024-03-23T23:42:51.749336+0000","last_undegraded":"2024-03-23T23:42:51.749336+0000","last_fullsized":"2024-03-23T23:42:51.749336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:49:52.067143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763373+0000","last_change":"2024-03-23T23:42:40.683983+0000","last_active":"2024-03-23T23:42:51.763373+0000","last_peered":"2024-03-23T23:42:51.763373+0000","last_clean":"2024-03-23T23:42:51.763373+0000","last_became_active":"2024-03-23T23:42:40.683711+0000","last_became_peered":"2024-03-23T23:42:40.683711+0000","last_unstale":"2024-03-23T23:42:51.763373+0000","last_undegraded":"2024-03-23T23:42:51.763373+0000","last_fullsized":"2024-03-23T23:42:51.763373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:51:30.695597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189321+0000","last_change":"2024-03-23T23:42:50.766544+0000","last_active":"2024-03-23T23:42:52.189321+0000","last_peered":"2024-03-23T23:42:52.189321+0000","last_clean":"2024-03-23T23:42:52.189321+0000","last_became_active":"2024-03-23T23:42:50.766328+0000","last_became_peered":"2024-03-23T23:42:50.766328+0000","last_unstale":"2024-03-23T23:42:52.189321+0000","last_undegraded":"2024-03-23T23:42:52.189321+0000","last_fullsized":"2024-03-23T23:42:52.189321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:28:43.677331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766986+0000","last_change":"2024-03-23T23:42:40.678622+0000","last_active":"2024-03-23T23:42:51.766986+0000","last_peered":"2024-03-23T23:42:51.766986+0000","last_clean":"2024-03-23T23:42:51.766986+0000","last_became_active":"2024-03-23T23:42:40.678325+0000","last_became_peered":"2024-03-23T23:42:40.678325+0000","last_unstale":"2024-03-23T23:42:51.766986+0000","last_undegraded":"2024-03-23T23:42:51.766986+0000","last_fullsized":"2024-03-23T23:42:51.766986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:54:27.641281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189432+0000","last_change":"2024-03-23T23:42:50.750690+0000","last_active":"2024-03-23T23:42:52.189432+0000","last_peered":"2024-03-23T23:42:52.189432+0000","last_clean":"2024-03-23T23:42:52.189432+0000","last_became_active":"2024-03-23T23:42:50.750466+0000","last_became_peered":"2024-03-23T23:42:50.750466+0000","last_unstale":"2024-03-23T23:42:52.189432+0000","last_undegraded":"2024-03-23T23:42:52.189432+0000","last_fullsized":"2024-03-23T23:42:52.189432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:13:07.156401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190227+0000","last_change":"2024-03-23T23:42:40.701959+0000","last_active":"2024-03-23T23:42:52.190227+0000","last_peered":"2024-03-23T23:42:52.190227+0000","last_clean":"2024-03-23T23:42:52.190227+0000","last_became_active":"2024-03-23T23:42:40.700855+0000","last_became_peered":"2024-03-23T23:42:40.700855+0000","last_unstale":"2024-03-23T23:42:52.190227+0000","last_undegraded":"2024-03-23T23:42:52.190227+0000","last_fullsized":"2024-03-23T23:42:52.190227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:49:42.009983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":103450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":101984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":101452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":286720,"data_stored":104468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":692262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":262144,"data_stored":101292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":282624,"data_stored":103016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":864256,"data_stored":692228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T23:43:00.921 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T23:43:01.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.093+0000 7f1705c00640 1 Processor -- start 2024-03-23T23:43:01.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.097+0000 7f1705c00640 1 -- start start 2024-03-23T23:43:01.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.097+0000 7f1705c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1700152c70 0x7f170006fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:01.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.097+0000 7f1705c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f170006e1b0 0x7f1700155d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:01.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.097+0000 7f1705c00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1700153050 con 0x7f17000c2890 2024-03-23T23:43:01.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.097+0000 7f1705c00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17000c42b0 con 0x7f1700152c70 2024-03-23T23:43:01.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.097+0000 7f1705c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17000c4590 con 0x7f170006e1b0 2024-03-23T23:43:01.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.097+0000 7f16ffe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1700152c70 0x7f170006fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:01.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.097+0000 7f16ffe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1700152c70 0x7f170006fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42336/0 (socket says 172.21.15.8:42336) 2024-03-23T23:43:01.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.097+0000 7f16ffe00640 1 -- 172.21.15.8:0/588697772 learned_addr learned my addr 172.21.15.8:0/588697772 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:01.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.097+0000 7f1705200640 1 --2- 172.21.15.8:0/588697772 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f170006e1b0 0x7f1700155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:01.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.097+0000 7f16f7400640 1 --1- 172.21.15.8:0/588697772 >> v1:172.21.15.8:6789/0 conn(0x7f17000c2890 0x7f170006b170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:45096/0 (socket says 172.21.15.8:45096) 2024-03-23T23:43:01.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.097+0000 7f16ffe00640 1 -- 172.21.15.8:0/588697772 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f170006e1b0 msgr2=0x7f1700155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:01.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.097+0000 7f16ffe00640 1 --2- 172.21.15.8:0/588697772 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f170006e1b0 0x7f1700155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:01.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.097+0000 7f16ffe00640 1 -- 172.21.15.8:0/588697772 >> v1:172.21.15.8:6789/0 conn(0x7f17000c2890 legacy=0x7f170006b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:01.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.097+0000 7f16ffe00640 1 -- 172.21.15.8:0/588697772 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17001557f0 con 0x7f1700152c70 2024-03-23T23:43:01.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.101+0000 7f16ffe00640 1 --2- 172.21.15.8:0/588697772 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1700152c70 0x7f170006fe20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f16f0009870 tx=0x7f16f001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614fe6de043e023c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:01.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.101+0000 7f16ff400640 1 -- 172.21.15.8:0/588697772 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f00b1070 con 0x7f1700152c70 2024-03-23T23:43:01.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.101+0000 7f16ff400640 1 -- 172.21.15.8:0/588697772 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f00a8050 con 0x7f1700152c70 2024-03-23T23:43:01.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.101+0000 7f16ff400640 1 -- 172.21.15.8:0/588697772 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f00ac860 con 0x7f1700152c70 2024-03-23T23:43:01.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.101+0000 7f1705c00640 1 -- 172.21.15.8:0/588697772 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1700152c70 msgr2=0x7f170006fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:01.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.101+0000 7f1705c00640 1 --2- 172.21.15.8:0/588697772 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1700152c70 0x7f170006fe20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f16f0009870 tx=0x7f16f001c4d0 comp rx=0 tx=0).stop 2024-03-23T23:43:01.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.101+0000 7f1705c00640 1 -- 172.21.15.8:0/588697772 shutdown_connections 2024-03-23T23:43:01.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.101+0000 7f1705c00640 1 --2- 172.21.15.8:0/588697772 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f170006e1b0 0x7f1700155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:01.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.101+0000 7f1705c00640 1 --2- 172.21.15.8:0/588697772 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1700152c70 0x7f170006fe20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:01.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.101+0000 7f1705c00640 1 -- 172.21.15.8:0/588697772 >> 172.21.15.8:0/588697772 conn(0x7f17000c4990 msgr2=0x7f17000c4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:01.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.101+0000 7f1705c00640 1 -- 172.21.15.8:0/588697772 shutdown_connections 2024-03-23T23:43:01.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.101+0000 7f1705c00640 1 -- 172.21.15.8:0/588697772 wait complete. 2024-03-23T23:43:01.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.101+0000 7f1705c00640 1 Processor -- start 2024-03-23T23:43:01.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.101+0000 7f1705c00640 1 -- start start 2024-03-23T23:43:01.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.105+0000 7f1705c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f170006e1b0 0x7f170014a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:01.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.105+0000 7f1705c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17000c2890 0x7f17001ef390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:01.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.105+0000 7f1705c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1700152c70 0x7f17001ee9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:01.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.105+0000 7f1705c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1700162b30 con 0x7f17000c2890 2024-03-23T23:43:01.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.105+0000 7f1705c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17001629b0 con 0x7f1700152c70 2024-03-23T23:43:01.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.105+0000 7f1705c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1700162cb0 con 0x7f170006e1b0 2024-03-23T23:43:01.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.105+0000 7f16f7400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17000c2890 0x7f17001ef390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:01.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.105+0000 7f16ffe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f170006e1b0 0x7f170014a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:01.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.105+0000 7f16f7400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17000c2890 0x7f17001ef390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42344/0 (socket says 172.21.15.8:42344) 2024-03-23T23:43:01.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.105+0000 7f16f7400640 1 -- 172.21.15.8:0/2381739118 learned_addr learned my addr 172.21.15.8:0/2381739118 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:01.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.105+0000 7f1705200640 1 --2- 172.21.15.8:0/2381739118 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1700152c70 0x7f17001ee9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:01.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.105+0000 7f16f7400640 1 -- 172.21.15.8:0/2381739118 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f170006e1b0 msgr2=0x7f170014a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:01.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.105+0000 7f16f7400640 1 --2- 172.21.15.8:0/2381739118 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f170006e1b0 0x7f170014a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:01.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.105+0000 7f16f7400640 1 -- 172.21.15.8:0/2381739118 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1700152c70 msgr2=0x7f17001ee9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:01.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.105+0000 7f16f7400640 1 --2- 172.21.15.8:0/2381739118 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1700152c70 0x7f17001ee9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:01.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.105+0000 7f16f7400640 1 -- 172.21.15.8:0/2381739118 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17001595d0 con 0x7f17000c2890 2024-03-23T23:43:01.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.105+0000 7f16f7400640 1 --2- 172.21.15.8:0/2381739118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17000c2890 0x7f17001ef390 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f16e800c460 tx=0x7f16e800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:01.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.105+0000 7f16fcc00640 1 -- 172.21.15.8:0/2381739118 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e8018070 con 0x7f17000c2890 2024-03-23T23:43:01.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.105+0000 7f16fcc00640 1 -- 172.21.15.8:0/2381739118 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e8007480 con 0x7f17000c2890 2024-03-23T23:43:01.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.105+0000 7f1705c00640 1 -- 172.21.15.8:0/2381739118 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17001598b0 con 0x7f17000c2890 2024-03-23T23:43:01.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.105+0000 7f16fcc00640 1 -- 172.21.15.8:0/2381739118 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e80047f0 con 0x7f17000c2890 2024-03-23T23:43:01.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.105+0000 7f1705c00640 1 -- 172.21.15.8:0/2381739118 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1700149bf0 con 0x7f17000c2890 2024-03-23T23:43:01.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.105+0000 7f1705c00640 1 -- 172.21.15.8:0/2381739118 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f170004f410 con 0x7f17000c2890 2024-03-23T23:43:01.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.105+0000 7f16fcc00640 1 -- 172.21.15.8:0/2381739118 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f16e801b070 con 0x7f17000c2890 2024-03-23T23:43:01.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.109+0000 7f16fcc00640 1 --2- 172.21.15.8:0/2381739118 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f16dc067660 0x7f16dc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:01.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.109+0000 7f16fcc00640 1 -- 172.21.15.8:0/2381739118 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f16e8084e70 con 0x7f17000c2890 2024-03-23T23:43:01.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.109+0000 7f16ffe00640 1 --2- 172.21.15.8:0/2381739118 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f16dc067660 0x7f16dc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:01.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.109+0000 7f16ffe00640 1 --2- 172.21.15.8:0/2381739118 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f16dc067660 0x7f16dc069b20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f16f00ae000 tx=0x7f16f00a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:01.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.113+0000 7f16fcc00640 1 -- 172.21.15.8:0/2381739118 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f16e8055160 con 0x7f17000c2890 2024-03-23T23:43:01.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.285+0000 7f1705c00640 1 -- 172.21.15.8:0/2381739118 --> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f170014eb50 con 0x7f16dc067660 2024-03-23T23:43:01.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.297+0000 7f16fcc00640 1 -- 172.21.15.8:0/2381739118 <== mgr.4098 v2:172.21.15.196:6832/1295060067 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+490307 (secure 0 0 0) 0x7f16f00a8040 con 0x7f16dc067660 2024-03-23T23:43:01.302 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:43:01.306 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-03-23T23:43:01.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.301+0000 7f1705c00640 1 -- 172.21.15.8:0/2381739118 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f16dc067660 msgr2=0x7f16dc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:01.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.301+0000 7f1705c00640 1 --2- 172.21.15.8:0/2381739118 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f16dc067660 0x7f16dc069b20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f16f00ae000 tx=0x7f16f00a7000 comp rx=0 tx=0).stop 2024-03-23T23:43:01.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.301+0000 7f1705c00640 1 -- 172.21.15.8:0/2381739118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17000c2890 msgr2=0x7f17001ef390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:01.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.301+0000 7f1705c00640 1 --2- 172.21.15.8:0/2381739118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17000c2890 0x7f17001ef390 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f16e800c460 tx=0x7f16e800c920 comp rx=0 tx=0).stop 2024-03-23T23:43:01.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.301+0000 7f1705c00640 1 -- 172.21.15.8:0/2381739118 shutdown_connections 2024-03-23T23:43:01.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.301+0000 7f1705c00640 1 --2- 172.21.15.8:0/2381739118 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1700152c70 0x7f17001ee9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:01.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.301+0000 7f1705c00640 1 --2- 172.21.15.8:0/2381739118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17000c2890 0x7f17001ef390 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:01.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.301+0000 7f1705c00640 1 --2- 172.21.15.8:0/2381739118 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f16dc067660 0x7f16dc069b20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:01.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.301+0000 7f1705c00640 1 --2- 172.21.15.8:0/2381739118 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f170006e1b0 0x7f170014a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:01.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.301+0000 7f1705c00640 1 -- 172.21.15.8:0/2381739118 >> 172.21.15.8:0/2381739118 conn(0x7f17000c4990 msgr2=0x7f170015f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:01.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.301+0000 7f1705c00640 1 -- 172.21.15.8:0/2381739118 shutdown_connections 2024-03-23T23:43:01.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.301+0000 7f1705c00640 1 -- 172.21.15.8:0/2381739118 wait complete. 2024-03-23T23:43:01.322 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-03-23T23:43:00.276639+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":249,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240296,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734424,"statfs":{"total":773094113280,"available":772848050176,"internally_reserved":0,"allocated":3383296,"data_stored":2000152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.547812"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750876+0000","last_change":"2024-03-23T23:42:50.736219+0000","last_active":"2024-03-23T23:42:51.750876+0000","last_peered":"2024-03-23T23:42:51.750876+0000","last_clean":"2024-03-23T23:42:51.750876+0000","last_became_active":"2024-03-23T23:42:50.735940+0000","last_became_peered":"2024-03-23T23:42:50.735940+0000","last_unstale":"2024-03-23T23:42:51.750876+0000","last_undegraded":"2024-03-23T23:42:51.750876+0000","last_fullsized":"2024-03-23T23:42:51.750876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:11:44.111477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763488+0000","last_change":"2024-03-23T23:42:39.693858+0000","last_active":"2024-03-23T23:42:51.763488+0000","last_peered":"2024-03-23T23:42:51.763488+0000","last_clean":"2024-03-23T23:42:51.763488+0000","last_became_active":"2024-03-23T23:42:39.693636+0000","last_became_peered":"2024-03-23T23:42:39.693636+0000","last_unstale":"2024-03-23T23:42:51.763488+0000","last_undegraded":"2024-03-23T23:42:51.763488+0000","last_fullsized":"2024-03-23T23:42:51.763488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:44:07.213123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328567+0000","last_change":"2024-03-23T23:42:40.685708+0000","last_active":"2024-03-23T23:42:52.328567+0000","last_peered":"2024-03-23T23:42:52.328567+0000","last_clean":"2024-03-23T23:42:52.328567+0000","last_became_active":"2024-03-23T23:42:40.682755+0000","last_became_peered":"2024-03-23T23:42:40.682755+0000","last_unstale":"2024-03-23T23:42:52.328567+0000","last_undegraded":"2024-03-23T23:42:52.328567+0000","last_fullsized":"2024-03-23T23:42:52.328567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:04.633288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327590+0000","last_change":"2024-03-23T23:42:49.750108+0000","last_active":"2024-03-23T23:42:52.327590+0000","last_peered":"2024-03-23T23:42:52.327590+0000","last_clean":"2024-03-23T23:42:52.327590+0000","last_became_active":"2024-03-23T23:42:49.749634+0000","last_became_peered":"2024-03-23T23:42:49.749634+0000","last_unstale":"2024-03-23T23:42:52.327590+0000","last_undegraded":"2024-03-23T23:42:52.327590+0000","last_fullsized":"2024-03-23T23:42:52.327590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:49:16.758908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766376+0000","last_change":"2024-03-23T23:42:50.752450+0000","last_active":"2024-03-23T23:42:51.766376+0000","last_peered":"2024-03-23T23:42:51.766376+0000","last_clean":"2024-03-23T23:42:51.766376+0000","last_became_active":"2024-03-23T23:42:50.752078+0000","last_became_peered":"2024-03-23T23:42:50.752078+0000","last_unstale":"2024-03-23T23:42:51.766376+0000","last_undegraded":"2024-03-23T23:42:51.766376+0000","last_fullsized":"2024-03-23T23:42:51.766376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:28:43.677331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328677+0000","last_change":"2024-03-23T23:42:39.687108+0000","last_active":"2024-03-23T23:42:52.328677+0000","last_peered":"2024-03-23T23:42:52.328677+0000","last_clean":"2024-03-23T23:42:52.328677+0000","last_became_active":"2024-03-23T23:42:39.686875+0000","last_became_peered":"2024-03-23T23:42:39.686875+0000","last_unstale":"2024-03-23T23:42:52.328677+0000","last_undegraded":"2024-03-23T23:42:52.328677+0000","last_fullsized":"2024-03-23T23:42:52.328677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:05:52.079172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763410+0000","last_change":"2024-03-23T23:42:40.698746+0000","last_active":"2024-03-23T23:42:51.763410+0000","last_peered":"2024-03-23T23:42:51.763410+0000","last_clean":"2024-03-23T23:42:51.763410+0000","last_became_active":"2024-03-23T23:42:40.698003+0000","last_became_peered":"2024-03-23T23:42:40.698003+0000","last_unstale":"2024-03-23T23:42:51.763410+0000","last_undegraded":"2024-03-23T23:42:51.763410+0000","last_fullsized":"2024-03-23T23:42:51.763410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:53:46.437114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751376+0000","last_change":"2024-03-23T23:42:49.728923+0000","last_active":"2024-03-23T23:42:51.751376+0000","last_peered":"2024-03-23T23:42:51.751376+0000","last_clean":"2024-03-23T23:42:51.751376+0000","last_became_active":"2024-03-23T23:42:49.728261+0000","last_became_peered":"2024-03-23T23:42:49.728261+0000","last_unstale":"2024-03-23T23:42:51.751376+0000","last_undegraded":"2024-03-23T23:42:51.751376+0000","last_fullsized":"2024-03-23T23:42:51.751376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:22.375891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189476+0000","last_change":"2024-03-23T23:42:50.755852+0000","last_active":"2024-03-23T23:42:52.189476+0000","last_peered":"2024-03-23T23:42:52.189476+0000","last_clean":"2024-03-23T23:42:52.189476+0000","last_became_active":"2024-03-23T23:42:50.755600+0000","last_became_peered":"2024-03-23T23:42:50.755600+0000","last_unstale":"2024-03-23T23:42:52.189476+0000","last_undegraded":"2024-03-23T23:42:52.189476+0000","last_fullsized":"2024-03-23T23:42:52.189476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:29:47.303374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190128+0000","last_change":"2024-03-23T23:42:39.696690+0000","last_active":"2024-03-23T23:42:52.190128+0000","last_peered":"2024-03-23T23:42:52.190128+0000","last_clean":"2024-03-23T23:42:52.190128+0000","last_became_active":"2024-03-23T23:42:39.696342+0000","last_became_peered":"2024-03-23T23:42:39.696342+0000","last_unstale":"2024-03-23T23:42:52.190128+0000","last_undegraded":"2024-03-23T23:42:52.190128+0000","last_fullsized":"2024-03-23T23:42:52.190128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:42:37.702720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328460+0000","last_change":"2024-03-23T23:42:40.700355+0000","last_active":"2024-03-23T23:42:52.328460+0000","last_peered":"2024-03-23T23:42:52.328460+0000","last_clean":"2024-03-23T23:42:52.328460+0000","last_became_active":"2024-03-23T23:42:40.697668+0000","last_became_peered":"2024-03-23T23:42:40.697668+0000","last_unstale":"2024-03-23T23:42:52.328460+0000","last_undegraded":"2024-03-23T23:42:52.328460+0000","last_fullsized":"2024-03-23T23:42:52.328460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:23:43.515519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751380+0000","last_change":"2024-03-23T23:42:49.744792+0000","last_active":"2024-03-23T23:42:51.751380+0000","last_peered":"2024-03-23T23:42:51.751380+0000","last_clean":"2024-03-23T23:42:51.751380+0000","last_became_active":"2024-03-23T23:42:49.744561+0000","last_became_peered":"2024-03-23T23:42:49.744561+0000","last_unstale":"2024-03-23T23:42:51.751380+0000","last_undegraded":"2024-03-23T23:42:51.751380+0000","last_fullsized":"2024-03-23T23:42:51.751380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:07:58.222020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328699+0000","last_change":"2024-03-23T23:42:50.755575+0000","last_active":"2024-03-23T23:42:52.328699+0000","last_peered":"2024-03-23T23:42:52.328699+0000","last_clean":"2024-03-23T23:42:52.328699+0000","last_became_active":"2024-03-23T23:42:50.755337+0000","last_became_peered":"2024-03-23T23:42:50.755337+0000","last_unstale":"2024-03-23T23:42:52.328699+0000","last_undegraded":"2024-03-23T23:42:52.328699+0000","last_fullsized":"2024-03-23T23:42:52.328699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:13.911327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189958+0000","last_change":"2024-03-23T23:42:39.696707+0000","last_active":"2024-03-23T23:42:52.189958+0000","last_peered":"2024-03-23T23:42:52.189958+0000","last_clean":"2024-03-23T23:42:52.189958+0000","last_became_active":"2024-03-23T23:42:39.696401+0000","last_became_peered":"2024-03-23T23:42:39.696401+0000","last_unstale":"2024-03-23T23:42:52.189958+0000","last_undegraded":"2024-03-23T23:42:52.189958+0000","last_fullsized":"2024-03-23T23:42:52.189958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:55.757707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328921+0000","last_change":"2024-03-23T23:42:40.700389+0000","last_active":"2024-03-23T23:42:52.328921+0000","last_peered":"2024-03-23T23:42:52.328921+0000","last_clean":"2024-03-23T23:42:52.328921+0000","last_became_active":"2024-03-23T23:42:40.699770+0000","last_became_peered":"2024-03-23T23:42:40.699770+0000","last_unstale":"2024-03-23T23:42:52.328921+0000","last_undegraded":"2024-03-23T23:42:52.328921+0000","last_fullsized":"2024-03-23T23:42:52.328921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:27.675824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751083+0000","last_change":"2024-03-23T23:42:49.745710+0000","last_active":"2024-03-23T23:42:51.751083+0000","last_peered":"2024-03-23T23:42:51.751083+0000","last_clean":"2024-03-23T23:42:51.751083+0000","last_became_active":"2024-03-23T23:42:49.745526+0000","last_became_peered":"2024-03-23T23:42:49.745526+0000","last_unstale":"2024-03-23T23:42:51.751083+0000","last_undegraded":"2024-03-23T23:42:51.751083+0000","last_fullsized":"2024-03-23T23:42:51.751083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:05:26.746849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766631+0000","last_change":"2024-03-23T23:42:50.747274+0000","last_active":"2024-03-23T23:42:51.766631+0000","last_peered":"2024-03-23T23:42:51.766631+0000","last_clean":"2024-03-23T23:42:51.766631+0000","last_became_active":"2024-03-23T23:42:50.746937+0000","last_became_peered":"2024-03-23T23:42:50.746937+0000","last_unstale":"2024-03-23T23:42:51.766631+0000","last_undegraded":"2024-03-23T23:42:51.766631+0000","last_fullsized":"2024-03-23T23:42:51.766631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:19.610436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751450+0000","last_change":"2024-03-23T23:42:40.682467+0000","last_active":"2024-03-23T23:42:51.751450+0000","last_peered":"2024-03-23T23:42:51.751450+0000","last_clean":"2024-03-23T23:42:51.751450+0000","last_became_active":"2024-03-23T23:42:40.682192+0000","last_became_peered":"2024-03-23T23:42:40.682192+0000","last_unstale":"2024-03-23T23:42:51.751450+0000","last_undegraded":"2024-03-23T23:42:51.751450+0000","last_fullsized":"2024-03-23T23:42:51.751450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:37:24.839568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189778+0000","last_change":"2024-03-23T23:42:39.696528+0000","last_active":"2024-03-23T23:42:52.189778+0000","last_peered":"2024-03-23T23:42:52.189778+0000","last_clean":"2024-03-23T23:42:52.189778+0000","last_became_active":"2024-03-23T23:42:39.696207+0000","last_became_peered":"2024-03-23T23:42:39.696207+0000","last_unstale":"2024-03-23T23:42:52.189778+0000","last_undegraded":"2024-03-23T23:42:52.189778+0000","last_fullsized":"2024-03-23T23:42:52.189778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:02.190910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751687+0000","last_change":"2024-03-23T23:42:49.734156+0000","last_active":"2024-03-23T23:42:51.751687+0000","last_peered":"2024-03-23T23:42:51.751687+0000","last_clean":"2024-03-23T23:42:51.751687+0000","last_became_active":"2024-03-23T23:42:49.733888+0000","last_became_peered":"2024-03-23T23:42:49.733888+0000","last_unstale":"2024-03-23T23:42:51.751687+0000","last_undegraded":"2024-03-23T23:42:51.751687+0000","last_fullsized":"2024-03-23T23:42:51.751687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:23:52.568123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749858+0000","last_change":"2024-03-23T23:42:50.759749+0000","last_active":"2024-03-23T23:42:51.749858+0000","last_peered":"2024-03-23T23:42:51.749858+0000","last_clean":"2024-03-23T23:42:51.749858+0000","last_became_active":"2024-03-23T23:42:50.758670+0000","last_became_peered":"2024-03-23T23:42:50.758670+0000","last_unstale":"2024-03-23T23:42:51.749858+0000","last_undegraded":"2024-03-23T23:42:51.749858+0000","last_fullsized":"2024-03-23T23:42:51.749858+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:16:02.318732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327985+0000","last_change":"2024-03-23T23:42:40.674574+0000","last_active":"2024-03-23T23:42:52.327985+0000","last_peered":"2024-03-23T23:42:52.327985+0000","last_clean":"2024-03-23T23:42:52.327985+0000","last_became_active":"2024-03-23T23:42:40.674293+0000","last_became_peered":"2024-03-23T23:42:40.674293+0000","last_unstale":"2024-03-23T23:42:52.327985+0000","last_undegraded":"2024-03-23T23:42:52.327985+0000","last_fullsized":"2024-03-23T23:42:52.327985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:37:24.839568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767035+0000","last_change":"2024-03-23T23:42:39.683165+0000","last_active":"2024-03-23T23:42:51.767035+0000","last_peered":"2024-03-23T23:42:51.767035+0000","last_clean":"2024-03-23T23:42:51.767035+0000","last_became_active":"2024-03-23T23:42:39.680121+0000","last_became_peered":"2024-03-23T23:42:39.680121+0000","last_unstale":"2024-03-23T23:42:51.767035+0000","last_undegraded":"2024-03-23T23:42:51.767035+0000","last_fullsized":"2024-03-23T23:42:51.767035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:02.190910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752029+0000","last_change":"2024-03-23T23:42:49.745016+0000","last_active":"2024-03-23T23:42:51.752029+0000","last_peered":"2024-03-23T23:42:51.752029+0000","last_clean":"2024-03-23T23:42:51.752029+0000","last_became_active":"2024-03-23T23:42:49.744742+0000","last_became_peered":"2024-03-23T23:42:49.744742+0000","last_unstale":"2024-03-23T23:42:51.752029+0000","last_undegraded":"2024-03-23T23:42:51.752029+0000","last_fullsized":"2024-03-23T23:42:51.752029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:30.033743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751217+0000","last_change":"2024-03-23T23:42:50.749792+0000","last_active":"2024-03-23T23:42:51.751217+0000","last_peered":"2024-03-23T23:42:51.751217+0000","last_clean":"2024-03-23T23:42:51.751217+0000","last_became_active":"2024-03-23T23:42:50.749491+0000","last_became_peered":"2024-03-23T23:42:50.749491+0000","last_unstale":"2024-03-23T23:42:51.751217+0000","last_undegraded":"2024-03-23T23:42:51.751217+0000","last_fullsized":"2024-03-23T23:42:51.751217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:25:44.894505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327680+0000","last_change":"2024-03-23T23:42:40.682999+0000","last_active":"2024-03-23T23:42:52.327680+0000","last_peered":"2024-03-23T23:42:52.327680+0000","last_clean":"2024-03-23T23:42:52.327680+0000","last_became_active":"2024-03-23T23:42:40.682672+0000","last_became_peered":"2024-03-23T23:42:40.682672+0000","last_unstale":"2024-03-23T23:42:52.327680+0000","last_undegraded":"2024-03-23T23:42:52.327680+0000","last_fullsized":"2024-03-23T23:42:52.327680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:59:45.154553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767148+0000","last_change":"2024-03-23T23:42:39.691470+0000","last_active":"2024-03-23T23:42:51.767148+0000","last_peered":"2024-03-23T23:42:51.767148+0000","last_clean":"2024-03-23T23:42:51.767148+0000","last_became_active":"2024-03-23T23:42:39.691124+0000","last_became_peered":"2024-03-23T23:42:39.691124+0000","last_unstale":"2024-03-23T23:42:51.767148+0000","last_undegraded":"2024-03-23T23:42:51.767148+0000","last_fullsized":"2024-03-23T23:42:51.767148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:55.757707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767321+0000","last_change":"2024-03-23T23:42:49.750016+0000","last_active":"2024-03-23T23:42:51.767321+0000","last_peered":"2024-03-23T23:42:51.767321+0000","last_clean":"2024-03-23T23:42:51.767321+0000","last_became_active":"2024-03-23T23:42:49.749279+0000","last_became_peered":"2024-03-23T23:42:49.749279+0000","last_unstale":"2024-03-23T23:42:51.767321+0000","last_undegraded":"2024-03-23T23:42:51.767321+0000","last_fullsized":"2024-03-23T23:42:51.767321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:41:14.671834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328693+0000","last_change":"2024-03-23T23:42:50.753669+0000","last_active":"2024-03-23T23:42:52.328693+0000","last_peered":"2024-03-23T23:42:52.328693+0000","last_clean":"2024-03-23T23:42:52.328693+0000","last_became_active":"2024-03-23T23:42:50.752674+0000","last_became_peered":"2024-03-23T23:42:50.752674+0000","last_unstale":"2024-03-23T23:42:52.328693+0000","last_undegraded":"2024-03-23T23:42:52.328693+0000","last_fullsized":"2024-03-23T23:42:52.328693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:39:04.727316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751477+0000","last_change":"2024-03-23T23:42:40.685051+0000","last_active":"2024-03-23T23:42:51.751477+0000","last_peered":"2024-03-23T23:42:51.751477+0000","last_clean":"2024-03-23T23:42:51.751477+0000","last_became_active":"2024-03-23T23:42:40.684677+0000","last_became_peered":"2024-03-23T23:42:40.684677+0000","last_unstale":"2024-03-23T23:42:51.751477+0000","last_undegraded":"2024-03-23T23:42:51.751477+0000","last_fullsized":"2024-03-23T23:42:51.751477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:20.920978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189995+0000","last_change":"2024-03-23T23:42:39.695253+0000","last_active":"2024-03-23T23:42:52.189995+0000","last_peered":"2024-03-23T23:42:52.189995+0000","last_clean":"2024-03-23T23:42:52.189995+0000","last_became_active":"2024-03-23T23:42:39.694746+0000","last_became_peered":"2024-03-23T23:42:39.694746+0000","last_unstale":"2024-03-23T23:42:52.189995+0000","last_undegraded":"2024-03-23T23:42:52.189995+0000","last_fullsized":"2024-03-23T23:42:52.189995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:57.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752459+0000","last_change":"2024-03-23T23:42:49.724285+0000","last_active":"2024-03-23T23:42:51.752459+0000","last_peered":"2024-03-23T23:42:51.752459+0000","last_clean":"2024-03-23T23:42:51.752459+0000","last_became_active":"2024-03-23T23:42:49.724009+0000","last_became_peered":"2024-03-23T23:42:49.724009+0000","last_unstale":"2024-03-23T23:42:51.752459+0000","last_undegraded":"2024-03-23T23:42:51.752459+0000","last_fullsized":"2024-03-23T23:42:51.752459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:01:04.035970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327444+0000","last_change":"2024-03-23T23:42:50.746737+0000","last_active":"2024-03-23T23:42:52.327444+0000","last_peered":"2024-03-23T23:42:52.327444+0000","last_clean":"2024-03-23T23:42:52.327444+0000","last_became_active":"2024-03-23T23:42:50.746492+0000","last_became_peered":"2024-03-23T23:42:50.746492+0000","last_unstale":"2024-03-23T23:42:52.327444+0000","last_undegraded":"2024-03-23T23:42:52.327444+0000","last_fullsized":"2024-03-23T23:42:52.327444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:50.597847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763599+0000","last_change":"2024-03-23T23:42:40.680963+0000","last_active":"2024-03-23T23:42:51.763599+0000","last_peered":"2024-03-23T23:42:51.763599+0000","last_clean":"2024-03-23T23:42:51.763599+0000","last_became_active":"2024-03-23T23:42:40.680744+0000","last_became_peered":"2024-03-23T23:42:40.680744+0000","last_unstale":"2024-03-23T23:42:51.763599+0000","last_undegraded":"2024-03-23T23:42:51.763599+0000","last_fullsized":"2024-03-23T23:42:51.763599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:17:19.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.753179+0000","last_change":"2024-03-23T23:42:39.691813+0000","last_active":"2024-03-23T23:42:51.753179+0000","last_peered":"2024-03-23T23:42:51.753179+0000","last_clean":"2024-03-23T23:42:51.753179+0000","last_became_active":"2024-03-23T23:42:39.691519+0000","last_became_peered":"2024-03-23T23:42:39.691519+0000","last_unstale":"2024-03-23T23:42:51.753179+0000","last_undegraded":"2024-03-23T23:42:51.753179+0000","last_fullsized":"2024-03-23T23:42:51.753179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:27:41.386662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751110+0000","last_change":"2024-03-23T23:42:49.734197+0000","last_active":"2024-03-23T23:42:51.751110+0000","last_peered":"2024-03-23T23:42:51.751110+0000","last_clean":"2024-03-23T23:42:51.751110+0000","last_became_active":"2024-03-23T23:42:49.733715+0000","last_became_peered":"2024-03-23T23:42:49.733715+0000","last_unstale":"2024-03-23T23:42:51.751110+0000","last_undegraded":"2024-03-23T23:42:51.751110+0000","last_fullsized":"2024-03-23T23:42:51.751110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:36.728428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750902+0000","last_change":"2024-03-23T23:42:50.739957+0000","last_active":"2024-03-23T23:42:51.750902+0000","last_peered":"2024-03-23T23:42:51.750902+0000","last_clean":"2024-03-23T23:42:51.750902+0000","last_became_active":"2024-03-23T23:42:50.739706+0000","last_became_peered":"2024-03-23T23:42:50.739706+0000","last_unstale":"2024-03-23T23:42:51.750902+0000","last_undegraded":"2024-03-23T23:42:51.750902+0000","last_fullsized":"2024-03-23T23:42:51.750902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:49:17.763463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328339+0000","last_change":"2024-03-23T23:42:40.686865+0000","last_active":"2024-03-23T23:42:52.328339+0000","last_peered":"2024-03-23T23:42:52.328339+0000","last_clean":"2024-03-23T23:42:52.328339+0000","last_became_active":"2024-03-23T23:42:40.686582+0000","last_became_peered":"2024-03-23T23:42:40.686582+0000","last_unstale":"2024-03-23T23:42:52.328339+0000","last_undegraded":"2024-03-23T23:42:52.328339+0000","last_fullsized":"2024-03-23T23:42:52.328339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:05:17.694245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767041+0000","last_change":"2024-03-23T23:42:39.678962+0000","last_active":"2024-03-23T23:42:51.767041+0000","last_peered":"2024-03-23T23:42:51.767041+0000","last_clean":"2024-03-23T23:42:51.767041+0000","last_became_active":"2024-03-23T23:42:39.678603+0000","last_became_peered":"2024-03-23T23:42:39.678603+0000","last_unstale":"2024-03-23T23:42:51.767041+0000","last_undegraded":"2024-03-23T23:42:51.767041+0000","last_fullsized":"2024-03-23T23:42:51.767041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:43:46.206865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327329+0000","last_change":"2024-03-23T23:42:49.740561+0000","last_active":"2024-03-23T23:42:52.327329+0000","last_peered":"2024-03-23T23:42:52.327329+0000","last_clean":"2024-03-23T23:42:52.327329+0000","last_became_active":"2024-03-23T23:42:49.740290+0000","last_became_peered":"2024-03-23T23:42:49.740290+0000","last_unstale":"2024-03-23T23:42:52.327329+0000","last_undegraded":"2024-03-23T23:42:52.327329+0000","last_fullsized":"2024-03-23T23:42:52.327329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:21:24.160603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751249+0000","last_change":"2024-03-23T23:42:50.751107+0000","last_active":"2024-03-23T23:42:51.751249+0000","last_peered":"2024-03-23T23:42:51.751249+0000","last_clean":"2024-03-23T23:42:51.751249+0000","last_became_active":"2024-03-23T23:42:50.750859+0000","last_became_peered":"2024-03-23T23:42:50.750859+0000","last_unstale":"2024-03-23T23:42:51.751249+0000","last_undegraded":"2024-03-23T23:42:51.751249+0000","last_fullsized":"2024-03-23T23:42:51.751249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:49:17.763463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766837+0000","last_change":"2024-03-23T23:42:40.686486+0000","last_active":"2024-03-23T23:42:51.766837+0000","last_peered":"2024-03-23T23:42:51.766837+0000","last_clean":"2024-03-23T23:42:51.766837+0000","last_became_active":"2024-03-23T23:42:40.686186+0000","last_became_peered":"2024-03-23T23:42:40.686186+0000","last_unstale":"2024-03-23T23:42:51.766837+0000","last_undegraded":"2024-03-23T23:42:51.766837+0000","last_fullsized":"2024-03-23T23:42:51.766837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:46:30.427072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190217+0000","last_change":"2024-03-23T23:42:39.695099+0000","last_active":"2024-03-23T23:42:52.190217+0000","last_peered":"2024-03-23T23:42:52.190217+0000","last_clean":"2024-03-23T23:42:52.190217+0000","last_became_active":"2024-03-23T23:42:39.694720+0000","last_became_peered":"2024-03-23T23:42:39.694720+0000","last_unstale":"2024-03-23T23:42:52.190217+0000","last_undegraded":"2024-03-23T23:42:52.190217+0000","last_fullsized":"2024-03-23T23:42:52.190217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:58:07.880313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.762762+0000","last_change":"2024-03-23T23:42:49.739099+0000","last_active":"2024-03-23T23:42:51.762762+0000","last_peered":"2024-03-23T23:42:51.762762+0000","last_clean":"2024-03-23T23:42:51.762762+0000","last_became_active":"2024-03-23T23:42:49.738198+0000","last_became_peered":"2024-03-23T23:42:49.738198+0000","last_unstale":"2024-03-23T23:42:51.762762+0000","last_undegraded":"2024-03-23T23:42:51.762762+0000","last_fullsized":"2024-03-23T23:42:51.762762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:57:34.600362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.762957+0000","last_change":"2024-03-23T23:42:50.754941+0000","last_active":"2024-03-23T23:42:51.762957+0000","last_peered":"2024-03-23T23:42:51.762957+0000","last_clean":"2024-03-23T23:42:51.762957+0000","last_became_active":"2024-03-23T23:42:50.754585+0000","last_became_peered":"2024-03-23T23:42:50.754585+0000","last_unstale":"2024-03-23T23:42:51.762957+0000","last_undegraded":"2024-03-23T23:42:51.762957+0000","last_fullsized":"2024-03-23T23:42:51.762957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:42:23.236324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328954+0000","last_change":"2024-03-23T23:42:40.700610+0000","last_active":"2024-03-23T23:42:52.328954+0000","last_peered":"2024-03-23T23:42:52.328954+0000","last_clean":"2024-03-23T23:42:52.328954+0000","last_became_active":"2024-03-23T23:42:40.700112+0000","last_became_peered":"2024-03-23T23:42:40.700112+0000","last_unstale":"2024-03-23T23:42:52.328954+0000","last_undegraded":"2024-03-23T23:42:52.328954+0000","last_fullsized":"2024-03-23T23:42:52.328954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:07:49.169416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766866+0000","last_change":"2024-03-23T23:42:39.686509+0000","last_active":"2024-03-23T23:42:51.766866+0000","last_peered":"2024-03-23T23:42:51.766866+0000","last_clean":"2024-03-23T23:42:51.766866+0000","last_became_active":"2024-03-23T23:42:39.686094+0000","last_became_peered":"2024-03-23T23:42:39.686094+0000","last_unstale":"2024-03-23T23:42:51.766866+0000","last_undegraded":"2024-03-23T23:42:51.766866+0000","last_fullsized":"2024-03-23T23:42:51.766866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:57:20.394530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766601+0000","last_change":"2024-03-23T23:42:49.738274+0000","last_active":"2024-03-23T23:42:51.766601+0000","last_peered":"2024-03-23T23:42:51.766601+0000","last_clean":"2024-03-23T23:42:51.766601+0000","last_became_active":"2024-03-23T23:42:49.737916+0000","last_became_peered":"2024-03-23T23:42:49.737916+0000","last_unstale":"2024-03-23T23:42:51.766601+0000","last_undegraded":"2024-03-23T23:42:51.766601+0000","last_fullsized":"2024-03-23T23:42:51.766601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:18:12.997092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763279+0000","last_change":"2024-03-23T23:42:50.764148+0000","last_active":"2024-03-23T23:42:51.763279+0000","last_peered":"2024-03-23T23:42:51.763279+0000","last_clean":"2024-03-23T23:42:51.763279+0000","last_became_active":"2024-03-23T23:42:50.763768+0000","last_became_peered":"2024-03-23T23:42:50.763768+0000","last_unstale":"2024-03-23T23:42:51.763279+0000","last_undegraded":"2024-03-23T23:42:51.763279+0000","last_fullsized":"2024-03-23T23:42:51.763279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:52:48.699642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751565+0000","last_change":"2024-03-23T23:42:40.679988+0000","last_active":"2024-03-23T23:42:51.751565+0000","last_peered":"2024-03-23T23:42:51.751565+0000","last_clean":"2024-03-23T23:42:51.751565+0000","last_became_active":"2024-03-23T23:42:40.679488+0000","last_became_peered":"2024-03-23T23:42:40.679488+0000","last_unstale":"2024-03-23T23:42:51.751565+0000","last_undegraded":"2024-03-23T23:42:51.751565+0000","last_fullsized":"2024-03-23T23:42:51.751565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:10:32.251287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328493+0000","last_change":"2024-03-23T23:42:39.679741+0000","last_active":"2024-03-23T23:42:52.328493+0000","last_peered":"2024-03-23T23:42:52.328493+0000","last_clean":"2024-03-23T23:42:52.328493+0000","last_became_active":"2024-03-23T23:42:39.678864+0000","last_became_peered":"2024-03-23T23:42:39.678864+0000","last_unstale":"2024-03-23T23:42:52.328493+0000","last_undegraded":"2024-03-23T23:42:52.328493+0000","last_fullsized":"2024-03-23T23:42:52.328493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:50.559059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766763+0000","last_change":"2024-03-23T23:42:49.739837+0000","last_active":"2024-03-23T23:42:51.766763+0000","last_peered":"2024-03-23T23:42:51.766763+0000","last_clean":"2024-03-23T23:42:51.766763+0000","last_became_active":"2024-03-23T23:42:49.739570+0000","last_became_peered":"2024-03-23T23:42:49.739570+0000","last_unstale":"2024-03-23T23:42:51.766763+0000","last_undegraded":"2024-03-23T23:42:51.766763+0000","last_fullsized":"2024-03-23T23:42:51.766763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:57:34.600362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749980+0000","last_change":"2024-03-23T23:42:50.753912+0000","last_active":"2024-03-23T23:42:51.749980+0000","last_peered":"2024-03-23T23:42:51.749980+0000","last_clean":"2024-03-23T23:42:51.749980+0000","last_became_active":"2024-03-23T23:42:50.753629+0000","last_became_peered":"2024-03-23T23:42:50.753629+0000","last_unstale":"2024-03-23T23:42:51.749980+0000","last_undegraded":"2024-03-23T23:42:51.749980+0000","last_fullsized":"2024-03-23T23:42:51.749980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:40:32.748113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766326+0000","last_change":"2024-03-23T23:42:40.682840+0000","last_active":"2024-03-23T23:42:51.766326+0000","last_peered":"2024-03-23T23:42:51.766326+0000","last_clean":"2024-03-23T23:42:51.766326+0000","last_became_active":"2024-03-23T23:42:40.682391+0000","last_became_peered":"2024-03-23T23:42:40.682391+0000","last_unstale":"2024-03-23T23:42:51.766326+0000","last_undegraded":"2024-03-23T23:42:51.766326+0000","last_fullsized":"2024-03-23T23:42:51.766326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:42:14.952953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749558+0000","last_change":"2024-03-23T23:42:39.680763+0000","last_active":"2024-03-23T23:42:51.749558+0000","last_peered":"2024-03-23T23:42:51.749558+0000","last_clean":"2024-03-23T23:42:51.749558+0000","last_became_active":"2024-03-23T23:42:39.680494+0000","last_became_peered":"2024-03-23T23:42:39.680494+0000","last_unstale":"2024-03-23T23:42:51.749558+0000","last_undegraded":"2024-03-23T23:42:51.749558+0000","last_fullsized":"2024-03-23T23:42:51.749558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:57.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767406+0000","last_change":"2024-03-23T23:42:49.737456+0000","last_active":"2024-03-23T23:42:51.767406+0000","last_peered":"2024-03-23T23:42:51.767406+0000","last_clean":"2024-03-23T23:42:51.767406+0000","last_became_active":"2024-03-23T23:42:49.737196+0000","last_became_peered":"2024-03-23T23:42:49.737196+0000","last_unstale":"2024-03-23T23:42:51.767406+0000","last_undegraded":"2024-03-23T23:42:51.767406+0000","last_fullsized":"2024-03-23T23:42:51.767406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:49:42.789292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.329037+0000","last_change":"2024-03-23T23:42:50.763308+0000","last_active":"2024-03-23T23:42:52.329037+0000","last_peered":"2024-03-23T23:42:52.329037+0000","last_clean":"2024-03-23T23:42:52.329037+0000","last_became_active":"2024-03-23T23:42:50.763007+0000","last_became_peered":"2024-03-23T23:42:50.763007+0000","last_unstale":"2024-03-23T23:42:52.329037+0000","last_undegraded":"2024-03-23T23:42:52.329037+0000","last_fullsized":"2024-03-23T23:42:52.329037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:32:46.055472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.762549+0000","last_change":"2024-03-23T23:42:40.675570+0000","last_active":"2024-03-23T23:42:51.762549+0000","last_peered":"2024-03-23T23:42:51.762549+0000","last_clean":"2024-03-23T23:42:51.762549+0000","last_became_active":"2024-03-23T23:42:40.674390+0000","last_became_peered":"2024-03-23T23:42:40.674390+0000","last_unstale":"2024-03-23T23:42:51.762549+0000","last_undegraded":"2024-03-23T23:42:51.762549+0000","last_fullsized":"2024-03-23T23:42:51.762549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:31:34.412092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189672+0000","last_change":"2024-03-23T23:42:39.690057+0000","last_active":"2024-03-23T23:42:52.189672+0000","last_peered":"2024-03-23T23:42:52.189672+0000","last_clean":"2024-03-23T23:42:52.189672+0000","last_became_active":"2024-03-23T23:42:39.689763+0000","last_became_peered":"2024-03-23T23:42:39.689763+0000","last_unstale":"2024-03-23T23:42:52.189672+0000","last_undegraded":"2024-03-23T23:42:52.189672+0000","last_fullsized":"2024-03-23T23:42:52.189672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:01.607584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763516+0000","last_change":"2024-03-23T23:42:49.734213+0000","last_active":"2024-03-23T23:42:51.763516+0000","last_peered":"2024-03-23T23:42:51.763516+0000","last_clean":"2024-03-23T23:42:51.763516+0000","last_became_active":"2024-03-23T23:42:49.733115+0000","last_became_peered":"2024-03-23T23:42:49.733115+0000","last_unstale":"2024-03-23T23:42:51.763516+0000","last_undegraded":"2024-03-23T23:42:51.763516+0000","last_fullsized":"2024-03-23T23:42:51.763516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:18:12.997092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189689+0000","last_change":"2024-03-23T23:42:50.759000+0000","last_active":"2024-03-23T23:42:52.189689+0000","last_peered":"2024-03-23T23:42:52.189689+0000","last_clean":"2024-03-23T23:42:52.189689+0000","last_became_active":"2024-03-23T23:42:50.758552+0000","last_became_peered":"2024-03-23T23:42:50.758552+0000","last_unstale":"2024-03-23T23:42:52.189689+0000","last_undegraded":"2024-03-23T23:42:52.189689+0000","last_fullsized":"2024-03-23T23:42:52.189689+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:04:26.911514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327764+0000","last_change":"2024-03-23T23:42:40.700998+0000","last_active":"2024-03-23T23:42:52.327764+0000","last_peered":"2024-03-23T23:42:52.327764+0000","last_clean":"2024-03-23T23:42:52.327764+0000","last_became_active":"2024-03-23T23:42:40.700788+0000","last_became_peered":"2024-03-23T23:42:40.700788+0000","last_unstale":"2024-03-23T23:42:52.327764+0000","last_undegraded":"2024-03-23T23:42:52.327764+0000","last_fullsized":"2024-03-23T23:42:52.327764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:14:44.739525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328524+0000","last_change":"2024-03-23T23:42:39.687712+0000","last_active":"2024-03-23T23:42:52.328524+0000","last_peered":"2024-03-23T23:42:52.328524+0000","last_clean":"2024-03-23T23:42:52.328524+0000","last_became_active":"2024-03-23T23:42:39.687378+0000","last_became_peered":"2024-03-23T23:42:39.687378+0000","last_unstale":"2024-03-23T23:42:52.328524+0000","last_undegraded":"2024-03-23T23:42:52.328524+0000","last_fullsized":"2024-03-23T23:42:52.328524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:20:38.456655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189176+0000","last_change":"2024-03-23T23:42:27.940270+0000","last_active":"2024-03-23T23:42:52.189176+0000","last_peered":"2024-03-23T23:42:52.189176+0000","last_clean":"2024-03-23T23:42:52.189176+0000","last_became_active":"2024-03-23T23:42:27.939061+0000","last_became_peered":"2024-03-23T23:42:27.939061+0000","last_unstale":"2024-03-23T23:42:52.189176+0000","last_undegraded":"2024-03-23T23:42:52.189176+0000","last_fullsized":"2024-03-23T23:42:52.189176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:26.509742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:26.509742+0000","last_clean_scrub_stamp":"2024-03-23T23:42:26.509742+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:49.258623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752132+0000","last_change":"2024-03-23T23:42:49.729231+0000","last_active":"2024-03-23T23:42:51.752132+0000","last_peered":"2024-03-23T23:42:51.752132+0000","last_clean":"2024-03-23T23:42:51.752132+0000","last_became_active":"2024-03-23T23:42:49.728990+0000","last_became_peered":"2024-03-23T23:42:49.728990+0000","last_unstale":"2024-03-23T23:42:51.752132+0000","last_undegraded":"2024-03-23T23:42:51.752132+0000","last_fullsized":"2024-03-23T23:42:51.752132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:01:04.035970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749662+0000","last_change":"2024-03-23T23:42:50.757668+0000","last_active":"2024-03-23T23:42:51.749662+0000","last_peered":"2024-03-23T23:42:51.749662+0000","last_clean":"2024-03-23T23:42:51.749662+0000","last_became_active":"2024-03-23T23:42:50.756900+0000","last_became_peered":"2024-03-23T23:42:50.756900+0000","last_unstale":"2024-03-23T23:42:51.749662+0000","last_undegraded":"2024-03-23T23:42:51.749662+0000","last_fullsized":"2024-03-23T23:42:51.749662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:24:53.959288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190056+0000","last_change":"2024-03-23T23:42:40.711591+0000","last_active":"2024-03-23T23:42:52.190056+0000","last_peered":"2024-03-23T23:42:52.190056+0000","last_clean":"2024-03-23T23:42:52.190056+0000","last_became_active":"2024-03-23T23:42:40.711306+0000","last_became_peered":"2024-03-23T23:42:40.711306+0000","last_unstale":"2024-03-23T23:42:52.190056+0000","last_undegraded":"2024-03-23T23:42:52.190056+0000","last_fullsized":"2024-03-23T23:42:52.190056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:34:16.693372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749901+0000","last_change":"2024-03-23T23:42:39.684163+0000","last_active":"2024-03-23T23:42:51.749901+0000","last_peered":"2024-03-23T23:42:51.749901+0000","last_clean":"2024-03-23T23:42:51.749901+0000","last_became_active":"2024-03-23T23:42:39.683211+0000","last_became_peered":"2024-03-23T23:42:39.683211+0000","last_unstale":"2024-03-23T23:42:51.749901+0000","last_undegraded":"2024-03-23T23:42:51.749901+0000","last_fullsized":"2024-03-23T23:42:51.749901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:47:27.092873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751343+0000","last_change":"2024-03-23T23:42:49.735824+0000","last_active":"2024-03-23T23:42:51.751343+0000","last_peered":"2024-03-23T23:42:51.751343+0000","last_clean":"2024-03-23T23:42:51.751343+0000","last_became_active":"2024-03-23T23:42:49.735473+0000","last_became_peered":"2024-03-23T23:42:49.735473+0000","last_unstale":"2024-03-23T23:42:51.751343+0000","last_undegraded":"2024-03-23T23:42:51.751343+0000","last_fullsized":"2024-03-23T23:42:51.751343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:44:12.438729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749471+0000","last_change":"2024-03-23T23:42:50.745563+0000","last_active":"2024-03-23T23:42:51.749471+0000","last_peered":"2024-03-23T23:42:51.749471+0000","last_clean":"2024-03-23T23:42:51.749471+0000","last_became_active":"2024-03-23T23:42:50.745256+0000","last_became_peered":"2024-03-23T23:42:50.745256+0000","last_unstale":"2024-03-23T23:42:51.749471+0000","last_undegraded":"2024-03-23T23:42:51.749471+0000","last_fullsized":"2024-03-23T23:42:51.749471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:34:26.750531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328628+0000","last_change":"2024-03-23T23:42:40.700124+0000","last_active":"2024-03-23T23:42:52.328628+0000","last_peered":"2024-03-23T23:42:52.328628+0000","last_clean":"2024-03-23T23:42:52.328628+0000","last_became_active":"2024-03-23T23:42:40.697369+0000","last_became_peered":"2024-03-23T23:42:40.697369+0000","last_unstale":"2024-03-23T23:42:52.328628+0000","last_undegraded":"2024-03-23T23:42:52.328628+0000","last_fullsized":"2024-03-23T23:42:52.328628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:20.981139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767558+0000","last_change":"2024-03-23T23:42:39.681013+0000","last_active":"2024-03-23T23:42:51.767558+0000","last_peered":"2024-03-23T23:42:51.767558+0000","last_clean":"2024-03-23T23:42:51.767558+0000","last_became_active":"2024-03-23T23:42:39.680669+0000","last_became_peered":"2024-03-23T23:42:39.680669+0000","last_unstale":"2024-03-23T23:42:51.767558+0000","last_undegraded":"2024-03-23T23:42:51.767558+0000","last_fullsized":"2024-03-23T23:42:51.767558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:58:07.880313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.762672+0000","last_change":"2024-03-23T23:42:49.736747+0000","last_active":"2024-03-23T23:42:51.762672+0000","last_peered":"2024-03-23T23:42:51.762672+0000","last_clean":"2024-03-23T23:42:51.762672+0000","last_became_active":"2024-03-23T23:42:49.734508+0000","last_became_peered":"2024-03-23T23:42:49.734508+0000","last_unstale":"2024-03-23T23:42:51.762672+0000","last_undegraded":"2024-03-23T23:42:51.762672+0000","last_fullsized":"2024-03-23T23:42:51.762672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:54.356082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189347+0000","last_change":"2024-03-23T23:42:50.751141+0000","last_active":"2024-03-23T23:42:52.189347+0000","last_peered":"2024-03-23T23:42:52.189347+0000","last_clean":"2024-03-23T23:42:52.189347+0000","last_became_active":"2024-03-23T23:42:50.750269+0000","last_became_peered":"2024-03-23T23:42:50.750269+0000","last_unstale":"2024-03-23T23:42:52.189347+0000","last_undegraded":"2024-03-23T23:42:52.189347+0000","last_fullsized":"2024-03-23T23:42:52.189347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:46:10.784416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190299+0000","last_change":"2024-03-23T23:42:40.706713+0000","last_active":"2024-03-23T23:42:52.190299+0000","last_peered":"2024-03-23T23:42:52.190299+0000","last_clean":"2024-03-23T23:42:52.190299+0000","last_became_active":"2024-03-23T23:42:40.704328+0000","last_became_peered":"2024-03-23T23:42:40.704328+0000","last_unstale":"2024-03-23T23:42:52.190299+0000","last_undegraded":"2024-03-23T23:42:52.190299+0000","last_fullsized":"2024-03-23T23:42:52.190299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:15:52.261572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750011+0000","last_change":"2024-03-23T23:42:39.681906+0000","last_active":"2024-03-23T23:42:51.750011+0000","last_peered":"2024-03-23T23:42:51.750011+0000","last_clean":"2024-03-23T23:42:51.750011+0000","last_became_active":"2024-03-23T23:42:39.680506+0000","last_became_peered":"2024-03-23T23:42:39.680506+0000","last_unstale":"2024-03-23T23:42:51.750011+0000","last_undegraded":"2024-03-23T23:42:51.750011+0000","last_fullsized":"2024-03-23T23:42:51.750011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:44:07.213123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328020+0000","last_change":"2024-03-23T23:42:49.737735+0000","last_active":"2024-03-23T23:42:52.328020+0000","last_peered":"2024-03-23T23:42:52.328020+0000","last_clean":"2024-03-23T23:42:52.328020+0000","last_became_active":"2024-03-23T23:42:49.737434+0000","last_became_peered":"2024-03-23T23:42:49.737434+0000","last_unstale":"2024-03-23T23:42:52.328020+0000","last_undegraded":"2024-03-23T23:42:52.328020+0000","last_fullsized":"2024-03-23T23:42:52.328020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:58:10.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749338+0000","last_change":"2024-03-23T23:42:50.746922+0000","last_active":"2024-03-23T23:42:51.749338+0000","last_peered":"2024-03-23T23:42:51.749338+0000","last_clean":"2024-03-23T23:42:51.749338+0000","last_became_active":"2024-03-23T23:42:50.746105+0000","last_became_peered":"2024-03-23T23:42:50.746105+0000","last_unstale":"2024-03-23T23:42:51.749338+0000","last_undegraded":"2024-03-23T23:42:51.749338+0000","last_fullsized":"2024-03-23T23:42:51.749338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:46:40.484231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189958+0000","last_change":"2024-03-23T23:42:40.696584+0000","last_active":"2024-03-23T23:42:52.189958+0000","last_peered":"2024-03-23T23:42:52.189958+0000","last_clean":"2024-03-23T23:42:52.189958+0000","last_became_active":"2024-03-23T23:42:40.696141+0000","last_became_peered":"2024-03-23T23:42:40.696141+0000","last_unstale":"2024-03-23T23:42:52.189958+0000","last_undegraded":"2024-03-23T23:42:52.189958+0000","last_fullsized":"2024-03-23T23:42:52.189958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:45.303477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752716+0000","last_change":"2024-03-23T23:42:39.686863+0000","last_active":"2024-03-23T23:42:51.752716+0000","last_peered":"2024-03-23T23:42:51.752716+0000","last_clean":"2024-03-23T23:42:51.752716+0000","last_became_active":"2024-03-23T23:42:39.686491+0000","last_became_peered":"2024-03-23T23:42:39.686491+0000","last_unstale":"2024-03-23T23:42:51.752716+0000","last_undegraded":"2024-03-23T23:42:51.752716+0000","last_fullsized":"2024-03-23T23:42:51.752716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:38:13.752628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751016+0000","last_change":"2024-03-23T23:42:49.733982+0000","last_active":"2024-03-23T23:42:51.751016+0000","last_peered":"2024-03-23T23:42:51.751016+0000","last_clean":"2024-03-23T23:42:51.751016+0000","last_became_active":"2024-03-23T23:42:49.733389+0000","last_became_peered":"2024-03-23T23:42:49.733389+0000","last_unstale":"2024-03-23T23:42:51.751016+0000","last_undegraded":"2024-03-23T23:42:51.751016+0000","last_fullsized":"2024-03-23T23:42:51.751016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:13.685893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328287+0000","last_change":"2024-03-23T23:42:50.764083+0000","last_active":"2024-03-23T23:42:52.328287+0000","last_peered":"2024-03-23T23:42:52.328287+0000","last_clean":"2024-03-23T23:42:52.328287+0000","last_became_active":"2024-03-23T23:42:50.763871+0000","last_became_peered":"2024-03-23T23:42:50.763871+0000","last_unstale":"2024-03-23T23:42:52.328287+0000","last_undegraded":"2024-03-23T23:42:52.328287+0000","last_fullsized":"2024-03-23T23:42:52.328287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:32:46.055472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189656+0000","last_change":"2024-03-23T23:42:40.700961+0000","last_active":"2024-03-23T23:42:52.189656+0000","last_peered":"2024-03-23T23:42:52.189656+0000","last_clean":"2024-03-23T23:42:52.189656+0000","last_became_active":"2024-03-23T23:42:40.700800+0000","last_became_peered":"2024-03-23T23:42:40.700800+0000","last_unstale":"2024-03-23T23:42:52.189656+0000","last_undegraded":"2024-03-23T23:42:52.189656+0000","last_fullsized":"2024-03-23T23:42:52.189656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:54:27.641281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749328+0000","last_change":"2024-03-23T23:42:39.676075+0000","last_active":"2024-03-23T23:42:51.749328+0000","last_peered":"2024-03-23T23:42:51.749328+0000","last_clean":"2024-03-23T23:42:51.749328+0000","last_became_active":"2024-03-23T23:42:39.675770+0000","last_became_peered":"2024-03-23T23:42:39.675770+0000","last_unstale":"2024-03-23T23:42:51.749328+0000","last_undegraded":"2024-03-23T23:42:51.749328+0000","last_fullsized":"2024-03-23T23:42:51.749328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:24:11.933075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763597+0000","last_change":"2024-03-23T23:42:49.739529+0000","last_active":"2024-03-23T23:42:51.763597+0000","last_peered":"2024-03-23T23:42:51.763597+0000","last_clean":"2024-03-23T23:42:51.763597+0000","last_became_active":"2024-03-23T23:42:49.738053+0000","last_became_peered":"2024-03-23T23:42:49.738053+0000","last_unstale":"2024-03-23T23:42:51.763597+0000","last_undegraded":"2024-03-23T23:42:51.763597+0000","last_fullsized":"2024-03-23T23:42:51.763597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:52:57.561036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328637+0000","last_change":"2024-03-23T23:42:50.771347+0000","last_active":"2024-03-23T23:42:52.328637+0000","last_peered":"2024-03-23T23:42:52.328637+0000","last_clean":"2024-03-23T23:42:52.328637+0000","last_became_active":"2024-03-23T23:42:50.770998+0000","last_became_peered":"2024-03-23T23:42:50.770998+0000","last_unstale":"2024-03-23T23:42:52.328637+0000","last_undegraded":"2024-03-23T23:42:52.328637+0000","last_fullsized":"2024-03-23T23:42:52.328637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:57:04.394872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750921+0000","last_change":"2024-03-23T23:42:40.677314+0000","last_active":"2024-03-23T23:42:51.750921+0000","last_peered":"2024-03-23T23:42:51.750921+0000","last_clean":"2024-03-23T23:42:51.750921+0000","last_became_active":"2024-03-23T23:42:40.675416+0000","last_became_peered":"2024-03-23T23:42:40.675416+0000","last_unstale":"2024-03-23T23:42:51.750921+0000","last_undegraded":"2024-03-23T23:42:51.750921+0000","last_fullsized":"2024-03-23T23:42:51.750921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:01:06.338641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751663+0000","last_change":"2024-03-23T23:42:39.681827+0000","last_active":"2024-03-23T23:42:51.751663+0000","last_peered":"2024-03-23T23:42:51.751663+0000","last_clean":"2024-03-23T23:42:51.751663+0000","last_became_active":"2024-03-23T23:42:39.681418+0000","last_became_peered":"2024-03-23T23:42:39.681418+0000","last_unstale":"2024-03-23T23:42:51.751663+0000","last_undegraded":"2024-03-23T23:42:51.751663+0000","last_fullsized":"2024-03-23T23:42:51.751663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:50.559059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328221+0000","last_change":"2024-03-23T23:42:49.744708+0000","last_active":"2024-03-23T23:42:52.328221+0000","last_peered":"2024-03-23T23:42:52.328221+0000","last_clean":"2024-03-23T23:42:52.328221+0000","last_became_active":"2024-03-23T23:42:49.744422+0000","last_became_peered":"2024-03-23T23:42:49.744422+0000","last_unstale":"2024-03-23T23:42:52.328221+0000","last_undegraded":"2024-03-23T23:42:52.328221+0000","last_fullsized":"2024-03-23T23:42:52.328221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:25:43.889950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328641+0000","last_change":"2024-03-23T23:42:50.753064+0000","last_active":"2024-03-23T23:42:52.328641+0000","last_peered":"2024-03-23T23:42:52.328641+0000","last_clean":"2024-03-23T23:42:52.328641+0000","last_became_active":"2024-03-23T23:42:50.752783+0000","last_became_peered":"2024-03-23T23:42:50.752783+0000","last_unstale":"2024-03-23T23:42:52.328641+0000","last_undegraded":"2024-03-23T23:42:52.328641+0000","last_fullsized":"2024-03-23T23:42:52.328641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:39:49.888359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189741+0000","last_change":"2024-03-23T23:42:40.704046+0000","last_active":"2024-03-23T23:42:52.189741+0000","last_peered":"2024-03-23T23:42:52.189741+0000","last_clean":"2024-03-23T23:42:52.189741+0000","last_became_active":"2024-03-23T23:42:40.703787+0000","last_became_peered":"2024-03-23T23:42:40.703787+0000","last_unstale":"2024-03-23T23:42:52.189741+0000","last_undegraded":"2024-03-23T23:42:52.189741+0000","last_fullsized":"2024-03-23T23:42:52.189741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:16:16.737284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328439+0000","last_change":"2024-03-23T23:42:39.688483+0000","last_active":"2024-03-23T23:42:52.328439+0000","last_peered":"2024-03-23T23:42:52.328439+0000","last_clean":"2024-03-23T23:42:52.328439+0000","last_became_active":"2024-03-23T23:42:39.688141+0000","last_became_peered":"2024-03-23T23:42:39.688141+0000","last_unstale":"2024-03-23T23:42:52.328439+0000","last_undegraded":"2024-03-23T23:42:52.328439+0000","last_fullsized":"2024-03-23T23:42:52.328439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:32.254099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"24'6","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328127+0000","last_change":"2024-03-23T23:42:49.749027+0000","last_active":"2024-03-23T23:42:52.328127+0000","last_peered":"2024-03-23T23:42:52.328127+0000","last_clean":"2024-03-23T23:42:52.328127+0000","last_became_active":"2024-03-23T23:42:49.748687+0000","last_became_peered":"2024-03-23T23:42:49.748687+0000","last_unstale":"2024-03-23T23:42:52.328127+0000","last_undegraded":"2024-03-23T23:42:52.328127+0000","last_fullsized":"2024-03-23T23:42:52.328127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:27.818117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328083+0000","last_change":"2024-03-23T23:42:50.752273+0000","last_active":"2024-03-23T23:42:52.328083+0000","last_peered":"2024-03-23T23:42:52.328083+0000","last_clean":"2024-03-23T23:42:52.328083+0000","last_became_active":"2024-03-23T23:42:50.751874+0000","last_became_peered":"2024-03-23T23:42:50.751874+0000","last_unstale":"2024-03-23T23:42:52.328083+0000","last_undegraded":"2024-03-23T23:42:52.328083+0000","last_fullsized":"2024-03-23T23:42:52.328083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:20:53.750917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.762660+0000","last_change":"2024-03-23T23:42:40.688909+0000","last_active":"2024-03-23T23:42:51.762660+0000","last_peered":"2024-03-23T23:42:51.762660+0000","last_clean":"2024-03-23T23:42:51.762660+0000","last_became_active":"2024-03-23T23:42:40.688636+0000","last_became_peered":"2024-03-23T23:42:40.688636+0000","last_unstale":"2024-03-23T23:42:51.762660+0000","last_undegraded":"2024-03-23T23:42:51.762660+0000","last_fullsized":"2024-03-23T23:42:51.762660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:26:16.171920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763113+0000","last_change":"2024-03-23T23:42:39.681926+0000","last_active":"2024-03-23T23:42:51.763113+0000","last_peered":"2024-03-23T23:42:51.763113+0000","last_clean":"2024-03-23T23:42:51.763113+0000","last_became_active":"2024-03-23T23:42:39.681028+0000","last_became_peered":"2024-03-23T23:42:39.681028+0000","last_unstale":"2024-03-23T23:42:51.763113+0000","last_undegraded":"2024-03-23T23:42:51.763113+0000","last_fullsized":"2024-03-23T23:42:51.763113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:24:11.933075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328871+0000","last_change":"2024-03-23T23:42:49.741915+0000","last_active":"2024-03-23T23:42:52.328871+0000","last_peered":"2024-03-23T23:42:52.328871+0000","last_clean":"2024-03-23T23:42:52.328871+0000","last_became_active":"2024-03-23T23:42:49.741650+0000","last_became_peered":"2024-03-23T23:42:49.741650+0000","last_unstale":"2024-03-23T23:42:52.328871+0000","last_undegraded":"2024-03-23T23:42:52.328871+0000","last_fullsized":"2024-03-23T23:42:52.328871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:11:43.106922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327956+0000","last_change":"2024-03-23T23:42:50.752979+0000","last_active":"2024-03-23T23:42:52.327956+0000","last_peered":"2024-03-23T23:42:52.327956+0000","last_clean":"2024-03-23T23:42:52.327956+0000","last_became_active":"2024-03-23T23:42:50.751848+0000","last_became_peered":"2024-03-23T23:42:50.751848+0000","last_unstale":"2024-03-23T23:42:52.327956+0000","last_undegraded":"2024-03-23T23:42:52.327956+0000","last_fullsized":"2024-03-23T23:42:52.327956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:39:04.727316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190024+0000","last_change":"2024-03-23T23:42:40.689988+0000","last_active":"2024-03-23T23:42:52.190024+0000","last_peered":"2024-03-23T23:42:52.190024+0000","last_clean":"2024-03-23T23:42:52.190024+0000","last_became_active":"2024-03-23T23:42:40.689477+0000","last_became_peered":"2024-03-23T23:42:40.689477+0000","last_unstale":"2024-03-23T23:42:52.190024+0000","last_undegraded":"2024-03-23T23:42:52.190024+0000","last_fullsized":"2024-03-23T23:42:52.190024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:46:30.427072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752122+0000","last_change":"2024-03-23T23:42:39.689429+0000","last_active":"2024-03-23T23:42:51.752122+0000","last_peered":"2024-03-23T23:42:51.752122+0000","last_clean":"2024-03-23T23:42:51.752122+0000","last_became_active":"2024-03-23T23:42:39.688066+0000","last_became_peered":"2024-03-23T23:42:39.688066+0000","last_unstale":"2024-03-23T23:42:51.752122+0000","last_undegraded":"2024-03-23T23:42:51.752122+0000","last_fullsized":"2024-03-23T23:42:51.752122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:32.254099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766492+0000","last_change":"2024-03-23T23:42:49.733543+0000","last_active":"2024-03-23T23:42:51.766492+0000","last_peered":"2024-03-23T23:42:51.766492+0000","last_clean":"2024-03-23T23:42:51.766492+0000","last_became_active":"2024-03-23T23:42:49.733197+0000","last_became_peered":"2024-03-23T23:42:49.733197+0000","last_unstale":"2024-03-23T23:42:51.766492+0000","last_undegraded":"2024-03-23T23:42:51.766492+0000","last_fullsized":"2024-03-23T23:42:51.766492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:45:20.189501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766823+0000","last_change":"2024-03-23T23:42:50.756687+0000","last_active":"2024-03-23T23:42:51.766823+0000","last_peered":"2024-03-23T23:42:51.766823+0000","last_clean":"2024-03-23T23:42:51.766823+0000","last_became_active":"2024-03-23T23:42:50.756371+0000","last_became_peered":"2024-03-23T23:42:50.756371+0000","last_unstale":"2024-03-23T23:42:51.766823+0000","last_undegraded":"2024-03-23T23:42:51.766823+0000","last_fullsized":"2024-03-23T23:42:51.766823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:29:47.303374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752229+0000","last_change":"2024-03-23T23:42:40.683025+0000","last_active":"2024-03-23T23:42:51.752229+0000","last_peered":"2024-03-23T23:42:51.752229+0000","last_clean":"2024-03-23T23:42:51.752229+0000","last_became_active":"2024-03-23T23:42:40.682798+0000","last_became_peered":"2024-03-23T23:42:40.682798+0000","last_unstale":"2024-03-23T23:42:51.752229+0000","last_undegraded":"2024-03-23T23:42:51.752229+0000","last_fullsized":"2024-03-23T23:42:51.752229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:51.565112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767463+0000","last_change":"2024-03-23T23:42:39.681675+0000","last_active":"2024-03-23T23:42:51.767463+0000","last_peered":"2024-03-23T23:42:51.767463+0000","last_clean":"2024-03-23T23:42:51.767463+0000","last_became_active":"2024-03-23T23:42:39.681364+0000","last_became_peered":"2024-03-23T23:42:39.681364+0000","last_unstale":"2024-03-23T23:42:51.767463+0000","last_undegraded":"2024-03-23T23:42:51.767463+0000","last_fullsized":"2024-03-23T23:42:51.767463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:42:37.702720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751398+0000","last_change":"2024-03-23T23:42:49.723350+0000","last_active":"2024-03-23T23:42:51.751398+0000","last_peered":"2024-03-23T23:42:51.751398+0000","last_clean":"2024-03-23T23:42:51.751398+0000","last_became_active":"2024-03-23T23:42:49.723058+0000","last_became_peered":"2024-03-23T23:42:49.723058+0000","last_unstale":"2024-03-23T23:42:51.751398+0000","last_undegraded":"2024-03-23T23:42:51.751398+0000","last_fullsized":"2024-03-23T23:42:51.751398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:43:02.835034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751554+0000","last_change":"2024-03-23T23:42:50.746422+0000","last_active":"2024-03-23T23:42:51.751554+0000","last_peered":"2024-03-23T23:42:51.751554+0000","last_clean":"2024-03-23T23:42:51.751554+0000","last_became_active":"2024-03-23T23:42:50.746104+0000","last_became_peered":"2024-03-23T23:42:50.746104+0000","last_unstale":"2024-03-23T23:42:51.751554+0000","last_undegraded":"2024-03-23T23:42:51.751554+0000","last_fullsized":"2024-03-23T23:42:51.751554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:40:34.077584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763417+0000","last_change":"2024-03-23T23:42:40.700381+0000","last_active":"2024-03-23T23:42:51.763417+0000","last_peered":"2024-03-23T23:42:51.763417+0000","last_clean":"2024-03-23T23:42:51.763417+0000","last_became_active":"2024-03-23T23:42:40.698428+0000","last_became_peered":"2024-03-23T23:42:40.698428+0000","last_unstale":"2024-03-23T23:42:51.763417+0000","last_undegraded":"2024-03-23T23:42:51.763417+0000","last_fullsized":"2024-03-23T23:42:51.763417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:07:29.242921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328837+0000","last_change":"2024-03-23T23:42:39.691092+0000","last_active":"2024-03-23T23:42:52.328837+0000","last_peered":"2024-03-23T23:42:52.328837+0000","last_clean":"2024-03-23T23:42:52.328837+0000","last_became_active":"2024-03-23T23:42:39.687473+0000","last_became_peered":"2024-03-23T23:42:39.687473+0000","last_unstale":"2024-03-23T23:42:52.328837+0000","last_undegraded":"2024-03-23T23:42:52.328837+0000","last_fullsized":"2024-03-23T23:42:52.328837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:08:03.578884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327476+0000","last_change":"2024-03-23T23:42:49.748693+0000","last_active":"2024-03-23T23:42:52.327476+0000","last_peered":"2024-03-23T23:42:52.327476+0000","last_clean":"2024-03-23T23:42:52.327476+0000","last_became_active":"2024-03-23T23:42:49.748389+0000","last_became_peered":"2024-03-23T23:42:49.748389+0000","last_unstale":"2024-03-23T23:42:52.327476+0000","last_undegraded":"2024-03-23T23:42:52.327476+0000","last_fullsized":"2024-03-23T23:42:52.327476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:58:10.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189491+0000","last_change":"2024-03-23T23:42:50.749547+0000","last_active":"2024-03-23T23:42:52.189491+0000","last_peered":"2024-03-23T23:42:52.189491+0000","last_clean":"2024-03-23T23:42:52.189491+0000","last_became_active":"2024-03-23T23:42:50.749066+0000","last_became_peered":"2024-03-23T23:42:50.749066+0000","last_unstale":"2024-03-23T23:42:52.189491+0000","last_undegraded":"2024-03-23T23:42:52.189491+0000","last_fullsized":"2024-03-23T23:42:52.189491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:09:19.723830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328727+0000","last_change":"2024-03-23T23:42:40.708795+0000","last_active":"2024-03-23T23:42:52.328727+0000","last_peered":"2024-03-23T23:42:52.328727+0000","last_clean":"2024-03-23T23:42:52.328727+0000","last_became_active":"2024-03-23T23:42:40.708199+0000","last_became_peered":"2024-03-23T23:42:40.708199+0000","last_unstale":"2024-03-23T23:42:52.328727+0000","last_undegraded":"2024-03-23T23:42:52.328727+0000","last_fullsized":"2024-03-23T23:42:52.328727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:53.782430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.753135+0000","last_change":"2024-03-23T23:42:39.684669+0000","last_active":"2024-03-23T23:42:51.753135+0000","last_peered":"2024-03-23T23:42:51.753135+0000","last_clean":"2024-03-23T23:42:51.753135+0000","last_became_active":"2024-03-23T23:42:39.684360+0000","last_became_peered":"2024-03-23T23:42:39.684360+0000","last_unstale":"2024-03-23T23:42:51.753135+0000","last_undegraded":"2024-03-23T23:42:51.753135+0000","last_fullsized":"2024-03-23T23:42:51.753135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:19.914926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327466+0000","last_change":"2024-03-23T23:42:49.741577+0000","last_active":"2024-03-23T23:42:52.327466+0000","last_peered":"2024-03-23T23:42:52.327466+0000","last_clean":"2024-03-23T23:42:52.327466+0000","last_became_active":"2024-03-23T23:42:49.741270+0000","last_became_peered":"2024-03-23T23:42:49.741270+0000","last_unstale":"2024-03-23T23:42:52.327466+0000","last_undegraded":"2024-03-23T23:42:52.327466+0000","last_fullsized":"2024-03-23T23:42:52.327466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:11:43.106922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.753001+0000","last_change":"2024-03-23T23:42:50.751992+0000","last_active":"2024-03-23T23:42:51.753001+0000","last_peered":"2024-03-23T23:42:51.753001+0000","last_clean":"2024-03-23T23:42:51.753001+0000","last_became_active":"2024-03-23T23:42:50.748281+0000","last_became_peered":"2024-03-23T23:42:50.748281+0000","last_unstale":"2024-03-23T23:42:51.753001+0000","last_undegraded":"2024-03-23T23:42:51.753001+0000","last_fullsized":"2024-03-23T23:42:51.753001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:57.968968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763361+0000","last_change":"2024-03-23T23:42:49.741658+0000","last_active":"2024-03-23T23:42:51.763361+0000","last_peered":"2024-03-23T23:42:51.763361+0000","last_clean":"2024-03-23T23:42:51.763361+0000","last_became_active":"2024-03-23T23:42:49.740899+0000","last_became_peered":"2024-03-23T23:42:49.740899+0000","last_unstale":"2024-03-23T23:42:51.763361+0000","last_undegraded":"2024-03-23T23:42:51.763361+0000","last_fullsized":"2024-03-23T23:42:51.763361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:45:20.189501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766424+0000","last_change":"2024-03-23T23:42:40.679384+0000","last_active":"2024-03-23T23:42:51.766424+0000","last_peered":"2024-03-23T23:42:51.766424+0000","last_clean":"2024-03-23T23:42:51.766424+0000","last_became_active":"2024-03-23T23:42:40.679070+0000","last_became_peered":"2024-03-23T23:42:40.679070+0000","last_unstale":"2024-03-23T23:42:51.766424+0000","last_undegraded":"2024-03-23T23:42:51.766424+0000","last_fullsized":"2024-03-23T23:42:51.766424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:26:16.171920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328187+0000","last_change":"2024-03-23T23:42:39.682839+0000","last_active":"2024-03-23T23:42:52.328187+0000","last_peered":"2024-03-23T23:42:52.328187+0000","last_clean":"2024-03-23T23:42:52.328187+0000","last_became_active":"2024-03-23T23:42:39.682584+0000","last_became_peered":"2024-03-23T23:42:39.682584+0000","last_unstale":"2024-03-23T23:42:52.328187+0000","last_undegraded":"2024-03-23T23:42:52.328187+0000","last_fullsized":"2024-03-23T23:42:52.328187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:19.914926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763311+0000","last_change":"2024-03-23T23:42:50.752596+0000","last_active":"2024-03-23T23:42:51.763311+0000","last_peered":"2024-03-23T23:42:51.763311+0000","last_clean":"2024-03-23T23:42:51.763311+0000","last_became_active":"2024-03-23T23:42:50.751598+0000","last_became_peered":"2024-03-23T23:42:50.751598+0000","last_unstale":"2024-03-23T23:42:51.763311+0000","last_undegraded":"2024-03-23T23:42:51.763311+0000","last_fullsized":"2024-03-23T23:42:51.763311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:37:19.741781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.753080+0000","last_change":"2024-03-23T23:42:49.734629+0000","last_active":"2024-03-23T23:42:51.753080+0000","last_peered":"2024-03-23T23:42:51.753080+0000","last_clean":"2024-03-23T23:42:51.753080+0000","last_became_active":"2024-03-23T23:42:49.734309+0000","last_became_peered":"2024-03-23T23:42:49.734309+0000","last_unstale":"2024-03-23T23:42:51.753080+0000","last_undegraded":"2024-03-23T23:42:51.753080+0000","last_fullsized":"2024-03-23T23:42:51.753080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:46.760020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327687+0000","last_change":"2024-03-23T23:42:40.674605+0000","last_active":"2024-03-23T23:42:52.327687+0000","last_peered":"2024-03-23T23:42:52.327687+0000","last_clean":"2024-03-23T23:42:52.327687+0000","last_became_active":"2024-03-23T23:42:40.674366+0000","last_became_peered":"2024-03-23T23:42:40.674366+0000","last_unstale":"2024-03-23T23:42:52.327687+0000","last_undegraded":"2024-03-23T23:42:52.327687+0000","last_fullsized":"2024-03-23T23:42:52.327687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327666+0000","last_change":"2024-03-23T23:42:39.688646+0000","last_active":"2024-03-23T23:42:52.327666+0000","last_peered":"2024-03-23T23:42:52.327666+0000","last_clean":"2024-03-23T23:42:52.327666+0000","last_became_active":"2024-03-23T23:42:39.687489+0000","last_became_peered":"2024-03-23T23:42:39.687489+0000","last_unstale":"2024-03-23T23:42:52.327666+0000","last_undegraded":"2024-03-23T23:42:52.327666+0000","last_fullsized":"2024-03-23T23:42:52.327666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:07:12.649156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767201+0000","last_change":"2024-03-23T23:42:50.748511+0000","last_active":"2024-03-23T23:42:51.767201+0000","last_peered":"2024-03-23T23:42:51.767201+0000","last_clean":"2024-03-23T23:42:51.767201+0000","last_became_active":"2024-03-23T23:42:50.747154+0000","last_became_peered":"2024-03-23T23:42:50.747154+0000","last_unstale":"2024-03-23T23:42:51.767201+0000","last_undegraded":"2024-03-23T23:42:51.767201+0000","last_fullsized":"2024-03-23T23:42:51.767201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:09:19.723830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751549+0000","last_change":"2024-03-23T23:42:39.681458+0000","last_active":"2024-03-23T23:42:51.751549+0000","last_peered":"2024-03-23T23:42:51.751549+0000","last_clean":"2024-03-23T23:42:51.751549+0000","last_became_active":"2024-03-23T23:42:39.681158+0000","last_became_peered":"2024-03-23T23:42:39.681158+0000","last_unstale":"2024-03-23T23:42:51.751549+0000","last_undegraded":"2024-03-23T23:42:51.751549+0000","last_fullsized":"2024-03-23T23:42:51.751549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:08:03.578884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763042+0000","last_change":"2024-03-23T23:42:40.676571+0000","last_active":"2024-03-23T23:42:51.763042+0000","last_peered":"2024-03-23T23:42:51.763042+0000","last_clean":"2024-03-23T23:42:51.763042+0000","last_became_active":"2024-03-23T23:42:40.675877+0000","last_became_peered":"2024-03-23T23:42:40.675877+0000","last_unstale":"2024-03-23T23:42:51.763042+0000","last_undegraded":"2024-03-23T23:42:51.763042+0000","last_fullsized":"2024-03-23T23:42:51.763042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:52.220411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749759+0000","last_change":"2024-03-23T23:42:49.734208+0000","last_active":"2024-03-23T23:42:51.749759+0000","last_peered":"2024-03-23T23:42:51.749759+0000","last_clean":"2024-03-23T23:42:51.749759+0000","last_became_active":"2024-03-23T23:42:49.732943+0000","last_became_peered":"2024-03-23T23:42:49.732943+0000","last_unstale":"2024-03-23T23:42:51.749759+0000","last_undegraded":"2024-03-23T23:42:51.749759+0000","last_fullsized":"2024-03-23T23:42:51.749759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:43.683275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751832+0000","last_change":"2024-03-23T23:42:50.752722+0000","last_active":"2024-03-23T23:42:51.751832+0000","last_peered":"2024-03-23T23:42:51.751832+0000","last_clean":"2024-03-23T23:42:51.751832+0000","last_became_active":"2024-03-23T23:42:50.749400+0000","last_became_peered":"2024-03-23T23:42:50.749400+0000","last_unstale":"2024-03-23T23:42:51.751832+0000","last_undegraded":"2024-03-23T23:42:51.751832+0000","last_fullsized":"2024-03-23T23:42:51.751832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:16:44.027189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328094+0000","last_change":"2024-03-23T23:42:39.688422+0000","last_active":"2024-03-23T23:42:52.328094+0000","last_peered":"2024-03-23T23:42:52.328094+0000","last_clean":"2024-03-23T23:42:52.328094+0000","last_became_active":"2024-03-23T23:42:39.687423+0000","last_became_peered":"2024-03-23T23:42:39.687423+0000","last_unstale":"2024-03-23T23:42:52.328094+0000","last_undegraded":"2024-03-23T23:42:52.328094+0000","last_fullsized":"2024-03-23T23:42:52.328094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:20:38.456655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751184+0000","last_change":"2024-03-23T23:42:40.680801+0000","last_active":"2024-03-23T23:42:51.751184+0000","last_peered":"2024-03-23T23:42:51.751184+0000","last_clean":"2024-03-23T23:42:51.751184+0000","last_became_active":"2024-03-23T23:42:40.680511+0000","last_became_peered":"2024-03-23T23:42:40.680511+0000","last_unstale":"2024-03-23T23:42:51.751184+0000","last_undegraded":"2024-03-23T23:42:51.751184+0000","last_fullsized":"2024-03-23T23:42:51.751184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:27:42.392714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328321+0000","last_change":"2024-03-23T23:42:49.751291+0000","last_active":"2024-03-23T23:42:52.328321+0000","last_peered":"2024-03-23T23:42:52.328321+0000","last_clean":"2024-03-23T23:42:52.328321+0000","last_became_active":"2024-03-23T23:42:49.749695+0000","last_became_peered":"2024-03-23T23:42:49.749695+0000","last_unstale":"2024-03-23T23:42:52.328321+0000","last_undegraded":"2024-03-23T23:42:52.328321+0000","last_fullsized":"2024-03-23T23:42:52.328321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:40:33.073029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328522+0000","last_change":"2024-03-23T23:42:50.752672+0000","last_active":"2024-03-23T23:42:52.328522+0000","last_peered":"2024-03-23T23:42:52.328522+0000","last_clean":"2024-03-23T23:42:52.328522+0000","last_became_active":"2024-03-23T23:42:50.752394+0000","last_became_peered":"2024-03-23T23:42:50.752394+0000","last_unstale":"2024-03-23T23:42:52.328522+0000","last_undegraded":"2024-03-23T23:42:52.328522+0000","last_fullsized":"2024-03-23T23:42:52.328522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:51:01.385876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750919+0000","last_change":"2024-03-23T23:42:40.679042+0000","last_active":"2024-03-23T23:42:51.750919+0000","last_peered":"2024-03-23T23:42:51.750919+0000","last_clean":"2024-03-23T23:42:51.750919+0000","last_became_active":"2024-03-23T23:42:40.678518+0000","last_became_peered":"2024-03-23T23:42:40.678518+0000","last_unstale":"2024-03-23T23:42:51.750919+0000","last_undegraded":"2024-03-23T23:42:51.750919+0000","last_fullsized":"2024-03-23T23:42:51.750919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:12:14.359173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767231+0000","last_change":"2024-03-23T23:42:50.757132+0000","last_active":"2024-03-23T23:42:51.767231+0000","last_peered":"2024-03-23T23:42:51.767231+0000","last_clean":"2024-03-23T23:42:51.767231+0000","last_became_active":"2024-03-23T23:42:50.756813+0000","last_became_peered":"2024-03-23T23:42:50.756813+0000","last_unstale":"2024-03-23T23:42:51.767231+0000","last_undegraded":"2024-03-23T23:42:51.767231+0000","last_fullsized":"2024-03-23T23:42:51.767231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:04:26.911514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749494+0000","last_change":"2024-03-23T23:42:40.702411+0000","last_active":"2024-03-23T23:42:51.749494+0000","last_peered":"2024-03-23T23:42:51.749494+0000","last_clean":"2024-03-23T23:42:51.749494+0000","last_became_active":"2024-03-23T23:42:40.701398+0000","last_became_peered":"2024-03-23T23:42:40.701398+0000","last_unstale":"2024-03-23T23:42:51.749494+0000","last_undegraded":"2024-03-23T23:42:51.749494+0000","last_fullsized":"2024-03-23T23:42:51.749494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:03.196963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328386+0000","last_change":"2024-03-23T23:42:50.756769+0000","last_active":"2024-03-23T23:42:52.328386+0000","last_peered":"2024-03-23T23:42:52.328386+0000","last_clean":"2024-03-23T23:42:52.328386+0000","last_became_active":"2024-03-23T23:42:50.756503+0000","last_became_peered":"2024-03-23T23:42:50.756503+0000","last_unstale":"2024-03-23T23:42:52.328386+0000","last_undegraded":"2024-03-23T23:42:52.328386+0000","last_fullsized":"2024-03-23T23:42:52.328386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:50.597847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328394+0000","last_change":"2024-03-23T23:42:40.698519+0000","last_active":"2024-03-23T23:42:52.328394+0000","last_peered":"2024-03-23T23:42:52.328394+0000","last_clean":"2024-03-23T23:42:52.328394+0000","last_became_active":"2024-03-23T23:42:40.695218+0000","last_became_peered":"2024-03-23T23:42:40.695218+0000","last_unstale":"2024-03-23T23:42:52.328394+0000","last_undegraded":"2024-03-23T23:42:52.328394+0000","last_fullsized":"2024-03-23T23:42:52.328394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:00:54.983365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767039+0000","last_change":"2024-03-23T23:42:50.748726+0000","last_active":"2024-03-23T23:42:51.767039+0000","last_peered":"2024-03-23T23:42:51.767039+0000","last_clean":"2024-03-23T23:42:51.767039+0000","last_became_active":"2024-03-23T23:42:50.748105+0000","last_became_peered":"2024-03-23T23:42:50.748105+0000","last_unstale":"2024-03-23T23:42:51.767039+0000","last_undegraded":"2024-03-23T23:42:51.767039+0000","last_fullsized":"2024-03-23T23:42:51.767039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:54.910408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763001+0000","last_change":"2024-03-23T23:42:40.673293+0000","last_active":"2024-03-23T23:42:51.763001+0000","last_peered":"2024-03-23T23:42:51.763001+0000","last_clean":"2024-03-23T23:42:51.763001+0000","last_became_active":"2024-03-23T23:42:40.672910+0000","last_became_peered":"2024-03-23T23:42:40.672910+0000","last_unstale":"2024-03-23T23:42:51.763001+0000","last_undegraded":"2024-03-23T23:42:51.763001+0000","last_fullsized":"2024-03-23T23:42:51.763001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:42:14.952953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189476+0000","last_change":"2024-03-23T23:42:50.750291+0000","last_active":"2024-03-23T23:42:52.189476+0000","last_peered":"2024-03-23T23:42:52.189476+0000","last_clean":"2024-03-23T23:42:52.189476+0000","last_became_active":"2024-03-23T23:42:50.749908+0000","last_became_peered":"2024-03-23T23:42:50.749908+0000","last_unstale":"2024-03-23T23:42:52.189476+0000","last_undegraded":"2024-03-23T23:42:52.189476+0000","last_fullsized":"2024-03-23T23:42:52.189476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:54.910408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328216+0000","last_change":"2024-03-23T23:42:40.685370+0000","last_active":"2024-03-23T23:42:52.328216+0000","last_peered":"2024-03-23T23:42:52.328216+0000","last_clean":"2024-03-23T23:42:52.328216+0000","last_became_active":"2024-03-23T23:42:40.685120+0000","last_became_peered":"2024-03-23T23:42:40.685120+0000","last_unstale":"2024-03-23T23:42:52.328216+0000","last_undegraded":"2024-03-23T23:42:52.328216+0000","last_fullsized":"2024-03-23T23:42:52.328216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751268+0000","last_change":"2024-03-23T23:42:50.747361+0000","last_active":"2024-03-23T23:42:51.751268+0000","last_peered":"2024-03-23T23:42:51.751268+0000","last_clean":"2024-03-23T23:42:51.751268+0000","last_became_active":"2024-03-23T23:42:50.746310+0000","last_became_peered":"2024-03-23T23:42:50.746310+0000","last_unstale":"2024-03-23T23:42:51.751268+0000","last_undegraded":"2024-03-23T23:42:51.751268+0000","last_fullsized":"2024-03-23T23:42:51.751268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:57.968968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767365+0000","last_change":"2024-03-23T23:42:40.677168+0000","last_active":"2024-03-23T23:42:51.767365+0000","last_peered":"2024-03-23T23:42:51.767365+0000","last_clean":"2024-03-23T23:42:51.767365+0000","last_became_active":"2024-03-23T23:42:40.676912+0000","last_became_peered":"2024-03-23T23:42:40.676912+0000","last_unstale":"2024-03-23T23:42:51.767365+0000","last_undegraded":"2024-03-23T23:42:51.767365+0000","last_fullsized":"2024-03-23T23:42:51.767365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:17:19.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189346+0000","last_change":"2024-03-23T23:42:50.749305+0000","last_active":"2024-03-23T23:42:52.189346+0000","last_peered":"2024-03-23T23:42:52.189346+0000","last_clean":"2024-03-23T23:42:52.189346+0000","last_became_active":"2024-03-23T23:42:50.748798+0000","last_became_peered":"2024-03-23T23:42:50.748798+0000","last_unstale":"2024-03-23T23:42:52.189346+0000","last_undegraded":"2024-03-23T23:42:52.189346+0000","last_fullsized":"2024-03-23T23:42:52.189346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:19.610436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752528+0000","last_change":"2024-03-23T23:42:40.694420+0000","last_active":"2024-03-23T23:42:51.752528+0000","last_peered":"2024-03-23T23:42:51.752528+0000","last_clean":"2024-03-23T23:42:51.752528+0000","last_became_active":"2024-03-23T23:42:40.693867+0000","last_became_peered":"2024-03-23T23:42:40.693867+0000","last_unstale":"2024-03-23T23:42:51.752528+0000","last_undegraded":"2024-03-23T23:42:51.752528+0000","last_fullsized":"2024-03-23T23:42:51.752528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:54.557634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751411+0000","last_change":"2024-03-23T23:42:50.754149+0000","last_active":"2024-03-23T23:42:51.751411+0000","last_peered":"2024-03-23T23:42:51.751411+0000","last_clean":"2024-03-23T23:42:51.751411+0000","last_became_active":"2024-03-23T23:42:50.753471+0000","last_became_peered":"2024-03-23T23:42:50.753471+0000","last_unstale":"2024-03-23T23:42:51.751411+0000","last_undegraded":"2024-03-23T23:42:51.751411+0000","last_fullsized":"2024-03-23T23:42:51.751411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:28.822672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328282+0000","last_change":"2024-03-23T23:42:40.685177+0000","last_active":"2024-03-23T23:42:52.328282+0000","last_peered":"2024-03-23T23:42:52.328282+0000","last_clean":"2024-03-23T23:42:52.328282+0000","last_became_active":"2024-03-23T23:42:40.684495+0000","last_became_peered":"2024-03-23T23:42:40.684495+0000","last_unstale":"2024-03-23T23:42:52.328282+0000","last_undegraded":"2024-03-23T23:42:52.328282+0000","last_fullsized":"2024-03-23T23:42:52.328282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:27.675824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328493+0000","last_change":"2024-03-23T23:42:50.746438+0000","last_active":"2024-03-23T23:42:52.328493+0000","last_peered":"2024-03-23T23:42:52.328493+0000","last_clean":"2024-03-23T23:42:52.328493+0000","last_became_active":"2024-03-23T23:42:50.745771+0000","last_became_peered":"2024-03-23T23:42:50.745771+0000","last_unstale":"2024-03-23T23:42:52.328493+0000","last_undegraded":"2024-03-23T23:42:52.328493+0000","last_fullsized":"2024-03-23T23:42:52.328493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:22:17.484059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328084+0000","last_change":"2024-03-23T23:42:40.701852+0000","last_active":"2024-03-23T23:42:52.328084+0000","last_peered":"2024-03-23T23:42:52.328084+0000","last_clean":"2024-03-23T23:42:52.328084+0000","last_became_active":"2024-03-23T23:42:40.701566+0000","last_became_peered":"2024-03-23T23:42:40.701566+0000","last_unstale":"2024-03-23T23:42:52.328084+0000","last_undegraded":"2024-03-23T23:42:52.328084+0000","last_fullsized":"2024-03-23T23:42:52.328084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190034+0000","last_change":"2024-03-23T23:42:50.758879+0000","last_active":"2024-03-23T23:42:52.190034+0000","last_peered":"2024-03-23T23:42:52.190034+0000","last_clean":"2024-03-23T23:42:52.190034+0000","last_became_active":"2024-03-23T23:42:50.758564+0000","last_became_peered":"2024-03-23T23:42:50.758564+0000","last_unstale":"2024-03-23T23:42:52.190034+0000","last_undegraded":"2024-03-23T23:42:52.190034+0000","last_fullsized":"2024-03-23T23:42:52.190034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:11:29.268536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327548+0000","last_change":"2024-03-23T23:42:40.684899+0000","last_active":"2024-03-23T23:42:52.327548+0000","last_peered":"2024-03-23T23:42:52.327548+0000","last_clean":"2024-03-23T23:42:52.327548+0000","last_became_active":"2024-03-23T23:42:40.684603+0000","last_became_peered":"2024-03-23T23:42:40.684603+0000","last_unstale":"2024-03-23T23:42:52.327548+0000","last_undegraded":"2024-03-23T23:42:52.327548+0000","last_fullsized":"2024-03-23T23:42:52.327548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:54.557634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749737+0000","last_change":"2024-03-23T23:42:50.754096+0000","last_active":"2024-03-23T23:42:51.749737+0000","last_peered":"2024-03-23T23:42:51.749737+0000","last_clean":"2024-03-23T23:42:51.749737+0000","last_became_active":"2024-03-23T23:42:50.753602+0000","last_became_peered":"2024-03-23T23:42:50.753602+0000","last_unstale":"2024-03-23T23:42:51.749737+0000","last_undegraded":"2024-03-23T23:42:51.749737+0000","last_fullsized":"2024-03-23T23:42:51.749737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:16:26.794444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328338+0000","last_change":"2024-03-23T23:42:40.707800+0000","last_active":"2024-03-23T23:42:52.328338+0000","last_peered":"2024-03-23T23:42:52.328338+0000","last_clean":"2024-03-23T23:42:52.328338+0000","last_became_active":"2024-03-23T23:42:40.707528+0000","last_became_peered":"2024-03-23T23:42:40.707528+0000","last_unstale":"2024-03-23T23:42:52.328338+0000","last_undegraded":"2024-03-23T23:42:52.328338+0000","last_fullsized":"2024-03-23T23:42:52.328338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:03:24.275154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328659+0000","last_change":"2024-03-23T23:42:50.741324+0000","last_active":"2024-03-23T23:42:52.328659+0000","last_peered":"2024-03-23T23:42:52.328659+0000","last_clean":"2024-03-23T23:42:52.328659+0000","last_became_active":"2024-03-23T23:42:50.741065+0000","last_became_peered":"2024-03-23T23:42:50.741065+0000","last_unstale":"2024-03-23T23:42:52.328659+0000","last_undegraded":"2024-03-23T23:42:52.328659+0000","last_fullsized":"2024-03-23T23:42:52.328659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:13.911327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.762890+0000","last_change":"2024-03-23T23:42:40.689122+0000","last_active":"2024-03-23T23:42:51.762890+0000","last_peered":"2024-03-23T23:42:51.762890+0000","last_clean":"2024-03-23T23:42:51.762890+0000","last_became_active":"2024-03-23T23:42:40.688875+0000","last_became_peered":"2024-03-23T23:42:40.688875+0000","last_unstale":"2024-03-23T23:42:51.762890+0000","last_undegraded":"2024-03-23T23:42:51.762890+0000","last_fullsized":"2024-03-23T23:42:51.762890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:27:03.132032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750979+0000","last_change":"2024-03-23T23:42:50.762055+0000","last_active":"2024-03-23T23:42:51.750979+0000","last_peered":"2024-03-23T23:42:51.750979+0000","last_clean":"2024-03-23T23:42:51.750979+0000","last_became_active":"2024-03-23T23:42:50.761762+0000","last_became_peered":"2024-03-23T23:42:50.761762+0000","last_unstale":"2024-03-23T23:42:51.750979+0000","last_undegraded":"2024-03-23T23:42:51.750979+0000","last_fullsized":"2024-03-23T23:42:51.750979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:28.822672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752195+0000","last_change":"2024-03-23T23:42:40.683701+0000","last_active":"2024-03-23T23:42:51.752195+0000","last_peered":"2024-03-23T23:42:51.752195+0000","last_clean":"2024-03-23T23:42:51.752195+0000","last_became_active":"2024-03-23T23:42:40.683377+0000","last_became_peered":"2024-03-23T23:42:40.683377+0000","last_unstale":"2024-03-23T23:42:51.752195+0000","last_undegraded":"2024-03-23T23:42:51.752195+0000","last_fullsized":"2024-03-23T23:42:51.752195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751120+0000","last_change":"2024-03-23T23:42:50.754372+0000","last_active":"2024-03-23T23:42:51.751120+0000","last_peered":"2024-03-23T23:42:51.751120+0000","last_clean":"2024-03-23T23:42:51.751120+0000","last_became_active":"2024-03-23T23:42:50.754072+0000","last_became_peered":"2024-03-23T23:42:50.754072+0000","last_unstale":"2024-03-23T23:42:51.751120+0000","last_undegraded":"2024-03-23T23:42:51.751120+0000","last_fullsized":"2024-03-23T23:42:51.751120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:40:34.077584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190143+0000","last_change":"2024-03-23T23:42:40.689769+0000","last_active":"2024-03-23T23:42:52.190143+0000","last_peered":"2024-03-23T23:42:52.190143+0000","last_clean":"2024-03-23T23:42:52.190143+0000","last_became_active":"2024-03-23T23:42:40.689111+0000","last_became_peered":"2024-03-23T23:42:40.689111+0000","last_unstale":"2024-03-23T23:42:52.190143+0000","last_undegraded":"2024-03-23T23:42:52.190143+0000","last_fullsized":"2024-03-23T23:42:52.190143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:40:22.690954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328020+0000","last_change":"2024-03-23T23:42:50.759792+0000","last_active":"2024-03-23T23:42:52.328020+0000","last_peered":"2024-03-23T23:42:52.328020+0000","last_clean":"2024-03-23T23:42:52.328020+0000","last_became_active":"2024-03-23T23:42:50.759604+0000","last_became_peered":"2024-03-23T23:42:50.759604+0000","last_unstale":"2024-03-23T23:42:52.328020+0000","last_undegraded":"2024-03-23T23:42:52.328020+0000","last_fullsized":"2024-03-23T23:42:52.328020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:15:25.617521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749937+0000","last_change":"2024-03-23T23:42:40.690961+0000","last_active":"2024-03-23T23:42:51.749937+0000","last_peered":"2024-03-23T23:42:51.749937+0000","last_clean":"2024-03-23T23:42:51.749937+0000","last_became_active":"2024-03-23T23:42:40.690690+0000","last_became_peered":"2024-03-23T23:42:40.690690+0000","last_unstale":"2024-03-23T23:42:51.749937+0000","last_undegraded":"2024-03-23T23:42:51.749937+0000","last_fullsized":"2024-03-23T23:42:51.749937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:56.763759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.762557+0000","last_change":"2024-03-23T23:42:50.764821+0000","last_active":"2024-03-23T23:42:51.762557+0000","last_peered":"2024-03-23T23:42:51.762557+0000","last_clean":"2024-03-23T23:42:51.762557+0000","last_became_active":"2024-03-23T23:42:50.764563+0000","last_became_peered":"2024-03-23T23:42:50.764563+0000","last_unstale":"2024-03-23T23:42:51.762557+0000","last_undegraded":"2024-03-23T23:42:51.762557+0000","last_fullsized":"2024-03-23T23:42:51.762557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:48:24.982671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.329026+0000","last_change":"2024-03-23T23:42:40.708540+0000","last_active":"2024-03-23T23:42:52.329026+0000","last_peered":"2024-03-23T23:42:52.329026+0000","last_clean":"2024-03-23T23:42:52.329026+0000","last_became_active":"2024-03-23T23:42:40.708031+0000","last_became_peered":"2024-03-23T23:42:40.708031+0000","last_unstale":"2024-03-23T23:42:52.329026+0000","last_undegraded":"2024-03-23T23:42:52.329026+0000","last_fullsized":"2024-03-23T23:42:52.329026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:44:03.386124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766736+0000","last_change":"2024-03-23T23:42:50.771062+0000","last_active":"2024-03-23T23:42:51.766736+0000","last_peered":"2024-03-23T23:42:51.766736+0000","last_clean":"2024-03-23T23:42:51.766736+0000","last_became_active":"2024-03-23T23:42:50.770790+0000","last_became_peered":"2024-03-23T23:42:50.770790+0000","last_unstale":"2024-03-23T23:42:51.766736+0000","last_undegraded":"2024-03-23T23:42:51.766736+0000","last_fullsized":"2024-03-23T23:42:51.766736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:13:07.156401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328080+0000","last_change":"2024-03-23T23:42:40.697920+0000","last_active":"2024-03-23T23:42:52.328080+0000","last_peered":"2024-03-23T23:42:52.328080+0000","last_clean":"2024-03-23T23:42:52.328080+0000","last_became_active":"2024-03-23T23:42:40.697694+0000","last_became_peered":"2024-03-23T23:42:40.697694+0000","last_unstale":"2024-03-23T23:42:52.328080+0000","last_undegraded":"2024-03-23T23:42:52.328080+0000","last_fullsized":"2024-03-23T23:42:52.328080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752567+0000","last_change":"2024-03-23T23:42:50.751694+0000","last_active":"2024-03-23T23:42:51.752567+0000","last_peered":"2024-03-23T23:42:51.752567+0000","last_clean":"2024-03-23T23:42:51.752567+0000","last_became_active":"2024-03-23T23:42:50.751452+0000","last_became_peered":"2024-03-23T23:42:50.751452+0000","last_unstale":"2024-03-23T23:42:51.752567+0000","last_undegraded":"2024-03-23T23:42:51.752567+0000","last_fullsized":"2024-03-23T23:42:51.752567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:57:49.981068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767129+0000","last_change":"2024-03-23T23:42:40.681928+0000","last_active":"2024-03-23T23:42:51.767129+0000","last_peered":"2024-03-23T23:42:51.767129+0000","last_clean":"2024-03-23T23:42:51.767129+0000","last_became_active":"2024-03-23T23:42:40.681337+0000","last_became_peered":"2024-03-23T23:42:40.681337+0000","last_unstale":"2024-03-23T23:42:51.767129+0000","last_undegraded":"2024-03-23T23:42:51.767129+0000","last_fullsized":"2024-03-23T23:42:51.767129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:52.220411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328332+0000","last_change":"2024-03-23T23:42:50.769003+0000","last_active":"2024-03-23T23:42:52.328332+0000","last_peered":"2024-03-23T23:42:52.328332+0000","last_clean":"2024-03-23T23:42:52.328332+0000","last_became_active":"2024-03-23T23:42:50.768695+0000","last_became_peered":"2024-03-23T23:42:50.768695+0000","last_unstale":"2024-03-23T23:42:52.328332+0000","last_undegraded":"2024-03-23T23:42:52.328332+0000","last_fullsized":"2024-03-23T23:42:52.328332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:17:11.847056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.762577+0000","last_change":"2024-03-23T23:42:40.680934+0000","last_active":"2024-03-23T23:42:51.762577+0000","last_peered":"2024-03-23T23:42:51.762577+0000","last_clean":"2024-03-23T23:42:51.762577+0000","last_became_active":"2024-03-23T23:42:40.680643+0000","last_became_peered":"2024-03-23T23:42:40.680643+0000","last_unstale":"2024-03-23T23:42:51.762577+0000","last_undegraded":"2024-03-23T23:42:51.762577+0000","last_fullsized":"2024-03-23T23:42:51.762577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:34.630671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189908+0000","last_change":"2024-03-23T23:42:50.762401+0000","last_active":"2024-03-23T23:42:52.189908+0000","last_peered":"2024-03-23T23:42:52.189908+0000","last_clean":"2024-03-23T23:42:52.189908+0000","last_became_active":"2024-03-23T23:42:50.762183+0000","last_became_peered":"2024-03-23T23:42:50.762183+0000","last_unstale":"2024-03-23T23:42:52.189908+0000","last_undegraded":"2024-03-23T23:42:52.189908+0000","last_fullsized":"2024-03-23T23:42:52.189908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:13:10.497921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327888+0000","last_change":"2024-03-23T23:42:40.682736+0000","last_active":"2024-03-23T23:42:52.327888+0000","last_peered":"2024-03-23T23:42:52.327888+0000","last_clean":"2024-03-23T23:42:52.327888+0000","last_became_active":"2024-03-23T23:42:40.682410+0000","last_became_peered":"2024-03-23T23:42:40.682410+0000","last_unstale":"2024-03-23T23:42:52.327888+0000","last_undegraded":"2024-03-23T23:42:52.327888+0000","last_fullsized":"2024-03-23T23:42:52.327888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:01:06.338641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327793+0000","last_change":"2024-03-23T23:42:50.749204+0000","last_active":"2024-03-23T23:42:52.327793+0000","last_peered":"2024-03-23T23:42:52.327793+0000","last_clean":"2024-03-23T23:42:52.327793+0000","last_became_active":"2024-03-23T23:42:50.748809+0000","last_became_peered":"2024-03-23T23:42:50.748809+0000","last_unstale":"2024-03-23T23:42:52.327793+0000","last_undegraded":"2024-03-23T23:42:52.327793+0000","last_fullsized":"2024-03-23T23:42:52.327793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:39:49.888359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752151+0000","last_change":"2024-03-23T23:42:40.682523+0000","last_active":"2024-03-23T23:42:51.752151+0000","last_peered":"2024-03-23T23:42:51.752151+0000","last_clean":"2024-03-23T23:42:51.752151+0000","last_became_active":"2024-03-23T23:42:40.682155+0000","last_became_peered":"2024-03-23T23:42:40.682155+0000","last_unstale":"2024-03-23T23:42:51.752151+0000","last_undegraded":"2024-03-23T23:42:51.752151+0000","last_fullsized":"2024-03-23T23:42:51.752151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:33.260151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749469+0000","last_change":"2024-03-23T23:42:50.746115+0000","last_active":"2024-03-23T23:42:51.749469+0000","last_peered":"2024-03-23T23:42:51.749469+0000","last_clean":"2024-03-23T23:42:51.749469+0000","last_became_active":"2024-03-23T23:42:50.745858+0000","last_became_peered":"2024-03-23T23:42:50.745858+0000","last_unstale":"2024-03-23T23:42:51.749469+0000","last_undegraded":"2024-03-23T23:42:51.749469+0000","last_fullsized":"2024-03-23T23:42:51.749469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:00:43.318455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752280+0000","last_change":"2024-03-23T23:42:40.702089+0000","last_active":"2024-03-23T23:42:51.752280+0000","last_peered":"2024-03-23T23:42:51.752280+0000","last_clean":"2024-03-23T23:42:51.752280+0000","last_became_active":"2024-03-23T23:42:40.701874+0000","last_became_peered":"2024-03-23T23:42:40.701874+0000","last_unstale":"2024-03-23T23:42:51.752280+0000","last_undegraded":"2024-03-23T23:42:51.752280+0000","last_fullsized":"2024-03-23T23:42:51.752280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189853+0000","last_change":"2024-03-23T23:42:50.773115+0000","last_active":"2024-03-23T23:42:52.189853+0000","last_peered":"2024-03-23T23:42:52.189853+0000","last_clean":"2024-03-23T23:42:52.189853+0000","last_became_active":"2024-03-23T23:42:50.772849+0000","last_became_peered":"2024-03-23T23:42:50.772849+0000","last_unstale":"2024-03-23T23:42:52.189853+0000","last_undegraded":"2024-03-23T23:42:52.189853+0000","last_fullsized":"2024-03-23T23:42:52.189853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:29:42.898728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752487+0000","last_change":"2024-03-23T23:42:40.703254+0000","last_active":"2024-03-23T23:42:51.752487+0000","last_peered":"2024-03-23T23:42:51.752487+0000","last_clean":"2024-03-23T23:42:51.752487+0000","last_became_active":"2024-03-23T23:42:40.702447+0000","last_became_peered":"2024-03-23T23:42:40.702447+0000","last_unstale":"2024-03-23T23:42:51.752487+0000","last_undegraded":"2024-03-23T23:42:51.752487+0000","last_fullsized":"2024-03-23T23:42:51.752487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:59:45.154553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328157+0000","last_change":"2024-03-23T23:42:50.748946+0000","last_active":"2024-03-23T23:42:52.328157+0000","last_peered":"2024-03-23T23:42:52.328157+0000","last_clean":"2024-03-23T23:42:52.328157+0000","last_became_active":"2024-03-23T23:42:50.745205+0000","last_became_peered":"2024-03-23T23:42:50.745205+0000","last_unstale":"2024-03-23T23:42:52.328157+0000","last_undegraded":"2024-03-23T23:42:52.328157+0000","last_fullsized":"2024-03-23T23:42:52.328157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:58:16.372010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190250+0000","last_change":"2024-03-23T23:42:40.714331+0000","last_active":"2024-03-23T23:42:52.190250+0000","last_peered":"2024-03-23T23:42:52.190250+0000","last_clean":"2024-03-23T23:42:52.190250+0000","last_became_active":"2024-03-23T23:42:40.713737+0000","last_became_peered":"2024-03-23T23:42:40.713737+0000","last_unstale":"2024-03-23T23:42:52.190250+0000","last_undegraded":"2024-03-23T23:42:52.190250+0000","last_fullsized":"2024-03-23T23:42:52.190250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:24:43.902129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328361+0000","last_change":"2024-03-23T23:42:50.746666+0000","last_active":"2024-03-23T23:42:52.328361+0000","last_peered":"2024-03-23T23:42:52.328361+0000","last_clean":"2024-03-23T23:42:52.328361+0000","last_became_active":"2024-03-23T23:42:50.746149+0000","last_became_peered":"2024-03-23T23:42:50.746149+0000","last_unstale":"2024-03-23T23:42:52.328361+0000","last_undegraded":"2024-03-23T23:42:52.328361+0000","last_fullsized":"2024-03-23T23:42:52.328361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:42:58.533499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327499+0000","last_change":"2024-03-23T23:42:40.710655+0000","last_active":"2024-03-23T23:42:52.327499+0000","last_peered":"2024-03-23T23:42:52.327499+0000","last_clean":"2024-03-23T23:42:52.327499+0000","last_became_active":"2024-03-23T23:42:40.710362+0000","last_became_peered":"2024-03-23T23:42:40.710362+0000","last_unstale":"2024-03-23T23:42:52.327499+0000","last_undegraded":"2024-03-23T23:42:52.327499+0000","last_fullsized":"2024-03-23T23:42:52.327499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:12:14.359173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752890+0000","last_change":"2024-03-23T23:42:50.753397+0000","last_active":"2024-03-23T23:42:51.752890+0000","last_peered":"2024-03-23T23:42:51.752890+0000","last_clean":"2024-03-23T23:42:51.752890+0000","last_became_active":"2024-03-23T23:42:50.753085+0000","last_became_peered":"2024-03-23T23:42:50.753085+0000","last_unstale":"2024-03-23T23:42:51.752890+0000","last_undegraded":"2024-03-23T23:42:51.752890+0000","last_fullsized":"2024-03-23T23:42:51.752890+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:25:44.894505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189509+0000","last_change":"2024-03-23T23:42:40.689380+0000","last_active":"2024-03-23T23:42:52.189509+0000","last_peered":"2024-03-23T23:42:52.189509+0000","last_clean":"2024-03-23T23:42:52.189509+0000","last_became_active":"2024-03-23T23:42:40.689023+0000","last_became_peered":"2024-03-23T23:42:40.689023+0000","last_unstale":"2024-03-23T23:42:52.189509+0000","last_undegraded":"2024-03-23T23:42:52.189509+0000","last_fullsized":"2024-03-23T23:42:52.189509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:17:19.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766610+0000","last_change":"2024-03-23T23:42:50.756133+0000","last_active":"2024-03-23T23:42:51.766610+0000","last_peered":"2024-03-23T23:42:51.766610+0000","last_clean":"2024-03-23T23:42:51.766610+0000","last_became_active":"2024-03-23T23:42:50.755405+0000","last_became_peered":"2024-03-23T23:42:50.755405+0000","last_unstale":"2024-03-23T23:42:51.766610+0000","last_undegraded":"2024-03-23T23:42:51.766610+0000","last_fullsized":"2024-03-23T23:42:51.766610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:46:10.784416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328292+0000","last_change":"2024-03-23T23:42:40.698234+0000","last_active":"2024-03-23T23:42:52.328292+0000","last_peered":"2024-03-23T23:42:52.328292+0000","last_clean":"2024-03-23T23:42:52.328292+0000","last_became_active":"2024-03-23T23:42:40.695978+0000","last_became_peered":"2024-03-23T23:42:40.695978+0000","last_unstale":"2024-03-23T23:42:52.328292+0000","last_undegraded":"2024-03-23T23:42:52.328292+0000","last_fullsized":"2024-03-23T23:42:52.328292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:04.633288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328907+0000","last_change":"2024-03-23T23:42:50.752051+0000","last_active":"2024-03-23T23:42:52.328907+0000","last_peered":"2024-03-23T23:42:52.328907+0000","last_clean":"2024-03-23T23:42:52.328907+0000","last_became_active":"2024-03-23T23:42:50.751738+0000","last_became_peered":"2024-03-23T23:42:50.751738+0000","last_unstale":"2024-03-23T23:42:52.328907+0000","last_undegraded":"2024-03-23T23:42:52.328907+0000","last_fullsized":"2024-03-23T23:42:52.328907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:20:53.750917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189626+0000","last_change":"2024-03-23T23:42:40.698407+0000","last_active":"2024-03-23T23:42:52.189626+0000","last_peered":"2024-03-23T23:42:52.189626+0000","last_clean":"2024-03-23T23:42:52.189626+0000","last_became_active":"2024-03-23T23:42:40.698092+0000","last_became_peered":"2024-03-23T23:42:40.698092+0000","last_unstale":"2024-03-23T23:42:52.189626+0000","last_undegraded":"2024-03-23T23:42:52.189626+0000","last_fullsized":"2024-03-23T23:42:52.189626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:00:33.261296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327627+0000","last_change":"2024-03-23T23:42:50.753000+0000","last_active":"2024-03-23T23:42:52.327627+0000","last_peered":"2024-03-23T23:42:52.327627+0000","last_clean":"2024-03-23T23:42:52.327627+0000","last_became_active":"2024-03-23T23:42:50.752614+0000","last_became_peered":"2024-03-23T23:42:50.752614+0000","last_unstale":"2024-03-23T23:42:52.327627+0000","last_undegraded":"2024-03-23T23:42:52.327627+0000","last_fullsized":"2024-03-23T23:42:52.327627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:57:04.394872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328439+0000","last_change":"2024-03-23T23:42:40.700631+0000","last_active":"2024-03-23T23:42:52.328439+0000","last_peered":"2024-03-23T23:42:52.328439+0000","last_clean":"2024-03-23T23:42:52.328439+0000","last_became_active":"2024-03-23T23:42:40.697932+0000","last_became_peered":"2024-03-23T23:42:40.697932+0000","last_unstale":"2024-03-23T23:42:52.328439+0000","last_undegraded":"2024-03-23T23:42:52.328439+0000","last_fullsized":"2024-03-23T23:42:52.328439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:05:17.694245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749336+0000","last_change":"2024-03-23T23:42:50.765991+0000","last_active":"2024-03-23T23:42:51.749336+0000","last_peered":"2024-03-23T23:42:51.749336+0000","last_clean":"2024-03-23T23:42:51.749336+0000","last_became_active":"2024-03-23T23:42:50.765716+0000","last_became_peered":"2024-03-23T23:42:50.765716+0000","last_unstale":"2024-03-23T23:42:51.749336+0000","last_undegraded":"2024-03-23T23:42:51.749336+0000","last_fullsized":"2024-03-23T23:42:51.749336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:49:52.067143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763373+0000","last_change":"2024-03-23T23:42:40.683983+0000","last_active":"2024-03-23T23:42:51.763373+0000","last_peered":"2024-03-23T23:42:51.763373+0000","last_clean":"2024-03-23T23:42:51.763373+0000","last_became_active":"2024-03-23T23:42:40.683711+0000","last_became_peered":"2024-03-23T23:42:40.683711+0000","last_unstale":"2024-03-23T23:42:51.763373+0000","last_undegraded":"2024-03-23T23:42:51.763373+0000","last_fullsized":"2024-03-23T23:42:51.763373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:51:30.695597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189321+0000","last_change":"2024-03-23T23:42:50.766544+0000","last_active":"2024-03-23T23:42:52.189321+0000","last_peered":"2024-03-23T23:42:52.189321+0000","last_clean":"2024-03-23T23:42:52.189321+0000","last_became_active":"2024-03-23T23:42:50.766328+0000","last_became_peered":"2024-03-23T23:42:50.766328+0000","last_unstale":"2024-03-23T23:42:52.189321+0000","last_undegraded":"2024-03-23T23:42:52.189321+0000","last_fullsized":"2024-03-23T23:42:52.189321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:28:43.677331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766986+0000","last_change":"2024-03-23T23:42:40.678622+0000","last_active":"2024-03-23T23:42:51.766986+0000","last_peered":"2024-03-23T23:42:51.766986+0000","last_clean":"2024-03-23T23:42:51.766986+0000","last_became_active":"2024-03-23T23:42:40.678325+0000","last_became_peered":"2024-03-23T23:42:40.678325+0000","last_unstale":"2024-03-23T23:42:51.766986+0000","last_undegraded":"2024-03-23T23:42:51.766986+0000","last_fullsized":"2024-03-23T23:42:51.766986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:54:27.641281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189432+0000","last_change":"2024-03-23T23:42:50.750690+0000","last_active":"2024-03-23T23:42:52.189432+0000","last_peered":"2024-03-23T23:42:52.189432+0000","last_clean":"2024-03-23T23:42:52.189432+0000","last_became_active":"2024-03-23T23:42:50.750466+0000","last_became_peered":"2024-03-23T23:42:50.750466+0000","last_unstale":"2024-03-23T23:42:52.189432+0000","last_undegraded":"2024-03-23T23:42:52.189432+0000","last_fullsized":"2024-03-23T23:42:52.189432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:13:07.156401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190227+0000","last_change":"2024-03-23T23:42:40.701959+0000","last_active":"2024-03-23T23:42:52.190227+0000","last_peered":"2024-03-23T23:42:52.190227+0000","last_clean":"2024-03-23T23:42:52.190227+0000","last_became_active":"2024-03-23T23:42:40.700855+0000","last_became_peered":"2024-03-23T23:42:40.700855+0000","last_unstale":"2024-03-23T23:42:52.190227+0000","last_undegraded":"2024-03-23T23:42:52.190227+0000","last_fullsized":"2024-03-23T23:42:52.190227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:49:42.009983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":103450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":101984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":101452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":286720,"data_stored":104468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":692262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":262144,"data_stored":101292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":282624,"data_stored":103016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":864256,"data_stored":692228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T23:43:01.329 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-23T23:43:01.329 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-23T23:43:01.329 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-23T23:43:01.330 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-23T23:43:01.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.501+0000 7f429ea00640 1 Processor -- start 2024-03-23T23:43:01.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.501+0000 7f429ea00640 1 -- start start 2024-03-23T23:43:01.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.505+0000 7f429ea00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f42980a9470 0x7f4298152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:01.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.505+0000 7f429ea00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f429806fce0 0x7f429815cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:01.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.505+0000 7f429ea00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42981527b0 con 0x7f429814fcd0 2024-03-23T23:43:01.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.505+0000 7f429ea00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4298071fd0 con 0x7f42980a9470 2024-03-23T23:43:01.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.505+0000 7f429ea00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42980722b0 con 0x7f429806fce0 2024-03-23T23:43:01.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.505+0000 7f428fe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f42980a9470 0x7f4298152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:01.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.505+0000 7f4297e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f429814fcd0 0x7f42980c4190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:46346/0 (socket says 172.21.15.8:46346) 2024-03-23T23:43:01.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.505+0000 7f429ca00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f429806fce0 0x7f429815cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:01.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.505+0000 7f4297e00640 1 -- 172.21.15.8:0/3477006399 learned_addr learned my addr 172.21.15.8:0/3477006399 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:43:01.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.505+0000 7f428fe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f42980a9470 0x7f4298152cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42354/0 (socket says 172.21.15.8:42354) 2024-03-23T23:43:01.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.505+0000 7f428fe00640 1 -- 172.21.15.8:0/3477006399 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f429806fce0 msgr2=0x7f429815cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:01.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.505+0000 7f428fe00640 1 --2- 172.21.15.8:0/3477006399 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f429806fce0 0x7f429815cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:01.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.505+0000 7f428fe00640 1 -- 172.21.15.8:0/3477006399 >> v1:172.21.15.196:6789/0 conn(0x7f429814fcd0 legacy=0x7f42980c4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:01.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.505+0000 7f428fe00640 1 -- 172.21.15.8:0/3477006399 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4298072590 con 0x7f42980a9470 2024-03-23T23:43:01.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.509+0000 7f428fe00640 1 --2- 172.21.15.8:0/3477006399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42980a9470 0x7f4298152cb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f428000ba60 tx=0x7f428001ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f7444d7770c16e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:01.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.509+0000 7f4297400640 1 -- 172.21.15.8:0/3477006399 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42800b4070 con 0x7f42980a9470 2024-03-23T23:43:01.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.509+0000 7f4297400640 1 -- 172.21.15.8:0/3477006399 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42800a7930 con 0x7f42980a9470 2024-03-23T23:43:01.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.509+0000 7f4297400640 1 -- 172.21.15.8:0/3477006399 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42800a7d00 con 0x7f42980a9470 2024-03-23T23:43:01.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.509+0000 7f429ea00640 1 -- 172.21.15.8:0/3477006399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42980a9470 msgr2=0x7f4298152cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:01.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.509+0000 7f429ea00640 1 --2- 172.21.15.8:0/3477006399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42980a9470 0x7f4298152cb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f428000ba60 tx=0x7f428001ea50 comp rx=0 tx=0).stop 2024-03-23T23:43:01.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.509+0000 7f429ea00640 1 -- 172.21.15.8:0/3477006399 shutdown_connections 2024-03-23T23:43:01.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.509+0000 7f429ea00640 1 --2- 172.21.15.8:0/3477006399 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f429806fce0 0x7f429815cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:01.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.509+0000 7f429ea00640 1 --2- 172.21.15.8:0/3477006399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42980a9470 0x7f4298152cb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:01.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.509+0000 7f429ea00640 1 -- 172.21.15.8:0/3477006399 >> 172.21.15.8:0/3477006399 conn(0x7f42980c8180 msgr2=0x7f42980c8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:01.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.509+0000 7f429ea00640 1 -- 172.21.15.8:0/3477006399 shutdown_connections 2024-03-23T23:43:01.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.509+0000 7f429ea00640 1 -- 172.21.15.8:0/3477006399 wait complete. 2024-03-23T23:43:01.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.509+0000 7f429ea00640 1 Processor -- start 2024-03-23T23:43:01.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.509+0000 7f429ea00640 1 -- start start 2024-03-23T23:43:01.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.509+0000 7f429ea00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f429806fce0 0x7f42981f2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:01.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.509+0000 7f429ea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42980a9470 0x7f42981439b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:01.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.509+0000 7f429ea00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f429814fcd0 0x7f42980c15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:01.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.509+0000 7f429ea00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42980aab10 con 0x7f42980a9470 2024-03-23T23:43:01.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.509+0000 7f429ea00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42980aa990 con 0x7f429806fce0 2024-03-23T23:43:01.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.509+0000 7f429ea00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f429806b980 con 0x7f429814fcd0 2024-03-23T23:43:01.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.509+0000 7f428fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42980a9470 0x7f42981439b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:01.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.513+0000 7f428fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42980a9470 0x7f42981439b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42366/0 (socket says 172.21.15.8:42366) 2024-03-23T23:43:01.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.513+0000 7f428fe00640 1 -- 172.21.15.8:0/2889964702 learned_addr learned my addr 172.21.15.8:0/2889964702 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:01.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.513+0000 7f4297e00640 1 --2- 172.21.15.8:0/2889964702 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f429806fce0 0x7f42981f2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:01.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.513+0000 7f429ca00640 1 --2- 172.21.15.8:0/2889964702 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f429814fcd0 0x7f42980c15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:01.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.513+0000 7f428fe00640 1 -- 172.21.15.8:0/2889964702 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f429814fcd0 msgr2=0x7f42980c15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:01.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.513+0000 7f428fe00640 1 --2- 172.21.15.8:0/2889964702 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f429814fcd0 0x7f42980c15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:01.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.513+0000 7f428fe00640 1 -- 172.21.15.8:0/2889964702 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f429806fce0 msgr2=0x7f42981f2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:01.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.513+0000 7f428fe00640 1 --2- 172.21.15.8:0/2889964702 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f429806fce0 0x7f42981f2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:01.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.513+0000 7f428fe00640 1 -- 172.21.15.8:0/2889964702 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42981f2b80 con 0x7f42980a9470 2024-03-23T23:43:01.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.513+0000 7f429ca00640 1 --2- 172.21.15.8:0/2889964702 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f429814fcd0 0x7f42980c15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:43:01.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.513+0000 7f428fe00640 1 --2- 172.21.15.8:0/2889964702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42980a9470 0x7f42981439b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f42800b2040 tx=0x7f428001b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:01.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.513+0000 7f4294c00640 1 -- 172.21.15.8:0/2889964702 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42800bd070 con 0x7f42980a9470 2024-03-23T23:43:01.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.513+0000 7f4294c00640 1 -- 172.21.15.8:0/2889964702 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42800af640 con 0x7f42980a9470 2024-03-23T23:43:01.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.513+0000 7f4294c00640 1 -- 172.21.15.8:0/2889964702 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42800b4040 con 0x7f42980a9470 2024-03-23T23:43:01.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.513+0000 7f429ea00640 1 -- 172.21.15.8:0/2889964702 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42980acad0 con 0x7f42980a9470 2024-03-23T23:43:01.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.513+0000 7f429ea00640 1 -- 172.21.15.8:0/2889964702 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42981eeb70 con 0x7f42980a9470 2024-03-23T23:43:01.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.513+0000 7f429ea00640 1 -- 172.21.15.8:0/2889964702 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f429804f480 con 0x7f42980a9470 2024-03-23T23:43:01.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.513+0000 7f4294c00640 1 -- 172.21.15.8:0/2889964702 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f42800c0070 con 0x7f42980a9470 2024-03-23T23:43:01.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.517+0000 7f4294c00640 1 --2- 172.21.15.8:0/2889964702 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4274067690 0x7f4274069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:01.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.517+0000 7f4294c00640 1 -- 172.21.15.8:0/2889964702 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f428011f360 con 0x7f42980a9470 2024-03-23T23:43:01.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.517+0000 7f4297e00640 1 --2- 172.21.15.8:0/2889964702 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4274067690 0x7f4274069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:01.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.517+0000 7f4297e00640 1 --2- 172.21.15.8:0/2889964702 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4274067690 0x7f4274069b50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4288005890 tx=0x7f4288009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:01.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.521+0000 7f4294c00640 1 -- 172.21.15.8:0/2889964702 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f4280018760 con 0x7f42980a9470 2024-03-23T23:43:01.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.713+0000 7f429ea00640 1 -- 172.21.15.8:0/2889964702 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f42980ad730 con 0x7f42980a9470 2024-03-23T23:43:01.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.713+0000 7f4294c00640 1 -- 172.21.15.8:0/2889964702 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f42800ef650 con 0x7f42980a9470 2024-03-23T23:43:01.716 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:43:01.716 INFO:teuthology.orchestra.run.smithi008.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-23T23:43:01.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.717+0000 7f429ea00640 1 -- 172.21.15.8:0/2889964702 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4274067690 msgr2=0x7f4274069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:01.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.717+0000 7f429ea00640 1 --2- 172.21.15.8:0/2889964702 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4274067690 0x7f4274069b50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4288005890 tx=0x7f4288009040 comp rx=0 tx=0).stop 2024-03-23T23:43:01.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.717+0000 7f429ea00640 1 -- 172.21.15.8:0/2889964702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42980a9470 msgr2=0x7f42981439b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:01.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.717+0000 7f429ea00640 1 --2- 172.21.15.8:0/2889964702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42980a9470 0x7f42981439b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f42800b2040 tx=0x7f428001b7f0 comp rx=0 tx=0).stop 2024-03-23T23:43:01.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.717+0000 7f429ea00640 1 -- 172.21.15.8:0/2889964702 shutdown_connections 2024-03-23T23:43:01.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.717+0000 7f429ea00640 1 --2- 172.21.15.8:0/2889964702 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4274067690 0x7f4274069b50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:01.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.717+0000 7f429ea00640 1 --2- 172.21.15.8:0/2889964702 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f429814fcd0 0x7f42980c15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:01.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.717+0000 7f429ea00640 1 --2- 172.21.15.8:0/2889964702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42980a9470 0x7f42981439b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:01.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.717+0000 7f429ea00640 1 --2- 172.21.15.8:0/2889964702 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f429806fce0 0x7f42981f2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:01.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.717+0000 7f429ea00640 1 -- 172.21.15.8:0/2889964702 >> 172.21.15.8:0/2889964702 conn(0x7f42980c8180 msgr2=0x7f429814d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:01.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.717+0000 7f429ea00640 1 -- 172.21.15.8:0/2889964702 shutdown_connections 2024-03-23T23:43:01.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.717+0000 7f429ea00640 1 -- 172.21.15.8:0/2889964702 wait complete. 2024-03-23T23:43:01.737 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-23T23:43:01.737 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:43:01.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.877+0000 7fd856c00640 1 Processor -- start 2024-03-23T23:43:01.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.877+0000 7fd856c00640 1 -- start start 2024-03-23T23:43:01.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.877+0000 7fd856c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8500c2f10 0x7fd8500c3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:01.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.877+0000 7fd856c00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8500c4790 con 0x7fd850153250 2024-03-23T23:43:01.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.877+0000 7fd856c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8500c44e0 con 0x7fd8500c4080 2024-03-23T23:43:01.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.877+0000 7fd856c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8500c07d0 con 0x7fd8500c2f10 2024-03-23T23:43:01.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.877+0000 7fd854c00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd850153250 0x7fd850158f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:45106/0 (socket says 172.21.15.8:45106) 2024-03-23T23:43:01.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.877+0000 7fd854c00640 1 -- 172.21.15.8:0/2155476206 learned_addr learned my addr 172.21.15.8:0/2155476206 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:43:01.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.877+0000 7fd84fe00640 1 --2- 172.21.15.8:0/2155476206 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8500c2f10 0x7fd8500c3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:01.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.877+0000 7fd84f400640 1 -- 172.21.15.8:0/2155476206 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 832138399 0 0) 0x7fd8500c4790 con 0x7fd850153250 2024-03-23T23:43:01.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.877+0000 7fd84f400640 1 -- 172.21.15.8:0/2155476206 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd834003530 con 0x7fd850153250 2024-03-23T23:43:01.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.877+0000 7fd84f400640 1 -- 172.21.15.8:0/2155476206 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 231345386 0 0) 0x7fd8500c44e0 con 0x7fd8500c4080 2024-03-23T23:43:01.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.877+0000 7fd84f400640 1 -- 172.21.15.8:0/2155476206 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8500c4790 con 0x7fd8500c4080 2024-03-23T23:43:01.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.877+0000 7fd84fe00640 1 -- 172.21.15.8:0/2155476206 >> v1:172.21.15.196:6789/0 conn(0x7fd8500c4080 legacy=0x7fd850152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:01.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.877+0000 7fd84fe00640 1 -- 172.21.15.8:0/2155476206 >> v1:172.21.15.8:6789/0 conn(0x7fd850153250 legacy=0x7fd850158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:01.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.877+0000 7fd84fe00640 1 -- 172.21.15.8:0/2155476206 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8500c0ab0 con 0x7fd8500c2f10 2024-03-23T23:43:01.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.881+0000 7fd84fe00640 1 --2- 172.21.15.8:0/2155476206 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8500c2f10 0x7fd8500c3b40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd840009820 tx=0x7fd84001c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=333f80c84f5e80 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:01.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.881+0000 7fd84f400640 1 -- 172.21.15.8:0/2155476206 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8400b0070 con 0x7fd8500c2f10 2024-03-23T23:43:01.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.881+0000 7fd84f400640 1 -- 172.21.15.8:0/2155476206 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8400ab600 con 0x7fd8500c2f10 2024-03-23T23:43:01.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.881+0000 7fd84f400640 1 -- 172.21.15.8:0/2155476206 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8400ab9b0 con 0x7fd8500c2f10 2024-03-23T23:43:01.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.881+0000 7fd856c00640 1 -- 172.21.15.8:0/2155476206 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8500c2f10 msgr2=0x7fd8500c3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:01.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.881+0000 7fd856c00640 1 --2- 172.21.15.8:0/2155476206 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8500c2f10 0x7fd8500c3b40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd840009820 tx=0x7fd84001c3a0 comp rx=0 tx=0).stop 2024-03-23T23:43:01.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.881+0000 7fd856c00640 1 -- 172.21.15.8:0/2155476206 shutdown_connections 2024-03-23T23:43:01.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.881+0000 7fd856c00640 1 --2- 172.21.15.8:0/2155476206 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8500c2f10 0x7fd8500c3b40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:01.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.881+0000 7fd856c00640 1 -- 172.21.15.8:0/2155476206 >> 172.21.15.8:0/2155476206 conn(0x7fd85006b170 msgr2=0x7fd85006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:01.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.881+0000 7fd856c00640 1 -- 172.21.15.8:0/2155476206 shutdown_connections 2024-03-23T23:43:01.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.881+0000 7fd856c00640 1 -- 172.21.15.8:0/2155476206 wait complete. 2024-03-23T23:43:01.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.885+0000 7fd856c00640 1 Processor -- start 2024-03-23T23:43:01.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.885+0000 7fd856c00640 1 -- start start 2024-03-23T23:43:01.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.885+0000 7fd856c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8500c2f10 0x7fd8501f2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:01.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.885+0000 7fd856c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8500c4080 0x7fd850145cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:01.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.885+0000 7fd856c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd850153250 0x7fd8501ef440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:01.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.885+0000 7fd856c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8500c3470 con 0x7fd850153250 2024-03-23T23:43:01.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.885+0000 7fd856c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8500c32f0 con 0x7fd8500c4080 2024-03-23T23:43:01.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.885+0000 7fd856c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd850163ac0 con 0x7fd8500c2f10 2024-03-23T23:43:01.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.885+0000 7fd854c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd850153250 0x7fd8501ef440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:01.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.885+0000 7fd84fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8500c2f10 0x7fd8501f2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:01.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.885+0000 7fd84fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8500c2f10 0x7fd8501f2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:49820/0 (socket says 172.21.15.8:49820) 2024-03-23T23:43:01.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.885+0000 7fd847e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8500c4080 0x7fd850145cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:01.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.885+0000 7fd84fe00640 1 -- 172.21.15.8:0/1207539923 learned_addr learned my addr 172.21.15.8:0/1207539923 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:01.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.885+0000 7fd84fe00640 1 -- 172.21.15.8:0/1207539923 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8500c4080 msgr2=0x7fd850145cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:01.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.885+0000 7fd84fe00640 1 --2- 172.21.15.8:0/1207539923 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8500c4080 0x7fd850145cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:01.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.885+0000 7fd84fe00640 1 -- 172.21.15.8:0/1207539923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd850153250 msgr2=0x7fd8501ef440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:01.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.885+0000 7fd84fe00640 1 --2- 172.21.15.8:0/1207539923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd850153250 0x7fd8501ef440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:01.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.885+0000 7fd84fe00640 1 -- 172.21.15.8:0/1207539923 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8500731b0 con 0x7fd8500c2f10 2024-03-23T23:43:01.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.885+0000 7fd847e00640 1 --2- 172.21.15.8:0/1207539923 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8500c4080 0x7fd850145cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:43:01.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.885+0000 7fd854c00640 1 --2- 172.21.15.8:0/1207539923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd850153250 0x7fd8501ef440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:43:01.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.885+0000 7fd84fe00640 1 --2- 172.21.15.8:0/1207539923 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8500c2f10 0x7fd8501f2d20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd840018fb0 tx=0x7fd840019140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:01.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.885+0000 7fd84cc00640 1 -- 172.21.15.8:0/1207539923 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8400b9020 con 0x7fd8500c2f10 2024-03-23T23:43:01.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.885+0000 7fd84cc00640 1 -- 172.21.15.8:0/1207539923 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8400ab7b0 con 0x7fd8500c2f10 2024-03-23T23:43:01.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.885+0000 7fd856c00640 1 -- 172.21.15.8:0/1207539923 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd850158ec0 con 0x7fd8500c2f10 2024-03-23T23:43:01.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.885+0000 7fd84cc00640 1 -- 172.21.15.8:0/1207539923 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8400b0040 con 0x7fd8500c2f10 2024-03-23T23:43:01.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.885+0000 7fd856c00640 1 -- 172.21.15.8:0/1207539923 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd850158340 con 0x7fd8500c2f10 2024-03-23T23:43:01.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.885+0000 7fd856c00640 1 -- 172.21.15.8:0/1207539923 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd850068270 con 0x7fd8500c2f10 2024-03-23T23:43:01.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.889+0000 7fd84cc00640 1 -- 172.21.15.8:0/1207539923 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd8400bc020 con 0x7fd8500c2f10 2024-03-23T23:43:01.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.889+0000 7fd84cc00640 1 --2- 172.21.15.8:0/1207539923 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd82c067660 0x7fd82c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:01.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.889+0000 7fd84cc00640 1 -- 172.21.15.8:0/1207539923 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fd84011f780 con 0x7fd8500c2f10 2024-03-23T23:43:01.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.889+0000 7fd847e00640 1 --2- 172.21.15.8:0/1207539923 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd82c067660 0x7fd82c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:01.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.889+0000 7fd847e00640 1 --2- 172.21.15.8:0/1207539923 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd82c067660 0x7fd82c069b20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd838001bb0 tx=0x7fd838009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:01.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:01.897+0000 7fd84cc00640 1 -- 172.21.15.8:0/1207539923 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fd8400c3030 con 0x7fd8500c2f10 2024-03-23T23:43:02.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.061+0000 7fd856c00640 1 -- 172.21.15.8:0/1207539923 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd850158620 con 0x7fd8500c2f10 2024-03-23T23:43:02.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.061+0000 7fd84cc00640 1 -- 172.21.15.8:0/1207539923 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20271 (secure 0 0 0) 0x7fd8400160b0 con 0x7fd8500c2f10 2024-03-23T23:43:02.064 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:43:02.064 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":25,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","created":"2024-03-23T23:42:15.169430+0000","modified":"2024-03-23T23:42:51.739271+0000","last_up_change":"2024-03-23T23:42:26.509742+0000","last_in_change":"2024-03-23T23:42:17.662330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:42:26.327445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-23T23:42:38.218800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-23T23:42:39.054195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-23T23:42:48.327799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-23T23:42:49.113061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e967bf31-21d6-4d11-bc3d-0df8177a1b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6809","nonce":2187201732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6811","nonce":2187201732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6815","nonce":2187201732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6813","nonce":2187201732}]},"public_addr":"172.21.15.8:6809/2187201732","cluster_addr":"172.21.15.8:6811/2187201732","heartbeat_back_addr":"172.21.15.8:6815/2187201732","heartbeat_front_addr":"172.21.15.8:6813/2187201732","state":["exists","up"]},{"osd":1,"uuid":"c8e33701-7acd-4474-8402-d52461171fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6818","nonce":3205168010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6822","nonce":3205168010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6830","nonce":3205168010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6826","nonce":3205168010}]},"public_addr":"172.21.15.8:6818/3205168010","cluster_addr":"172.21.15.8:6822/3205168010","heartbeat_back_addr":"172.21.15.8:6830/3205168010","heartbeat_front_addr":"172.21.15.8:6826/3205168010","state":["exists","up"]},{"osd":2,"uuid":"ceebdbf7-4c2f-4757-b52d-fd8b20e77570","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6801","nonce":475463656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6803","nonce":475463656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6807","nonce":475463656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6805","nonce":475463656}]},"public_addr":"172.21.15.8:6801/475463656","cluster_addr":"172.21.15.8:6803/475463656","heartbeat_back_addr":"172.21.15.8:6807/475463656","heartbeat_front_addr":"172.21.15.8:6805/475463656","state":["exists","up"]},{"osd":3,"uuid":"89e258da-5767-429e-8441-edf877d2f3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6819","nonce":1514082871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6821","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6823","nonce":1514082871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6829","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6831","nonce":1514082871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6825","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6827","nonce":1514082871}]},"public_addr":"172.21.15.8:6819/1514082871","cluster_addr":"172.21.15.8:6823/1514082871","heartbeat_back_addr":"172.21.15.8:6831/1514082871","heartbeat_front_addr":"172.21.15.8:6827/1514082871","state":["exists","up"]},{"osd":4,"uuid":"2b7451ae-ea16-4f0a-ae50-04fde75e45ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6825","nonce":3516578147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6827","nonce":3516578147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6831","nonce":3516578147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6829","nonce":3516578147}]},"public_addr":"172.21.15.196:6825/3516578147","cluster_addr":"172.21.15.196:6827/3516578147","heartbeat_back_addr":"172.21.15.196:6831/3516578147","heartbeat_front_addr":"172.21.15.196:6829/3516578147","state":["exists","up"]},{"osd":5,"uuid":"e68a8914-e591-466a-bc9e-f2d7c67aac13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6802","nonce":830595758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6806","nonce":830595758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6814","nonce":830595758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6810","nonce":830595758}]},"public_addr":"172.21.15.196:6802/830595758","cluster_addr":"172.21.15.196:6806/830595758","heartbeat_back_addr":"172.21.15.196:6814/830595758","heartbeat_front_addr":"172.21.15.196:6810/830595758","state":["exists","up"]},{"osd":6,"uuid":"e47723c5-50a0-4cd8-92d9-01972072b422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6801","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6803","nonce":472639906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6805","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6807","nonce":472639906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6815","nonce":472639906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6811","nonce":472639906}]},"public_addr":"172.21.15.196:6803/472639906","cluster_addr":"172.21.15.196:6807/472639906","heartbeat_back_addr":"172.21.15.196:6815/472639906","heartbeat_front_addr":"172.21.15.196:6811/472639906","state":["exists","up"]},{"osd":7,"uuid":"e1e9113d-8005-47b3-9a75-9e701199f1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6817","nonce":4151820349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6819","nonce":4151820349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6823","nonce":4151820349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6821","nonce":4151820349}]},"public_addr":"172.21.15.196:6817/4151820349","cluster_addr":"172.21.15.196:6819/4151820349","heartbeat_back_addr":"172.21.15.196:6823/4151820349","heartbeat_front_addr":"172.21.15.196:6821/4151820349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.221790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.265974+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.190319+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.376359+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.329657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.402958+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.300703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.133121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:43:02.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.065+0000 7fd856c00640 1 -- 172.21.15.8:0/1207539923 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd82c067660 msgr2=0x7fd82c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:02.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.065+0000 7fd856c00640 1 --2- 172.21.15.8:0/1207539923 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd82c067660 0x7fd82c069b20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd838001bb0 tx=0x7fd838009040 comp rx=0 tx=0).stop 2024-03-23T23:43:02.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.065+0000 7fd856c00640 1 -- 172.21.15.8:0/1207539923 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8500c2f10 msgr2=0x7fd8501f2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:02.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.065+0000 7fd856c00640 1 --2- 172.21.15.8:0/1207539923 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8500c2f10 0x7fd8501f2d20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd840018fb0 tx=0x7fd840019140 comp rx=0 tx=0).stop 2024-03-23T23:43:02.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.065+0000 7fd856c00640 1 -- 172.21.15.8:0/1207539923 shutdown_connections 2024-03-23T23:43:02.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.065+0000 7fd856c00640 1 --2- 172.21.15.8:0/1207539923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd850153250 0x7fd8501ef440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:02.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.065+0000 7fd856c00640 1 --2- 172.21.15.8:0/1207539923 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8500c4080 0x7fd850145cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:02.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.065+0000 7fd856c00640 1 --2- 172.21.15.8:0/1207539923 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd82c067660 0x7fd82c069b20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:02.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.065+0000 7fd856c00640 1 --2- 172.21.15.8:0/1207539923 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8500c2f10 0x7fd8501f2d20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:02.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.065+0000 7fd856c00640 1 -- 172.21.15.8:0/1207539923 >> 172.21.15.8:0/1207539923 conn(0x7fd85006b170 msgr2=0x7fd850071f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:02.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.065+0000 7fd856c00640 1 -- 172.21.15.8:0/1207539923 shutdown_connections 2024-03-23T23:43:02.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.065+0000 7fd856c00640 1 -- 172.21.15.8:0/1207539923 wait complete. 2024-03-23T23:43:02.086 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-23T23:42:26.327445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-03-23T23:42:38.218800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-03-23T23:42:39.054195+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-03-23T23:42:48.327799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-03-23T23:42:49.113061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-23T23:43:02.087 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-23T23:43:02.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.229+0000 7f94d1400640 1 Processor -- start 2024-03-23T23:43:02.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.229+0000 7f94d1400640 1 -- start start 2024-03-23T23:43:02.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.229+0000 7f94d1400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f94cc0c2e80 0x7f94cc1590f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:02.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.229+0000 7f94d1400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f94cc0c42a0 0x7f94cc159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:02.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.229+0000 7f94d1400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94cc1567d0 con 0x7f94cc14fa80 2024-03-23T23:43:02.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.229+0000 7f94d1400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94cc1562a0 con 0x7f94cc0c42a0 2024-03-23T23:43:02.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.229+0000 7f94d1400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94cc0c26b0 con 0x7f94cc0c2e80 2024-03-23T23:43:02.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.229+0000 7f94cb200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f94cc0c42a0 0x7f94cc159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:02.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.229+0000 7f94c1e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f94cc0c2e80 0x7f94cc1590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:02.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.229+0000 7f94ca800640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f94cc14fa80 0x7f94cc0ad880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:46370/0 (socket says 172.21.15.8:46370) 2024-03-23T23:43:02.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.229+0000 7f94ca800640 1 -- 172.21.15.8:0/3782293598 learned_addr learned my addr 172.21.15.8:0/3782293598 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:43:02.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.233+0000 7f94c1e00640 1 -- 172.21.15.8:0/3782293598 >> v2:172.21.15.8:3300/0 conn(0x7f94cc0c42a0 msgr2=0x7f94cc159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:02.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.233+0000 7f94c1e00640 1 --2- 172.21.15.8:0/3782293598 >> v2:172.21.15.8:3300/0 conn(0x7f94cc0c42a0 0x7f94cc159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:02.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.233+0000 7f94c1e00640 1 -- 172.21.15.8:0/3782293598 >> v1:172.21.15.196:6789/0 conn(0x7f94cc14fa80 legacy=0x7f94cc0ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:02.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.233+0000 7f94c1e00640 1 -- 172.21.15.8:0/3782293598 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94cc0c3980 con 0x7f94cc0c2e80 2024-03-23T23:43:02.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.233+0000 7f94cb200640 1 --2- 172.21.15.8:0/3782293598 >> v2:172.21.15.8:3300/0 conn(0x7f94cc0c42a0 0x7f94cc159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:43:02.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.233+0000 7f94c9e00640 1 -- 172.21.15.8:0/3782293598 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898840445 0 0) 0x7f94cc1567d0 con 0x7f94cc14fa80 2024-03-23T23:43:02.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.233+0000 7f94c1e00640 1 --2- 172.21.15.8:0/3782293598 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f94cc0c2e80 0x7f94cc1590f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f94cc0c48d0 tx=0x7f94b401c340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b255ebb6047708ba server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:02.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.233+0000 7f94c9e00640 1 -- 172.21.15.8:0/3782293598 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b40b0070 con 0x7f94cc0c2e80 2024-03-23T23:43:02.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.233+0000 7f94c9e00640 1 -- 172.21.15.8:0/3782293598 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b40ab600 con 0x7f94cc0c2e80 2024-03-23T23:43:02.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.233+0000 7f94c9e00640 1 -- 172.21.15.8:0/3782293598 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b40ab9d0 con 0x7f94cc0c2e80 2024-03-23T23:43:02.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.233+0000 7f94d1400640 1 -- 172.21.15.8:0/3782293598 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f94cc0c2e80 msgr2=0x7f94cc1590f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:02.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.233+0000 7f94d1400640 1 --2- 172.21.15.8:0/3782293598 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f94cc0c2e80 0x7f94cc1590f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f94cc0c48d0 tx=0x7f94b401c340 comp rx=0 tx=0).stop 2024-03-23T23:43:02.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.237+0000 7f94d1400640 1 -- 172.21.15.8:0/3782293598 shutdown_connections 2024-03-23T23:43:02.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.237+0000 7f94d1400640 1 --2- 172.21.15.8:0/3782293598 >> v2:172.21.15.8:3300/0 conn(0x7f94cc0c42a0 0x7f94cc159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:02.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.237+0000 7f94d1400640 1 --2- 172.21.15.8:0/3782293598 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f94cc0c2e80 0x7f94cc1590f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:02.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.237+0000 7f94d1400640 1 -- 172.21.15.8:0/3782293598 >> 172.21.15.8:0/3782293598 conn(0x7f94cc0c4a70 msgr2=0x7f94cc0c4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:02.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.237+0000 7f94d1400640 1 -- 172.21.15.8:0/3782293598 shutdown_connections 2024-03-23T23:43:02.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.237+0000 7f94d1400640 1 -- 172.21.15.8:0/3782293598 wait complete. 2024-03-23T23:43:02.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.237+0000 7f94d1400640 1 Processor -- start 2024-03-23T23:43:02.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.237+0000 7f94d1400640 1 -- start start 2024-03-23T23:43:02.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.237+0000 7f94d1400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f94cc0c2e80 0x7f94cc1545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:02.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.237+0000 7f94d1400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94cc0c42a0 0x7f94cc149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:02.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.237+0000 7f94d1400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f94cc14fa80 0x7f94cc149c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:02.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.237+0000 7f94d1400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc0ae110 con 0x7f94cc0c42a0 2024-03-23T23:43:02.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.237+0000 7f94d1400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc0adf90 con 0x7f94cc0c2e80 2024-03-23T23:43:02.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.237+0000 7f94d1400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc159b70 con 0x7f94cc14fa80 2024-03-23T23:43:02.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.237+0000 7f94c1e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94cc0c42a0 0x7f94cc149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:02.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.237+0000 7f94c1e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94cc0c42a0 0x7f94cc149730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42394/0 (socket says 172.21.15.8:42394) 2024-03-23T23:43:02.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.237+0000 7f94c1e00640 1 -- 172.21.15.8:0/2903528771 learned_addr learned my addr 172.21.15.8:0/2903528771 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:02.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.237+0000 7f94ca800640 1 --2- 172.21.15.8:0/2903528771 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f94cc0c2e80 0x7f94cc1545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:02.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.237+0000 7f94cb200640 1 --2- 172.21.15.8:0/2903528771 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f94cc14fa80 0x7f94cc149c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:02.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.237+0000 7f94c1e00640 1 -- 172.21.15.8:0/2903528771 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f94cc14fa80 msgr2=0x7f94cc149c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:02.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.237+0000 7f94c1e00640 1 --2- 172.21.15.8:0/2903528771 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f94cc14fa80 0x7f94cc149c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:02.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.237+0000 7f94c1e00640 1 -- 172.21.15.8:0/2903528771 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f94cc0c2e80 msgr2=0x7f94cc1545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:02.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.237+0000 7f94c1e00640 1 --2- 172.21.15.8:0/2903528771 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f94cc0c2e80 0x7f94cc1545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:02.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.237+0000 7f94c1e00640 1 -- 172.21.15.8:0/2903528771 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94cc14a1b0 con 0x7f94cc0c42a0 2024-03-23T23:43:02.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.237+0000 7f94c1e00640 1 --2- 172.21.15.8:0/2903528771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94cc0c42a0 0x7f94cc149730 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f94b401c820 tx=0x7f94b401ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:02.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.241+0000 7f94c3400640 1 -- 172.21.15.8:0/2903528771 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b40b9070 con 0x7f94cc0c42a0 2024-03-23T23:43:02.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.241+0000 7f94c3400640 1 -- 172.21.15.8:0/2903528771 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b40b4420 con 0x7f94cc0c42a0 2024-03-23T23:43:02.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.241+0000 7f94c3400640 1 -- 172.21.15.8:0/2903528771 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b40b0040 con 0x7f94cc0c42a0 2024-03-23T23:43:02.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.241+0000 7f94d1400640 1 -- 172.21.15.8:0/2903528771 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94cc1eedc0 con 0x7f94cc0c42a0 2024-03-23T23:43:02.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.241+0000 7f94d1400640 1 -- 172.21.15.8:0/2903528771 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94cc154b20 con 0x7f94cc0c42a0 2024-03-23T23:43:02.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.241+0000 7f94d1400640 1 -- 172.21.15.8:0/2903528771 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94cc152f40 con 0x7f94cc0c42a0 2024-03-23T23:43:02.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.241+0000 7f94c3400640 1 -- 172.21.15.8:0/2903528771 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f94b40b33c0 con 0x7f94cc0c42a0 2024-03-23T23:43:02.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.241+0000 7f94c3400640 1 --2- 172.21.15.8:0/2903528771 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f94a8067660 0x7f94a8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:02.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.241+0000 7f94c3400640 1 -- 172.21.15.8:0/2903528771 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f94b411ebe0 con 0x7f94cc0c42a0 2024-03-23T23:43:02.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.241+0000 7f94ca800640 1 --2- 172.21.15.8:0/2903528771 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f94a8067660 0x7f94a8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:02.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.245+0000 7f94ca800640 1 --2- 172.21.15.8:0/2903528771 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f94a8067660 0x7f94a8069b20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f94bc000f70 tx=0x7f94bc007df0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:02.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.245+0000 7f94c3400640 1 -- 172.21.15.8:0/2903528771 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f94b4016050 con 0x7f94cc0c42a0 2024-03-23T23:43:02.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.509+0000 7f94d1400640 1 -- 172.21.15.8:0/2903528771 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f94cc04f410 con 0x7f94cc0c42a0 2024-03-23T23:43:02.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.509+0000 7f94c3400640 1 -- 172.21.15.8:0/2903528771 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f94b40eef90 con 0x7f94cc0c42a0 2024-03-23T23:43:02.512 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-03-23T23:43:02.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.513+0000 7f94d1400640 1 -- 172.21.15.8:0/2903528771 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f94a8067660 msgr2=0x7f94a8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:02.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.513+0000 7f94d1400640 1 --2- 172.21.15.8:0/2903528771 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f94a8067660 0x7f94a8069b20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f94bc000f70 tx=0x7f94bc007df0 comp rx=0 tx=0).stop 2024-03-23T23:43:02.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.513+0000 7f94d1400640 1 -- 172.21.15.8:0/2903528771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94cc0c42a0 msgr2=0x7f94cc149730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:02.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.513+0000 7f94d1400640 1 --2- 172.21.15.8:0/2903528771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94cc0c42a0 0x7f94cc149730 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f94b401c820 tx=0x7f94b401ab80 comp rx=0 tx=0).stop 2024-03-23T23:43:02.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.513+0000 7f94d1400640 1 -- 172.21.15.8:0/2903528771 shutdown_connections 2024-03-23T23:43:02.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.513+0000 7f94d1400640 1 --2- 172.21.15.8:0/2903528771 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f94a8067660 0x7f94a8069b20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:02.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.513+0000 7f94d1400640 1 --2- 172.21.15.8:0/2903528771 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f94cc14fa80 0x7f94cc149c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:02.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.513+0000 7f94d1400640 1 --2- 172.21.15.8:0/2903528771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94cc0c42a0 0x7f94cc149730 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:02.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.513+0000 7f94d1400640 1 --2- 172.21.15.8:0/2903528771 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f94cc0c2e80 0x7f94cc1545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:02.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.513+0000 7f94d1400640 1 -- 172.21.15.8:0/2903528771 >> 172.21.15.8:0/2903528771 conn(0x7f94cc0c4a70 msgr2=0x7f94cc0ad880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:02.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.513+0000 7f94d1400640 1 -- 172.21.15.8:0/2903528771 shutdown_connections 2024-03-23T23:43:02.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.513+0000 7f94d1400640 1 -- 172.21.15.8:0/2903528771 wait complete. 2024-03-23T23:43:02.534 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-03-23T23:43:02.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.677+0000 7f3e40800640 1 Processor -- start 2024-03-23T23:43:02.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.677+0000 7f3e40800640 1 -- start start 2024-03-23T23:43:02.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.681+0000 7f3e40800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3e38151000 0x7f3e381542c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:02.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.681+0000 7f3e40800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e380c4fb0 0x7f3e380c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:02.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.681+0000 7f3e40800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3e380c73a0 0x7f3e380ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:02.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.681+0000 7f3e40800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e380c84a0 con 0x7f3e38151000 2024-03-23T23:43:02.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.681+0000 7f3e40800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e380c46a0 con 0x7f3e380c73a0 2024-03-23T23:43:02.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.681+0000 7f3e40800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e380c5770 con 0x7f3e380c4fb0 2024-03-23T23:43:02.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.681+0000 7f3e3de00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3e38151000 0x7f3e381542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:02.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.681+0000 7f3e3d400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e380c4fb0 0x7f3e380c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:02.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.681+0000 7f3e3de00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3e38151000 0x7f3e381542c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42406/0 (socket says 172.21.15.8:42406) 2024-03-23T23:43:02.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.681+0000 7f3e3d400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e380c4fb0 0x7f3e380c6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:49844/0 (socket says 172.21.15.8:49844) 2024-03-23T23:43:02.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.681+0000 7f3e3e800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3e380c73a0 0x7f3e380ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:02.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.681+0000 7f3e3de00640 1 -- 172.21.15.8:0/1652441665 learned_addr learned my addr 172.21.15.8:0/1652441665 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:02.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.681+0000 7f3e3de00640 1 -- 172.21.15.8:0/1652441665 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e380c4fb0 msgr2=0x7f3e380c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:02.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.681+0000 7f3e3de00640 1 --2- 172.21.15.8:0/1652441665 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e380c4fb0 0x7f3e380c6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:02.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.681+0000 7f3e3de00640 1 -- 172.21.15.8:0/1652441665 >> v2:172.21.15.196:3300/0 conn(0x7f3e380c73a0 msgr2=0x7f3e380ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:02.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.681+0000 7f3e3de00640 1 --2- 172.21.15.8:0/1652441665 >> v2:172.21.15.196:3300/0 conn(0x7f3e380c73a0 0x7f3e380ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:02.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.681+0000 7f3e3de00640 1 -- 172.21.15.8:0/1652441665 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e380c5490 con 0x7f3e38151000 2024-03-23T23:43:02.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.685+0000 7f3e3de00640 1 --2- 172.21.15.8:0/1652441665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e38151000 0x7f3e381542c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3e380c7780 tx=0x7f3e2c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e490a6b8172415c6 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:02.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.685+0000 7f3e3ca00640 1 -- 172.21.15.8:0/1652441665 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c0ab620 con 0x7f3e38151000 2024-03-23T23:43:02.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.685+0000 7f3e3ca00640 1 -- 172.21.15.8:0/1652441665 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2c0b0070 con 0x7f3e38151000 2024-03-23T23:43:02.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.685+0000 7f3e3ca00640 1 -- 172.21.15.8:0/1652441665 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c0ab9e0 con 0x7f3e38151000 2024-03-23T23:43:02.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.685+0000 7f3e40800640 1 -- 172.21.15.8:0/1652441665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e38151000 msgr2=0x7f3e381542c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:02.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.685+0000 7f3e40800640 1 --2- 172.21.15.8:0/1652441665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e38151000 0x7f3e381542c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3e380c7780 tx=0x7f3e2c01c460 comp rx=0 tx=0).stop 2024-03-23T23:43:02.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.685+0000 7f3e40800640 1 -- 172.21.15.8:0/1652441665 shutdown_connections 2024-03-23T23:43:02.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.685+0000 7f3e40800640 1 --2- 172.21.15.8:0/1652441665 >> v2:172.21.15.196:3300/0 conn(0x7f3e380c73a0 0x7f3e380ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:02.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.685+0000 7f3e40800640 1 --2- 172.21.15.8:0/1652441665 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e380c4fb0 0x7f3e380c6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:02.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.685+0000 7f3e40800640 1 --2- 172.21.15.8:0/1652441665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e38151000 0x7f3e381542c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:02.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.685+0000 7f3e40800640 1 -- 172.21.15.8:0/1652441665 >> 172.21.15.8:0/1652441665 conn(0x7f3e380aad10 msgr2=0x7f3e380ab120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:02.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.685+0000 7f3e40800640 1 -- 172.21.15.8:0/1652441665 shutdown_connections 2024-03-23T23:43:02.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.685+0000 7f3e40800640 1 -- 172.21.15.8:0/1652441665 wait complete. 2024-03-23T23:43:02.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.685+0000 7f3e40800640 1 Processor -- start 2024-03-23T23:43:02.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.685+0000 7f3e40800640 1 -- start start 2024-03-23T23:43:02.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.689+0000 7f3e40800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e380c4fb0 0x7f3e380c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:02.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.689+0000 7f3e40800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e380c73a0 0x7f3e381f1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:02.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.689+0000 7f3e40800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e38151000 0x7f3e381f1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:02.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.689+0000 7f3e40800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e380c3610 con 0x7f3e380c73a0 2024-03-23T23:43:02.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.689+0000 7f3e40800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e380c3490 con 0x7f3e38151000 2024-03-23T23:43:02.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.689+0000 7f3e40800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e38157440 con 0x7f3e380c4fb0 2024-03-23T23:43:02.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.689+0000 7f3e3d400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e380c73a0 0x7f3e381f1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:02.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.689+0000 7f3e3d400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e380c73a0 0x7f3e381f1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42412/0 (socket says 172.21.15.8:42412) 2024-03-23T23:43:02.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.689+0000 7f3e3de00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e380c4fb0 0x7f3e380c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:02.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.689+0000 7f3e3d400640 1 -- 172.21.15.8:0/2388748399 learned_addr learned my addr 172.21.15.8:0/2388748399 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:02.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.689+0000 7f3e3e800640 1 --2- 172.21.15.8:0/2388748399 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e38151000 0x7f3e381f1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:02.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.689+0000 7f3e3d400640 1 -- 172.21.15.8:0/2388748399 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e380c4fb0 msgr2=0x7f3e380c25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:02.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.689+0000 7f3e3d400640 1 --2- 172.21.15.8:0/2388748399 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e380c4fb0 0x7f3e380c25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:02.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.689+0000 7f3e3d400640 1 -- 172.21.15.8:0/2388748399 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e38151000 msgr2=0x7f3e381f1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:02.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.689+0000 7f3e3d400640 1 --2- 172.21.15.8:0/2388748399 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e38151000 0x7f3e381f1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:02.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.689+0000 7f3e3d400640 1 -- 172.21.15.8:0/2388748399 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e380acdf0 con 0x7f3e380c73a0 2024-03-23T23:43:02.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.689+0000 7f3e3de00640 1 --2- 172.21.15.8:0/2388748399 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e380c4fb0 0x7f3e380c25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:43:02.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.689+0000 7f3e3d400640 1 --2- 172.21.15.8:0/2388748399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e380c73a0 0x7f3e381f1740 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3e2800e8e0 tx=0x7f3e2800eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:02.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.689+0000 7f3e32000640 1 -- 172.21.15.8:0/2388748399 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e28017070 con 0x7f3e380c73a0 2024-03-23T23:43:02.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.689+0000 7f3e32000640 1 -- 172.21.15.8:0/2388748399 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2800ca00 con 0x7f3e380c73a0 2024-03-23T23:43:02.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.689+0000 7f3e40800640 1 -- 172.21.15.8:0/2388748399 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e38153390 con 0x7f3e380c73a0 2024-03-23T23:43:02.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.689+0000 7f3e32000640 1 -- 172.21.15.8:0/2388748399 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2800cdd0 con 0x7f3e380c73a0 2024-03-23T23:43:02.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.689+0000 7f3e40800640 1 -- 172.21.15.8:0/2388748399 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e381eecf0 con 0x7f3e380c73a0 2024-03-23T23:43:02.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.689+0000 7f3e40800640 1 -- 172.21.15.8:0/2388748399 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e3804f410 con 0x7f3e380c73a0 2024-03-23T23:43:02.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.693+0000 7f3e32000640 1 -- 172.21.15.8:0/2388748399 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3e2801a070 con 0x7f3e380c73a0 2024-03-23T23:43:02.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.693+0000 7f3e32000640 1 --2- 172.21.15.8:0/2388748399 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3e1c067660 0x7f3e1c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:02.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.693+0000 7f3e32000640 1 -- 172.21.15.8:0/2388748399 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f3e28085f70 con 0x7f3e380c73a0 2024-03-23T23:43:02.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.693+0000 7f3e3de00640 1 --2- 172.21.15.8:0/2388748399 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3e1c067660 0x7f3e1c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:02.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.693+0000 7f3e3de00640 1 --2- 172.21.15.8:0/2388748399 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3e1c067660 0x7f3e1c069b20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c0af000 tx=0x7f3e2c0a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:02.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.697+0000 7f3e32000640 1 -- 172.21.15.8:0/2388748399 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f3e28056260 con 0x7f3e380c73a0 2024-03-23T23:43:02.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.901+0000 7f3e40800640 1 -- 172.21.15.8:0/2388748399 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3e38154ab0 con 0x7f3e380c73a0 2024-03-23T23:43:02.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.901+0000 7f3e32000640 1 -- 172.21.15.8:0/2388748399 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v25) v1 ==== 99+0+11 (secure 0 0 0) 0x7f3e2805a300 con 0x7f3e380c73a0 2024-03-23T23:43:02.904 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-03-23T23:43:02.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.905+0000 7f3e40800640 1 -- 172.21.15.8:0/2388748399 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3e1c067660 msgr2=0x7f3e1c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:02.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.905+0000 7f3e40800640 1 --2- 172.21.15.8:0/2388748399 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3e1c067660 0x7f3e1c069b20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c0af000 tx=0x7f3e2c0a7000 comp rx=0 tx=0).stop 2024-03-23T23:43:02.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.905+0000 7f3e40800640 1 -- 172.21.15.8:0/2388748399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e380c73a0 msgr2=0x7f3e381f1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:02.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.905+0000 7f3e40800640 1 --2- 172.21.15.8:0/2388748399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e380c73a0 0x7f3e381f1740 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3e2800e8e0 tx=0x7f3e2800eda0 comp rx=0 tx=0).stop 2024-03-23T23:43:02.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.905+0000 7f3e40800640 1 -- 172.21.15.8:0/2388748399 shutdown_connections 2024-03-23T23:43:02.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.905+0000 7f3e40800640 1 --2- 172.21.15.8:0/2388748399 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e38151000 0x7f3e381f1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:02.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.905+0000 7f3e40800640 1 --2- 172.21.15.8:0/2388748399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e380c73a0 0x7f3e381f1740 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:02.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.905+0000 7f3e40800640 1 --2- 172.21.15.8:0/2388748399 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3e1c067660 0x7f3e1c069b20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:02.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.905+0000 7f3e40800640 1 --2- 172.21.15.8:0/2388748399 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e380c4fb0 0x7f3e380c25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:02.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.905+0000 7f3e40800640 1 -- 172.21.15.8:0/2388748399 >> 172.21.15.8:0/2388748399 conn(0x7f3e380aad10 msgr2=0x7f3e3814ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:02.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.905+0000 7f3e40800640 1 -- 172.21.15.8:0/2388748399 shutdown_connections 2024-03-23T23:43:02.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:02.905+0000 7f3e40800640 1 -- 172.21.15.8:0/2388748399 wait complete. 2024-03-23T23:43:02.926 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-03-23T23:43:03.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.065+0000 7fcb2a800640 1 Processor -- start 2024-03-23T23:43:03.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.069+0000 7fcb2a800640 1 -- start start 2024-03-23T23:43:03.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.069+0000 7fcb2a800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fcb2406de00 0x7fcb241595f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:03.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.069+0000 7fcb2a800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb240732a0 con 0x7fcb24152cc0 2024-03-23T23:43:03.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.069+0000 7fcb2a800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb2406e4f0 con 0x7fcb240c33a0 2024-03-23T23:43:03.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.069+0000 7fcb2a800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb2406e7d0 con 0x7fcb2406de00 2024-03-23T23:43:03.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.069+0000 7fcb23400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fcb24152cc0 0x7fcb240ad880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:45406/0 (socket says 172.21.15.8:45406) 2024-03-23T23:43:03.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.069+0000 7fcb23400640 1 -- 172.21.15.8:0/1220247226 learned_addr learned my addr 172.21.15.8:0/1220247226 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:43:03.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.069+0000 7fcb23e00640 1 --2- 172.21.15.8:0/1220247226 >> v2:172.21.15.196:3300/0 conn(0x7fcb2406de00 0x7fcb241595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:03.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.069+0000 7fcb22a00640 1 -- 172.21.15.8:0/1220247226 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1943705605 0 0) 0x7fcb240732a0 con 0x7fcb24152cc0 2024-03-23T23:43:03.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.069+0000 7fcb22a00640 1 -- 172.21.15.8:0/1220247226 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb08003530 con 0x7fcb24152cc0 2024-03-23T23:43:03.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.069+0000 7fcb22a00640 1 -- 172.21.15.8:0/1220247226 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1519126669 0 0) 0x7fcb2406e4f0 con 0x7fcb240c33a0 2024-03-23T23:43:03.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.069+0000 7fcb23e00640 1 -- 172.21.15.8:0/1220247226 >> v1:172.21.15.196:6789/0 conn(0x7fcb240c33a0 legacy=0x7fcb24158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:03.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.069+0000 7fcb23e00640 1 -- 172.21.15.8:0/1220247226 >> v1:172.21.15.8:6789/0 conn(0x7fcb24152cc0 legacy=0x7fcb240ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:03.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.069+0000 7fcb23e00640 1 -- 172.21.15.8:0/1220247226 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb2406eab0 con 0x7fcb2406de00 2024-03-23T23:43:03.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.073+0000 7fcb23e00640 1 --2- 172.21.15.8:0/1220247226 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb2406de00 0x7fcb241595f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c009d90 tx=0x7fcb1c01c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a109c5b28d071c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:03.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.073+0000 7fcb22a00640 1 -- 172.21.15.8:0/1220247226 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c0b2070 con 0x7fcb2406de00 2024-03-23T23:43:03.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.073+0000 7fcb22a00640 1 -- 172.21.15.8:0/1220247226 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1c0a5970 con 0x7fcb2406de00 2024-03-23T23:43:03.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.073+0000 7fcb22a00640 1 -- 172.21.15.8:0/1220247226 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c0a5d40 con 0x7fcb2406de00 2024-03-23T23:43:03.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.073+0000 7fcb2a800640 1 -- 172.21.15.8:0/1220247226 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb2406de00 msgr2=0x7fcb241595f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:03.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.073+0000 7fcb2a800640 1 --2- 172.21.15.8:0/1220247226 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb2406de00 0x7fcb241595f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c009d90 tx=0x7fcb1c01c8b0 comp rx=0 tx=0).stop 2024-03-23T23:43:03.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.073+0000 7fcb2a800640 1 -- 172.21.15.8:0/1220247226 shutdown_connections 2024-03-23T23:43:03.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.073+0000 7fcb2a800640 1 --2- 172.21.15.8:0/1220247226 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb2406de00 0x7fcb241595f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:03.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.073+0000 7fcb2a800640 1 -- 172.21.15.8:0/1220247226 >> 172.21.15.8:0/1220247226 conn(0x7fcb240c4a70 msgr2=0x7fcb240c4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:03.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.073+0000 7fcb2a800640 1 -- 172.21.15.8:0/1220247226 shutdown_connections 2024-03-23T23:43:03.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.073+0000 7fcb2a800640 1 -- 172.21.15.8:0/1220247226 wait complete. 2024-03-23T23:43:03.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.073+0000 7fcb2a800640 1 Processor -- start 2024-03-23T23:43:03.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.073+0000 7fcb2a800640 1 -- start start 2024-03-23T23:43:03.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.077+0000 7fcb2a800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb2406de00 0x7fcb24153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:03.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.077+0000 7fcb2a800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb240c33a0 0x7fcb241edb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:03.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.077+0000 7fcb2a800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb24152cc0 0x7fcb241ee060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:03.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.077+0000 7fcb2a800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb240adf90 con 0x7fcb24152cc0 2024-03-23T23:43:03.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.077+0000 7fcb2a800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb241530a0 con 0x7fcb240c33a0 2024-03-23T23:43:03.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.077+0000 7fcb2a800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb240ae110 con 0x7fcb2406de00 2024-03-23T23:43:03.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.077+0000 7fcb23e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb24152cc0 0x7fcb241ee060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:03.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.077+0000 7fcb23e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb24152cc0 0x7fcb241ee060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60092/0 (socket says 172.21.15.8:60092) 2024-03-23T23:43:03.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.077+0000 7fcb23e00640 1 -- 172.21.15.8:0/1821312851 learned_addr learned my addr 172.21.15.8:0/1821312851 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:03.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.077+0000 7fcb23400640 1 --2- 172.21.15.8:0/1821312851 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb2406de00 0x7fcb24153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:03.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.077+0000 7fcb1be00640 1 --2- 172.21.15.8:0/1821312851 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb240c33a0 0x7fcb241edb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:03.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.077+0000 7fcb23e00640 1 -- 172.21.15.8:0/1821312851 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb2406de00 msgr2=0x7fcb24153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:03.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.077+0000 7fcb23e00640 1 --2- 172.21.15.8:0/1821312851 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb2406de00 0x7fcb24153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:03.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.077+0000 7fcb23e00640 1 -- 172.21.15.8:0/1821312851 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb240c33a0 msgr2=0x7fcb241edb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:03.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.077+0000 7fcb23e00640 1 --2- 172.21.15.8:0/1821312851 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb240c33a0 0x7fcb241edb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:03.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.077+0000 7fcb23e00640 1 -- 172.21.15.8:0/1821312851 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb241ee5a0 con 0x7fcb24152cc0 2024-03-23T23:43:03.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.077+0000 7fcb23e00640 1 --2- 172.21.15.8:0/1821312851 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb24152cc0 0x7fcb241ee060 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c0b0040 tx=0x7fcb1c019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:03.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.077+0000 7fcb1b400640 1 -- 172.21.15.8:0/1821312851 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c0bd070 con 0x7fcb24152cc0 2024-03-23T23:43:03.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.077+0000 7fcb1b400640 1 -- 172.21.15.8:0/1821312851 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1c003ba0 con 0x7fcb24152cc0 2024-03-23T23:43:03.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.077+0000 7fcb2a800640 1 -- 172.21.15.8:0/1821312851 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb241ee820 con 0x7fcb24152cc0 2024-03-23T23:43:03.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.077+0000 7fcb1b400640 1 -- 172.21.15.8:0/1821312851 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c0b2040 con 0x7fcb24152cc0 2024-03-23T23:43:03.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.077+0000 7fcb2a800640 1 -- 172.21.15.8:0/1821312851 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb2414e650 con 0x7fcb24152cc0 2024-03-23T23:43:03.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.077+0000 7fcb2a800640 1 -- 172.21.15.8:0/1821312851 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb2404f410 con 0x7fcb24152cc0 2024-03-23T23:43:03.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.081+0000 7fcb1b400640 1 -- 172.21.15.8:0/1821312851 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fcb1c003fd0 con 0x7fcb24152cc0 2024-03-23T23:43:03.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.081+0000 7fcb1b400640 1 --2- 172.21.15.8:0/1821312851 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcb00067660 0x7fcb00069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:03.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.081+0000 7fcb1b400640 1 -- 172.21.15.8:0/1821312851 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fcb1c120a40 con 0x7fcb24152cc0 2024-03-23T23:43:03.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.081+0000 7fcb23400640 1 --2- 172.21.15.8:0/1821312851 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcb00067660 0x7fcb00069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:03.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.081+0000 7fcb23400640 1 --2- 172.21.15.8:0/1821312851 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcb00067660 0x7fcb00069b20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcb140011f0 tx=0x7fcb14007d40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:03.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.085+0000 7fcb1b400640 1 -- 172.21.15.8:0/1821312851 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fcb241ee5a0 con 0x7fcb24152cc0 2024-03-23T23:43:03.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.245+0000 7fcb2a800640 1 -- 172.21.15.8:0/1821312851 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7fcb241598f0 con 0x7fcb24152cc0 2024-03-23T23:43:03.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.249+0000 7fcb1b400640 1 -- 172.21.15.8:0/1821312851 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v25) v1 ==== 95+0+11 (secure 0 0 0) 0x7fcb1c016560 con 0x7fcb24152cc0 2024-03-23T23:43:03.249 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-03-23T23:43:03.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.249+0000 7fcb2a800640 1 -- 172.21.15.8:0/1821312851 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcb00067660 msgr2=0x7fcb00069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:03.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.249+0000 7fcb2a800640 1 --2- 172.21.15.8:0/1821312851 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcb00067660 0x7fcb00069b20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcb140011f0 tx=0x7fcb14007d40 comp rx=0 tx=0).stop 2024-03-23T23:43:03.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.249+0000 7fcb2a800640 1 -- 172.21.15.8:0/1821312851 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb24152cc0 msgr2=0x7fcb241ee060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:03.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.249+0000 7fcb2a800640 1 --2- 172.21.15.8:0/1821312851 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb24152cc0 0x7fcb241ee060 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c0b0040 tx=0x7fcb1c019650 comp rx=0 tx=0).stop 2024-03-23T23:43:03.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.249+0000 7fcb2a800640 1 -- 172.21.15.8:0/1821312851 shutdown_connections 2024-03-23T23:43:03.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.249+0000 7fcb2a800640 1 --2- 172.21.15.8:0/1821312851 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb24152cc0 0x7fcb241ee060 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:03.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.249+0000 7fcb2a800640 1 --2- 172.21.15.8:0/1821312851 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb240c33a0 0x7fcb241edb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:03.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.249+0000 7fcb2a800640 1 --2- 172.21.15.8:0/1821312851 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcb00067660 0x7fcb00069b20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:03.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.249+0000 7fcb2a800640 1 --2- 172.21.15.8:0/1821312851 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb2406de00 0x7fcb24153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:03.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.249+0000 7fcb2a800640 1 -- 172.21.15.8:0/1821312851 >> 172.21.15.8:0/1821312851 conn(0x7fcb240c4a70 msgr2=0x7fcb24071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:03.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.249+0000 7fcb2a800640 1 -- 172.21.15.8:0/1821312851 shutdown_connections 2024-03-23T23:43:03.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.249+0000 7fcb2a800640 1 -- 172.21.15.8:0/1821312851 wait complete. 2024-03-23T23:43:03.270 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-03-23T23:43:03.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.417+0000 7f6b4dc00640 1 Processor -- start 2024-03-23T23:43:03.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.417+0000 7f6b4dc00640 1 -- start start 2024-03-23T23:43:03.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.417+0000 7f6b4dc00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6b48152ff0 0x7f6b480714f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:03.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.417+0000 7f6b4dc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6b48159860 0x7f6b4806ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:03.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.417+0000 7f6b4dc00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b48159dd0 con 0x7f6b4806f190 2024-03-23T23:43:03.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.417+0000 7f6b4dc00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b480701f0 con 0x7f6b48152ff0 2024-03-23T23:43:03.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.417+0000 7f6b4dc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b480704d0 con 0x7f6b48159860 2024-03-23T23:43:03.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.417+0000 7f6b46a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6b48152ff0 0x7f6b480714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:03.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.417+0000 7f6b3e000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6b48159860 0x7f6b4806ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:03.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.417+0000 7f6b46a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6b48152ff0 0x7f6b480714f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60096/0 (socket says 172.21.15.8:60096) 2024-03-23T23:43:03.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.417+0000 7f6b46a00640 1 -- 172.21.15.8:0/3274289113 learned_addr learned my addr 172.21.15.8:0/3274289113 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:03.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.417+0000 7f6b47400640 1 --1- 172.21.15.8:0/3274289113 >> v1:172.21.15.196:6789/0 conn(0x7f6b4806f190 0x7f6b480c2390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:59918/0 (socket says 172.21.15.8:59918) 2024-03-23T23:43:03.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.417+0000 7f6b46a00640 1 -- 172.21.15.8:0/3274289113 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6b48159860 msgr2=0x7f6b4806ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:03.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.417+0000 7f6b46a00640 1 --2- 172.21.15.8:0/3274289113 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6b48159860 0x7f6b4806ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:03.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.417+0000 7f6b46a00640 1 -- 172.21.15.8:0/3274289113 >> v1:172.21.15.196:6789/0 conn(0x7f6b4806f190 legacy=0x7f6b480c2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:03.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.417+0000 7f6b46000640 1 -- 172.21.15.8:0/3274289113 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1622368623 0 0) 0x7f6b48159dd0 con 0x7f6b4806f190 2024-03-23T23:43:03.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.417+0000 7f6b46a00640 1 -- 172.21.15.8:0/3274289113 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b480707b0 con 0x7f6b48152ff0 2024-03-23T23:43:03.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.421+0000 7f6b46a00640 1 --2- 172.21.15.8:0/3274289113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b48152ff0 0x7f6b480714f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6b38009870 tx=0x7f6b3801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=658927a488f05372 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:03.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.421+0000 7f6b46000640 1 -- 172.21.15.8:0/3274289113 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b380b0070 con 0x7f6b48152ff0 2024-03-23T23:43:03.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.421+0000 7f6b46000640 1 -- 172.21.15.8:0/3274289113 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b380ab600 con 0x7f6b48152ff0 2024-03-23T23:43:03.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.421+0000 7f6b46000640 1 -- 172.21.15.8:0/3274289113 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b380ab9d0 con 0x7f6b48152ff0 2024-03-23T23:43:03.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.421+0000 7f6b4dc00640 1 -- 172.21.15.8:0/3274289113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b48152ff0 msgr2=0x7f6b480714f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:03.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.421+0000 7f6b4dc00640 1 --2- 172.21.15.8:0/3274289113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b48152ff0 0x7f6b480714f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6b38009870 tx=0x7f6b3801c4d0 comp rx=0 tx=0).stop 2024-03-23T23:43:03.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.421+0000 7f6b4dc00640 1 -- 172.21.15.8:0/3274289113 shutdown_connections 2024-03-23T23:43:03.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.421+0000 7f6b4dc00640 1 --2- 172.21.15.8:0/3274289113 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6b48159860 0x7f6b4806ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:03.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.421+0000 7f6b4dc00640 1 --2- 172.21.15.8:0/3274289113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b48152ff0 0x7f6b480714f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:03.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.421+0000 7f6b4dc00640 1 -- 172.21.15.8:0/3274289113 >> 172.21.15.8:0/3274289113 conn(0x7f6b480aad10 msgr2=0x7f6b480ab120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:03.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.421+0000 7f6b4dc00640 1 -- 172.21.15.8:0/3274289113 shutdown_connections 2024-03-23T23:43:03.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.421+0000 7f6b4dc00640 1 -- 172.21.15.8:0/3274289113 wait complete. 2024-03-23T23:43:03.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.425+0000 7f6b4dc00640 1 Processor -- start 2024-03-23T23:43:03.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.425+0000 7f6b4dc00640 1 -- start start 2024-03-23T23:43:03.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.425+0000 7f6b4dc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b4806f190 0x7f6b4814c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:03.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.425+0000 7f6b4dc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6b48152ff0 0x7f6b4814f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:03.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.425+0000 7f6b4dc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b48159860 0x7f6b4814a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:03.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.425+0000 7f6b4dc00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b480c75a0 con 0x7f6b48159860 2024-03-23T23:43:03.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.425+0000 7f6b4dc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b480c7420 con 0x7f6b4806f190 2024-03-23T23:43:03.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.425+0000 7f6b4dc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b48162a00 con 0x7f6b48152ff0 2024-03-23T23:43:03.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.425+0000 7f6b47400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b48159860 0x7f6b4814a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:03.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.425+0000 7f6b47400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b48159860 0x7f6b4814a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60112/0 (socket says 172.21.15.8:60112) 2024-03-23T23:43:03.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.425+0000 7f6b47400640 1 -- 172.21.15.8:0/1309063198 learned_addr learned my addr 172.21.15.8:0/1309063198 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:03.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.425+0000 7f6b46a00640 1 --2- 172.21.15.8:0/1309063198 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b4806f190 0x7f6b4814c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:03.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.425+0000 7f6b3e000640 1 --2- 172.21.15.8:0/1309063198 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6b48152ff0 0x7f6b4814f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:03.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.425+0000 7f6b47400640 1 -- 172.21.15.8:0/1309063198 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6b48152ff0 msgr2=0x7f6b4814f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:03.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.425+0000 7f6b47400640 1 --2- 172.21.15.8:0/1309063198 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6b48152ff0 0x7f6b4814f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:03.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.425+0000 7f6b47400640 1 -- 172.21.15.8:0/1309063198 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b4806f190 msgr2=0x7f6b4814c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:03.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.425+0000 7f6b47400640 1 --2- 172.21.15.8:0/1309063198 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b4806f190 0x7f6b4814c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:03.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.425+0000 7f6b47400640 1 -- 172.21.15.8:0/1309063198 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4814b8d0 con 0x7f6b48159860 2024-03-23T23:43:03.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.425+0000 7f6b46a00640 1 --2- 172.21.15.8:0/1309063198 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b4806f190 0x7f6b4814c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:43:03.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.425+0000 7f6b47400640 1 --2- 172.21.15.8:0/1309063198 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b48159860 0x7f6b4814a080 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000c730 tx=0x7f6b4000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:03.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.425+0000 7f6b3f400640 1 -- 172.21.15.8:0/1309063198 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b40018070 con 0x7f6b48159860 2024-03-23T23:43:03.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.425+0000 7f6b3f400640 1 -- 172.21.15.8:0/1309063198 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4000ce40 con 0x7f6b48159860 2024-03-23T23:43:03.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.425+0000 7f6b3f400640 1 -- 172.21.15.8:0/1309063198 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4000a860 con 0x7f6b48159860 2024-03-23T23:43:03.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.425+0000 7f6b4dc00640 1 -- 172.21.15.8:0/1309063198 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b4814bbb0 con 0x7f6b48159860 2024-03-23T23:43:03.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.425+0000 7f6b4dc00640 1 -- 172.21.15.8:0/1309063198 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b480aa3c0 con 0x7f6b48159860 2024-03-23T23:43:03.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.429+0000 7f6b4dc00640 1 -- 172.21.15.8:0/1309063198 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b4804f410 con 0x7f6b48159860 2024-03-23T23:43:03.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.429+0000 7f6b3f400640 1 -- 172.21.15.8:0/1309063198 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f6b4000aa00 con 0x7f6b48159860 2024-03-23T23:43:03.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.429+0000 7f6b3f400640 1 --2- 172.21.15.8:0/1309063198 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6b24067690 0x7f6b24069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:03.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.429+0000 7f6b3f400640 1 -- 172.21.15.8:0/1309063198 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f6b400850f0 con 0x7f6b48159860 2024-03-23T23:43:03.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.429+0000 7f6b46a00640 1 --2- 172.21.15.8:0/1309063198 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6b24067690 0x7f6b24069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:03.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.429+0000 7f6b46a00640 1 --2- 172.21.15.8:0/1309063198 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6b24067690 0x7f6b24069b50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6b380ad000 tx=0x7f6b380a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:03.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.433+0000 7f6b3f400640 1 -- 172.21.15.8:0/1309063198 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f6b40055350 con 0x7f6b48159860 2024-03-23T23:43:03.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.597+0000 7f6b4dc00640 1 -- 172.21.15.8:0/1309063198 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6b480c8d40 con 0x7f6b48159860 2024-03-23T23:43:03.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.601+0000 7f6b3f400640 1 -- 172.21.15.8:0/1309063198 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v25) v1 ==== 99+0+11 (secure 0 0 0) 0x7f6b400593f0 con 0x7f6b48159860 2024-03-23T23:43:03.601 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-03-23T23:43:03.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.601+0000 7f6b4dc00640 1 -- 172.21.15.8:0/1309063198 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6b24067690 msgr2=0x7f6b24069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:03.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.601+0000 7f6b4dc00640 1 --2- 172.21.15.8:0/1309063198 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6b24067690 0x7f6b24069b50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6b380ad000 tx=0x7f6b380a6000 comp rx=0 tx=0).stop 2024-03-23T23:43:03.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.601+0000 7f6b4dc00640 1 -- 172.21.15.8:0/1309063198 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b48159860 msgr2=0x7f6b4814a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:03.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.601+0000 7f6b4dc00640 1 --2- 172.21.15.8:0/1309063198 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b48159860 0x7f6b4814a080 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000c730 tx=0x7f6b4000cbf0 comp rx=0 tx=0).stop 2024-03-23T23:43:03.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.601+0000 7f6b4dc00640 1 -- 172.21.15.8:0/1309063198 shutdown_connections 2024-03-23T23:43:03.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.601+0000 7f6b4dc00640 1 --2- 172.21.15.8:0/1309063198 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b48159860 0x7f6b4814a080 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:03.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.601+0000 7f6b4dc00640 1 --2- 172.21.15.8:0/1309063198 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6b24067690 0x7f6b24069b50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:03.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.601+0000 7f6b4dc00640 1 --2- 172.21.15.8:0/1309063198 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6b48152ff0 0x7f6b4814f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:03.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.601+0000 7f6b4dc00640 1 --2- 172.21.15.8:0/1309063198 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b4806f190 0x7f6b4814c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:03.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.601+0000 7f6b4dc00640 1 -- 172.21.15.8:0/1309063198 >> 172.21.15.8:0/1309063198 conn(0x7f6b480aad10 msgr2=0x7f6b480c3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:03.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.601+0000 7f6b4dc00640 1 -- 172.21.15.8:0/1309063198 shutdown_connections 2024-03-23T23:43:03.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.601+0000 7f6b4dc00640 1 -- 172.21.15.8:0/1309063198 wait complete. 2024-03-23T23:43:03.621 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-03-23T23:43:03.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.773+0000 7fbaefe00640 1 Processor -- start 2024-03-23T23:43:03.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.773+0000 7fbaefe00640 1 -- start start 2024-03-23T23:43:03.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.773+0000 7fbaefe00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbae8159860 0x7fbae80714f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:03.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.773+0000 7fbaefe00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae8159dd0 con 0x7fbae80c2390 2024-03-23T23:43:03.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.777+0000 7fbaefe00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae80701f0 con 0x7fbae8152ff0 2024-03-23T23:43:03.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.777+0000 7fbaefe00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbae80704d0 con 0x7fbae8159860 2024-03-23T23:43:03.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.777+0000 7fbaed400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fbae8152ff0 0x7fbae806ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:59928/0 (socket says 172.21.15.8:59928) 2024-03-23T23:43:03.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.777+0000 7fbaede00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fbae80c2390 0x7fbae81601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:45414/0 (socket says 172.21.15.8:45414) 2024-03-23T23:43:03.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.777+0000 7fbaed400640 1 -- 172.21.15.8:0/902083245 learned_addr learned my addr 172.21.15.8:0/902083245 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:43:03.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.777+0000 7fbaeca00640 1 --2- 172.21.15.8:0/902083245 >> v2:172.21.15.196:3300/0 conn(0x7fbae8159860 0x7fbae80714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:03.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.777+0000 7fbae7e00640 1 -- 172.21.15.8:0/902083245 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 442009909 0 0) 0x7fbae80701f0 con 0x7fbae8152ff0 2024-03-23T23:43:03.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.777+0000 7fbae7e00640 1 -- 172.21.15.8:0/902083245 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbad0003530 con 0x7fbae8152ff0 2024-03-23T23:43:03.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.777+0000 7fbae7e00640 1 -- 172.21.15.8:0/902083245 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2025230291 0 0) 0x7fbae8159dd0 con 0x7fbae80c2390 2024-03-23T23:43:03.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.777+0000 7fbae7e00640 1 -- 172.21.15.8:0/902083245 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbae80701f0 con 0x7fbae80c2390 2024-03-23T23:43:03.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.777+0000 7fbaeca00640 1 -- 172.21.15.8:0/902083245 >> v1:172.21.15.196:6789/0 conn(0x7fbae8152ff0 legacy=0x7fbae806ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:03.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.777+0000 7fbaeca00640 1 -- 172.21.15.8:0/902083245 >> v1:172.21.15.8:6789/0 conn(0x7fbae80c2390 legacy=0x7fbae81601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:03.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.777+0000 7fbaeca00640 1 -- 172.21.15.8:0/902083245 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae80707b0 con 0x7fbae8159860 2024-03-23T23:43:03.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.781+0000 7fbaeca00640 1 --2- 172.21.15.8:0/902083245 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbae8159860 0x7fbae80714f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbad40097c0 tx=0x7fbad401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98430c0e5292634 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:03.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.781+0000 7fbae7e00640 1 -- 172.21.15.8:0/902083245 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad40b0070 con 0x7fbae8159860 2024-03-23T23:43:03.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.781+0000 7fbae7e00640 1 -- 172.21.15.8:0/902083245 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad40ab600 con 0x7fbae8159860 2024-03-23T23:43:03.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.781+0000 7fbae7e00640 1 -- 172.21.15.8:0/902083245 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad40ab9d0 con 0x7fbae8159860 2024-03-23T23:43:03.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.781+0000 7fbaefe00640 1 -- 172.21.15.8:0/902083245 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbae8159860 msgr2=0x7fbae80714f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:03.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.781+0000 7fbaefe00640 1 --2- 172.21.15.8:0/902083245 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbae8159860 0x7fbae80714f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbad40097c0 tx=0x7fbad401c410 comp rx=0 tx=0).stop 2024-03-23T23:43:03.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.781+0000 7fbaefe00640 1 -- 172.21.15.8:0/902083245 shutdown_connections 2024-03-23T23:43:03.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.781+0000 7fbaefe00640 1 --2- 172.21.15.8:0/902083245 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbae8159860 0x7fbae80714f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:03.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.781+0000 7fbaefe00640 1 -- 172.21.15.8:0/902083245 >> 172.21.15.8:0/902083245 conn(0x7fbae80aad10 msgr2=0x7fbae80ab120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:03.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.781+0000 7fbaefe00640 1 -- 172.21.15.8:0/902083245 shutdown_connections 2024-03-23T23:43:03.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.781+0000 7fbaefe00640 1 -- 172.21.15.8:0/902083245 wait complete. 2024-03-23T23:43:03.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.785+0000 7fbaefe00640 1 Processor -- start 2024-03-23T23:43:03.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.785+0000 7fbaefe00640 1 -- start start 2024-03-23T23:43:03.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.785+0000 7fbaefe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbae80c2390 0x7fbae814a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:03.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.785+0000 7fbaefe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbae8152ff0 0x7fbae814e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:03.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.785+0000 7fbaefe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbae8159860 0x7fbae814e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:03.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.785+0000 7fbaefe00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae806f4e0 con 0x7fbae8159860 2024-03-23T23:43:03.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.785+0000 7fbaefe00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae806f360 con 0x7fbae80c2390 2024-03-23T23:43:03.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.785+0000 7fbaefe00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae80c7420 con 0x7fbae8152ff0 2024-03-23T23:43:03.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.785+0000 7fbaede00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbae8159860 0x7fbae814e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:03.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.785+0000 7fbaed400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbae80c2390 0x7fbae814a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:03.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.785+0000 7fbaeca00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbae8152ff0 0x7fbae814e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:03.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.785+0000 7fbaede00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbae8159860 0x7fbae814e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60126/0 (socket says 172.21.15.8:60126) 2024-03-23T23:43:03.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.785+0000 7fbaede00640 1 -- 172.21.15.8:0/1397767621 learned_addr learned my addr 172.21.15.8:0/1397767621 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:03.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.785+0000 7fbaede00640 1 -- 172.21.15.8:0/1397767621 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbae8152ff0 msgr2=0x7fbae814e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:03.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.785+0000 7fbaede00640 1 --2- 172.21.15.8:0/1397767621 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbae8152ff0 0x7fbae814e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:03.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.785+0000 7fbaede00640 1 -- 172.21.15.8:0/1397767621 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbae80c2390 msgr2=0x7fbae814a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:03.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.785+0000 7fbaede00640 1 --2- 172.21.15.8:0/1397767621 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbae80c2390 0x7fbae814a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:03.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.785+0000 7fbaede00640 1 -- 172.21.15.8:0/1397767621 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae81522e0 con 0x7fbae8159860 2024-03-23T23:43:03.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.785+0000 7fbaede00640 1 --2- 172.21.15.8:0/1397767621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbae8159860 0x7fbae814e8f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbae000c7a0 tx=0x7fbae000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:03.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.785+0000 7fbae5600640 1 -- 172.21.15.8:0/1397767621 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae0017070 con 0x7fbae8159860 2024-03-23T23:43:03.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.785+0000 7fbae5600640 1 -- 172.21.15.8:0/1397767621 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae000a640 con 0x7fbae8159860 2024-03-23T23:43:03.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.785+0000 7fbaefe00640 1 -- 172.21.15.8:0/1397767621 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae80acf50 con 0x7fbae8159860 2024-03-23T23:43:03.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.785+0000 7fbae5600640 1 -- 172.21.15.8:0/1397767621 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae000a9f0 con 0x7fbae8159860 2024-03-23T23:43:03.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.785+0000 7fbaefe00640 1 -- 172.21.15.8:0/1397767621 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae814aac0 con 0x7fbae8159860 2024-03-23T23:43:03.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.785+0000 7fbaefe00640 1 -- 172.21.15.8:0/1397767621 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbae804f410 con 0x7fbae8159860 2024-03-23T23:43:03.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.789+0000 7fbae5600640 1 -- 172.21.15.8:0/1397767621 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fbae001a070 con 0x7fbae8159860 2024-03-23T23:43:03.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.789+0000 7fbae5600640 1 --2- 172.21.15.8:0/1397767621 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbac8067660 0x7fbac8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:03.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.789+0000 7fbae5600640 1 -- 172.21.15.8:0/1397767621 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fbae00851e0 con 0x7fbae8159860 2024-03-23T23:43:03.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.789+0000 7fbaed400640 1 --2- 172.21.15.8:0/1397767621 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbac8067660 0x7fbac8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:03.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.789+0000 7fbaed400640 1 --2- 172.21.15.8:0/1397767621 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbac8067660 0x7fbac8069b20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbadc007fd0 tx=0x7fbadc007d60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:03.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.793+0000 7fbae5600640 1 -- 172.21.15.8:0/1397767621 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fbae0055450 con 0x7fbae8159860 2024-03-23T23:43:03.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.957+0000 7fbaefe00640 1 -- 172.21.15.8:0/1397767621 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) v1 -- 0x7fbae80c8d40 con 0x7fbae8159860 2024-03-23T23:43:03.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.957+0000 7fbae5600640 1 -- 172.21.15.8:0/1397767621 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v25) v1 ==== 95+0+11 (secure 0 0 0) 0x7fbae00594f0 con 0x7fbae8159860 2024-03-23T23:43:03.958 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-03-23T23:43:03.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.957+0000 7fbaefe00640 1 -- 172.21.15.8:0/1397767621 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbac8067660 msgr2=0x7fbac8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:03.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.957+0000 7fbaefe00640 1 --2- 172.21.15.8:0/1397767621 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbac8067660 0x7fbac8069b20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbadc007fd0 tx=0x7fbadc007d60 comp rx=0 tx=0).stop 2024-03-23T23:43:03.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.957+0000 7fbaefe00640 1 -- 172.21.15.8:0/1397767621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbae8159860 msgr2=0x7fbae814e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:03.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.957+0000 7fbaefe00640 1 --2- 172.21.15.8:0/1397767621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbae8159860 0x7fbae814e8f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbae000c7a0 tx=0x7fbae000cc60 comp rx=0 tx=0).stop 2024-03-23T23:43:03.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.957+0000 7fbaefe00640 1 -- 172.21.15.8:0/1397767621 shutdown_connections 2024-03-23T23:43:03.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.957+0000 7fbaefe00640 1 --2- 172.21.15.8:0/1397767621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbae8159860 0x7fbae814e8f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:03.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.957+0000 7fbaefe00640 1 --2- 172.21.15.8:0/1397767621 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbac8067660 0x7fbac8069b20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:03.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.957+0000 7fbaefe00640 1 --2- 172.21.15.8:0/1397767621 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbae8152ff0 0x7fbae814e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:03.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.957+0000 7fbaefe00640 1 --2- 172.21.15.8:0/1397767621 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbae80c2390 0x7fbae814a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:03.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.957+0000 7fbaefe00640 1 -- 172.21.15.8:0/1397767621 >> 172.21.15.8:0/1397767621 conn(0x7fbae80aad10 msgr2=0x7fbae806ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:03.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.957+0000 7fbaefe00640 1 -- 172.21.15.8:0/1397767621 shutdown_connections 2024-03-23T23:43:03.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:03.957+0000 7fbaefe00640 1 -- 172.21.15.8:0/1397767621 wait complete. 2024-03-23T23:43:03.979 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T23:43:04.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.121+0000 7fbca1200640 1 Processor -- start 2024-03-23T23:43:04.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.121+0000 7fbca1200640 1 -- start start 2024-03-23T23:43:04.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.121+0000 7fbca1200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbc9c155610 0x7fbc9c160f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:04.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.121+0000 7fbca1200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc9c155bb0 con 0x7fbc9c153060 2024-03-23T23:43:04.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.121+0000 7fbca1200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc9c155e90 con 0x7fbc9c06c3e0 2024-03-23T23:43:04.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.121+0000 7fbca1200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc9c156170 con 0x7fbc9c155610 2024-03-23T23:43:04.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.121+0000 7fbc9be00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbc9c155610 0x7fbc9c160f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:04.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.121+0000 7fbc92a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fbc9c153060 0x7fbc9c159100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:45418/0 (socket says 172.21.15.8:45418) 2024-03-23T23:43:04.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.121+0000 7fbc92a00640 1 -- 172.21.15.8:0/2303193909 learned_addr learned my addr 172.21.15.8:0/2303193909 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:43:04.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.121+0000 7fbc9b400640 1 --1- 172.21.15.8:0/2303193909 >> v1:172.21.15.196:6789/0 conn(0x7fbc9c06c3e0 0x7fbc9c152950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:59938/0 (socket says 172.21.15.8:59938) 2024-03-23T23:43:04.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.121+0000 7fbc9be00640 1 -- 172.21.15.8:0/2303193909 >> v1:172.21.15.196:6789/0 conn(0x7fbc9c06c3e0 legacy=0x7fbc9c152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:04.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.121+0000 7fbc9be00640 1 -- 172.21.15.8:0/2303193909 >> v1:172.21.15.8:6789/0 conn(0x7fbc9c153060 legacy=0x7fbc9c159100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:04.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.121+0000 7fbc9aa00640 1 -- 172.21.15.8:0/2303193909 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2217393661 0 0) 0x7fbc9c155e90 con 0x7fbc9c06c3e0 2024-03-23T23:43:04.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.121+0000 7fbc9be00640 1 -- 172.21.15.8:0/2303193909 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9c156450 con 0x7fbc9c155610 2024-03-23T23:43:04.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.125+0000 7fbc9be00640 1 --2- 172.21.15.8:0/2303193909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc9c155610 0x7fbc9c160f80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbc940097c0 tx=0x7fbc9401c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba3e5dcfc0138f2 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:04.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.125+0000 7fbc9aa00640 1 -- 172.21.15.8:0/2303193909 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc940b0070 con 0x7fbc9c155610 2024-03-23T23:43:04.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.125+0000 7fbc9aa00640 1 -- 172.21.15.8:0/2303193909 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc940ab600 con 0x7fbc9c155610 2024-03-23T23:43:04.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.125+0000 7fbc9aa00640 1 -- 172.21.15.8:0/2303193909 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc940ab9d0 con 0x7fbc9c155610 2024-03-23T23:43:04.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.125+0000 7fbca1200640 1 -- 172.21.15.8:0/2303193909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc9c155610 msgr2=0x7fbc9c160f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:04.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.125+0000 7fbca1200640 1 --2- 172.21.15.8:0/2303193909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc9c155610 0x7fbc9c160f80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbc940097c0 tx=0x7fbc9401c270 comp rx=0 tx=0).stop 2024-03-23T23:43:04.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.125+0000 7fbca1200640 1 -- 172.21.15.8:0/2303193909 shutdown_connections 2024-03-23T23:43:04.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.125+0000 7fbca1200640 1 --2- 172.21.15.8:0/2303193909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc9c155610 0x7fbc9c160f80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:04.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.125+0000 7fbca1200640 1 -- 172.21.15.8:0/2303193909 >> 172.21.15.8:0/2303193909 conn(0x7fbc9c0c7fa0 msgr2=0x7fbc9c0c4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:04.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.125+0000 7fbca1200640 1 -- 172.21.15.8:0/2303193909 shutdown_connections 2024-03-23T23:43:04.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.125+0000 7fbca1200640 1 -- 172.21.15.8:0/2303193909 wait complete. 2024-03-23T23:43:04.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.125+0000 7fbca1200640 1 Processor -- start 2024-03-23T23:43:04.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.125+0000 7fbca1200640 1 -- start start 2024-03-23T23:43:04.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.129+0000 7fbca1200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbc9c06c3e0 0x7fbc9c0c0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:04.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.129+0000 7fbca1200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbc9c153060 0x7fbc9c147f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:04.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.129+0000 7fbca1200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc9c155610 0x7fbc9c148440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:04.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.129+0000 7fbca1200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c06c940 con 0x7fbc9c155610 2024-03-23T23:43:04.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.129+0000 7fbca1200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c06c7c0 con 0x7fbc9c06c3e0 2024-03-23T23:43:04.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.129+0000 7fbca1200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c163ce0 con 0x7fbc9c153060 2024-03-23T23:43:04.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.129+0000 7fbc9be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc9c155610 0x7fbc9c148440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:04.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.129+0000 7fbc9be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc9c155610 0x7fbc9c148440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60138/0 (socket says 172.21.15.8:60138) 2024-03-23T23:43:04.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.129+0000 7fbc9be00640 1 -- 172.21.15.8:0/2526240487 learned_addr learned my addr 172.21.15.8:0/2526240487 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:04.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.129+0000 7fbc9b400640 1 --2- 172.21.15.8:0/2526240487 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbc9c06c3e0 0x7fbc9c0c0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:04.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.129+0000 7fbc92a00640 1 --2- 172.21.15.8:0/2526240487 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbc9c153060 0x7fbc9c147f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:04.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.129+0000 7fbc9be00640 1 -- 172.21.15.8:0/2526240487 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbc9c153060 msgr2=0x7fbc9c147f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:04.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.129+0000 7fbc9be00640 1 --2- 172.21.15.8:0/2526240487 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbc9c153060 0x7fbc9c147f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:04.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.129+0000 7fbc9be00640 1 -- 172.21.15.8:0/2526240487 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbc9c06c3e0 msgr2=0x7fbc9c0c0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:04.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.129+0000 7fbc9be00640 1 --2- 172.21.15.8:0/2526240487 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbc9c06c3e0 0x7fbc9c0c0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:04.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.129+0000 7fbc9be00640 1 -- 172.21.15.8:0/2526240487 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9c14f430 con 0x7fbc9c155610 2024-03-23T23:43:04.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.129+0000 7fbc9be00640 1 --2- 172.21.15.8:0/2526240487 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc9c155610 0x7fbc9c148440 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbc940ae040 tx=0x7fbc9401aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:04.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.129+0000 7fbc93e00640 1 -- 172.21.15.8:0/2526240487 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc940bb070 con 0x7fbc9c155610 2024-03-23T23:43:04.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.129+0000 7fbc93e00640 1 -- 172.21.15.8:0/2526240487 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc94004020 con 0x7fbc9c155610 2024-03-23T23:43:04.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.129+0000 7fbca1200640 1 -- 172.21.15.8:0/2526240487 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc9c148980 con 0x7fbc9c155610 2024-03-23T23:43:04.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.129+0000 7fbc93e00640 1 -- 172.21.15.8:0/2526240487 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc940b0040 con 0x7fbc9c155610 2024-03-23T23:43:04.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.129+0000 7fbca1200640 1 -- 172.21.15.8:0/2526240487 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc9c0aad80 con 0x7fbc9c155610 2024-03-23T23:43:04.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.129+0000 7fbca1200640 1 -- 172.21.15.8:0/2526240487 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc9c04f410 con 0x7fbc9c155610 2024-03-23T23:43:04.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.133+0000 7fbc93e00640 1 -- 172.21.15.8:0/2526240487 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fbc94003620 con 0x7fbc9c155610 2024-03-23T23:43:04.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.133+0000 7fbc93e00640 1 --2- 172.21.15.8:0/2526240487 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbc78067690 0x7fbc78069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:04.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.133+0000 7fbc93e00640 1 -- 172.21.15.8:0/2526240487 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fbc94120070 con 0x7fbc9c155610 2024-03-23T23:43:04.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.133+0000 7fbc9b400640 1 --2- 172.21.15.8:0/2526240487 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbc78067690 0x7fbc78069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:04.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.133+0000 7fbc9b400640 1 --2- 172.21.15.8:0/2526240487 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbc78067690 0x7fbc78069b50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c000f70 tx=0x7fbc8c007e50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:04.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.137+0000 7fbc93e00640 1 -- 172.21.15.8:0/2526240487 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fbc94015fb0 con 0x7fbc9c155610 2024-03-23T23:43:04.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.333+0000 7fbca1200640 1 -- 172.21.15.8:0/2526240487 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc9c0c1640 con 0x7fbc9c155610 2024-03-23T23:43:04.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.337+0000 7fbc93e00640 1 -- 172.21.15.8:0/2526240487 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6245 (secure 0 0 0) 0x7fbc940f0500 con 0x7fbc9c155610 2024-03-23T23:43:04.337 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:43:04.337 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6836/3149325777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3149325777},{"type":"v1","addr":"172.21.15.196:6836","nonce":3149325777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6833/1542162403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1542162403},{"type":"v1","addr":"172.21.15.8:6833","nonce":1542162403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T23:42:40.070799+0000","modified":"2024-03-23T23:42:44.080269+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6837/3402347550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":3402347550},{"type":"v1","addr":"172.21.15.196:6837","nonce":3402347550}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T23:42:50.113972+0000","modified":"2024-03-23T23:42:54.152778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.8:6835/3531853933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3531853933},{"type":"v1","addr":"172.21.15.8:6835","nonce":3531853933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4269,"qdb_cluster":[4269]},"id":2}]} 2024-03-23T23:43:04.338 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 15 2024-03-23T23:43:04.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.337+0000 7fbca1200640 1 -- 172.21.15.8:0/2526240487 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbc78067690 msgr2=0x7fbc78069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:04.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.337+0000 7fbca1200640 1 --2- 172.21.15.8:0/2526240487 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbc78067690 0x7fbc78069b50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c000f70 tx=0x7fbc8c007e50 comp rx=0 tx=0).stop 2024-03-23T23:43:04.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.337+0000 7fbca1200640 1 -- 172.21.15.8:0/2526240487 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc9c155610 msgr2=0x7fbc9c148440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:04.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.337+0000 7fbca1200640 1 --2- 172.21.15.8:0/2526240487 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc9c155610 0x7fbc9c148440 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbc940ae040 tx=0x7fbc9401aab0 comp rx=0 tx=0).stop 2024-03-23T23:43:04.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.337+0000 7fbca1200640 1 -- 172.21.15.8:0/2526240487 shutdown_connections 2024-03-23T23:43:04.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.337+0000 7fbca1200640 1 --2- 172.21.15.8:0/2526240487 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc9c155610 0x7fbc9c148440 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:04.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.337+0000 7fbca1200640 1 --2- 172.21.15.8:0/2526240487 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbc78067690 0x7fbc78069b50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:04.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.337+0000 7fbca1200640 1 --2- 172.21.15.8:0/2526240487 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbc9c153060 0x7fbc9c147f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:04.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.337+0000 7fbca1200640 1 --2- 172.21.15.8:0/2526240487 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbc9c06c3e0 0x7fbc9c0c0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:04.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.337+0000 7fbca1200640 1 -- 172.21.15.8:0/2526240487 >> 172.21.15.8:0/2526240487 conn(0x7fbc9c0c7fa0 msgr2=0x7fbc9c159100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:04.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.337+0000 7fbca1200640 1 -- 172.21.15.8:0/2526240487 shutdown_connections 2024-03-23T23:43:04.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.337+0000 7fbca1200640 1 -- 172.21.15.8:0/2526240487 wait complete. 2024-03-23T23:43:04.358 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:43:04.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.497+0000 7fb4fb400640 1 Processor -- start 2024-03-23T23:43:04.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.497+0000 7fb4fb400640 1 -- start start 2024-03-23T23:43:04.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.497+0000 7fb4fb400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb4f4070b50 0x7fb4f41541b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:04.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.497+0000 7fb4fb400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4f40c5560 0x7fb4f406ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:04.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.497+0000 7fb4fb400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f41546f0 con 0x7fb4f414d8b0 2024-03-23T23:43:04.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.497+0000 7fb4fb400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f40c4830 con 0x7fb4f4070b50 2024-03-23T23:43:04.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.497+0000 7fb4fb400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f40c50d0 con 0x7fb4f40c5560 2024-03-23T23:43:04.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.501+0000 7fb4f3e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb4f4070b50 0x7fb4f41541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:04.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.501+0000 7fb4f9400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4f40c5560 0x7fb4f406ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:04.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.501+0000 7fb4f8a00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fb4f414d8b0 0x7fb4f40c7130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:59954/0 (socket says 172.21.15.8:59954) 2024-03-23T23:43:04.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.501+0000 7fb4f8a00640 1 -- 172.21.15.8:0/299480816 learned_addr learned my addr 172.21.15.8:0/299480816 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:43:04.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.501+0000 7fb4f3400640 1 -- 172.21.15.8:0/299480816 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1761145569 0 0) 0x7fb4e8001120 con 0x7fb4f414d8b0 2024-03-23T23:43:04.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.501+0000 7fb4f3400640 1 -- 172.21.15.8:0/299480816 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4dc003530 con 0x7fb4f414d8b0 2024-03-23T23:43:04.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.501+0000 7fb4f9400640 1 -- 172.21.15.8:0/299480816 >> v2:172.21.15.196:3300/0 conn(0x7fb4f4070b50 msgr2=0x7fb4f41541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:04.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.501+0000 7fb4f9400640 1 --2- 172.21.15.8:0/299480816 >> v2:172.21.15.196:3300/0 conn(0x7fb4f4070b50 0x7fb4f41541b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:04.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.501+0000 7fb4f9400640 1 -- 172.21.15.8:0/299480816 >> v1:172.21.15.196:6789/0 conn(0x7fb4f414d8b0 legacy=0x7fb4f40c7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:04.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.501+0000 7fb4f9400640 1 -- 172.21.15.8:0/299480816 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f40710e0 con 0x7fb4f40c5560 2024-03-23T23:43:04.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.501+0000 7fb4f3e00640 1 --2- 172.21.15.8:0/299480816 >> v2:172.21.15.196:3300/0 conn(0x7fb4f4070b50 0x7fb4f41541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:43:04.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.501+0000 7fb4f9400640 1 --2- 172.21.15.8:0/299480816 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4f40c5560 0x7fb4f406ed00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec009d90 tx=0x7fb4ec01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=257d97551abee753 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:04.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.501+0000 7fb4f3400640 1 -- 172.21.15.8:0/299480816 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec0b2070 con 0x7fb4f40c5560 2024-03-23T23:43:04.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.501+0000 7fb4f3400640 1 -- 172.21.15.8:0/299480816 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4ec0a5830 con 0x7fb4f40c5560 2024-03-23T23:43:04.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.501+0000 7fb4f3400640 1 -- 172.21.15.8:0/299480816 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec0a5c00 con 0x7fb4f40c5560 2024-03-23T23:43:04.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.505+0000 7fb4fb400640 1 -- 172.21.15.8:0/299480816 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4f40c5560 msgr2=0x7fb4f406ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:04.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.505+0000 7fb4fb400640 1 --2- 172.21.15.8:0/299480816 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4f40c5560 0x7fb4f406ed00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec009d90 tx=0x7fb4ec01c970 comp rx=0 tx=0).stop 2024-03-23T23:43:04.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.505+0000 7fb4fb400640 1 -- 172.21.15.8:0/299480816 shutdown_connections 2024-03-23T23:43:04.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.505+0000 7fb4fb400640 1 --2- 172.21.15.8:0/299480816 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4f40c5560 0x7fb4f406ed00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:04.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.505+0000 7fb4fb400640 1 --2- 172.21.15.8:0/299480816 >> v2:172.21.15.196:3300/0 conn(0x7fb4f4070b50 0x7fb4f41541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:04.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.505+0000 7fb4fb400640 1 -- 172.21.15.8:0/299480816 >> 172.21.15.8:0/299480816 conn(0x7fb4f40aafe0 msgr2=0x7fb4f40ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:04.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.505+0000 7fb4fb400640 1 -- 172.21.15.8:0/299480816 shutdown_connections 2024-03-23T23:43:04.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.505+0000 7fb4fb400640 1 -- 172.21.15.8:0/299480816 wait complete. 2024-03-23T23:43:04.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.505+0000 7fb4fb400640 1 Processor -- start 2024-03-23T23:43:04.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.505+0000 7fb4fb400640 1 -- start start 2024-03-23T23:43:04.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.505+0000 7fb4fb400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb4f4070b50 0x7fb4f41eef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:04.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.505+0000 7fb4fb400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4f40c5560 0x7fb4f414b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:04.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.505+0000 7fb4fb400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4f414d8b0 0x7fb4f41f2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:04.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.505+0000 7fb4fb400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f4160a50 con 0x7fb4f414d8b0 2024-03-23T23:43:04.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.505+0000 7fb4fb400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f41608d0 con 0x7fb4f4070b50 2024-03-23T23:43:04.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.505+0000 7fb4fb400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f4160bd0 con 0x7fb4f40c5560 2024-03-23T23:43:04.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.505+0000 7fb4f9400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4f414d8b0 0x7fb4f41f2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:04.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.505+0000 7fb4f8a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb4f4070b50 0x7fb4f41eef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:04.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.505+0000 7fb4f3e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4f40c5560 0x7fb4f414b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:04.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.505+0000 7fb4f9400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4f414d8b0 0x7fb4f41f2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60150/0 (socket says 172.21.15.8:60150) 2024-03-23T23:43:04.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.505+0000 7fb4f9400640 1 -- 172.21.15.8:0/3622557639 learned_addr learned my addr 172.21.15.8:0/3622557639 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:04.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.505+0000 7fb4f9400640 1 -- 172.21.15.8:0/3622557639 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4f40c5560 msgr2=0x7fb4f414b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:04.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.505+0000 7fb4f9400640 1 --2- 172.21.15.8:0/3622557639 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4f40c5560 0x7fb4f414b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:04.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.505+0000 7fb4f9400640 1 -- 172.21.15.8:0/3622557639 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb4f4070b50 msgr2=0x7fb4f41eef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:04.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.505+0000 7fb4f9400640 1 --2- 172.21.15.8:0/3622557639 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb4f4070b50 0x7fb4f41eef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:04.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.505+0000 7fb4f9400640 1 -- 172.21.15.8:0/3622557639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f41ef490 con 0x7fb4f414d8b0 2024-03-23T23:43:04.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.505+0000 7fb4f8a00640 1 --2- 172.21.15.8:0/3622557639 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb4f4070b50 0x7fb4f41eef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:43:04.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.509+0000 7fb4f9400640 1 --2- 172.21.15.8:0/3622557639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4f414d8b0 0x7fb4f41f2460 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec01b020 tx=0x7fb4ec019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:04.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.509+0000 7fb4f0c00640 1 -- 172.21.15.8:0/3622557639 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec0bd020 con 0x7fb4f414d8b0 2024-03-23T23:43:04.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.509+0000 7fb4f0c00640 1 -- 172.21.15.8:0/3622557639 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4ec0b8470 con 0x7fb4f414d8b0 2024-03-23T23:43:04.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.509+0000 7fb4f0c00640 1 -- 172.21.15.8:0/3622557639 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec0b2040 con 0x7fb4f414d8b0 2024-03-23T23:43:04.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.509+0000 7fb4fb400640 1 -- 172.21.15.8:0/3622557639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f4156bf0 con 0x7fb4f414d8b0 2024-03-23T23:43:04.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.509+0000 7fb4fb400640 1 -- 172.21.15.8:0/3622557639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f4157170 con 0x7fb4f414d8b0 2024-03-23T23:43:04.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.509+0000 7fb4fb400640 1 -- 172.21.15.8:0/3622557639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f4068270 con 0x7fb4f414d8b0 2024-03-23T23:43:04.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.509+0000 7fb4f0c00640 1 -- 172.21.15.8:0/3622557639 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb4ec0c0020 con 0x7fb4f414d8b0 2024-03-23T23:43:04.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.509+0000 7fb4f0c00640 1 --2- 172.21.15.8:0/3622557639 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb4d4067690 0x7fb4d4069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:04.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.509+0000 7fb4f0c00640 1 -- 172.21.15.8:0/3622557639 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fb4ec1207c0 con 0x7fb4f414d8b0 2024-03-23T23:43:04.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.509+0000 7fb4f8a00640 1 --2- 172.21.15.8:0/3622557639 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb4d4067690 0x7fb4d4069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:04.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.513+0000 7fb4f8a00640 1 --2- 172.21.15.8:0/3622557639 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb4d4067690 0x7fb4d4069b50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8007fd0 tx=0x7fb4e8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:04.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.513+0000 7fb4f0c00640 1 -- 172.21.15.8:0/3622557639 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fb4ec0c7030 con 0x7fb4f414d8b0 2024-03-23T23:43:04.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.677+0000 7fb4fb400640 1 -- 172.21.15.8:0/3622557639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4f40c3c30 con 0x7fb4f414d8b0 2024-03-23T23:43:04.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.681+0000 7fb4f0c00640 1 -- 172.21.15.8:0/3622557639 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20271 (secure 0 0 0) 0x7fb4f41ef490 con 0x7fb4f414d8b0 2024-03-23T23:43:04.681 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:43:04.681 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":25,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","created":"2024-03-23T23:42:15.169430+0000","modified":"2024-03-23T23:42:51.739271+0000","last_up_change":"2024-03-23T23:42:26.509742+0000","last_in_change":"2024-03-23T23:42:17.662330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:42:26.327445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-23T23:42:38.218800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-23T23:42:39.054195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-23T23:42:48.327799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-23T23:42:49.113061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e967bf31-21d6-4d11-bc3d-0df8177a1b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6809","nonce":2187201732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6811","nonce":2187201732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6815","nonce":2187201732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6813","nonce":2187201732}]},"public_addr":"172.21.15.8:6809/2187201732","cluster_addr":"172.21.15.8:6811/2187201732","heartbeat_back_addr":"172.21.15.8:6815/2187201732","heartbeat_front_addr":"172.21.15.8:6813/2187201732","state":["exists","up"]},{"osd":1,"uuid":"c8e33701-7acd-4474-8402-d52461171fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6818","nonce":3205168010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6822","nonce":3205168010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6830","nonce":3205168010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6826","nonce":3205168010}]},"public_addr":"172.21.15.8:6818/3205168010","cluster_addr":"172.21.15.8:6822/3205168010","heartbeat_back_addr":"172.21.15.8:6830/3205168010","heartbeat_front_addr":"172.21.15.8:6826/3205168010","state":["exists","up"]},{"osd":2,"uuid":"ceebdbf7-4c2f-4757-b52d-fd8b20e77570","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6801","nonce":475463656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6803","nonce":475463656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6807","nonce":475463656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6805","nonce":475463656}]},"public_addr":"172.21.15.8:6801/475463656","cluster_addr":"172.21.15.8:6803/475463656","heartbeat_back_addr":"172.21.15.8:6807/475463656","heartbeat_front_addr":"172.21.15.8:6805/475463656","state":["exists","up"]},{"osd":3,"uuid":"89e258da-5767-429e-8441-edf877d2f3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6819","nonce":1514082871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6821","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6823","nonce":1514082871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6829","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6831","nonce":1514082871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6825","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6827","nonce":1514082871}]},"public_addr":"172.21.15.8:6819/1514082871","cluster_addr":"172.21.15.8:6823/1514082871","heartbeat_back_addr":"172.21.15.8:6831/1514082871","heartbeat_front_addr":"172.21.15.8:6827/1514082871","state":["exists","up"]},{"osd":4,"uuid":"2b7451ae-ea16-4f0a-ae50-04fde75e45ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6825","nonce":3516578147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6827","nonce":3516578147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6831","nonce":3516578147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6829","nonce":3516578147}]},"public_addr":"172.21.15.196:6825/3516578147","cluster_addr":"172.21.15.196:6827/3516578147","heartbeat_back_addr":"172.21.15.196:6831/3516578147","heartbeat_front_addr":"172.21.15.196:6829/3516578147","state":["exists","up"]},{"osd":5,"uuid":"e68a8914-e591-466a-bc9e-f2d7c67aac13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6802","nonce":830595758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6806","nonce":830595758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6814","nonce":830595758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6810","nonce":830595758}]},"public_addr":"172.21.15.196:6802/830595758","cluster_addr":"172.21.15.196:6806/830595758","heartbeat_back_addr":"172.21.15.196:6814/830595758","heartbeat_front_addr":"172.21.15.196:6810/830595758","state":["exists","up"]},{"osd":6,"uuid":"e47723c5-50a0-4cd8-92d9-01972072b422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6801","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6803","nonce":472639906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6805","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6807","nonce":472639906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6815","nonce":472639906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6811","nonce":472639906}]},"public_addr":"172.21.15.196:6803/472639906","cluster_addr":"172.21.15.196:6807/472639906","heartbeat_back_addr":"172.21.15.196:6815/472639906","heartbeat_front_addr":"172.21.15.196:6811/472639906","state":["exists","up"]},{"osd":7,"uuid":"e1e9113d-8005-47b3-9a75-9e701199f1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6817","nonce":4151820349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6819","nonce":4151820349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6823","nonce":4151820349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6821","nonce":4151820349}]},"public_addr":"172.21.15.196:6817/4151820349","cluster_addr":"172.21.15.196:6819/4151820349","heartbeat_back_addr":"172.21.15.196:6823/4151820349","heartbeat_front_addr":"172.21.15.196:6821/4151820349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.221790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.265974+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.190319+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.376359+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.329657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.402958+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.300703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.133121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:43:04.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.681+0000 7fb4fb400640 1 -- 172.21.15.8:0/3622557639 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb4d4067690 msgr2=0x7fb4d4069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:04.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.681+0000 7fb4fb400640 1 --2- 172.21.15.8:0/3622557639 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb4d4067690 0x7fb4d4069b50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8007fd0 tx=0x7fb4e8009040 comp rx=0 tx=0).stop 2024-03-23T23:43:04.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.681+0000 7fb4fb400640 1 -- 172.21.15.8:0/3622557639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4f414d8b0 msgr2=0x7fb4f41f2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:04.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.681+0000 7fb4fb400640 1 --2- 172.21.15.8:0/3622557639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4f414d8b0 0x7fb4f41f2460 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec01b020 tx=0x7fb4ec019710 comp rx=0 tx=0).stop 2024-03-23T23:43:04.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.681+0000 7fb4fb400640 1 -- 172.21.15.8:0/3622557639 shutdown_connections 2024-03-23T23:43:04.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.681+0000 7fb4fb400640 1 --2- 172.21.15.8:0/3622557639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4f414d8b0 0x7fb4f41f2460 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:04.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.681+0000 7fb4fb400640 1 --2- 172.21.15.8:0/3622557639 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb4d4067690 0x7fb4d4069b50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:04.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.681+0000 7fb4fb400640 1 --2- 172.21.15.8:0/3622557639 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4f40c5560 0x7fb4f414b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:04.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.681+0000 7fb4fb400640 1 --2- 172.21.15.8:0/3622557639 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb4f4070b50 0x7fb4f41eef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:04.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.681+0000 7fb4fb400640 1 -- 172.21.15.8:0/3622557639 >> 172.21.15.8:0/3622557639 conn(0x7fb4f40aafe0 msgr2=0x7fb4f40c6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:04.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.681+0000 7fb4fb400640 1 -- 172.21.15.8:0/3622557639 shutdown_connections 2024-03-23T23:43:04.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.681+0000 7fb4fb400640 1 -- 172.21.15.8:0/3622557639 wait complete. 2024-03-23T23:43:04.705 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-23T23:42:26.327445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-03-23T23:42:38.218800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-03-23T23:42:39.054195+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-03-23T23:42:48.327799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-03-23T23:42:49.113061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-23T23:43:04.706 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-23T23:43:04.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.849+0000 7f56a0800640 1 Processor -- start 2024-03-23T23:43:04.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.849+0000 7f56a0800640 1 -- start start 2024-03-23T23:43:04.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.853+0000 7f56a0800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56980c6e40 0x7f56980c2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:04.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.853+0000 7f56a0800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56981531f0 con 0x7f56980c2370 2024-03-23T23:43:04.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.853+0000 7f56a0800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56981559a0 con 0x7f569815e100 2024-03-23T23:43:04.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.853+0000 7f56a0800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569806d6a0 con 0x7f56980c6e40 2024-03-23T23:43:04.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.853+0000 7f569de00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f56980c2370 0x7f569806db30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:45434/0 (socket says 172.21.15.8:45434) 2024-03-23T23:43:04.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.853+0000 7f569de00640 1 -- 172.21.15.8:0/1596857171 learned_addr learned my addr 172.21.15.8:0/1596857171 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:43:04.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.853+0000 7f569d400640 1 --2- 172.21.15.8:0/1596857171 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56980c6e40 0x7f56980c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:04.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.853+0000 7f569ca00640 1 -- 172.21.15.8:0/1596857171 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 161079884 0 0) 0x7f56981531f0 con 0x7f56980c2370 2024-03-23T23:43:04.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.853+0000 7f569ca00640 1 -- 172.21.15.8:0/1596857171 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5680003530 con 0x7f56980c2370 2024-03-23T23:43:04.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.853+0000 7f569ca00640 1 -- 172.21.15.8:0/1596857171 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2540039272 0 0) 0x7f56981559a0 con 0x7f569815e100 2024-03-23T23:43:04.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.853+0000 7f569ca00640 1 -- 172.21.15.8:0/1596857171 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56981531f0 con 0x7f569815e100 2024-03-23T23:43:04.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.853+0000 7f569d400640 1 -- 172.21.15.8:0/1596857171 >> v1:172.21.15.196:6789/0 conn(0x7f569815e100 legacy=0x7f56981604f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:04.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.853+0000 7f569d400640 1 -- 172.21.15.8:0/1596857171 >> v1:172.21.15.8:6789/0 conn(0x7f56980c2370 legacy=0x7f569806db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:04.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.853+0000 7f569d400640 1 -- 172.21.15.8:0/1596857171 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569806d050 con 0x7f56980c6e40 2024-03-23T23:43:04.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.853+0000 7f569d400640 1 --2- 172.21.15.8:0/1596857171 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56980c6e40 0x7f56980c2750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f56880097f0 tx=0x7f568801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e088f3cafc5ad07c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:04.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.857+0000 7f569ca00640 1 -- 172.21.15.8:0/1596857171 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56880b2070 con 0x7f56980c6e40 2024-03-23T23:43:04.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.857+0000 7f569ca00640 1 -- 172.21.15.8:0/1596857171 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56880a9070 con 0x7f56980c6e40 2024-03-23T23:43:04.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.857+0000 7f569ca00640 1 -- 172.21.15.8:0/1596857171 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56880ad880 con 0x7f56980c6e40 2024-03-23T23:43:04.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.857+0000 7f56a0800640 1 -- 172.21.15.8:0/1596857171 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56980c6e40 msgr2=0x7f56980c2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:04.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.857+0000 7f56a0800640 1 --2- 172.21.15.8:0/1596857171 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56980c6e40 0x7f56980c2750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f56880097f0 tx=0x7f568801c450 comp rx=0 tx=0).stop 2024-03-23T23:43:04.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.857+0000 7f56a0800640 1 -- 172.21.15.8:0/1596857171 shutdown_connections 2024-03-23T23:43:04.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.857+0000 7f56a0800640 1 --2- 172.21.15.8:0/1596857171 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56980c6e40 0x7f56980c2750 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:04.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.857+0000 7f56a0800640 1 -- 172.21.15.8:0/1596857171 >> 172.21.15.8:0/1596857171 conn(0x7f56980aacf0 msgr2=0x7f56980ab100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:04.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.857+0000 7f56a0800640 1 -- 172.21.15.8:0/1596857171 shutdown_connections 2024-03-23T23:43:04.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.857+0000 7f56a0800640 1 -- 172.21.15.8:0/1596857171 wait complete. 2024-03-23T23:43:04.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.857+0000 7f56a0800640 1 Processor -- start 2024-03-23T23:43:04.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.857+0000 7f56a0800640 1 -- start start 2024-03-23T23:43:04.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.857+0000 7f56a0800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56980c2370 0x7f5698157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:04.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.857+0000 7f56a0800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56980c6e40 0x7f5698151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:04.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.857+0000 7f56a0800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f569815e100 0x7f569814fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:04.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.857+0000 7f56a0800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56980c8be0 con 0x7f56980c6e40 2024-03-23T23:43:04.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.857+0000 7f56a0800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56980ab810 con 0x7f569815e100 2024-03-23T23:43:04.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.857+0000 7f56a0800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56980c8360 con 0x7f56980c2370 2024-03-23T23:43:04.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.857+0000 7f569de00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56980c2370 0x7f5698157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:04.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.857+0000 7f569d400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56980c6e40 0x7f5698151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:04.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.857+0000 7f569d400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56980c6e40 0x7f5698151ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60158/0 (socket says 172.21.15.8:60158) 2024-03-23T23:43:04.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.857+0000 7f569de00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56980c2370 0x7f5698157fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:58406/0 (socket says 172.21.15.8:58406) 2024-03-23T23:43:04.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.857+0000 7f569d400640 1 -- 172.21.15.8:0/1844311435 learned_addr learned my addr 172.21.15.8:0/1844311435 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:04.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.857+0000 7f569e800640 1 --2- 172.21.15.8:0/1844311435 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f569815e100 0x7f569814fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:04.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.861+0000 7f569d400640 1 -- 172.21.15.8:0/1844311435 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56980c2370 msgr2=0x7f5698157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:04.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.861+0000 7f569d400640 1 --2- 172.21.15.8:0/1844311435 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56980c2370 0x7f5698157fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:04.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.861+0000 7f569d400640 1 -- 172.21.15.8:0/1844311435 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f569815e100 msgr2=0x7f569814fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:04.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.861+0000 7f569d400640 1 --2- 172.21.15.8:0/1844311435 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f569815e100 0x7f569814fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:04.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.861+0000 7f569d400640 1 -- 172.21.15.8:0/1844311435 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5698159660 con 0x7f56980c6e40 2024-03-23T23:43:04.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.861+0000 7f569d400640 1 --2- 172.21.15.8:0/1844311435 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56980c6e40 0x7f5698151ec0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f56880b0040 tx=0x7f56880191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:04.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.861+0000 7f5692000640 1 -- 172.21.15.8:0/1844311435 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56880b2040 con 0x7f56980c6e40 2024-03-23T23:43:04.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.861+0000 7f5692000640 1 -- 172.21.15.8:0/1844311435 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56880add30 con 0x7f56980c6e40 2024-03-23T23:43:04.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.861+0000 7f56a0800640 1 -- 172.21.15.8:0/1844311435 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5698159940 con 0x7f56980c6e40 2024-03-23T23:43:04.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.861+0000 7f5692000640 1 -- 172.21.15.8:0/1844311435 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56880b6630 con 0x7f56980c6e40 2024-03-23T23:43:04.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.861+0000 7f56a0800640 1 -- 172.21.15.8:0/1844311435 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5698158710 con 0x7f56980c6e40 2024-03-23T23:43:04.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.861+0000 7f56a0800640 1 -- 172.21.15.8:0/1844311435 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f569804f410 con 0x7f56980c6e40 2024-03-23T23:43:04.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.861+0000 7f5692000640 1 -- 172.21.15.8:0/1844311435 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f56880ab070 con 0x7f56980c6e40 2024-03-23T23:43:04.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.861+0000 7f5692000640 1 --2- 172.21.15.8:0/1844311435 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f567c067660 0x7f567c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:04.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.861+0000 7f5692000640 1 -- 172.21.15.8:0/1844311435 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f568811f0e0 con 0x7f56980c6e40 2024-03-23T23:43:04.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.865+0000 7f569de00640 1 --2- 172.21.15.8:0/1844311435 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f567c067660 0x7f567c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:04.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.865+0000 7f569de00640 1 --2- 172.21.15.8:0/1844311435 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f567c067660 0x7f567c069b20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f568c007fd0 tx=0x7f568c007d80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:04.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:04.869+0000 7f5692000640 1 -- 172.21.15.8:0/1844311435 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f56880160d0 con 0x7f56980c6e40 2024-03-23T23:43:05.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.029+0000 7f56a0800640 1 -- 172.21.15.8:0/1844311435 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f569806f0c0 con 0x7f56980c6e40 2024-03-23T23:43:05.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.029+0000 7f5692000640 1 -- 172.21.15.8:0/1844311435 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f56880ef3d0 con 0x7f56980c6e40 2024-03-23T23:43:05.032 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-03-23T23:43:05.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.033+0000 7f56a0800640 1 -- 172.21.15.8:0/1844311435 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f567c067660 msgr2=0x7f567c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:05.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.033+0000 7f56a0800640 1 --2- 172.21.15.8:0/1844311435 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f567c067660 0x7f567c069b20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f568c007fd0 tx=0x7f568c007d80 comp rx=0 tx=0).stop 2024-03-23T23:43:05.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.033+0000 7f56a0800640 1 -- 172.21.15.8:0/1844311435 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56980c6e40 msgr2=0x7f5698151ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:05.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.033+0000 7f56a0800640 1 --2- 172.21.15.8:0/1844311435 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56980c6e40 0x7f5698151ec0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f56880b0040 tx=0x7f56880191f0 comp rx=0 tx=0).stop 2024-03-23T23:43:05.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.033+0000 7f56a0800640 1 -- 172.21.15.8:0/1844311435 shutdown_connections 2024-03-23T23:43:05.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.033+0000 7f56a0800640 1 --2- 172.21.15.8:0/1844311435 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f569815e100 0x7f569814fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:05.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.033+0000 7f56a0800640 1 --2- 172.21.15.8:0/1844311435 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56980c6e40 0x7f5698151ec0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:05.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.033+0000 7f56a0800640 1 --2- 172.21.15.8:0/1844311435 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f567c067660 0x7f567c069b20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:05.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.033+0000 7f56a0800640 1 --2- 172.21.15.8:0/1844311435 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56980c2370 0x7f5698157fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:05.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.033+0000 7f56a0800640 1 -- 172.21.15.8:0/1844311435 >> 172.21.15.8:0/1844311435 conn(0x7f56980aacf0 msgr2=0x7f56980ab0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:05.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.033+0000 7f56a0800640 1 -- 172.21.15.8:0/1844311435 shutdown_connections 2024-03-23T23:43:05.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.033+0000 7f56a0800640 1 -- 172.21.15.8:0/1844311435 wait complete. 2024-03-23T23:43:05.053 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-03-23T23:43:05.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.193+0000 7fbbbde00640 1 Processor -- start 2024-03-23T23:43:05.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.193+0000 7fbbbde00640 1 -- start start 2024-03-23T23:43:05.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.197+0000 7fbbbde00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbbb8152ff0 0x7fbbb80714f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:05.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.197+0000 7fbbbde00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbbb8159860 0x7fbbb806ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:05.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.197+0000 7fbbbde00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbbb806f190 0x7fbbb80c2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:05.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.197+0000 7fbbbde00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb8159dd0 con 0x7fbbb8159860 2024-03-23T23:43:05.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.197+0000 7fbbbde00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb80701f0 con 0x7fbbb806f190 2024-03-23T23:43:05.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.197+0000 7fbbbde00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb80704d0 con 0x7fbbb8152ff0 2024-03-23T23:43:05.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.197+0000 7fbbae000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbbb8159860 0x7fbbb806ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:05.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.197+0000 7fbbae000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbbb8159860 0x7fbbb806ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60168/0 (socket says 172.21.15.8:60168) 2024-03-23T23:43:05.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.197+0000 7fbbae000640 1 -- 172.21.15.8:0/50696276 learned_addr learned my addr 172.21.15.8:0/50696276 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:05.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.197+0000 7fbbb7400640 1 --2- 172.21.15.8:0/50696276 >> v2:172.21.15.196:3300/0 conn(0x7fbbb806f190 0x7fbbb80c2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:05.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.197+0000 7fbbb6a00640 1 --2- 172.21.15.8:0/50696276 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbbb8152ff0 0x7fbbb80714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:05.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.197+0000 7fbbae000640 1 -- 172.21.15.8:0/50696276 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbbb8152ff0 msgr2=0x7fbbb80714f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:05.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.197+0000 7fbbae000640 1 --2- 172.21.15.8:0/50696276 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbbb8152ff0 0x7fbbb80714f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:05.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.197+0000 7fbbae000640 1 -- 172.21.15.8:0/50696276 >> v2:172.21.15.196:3300/0 conn(0x7fbbb806f190 msgr2=0x7fbbb80c2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:05.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.197+0000 7fbbae000640 1 --2- 172.21.15.8:0/50696276 >> v2:172.21.15.196:3300/0 conn(0x7fbbb806f190 0x7fbbb80c2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:05.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.197+0000 7fbbae000640 1 -- 172.21.15.8:0/50696276 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb80707b0 con 0x7fbbb8159860 2024-03-23T23:43:05.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.201+0000 7fbbae000640 1 --2- 172.21.15.8:0/50696276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbbb8159860 0x7fbbb806ec50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbbb80abd30 tx=0x7fbba001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0a9ffac0f21a22 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:05.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.201+0000 7fbbb6000640 1 -- 172.21.15.8:0/50696276 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba00b0070 con 0x7fbbb8159860 2024-03-23T23:43:05.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.201+0000 7fbbb6000640 1 -- 172.21.15.8:0/50696276 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba00ab600 con 0x7fbbb8159860 2024-03-23T23:43:05.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.201+0000 7fbbb6000640 1 -- 172.21.15.8:0/50696276 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba00ab9d0 con 0x7fbbb8159860 2024-03-23T23:43:05.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.201+0000 7fbbbde00640 1 -- 172.21.15.8:0/50696276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbbb8159860 msgr2=0x7fbbb806ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:05.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.201+0000 7fbbbde00640 1 --2- 172.21.15.8:0/50696276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbbb8159860 0x7fbbb806ec50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbbb80abd30 tx=0x7fbba001c490 comp rx=0 tx=0).stop 2024-03-23T23:43:05.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.201+0000 7fbbbde00640 1 -- 172.21.15.8:0/50696276 shutdown_connections 2024-03-23T23:43:05.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.201+0000 7fbbbde00640 1 --2- 172.21.15.8:0/50696276 >> v2:172.21.15.196:3300/0 conn(0x7fbbb806f190 0x7fbbb80c2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:05.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.201+0000 7fbbbde00640 1 --2- 172.21.15.8:0/50696276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbbb8159860 0x7fbbb806ec50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:05.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.201+0000 7fbbbde00640 1 --2- 172.21.15.8:0/50696276 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbbb8152ff0 0x7fbbb80714f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:05.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.201+0000 7fbbbde00640 1 -- 172.21.15.8:0/50696276 >> 172.21.15.8:0/50696276 conn(0x7fbbb80aad10 msgr2=0x7fbbb80ab120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:05.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.201+0000 7fbbbde00640 1 -- 172.21.15.8:0/50696276 shutdown_connections 2024-03-23T23:43:05.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.201+0000 7fbbbde00640 1 -- 172.21.15.8:0/50696276 wait complete. 2024-03-23T23:43:05.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.201+0000 7fbbbde00640 1 Processor -- start 2024-03-23T23:43:05.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.201+0000 7fbbbde00640 1 -- start start 2024-03-23T23:43:05.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.205+0000 7fbbbde00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbbb806f190 0x7fbbb80c4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:05.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.205+0000 7fbbbde00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbbb8152ff0 0x7fbbb81f2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:05.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.205+0000 7fbbbde00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbbb8159860 0x7fbbb81f2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:05.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.205+0000 7fbbbde00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb8156090 con 0x7fbbb806f190 2024-03-23T23:43:05.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.205+0000 7fbbbde00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb80c7630 con 0x7fbbb8159860 2024-03-23T23:43:05.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.205+0000 7fbbbde00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb8156210 con 0x7fbbb8152ff0 2024-03-23T23:43:05.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.205+0000 7fbbb6a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbbb806f190 0x7fbbb80c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:05.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.205+0000 7fbbb6a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbbb806f190 0x7fbbb80c4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60172/0 (socket says 172.21.15.8:60172) 2024-03-23T23:43:05.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.205+0000 7fbbb6a00640 1 -- 172.21.15.8:0/2588712108 learned_addr learned my addr 172.21.15.8:0/2588712108 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:05.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.205+0000 7fbbb7400640 1 --2- 172.21.15.8:0/2588712108 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbbb8159860 0x7fbbb81f2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:05.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.205+0000 7fbbae000640 1 --2- 172.21.15.8:0/2588712108 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbbb8152ff0 0x7fbbb81f2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:05.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.205+0000 7fbbb6a00640 1 -- 172.21.15.8:0/2588712108 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbbb8152ff0 msgr2=0x7fbbb81f2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:05.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.205+0000 7fbbb6a00640 1 --2- 172.21.15.8:0/2588712108 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbbb8152ff0 0x7fbbb81f2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:05.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.205+0000 7fbbb6a00640 1 -- 172.21.15.8:0/2588712108 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbbb8159860 msgr2=0x7fbbb81f2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:05.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.205+0000 7fbbb6a00640 1 --2- 172.21.15.8:0/2588712108 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbbb8159860 0x7fbbb81f2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:05.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.205+0000 7fbbb6a00640 1 -- 172.21.15.8:0/2588712108 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb815e420 con 0x7fbbb806f190 2024-03-23T23:43:05.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.205+0000 7fbbb6a00640 1 --2- 172.21.15.8:0/2588712108 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbbb806f190 0x7fbbb80c4440 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbba800e930 tx=0x7fbba800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:05.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.205+0000 7fbbafe00640 1 -- 172.21.15.8:0/2588712108 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba8017070 con 0x7fbbb806f190 2024-03-23T23:43:05.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.205+0000 7fbbafe00640 1 -- 172.21.15.8:0/2588712108 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba800ca00 con 0x7fbbb806f190 2024-03-23T23:43:05.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.205+0000 7fbbafe00640 1 -- 172.21.15.8:0/2588712108 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba800cdb0 con 0x7fbbb806f190 2024-03-23T23:43:05.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.205+0000 7fbbbde00640 1 -- 172.21.15.8:0/2588712108 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb81528c0 con 0x7fbbb806f190 2024-03-23T23:43:05.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.205+0000 7fbbbde00640 1 -- 172.21.15.8:0/2588712108 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb815d940 con 0x7fbbb806f190 2024-03-23T23:43:05.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.205+0000 7fbbbde00640 1 -- 172.21.15.8:0/2588712108 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb804f410 con 0x7fbbb806f190 2024-03-23T23:43:05.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.205+0000 7fbbafe00640 1 -- 172.21.15.8:0/2588712108 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fbba801a070 con 0x7fbbb806f190 2024-03-23T23:43:05.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.209+0000 7fbbafe00640 1 --2- 172.21.15.8:0/2588712108 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbb94067660 0x7fbb94069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:05.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.209+0000 7fbbafe00640 1 -- 172.21.15.8:0/2588712108 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fbba8085b90 con 0x7fbbb806f190 2024-03-23T23:43:05.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.209+0000 7fbbae000640 1 --2- 172.21.15.8:0/2588712108 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbb94067660 0x7fbb94069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:05.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.209+0000 7fbbae000640 1 --2- 172.21.15.8:0/2588712108 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbb94067660 0x7fbb94069b20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbba00ad000 tx=0x7fbba0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:05.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.217+0000 7fbbafe00640 1 -- 172.21.15.8:0/2588712108 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fbba8055f40 con 0x7fbbb806f190 2024-03-23T23:43:05.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.457+0000 7fbbbde00640 1 -- 172.21.15.8:0/2588712108 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbbb8067ca0 con 0x7fbbb806f190 2024-03-23T23:43:05.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.457+0000 7fbbafe00640 1 -- 172.21.15.8:0/2588712108 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v25) v1 ==== 99+0+11 (secure 0 0 0) 0x7fbba8059fe0 con 0x7fbbb806f190 2024-03-23T23:43:05.458 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-03-23T23:43:05.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.461+0000 7fbbbde00640 1 -- 172.21.15.8:0/2588712108 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbb94067660 msgr2=0x7fbb94069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:05.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.461+0000 7fbbbde00640 1 --2- 172.21.15.8:0/2588712108 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbb94067660 0x7fbb94069b20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbba00ad000 tx=0x7fbba0008040 comp rx=0 tx=0).stop 2024-03-23T23:43:05.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.461+0000 7fbbbde00640 1 -- 172.21.15.8:0/2588712108 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbbb806f190 msgr2=0x7fbbb80c4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:05.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.461+0000 7fbbbde00640 1 --2- 172.21.15.8:0/2588712108 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbbb806f190 0x7fbbb80c4440 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbba800e930 tx=0x7fbba800edf0 comp rx=0 tx=0).stop 2024-03-23T23:43:05.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.461+0000 7fbbbde00640 1 -- 172.21.15.8:0/2588712108 shutdown_connections 2024-03-23T23:43:05.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.461+0000 7fbbbde00640 1 --2- 172.21.15.8:0/2588712108 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbbb8159860 0x7fbbb81f2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:05.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.461+0000 7fbbbde00640 1 --2- 172.21.15.8:0/2588712108 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbb94067660 0x7fbb94069b20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:05.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.461+0000 7fbbbde00640 1 --2- 172.21.15.8:0/2588712108 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbbb8152ff0 0x7fbbb81f2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:05.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.461+0000 7fbbbde00640 1 --2- 172.21.15.8:0/2588712108 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbbb806f190 0x7fbbb80c4440 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:05.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.461+0000 7fbbbde00640 1 -- 172.21.15.8:0/2588712108 >> 172.21.15.8:0/2588712108 conn(0x7fbbb80aad10 msgr2=0x7fbbb8153dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:05.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.461+0000 7fbbbde00640 1 -- 172.21.15.8:0/2588712108 shutdown_connections 2024-03-23T23:43:05.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.461+0000 7fbbbde00640 1 -- 172.21.15.8:0/2588712108 wait complete. 2024-03-23T23:43:05.480 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-03-23T23:43:05.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.621+0000 7f0ea7200640 1 Processor -- start 2024-03-23T23:43:05.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.621+0000 7f0ea7200640 1 -- start start 2024-03-23T23:43:05.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.625+0000 7f0ea7200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0ea0159860 0x7f0ea00714f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:05.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.625+0000 7f0ea7200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea0159dd0 con 0x7f0ea0152ff0 2024-03-23T23:43:05.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.625+0000 7f0ea7200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea00701f0 con 0x7f0ea00c2390 2024-03-23T23:43:05.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.625+0000 7f0ea7200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea00704d0 con 0x7f0ea0159860 2024-03-23T23:43:05.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.625+0000 7f0e97e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0ea0159860 0x7f0ea00714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:05.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.625+0000 7f0e9fe00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f0ea0152ff0 0x7f0ea006ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:45438/0 (socket says 172.21.15.8:45438) 2024-03-23T23:43:05.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.625+0000 7f0e9fe00640 1 -- 172.21.15.8:0/3122882790 learned_addr learned my addr 172.21.15.8:0/3122882790 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:43:05.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.625+0000 7f0e97e00640 1 -- 172.21.15.8:0/3122882790 >> v1:172.21.15.196:6789/0 conn(0x7f0ea00c2390 legacy=0x7f0ea01601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:05.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.625+0000 7f0e97e00640 1 -- 172.21.15.8:0/3122882790 >> v1:172.21.15.8:6789/0 conn(0x7f0ea0152ff0 legacy=0x7f0ea006ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:05.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.625+0000 7f0e97e00640 1 -- 172.21.15.8:0/3122882790 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea00707b0 con 0x7f0ea0159860 2024-03-23T23:43:05.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.625+0000 7f0e9f400640 1 -- 172.21.15.8:0/3122882790 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3000629045 0 0) 0x7f0ea0159dd0 con 0x7f0ea0152ff0 2024-03-23T23:43:05.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.629+0000 7f0e97e00640 1 --2- 172.21.15.8:0/3122882790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ea0159860 0x7f0ea00714f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0e880097c0 tx=0x7f0e8801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de2663325bdef875 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:05.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.629+0000 7f0e9f400640 1 -- 172.21.15.8:0/3122882790 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e880b0070 con 0x7f0ea0159860 2024-03-23T23:43:05.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.629+0000 7f0e9f400640 1 -- 172.21.15.8:0/3122882790 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e880ab600 con 0x7f0ea0159860 2024-03-23T23:43:05.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.629+0000 7f0e9f400640 1 -- 172.21.15.8:0/3122882790 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e880ab9d0 con 0x7f0ea0159860 2024-03-23T23:43:05.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.629+0000 7f0ea7200640 1 -- 172.21.15.8:0/3122882790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ea0159860 msgr2=0x7f0ea00714f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:05.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.629+0000 7f0ea7200640 1 --2- 172.21.15.8:0/3122882790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ea0159860 0x7f0ea00714f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0e880097c0 tx=0x7f0e8801c410 comp rx=0 tx=0).stop 2024-03-23T23:43:05.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.629+0000 7f0ea7200640 1 -- 172.21.15.8:0/3122882790 shutdown_connections 2024-03-23T23:43:05.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.629+0000 7f0ea7200640 1 --2- 172.21.15.8:0/3122882790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ea0159860 0x7f0ea00714f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:05.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.629+0000 7f0ea7200640 1 -- 172.21.15.8:0/3122882790 >> 172.21.15.8:0/3122882790 conn(0x7f0ea00aad10 msgr2=0x7f0ea00ab120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:05.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.629+0000 7f0ea7200640 1 -- 172.21.15.8:0/3122882790 shutdown_connections 2024-03-23T23:43:05.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.629+0000 7f0ea7200640 1 -- 172.21.15.8:0/3122882790 wait complete. 2024-03-23T23:43:05.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.629+0000 7f0ea7200640 1 Processor -- start 2024-03-23T23:43:05.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.629+0000 7f0ea7200640 1 -- start start 2024-03-23T23:43:05.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.629+0000 7f0ea7200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ea00c2390 0x7f0ea0155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:05.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.629+0000 7f0ea7200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ea0152ff0 0x7f0ea0157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:05.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.629+0000 7f0ea7200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ea0159860 0x7f0ea0150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:05.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.629+0000 7f0ea7200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea006f4e0 con 0x7f0ea0152ff0 2024-03-23T23:43:05.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.629+0000 7f0ea7200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea006f360 con 0x7f0ea00c2390 2024-03-23T23:43:05.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.629+0000 7f0ea7200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea00c7420 con 0x7f0ea0159860 2024-03-23T23:43:05.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.629+0000 7f0e97e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ea0152ff0 0x7f0ea0157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:05.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.629+0000 7f0e9fe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ea00c2390 0x7f0ea0155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:05.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.629+0000 7f0e97e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ea0152ff0 0x7f0ea0157f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60184/0 (socket says 172.21.15.8:60184) 2024-03-23T23:43:05.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.629+0000 7f0e9fe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ea00c2390 0x7f0ea0155d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:41506/0 (socket says 172.21.15.8:41506) 2024-03-23T23:43:05.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.629+0000 7f0e97e00640 1 -- 172.21.15.8:0/2489408287 learned_addr learned my addr 172.21.15.8:0/2489408287 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:05.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.629+0000 7f0ea5200640 1 --2- 172.21.15.8:0/2489408287 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ea0159860 0x7f0ea0150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:05.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.633+0000 7f0e97e00640 1 -- 172.21.15.8:0/2489408287 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ea0159860 msgr2=0x7f0ea0150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:05.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.633+0000 7f0e97e00640 1 --2- 172.21.15.8:0/2489408287 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ea0159860 0x7f0ea0150ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:05.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.633+0000 7f0e97e00640 1 -- 172.21.15.8:0/2489408287 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ea00c2390 msgr2=0x7f0ea0155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:05.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.633+0000 7f0e97e00640 1 --2- 172.21.15.8:0/2489408287 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ea00c2390 0x7f0ea0155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:05.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.633+0000 7f0e97e00640 1 -- 172.21.15.8:0/2489408287 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea0155670 con 0x7f0ea0152ff0 2024-03-23T23:43:05.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.633+0000 7f0e9fe00640 1 --2- 172.21.15.8:0/2489408287 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ea00c2390 0x7f0ea0155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:43:05.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.633+0000 7f0ea5200640 1 --2- 172.21.15.8:0/2489408287 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ea0159860 0x7f0ea0150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:43:05.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.633+0000 7f0e97e00640 1 --2- 172.21.15.8:0/2489408287 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ea0152ff0 0x7f0ea0157f00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0e880ae040 tx=0x7f0e880191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:05.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.633+0000 7f0e9cc00640 1 -- 172.21.15.8:0/2489408287 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e880b0040 con 0x7f0ea0152ff0 2024-03-23T23:43:05.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.633+0000 7f0e9cc00640 1 -- 172.21.15.8:0/2489408287 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e88004020 con 0x7f0ea0152ff0 2024-03-23T23:43:05.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.633+0000 7f0e9cc00640 1 -- 172.21.15.8:0/2489408287 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e880043d0 con 0x7f0ea0152ff0 2024-03-23T23:43:05.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.633+0000 7f0ea7200640 1 -- 172.21.15.8:0/2489408287 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea0156370 con 0x7f0ea0152ff0 2024-03-23T23:43:05.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.633+0000 7f0ea7200640 1 -- 172.21.15.8:0/2489408287 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea01503f0 con 0x7f0ea0152ff0 2024-03-23T23:43:05.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.633+0000 7f0ea7200640 1 -- 172.21.15.8:0/2489408287 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea004f410 con 0x7f0ea0152ff0 2024-03-23T23:43:05.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.633+0000 7f0e9cc00640 1 -- 172.21.15.8:0/2489408287 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f0e880b3040 con 0x7f0ea0152ff0 2024-03-23T23:43:05.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.633+0000 7f0e9cc00640 1 --2- 172.21.15.8:0/2489408287 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0e7c067660 0x7f0e7c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:05.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.633+0000 7f0e9cc00640 1 -- 172.21.15.8:0/2489408287 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f0e88120380 con 0x7f0ea0152ff0 2024-03-23T23:43:05.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.637+0000 7f0e9fe00640 1 --2- 172.21.15.8:0/2489408287 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0e7c067660 0x7f0e7c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:05.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.637+0000 7f0e9fe00640 1 --2- 172.21.15.8:0/2489408287 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0e7c067660 0x7f0e7c069b20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0e90007bc0 tx=0x7f0e90007b10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:05.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.637+0000 7f0e9cc00640 1 -- 172.21.15.8:0/2489408287 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f0e880c4030 con 0x7f0ea0152ff0 2024-03-23T23:43:05.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.805+0000 7f0ea7200640 1 -- 172.21.15.8:0/2489408287 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7f0ea00c8d40 con 0x7f0ea0152ff0 2024-03-23T23:43:05.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.805+0000 7f0e9cc00640 1 -- 172.21.15.8:0/2489408287 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v25) v1 ==== 95+0+11 (secure 0 0 0) 0x7f0e880bb030 con 0x7f0ea0152ff0 2024-03-23T23:43:05.805 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-03-23T23:43:05.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.805+0000 7f0ea7200640 1 -- 172.21.15.8:0/2489408287 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0e7c067660 msgr2=0x7f0e7c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:05.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.805+0000 7f0ea7200640 1 --2- 172.21.15.8:0/2489408287 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0e7c067660 0x7f0e7c069b20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0e90007bc0 tx=0x7f0e90007b10 comp rx=0 tx=0).stop 2024-03-23T23:43:05.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.805+0000 7f0ea7200640 1 -- 172.21.15.8:0/2489408287 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ea0152ff0 msgr2=0x7f0ea0157f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:05.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.805+0000 7f0ea7200640 1 --2- 172.21.15.8:0/2489408287 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ea0152ff0 0x7f0ea0157f00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0e880ae040 tx=0x7f0e880191b0 comp rx=0 tx=0).stop 2024-03-23T23:43:05.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.805+0000 7f0ea7200640 1 -- 172.21.15.8:0/2489408287 shutdown_connections 2024-03-23T23:43:05.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.805+0000 7f0ea7200640 1 --2- 172.21.15.8:0/2489408287 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0e7c067660 0x7f0e7c069b20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:05.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.805+0000 7f0ea7200640 1 --2- 172.21.15.8:0/2489408287 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ea0159860 0x7f0ea0150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:05.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.805+0000 7f0ea7200640 1 --2- 172.21.15.8:0/2489408287 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ea0152ff0 0x7f0ea0157f00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:05.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.805+0000 7f0ea7200640 1 --2- 172.21.15.8:0/2489408287 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ea00c2390 0x7f0ea0155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:05.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.805+0000 7f0ea7200640 1 -- 172.21.15.8:0/2489408287 >> 172.21.15.8:0/2489408287 conn(0x7f0ea00aad10 msgr2=0x7f0ea006d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:05.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.805+0000 7f0ea7200640 1 -- 172.21.15.8:0/2489408287 shutdown_connections 2024-03-23T23:43:05.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.805+0000 7f0ea7200640 1 -- 172.21.15.8:0/2489408287 wait complete. 2024-03-23T23:43:05.827 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-03-23T23:43:05.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.969+0000 7f9d93200640 1 Processor -- start 2024-03-23T23:43:05.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.969+0000 7f9d93200640 1 -- start start 2024-03-23T23:43:05.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.969+0000 7f9d93200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d8c1542d0 0x7f9d8c0c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:05.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.969+0000 7f9d93200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d8c0c3940 con 0x7f9d8c0c5210 2024-03-23T23:43:05.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.969+0000 7f9d93200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d8c0c5740 con 0x7f9d8c0712a0 2024-03-23T23:43:05.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.969+0000 7f9d93200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c0c4df0 con 0x7f9d8c1542d0 2024-03-23T23:43:05.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.969+0000 7f9d83e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f9d8c0c5210 0x7f9d8c150480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:45452/0 (socket says 172.21.15.8:45452) 2024-03-23T23:43:05.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.969+0000 7f9d91200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d8c1542d0 0x7f9d8c0c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:05.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.969+0000 7f9d8be00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f9d8c0712a0 0x7f9d8c0c46e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:59982/0 (socket says 172.21.15.8:59982) 2024-03-23T23:43:05.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.969+0000 7f9d83e00640 1 -- 172.21.15.8:0/2050533960 learned_addr learned my addr 172.21.15.8:0/2050533960 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:43:05.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.969+0000 7f9d91200640 1 -- 172.21.15.8:0/2050533960 >> v1:172.21.15.196:6789/0 conn(0x7f9d8c0712a0 legacy=0x7f9d8c0c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:05.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.969+0000 7f9d8b400640 1 -- 172.21.15.8:0/2050533960 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3211149972 0 0) 0x7f9d8c0c5740 con 0x7f9d8c0712a0 2024-03-23T23:43:05.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.969+0000 7f9d91200640 1 -- 172.21.15.8:0/2050533960 >> v1:172.21.15.8:6789/0 conn(0x7f9d8c0c5210 legacy=0x7f9d8c150480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:05.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.969+0000 7f9d91200640 1 -- 172.21.15.8:0/2050533960 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8c0c3c00 con 0x7f9d8c1542d0 2024-03-23T23:43:05.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.973+0000 7f9d91200640 1 --2- 172.21.15.8:0/2050533960 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d8c1542d0 0x7f9d8c0c6e40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9d84009dc0 tx=0x7f9d8401c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea86c100bfbace58 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:05.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.973+0000 7f9d8b400640 1 -- 172.21.15.8:0/2050533960 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d840b2070 con 0x7f9d8c1542d0 2024-03-23T23:43:05.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.973+0000 7f9d8b400640 1 -- 172.21.15.8:0/2050533960 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d840a5860 con 0x7f9d8c1542d0 2024-03-23T23:43:05.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.973+0000 7f9d8b400640 1 -- 172.21.15.8:0/2050533960 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d840a5c30 con 0x7f9d8c1542d0 2024-03-23T23:43:05.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.973+0000 7f9d93200640 1 -- 172.21.15.8:0/2050533960 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d8c1542d0 msgr2=0x7f9d8c0c6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:05.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.973+0000 7f9d93200640 1 --2- 172.21.15.8:0/2050533960 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d8c1542d0 0x7f9d8c0c6e40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9d84009dc0 tx=0x7f9d8401c990 comp rx=0 tx=0).stop 2024-03-23T23:43:05.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.973+0000 7f9d93200640 1 -- 172.21.15.8:0/2050533960 shutdown_connections 2024-03-23T23:43:05.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.973+0000 7f9d93200640 1 --2- 172.21.15.8:0/2050533960 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d8c1542d0 0x7f9d8c0c6e40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:05.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.973+0000 7f9d93200640 1 -- 172.21.15.8:0/2050533960 >> 172.21.15.8:0/2050533960 conn(0x7f9d8c0aacf0 msgr2=0x7f9d8c0ab100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:05.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.973+0000 7f9d93200640 1 -- 172.21.15.8:0/2050533960 shutdown_connections 2024-03-23T23:43:05.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.973+0000 7f9d93200640 1 -- 172.21.15.8:0/2050533960 wait complete. 2024-03-23T23:43:05.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.977+0000 7f9d93200640 1 Processor -- start 2024-03-23T23:43:05.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.977+0000 7f9d93200640 1 -- start start 2024-03-23T23:43:05.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.977+0000 7f9d93200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d8c0712a0 0x7f9d8c0addd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:05.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.977+0000 7f9d93200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d8c0c5210 0x7f9d8c1486d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:05.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.977+0000 7f9d93200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d8c1542d0 0x7f9d8c0be1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:05.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.977+0000 7f9d93200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c071800 con 0x7f9d8c1542d0 2024-03-23T23:43:05.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.977+0000 7f9d93200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c071680 con 0x7f9d8c0c5210 2024-03-23T23:43:05.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.977+0000 7f9d93200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c1611d0 con 0x7f9d8c0712a0 2024-03-23T23:43:05.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.977+0000 7f9d91200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d8c1542d0 0x7f9d8c0be1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:05.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.977+0000 7f9d8be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d8c0712a0 0x7f9d8c0addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:05.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.977+0000 7f9d91200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d8c1542d0 0x7f9d8c0be1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60192/0 (socket says 172.21.15.8:60192) 2024-03-23T23:43:05.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.977+0000 7f9d91200640 1 -- 172.21.15.8:0/4212512850 learned_addr learned my addr 172.21.15.8:0/4212512850 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:05.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.977+0000 7f9d83e00640 1 --2- 172.21.15.8:0/4212512850 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d8c0c5210 0x7f9d8c1486d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:05.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.977+0000 7f9d91200640 1 -- 172.21.15.8:0/4212512850 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d8c0712a0 msgr2=0x7f9d8c0addd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:05.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.977+0000 7f9d91200640 1 --2- 172.21.15.8:0/4212512850 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d8c0712a0 0x7f9d8c0addd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:05.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.977+0000 7f9d91200640 1 -- 172.21.15.8:0/4212512850 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d8c0c5210 msgr2=0x7f9d8c1486d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:05.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.977+0000 7f9d91200640 1 --2- 172.21.15.8:0/4212512850 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d8c0c5210 0x7f9d8c1486d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:05.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.977+0000 7f9d91200640 1 -- 172.21.15.8:0/4212512850 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8c145e20 con 0x7f9d8c1542d0 2024-03-23T23:43:05.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.977+0000 7f9d91200640 1 --2- 172.21.15.8:0/4212512850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d8c1542d0 0x7f9d8c0be1c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9d8401ce70 tx=0x7f9d84019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:05.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.977+0000 7f9d88c00640 1 -- 172.21.15.8:0/4212512850 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d840b2050 con 0x7f9d8c1542d0 2024-03-23T23:43:05.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.977+0000 7f9d88c00640 1 -- 172.21.15.8:0/4212512850 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d840be070 con 0x7f9d8c1542d0 2024-03-23T23:43:05.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.977+0000 7f9d93200640 1 -- 172.21.15.8:0/4212512850 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d8c1460e0 con 0x7f9d8c1542d0 2024-03-23T23:43:05.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.977+0000 7f9d88c00640 1 -- 172.21.15.8:0/4212512850 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d840adab0 con 0x7f9d8c1542d0 2024-03-23T23:43:05.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.977+0000 7f9d93200640 1 -- 172.21.15.8:0/4212512850 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d8c0ad5d0 con 0x7f9d8c1542d0 2024-03-23T23:43:05.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.981+0000 7f9d93200640 1 -- 172.21.15.8:0/4212512850 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d8c04f410 con 0x7f9d8c1542d0 2024-03-23T23:43:05.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.981+0000 7f9d88c00640 1 -- 172.21.15.8:0/4212512850 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f9d840adc50 con 0x7f9d8c1542d0 2024-03-23T23:43:05.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.981+0000 7f9d88c00640 1 --2- 172.21.15.8:0/4212512850 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9d680676b0 0x7f9d68069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:05.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.981+0000 7f9d88c00640 1 -- 172.21.15.8:0/4212512850 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f9d84120d10 con 0x7f9d8c1542d0 2024-03-23T23:43:05.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.981+0000 7f9d8be00640 1 --2- 172.21.15.8:0/4212512850 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9d680676b0 0x7f9d68069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:05.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.981+0000 7f9d8be00640 1 --2- 172.21.15.8:0/4212512850 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9d680676b0 0x7f9d68069b70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c000f70 tx=0x7f9d7c007240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:05.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:05.985+0000 7f9d88c00640 1 -- 172.21.15.8:0/4212512850 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f9d84126020 con 0x7f9d8c1542d0 2024-03-23T23:43:06.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.261+0000 7f9d93200640 1 -- 172.21.15.8:0/4212512850 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9d8c0c3620 con 0x7f9d8c1542d0 2024-03-23T23:43:06.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.261+0000 7f9d88c00640 1 -- 172.21.15.8:0/4212512850 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v25) v1 ==== 99+0+11 (secure 0 0 0) 0x7f9d84016580 con 0x7f9d8c1542d0 2024-03-23T23:43:06.264 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-03-23T23:43:06.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.265+0000 7f9d93200640 1 -- 172.21.15.8:0/4212512850 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9d680676b0 msgr2=0x7f9d68069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:06.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.265+0000 7f9d93200640 1 --2- 172.21.15.8:0/4212512850 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9d680676b0 0x7f9d68069b70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c000f70 tx=0x7f9d7c007240 comp rx=0 tx=0).stop 2024-03-23T23:43:06.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.265+0000 7f9d93200640 1 -- 172.21.15.8:0/4212512850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d8c1542d0 msgr2=0x7f9d8c0be1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:06.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.265+0000 7f9d93200640 1 --2- 172.21.15.8:0/4212512850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d8c1542d0 0x7f9d8c0be1c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9d8401ce70 tx=0x7f9d84019730 comp rx=0 tx=0).stop 2024-03-23T23:43:06.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.265+0000 7f9d93200640 1 -- 172.21.15.8:0/4212512850 shutdown_connections 2024-03-23T23:43:06.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.265+0000 7f9d93200640 1 --2- 172.21.15.8:0/4212512850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d8c1542d0 0x7f9d8c0be1c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:06.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.265+0000 7f9d93200640 1 --2- 172.21.15.8:0/4212512850 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d8c0c5210 0x7f9d8c1486d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:06.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.265+0000 7f9d93200640 1 --2- 172.21.15.8:0/4212512850 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9d680676b0 0x7f9d68069b70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:06.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.265+0000 7f9d93200640 1 --2- 172.21.15.8:0/4212512850 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d8c0712a0 0x7f9d8c0addd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:06.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.265+0000 7f9d93200640 1 -- 172.21.15.8:0/4212512850 >> 172.21.15.8:0/4212512850 conn(0x7f9d8c0aacf0 msgr2=0x7f9d8c14b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:06.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.265+0000 7f9d93200640 1 -- 172.21.15.8:0/4212512850 shutdown_connections 2024-03-23T23:43:06.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.265+0000 7f9d93200640 1 -- 172.21.15.8:0/4212512850 wait complete. 2024-03-23T23:43:06.286 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-03-23T23:43:06.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.429+0000 7f26fb200640 1 Processor -- start 2024-03-23T23:43:06.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.429+0000 7f26fb200640 1 -- start start 2024-03-23T23:43:06.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.429+0000 7f26fb200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26fc06ed00 0x7f26fc157040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:06.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.429+0000 7f26fb200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f26fc0700d0 0x7f26fc157580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:06.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.429+0000 7f26fb200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26fc06f200 con 0x7f26fc06b3d0 2024-03-23T23:43:06.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.429+0000 7f26fb200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26fc156bb0 con 0x7f26fc0700d0 2024-03-23T23:43:06.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.429+0000 7f26fb200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc06f4e0 con 0x7f26fc06ed00 2024-03-23T23:43:06.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.429+0000 7f26fa800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f26fc0700d0 0x7f26fc157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:06.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.429+0000 7f26f9e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f26fc06b3d0 0x7f26fc1508c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:45456/0 (socket says 172.21.15.8:45456) 2024-03-23T23:43:06.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.429+0000 7f26f9e00640 1 -- 172.21.15.8:0/1778845802 learned_addr learned my addr 172.21.15.8:0/1778845802 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:43:06.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.429+0000 7f26f3e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26fc06ed00 0x7f26fc157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:06.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.429+0000 7f26fa800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f26fc0700d0 0x7f26fc157580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60196/0 (socket says 172.21.15.8:60196) 2024-03-23T23:43:06.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.433+0000 7f26fa800640 1 -- 172.21.15.8:0/1778845802 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26fc06ed00 msgr2=0x7f26fc157040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:06.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.433+0000 7f26fa800640 1 --2- 172.21.15.8:0/1778845802 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26fc06ed00 0x7f26fc157040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:06.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.433+0000 7f26fa800640 1 -- 172.21.15.8:0/1778845802 >> v1:172.21.15.8:6789/0 conn(0x7f26fc06b3d0 legacy=0x7f26fc1508c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:06.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.433+0000 7f26fa800640 1 -- 172.21.15.8:0/1778845802 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26fc06f7c0 con 0x7f26fc0700d0 2024-03-23T23:43:06.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.433+0000 7f26f9400640 1 -- 172.21.15.8:0/1778845802 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687228628 0 0) 0x7f26fc06f200 con 0x7f26fc06b3d0 2024-03-23T23:43:06.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.433+0000 7f26fa800640 1 --2- 172.21.15.8:0/1778845802 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26fc0700d0 0x7f26fc157580 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f26f4009d90 tx=0x7f26f401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=385e57f01245f87e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:06.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.433+0000 7f26f9400640 1 -- 172.21.15.8:0/1778845802 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f40b2070 con 0x7f26fc0700d0 2024-03-23T23:43:06.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.433+0000 7f26f9400640 1 -- 172.21.15.8:0/1778845802 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f40a58b0 con 0x7f26fc0700d0 2024-03-23T23:43:06.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.433+0000 7f26f9400640 1 -- 172.21.15.8:0/1778845802 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f40a5c80 con 0x7f26fc0700d0 2024-03-23T23:43:06.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.433+0000 7f26fb200640 1 -- 172.21.15.8:0/1778845802 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26fc0700d0 msgr2=0x7f26fc157580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:06.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.433+0000 7f26fb200640 1 --2- 172.21.15.8:0/1778845802 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26fc0700d0 0x7f26fc157580 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f26f4009d90 tx=0x7f26f401c8e0 comp rx=0 tx=0).stop 2024-03-23T23:43:06.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.437+0000 7f26fb200640 1 -- 172.21.15.8:0/1778845802 shutdown_connections 2024-03-23T23:43:06.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.437+0000 7f26fb200640 1 --2- 172.21.15.8:0/1778845802 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26fc0700d0 0x7f26fc157580 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:06.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.437+0000 7f26fb200640 1 --2- 172.21.15.8:0/1778845802 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26fc06ed00 0x7f26fc157040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:06.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.437+0000 7f26fb200640 1 -- 172.21.15.8:0/1778845802 >> 172.21.15.8:0/1778845802 conn(0x7f26fc06db90 msgr2=0x7f26fc06dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:06.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.437+0000 7f26fb200640 1 -- 172.21.15.8:0/1778845802 shutdown_connections 2024-03-23T23:43:06.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.437+0000 7f26fb200640 1 -- 172.21.15.8:0/1778845802 wait complete. 2024-03-23T23:43:06.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.437+0000 7f26fb200640 1 Processor -- start 2024-03-23T23:43:06.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.437+0000 7f26fb200640 1 -- start start 2024-03-23T23:43:06.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.437+0000 7f26fb200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26fc06b3d0 0x7f26fc154f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:06.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.437+0000 7f26fb200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26fc06ed00 0x7f26fc1f1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:06.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.437+0000 7f26fb200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26fc0700d0 0x7f26fc14ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:06.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.437+0000 7f26fb200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc150fd0 con 0x7f26fc06b3d0 2024-03-23T23:43:06.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.437+0000 7f26fb200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc151150 con 0x7f26fc06ed00 2024-03-23T23:43:06.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.437+0000 7f26fb200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc06b7b0 con 0x7f26fc0700d0 2024-03-23T23:43:06.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.437+0000 7f26f3e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26fc06ed00 0x7f26fc1f1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:06.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.437+0000 7f26f3e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26fc06ed00 0x7f26fc1f1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:41528/0 (socket says 172.21.15.8:41528) 2024-03-23T23:43:06.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.437+0000 7f26f3e00640 1 -- 172.21.15.8:0/2193466537 learned_addr learned my addr 172.21.15.8:0/2193466537 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:06.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.437+0000 7f26f9e00640 1 --2- 172.21.15.8:0/2193466537 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26fc06b3d0 0x7f26fc154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:06.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.437+0000 7f26fa800640 1 --2- 172.21.15.8:0/2193466537 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26fc0700d0 0x7f26fc14ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:06.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.437+0000 7f26f3e00640 1 -- 172.21.15.8:0/2193466537 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26fc0700d0 msgr2=0x7f26fc14ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:06.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.437+0000 7f26f3e00640 1 --2- 172.21.15.8:0/2193466537 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26fc0700d0 0x7f26fc14ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:06.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.437+0000 7f26f3e00640 1 -- 172.21.15.8:0/2193466537 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26fc06b3d0 msgr2=0x7f26fc154f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:06.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.437+0000 7f26f3e00640 1 --2- 172.21.15.8:0/2193466537 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26fc06b3d0 0x7f26fc154f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:06.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.437+0000 7f26f3e00640 1 -- 172.21.15.8:0/2193466537 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26fc1f20f0 con 0x7f26fc06ed00 2024-03-23T23:43:06.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.441+0000 7f26f3e00640 1 --2- 172.21.15.8:0/2193466537 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26fc06ed00 0x7f26fc1f1bb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f26e400e930 tx=0x7f26e400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:06.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.441+0000 7f26f2000640 1 -- 172.21.15.8:0/2193466537 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e4017070 con 0x7f26fc06ed00 2024-03-23T23:43:06.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.441+0000 7f26f2000640 1 -- 172.21.15.8:0/2193466537 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e400ca00 con 0x7f26fc06ed00 2024-03-23T23:43:06.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.441+0000 7f26f2000640 1 -- 172.21.15.8:0/2193466537 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e400cdb0 con 0x7f26fc06ed00 2024-03-23T23:43:06.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.441+0000 7f26fb200640 1 -- 172.21.15.8:0/2193466537 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26fc1edd90 con 0x7f26fc06ed00 2024-03-23T23:43:06.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.441+0000 7f26fb200640 1 -- 172.21.15.8:0/2193466537 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26fc1ee030 con 0x7f26fc06ed00 2024-03-23T23:43:06.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.441+0000 7f26fb200640 1 -- 172.21.15.8:0/2193466537 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26fc075800 con 0x7f26fc06ed00 2024-03-23T23:43:06.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.441+0000 7f26f2000640 1 -- 172.21.15.8:0/2193466537 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f26e401a070 con 0x7f26fc06ed00 2024-03-23T23:43:06.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.441+0000 7f26f2000640 1 --2- 172.21.15.8:0/2193466537 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f26d8067660 0x7f26d8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:06.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.441+0000 7f26f2000640 1 -- 172.21.15.8:0/2193466537 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f26e4085b90 con 0x7f26fc06ed00 2024-03-23T23:43:06.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.441+0000 7f26f9e00640 1 --2- 172.21.15.8:0/2193466537 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f26d8067660 0x7f26d8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:06.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.445+0000 7f26f9e00640 1 --2- 172.21.15.8:0/2193466537 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f26d8067660 0x7f26d8069b20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f26ec007fd0 tx=0x7f26ec007d60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:06.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.449+0000 7f26f2000640 1 -- 172.21.15.8:0/2193466537 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f26e4055f40 con 0x7f26fc06ed00 2024-03-23T23:43:06.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.609+0000 7f26fb200640 1 -- 172.21.15.8:0/2193466537 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) v1 -- 0x7f26fc072a30 con 0x7f26fc06ed00 2024-03-23T23:43:06.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.609+0000 7f26f2000640 1 -- 172.21.15.8:0/2193466537 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v25) v1 ==== 95+0+11 (secure 0 0 0) 0x7f26e4059fe0 con 0x7f26fc06ed00 2024-03-23T23:43:06.612 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-03-23T23:43:06.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.613+0000 7f26fb200640 1 -- 172.21.15.8:0/2193466537 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f26d8067660 msgr2=0x7f26d8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:06.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.613+0000 7f26fb200640 1 --2- 172.21.15.8:0/2193466537 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f26d8067660 0x7f26d8069b20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f26ec007fd0 tx=0x7f26ec007d60 comp rx=0 tx=0).stop 2024-03-23T23:43:06.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.613+0000 7f26fb200640 1 -- 172.21.15.8:0/2193466537 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26fc06ed00 msgr2=0x7f26fc1f1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:06.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.613+0000 7f26fb200640 1 --2- 172.21.15.8:0/2193466537 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26fc06ed00 0x7f26fc1f1bb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f26e400e930 tx=0x7f26e400edf0 comp rx=0 tx=0).stop 2024-03-23T23:43:06.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.613+0000 7f26fb200640 1 -- 172.21.15.8:0/2193466537 shutdown_connections 2024-03-23T23:43:06.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.613+0000 7f26fb200640 1 --2- 172.21.15.8:0/2193466537 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f26d8067660 0x7f26d8069b20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:06.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.613+0000 7f26fb200640 1 --2- 172.21.15.8:0/2193466537 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26fc0700d0 0x7f26fc14ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:06.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.613+0000 7f26fb200640 1 --2- 172.21.15.8:0/2193466537 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26fc06ed00 0x7f26fc1f1bb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:06.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.613+0000 7f26fb200640 1 --2- 172.21.15.8:0/2193466537 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26fc06b3d0 0x7f26fc154f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:06.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.613+0000 7f26fb200640 1 -- 172.21.15.8:0/2193466537 >> 172.21.15.8:0/2193466537 conn(0x7f26fc06db90 msgr2=0x7f26fc071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:06.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.613+0000 7f26fb200640 1 -- 172.21.15.8:0/2193466537 shutdown_connections 2024-03-23T23:43:06.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.613+0000 7f26fb200640 1 -- 172.21.15.8:0/2193466537 wait complete. 2024-03-23T23:43:06.642 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T23:43:06.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.789+0000 7fa74cc00640 1 Processor -- start 2024-03-23T23:43:06.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.789+0000 7fa74cc00640 1 -- start start 2024-03-23T23:43:06.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.789+0000 7fa74cc00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa74814d8b0 0x7fa7480c7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:06.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.789+0000 7fa74cc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa748070b50 0x7fa7481541b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:06.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.789+0000 7fa74cc00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa7480c5560 0x7fa74806ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:06.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.789+0000 7fa74cc00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7480c4830 con 0x7fa7480c5560 2024-03-23T23:43:06.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.789+0000 7fa74cc00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7480c50d0 con 0x7fa74814d8b0 2024-03-23T23:43:06.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.789+0000 7fa74cc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7480c7670 con 0x7fa748070b50 2024-03-23T23:43:06.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.789+0000 7fa73fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa748070b50 0x7fa7481541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:06.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.789+0000 7fa73fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa748070b50 0x7fa7481541b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:58466/0 (socket says 172.21.15.8:58466) 2024-03-23T23:43:06.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.789+0000 7fa73fe00640 1 -- 172.21.15.8:0/2158437404 learned_addr learned my addr 172.21.15.8:0/2158437404 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:06.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.789+0000 7fa745e00640 1 --2- 172.21.15.8:0/2158437404 >> v2:172.21.15.196:3300/0 conn(0x7fa74814d8b0 0x7fa7480c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:06.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.789+0000 7fa746800640 1 --2- 172.21.15.8:0/2158437404 >> v2:172.21.15.8:3300/0 conn(0x7fa7480c5560 0x7fa74806ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:06.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.789+0000 7fa73fe00640 1 -- 172.21.15.8:0/2158437404 >> v2:172.21.15.196:3300/0 conn(0x7fa74814d8b0 msgr2=0x7fa7480c7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:06.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.789+0000 7fa73fe00640 1 --2- 172.21.15.8:0/2158437404 >> v2:172.21.15.196:3300/0 conn(0x7fa74814d8b0 0x7fa7480c7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:06.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.789+0000 7fa73fe00640 1 -- 172.21.15.8:0/2158437404 >> v2:172.21.15.8:3300/0 conn(0x7fa7480c5560 msgr2=0x7fa74806ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:06.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.789+0000 7fa73fe00640 1 --2- 172.21.15.8:0/2158437404 >> v2:172.21.15.8:3300/0 conn(0x7fa7480c5560 0x7fa74806ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:06.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.789+0000 7fa73fe00640 1 -- 172.21.15.8:0/2158437404 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7481546f0 con 0x7fa748070b50 2024-03-23T23:43:06.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.793+0000 7fa73fe00640 1 --2- 172.21.15.8:0/2158437404 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa748070b50 0x7fa7481541b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa748068f70 tx=0x7fa73001c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=141cd0da8f3484f1 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:06.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.793+0000 7fa745400640 1 -- 172.21.15.8:0/2158437404 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7300b0070 con 0x7fa748070b50 2024-03-23T23:43:06.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.793+0000 7fa745400640 1 -- 172.21.15.8:0/2158437404 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7300ab600 con 0x7fa748070b50 2024-03-23T23:43:06.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.793+0000 7fa745400640 1 -- 172.21.15.8:0/2158437404 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7300ab9d0 con 0x7fa748070b50 2024-03-23T23:43:06.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.793+0000 7fa74cc00640 1 -- 172.21.15.8:0/2158437404 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa748070b50 msgr2=0x7fa7481541b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:06.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.793+0000 7fa74cc00640 1 --2- 172.21.15.8:0/2158437404 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa748070b50 0x7fa7481541b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa748068f70 tx=0x7fa73001c520 comp rx=0 tx=0).stop 2024-03-23T23:43:06.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.793+0000 7fa74cc00640 1 -- 172.21.15.8:0/2158437404 shutdown_connections 2024-03-23T23:43:06.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.793+0000 7fa74cc00640 1 --2- 172.21.15.8:0/2158437404 >> v2:172.21.15.8:3300/0 conn(0x7fa7480c5560 0x7fa74806ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:06.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.793+0000 7fa74cc00640 1 --2- 172.21.15.8:0/2158437404 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa748070b50 0x7fa7481541b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:06.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.793+0000 7fa74cc00640 1 --2- 172.21.15.8:0/2158437404 >> v2:172.21.15.196:3300/0 conn(0x7fa74814d8b0 0x7fa7480c7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:06.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.793+0000 7fa74cc00640 1 -- 172.21.15.8:0/2158437404 >> 172.21.15.8:0/2158437404 conn(0x7fa7480aafe0 msgr2=0x7fa7480ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:06.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.793+0000 7fa74cc00640 1 -- 172.21.15.8:0/2158437404 shutdown_connections 2024-03-23T23:43:06.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.793+0000 7fa74cc00640 1 -- 172.21.15.8:0/2158437404 wait complete. 2024-03-23T23:43:06.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.797+0000 7fa74cc00640 1 Processor -- start 2024-03-23T23:43:06.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.797+0000 7fa74cc00640 1 -- start start 2024-03-23T23:43:06.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.797+0000 7fa74cc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa748070b50 0x7fa7481534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:06.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.797+0000 7fa74cc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7480c5560 0x7fa7481f2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:06.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.797+0000 7fa74cc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa74814d8b0 0x7fa748147080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:06.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.797+0000 7fa74cc00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7480c5af0 con 0x7fa7480c5560 2024-03-23T23:43:06.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.797+0000 7fa74cc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7480c5970 con 0x7fa748070b50 2024-03-23T23:43:06.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.797+0000 7fa74cc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa748157530 con 0x7fa74814d8b0 2024-03-23T23:43:06.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.797+0000 7fa73fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7480c5560 0x7fa7481f2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:06.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.797+0000 7fa73fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7480c5560 0x7fa7481f2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60204/0 (socket says 172.21.15.8:60204) 2024-03-23T23:43:06.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.797+0000 7fa73fe00640 1 -- 172.21.15.8:0/3384478169 learned_addr learned my addr 172.21.15.8:0/3384478169 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:06.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.797+0000 7fa745e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa748070b50 0x7fa7481534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:06.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.797+0000 7fa746800640 1 --2- 172.21.15.8:0/3384478169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa74814d8b0 0x7fa748147080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:06.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.797+0000 7fa73fe00640 1 -- 172.21.15.8:0/3384478169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa74814d8b0 msgr2=0x7fa748147080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:06.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.797+0000 7fa73fe00640 1 --2- 172.21.15.8:0/3384478169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa74814d8b0 0x7fa748147080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:06.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.797+0000 7fa73fe00640 1 -- 172.21.15.8:0/3384478169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa748070b50 msgr2=0x7fa7481534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:06.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.797+0000 7fa73fe00640 1 --2- 172.21.15.8:0/3384478169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa748070b50 0x7fa7481534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:06.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.797+0000 7fa73fe00640 1 -- 172.21.15.8:0/3384478169 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7480c2700 con 0x7fa7480c5560 2024-03-23T23:43:06.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.797+0000 7fa745e00640 1 --2- 172.21.15.8:0/3384478169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa748070b50 0x7fa7481534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:43:06.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.797+0000 7fa73fe00640 1 --2- 172.21.15.8:0/3384478169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7480c5560 0x7fa7481f2490 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa73001cdc0 tx=0x7fa73001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:06.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.797+0000 7fa73e000640 1 -- 172.21.15.8:0/3384478169 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7300ba020 con 0x7fa7480c5560 2024-03-23T23:43:06.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.797+0000 7fa73e000640 1 -- 172.21.15.8:0/3384478169 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7300b6420 con 0x7fa7480c5560 2024-03-23T23:43:06.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.797+0000 7fa74cc00640 1 -- 172.21.15.8:0/3384478169 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa74813f4a0 con 0x7fa7480c5560 2024-03-23T23:43:06.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.797+0000 7fa73e000640 1 -- 172.21.15.8:0/3384478169 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7300b0040 con 0x7fa7480c5560 2024-03-23T23:43:06.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.797+0000 7fa74cc00640 1 -- 172.21.15.8:0/3384478169 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7480c2c50 con 0x7fa7480c5560 2024-03-23T23:43:06.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.801+0000 7fa74cc00640 1 -- 172.21.15.8:0/3384478169 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa748068270 con 0x7fa7480c5560 2024-03-23T23:43:06.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.801+0000 7fa73e000640 1 -- 172.21.15.8:0/3384478169 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fa7300bd020 con 0x7fa7480c5560 2024-03-23T23:43:06.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.801+0000 7fa73e000640 1 --2- 172.21.15.8:0/3384478169 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa724067660 0x7fa724069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:06.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.801+0000 7fa73e000640 1 -- 172.21.15.8:0/3384478169 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fa73011fbb0 con 0x7fa7480c5560 2024-03-23T23:43:06.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.801+0000 7fa745e00640 1 --2- 172.21.15.8:0/3384478169 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa724067660 0x7fa724069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:06.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.801+0000 7fa745e00640 1 --2- 172.21.15.8:0/3384478169 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa724067660 0x7fa724069b20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa738009eb0 tx=0x7fa738009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:06.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:06.809+0000 7fa73e000640 1 -- 172.21.15.8:0/3384478169 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fa7300c4030 con 0x7fa7480c5560 2024-03-23T23:43:07.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.013+0000 7fa74cc00640 1 -- 172.21.15.8:0/3384478169 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7480abd30 con 0x7fa7480c5560 2024-03-23T23:43:07.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.017+0000 7fa73e000640 1 -- 172.21.15.8:0/3384478169 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6245 (secure 0 0 0) 0x7fa7481546f0 con 0x7fa7480c5560 2024-03-23T23:43:07.017 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:43:07.017 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6836/3149325777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3149325777},{"type":"v1","addr":"172.21.15.196:6836","nonce":3149325777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6833/1542162403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1542162403},{"type":"v1","addr":"172.21.15.8:6833","nonce":1542162403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T23:42:40.070799+0000","modified":"2024-03-23T23:42:44.080269+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6837/3402347550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":3402347550},{"type":"v1","addr":"172.21.15.196:6837","nonce":3402347550}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T23:42:50.113972+0000","modified":"2024-03-23T23:42:54.152778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.8:6835/3531853933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3531853933},{"type":"v1","addr":"172.21.15.8:6835","nonce":3531853933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4269,"qdb_cluster":[4269]},"id":2}]} 2024-03-23T23:43:07.018 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 15 2024-03-23T23:43:07.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.017+0000 7fa74cc00640 1 -- 172.21.15.8:0/3384478169 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa724067660 msgr2=0x7fa724069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:07.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.017+0000 7fa74cc00640 1 --2- 172.21.15.8:0/3384478169 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa724067660 0x7fa724069b20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa738009eb0 tx=0x7fa738009190 comp rx=0 tx=0).stop 2024-03-23T23:43:07.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.017+0000 7fa74cc00640 1 -- 172.21.15.8:0/3384478169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7480c5560 msgr2=0x7fa7481f2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:07.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.017+0000 7fa74cc00640 1 --2- 172.21.15.8:0/3384478169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7480c5560 0x7fa7481f2490 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa73001cdc0 tx=0x7fa73001ad60 comp rx=0 tx=0).stop 2024-03-23T23:43:07.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.017+0000 7fa74cc00640 1 -- 172.21.15.8:0/3384478169 shutdown_connections 2024-03-23T23:43:07.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.017+0000 7fa74cc00640 1 --2- 172.21.15.8:0/3384478169 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa724067660 0x7fa724069b20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:07.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.017+0000 7fa74cc00640 1 --2- 172.21.15.8:0/3384478169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa74814d8b0 0x7fa748147080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:07.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.017+0000 7fa74cc00640 1 --2- 172.21.15.8:0/3384478169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7480c5560 0x7fa7481f2490 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:07.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.017+0000 7fa74cc00640 1 --2- 172.21.15.8:0/3384478169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa748070b50 0x7fa7481534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:07.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.017+0000 7fa74cc00640 1 -- 172.21.15.8:0/3384478169 >> 172.21.15.8:0/3384478169 conn(0x7fa7480aafe0 msgr2=0x7fa7480a8f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:07.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.017+0000 7fa74cc00640 1 -- 172.21.15.8:0/3384478169 shutdown_connections 2024-03-23T23:43:07.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.017+0000 7fa74cc00640 1 -- 172.21.15.8:0/3384478169 wait complete. 2024-03-23T23:43:07.038 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:43:07.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.177+0000 7f957d600640 1 Processor -- start 2024-03-23T23:43:07.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.177+0000 7f957d600640 1 -- start start 2024-03-23T23:43:07.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.177+0000 7f957d600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9578152de0 0x7f957806f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:07.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.177+0000 7f957d600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f95780c14a0 0x7f9578155710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:07.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.177+0000 7f957d600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f957806edc0 0x7f9578155c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:07.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.177+0000 7f957d600640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95781531c0 con 0x7f957806edc0 2024-03-23T23:43:07.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.177+0000 7f957d600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95781598b0 con 0x7f95780c14a0 2024-03-23T23:43:07.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.177+0000 7f957d600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9578159b90 con 0x7f9578152de0 2024-03-23T23:43:07.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.177+0000 7f957cc00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f957806edc0 0x7f9578155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:07.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.177+0000 7f9577e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9578152de0 0x7f957806f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:07.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.177+0000 7f957cc00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f957806edc0 0x7f9578155c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60208/0 (socket says 172.21.15.8:60208) 2024-03-23T23:43:07.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.177+0000 7f957cc00640 1 -- 172.21.15.8:0/4136041561 learned_addr learned my addr 172.21.15.8:0/4136041561 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:07.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.177+0000 7f956fe00640 1 --2- 172.21.15.8:0/4136041561 >> v2:172.21.15.196:3300/0 conn(0x7f95780c14a0 0x7f9578155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:07.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.181+0000 7f957cc00640 1 -- 172.21.15.8:0/4136041561 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9578152de0 msgr2=0x7f957806f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:07.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.181+0000 7f957cc00640 1 --2- 172.21.15.8:0/4136041561 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9578152de0 0x7f957806f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:07.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.181+0000 7f957cc00640 1 -- 172.21.15.8:0/4136041561 >> v2:172.21.15.196:3300/0 conn(0x7f95780c14a0 msgr2=0x7f9578155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:07.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.181+0000 7f957cc00640 1 --2- 172.21.15.8:0/4136041561 >> v2:172.21.15.196:3300/0 conn(0x7f95780c14a0 0x7f9578155710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:07.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.181+0000 7f957cc00640 1 -- 172.21.15.8:0/4136041561 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95780c2030 con 0x7f957806edc0 2024-03-23T23:43:07.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.181+0000 7f957cc00640 1 --2- 172.21.15.8:0/4136041561 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f957806edc0 0x7f9578155c50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f95780c2940 tx=0x7f957001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1437bef4609465 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:07.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.181+0000 7f9577400640 1 -- 172.21.15.8:0/4136041561 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95700a56c0 con 0x7f957806edc0 2024-03-23T23:43:07.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.181+0000 7f9577400640 1 -- 172.21.15.8:0/4136041561 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95700a5860 con 0x7f957806edc0 2024-03-23T23:43:07.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.181+0000 7f9577400640 1 -- 172.21.15.8:0/4136041561 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95700a5c30 con 0x7f957806edc0 2024-03-23T23:43:07.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.181+0000 7f957d600640 1 -- 172.21.15.8:0/4136041561 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f957806edc0 msgr2=0x7f9578155c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:07.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.181+0000 7f957d600640 1 --2- 172.21.15.8:0/4136041561 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f957806edc0 0x7f9578155c50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f95780c2940 tx=0x7f957001c930 comp rx=0 tx=0).stop 2024-03-23T23:43:07.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.181+0000 7f957d600640 1 -- 172.21.15.8:0/4136041561 shutdown_connections 2024-03-23T23:43:07.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.181+0000 7f957d600640 1 --2- 172.21.15.8:0/4136041561 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f957806edc0 0x7f9578155c50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:07.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.181+0000 7f957d600640 1 --2- 172.21.15.8:0/4136041561 >> v2:172.21.15.196:3300/0 conn(0x7f95780c14a0 0x7f9578155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:07.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.181+0000 7f957d600640 1 --2- 172.21.15.8:0/4136041561 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9578152de0 0x7f957806f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:07.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.181+0000 7f957d600640 1 -- 172.21.15.8:0/4136041561 >> 172.21.15.8:0/4136041561 conn(0x7f957806c280 msgr2=0x7f957806c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:07.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.185+0000 7f957d600640 1 -- 172.21.15.8:0/4136041561 shutdown_connections 2024-03-23T23:43:07.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.185+0000 7f957d600640 1 -- 172.21.15.8:0/4136041561 wait complete. 2024-03-23T23:43:07.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.185+0000 7f957d600640 1 Processor -- start 2024-03-23T23:43:07.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.185+0000 7f957d600640 1 -- start start 2024-03-23T23:43:07.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.185+0000 7f957d600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f957806edc0 0x7f95780accc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:07.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.185+0000 7f957d600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95780c14a0 0x7f95780c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:07.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.185+0000 7f957d600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9578152de0 0x7f95780c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:07.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.185+0000 7f957d600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957806bd10 con 0x7f9578152de0 2024-03-23T23:43:07.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.185+0000 7f957d600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957806bb90 con 0x7f95780c14a0 2024-03-23T23:43:07.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.185+0000 7f957d600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f957806be90 con 0x7f957806edc0 2024-03-23T23:43:07.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.185+0000 7f957cc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9578152de0 0x7f95780c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:07.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.185+0000 7f957cc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9578152de0 0x7f95780c61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60222/0 (socket says 172.21.15.8:60222) 2024-03-23T23:43:07.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.185+0000 7f957cc00640 1 -- 172.21.15.8:0/2147042631 learned_addr learned my addr 172.21.15.8:0/2147042631 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:07.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.185+0000 7f956fe00640 1 --2- 172.21.15.8:0/2147042631 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95780c14a0 0x7f95780c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:07.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.185+0000 7f9577e00640 1 --2- 172.21.15.8:0/2147042631 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f957806edc0 0x7f95780accc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:07.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.185+0000 7f957cc00640 1 -- 172.21.15.8:0/2147042631 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f957806edc0 msgr2=0x7f95780accc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:07.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.185+0000 7f957cc00640 1 --2- 172.21.15.8:0/2147042631 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f957806edc0 0x7f95780accc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:07.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.185+0000 7f957cc00640 1 -- 172.21.15.8:0/2147042631 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95780c14a0 msgr2=0x7f95780c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:07.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.185+0000 7f957cc00640 1 --2- 172.21.15.8:0/2147042631 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95780c14a0 0x7f95780c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:07.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.185+0000 7f957cc00640 1 -- 172.21.15.8:0/2147042631 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f957814ffc0 con 0x7f9578152de0 2024-03-23T23:43:07.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.185+0000 7f957cc00640 1 --2- 172.21.15.8:0/2147042631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9578152de0 0x7f95780c61a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f957001afe0 tx=0x7f95700196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:07.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.185+0000 7f9574c00640 1 -- 172.21.15.8:0/2147042631 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95700bc020 con 0x7f9578152de0 2024-03-23T23:43:07.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.185+0000 7f9574c00640 1 -- 172.21.15.8:0/2147042631 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95700b8670 con 0x7f9578152de0 2024-03-23T23:43:07.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.185+0000 7f9574c00640 1 -- 172.21.15.8:0/2147042631 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9570009510 con 0x7f9578152de0 2024-03-23T23:43:07.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.185+0000 7f957d600640 1 -- 172.21.15.8:0/2147042631 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95781502a0 con 0x7f9578152de0 2024-03-23T23:43:07.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.189+0000 7f957d600640 1 -- 172.21.15.8:0/2147042631 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f957814e240 con 0x7f9578152de0 2024-03-23T23:43:07.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.189+0000 7f957d600640 1 -- 172.21.15.8:0/2147042631 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f957804f410 con 0x7f9578152de0 2024-03-23T23:43:07.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.189+0000 7f9574c00640 1 -- 172.21.15.8:0/2147042631 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f95700bf020 con 0x7f9578152de0 2024-03-23T23:43:07.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.189+0000 7f9574c00640 1 --2- 172.21.15.8:0/2147042631 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9554067660 0x7f9554069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:07.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.189+0000 7f9574c00640 1 -- 172.21.15.8:0/2147042631 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f95701209c0 con 0x7f9578152de0 2024-03-23T23:43:07.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.189+0000 7f9577e00640 1 --2- 172.21.15.8:0/2147042631 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9554067660 0x7f9554069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:07.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.193+0000 7f9577e00640 1 --2- 172.21.15.8:0/2147042631 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9554067660 0x7f9554069b20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f95780c76a0 tx=0x7f9568009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:07.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.193+0000 7f9574c00640 1 -- 172.21.15.8:0/2147042631 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f95700c6030 con 0x7f9578152de0 2024-03-23T23:43:07.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.537+0000 7f957d600640 1 -- 172.21.15.8:0/2147042631 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95780c36e0 con 0x7f9578152de0 2024-03-23T23:43:07.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.541+0000 7f9574c00640 1 -- 172.21.15.8:0/2147042631 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20271 (secure 0 0 0) 0x7f95700165e0 con 0x7f9578152de0 2024-03-23T23:43:07.541 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:43:07.542 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":25,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","created":"2024-03-23T23:42:15.169430+0000","modified":"2024-03-23T23:42:51.739271+0000","last_up_change":"2024-03-23T23:42:26.509742+0000","last_in_change":"2024-03-23T23:42:17.662330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:42:26.327445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-23T23:42:38.218800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-23T23:42:39.054195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-23T23:42:48.327799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-23T23:42:49.113061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e967bf31-21d6-4d11-bc3d-0df8177a1b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6809","nonce":2187201732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6811","nonce":2187201732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6815","nonce":2187201732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6813","nonce":2187201732}]},"public_addr":"172.21.15.8:6809/2187201732","cluster_addr":"172.21.15.8:6811/2187201732","heartbeat_back_addr":"172.21.15.8:6815/2187201732","heartbeat_front_addr":"172.21.15.8:6813/2187201732","state":["exists","up"]},{"osd":1,"uuid":"c8e33701-7acd-4474-8402-d52461171fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6818","nonce":3205168010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6822","nonce":3205168010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6830","nonce":3205168010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6826","nonce":3205168010}]},"public_addr":"172.21.15.8:6818/3205168010","cluster_addr":"172.21.15.8:6822/3205168010","heartbeat_back_addr":"172.21.15.8:6830/3205168010","heartbeat_front_addr":"172.21.15.8:6826/3205168010","state":["exists","up"]},{"osd":2,"uuid":"ceebdbf7-4c2f-4757-b52d-fd8b20e77570","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6801","nonce":475463656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6803","nonce":475463656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6807","nonce":475463656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6805","nonce":475463656}]},"public_addr":"172.21.15.8:6801/475463656","cluster_addr":"172.21.15.8:6803/475463656","heartbeat_back_addr":"172.21.15.8:6807/475463656","heartbeat_front_addr":"172.21.15.8:6805/475463656","state":["exists","up"]},{"osd":3,"uuid":"89e258da-5767-429e-8441-edf877d2f3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6819","nonce":1514082871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6821","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6823","nonce":1514082871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6829","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6831","nonce":1514082871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6825","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6827","nonce":1514082871}]},"public_addr":"172.21.15.8:6819/1514082871","cluster_addr":"172.21.15.8:6823/1514082871","heartbeat_back_addr":"172.21.15.8:6831/1514082871","heartbeat_front_addr":"172.21.15.8:6827/1514082871","state":["exists","up"]},{"osd":4,"uuid":"2b7451ae-ea16-4f0a-ae50-04fde75e45ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6825","nonce":3516578147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6827","nonce":3516578147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6831","nonce":3516578147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6829","nonce":3516578147}]},"public_addr":"172.21.15.196:6825/3516578147","cluster_addr":"172.21.15.196:6827/3516578147","heartbeat_back_addr":"172.21.15.196:6831/3516578147","heartbeat_front_addr":"172.21.15.196:6829/3516578147","state":["exists","up"]},{"osd":5,"uuid":"e68a8914-e591-466a-bc9e-f2d7c67aac13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6802","nonce":830595758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6806","nonce":830595758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6814","nonce":830595758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6810","nonce":830595758}]},"public_addr":"172.21.15.196:6802/830595758","cluster_addr":"172.21.15.196:6806/830595758","heartbeat_back_addr":"172.21.15.196:6814/830595758","heartbeat_front_addr":"172.21.15.196:6810/830595758","state":["exists","up"]},{"osd":6,"uuid":"e47723c5-50a0-4cd8-92d9-01972072b422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6801","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6803","nonce":472639906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6805","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6807","nonce":472639906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6815","nonce":472639906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6811","nonce":472639906}]},"public_addr":"172.21.15.196:6803/472639906","cluster_addr":"172.21.15.196:6807/472639906","heartbeat_back_addr":"172.21.15.196:6815/472639906","heartbeat_front_addr":"172.21.15.196:6811/472639906","state":["exists","up"]},{"osd":7,"uuid":"e1e9113d-8005-47b3-9a75-9e701199f1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6817","nonce":4151820349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6819","nonce":4151820349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6823","nonce":4151820349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6821","nonce":4151820349}]},"public_addr":"172.21.15.196:6817/4151820349","cluster_addr":"172.21.15.196:6819/4151820349","heartbeat_back_addr":"172.21.15.196:6823/4151820349","heartbeat_front_addr":"172.21.15.196:6821/4151820349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.221790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.265974+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.190319+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.376359+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.329657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.402958+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.300703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.133121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:43:07.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.541+0000 7f957d600640 1 -- 172.21.15.8:0/2147042631 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9554067660 msgr2=0x7f9554069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:07.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.541+0000 7f957d600640 1 --2- 172.21.15.8:0/2147042631 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9554067660 0x7f9554069b20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f95780c76a0 tx=0x7f9568009190 comp rx=0 tx=0).stop 2024-03-23T23:43:07.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.541+0000 7f957d600640 1 -- 172.21.15.8:0/2147042631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9578152de0 msgr2=0x7f95780c61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:07.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.541+0000 7f957d600640 1 --2- 172.21.15.8:0/2147042631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9578152de0 0x7f95780c61a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f957001afe0 tx=0x7f95700196d0 comp rx=0 tx=0).stop 2024-03-23T23:43:07.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.541+0000 7f957d600640 1 -- 172.21.15.8:0/2147042631 shutdown_connections 2024-03-23T23:43:07.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.541+0000 7f957d600640 1 --2- 172.21.15.8:0/2147042631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9578152de0 0x7f95780c61a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:07.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.541+0000 7f957d600640 1 --2- 172.21.15.8:0/2147042631 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95780c14a0 0x7f95780c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:07.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.541+0000 7f957d600640 1 --2- 172.21.15.8:0/2147042631 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9554067660 0x7f9554069b20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:07.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.541+0000 7f957d600640 1 --2- 172.21.15.8:0/2147042631 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f957806edc0 0x7f95780accc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:07.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.541+0000 7f957d600640 1 -- 172.21.15.8:0/2147042631 >> 172.21.15.8:0/2147042631 conn(0x7f957806c280 msgr2=0x7f95781589f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:07.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.541+0000 7f957d600640 1 -- 172.21.15.8:0/2147042631 shutdown_connections 2024-03-23T23:43:07.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.541+0000 7f957d600640 1 -- 172.21.15.8:0/2147042631 wait complete. 2024-03-23T23:43:07.563 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T23:43:07.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.701+0000 7f4077400640 1 Processor -- start 2024-03-23T23:43:07.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.701+0000 7f4077400640 1 -- start start 2024-03-23T23:43:07.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.705+0000 7f4077400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f407006d6e0 0x7f4070155a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:07.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.705+0000 7f4077400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f40700c4e40 0x7f4070155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:07.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.705+0000 7f4077400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40700c4340 con 0x7f40700c8a50 2024-03-23T23:43:07.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.705+0000 7f4077400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40700c4740 con 0x7f407006d6e0 2024-03-23T23:43:07.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.705+0000 7f4077400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40700c4060 con 0x7f40700c4e40 2024-03-23T23:43:07.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.705+0000 7f406fe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f407006d6e0 0x7f4070155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:07.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.705+0000 7f4074a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f40700c8a50 0x7f40700c2660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:45464/0 (socket says 172.21.15.8:45464) 2024-03-23T23:43:07.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.705+0000 7f406fe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f407006d6e0 0x7f4070155a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60230/0 (socket says 172.21.15.8:60230) 2024-03-23T23:43:07.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.705+0000 7f4074a00640 1 -- 172.21.15.8:0/1196528007 learned_addr learned my addr 172.21.15.8:0/1196528007 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:43:07.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.705+0000 7f4075400640 1 --2- 172.21.15.8:0/1196528007 >> v2:172.21.15.196:3300/0 conn(0x7f40700c4e40 0x7f4070155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:07.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.705+0000 7f406fe00640 1 -- 172.21.15.8:0/1196528007 >> v2:172.21.15.196:3300/0 conn(0x7f40700c4e40 msgr2=0x7f4070155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:07.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.705+0000 7f406fe00640 1 --2- 172.21.15.8:0/1196528007 >> v2:172.21.15.196:3300/0 conn(0x7f40700c4e40 0x7f4070155fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:07.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.705+0000 7f406fe00640 1 -- 172.21.15.8:0/1196528007 >> v1:172.21.15.8:6789/0 conn(0x7f40700c8a50 legacy=0x7f40700c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:07.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.705+0000 7f406fe00640 1 -- 172.21.15.8:0/1196528007 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40700c3570 con 0x7f407006d6e0 2024-03-23T23:43:07.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.705+0000 7f4075400640 1 --2- 172.21.15.8:0/1196528007 >> v2:172.21.15.196:3300/0 conn(0x7f40700c4e40 0x7f4070155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:43:07.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.709+0000 7f406fe00640 1 --2- 172.21.15.8:0/1196528007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f407006d6e0 0x7f4070155a60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f407006c100 tx=0x7f405c01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb88316366dee63 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:07.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.709+0000 7f406f400640 1 -- 172.21.15.8:0/1196528007 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c0b0070 con 0x7f407006d6e0 2024-03-23T23:43:07.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.709+0000 7f406f400640 1 -- 172.21.15.8:0/1196528007 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405c0ab600 con 0x7f407006d6e0 2024-03-23T23:43:07.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.709+0000 7f406f400640 1 -- 172.21.15.8:0/1196528007 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c0ab9d0 con 0x7f407006d6e0 2024-03-23T23:43:07.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.709+0000 7f4077400640 1 -- 172.21.15.8:0/1196528007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f407006d6e0 msgr2=0x7f4070155a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:07.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.709+0000 7f4077400640 1 --2- 172.21.15.8:0/1196528007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f407006d6e0 0x7f4070155a60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f407006c100 tx=0x7f405c01c330 comp rx=0 tx=0).stop 2024-03-23T23:43:07.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.709+0000 7f4077400640 1 -- 172.21.15.8:0/1196528007 shutdown_connections 2024-03-23T23:43:07.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.709+0000 7f4077400640 1 --2- 172.21.15.8:0/1196528007 >> v2:172.21.15.196:3300/0 conn(0x7f40700c4e40 0x7f4070155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:07.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.709+0000 7f4077400640 1 --2- 172.21.15.8:0/1196528007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f407006d6e0 0x7f4070155a60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:07.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.709+0000 7f4077400640 1 -- 172.21.15.8:0/1196528007 >> 172.21.15.8:0/1196528007 conn(0x7f40700aafe0 msgr2=0x7f40700ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:07.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.709+0000 7f4077400640 1 -- 172.21.15.8:0/1196528007 shutdown_connections 2024-03-23T23:43:07.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.709+0000 7f4077400640 1 -- 172.21.15.8:0/1196528007 wait complete. 2024-03-23T23:43:07.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.709+0000 7f4077400640 1 Processor -- start 2024-03-23T23:43:07.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.709+0000 7f4077400640 1 -- start start 2024-03-23T23:43:07.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.713+0000 7f4077400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40700c4e40 0x7f407014a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:07.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.713+0000 7f4077400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40700c8a50 0x7f407014f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:07.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.713+0000 7f4077400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f407014fa30 0x7f40701f16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:07.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.713+0000 7f4077400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40700c8e30 con 0x7f407014fa30 2024-03-23T23:43:07.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.713+0000 7f4077400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407006e1e0 con 0x7f40700c4e40 2024-03-23T23:43:07.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.713+0000 7f4077400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4070159f20 con 0x7f40700c8a50 2024-03-23T23:43:07.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.713+0000 7f4075400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f407014fa30 0x7f40701f16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:07.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.713+0000 7f4074a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40700c4e40 0x7f407014a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:07.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.713+0000 7f4075400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f407014fa30 0x7f40701f16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60240/0 (socket says 172.21.15.8:60240) 2024-03-23T23:43:07.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.713+0000 7f406fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40700c8a50 0x7f407014f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:07.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.713+0000 7f4075400640 1 -- 172.21.15.8:0/1574975951 learned_addr learned my addr 172.21.15.8:0/1574975951 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:07.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.713+0000 7f4075400640 1 -- 172.21.15.8:0/1574975951 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40700c8a50 msgr2=0x7f407014f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:07.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.713+0000 7f4075400640 1 --2- 172.21.15.8:0/1574975951 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40700c8a50 0x7f407014f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:07.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.713+0000 7f4075400640 1 -- 172.21.15.8:0/1574975951 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40700c4e40 msgr2=0x7f407014a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:07.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.713+0000 7f4075400640 1 --2- 172.21.15.8:0/1574975951 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40700c4e40 0x7f407014a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:07.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.713+0000 7f4075400640 1 -- 172.21.15.8:0/1574975951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40701573a0 con 0x7f407014fa30 2024-03-23T23:43:07.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.713+0000 7f4074a00640 1 --2- 172.21.15.8:0/1574975951 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40700c4e40 0x7f407014a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:43:07.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.713+0000 7f4075400640 1 --2- 172.21.15.8:0/1574975951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f407014fa30 0x7f40701f16e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f406800efc0 tx=0x7f4068009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:07.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.713+0000 7f406cc00640 1 -- 172.21.15.8:0/1574975951 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4068018030 con 0x7f407014fa30 2024-03-23T23:43:07.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.713+0000 7f406cc00640 1 -- 172.21.15.8:0/1574975951 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406800cd20 con 0x7f407014fa30 2024-03-23T23:43:07.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.713+0000 7f406cc00640 1 -- 172.21.15.8:0/1574975951 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4068003bc0 con 0x7f407014fa30 2024-03-23T23:43:07.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.713+0000 7f4077400640 1 -- 172.21.15.8:0/1574975951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4070159860 con 0x7f407014fa30 2024-03-23T23:43:07.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.713+0000 7f4077400640 1 -- 172.21.15.8:0/1574975951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f407014ad50 con 0x7f407014fa30 2024-03-23T23:43:07.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.713+0000 7f4077400640 1 -- 172.21.15.8:0/1574975951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4070068270 con 0x7f407014fa30 2024-03-23T23:43:07.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.717+0000 7f406cc00640 1 -- 172.21.15.8:0/1574975951 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f406801b070 con 0x7f407014fa30 2024-03-23T23:43:07.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.717+0000 7f406cc00640 1 --2- 172.21.15.8:0/1574975951 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4050067660 0x7f4050069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:07.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.717+0000 7f406cc00640 1 -- 172.21.15.8:0/1574975951 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f4068086440 con 0x7f407014fa30 2024-03-23T23:43:07.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.717+0000 7f4074a00640 1 --2- 172.21.15.8:0/1574975951 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4050067660 0x7f4050069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:07.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.717+0000 7f4074a00640 1 --2- 172.21.15.8:0/1574975951 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4050067660 0x7f4050069b20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4064000f70 tx=0x7f4064007e90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:07.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.721+0000 7f406cc00640 1 -- 172.21.15.8:0/1574975951 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f4068010040 con 0x7f407014fa30 2024-03-23T23:43:07.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.917+0000 7f4077400640 1 -- 172.21.15.8:0/1574975951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40700c8fb0 con 0x7f407014fa30 2024-03-23T23:43:07.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.921+0000 7f406cc00640 1 -- 172.21.15.8:0/1574975951 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6245 (secure 0 0 0) 0x7f4068056730 con 0x7f407014fa30 2024-03-23T23:43:07.921 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:43:07.921 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6836/3149325777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3149325777},{"type":"v1","addr":"172.21.15.196:6836","nonce":3149325777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6833/1542162403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1542162403},{"type":"v1","addr":"172.21.15.8:6833","nonce":1542162403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T23:42:40.070799+0000","modified":"2024-03-23T23:42:44.080269+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6837/3402347550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":3402347550},{"type":"v1","addr":"172.21.15.196:6837","nonce":3402347550}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T23:42:50.113972+0000","modified":"2024-03-23T23:42:54.152778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.8:6835/3531853933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3531853933},{"type":"v1","addr":"172.21.15.8:6835","nonce":3531853933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4269,"qdb_cluster":[4269]},"id":2}]} 2024-03-23T23:43:07.922 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 15 2024-03-23T23:43:07.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.921+0000 7f4077400640 1 -- 172.21.15.8:0/1574975951 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4050067660 msgr2=0x7f4050069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:07.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.921+0000 7f4077400640 1 --2- 172.21.15.8:0/1574975951 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4050067660 0x7f4050069b20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4064000f70 tx=0x7f4064007e90 comp rx=0 tx=0).stop 2024-03-23T23:43:07.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.921+0000 7f4077400640 1 -- 172.21.15.8:0/1574975951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f407014fa30 msgr2=0x7f40701f16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:07.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.921+0000 7f4077400640 1 --2- 172.21.15.8:0/1574975951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f407014fa30 0x7f40701f16e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f406800efc0 tx=0x7f4068009f90 comp rx=0 tx=0).stop 2024-03-23T23:43:07.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.921+0000 7f4077400640 1 -- 172.21.15.8:0/1574975951 shutdown_connections 2024-03-23T23:43:07.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.921+0000 7f4077400640 1 --2- 172.21.15.8:0/1574975951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f407014fa30 0x7f40701f16e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:07.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.921+0000 7f4077400640 1 --2- 172.21.15.8:0/1574975951 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4050067660 0x7f4050069b20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:07.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.921+0000 7f4077400640 1 --2- 172.21.15.8:0/1574975951 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40700c8a50 0x7f407014f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:07.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.921+0000 7f4077400640 1 --2- 172.21.15.8:0/1574975951 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40700c4e40 0x7f407014a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:07.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.921+0000 7f4077400640 1 -- 172.21.15.8:0/1574975951 >> 172.21.15.8:0/1574975951 conn(0x7f40700aafe0 msgr2=0x7f40701538d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:07.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.921+0000 7f4077400640 1 -- 172.21.15.8:0/1574975951 shutdown_connections 2024-03-23T23:43:07.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:07.921+0000 7f4077400640 1 -- 172.21.15.8:0/1574975951 wait complete. 2024-03-23T23:43:08.345 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-23T23:42:40.070799+0000', 'modified': '2024-03-23T23:42:44.080269+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4294': {'gid': 4294, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.196:6837/3402347550', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6835', 'nonce': 3402347550}, {'type': 'v1', 'addr': '172.21.15.196:6837', 'nonce': 3402347550}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'a', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4294, 'qdb_cluster': [4294]} 2024-03-23T23:43:08.345 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-23T23:43:08.345 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-03-23T23:43:08.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.485+0000 7f3825a00640 1 Processor -- start 2024-03-23T23:43:08.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.485+0000 7f3825a00640 1 -- start start 2024-03-23T23:43:08.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.489+0000 7f3825a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38200c8a50 0x7f38200c2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:08.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.489+0000 7f3825a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f38200c2ba0 0x7f3820160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:08.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.489+0000 7f3825a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38200c4340 con 0x7f382006d6e0 2024-03-23T23:43:08.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.489+0000 7f3825a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38200c4740 con 0x7f38200c2ba0 2024-03-23T23:43:08.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.489+0000 7f3825a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38200c4060 con 0x7f38200c8a50 2024-03-23T23:43:08.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.489+0000 7f3817e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f382006d6e0 0x7f3820155a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:45480/0 (socket says 172.21.15.8:45480) 2024-03-23T23:43:08.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.489+0000 7f3817e00640 1 -- 172.21.15.8:0/2795871537 learned_addr learned my addr 172.21.15.8:0/2795871537 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:43:08.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.489+0000 7f381ea00640 1 --2- 172.21.15.8:0/2795871537 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38200c8a50 0x7f38200c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:08.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.489+0000 7f381f400640 1 --2- 172.21.15.8:0/2795871537 >> v2:172.21.15.196:3300/0 conn(0x7f38200c2ba0 0x7f3820160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:08.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.489+0000 7f381e000640 1 -- 172.21.15.8:0/2795871537 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 533866461 0 0) 0x7f38200c4340 con 0x7f382006d6e0 2024-03-23T23:43:08.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.489+0000 7f381e000640 1 -- 172.21.15.8:0/2795871537 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3804003530 con 0x7f382006d6e0 2024-03-23T23:43:08.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.489+0000 7f381f400640 1 -- 172.21.15.8:0/2795871537 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38200c8a50 msgr2=0x7f38200c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:08.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.489+0000 7f381f400640 1 --2- 172.21.15.8:0/2795871537 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38200c8a50 0x7f38200c2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.489+0000 7f381f400640 1 -- 172.21.15.8:0/2795871537 >> v1:172.21.15.8:6789/0 conn(0x7f382006d6e0 legacy=0x7f3820155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:08.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.489+0000 7f381f400640 1 -- 172.21.15.8:0/2795871537 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38200c3570 con 0x7f38200c2ba0 2024-03-23T23:43:08.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.489+0000 7f381f400640 1 --2- 172.21.15.8:0/2795871537 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38200c2ba0 0x7f3820160300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3818009d90 tx=0x7f381801c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=998ead0b65cd50e1 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:08.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.493+0000 7f381e000640 1 -- 172.21.15.8:0/2795871537 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38180b2070 con 0x7f38200c2ba0 2024-03-23T23:43:08.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.493+0000 7f381e000640 1 -- 172.21.15.8:0/2795871537 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38180a5970 con 0x7f38200c2ba0 2024-03-23T23:43:08.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.493+0000 7f381e000640 1 -- 172.21.15.8:0/2795871537 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38180a5d40 con 0x7f38200c2ba0 2024-03-23T23:43:08.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.493+0000 7f3825a00640 1 -- 172.21.15.8:0/2795871537 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38200c2ba0 msgr2=0x7f3820160300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:08.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.493+0000 7f3825a00640 1 --2- 172.21.15.8:0/2795871537 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38200c2ba0 0x7f3820160300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3818009d90 tx=0x7f381801c8b0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.493+0000 7f3825a00640 1 -- 172.21.15.8:0/2795871537 shutdown_connections 2024-03-23T23:43:08.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.493+0000 7f3825a00640 1 --2- 172.21.15.8:0/2795871537 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38200c2ba0 0x7f3820160300 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.493+0000 7f3825a00640 1 --2- 172.21.15.8:0/2795871537 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38200c8a50 0x7f38200c2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.493+0000 7f3825a00640 1 -- 172.21.15.8:0/2795871537 >> 172.21.15.8:0/2795871537 conn(0x7f38200aafe0 msgr2=0x7f38200ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:08.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.493+0000 7f3825a00640 1 -- 172.21.15.8:0/2795871537 shutdown_connections 2024-03-23T23:43:08.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.493+0000 7f3825a00640 1 -- 172.21.15.8:0/2795871537 wait complete. 2024-03-23T23:43:08.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.493+0000 7f3825a00640 1 Processor -- start 2024-03-23T23:43:08.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.493+0000 7f3825a00640 1 -- start start 2024-03-23T23:43:08.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.493+0000 7f3825a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38200c2ba0 0x7f382014d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:08.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.493+0000 7f3825a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38200c8a50 0x7f382014b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:08.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.493+0000 7f3825a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3820143af0 0x7f38200aa050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:08.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.493+0000 7f3825a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382006e360 con 0x7f38200c8a50 2024-03-23T23:43:08.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.493+0000 7f3825a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382006e1e0 con 0x7f38200c2ba0 2024-03-23T23:43:08.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.493+0000 7f3825a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3820156170 con 0x7f3820143af0 2024-03-23T23:43:08.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.493+0000 7f3817e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38200c8a50 0x7f382014b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:08.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.493+0000 7f3817e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38200c8a50 0x7f382014b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60248/0 (socket says 172.21.15.8:60248) 2024-03-23T23:43:08.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.493+0000 7f3817e00640 1 -- 172.21.15.8:0/2618103025 learned_addr learned my addr 172.21.15.8:0/2618103025 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:08.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.493+0000 7f381ea00640 1 --2- 172.21.15.8:0/2618103025 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38200c2ba0 0x7f382014d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:08.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.493+0000 7f381f400640 1 --2- 172.21.15.8:0/2618103025 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3820143af0 0x7f38200aa050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:08.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.497+0000 7f3817e00640 1 -- 172.21.15.8:0/2618103025 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3820143af0 msgr2=0x7f38200aa050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:08.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.497+0000 7f3817e00640 1 --2- 172.21.15.8:0/2618103025 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3820143af0 0x7f38200aa050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.497+0000 7f3817e00640 1 -- 172.21.15.8:0/2618103025 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38200c2ba0 msgr2=0x7f382014d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:08.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.497+0000 7f3817e00640 1 --2- 172.21.15.8:0/2618103025 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38200c2ba0 0x7f382014d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.497+0000 7f3817e00640 1 -- 172.21.15.8:0/2618103025 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382014e6e0 con 0x7f38200c8a50 2024-03-23T23:43:08.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.497+0000 7f381ea00640 1 --2- 172.21.15.8:0/2618103025 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38200c2ba0 0x7f382014d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:43:08.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.497+0000 7f3817e00640 1 --2- 172.21.15.8:0/2618103025 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38200c8a50 0x7f382014b640 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f380800c450 tx=0x7f380800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:08.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.497+0000 7f3816a00640 1 -- 172.21.15.8:0/2618103025 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3808017070 con 0x7f38200c8a50 2024-03-23T23:43:08.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.497+0000 7f3816a00640 1 -- 172.21.15.8:0/2618103025 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3808005cf0 con 0x7f38200c8a50 2024-03-23T23:43:08.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.497+0000 7f3816a00640 1 -- 172.21.15.8:0/2618103025 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3808007290 con 0x7f38200c8a50 2024-03-23T23:43:08.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.497+0000 7f3825a00640 1 -- 172.21.15.8:0/2618103025 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f382014e400 con 0x7f38200c8a50 2024-03-23T23:43:08.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.497+0000 7f3825a00640 1 -- 172.21.15.8:0/2618103025 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f382014bb80 con 0x7f38200c8a50 2024-03-23T23:43:08.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.497+0000 7f3816a00640 1 -- 172.21.15.8:0/2618103025 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f380801a070 con 0x7f38200c8a50 2024-03-23T23:43:08.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.497+0000 7f3816a00640 1 --2- 172.21.15.8:0/2618103025 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f37fc067660 0x7f37fc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:08.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.497+0000 7f3816a00640 1 -- 172.21.15.8:0/2618103025 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f3808084f50 con 0x7f38200c8a50 2024-03-23T23:43:08.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f3828e8a000 1 Processor -- start 2024-03-23T23:43:08.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f381ea00640 1 --2- 172.21.15.8:0/2618103025 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f37fc067660 0x7f37fc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:08.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f3828e8a000 1 -- start start 2024-03-23T23:43:08.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f381ea00640 1 --2- 172.21.15.8:0/2618103025 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f37fc067660 0x7f37fc069b20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3810009eb0 tx=0x7f3810009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:08.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f3828e8a000 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5596ec4ecfb0 0x5596ec4ed390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:08.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f3828e8a000 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5596ec4ed8d0 0x5596ec4edcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:08.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f3828e8a000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5596ec4ee1f0 0x5596ec5378d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:08.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f3828e8a000 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596ec33d680 con 0x5596ec4ed8d0 2024-03-23T23:43:08.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f3828e8a000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596ec2c4b00 con 0x5596ec4ee1f0 2024-03-23T23:43:08.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f3828e8a000 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596ec339720 con 0x5596ec4ecfb0 2024-03-23T23:43:08.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f3817e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5596ec4ed8d0 0x5596ec4edcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:08.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f381ea00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5596ec4ecfb0 0x5596ec4ed390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:08.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f3817e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5596ec4ed8d0 0x5596ec4edcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60250/0 (socket says 172.21.15.8:60250) 2024-03-23T23:43:08.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f381ea00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5596ec4ecfb0 0x5596ec4ed390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:58546/0 (socket says 172.21.15.8:58546) 2024-03-23T23:43:08.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f3817e00640 1 -- 172.21.15.8:0/1006983855 learned_addr learned my addr 172.21.15.8:0/1006983855 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:08.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f381f400640 1 --2- 172.21.15.8:0/1006983855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5596ec4ee1f0 0x5596ec5378d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:08.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f3817e00640 1 -- 172.21.15.8:0/1006983855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5596ec4ecfb0 msgr2=0x5596ec4ed390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:08.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f3817e00640 1 --2- 172.21.15.8:0/1006983855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5596ec4ecfb0 0x5596ec4ed390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f3817e00640 1 -- 172.21.15.8:0/1006983855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5596ec4ee1f0 msgr2=0x5596ec5378d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:08.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f3817e00640 1 --2- 172.21.15.8:0/1006983855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5596ec4ee1f0 0x5596ec5378d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f3817e00640 1 -- 172.21.15.8:0/1006983855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596ec315940 con 0x5596ec4ed8d0 2024-03-23T23:43:08.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f381ea00640 1 --2- 172.21.15.8:0/1006983855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5596ec4ecfb0 0x5596ec4ed390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:43:08.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f3817e00640 1 --2- 172.21.15.8:0/1006983855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5596ec4ed8d0 0x5596ec4edcb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3808007fd0 tx=0x7f3808055380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ede7b9425c5f55 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:08.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f380f400640 1 -- 172.21.15.8:0/1006983855 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3808053540 con 0x5596ec4ed8d0 2024-03-23T23:43:08.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f380f400640 1 -- 172.21.15.8:0/1006983855 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38080518b0 con 0x5596ec4ed8d0 2024-03-23T23:43:08.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f380f400640 1 -- 172.21.15.8:0/1006983855 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380805d650 con 0x5596ec4ed8d0 2024-03-23T23:43:08.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f3828e8a000 1 -- 172.21.15.8:0/1006983855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5596ec4ed8d0 msgr2=0x5596ec4edcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:08.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f3828e8a000 1 --2- 172.21.15.8:0/1006983855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5596ec4ed8d0 0x5596ec4edcb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3808007fd0 tx=0x7f3808055380 comp rx=0 tx=0).stop 2024-03-23T23:43:08.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f3828e8a000 1 -- 172.21.15.8:0/1006983855 shutdown_connections 2024-03-23T23:43:08.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f3828e8a000 1 --2- 172.21.15.8:0/1006983855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5596ec4ee1f0 0x5596ec5378d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f3828e8a000 1 --2- 172.21.15.8:0/1006983855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5596ec4ed8d0 0x5596ec4edcb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f3828e8a000 1 --2- 172.21.15.8:0/1006983855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5596ec4ecfb0 0x5596ec4ed390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f3828e8a000 1 -- 172.21.15.8:0/1006983855 >> 172.21.15.8:0/1006983855 conn(0x5596ec52b630 msgr2=0x5596ec52da50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:08.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f3828e8a000 1 -- 172.21.15.8:0/1006983855 shutdown_connections 2024-03-23T23:43:08.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f3828e8a000 1 -- 172.21.15.8:0/1006983855 wait complete. 2024-03-23T23:43:08.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.501+0000 7f3828e8a000 1 -- start start 2024-03-23T23:43:08.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f3828e8a000 1 Processor -- start 2024-03-23T23:43:08.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f3828e8a000 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5596ec4ecfb0 0x5596ec4f2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:08.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f3828e8a000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5596ec4ed8d0 0x5596ec4f3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:08.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f3828e8a000 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5596ec4ee1f0 0x5596ec4f3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:08.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f3828e8a000 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596ec309ff0 con 0x5596ec4ecfb0 2024-03-23T23:43:08.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f3828e8a000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596ec2f7ae0 con 0x5596ec4ed8d0 2024-03-23T23:43:08.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f3828e8a000 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596ec2e5a80 con 0x5596ec4ee1f0 2024-03-23T23:43:08.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f3828e8a000 10 client.0 _ll_register_callbacks cb 0x5596ec4daff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-23T23:43:08.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f381ea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5596ec4ecfb0 0x5596ec4f2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:08.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f3817e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5596ec4ed8d0 0x5596ec4f3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:08.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f381ea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5596ec4ecfb0 0x5596ec4f2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60254/0 (socket says 172.21.15.8:60254) 2024-03-23T23:43:08.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f381ea00640 1 -- 172.21.15.8:0/4044077222 learned_addr learned my addr 172.21.15.8:0/4044077222 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:08.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f381f400640 1 --2- 172.21.15.8:0/4044077222 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5596ec4ee1f0 0x5596ec4f3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:08.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f3817e00640 1 -- 172.21.15.8:0/4044077222 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5596ec4ee1f0 msgr2=0x5596ec4f3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:08.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f3817e00640 1 --2- 172.21.15.8:0/4044077222 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5596ec4ee1f0 0x5596ec4f3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f3817e00640 1 -- 172.21.15.8:0/4044077222 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5596ec4ecfb0 msgr2=0x5596ec4f2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:08.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f3817e00640 1 --2- 172.21.15.8:0/4044077222 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5596ec4ecfb0 0x5596ec4f2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f3817e00640 1 -- 172.21.15.8:0/4044077222 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5596ec382d80 con 0x5596ec4ed8d0 2024-03-23T23:43:08.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f3817e00640 1 --2- 172.21.15.8:0/4044077222 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5596ec4ed8d0 0x5596ec4f3310 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3808054f40 tx=0x7f3808000bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e4c746681aacbeb server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:08.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f3803e00640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-03-23T23:43:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f3803e00640 1 -- 172.21.15.8:0/4044077222 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3808054890 con 0x5596ec4ed8d0 2024-03-23T23:43:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f3803e00640 1 -- 172.21.15.8:0/4044077222 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f3808071de0 con 0x5596ec4ed8d0 2024-03-23T23:43:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f3828e8a000 1 -- 172.21.15.8:0/4044077222 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f38080518b0 con 0x5596ec4ed8d0 2024-03-23T23:43:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f3803e00640 1 -- 172.21.15.8:0/4044077222 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3808007430 con 0x5596ec4ed8d0 2024-03-23T23:43:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f3828e8a000 10 client.4786 fetch_fsmap learned FSMap version 15 2024-03-23T23:43:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f3828e8a000 1 -- 172.21.15.8:0/4044077222 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x5596ec2c4d10 con 0x5596ec4ed8d0 2024-03-23T23:43:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f3803e00640 1 -- 172.21.15.8:0/4044077222 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38080518b0 con 0x5596ec4ed8d0 2024-03-23T23:43:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f3803e00640 1 -- 172.21.15.8:0/4044077222 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 15) v1 ==== 3918+0+0 (secure 0 0 0) 0x7f38080075d0 con 0x5596ec4ed8d0 2024-03-23T23:43:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f3828e8a000 10 client.4786 fetch_fsmap finished waiting for FSMap version 15 2024-03-23T23:43:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f3828e8a000 10 client.4786 resolve_mds: resolved name 'd' to daemon mds.d 2024-03-23T23:43:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f3828e8a000 20 client.4786 populate_metadata read hostname 'smithi008' 2024-03-23T23:43:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f3828e8a000 1 --2- 172.21.15.8:0/4044077222 >> [v2:172.21.15.196:6835/3402347550,v1:172.21.15.196:6837/3402347550] conn(0x5596ec540c40 0x5596ec543030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f3828e8a000 4 client.4786 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-23T23:43:08.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f3828e8a000 1 -- 172.21.15.8:0/4044077222 --> [v2:172.21.15.196:6835/3402347550,v1:172.21.15.196:6837/3402347550] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5596ec2d8b60 con 0x5596ec540c40 2024-03-23T23:43:08.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.505+0000 7f381ea00640 1 --2- 172.21.15.8:0/4044077222 >> [v2:172.21.15.196:6835/3402347550,v1:172.21.15.196:6837/3402347550] conn(0x5596ec540c40 0x5596ec543030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:08.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.509+0000 7f3803e00640 10 client.4786 ms_handle_connect on v2:172.21.15.196:6835/3402347550 2024-03-23T23:43:08.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.509+0000 7f381ea00640 1 --2- 172.21.15.8:0/4044077222 >> [v2:172.21.15.196:6835/3402347550,v1:172.21.15.196:6837/3402347550] conn(0x5596ec540c40 0x5596ec543030 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b097af60aaf1cc server_cookie=76d879e720f633ec in_seq=0 out_seq=0 2024-03-23T23:43:08.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.509+0000 7f3803e00640 1 -- 172.21.15.8:0/4044077222 <== mds.0 v2:172.21.15.196:6835/3402347550 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5596ec2d8b60 con 0x5596ec540c40 2024-03-23T23:43:08.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.509+0000 7f3803e00640 10 client.4786 handle_command_reply: tid=0 2024-03-23T23:43:08.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.509+0000 7f3828e8a000 1 client.4786 shutdown 2024-03-23T23:43:08.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.509+0000 7f3828e8a000 1 -- 172.21.15.8:0/4044077222 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5596ec4ed8d0 msgr2=0x5596ec4f3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:08.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.509+0000 7f3828e8a000 1 --2- 172.21.15.8:0/4044077222 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5596ec4ed8d0 0x5596ec4f3310 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3808054f40 tx=0x7f3808000bd0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.509+0000 7f3828e8a000 1 -- 172.21.15.8:0/4044077222 shutdown_connections 2024-03-23T23:43:08.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.509+0000 7f3828e8a000 1 --2- 172.21.15.8:0/4044077222 >> [v2:172.21.15.196:6835/3402347550,v1:172.21.15.196:6837/3402347550] conn(0x5596ec540c40 0x5596ec543030 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.509+0000 7f3828e8a000 1 --2- 172.21.15.8:0/4044077222 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5596ec4ee1f0 0x5596ec4f3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.509+0000 7f3828e8a000 1 --2- 172.21.15.8:0/4044077222 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5596ec4ed8d0 0x5596ec4f3310 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.509+0000 7f3828e8a000 1 --2- 172.21.15.8:0/4044077222 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5596ec4ecfb0 0x5596ec4f2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.509+0000 7f3803e00640 0 client.4786 ms_handle_reset on v2:172.21.15.196:6835/3402347550 2024-03-23T23:43:08.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.509+0000 7f3828e8a000 1 -- 172.21.15.8:0/4044077222 >> 172.21.15.8:0/4044077222 conn(0x5596ec52b630 msgr2=0x5596ec4ec6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:08.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.509+0000 7f3828e8a000 1 -- 172.21.15.8:0/4044077222 shutdown_connections 2024-03-23T23:43:08.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.509+0000 7f3828e8a000 1 -- 172.21.15.8:0/4044077222 wait complete. 2024-03-23T23:43:08.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.509+0000 7f3828e8a000 20 client.4786 trim_cache size 0 max 16384 2024-03-23T23:43:08.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.525+0000 7f3828e8a000 1 Processor -- start 2024-03-23T23:43:08.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.525+0000 7f3828e8a000 1 -- start start 2024-03-23T23:43:08.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.525+0000 7f3828e8a000 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5596ec4ecfb0 0x5596ec545e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:08.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.525+0000 7f3828e8a000 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5596ec4ed8d0 0x5596ec541020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:08.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.525+0000 7f3828e8a000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5596ec4ee1f0 0x5596ec541560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:08.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.525+0000 7f3828e8a000 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38201fdaa0 con 0x5596ec4ed8d0 2024-03-23T23:43:08.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.525+0000 7f3828e8a000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38201fb770 con 0x5596ec4ee1f0 2024-03-23T23:43:08.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.525+0000 7f3828e8a000 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38201fbd70 con 0x5596ec4ecfb0 2024-03-23T23:43:08.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.525+0000 7f3817e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5596ec4ed8d0 0x5596ec541020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:08.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.525+0000 7f3817e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5596ec4ed8d0 0x5596ec541020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60256/0 (socket says 172.21.15.8:60256) 2024-03-23T23:43:08.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.525+0000 7f3817e00640 1 -- 172.21.15.8:0/2622549469 learned_addr learned my addr 172.21.15.8:0/2622549469 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:08.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.525+0000 7f381f400640 1 --2- 172.21.15.8:0/2622549469 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5596ec4ee1f0 0x5596ec541560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:08.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.525+0000 7f381ea00640 1 --2- 172.21.15.8:0/2622549469 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5596ec4ecfb0 0x5596ec545e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:08.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f3817e00640 1 -- 172.21.15.8:0/2622549469 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5596ec4ecfb0 msgr2=0x5596ec545e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:08.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f3817e00640 1 --2- 172.21.15.8:0/2622549469 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5596ec4ecfb0 0x5596ec545e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f3817e00640 1 -- 172.21.15.8:0/2622549469 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5596ec4ee1f0 msgr2=0x5596ec541560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:08.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f3817e00640 1 --2- 172.21.15.8:0/2622549469 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5596ec4ee1f0 0x5596ec541560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f3817e00640 1 -- 172.21.15.8:0/2622549469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596ec30a540 con 0x5596ec4ed8d0 2024-03-23T23:43:08.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f381f400640 1 --2- 172.21.15.8:0/2622549469 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5596ec4ee1f0 0x5596ec541560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:43:08.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f3817e00640 1 --2- 172.21.15.8:0/2622549469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5596ec4ed8d0 0x5596ec541020 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f380805b2c0 tx=0x7f380807e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f6d8c5004b34f1 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:08.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f380ea00640 1 -- 172.21.15.8:0/2622549469 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3808054690 con 0x5596ec4ed8d0 2024-03-23T23:43:08.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f380ea00640 1 -- 172.21.15.8:0/2622549469 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3808080070 con 0x5596ec4ed8d0 2024-03-23T23:43:08.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f380ea00640 1 -- 172.21.15.8:0/2622549469 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380805b340 con 0x5596ec4ed8d0 2024-03-23T23:43:08.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f3828e8a000 1 -- 172.21.15.8:0/2622549469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5596ec4ed8d0 msgr2=0x5596ec541020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:08.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f3828e8a000 1 --2- 172.21.15.8:0/2622549469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5596ec4ed8d0 0x5596ec541020 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f380805b2c0 tx=0x7f380807e070 comp rx=0 tx=0).stop 2024-03-23T23:43:08.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f3828e8a000 1 -- 172.21.15.8:0/2622549469 shutdown_connections 2024-03-23T23:43:08.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f3828e8a000 1 --2- 172.21.15.8:0/2622549469 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5596ec4ee1f0 0x5596ec541560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f3828e8a000 1 --2- 172.21.15.8:0/2622549469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5596ec4ed8d0 0x5596ec541020 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f3828e8a000 1 --2- 172.21.15.8:0/2622549469 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5596ec4ecfb0 0x5596ec545e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f3828e8a000 1 -- 172.21.15.8:0/2622549469 >> 172.21.15.8:0/2622549469 conn(0x5596ec52b630 msgr2=0x5596ec4ebfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:08.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f3828e8a000 1 -- 172.21.15.8:0/2622549469 shutdown_connections 2024-03-23T23:43:08.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f3828e8a000 1 -- 172.21.15.8:0/2622549469 wait complete. 2024-03-23T23:43:08.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f3828e8a000 1 -- start start 2024-03-23T23:43:08.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f3828e8a000 1 Processor -- start 2024-03-23T23:43:08.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f3828e8a000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5596ec4ecfb0 0x5596ec544350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:08.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f3828e8a000 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5596ec4ed8d0 0x5596ec544890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:08.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f3828e8a000 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5596ec4ee1f0 0x5596ec544dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:08.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f3828e8a000 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596ec33c990 con 0x5596ec4ee1f0 2024-03-23T23:43:08.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f3828e8a000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596ec3fa700 con 0x5596ec4ecfb0 2024-03-23T23:43:08.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f3828e8a000 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596ec2d5750 con 0x5596ec4ed8d0 2024-03-23T23:43:08.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f3828e8a000 10 client.0 _ll_register_callbacks cb 0x7f3804003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-23T23:43:08.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f381f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5596ec4ee1f0 0x5596ec544dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:08.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f381f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5596ec4ee1f0 0x5596ec544dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60272/0 (socket says 172.21.15.8:60272) 2024-03-23T23:43:08.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f381f400640 1 -- 172.21.15.8:0/3164826148 learned_addr learned my addr 172.21.15.8:0/3164826148 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:08.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f3817e00640 1 --2- 172.21.15.8:0/3164826148 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5596ec4ed8d0 0x5596ec544890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:08.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.529+0000 7f381ea00640 1 --2- 172.21.15.8:0/3164826148 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5596ec4ecfb0 0x5596ec544350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:08.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f381f400640 1 -- 172.21.15.8:0/3164826148 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5596ec4ed8d0 msgr2=0x5596ec544890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:08.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f381f400640 1 --2- 172.21.15.8:0/3164826148 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5596ec4ed8d0 0x5596ec544890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f381f400640 1 -- 172.21.15.8:0/3164826148 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5596ec4ecfb0 msgr2=0x5596ec544350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:08.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f381f400640 1 --2- 172.21.15.8:0/3164826148 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5596ec4ecfb0 0x5596ec544350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f381f400640 1 -- 172.21.15.8:0/3164826148 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5596ec2d14b0 con 0x5596ec4ee1f0 2024-03-23T23:43:08.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f381f400640 1 --2- 172.21.15.8:0/3164826148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5596ec4ee1f0 0x5596ec544dd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f381801cd90 tx=0x7f381801b0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe20a65a2ac0580 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:08.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3803e00640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-23T23:43:08.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3803e00640 1 -- 172.21.15.8:0/3164826148 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38180b2040 con 0x5596ec4ee1f0 2024-03-23T23:43:08.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3803e00640 1 -- 172.21.15.8:0/3164826148 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f38180c6e00 con 0x5596ec4ee1f0 2024-03-23T23:43:08.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3828e8a000 1 -- 172.21.15.8:0/3164826148 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3808080070 con 0x5596ec4ee1f0 2024-03-23T23:43:08.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3803e00640 1 -- 172.21.15.8:0/3164826148 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38180a5a40 con 0x5596ec4ee1f0 2024-03-23T23:43:08.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3828e8a000 10 client.4809 fetch_fsmap learned FSMap version 15 2024-03-23T23:43:08.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3828e8a000 1 -- 172.21.15.8:0/3164826148 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x5596ec2e42f0 con 0x5596ec4ee1f0 2024-03-23T23:43:08.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3803e00640 1 -- 172.21.15.8:0/3164826148 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3808080070 con 0x5596ec4ee1f0 2024-03-23T23:43:08.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3803e00640 1 -- 172.21.15.8:0/3164826148 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 15) v1 ==== 3918+0+0 (secure 0 0 0) 0x7f38180a5be0 con 0x5596ec4ee1f0 2024-03-23T23:43:08.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3828e8a000 10 client.4809 fetch_fsmap finished waiting for FSMap version 15 2024-03-23T23:43:08.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3828e8a000 10 client.4809 resolve_mds: resolved name 'd' to daemon mds.d 2024-03-23T23:43:08.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3828e8a000 20 client.4809 populate_metadata read hostname 'smithi008' 2024-03-23T23:43:08.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3828e8a000 1 --2- 172.21.15.8:0/3164826148 >> [v2:172.21.15.196:6835/3402347550,v1:172.21.15.196:6837/3402347550] conn(0x5596ec59cb90 0x5596ec59ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:08.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3828e8a000 4 client.4809 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-23T23:43:08.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3828e8a000 1 -- 172.21.15.8:0/3164826148 --> [v2:172.21.15.196:6835/3402347550,v1:172.21.15.196:6837/3402347550] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5596ec34abc0 con 0x5596ec59cb90 2024-03-23T23:43:08.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f381ea00640 1 --2- 172.21.15.8:0/3164826148 >> [v2:172.21.15.196:6835/3402347550,v1:172.21.15.196:6837/3402347550] conn(0x5596ec59cb90 0x5596ec59ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:08.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f381ea00640 1 --2- 172.21.15.8:0/3164826148 >> [v2:172.21.15.196:6835/3402347550,v1:172.21.15.196:6837/3402347550] conn(0x5596ec59cb90 0x5596ec59ef80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf5fb341ca676892 server_cookie=fa6d30c8c38ac81d in_seq=0 out_seq=0 2024-03-23T23:43:08.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3803e00640 10 client.4809 ms_handle_connect on v2:172.21.15.196:6835/3402347550 2024-03-23T23:43:08.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3803e00640 1 -- 172.21.15.8:0/3164826148 <== mds.0 v2:172.21.15.196:6835/3402347550 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5596ec34abc0 con 0x5596ec59cb90 2024-03-23T23:43:08.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3803e00640 10 client.4809 handle_command_reply: tid=0 2024-03-23T23:43:08.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3828e8a000 1 client.4809 shutdown 2024-03-23T23:43:08.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3828e8a000 1 -- 172.21.15.8:0/3164826148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5596ec4ee1f0 msgr2=0x5596ec544dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:08.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3828e8a000 1 --2- 172.21.15.8:0/3164826148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5596ec4ee1f0 0x5596ec544dd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f381801cd90 tx=0x7f381801b0f0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3828e8a000 1 -- 172.21.15.8:0/3164826148 shutdown_connections 2024-03-23T23:43:08.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3828e8a000 1 --2- 172.21.15.8:0/3164826148 >> [v2:172.21.15.196:6835/3402347550,v1:172.21.15.196:6837/3402347550] conn(0x5596ec59cb90 0x5596ec59ef80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3828e8a000 1 --2- 172.21.15.8:0/3164826148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5596ec4ee1f0 0x5596ec544dd0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3828e8a000 1 --2- 172.21.15.8:0/3164826148 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5596ec4ed8d0 0x5596ec544890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3828e8a000 1 --2- 172.21.15.8:0/3164826148 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5596ec4ecfb0 0x5596ec544350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3803e00640 0 client.4809 ms_handle_reset on v2:172.21.15.196:6835/3402347550 2024-03-23T23:43:08.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3828e8a000 1 -- 172.21.15.8:0/3164826148 >> 172.21.15.8:0/3164826148 conn(0x5596ec52b630 msgr2=0x5596ec58e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:08.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3828e8a000 1 -- 172.21.15.8:0/3164826148 shutdown_connections 2024-03-23T23:43:08.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3828e8a000 1 -- 172.21.15.8:0/3164826148 wait complete. 2024-03-23T23:43:08.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3828e8a000 20 client.4809 trim_cache size 0 max 16384 2024-03-23T23:43:08.540 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:43:08.540 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:43:08.540 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2024-03-23T23:43:08.540 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 4294, 2024-03-23T23:43:08.540 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2024-03-23T23:43:08.540 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2024-03-23T23:43:08.540 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "a", 2024-03-23T23:43:08.540 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 27.854766809000001, 2024-03-23T23:43:08.541 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 9, 2024-03-23T23:43:08.541 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 25, 2024-03-23T23:43:08.541 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 21, 2024-03-23T23:43:08.541 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 35.002089587999997 2024-03-23T23:43:08.541 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:43:08.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3825a00640 1 -- 172.21.15.8:0/2618103025 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f37fc067660 msgr2=0x7f37fc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:08.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3825a00640 1 --2- 172.21.15.8:0/2618103025 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f37fc067660 0x7f37fc069b20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3810009eb0 tx=0x7f3810009190 comp rx=0 tx=0).stop 2024-03-23T23:43:08.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3825a00640 1 -- 172.21.15.8:0/2618103025 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38200c8a50 msgr2=0x7f382014b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:08.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3825a00640 1 --2- 172.21.15.8:0/2618103025 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38200c8a50 0x7f382014b640 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f380800c450 tx=0x7f380800c910 comp rx=0 tx=0).stop 2024-03-23T23:43:08.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3825a00640 1 -- 172.21.15.8:0/2618103025 shutdown_connections 2024-03-23T23:43:08.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3825a00640 1 --2- 172.21.15.8:0/2618103025 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f37fc067660 0x7f37fc069b20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3825a00640 1 --2- 172.21.15.8:0/2618103025 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3820143af0 0x7f38200aa050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3825a00640 1 --2- 172.21.15.8:0/2618103025 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38200c8a50 0x7f382014b640 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3825a00640 1 --2- 172.21.15.8:0/2618103025 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38200c2ba0 0x7f382014d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3825a00640 1 -- 172.21.15.8:0/2618103025 >> 172.21.15.8:0/2618103025 conn(0x7f38200aafe0 msgr2=0x7f382006f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:08.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3825a00640 1 -- 172.21.15.8:0/2618103025 shutdown_connections 2024-03-23T23:43:08.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.533+0000 7f3825a00640 1 -- 172.21.15.8:0/2618103025 wait complete. 2024-03-23T23:43:08.556 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:43:08.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.693+0000 7fe65c600640 1 Processor -- start 2024-03-23T23:43:08.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.693+0000 7fe65c600640 1 -- start start 2024-03-23T23:43:08.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.697+0000 7fe65c600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe6540c8a50 0x7fe6540c2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:08.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.697+0000 7fe65c600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe65406d6e0 0x7fe654155a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:08.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.697+0000 7fe65c600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe6540c2ba0 0x7fe654155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:08.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.697+0000 7fe65c600640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6540c4740 con 0x7fe6540c8a50 2024-03-23T23:43:08.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.697+0000 7fe65c600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6540c4340 con 0x7fe6540c2ba0 2024-03-23T23:43:08.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.697+0000 7fe65c600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6540c4060 con 0x7fe65406d6e0 2024-03-23T23:43:08.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.697+0000 7fe659c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe6540c8a50 0x7fe6540c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:08.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.697+0000 7fe659c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe6540c8a50 0x7fe6540c2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60286/0 (socket says 172.21.15.8:60286) 2024-03-23T23:43:08.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.697+0000 7fe659c00640 1 -- 172.21.15.8:0/3098540112 learned_addr learned my addr 172.21.15.8:0/3098540112 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:08.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.697+0000 7fe659200640 1 --2- 172.21.15.8:0/3098540112 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe65406d6e0 0x7fe654155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:08.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.697+0000 7fe65a600640 1 --2- 172.21.15.8:0/3098540112 >> v2:172.21.15.196:3300/0 conn(0x7fe6540c2ba0 0x7fe654155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:08.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.697+0000 7fe659c00640 1 -- 172.21.15.8:0/3098540112 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe65406d6e0 msgr2=0x7fe654155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:08.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.697+0000 7fe659c00640 1 --2- 172.21.15.8:0/3098540112 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe65406d6e0 0x7fe654155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.697+0000 7fe659c00640 1 -- 172.21.15.8:0/3098540112 >> v2:172.21.15.196:3300/0 conn(0x7fe6540c2ba0 msgr2=0x7fe654155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:08.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.697+0000 7fe659c00640 1 --2- 172.21.15.8:0/3098540112 >> v2:172.21.15.196:3300/0 conn(0x7fe6540c2ba0 0x7fe654155fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.697+0000 7fe659c00640 1 -- 172.21.15.8:0/3098540112 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6540c3570 con 0x7fe6540c8a50 2024-03-23T23:43:08.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.701+0000 7fe659c00640 1 --2- 172.21.15.8:0/3098540112 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6540c8a50 0x7fe6540c2660 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe6540a8f20 tx=0x7fe64801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67a978f92fe6158d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:08.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.701+0000 7fe653e00640 1 -- 172.21.15.8:0/3098540112 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6480ab620 con 0x7fe6540c8a50 2024-03-23T23:43:08.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.701+0000 7fe653e00640 1 -- 172.21.15.8:0/3098540112 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6480b0070 con 0x7fe6540c8a50 2024-03-23T23:43:08.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.701+0000 7fe653e00640 1 -- 172.21.15.8:0/3098540112 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6480ab9e0 con 0x7fe6540c8a50 2024-03-23T23:43:08.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.701+0000 7fe65c600640 1 -- 172.21.15.8:0/3098540112 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6540c8a50 msgr2=0x7fe6540c2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:08.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.701+0000 7fe65c600640 1 --2- 172.21.15.8:0/3098540112 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6540c8a50 0x7fe6540c2660 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe6540a8f20 tx=0x7fe64801c460 comp rx=0 tx=0).stop 2024-03-23T23:43:08.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.701+0000 7fe65c600640 1 -- 172.21.15.8:0/3098540112 shutdown_connections 2024-03-23T23:43:08.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.701+0000 7fe65c600640 1 --2- 172.21.15.8:0/3098540112 >> v2:172.21.15.196:3300/0 conn(0x7fe6540c2ba0 0x7fe654155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.701+0000 7fe65c600640 1 --2- 172.21.15.8:0/3098540112 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe65406d6e0 0x7fe654155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.701+0000 7fe65c600640 1 --2- 172.21.15.8:0/3098540112 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6540c8a50 0x7fe6540c2660 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.701+0000 7fe65c600640 1 -- 172.21.15.8:0/3098540112 >> 172.21.15.8:0/3098540112 conn(0x7fe6540aafe0 msgr2=0x7fe6540ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:08.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.701+0000 7fe65c600640 1 -- 172.21.15.8:0/3098540112 shutdown_connections 2024-03-23T23:43:08.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.701+0000 7fe65c600640 1 -- 172.21.15.8:0/3098540112 wait complete. 2024-03-23T23:43:08.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.705+0000 7fe65c600640 1 Processor -- start 2024-03-23T23:43:08.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.705+0000 7fe65c600640 1 -- start start 2024-03-23T23:43:08.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.705+0000 7fe65c600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe6540c2ba0 0x7fe654150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:08.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.705+0000 7fe65c600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6540c8a50 0x7fe6541f1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:08.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.705+0000 7fe65c600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6541f2120 0x7fe65415b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:08.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.705+0000 7fe65c600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65406e360 con 0x7fe6541f2120 2024-03-23T23:43:08.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.705+0000 7fe65c600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65406e1e0 con 0x7fe6540c2ba0 2024-03-23T23:43:08.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.705+0000 7fe65c600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6540c3c30 con 0x7fe6540c8a50 2024-03-23T23:43:08.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.705+0000 7fe659c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe6540c2ba0 0x7fe654150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:08.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.705+0000 7fe65a600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6541f2120 0x7fe65415b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:08.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.705+0000 7fe659200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6540c8a50 0x7fe6541f1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:08.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.705+0000 7fe659c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe6540c2ba0 0x7fe654150aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:41656/0 (socket says 172.21.15.8:41656) 2024-03-23T23:43:08.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.705+0000 7fe659c00640 1 -- 172.21.15.8:0/227506832 learned_addr learned my addr 172.21.15.8:0/227506832 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:08.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.705+0000 7fe659c00640 1 -- 172.21.15.8:0/227506832 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6540c8a50 msgr2=0x7fe6541f1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:08.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.705+0000 7fe659c00640 1 --2- 172.21.15.8:0/227506832 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6540c8a50 0x7fe6541f1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.705+0000 7fe659c00640 1 -- 172.21.15.8:0/227506832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6541f2120 msgr2=0x7fe65415b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:08.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.705+0000 7fe659c00640 1 --2- 172.21.15.8:0/227506832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6541f2120 0x7fe65415b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.705+0000 7fe659c00640 1 -- 172.21.15.8:0/227506832 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6540ac070 con 0x7fe6540c2ba0 2024-03-23T23:43:08.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.705+0000 7fe659c00640 1 --2- 172.21.15.8:0/227506832 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe6540c2ba0 0x7fe654150aa0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe64801cd00 tx=0x7fe64801aca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:08.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.705+0000 7fe651600640 1 -- 172.21.15.8:0/227506832 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6480abc50 con 0x7fe6540c2ba0 2024-03-23T23:43:08.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.705+0000 7fe651600640 1 -- 172.21.15.8:0/227506832 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6480abe10 con 0x7fe6540c2ba0 2024-03-23T23:43:08.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.705+0000 7fe65c600640 1 -- 172.21.15.8:0/227506832 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6541f2800 con 0x7fe6540c2ba0 2024-03-23T23:43:08.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.705+0000 7fe651600640 1 -- 172.21.15.8:0/227506832 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6480be630 con 0x7fe6540c2ba0 2024-03-23T23:43:08.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.709+0000 7fe65c600640 1 -- 172.21.15.8:0/227506832 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6540ae270 con 0x7fe6540c2ba0 2024-03-23T23:43:08.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.709+0000 7fe65c600640 1 -- 172.21.15.8:0/227506832 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe654068270 con 0x7fe6540c2ba0 2024-03-23T23:43:08.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.709+0000 7fe651600640 1 -- 172.21.15.8:0/227506832 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fe6480c7440 con 0x7fe6540c2ba0 2024-03-23T23:43:08.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.709+0000 7fe651600640 1 --2- 172.21.15.8:0/227506832 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe634067690 0x7fe634069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:08.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.709+0000 7fe651600640 1 -- 172.21.15.8:0/227506832 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fe64811fe70 con 0x7fe6540c2ba0 2024-03-23T23:43:08.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.709+0000 7fe659200640 1 --2- 172.21.15.8:0/227506832 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe634067690 0x7fe634069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:08.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.709+0000 7fe659200640 1 --2- 172.21.15.8:0/227506832 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe634067690 0x7fe634069b50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe6541ec250 tx=0x7fe640009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:08.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.713+0000 7fe651600640 1 -- 172.21.15.8:0/227506832 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fe648016110 con 0x7fe6540c2ba0 2024-03-23T23:43:08.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.881+0000 7fe65c600640 1 -- 172.21.15.8:0/227506832 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6540735e0 con 0x7fe6540c2ba0 2024-03-23T23:43:08.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.881+0000 7fe651600640 1 -- 172.21.15.8:0/227506832 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20271 (secure 0 0 0) 0x7fe6480f0160 con 0x7fe6540c2ba0 2024-03-23T23:43:08.884 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:43:08.884 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":25,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","created":"2024-03-23T23:42:15.169430+0000","modified":"2024-03-23T23:42:51.739271+0000","last_up_change":"2024-03-23T23:42:26.509742+0000","last_in_change":"2024-03-23T23:42:17.662330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:42:26.327445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-23T23:42:38.218800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-23T23:42:39.054195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-23T23:42:48.327799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-23T23:42:49.113061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e967bf31-21d6-4d11-bc3d-0df8177a1b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6809","nonce":2187201732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6811","nonce":2187201732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6815","nonce":2187201732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6813","nonce":2187201732}]},"public_addr":"172.21.15.8:6809/2187201732","cluster_addr":"172.21.15.8:6811/2187201732","heartbeat_back_addr":"172.21.15.8:6815/2187201732","heartbeat_front_addr":"172.21.15.8:6813/2187201732","state":["exists","up"]},{"osd":1,"uuid":"c8e33701-7acd-4474-8402-d52461171fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6818","nonce":3205168010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6822","nonce":3205168010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6830","nonce":3205168010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6826","nonce":3205168010}]},"public_addr":"172.21.15.8:6818/3205168010","cluster_addr":"172.21.15.8:6822/3205168010","heartbeat_back_addr":"172.21.15.8:6830/3205168010","heartbeat_front_addr":"172.21.15.8:6826/3205168010","state":["exists","up"]},{"osd":2,"uuid":"ceebdbf7-4c2f-4757-b52d-fd8b20e77570","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6801","nonce":475463656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6803","nonce":475463656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6807","nonce":475463656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6805","nonce":475463656}]},"public_addr":"172.21.15.8:6801/475463656","cluster_addr":"172.21.15.8:6803/475463656","heartbeat_back_addr":"172.21.15.8:6807/475463656","heartbeat_front_addr":"172.21.15.8:6805/475463656","state":["exists","up"]},{"osd":3,"uuid":"89e258da-5767-429e-8441-edf877d2f3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6819","nonce":1514082871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6821","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6823","nonce":1514082871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6829","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6831","nonce":1514082871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6825","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6827","nonce":1514082871}]},"public_addr":"172.21.15.8:6819/1514082871","cluster_addr":"172.21.15.8:6823/1514082871","heartbeat_back_addr":"172.21.15.8:6831/1514082871","heartbeat_front_addr":"172.21.15.8:6827/1514082871","state":["exists","up"]},{"osd":4,"uuid":"2b7451ae-ea16-4f0a-ae50-04fde75e45ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6825","nonce":3516578147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6827","nonce":3516578147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6831","nonce":3516578147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6829","nonce":3516578147}]},"public_addr":"172.21.15.196:6825/3516578147","cluster_addr":"172.21.15.196:6827/3516578147","heartbeat_back_addr":"172.21.15.196:6831/3516578147","heartbeat_front_addr":"172.21.15.196:6829/3516578147","state":["exists","up"]},{"osd":5,"uuid":"e68a8914-e591-466a-bc9e-f2d7c67aac13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6802","nonce":830595758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6806","nonce":830595758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6814","nonce":830595758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6810","nonce":830595758}]},"public_addr":"172.21.15.196:6802/830595758","cluster_addr":"172.21.15.196:6806/830595758","heartbeat_back_addr":"172.21.15.196:6814/830595758","heartbeat_front_addr":"172.21.15.196:6810/830595758","state":["exists","up"]},{"osd":6,"uuid":"e47723c5-50a0-4cd8-92d9-01972072b422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6801","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6803","nonce":472639906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6805","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6807","nonce":472639906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6815","nonce":472639906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6811","nonce":472639906}]},"public_addr":"172.21.15.196:6803/472639906","cluster_addr":"172.21.15.196:6807/472639906","heartbeat_back_addr":"172.21.15.196:6815/472639906","heartbeat_front_addr":"172.21.15.196:6811/472639906","state":["exists","up"]},{"osd":7,"uuid":"e1e9113d-8005-47b3-9a75-9e701199f1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6817","nonce":4151820349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6819","nonce":4151820349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6823","nonce":4151820349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6821","nonce":4151820349}]},"public_addr":"172.21.15.196:6817/4151820349","cluster_addr":"172.21.15.196:6819/4151820349","heartbeat_back_addr":"172.21.15.196:6823/4151820349","heartbeat_front_addr":"172.21.15.196:6821/4151820349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.221790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.265974+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.190319+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.376359+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.329657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.402958+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.300703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.133121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:43:08.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.885+0000 7fe65c600640 1 -- 172.21.15.8:0/227506832 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe634067690 msgr2=0x7fe634069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:08.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.885+0000 7fe65c600640 1 --2- 172.21.15.8:0/227506832 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe634067690 0x7fe634069b50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe6541ec250 tx=0x7fe640009190 comp rx=0 tx=0).stop 2024-03-23T23:43:08.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.885+0000 7fe65c600640 1 -- 172.21.15.8:0/227506832 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe6540c2ba0 msgr2=0x7fe654150aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:08.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.885+0000 7fe65c600640 1 --2- 172.21.15.8:0/227506832 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe6540c2ba0 0x7fe654150aa0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe64801cd00 tx=0x7fe64801aca0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.885+0000 7fe65c600640 1 -- 172.21.15.8:0/227506832 shutdown_connections 2024-03-23T23:43:08.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.885+0000 7fe65c600640 1 --2- 172.21.15.8:0/227506832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6541f2120 0x7fe65415b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.885+0000 7fe65c600640 1 --2- 172.21.15.8:0/227506832 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe634067690 0x7fe634069b50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.885+0000 7fe65c600640 1 --2- 172.21.15.8:0/227506832 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6540c8a50 0x7fe6541f1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.885+0000 7fe65c600640 1 --2- 172.21.15.8:0/227506832 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe6540c2ba0 0x7fe654150aa0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:08.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.885+0000 7fe65c600640 1 -- 172.21.15.8:0/227506832 >> 172.21.15.8:0/227506832 conn(0x7fe6540aafe0 msgr2=0x7fe6541523e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:08.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.885+0000 7fe65c600640 1 -- 172.21.15.8:0/227506832 shutdown_connections 2024-03-23T23:43:08.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:08.885+0000 7fe65c600640 1 -- 172.21.15.8:0/227506832 wait complete. 2024-03-23T23:43:08.906 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-23T23:42:26.327445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-03-23T23:42:38.218800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-03-23T23:42:39.054195+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-03-23T23:42:48.327799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-03-23T23:42:49.113061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-23T23:43:08.906 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-23T23:43:09.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.049+0000 7f52db800640 1 Processor -- start 2024-03-23T23:43:09.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.049+0000 7f52db800640 1 -- start start 2024-03-23T23:43:09.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.049+0000 7f52db800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52d414d9d0 0x7f52d4154030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:09.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.049+0000 7f52db800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f52d40701a0 0x7f52d415df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:09.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.049+0000 7f52db800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d40c3700 con 0x7f52d406fd60 2024-03-23T23:43:09.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.049+0000 7f52db800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d40c4830 con 0x7f52d40701a0 2024-03-23T23:43:09.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.049+0000 7f52db800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d4156d40 con 0x7f52d414d9d0 2024-03-23T23:43:09.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.049+0000 7f52d3e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f52d406fd60 0x7f52d41571d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:45488/0 (socket says 172.21.15.8:45488) 2024-03-23T23:43:09.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.049+0000 7f52d3e00640 1 -- 172.21.15.8:0/2365240616 learned_addr learned my addr 172.21.15.8:0/2365240616 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:43:09.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.049+0000 7f52d8e00640 1 --2- 172.21.15.8:0/2365240616 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52d414d9d0 0x7f52d4154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:09.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.049+0000 7f52d9800640 1 --2- 172.21.15.8:0/2365240616 >> v2:172.21.15.196:3300/0 conn(0x7f52d40701a0 0x7f52d415df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:09.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.053+0000 7f52d3400640 1 -- 172.21.15.8:0/2365240616 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362636791 0 0) 0x7f52d40c3700 con 0x7f52d406fd60 2024-03-23T23:43:09.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.053+0000 7f52d3400640 1 -- 172.21.15.8:0/2365240616 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52bc003530 con 0x7f52d406fd60 2024-03-23T23:43:09.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.053+0000 7f52d8e00640 1 -- 172.21.15.8:0/2365240616 >> v2:172.21.15.196:3300/0 conn(0x7f52d40701a0 msgr2=0x7f52d415df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:09.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.053+0000 7f52d8e00640 1 --2- 172.21.15.8:0/2365240616 >> v2:172.21.15.196:3300/0 conn(0x7f52d40701a0 0x7f52d415df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:09.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.053+0000 7f52d8e00640 1 -- 172.21.15.8:0/2365240616 >> v1:172.21.15.8:6789/0 conn(0x7f52d406fd60 legacy=0x7f52d41571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:09.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.053+0000 7f52d8e00640 1 -- 172.21.15.8:0/2365240616 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d4154570 con 0x7f52d414d9d0 2024-03-23T23:43:09.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.053+0000 7f52d9800640 1 --2- 172.21.15.8:0/2365240616 >> v2:172.21.15.196:3300/0 conn(0x7f52d40701a0 0x7f52d415df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:43:09.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.053+0000 7f52d8e00640 1 --2- 172.21.15.8:0/2365240616 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52d414d9d0 0x7f52d4154030 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f52c80097c0 tx=0x7f52c801c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9e82426679de8b2 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:09.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.053+0000 7f52d3400640 1 -- 172.21.15.8:0/2365240616 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c80b0070 con 0x7f52d414d9d0 2024-03-23T23:43:09.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.053+0000 7f52d3400640 1 -- 172.21.15.8:0/2365240616 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c80ab600 con 0x7f52d414d9d0 2024-03-23T23:43:09.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.053+0000 7f52d3400640 1 -- 172.21.15.8:0/2365240616 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c80ab9d0 con 0x7f52d414d9d0 2024-03-23T23:43:09.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.057+0000 7f52db800640 1 -- 172.21.15.8:0/2365240616 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52d414d9d0 msgr2=0x7f52d4154030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:09.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.057+0000 7f52db800640 1 --2- 172.21.15.8:0/2365240616 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52d414d9d0 0x7f52d4154030 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f52c80097c0 tx=0x7f52c801c380 comp rx=0 tx=0).stop 2024-03-23T23:43:09.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.057+0000 7f52db800640 1 -- 172.21.15.8:0/2365240616 shutdown_connections 2024-03-23T23:43:09.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.057+0000 7f52db800640 1 --2- 172.21.15.8:0/2365240616 >> v2:172.21.15.196:3300/0 conn(0x7f52d40701a0 0x7f52d415df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:09.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.057+0000 7f52db800640 1 --2- 172.21.15.8:0/2365240616 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52d414d9d0 0x7f52d4154030 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:09.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.057+0000 7f52db800640 1 -- 172.21.15.8:0/2365240616 >> 172.21.15.8:0/2365240616 conn(0x7f52d40c4a70 msgr2=0x7f52d40c4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:09.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.057+0000 7f52db800640 1 -- 172.21.15.8:0/2365240616 shutdown_connections 2024-03-23T23:43:09.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.057+0000 7f52db800640 1 -- 172.21.15.8:0/2365240616 wait complete. 2024-03-23T23:43:09.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.057+0000 7f52db800640 1 Processor -- start 2024-03-23T23:43:09.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.057+0000 7f52db800640 1 -- start start 2024-03-23T23:43:09.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.057+0000 7f52db800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f52d406fd60 0x7f52d41418e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:09.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.057+0000 7f52db800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52d40701a0 0x7f52d406f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:09.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.057+0000 7f52db800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52d4141e20 0x7f52d41ee860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:09.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.057+0000 7f52db800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d40a95f0 con 0x7f52d4141e20 2024-03-23T23:43:09.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.057+0000 7f52db800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d40a9470 con 0x7f52d406fd60 2024-03-23T23:43:09.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.057+0000 7f52db800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d40c3b60 con 0x7f52d40701a0 2024-03-23T23:43:09.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.057+0000 7f52d9800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52d4141e20 0x7f52d41ee860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:09.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.057+0000 7f52d9800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52d4141e20 0x7f52d41ee860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60310/0 (socket says 172.21.15.8:60310) 2024-03-23T23:43:09.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.057+0000 7f52d9800640 1 -- 172.21.15.8:0/831890133 learned_addr learned my addr 172.21.15.8:0/831890133 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:09.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.057+0000 7f52d8e00640 1 --2- 172.21.15.8:0/831890133 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f52d406fd60 0x7f52d41418e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:09.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.057+0000 7f52d3e00640 1 --2- 172.21.15.8:0/831890133 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52d40701a0 0x7f52d406f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:09.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.057+0000 7f52d9800640 1 -- 172.21.15.8:0/831890133 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52d40701a0 msgr2=0x7f52d406f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:09.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.057+0000 7f52d9800640 1 --2- 172.21.15.8:0/831890133 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52d40701a0 0x7f52d406f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:09.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.057+0000 7f52d9800640 1 -- 172.21.15.8:0/831890133 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f52d406fd60 msgr2=0x7f52d41418e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:09.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.057+0000 7f52d9800640 1 --2- 172.21.15.8:0/831890133 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f52d406fd60 0x7f52d41418e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:09.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.057+0000 7f52d9800640 1 -- 172.21.15.8:0/831890133 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d415e230 con 0x7f52d4141e20 2024-03-23T23:43:09.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.057+0000 7f52d8e00640 1 --2- 172.21.15.8:0/831890133 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f52d406fd60 0x7f52d41418e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:43:09.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.057+0000 7f52d9800640 1 --2- 172.21.15.8:0/831890133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52d4141e20 0x7f52d41ee860 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f52cc009e60 tx=0x7f52cc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:09.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.061+0000 7f52d0c00640 1 -- 172.21.15.8:0/831890133 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc018030 con 0x7f52d4141e20 2024-03-23T23:43:09.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.061+0000 7f52d0c00640 1 -- 172.21.15.8:0/831890133 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52cc00cdf0 con 0x7f52d4141e20 2024-03-23T23:43:09.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.061+0000 7f52d0c00640 1 -- 172.21.15.8:0/831890133 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc003bc0 con 0x7f52d4141e20 2024-03-23T23:43:09.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.061+0000 7f52db800640 1 -- 172.21.15.8:0/831890133 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d41f1db0 con 0x7f52d4141e20 2024-03-23T23:43:09.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.061+0000 7f52db800640 1 -- 172.21.15.8:0/831890133 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d41f2370 con 0x7f52d4141e20 2024-03-23T23:43:09.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.061+0000 7f52db800640 1 -- 172.21.15.8:0/831890133 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d404f410 con 0x7f52d4141e20 2024-03-23T23:43:09.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.061+0000 7f52d0c00640 1 -- 172.21.15.8:0/831890133 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f52cc01b070 con 0x7f52d4141e20 2024-03-23T23:43:09.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.061+0000 7f52d0c00640 1 --2- 172.21.15.8:0/831890133 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f52b4067690 0x7f52b4069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:09.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.061+0000 7f52d0c00640 1 -- 172.21.15.8:0/831890133 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f52cc0863d0 con 0x7f52d4141e20 2024-03-23T23:43:09.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.061+0000 7f52d8e00640 1 --2- 172.21.15.8:0/831890133 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f52b4067690 0x7f52b4069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:09.065 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.065+0000 7f52d8e00640 1 --2- 172.21.15.8:0/831890133 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f52b4067690 0x7f52b4069b50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f52c80ad000 tx=0x7f52c80a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:09.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.065+0000 7f52d0c00640 1 -- 172.21.15.8:0/831890133 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f52cc022070 con 0x7f52d4141e20 2024-03-23T23:43:09.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.229+0000 7f52db800640 1 -- 172.21.15.8:0/831890133 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f52d4074870 con 0x7f52d4141e20 2024-03-23T23:43:09.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.229+0000 7f52d0c00640 1 -- 172.21.15.8:0/831890133 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f52cc010040 con 0x7f52d4141e20 2024-03-23T23:43:09.231 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-03-23T23:43:09.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.229+0000 7f52db800640 1 -- 172.21.15.8:0/831890133 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f52b4067690 msgr2=0x7f52b4069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:09.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.229+0000 7f52db800640 1 --2- 172.21.15.8:0/831890133 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f52b4067690 0x7f52b4069b50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f52c80ad000 tx=0x7f52c80a6000 comp rx=0 tx=0).stop 2024-03-23T23:43:09.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.229+0000 7f52db800640 1 -- 172.21.15.8:0/831890133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52d4141e20 msgr2=0x7f52d41ee860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:09.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.229+0000 7f52db800640 1 --2- 172.21.15.8:0/831890133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52d4141e20 0x7f52d41ee860 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f52cc009e60 tx=0x7f52cc00c490 comp rx=0 tx=0).stop 2024-03-23T23:43:09.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.229+0000 7f52db800640 1 -- 172.21.15.8:0/831890133 shutdown_connections 2024-03-23T23:43:09.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.229+0000 7f52db800640 1 --2- 172.21.15.8:0/831890133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52d4141e20 0x7f52d41ee860 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:09.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.229+0000 7f52db800640 1 --2- 172.21.15.8:0/831890133 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f52b4067690 0x7f52b4069b50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:09.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.229+0000 7f52db800640 1 --2- 172.21.15.8:0/831890133 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52d40701a0 0x7f52d406f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:09.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.229+0000 7f52db800640 1 --2- 172.21.15.8:0/831890133 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f52d406fd60 0x7f52d41418e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:09.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.229+0000 7f52db800640 1 -- 172.21.15.8:0/831890133 >> 172.21.15.8:0/831890133 conn(0x7f52d40c4a70 msgr2=0x7f52d40c13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:09.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.233+0000 7f52db800640 1 -- 172.21.15.8:0/831890133 shutdown_connections 2024-03-23T23:43:09.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.233+0000 7f52db800640 1 -- 172.21.15.8:0/831890133 wait complete. 2024-03-23T23:43:09.252 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-03-23T23:43:09.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.393+0000 7fdae5400640 1 Processor -- start 2024-03-23T23:43:09.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.393+0000 7fdae5400640 1 -- start start 2024-03-23T23:43:09.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.393+0000 7fdae5400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fdae00c86b0 0x7fdae01542c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:09.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.393+0000 7fdae5400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae00c5770 con 0x7fdae00c4fb0 2024-03-23T23:43:09.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.393+0000 7fdae5400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae00c5490 con 0x7fdae0151000 2024-03-23T23:43:09.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.393+0000 7fdae5400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae00c84a0 con 0x7fdae00c86b0 2024-03-23T23:43:09.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.393+0000 7fdadde00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fdae00c4fb0 0x7fdae00ae8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:45502/0 (socket says 172.21.15.8:45502) 2024-03-23T23:43:09.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.393+0000 7fdadde00640 1 -- 172.21.15.8:0/987037270 learned_addr learned my addr 172.21.15.8:0/987037270 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:43:09.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.393+0000 7fdadf200640 1 --2- 172.21.15.8:0/987037270 >> v2:172.21.15.8:3300/0 conn(0x7fdae00c86b0 0x7fdae01542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:09.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.393+0000 7fdadd400640 1 -- 172.21.15.8:0/987037270 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 75670354 0 0) 0x7fdae00c5490 con 0x7fdae0151000 2024-03-23T23:43:09.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.393+0000 7fdadd400640 1 -- 172.21.15.8:0/987037270 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdac4003530 con 0x7fdae0151000 2024-03-23T23:43:09.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.393+0000 7fdadd400640 1 -- 172.21.15.8:0/987037270 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3055344265 0 0) 0x7fdae00c5770 con 0x7fdae00c4fb0 2024-03-23T23:43:09.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.397+0000 7fdadd400640 1 -- 172.21.15.8:0/987037270 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdae00c5490 con 0x7fdae00c4fb0 2024-03-23T23:43:09.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.397+0000 7fdadf200640 1 -- 172.21.15.8:0/987037270 >> v1:172.21.15.196:6789/0 conn(0x7fdae0151000 legacy=0x7fdae00c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:09.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.397+0000 7fdadf200640 1 -- 172.21.15.8:0/987037270 >> v1:172.21.15.8:6789/0 conn(0x7fdae00c4fb0 legacy=0x7fdae00ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:09.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.397+0000 7fdadf200640 1 -- 172.21.15.8:0/987037270 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae01537e0 con 0x7fdae00c86b0 2024-03-23T23:43:09.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.397+0000 7fdadf200640 1 --2- 172.21.15.8:0/987037270 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdae00c86b0 0x7fdae01542c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdad8009d90 tx=0x7fdad801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ca093f272395c3 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:09.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.397+0000 7fdadd400640 1 -- 172.21.15.8:0/987037270 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad80b2070 con 0x7fdae00c86b0 2024-03-23T23:43:09.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.397+0000 7fdadd400640 1 -- 172.21.15.8:0/987037270 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad80a5800 con 0x7fdae00c86b0 2024-03-23T23:43:09.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.397+0000 7fdadd400640 1 -- 172.21.15.8:0/987037270 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad80a5bb0 con 0x7fdae00c86b0 2024-03-23T23:43:09.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.397+0000 7fdae5400640 1 -- 172.21.15.8:0/987037270 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdae00c86b0 msgr2=0x7fdae01542c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:09.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.397+0000 7fdae5400640 1 --2- 172.21.15.8:0/987037270 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdae00c86b0 0x7fdae01542c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdad8009d90 tx=0x7fdad801c850 comp rx=0 tx=0).stop 2024-03-23T23:43:09.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.397+0000 7fdae5400640 1 -- 172.21.15.8:0/987037270 shutdown_connections 2024-03-23T23:43:09.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.397+0000 7fdae5400640 1 --2- 172.21.15.8:0/987037270 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdae00c86b0 0x7fdae01542c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:09.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.397+0000 7fdae5400640 1 -- 172.21.15.8:0/987037270 >> 172.21.15.8:0/987037270 conn(0x7fdae00aad10 msgr2=0x7fdae00ab120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:09.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.397+0000 7fdae5400640 1 -- 172.21.15.8:0/987037270 shutdown_connections 2024-03-23T23:43:09.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.401+0000 7fdae5400640 1 -- 172.21.15.8:0/987037270 wait complete. 2024-03-23T23:43:09.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.401+0000 7fdae5400640 1 Processor -- start 2024-03-23T23:43:09.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.401+0000 7fdae5400640 1 -- start start 2024-03-23T23:43:09.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.401+0000 7fdae5400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdae00c4fb0 0x7fdae01463a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:09.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.401+0000 7fdae5400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdae00c86b0 0x7fdae00ac5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:09.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.401+0000 7fdae5400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdae0151000 0x7fdae00acae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:09.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.401+0000 7fdae5400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae00af150 con 0x7fdae0151000 2024-03-23T23:43:09.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.401+0000 7fdae5400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae00aefd0 con 0x7fdae00c86b0 2024-03-23T23:43:09.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.401+0000 7fdae5400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae00c3490 con 0x7fdae00c4fb0 2024-03-23T23:43:09.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.401+0000 7fdadf200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdae0151000 0x7fdae00acae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:09.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.401+0000 7fdadf200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdae0151000 0x7fdae00acae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60324/0 (socket says 172.21.15.8:60324) 2024-03-23T23:43:09.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.401+0000 7fdadf200640 1 -- 172.21.15.8:0/1371875685 learned_addr learned my addr 172.21.15.8:0/1371875685 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:09.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.401+0000 7fdade800640 1 --2- 172.21.15.8:0/1371875685 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdae00c4fb0 0x7fdae01463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:09.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.401+0000 7fdadde00640 1 --2- 172.21.15.8:0/1371875685 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdae00c86b0 0x7fdae00ac5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:09.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.401+0000 7fdadf200640 1 -- 172.21.15.8:0/1371875685 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdae00c4fb0 msgr2=0x7fdae01463a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:09.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.401+0000 7fdadf200640 1 --2- 172.21.15.8:0/1371875685 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdae00c4fb0 0x7fdae01463a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:09.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.401+0000 7fdadf200640 1 -- 172.21.15.8:0/1371875685 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdae00c86b0 msgr2=0x7fdae00ac5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:09.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.401+0000 7fdadf200640 1 --2- 172.21.15.8:0/1371875685 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdae00c86b0 0x7fdae00ac5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:09.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.401+0000 7fdadf200640 1 -- 172.21.15.8:0/1371875685 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae00add30 con 0x7fdae0151000 2024-03-23T23:43:09.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.401+0000 7fdadf200640 1 --2- 172.21.15.8:0/1371875685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdae0151000 0x7fdae00acae0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdad80b0040 tx=0x7fdad80195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:09.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.401+0000 7fdad6a00640 1 -- 172.21.15.8:0/1371875685 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad80b2050 con 0x7fdae0151000 2024-03-23T23:43:09.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.401+0000 7fdad6a00640 1 -- 172.21.15.8:0/1371875685 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad80be070 con 0x7fdae0151000 2024-03-23T23:43:09.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.401+0000 7fdae5400640 1 -- 172.21.15.8:0/1371875685 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae01ee5e0 con 0x7fdae0151000 2024-03-23T23:43:09.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.401+0000 7fdad6a00640 1 -- 172.21.15.8:0/1371875685 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad80ad870 con 0x7fdae0151000 2024-03-23T23:43:09.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.401+0000 7fdae5400640 1 -- 172.21.15.8:0/1371875685 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae00ae2d0 con 0x7fdae0151000 2024-03-23T23:43:09.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.405+0000 7fdae5400640 1 -- 172.21.15.8:0/1371875685 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae004f410 con 0x7fdae0151000 2024-03-23T23:43:09.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.405+0000 7fdad6a00640 1 -- 172.21.15.8:0/1371875685 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fdad80ada10 con 0x7fdae0151000 2024-03-23T23:43:09.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.405+0000 7fdad6a00640 1 --2- 172.21.15.8:0/1371875685 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdac0067660 0x7fdac0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:09.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.405+0000 7fdad6a00640 1 -- 172.21.15.8:0/1371875685 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fdad8120b30 con 0x7fdae0151000 2024-03-23T23:43:09.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.405+0000 7fdade800640 1 --2- 172.21.15.8:0/1371875685 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdac0067660 0x7fdac0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:09.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.405+0000 7fdade800640 1 --2- 172.21.15.8:0/1371875685 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdac0067660 0x7fdac0069b20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdad0007fd0 tx=0x7fdad0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:09.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.413+0000 7fdad6a00640 1 -- 172.21.15.8:0/1371875685 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fdad8016560 con 0x7fdae0151000 2024-03-23T23:43:09.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.577+0000 7fdae5400640 1 -- 172.21.15.8:0/1371875685 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdae006e490 con 0x7fdae0151000 2024-03-23T23:43:09.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.577+0000 7fdad6a00640 1 -- 172.21.15.8:0/1371875685 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v25) v1 ==== 99+0+11 (secure 0 0 0) 0x7fdad80add00 con 0x7fdae0151000 2024-03-23T23:43:09.578 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-03-23T23:43:09.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.577+0000 7fdae5400640 1 -- 172.21.15.8:0/1371875685 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdac0067660 msgr2=0x7fdac0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:09.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.577+0000 7fdae5400640 1 --2- 172.21.15.8:0/1371875685 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdac0067660 0x7fdac0069b20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdad0007fd0 tx=0x7fdad0009040 comp rx=0 tx=0).stop 2024-03-23T23:43:09.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.577+0000 7fdae5400640 1 -- 172.21.15.8:0/1371875685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdae0151000 msgr2=0x7fdae00acae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:09.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.577+0000 7fdae5400640 1 --2- 172.21.15.8:0/1371875685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdae0151000 0x7fdae00acae0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdad80b0040 tx=0x7fdad80195f0 comp rx=0 tx=0).stop 2024-03-23T23:43:09.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.577+0000 7fdae5400640 1 -- 172.21.15.8:0/1371875685 shutdown_connections 2024-03-23T23:43:09.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.577+0000 7fdae5400640 1 --2- 172.21.15.8:0/1371875685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdae0151000 0x7fdae00acae0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:09.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.577+0000 7fdae5400640 1 --2- 172.21.15.8:0/1371875685 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdae00c86b0 0x7fdae00ac5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:09.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.577+0000 7fdae5400640 1 --2- 172.21.15.8:0/1371875685 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdac0067660 0x7fdac0069b20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:09.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.577+0000 7fdae5400640 1 --2- 172.21.15.8:0/1371875685 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdae00c4fb0 0x7fdae01463a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:09.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.577+0000 7fdae5400640 1 -- 172.21.15.8:0/1371875685 >> 172.21.15.8:0/1371875685 conn(0x7fdae00aad10 msgr2=0x7fdae01474f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:09.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.577+0000 7fdae5400640 1 -- 172.21.15.8:0/1371875685 shutdown_connections 2024-03-23T23:43:09.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.577+0000 7fdae5400640 1 -- 172.21.15.8:0/1371875685 wait complete. 2024-03-23T23:43:09.598 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-03-23T23:43:09.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.737+0000 7f7124000640 1 Processor -- start 2024-03-23T23:43:09.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.737+0000 7f7124000640 1 -- start start 2024-03-23T23:43:09.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.741+0000 7f7124000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f711c14fa80 0x7f711c0ad880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:09.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.741+0000 7f7124000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f711c0c2e80 0x7f711c1590f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:09.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.741+0000 7f7124000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f711c1567d0 con 0x7f711c0addc0 2024-03-23T23:43:09.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.741+0000 7f7124000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711c1562a0 con 0x7f711c0c2e80 2024-03-23T23:43:09.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.741+0000 7f7124000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711c0c26b0 con 0x7f711c14fa80 2024-03-23T23:43:09.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.741+0000 7f7122000640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f711c0addc0 0x7f711c159630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:45508/0 (socket says 172.21.15.8:45508) 2024-03-23T23:43:09.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.741+0000 7f7122000640 1 -- 172.21.15.8:0/3345165411 learned_addr learned my addr 172.21.15.8:0/3345165411 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:43:09.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.741+0000 7f7120c00640 1 --2- 172.21.15.8:0/3345165411 >> v2:172.21.15.196:3300/0 conn(0x7f711c0c2e80 0x7f711c1590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:09.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.741+0000 7f7121600640 1 --2- 172.21.15.8:0/3345165411 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f711c14fa80 0x7f711c0ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:09.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.741+0000 7f711be00640 1 -- 172.21.15.8:0/3345165411 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 597826547 0 0) 0x7f711c1567d0 con 0x7f711c0addc0 2024-03-23T23:43:09.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.741+0000 7f711be00640 1 -- 172.21.15.8:0/3345165411 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7104003530 con 0x7f711c0addc0 2024-03-23T23:43:09.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.741+0000 7f7121600640 1 -- 172.21.15.8:0/3345165411 >> v2:172.21.15.196:3300/0 conn(0x7f711c0c2e80 msgr2=0x7f711c1590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:09.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.741+0000 7f7121600640 1 --2- 172.21.15.8:0/3345165411 >> v2:172.21.15.196:3300/0 conn(0x7f711c0c2e80 0x7f711c1590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:09.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.741+0000 7f7121600640 1 -- 172.21.15.8:0/3345165411 >> v1:172.21.15.8:6789/0 conn(0x7f711c0addc0 legacy=0x7f711c159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:09.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.741+0000 7f7121600640 1 -- 172.21.15.8:0/3345165411 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711c159d40 con 0x7f711c14fa80 2024-03-23T23:43:09.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.745+0000 7f7121600640 1 --2- 172.21.15.8:0/3345165411 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f711c14fa80 0x7f711c0ad880 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f71100097c0 tx=0x7f711001c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=635f361c7237a644 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:09.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.745+0000 7f711be00640 1 -- 172.21.15.8:0/3345165411 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71100b0070 con 0x7f711c14fa80 2024-03-23T23:43:09.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.745+0000 7f711be00640 1 -- 172.21.15.8:0/3345165411 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71100ab600 con 0x7f711c14fa80 2024-03-23T23:43:09.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.745+0000 7f711be00640 1 -- 172.21.15.8:0/3345165411 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71100ab9d0 con 0x7f711c14fa80 2024-03-23T23:43:09.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.745+0000 7f7124000640 1 -- 172.21.15.8:0/3345165411 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f711c14fa80 msgr2=0x7f711c0ad880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:09.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.745+0000 7f7124000640 1 --2- 172.21.15.8:0/3345165411 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f711c14fa80 0x7f711c0ad880 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f71100097c0 tx=0x7f711001c380 comp rx=0 tx=0).stop 2024-03-23T23:43:09.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.745+0000 7f7124000640 1 -- 172.21.15.8:0/3345165411 shutdown_connections 2024-03-23T23:43:09.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.745+0000 7f7124000640 1 --2- 172.21.15.8:0/3345165411 >> v2:172.21.15.196:3300/0 conn(0x7f711c0c2e80 0x7f711c1590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:09.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.745+0000 7f7124000640 1 --2- 172.21.15.8:0/3345165411 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f711c14fa80 0x7f711c0ad880 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:09.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.745+0000 7f7124000640 1 -- 172.21.15.8:0/3345165411 >> 172.21.15.8:0/3345165411 conn(0x7f711c0c4a70 msgr2=0x7f711c0c4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:09.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.749+0000 7f7124000640 1 -- 172.21.15.8:0/3345165411 shutdown_connections 2024-03-23T23:43:09.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.749+0000 7f7124000640 1 -- 172.21.15.8:0/3345165411 wait complete. 2024-03-23T23:43:09.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.749+0000 7f7124000640 1 Processor -- start 2024-03-23T23:43:09.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.749+0000 7f7124000640 1 -- start start 2024-03-23T23:43:09.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.749+0000 7f7124000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f711c0addc0 0x7f711c158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:09.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.749+0000 7f7124000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f711c0c2e80 0x7f711c13f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:09.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.749+0000 7f7124000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f711c14fa80 0x7f711c13fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:09.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.749+0000 7f7124000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c162b40 con 0x7f711c0addc0 2024-03-23T23:43:09.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.749+0000 7f7124000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c1629c0 con 0x7f711c0c2e80 2024-03-23T23:43:09.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.749+0000 7f7124000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711c162cc0 con 0x7f711c14fa80 2024-03-23T23:43:09.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.749+0000 7f7121600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f711c0addc0 0x7f711c158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:09.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.749+0000 7f7121600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f711c0addc0 0x7f711c158280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60326/0 (socket says 172.21.15.8:60326) 2024-03-23T23:43:09.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.749+0000 7f7121600640 1 -- 172.21.15.8:0/4000068846 learned_addr learned my addr 172.21.15.8:0/4000068846 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:09.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.749+0000 7f7122000640 1 --2- 172.21.15.8:0/4000068846 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f711c14fa80 0x7f711c13fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:09.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.749+0000 7f7120c00640 1 --2- 172.21.15.8:0/4000068846 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f711c0c2e80 0x7f711c13f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:09.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.749+0000 7f7121600640 1 -- 172.21.15.8:0/4000068846 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f711c14fa80 msgr2=0x7f711c13fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:09.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.749+0000 7f7121600640 1 --2- 172.21.15.8:0/4000068846 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f711c14fa80 0x7f711c13fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:09.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.749+0000 7f7121600640 1 -- 172.21.15.8:0/4000068846 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f711c0c2e80 msgr2=0x7f711c13f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:09.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.749+0000 7f7121600640 1 --2- 172.21.15.8:0/4000068846 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f711c0c2e80 0x7f711c13f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:09.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.749+0000 7f7121600640 1 -- 172.21.15.8:0/4000068846 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711c0c1550 con 0x7f711c0addc0 2024-03-23T23:43:09.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.749+0000 7f7121600640 1 --2- 172.21.15.8:0/4000068846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f711c0addc0 0x7f711c158280 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7110018f90 tx=0x7f7110019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:09.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.749+0000 7f7119600640 1 -- 172.21.15.8:0/4000068846 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71100b9070 con 0x7f711c0addc0 2024-03-23T23:43:09.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.749+0000 7f7119600640 1 -- 172.21.15.8:0/4000068846 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71100b5480 con 0x7f711c0addc0 2024-03-23T23:43:09.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.749+0000 7f7119600640 1 -- 172.21.15.8:0/4000068846 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71100b0040 con 0x7f711c0addc0 2024-03-23T23:43:09.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.749+0000 7f7124000640 1 -- 172.21.15.8:0/4000068846 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f711c0c7930 con 0x7f711c0addc0 2024-03-23T23:43:09.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.753+0000 7f7124000640 1 -- 172.21.15.8:0/4000068846 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f711c147cc0 con 0x7f711c0addc0 2024-03-23T23:43:09.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.753+0000 7f7124000640 1 -- 172.21.15.8:0/4000068846 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f711c04f410 con 0x7f711c0addc0 2024-03-23T23:43:09.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.753+0000 7f7119600640 1 -- 172.21.15.8:0/4000068846 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f71100bc070 con 0x7f711c0addc0 2024-03-23T23:43:09.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.753+0000 7f7119600640 1 --2- 172.21.15.8:0/4000068846 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f70fc067660 0x7f70fc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:09.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.753+0000 7f7119600640 1 -- 172.21.15.8:0/4000068846 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f711011fd50 con 0x7f711c0addc0 2024-03-23T23:43:09.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.753+0000 7f7120c00640 1 --2- 172.21.15.8:0/4000068846 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f70fc067660 0x7f70fc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:09.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.753+0000 7f7120c00640 1 --2- 172.21.15.8:0/4000068846 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f70fc067660 0x7f70fc069b20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f711c1533c0 tx=0x7f7108009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:09.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.757+0000 7f7119600640 1 -- 172.21.15.8:0/4000068846 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f71100c3030 con 0x7f711c0addc0 2024-03-23T23:43:09.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.921+0000 7f7124000640 1 -- 172.21.15.8:0/4000068846 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7f711c0c3320 con 0x7f711c0addc0 2024-03-23T23:43:09.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.921+0000 7f7119600640 1 -- 172.21.15.8:0/4000068846 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v25) v1 ==== 95+0+11 (secure 0 0 0) 0x7f7110016090 con 0x7f711c0addc0 2024-03-23T23:43:09.923 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-03-23T23:43:09.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.921+0000 7f7124000640 1 -- 172.21.15.8:0/4000068846 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f70fc067660 msgr2=0x7f70fc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:09.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.921+0000 7f7124000640 1 --2- 172.21.15.8:0/4000068846 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f70fc067660 0x7f70fc069b20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f711c1533c0 tx=0x7f7108009190 comp rx=0 tx=0).stop 2024-03-23T23:43:09.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.921+0000 7f7124000640 1 -- 172.21.15.8:0/4000068846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f711c0addc0 msgr2=0x7f711c158280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:09.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.921+0000 7f7124000640 1 --2- 172.21.15.8:0/4000068846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f711c0addc0 0x7f711c158280 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7110018f90 tx=0x7f7110019120 comp rx=0 tx=0).stop 2024-03-23T23:43:09.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.921+0000 7f7124000640 1 -- 172.21.15.8:0/4000068846 shutdown_connections 2024-03-23T23:43:09.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.921+0000 7f7124000640 1 --2- 172.21.15.8:0/4000068846 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f70fc067660 0x7f70fc069b20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:09.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.921+0000 7f7124000640 1 --2- 172.21.15.8:0/4000068846 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f711c14fa80 0x7f711c13fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:09.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.921+0000 7f7124000640 1 --2- 172.21.15.8:0/4000068846 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f711c0c2e80 0x7f711c13f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:09.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.921+0000 7f7124000640 1 --2- 172.21.15.8:0/4000068846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f711c0addc0 0x7f711c158280 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:09.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.921+0000 7f7124000640 1 -- 172.21.15.8:0/4000068846 >> 172.21.15.8:0/4000068846 conn(0x7f711c0c4a70 msgr2=0x7f711c06df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:09.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.921+0000 7f7124000640 1 -- 172.21.15.8:0/4000068846 shutdown_connections 2024-03-23T23:43:09.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:09.921+0000 7f7124000640 1 -- 172.21.15.8:0/4000068846 wait complete. 2024-03-23T23:43:09.943 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-03-23T23:43:10.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.085+0000 7f05cb000640 1 Processor -- start 2024-03-23T23:43:10.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.085+0000 7f05cb000640 1 -- start start 2024-03-23T23:43:10.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.085+0000 7f05cb000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05c40c4fb0 0x7f05c41542c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:10.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.085+0000 7f05cb000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f05c40c86b0 0x7f05c40ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:10.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.085+0000 7f05cb000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c40c5770 con 0x7f05c4151000 2024-03-23T23:43:10.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.085+0000 7f05cb000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c40c84a0 con 0x7f05c40c86b0 2024-03-23T23:43:10.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.085+0000 7f05cb000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c40c46a0 con 0x7f05c40c4fb0 2024-03-23T23:43:10.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.085+0000 7f05c9000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f05c40c86b0 0x7f05c40ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:10.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.085+0000 7f05c3e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f05c4151000 0x7f05c40c6e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:59990/0 (socket says 172.21.15.8:59990) 2024-03-23T23:43:10.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.085+0000 7f05c3e00640 1 -- 172.21.15.8:0/2692556151 learned_addr learned my addr 172.21.15.8:0/2692556151 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:43:10.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.085+0000 7f05bbe00640 1 --2- 172.21.15.8:0/2692556151 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05c40c4fb0 0x7f05c41542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:10.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.085+0000 7f05c3400640 1 -- 172.21.15.8:0/2692556151 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3792171398 0 0) 0x7f05c40c5770 con 0x7f05c4151000 2024-03-23T23:43:10.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.085+0000 7f05c3400640 1 -- 172.21.15.8:0/2692556151 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05a8003530 con 0x7f05c4151000 2024-03-23T23:43:10.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.085+0000 7f05c9000640 1 -- 172.21.15.8:0/2692556151 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05c40c4fb0 msgr2=0x7f05c41542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:10.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.085+0000 7f05c9000640 1 --2- 172.21.15.8:0/2692556151 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05c40c4fb0 0x7f05c41542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:10.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.085+0000 7f05c9000640 1 -- 172.21.15.8:0/2692556151 >> v1:172.21.15.196:6789/0 conn(0x7f05c4151000 legacy=0x7f05c40c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:10.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.085+0000 7f05c9000640 1 -- 172.21.15.8:0/2692556151 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c40c5490 con 0x7f05c40c86b0 2024-03-23T23:43:10.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.085+0000 7f05bbe00640 1 --2- 172.21.15.8:0/2692556151 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05c40c4fb0 0x7f05c41542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:43:10.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.093+0000 7f05c9000640 1 --2- 172.21.15.8:0/2692556151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05c40c86b0 0x7f05c40ae8c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f05bc009d90 tx=0x7f05bc01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b8c07fdde931065 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:10.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.093+0000 7f05c3400640 1 -- 172.21.15.8:0/2692556151 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc0b2070 con 0x7f05c40c86b0 2024-03-23T23:43:10.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.093+0000 7f05c3400640 1 -- 172.21.15.8:0/2692556151 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05bc0a5970 con 0x7f05c40c86b0 2024-03-23T23:43:10.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.093+0000 7f05c3400640 1 -- 172.21.15.8:0/2692556151 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc0a5d40 con 0x7f05c40c86b0 2024-03-23T23:43:10.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.093+0000 7f05cb000640 1 -- 172.21.15.8:0/2692556151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05c40c86b0 msgr2=0x7f05c40ae8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:10.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.093+0000 7f05cb000640 1 --2- 172.21.15.8:0/2692556151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05c40c86b0 0x7f05c40ae8c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f05bc009d90 tx=0x7f05bc01c8b0 comp rx=0 tx=0).stop 2024-03-23T23:43:10.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.093+0000 7f05cb000640 1 -- 172.21.15.8:0/2692556151 shutdown_connections 2024-03-23T23:43:10.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.093+0000 7f05cb000640 1 --2- 172.21.15.8:0/2692556151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05c40c86b0 0x7f05c40ae8c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:10.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.093+0000 7f05cb000640 1 --2- 172.21.15.8:0/2692556151 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05c40c4fb0 0x7f05c41542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:10.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.093+0000 7f05cb000640 1 -- 172.21.15.8:0/2692556151 >> 172.21.15.8:0/2692556151 conn(0x7f05c40aad10 msgr2=0x7f05c40ab120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:10.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.093+0000 7f05cb000640 1 -- 172.21.15.8:0/2692556151 shutdown_connections 2024-03-23T23:43:10.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.093+0000 7f05cb000640 1 -- 172.21.15.8:0/2692556151 wait complete. 2024-03-23T23:43:10.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.093+0000 7f05cb000640 1 Processor -- start 2024-03-23T23:43:10.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.093+0000 7f05cb000640 1 -- start start 2024-03-23T23:43:10.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.097+0000 7f05cb000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05c40c4fb0 0x7f05c41f15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:10.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.097+0000 7f05cb000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05c40c86b0 0x7f05c40c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:10.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.097+0000 7f05cb000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05c4151000 0x7f05c41ee880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:10.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.097+0000 7f05cb000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c40c3490 con 0x7f05c40c86b0 2024-03-23T23:43:10.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.097+0000 7f05cb000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c40c7570 con 0x7f05c4151000 2024-03-23T23:43:10.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.097+0000 7f05cb000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c40c3610 con 0x7f05c40c4fb0 2024-03-23T23:43:10.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.097+0000 7f05bbe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05c40c86b0 0x7f05c40c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:10.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.097+0000 7f05c3e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05c40c4fb0 0x7f05c41f15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:10.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.097+0000 7f05bbe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05c40c86b0 0x7f05c40c25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60344/0 (socket says 172.21.15.8:60344) 2024-03-23T23:43:10.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.097+0000 7f05bbe00640 1 -- 172.21.15.8:0/2319022684 learned_addr learned my addr 172.21.15.8:0/2319022684 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:10.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.097+0000 7f05c9000640 1 --2- 172.21.15.8:0/2319022684 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05c4151000 0x7f05c41ee880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:10.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.097+0000 7f05bbe00640 1 -- 172.21.15.8:0/2319022684 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05c40c4fb0 msgr2=0x7f05c41f15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:10.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.097+0000 7f05bbe00640 1 --2- 172.21.15.8:0/2319022684 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05c40c4fb0 0x7f05c41f15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:10.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.097+0000 7f05bbe00640 1 -- 172.21.15.8:0/2319022684 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05c4151000 msgr2=0x7f05c41ee880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:10.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.097+0000 7f05bbe00640 1 --2- 172.21.15.8:0/2319022684 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05c4151000 0x7f05c41ee880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:10.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.097+0000 7f05bbe00640 1 -- 172.21.15.8:0/2319022684 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c406c560 con 0x7f05c40c86b0 2024-03-23T23:43:10.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.097+0000 7f05bbe00640 1 --2- 172.21.15.8:0/2319022684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05c40c86b0 0x7f05c40c25f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f05ac00e9b0 tx=0x7f05ac00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:10.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.097+0000 7f05c0c00640 1 -- 172.21.15.8:0/2319022684 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac017070 con 0x7f05c40c86b0 2024-03-23T23:43:10.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.097+0000 7f05c0c00640 1 -- 172.21.15.8:0/2319022684 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ac00ca00 con 0x7f05c40c86b0 2024-03-23T23:43:10.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.097+0000 7f05cb000640 1 -- 172.21.15.8:0/2319022684 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c406c280 con 0x7f05c40c86b0 2024-03-23T23:43:10.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.097+0000 7f05c0c00640 1 -- 172.21.15.8:0/2319022684 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac00cdd0 con 0x7f05c40c86b0 2024-03-23T23:43:10.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.097+0000 7f05cb000640 1 -- 172.21.15.8:0/2319022684 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c40acb70 con 0x7f05c40c86b0 2024-03-23T23:43:10.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.097+0000 7f05cb000640 1 -- 172.21.15.8:0/2319022684 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c404f410 con 0x7f05c40c86b0 2024-03-23T23:43:10.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.101+0000 7f05c0c00640 1 -- 172.21.15.8:0/2319022684 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f05ac01a070 con 0x7f05c40c86b0 2024-03-23T23:43:10.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.101+0000 7f05c0c00640 1 --2- 172.21.15.8:0/2319022684 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f05a0067690 0x7f05a0069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:10.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.101+0000 7f05c0c00640 1 -- 172.21.15.8:0/2319022684 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f05ac085960 con 0x7f05c40c86b0 2024-03-23T23:43:10.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.101+0000 7f05c3e00640 1 --2- 172.21.15.8:0/2319022684 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f05a0067690 0x7f05a0069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:10.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.101+0000 7f05c3e00640 1 --2- 172.21.15.8:0/2319022684 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f05a0067690 0x7f05a0069b50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f05b4007fd0 tx=0x7f05b4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:10.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.105+0000 7f05c0c00640 1 -- 172.21.15.8:0/2319022684 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f05ac055cf0 con 0x7f05c40c86b0 2024-03-23T23:43:10.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.268+0000 7f05cb000640 1 -- 172.21.15.8:0/2319022684 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) v1 -- 0x7f05c406edd0 con 0x7f05c40c86b0 2024-03-23T23:43:10.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.268+0000 7f05c0c00640 1 -- 172.21.15.8:0/2319022684 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v25) v1 ==== 99+0+11 (secure 0 0 0) 0x7f05ac059d90 con 0x7f05c40c86b0 2024-03-23T23:43:10.272 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-03-23T23:43:10.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.272+0000 7f05cb000640 1 -- 172.21.15.8:0/2319022684 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f05a0067690 msgr2=0x7f05a0069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:10.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.272+0000 7f05cb000640 1 --2- 172.21.15.8:0/2319022684 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f05a0067690 0x7f05a0069b50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f05b4007fd0 tx=0x7f05b4009040 comp rx=0 tx=0).stop 2024-03-23T23:43:10.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.272+0000 7f05cb000640 1 -- 172.21.15.8:0/2319022684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05c40c86b0 msgr2=0x7f05c40c25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:10.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.272+0000 7f05cb000640 1 --2- 172.21.15.8:0/2319022684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05c40c86b0 0x7f05c40c25f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f05ac00e9b0 tx=0x7f05ac00ee70 comp rx=0 tx=0).stop 2024-03-23T23:43:10.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.272+0000 7f05cb000640 1 -- 172.21.15.8:0/2319022684 shutdown_connections 2024-03-23T23:43:10.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.272+0000 7f05cb000640 1 --2- 172.21.15.8:0/2319022684 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05c4151000 0x7f05c41ee880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:10.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.272+0000 7f05cb000640 1 --2- 172.21.15.8:0/2319022684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05c40c86b0 0x7f05c40c25f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:10.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.272+0000 7f05cb000640 1 --2- 172.21.15.8:0/2319022684 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f05a0067690 0x7f05a0069b50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:10.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.272+0000 7f05cb000640 1 --2- 172.21.15.8:0/2319022684 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05c40c4fb0 0x7f05c41f15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:10.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.272+0000 7f05cb000640 1 -- 172.21.15.8:0/2319022684 >> 172.21.15.8:0/2319022684 conn(0x7f05c40aad10 msgr2=0x7f05c40706a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:10.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.272+0000 7f05cb000640 1 -- 172.21.15.8:0/2319022684 shutdown_connections 2024-03-23T23:43:10.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.272+0000 7f05cb000640 1 -- 172.21.15.8:0/2319022684 wait complete. 2024-03-23T23:43:10.294 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-03-23T23:43:10.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.436+0000 7fcaa8c00640 1 Processor -- start 2024-03-23T23:43:10.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.436+0000 7fcaa8c00640 1 -- start start 2024-03-23T23:43:10.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.436+0000 7fcaa8c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fcaa40712a0 0x7fcaa41542d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:10.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.436+0000 7fcaa8c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcaa40c5210 0x7fcaa40c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:10.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.436+0000 7fcaa8c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa40c3940 con 0x7fcaa40c46e0 2024-03-23T23:43:10.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.436+0000 7fcaa8c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa40c5740 con 0x7fcaa40712a0 2024-03-23T23:43:10.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.436+0000 7fcaa8c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa40c3c00 con 0x7fcaa40c5210 2024-03-23T23:43:10.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.436+0000 7fcaa1e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fcaa40712a0 0x7fcaa41542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:10.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.436+0000 7fcaa2800640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fcaa40c46e0 0x7fcaa4156c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:59994/0 (socket says 172.21.15.8:59994) 2024-03-23T23:43:10.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.436+0000 7fcaa2800640 1 -- 172.21.15.8:0/3304257099 learned_addr learned my addr 172.21.15.8:0/3304257099 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:43:10.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.436+0000 7fca9be00640 1 --2- 172.21.15.8:0/3304257099 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcaa40c5210 0x7fcaa40c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:10.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.436+0000 7fcaa1e00640 1 -- 172.21.15.8:0/3304257099 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcaa40c5210 msgr2=0x7fcaa40c6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:10.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.436+0000 7fcaa1e00640 1 --2- 172.21.15.8:0/3304257099 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcaa40c5210 0x7fcaa40c6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:10.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.436+0000 7fcaa1e00640 1 -- 172.21.15.8:0/3304257099 >> v1:172.21.15.196:6789/0 conn(0x7fcaa40c46e0 legacy=0x7fcaa4156c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:10.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.436+0000 7fcaa1e00640 1 -- 172.21.15.8:0/3304257099 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa40c3ee0 con 0x7fcaa40712a0 2024-03-23T23:43:10.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.436+0000 7fcaa1400640 1 -- 172.21.15.8:0/3304257099 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 612199389 0 0) 0x7fcaa40c3940 con 0x7fcaa40c46e0 2024-03-23T23:43:10.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.440+0000 7fcaa1e00640 1 --2- 172.21.15.8:0/3304257099 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcaa40712a0 0x7fcaa41542d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fca940097c0 tx=0x7fca9401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a4628789eff1196 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:10.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.440+0000 7fcaa1400640 1 -- 172.21.15.8:0/3304257099 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca940aa5f0 con 0x7fcaa40712a0 2024-03-23T23:43:10.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.440+0000 7fcaa1400640 1 -- 172.21.15.8:0/3304257099 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca940af070 con 0x7fcaa40712a0 2024-03-23T23:43:10.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.440+0000 7fcaa1400640 1 -- 172.21.15.8:0/3304257099 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca940aa9b0 con 0x7fcaa40712a0 2024-03-23T23:43:10.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.440+0000 7fcaa8c00640 1 -- 172.21.15.8:0/3304257099 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcaa40712a0 msgr2=0x7fcaa41542d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:10.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.440+0000 7fcaa8c00640 1 --2- 172.21.15.8:0/3304257099 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcaa40712a0 0x7fcaa41542d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fca940097c0 tx=0x7fca9401c470 comp rx=0 tx=0).stop 2024-03-23T23:43:10.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.440+0000 7fcaa8c00640 1 -- 172.21.15.8:0/3304257099 shutdown_connections 2024-03-23T23:43:10.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.440+0000 7fcaa8c00640 1 --2- 172.21.15.8:0/3304257099 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcaa40c5210 0x7fcaa40c6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:10.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.440+0000 7fcaa8c00640 1 --2- 172.21.15.8:0/3304257099 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcaa40712a0 0x7fcaa41542d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:10.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.440+0000 7fcaa8c00640 1 -- 172.21.15.8:0/3304257099 >> 172.21.15.8:0/3304257099 conn(0x7fcaa40aacf0 msgr2=0x7fcaa40ab100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:10.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.440+0000 7fcaa8c00640 1 -- 172.21.15.8:0/3304257099 shutdown_connections 2024-03-23T23:43:10.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.440+0000 7fcaa8c00640 1 -- 172.21.15.8:0/3304257099 wait complete. 2024-03-23T23:43:10.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.444+0000 7fcaa8c00640 1 Processor -- start 2024-03-23T23:43:10.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.444+0000 7fcaa8c00640 1 -- start start 2024-03-23T23:43:10.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.444+0000 7fcaa8c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcaa40712a0 0x7fcaa41472b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:10.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.444+0000 7fcaa8c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcaa40c46e0 0x7fcaa40c25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:10.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.444+0000 7fcaa8c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaa40c5210 0x7fcaa40c2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:10.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.444+0000 7fcaa8c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa41601c0 con 0x7fcaa40c5210 2024-03-23T23:43:10.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.444+0000 7fcaa8c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa40718d0 con 0x7fcaa40c46e0 2024-03-23T23:43:10.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.444+0000 7fcaa8c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa4160340 con 0x7fcaa40712a0 2024-03-23T23:43:10.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.444+0000 7fcaa2800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaa40c5210 0x7fcaa40c2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:10.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.444+0000 7fcaa2800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaa40c5210 0x7fcaa40c2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60358/0 (socket says 172.21.15.8:60358) 2024-03-23T23:43:10.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.444+0000 7fcaa2800640 1 -- 172.21.15.8:0/3518232848 learned_addr learned my addr 172.21.15.8:0/3518232848 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:10.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.448+0000 7fca9be00640 1 --2- 172.21.15.8:0/3518232848 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcaa40c46e0 0x7fcaa40c25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:10.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.448+0000 7fcaa1e00640 1 --2- 172.21.15.8:0/3518232848 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcaa40712a0 0x7fcaa41472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:10.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.448+0000 7fcaa2800640 1 -- 172.21.15.8:0/3518232848 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcaa40712a0 msgr2=0x7fcaa41472b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:10.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.448+0000 7fcaa2800640 1 --2- 172.21.15.8:0/3518232848 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcaa40712a0 0x7fcaa41472b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:10.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.448+0000 7fcaa2800640 1 -- 172.21.15.8:0/3518232848 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcaa40c46e0 msgr2=0x7fcaa40c25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:10.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.448+0000 7fcaa2800640 1 --2- 172.21.15.8:0/3518232848 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcaa40c46e0 0x7fcaa40c25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:10.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.448+0000 7fcaa2800640 1 -- 172.21.15.8:0/3518232848 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa41504a0 con 0x7fcaa40c5210 2024-03-23T23:43:10.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.448+0000 7fca9be00640 1 --2- 172.21.15.8:0/3518232848 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcaa40c46e0 0x7fcaa40c25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:43:10.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.448+0000 7fcaa2800640 1 --2- 172.21.15.8:0/3518232848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaa40c5210 0x7fcaa40c2b10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00c7a0 tx=0x7fca9c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:10.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.448+0000 7fca9a000640 1 -- 172.21.15.8:0/3518232848 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c018070 con 0x7fcaa40c5210 2024-03-23T23:43:10.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.448+0000 7fca9a000640 1 -- 172.21.15.8:0/3518232848 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9c00a640 con 0x7fcaa40c5210 2024-03-23T23:43:10.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.448+0000 7fca9a000640 1 -- 172.21.15.8:0/3518232848 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c00aab0 con 0x7fcaa40c5210 2024-03-23T23:43:10.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.448+0000 7fcaa8c00640 1 -- 172.21.15.8:0/3518232848 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa406e010 con 0x7fcaa40c5210 2024-03-23T23:43:10.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.448+0000 7fcaa8c00640 1 -- 172.21.15.8:0/3518232848 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa4150720 con 0x7fcaa40c5210 2024-03-23T23:43:10.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.448+0000 7fcaa8c00640 1 -- 172.21.15.8:0/3518232848 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa414efa0 con 0x7fcaa40c5210 2024-03-23T23:43:10.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.452+0000 7fca9a000640 1 -- 172.21.15.8:0/3518232848 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fca9c01b070 con 0x7fcaa40c5210 2024-03-23T23:43:10.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.452+0000 7fca9a000640 1 --2- 172.21.15.8:0/3518232848 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fca80067690 0x7fca80069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:10.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.452+0000 7fca9a000640 1 -- 172.21.15.8:0/3518232848 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fca9c085110 con 0x7fcaa40c5210 2024-03-23T23:43:10.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.452+0000 7fcaa1e00640 1 --2- 172.21.15.8:0/3518232848 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fca80067690 0x7fca80069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:10.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.452+0000 7fcaa1e00640 1 --2- 172.21.15.8:0/3518232848 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fca80067690 0x7fca80069b50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fca940ae000 tx=0x7fca940a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:10.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.456+0000 7fca9a000640 1 -- 172.21.15.8:0/3518232848 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fcaa41504a0 con 0x7fcaa40c5210 2024-03-23T23:43:10.505 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:43:10.509 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:43:10.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.620+0000 7fcaa8c00640 1 -- 172.21.15.8:0/3518232848 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) v1 -- 0x7fcaa404f410 con 0x7fcaa40c5210 2024-03-23T23:43:10.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.620+0000 7fca9a000640 1 -- 172.21.15.8:0/3518232848 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v25) v1 ==== 95+0+11 (secure 0 0 0) 0x7fca9c055400 con 0x7fcaa40c5210 2024-03-23T23:43:10.628 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-03-23T23:43:10.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.624+0000 7fcaa8c00640 1 -- 172.21.15.8:0/3518232848 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fca80067690 msgr2=0x7fca80069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:10.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.624+0000 7fcaa8c00640 1 --2- 172.21.15.8:0/3518232848 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fca80067690 0x7fca80069b50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fca940ae000 tx=0x7fca940a7000 comp rx=0 tx=0).stop 2024-03-23T23:43:10.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.624+0000 7fcaa8c00640 1 -- 172.21.15.8:0/3518232848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaa40c5210 msgr2=0x7fcaa40c2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:10.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.624+0000 7fcaa8c00640 1 --2- 172.21.15.8:0/3518232848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaa40c5210 0x7fcaa40c2b10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00c7a0 tx=0x7fca9c00cc60 comp rx=0 tx=0).stop 2024-03-23T23:43:10.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.624+0000 7fcaa8c00640 1 -- 172.21.15.8:0/3518232848 shutdown_connections 2024-03-23T23:43:10.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.624+0000 7fcaa8c00640 1 --2- 172.21.15.8:0/3518232848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaa40c5210 0x7fcaa40c2b10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:10.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.624+0000 7fcaa8c00640 1 --2- 172.21.15.8:0/3518232848 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcaa40c46e0 0x7fcaa40c25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:10.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.624+0000 7fcaa8c00640 1 --2- 172.21.15.8:0/3518232848 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fca80067690 0x7fca80069b50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:10.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.624+0000 7fcaa8c00640 1 --2- 172.21.15.8:0/3518232848 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcaa40712a0 0x7fcaa41472b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:10.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.624+0000 7fcaa8c00640 1 -- 172.21.15.8:0/3518232848 >> 172.21.15.8:0/3518232848 conn(0x7fcaa40aacf0 msgr2=0x7fcaa4151570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:10.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.624+0000 7fcaa8c00640 1 -- 172.21.15.8:0/3518232848 shutdown_connections 2024-03-23T23:43:10.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.624+0000 7fcaa8c00640 1 -- 172.21.15.8:0/3518232848 wait complete. 2024-03-23T23:43:10.646 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T23:43:10.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.784+0000 7f6141400640 1 Processor -- start 2024-03-23T23:43:10.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.784+0000 7f6141400640 1 -- start start 2024-03-23T23:43:10.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.784+0000 7f6141400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f613c0711a0 0x7f613c153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:10.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.784+0000 7f6141400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f613c0c8a40 0x7f613c154200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:10.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.784+0000 7f6141400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f613c0c4670 con 0x7f613c0c6dd0 2024-03-23T23:43:10.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.784+0000 7f6141400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f613c0c4940 con 0x7f613c0c8a40 2024-03-23T23:43:10.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.784+0000 7f6141400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f613c153830 con 0x7f613c0711a0 2024-03-23T23:43:10.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.784+0000 7f6140a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f613c0c8a40 0x7f613c154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:10.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.784+0000 7f6140a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f613c0c8a40 0x7f613c154200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60374/0 (socket says 172.21.15.8:60374) 2024-03-23T23:43:10.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.784+0000 7f6140a00640 1 -- 172.21.15.8:0/2596992743 learned_addr learned my addr 172.21.15.8:0/2596992743 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:10.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.784+0000 7f613be00640 1 --2- 172.21.15.8:0/2596992743 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f613c0711a0 0x7f613c153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:10.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.784+0000 7f6140a00640 1 -- 172.21.15.8:0/2596992743 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f613c0711a0 msgr2=0x7f613c153cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:10.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.784+0000 7f6140a00640 1 --2- 172.21.15.8:0/2596992743 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f613c0711a0 0x7f613c153cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:10.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.784+0000 7f6140a00640 1 -- 172.21.15.8:0/2596992743 >> v1:172.21.15.196:6789/0 conn(0x7f613c0c6dd0 legacy=0x7f613c1508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:10.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.788+0000 7f6140a00640 1 -- 172.21.15.8:0/2596992743 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f613c0c4b90 con 0x7f613c0c8a40 2024-03-23T23:43:10.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.788+0000 7f6140a00640 1 --2- 172.21.15.8:0/2596992743 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f613c0c8a40 0x7f613c154200 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6134009e50 tx=0x7f613401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c716f04c4d2f34 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:10.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.788+0000 7f613b400640 1 -- 172.21.15.8:0/2596992743 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61340a5660 con 0x7f613c0c8a40 2024-03-23T23:43:10.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.788+0000 7f613b400640 1 -- 172.21.15.8:0/2596992743 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61340a5800 con 0x7f613c0c8a40 2024-03-23T23:43:10.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.788+0000 7f613b400640 1 -- 172.21.15.8:0/2596992743 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61340a5bd0 con 0x7f613c0c8a40 2024-03-23T23:43:10.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.788+0000 7f6141400640 1 -- 172.21.15.8:0/2596992743 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f613c0c8a40 msgr2=0x7f613c154200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:10.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.788+0000 7f6141400640 1 --2- 172.21.15.8:0/2596992743 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f613c0c8a40 0x7f613c154200 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6134009e50 tx=0x7f613401c9a0 comp rx=0 tx=0).stop 2024-03-23T23:43:10.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.788+0000 7f6141400640 1 -- 172.21.15.8:0/2596992743 shutdown_connections 2024-03-23T23:43:10.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.788+0000 7f6141400640 1 --2- 172.21.15.8:0/2596992743 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f613c0c8a40 0x7f613c154200 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:10.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.788+0000 7f6141400640 1 --2- 172.21.15.8:0/2596992743 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f613c0711a0 0x7f613c153cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:10.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.788+0000 7f6141400640 1 -- 172.21.15.8:0/2596992743 >> 172.21.15.8:0/2596992743 conn(0x7f613c0aac80 msgr2=0x7f613c0ab090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:10.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.788+0000 7f6141400640 1 -- 172.21.15.8:0/2596992743 shutdown_connections 2024-03-23T23:43:10.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.788+0000 7f6141400640 1 -- 172.21.15.8:0/2596992743 wait complete. 2024-03-23T23:43:10.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.792+0000 7f6141400640 1 Processor -- start 2024-03-23T23:43:10.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.792+0000 7f6141400640 1 -- start start 2024-03-23T23:43:10.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.792+0000 7f6141400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f613c0711a0 0x7f613c1424d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:10.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.792+0000 7f6141400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f613c0c6dd0 0x7f613c1ee8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:10.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.792+0000 7f6141400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f613c0c8a40 0x7f613c1eee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:10.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.792+0000 7f6141400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613c1606c0 con 0x7f613c0711a0 2024-03-23T23:43:10.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.792+0000 7f6141400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613c0717d0 con 0x7f613c0c8a40 2024-03-23T23:43:10.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.792+0000 7f6141400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f613c160840 con 0x7f613c0c6dd0 2024-03-23T23:43:10.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.792+0000 7f613be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f613c0711a0 0x7f613c1424d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:10.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.792+0000 7f613be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f613c0711a0 0x7f613c1424d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60382/0 (socket says 172.21.15.8:60382) 2024-03-23T23:43:10.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.792+0000 7f613be00640 1 -- 172.21.15.8:0/4165880328 learned_addr learned my addr 172.21.15.8:0/4165880328 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:10.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.792+0000 7f6140a00640 1 --2- 172.21.15.8:0/4165880328 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f613c0c8a40 0x7f613c1eee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:10.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.792+0000 7f6133e00640 1 --2- 172.21.15.8:0/4165880328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f613c0c6dd0 0x7f613c1ee8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:10.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.792+0000 7f613be00640 1 -- 172.21.15.8:0/4165880328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f613c0c6dd0 msgr2=0x7f613c1ee8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:10.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.792+0000 7f613be00640 1 --2- 172.21.15.8:0/4165880328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f613c0c6dd0 0x7f613c1ee8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:10.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.792+0000 7f613be00640 1 -- 172.21.15.8:0/4165880328 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f613c0c8a40 msgr2=0x7f613c1eee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:10.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.792+0000 7f613be00640 1 --2- 172.21.15.8:0/4165880328 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f613c0c8a40 0x7f613c1eee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:10.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.792+0000 7f613be00640 1 -- 172.21.15.8:0/4165880328 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f613c1ef4c0 con 0x7f613c0711a0 2024-03-23T23:43:10.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.792+0000 7f6133e00640 1 --2- 172.21.15.8:0/4165880328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f613c0c6dd0 0x7f613c1ee8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:43:10.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.792+0000 7f613be00640 1 --2- 172.21.15.8:0/4165880328 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f613c0711a0 0x7f613c1424d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f612c00e8a0 tx=0x7f612c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:10.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.792+0000 7f6138c00640 1 -- 172.21.15.8:0/4165880328 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c017070 con 0x7f613c0711a0 2024-03-23T23:43:10.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.792+0000 7f6138c00640 1 -- 172.21.15.8:0/4165880328 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f612c00c940 con 0x7f613c0711a0 2024-03-23T23:43:10.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.792+0000 7f6141400640 1 -- 172.21.15.8:0/4165880328 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f613c0aa9f0 con 0x7f613c0711a0 2024-03-23T23:43:10.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.792+0000 7f6138c00640 1 -- 172.21.15.8:0/4165880328 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c00ccf0 con 0x7f613c0711a0 2024-03-23T23:43:10.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.792+0000 7f6141400640 1 -- 172.21.15.8:0/4165880328 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f613c0aa0f0 con 0x7f613c0711a0 2024-03-23T23:43:10.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.796+0000 7f6141400640 1 -- 172.21.15.8:0/4165880328 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f613c04f410 con 0x7f613c0711a0 2024-03-23T23:43:10.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.796+0000 7f6138c00640 1 -- 172.21.15.8:0/4165880328 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f612c01a070 con 0x7f613c0711a0 2024-03-23T23:43:10.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.796+0000 7f6138c00640 1 --2- 172.21.15.8:0/4165880328 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6118067660 0x7f6118069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:10.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.796+0000 7f6138c00640 1 -- 172.21.15.8:0/4165880328 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f612c0859e0 con 0x7f613c0711a0 2024-03-23T23:43:10.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.796+0000 7f6133e00640 1 --2- 172.21.15.8:0/4165880328 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6118067660 0x7f6118069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:10.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.796+0000 7f6133e00640 1 --2- 172.21.15.8:0/4165880328 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6118067660 0x7f6118069b20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f613c149cf0 tx=0x7f6124009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:10.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.800+0000 7f6138c00640 1 -- 172.21.15.8:0/4165880328 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f612c055d70 con 0x7f613c0711a0 2024-03-23T23:43:11.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:10.996+0000 7f6141400640 1 -- 172.21.15.8:0/4165880328 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f613c14ba70 con 0x7f613c0711a0 2024-03-23T23:43:11.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.000+0000 7f6138c00640 1 -- 172.21.15.8:0/4165880328 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6245 (secure 0 0 0) 0x7f612c059e10 con 0x7f613c0711a0 2024-03-23T23:43:11.001 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:43:11.002 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6836/3149325777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3149325777},{"type":"v1","addr":"172.21.15.196:6836","nonce":3149325777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6833/1542162403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1542162403},{"type":"v1","addr":"172.21.15.8:6833","nonce":1542162403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T23:42:40.070799+0000","modified":"2024-03-23T23:42:44.080269+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6837/3402347550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":3402347550},{"type":"v1","addr":"172.21.15.196:6837","nonce":3402347550}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T23:42:50.113972+0000","modified":"2024-03-23T23:42:54.152778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.8:6835/3531853933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3531853933},{"type":"v1","addr":"172.21.15.8:6835","nonce":3531853933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4269,"qdb_cluster":[4269]},"id":2}]} 2024-03-23T23:43:11.002 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 15 2024-03-23T23:43:11.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.000+0000 7f6141400640 1 -- 172.21.15.8:0/4165880328 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6118067660 msgr2=0x7f6118069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:11.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.000+0000 7f6141400640 1 --2- 172.21.15.8:0/4165880328 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6118067660 0x7f6118069b20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f613c149cf0 tx=0x7f6124009040 comp rx=0 tx=0).stop 2024-03-23T23:43:11.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.000+0000 7f6141400640 1 -- 172.21.15.8:0/4165880328 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f613c0711a0 msgr2=0x7f613c1424d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:11.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.000+0000 7f6141400640 1 --2- 172.21.15.8:0/4165880328 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f613c0711a0 0x7f613c1424d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f612c00e8a0 tx=0x7f612c00eca0 comp rx=0 tx=0).stop 2024-03-23T23:43:11.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.000+0000 7f6141400640 1 -- 172.21.15.8:0/4165880328 shutdown_connections 2024-03-23T23:43:11.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.000+0000 7f6141400640 1 --2- 172.21.15.8:0/4165880328 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f613c0c8a40 0x7f613c1eee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:11.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.000+0000 7f6141400640 1 --2- 172.21.15.8:0/4165880328 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6118067660 0x7f6118069b20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:11.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.000+0000 7f6141400640 1 --2- 172.21.15.8:0/4165880328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f613c0c6dd0 0x7f613c1ee8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:11.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.000+0000 7f6141400640 1 --2- 172.21.15.8:0/4165880328 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f613c0711a0 0x7f613c1424d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:11.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.000+0000 7f6141400640 1 -- 172.21.15.8:0/4165880328 >> 172.21.15.8:0/4165880328 conn(0x7f613c0aac80 msgr2=0x7f613c153bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:11.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.000+0000 7f6141400640 1 -- 172.21.15.8:0/4165880328 shutdown_connections 2024-03-23T23:43:11.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.000+0000 7f6141400640 1 -- 172.21.15.8:0/4165880328 wait complete. 2024-03-23T23:43:11.022 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:43:11.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.160+0000 7fb7efe00640 1 Processor -- start 2024-03-23T23:43:11.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.160+0000 7fb7efe00640 1 -- start start 2024-03-23T23:43:11.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.160+0000 7fb7efe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb7e80c8a50 0x7fb7e80c2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:11.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.160+0000 7fb7efe00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb7e80c2ba0 0x7fb7e8160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:11.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.160+0000 7fb7efe00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e80c4340 con 0x7fb7e806d6e0 2024-03-23T23:43:11.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.160+0000 7fb7efe00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e80c4740 con 0x7fb7e80c8a50 2024-03-23T23:43:11.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.160+0000 7fb7efe00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e80c4060 con 0x7fb7e80c2ba0 2024-03-23T23:43:11.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.164+0000 7fb7ed400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb7e80c8a50 0x7fb7e80c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:11.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.164+0000 7fb7eca00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fb7e806d6e0 0x7fb7e8155a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:45524/0 (socket says 172.21.15.8:45524) 2024-03-23T23:43:11.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.164+0000 7fb7eca00640 1 -- 172.21.15.8:0/1365514342 learned_addr learned my addr 172.21.15.8:0/1365514342 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:43:11.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.164+0000 7fb7ede00640 1 --2- 172.21.15.8:0/1365514342 >> v2:172.21.15.196:3300/0 conn(0x7fb7e80c2ba0 0x7fb7e8160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:11.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.164+0000 7fb7ed400640 1 -- 172.21.15.8:0/1365514342 >> v2:172.21.15.196:3300/0 conn(0x7fb7e80c2ba0 msgr2=0x7fb7e8160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:11.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.164+0000 7fb7ed400640 1 --2- 172.21.15.8:0/1365514342 >> v2:172.21.15.196:3300/0 conn(0x7fb7e80c2ba0 0x7fb7e8160300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:11.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.164+0000 7fb7ed400640 1 -- 172.21.15.8:0/1365514342 >> v1:172.21.15.8:6789/0 conn(0x7fb7e806d6e0 legacy=0x7fb7e8155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:11.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.164+0000 7fb7ed400640 1 -- 172.21.15.8:0/1365514342 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e80c3570 con 0x7fb7e80c8a50 2024-03-23T23:43:11.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.164+0000 7fb7ed400640 1 --2- 172.21.15.8:0/1365514342 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7e80c8a50 0x7fb7e80c2660 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb7e806c100 tx=0x7fb7dc01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff5fb9b1cdb59b8a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:11.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.164+0000 7fb7e7e00640 1 -- 172.21.15.8:0/1365514342 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc0b1070 con 0x7fb7e80c8a50 2024-03-23T23:43:11.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.164+0000 7fb7e7e00640 1 -- 172.21.15.8:0/1365514342 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7dc0ac620 con 0x7fb7e80c8a50 2024-03-23T23:43:11.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.164+0000 7fb7e7e00640 1 -- 172.21.15.8:0/1365514342 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc0ac9f0 con 0x7fb7e80c8a50 2024-03-23T23:43:11.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.168+0000 7fb7efe00640 1 -- 172.21.15.8:0/1365514342 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7e80c8a50 msgr2=0x7fb7e80c2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:11.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.168+0000 7fb7efe00640 1 --2- 172.21.15.8:0/1365514342 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7e80c8a50 0x7fb7e80c2660 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb7e806c100 tx=0x7fb7dc01c3c0 comp rx=0 tx=0).stop 2024-03-23T23:43:11.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.168+0000 7fb7efe00640 1 -- 172.21.15.8:0/1365514342 shutdown_connections 2024-03-23T23:43:11.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.168+0000 7fb7efe00640 1 --2- 172.21.15.8:0/1365514342 >> v2:172.21.15.196:3300/0 conn(0x7fb7e80c2ba0 0x7fb7e8160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:11.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.168+0000 7fb7efe00640 1 --2- 172.21.15.8:0/1365514342 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7e80c8a50 0x7fb7e80c2660 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:11.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.168+0000 7fb7efe00640 1 -- 172.21.15.8:0/1365514342 >> 172.21.15.8:0/1365514342 conn(0x7fb7e80aafe0 msgr2=0x7fb7e80ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:11.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.168+0000 7fb7efe00640 1 -- 172.21.15.8:0/1365514342 shutdown_connections 2024-03-23T23:43:11.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.168+0000 7fb7efe00640 1 -- 172.21.15.8:0/1365514342 wait complete. 2024-03-23T23:43:11.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.168+0000 7fb7efe00640 1 Processor -- start 2024-03-23T23:43:11.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.168+0000 7fb7efe00640 1 -- start start 2024-03-23T23:43:11.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.172+0000 7fb7efe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7e80c2ba0 0x7fb7e8152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:11.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.172+0000 7fb7efe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb7e80c8a50 0x7fb7e81f1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:11.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.172+0000 7fb7efe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb7e81f2290 0x7fb7e80ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:11.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.172+0000 7fb7efe00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e806e360 con 0x7fb7e80c2ba0 2024-03-23T23:43:11.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.172+0000 7fb7efe00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e806e1e0 con 0x7fb7e81f2290 2024-03-23T23:43:11.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.172+0000 7fb7efe00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e8156170 con 0x7fb7e80c8a50 2024-03-23T23:43:11.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.172+0000 7fb7ed400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7e80c2ba0 0x7fb7e8152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:11.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.172+0000 7fb7ed400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7e80c2ba0 0x7fb7e8152800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60394/0 (socket says 172.21.15.8:60394) 2024-03-23T23:43:11.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.172+0000 7fb7ed400640 1 -- 172.21.15.8:0/3946297888 learned_addr learned my addr 172.21.15.8:0/3946297888 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:11.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.172+0000 7fb7eca00640 1 --2- 172.21.15.8:0/3946297888 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb7e80c8a50 0x7fb7e81f1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:11.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.172+0000 7fb7ede00640 1 --2- 172.21.15.8:0/3946297888 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb7e81f2290 0x7fb7e80ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:11.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.172+0000 7fb7ed400640 1 -- 172.21.15.8:0/3946297888 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb7e80c8a50 msgr2=0x7fb7e81f1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:11.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.172+0000 7fb7ed400640 1 --2- 172.21.15.8:0/3946297888 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb7e80c8a50 0x7fb7e81f1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:11.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.172+0000 7fb7ed400640 1 -- 172.21.15.8:0/3946297888 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb7e81f2290 msgr2=0x7fb7e80ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:11.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.172+0000 7fb7ed400640 1 --2- 172.21.15.8:0/3946297888 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb7e81f2290 0x7fb7e80ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:11.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.172+0000 7fb7ed400640 1 -- 172.21.15.8:0/3946297888 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e81572d0 con 0x7fb7e80c2ba0 2024-03-23T23:43:11.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.172+0000 7fb7ed400640 1 --2- 172.21.15.8:0/3946297888 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7e80c2ba0 0x7fb7e8152800 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc0af040 tx=0x7fb7dc01ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:11.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.172+0000 7fb7e5600640 1 -- 172.21.15.8:0/3946297888 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc0b1050 con 0x7fb7e80c2ba0 2024-03-23T23:43:11.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.172+0000 7fb7e5600640 1 -- 172.21.15.8:0/3946297888 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7dc0bd070 con 0x7fb7e80c2ba0 2024-03-23T23:43:11.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.172+0000 7fb7efe00640 1 -- 172.21.15.8:0/3946297888 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e81575b0 con 0x7fb7e80c2ba0 2024-03-23T23:43:11.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.172+0000 7fb7e5600640 1 -- 172.21.15.8:0/3946297888 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc0b8670 con 0x7fb7e80c2ba0 2024-03-23T23:43:11.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.172+0000 7fb7efe00640 1 -- 172.21.15.8:0/3946297888 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e81f1850 con 0x7fb7e80c2ba0 2024-03-23T23:43:11.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.172+0000 7fb7efe00640 1 -- 172.21.15.8:0/3946297888 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e8068270 con 0x7fb7e80c2ba0 2024-03-23T23:43:11.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.176+0000 7fb7e5600640 1 -- 172.21.15.8:0/3946297888 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb7dc0b8810 con 0x7fb7e80c2ba0 2024-03-23T23:43:11.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.176+0000 7fb7e5600640 1 --2- 172.21.15.8:0/3946297888 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb7c8067660 0x7fb7c8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:11.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.176+0000 7fb7e5600640 1 -- 172.21.15.8:0/3946297888 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fb7dc120150 con 0x7fb7e80c2ba0 2024-03-23T23:43:11.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.176+0000 7fb7eca00640 1 --2- 172.21.15.8:0/3946297888 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb7c8067660 0x7fb7c8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:11.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.176+0000 7fb7eca00640 1 --2- 172.21.15.8:0/3946297888 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb7c8067660 0x7fb7c8069b20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4000f70 tx=0x7fb7d4007e90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:11.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.180+0000 7fb7e5600640 1 -- 172.21.15.8:0/3946297888 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fb7dc016070 con 0x7fb7e80c2ba0 2024-03-23T23:43:11.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.520+0000 7fb7efe00640 1 -- 172.21.15.8:0/3946297888 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7e80c32b0 con 0x7fb7e80c2ba0 2024-03-23T23:43:11.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.520+0000 7fb7e5600640 1 -- 172.21.15.8:0/3946297888 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20271 (secure 0 0 0) 0x7fb7dc0f0560 con 0x7fb7e80c2ba0 2024-03-23T23:43:11.623 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:43:11.624 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":25,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","created":"2024-03-23T23:42:15.169430+0000","modified":"2024-03-23T23:42:51.739271+0000","last_up_change":"2024-03-23T23:42:26.509742+0000","last_in_change":"2024-03-23T23:42:17.662330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:42:26.327445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-23T23:42:38.218800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-23T23:42:39.054195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-23T23:42:48.327799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-23T23:42:49.113061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e967bf31-21d6-4d11-bc3d-0df8177a1b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6809","nonce":2187201732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6811","nonce":2187201732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6815","nonce":2187201732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6813","nonce":2187201732}]},"public_addr":"172.21.15.8:6809/2187201732","cluster_addr":"172.21.15.8:6811/2187201732","heartbeat_back_addr":"172.21.15.8:6815/2187201732","heartbeat_front_addr":"172.21.15.8:6813/2187201732","state":["exists","up"]},{"osd":1,"uuid":"c8e33701-7acd-4474-8402-d52461171fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6818","nonce":3205168010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6822","nonce":3205168010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6830","nonce":3205168010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6826","nonce":3205168010}]},"public_addr":"172.21.15.8:6818/3205168010","cluster_addr":"172.21.15.8:6822/3205168010","heartbeat_back_addr":"172.21.15.8:6830/3205168010","heartbeat_front_addr":"172.21.15.8:6826/3205168010","state":["exists","up"]},{"osd":2,"uuid":"ceebdbf7-4c2f-4757-b52d-fd8b20e77570","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6801","nonce":475463656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6803","nonce":475463656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6807","nonce":475463656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6805","nonce":475463656}]},"public_addr":"172.21.15.8:6801/475463656","cluster_addr":"172.21.15.8:6803/475463656","heartbeat_back_addr":"172.21.15.8:6807/475463656","heartbeat_front_addr":"172.21.15.8:6805/475463656","state":["exists","up"]},{"osd":3,"uuid":"89e258da-5767-429e-8441-edf877d2f3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6819","nonce":1514082871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6821","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6823","nonce":1514082871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6829","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6831","nonce":1514082871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6825","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6827","nonce":1514082871}]},"public_addr":"172.21.15.8:6819/1514082871","cluster_addr":"172.21.15.8:6823/1514082871","heartbeat_back_addr":"172.21.15.8:6831/1514082871","heartbeat_front_addr":"172.21.15.8:6827/1514082871","state":["exists","up"]},{"osd":4,"uuid":"2b7451ae-ea16-4f0a-ae50-04fde75e45ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6825","nonce":3516578147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6827","nonce":3516578147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6831","nonce":3516578147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6829","nonce":3516578147}]},"public_addr":"172.21.15.196:6825/3516578147","cluster_addr":"172.21.15.196:6827/3516578147","heartbeat_back_addr":"172.21.15.196:6831/3516578147","heartbeat_front_addr":"172.21.15.196:6829/3516578147","state":["exists","up"]},{"osd":5,"uuid":"e68a8914-e591-466a-bc9e-f2d7c67aac13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6802","nonce":830595758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6806","nonce":830595758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6814","nonce":830595758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6810","nonce":830595758}]},"public_addr":"172.21.15.196:6802/830595758","cluster_addr":"172.21.15.196:6806/830595758","heartbeat_back_addr":"172.21.15.196:6814/830595758","heartbeat_front_addr":"172.21.15.196:6810/830595758","state":["exists","up"]},{"osd":6,"uuid":"e47723c5-50a0-4cd8-92d9-01972072b422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6801","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6803","nonce":472639906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6805","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6807","nonce":472639906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6815","nonce":472639906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6811","nonce":472639906}]},"public_addr":"172.21.15.196:6803/472639906","cluster_addr":"172.21.15.196:6807/472639906","heartbeat_back_addr":"172.21.15.196:6815/472639906","heartbeat_front_addr":"172.21.15.196:6811/472639906","state":["exists","up"]},{"osd":7,"uuid":"e1e9113d-8005-47b3-9a75-9e701199f1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6817","nonce":4151820349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6819","nonce":4151820349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6823","nonce":4151820349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6821","nonce":4151820349}]},"public_addr":"172.21.15.196:6817/4151820349","cluster_addr":"172.21.15.196:6819/4151820349","heartbeat_back_addr":"172.21.15.196:6823/4151820349","heartbeat_front_addr":"172.21.15.196:6821/4151820349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.221790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.265974+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.190319+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.376359+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.329657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.402958+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.300703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.133121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:43:11.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.524+0000 7fb7efe00640 1 -- 172.21.15.8:0/3946297888 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb7c8067660 msgr2=0x7fb7c8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:11.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.524+0000 7fb7efe00640 1 --2- 172.21.15.8:0/3946297888 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb7c8067660 0x7fb7c8069b20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4000f70 tx=0x7fb7d4007e90 comp rx=0 tx=0).stop 2024-03-23T23:43:11.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.524+0000 7fb7efe00640 1 -- 172.21.15.8:0/3946297888 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7e80c2ba0 msgr2=0x7fb7e8152800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:11.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.524+0000 7fb7efe00640 1 --2- 172.21.15.8:0/3946297888 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7e80c2ba0 0x7fb7e8152800 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc0af040 tx=0x7fb7dc01ac00 comp rx=0 tx=0).stop 2024-03-23T23:43:11.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.524+0000 7fb7efe00640 1 -- 172.21.15.8:0/3946297888 shutdown_connections 2024-03-23T23:43:11.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.524+0000 7fb7efe00640 1 --2- 172.21.15.8:0/3946297888 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb7e81f2290 0x7fb7e80ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:11.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.524+0000 7fb7efe00640 1 --2- 172.21.15.8:0/3946297888 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb7c8067660 0x7fb7c8069b20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:11.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.524+0000 7fb7efe00640 1 --2- 172.21.15.8:0/3946297888 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb7e80c8a50 0x7fb7e81f1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:11.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.524+0000 7fb7efe00640 1 --2- 172.21.15.8:0/3946297888 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7e80c2ba0 0x7fb7e8152800 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:11.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.524+0000 7fb7efe00640 1 -- 172.21.15.8:0/3946297888 >> 172.21.15.8:0/3946297888 conn(0x7fb7e80aafe0 msgr2=0x7fb7e8070360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:11.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.524+0000 7fb7efe00640 1 -- 172.21.15.8:0/3946297888 shutdown_connections 2024-03-23T23:43:11.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.524+0000 7fb7efe00640 1 -- 172.21.15.8:0/3946297888 wait complete. 2024-03-23T23:43:11.627 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T23:43:11.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.768+0000 7fdb36200640 1 Processor -- start 2024-03-23T23:43:11.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.768+0000 7fdb36200640 1 -- start start 2024-03-23T23:43:11.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.768+0000 7fdb36200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdb300c8a50 0x7fdb300c2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:11.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.768+0000 7fdb36200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb300c4340 con 0x7fdb300c2ba0 2024-03-23T23:43:11.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.768+0000 7fdb36200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb300c4060 con 0x7fdb3006d6e0 2024-03-23T23:43:11.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.768+0000 7fdb36200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb300c4740 con 0x7fdb300c8a50 2024-03-23T23:43:11.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.768+0000 7fdb2fe00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fdb300c2ba0 0x7fdb30160300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:45528/0 (socket says 172.21.15.8:45528) 2024-03-23T23:43:11.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.768+0000 7fdb2fe00640 1 -- 172.21.15.8:0/716407029 learned_addr learned my addr 172.21.15.8:0/716407029 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:43:11.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.768+0000 7fdb2f400640 1 --2- 172.21.15.8:0/716407029 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdb300c8a50 0x7fdb300c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:11.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.768+0000 7fdb2ea00640 1 -- 172.21.15.8:0/716407029 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129166650 0 0) 0x7fdb300c4340 con 0x7fdb300c2ba0 2024-03-23T23:43:11.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.768+0000 7fdb2ea00640 1 -- 172.21.15.8:0/716407029 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb14003530 con 0x7fdb300c2ba0 2024-03-23T23:43:11.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.768+0000 7fdb2ea00640 1 -- 172.21.15.8:0/716407029 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3417710368 0 0) 0x7fdb300c4060 con 0x7fdb3006d6e0 2024-03-23T23:43:11.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.768+0000 7fdb2ea00640 1 -- 172.21.15.8:0/716407029 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb300c4340 con 0x7fdb3006d6e0 2024-03-23T23:43:11.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.768+0000 7fdb2f400640 1 -- 172.21.15.8:0/716407029 >> v1:172.21.15.196:6789/0 conn(0x7fdb3006d6e0 legacy=0x7fdb30155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:11.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.768+0000 7fdb2f400640 1 -- 172.21.15.8:0/716407029 >> v1:172.21.15.8:6789/0 conn(0x7fdb300c2ba0 legacy=0x7fdb30160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:11.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.768+0000 7fdb2ea00640 1 -- 172.21.15.8:0/716407029 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 691740561 0 0) 0x7fdb14003530 con 0x7fdb300c2ba0 2024-03-23T23:43:11.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.768+0000 7fdb2f400640 1 -- 172.21.15.8:0/716407029 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb300c3570 con 0x7fdb300c8a50 2024-03-23T23:43:11.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.776+0000 7fdb2f400640 1 --2- 172.21.15.8:0/716407029 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdb300c8a50 0x7fdb300c2660 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdb200097f0 tx=0x7fdb2001c340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9378e72c7f40fb2d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:11.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.776+0000 7fdb2ea00640 1 -- 172.21.15.8:0/716407029 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb200b0070 con 0x7fdb300c8a50 2024-03-23T23:43:11.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.776+0000 7fdb2ea00640 1 -- 172.21.15.8:0/716407029 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb200ab400 con 0x7fdb300c8a50 2024-03-23T23:43:11.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.776+0000 7fdb2ea00640 1 -- 172.21.15.8:0/716407029 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb28001a00 con 0x7fdb300c8a50 2024-03-23T23:43:11.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.776+0000 7fdb36200640 1 -- 172.21.15.8:0/716407029 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdb300c8a50 msgr2=0x7fdb300c2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:11.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.776+0000 7fdb36200640 1 --2- 172.21.15.8:0/716407029 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdb300c8a50 0x7fdb300c2660 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdb200097f0 tx=0x7fdb2001c340 comp rx=0 tx=0).stop 2024-03-23T23:43:11.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.776+0000 7fdb36200640 1 -- 172.21.15.8:0/716407029 shutdown_connections 2024-03-23T23:43:11.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.776+0000 7fdb36200640 1 --2- 172.21.15.8:0/716407029 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdb300c8a50 0x7fdb300c2660 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:11.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.776+0000 7fdb36200640 1 -- 172.21.15.8:0/716407029 >> 172.21.15.8:0/716407029 conn(0x7fdb300aafe0 msgr2=0x7fdb300ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:11.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.776+0000 7fdb36200640 1 -- 172.21.15.8:0/716407029 shutdown_connections 2024-03-23T23:43:11.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.776+0000 7fdb36200640 1 -- 172.21.15.8:0/716407029 wait complete. 2024-03-23T23:43:11.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.776+0000 7fdb36200640 1 Processor -- start 2024-03-23T23:43:11.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.780+0000 7fdb36200640 1 -- start start 2024-03-23T23:43:11.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.780+0000 7fdb36200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb300c2ba0 0x7fdb300c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:11.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.780+0000 7fdb36200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb300c8a50 0x7fdb30151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:11.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.780+0000 7fdb36200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdb301516b0 0x7fdb30145540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:11.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.780+0000 7fdb36200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3006e360 con 0x7fdb300c2ba0 2024-03-23T23:43:11.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.780+0000 7fdb36200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3006e1e0 con 0x7fdb300c8a50 2024-03-23T23:43:11.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.780+0000 7fdb36200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb30156170 con 0x7fdb301516b0 2024-03-23T23:43:11.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.780+0000 7fdb2f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb300c2ba0 0x7fdb300c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:11.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.780+0000 7fdb2f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb300c2ba0 0x7fdb300c7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60402/0 (socket says 172.21.15.8:60402) 2024-03-23T23:43:11.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.780+0000 7fdb2f400640 1 -- 172.21.15.8:0/2090831184 learned_addr learned my addr 172.21.15.8:0/2090831184 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:11.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.780+0000 7fdb27e00640 1 --2- 172.21.15.8:0/2090831184 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb300c8a50 0x7fdb30151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:11.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.780+0000 7fdb2fe00640 1 --2- 172.21.15.8:0/2090831184 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdb301516b0 0x7fdb30145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:11.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.780+0000 7fdb2f400640 1 -- 172.21.15.8:0/2090831184 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdb301516b0 msgr2=0x7fdb30145540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:11.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.780+0000 7fdb2f400640 1 --2- 172.21.15.8:0/2090831184 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdb301516b0 0x7fdb30145540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:11.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.780+0000 7fdb2f400640 1 -- 172.21.15.8:0/2090831184 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb300c8a50 msgr2=0x7fdb30151170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:11.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.780+0000 7fdb2f400640 1 --2- 172.21.15.8:0/2090831184 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb300c8a50 0x7fdb30151170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:11.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.780+0000 7fdb2f400640 1 -- 172.21.15.8:0/2090831184 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb301f1c40 con 0x7fdb300c2ba0 2024-03-23T23:43:11.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.780+0000 7fdb2f400640 1 --2- 172.21.15.8:0/2090831184 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb300c2ba0 0x7fdb300c7590 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdb200ae040 tx=0x7fdb2001ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:11.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.780+0000 7fdb27400640 1 -- 172.21.15.8:0/2090831184 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb200bb020 con 0x7fdb300c2ba0 2024-03-23T23:43:11.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.780+0000 7fdb27400640 1 -- 172.21.15.8:0/2090831184 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb200b1040 con 0x7fdb300c2ba0 2024-03-23T23:43:11.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.780+0000 7fdb27400640 1 -- 172.21.15.8:0/2090831184 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb200b0050 con 0x7fdb300c2ba0 2024-03-23T23:43:11.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.780+0000 7fdb36200640 1 -- 172.21.15.8:0/2090831184 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb301f1f20 con 0x7fdb300c2ba0 2024-03-23T23:43:11.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.780+0000 7fdb36200640 1 -- 172.21.15.8:0/2090831184 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb301f24e0 con 0x7fdb300c2ba0 2024-03-23T23:43:11.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.784+0000 7fdb36200640 1 -- 172.21.15.8:0/2090831184 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb30068270 con 0x7fdb300c2ba0 2024-03-23T23:43:11.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.784+0000 7fdb27400640 1 -- 172.21.15.8:0/2090831184 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fdb200be070 con 0x7fdb300c2ba0 2024-03-23T23:43:11.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.784+0000 7fdb27400640 1 --2- 172.21.15.8:0/2090831184 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdb0c067660 0x7fdb0c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:11.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.784+0000 7fdb27400640 1 -- 172.21.15.8:0/2090831184 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fdb2011efc0 con 0x7fdb300c2ba0 2024-03-23T23:43:11.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.784+0000 7fdb27e00640 1 --2- 172.21.15.8:0/2090831184 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdb0c067660 0x7fdb0c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:11.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.784+0000 7fdb27e00640 1 --2- 172.21.15.8:0/2090831184 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdb0c067660 0x7fdb0c069b20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdb30155cc0 tx=0x7fdb18009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:11.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.788+0000 7fdb27400640 1 -- 172.21.15.8:0/2090831184 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fdb20015ff0 con 0x7fdb300c2ba0 2024-03-23T23:43:11.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.988+0000 7fdb36200640 1 -- 172.21.15.8:0/2090831184 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb3014ffa0 con 0x7fdb300c2ba0 2024-03-23T23:43:11.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.992+0000 7fdb27400640 1 -- 172.21.15.8:0/2090831184 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6245 (secure 0 0 0) 0x7fdb200ef350 con 0x7fdb300c2ba0 2024-03-23T23:43:11.993 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:43:11.993 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6836/3149325777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3149325777},{"type":"v1","addr":"172.21.15.196:6836","nonce":3149325777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6833/1542162403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1542162403},{"type":"v1","addr":"172.21.15.8:6833","nonce":1542162403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T23:42:40.070799+0000","modified":"2024-03-23T23:42:44.080269+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6837/3402347550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":3402347550},{"type":"v1","addr":"172.21.15.196:6837","nonce":3402347550}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T23:42:50.113972+0000","modified":"2024-03-23T23:42:54.152778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.8:6835/3531853933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3531853933},{"type":"v1","addr":"172.21.15.8:6835","nonce":3531853933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4269,"qdb_cluster":[4269]},"id":2}]} 2024-03-23T23:43:11.993 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 15 2024-03-23T23:43:11.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.992+0000 7fdb36200640 1 -- 172.21.15.8:0/2090831184 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdb0c067660 msgr2=0x7fdb0c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:11.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.992+0000 7fdb36200640 1 --2- 172.21.15.8:0/2090831184 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdb0c067660 0x7fdb0c069b20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdb30155cc0 tx=0x7fdb18009040 comp rx=0 tx=0).stop 2024-03-23T23:43:11.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.992+0000 7fdb36200640 1 -- 172.21.15.8:0/2090831184 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb300c2ba0 msgr2=0x7fdb300c7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:11.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.992+0000 7fdb36200640 1 --2- 172.21.15.8:0/2090831184 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb300c2ba0 0x7fdb300c7590 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdb200ae040 tx=0x7fdb2001ab80 comp rx=0 tx=0).stop 2024-03-23T23:43:11.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.992+0000 7fdb36200640 1 -- 172.21.15.8:0/2090831184 shutdown_connections 2024-03-23T23:43:11.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.992+0000 7fdb36200640 1 --2- 172.21.15.8:0/2090831184 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdb0c067660 0x7fdb0c069b20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:11.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.992+0000 7fdb36200640 1 --2- 172.21.15.8:0/2090831184 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdb301516b0 0x7fdb30145540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:11.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.992+0000 7fdb36200640 1 --2- 172.21.15.8:0/2090831184 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb300c8a50 0x7fdb30151170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:11.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.992+0000 7fdb36200640 1 --2- 172.21.15.8:0/2090831184 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb300c2ba0 0x7fdb300c7590 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:11.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.992+0000 7fdb36200640 1 -- 172.21.15.8:0/2090831184 >> 172.21.15.8:0/2090831184 conn(0x7fdb300aafe0 msgr2=0x7fdb3014f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:11.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.992+0000 7fdb36200640 1 -- 172.21.15.8:0/2090831184 shutdown_connections 2024-03-23T23:43:11.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:11.992+0000 7fdb36200640 1 -- 172.21.15.8:0/2090831184 wait complete. 2024-03-23T23:43:12.416 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-23T23:42:50.113972+0000', 'modified': '2024-03-23T23:42:54.152778+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4269}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4269': {'gid': 4269, 'name': 'a', 'rank': 0, 'incarnation': 10, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.8:6835/3531853933', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6834', 'nonce': 3531853933}, {'type': 'v1', 'addr': '172.21.15.8:6835', 'nonce': 3531853933}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'b', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4269, 'qdb_cluster': [4269]} 2024-03-23T23:43:12.416 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-23T23:43:12.416 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-03-23T23:43:12.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.556+0000 7f7e8b200640 1 Processor -- start 2024-03-23T23:43:12.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.556+0000 7f7e8b200640 1 -- start start 2024-03-23T23:43:12.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.556+0000 7f7e8b200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7e840c4e40 0x7f7e84161310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:12.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.556+0000 7f7e8b200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e840c4340 con 0x7f7e8406d6e0 2024-03-23T23:43:12.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.556+0000 7f7e8b200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e840c4060 con 0x7f7e840c8a50 2024-03-23T23:43:12.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.556+0000 7f7e8b200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e840c4740 con 0x7f7e840c4e40 2024-03-23T23:43:12.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.560+0000 7f7e7b400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f7e8406d6e0 0x7f7e84155a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:45534/0 (socket says 172.21.15.8:45534) 2024-03-23T23:43:12.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.560+0000 7f7e7b400640 1 -- 172.21.15.8:0/268677346 learned_addr learned my addr 172.21.15.8:0/268677346 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:43:12.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.560+0000 7f7e89200640 1 --2- 172.21.15.8:0/268677346 >> v2:172.21.15.196:3300/0 conn(0x7f7e840c4e40 0x7f7e84161310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:12.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.560+0000 7f7e83400640 1 -- 172.21.15.8:0/268677346 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2850839695 0 0) 0x7f7e840c4340 con 0x7f7e8406d6e0 2024-03-23T23:43:12.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.560+0000 7f7e83400640 1 -- 172.21.15.8:0/268677346 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e68003530 con 0x7f7e8406d6e0 2024-03-23T23:43:12.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.560+0000 7f7e89200640 1 -- 172.21.15.8:0/268677346 >> v1:172.21.15.196:6789/0 conn(0x7f7e840c8a50 legacy=0x7f7e840c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:12.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.560+0000 7f7e83400640 1 -- 172.21.15.8:0/268677346 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3789510156 0 0) 0x7f7e840c4060 con 0x7f7e840c8a50 2024-03-23T23:43:12.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.560+0000 7f7e89200640 1 -- 172.21.15.8:0/268677346 >> v1:172.21.15.8:6789/0 conn(0x7f7e8406d6e0 legacy=0x7f7e84155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:12.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.560+0000 7f7e89200640 1 -- 172.21.15.8:0/268677346 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e840c3570 con 0x7f7e840c4e40 2024-03-23T23:43:12.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.560+0000 7f7e89200640 1 --2- 172.21.15.8:0/268677346 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e840c4e40 0x7f7e84161310 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c0097c0 tx=0x7f7e7c01c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67a01c56e2ca68b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:12.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.560+0000 7f7e83400640 1 -- 172.21.15.8:0/268677346 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c0b0070 con 0x7f7e840c4e40 2024-03-23T23:43:12.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.560+0000 7f7e83400640 1 -- 172.21.15.8:0/268677346 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7c004230 con 0x7f7e840c4e40 2024-03-23T23:43:12.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.560+0000 7f7e83400640 1 -- 172.21.15.8:0/268677346 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c003620 con 0x7f7e840c4e40 2024-03-23T23:43:12.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.564+0000 7f7e8b200640 1 -- 172.21.15.8:0/268677346 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e840c4e40 msgr2=0x7f7e84161310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:12.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.564+0000 7f7e8b200640 1 --2- 172.21.15.8:0/268677346 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e840c4e40 0x7f7e84161310 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c0097c0 tx=0x7f7e7c01c350 comp rx=0 tx=0).stop 2024-03-23T23:43:12.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.564+0000 7f7e8b200640 1 -- 172.21.15.8:0/268677346 shutdown_connections 2024-03-23T23:43:12.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.564+0000 7f7e8b200640 1 --2- 172.21.15.8:0/268677346 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e840c4e40 0x7f7e84161310 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.564+0000 7f7e8b200640 1 -- 172.21.15.8:0/268677346 >> 172.21.15.8:0/268677346 conn(0x7f7e840aafe0 msgr2=0x7f7e840ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:12.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.564+0000 7f7e8b200640 1 -- 172.21.15.8:0/268677346 shutdown_connections 2024-03-23T23:43:12.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.564+0000 7f7e8b200640 1 -- 172.21.15.8:0/268677346 wait complete. 2024-03-23T23:43:12.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.564+0000 7f7e8b200640 1 Processor -- start 2024-03-23T23:43:12.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.564+0000 7f7e8b200640 1 -- start start 2024-03-23T23:43:12.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.564+0000 7f7e8b200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e840c4e40 0x7f7e8406f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:12.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.564+0000 7f7e8b200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e840c8a50 0x7f7e841eea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:12.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.564+0000 7f7e8b200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7e840ac070 0x7f7e84157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:12.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.564+0000 7f7e8b200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e840c8e30 con 0x7f7e840c4e40 2024-03-23T23:43:12.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.564+0000 7f7e8b200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8406e1e0 con 0x7f7e840c8a50 2024-03-23T23:43:12.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.564+0000 7f7e8b200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e841ee5f0 con 0x7f7e840ac070 2024-03-23T23:43:12.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.564+0000 7f7e83e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e840c4e40 0x7f7e8406f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:12.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.564+0000 7f7e83e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e840c4e40 0x7f7e8406f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60418/0 (socket says 172.21.15.8:60418) 2024-03-23T23:43:12.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.564+0000 7f7e83e00640 1 -- 172.21.15.8:0/1697346436 learned_addr learned my addr 172.21.15.8:0/1697346436 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:12.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.564+0000 7f7e7b400640 1 --2- 172.21.15.8:0/1697346436 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e840c8a50 0x7f7e841eea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:12.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.564+0000 7f7e89200640 1 --2- 172.21.15.8:0/1697346436 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7e840ac070 0x7f7e84157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:12.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.564+0000 7f7e83e00640 1 -- 172.21.15.8:0/1697346436 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7e840ac070 msgr2=0x7f7e84157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:12.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.564+0000 7f7e83e00640 1 --2- 172.21.15.8:0/1697346436 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7e840ac070 0x7f7e84157e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.564+0000 7f7e83e00640 1 -- 172.21.15.8:0/1697346436 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e840c8a50 msgr2=0x7f7e841eea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:12.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.564+0000 7f7e83e00640 1 --2- 172.21.15.8:0/1697346436 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e840c8a50 0x7f7e841eea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.564+0000 7f7e83e00640 1 -- 172.21.15.8:0/1697346436 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8414a780 con 0x7f7e840c4e40 2024-03-23T23:43:12.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.568+0000 7f7e83e00640 1 --2- 172.21.15.8:0/1697346436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e840c4e40 0x7f7e8406f500 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400c700 tx=0x7f7e7400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:12.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.568+0000 7f7e80c00640 1 -- 172.21.15.8:0/1697346436 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e74017070 con 0x7f7e840c4e40 2024-03-23T23:43:12.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.568+0000 7f7e80c00640 1 -- 172.21.15.8:0/1697346436 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e74003db0 con 0x7f7e840c4e40 2024-03-23T23:43:12.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.568+0000 7f7e80c00640 1 -- 172.21.15.8:0/1697346436 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e740052b0 con 0x7f7e840c4e40 2024-03-23T23:43:12.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.568+0000 7f7e8b200640 1 -- 172.21.15.8:0/1697346436 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e841f2370 con 0x7f7e840c4e40 2024-03-23T23:43:12.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.568+0000 7f7e8b200640 1 -- 172.21.15.8:0/1697346436 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e84158f60 con 0x7f7e840c4e40 2024-03-23T23:43:12.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.568+0000 7f7e80c00640 1 -- 172.21.15.8:0/1697346436 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f7e7401a070 con 0x7f7e840c4e40 2024-03-23T23:43:12.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.568+0000 7f7e8e707000 1 Processor -- start 2024-03-23T23:43:12.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.568+0000 7f7e8e707000 1 -- start start 2024-03-23T23:43:12.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e80c00640 1 --2- 172.21.15.8:0/1697346436 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7e60067660 0x7f7e60069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:12.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e8e707000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55839ba35fb0 0x55839ba36390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:12.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e80c00640 1 -- 172.21.15.8:0/1697346436 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f7e740850c0 con 0x7f7e840c4e40 2024-03-23T23:43:12.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e8e707000 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55839ba368d0 0x55839ba36cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:12.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e8e707000 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55839ba371f0 0x55839ba808d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:12.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e8e707000 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55839b886680 con 0x55839ba371f0 2024-03-23T23:43:12.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e8e707000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x55839b80db00 con 0x55839ba35fb0 2024-03-23T23:43:12.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e8e707000 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x55839b882720 con 0x55839ba368d0 2024-03-23T23:43:12.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e89200640 1 --2- 172.21.15.8:0/1697346436 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7e60067660 0x7f7e60069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:12.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e83e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55839ba35fb0 0x55839ba36390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:12.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e83e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55839ba35fb0 0x55839ba36390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:41792/0 (socket says 172.21.15.8:41792) 2024-03-23T23:43:12.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e83e00640 1 -- 172.21.15.8:0/1529795501 learned_addr learned my addr 172.21.15.8:0/1529795501 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:12.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e89200640 1 --2- 172.21.15.8:0/1529795501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55839ba371f0 0x55839ba808d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:12.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e7b400640 1 --2- 172.21.15.8:0/1529795501 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55839ba368d0 0x55839ba36cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:12.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e83e00640 1 -- 172.21.15.8:0/1529795501 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55839ba368d0 msgr2=0x55839ba36cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:12.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e83e00640 1 --2- 172.21.15.8:0/1529795501 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55839ba368d0 0x55839ba36cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e83e00640 1 -- 172.21.15.8:0/1529795501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55839ba371f0 msgr2=0x55839ba808d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:12.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e83e00640 1 --2- 172.21.15.8:0/1529795501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55839ba371f0 0x55839ba808d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e83e00640 1 -- 172.21.15.8:0/1529795501 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55839b85e940 con 0x55839ba35fb0 2024-03-23T23:43:12.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e83e00640 1 --2- 172.21.15.8:0/1529795501 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55839ba35fb0 0x55839ba36390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7e740832f0 tx=0x7f7e74085050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec3a46bb9b0e2925 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:12.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e89200640 1 --2- 172.21.15.8:0/1697346436 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7e60067660 0x7f7e60069b20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c0ad000 tx=0x7f7e7c0046d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:12.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e78c00640 1 -- 172.21.15.8:0/1529795501 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7406d070 con 0x55839ba35fb0 2024-03-23T23:43:12.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e78c00640 1 -- 172.21.15.8:0/1529795501 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7400ce10 con 0x55839ba35fb0 2024-03-23T23:43:12.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e78c00640 1 -- 172.21.15.8:0/1529795501 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e74053750 con 0x55839ba35fb0 2024-03-23T23:43:12.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e8e707000 1 -- 172.21.15.8:0/1529795501 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55839ba35fb0 msgr2=0x55839ba36390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:12.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e8e707000 1 --2- 172.21.15.8:0/1529795501 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55839ba35fb0 0x55839ba36390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7e740832f0 tx=0x7f7e74085050 comp rx=0 tx=0).stop 2024-03-23T23:43:12.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e8e707000 1 -- 172.21.15.8:0/1529795501 shutdown_connections 2024-03-23T23:43:12.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e8e707000 1 --2- 172.21.15.8:0/1529795501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55839ba371f0 0x55839ba808d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e8e707000 1 --2- 172.21.15.8:0/1529795501 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55839ba368d0 0x55839ba36cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e8e707000 1 --2- 172.21.15.8:0/1529795501 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55839ba35fb0 0x55839ba36390 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e8e707000 1 -- 172.21.15.8:0/1529795501 >> 172.21.15.8:0/1529795501 conn(0x55839ba74630 msgr2=0x55839ba76a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:12.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e8e707000 1 -- 172.21.15.8:0/1529795501 shutdown_connections 2024-03-23T23:43:12.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e8e707000 1 -- 172.21.15.8:0/1529795501 wait complete. 2024-03-23T23:43:12.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e8e707000 1 -- start start 2024-03-23T23:43:12.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.572+0000 7f7e8e707000 1 Processor -- start 2024-03-23T23:43:12.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e8e707000 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55839ba35fb0 0x55839ba3bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:12.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e8e707000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55839ba368d0 0x55839ba3c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:12.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e8e707000 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55839ba371f0 0x55839ba3c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:12.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e8e707000 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55839b852ff0 con 0x55839ba371f0 2024-03-23T23:43:12.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e8e707000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x55839b840ae0 con 0x55839ba368d0 2024-03-23T23:43:12.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e8e707000 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x55839b82ea80 con 0x55839ba35fb0 2024-03-23T23:43:12.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e8e707000 10 client.0 _ll_register_callbacks cb 0x55839ba23ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-23T23:43:12.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e89200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55839ba371f0 0x55839ba3c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:12.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e89200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55839ba371f0 0x55839ba3c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60442/0 (socket says 172.21.15.8:60442) 2024-03-23T23:43:12.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e89200640 1 -- 172.21.15.8:0/1936773024 learned_addr learned my addr 172.21.15.8:0/1936773024 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:12.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e7b400640 1 --2- 172.21.15.8:0/1936773024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55839ba368d0 0x55839ba3c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:12.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e83e00640 1 --2- 172.21.15.8:0/1936773024 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55839ba35fb0 0x55839ba3bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:12.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e89200640 1 -- 172.21.15.8:0/1936773024 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55839ba35fb0 msgr2=0x55839ba3bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:12.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e89200640 1 --2- 172.21.15.8:0/1936773024 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55839ba35fb0 0x55839ba3bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e89200640 1 -- 172.21.15.8:0/1936773024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55839ba368d0 msgr2=0x55839ba3c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:12.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e89200640 1 --2- 172.21.15.8:0/1936773024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55839ba368d0 0x55839ba3c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e89200640 1 -- 172.21.15.8:0/1936773024 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55839b8cbd80 con 0x55839ba371f0 2024-03-23T23:43:12.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e89200640 1 --2- 172.21.15.8:0/1936773024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55839ba371f0 0x55839ba3c850 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c019f80 tx=0x7f7e7c01ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f0b97c2882741c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:12.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e71600640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-23T23:43:12.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e71600640 1 -- 172.21.15.8:0/1936773024 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c0b0040 con 0x55839ba371f0 2024-03-23T23:43:12.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e8e707000 1 -- 172.21.15.8:0/1936773024 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7e7400ce10 con 0x55839ba371f0 2024-03-23T23:43:12.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e71600640 1 -- 172.21.15.8:0/1936773024 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f7e7c0c0040 con 0x55839ba371f0 2024-03-23T23:43:12.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e71600640 1 -- 172.21.15.8:0/1936773024 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e7c0d1050 con 0x55839ba371f0 2024-03-23T23:43:12.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e8e707000 10 client.4878 fetch_fsmap learned FSMap version 15 2024-03-23T23:43:12.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e8e707000 1 -- 172.21.15.8:0/1936773024 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55839b80dd10 con 0x55839ba371f0 2024-03-23T23:43:12.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e71600640 1 -- 172.21.15.8:0/1936773024 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7400ce10 con 0x55839ba371f0 2024-03-23T23:43:12.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e71600640 1 -- 172.21.15.8:0/1936773024 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 15) v1 ==== 3918+0+0 (secure 0 0 0) 0x7f7e7c0d4020 con 0x55839ba371f0 2024-03-23T23:43:12.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e8e707000 10 client.4878 fetch_fsmap finished waiting for FSMap version 15 2024-03-23T23:43:12.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e8e707000 10 client.4878 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-23T23:43:12.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e8e707000 20 client.4878 populate_metadata read hostname 'smithi008' 2024-03-23T23:43:12.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e8e707000 1 --2- 172.21.15.8:0/1936773024 >> [v2:172.21.15.8:6834/3531853933,v1:172.21.15.8:6835/3531853933] conn(0x55839ba89c40 0x55839ba8c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:12.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e8e707000 4 client.4878 mds_command: new command op to 4269 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-23T23:43:12.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e8e707000 1 -- 172.21.15.8:0/1936773024 --> [v2:172.21.15.8:6834/3531853933,v1:172.21.15.8:6835/3531853933] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55839b821b60 con 0x55839ba89c40 2024-03-23T23:43:12.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e83e00640 1 --2- 172.21.15.8:0/1936773024 >> [v2:172.21.15.8:6834/3531853933,v1:172.21.15.8:6835/3531853933] conn(0x55839ba89c40 0x55839ba8c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:12.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e71600640 10 client.4878 ms_handle_connect on v2:172.21.15.8:6834/3531853933 2024-03-23T23:43:12.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.576+0000 7f7e83e00640 1 --2- 172.21.15.8:0/1936773024 >> [v2:172.21.15.8:6834/3531853933,v1:172.21.15.8:6835/3531853933] conn(0x55839ba89c40 0x55839ba8c030 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e60706bb167d6124 server_cookie=f093b00a1dc9c9cc in_seq=0 out_seq=0 2024-03-23T23:43:12.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.580+0000 7f7e71600640 1 -- 172.21.15.8:0/1936773024 <== mds.0 v2:172.21.15.8:6834/3531853933 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55839b821b60 con 0x55839ba89c40 2024-03-23T23:43:12.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.580+0000 7f7e71600640 10 client.4878 handle_command_reply: tid=0 2024-03-23T23:43:12.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.580+0000 7f7e8e707000 1 client.4878 shutdown 2024-03-23T23:43:12.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.580+0000 7f7e8e707000 1 -- 172.21.15.8:0/1936773024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55839ba371f0 msgr2=0x55839ba3c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:12.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.580+0000 7f7e8e707000 1 --2- 172.21.15.8:0/1936773024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55839ba371f0 0x55839ba3c850 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c019f80 tx=0x7f7e7c01ab90 comp rx=0 tx=0).stop 2024-03-23T23:43:12.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.580+0000 7f7e8e707000 1 -- 172.21.15.8:0/1936773024 shutdown_connections 2024-03-23T23:43:12.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.580+0000 7f7e8e707000 1 --2- 172.21.15.8:0/1936773024 >> [v2:172.21.15.8:6834/3531853933,v1:172.21.15.8:6835/3531853933] conn(0x55839ba89c40 0x55839ba8c030 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.580+0000 7f7e8e707000 1 --2- 172.21.15.8:0/1936773024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55839ba371f0 0x55839ba3c850 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.580+0000 7f7e8e707000 1 --2- 172.21.15.8:0/1936773024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55839ba368d0 0x55839ba3c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.580+0000 7f7e8e707000 1 --2- 172.21.15.8:0/1936773024 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55839ba35fb0 0x55839ba3bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.580+0000 7f7e8e707000 1 -- 172.21.15.8:0/1936773024 >> 172.21.15.8:0/1936773024 conn(0x55839ba74630 msgr2=0x55839ba356b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:12.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.580+0000 7f7e71600640 0 client.4878 ms_handle_reset on v2:172.21.15.8:6834/3531853933 2024-03-23T23:43:12.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.580+0000 7f7e8e707000 1 -- 172.21.15.8:0/1936773024 shutdown_connections 2024-03-23T23:43:12.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.580+0000 7f7e8e707000 1 -- 172.21.15.8:0/1936773024 wait complete. 2024-03-23T23:43:12.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.580+0000 7f7e8e707000 20 client.4878 trim_cache size 0 max 16384 2024-03-23T23:43:12.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.596+0000 7f7e8e707000 1 Processor -- start 2024-03-23T23:43:12.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.596+0000 7f7e8e707000 1 -- start start 2024-03-23T23:43:12.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.596+0000 7f7e8e707000 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55839ba35fb0 0x55839ba8ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:12.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.596+0000 7f7e8e707000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55839ba368d0 0x55839ba8a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:12.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.596+0000 7f7e8e707000 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55839ba371f0 0x55839ba8a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:12.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.596+0000 7f7e8e707000 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e841fda80 con 0x55839ba35fb0 2024-03-23T23:43:12.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.596+0000 7f7e8e707000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e84146d70 con 0x55839ba368d0 2024-03-23T23:43:12.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.596+0000 7f7e8e707000 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e841fbcd0 con 0x55839ba371f0 2024-03-23T23:43:12.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.596+0000 7f7e83e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55839ba35fb0 0x55839ba8ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:12.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.596+0000 7f7e83e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55839ba35fb0 0x55839ba8ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60446/0 (socket says 172.21.15.8:60446) 2024-03-23T23:43:12.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.596+0000 7f7e83e00640 1 -- 172.21.15.8:0/3187056840 learned_addr learned my addr 172.21.15.8:0/3187056840 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:12.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.596+0000 7f7e7b400640 1 --2- 172.21.15.8:0/3187056840 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55839ba368d0 0x55839ba8a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:12.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.596+0000 7f7e89200640 1 --2- 172.21.15.8:0/3187056840 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55839ba371f0 0x55839ba8a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:12.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.596+0000 7f7e83e00640 1 -- 172.21.15.8:0/3187056840 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55839ba371f0 msgr2=0x55839ba8a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:12.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.596+0000 7f7e83e00640 1 --2- 172.21.15.8:0/3187056840 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55839ba371f0 0x55839ba8a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.596+0000 7f7e83e00640 1 -- 172.21.15.8:0/3187056840 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55839ba368d0 msgr2=0x55839ba8a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:12.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.596+0000 7f7e83e00640 1 --2- 172.21.15.8:0/3187056840 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55839ba368d0 0x55839ba8a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.596+0000 7f7e83e00640 1 -- 172.21.15.8:0/3187056840 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55839b853540 con 0x55839ba35fb0 2024-03-23T23:43:12.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.596+0000 7f7e7b400640 1 --2- 172.21.15.8:0/3187056840 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55839ba368d0 0x55839ba8a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:43:12.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.596+0000 7f7e89200640 1 --2- 172.21.15.8:0/3187056840 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55839ba371f0 0x55839ba8a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:43:12.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.596+0000 7f7e83e00640 1 --2- 172.21.15.8:0/3187056840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55839ba35fb0 0x55839ba8ee90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7e7407e010 tx=0x7f7e74013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb904a8a2ddd8b2f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:12.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.596+0000 7f7e73e00640 1 -- 172.21.15.8:0/3187056840 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7406d040 con 0x55839ba35fb0 2024-03-23T23:43:12.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.596+0000 7f7e73e00640 1 -- 172.21.15.8:0/3187056840 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7406d1e0 con 0x55839ba35fb0 2024-03-23T23:43:12.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.596+0000 7f7e73e00640 1 -- 172.21.15.8:0/3187056840 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e74051ac0 con 0x55839ba35fb0 2024-03-23T23:43:12.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e8e707000 1 -- 172.21.15.8:0/3187056840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55839ba35fb0 msgr2=0x55839ba8ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:12.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e8e707000 1 --2- 172.21.15.8:0/3187056840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55839ba35fb0 0x55839ba8ee90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7e7407e010 tx=0x7f7e74013000 comp rx=0 tx=0).stop 2024-03-23T23:43:12.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e8e707000 1 -- 172.21.15.8:0/3187056840 shutdown_connections 2024-03-23T23:43:12.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e8e707000 1 --2- 172.21.15.8:0/3187056840 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55839ba371f0 0x55839ba8a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e8e707000 1 --2- 172.21.15.8:0/3187056840 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55839ba368d0 0x55839ba8a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e8e707000 1 --2- 172.21.15.8:0/3187056840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55839ba35fb0 0x55839ba8ee90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e8e707000 1 -- 172.21.15.8:0/3187056840 >> 172.21.15.8:0/3187056840 conn(0x55839ba74630 msgr2=0x55839ba34fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:12.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e8e707000 1 -- 172.21.15.8:0/3187056840 shutdown_connections 2024-03-23T23:43:12.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e8e707000 1 -- 172.21.15.8:0/3187056840 wait complete. 2024-03-23T23:43:12.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e8e707000 1 -- start start 2024-03-23T23:43:12.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e8e707000 1 Processor -- start 2024-03-23T23:43:12.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e8e707000 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55839ba35fb0 0x55839ba8d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:12.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e8e707000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55839ba368d0 0x55839ba8d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:12.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e8e707000 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55839ba371f0 0x55839ba8ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:12.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e8e707000 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55839b885990 con 0x55839ba371f0 2024-03-23T23:43:12.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e8e707000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x55839b943700 con 0x55839ba368d0 2024-03-23T23:43:12.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e8e707000 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x55839b81e750 con 0x55839ba35fb0 2024-03-23T23:43:12.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e8e707000 10 client.0 _ll_register_callbacks cb 0x7f7e7c009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-23T23:43:12.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e89200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55839ba371f0 0x55839ba8ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:12.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e83e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55839ba35fb0 0x55839ba8d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:12.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e89200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55839ba371f0 0x55839ba8ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60450/0 (socket says 172.21.15.8:60450) 2024-03-23T23:43:12.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e89200640 1 -- 172.21.15.8:0/3981254116 learned_addr learned my addr 172.21.15.8:0/3981254116 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:12.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e7b400640 1 --2- 172.21.15.8:0/3981254116 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55839ba368d0 0x55839ba8d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:12.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e89200640 1 -- 172.21.15.8:0/3981254116 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55839ba35fb0 msgr2=0x55839ba8d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:12.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e89200640 1 --2- 172.21.15.8:0/3981254116 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55839ba35fb0 0x55839ba8d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e89200640 1 -- 172.21.15.8:0/3981254116 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55839ba368d0 msgr2=0x55839ba8d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:12.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e89200640 1 --2- 172.21.15.8:0/3981254116 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55839ba368d0 0x55839ba8d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e89200640 1 -- 172.21.15.8:0/3981254116 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55839b81a4b0 con 0x55839ba371f0 2024-03-23T23:43:12.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e89200640 1 --2- 172.21.15.8:0/3981254116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55839ba371f0 0x55839ba8ddd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c0097c0 tx=0x7f7e7c0190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a92bb2c2c31dee70 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:12.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e71600640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-23T23:43:12.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e71600640 1 -- 172.21.15.8:0/3981254116 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c0da060 con 0x55839ba371f0 2024-03-23T23:43:12.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e71600640 1 -- 172.21.15.8:0/3981254116 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f7e7c0ca040 con 0x55839ba371f0 2024-03-23T23:43:12.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e8e707000 1 -- 172.21.15.8:0/3981254116 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7e7406d1e0 con 0x55839ba371f0 2024-03-23T23:43:12.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e71600640 1 -- 172.21.15.8:0/3981254116 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e7c0b0070 con 0x55839ba371f0 2024-03-23T23:43:12.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e8e707000 10 client.4884 fetch_fsmap learned FSMap version 15 2024-03-23T23:43:12.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e8e707000 1 -- 172.21.15.8:0/3981254116 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55839b82d2f0 con 0x55839ba371f0 2024-03-23T23:43:12.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e71600640 1 -- 172.21.15.8:0/3981254116 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7406d1e0 con 0x55839ba371f0 2024-03-23T23:43:12.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e71600640 1 -- 172.21.15.8:0/3981254116 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 15) v1 ==== 3918+0+0 (secure 0 0 0) 0x7f7e7c0d4040 con 0x55839ba371f0 2024-03-23T23:43:12.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e8e707000 10 client.4884 fetch_fsmap finished waiting for FSMap version 15 2024-03-23T23:43:12.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e8e707000 10 client.4884 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-23T23:43:12.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.600+0000 7f7e8e707000 20 client.4884 populate_metadata read hostname 'smithi008' 2024-03-23T23:43:12.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e8e707000 1 --2- 172.21.15.8:0/3981254116 >> [v2:172.21.15.8:6834/3531853933,v1:172.21.15.8:6835/3531853933] conn(0x55839ba8e760 0x55839bae7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:12.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e8e707000 4 client.4884 mds_command: new command op to 4269 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-23T23:43:12.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e8e707000 1 -- 172.21.15.8:0/3981254116 --> [v2:172.21.15.8:6834/3531853933,v1:172.21.15.8:6835/3531853933] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55839b893bc0 con 0x55839ba8e760 2024-03-23T23:43:12.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e83e00640 1 --2- 172.21.15.8:0/3981254116 >> [v2:172.21.15.8:6834/3531853933,v1:172.21.15.8:6835/3531853933] conn(0x55839ba8e760 0x55839bae7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:12.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e83e00640 1 --2- 172.21.15.8:0/3981254116 >> [v2:172.21.15.8:6834/3531853933,v1:172.21.15.8:6835/3531853933] conn(0x55839ba8e760 0x55839bae7ba0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8247cb3665fb70e server_cookie=4efde356c0ba5220 in_seq=0 out_seq=0 2024-03-23T23:43:12.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e71600640 10 client.4884 ms_handle_connect on v2:172.21.15.8:6834/3531853933 2024-03-23T23:43:12.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e71600640 1 -- 172.21.15.8:0/3981254116 <== mds.0 v2:172.21.15.8:6834/3531853933 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+320 (crc 0 0 0) 0x55839b893bc0 con 0x55839ba8e760 2024-03-23T23:43:12.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e71600640 10 client.4884 handle_command_reply: tid=0 2024-03-23T23:43:12.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e8e707000 1 client.4884 shutdown 2024-03-23T23:43:12.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e8e707000 1 -- 172.21.15.8:0/3981254116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55839ba371f0 msgr2=0x55839ba8ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:12.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e8e707000 1 --2- 172.21.15.8:0/3981254116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55839ba371f0 0x55839ba8ddd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c0097c0 tx=0x7f7e7c0190f0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e8e707000 1 -- 172.21.15.8:0/3981254116 shutdown_connections 2024-03-23T23:43:12.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e8e707000 1 --2- 172.21.15.8:0/3981254116 >> [v2:172.21.15.8:6834/3531853933,v1:172.21.15.8:6835/3531853933] conn(0x55839ba8e760 0x55839bae7ba0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e8e707000 1 --2- 172.21.15.8:0/3981254116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55839ba371f0 0x55839ba8ddd0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e8e707000 1 --2- 172.21.15.8:0/3981254116 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55839ba368d0 0x55839ba8d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e71600640 0 client.4884 ms_handle_reset on v2:172.21.15.8:6834/3531853933 2024-03-23T23:43:12.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e8e707000 1 --2- 172.21.15.8:0/3981254116 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55839ba35fb0 0x55839ba8d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e8e707000 1 -- 172.21.15.8:0/3981254116 >> 172.21.15.8:0/3981254116 conn(0x55839ba74630 msgr2=0x55839bad74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:12.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e8e707000 1 -- 172.21.15.8:0/3981254116 shutdown_connections 2024-03-23T23:43:12.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e8e707000 1 -- 172.21.15.8:0/3981254116 wait complete. 2024-03-23T23:43:12.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e8e707000 20 client.4884 trim_cache size 0 max 16384 2024-03-23T23:43:12.613 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:43:12.613 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:43:12.613 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2024-03-23T23:43:12.613 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 4269, 2024-03-23T23:43:12.613 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2024-03-23T23:43:12.613 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2024-03-23T23:43:12.613 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "b", 2024-03-23T23:43:12.613 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 21.861389825, 2024-03-23T23:43:12.613 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 15, 2024-03-23T23:43:12.613 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 25, 2024-03-23T23:43:12.614 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 25, 2024-03-23T23:43:12.614 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 39.159193641000002 2024-03-23T23:43:12.614 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:43:12.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e8b200640 1 -- 172.21.15.8:0/1697346436 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7e60067660 msgr2=0x7f7e60069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:12.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e8b200640 1 --2- 172.21.15.8:0/1697346436 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7e60067660 0x7f7e60069b20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c0ad000 tx=0x7f7e7c0046d0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e8b200640 1 -- 172.21.15.8:0/1697346436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e840c4e40 msgr2=0x7f7e8406f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:12.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e8b200640 1 --2- 172.21.15.8:0/1697346436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e840c4e40 0x7f7e8406f500 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400c700 tx=0x7f7e7400cbc0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e8b200640 1 -- 172.21.15.8:0/1697346436 shutdown_connections 2024-03-23T23:43:12.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e8b200640 1 --2- 172.21.15.8:0/1697346436 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7e60067660 0x7f7e60069b20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e8b200640 1 --2- 172.21.15.8:0/1697346436 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7e840ac070 0x7f7e84157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e8b200640 1 --2- 172.21.15.8:0/1697346436 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e840c8a50 0x7f7e841eea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e8b200640 1 --2- 172.21.15.8:0/1697346436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e840c4e40 0x7f7e8406f500 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e8b200640 1 -- 172.21.15.8:0/1697346436 >> 172.21.15.8:0/1697346436 conn(0x7f7e840aafe0 msgr2=0x7f7e840c2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:12.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e8b200640 1 -- 172.21.15.8:0/1697346436 shutdown_connections 2024-03-23T23:43:12.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.604+0000 7f7e8b200640 1 -- 172.21.15.8:0/1697346436 wait complete. 2024-03-23T23:43:12.635 INFO:teuthology.run_tasks:Running task kclient... 2024-03-23T23:43:12.666 INFO:tasks.kclient:Mounting kernel clients... 2024-03-23T23:43:12.666 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-03-23T23:43:12.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:12.666 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2024-03-23T23:43:12.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:12.677 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link delete ceph-brx 2024-03-23T23:43:12.743 INFO:teuthology.orchestra.run.smithi008.stderr:Cannot find device "ceph-brx" 2024-03-23T23:43:12.744 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-23T23:43:12.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:12.745 DEBUG:teuthology.orchestra.run.smithi196:> ip netns list 2024-03-23T23:43:12.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:12.754 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link delete ceph-brx 2024-03-23T23:43:12.819 INFO:teuthology.orchestra.run.smithi196.stderr:Cannot find device "ceph-brx" 2024-03-23T23:43:12.820 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-23T23:43:12.821 INFO:tasks.kclient:client.0 config is {'syntax': 'v1', 'cephfs_name': 'a'} 2024-03-23T23:43:12.821 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-23T23:43:12.821 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-23T23:43:12.821 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-23T23:43:12.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.960+0000 7fab04600640 1 Processor -- start 2024-03-23T23:43:12.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.960+0000 7fab04600640 1 -- start start 2024-03-23T23:43:12.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.960+0000 7fab04600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faafc150da0 0x7faafc06b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:12.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.960+0000 7fab04600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7faafc06ee90 0x7faafc072130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:12.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.960+0000 7fab04600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7faafc06b6b0 0x7faafc072670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:12.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.960+0000 7fab04600640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faafc0a9750 con 0x7faafc06ee90 2024-03-23T23:43:12.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.960+0000 7fab04600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faafc1541b0 con 0x7faafc06b6b0 2024-03-23T23:43:12.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.960+0000 7fab04600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faafc0a9470 con 0x7faafc150da0 2024-03-23T23:43:12.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.960+0000 7fab01200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7faafc06ee90 0x7faafc072130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:12.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.960+0000 7fab01c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faafc150da0 0x7faafc06b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:12.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.960+0000 7fab01200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7faafc06ee90 0x7faafc072130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54646/0 (socket says 172.21.15.8:54646) 2024-03-23T23:43:12.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.960+0000 7fab01200640 1 -- 172.21.15.8:0/1930440835 learned_addr learned my addr 172.21.15.8:0/1930440835 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:12.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.960+0000 7fab02600640 1 --2- 172.21.15.8:0/1930440835 >> v2:172.21.15.196:3300/0 conn(0x7faafc06b6b0 0x7faafc072670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:12.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.960+0000 7fab01200640 1 -- 172.21.15.8:0/1930440835 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faafc150da0 msgr2=0x7faafc06b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:12.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.960+0000 7fab01200640 1 --2- 172.21.15.8:0/1930440835 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faafc150da0 0x7faafc06b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.960+0000 7fab01200640 1 -- 172.21.15.8:0/1930440835 >> v2:172.21.15.196:3300/0 conn(0x7faafc06b6b0 msgr2=0x7faafc072670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:12.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.960+0000 7fab01200640 1 --2- 172.21.15.8:0/1930440835 >> v2:172.21.15.196:3300/0 conn(0x7faafc06b6b0 0x7faafc072670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.960+0000 7fab01200640 1 -- 172.21.15.8:0/1930440835 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faafc06bc20 con 0x7faafc06ee90 2024-03-23T23:43:12.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.964+0000 7fab01200640 1 --2- 172.21.15.8:0/1930440835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faafc06ee90 0x7faafc072130 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faafc06dcb0 tx=0x7faae801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30d4aa39f0959827 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:12.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.964+0000 7faafbe00640 1 -- 172.21.15.8:0/1930440835 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae80b0070 con 0x7faafc06ee90 2024-03-23T23:43:12.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.964+0000 7faafbe00640 1 -- 172.21.15.8:0/1930440835 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae80ab600 con 0x7faafc06ee90 2024-03-23T23:43:12.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.964+0000 7faafbe00640 1 -- 172.21.15.8:0/1930440835 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae80ab9d0 con 0x7faafc06ee90 2024-03-23T23:43:12.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.964+0000 7fab04600640 1 -- 172.21.15.8:0/1930440835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faafc06ee90 msgr2=0x7faafc072130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:12.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.964+0000 7fab04600640 1 --2- 172.21.15.8:0/1930440835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faafc06ee90 0x7faafc072130 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faafc06dcb0 tx=0x7faae801c490 comp rx=0 tx=0).stop 2024-03-23T23:43:12.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.964+0000 7fab04600640 1 -- 172.21.15.8:0/1930440835 shutdown_connections 2024-03-23T23:43:12.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.964+0000 7fab04600640 1 --2- 172.21.15.8:0/1930440835 >> v2:172.21.15.196:3300/0 conn(0x7faafc06b6b0 0x7faafc072670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.964+0000 7fab04600640 1 --2- 172.21.15.8:0/1930440835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faafc06ee90 0x7faafc072130 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.964+0000 7fab04600640 1 --2- 172.21.15.8:0/1930440835 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faafc150da0 0x7faafc06b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.964+0000 7fab04600640 1 -- 172.21.15.8:0/1930440835 >> 172.21.15.8:0/1930440835 conn(0x7faafc06c280 msgr2=0x7faafc06c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:12.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.964+0000 7fab04600640 1 -- 172.21.15.8:0/1930440835 shutdown_connections 2024-03-23T23:43:12.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.964+0000 7fab04600640 1 -- 172.21.15.8:0/1930440835 wait complete. 2024-03-23T23:43:12.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.968+0000 7fab04600640 1 Processor -- start 2024-03-23T23:43:12.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.968+0000 7fab04600640 1 -- start start 2024-03-23T23:43:12.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.968+0000 7fab04600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faafc06b6b0 0x7faafc15c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:12.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.968+0000 7fab04600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faafc06ee90 0x7faafc15ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:12.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.968+0000 7fab04600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faafc150da0 0x7faafc0c2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:12.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.968+0000 7fab04600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faafc0700d0 con 0x7faafc06ee90 2024-03-23T23:43:12.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.968+0000 7fab04600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faafc06ff50 con 0x7faafc150da0 2024-03-23T23:43:12.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.968+0000 7fab04600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faafc157490 con 0x7faafc06b6b0 2024-03-23T23:43:12.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.972+0000 7fab01200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faafc06ee90 0x7faafc15ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:12.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.972+0000 7fab02600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faafc150da0 0x7faafc0c2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:12.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.972+0000 7fab01200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faafc06ee90 0x7faafc15ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54656/0 (socket says 172.21.15.8:54656) 2024-03-23T23:43:12.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.972+0000 7fab01200640 1 -- 172.21.15.8:0/3810804540 learned_addr learned my addr 172.21.15.8:0/3810804540 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:12.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.972+0000 7fab01c00640 1 --2- 172.21.15.8:0/3810804540 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faafc06b6b0 0x7faafc15c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:12.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.972+0000 7fab01200640 1 -- 172.21.15.8:0/3810804540 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faafc06b6b0 msgr2=0x7faafc15c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:12.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.972+0000 7fab01200640 1 --2- 172.21.15.8:0/3810804540 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faafc06b6b0 0x7faafc15c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.972+0000 7fab01200640 1 -- 172.21.15.8:0/3810804540 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faafc150da0 msgr2=0x7faafc0c2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:12.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.972+0000 7fab01200640 1 --2- 172.21.15.8:0/3810804540 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faafc150da0 0x7faafc0c2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:12.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.972+0000 7fab01200640 1 -- 172.21.15.8:0/3810804540 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faafc158180 con 0x7faafc06ee90 2024-03-23T23:43:12.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.972+0000 7fab02600640 1 --2- 172.21.15.8:0/3810804540 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faafc150da0 0x7faafc0c2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:43:12.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.972+0000 7fab01200640 1 --2- 172.21.15.8:0/3810804540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faafc06ee90 0x7faafc15ca20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7faae80ae040 tx=0x7faae801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:12.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.972+0000 7faaf9600640 1 -- 172.21.15.8:0/3810804540 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae80ba020 con 0x7faafc06ee90 2024-03-23T23:43:12.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.972+0000 7faaf9600640 1 -- 172.21.15.8:0/3810804540 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae80b6420 con 0x7faafc06ee90 2024-03-23T23:43:12.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.972+0000 7faaf9600640 1 -- 172.21.15.8:0/3810804540 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae80b0040 con 0x7faafc06ee90 2024-03-23T23:43:12.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.972+0000 7fab04600640 1 -- 172.21.15.8:0/3810804540 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faafc1ece20 con 0x7faafc06ee90 2024-03-23T23:43:12.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.972+0000 7fab04600640 1 -- 172.21.15.8:0/3810804540 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faafc0c4600 con 0x7faafc06ee90 2024-03-23T23:43:12.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.972+0000 7fab04600640 1 -- 172.21.15.8:0/3810804540 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faafc068270 con 0x7faafc06ee90 2024-03-23T23:43:12.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.972+0000 7faaf9600640 1 -- 172.21.15.8:0/3810804540 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7faae80bd020 con 0x7faafc06ee90 2024-03-23T23:43:12.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.976+0000 7faaf9600640 1 --2- 172.21.15.8:0/3810804540 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7faadc067690 0x7faadc069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:12.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.976+0000 7faaf9600640 1 -- 172.21.15.8:0/3810804540 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7faae811fac0 con 0x7faafc06ee90 2024-03-23T23:43:12.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.976+0000 7fab01c00640 1 --2- 172.21.15.8:0/3810804540 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7faadc067690 0x7faadc069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:12.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.976+0000 7fab01c00640 1 --2- 172.21.15.8:0/3810804540 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7faadc067690 0x7faadc069b50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7faafc156230 tx=0x7faaf0009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:12.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:12.980+0000 7faaf9600640 1 -- 172.21.15.8:0/3810804540 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7faae80c4030 con 0x7faafc06ee90 2024-03-23T23:43:13.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:13.176+0000 7fab04600640 1 -- 172.21.15.8:0/3810804540 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7faafc06f330 con 0x7faafc06ee90 2024-03-23T23:43:13.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:13.176+0000 7faaf9600640 1 -- 172.21.15.8:0/3810804540 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+116 (secure 0 0 0) 0x7faae8016110 con 0x7faafc06ee90 2024-03-23T23:43:13.179 INFO:teuthology.orchestra.run.smithi008.stdout:name: a, metadata pool: a_metadata, data pools: [a_data ] 2024-03-23T23:43:13.180 INFO:teuthology.orchestra.run.smithi008.stdout:name: b, metadata pool: b_metadata, data pools: [b_data ] 2024-03-23T23:43:13.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:13.180+0000 7fab04600640 1 -- 172.21.15.8:0/3810804540 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7faadc067690 msgr2=0x7faadc069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:13.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:13.180+0000 7fab04600640 1 --2- 172.21.15.8:0/3810804540 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7faadc067690 0x7faadc069b50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7faafc156230 tx=0x7faaf0009190 comp rx=0 tx=0).stop 2024-03-23T23:43:13.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:13.180+0000 7fab04600640 1 -- 172.21.15.8:0/3810804540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faafc06ee90 msgr2=0x7faafc15ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:13.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:13.180+0000 7fab04600640 1 --2- 172.21.15.8:0/3810804540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faafc06ee90 0x7faafc15ca20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7faae80ae040 tx=0x7faae801acd0 comp rx=0 tx=0).stop 2024-03-23T23:43:13.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:13.180+0000 7fab04600640 1 -- 172.21.15.8:0/3810804540 shutdown_connections 2024-03-23T23:43:13.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:13.180+0000 7fab04600640 1 --2- 172.21.15.8:0/3810804540 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faafc150da0 0x7faafc0c2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:13.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:13.180+0000 7fab04600640 1 --2- 172.21.15.8:0/3810804540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faafc06ee90 0x7faafc15ca20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:13.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:13.180+0000 7fab04600640 1 --2- 172.21.15.8:0/3810804540 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7faadc067690 0x7faadc069b50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:13.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:13.180+0000 7fab04600640 1 --2- 172.21.15.8:0/3810804540 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faafc06b6b0 0x7faafc15c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:13.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:13.180+0000 7fab04600640 1 -- 172.21.15.8:0/3810804540 >> 172.21.15.8:0/3810804540 conn(0x7faafc06c280 msgr2=0x7faafc156540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:13.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:13.180+0000 7fab04600640 1 -- 172.21.15.8:0/3810804540 shutdown_connections 2024-03-23T23:43:13.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:13.180+0000 7fab04600640 1 -- 172.21.15.8:0/3810804540 wait complete. 2024-03-23T23:43:13.201 INFO:tasks.cephfs.mount:Mounting Ceph FS a; just confirmed its presence on cluster 2024-03-23T23:43:13.201 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-23T23:43:13.201 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi008.front.sepia.ceph.com 2024-03-23T23:43:13.201 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-23T23:43:13.201 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-23T23:43:13.201 INFO:tasks.cephfs.mount:self.cephfs_name = a 2024-03-23T23:43:13.201 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-23T23:43:13.202 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-23T23:43:13.202 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-23T23:43:13.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:13.202 DEBUG:teuthology.orchestra.run.smithi008:> ip addr 2024-03-23T23:43:13.211 INFO:teuthology.orchestra.run.smithi008.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-23T23:43:13.211 INFO:teuthology.orchestra.run.smithi008.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-23T23:43:13.211 INFO:teuthology.orchestra.run.smithi008.stdout: inet 127.0.0.1/8 scope host lo 2024-03-23T23:43:13.211 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-03-23T23:43:13.211 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 ::1/128 scope host 2024-03-23T23:43:13.211 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-03-23T23:43:13.211 INFO:teuthology.orchestra.run.smithi008.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-23T23:43:13.211 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2e brd ff:ff:ff:ff:ff:ff 2024-03-23T23:43:13.211 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f0 2024-03-23T23:43:13.211 INFO:teuthology.orchestra.run.smithi008.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-23T23:43:13.211 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2f brd ff:ff:ff:ff:ff:ff 2024-03-23T23:43:13.211 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f1 2024-03-23T23:43:13.212 INFO:teuthology.orchestra.run.smithi008.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-23T23:43:13.212 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:fe brd ff:ff:ff:ff:ff:ff 2024-03-23T23:43:13.212 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f0 2024-03-23T23:43:13.212 INFO:teuthology.orchestra.run.smithi008.stdout: inet 172.21.15.8/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-03-23T23:43:13.212 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft 42466sec preferred_lft 42466sec 2024-03-23T23:43:13.212 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::ae1f:6bff:fef8:25fe/64 scope link 2024-03-23T23:43:13.212 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-03-23T23:43:13.212 INFO:teuthology.orchestra.run.smithi008.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-23T23:43:13.212 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:ff brd ff:ff:ff:ff:ff:ff 2024-03-23T23:43:13.212 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f1 2024-03-23T23:43:13.213 INFO:teuthology.orchestra.run.smithi008.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-03-23T23:43:13.213 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 02:42:74:07:1d:de brd ff:ff:ff:ff:ff:ff 2024-03-23T23:43:13.213 INFO:teuthology.orchestra.run.smithi008.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-03-23T23:43:13.213 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-03-23T23:43:13.214 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-23T23:43:13.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:13.214 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2024-03-23T23:43:13.214 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2024-03-23T23:43:13.214 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link add name ceph-brx type bridge 2024-03-23T23:43:13.214 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip addr flush dev ceph-brx 2024-03-23T23:43:13.214 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set ceph-brx up 2024-03-23T23:43:13.214 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-23T23:43:13.215 DEBUG:teuthology.orchestra.run.smithi008:> ') 2024-03-23T23:43:13.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:13.324 DEBUG:teuthology.orchestra.run.smithi008:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-23T23:43:13.343 INFO:teuthology.orchestra.run.smithi008.stdout:1 2024-03-23T23:43:13.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:13.345 DEBUG:teuthology.orchestra.run.smithi008:> route 2024-03-23T23:43:13.417 INFO:teuthology.orchestra.run.smithi008.stdout:Kernel IP routing table 2024-03-23T23:43:13.417 INFO:teuthology.orchestra.run.smithi008.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-23T23:43:13.418 INFO:teuthology.orchestra.run.smithi008.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-03-23T23:43:13.418 INFO:teuthology.orchestra.run.smithi008.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-03-23T23:43:13.418 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-03-23T23:43:13.418 INFO:teuthology.orchestra.run.smithi008.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-23T23:43:13.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:13.418 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2024-03-23T23:43:13.418 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2024-03-23T23:43:13.419 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-23T23:43:13.419 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-23T23:43:13.419 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-23T23:43:13.419 DEBUG:teuthology.orchestra.run.smithi008:> ') 2024-03-23T23:43:13.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:13.510 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2024-03-23T23:43:13.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:13.519 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list-id 2024-03-23T23:43:13.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:13.569 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2024-03-23T23:43:13.569 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2024-03-23T23:43:13.569 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-23T23:43:13.569 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-23T23:43:13.569 DEBUG:teuthology.orchestra.run.smithi008:> ') 2024-03-23T23:43:13.651 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-23T23:43:13.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:13.651 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2024-03-23T23:43:13.651 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2024-03-23T23:43:13.651 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-23T23:43:13.652 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-23T23:43:13.652 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-23T23:43:13.652 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-23T23:43:13.652 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-23T23:43:13.652 DEBUG:teuthology.orchestra.run.smithi008:> ') 2024-03-23T23:43:13.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:13.827 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2024-03-23T23:43:13.827 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2024-03-23T23:43:13.827 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set brx.0 up 2024-03-23T23:43:13.827 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set dev brx.0 master ceph-brx 2024-03-23T23:43:13.827 DEBUG:teuthology.orchestra.run.smithi008:> ') 2024-03-23T23:43:13.867 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-23T23:43:13.867 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-23T23:43:13.916 INFO:teuthology.orchestra.run.smithi008.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-23T23:43:13.917 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-23T23:43:13.917 DEBUG:teuthology.orchestra.run.smithi008:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-23T23:43:13.967 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-23T23:43:13.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:13.968 DEBUG:teuthology.orchestra.run.smithi008:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=a 2024-03-23T23:43:14.070 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=a 2024-03-23T23:43:14.070 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=a". 2024-03-23T23:43:14.070 INFO:teuthology.orchestra.run.smithi008.stdout:invalid new device string format 2024-03-23T23:43:14.596 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=a 2024-03-23T23:43:14.597 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=a". 2024-03-23T23:43:14.597 INFO:teuthology.orchestra.run.smithi008.stdout:invalid new device string format 2024-03-23T23:43:14.597 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.196:3300,172.21.15.196:3301" 2024-03-23T23:43:14.597 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-23T23:43:14.609 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=a 2024-03-23T23:43:14.609 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=a". 2024-03-23T23:43:14.609 INFO:teuthology.orchestra.run.smithi008.stdout:invalid new device string format 2024-03-23T23:43:14.609 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.196:3300,172.21.15.196:3301" 2024-03-23T23:43:14.609 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-23T23:43:14.610 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: resolved to: "172.21.15.8:6789,172.21.15.196:6789,172.21.15.196:6790" 2024-03-23T23:43:14.610 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.8:6789,172.21.15.196:6789,172.21.15.196:6790:/ 2024-03-23T23:43:14.610 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=a,key=0,fsid=c1a2a381-bc04-418a-8aea-f38031d04f8d" will pass to kernel 2024-03-23T23:43:14.613 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-23T23:43:14.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:14.613 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-23T23:43:14.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:14.634 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-23T23:43:14.709 INFO:teuthology.orchestra.run.smithi008.stdout:client4879 2024-03-23T23:43:14.709 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-23T23:43:14.709 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-23T23:43:14.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:14.761 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-23T23:43:14.822 INFO:teuthology.orchestra.run.smithi008.stdout:client4879 2024-03-23T23:43:14.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:14.823 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-23T23:43:14.884 INFO:teuthology.orchestra.run.smithi008.stdout:client4879 2024-03-23T23:43:14.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:14.885 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c1a2a381-bc04-418a-8aea-f38031d04f8d.client4879/status') 2024-03-23T23:43:14.952 INFO:teuthology.orchestra.run.smithi008.stdout:instance: client.4879 (3)172.21.15.8:0/1546253278 2024-03-23T23:43:14.952 INFO:teuthology.orchestra.run.smithi008.stdout:blocklisted: false 2024-03-23T23:43:14.952 INFO:teuthology.orchestra.run.smithi008.stderr:0+1 records in 2024-03-23T23:43:14.952 INFO:teuthology.orchestra.run.smithi008.stderr:0+1 records out 2024-03-23T23:43:14.952 INFO:teuthology.orchestra.run.smithi008.stderr:69 bytes copied, 7.405e-05 s, 932 kB/s 2024-03-23T23:43:14.954 INFO:tasks.kclient:client.1 config is {'syntax': 'v1', 'cephfs_name': 'b'} 2024-03-23T23:43:14.954 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-23T23:43:14.954 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-23T23:43:14.954 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-23T23:43:15.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.132+0000 7f1522000640 1 Processor -- start 2024-03-23T23:43:15.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.132+0000 7f1522000640 1 -- start start 2024-03-23T23:43:15.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.136+0000 7f1522000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f151c14d8b0 0x7f151c0c7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:15.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.136+0000 7f1522000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f151c0c5560 0x7f151c06ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:15.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.136+0000 7f1522000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f151c0c7670 con 0x7f151c070b50 2024-03-23T23:43:15.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.136+0000 7f1522000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f151c0c4830 con 0x7f151c14d8b0 2024-03-23T23:43:15.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.136+0000 7f1522000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f151c0c50d0 con 0x7f151c0c5560 2024-03-23T23:43:15.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.136+0000 7f151b400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f151c14d8b0 0x7f151c0c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:15.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.136+0000 7f151b400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f151c14d8b0 0x7f151c0c7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54668/0 (socket says 172.21.15.8:54668) 2024-03-23T23:43:15.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.136+0000 7f1512a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f151c070b50 0x7f151c1541b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48066/0 (socket says 172.21.15.8:48066) 2024-03-23T23:43:15.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.136+0000 7f151b400640 1 -- 172.21.15.8:0/3355472796 learned_addr learned my addr 172.21.15.8:0/3355472796 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:15.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.136+0000 7f151be00640 1 --2- 172.21.15.8:0/3355472796 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f151c0c5560 0x7f151c06ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:15.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.136+0000 7f151b400640 1 -- 172.21.15.8:0/3355472796 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f151c0c5560 msgr2=0x7f151c06ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:15.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.136+0000 7f151b400640 1 --2- 172.21.15.8:0/3355472796 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f151c0c5560 0x7f151c06ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:15.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.136+0000 7f151b400640 1 -- 172.21.15.8:0/3355472796 >> v1:172.21.15.8:6789/0 conn(0x7f151c070b50 legacy=0x7f151c1541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:15.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.136+0000 7f151b400640 1 -- 172.21.15.8:0/3355472796 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151c0710e0 con 0x7f151c14d8b0 2024-03-23T23:43:15.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.136+0000 7f151aa00640 1 -- 172.21.15.8:0/3355472796 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3033963383 0 0) 0x7f151c0c7670 con 0x7f151c070b50 2024-03-23T23:43:15.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.136+0000 7f151b400640 1 --2- 172.21.15.8:0/3355472796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f151c14d8b0 0x7f151c0c7130 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f150c009870 tx=0x7f150c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a35a766c842a3f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:15.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.140+0000 7f151aa00640 1 -- 172.21.15.8:0/3355472796 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c0b2070 con 0x7f151c14d8b0 2024-03-23T23:43:15.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.140+0000 7f151aa00640 1 -- 172.21.15.8:0/3355472796 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150c0a9070 con 0x7f151c14d8b0 2024-03-23T23:43:15.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.140+0000 7f151aa00640 1 -- 172.21.15.8:0/3355472796 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c0ad880 con 0x7f151c14d8b0 2024-03-23T23:43:15.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.140+0000 7f1522000640 1 -- 172.21.15.8:0/3355472796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f151c14d8b0 msgr2=0x7f151c0c7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:15.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.140+0000 7f1522000640 1 --2- 172.21.15.8:0/3355472796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f151c14d8b0 0x7f151c0c7130 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f150c009870 tx=0x7f150c01c560 comp rx=0 tx=0).stop 2024-03-23T23:43:15.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.140+0000 7f1522000640 1 -- 172.21.15.8:0/3355472796 shutdown_connections 2024-03-23T23:43:15.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.140+0000 7f1522000640 1 --2- 172.21.15.8:0/3355472796 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f151c0c5560 0x7f151c06ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:15.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.140+0000 7f1522000640 1 --2- 172.21.15.8:0/3355472796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f151c14d8b0 0x7f151c0c7130 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:15.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.140+0000 7f1522000640 1 -- 172.21.15.8:0/3355472796 >> 172.21.15.8:0/3355472796 conn(0x7f151c0aafe0 msgr2=0x7f151c0ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:15.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.140+0000 7f1522000640 1 -- 172.21.15.8:0/3355472796 shutdown_connections 2024-03-23T23:43:15.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.140+0000 7f1522000640 1 -- 172.21.15.8:0/3355472796 wait complete. 2024-03-23T23:43:15.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.140+0000 7f1522000640 1 Processor -- start 2024-03-23T23:43:15.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.140+0000 7f1522000640 1 -- start start 2024-03-23T23:43:15.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.140+0000 7f1522000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f151c070b50 0x7f151c1ee150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:15.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.140+0000 7f1522000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f151c0c5560 0x7f151c147d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:15.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.140+0000 7f1522000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f151c14d8b0 0x7f151c141140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:15.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.140+0000 7f1522000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151c160a50 con 0x7f151c070b50 2024-03-23T23:43:15.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.140+0000 7f1522000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151c1608d0 con 0x7f151c14d8b0 2024-03-23T23:43:15.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.140+0000 7f1522000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f151c160bd0 con 0x7f151c0c5560 2024-03-23T23:43:15.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.140+0000 7f151b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f151c070b50 0x7f151c1ee150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:15.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.140+0000 7f151b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f151c070b50 0x7f151c1ee150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54676/0 (socket says 172.21.15.8:54676) 2024-03-23T23:43:15.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.140+0000 7f151b400640 1 -- 172.21.15.8:0/3922573150 learned_addr learned my addr 172.21.15.8:0/3922573150 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:15.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.140+0000 7f1512a00640 1 --2- 172.21.15.8:0/3922573150 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f151c0c5560 0x7f151c147d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:15.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.140+0000 7f151be00640 1 --2- 172.21.15.8:0/3922573150 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f151c14d8b0 0x7f151c141140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:15.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.140+0000 7f151b400640 1 -- 172.21.15.8:0/3922573150 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f151c0c5560 msgr2=0x7f151c147d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:15.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.140+0000 7f151b400640 1 --2- 172.21.15.8:0/3922573150 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f151c0c5560 0x7f151c147d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:15.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.140+0000 7f151b400640 1 -- 172.21.15.8:0/3922573150 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f151c14d8b0 msgr2=0x7f151c141140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:15.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.140+0000 7f151b400640 1 --2- 172.21.15.8:0/3922573150 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f151c14d8b0 0x7f151c141140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:15.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.140+0000 7f151b400640 1 -- 172.21.15.8:0/3922573150 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151c1ee730 con 0x7f151c070b50 2024-03-23T23:43:15.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.140+0000 7f1512a00640 1 --2- 172.21.15.8:0/3922573150 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f151c0c5560 0x7f151c147d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:43:15.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.140+0000 7f151be00640 1 --2- 172.21.15.8:0/3922573150 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f151c14d8b0 0x7f151c141140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:43:15.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.144+0000 7f151b400640 1 --2- 172.21.15.8:0/3922573150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f151c070b50 0x7f151c1ee150 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f150c01ac10 tx=0x7f150c01ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:15.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.144+0000 7f1513e00640 1 -- 172.21.15.8:0/3922573150 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c0bc020 con 0x7f151c070b50 2024-03-23T23:43:15.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.144+0000 7f1513e00640 1 -- 172.21.15.8:0/3922573150 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150c0add80 con 0x7f151c070b50 2024-03-23T23:43:15.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.144+0000 7f1522000640 1 -- 172.21.15.8:0/3922573150 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f151c1eea10 con 0x7f151c070b50 2024-03-23T23:43:15.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.144+0000 7f1513e00640 1 -- 172.21.15.8:0/3922573150 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c0b2040 con 0x7f151c070b50 2024-03-23T23:43:15.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.144+0000 7f1522000640 1 -- 172.21.15.8:0/3922573150 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f151c1eefd0 con 0x7f151c070b50 2024-03-23T23:43:15.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.144+0000 7f1522000640 1 -- 172.21.15.8:0/3922573150 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f151c068270 con 0x7f151c070b50 2024-03-23T23:43:15.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.144+0000 7f1513e00640 1 -- 172.21.15.8:0/3922573150 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f150c0bf020 con 0x7f151c070b50 2024-03-23T23:43:15.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.148+0000 7f1513e00640 1 --2- 172.21.15.8:0/3922573150 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f14f8067690 0x7f14f8069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:15.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.148+0000 7f1513e00640 1 -- 172.21.15.8:0/3922573150 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f150c11fda0 con 0x7f151c070b50 2024-03-23T23:43:15.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.148+0000 7f1512a00640 1 --2- 172.21.15.8:0/3922573150 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f14f8067690 0x7f14f8069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:15.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.148+0000 7f1512a00640 1 --2- 172.21.15.8:0/3922573150 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f14f8067690 0x7f14f8069b50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f151c14b7c0 tx=0x7f1504007cd0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:15.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.148+0000 7f1513e00640 1 -- 172.21.15.8:0/3922573150 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f150c0c6030 con 0x7f151c070b50 2024-03-23T23:43:15.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.468+0000 7f1522000640 1 -- 172.21.15.8:0/3922573150 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f151c0c3c30 con 0x7f151c070b50 2024-03-23T23:43:15.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.468+0000 7f1513e00640 1 -- 172.21.15.8:0/3922573150 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+116 (secure 0 0 0) 0x7f150c016150 con 0x7f151c070b50 2024-03-23T23:43:15.472 INFO:teuthology.orchestra.run.smithi008.stdout:name: a, metadata pool: a_metadata, data pools: [a_data ] 2024-03-23T23:43:15.472 INFO:teuthology.orchestra.run.smithi008.stdout:name: b, metadata pool: b_metadata, data pools: [b_data ] 2024-03-23T23:43:15.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.472+0000 7f1522000640 1 -- 172.21.15.8:0/3922573150 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f14f8067690 msgr2=0x7f14f8069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:15.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.472+0000 7f1522000640 1 --2- 172.21.15.8:0/3922573150 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f14f8067690 0x7f14f8069b50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f151c14b7c0 tx=0x7f1504007cd0 comp rx=0 tx=0).stop 2024-03-23T23:43:15.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.472+0000 7f1522000640 1 -- 172.21.15.8:0/3922573150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f151c070b50 msgr2=0x7f151c1ee150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:15.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.472+0000 7f1522000640 1 --2- 172.21.15.8:0/3922573150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f151c070b50 0x7f151c1ee150 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f150c01ac10 tx=0x7f150c01ada0 comp rx=0 tx=0).stop 2024-03-23T23:43:15.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.472+0000 7f1522000640 1 -- 172.21.15.8:0/3922573150 shutdown_connections 2024-03-23T23:43:15.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.472+0000 7f1522000640 1 --2- 172.21.15.8:0/3922573150 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f151c14d8b0 0x7f151c141140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:15.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.472+0000 7f1522000640 1 --2- 172.21.15.8:0/3922573150 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f14f8067690 0x7f14f8069b50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:15.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.472+0000 7f1522000640 1 --2- 172.21.15.8:0/3922573150 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f151c0c5560 0x7f151c147d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:15.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.472+0000 7f1522000640 1 --2- 172.21.15.8:0/3922573150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f151c070b50 0x7f151c1ee150 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:15.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.472+0000 7f1522000640 1 -- 172.21.15.8:0/3922573150 >> 172.21.15.8:0/3922573150 conn(0x7f151c0aafe0 msgr2=0x7f151c14ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:15.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.472+0000 7f1522000640 1 -- 172.21.15.8:0/3922573150 shutdown_connections 2024-03-23T23:43:15.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:15.472+0000 7f1522000640 1 -- 172.21.15.8:0/3922573150 wait complete. 2024-03-23T23:43:15.493 INFO:tasks.cephfs.mount:Mounting Ceph FS b; just confirmed its presence on cluster 2024-03-23T23:43:15.493 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-23T23:43:15.493 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi196.front.sepia.ceph.com 2024-03-23T23:43:15.494 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-23T23:43:15.494 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-23T23:43:15.494 INFO:tasks.cephfs.mount:self.cephfs_name = b 2024-03-23T23:43:15.494 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-23T23:43:15.494 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-23T23:43:15.494 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-23T23:43:15.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:15.494 DEBUG:teuthology.orchestra.run.smithi196:> ip addr 2024-03-23T23:43:15.503 INFO:teuthology.orchestra.run.smithi196.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-23T23:43:15.503 INFO:teuthology.orchestra.run.smithi196.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-23T23:43:15.503 INFO:teuthology.orchestra.run.smithi196.stdout: inet 127.0.0.1/8 scope host lo 2024-03-23T23:43:15.503 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-03-23T23:43:15.503 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 ::1/128 scope host 2024-03-23T23:43:15.503 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-03-23T23:43:15.503 INFO:teuthology.orchestra.run.smithi196.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-23T23:43:15.503 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:d9:38:be brd ff:ff:ff:ff:ff:ff 2024-03-23T23:43:15.503 INFO:teuthology.orchestra.run.smithi196.stdout: altname enp7s0f0 2024-03-23T23:43:15.503 INFO:teuthology.orchestra.run.smithi196.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-23T23:43:15.503 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:d9:38:bf brd ff:ff:ff:ff:ff:ff 2024-03-23T23:43:15.504 INFO:teuthology.orchestra.run.smithi196.stdout: altname enp7s0f1 2024-03-23T23:43:15.504 INFO:teuthology.orchestra.run.smithi196.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-23T23:43:15.504 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:88:7f:46 brd ff:ff:ff:ff:ff:ff 2024-03-23T23:43:15.504 INFO:teuthology.orchestra.run.smithi196.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-23T23:43:15.504 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:88:7f:47 brd ff:ff:ff:ff:ff:ff 2024-03-23T23:43:15.504 INFO:teuthology.orchestra.run.smithi196.stdout: inet 172.21.15.196/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-03-23T23:43:15.504 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft 42469sec preferred_lft 42469sec 2024-03-23T23:43:15.504 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 fe80::ec4:7aff:fe88:7f47/64 scope link 2024-03-23T23:43:15.504 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-03-23T23:43:15.504 INFO:teuthology.orchestra.run.smithi196.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-03-23T23:43:15.504 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 02:42:ba:4e:cd:e2 brd ff:ff:ff:ff:ff:ff 2024-03-23T23:43:15.504 INFO:teuthology.orchestra.run.smithi196.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-03-23T23:43:15.504 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-03-23T23:43:15.505 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-23T23:43:15.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:15.506 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec bash -c ' 2024-03-23T23:43:15.506 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2024-03-23T23:43:15.506 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link add name ceph-brx type bridge 2024-03-23T23:43:15.506 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip addr flush dev ceph-brx 2024-03-23T23:43:15.506 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link set ceph-brx up 2024-03-23T23:43:15.506 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-23T23:43:15.506 DEBUG:teuthology.orchestra.run.smithi196:> ') 2024-03-23T23:43:15.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:15.618 DEBUG:teuthology.orchestra.run.smithi196:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-23T23:43:15.635 INFO:teuthology.orchestra.run.smithi196.stdout:1 2024-03-23T23:43:15.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:15.637 DEBUG:teuthology.orchestra.run.smithi196:> route 2024-03-23T23:43:15.706 INFO:teuthology.orchestra.run.smithi196.stdout:Kernel IP routing table 2024-03-23T23:43:15.707 INFO:teuthology.orchestra.run.smithi196.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-23T23:43:15.707 INFO:teuthology.orchestra.run.smithi196.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-03-23T23:43:15.707 INFO:teuthology.orchestra.run.smithi196.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-23T23:43:15.707 INFO:teuthology.orchestra.run.smithi196.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-03-23T23:43:15.707 INFO:teuthology.orchestra.run.smithi196.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-03-23T23:43:15.707 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-23T23:43:15.707 INFO:teuthology.orchestra.run.smithi196.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-23T23:43:15.707 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-23T23:43:15.707 INFO:teuthology.orchestra.run.smithi196.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-23T23:43:15.707 INFO:teuthology.orchestra.run.smithi196.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-23T23:43:15.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:15.708 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec bash -c ' 2024-03-23T23:43:15.708 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2024-03-23T23:43:15.708 DEBUG:teuthology.orchestra.run.smithi196:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-23T23:43:15.708 DEBUG:teuthology.orchestra.run.smithi196:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-23T23:43:15.708 DEBUG:teuthology.orchestra.run.smithi196:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-23T23:43:15.708 DEBUG:teuthology.orchestra.run.smithi196:> ') 2024-03-23T23:43:15.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:15.799 DEBUG:teuthology.orchestra.run.smithi196:> ip netns list 2024-03-23T23:43:15.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:15.809 DEBUG:teuthology.orchestra.run.smithi196:> ip netns list-id 2024-03-23T23:43:15.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:15.857 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec bash -c ' 2024-03-23T23:43:15.857 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2024-03-23T23:43:15.858 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-23T23:43:15.858 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-03-23T23:43:15.858 DEBUG:teuthology.orchestra.run.smithi196:> ') 2024-03-23T23:43:15.942 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-03-23T23:43:15.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:15.942 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec bash -c ' 2024-03-23T23:43:15.943 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2024-03-23T23:43:15.943 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-03-23T23:43:15.943 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-23T23:43:15.943 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-03-23T23:43:15.943 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-03-23T23:43:15.943 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-03-23T23:43:15.943 DEBUG:teuthology.orchestra.run.smithi196:> ') 2024-03-23T23:43:16.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:16.116 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec bash -c ' 2024-03-23T23:43:16.116 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2024-03-23T23:43:16.116 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link set brx.0 up 2024-03-23T23:43:16.116 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link set dev brx.0 master ceph-brx 2024-03-23T23:43:16.116 DEBUG:teuthology.orchestra.run.smithi196:> ') 2024-03-23T23:43:16.155 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-23T23:43:16.155 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-23T23:43:16.206 INFO:teuthology.orchestra.run.smithi196.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-23T23:43:16.206 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-23T23:43:16.206 DEBUG:teuthology.orchestra.run.smithi196:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-23T23:43:16.256 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-23T23:43:16.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:16.257 DEBUG:teuthology.orchestra.run.smithi196:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=b 2024-03-23T23:43:16.359 INFO:teuthology.orchestra.run.smithi196.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=b 2024-03-23T23:43:16.359 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=b". 2024-03-23T23:43:16.359 INFO:teuthology.orchestra.run.smithi196.stdout:invalid new device string format 2024-03-23T23:43:16.901 INFO:teuthology.orchestra.run.smithi196.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=b 2024-03-23T23:43:16.901 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=b". 2024-03-23T23:43:16.901 INFO:teuthology.orchestra.run.smithi196.stdout:invalid new device string format 2024-03-23T23:43:16.901 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.196:3300,172.21.15.196:3301" 2024-03-23T23:43:16.901 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-23T23:43:16.912 INFO:teuthology.orchestra.run.smithi196.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=b 2024-03-23T23:43:16.912 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=b". 2024-03-23T23:43:16.912 INFO:teuthology.orchestra.run.smithi196.stdout:invalid new device string format 2024-03-23T23:43:16.912 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.196:3300,172.21.15.196:3301" 2024-03-23T23:43:16.912 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-23T23:43:16.913 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: resolved to: "172.21.15.8:6789,172.21.15.196:6789,172.21.15.196:6790" 2024-03-23T23:43:16.913 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.8:6789,172.21.15.196:6789,172.21.15.196:6790:/ 2024-03-23T23:43:16.913 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=b,key=1,fsid=c1a2a381-bc04-418a-8aea-f38031d04f8d" will pass to kernel 2024-03-23T23:43:16.916 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-23T23:43:16.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:16.917 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-23T23:43:16.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:16.939 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-23T23:43:17.023 INFO:teuthology.orchestra.run.smithi196.stdout:client4902 2024-03-23T23:43:17.023 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-23T23:43:17.023 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-23T23:43:17.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:17.079 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-23T23:43:17.143 INFO:teuthology.orchestra.run.smithi196.stdout:client4902 2024-03-23T23:43:17.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:17.143 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-23T23:43:17.204 INFO:teuthology.orchestra.run.smithi196.stdout:client4902 2024-03-23T23:43:17.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:43:17.205 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c1a2a381-bc04-418a-8aea-f38031d04f8d.client4902/status') 2024-03-23T23:43:17.270 INFO:teuthology.orchestra.run.smithi196.stdout:instance: client.4902 (3)172.21.15.196:0/1213453088 2024-03-23T23:43:17.271 INFO:teuthology.orchestra.run.smithi196.stdout:blocklisted: false 2024-03-23T23:43:17.271 INFO:teuthology.orchestra.run.smithi196.stderr:0+1 records in 2024-03-23T23:43:17.271 INFO:teuthology.orchestra.run.smithi196.stderr:0+1 records out 2024-03-23T23:43:17.271 INFO:teuthology.orchestra.run.smithi196.stderr:71 bytes copied, 7.0469e-05 s, 1.0 MB/s 2024-03-23T23:43:17.273 INFO:teuthology.run_tasks:Running task mon_thrash... 2024-03-23T23:43:17.334 INFO:tasks.mon_thrash:Beginning mon_thrash... 2024-03-23T23:43:17.335 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:43:17.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.476+0000 7f1ef3a00640 1 Processor -- start 2024-03-23T23:43:17.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.476+0000 7f1ef3a00640 1 -- start start 2024-03-23T23:43:17.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.476+0000 7f1ef3a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1eec0c3f00 0x7f1eec0c4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:17.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.476+0000 7f1ef3a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eec1542a0 con 0x7f1eec0c55b0 2024-03-23T23:43:17.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.476+0000 7f1ef3a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eec154540 con 0x7f1eec150f30 2024-03-23T23:43:17.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.476+0000 7f1ef3a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eec06f780 con 0x7f1eec0c3f00 2024-03-23T23:43:17.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.476+0000 7f1eebe00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f1eec0c55b0 0x7f1eec0715e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48076/0 (socket says 172.21.15.8:48076) 2024-03-23T23:43:17.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.476+0000 7f1eebe00640 1 -- 172.21.15.8:0/773213484 learned_addr learned my addr 172.21.15.8:0/773213484 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:43:17.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.476+0000 7f1ef1a00640 1 --2- 172.21.15.8:0/773213484 >> v2:172.21.15.196:3300/0 conn(0x7f1eec0c3f00 0x7f1eec0c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:17.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.476+0000 7f1eeb400640 1 -- 172.21.15.8:0/773213484 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4161693431 0 0) 0x7f1eec154540 con 0x7f1eec150f30 2024-03-23T23:43:17.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.476+0000 7f1eeb400640 1 -- 172.21.15.8:0/773213484 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ed4003530 con 0x7f1eec150f30 2024-03-23T23:43:17.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.476+0000 7f1ef1a00640 1 -- 172.21.15.8:0/773213484 >> v1:172.21.15.196:6789/0 conn(0x7f1eec150f30 legacy=0x7f1eec0c7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:17.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.476+0000 7f1ef1a00640 1 -- 172.21.15.8:0/773213484 >> v1:172.21.15.8:6789/0 conn(0x7f1eec0c55b0 legacy=0x7f1eec0715e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:17.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.476+0000 7f1eeb400640 1 -- 172.21.15.8:0/773213484 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4216247819 0 0) 0x7f1eec1542a0 con 0x7f1eec0c55b0 2024-03-23T23:43:17.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.476+0000 7f1ef1a00640 1 -- 172.21.15.8:0/773213484 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eec06f9d0 con 0x7f1eec0c3f00 2024-03-23T23:43:17.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.480+0000 7f1ef1a00640 1 --2- 172.21.15.8:0/773213484 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1eec0c3f00 0x7f1eec0c4450 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4009d90 tx=0x7f1ee401c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7065da789c6816f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:17.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.480+0000 7f1eeb400640 1 -- 172.21.15.8:0/773213484 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee40a8650 con 0x7f1eec0c3f00 2024-03-23T23:43:17.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.480+0000 7f1eeb400640 1 -- 172.21.15.8:0/773213484 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee40a87f0 con 0x7f1eec0c3f00 2024-03-23T23:43:17.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.480+0000 7f1eeb400640 1 -- 172.21.15.8:0/773213484 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee40a8bc0 con 0x7f1eec0c3f00 2024-03-23T23:43:17.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.480+0000 7f1ef3a00640 1 -- 172.21.15.8:0/773213484 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1eec0c3f00 msgr2=0x7f1eec0c4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:17.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.480+0000 7f1ef3a00640 1 --2- 172.21.15.8:0/773213484 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1eec0c3f00 0x7f1eec0c4450 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4009d90 tx=0x7f1ee401c820 comp rx=0 tx=0).stop 2024-03-23T23:43:17.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.480+0000 7f1ef3a00640 1 -- 172.21.15.8:0/773213484 shutdown_connections 2024-03-23T23:43:17.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.480+0000 7f1ef3a00640 1 --2- 172.21.15.8:0/773213484 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1eec0c3f00 0x7f1eec0c4450 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:17.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.480+0000 7f1ef3a00640 1 -- 172.21.15.8:0/773213484 >> 172.21.15.8:0/773213484 conn(0x7f1eec0aaee0 msgr2=0x7f1eec0ab2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:17.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.480+0000 7f1ef3a00640 1 -- 172.21.15.8:0/773213484 shutdown_connections 2024-03-23T23:43:17.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.480+0000 7f1ef3a00640 1 -- 172.21.15.8:0/773213484 wait complete. 2024-03-23T23:43:17.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.484+0000 7f1ef3a00640 1 Processor -- start 2024-03-23T23:43:17.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.484+0000 7f1ef3a00640 1 -- start start 2024-03-23T23:43:17.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.484+0000 7f1ef3a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1eec0c3f00 0x7f1eec1eed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:17.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.484+0000 7f1ef3a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1eec0c55b0 0x7f1eec14a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:17.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.484+0000 7f1ef3a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1eec150f30 0x7f1eec14ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:17.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.484+0000 7f1ef3a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec161be0 con 0x7f1eec0c3f00 2024-03-23T23:43:17.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.484+0000 7f1ef3a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec161a60 con 0x7f1eec150f30 2024-03-23T23:43:17.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.484+0000 7f1ef3a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec161d60 con 0x7f1eec0c55b0 2024-03-23T23:43:17.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.484+0000 7f1ef1000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1eec0c3f00 0x7f1eec1eed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:17.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.484+0000 7f1ef1000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1eec0c3f00 0x7f1eec1eed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54692/0 (socket says 172.21.15.8:54692) 2024-03-23T23:43:17.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.484+0000 7f1ef1000640 1 -- 172.21.15.8:0/889330778 learned_addr learned my addr 172.21.15.8:0/889330778 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:17.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.484+0000 7f1eebe00640 1 --2- 172.21.15.8:0/889330778 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1eec0c55b0 0x7f1eec14a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:17.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.484+0000 7f1ef1a00640 1 --2- 172.21.15.8:0/889330778 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1eec150f30 0x7f1eec14ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:17.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.488+0000 7f1ef1000640 1 -- 172.21.15.8:0/889330778 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1eec0c55b0 msgr2=0x7f1eec14a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:17.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.488+0000 7f1ef1000640 1 --2- 172.21.15.8:0/889330778 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1eec0c55b0 0x7f1eec14a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:17.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.488+0000 7f1ef1000640 1 -- 172.21.15.8:0/889330778 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1eec150f30 msgr2=0x7f1eec14ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:17.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.488+0000 7f1ef1000640 1 --2- 172.21.15.8:0/889330778 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1eec150f30 0x7f1eec14ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:17.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.488+0000 7f1ef1000640 1 -- 172.21.15.8:0/889330778 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eec14b430 con 0x7f1eec0c3f00 2024-03-23T23:43:17.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.488+0000 7f1ef1000640 1 --2- 172.21.15.8:0/889330778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1eec0c3f00 0x7f1eec1eed20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1ee000c460 tx=0x7f1ee000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:17.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.488+0000 7f1ee8c00640 1 -- 172.21.15.8:0/889330778 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0017070 con 0x7f1eec0c3f00 2024-03-23T23:43:17.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.488+0000 7f1ee8c00640 1 -- 172.21.15.8:0/889330778 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee00052f0 con 0x7f1eec0c3f00 2024-03-23T23:43:17.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.488+0000 7f1ee8c00640 1 -- 172.21.15.8:0/889330778 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0003840 con 0x7f1eec0c3f00 2024-03-23T23:43:17.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.488+0000 7f1ef3a00640 1 -- 172.21.15.8:0/889330778 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eec06c3b0 con 0x7f1eec0c3f00 2024-03-23T23:43:17.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.488+0000 7f1ef3a00640 1 -- 172.21.15.8:0/889330778 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eec06c970 con 0x7f1eec0c3f00 2024-03-23T23:43:17.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.488+0000 7f1ef3a00640 1 -- 172.21.15.8:0/889330778 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eec06cb70 con 0x7f1eec0c3f00 2024-03-23T23:43:17.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.488+0000 7f1ee8c00640 1 -- 172.21.15.8:0/889330778 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f1ee001a070 con 0x7f1eec0c3f00 2024-03-23T23:43:17.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.488+0000 7f1ee8c00640 1 --2- 172.21.15.8:0/889330778 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1ecc067660 0x7f1ecc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:17.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.492+0000 7f1ee8c00640 1 -- 172.21.15.8:0/889330778 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f1ee0084f90 con 0x7f1eec0c3f00 2024-03-23T23:43:17.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.492+0000 7f1eebe00640 1 --2- 172.21.15.8:0/889330778 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1ecc067660 0x7f1ecc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:17.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.492+0000 7f1eebe00640 1 --2- 172.21.15.8:0/889330778 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1ecc067660 0x7f1ecc069b20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1eec153050 tx=0x7f1ed8007d60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:17.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.496+0000 7f1ee8c00640 1 -- 172.21.15.8:0/889330778 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f1eec06cb70 con 0x7f1eec0c3f00 2024-03-23T23:43:17.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.660+0000 7f1ef3a00640 1 -- 172.21.15.8:0/889330778 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1eec068270 con 0x7f1eec0c3f00 2024-03-23T23:43:17.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.664+0000 7f1ee8c00640 1 -- 172.21.15.8:0/889330778 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20271 (secure 0 0 0) 0x7f1ee005b020 con 0x7f1eec0c3f00 2024-03-23T23:43:17.665 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:43:17.665 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":25,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","created":"2024-03-23T23:42:15.169430+0000","modified":"2024-03-23T23:42:51.739271+0000","last_up_change":"2024-03-23T23:42:26.509742+0000","last_in_change":"2024-03-23T23:42:17.662330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:42:26.327445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-23T23:42:38.218800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-23T23:42:39.054195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-23T23:42:48.327799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-23T23:42:49.113061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e967bf31-21d6-4d11-bc3d-0df8177a1b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6809","nonce":2187201732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6811","nonce":2187201732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6815","nonce":2187201732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6813","nonce":2187201732}]},"public_addr":"172.21.15.8:6809/2187201732","cluster_addr":"172.21.15.8:6811/2187201732","heartbeat_back_addr":"172.21.15.8:6815/2187201732","heartbeat_front_addr":"172.21.15.8:6813/2187201732","state":["exists","up"]},{"osd":1,"uuid":"c8e33701-7acd-4474-8402-d52461171fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6818","nonce":3205168010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6822","nonce":3205168010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6830","nonce":3205168010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6826","nonce":3205168010}]},"public_addr":"172.21.15.8:6818/3205168010","cluster_addr":"172.21.15.8:6822/3205168010","heartbeat_back_addr":"172.21.15.8:6830/3205168010","heartbeat_front_addr":"172.21.15.8:6826/3205168010","state":["exists","up"]},{"osd":2,"uuid":"ceebdbf7-4c2f-4757-b52d-fd8b20e77570","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6801","nonce":475463656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6803","nonce":475463656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6807","nonce":475463656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6805","nonce":475463656}]},"public_addr":"172.21.15.8:6801/475463656","cluster_addr":"172.21.15.8:6803/475463656","heartbeat_back_addr":"172.21.15.8:6807/475463656","heartbeat_front_addr":"172.21.15.8:6805/475463656","state":["exists","up"]},{"osd":3,"uuid":"89e258da-5767-429e-8441-edf877d2f3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6819","nonce":1514082871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6821","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6823","nonce":1514082871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6829","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6831","nonce":1514082871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6825","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6827","nonce":1514082871}]},"public_addr":"172.21.15.8:6819/1514082871","cluster_addr":"172.21.15.8:6823/1514082871","heartbeat_back_addr":"172.21.15.8:6831/1514082871","heartbeat_front_addr":"172.21.15.8:6827/1514082871","state":["exists","up"]},{"osd":4,"uuid":"2b7451ae-ea16-4f0a-ae50-04fde75e45ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6825","nonce":3516578147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6827","nonce":3516578147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6831","nonce":3516578147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6829","nonce":3516578147}]},"public_addr":"172.21.15.196:6825/3516578147","cluster_addr":"172.21.15.196:6827/3516578147","heartbeat_back_addr":"172.21.15.196:6831/3516578147","heartbeat_front_addr":"172.21.15.196:6829/3516578147","state":["exists","up"]},{"osd":5,"uuid":"e68a8914-e591-466a-bc9e-f2d7c67aac13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6802","nonce":830595758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6806","nonce":830595758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6814","nonce":830595758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6810","nonce":830595758}]},"public_addr":"172.21.15.196:6802/830595758","cluster_addr":"172.21.15.196:6806/830595758","heartbeat_back_addr":"172.21.15.196:6814/830595758","heartbeat_front_addr":"172.21.15.196:6810/830595758","state":["exists","up"]},{"osd":6,"uuid":"e47723c5-50a0-4cd8-92d9-01972072b422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6801","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6803","nonce":472639906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6805","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6807","nonce":472639906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6815","nonce":472639906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6811","nonce":472639906}]},"public_addr":"172.21.15.196:6803/472639906","cluster_addr":"172.21.15.196:6807/472639906","heartbeat_back_addr":"172.21.15.196:6815/472639906","heartbeat_front_addr":"172.21.15.196:6811/472639906","state":["exists","up"]},{"osd":7,"uuid":"e1e9113d-8005-47b3-9a75-9e701199f1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6817","nonce":4151820349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6819","nonce":4151820349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6823","nonce":4151820349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6821","nonce":4151820349}]},"public_addr":"172.21.15.196:6817/4151820349","cluster_addr":"172.21.15.196:6819/4151820349","heartbeat_back_addr":"172.21.15.196:6823/4151820349","heartbeat_front_addr":"172.21.15.196:6821/4151820349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.221790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.265974+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.190319+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.376359+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.329657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.402958+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.300703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.133121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:43:17.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.664+0000 7f1ef3a00640 1 -- 172.21.15.8:0/889330778 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1ecc067660 msgr2=0x7f1ecc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:17.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.664+0000 7f1ef3a00640 1 --2- 172.21.15.8:0/889330778 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1ecc067660 0x7f1ecc069b20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1eec153050 tx=0x7f1ed8007d60 comp rx=0 tx=0).stop 2024-03-23T23:43:17.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.664+0000 7f1ef3a00640 1 -- 172.21.15.8:0/889330778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1eec0c3f00 msgr2=0x7f1eec1eed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:17.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.664+0000 7f1ef3a00640 1 --2- 172.21.15.8:0/889330778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1eec0c3f00 0x7f1eec1eed20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1ee000c460 tx=0x7f1ee000c920 comp rx=0 tx=0).stop 2024-03-23T23:43:17.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.664+0000 7f1ef3a00640 1 -- 172.21.15.8:0/889330778 shutdown_connections 2024-03-23T23:43:17.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.664+0000 7f1ef3a00640 1 --2- 172.21.15.8:0/889330778 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1eec150f30 0x7f1eec14ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:17.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.664+0000 7f1ef3a00640 1 --2- 172.21.15.8:0/889330778 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1ecc067660 0x7f1ecc069b20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:17.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.664+0000 7f1ef3a00640 1 --2- 172.21.15.8:0/889330778 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1eec0c55b0 0x7f1eec14a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:17.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.664+0000 7f1ef3a00640 1 --2- 172.21.15.8:0/889330778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1eec0c3f00 0x7f1eec1eed20 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:17.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.664+0000 7f1ef3a00640 1 -- 172.21.15.8:0/889330778 >> 172.21.15.8:0/889330778 conn(0x7f1eec0aaee0 msgr2=0x7f1eec0c2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:17.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.664+0000 7f1ef3a00640 1 -- 172.21.15.8:0/889330778 shutdown_connections 2024-03-23T23:43:17.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.664+0000 7f1ef3a00640 1 -- 172.21.15.8:0/889330778 wait complete. 2024-03-23T23:43:17.687 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-23T23:42:26.327445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-03-23T23:42:38.218800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-03-23T23:42:39.054195+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-03-23T23:42:48.327799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-03-23T23:42:49.113061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-23T23:43:17.688 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-23T23:43:17.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.828+0000 7f85fc000640 1 Processor -- start 2024-03-23T23:43:17.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.828+0000 7f85fc000640 1 -- start start 2024-03-23T23:43:17.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.828+0000 7f85fc000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f85f4152e50 0x7f85f40c0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:17.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.832+0000 7f85fc000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f85f406cd60 0x7f85f40c3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:17.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.832+0000 7f85fc000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f40c1ff0 con 0x7f85f40c2760 2024-03-23T23:43:17.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.832+0000 7f85fc000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f406d6e0 con 0x7f85f406cd60 2024-03-23T23:43:17.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.832+0000 7f85fc000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f40c1020 con 0x7f85f4152e50 2024-03-23T23:43:17.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.832+0000 7f85fa000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f85f406cd60 0x7f85f40c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:17.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.832+0000 7f85fa000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f85f406cd60 0x7f85f40c3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54706/0 (socket says 172.21.15.8:54706) 2024-03-23T23:43:17.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.832+0000 7f85fa000640 1 -- 172.21.15.8:0/569894340 learned_addr learned my addr 172.21.15.8:0/569894340 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:17.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.832+0000 7f85f9600640 1 --2- 172.21.15.8:0/569894340 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f85f4152e50 0x7f85f40c0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:17.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.832+0000 7f85fa000640 1 -- 172.21.15.8:0/569894340 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f85f4152e50 msgr2=0x7f85f40c0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:17.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.832+0000 7f85fa000640 1 --2- 172.21.15.8:0/569894340 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f85f4152e50 0x7f85f40c0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:17.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.832+0000 7f85fa000640 1 -- 172.21.15.8:0/569894340 >> v1:172.21.15.196:6789/0 conn(0x7f85f40c2760 legacy=0x7f85f40c2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:17.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.832+0000 7f85fa000640 1 -- 172.21.15.8:0/569894340 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f40c1300 con 0x7f85f406cd60 2024-03-23T23:43:17.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.832+0000 7f85f3e00640 1 -- 172.21.15.8:0/569894340 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 205389072 0 0) 0x7f85f40c1ff0 con 0x7f85f40c2760 2024-03-23T23:43:17.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.832+0000 7f85fa000640 1 --2- 172.21.15.8:0/569894340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85f406cd60 0x7f85f40c3440 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f85f406d860 tx=0x7f85ec01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bacb7f03a0d48ff4 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:17.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.832+0000 7f85f3e00640 1 -- 172.21.15.8:0/569894340 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ec0a5690 con 0x7f85f406cd60 2024-03-23T23:43:17.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.832+0000 7f85f3e00640 1 -- 172.21.15.8:0/569894340 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85ec0a5830 con 0x7f85f406cd60 2024-03-23T23:43:17.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.832+0000 7f85f3e00640 1 -- 172.21.15.8:0/569894340 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ec0a5c00 con 0x7f85f406cd60 2024-03-23T23:43:17.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.836+0000 7f85fc000640 1 -- 172.21.15.8:0/569894340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85f406cd60 msgr2=0x7f85f40c3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:17.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.836+0000 7f85fc000640 1 --2- 172.21.15.8:0/569894340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85f406cd60 0x7f85f40c3440 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f85f406d860 tx=0x7f85ec01c8c0 comp rx=0 tx=0).stop 2024-03-23T23:43:17.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.836+0000 7f85fc000640 1 -- 172.21.15.8:0/569894340 shutdown_connections 2024-03-23T23:43:17.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.836+0000 7f85fc000640 1 --2- 172.21.15.8:0/569894340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85f406cd60 0x7f85f40c3440 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:17.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.836+0000 7f85fc000640 1 --2- 172.21.15.8:0/569894340 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f85f4152e50 0x7f85f40c0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:17.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.836+0000 7f85fc000640 1 -- 172.21.15.8:0/569894340 >> 172.21.15.8:0/569894340 conn(0x7f85f406b170 msgr2=0x7f85f406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:17.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.836+0000 7f85fc000640 1 -- 172.21.15.8:0/569894340 shutdown_connections 2024-03-23T23:43:17.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.836+0000 7f85fc000640 1 -- 172.21.15.8:0/569894340 wait complete. 2024-03-23T23:43:17.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.836+0000 7f85fc000640 1 Processor -- start 2024-03-23T23:43:17.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.836+0000 7f85fc000640 1 -- start start 2024-03-23T23:43:17.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.840+0000 7f85fc000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85f406cd60 0x7f85f41546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:17.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.840+0000 7f85fc000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f85f40c2760 0x7f85f414c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:17.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.840+0000 7f85fc000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f85f4152e50 0x7f85f414cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:17.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.840+0000 7f85fc000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f406dcd0 con 0x7f85f406cd60 2024-03-23T23:43:17.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.840+0000 7f85fc000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f406db50 con 0x7f85f40c2760 2024-03-23T23:43:17.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.840+0000 7f85fc000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f4162a20 con 0x7f85f4152e50 2024-03-23T23:43:17.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.840+0000 7f85f9600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85f406cd60 0x7f85f41546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:17.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.840+0000 7f85f9600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85f406cd60 0x7f85f41546b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54712/0 (socket says 172.21.15.8:54712) 2024-03-23T23:43:17.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.840+0000 7f85f9600640 1 -- 172.21.15.8:0/2369938389 learned_addr learned my addr 172.21.15.8:0/2369938389 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:17.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.840+0000 7f85f8c00640 1 --2- 172.21.15.8:0/2369938389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f85f40c2760 0x7f85f414c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:17.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.840+0000 7f85fa000640 1 --2- 172.21.15.8:0/2369938389 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f85f4152e50 0x7f85f414cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:17.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.840+0000 7f85f9600640 1 -- 172.21.15.8:0/2369938389 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f85f4152e50 msgr2=0x7f85f414cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:17.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.840+0000 7f85f9600640 1 --2- 172.21.15.8:0/2369938389 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f85f4152e50 0x7f85f414cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:17.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.840+0000 7f85f9600640 1 -- 172.21.15.8:0/2369938389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f85f40c2760 msgr2=0x7f85f414c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:17.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.840+0000 7f85f9600640 1 --2- 172.21.15.8:0/2369938389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f85f40c2760 0x7f85f414c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:17.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.840+0000 7f85f9600640 1 -- 172.21.15.8:0/2369938389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f4153b30 con 0x7f85f406cd60 2024-03-23T23:43:17.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.840+0000 7f85f9600640 1 --2- 172.21.15.8:0/2369938389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85f406cd60 0x7f85f41546b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f85e800e8a0 tx=0x7f85e800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:17.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.840+0000 7f85f1600640 1 -- 172.21.15.8:0/2369938389 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e8017070 con 0x7f85f406cd60 2024-03-23T23:43:17.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.840+0000 7f85f1600640 1 -- 172.21.15.8:0/2369938389 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e800c940 con 0x7f85f406cd60 2024-03-23T23:43:17.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.840+0000 7f85fc000640 1 -- 172.21.15.8:0/2369938389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f4153890 con 0x7f85f406cd60 2024-03-23T23:43:17.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.840+0000 7f85f1600640 1 -- 172.21.15.8:0/2369938389 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e800ccf0 con 0x7f85f406cd60 2024-03-23T23:43:17.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.840+0000 7f85fc000640 1 -- 172.21.15.8:0/2369938389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f4152330 con 0x7f85f406cd60 2024-03-23T23:43:17.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.840+0000 7f85fc000640 1 -- 172.21.15.8:0/2369938389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f404f410 con 0x7f85f406cd60 2024-03-23T23:43:17.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.844+0000 7f85f1600640 1 -- 172.21.15.8:0/2369938389 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f85e801a070 con 0x7f85f406cd60 2024-03-23T23:43:17.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.844+0000 7f85f1600640 1 --2- 172.21.15.8:0/2369938389 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f85d4067690 0x7f85d4069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:17.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.844+0000 7f85f1600640 1 -- 172.21.15.8:0/2369938389 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f85e8085ab0 con 0x7f85f406cd60 2024-03-23T23:43:17.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.844+0000 7f85f8c00640 1 --2- 172.21.15.8:0/2369938389 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f85d4067690 0x7f85d4069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:17.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.844+0000 7f85f8c00640 1 --2- 172.21.15.8:0/2369938389 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f85d4067690 0x7f85d4069b50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f85f40730a0 tx=0x7f85e0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:17.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:17.848+0000 7f85f1600640 1 -- 172.21.15.8:0/2369938389 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f85e8055db0 con 0x7f85f406cd60 2024-03-23T23:43:18.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.012+0000 7f85fc000640 1 -- 172.21.15.8:0/2369938389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f85f40c1b30 con 0x7f85f406cd60 2024-03-23T23:43:18.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.012+0000 7f85f1600640 1 -- 172.21.15.8:0/2369938389 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f85e8059e50 con 0x7f85f406cd60 2024-03-23T23:43:18.014 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-03-23T23:43:18.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.012+0000 7f85fc000640 1 -- 172.21.15.8:0/2369938389 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f85d4067690 msgr2=0x7f85d4069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:18.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.012+0000 7f85fc000640 1 --2- 172.21.15.8:0/2369938389 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f85d4067690 0x7f85d4069b50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f85f40730a0 tx=0x7f85e0009040 comp rx=0 tx=0).stop 2024-03-23T23:43:18.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.012+0000 7f85fc000640 1 -- 172.21.15.8:0/2369938389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85f406cd60 msgr2=0x7f85f41546b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:18.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.012+0000 7f85fc000640 1 --2- 172.21.15.8:0/2369938389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85f406cd60 0x7f85f41546b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f85e800e8a0 tx=0x7f85e800eca0 comp rx=0 tx=0).stop 2024-03-23T23:43:18.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.012+0000 7f85fc000640 1 -- 172.21.15.8:0/2369938389 shutdown_connections 2024-03-23T23:43:18.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.012+0000 7f85fc000640 1 --2- 172.21.15.8:0/2369938389 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f85d4067690 0x7f85d4069b50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:18.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.012+0000 7f85fc000640 1 --2- 172.21.15.8:0/2369938389 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f85f4152e50 0x7f85f414cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:18.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.012+0000 7f85fc000640 1 --2- 172.21.15.8:0/2369938389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f85f40c2760 0x7f85f414c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:18.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.012+0000 7f85fc000640 1 --2- 172.21.15.8:0/2369938389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85f406cd60 0x7f85f41546b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:18.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.012+0000 7f85fc000640 1 -- 172.21.15.8:0/2369938389 >> 172.21.15.8:0/2369938389 conn(0x7f85f406b170 msgr2=0x7f85f40c7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:18.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.012+0000 7f85fc000640 1 -- 172.21.15.8:0/2369938389 shutdown_connections 2024-03-23T23:43:18.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.012+0000 7f85fc000640 1 -- 172.21.15.8:0/2369938389 wait complete. 2024-03-23T23:43:18.037 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-03-23T23:43:18.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.180+0000 7f9151e00640 1 Processor -- start 2024-03-23T23:43:18.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.180+0000 7f9151e00640 1 -- start start 2024-03-23T23:43:18.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.180+0000 7f9151e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f914c14a230 0x7f914c0c1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:18.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.180+0000 7f9151e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f914c072470 0x7f914c0728a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:18.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.180+0000 7f9151e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f914c1546c0 con 0x7f914c0c2e70 2024-03-23T23:43:18.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.180+0000 7f9151e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f914c071fe0 con 0x7f914c14a230 2024-03-23T23:43:18.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.180+0000 7f9151e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f914c14a610 con 0x7f914c072470 2024-03-23T23:43:18.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.180+0000 7f914aa00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f914c14a230 0x7f914c0c1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:18.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.180+0000 7f914aa00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f914c14a230 0x7f914c0c1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54724/0 (socket says 172.21.15.8:54724) 2024-03-23T23:43:18.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.180+0000 7f914a000640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f914c0c2e70 0x7f914c0c3990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48090/0 (socket says 172.21.15.8:48090) 2024-03-23T23:43:18.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.180+0000 7f914aa00640 1 -- 172.21.15.8:0/2897946070 learned_addr learned my addr 172.21.15.8:0/2897946070 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:18.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.180+0000 7f914b400640 1 --2- 172.21.15.8:0/2897946070 >> v2:172.21.15.196:3300/0 conn(0x7f914c072470 0x7f914c0728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:18.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.180+0000 7f914aa00640 1 -- 172.21.15.8:0/2897946070 >> v2:172.21.15.196:3300/0 conn(0x7f914c072470 msgr2=0x7f914c0728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:18.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.180+0000 7f914aa00640 1 --2- 172.21.15.8:0/2897946070 >> v2:172.21.15.196:3300/0 conn(0x7f914c072470 0x7f914c0728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:18.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.180+0000 7f914aa00640 1 -- 172.21.15.8:0/2897946070 >> v1:172.21.15.8:6789/0 conn(0x7f914c0c2e70 legacy=0x7f914c0c3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:18.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.180+0000 7f914aa00640 1 -- 172.21.15.8:0/2897946070 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914c0c20f0 con 0x7f914c14a230 2024-03-23T23:43:18.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.180+0000 7f914b400640 1 --2- 172.21.15.8:0/2897946070 >> v2:172.21.15.196:3300/0 conn(0x7f914c072470 0x7f914c0728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:43:18.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.184+0000 7f914aa00640 1 --2- 172.21.15.8:0/2897946070 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f914c14a230 0x7f914c0c1a60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f914c070610 tx=0x7f913c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af38078952104b2b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:18.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.184+0000 7f9149600640 1 -- 172.21.15.8:0/2897946070 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c0b0070 con 0x7f914c14a230 2024-03-23T23:43:18.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.184+0000 7f9149600640 1 -- 172.21.15.8:0/2897946070 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913c0ab600 con 0x7f914c14a230 2024-03-23T23:43:18.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.184+0000 7f9149600640 1 -- 172.21.15.8:0/2897946070 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c0ab9d0 con 0x7f914c14a230 2024-03-23T23:43:18.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.184+0000 7f9151e00640 1 -- 172.21.15.8:0/2897946070 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f914c14a230 msgr2=0x7f914c0c1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:18.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.184+0000 7f9151e00640 1 --2- 172.21.15.8:0/2897946070 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f914c14a230 0x7f914c0c1a60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f914c070610 tx=0x7f913c01c490 comp rx=0 tx=0).stop 2024-03-23T23:43:18.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.184+0000 7f9151e00640 1 -- 172.21.15.8:0/2897946070 shutdown_connections 2024-03-23T23:43:18.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.184+0000 7f9151e00640 1 --2- 172.21.15.8:0/2897946070 >> v2:172.21.15.196:3300/0 conn(0x7f914c072470 0x7f914c0728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:18.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.184+0000 7f9151e00640 1 --2- 172.21.15.8:0/2897946070 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f914c14a230 0x7f914c0c1a60 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:18.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.184+0000 7f9151e00640 1 -- 172.21.15.8:0/2897946070 >> 172.21.15.8:0/2897946070 conn(0x7f914c06b170 msgr2=0x7f914c06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:18.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.184+0000 7f9151e00640 1 -- 172.21.15.8:0/2897946070 shutdown_connections 2024-03-23T23:43:18.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.184+0000 7f9151e00640 1 -- 172.21.15.8:0/2897946070 wait complete. 2024-03-23T23:43:18.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.188+0000 7f9151e00640 1 Processor -- start 2024-03-23T23:43:18.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.188+0000 7f9151e00640 1 -- start start 2024-03-23T23:43:18.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.188+0000 7f9151e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f914c072470 0x7f914c0ab400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:18.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.188+0000 7f9151e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f914c0c2e70 0x7f914c157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:18.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.188+0000 7f9151e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f914c14a230 0x7f914c142510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:18.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.188+0000 7f9151e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c0c4220 con 0x7f914c14a230 2024-03-23T23:43:18.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.188+0000 7f9151e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c0c40a0 con 0x7f914c0c2e70 2024-03-23T23:43:18.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.188+0000 7f9151e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f914c1608c0 con 0x7f914c072470 2024-03-23T23:43:18.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.188+0000 7f914b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f914c14a230 0x7f914c142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:18.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.188+0000 7f914b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f914c14a230 0x7f914c142510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54738/0 (socket says 172.21.15.8:54738) 2024-03-23T23:43:18.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.188+0000 7f914b400640 1 -- 172.21.15.8:0/1271526111 learned_addr learned my addr 172.21.15.8:0/1271526111 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:18.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.188+0000 7f914aa00640 1 --2- 172.21.15.8:0/1271526111 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f914c072470 0x7f914c0ab400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:18.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.188+0000 7f914a000640 1 --2- 172.21.15.8:0/1271526111 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f914c0c2e70 0x7f914c157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:18.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.188+0000 7f914b400640 1 -- 172.21.15.8:0/1271526111 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f914c072470 msgr2=0x7f914c0ab400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:18.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.188+0000 7f914b400640 1 --2- 172.21.15.8:0/1271526111 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f914c072470 0x7f914c0ab400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:18.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.188+0000 7f914b400640 1 -- 172.21.15.8:0/1271526111 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f914c0c2e70 msgr2=0x7f914c157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:18.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.188+0000 7f914b400640 1 --2- 172.21.15.8:0/1271526111 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f914c0c2e70 0x7f914c157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:18.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.188+0000 7f914b400640 1 -- 172.21.15.8:0/1271526111 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914c1ee1c0 con 0x7f914c14a230 2024-03-23T23:43:18.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.188+0000 7f914b400640 1 --2- 172.21.15.8:0/1271526111 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f914c14a230 0x7f914c142510 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9144009e60 tx=0x7f914400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:18.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.188+0000 7f9143400640 1 -- 172.21.15.8:0/1271526111 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9144018030 con 0x7f914c14a230 2024-03-23T23:43:18.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.188+0000 7f9143400640 1 -- 172.21.15.8:0/1271526111 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914400cdf0 con 0x7f914c14a230 2024-03-23T23:43:18.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.188+0000 7f9143400640 1 -- 172.21.15.8:0/1271526111 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9144003bc0 con 0x7f914c14a230 2024-03-23T23:43:18.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.188+0000 7f9151e00640 1 -- 172.21.15.8:0/1271526111 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f914c1ee4a0 con 0x7f914c14a230 2024-03-23T23:43:18.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.188+0000 7f9151e00640 1 -- 172.21.15.8:0/1271526111 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f914c1eea60 con 0x7f914c14a230 2024-03-23T23:43:18.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.192+0000 7f9151e00640 1 -- 172.21.15.8:0/1271526111 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f914c04f410 con 0x7f914c14a230 2024-03-23T23:43:18.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.192+0000 7f9143400640 1 -- 172.21.15.8:0/1271526111 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f914401b070 con 0x7f914c14a230 2024-03-23T23:43:18.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.192+0000 7f9143400640 1 --2- 172.21.15.8:0/1271526111 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f912c067660 0x7f912c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:18.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.192+0000 7f9143400640 1 -- 172.21.15.8:0/1271526111 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f9144086470 con 0x7f914c14a230 2024-03-23T23:43:18.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.192+0000 7f914aa00640 1 --2- 172.21.15.8:0/1271526111 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f912c067660 0x7f912c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:18.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.192+0000 7f914aa00640 1 --2- 172.21.15.8:0/1271526111 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f912c067660 0x7f912c069b20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f913c0ad000 tx=0x7f913c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:18.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.196+0000 7f9143400640 1 -- 172.21.15.8:0/1271526111 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f9144010040 con 0x7f914c14a230 2024-03-23T23:43:18.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.360+0000 7f9151e00640 1 -- 172.21.15.8:0/1271526111 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7f914c0c2c50 con 0x7f914c14a230 2024-03-23T23:43:18.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.360+0000 7f9143400640 1 -- 172.21.15.8:0/1271526111 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v25) v1 ==== 99+0+11 (secure 0 0 0) 0x7f9144056760 con 0x7f914c14a230 2024-03-23T23:43:18.363 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-03-23T23:43:18.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.364+0000 7f9151e00640 1 -- 172.21.15.8:0/1271526111 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f912c067660 msgr2=0x7f912c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:18.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.364+0000 7f9151e00640 1 --2- 172.21.15.8:0/1271526111 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f912c067660 0x7f912c069b20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f913c0ad000 tx=0x7f913c008040 comp rx=0 tx=0).stop 2024-03-23T23:43:18.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.364+0000 7f9151e00640 1 -- 172.21.15.8:0/1271526111 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f914c14a230 msgr2=0x7f914c142510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:18.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.364+0000 7f9151e00640 1 --2- 172.21.15.8:0/1271526111 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f914c14a230 0x7f914c142510 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9144009e60 tx=0x7f914400c490 comp rx=0 tx=0).stop 2024-03-23T23:43:18.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.364+0000 7f9151e00640 1 -- 172.21.15.8:0/1271526111 shutdown_connections 2024-03-23T23:43:18.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.364+0000 7f9151e00640 1 --2- 172.21.15.8:0/1271526111 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f914c14a230 0x7f914c142510 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:18.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.364+0000 7f9151e00640 1 --2- 172.21.15.8:0/1271526111 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f914c0c2e70 0x7f914c157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:18.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.364+0000 7f9151e00640 1 --2- 172.21.15.8:0/1271526111 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f912c067660 0x7f912c069b20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:18.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.364+0000 7f9151e00640 1 --2- 172.21.15.8:0/1271526111 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f914c072470 0x7f914c0ab400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:18.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.364+0000 7f9151e00640 1 -- 172.21.15.8:0/1271526111 >> 172.21.15.8:0/1271526111 conn(0x7f914c06b170 msgr2=0x7f914c0c1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:18.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.364+0000 7f9151e00640 1 -- 172.21.15.8:0/1271526111 shutdown_connections 2024-03-23T23:43:18.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.364+0000 7f9151e00640 1 -- 172.21.15.8:0/1271526111 wait complete. 2024-03-23T23:43:18.385 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-03-23T23:43:18.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.528+0000 7f7ec7000640 1 Processor -- start 2024-03-23T23:43:18.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.528+0000 7f7ec7000640 1 -- start start 2024-03-23T23:43:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.528+0000 7f7ec7000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ec006ec40 0x7f7ec01561c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.528+0000 7f7ec7000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ec006bd10 con 0x7f7ec0152e00 2024-03-23T23:43:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.528+0000 7f7ec7000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ec00adc40 con 0x7f7ec006b170 2024-03-23T23:43:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.528+0000 7f7ec7000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ec0157270 con 0x7f7ec006ec40 2024-03-23T23:43:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.528+0000 7f7ec5200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ec006ec40 0x7f7ec01561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.528+0000 7f7ec5c00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f7ec0152e00 0x7f7ec0156b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48096/0 (socket says 172.21.15.8:48096) 2024-03-23T23:43:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.532+0000 7f7ec5c00640 1 -- 172.21.15.8:0/2565303205 learned_addr learned my addr 172.21.15.8:0/2565303205 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:43:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.532+0000 7f7ec5200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ec006ec40 0x7f7ec01561c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54744/0 (socket says 172.21.15.8:54744) 2024-03-23T23:43:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.532+0000 7f7ec5200640 1 -- 172.21.15.8:0/2565303205 >> v1:172.21.15.196:6789/0 conn(0x7f7ec006b170 legacy=0x7f7ec015fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.532+0000 7f7ec5200640 1 -- 172.21.15.8:0/2565303205 >> v1:172.21.15.8:6789/0 conn(0x7f7ec0152e00 legacy=0x7f7ec0156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:18.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.532+0000 7f7ec5200640 1 -- 172.21.15.8:0/2565303205 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec00adf20 con 0x7f7ec006ec40 2024-03-23T23:43:18.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.532+0000 7f7ec5200640 1 --2- 172.21.15.8:0/2565303205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ec006ec40 0x7f7ec01561c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7eac0097c0 tx=0x7f7eac01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d29fcfcaab1338 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:18.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.532+0000 7f7ebfe00640 1 -- 172.21.15.8:0/2565303205 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac0b2070 con 0x7f7ec006ec40 2024-03-23T23:43:18.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.532+0000 7f7ebfe00640 1 -- 172.21.15.8:0/2565303205 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eac0ad680 con 0x7f7ec006ec40 2024-03-23T23:43:18.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.532+0000 7f7ebfe00640 1 -- 172.21.15.8:0/2565303205 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac0ada50 con 0x7f7ec006ec40 2024-03-23T23:43:18.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.536+0000 7f7ec7000640 1 -- 172.21.15.8:0/2565303205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ec006ec40 msgr2=0x7f7ec01561c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:18.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.536+0000 7f7ec7000640 1 --2- 172.21.15.8:0/2565303205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ec006ec40 0x7f7ec01561c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7eac0097c0 tx=0x7f7eac01c470 comp rx=0 tx=0).stop 2024-03-23T23:43:18.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.536+0000 7f7ec7000640 1 -- 172.21.15.8:0/2565303205 shutdown_connections 2024-03-23T23:43:18.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.536+0000 7f7ec7000640 1 --2- 172.21.15.8:0/2565303205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ec006ec40 0x7f7ec01561c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:18.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.536+0000 7f7ec7000640 1 -- 172.21.15.8:0/2565303205 >> 172.21.15.8:0/2565303205 conn(0x7f7ec00c4990 msgr2=0x7f7ec00c4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:18.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.536+0000 7f7ec7000640 1 -- 172.21.15.8:0/2565303205 shutdown_connections 2024-03-23T23:43:18.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.536+0000 7f7ec7000640 1 -- 172.21.15.8:0/2565303205 wait complete. 2024-03-23T23:43:18.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.536+0000 7f7ec7000640 1 Processor -- start 2024-03-23T23:43:18.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.536+0000 7f7ec7000640 1 -- start start 2024-03-23T23:43:18.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.540+0000 7f7ec7000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ec006b170 0x7f7ec0142570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:18.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.540+0000 7f7ec7000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ec006ec40 0x7f7ec01511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:18.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.540+0000 7f7ec7000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ec0152e00 0x7f7ec0151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:18.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.540+0000 7f7ec7000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec0070670 con 0x7f7ec006ec40 2024-03-23T23:43:18.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.540+0000 7f7ec7000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec00704f0 con 0x7f7ec006b170 2024-03-23T23:43:18.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.540+0000 7f7ec7000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec00ad880 con 0x7f7ec0152e00 2024-03-23T23:43:18.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.540+0000 7f7ec5200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ec006ec40 0x7f7ec01511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:18.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.540+0000 7f7ec5200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ec006ec40 0x7f7ec01511b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54748/0 (socket says 172.21.15.8:54748) 2024-03-23T23:43:18.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.540+0000 7f7ec5200640 1 -- 172.21.15.8:0/2653270707 learned_addr learned my addr 172.21.15.8:0/2653270707 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:18.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.540+0000 7f7ec5c00640 1 --2- 172.21.15.8:0/2653270707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ec006b170 0x7f7ec0142570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:18.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.540+0000 7f7ec6600640 1 --2- 172.21.15.8:0/2653270707 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ec0152e00 0x7f7ec0151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:18.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.540+0000 7f7ec5200640 1 -- 172.21.15.8:0/2653270707 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ec0152e00 msgr2=0x7f7ec0151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:18.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.540+0000 7f7ec5200640 1 --2- 172.21.15.8:0/2653270707 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ec0152e00 0x7f7ec0151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:18.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.540+0000 7f7ec5200640 1 -- 172.21.15.8:0/2653270707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ec006b170 msgr2=0x7f7ec0142570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:18.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.540+0000 7f7ec5200640 1 --2- 172.21.15.8:0/2653270707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ec006b170 0x7f7ec0142570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:18.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.540+0000 7f7ec5200640 1 -- 172.21.15.8:0/2653270707 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec0142ab0 con 0x7f7ec006ec40 2024-03-23T23:43:18.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.540+0000 7f7ec5200640 1 --2- 172.21.15.8:0/2653270707 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ec006ec40 0x7f7ec01511b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7eac019080 tx=0x7f7eac01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:18.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.540+0000 7f7ebd600640 1 -- 172.21.15.8:0/2653270707 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac0b2040 con 0x7f7ec006ec40 2024-03-23T23:43:18.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.540+0000 7f7ebd600640 1 -- 172.21.15.8:0/2653270707 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eac0bd070 con 0x7f7ec006ec40 2024-03-23T23:43:18.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.540+0000 7f7ec7000640 1 -- 172.21.15.8:0/2653270707 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec0141780 con 0x7f7ec006ec40 2024-03-23T23:43:18.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.540+0000 7f7ebd600640 1 -- 172.21.15.8:0/2653270707 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac0b8450 con 0x7f7ec006ec40 2024-03-23T23:43:18.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.540+0000 7f7ec7000640 1 -- 172.21.15.8:0/2653270707 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec00c2f90 con 0x7f7ec006ec40 2024-03-23T23:43:18.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.540+0000 7f7ec7000640 1 -- 172.21.15.8:0/2653270707 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec01585d0 con 0x7f7ec006ec40 2024-03-23T23:43:18.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.540+0000 7f7ebd600640 1 -- 172.21.15.8:0/2653270707 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f7eac0b85f0 con 0x7f7ec006ec40 2024-03-23T23:43:18.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.544+0000 7f7ebd600640 1 --2- 172.21.15.8:0/2653270707 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7ea0067660 0x7f7ea0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:18.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.544+0000 7f7ebd600640 1 -- 172.21.15.8:0/2653270707 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f7eac11fdc0 con 0x7f7ec006ec40 2024-03-23T23:43:18.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.544+0000 7f7ec5c00640 1 --2- 172.21.15.8:0/2653270707 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7ea0067660 0x7f7ea0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:18.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.544+0000 7f7ec5c00640 1 --2- 172.21.15.8:0/2653270707 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7ea0067660 0x7f7ea0069b20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0144840 tx=0x7f7eb4007e90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:18.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.548+0000 7f7ebd600640 1 -- 172.21.15.8:0/2653270707 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f7eac016090 con 0x7f7ec006ec40 2024-03-23T23:43:18.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.712+0000 7f7ec7000640 1 -- 172.21.15.8:0/2653270707 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7f7ec006bee0 con 0x7f7ec006ec40 2024-03-23T23:43:18.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.712+0000 7f7ebd600640 1 -- 172.21.15.8:0/2653270707 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v25) v1 ==== 95+0+11 (secure 0 0 0) 0x7f7eac0f0150 con 0x7f7ec006ec40 2024-03-23T23:43:18.714 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-03-23T23:43:18.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.712+0000 7f7ec7000640 1 -- 172.21.15.8:0/2653270707 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7ea0067660 msgr2=0x7f7ea0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:18.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.712+0000 7f7ec7000640 1 --2- 172.21.15.8:0/2653270707 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7ea0067660 0x7f7ea0069b20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0144840 tx=0x7f7eb4007e90 comp rx=0 tx=0).stop 2024-03-23T23:43:18.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.712+0000 7f7ec7000640 1 -- 172.21.15.8:0/2653270707 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ec006ec40 msgr2=0x7f7ec01511b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:18.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.712+0000 7f7ec7000640 1 --2- 172.21.15.8:0/2653270707 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ec006ec40 0x7f7ec01511b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7eac019080 tx=0x7f7eac01acb0 comp rx=0 tx=0).stop 2024-03-23T23:43:18.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.712+0000 7f7ec7000640 1 -- 172.21.15.8:0/2653270707 shutdown_connections 2024-03-23T23:43:18.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.712+0000 7f7ec7000640 1 --2- 172.21.15.8:0/2653270707 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7ea0067660 0x7f7ea0069b20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:18.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.712+0000 7f7ec7000640 1 --2- 172.21.15.8:0/2653270707 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ec0152e00 0x7f7ec0151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:18.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.712+0000 7f7ec7000640 1 --2- 172.21.15.8:0/2653270707 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ec006ec40 0x7f7ec01511b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:18.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.712+0000 7f7ec7000640 1 --2- 172.21.15.8:0/2653270707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ec006b170 0x7f7ec0142570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:18.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.712+0000 7f7ec7000640 1 -- 172.21.15.8:0/2653270707 >> 172.21.15.8:0/2653270707 conn(0x7f7ec00c4990 msgr2=0x7f7ec0157e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:18.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.712+0000 7f7ec7000640 1 -- 172.21.15.8:0/2653270707 shutdown_connections 2024-03-23T23:43:18.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.712+0000 7f7ec7000640 1 -- 172.21.15.8:0/2653270707 wait complete. 2024-03-23T23:43:18.736 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-03-23T23:43:18.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.928+0000 7fde60600640 1 Processor -- start 2024-03-23T23:43:18.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.932+0000 7fde60600640 1 -- start start 2024-03-23T23:43:18.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.932+0000 7fde60600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fde58159860 0x7fde580714f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:18.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.932+0000 7fde60600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde580c2390 0x7fde580c2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:18.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.932+0000 7fde60600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde58159dd0 con 0x7fde58152ff0 2024-03-23T23:43:18.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.932+0000 7fde60600640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde580701f0 con 0x7fde58159860 2024-03-23T23:43:18.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.932+0000 7fde60600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde580704d0 con 0x7fde580c2390 2024-03-23T23:43:18.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.932+0000 7fde5d200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fde58159860 0x7fde580714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:18.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.932+0000 7fde5d200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fde58159860 0x7fde580714f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54758/0 (socket says 172.21.15.8:54758) 2024-03-23T23:43:18.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.932+0000 7fde5d200640 1 -- 172.21.15.8:0/543752317 learned_addr learned my addr 172.21.15.8:0/543752317 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:18.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.932+0000 7fde5e600640 1 --2- 172.21.15.8:0/543752317 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde580c2390 0x7fde580c2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:18.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.932+0000 7fde5dc00640 1 --1- 172.21.15.8:0/543752317 >> v1:172.21.15.196:6789/0 conn(0x7fde58152ff0 0x7fde5806ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:48880/0 (socket says 172.21.15.8:48880) 2024-03-23T23:43:18.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.932+0000 7fde5d200640 1 -- 172.21.15.8:0/543752317 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde580c2390 msgr2=0x7fde580c2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:18.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.932+0000 7fde5d200640 1 --2- 172.21.15.8:0/543752317 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde580c2390 0x7fde580c2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:18.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.932+0000 7fde5d200640 1 -- 172.21.15.8:0/543752317 >> v1:172.21.15.196:6789/0 conn(0x7fde58152ff0 legacy=0x7fde5806ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:18.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.932+0000 7fde57e00640 1 -- 172.21.15.8:0/543752317 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 160668 0 0) 0x7fde58159dd0 con 0x7fde58152ff0 2024-03-23T23:43:18.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.932+0000 7fde5d200640 1 -- 172.21.15.8:0/543752317 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde580707b0 con 0x7fde58159860 2024-03-23T23:43:18.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.936+0000 7fde5d200640 1 --2- 172.21.15.8:0/543752317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde58159860 0x7fde580714f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fde44009870 tx=0x7fde4401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca4a88009d39aa0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:18.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.936+0000 7fde57e00640 1 -- 172.21.15.8:0/543752317 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde440b0070 con 0x7fde58159860 2024-03-23T23:43:18.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.936+0000 7fde57e00640 1 -- 172.21.15.8:0/543752317 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde440ab600 con 0x7fde58159860 2024-03-23T23:43:18.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.936+0000 7fde57e00640 1 -- 172.21.15.8:0/543752317 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde440ab9d0 con 0x7fde58159860 2024-03-23T23:43:18.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.936+0000 7fde60600640 1 -- 172.21.15.8:0/543752317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde58159860 msgr2=0x7fde580714f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:18.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.936+0000 7fde60600640 1 --2- 172.21.15.8:0/543752317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde58159860 0x7fde580714f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fde44009870 tx=0x7fde4401c4d0 comp rx=0 tx=0).stop 2024-03-23T23:43:18.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.936+0000 7fde60600640 1 -- 172.21.15.8:0/543752317 shutdown_connections 2024-03-23T23:43:18.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.936+0000 7fde60600640 1 --2- 172.21.15.8:0/543752317 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde580c2390 0x7fde580c2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:18.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.936+0000 7fde60600640 1 --2- 172.21.15.8:0/543752317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde58159860 0x7fde580714f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:18.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.936+0000 7fde60600640 1 -- 172.21.15.8:0/543752317 >> 172.21.15.8:0/543752317 conn(0x7fde580aad10 msgr2=0x7fde580ab120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:18.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.936+0000 7fde60600640 1 -- 172.21.15.8:0/543752317 shutdown_connections 2024-03-23T23:43:18.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.936+0000 7fde60600640 1 -- 172.21.15.8:0/543752317 wait complete. 2024-03-23T23:43:18.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.936+0000 7fde60600640 1 Processor -- start 2024-03-23T23:43:18.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.936+0000 7fde60600640 1 -- start start 2024-03-23T23:43:18.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.940+0000 7fde60600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde580c2390 0x7fde58157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:18.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.940+0000 7fde60600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde58152ff0 0x7fde58147d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:18.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.940+0000 7fde60600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde58159860 0x7fde58148250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:18.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.940+0000 7fde60600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde580c75a0 con 0x7fde58152ff0 2024-03-23T23:43:18.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.940+0000 7fde60600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde580c7420 con 0x7fde58159860 2024-03-23T23:43:18.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.940+0000 7fde60600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde58162a00 con 0x7fde580c2390 2024-03-23T23:43:18.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.940+0000 7fde5d200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde58152ff0 0x7fde58147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:18.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.940+0000 7fde5d200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde58152ff0 0x7fde58147d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54764/0 (socket says 172.21.15.8:54764) 2024-03-23T23:43:18.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.940+0000 7fde5d200640 1 -- 172.21.15.8:0/4086777850 learned_addr learned my addr 172.21.15.8:0/4086777850 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:18.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.940+0000 7fde5e600640 1 --2- 172.21.15.8:0/4086777850 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde58159860 0x7fde58148250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:18.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.940+0000 7fde5dc00640 1 --2- 172.21.15.8:0/4086777850 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde580c2390 0x7fde58157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:18.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.940+0000 7fde5d200640 1 -- 172.21.15.8:0/4086777850 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde580c2390 msgr2=0x7fde58157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:18.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.940+0000 7fde5d200640 1 --2- 172.21.15.8:0/4086777850 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde580c2390 0x7fde58157ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:18.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.940+0000 7fde5d200640 1 -- 172.21.15.8:0/4086777850 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde58159860 msgr2=0x7fde58148250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:18.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.940+0000 7fde5d200640 1 --2- 172.21.15.8:0/4086777850 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde58159860 0x7fde58148250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:18.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.940+0000 7fde5d200640 1 -- 172.21.15.8:0/4086777850 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5806dbc0 con 0x7fde58152ff0 2024-03-23T23:43:18.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.940+0000 7fde5d200640 1 --2- 172.21.15.8:0/4086777850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde58152ff0 0x7fde58147d10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fde440ae040 tx=0x7fde44019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:18.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.940+0000 7fde55600640 1 -- 172.21.15.8:0/4086777850 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde440b0050 con 0x7fde58152ff0 2024-03-23T23:43:18.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.940+0000 7fde55600640 1 -- 172.21.15.8:0/4086777850 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde440bc070 con 0x7fde58152ff0 2024-03-23T23:43:18.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.940+0000 7fde60600640 1 -- 172.21.15.8:0/4086777850 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde5814fd90 con 0x7fde58152ff0 2024-03-23T23:43:18.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.940+0000 7fde55600640 1 -- 172.21.15.8:0/4086777850 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde440b5830 con 0x7fde58152ff0 2024-03-23T23:43:18.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.940+0000 7fde60600640 1 -- 172.21.15.8:0/4086777850 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde580ae7c0 con 0x7fde58152ff0 2024-03-23T23:43:18.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.940+0000 7fde60600640 1 -- 172.21.15.8:0/4086777850 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde5804f410 con 0x7fde58152ff0 2024-03-23T23:43:18.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.940+0000 7fde55600640 1 -- 172.21.15.8:0/4086777850 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fde440b59d0 con 0x7fde58152ff0 2024-03-23T23:43:18.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.944+0000 7fde55600640 1 --2- 172.21.15.8:0/4086777850 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fde38067660 0x7fde38069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:18.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.944+0000 7fde55600640 1 -- 172.21.15.8:0/4086777850 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fde441201f0 con 0x7fde58152ff0 2024-03-23T23:43:18.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.944+0000 7fde5dc00640 1 --2- 172.21.15.8:0/4086777850 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fde38067660 0x7fde38069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:18.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.944+0000 7fde5dc00640 1 --2- 172.21.15.8:0/4086777850 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fde38067660 0x7fde38069b20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fde4c007fd0 tx=0x7fde4c007d60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:18.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:18.948+0000 7fde55600640 1 -- 172.21.15.8:0/4086777850 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fde44016150 con 0x7fde58152ff0 2024-03-23T23:43:19.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.112+0000 7fde60600640 1 -- 172.21.15.8:0/4086777850 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) v1 -- 0x7fde580c8d40 con 0x7fde58152ff0 2024-03-23T23:43:19.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.112+0000 7fde55600640 1 -- 172.21.15.8:0/4086777850 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v25) v1 ==== 99+0+11 (secure 0 0 0) 0x7fde440f04e0 con 0x7fde58152ff0 2024-03-23T23:43:19.115 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-03-23T23:43:19.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.112+0000 7fde60600640 1 -- 172.21.15.8:0/4086777850 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fde38067660 msgr2=0x7fde38069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:19.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.112+0000 7fde60600640 1 --2- 172.21.15.8:0/4086777850 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fde38067660 0x7fde38069b20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fde4c007fd0 tx=0x7fde4c007d60 comp rx=0 tx=0).stop 2024-03-23T23:43:19.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.112+0000 7fde60600640 1 -- 172.21.15.8:0/4086777850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde58152ff0 msgr2=0x7fde58147d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:19.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.112+0000 7fde60600640 1 --2- 172.21.15.8:0/4086777850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde58152ff0 0x7fde58147d10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fde440ae040 tx=0x7fde44019270 comp rx=0 tx=0).stop 2024-03-23T23:43:19.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.112+0000 7fde60600640 1 -- 172.21.15.8:0/4086777850 shutdown_connections 2024-03-23T23:43:19.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.112+0000 7fde60600640 1 --2- 172.21.15.8:0/4086777850 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde58159860 0x7fde58148250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:19.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.112+0000 7fde60600640 1 --2- 172.21.15.8:0/4086777850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde58152ff0 0x7fde58147d10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:19.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.112+0000 7fde60600640 1 --2- 172.21.15.8:0/4086777850 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fde38067660 0x7fde38069b20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:19.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.112+0000 7fde60600640 1 --2- 172.21.15.8:0/4086777850 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde580c2390 0x7fde58157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:19.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.112+0000 7fde60600640 1 -- 172.21.15.8:0/4086777850 >> 172.21.15.8:0/4086777850 conn(0x7fde580aad10 msgr2=0x7fde58071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:19.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.112+0000 7fde60600640 1 -- 172.21.15.8:0/4086777850 shutdown_connections 2024-03-23T23:43:19.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.116+0000 7fde60600640 1 -- 172.21.15.8:0/4086777850 wait complete. 2024-03-23T23:43:19.136 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-03-23T23:43:19.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.276+0000 7fcd5ce00640 1 Processor -- start 2024-03-23T23:43:19.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.276+0000 7fcd5ce00640 1 -- start start 2024-03-23T23:43:19.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.280+0000 7fcd5ce00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fcd580714f0 0x7fcd581611f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:19.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.280+0000 7fcd5ce00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd58159dd0 con 0x7fcd58159860 2024-03-23T23:43:19.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.280+0000 7fcd5ce00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd580701f0 con 0x7fcd58152ff0 2024-03-23T23:43:19.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.280+0000 7fcd5ce00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd580704d0 con 0x7fcd580714f0 2024-03-23T23:43:19.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.280+0000 7fcd4fe00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fcd58159860 0x7fcd580c2390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48102/0 (socket says 172.21.15.8:48102) 2024-03-23T23:43:19.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.280+0000 7fcd4fe00640 1 -- 172.21.15.8:0/2127269312 learned_addr learned my addr 172.21.15.8:0/2127269312 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:43:19.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.280+0000 7fcd56800640 1 --2- 172.21.15.8:0/2127269312 >> v2:172.21.15.8:3300/0 conn(0x7fcd580714f0 0x7fcd581611f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:19.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.280+0000 7fcd56800640 1 -- 172.21.15.8:0/2127269312 >> v1:172.21.15.196:6789/0 conn(0x7fcd58152ff0 legacy=0x7fcd5806ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:19.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.280+0000 7fcd56800640 1 -- 172.21.15.8:0/2127269312 >> v1:172.21.15.8:6789/0 conn(0x7fcd58159860 legacy=0x7fcd580c2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:19.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.280+0000 7fcd55400640 1 -- 172.21.15.8:0/2127269312 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2945143066 0 0) 0x7fcd580701f0 con 0x7fcd58152ff0 2024-03-23T23:43:19.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.280+0000 7fcd56800640 1 -- 172.21.15.8:0/2127269312 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd580707b0 con 0x7fcd580714f0 2024-03-23T23:43:19.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.284+0000 7fcd56800640 1 --2- 172.21.15.8:0/2127269312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd580714f0 0x7fcd581611f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcd50009d90 tx=0x7fcd5001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4190a843fa7734 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:19.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.284+0000 7fcd55400640 1 -- 172.21.15.8:0/2127269312 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd500a66a0 con 0x7fcd580714f0 2024-03-23T23:43:19.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.284+0000 7fcd55400640 1 -- 172.21.15.8:0/2127269312 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd500a6840 con 0x7fcd580714f0 2024-03-23T23:43:19.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.284+0000 7fcd55400640 1 -- 172.21.15.8:0/2127269312 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd500a6c10 con 0x7fcd580714f0 2024-03-23T23:43:19.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.284+0000 7fcd5ce00640 1 -- 172.21.15.8:0/2127269312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd580714f0 msgr2=0x7fcd581611f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:19.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.284+0000 7fcd5ce00640 1 --2- 172.21.15.8:0/2127269312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd580714f0 0x7fcd581611f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcd50009d90 tx=0x7fcd5001c8e0 comp rx=0 tx=0).stop 2024-03-23T23:43:19.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.284+0000 7fcd5ce00640 1 -- 172.21.15.8:0/2127269312 shutdown_connections 2024-03-23T23:43:19.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.284+0000 7fcd5ce00640 1 --2- 172.21.15.8:0/2127269312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd580714f0 0x7fcd581611f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:19.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.284+0000 7fcd5ce00640 1 -- 172.21.15.8:0/2127269312 >> 172.21.15.8:0/2127269312 conn(0x7fcd580aad10 msgr2=0x7fcd580ab120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:19.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.284+0000 7fcd5ce00640 1 -- 172.21.15.8:0/2127269312 shutdown_connections 2024-03-23T23:43:19.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.284+0000 7fcd5ce00640 1 -- 172.21.15.8:0/2127269312 wait complete. 2024-03-23T23:43:19.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.284+0000 7fcd5ce00640 1 Processor -- start 2024-03-23T23:43:19.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.284+0000 7fcd5ce00640 1 -- start start 2024-03-23T23:43:19.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.284+0000 7fcd5ce00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcd580714f0 0x7fcd58158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:19.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.284+0000 7fcd5ce00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd58152ff0 0x7fcd5814c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:19.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.284+0000 7fcd5ce00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcd58159860 0x7fcd5814c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:19.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.284+0000 7fcd5ce00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd580c2c20 con 0x7fcd58152ff0 2024-03-23T23:43:19.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.284+0000 7fcd5ce00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd580c2aa0 con 0x7fcd58159860 2024-03-23T23:43:19.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.284+0000 7fcd5ce00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd580c7420 con 0x7fcd580714f0 2024-03-23T23:43:19.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.288+0000 7fcd4fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd58152ff0 0x7fcd5814c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:19.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.288+0000 7fcd4fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd58152ff0 0x7fcd5814c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54772/0 (socket says 172.21.15.8:54772) 2024-03-23T23:43:19.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.288+0000 7fcd55e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcd580714f0 0x7fcd58158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:19.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.288+0000 7fcd4fe00640 1 -- 172.21.15.8:0/763934525 learned_addr learned my addr 172.21.15.8:0/763934525 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:19.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.288+0000 7fcd56800640 1 --2- 172.21.15.8:0/763934525 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcd58159860 0x7fcd5814c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:19.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.288+0000 7fcd4fe00640 1 -- 172.21.15.8:0/763934525 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcd580714f0 msgr2=0x7fcd58158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:19.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.288+0000 7fcd4fe00640 1 --2- 172.21.15.8:0/763934525 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcd580714f0 0x7fcd58158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:19.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.288+0000 7fcd4fe00640 1 -- 172.21.15.8:0/763934525 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcd58159860 msgr2=0x7fcd5814c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:19.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.288+0000 7fcd4fe00640 1 --2- 172.21.15.8:0/763934525 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcd58159860 0x7fcd5814c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:19.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.288+0000 7fcd4fe00640 1 -- 172.21.15.8:0/763934525 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd58154740 con 0x7fcd58152ff0 2024-03-23T23:43:19.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.288+0000 7fcd4fe00640 1 --2- 172.21.15.8:0/763934525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd58152ff0 0x7fcd5814c300 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000c420 tx=0x7fcd4000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:19.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.288+0000 7fcd4e000640 1 -- 172.21.15.8:0/763934525 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd40017070 con 0x7fcd58152ff0 2024-03-23T23:43:19.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.288+0000 7fcd4e000640 1 -- 172.21.15.8:0/763934525 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd40005cf0 con 0x7fcd58152ff0 2024-03-23T23:43:19.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.288+0000 7fcd5ce00640 1 -- 172.21.15.8:0/763934525 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd58154a80 con 0x7fcd58152ff0 2024-03-23T23:43:19.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.288+0000 7fcd4e000640 1 -- 172.21.15.8:0/763934525 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd400072f0 con 0x7fcd58152ff0 2024-03-23T23:43:19.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.288+0000 7fcd5ce00640 1 -- 172.21.15.8:0/763934525 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd581552c0 con 0x7fcd58152ff0 2024-03-23T23:43:19.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.288+0000 7fcd5ce00640 1 -- 172.21.15.8:0/763934525 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd5804f410 con 0x7fcd58152ff0 2024-03-23T23:43:19.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.288+0000 7fcd4e000640 1 -- 172.21.15.8:0/763934525 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fcd4001a070 con 0x7fcd58152ff0 2024-03-23T23:43:19.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.292+0000 7fcd4e000640 1 --2- 172.21.15.8:0/763934525 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcd34067660 0x7fcd34069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:19.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.292+0000 7fcd4e000640 1 -- 172.21.15.8:0/763934525 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fcd40084eb0 con 0x7fcd58152ff0 2024-03-23T23:43:19.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.292+0000 7fcd55e00640 1 --2- 172.21.15.8:0/763934525 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcd34067660 0x7fcd34069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:19.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.292+0000 7fcd55e00640 1 --2- 172.21.15.8:0/763934525 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcd34067660 0x7fcd34069b20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcd580af290 tx=0x7fcd48009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:19.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.296+0000 7fcd4e000640 1 -- 172.21.15.8:0/763934525 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fcd58154a80 con 0x7fcd58152ff0 2024-03-23T23:43:19.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.460+0000 7fcd5ce00640 1 -- 172.21.15.8:0/763934525 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) v1 -- 0x7fcd58070980 con 0x7fcd58152ff0 2024-03-23T23:43:19.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.460+0000 7fcd4e000640 1 -- 172.21.15.8:0/763934525 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v25) v1 ==== 95+0+11 (secure 0 0 0) 0x7fcd40055240 con 0x7fcd58152ff0 2024-03-23T23:43:19.463 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-03-23T23:43:19.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.460+0000 7fcd5ce00640 1 -- 172.21.15.8:0/763934525 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcd34067660 msgr2=0x7fcd34069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:19.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.460+0000 7fcd5ce00640 1 --2- 172.21.15.8:0/763934525 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcd34067660 0x7fcd34069b20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcd580af290 tx=0x7fcd48009040 comp rx=0 tx=0).stop 2024-03-23T23:43:19.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.460+0000 7fcd5ce00640 1 -- 172.21.15.8:0/763934525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd58152ff0 msgr2=0x7fcd5814c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:19.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.460+0000 7fcd5ce00640 1 --2- 172.21.15.8:0/763934525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd58152ff0 0x7fcd5814c300 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000c420 tx=0x7fcd4000c8e0 comp rx=0 tx=0).stop 2024-03-23T23:43:19.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.464+0000 7fcd5ce00640 1 -- 172.21.15.8:0/763934525 shutdown_connections 2024-03-23T23:43:19.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.464+0000 7fcd5ce00640 1 --2- 172.21.15.8:0/763934525 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcd58159860 0x7fcd5814c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:19.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.464+0000 7fcd5ce00640 1 --2- 172.21.15.8:0/763934525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd58152ff0 0x7fcd5814c300 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:19.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.464+0000 7fcd5ce00640 1 --2- 172.21.15.8:0/763934525 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcd34067660 0x7fcd34069b20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:19.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.464+0000 7fcd5ce00640 1 --2- 172.21.15.8:0/763934525 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcd580714f0 0x7fcd58158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:19.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.464+0000 7fcd5ce00640 1 -- 172.21.15.8:0/763934525 >> 172.21.15.8:0/763934525 conn(0x7fcd580aad10 msgr2=0x7fcd5806cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:19.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.464+0000 7fcd5ce00640 1 -- 172.21.15.8:0/763934525 shutdown_connections 2024-03-23T23:43:19.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.464+0000 7fcd5ce00640 1 -- 172.21.15.8:0/763934525 wait complete. 2024-03-23T23:43:19.485 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2024-03-23T23:43:19.485 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T23:43:19.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.624+0000 7f7043600640 1 Processor -- start 2024-03-23T23:43:19.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.624+0000 7f7043600640 1 -- start start 2024-03-23T23:43:19.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.624+0000 7f7043600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f703c1530f0 0x7f703c0720a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:19.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.624+0000 7f7043600640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f703c0aa1f0 con 0x7f703c072d80 2024-03-23T23:43:19.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.624+0000 7f7043600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f703c0734b0 con 0x7f703c0725e0 2024-03-23T23:43:19.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.624+0000 7f7043600640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f703c073260 con 0x7f703c1530f0 2024-03-23T23:43:19.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.624+0000 7f7040c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f703c1530f0 0x7f703c0720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:19.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.624+0000 7f7040c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f703c1530f0 0x7f703c0720a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54774/0 (socket says 172.21.15.8:54774) 2024-03-23T23:43:19.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.624+0000 7f7040c00640 1 -- 172.21.15.8:0/781620358 learned_addr learned my addr 172.21.15.8:0/781620358 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:19.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.624+0000 7f7040c00640 1 -- 172.21.15.8:0/781620358 >> v1:172.21.15.196:6789/0 conn(0x7f703c0725e0 legacy=0x7f703c1560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:19.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.624+0000 7f7040c00640 1 -- 172.21.15.8:0/781620358 >> v1:172.21.15.8:6789/0 conn(0x7f703c072d80 legacy=0x7f703c155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:19.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.624+0000 7f7040c00640 1 -- 172.21.15.8:0/781620358 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703c06bcb0 con 0x7f703c1530f0 2024-03-23T23:43:19.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.628+0000 7f7040c00640 1 --2- 172.21.15.8:0/781620358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f703c1530f0 0x7f703c0720a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f702c009870 tx=0x7f702c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=178c55249e22a3db server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:19.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.628+0000 7f703be00640 1 -- 172.21.15.8:0/781620358 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c0b0070 con 0x7f703c1530f0 2024-03-23T23:43:19.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.628+0000 7f703be00640 1 -- 172.21.15.8:0/781620358 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702c0ab600 con 0x7f703c1530f0 2024-03-23T23:43:19.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.628+0000 7f703be00640 1 -- 172.21.15.8:0/781620358 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c0ab9d0 con 0x7f703c1530f0 2024-03-23T23:43:19.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.628+0000 7f7043600640 1 -- 172.21.15.8:0/781620358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f703c1530f0 msgr2=0x7f703c0720a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:19.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.628+0000 7f7043600640 1 --2- 172.21.15.8:0/781620358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f703c1530f0 0x7f703c0720a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f702c009870 tx=0x7f702c01c4d0 comp rx=0 tx=0).stop 2024-03-23T23:43:19.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.628+0000 7f7043600640 1 -- 172.21.15.8:0/781620358 shutdown_connections 2024-03-23T23:43:19.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.628+0000 7f7043600640 1 --2- 172.21.15.8:0/781620358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f703c1530f0 0x7f703c0720a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:19.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.628+0000 7f7043600640 1 -- 172.21.15.8:0/781620358 >> 172.21.15.8:0/781620358 conn(0x7f703c0c4d80 msgr2=0x7f703c0c5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:19.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.628+0000 7f7043600640 1 -- 172.21.15.8:0/781620358 shutdown_connections 2024-03-23T23:43:19.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.628+0000 7f7043600640 1 -- 172.21.15.8:0/781620358 wait complete. 2024-03-23T23:43:19.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.632+0000 7f7043600640 1 Processor -- start 2024-03-23T23:43:19.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.632+0000 7f7043600640 1 -- start start 2024-03-23T23:43:19.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.632+0000 7f7043600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f703c0725e0 0x7f703c148b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:19.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.632+0000 7f7043600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f703c072d80 0x7f703c0c7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:19.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.632+0000 7f7043600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f703c1530f0 0x7f703c147de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:19.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.632+0000 7f7043600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c1534d0 con 0x7f703c0725e0 2024-03-23T23:43:19.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.632+0000 7f7043600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c0c16b0 con 0x7f703c1530f0 2024-03-23T23:43:19.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.632+0000 7f7043600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f703c153650 con 0x7f703c072d80 2024-03-23T23:43:19.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.632+0000 7f7040c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f703c0725e0 0x7f703c148b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:19.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.632+0000 7f7040c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f703c0725e0 0x7f703c148b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54788/0 (socket says 172.21.15.8:54788) 2024-03-23T23:43:19.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.632+0000 7f7040c00640 1 -- 172.21.15.8:0/1471416917 learned_addr learned my addr 172.21.15.8:0/1471416917 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:19.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.632+0000 7f7041600640 1 --2- 172.21.15.8:0/1471416917 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f703c1530f0 0x7f703c147de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:19.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.632+0000 7f7033e00640 1 --2- 172.21.15.8:0/1471416917 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f703c072d80 0x7f703c0c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:19.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.632+0000 7f7040c00640 1 -- 172.21.15.8:0/1471416917 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f703c072d80 msgr2=0x7f703c0c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:19.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.632+0000 7f7040c00640 1 --2- 172.21.15.8:0/1471416917 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f703c072d80 0x7f703c0c7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:19.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.632+0000 7f7040c00640 1 -- 172.21.15.8:0/1471416917 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f703c1530f0 msgr2=0x7f703c147de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:19.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.632+0000 7f7040c00640 1 --2- 172.21.15.8:0/1471416917 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f703c1530f0 0x7f703c147de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:19.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.632+0000 7f7040c00640 1 -- 172.21.15.8:0/1471416917 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703c0c7ea0 con 0x7f703c0725e0 2024-03-23T23:43:19.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.632+0000 7f7033e00640 1 --2- 172.21.15.8:0/1471416917 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f703c072d80 0x7f703c0c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:43:19.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.632+0000 7f7040c00640 1 --2- 172.21.15.8:0/1471416917 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f703c0725e0 0x7f703c148b10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f702c0ae040 tx=0x7f702c019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:19.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.632+0000 7f7039600640 1 -- 172.21.15.8:0/1471416917 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c0bb070 con 0x7f703c0725e0 2024-03-23T23:43:19.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.632+0000 7f7039600640 1 -- 172.21.15.8:0/1471416917 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702c0b6630 con 0x7f703c0725e0 2024-03-23T23:43:19.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.632+0000 7f7039600640 1 -- 172.21.15.8:0/1471416917 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c0b0040 con 0x7f703c0725e0 2024-03-23T23:43:19.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.632+0000 7f7043600640 1 -- 172.21.15.8:0/1471416917 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f703c149050 con 0x7f703c0725e0 2024-03-23T23:43:19.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.632+0000 7f7043600640 1 -- 172.21.15.8:0/1471416917 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f703c1512c0 con 0x7f703c0725e0 2024-03-23T23:43:19.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.636+0000 7f7043600640 1 -- 172.21.15.8:0/1471416917 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f703c068270 con 0x7f703c0725e0 2024-03-23T23:43:19.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.636+0000 7f7039600640 1 -- 172.21.15.8:0/1471416917 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f702c0ab4c0 con 0x7f703c0725e0 2024-03-23T23:43:19.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.636+0000 7f7039600640 1 --2- 172.21.15.8:0/1471416917 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7018067660 0x7f7018069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:19.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.636+0000 7f7039600640 1 -- 172.21.15.8:0/1471416917 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f702c11f3e0 con 0x7f703c0725e0 2024-03-23T23:43:19.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.636+0000 7f7033e00640 1 --2- 172.21.15.8:0/1471416917 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7018067660 0x7f7018069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:19.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.636+0000 7f7033e00640 1 --2- 172.21.15.8:0/1471416917 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7018067660 0x7f7018069b20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f703c1f2c40 tx=0x7f7024009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:19.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.640+0000 7f7039600640 1 -- 172.21.15.8:0/1471416917 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f702c016150 con 0x7f703c0725e0 2024-03-23T23:43:19.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.804+0000 7f7043600640 1 -- 172.21.15.8:0/1471416917 --> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f703c14c680 con 0x7f7018067660 2024-03-23T23:43:19.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.816+0000 7f7039600640 1 -- 172.21.15.8:0/1471416917 <== mgr.4098 v2:172.21.15.196:6832/1295060067 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+490301 (secure 0 0 0) 0x7f703c14c680 con 0x7f7018067660 2024-03-23T23:43:19.825 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:43:19.829 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-03-23T23:43:19.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.824+0000 7f7043600640 1 -- 172.21.15.8:0/1471416917 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7018067660 msgr2=0x7f7018069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:19.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.824+0000 7f7043600640 1 --2- 172.21.15.8:0/1471416917 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7018067660 0x7f7018069b20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f703c1f2c40 tx=0x7f7024009040 comp rx=0 tx=0).stop 2024-03-23T23:43:19.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.824+0000 7f7043600640 1 -- 172.21.15.8:0/1471416917 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f703c0725e0 msgr2=0x7f703c148b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:19.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.824+0000 7f7043600640 1 --2- 172.21.15.8:0/1471416917 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f703c0725e0 0x7f703c148b10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f702c0ae040 tx=0x7f702c019270 comp rx=0 tx=0).stop 2024-03-23T23:43:19.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.824+0000 7f7043600640 1 -- 172.21.15.8:0/1471416917 shutdown_connections 2024-03-23T23:43:19.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.824+0000 7f7043600640 1 --2- 172.21.15.8:0/1471416917 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f703c1530f0 0x7f703c147de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:19.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.824+0000 7f7043600640 1 --2- 172.21.15.8:0/1471416917 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7018067660 0x7f7018069b20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:19.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.824+0000 7f7043600640 1 --2- 172.21.15.8:0/1471416917 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f703c072d80 0x7f703c0c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:19.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.824+0000 7f7043600640 1 --2- 172.21.15.8:0/1471416917 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f703c0725e0 0x7f703c148b10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:19.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.824+0000 7f7043600640 1 -- 172.21.15.8:0/1471416917 >> 172.21.15.8:0/1471416917 conn(0x7f703c0c4d80 msgr2=0x7f703c06b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:19.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.824+0000 7f7043600640 1 -- 172.21.15.8:0/1471416917 shutdown_connections 2024-03-23T23:43:19.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:19.824+0000 7f7043600640 1 -- 172.21.15.8:0/1471416917 wait complete. 2024-03-23T23:43:19.846 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-03-23T23:43:18.280471+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595696,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":253,"num_write_kb":2448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240272,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734448,"statfs":{"total":773094113280,"available":772848074752,"internally_reserved":0,"allocated":3383296,"data_stored":2000914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":508,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002583"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750876+0000","last_change":"2024-03-23T23:42:50.736219+0000","last_active":"2024-03-23T23:42:51.750876+0000","last_peered":"2024-03-23T23:42:51.750876+0000","last_clean":"2024-03-23T23:42:51.750876+0000","last_became_active":"2024-03-23T23:42:50.735940+0000","last_became_peered":"2024-03-23T23:42:50.735940+0000","last_unstale":"2024-03-23T23:42:51.750876+0000","last_undegraded":"2024-03-23T23:42:51.750876+0000","last_fullsized":"2024-03-23T23:42:51.750876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:11:44.111477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763488+0000","last_change":"2024-03-23T23:42:39.693858+0000","last_active":"2024-03-23T23:42:51.763488+0000","last_peered":"2024-03-23T23:42:51.763488+0000","last_clean":"2024-03-23T23:42:51.763488+0000","last_became_active":"2024-03-23T23:42:39.693636+0000","last_became_peered":"2024-03-23T23:42:39.693636+0000","last_unstale":"2024-03-23T23:42:51.763488+0000","last_undegraded":"2024-03-23T23:42:51.763488+0000","last_fullsized":"2024-03-23T23:42:51.763488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:44:07.213123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328567+0000","last_change":"2024-03-23T23:42:40.685708+0000","last_active":"2024-03-23T23:42:52.328567+0000","last_peered":"2024-03-23T23:42:52.328567+0000","last_clean":"2024-03-23T23:42:52.328567+0000","last_became_active":"2024-03-23T23:42:40.682755+0000","last_became_peered":"2024-03-23T23:42:40.682755+0000","last_unstale":"2024-03-23T23:42:52.328567+0000","last_undegraded":"2024-03-23T23:42:52.328567+0000","last_fullsized":"2024-03-23T23:42:52.328567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:04.633288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327590+0000","last_change":"2024-03-23T23:42:49.750108+0000","last_active":"2024-03-23T23:42:52.327590+0000","last_peered":"2024-03-23T23:42:52.327590+0000","last_clean":"2024-03-23T23:42:52.327590+0000","last_became_active":"2024-03-23T23:42:49.749634+0000","last_became_peered":"2024-03-23T23:42:49.749634+0000","last_unstale":"2024-03-23T23:42:52.327590+0000","last_undegraded":"2024-03-23T23:42:52.327590+0000","last_fullsized":"2024-03-23T23:42:52.327590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:49:16.758908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766376+0000","last_change":"2024-03-23T23:42:50.752450+0000","last_active":"2024-03-23T23:42:51.766376+0000","last_peered":"2024-03-23T23:42:51.766376+0000","last_clean":"2024-03-23T23:42:51.766376+0000","last_became_active":"2024-03-23T23:42:50.752078+0000","last_became_peered":"2024-03-23T23:42:50.752078+0000","last_unstale":"2024-03-23T23:42:51.766376+0000","last_undegraded":"2024-03-23T23:42:51.766376+0000","last_fullsized":"2024-03-23T23:42:51.766376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:28:43.677331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328677+0000","last_change":"2024-03-23T23:42:39.687108+0000","last_active":"2024-03-23T23:42:52.328677+0000","last_peered":"2024-03-23T23:42:52.328677+0000","last_clean":"2024-03-23T23:42:52.328677+0000","last_became_active":"2024-03-23T23:42:39.686875+0000","last_became_peered":"2024-03-23T23:42:39.686875+0000","last_unstale":"2024-03-23T23:42:52.328677+0000","last_undegraded":"2024-03-23T23:42:52.328677+0000","last_fullsized":"2024-03-23T23:42:52.328677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:05:52.079172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763410+0000","last_change":"2024-03-23T23:42:40.698746+0000","last_active":"2024-03-23T23:42:51.763410+0000","last_peered":"2024-03-23T23:42:51.763410+0000","last_clean":"2024-03-23T23:42:51.763410+0000","last_became_active":"2024-03-23T23:42:40.698003+0000","last_became_peered":"2024-03-23T23:42:40.698003+0000","last_unstale":"2024-03-23T23:42:51.763410+0000","last_undegraded":"2024-03-23T23:42:51.763410+0000","last_fullsized":"2024-03-23T23:42:51.763410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:53:46.437114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751376+0000","last_change":"2024-03-23T23:42:49.728923+0000","last_active":"2024-03-23T23:42:51.751376+0000","last_peered":"2024-03-23T23:42:51.751376+0000","last_clean":"2024-03-23T23:42:51.751376+0000","last_became_active":"2024-03-23T23:42:49.728261+0000","last_became_peered":"2024-03-23T23:42:49.728261+0000","last_unstale":"2024-03-23T23:42:51.751376+0000","last_undegraded":"2024-03-23T23:42:51.751376+0000","last_fullsized":"2024-03-23T23:42:51.751376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:22.375891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189476+0000","last_change":"2024-03-23T23:42:50.755852+0000","last_active":"2024-03-23T23:42:52.189476+0000","last_peered":"2024-03-23T23:42:52.189476+0000","last_clean":"2024-03-23T23:42:52.189476+0000","last_became_active":"2024-03-23T23:42:50.755600+0000","last_became_peered":"2024-03-23T23:42:50.755600+0000","last_unstale":"2024-03-23T23:42:52.189476+0000","last_undegraded":"2024-03-23T23:42:52.189476+0000","last_fullsized":"2024-03-23T23:42:52.189476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:29:47.303374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190128+0000","last_change":"2024-03-23T23:42:39.696690+0000","last_active":"2024-03-23T23:42:52.190128+0000","last_peered":"2024-03-23T23:42:52.190128+0000","last_clean":"2024-03-23T23:42:52.190128+0000","last_became_active":"2024-03-23T23:42:39.696342+0000","last_became_peered":"2024-03-23T23:42:39.696342+0000","last_unstale":"2024-03-23T23:42:52.190128+0000","last_undegraded":"2024-03-23T23:42:52.190128+0000","last_fullsized":"2024-03-23T23:42:52.190128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:42:37.702720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328460+0000","last_change":"2024-03-23T23:42:40.700355+0000","last_active":"2024-03-23T23:42:52.328460+0000","last_peered":"2024-03-23T23:42:52.328460+0000","last_clean":"2024-03-23T23:42:52.328460+0000","last_became_active":"2024-03-23T23:42:40.697668+0000","last_became_peered":"2024-03-23T23:42:40.697668+0000","last_unstale":"2024-03-23T23:42:52.328460+0000","last_undegraded":"2024-03-23T23:42:52.328460+0000","last_fullsized":"2024-03-23T23:42:52.328460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:23:43.515519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751380+0000","last_change":"2024-03-23T23:42:49.744792+0000","last_active":"2024-03-23T23:42:51.751380+0000","last_peered":"2024-03-23T23:42:51.751380+0000","last_clean":"2024-03-23T23:42:51.751380+0000","last_became_active":"2024-03-23T23:42:49.744561+0000","last_became_peered":"2024-03-23T23:42:49.744561+0000","last_unstale":"2024-03-23T23:42:51.751380+0000","last_undegraded":"2024-03-23T23:42:51.751380+0000","last_fullsized":"2024-03-23T23:42:51.751380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:07:58.222020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328699+0000","last_change":"2024-03-23T23:42:50.755575+0000","last_active":"2024-03-23T23:42:52.328699+0000","last_peered":"2024-03-23T23:42:52.328699+0000","last_clean":"2024-03-23T23:42:52.328699+0000","last_became_active":"2024-03-23T23:42:50.755337+0000","last_became_peered":"2024-03-23T23:42:50.755337+0000","last_unstale":"2024-03-23T23:42:52.328699+0000","last_undegraded":"2024-03-23T23:42:52.328699+0000","last_fullsized":"2024-03-23T23:42:52.328699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:13.911327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189958+0000","last_change":"2024-03-23T23:42:39.696707+0000","last_active":"2024-03-23T23:42:52.189958+0000","last_peered":"2024-03-23T23:42:52.189958+0000","last_clean":"2024-03-23T23:42:52.189958+0000","last_became_active":"2024-03-23T23:42:39.696401+0000","last_became_peered":"2024-03-23T23:42:39.696401+0000","last_unstale":"2024-03-23T23:42:52.189958+0000","last_undegraded":"2024-03-23T23:42:52.189958+0000","last_fullsized":"2024-03-23T23:42:52.189958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:55.757707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328921+0000","last_change":"2024-03-23T23:42:40.700389+0000","last_active":"2024-03-23T23:42:52.328921+0000","last_peered":"2024-03-23T23:42:52.328921+0000","last_clean":"2024-03-23T23:42:52.328921+0000","last_became_active":"2024-03-23T23:42:40.699770+0000","last_became_peered":"2024-03-23T23:42:40.699770+0000","last_unstale":"2024-03-23T23:42:52.328921+0000","last_undegraded":"2024-03-23T23:42:52.328921+0000","last_fullsized":"2024-03-23T23:42:52.328921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:27.675824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751083+0000","last_change":"2024-03-23T23:42:49.745710+0000","last_active":"2024-03-23T23:42:51.751083+0000","last_peered":"2024-03-23T23:42:51.751083+0000","last_clean":"2024-03-23T23:42:51.751083+0000","last_became_active":"2024-03-23T23:42:49.745526+0000","last_became_peered":"2024-03-23T23:42:49.745526+0000","last_unstale":"2024-03-23T23:42:51.751083+0000","last_undegraded":"2024-03-23T23:42:51.751083+0000","last_fullsized":"2024-03-23T23:42:51.751083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:05:26.746849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766631+0000","last_change":"2024-03-23T23:42:50.747274+0000","last_active":"2024-03-23T23:42:51.766631+0000","last_peered":"2024-03-23T23:42:51.766631+0000","last_clean":"2024-03-23T23:42:51.766631+0000","last_became_active":"2024-03-23T23:42:50.746937+0000","last_became_peered":"2024-03-23T23:42:50.746937+0000","last_unstale":"2024-03-23T23:42:51.766631+0000","last_undegraded":"2024-03-23T23:42:51.766631+0000","last_fullsized":"2024-03-23T23:42:51.766631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:19.610436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751450+0000","last_change":"2024-03-23T23:42:40.682467+0000","last_active":"2024-03-23T23:42:51.751450+0000","last_peered":"2024-03-23T23:42:51.751450+0000","last_clean":"2024-03-23T23:42:51.751450+0000","last_became_active":"2024-03-23T23:42:40.682192+0000","last_became_peered":"2024-03-23T23:42:40.682192+0000","last_unstale":"2024-03-23T23:42:51.751450+0000","last_undegraded":"2024-03-23T23:42:51.751450+0000","last_fullsized":"2024-03-23T23:42:51.751450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:37:24.839568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189778+0000","last_change":"2024-03-23T23:42:39.696528+0000","last_active":"2024-03-23T23:42:52.189778+0000","last_peered":"2024-03-23T23:42:52.189778+0000","last_clean":"2024-03-23T23:42:52.189778+0000","last_became_active":"2024-03-23T23:42:39.696207+0000","last_became_peered":"2024-03-23T23:42:39.696207+0000","last_unstale":"2024-03-23T23:42:52.189778+0000","last_undegraded":"2024-03-23T23:42:52.189778+0000","last_fullsized":"2024-03-23T23:42:52.189778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:02.190910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751687+0000","last_change":"2024-03-23T23:42:49.734156+0000","last_active":"2024-03-23T23:42:51.751687+0000","last_peered":"2024-03-23T23:42:51.751687+0000","last_clean":"2024-03-23T23:42:51.751687+0000","last_became_active":"2024-03-23T23:42:49.733888+0000","last_became_peered":"2024-03-23T23:42:49.733888+0000","last_unstale":"2024-03-23T23:42:51.751687+0000","last_undegraded":"2024-03-23T23:42:51.751687+0000","last_fullsized":"2024-03-23T23:42:51.751687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:23:52.568123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749858+0000","last_change":"2024-03-23T23:42:50.759749+0000","last_active":"2024-03-23T23:42:51.749858+0000","last_peered":"2024-03-23T23:42:51.749858+0000","last_clean":"2024-03-23T23:42:51.749858+0000","last_became_active":"2024-03-23T23:42:50.758670+0000","last_became_peered":"2024-03-23T23:42:50.758670+0000","last_unstale":"2024-03-23T23:42:51.749858+0000","last_undegraded":"2024-03-23T23:42:51.749858+0000","last_fullsized":"2024-03-23T23:42:51.749858+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:16:02.318732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327985+0000","last_change":"2024-03-23T23:42:40.674574+0000","last_active":"2024-03-23T23:42:52.327985+0000","last_peered":"2024-03-23T23:42:52.327985+0000","last_clean":"2024-03-23T23:42:52.327985+0000","last_became_active":"2024-03-23T23:42:40.674293+0000","last_became_peered":"2024-03-23T23:42:40.674293+0000","last_unstale":"2024-03-23T23:42:52.327985+0000","last_undegraded":"2024-03-23T23:42:52.327985+0000","last_fullsized":"2024-03-23T23:42:52.327985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:37:24.839568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767035+0000","last_change":"2024-03-23T23:42:39.683165+0000","last_active":"2024-03-23T23:42:51.767035+0000","last_peered":"2024-03-23T23:42:51.767035+0000","last_clean":"2024-03-23T23:42:51.767035+0000","last_became_active":"2024-03-23T23:42:39.680121+0000","last_became_peered":"2024-03-23T23:42:39.680121+0000","last_unstale":"2024-03-23T23:42:51.767035+0000","last_undegraded":"2024-03-23T23:42:51.767035+0000","last_fullsized":"2024-03-23T23:42:51.767035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:02.190910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752029+0000","last_change":"2024-03-23T23:42:49.745016+0000","last_active":"2024-03-23T23:42:51.752029+0000","last_peered":"2024-03-23T23:42:51.752029+0000","last_clean":"2024-03-23T23:42:51.752029+0000","last_became_active":"2024-03-23T23:42:49.744742+0000","last_became_peered":"2024-03-23T23:42:49.744742+0000","last_unstale":"2024-03-23T23:42:51.752029+0000","last_undegraded":"2024-03-23T23:42:51.752029+0000","last_fullsized":"2024-03-23T23:42:51.752029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:30.033743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751217+0000","last_change":"2024-03-23T23:42:50.749792+0000","last_active":"2024-03-23T23:42:51.751217+0000","last_peered":"2024-03-23T23:42:51.751217+0000","last_clean":"2024-03-23T23:42:51.751217+0000","last_became_active":"2024-03-23T23:42:50.749491+0000","last_became_peered":"2024-03-23T23:42:50.749491+0000","last_unstale":"2024-03-23T23:42:51.751217+0000","last_undegraded":"2024-03-23T23:42:51.751217+0000","last_fullsized":"2024-03-23T23:42:51.751217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:25:44.894505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327680+0000","last_change":"2024-03-23T23:42:40.682999+0000","last_active":"2024-03-23T23:42:52.327680+0000","last_peered":"2024-03-23T23:42:52.327680+0000","last_clean":"2024-03-23T23:42:52.327680+0000","last_became_active":"2024-03-23T23:42:40.682672+0000","last_became_peered":"2024-03-23T23:42:40.682672+0000","last_unstale":"2024-03-23T23:42:52.327680+0000","last_undegraded":"2024-03-23T23:42:52.327680+0000","last_fullsized":"2024-03-23T23:42:52.327680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:59:45.154553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767148+0000","last_change":"2024-03-23T23:42:39.691470+0000","last_active":"2024-03-23T23:42:51.767148+0000","last_peered":"2024-03-23T23:42:51.767148+0000","last_clean":"2024-03-23T23:42:51.767148+0000","last_became_active":"2024-03-23T23:42:39.691124+0000","last_became_peered":"2024-03-23T23:42:39.691124+0000","last_unstale":"2024-03-23T23:42:51.767148+0000","last_undegraded":"2024-03-23T23:42:51.767148+0000","last_fullsized":"2024-03-23T23:42:51.767148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:55.757707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767321+0000","last_change":"2024-03-23T23:42:49.750016+0000","last_active":"2024-03-23T23:42:51.767321+0000","last_peered":"2024-03-23T23:42:51.767321+0000","last_clean":"2024-03-23T23:42:51.767321+0000","last_became_active":"2024-03-23T23:42:49.749279+0000","last_became_peered":"2024-03-23T23:42:49.749279+0000","last_unstale":"2024-03-23T23:42:51.767321+0000","last_undegraded":"2024-03-23T23:42:51.767321+0000","last_fullsized":"2024-03-23T23:42:51.767321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:41:14.671834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328693+0000","last_change":"2024-03-23T23:42:50.753669+0000","last_active":"2024-03-23T23:42:52.328693+0000","last_peered":"2024-03-23T23:42:52.328693+0000","last_clean":"2024-03-23T23:42:52.328693+0000","last_became_active":"2024-03-23T23:42:50.752674+0000","last_became_peered":"2024-03-23T23:42:50.752674+0000","last_unstale":"2024-03-23T23:42:52.328693+0000","last_undegraded":"2024-03-23T23:42:52.328693+0000","last_fullsized":"2024-03-23T23:42:52.328693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:39:04.727316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751477+0000","last_change":"2024-03-23T23:42:40.685051+0000","last_active":"2024-03-23T23:42:51.751477+0000","last_peered":"2024-03-23T23:42:51.751477+0000","last_clean":"2024-03-23T23:42:51.751477+0000","last_became_active":"2024-03-23T23:42:40.684677+0000","last_became_peered":"2024-03-23T23:42:40.684677+0000","last_unstale":"2024-03-23T23:42:51.751477+0000","last_undegraded":"2024-03-23T23:42:51.751477+0000","last_fullsized":"2024-03-23T23:42:51.751477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:20.920978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189995+0000","last_change":"2024-03-23T23:42:39.695253+0000","last_active":"2024-03-23T23:42:52.189995+0000","last_peered":"2024-03-23T23:42:52.189995+0000","last_clean":"2024-03-23T23:42:52.189995+0000","last_became_active":"2024-03-23T23:42:39.694746+0000","last_became_peered":"2024-03-23T23:42:39.694746+0000","last_unstale":"2024-03-23T23:42:52.189995+0000","last_undegraded":"2024-03-23T23:42:52.189995+0000","last_fullsized":"2024-03-23T23:42:52.189995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:57.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752459+0000","last_change":"2024-03-23T23:42:49.724285+0000","last_active":"2024-03-23T23:42:51.752459+0000","last_peered":"2024-03-23T23:42:51.752459+0000","last_clean":"2024-03-23T23:42:51.752459+0000","last_became_active":"2024-03-23T23:42:49.724009+0000","last_became_peered":"2024-03-23T23:42:49.724009+0000","last_unstale":"2024-03-23T23:42:51.752459+0000","last_undegraded":"2024-03-23T23:42:51.752459+0000","last_fullsized":"2024-03-23T23:42:51.752459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:01:04.035970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327444+0000","last_change":"2024-03-23T23:42:50.746737+0000","last_active":"2024-03-23T23:42:52.327444+0000","last_peered":"2024-03-23T23:42:52.327444+0000","last_clean":"2024-03-23T23:42:52.327444+0000","last_became_active":"2024-03-23T23:42:50.746492+0000","last_became_peered":"2024-03-23T23:42:50.746492+0000","last_unstale":"2024-03-23T23:42:52.327444+0000","last_undegraded":"2024-03-23T23:42:52.327444+0000","last_fullsized":"2024-03-23T23:42:52.327444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:50.597847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763599+0000","last_change":"2024-03-23T23:42:40.680963+0000","last_active":"2024-03-23T23:42:51.763599+0000","last_peered":"2024-03-23T23:42:51.763599+0000","last_clean":"2024-03-23T23:42:51.763599+0000","last_became_active":"2024-03-23T23:42:40.680744+0000","last_became_peered":"2024-03-23T23:42:40.680744+0000","last_unstale":"2024-03-23T23:42:51.763599+0000","last_undegraded":"2024-03-23T23:42:51.763599+0000","last_fullsized":"2024-03-23T23:42:51.763599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:17:19.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.753179+0000","last_change":"2024-03-23T23:42:39.691813+0000","last_active":"2024-03-23T23:42:51.753179+0000","last_peered":"2024-03-23T23:42:51.753179+0000","last_clean":"2024-03-23T23:42:51.753179+0000","last_became_active":"2024-03-23T23:42:39.691519+0000","last_became_peered":"2024-03-23T23:42:39.691519+0000","last_unstale":"2024-03-23T23:42:51.753179+0000","last_undegraded":"2024-03-23T23:42:51.753179+0000","last_fullsized":"2024-03-23T23:42:51.753179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:27:41.386662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751110+0000","last_change":"2024-03-23T23:42:49.734197+0000","last_active":"2024-03-23T23:42:51.751110+0000","last_peered":"2024-03-23T23:42:51.751110+0000","last_clean":"2024-03-23T23:42:51.751110+0000","last_became_active":"2024-03-23T23:42:49.733715+0000","last_became_peered":"2024-03-23T23:42:49.733715+0000","last_unstale":"2024-03-23T23:42:51.751110+0000","last_undegraded":"2024-03-23T23:42:51.751110+0000","last_fullsized":"2024-03-23T23:42:51.751110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:36.728428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750902+0000","last_change":"2024-03-23T23:42:50.739957+0000","last_active":"2024-03-23T23:42:51.750902+0000","last_peered":"2024-03-23T23:42:51.750902+0000","last_clean":"2024-03-23T23:42:51.750902+0000","last_became_active":"2024-03-23T23:42:50.739706+0000","last_became_peered":"2024-03-23T23:42:50.739706+0000","last_unstale":"2024-03-23T23:42:51.750902+0000","last_undegraded":"2024-03-23T23:42:51.750902+0000","last_fullsized":"2024-03-23T23:42:51.750902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:49:17.763463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328339+0000","last_change":"2024-03-23T23:42:40.686865+0000","last_active":"2024-03-23T23:42:52.328339+0000","last_peered":"2024-03-23T23:42:52.328339+0000","last_clean":"2024-03-23T23:42:52.328339+0000","last_became_active":"2024-03-23T23:42:40.686582+0000","last_became_peered":"2024-03-23T23:42:40.686582+0000","last_unstale":"2024-03-23T23:42:52.328339+0000","last_undegraded":"2024-03-23T23:42:52.328339+0000","last_fullsized":"2024-03-23T23:42:52.328339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:05:17.694245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767041+0000","last_change":"2024-03-23T23:42:39.678962+0000","last_active":"2024-03-23T23:42:51.767041+0000","last_peered":"2024-03-23T23:42:51.767041+0000","last_clean":"2024-03-23T23:42:51.767041+0000","last_became_active":"2024-03-23T23:42:39.678603+0000","last_became_peered":"2024-03-23T23:42:39.678603+0000","last_unstale":"2024-03-23T23:42:51.767041+0000","last_undegraded":"2024-03-23T23:42:51.767041+0000","last_fullsized":"2024-03-23T23:42:51.767041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:43:46.206865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327329+0000","last_change":"2024-03-23T23:42:49.740561+0000","last_active":"2024-03-23T23:42:52.327329+0000","last_peered":"2024-03-23T23:42:52.327329+0000","last_clean":"2024-03-23T23:42:52.327329+0000","last_became_active":"2024-03-23T23:42:49.740290+0000","last_became_peered":"2024-03-23T23:42:49.740290+0000","last_unstale":"2024-03-23T23:42:52.327329+0000","last_undegraded":"2024-03-23T23:42:52.327329+0000","last_fullsized":"2024-03-23T23:42:52.327329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:21:24.160603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751249+0000","last_change":"2024-03-23T23:42:50.751107+0000","last_active":"2024-03-23T23:42:51.751249+0000","last_peered":"2024-03-23T23:42:51.751249+0000","last_clean":"2024-03-23T23:42:51.751249+0000","last_became_active":"2024-03-23T23:42:50.750859+0000","last_became_peered":"2024-03-23T23:42:50.750859+0000","last_unstale":"2024-03-23T23:42:51.751249+0000","last_undegraded":"2024-03-23T23:42:51.751249+0000","last_fullsized":"2024-03-23T23:42:51.751249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:49:17.763463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766837+0000","last_change":"2024-03-23T23:42:40.686486+0000","last_active":"2024-03-23T23:42:51.766837+0000","last_peered":"2024-03-23T23:42:51.766837+0000","last_clean":"2024-03-23T23:42:51.766837+0000","last_became_active":"2024-03-23T23:42:40.686186+0000","last_became_peered":"2024-03-23T23:42:40.686186+0000","last_unstale":"2024-03-23T23:42:51.766837+0000","last_undegraded":"2024-03-23T23:42:51.766837+0000","last_fullsized":"2024-03-23T23:42:51.766837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:46:30.427072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190217+0000","last_change":"2024-03-23T23:42:39.695099+0000","last_active":"2024-03-23T23:42:52.190217+0000","last_peered":"2024-03-23T23:42:52.190217+0000","last_clean":"2024-03-23T23:42:52.190217+0000","last_became_active":"2024-03-23T23:42:39.694720+0000","last_became_peered":"2024-03-23T23:42:39.694720+0000","last_unstale":"2024-03-23T23:42:52.190217+0000","last_undegraded":"2024-03-23T23:42:52.190217+0000","last_fullsized":"2024-03-23T23:42:52.190217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:58:07.880313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.762762+0000","last_change":"2024-03-23T23:42:49.739099+0000","last_active":"2024-03-23T23:42:51.762762+0000","last_peered":"2024-03-23T23:42:51.762762+0000","last_clean":"2024-03-23T23:42:51.762762+0000","last_became_active":"2024-03-23T23:42:49.738198+0000","last_became_peered":"2024-03-23T23:42:49.738198+0000","last_unstale":"2024-03-23T23:42:51.762762+0000","last_undegraded":"2024-03-23T23:42:51.762762+0000","last_fullsized":"2024-03-23T23:42:51.762762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:57:34.600362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.762957+0000","last_change":"2024-03-23T23:42:50.754941+0000","last_active":"2024-03-23T23:42:51.762957+0000","last_peered":"2024-03-23T23:42:51.762957+0000","last_clean":"2024-03-23T23:42:51.762957+0000","last_became_active":"2024-03-23T23:42:50.754585+0000","last_became_peered":"2024-03-23T23:42:50.754585+0000","last_unstale":"2024-03-23T23:42:51.762957+0000","last_undegraded":"2024-03-23T23:42:51.762957+0000","last_fullsized":"2024-03-23T23:42:51.762957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:42:23.236324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328954+0000","last_change":"2024-03-23T23:42:40.700610+0000","last_active":"2024-03-23T23:42:52.328954+0000","last_peered":"2024-03-23T23:42:52.328954+0000","last_clean":"2024-03-23T23:42:52.328954+0000","last_became_active":"2024-03-23T23:42:40.700112+0000","last_became_peered":"2024-03-23T23:42:40.700112+0000","last_unstale":"2024-03-23T23:42:52.328954+0000","last_undegraded":"2024-03-23T23:42:52.328954+0000","last_fullsized":"2024-03-23T23:42:52.328954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:07:49.169416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766866+0000","last_change":"2024-03-23T23:42:39.686509+0000","last_active":"2024-03-23T23:42:51.766866+0000","last_peered":"2024-03-23T23:42:51.766866+0000","last_clean":"2024-03-23T23:42:51.766866+0000","last_became_active":"2024-03-23T23:42:39.686094+0000","last_became_peered":"2024-03-23T23:42:39.686094+0000","last_unstale":"2024-03-23T23:42:51.766866+0000","last_undegraded":"2024-03-23T23:42:51.766866+0000","last_fullsized":"2024-03-23T23:42:51.766866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:57:20.394530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766601+0000","last_change":"2024-03-23T23:42:49.738274+0000","last_active":"2024-03-23T23:42:51.766601+0000","last_peered":"2024-03-23T23:42:51.766601+0000","last_clean":"2024-03-23T23:42:51.766601+0000","last_became_active":"2024-03-23T23:42:49.737916+0000","last_became_peered":"2024-03-23T23:42:49.737916+0000","last_unstale":"2024-03-23T23:42:51.766601+0000","last_undegraded":"2024-03-23T23:42:51.766601+0000","last_fullsized":"2024-03-23T23:42:51.766601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:18:12.997092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763279+0000","last_change":"2024-03-23T23:42:50.764148+0000","last_active":"2024-03-23T23:42:51.763279+0000","last_peered":"2024-03-23T23:42:51.763279+0000","last_clean":"2024-03-23T23:42:51.763279+0000","last_became_active":"2024-03-23T23:42:50.763768+0000","last_became_peered":"2024-03-23T23:42:50.763768+0000","last_unstale":"2024-03-23T23:42:51.763279+0000","last_undegraded":"2024-03-23T23:42:51.763279+0000","last_fullsized":"2024-03-23T23:42:51.763279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:52:48.699642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751565+0000","last_change":"2024-03-23T23:42:40.679988+0000","last_active":"2024-03-23T23:42:51.751565+0000","last_peered":"2024-03-23T23:42:51.751565+0000","last_clean":"2024-03-23T23:42:51.751565+0000","last_became_active":"2024-03-23T23:42:40.679488+0000","last_became_peered":"2024-03-23T23:42:40.679488+0000","last_unstale":"2024-03-23T23:42:51.751565+0000","last_undegraded":"2024-03-23T23:42:51.751565+0000","last_fullsized":"2024-03-23T23:42:51.751565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:10:32.251287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328493+0000","last_change":"2024-03-23T23:42:39.679741+0000","last_active":"2024-03-23T23:42:52.328493+0000","last_peered":"2024-03-23T23:42:52.328493+0000","last_clean":"2024-03-23T23:42:52.328493+0000","last_became_active":"2024-03-23T23:42:39.678864+0000","last_became_peered":"2024-03-23T23:42:39.678864+0000","last_unstale":"2024-03-23T23:42:52.328493+0000","last_undegraded":"2024-03-23T23:42:52.328493+0000","last_fullsized":"2024-03-23T23:42:52.328493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:50.559059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766763+0000","last_change":"2024-03-23T23:42:49.739837+0000","last_active":"2024-03-23T23:42:51.766763+0000","last_peered":"2024-03-23T23:42:51.766763+0000","last_clean":"2024-03-23T23:42:51.766763+0000","last_became_active":"2024-03-23T23:42:49.739570+0000","last_became_peered":"2024-03-23T23:42:49.739570+0000","last_unstale":"2024-03-23T23:42:51.766763+0000","last_undegraded":"2024-03-23T23:42:51.766763+0000","last_fullsized":"2024-03-23T23:42:51.766763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:57:34.600362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749980+0000","last_change":"2024-03-23T23:42:50.753912+0000","last_active":"2024-03-23T23:42:51.749980+0000","last_peered":"2024-03-23T23:42:51.749980+0000","last_clean":"2024-03-23T23:42:51.749980+0000","last_became_active":"2024-03-23T23:42:50.753629+0000","last_became_peered":"2024-03-23T23:42:50.753629+0000","last_unstale":"2024-03-23T23:42:51.749980+0000","last_undegraded":"2024-03-23T23:42:51.749980+0000","last_fullsized":"2024-03-23T23:42:51.749980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:40:32.748113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766326+0000","last_change":"2024-03-23T23:42:40.682840+0000","last_active":"2024-03-23T23:42:51.766326+0000","last_peered":"2024-03-23T23:42:51.766326+0000","last_clean":"2024-03-23T23:42:51.766326+0000","last_became_active":"2024-03-23T23:42:40.682391+0000","last_became_peered":"2024-03-23T23:42:40.682391+0000","last_unstale":"2024-03-23T23:42:51.766326+0000","last_undegraded":"2024-03-23T23:42:51.766326+0000","last_fullsized":"2024-03-23T23:42:51.766326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:42:14.952953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749558+0000","last_change":"2024-03-23T23:42:39.680763+0000","last_active":"2024-03-23T23:42:51.749558+0000","last_peered":"2024-03-23T23:42:51.749558+0000","last_clean":"2024-03-23T23:42:51.749558+0000","last_became_active":"2024-03-23T23:42:39.680494+0000","last_became_peered":"2024-03-23T23:42:39.680494+0000","last_unstale":"2024-03-23T23:42:51.749558+0000","last_undegraded":"2024-03-23T23:42:51.749558+0000","last_fullsized":"2024-03-23T23:42:51.749558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:57.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767406+0000","last_change":"2024-03-23T23:42:49.737456+0000","last_active":"2024-03-23T23:42:51.767406+0000","last_peered":"2024-03-23T23:42:51.767406+0000","last_clean":"2024-03-23T23:42:51.767406+0000","last_became_active":"2024-03-23T23:42:49.737196+0000","last_became_peered":"2024-03-23T23:42:49.737196+0000","last_unstale":"2024-03-23T23:42:51.767406+0000","last_undegraded":"2024-03-23T23:42:51.767406+0000","last_fullsized":"2024-03-23T23:42:51.767406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:49:42.789292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.329037+0000","last_change":"2024-03-23T23:42:50.763308+0000","last_active":"2024-03-23T23:42:52.329037+0000","last_peered":"2024-03-23T23:42:52.329037+0000","last_clean":"2024-03-23T23:42:52.329037+0000","last_became_active":"2024-03-23T23:42:50.763007+0000","last_became_peered":"2024-03-23T23:42:50.763007+0000","last_unstale":"2024-03-23T23:42:52.329037+0000","last_undegraded":"2024-03-23T23:42:52.329037+0000","last_fullsized":"2024-03-23T23:42:52.329037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:32:46.055472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.762549+0000","last_change":"2024-03-23T23:42:40.675570+0000","last_active":"2024-03-23T23:42:51.762549+0000","last_peered":"2024-03-23T23:42:51.762549+0000","last_clean":"2024-03-23T23:42:51.762549+0000","last_became_active":"2024-03-23T23:42:40.674390+0000","last_became_peered":"2024-03-23T23:42:40.674390+0000","last_unstale":"2024-03-23T23:42:51.762549+0000","last_undegraded":"2024-03-23T23:42:51.762549+0000","last_fullsized":"2024-03-23T23:42:51.762549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:31:34.412092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189672+0000","last_change":"2024-03-23T23:42:39.690057+0000","last_active":"2024-03-23T23:42:52.189672+0000","last_peered":"2024-03-23T23:42:52.189672+0000","last_clean":"2024-03-23T23:42:52.189672+0000","last_became_active":"2024-03-23T23:42:39.689763+0000","last_became_peered":"2024-03-23T23:42:39.689763+0000","last_unstale":"2024-03-23T23:42:52.189672+0000","last_undegraded":"2024-03-23T23:42:52.189672+0000","last_fullsized":"2024-03-23T23:42:52.189672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:01.607584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763516+0000","last_change":"2024-03-23T23:42:49.734213+0000","last_active":"2024-03-23T23:42:51.763516+0000","last_peered":"2024-03-23T23:42:51.763516+0000","last_clean":"2024-03-23T23:42:51.763516+0000","last_became_active":"2024-03-23T23:42:49.733115+0000","last_became_peered":"2024-03-23T23:42:49.733115+0000","last_unstale":"2024-03-23T23:42:51.763516+0000","last_undegraded":"2024-03-23T23:42:51.763516+0000","last_fullsized":"2024-03-23T23:42:51.763516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:18:12.997092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189689+0000","last_change":"2024-03-23T23:42:50.759000+0000","last_active":"2024-03-23T23:42:52.189689+0000","last_peered":"2024-03-23T23:42:52.189689+0000","last_clean":"2024-03-23T23:42:52.189689+0000","last_became_active":"2024-03-23T23:42:50.758552+0000","last_became_peered":"2024-03-23T23:42:50.758552+0000","last_unstale":"2024-03-23T23:42:52.189689+0000","last_undegraded":"2024-03-23T23:42:52.189689+0000","last_fullsized":"2024-03-23T23:42:52.189689+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:04:26.911514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327764+0000","last_change":"2024-03-23T23:42:40.700998+0000","last_active":"2024-03-23T23:42:52.327764+0000","last_peered":"2024-03-23T23:42:52.327764+0000","last_clean":"2024-03-23T23:42:52.327764+0000","last_became_active":"2024-03-23T23:42:40.700788+0000","last_became_peered":"2024-03-23T23:42:40.700788+0000","last_unstale":"2024-03-23T23:42:52.327764+0000","last_undegraded":"2024-03-23T23:42:52.327764+0000","last_fullsized":"2024-03-23T23:42:52.327764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:14:44.739525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328524+0000","last_change":"2024-03-23T23:42:39.687712+0000","last_active":"2024-03-23T23:42:52.328524+0000","last_peered":"2024-03-23T23:42:52.328524+0000","last_clean":"2024-03-23T23:42:52.328524+0000","last_became_active":"2024-03-23T23:42:39.687378+0000","last_became_peered":"2024-03-23T23:42:39.687378+0000","last_unstale":"2024-03-23T23:42:52.328524+0000","last_undegraded":"2024-03-23T23:42:52.328524+0000","last_fullsized":"2024-03-23T23:42:52.328524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:20:38.456655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189176+0000","last_change":"2024-03-23T23:42:27.940270+0000","last_active":"2024-03-23T23:42:52.189176+0000","last_peered":"2024-03-23T23:42:52.189176+0000","last_clean":"2024-03-23T23:42:52.189176+0000","last_became_active":"2024-03-23T23:42:27.939061+0000","last_became_peered":"2024-03-23T23:42:27.939061+0000","last_unstale":"2024-03-23T23:42:52.189176+0000","last_undegraded":"2024-03-23T23:42:52.189176+0000","last_fullsized":"2024-03-23T23:42:52.189176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:26.509742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:26.509742+0000","last_clean_scrub_stamp":"2024-03-23T23:42:26.509742+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:49.258623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752132+0000","last_change":"2024-03-23T23:42:49.729231+0000","last_active":"2024-03-23T23:42:51.752132+0000","last_peered":"2024-03-23T23:42:51.752132+0000","last_clean":"2024-03-23T23:42:51.752132+0000","last_became_active":"2024-03-23T23:42:49.728990+0000","last_became_peered":"2024-03-23T23:42:49.728990+0000","last_unstale":"2024-03-23T23:42:51.752132+0000","last_undegraded":"2024-03-23T23:42:51.752132+0000","last_fullsized":"2024-03-23T23:42:51.752132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:01:04.035970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749662+0000","last_change":"2024-03-23T23:42:50.757668+0000","last_active":"2024-03-23T23:42:51.749662+0000","last_peered":"2024-03-23T23:42:51.749662+0000","last_clean":"2024-03-23T23:42:51.749662+0000","last_became_active":"2024-03-23T23:42:50.756900+0000","last_became_peered":"2024-03-23T23:42:50.756900+0000","last_unstale":"2024-03-23T23:42:51.749662+0000","last_undegraded":"2024-03-23T23:42:51.749662+0000","last_fullsized":"2024-03-23T23:42:51.749662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:24:53.959288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190056+0000","last_change":"2024-03-23T23:42:40.711591+0000","last_active":"2024-03-23T23:42:52.190056+0000","last_peered":"2024-03-23T23:42:52.190056+0000","last_clean":"2024-03-23T23:42:52.190056+0000","last_became_active":"2024-03-23T23:42:40.711306+0000","last_became_peered":"2024-03-23T23:42:40.711306+0000","last_unstale":"2024-03-23T23:42:52.190056+0000","last_undegraded":"2024-03-23T23:42:52.190056+0000","last_fullsized":"2024-03-23T23:42:52.190056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:34:16.693372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749901+0000","last_change":"2024-03-23T23:42:39.684163+0000","last_active":"2024-03-23T23:42:51.749901+0000","last_peered":"2024-03-23T23:42:51.749901+0000","last_clean":"2024-03-23T23:42:51.749901+0000","last_became_active":"2024-03-23T23:42:39.683211+0000","last_became_peered":"2024-03-23T23:42:39.683211+0000","last_unstale":"2024-03-23T23:42:51.749901+0000","last_undegraded":"2024-03-23T23:42:51.749901+0000","last_fullsized":"2024-03-23T23:42:51.749901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:47:27.092873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751343+0000","last_change":"2024-03-23T23:42:49.735824+0000","last_active":"2024-03-23T23:42:51.751343+0000","last_peered":"2024-03-23T23:42:51.751343+0000","last_clean":"2024-03-23T23:42:51.751343+0000","last_became_active":"2024-03-23T23:42:49.735473+0000","last_became_peered":"2024-03-23T23:42:49.735473+0000","last_unstale":"2024-03-23T23:42:51.751343+0000","last_undegraded":"2024-03-23T23:42:51.751343+0000","last_fullsized":"2024-03-23T23:42:51.751343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:44:12.438729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749471+0000","last_change":"2024-03-23T23:42:50.745563+0000","last_active":"2024-03-23T23:42:51.749471+0000","last_peered":"2024-03-23T23:42:51.749471+0000","last_clean":"2024-03-23T23:42:51.749471+0000","last_became_active":"2024-03-23T23:42:50.745256+0000","last_became_peered":"2024-03-23T23:42:50.745256+0000","last_unstale":"2024-03-23T23:42:51.749471+0000","last_undegraded":"2024-03-23T23:42:51.749471+0000","last_fullsized":"2024-03-23T23:42:51.749471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:34:26.750531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328628+0000","last_change":"2024-03-23T23:42:40.700124+0000","last_active":"2024-03-23T23:42:52.328628+0000","last_peered":"2024-03-23T23:42:52.328628+0000","last_clean":"2024-03-23T23:42:52.328628+0000","last_became_active":"2024-03-23T23:42:40.697369+0000","last_became_peered":"2024-03-23T23:42:40.697369+0000","last_unstale":"2024-03-23T23:42:52.328628+0000","last_undegraded":"2024-03-23T23:42:52.328628+0000","last_fullsized":"2024-03-23T23:42:52.328628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:20.981139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767558+0000","last_change":"2024-03-23T23:42:39.681013+0000","last_active":"2024-03-23T23:42:51.767558+0000","last_peered":"2024-03-23T23:42:51.767558+0000","last_clean":"2024-03-23T23:42:51.767558+0000","last_became_active":"2024-03-23T23:42:39.680669+0000","last_became_peered":"2024-03-23T23:42:39.680669+0000","last_unstale":"2024-03-23T23:42:51.767558+0000","last_undegraded":"2024-03-23T23:42:51.767558+0000","last_fullsized":"2024-03-23T23:42:51.767558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:58:07.880313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.762672+0000","last_change":"2024-03-23T23:42:49.736747+0000","last_active":"2024-03-23T23:42:51.762672+0000","last_peered":"2024-03-23T23:42:51.762672+0000","last_clean":"2024-03-23T23:42:51.762672+0000","last_became_active":"2024-03-23T23:42:49.734508+0000","last_became_peered":"2024-03-23T23:42:49.734508+0000","last_unstale":"2024-03-23T23:42:51.762672+0000","last_undegraded":"2024-03-23T23:42:51.762672+0000","last_fullsized":"2024-03-23T23:42:51.762672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:54.356082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189347+0000","last_change":"2024-03-23T23:42:50.751141+0000","last_active":"2024-03-23T23:42:52.189347+0000","last_peered":"2024-03-23T23:42:52.189347+0000","last_clean":"2024-03-23T23:42:52.189347+0000","last_became_active":"2024-03-23T23:42:50.750269+0000","last_became_peered":"2024-03-23T23:42:50.750269+0000","last_unstale":"2024-03-23T23:42:52.189347+0000","last_undegraded":"2024-03-23T23:42:52.189347+0000","last_fullsized":"2024-03-23T23:42:52.189347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:46:10.784416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190299+0000","last_change":"2024-03-23T23:42:40.706713+0000","last_active":"2024-03-23T23:42:52.190299+0000","last_peered":"2024-03-23T23:42:52.190299+0000","last_clean":"2024-03-23T23:42:52.190299+0000","last_became_active":"2024-03-23T23:42:40.704328+0000","last_became_peered":"2024-03-23T23:42:40.704328+0000","last_unstale":"2024-03-23T23:42:52.190299+0000","last_undegraded":"2024-03-23T23:42:52.190299+0000","last_fullsized":"2024-03-23T23:42:52.190299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:15:52.261572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750011+0000","last_change":"2024-03-23T23:42:39.681906+0000","last_active":"2024-03-23T23:42:51.750011+0000","last_peered":"2024-03-23T23:42:51.750011+0000","last_clean":"2024-03-23T23:42:51.750011+0000","last_became_active":"2024-03-23T23:42:39.680506+0000","last_became_peered":"2024-03-23T23:42:39.680506+0000","last_unstale":"2024-03-23T23:42:51.750011+0000","last_undegraded":"2024-03-23T23:42:51.750011+0000","last_fullsized":"2024-03-23T23:42:51.750011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:44:07.213123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328020+0000","last_change":"2024-03-23T23:42:49.737735+0000","last_active":"2024-03-23T23:42:52.328020+0000","last_peered":"2024-03-23T23:42:52.328020+0000","last_clean":"2024-03-23T23:42:52.328020+0000","last_became_active":"2024-03-23T23:42:49.737434+0000","last_became_peered":"2024-03-23T23:42:49.737434+0000","last_unstale":"2024-03-23T23:42:52.328020+0000","last_undegraded":"2024-03-23T23:42:52.328020+0000","last_fullsized":"2024-03-23T23:42:52.328020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:58:10.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749338+0000","last_change":"2024-03-23T23:42:50.746922+0000","last_active":"2024-03-23T23:42:51.749338+0000","last_peered":"2024-03-23T23:42:51.749338+0000","last_clean":"2024-03-23T23:42:51.749338+0000","last_became_active":"2024-03-23T23:42:50.746105+0000","last_became_peered":"2024-03-23T23:42:50.746105+0000","last_unstale":"2024-03-23T23:42:51.749338+0000","last_undegraded":"2024-03-23T23:42:51.749338+0000","last_fullsized":"2024-03-23T23:42:51.749338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:46:40.484231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189958+0000","last_change":"2024-03-23T23:42:40.696584+0000","last_active":"2024-03-23T23:42:52.189958+0000","last_peered":"2024-03-23T23:42:52.189958+0000","last_clean":"2024-03-23T23:42:52.189958+0000","last_became_active":"2024-03-23T23:42:40.696141+0000","last_became_peered":"2024-03-23T23:42:40.696141+0000","last_unstale":"2024-03-23T23:42:52.189958+0000","last_undegraded":"2024-03-23T23:42:52.189958+0000","last_fullsized":"2024-03-23T23:42:52.189958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:45.303477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752716+0000","last_change":"2024-03-23T23:42:39.686863+0000","last_active":"2024-03-23T23:42:51.752716+0000","last_peered":"2024-03-23T23:42:51.752716+0000","last_clean":"2024-03-23T23:42:51.752716+0000","last_became_active":"2024-03-23T23:42:39.686491+0000","last_became_peered":"2024-03-23T23:42:39.686491+0000","last_unstale":"2024-03-23T23:42:51.752716+0000","last_undegraded":"2024-03-23T23:42:51.752716+0000","last_fullsized":"2024-03-23T23:42:51.752716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:38:13.752628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751016+0000","last_change":"2024-03-23T23:42:49.733982+0000","last_active":"2024-03-23T23:42:51.751016+0000","last_peered":"2024-03-23T23:42:51.751016+0000","last_clean":"2024-03-23T23:42:51.751016+0000","last_became_active":"2024-03-23T23:42:49.733389+0000","last_became_peered":"2024-03-23T23:42:49.733389+0000","last_unstale":"2024-03-23T23:42:51.751016+0000","last_undegraded":"2024-03-23T23:42:51.751016+0000","last_fullsized":"2024-03-23T23:42:51.751016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:13.685893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328287+0000","last_change":"2024-03-23T23:42:50.764083+0000","last_active":"2024-03-23T23:42:52.328287+0000","last_peered":"2024-03-23T23:42:52.328287+0000","last_clean":"2024-03-23T23:42:52.328287+0000","last_became_active":"2024-03-23T23:42:50.763871+0000","last_became_peered":"2024-03-23T23:42:50.763871+0000","last_unstale":"2024-03-23T23:42:52.328287+0000","last_undegraded":"2024-03-23T23:42:52.328287+0000","last_fullsized":"2024-03-23T23:42:52.328287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:32:46.055472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189656+0000","last_change":"2024-03-23T23:42:40.700961+0000","last_active":"2024-03-23T23:42:52.189656+0000","last_peered":"2024-03-23T23:42:52.189656+0000","last_clean":"2024-03-23T23:42:52.189656+0000","last_became_active":"2024-03-23T23:42:40.700800+0000","last_became_peered":"2024-03-23T23:42:40.700800+0000","last_unstale":"2024-03-23T23:42:52.189656+0000","last_undegraded":"2024-03-23T23:42:52.189656+0000","last_fullsized":"2024-03-23T23:42:52.189656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:54:27.641281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749328+0000","last_change":"2024-03-23T23:42:39.676075+0000","last_active":"2024-03-23T23:42:51.749328+0000","last_peered":"2024-03-23T23:42:51.749328+0000","last_clean":"2024-03-23T23:42:51.749328+0000","last_became_active":"2024-03-23T23:42:39.675770+0000","last_became_peered":"2024-03-23T23:42:39.675770+0000","last_unstale":"2024-03-23T23:42:51.749328+0000","last_undegraded":"2024-03-23T23:42:51.749328+0000","last_fullsized":"2024-03-23T23:42:51.749328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:24:11.933075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763597+0000","last_change":"2024-03-23T23:42:49.739529+0000","last_active":"2024-03-23T23:42:51.763597+0000","last_peered":"2024-03-23T23:42:51.763597+0000","last_clean":"2024-03-23T23:42:51.763597+0000","last_became_active":"2024-03-23T23:42:49.738053+0000","last_became_peered":"2024-03-23T23:42:49.738053+0000","last_unstale":"2024-03-23T23:42:51.763597+0000","last_undegraded":"2024-03-23T23:42:51.763597+0000","last_fullsized":"2024-03-23T23:42:51.763597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:52:57.561036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328637+0000","last_change":"2024-03-23T23:42:50.771347+0000","last_active":"2024-03-23T23:42:52.328637+0000","last_peered":"2024-03-23T23:42:52.328637+0000","last_clean":"2024-03-23T23:42:52.328637+0000","last_became_active":"2024-03-23T23:42:50.770998+0000","last_became_peered":"2024-03-23T23:42:50.770998+0000","last_unstale":"2024-03-23T23:42:52.328637+0000","last_undegraded":"2024-03-23T23:42:52.328637+0000","last_fullsized":"2024-03-23T23:42:52.328637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:57:04.394872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750921+0000","last_change":"2024-03-23T23:42:40.677314+0000","last_active":"2024-03-23T23:42:51.750921+0000","last_peered":"2024-03-23T23:42:51.750921+0000","last_clean":"2024-03-23T23:42:51.750921+0000","last_became_active":"2024-03-23T23:42:40.675416+0000","last_became_peered":"2024-03-23T23:42:40.675416+0000","last_unstale":"2024-03-23T23:42:51.750921+0000","last_undegraded":"2024-03-23T23:42:51.750921+0000","last_fullsized":"2024-03-23T23:42:51.750921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:01:06.338641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751663+0000","last_change":"2024-03-23T23:42:39.681827+0000","last_active":"2024-03-23T23:42:51.751663+0000","last_peered":"2024-03-23T23:42:51.751663+0000","last_clean":"2024-03-23T23:42:51.751663+0000","last_became_active":"2024-03-23T23:42:39.681418+0000","last_became_peered":"2024-03-23T23:42:39.681418+0000","last_unstale":"2024-03-23T23:42:51.751663+0000","last_undegraded":"2024-03-23T23:42:51.751663+0000","last_fullsized":"2024-03-23T23:42:51.751663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:50.559059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328221+0000","last_change":"2024-03-23T23:42:49.744708+0000","last_active":"2024-03-23T23:42:52.328221+0000","last_peered":"2024-03-23T23:42:52.328221+0000","last_clean":"2024-03-23T23:42:52.328221+0000","last_became_active":"2024-03-23T23:42:49.744422+0000","last_became_peered":"2024-03-23T23:42:49.744422+0000","last_unstale":"2024-03-23T23:42:52.328221+0000","last_undegraded":"2024-03-23T23:42:52.328221+0000","last_fullsized":"2024-03-23T23:42:52.328221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:25:43.889950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328641+0000","last_change":"2024-03-23T23:42:50.753064+0000","last_active":"2024-03-23T23:42:52.328641+0000","last_peered":"2024-03-23T23:42:52.328641+0000","last_clean":"2024-03-23T23:42:52.328641+0000","last_became_active":"2024-03-23T23:42:50.752783+0000","last_became_peered":"2024-03-23T23:42:50.752783+0000","last_unstale":"2024-03-23T23:42:52.328641+0000","last_undegraded":"2024-03-23T23:42:52.328641+0000","last_fullsized":"2024-03-23T23:42:52.328641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:39:49.888359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189741+0000","last_change":"2024-03-23T23:42:40.704046+0000","last_active":"2024-03-23T23:42:52.189741+0000","last_peered":"2024-03-23T23:42:52.189741+0000","last_clean":"2024-03-23T23:42:52.189741+0000","last_became_active":"2024-03-23T23:42:40.703787+0000","last_became_peered":"2024-03-23T23:42:40.703787+0000","last_unstale":"2024-03-23T23:42:52.189741+0000","last_undegraded":"2024-03-23T23:42:52.189741+0000","last_fullsized":"2024-03-23T23:42:52.189741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:16:16.737284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328439+0000","last_change":"2024-03-23T23:42:39.688483+0000","last_active":"2024-03-23T23:42:52.328439+0000","last_peered":"2024-03-23T23:42:52.328439+0000","last_clean":"2024-03-23T23:42:52.328439+0000","last_became_active":"2024-03-23T23:42:39.688141+0000","last_became_peered":"2024-03-23T23:42:39.688141+0000","last_unstale":"2024-03-23T23:42:52.328439+0000","last_undegraded":"2024-03-23T23:42:52.328439+0000","last_fullsized":"2024-03-23T23:42:52.328439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:32.254099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"25'8","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:43:16.912269+0000","last_change":"2024-03-23T23:42:49.749027+0000","last_active":"2024-03-23T23:43:16.912269+0000","last_peered":"2024-03-23T23:43:16.912269+0000","last_clean":"2024-03-23T23:43:16.912269+0000","last_became_active":"2024-03-23T23:42:49.748687+0000","last_became_peered":"2024-03-23T23:42:49.748687+0000","last_unstale":"2024-03-23T23:43:16.912269+0000","last_undegraded":"2024-03-23T23:43:16.912269+0000","last_fullsized":"2024-03-23T23:43:16.912269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:27.818117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1866,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328083+0000","last_change":"2024-03-23T23:42:50.752273+0000","last_active":"2024-03-23T23:42:52.328083+0000","last_peered":"2024-03-23T23:42:52.328083+0000","last_clean":"2024-03-23T23:42:52.328083+0000","last_became_active":"2024-03-23T23:42:50.751874+0000","last_became_peered":"2024-03-23T23:42:50.751874+0000","last_unstale":"2024-03-23T23:42:52.328083+0000","last_undegraded":"2024-03-23T23:42:52.328083+0000","last_fullsized":"2024-03-23T23:42:52.328083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:20:53.750917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.762660+0000","last_change":"2024-03-23T23:42:40.688909+0000","last_active":"2024-03-23T23:42:51.762660+0000","last_peered":"2024-03-23T23:42:51.762660+0000","last_clean":"2024-03-23T23:42:51.762660+0000","last_became_active":"2024-03-23T23:42:40.688636+0000","last_became_peered":"2024-03-23T23:42:40.688636+0000","last_unstale":"2024-03-23T23:42:51.762660+0000","last_undegraded":"2024-03-23T23:42:51.762660+0000","last_fullsized":"2024-03-23T23:42:51.762660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:26:16.171920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763113+0000","last_change":"2024-03-23T23:42:39.681926+0000","last_active":"2024-03-23T23:42:51.763113+0000","last_peered":"2024-03-23T23:42:51.763113+0000","last_clean":"2024-03-23T23:42:51.763113+0000","last_became_active":"2024-03-23T23:42:39.681028+0000","last_became_peered":"2024-03-23T23:42:39.681028+0000","last_unstale":"2024-03-23T23:42:51.763113+0000","last_undegraded":"2024-03-23T23:42:51.763113+0000","last_fullsized":"2024-03-23T23:42:51.763113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:24:11.933075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328871+0000","last_change":"2024-03-23T23:42:49.741915+0000","last_active":"2024-03-23T23:42:52.328871+0000","last_peered":"2024-03-23T23:42:52.328871+0000","last_clean":"2024-03-23T23:42:52.328871+0000","last_became_active":"2024-03-23T23:42:49.741650+0000","last_became_peered":"2024-03-23T23:42:49.741650+0000","last_unstale":"2024-03-23T23:42:52.328871+0000","last_undegraded":"2024-03-23T23:42:52.328871+0000","last_fullsized":"2024-03-23T23:42:52.328871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:11:43.106922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327956+0000","last_change":"2024-03-23T23:42:50.752979+0000","last_active":"2024-03-23T23:42:52.327956+0000","last_peered":"2024-03-23T23:42:52.327956+0000","last_clean":"2024-03-23T23:42:52.327956+0000","last_became_active":"2024-03-23T23:42:50.751848+0000","last_became_peered":"2024-03-23T23:42:50.751848+0000","last_unstale":"2024-03-23T23:42:52.327956+0000","last_undegraded":"2024-03-23T23:42:52.327956+0000","last_fullsized":"2024-03-23T23:42:52.327956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:39:04.727316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190024+0000","last_change":"2024-03-23T23:42:40.689988+0000","last_active":"2024-03-23T23:42:52.190024+0000","last_peered":"2024-03-23T23:42:52.190024+0000","last_clean":"2024-03-23T23:42:52.190024+0000","last_became_active":"2024-03-23T23:42:40.689477+0000","last_became_peered":"2024-03-23T23:42:40.689477+0000","last_unstale":"2024-03-23T23:42:52.190024+0000","last_undegraded":"2024-03-23T23:42:52.190024+0000","last_fullsized":"2024-03-23T23:42:52.190024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:46:30.427072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:43:14.610017+0000","last_change":"2024-03-23T23:42:39.689429+0000","last_active":"2024-03-23T23:43:14.610017+0000","last_peered":"2024-03-23T23:43:14.610017+0000","last_clean":"2024-03-23T23:43:14.610017+0000","last_became_active":"2024-03-23T23:42:39.688066+0000","last_became_peered":"2024-03-23T23:42:39.688066+0000","last_unstale":"2024-03-23T23:43:14.610017+0000","last_undegraded":"2024-03-23T23:43:14.610017+0000","last_fullsized":"2024-03-23T23:43:14.610017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:32.254099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1866,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766492+0000","last_change":"2024-03-23T23:42:49.733543+0000","last_active":"2024-03-23T23:42:51.766492+0000","last_peered":"2024-03-23T23:42:51.766492+0000","last_clean":"2024-03-23T23:42:51.766492+0000","last_became_active":"2024-03-23T23:42:49.733197+0000","last_became_peered":"2024-03-23T23:42:49.733197+0000","last_unstale":"2024-03-23T23:42:51.766492+0000","last_undegraded":"2024-03-23T23:42:51.766492+0000","last_fullsized":"2024-03-23T23:42:51.766492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:45:20.189501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766823+0000","last_change":"2024-03-23T23:42:50.756687+0000","last_active":"2024-03-23T23:42:51.766823+0000","last_peered":"2024-03-23T23:42:51.766823+0000","last_clean":"2024-03-23T23:42:51.766823+0000","last_became_active":"2024-03-23T23:42:50.756371+0000","last_became_peered":"2024-03-23T23:42:50.756371+0000","last_unstale":"2024-03-23T23:42:51.766823+0000","last_undegraded":"2024-03-23T23:42:51.766823+0000","last_fullsized":"2024-03-23T23:42:51.766823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:29:47.303374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752229+0000","last_change":"2024-03-23T23:42:40.683025+0000","last_active":"2024-03-23T23:42:51.752229+0000","last_peered":"2024-03-23T23:42:51.752229+0000","last_clean":"2024-03-23T23:42:51.752229+0000","last_became_active":"2024-03-23T23:42:40.682798+0000","last_became_peered":"2024-03-23T23:42:40.682798+0000","last_unstale":"2024-03-23T23:42:51.752229+0000","last_undegraded":"2024-03-23T23:42:51.752229+0000","last_fullsized":"2024-03-23T23:42:51.752229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:51.565112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767463+0000","last_change":"2024-03-23T23:42:39.681675+0000","last_active":"2024-03-23T23:42:51.767463+0000","last_peered":"2024-03-23T23:42:51.767463+0000","last_clean":"2024-03-23T23:42:51.767463+0000","last_became_active":"2024-03-23T23:42:39.681364+0000","last_became_peered":"2024-03-23T23:42:39.681364+0000","last_unstale":"2024-03-23T23:42:51.767463+0000","last_undegraded":"2024-03-23T23:42:51.767463+0000","last_fullsized":"2024-03-23T23:42:51.767463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:42:37.702720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751398+0000","last_change":"2024-03-23T23:42:49.723350+0000","last_active":"2024-03-23T23:42:51.751398+0000","last_peered":"2024-03-23T23:42:51.751398+0000","last_clean":"2024-03-23T23:42:51.751398+0000","last_became_active":"2024-03-23T23:42:49.723058+0000","last_became_peered":"2024-03-23T23:42:49.723058+0000","last_unstale":"2024-03-23T23:42:51.751398+0000","last_undegraded":"2024-03-23T23:42:51.751398+0000","last_fullsized":"2024-03-23T23:42:51.751398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:43:02.835034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751554+0000","last_change":"2024-03-23T23:42:50.746422+0000","last_active":"2024-03-23T23:42:51.751554+0000","last_peered":"2024-03-23T23:42:51.751554+0000","last_clean":"2024-03-23T23:42:51.751554+0000","last_became_active":"2024-03-23T23:42:50.746104+0000","last_became_peered":"2024-03-23T23:42:50.746104+0000","last_unstale":"2024-03-23T23:42:51.751554+0000","last_undegraded":"2024-03-23T23:42:51.751554+0000","last_fullsized":"2024-03-23T23:42:51.751554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:40:34.077584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763417+0000","last_change":"2024-03-23T23:42:40.700381+0000","last_active":"2024-03-23T23:42:51.763417+0000","last_peered":"2024-03-23T23:42:51.763417+0000","last_clean":"2024-03-23T23:42:51.763417+0000","last_became_active":"2024-03-23T23:42:40.698428+0000","last_became_peered":"2024-03-23T23:42:40.698428+0000","last_unstale":"2024-03-23T23:42:51.763417+0000","last_undegraded":"2024-03-23T23:42:51.763417+0000","last_fullsized":"2024-03-23T23:42:51.763417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:07:29.242921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328837+0000","last_change":"2024-03-23T23:42:39.691092+0000","last_active":"2024-03-23T23:42:52.328837+0000","last_peered":"2024-03-23T23:42:52.328837+0000","last_clean":"2024-03-23T23:42:52.328837+0000","last_became_active":"2024-03-23T23:42:39.687473+0000","last_became_peered":"2024-03-23T23:42:39.687473+0000","last_unstale":"2024-03-23T23:42:52.328837+0000","last_undegraded":"2024-03-23T23:42:52.328837+0000","last_fullsized":"2024-03-23T23:42:52.328837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:08:03.578884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327476+0000","last_change":"2024-03-23T23:42:49.748693+0000","last_active":"2024-03-23T23:42:52.327476+0000","last_peered":"2024-03-23T23:42:52.327476+0000","last_clean":"2024-03-23T23:42:52.327476+0000","last_became_active":"2024-03-23T23:42:49.748389+0000","last_became_peered":"2024-03-23T23:42:49.748389+0000","last_unstale":"2024-03-23T23:42:52.327476+0000","last_undegraded":"2024-03-23T23:42:52.327476+0000","last_fullsized":"2024-03-23T23:42:52.327476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:58:10.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189491+0000","last_change":"2024-03-23T23:42:50.749547+0000","last_active":"2024-03-23T23:42:52.189491+0000","last_peered":"2024-03-23T23:42:52.189491+0000","last_clean":"2024-03-23T23:42:52.189491+0000","last_became_active":"2024-03-23T23:42:50.749066+0000","last_became_peered":"2024-03-23T23:42:50.749066+0000","last_unstale":"2024-03-23T23:42:52.189491+0000","last_undegraded":"2024-03-23T23:42:52.189491+0000","last_fullsized":"2024-03-23T23:42:52.189491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:09:19.723830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328727+0000","last_change":"2024-03-23T23:42:40.708795+0000","last_active":"2024-03-23T23:42:52.328727+0000","last_peered":"2024-03-23T23:42:52.328727+0000","last_clean":"2024-03-23T23:42:52.328727+0000","last_became_active":"2024-03-23T23:42:40.708199+0000","last_became_peered":"2024-03-23T23:42:40.708199+0000","last_unstale":"2024-03-23T23:42:52.328727+0000","last_undegraded":"2024-03-23T23:42:52.328727+0000","last_fullsized":"2024-03-23T23:42:52.328727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:53.782430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.753135+0000","last_change":"2024-03-23T23:42:39.684669+0000","last_active":"2024-03-23T23:42:51.753135+0000","last_peered":"2024-03-23T23:42:51.753135+0000","last_clean":"2024-03-23T23:42:51.753135+0000","last_became_active":"2024-03-23T23:42:39.684360+0000","last_became_peered":"2024-03-23T23:42:39.684360+0000","last_unstale":"2024-03-23T23:42:51.753135+0000","last_undegraded":"2024-03-23T23:42:51.753135+0000","last_fullsized":"2024-03-23T23:42:51.753135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:19.914926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327466+0000","last_change":"2024-03-23T23:42:49.741577+0000","last_active":"2024-03-23T23:42:52.327466+0000","last_peered":"2024-03-23T23:42:52.327466+0000","last_clean":"2024-03-23T23:42:52.327466+0000","last_became_active":"2024-03-23T23:42:49.741270+0000","last_became_peered":"2024-03-23T23:42:49.741270+0000","last_unstale":"2024-03-23T23:42:52.327466+0000","last_undegraded":"2024-03-23T23:42:52.327466+0000","last_fullsized":"2024-03-23T23:42:52.327466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:11:43.106922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.753001+0000","last_change":"2024-03-23T23:42:50.751992+0000","last_active":"2024-03-23T23:42:51.753001+0000","last_peered":"2024-03-23T23:42:51.753001+0000","last_clean":"2024-03-23T23:42:51.753001+0000","last_became_active":"2024-03-23T23:42:50.748281+0000","last_became_peered":"2024-03-23T23:42:50.748281+0000","last_unstale":"2024-03-23T23:42:51.753001+0000","last_undegraded":"2024-03-23T23:42:51.753001+0000","last_fullsized":"2024-03-23T23:42:51.753001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:57.968968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763361+0000","last_change":"2024-03-23T23:42:49.741658+0000","last_active":"2024-03-23T23:42:51.763361+0000","last_peered":"2024-03-23T23:42:51.763361+0000","last_clean":"2024-03-23T23:42:51.763361+0000","last_became_active":"2024-03-23T23:42:49.740899+0000","last_became_peered":"2024-03-23T23:42:49.740899+0000","last_unstale":"2024-03-23T23:42:51.763361+0000","last_undegraded":"2024-03-23T23:42:51.763361+0000","last_fullsized":"2024-03-23T23:42:51.763361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:45:20.189501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766424+0000","last_change":"2024-03-23T23:42:40.679384+0000","last_active":"2024-03-23T23:42:51.766424+0000","last_peered":"2024-03-23T23:42:51.766424+0000","last_clean":"2024-03-23T23:42:51.766424+0000","last_became_active":"2024-03-23T23:42:40.679070+0000","last_became_peered":"2024-03-23T23:42:40.679070+0000","last_unstale":"2024-03-23T23:42:51.766424+0000","last_undegraded":"2024-03-23T23:42:51.766424+0000","last_fullsized":"2024-03-23T23:42:51.766424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:26:16.171920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328187+0000","last_change":"2024-03-23T23:42:39.682839+0000","last_active":"2024-03-23T23:42:52.328187+0000","last_peered":"2024-03-23T23:42:52.328187+0000","last_clean":"2024-03-23T23:42:52.328187+0000","last_became_active":"2024-03-23T23:42:39.682584+0000","last_became_peered":"2024-03-23T23:42:39.682584+0000","last_unstale":"2024-03-23T23:42:52.328187+0000","last_undegraded":"2024-03-23T23:42:52.328187+0000","last_fullsized":"2024-03-23T23:42:52.328187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:19.914926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763311+0000","last_change":"2024-03-23T23:42:50.752596+0000","last_active":"2024-03-23T23:42:51.763311+0000","last_peered":"2024-03-23T23:42:51.763311+0000","last_clean":"2024-03-23T23:42:51.763311+0000","last_became_active":"2024-03-23T23:42:50.751598+0000","last_became_peered":"2024-03-23T23:42:50.751598+0000","last_unstale":"2024-03-23T23:42:51.763311+0000","last_undegraded":"2024-03-23T23:42:51.763311+0000","last_fullsized":"2024-03-23T23:42:51.763311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:37:19.741781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.753080+0000","last_change":"2024-03-23T23:42:49.734629+0000","last_active":"2024-03-23T23:42:51.753080+0000","last_peered":"2024-03-23T23:42:51.753080+0000","last_clean":"2024-03-23T23:42:51.753080+0000","last_became_active":"2024-03-23T23:42:49.734309+0000","last_became_peered":"2024-03-23T23:42:49.734309+0000","last_unstale":"2024-03-23T23:42:51.753080+0000","last_undegraded":"2024-03-23T23:42:51.753080+0000","last_fullsized":"2024-03-23T23:42:51.753080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:46.760020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327687+0000","last_change":"2024-03-23T23:42:40.674605+0000","last_active":"2024-03-23T23:42:52.327687+0000","last_peered":"2024-03-23T23:42:52.327687+0000","last_clean":"2024-03-23T23:42:52.327687+0000","last_became_active":"2024-03-23T23:42:40.674366+0000","last_became_peered":"2024-03-23T23:42:40.674366+0000","last_unstale":"2024-03-23T23:42:52.327687+0000","last_undegraded":"2024-03-23T23:42:52.327687+0000","last_fullsized":"2024-03-23T23:42:52.327687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327666+0000","last_change":"2024-03-23T23:42:39.688646+0000","last_active":"2024-03-23T23:42:52.327666+0000","last_peered":"2024-03-23T23:42:52.327666+0000","last_clean":"2024-03-23T23:42:52.327666+0000","last_became_active":"2024-03-23T23:42:39.687489+0000","last_became_peered":"2024-03-23T23:42:39.687489+0000","last_unstale":"2024-03-23T23:42:52.327666+0000","last_undegraded":"2024-03-23T23:42:52.327666+0000","last_fullsized":"2024-03-23T23:42:52.327666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:07:12.649156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767201+0000","last_change":"2024-03-23T23:42:50.748511+0000","last_active":"2024-03-23T23:42:51.767201+0000","last_peered":"2024-03-23T23:42:51.767201+0000","last_clean":"2024-03-23T23:42:51.767201+0000","last_became_active":"2024-03-23T23:42:50.747154+0000","last_became_peered":"2024-03-23T23:42:50.747154+0000","last_unstale":"2024-03-23T23:42:51.767201+0000","last_undegraded":"2024-03-23T23:42:51.767201+0000","last_fullsized":"2024-03-23T23:42:51.767201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:09:19.723830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751549+0000","last_change":"2024-03-23T23:42:39.681458+0000","last_active":"2024-03-23T23:42:51.751549+0000","last_peered":"2024-03-23T23:42:51.751549+0000","last_clean":"2024-03-23T23:42:51.751549+0000","last_became_active":"2024-03-23T23:42:39.681158+0000","last_became_peered":"2024-03-23T23:42:39.681158+0000","last_unstale":"2024-03-23T23:42:51.751549+0000","last_undegraded":"2024-03-23T23:42:51.751549+0000","last_fullsized":"2024-03-23T23:42:51.751549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:08:03.578884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763042+0000","last_change":"2024-03-23T23:42:40.676571+0000","last_active":"2024-03-23T23:42:51.763042+0000","last_peered":"2024-03-23T23:42:51.763042+0000","last_clean":"2024-03-23T23:42:51.763042+0000","last_became_active":"2024-03-23T23:42:40.675877+0000","last_became_peered":"2024-03-23T23:42:40.675877+0000","last_unstale":"2024-03-23T23:42:51.763042+0000","last_undegraded":"2024-03-23T23:42:51.763042+0000","last_fullsized":"2024-03-23T23:42:51.763042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:52.220411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749759+0000","last_change":"2024-03-23T23:42:49.734208+0000","last_active":"2024-03-23T23:42:51.749759+0000","last_peered":"2024-03-23T23:42:51.749759+0000","last_clean":"2024-03-23T23:42:51.749759+0000","last_became_active":"2024-03-23T23:42:49.732943+0000","last_became_peered":"2024-03-23T23:42:49.732943+0000","last_unstale":"2024-03-23T23:42:51.749759+0000","last_undegraded":"2024-03-23T23:42:51.749759+0000","last_fullsized":"2024-03-23T23:42:51.749759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:43.683275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751832+0000","last_change":"2024-03-23T23:42:50.752722+0000","last_active":"2024-03-23T23:42:51.751832+0000","last_peered":"2024-03-23T23:42:51.751832+0000","last_clean":"2024-03-23T23:42:51.751832+0000","last_became_active":"2024-03-23T23:42:50.749400+0000","last_became_peered":"2024-03-23T23:42:50.749400+0000","last_unstale":"2024-03-23T23:42:51.751832+0000","last_undegraded":"2024-03-23T23:42:51.751832+0000","last_fullsized":"2024-03-23T23:42:51.751832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:16:44.027189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328094+0000","last_change":"2024-03-23T23:42:39.688422+0000","last_active":"2024-03-23T23:42:52.328094+0000","last_peered":"2024-03-23T23:42:52.328094+0000","last_clean":"2024-03-23T23:42:52.328094+0000","last_became_active":"2024-03-23T23:42:39.687423+0000","last_became_peered":"2024-03-23T23:42:39.687423+0000","last_unstale":"2024-03-23T23:42:52.328094+0000","last_undegraded":"2024-03-23T23:42:52.328094+0000","last_fullsized":"2024-03-23T23:42:52.328094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:20:38.456655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751184+0000","last_change":"2024-03-23T23:42:40.680801+0000","last_active":"2024-03-23T23:42:51.751184+0000","last_peered":"2024-03-23T23:42:51.751184+0000","last_clean":"2024-03-23T23:42:51.751184+0000","last_became_active":"2024-03-23T23:42:40.680511+0000","last_became_peered":"2024-03-23T23:42:40.680511+0000","last_unstale":"2024-03-23T23:42:51.751184+0000","last_undegraded":"2024-03-23T23:42:51.751184+0000","last_fullsized":"2024-03-23T23:42:51.751184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:27:42.392714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328321+0000","last_change":"2024-03-23T23:42:49.751291+0000","last_active":"2024-03-23T23:42:52.328321+0000","last_peered":"2024-03-23T23:42:52.328321+0000","last_clean":"2024-03-23T23:42:52.328321+0000","last_became_active":"2024-03-23T23:42:49.749695+0000","last_became_peered":"2024-03-23T23:42:49.749695+0000","last_unstale":"2024-03-23T23:42:52.328321+0000","last_undegraded":"2024-03-23T23:42:52.328321+0000","last_fullsized":"2024-03-23T23:42:52.328321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:40:33.073029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328522+0000","last_change":"2024-03-23T23:42:50.752672+0000","last_active":"2024-03-23T23:42:52.328522+0000","last_peered":"2024-03-23T23:42:52.328522+0000","last_clean":"2024-03-23T23:42:52.328522+0000","last_became_active":"2024-03-23T23:42:50.752394+0000","last_became_peered":"2024-03-23T23:42:50.752394+0000","last_unstale":"2024-03-23T23:42:52.328522+0000","last_undegraded":"2024-03-23T23:42:52.328522+0000","last_fullsized":"2024-03-23T23:42:52.328522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:51:01.385876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750919+0000","last_change":"2024-03-23T23:42:40.679042+0000","last_active":"2024-03-23T23:42:51.750919+0000","last_peered":"2024-03-23T23:42:51.750919+0000","last_clean":"2024-03-23T23:42:51.750919+0000","last_became_active":"2024-03-23T23:42:40.678518+0000","last_became_peered":"2024-03-23T23:42:40.678518+0000","last_unstale":"2024-03-23T23:42:51.750919+0000","last_undegraded":"2024-03-23T23:42:51.750919+0000","last_fullsized":"2024-03-23T23:42:51.750919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:12:14.359173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767231+0000","last_change":"2024-03-23T23:42:50.757132+0000","last_active":"2024-03-23T23:42:51.767231+0000","last_peered":"2024-03-23T23:42:51.767231+0000","last_clean":"2024-03-23T23:42:51.767231+0000","last_became_active":"2024-03-23T23:42:50.756813+0000","last_became_peered":"2024-03-23T23:42:50.756813+0000","last_unstale":"2024-03-23T23:42:51.767231+0000","last_undegraded":"2024-03-23T23:42:51.767231+0000","last_fullsized":"2024-03-23T23:42:51.767231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:04:26.911514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749494+0000","last_change":"2024-03-23T23:42:40.702411+0000","last_active":"2024-03-23T23:42:51.749494+0000","last_peered":"2024-03-23T23:42:51.749494+0000","last_clean":"2024-03-23T23:42:51.749494+0000","last_became_active":"2024-03-23T23:42:40.701398+0000","last_became_peered":"2024-03-23T23:42:40.701398+0000","last_unstale":"2024-03-23T23:42:51.749494+0000","last_undegraded":"2024-03-23T23:42:51.749494+0000","last_fullsized":"2024-03-23T23:42:51.749494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:03.196963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328386+0000","last_change":"2024-03-23T23:42:50.756769+0000","last_active":"2024-03-23T23:42:52.328386+0000","last_peered":"2024-03-23T23:42:52.328386+0000","last_clean":"2024-03-23T23:42:52.328386+0000","last_became_active":"2024-03-23T23:42:50.756503+0000","last_became_peered":"2024-03-23T23:42:50.756503+0000","last_unstale":"2024-03-23T23:42:52.328386+0000","last_undegraded":"2024-03-23T23:42:52.328386+0000","last_fullsized":"2024-03-23T23:42:52.328386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:50.597847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328394+0000","last_change":"2024-03-23T23:42:40.698519+0000","last_active":"2024-03-23T23:42:52.328394+0000","last_peered":"2024-03-23T23:42:52.328394+0000","last_clean":"2024-03-23T23:42:52.328394+0000","last_became_active":"2024-03-23T23:42:40.695218+0000","last_became_peered":"2024-03-23T23:42:40.695218+0000","last_unstale":"2024-03-23T23:42:52.328394+0000","last_undegraded":"2024-03-23T23:42:52.328394+0000","last_fullsized":"2024-03-23T23:42:52.328394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:00:54.983365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767039+0000","last_change":"2024-03-23T23:42:50.748726+0000","last_active":"2024-03-23T23:42:51.767039+0000","last_peered":"2024-03-23T23:42:51.767039+0000","last_clean":"2024-03-23T23:42:51.767039+0000","last_became_active":"2024-03-23T23:42:50.748105+0000","last_became_peered":"2024-03-23T23:42:50.748105+0000","last_unstale":"2024-03-23T23:42:51.767039+0000","last_undegraded":"2024-03-23T23:42:51.767039+0000","last_fullsized":"2024-03-23T23:42:51.767039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:54.910408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763001+0000","last_change":"2024-03-23T23:42:40.673293+0000","last_active":"2024-03-23T23:42:51.763001+0000","last_peered":"2024-03-23T23:42:51.763001+0000","last_clean":"2024-03-23T23:42:51.763001+0000","last_became_active":"2024-03-23T23:42:40.672910+0000","last_became_peered":"2024-03-23T23:42:40.672910+0000","last_unstale":"2024-03-23T23:42:51.763001+0000","last_undegraded":"2024-03-23T23:42:51.763001+0000","last_fullsized":"2024-03-23T23:42:51.763001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:42:14.952953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189476+0000","last_change":"2024-03-23T23:42:50.750291+0000","last_active":"2024-03-23T23:42:52.189476+0000","last_peered":"2024-03-23T23:42:52.189476+0000","last_clean":"2024-03-23T23:42:52.189476+0000","last_became_active":"2024-03-23T23:42:50.749908+0000","last_became_peered":"2024-03-23T23:42:50.749908+0000","last_unstale":"2024-03-23T23:42:52.189476+0000","last_undegraded":"2024-03-23T23:42:52.189476+0000","last_fullsized":"2024-03-23T23:42:52.189476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:54.910408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328216+0000","last_change":"2024-03-23T23:42:40.685370+0000","last_active":"2024-03-23T23:42:52.328216+0000","last_peered":"2024-03-23T23:42:52.328216+0000","last_clean":"2024-03-23T23:42:52.328216+0000","last_became_active":"2024-03-23T23:42:40.685120+0000","last_became_peered":"2024-03-23T23:42:40.685120+0000","last_unstale":"2024-03-23T23:42:52.328216+0000","last_undegraded":"2024-03-23T23:42:52.328216+0000","last_fullsized":"2024-03-23T23:42:52.328216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751268+0000","last_change":"2024-03-23T23:42:50.747361+0000","last_active":"2024-03-23T23:42:51.751268+0000","last_peered":"2024-03-23T23:42:51.751268+0000","last_clean":"2024-03-23T23:42:51.751268+0000","last_became_active":"2024-03-23T23:42:50.746310+0000","last_became_peered":"2024-03-23T23:42:50.746310+0000","last_unstale":"2024-03-23T23:42:51.751268+0000","last_undegraded":"2024-03-23T23:42:51.751268+0000","last_fullsized":"2024-03-23T23:42:51.751268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:57.968968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767365+0000","last_change":"2024-03-23T23:42:40.677168+0000","last_active":"2024-03-23T23:42:51.767365+0000","last_peered":"2024-03-23T23:42:51.767365+0000","last_clean":"2024-03-23T23:42:51.767365+0000","last_became_active":"2024-03-23T23:42:40.676912+0000","last_became_peered":"2024-03-23T23:42:40.676912+0000","last_unstale":"2024-03-23T23:42:51.767365+0000","last_undegraded":"2024-03-23T23:42:51.767365+0000","last_fullsized":"2024-03-23T23:42:51.767365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:17:19.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189346+0000","last_change":"2024-03-23T23:42:50.749305+0000","last_active":"2024-03-23T23:42:52.189346+0000","last_peered":"2024-03-23T23:42:52.189346+0000","last_clean":"2024-03-23T23:42:52.189346+0000","last_became_active":"2024-03-23T23:42:50.748798+0000","last_became_peered":"2024-03-23T23:42:50.748798+0000","last_unstale":"2024-03-23T23:42:52.189346+0000","last_undegraded":"2024-03-23T23:42:52.189346+0000","last_fullsized":"2024-03-23T23:42:52.189346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:19.610436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752528+0000","last_change":"2024-03-23T23:42:40.694420+0000","last_active":"2024-03-23T23:42:51.752528+0000","last_peered":"2024-03-23T23:42:51.752528+0000","last_clean":"2024-03-23T23:42:51.752528+0000","last_became_active":"2024-03-23T23:42:40.693867+0000","last_became_peered":"2024-03-23T23:42:40.693867+0000","last_unstale":"2024-03-23T23:42:51.752528+0000","last_undegraded":"2024-03-23T23:42:51.752528+0000","last_fullsized":"2024-03-23T23:42:51.752528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:54.557634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751411+0000","last_change":"2024-03-23T23:42:50.754149+0000","last_active":"2024-03-23T23:42:51.751411+0000","last_peered":"2024-03-23T23:42:51.751411+0000","last_clean":"2024-03-23T23:42:51.751411+0000","last_became_active":"2024-03-23T23:42:50.753471+0000","last_became_peered":"2024-03-23T23:42:50.753471+0000","last_unstale":"2024-03-23T23:42:51.751411+0000","last_undegraded":"2024-03-23T23:42:51.751411+0000","last_fullsized":"2024-03-23T23:42:51.751411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:28.822672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328282+0000","last_change":"2024-03-23T23:42:40.685177+0000","last_active":"2024-03-23T23:42:52.328282+0000","last_peered":"2024-03-23T23:42:52.328282+0000","last_clean":"2024-03-23T23:42:52.328282+0000","last_became_active":"2024-03-23T23:42:40.684495+0000","last_became_peered":"2024-03-23T23:42:40.684495+0000","last_unstale":"2024-03-23T23:42:52.328282+0000","last_undegraded":"2024-03-23T23:42:52.328282+0000","last_fullsized":"2024-03-23T23:42:52.328282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:27.675824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328493+0000","last_change":"2024-03-23T23:42:50.746438+0000","last_active":"2024-03-23T23:42:52.328493+0000","last_peered":"2024-03-23T23:42:52.328493+0000","last_clean":"2024-03-23T23:42:52.328493+0000","last_became_active":"2024-03-23T23:42:50.745771+0000","last_became_peered":"2024-03-23T23:42:50.745771+0000","last_unstale":"2024-03-23T23:42:52.328493+0000","last_undegraded":"2024-03-23T23:42:52.328493+0000","last_fullsized":"2024-03-23T23:42:52.328493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:22:17.484059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328084+0000","last_change":"2024-03-23T23:42:40.701852+0000","last_active":"2024-03-23T23:42:52.328084+0000","last_peered":"2024-03-23T23:42:52.328084+0000","last_clean":"2024-03-23T23:42:52.328084+0000","last_became_active":"2024-03-23T23:42:40.701566+0000","last_became_peered":"2024-03-23T23:42:40.701566+0000","last_unstale":"2024-03-23T23:42:52.328084+0000","last_undegraded":"2024-03-23T23:42:52.328084+0000","last_fullsized":"2024-03-23T23:42:52.328084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190034+0000","last_change":"2024-03-23T23:42:50.758879+0000","last_active":"2024-03-23T23:42:52.190034+0000","last_peered":"2024-03-23T23:42:52.190034+0000","last_clean":"2024-03-23T23:42:52.190034+0000","last_became_active":"2024-03-23T23:42:50.758564+0000","last_became_peered":"2024-03-23T23:42:50.758564+0000","last_unstale":"2024-03-23T23:42:52.190034+0000","last_undegraded":"2024-03-23T23:42:52.190034+0000","last_fullsized":"2024-03-23T23:42:52.190034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:11:29.268536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327548+0000","last_change":"2024-03-23T23:42:40.684899+0000","last_active":"2024-03-23T23:42:52.327548+0000","last_peered":"2024-03-23T23:42:52.327548+0000","last_clean":"2024-03-23T23:42:52.327548+0000","last_became_active":"2024-03-23T23:42:40.684603+0000","last_became_peered":"2024-03-23T23:42:40.684603+0000","last_unstale":"2024-03-23T23:42:52.327548+0000","last_undegraded":"2024-03-23T23:42:52.327548+0000","last_fullsized":"2024-03-23T23:42:52.327548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:54.557634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749737+0000","last_change":"2024-03-23T23:42:50.754096+0000","last_active":"2024-03-23T23:42:51.749737+0000","last_peered":"2024-03-23T23:42:51.749737+0000","last_clean":"2024-03-23T23:42:51.749737+0000","last_became_active":"2024-03-23T23:42:50.753602+0000","last_became_peered":"2024-03-23T23:42:50.753602+0000","last_unstale":"2024-03-23T23:42:51.749737+0000","last_undegraded":"2024-03-23T23:42:51.749737+0000","last_fullsized":"2024-03-23T23:42:51.749737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:16:26.794444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328338+0000","last_change":"2024-03-23T23:42:40.707800+0000","last_active":"2024-03-23T23:42:52.328338+0000","last_peered":"2024-03-23T23:42:52.328338+0000","last_clean":"2024-03-23T23:42:52.328338+0000","last_became_active":"2024-03-23T23:42:40.707528+0000","last_became_peered":"2024-03-23T23:42:40.707528+0000","last_unstale":"2024-03-23T23:42:52.328338+0000","last_undegraded":"2024-03-23T23:42:52.328338+0000","last_fullsized":"2024-03-23T23:42:52.328338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:03:24.275154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328659+0000","last_change":"2024-03-23T23:42:50.741324+0000","last_active":"2024-03-23T23:42:52.328659+0000","last_peered":"2024-03-23T23:42:52.328659+0000","last_clean":"2024-03-23T23:42:52.328659+0000","last_became_active":"2024-03-23T23:42:50.741065+0000","last_became_peered":"2024-03-23T23:42:50.741065+0000","last_unstale":"2024-03-23T23:42:52.328659+0000","last_undegraded":"2024-03-23T23:42:52.328659+0000","last_fullsized":"2024-03-23T23:42:52.328659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:13.911327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.762890+0000","last_change":"2024-03-23T23:42:40.689122+0000","last_active":"2024-03-23T23:42:51.762890+0000","last_peered":"2024-03-23T23:42:51.762890+0000","last_clean":"2024-03-23T23:42:51.762890+0000","last_became_active":"2024-03-23T23:42:40.688875+0000","last_became_peered":"2024-03-23T23:42:40.688875+0000","last_unstale":"2024-03-23T23:42:51.762890+0000","last_undegraded":"2024-03-23T23:42:51.762890+0000","last_fullsized":"2024-03-23T23:42:51.762890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:27:03.132032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750979+0000","last_change":"2024-03-23T23:42:50.762055+0000","last_active":"2024-03-23T23:42:51.750979+0000","last_peered":"2024-03-23T23:42:51.750979+0000","last_clean":"2024-03-23T23:42:51.750979+0000","last_became_active":"2024-03-23T23:42:50.761762+0000","last_became_peered":"2024-03-23T23:42:50.761762+0000","last_unstale":"2024-03-23T23:42:51.750979+0000","last_undegraded":"2024-03-23T23:42:51.750979+0000","last_fullsized":"2024-03-23T23:42:51.750979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:28.822672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752195+0000","last_change":"2024-03-23T23:42:40.683701+0000","last_active":"2024-03-23T23:42:51.752195+0000","last_peered":"2024-03-23T23:42:51.752195+0000","last_clean":"2024-03-23T23:42:51.752195+0000","last_became_active":"2024-03-23T23:42:40.683377+0000","last_became_peered":"2024-03-23T23:42:40.683377+0000","last_unstale":"2024-03-23T23:42:51.752195+0000","last_undegraded":"2024-03-23T23:42:51.752195+0000","last_fullsized":"2024-03-23T23:42:51.752195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751120+0000","last_change":"2024-03-23T23:42:50.754372+0000","last_active":"2024-03-23T23:42:51.751120+0000","last_peered":"2024-03-23T23:42:51.751120+0000","last_clean":"2024-03-23T23:42:51.751120+0000","last_became_active":"2024-03-23T23:42:50.754072+0000","last_became_peered":"2024-03-23T23:42:50.754072+0000","last_unstale":"2024-03-23T23:42:51.751120+0000","last_undegraded":"2024-03-23T23:42:51.751120+0000","last_fullsized":"2024-03-23T23:42:51.751120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:40:34.077584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190143+0000","last_change":"2024-03-23T23:42:40.689769+0000","last_active":"2024-03-23T23:42:52.190143+0000","last_peered":"2024-03-23T23:42:52.190143+0000","last_clean":"2024-03-23T23:42:52.190143+0000","last_became_active":"2024-03-23T23:42:40.689111+0000","last_became_peered":"2024-03-23T23:42:40.689111+0000","last_unstale":"2024-03-23T23:42:52.190143+0000","last_undegraded":"2024-03-23T23:42:52.190143+0000","last_fullsized":"2024-03-23T23:42:52.190143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:40:22.690954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328020+0000","last_change":"2024-03-23T23:42:50.759792+0000","last_active":"2024-03-23T23:42:52.328020+0000","last_peered":"2024-03-23T23:42:52.328020+0000","last_clean":"2024-03-23T23:42:52.328020+0000","last_became_active":"2024-03-23T23:42:50.759604+0000","last_became_peered":"2024-03-23T23:42:50.759604+0000","last_unstale":"2024-03-23T23:42:52.328020+0000","last_undegraded":"2024-03-23T23:42:52.328020+0000","last_fullsized":"2024-03-23T23:42:52.328020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:15:25.617521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749937+0000","last_change":"2024-03-23T23:42:40.690961+0000","last_active":"2024-03-23T23:42:51.749937+0000","last_peered":"2024-03-23T23:42:51.749937+0000","last_clean":"2024-03-23T23:42:51.749937+0000","last_became_active":"2024-03-23T23:42:40.690690+0000","last_became_peered":"2024-03-23T23:42:40.690690+0000","last_unstale":"2024-03-23T23:42:51.749937+0000","last_undegraded":"2024-03-23T23:42:51.749937+0000","last_fullsized":"2024-03-23T23:42:51.749937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:56.763759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.762557+0000","last_change":"2024-03-23T23:42:50.764821+0000","last_active":"2024-03-23T23:42:51.762557+0000","last_peered":"2024-03-23T23:42:51.762557+0000","last_clean":"2024-03-23T23:42:51.762557+0000","last_became_active":"2024-03-23T23:42:50.764563+0000","last_became_peered":"2024-03-23T23:42:50.764563+0000","last_unstale":"2024-03-23T23:42:51.762557+0000","last_undegraded":"2024-03-23T23:42:51.762557+0000","last_fullsized":"2024-03-23T23:42:51.762557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:48:24.982671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.329026+0000","last_change":"2024-03-23T23:42:40.708540+0000","last_active":"2024-03-23T23:42:52.329026+0000","last_peered":"2024-03-23T23:42:52.329026+0000","last_clean":"2024-03-23T23:42:52.329026+0000","last_became_active":"2024-03-23T23:42:40.708031+0000","last_became_peered":"2024-03-23T23:42:40.708031+0000","last_unstale":"2024-03-23T23:42:52.329026+0000","last_undegraded":"2024-03-23T23:42:52.329026+0000","last_fullsized":"2024-03-23T23:42:52.329026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:44:03.386124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766736+0000","last_change":"2024-03-23T23:42:50.771062+0000","last_active":"2024-03-23T23:42:51.766736+0000","last_peered":"2024-03-23T23:42:51.766736+0000","last_clean":"2024-03-23T23:42:51.766736+0000","last_became_active":"2024-03-23T23:42:50.770790+0000","last_became_peered":"2024-03-23T23:42:50.770790+0000","last_unstale":"2024-03-23T23:42:51.766736+0000","last_undegraded":"2024-03-23T23:42:51.766736+0000","last_fullsized":"2024-03-23T23:42:51.766736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:13:07.156401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328080+0000","last_change":"2024-03-23T23:42:40.697920+0000","last_active":"2024-03-23T23:42:52.328080+0000","last_peered":"2024-03-23T23:42:52.328080+0000","last_clean":"2024-03-23T23:42:52.328080+0000","last_became_active":"2024-03-23T23:42:40.697694+0000","last_became_peered":"2024-03-23T23:42:40.697694+0000","last_unstale":"2024-03-23T23:42:52.328080+0000","last_undegraded":"2024-03-23T23:42:52.328080+0000","last_fullsized":"2024-03-23T23:42:52.328080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752567+0000","last_change":"2024-03-23T23:42:50.751694+0000","last_active":"2024-03-23T23:42:51.752567+0000","last_peered":"2024-03-23T23:42:51.752567+0000","last_clean":"2024-03-23T23:42:51.752567+0000","last_became_active":"2024-03-23T23:42:50.751452+0000","last_became_peered":"2024-03-23T23:42:50.751452+0000","last_unstale":"2024-03-23T23:42:51.752567+0000","last_undegraded":"2024-03-23T23:42:51.752567+0000","last_fullsized":"2024-03-23T23:42:51.752567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:57:49.981068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767129+0000","last_change":"2024-03-23T23:42:40.681928+0000","last_active":"2024-03-23T23:42:51.767129+0000","last_peered":"2024-03-23T23:42:51.767129+0000","last_clean":"2024-03-23T23:42:51.767129+0000","last_became_active":"2024-03-23T23:42:40.681337+0000","last_became_peered":"2024-03-23T23:42:40.681337+0000","last_unstale":"2024-03-23T23:42:51.767129+0000","last_undegraded":"2024-03-23T23:42:51.767129+0000","last_fullsized":"2024-03-23T23:42:51.767129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:52.220411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328332+0000","last_change":"2024-03-23T23:42:50.769003+0000","last_active":"2024-03-23T23:42:52.328332+0000","last_peered":"2024-03-23T23:42:52.328332+0000","last_clean":"2024-03-23T23:42:52.328332+0000","last_became_active":"2024-03-23T23:42:50.768695+0000","last_became_peered":"2024-03-23T23:42:50.768695+0000","last_unstale":"2024-03-23T23:42:52.328332+0000","last_undegraded":"2024-03-23T23:42:52.328332+0000","last_fullsized":"2024-03-23T23:42:52.328332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:17:11.847056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.762577+0000","last_change":"2024-03-23T23:42:40.680934+0000","last_active":"2024-03-23T23:42:51.762577+0000","last_peered":"2024-03-23T23:42:51.762577+0000","last_clean":"2024-03-23T23:42:51.762577+0000","last_became_active":"2024-03-23T23:42:40.680643+0000","last_became_peered":"2024-03-23T23:42:40.680643+0000","last_unstale":"2024-03-23T23:42:51.762577+0000","last_undegraded":"2024-03-23T23:42:51.762577+0000","last_fullsized":"2024-03-23T23:42:51.762577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:34.630671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189908+0000","last_change":"2024-03-23T23:42:50.762401+0000","last_active":"2024-03-23T23:42:52.189908+0000","last_peered":"2024-03-23T23:42:52.189908+0000","last_clean":"2024-03-23T23:42:52.189908+0000","last_became_active":"2024-03-23T23:42:50.762183+0000","last_became_peered":"2024-03-23T23:42:50.762183+0000","last_unstale":"2024-03-23T23:42:52.189908+0000","last_undegraded":"2024-03-23T23:42:52.189908+0000","last_fullsized":"2024-03-23T23:42:52.189908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:13:10.497921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327888+0000","last_change":"2024-03-23T23:42:40.682736+0000","last_active":"2024-03-23T23:42:52.327888+0000","last_peered":"2024-03-23T23:42:52.327888+0000","last_clean":"2024-03-23T23:42:52.327888+0000","last_became_active":"2024-03-23T23:42:40.682410+0000","last_became_peered":"2024-03-23T23:42:40.682410+0000","last_unstale":"2024-03-23T23:42:52.327888+0000","last_undegraded":"2024-03-23T23:42:52.327888+0000","last_fullsized":"2024-03-23T23:42:52.327888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:01:06.338641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327793+0000","last_change":"2024-03-23T23:42:50.749204+0000","last_active":"2024-03-23T23:42:52.327793+0000","last_peered":"2024-03-23T23:42:52.327793+0000","last_clean":"2024-03-23T23:42:52.327793+0000","last_became_active":"2024-03-23T23:42:50.748809+0000","last_became_peered":"2024-03-23T23:42:50.748809+0000","last_unstale":"2024-03-23T23:42:52.327793+0000","last_undegraded":"2024-03-23T23:42:52.327793+0000","last_fullsized":"2024-03-23T23:42:52.327793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:39:49.888359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752151+0000","last_change":"2024-03-23T23:42:40.682523+0000","last_active":"2024-03-23T23:42:51.752151+0000","last_peered":"2024-03-23T23:42:51.752151+0000","last_clean":"2024-03-23T23:42:51.752151+0000","last_became_active":"2024-03-23T23:42:40.682155+0000","last_became_peered":"2024-03-23T23:42:40.682155+0000","last_unstale":"2024-03-23T23:42:51.752151+0000","last_undegraded":"2024-03-23T23:42:51.752151+0000","last_fullsized":"2024-03-23T23:42:51.752151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:33.260151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749469+0000","last_change":"2024-03-23T23:42:50.746115+0000","last_active":"2024-03-23T23:42:51.749469+0000","last_peered":"2024-03-23T23:42:51.749469+0000","last_clean":"2024-03-23T23:42:51.749469+0000","last_became_active":"2024-03-23T23:42:50.745858+0000","last_became_peered":"2024-03-23T23:42:50.745858+0000","last_unstale":"2024-03-23T23:42:51.749469+0000","last_undegraded":"2024-03-23T23:42:51.749469+0000","last_fullsized":"2024-03-23T23:42:51.749469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:00:43.318455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752280+0000","last_change":"2024-03-23T23:42:40.702089+0000","last_active":"2024-03-23T23:42:51.752280+0000","last_peered":"2024-03-23T23:42:51.752280+0000","last_clean":"2024-03-23T23:42:51.752280+0000","last_became_active":"2024-03-23T23:42:40.701874+0000","last_became_peered":"2024-03-23T23:42:40.701874+0000","last_unstale":"2024-03-23T23:42:51.752280+0000","last_undegraded":"2024-03-23T23:42:51.752280+0000","last_fullsized":"2024-03-23T23:42:51.752280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189853+0000","last_change":"2024-03-23T23:42:50.773115+0000","last_active":"2024-03-23T23:42:52.189853+0000","last_peered":"2024-03-23T23:42:52.189853+0000","last_clean":"2024-03-23T23:42:52.189853+0000","last_became_active":"2024-03-23T23:42:50.772849+0000","last_became_peered":"2024-03-23T23:42:50.772849+0000","last_unstale":"2024-03-23T23:42:52.189853+0000","last_undegraded":"2024-03-23T23:42:52.189853+0000","last_fullsized":"2024-03-23T23:42:52.189853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:29:42.898728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752487+0000","last_change":"2024-03-23T23:42:40.703254+0000","last_active":"2024-03-23T23:42:51.752487+0000","last_peered":"2024-03-23T23:42:51.752487+0000","last_clean":"2024-03-23T23:42:51.752487+0000","last_became_active":"2024-03-23T23:42:40.702447+0000","last_became_peered":"2024-03-23T23:42:40.702447+0000","last_unstale":"2024-03-23T23:42:51.752487+0000","last_undegraded":"2024-03-23T23:42:51.752487+0000","last_fullsized":"2024-03-23T23:42:51.752487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:59:45.154553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328157+0000","last_change":"2024-03-23T23:42:50.748946+0000","last_active":"2024-03-23T23:42:52.328157+0000","last_peered":"2024-03-23T23:42:52.328157+0000","last_clean":"2024-03-23T23:42:52.328157+0000","last_became_active":"2024-03-23T23:42:50.745205+0000","last_became_peered":"2024-03-23T23:42:50.745205+0000","last_unstale":"2024-03-23T23:42:52.328157+0000","last_undegraded":"2024-03-23T23:42:52.328157+0000","last_fullsized":"2024-03-23T23:42:52.328157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:58:16.372010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190250+0000","last_change":"2024-03-23T23:42:40.714331+0000","last_active":"2024-03-23T23:42:52.190250+0000","last_peered":"2024-03-23T23:42:52.190250+0000","last_clean":"2024-03-23T23:42:52.190250+0000","last_became_active":"2024-03-23T23:42:40.713737+0000","last_became_peered":"2024-03-23T23:42:40.713737+0000","last_unstale":"2024-03-23T23:42:52.190250+0000","last_undegraded":"2024-03-23T23:42:52.190250+0000","last_fullsized":"2024-03-23T23:42:52.190250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:24:43.902129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328361+0000","last_change":"2024-03-23T23:42:50.746666+0000","last_active":"2024-03-23T23:42:52.328361+0000","last_peered":"2024-03-23T23:42:52.328361+0000","last_clean":"2024-03-23T23:42:52.328361+0000","last_became_active":"2024-03-23T23:42:50.746149+0000","last_became_peered":"2024-03-23T23:42:50.746149+0000","last_unstale":"2024-03-23T23:42:52.328361+0000","last_undegraded":"2024-03-23T23:42:52.328361+0000","last_fullsized":"2024-03-23T23:42:52.328361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:42:58.533499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327499+0000","last_change":"2024-03-23T23:42:40.710655+0000","last_active":"2024-03-23T23:42:52.327499+0000","last_peered":"2024-03-23T23:42:52.327499+0000","last_clean":"2024-03-23T23:42:52.327499+0000","last_became_active":"2024-03-23T23:42:40.710362+0000","last_became_peered":"2024-03-23T23:42:40.710362+0000","last_unstale":"2024-03-23T23:42:52.327499+0000","last_undegraded":"2024-03-23T23:42:52.327499+0000","last_fullsized":"2024-03-23T23:42:52.327499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:12:14.359173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752890+0000","last_change":"2024-03-23T23:42:50.753397+0000","last_active":"2024-03-23T23:42:51.752890+0000","last_peered":"2024-03-23T23:42:51.752890+0000","last_clean":"2024-03-23T23:42:51.752890+0000","last_became_active":"2024-03-23T23:42:50.753085+0000","last_became_peered":"2024-03-23T23:42:50.753085+0000","last_unstale":"2024-03-23T23:42:51.752890+0000","last_undegraded":"2024-03-23T23:42:51.752890+0000","last_fullsized":"2024-03-23T23:42:51.752890+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:25:44.894505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189509+0000","last_change":"2024-03-23T23:42:40.689380+0000","last_active":"2024-03-23T23:42:52.189509+0000","last_peered":"2024-03-23T23:42:52.189509+0000","last_clean":"2024-03-23T23:42:52.189509+0000","last_became_active":"2024-03-23T23:42:40.689023+0000","last_became_peered":"2024-03-23T23:42:40.689023+0000","last_unstale":"2024-03-23T23:42:52.189509+0000","last_undegraded":"2024-03-23T23:42:52.189509+0000","last_fullsized":"2024-03-23T23:42:52.189509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:17:19.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766610+0000","last_change":"2024-03-23T23:42:50.756133+0000","last_active":"2024-03-23T23:42:51.766610+0000","last_peered":"2024-03-23T23:42:51.766610+0000","last_clean":"2024-03-23T23:42:51.766610+0000","last_became_active":"2024-03-23T23:42:50.755405+0000","last_became_peered":"2024-03-23T23:42:50.755405+0000","last_unstale":"2024-03-23T23:42:51.766610+0000","last_undegraded":"2024-03-23T23:42:51.766610+0000","last_fullsized":"2024-03-23T23:42:51.766610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:46:10.784416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328292+0000","last_change":"2024-03-23T23:42:40.698234+0000","last_active":"2024-03-23T23:42:52.328292+0000","last_peered":"2024-03-23T23:42:52.328292+0000","last_clean":"2024-03-23T23:42:52.328292+0000","last_became_active":"2024-03-23T23:42:40.695978+0000","last_became_peered":"2024-03-23T23:42:40.695978+0000","last_unstale":"2024-03-23T23:42:52.328292+0000","last_undegraded":"2024-03-23T23:42:52.328292+0000","last_fullsized":"2024-03-23T23:42:52.328292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:04.633288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328907+0000","last_change":"2024-03-23T23:42:50.752051+0000","last_active":"2024-03-23T23:42:52.328907+0000","last_peered":"2024-03-23T23:42:52.328907+0000","last_clean":"2024-03-23T23:42:52.328907+0000","last_became_active":"2024-03-23T23:42:50.751738+0000","last_became_peered":"2024-03-23T23:42:50.751738+0000","last_unstale":"2024-03-23T23:42:52.328907+0000","last_undegraded":"2024-03-23T23:42:52.328907+0000","last_fullsized":"2024-03-23T23:42:52.328907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:20:53.750917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189626+0000","last_change":"2024-03-23T23:42:40.698407+0000","last_active":"2024-03-23T23:42:52.189626+0000","last_peered":"2024-03-23T23:42:52.189626+0000","last_clean":"2024-03-23T23:42:52.189626+0000","last_became_active":"2024-03-23T23:42:40.698092+0000","last_became_peered":"2024-03-23T23:42:40.698092+0000","last_unstale":"2024-03-23T23:42:52.189626+0000","last_undegraded":"2024-03-23T23:42:52.189626+0000","last_fullsized":"2024-03-23T23:42:52.189626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:00:33.261296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327627+0000","last_change":"2024-03-23T23:42:50.753000+0000","last_active":"2024-03-23T23:42:52.327627+0000","last_peered":"2024-03-23T23:42:52.327627+0000","last_clean":"2024-03-23T23:42:52.327627+0000","last_became_active":"2024-03-23T23:42:50.752614+0000","last_became_peered":"2024-03-23T23:42:50.752614+0000","last_unstale":"2024-03-23T23:42:52.327627+0000","last_undegraded":"2024-03-23T23:42:52.327627+0000","last_fullsized":"2024-03-23T23:42:52.327627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:57:04.394872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328439+0000","last_change":"2024-03-23T23:42:40.700631+0000","last_active":"2024-03-23T23:42:52.328439+0000","last_peered":"2024-03-23T23:42:52.328439+0000","last_clean":"2024-03-23T23:42:52.328439+0000","last_became_active":"2024-03-23T23:42:40.697932+0000","last_became_peered":"2024-03-23T23:42:40.697932+0000","last_unstale":"2024-03-23T23:42:52.328439+0000","last_undegraded":"2024-03-23T23:42:52.328439+0000","last_fullsized":"2024-03-23T23:42:52.328439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:05:17.694245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749336+0000","last_change":"2024-03-23T23:42:50.765991+0000","last_active":"2024-03-23T23:42:51.749336+0000","last_peered":"2024-03-23T23:42:51.749336+0000","last_clean":"2024-03-23T23:42:51.749336+0000","last_became_active":"2024-03-23T23:42:50.765716+0000","last_became_peered":"2024-03-23T23:42:50.765716+0000","last_unstale":"2024-03-23T23:42:51.749336+0000","last_undegraded":"2024-03-23T23:42:51.749336+0000","last_fullsized":"2024-03-23T23:42:51.749336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:49:52.067143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763373+0000","last_change":"2024-03-23T23:42:40.683983+0000","last_active":"2024-03-23T23:42:51.763373+0000","last_peered":"2024-03-23T23:42:51.763373+0000","last_clean":"2024-03-23T23:42:51.763373+0000","last_became_active":"2024-03-23T23:42:40.683711+0000","last_became_peered":"2024-03-23T23:42:40.683711+0000","last_unstale":"2024-03-23T23:42:51.763373+0000","last_undegraded":"2024-03-23T23:42:51.763373+0000","last_fullsized":"2024-03-23T23:42:51.763373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:51:30.695597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189321+0000","last_change":"2024-03-23T23:42:50.766544+0000","last_active":"2024-03-23T23:42:52.189321+0000","last_peered":"2024-03-23T23:42:52.189321+0000","last_clean":"2024-03-23T23:42:52.189321+0000","last_became_active":"2024-03-23T23:42:50.766328+0000","last_became_peered":"2024-03-23T23:42:50.766328+0000","last_unstale":"2024-03-23T23:42:52.189321+0000","last_undegraded":"2024-03-23T23:42:52.189321+0000","last_fullsized":"2024-03-23T23:42:52.189321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:28:43.677331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766986+0000","last_change":"2024-03-23T23:42:40.678622+0000","last_active":"2024-03-23T23:42:51.766986+0000","last_peered":"2024-03-23T23:42:51.766986+0000","last_clean":"2024-03-23T23:42:51.766986+0000","last_became_active":"2024-03-23T23:42:40.678325+0000","last_became_peered":"2024-03-23T23:42:40.678325+0000","last_unstale":"2024-03-23T23:42:51.766986+0000","last_undegraded":"2024-03-23T23:42:51.766986+0000","last_fullsized":"2024-03-23T23:42:51.766986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:54:27.641281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189432+0000","last_change":"2024-03-23T23:42:50.750690+0000","last_active":"2024-03-23T23:42:52.189432+0000","last_peered":"2024-03-23T23:42:52.189432+0000","last_clean":"2024-03-23T23:42:52.189432+0000","last_became_active":"2024-03-23T23:42:50.750466+0000","last_became_peered":"2024-03-23T23:42:50.750466+0000","last_unstale":"2024-03-23T23:42:52.189432+0000","last_undegraded":"2024-03-23T23:42:52.189432+0000","last_fullsized":"2024-03-23T23:42:52.189432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:13:07.156401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190227+0000","last_change":"2024-03-23T23:42:40.701959+0000","last_active":"2024-03-23T23:42:52.190227+0000","last_peered":"2024-03-23T23:42:52.190227+0000","last_clean":"2024-03-23T23:42:52.190227+0000","last_became_active":"2024-03-23T23:42:40.700855+0000","last_became_peered":"2024-03-23T23:42:40.700855+0000","last_unstale":"2024-03-23T23:42:52.190227+0000","last_undegraded":"2024-03-23T23:42:52.190227+0000","last_fullsized":"2024-03-23T23:42:52.190227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:49:42.009983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2664,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2664,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":103704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":101984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":101452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":286720,"data_stored":104976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":692262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542157,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":262144,"data_stored":101292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":282624,"data_stored":103016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542157,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":864256,"data_stored":692228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T23:43:19.853 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T23:43:20.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.028+0000 7f6f9ce00640 1 Processor -- start 2024-03-23T23:43:20.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.028+0000 7f6f9ce00640 1 -- start start 2024-03-23T23:43:20.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.028+0000 7f6f9ce00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6f9806df70 0x7f6f9806ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:20.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.028+0000 7f6f9ce00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f980c3780 0x7f6f9814f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:20.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.028+0000 7f6f9ce00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f98155450 con 0x7f6f9814f5b0 2024-03-23T23:43:20.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.028+0000 7f6f9ce00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f98155730 con 0x7f6f9806df70 2024-03-23T23:43:20.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.028+0000 7f6f9ce00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f98155a10 con 0x7f6f980c3780 2024-03-23T23:43:20.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.028+0000 7f6f96800640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f6f9814f5b0 0x7f6f98152230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48114/0 (socket says 172.21.15.8:48114) 2024-03-23T23:43:20.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.028+0000 7f6f96800640 1 -- 172.21.15.8:0/254946468 learned_addr learned my addr 172.21.15.8:0/254946468 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:43:20.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.028+0000 7f6f8d400640 1 --2- 172.21.15.8:0/254946468 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f980c3780 0x7f6f9814f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:20.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.028+0000 7f6f95e00640 1 --2- 172.21.15.8:0/254946468 >> v2:172.21.15.196:3300/0 conn(0x7f6f9806df70 0x7f6f9806ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:20.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.028+0000 7f6f95400640 1 -- 172.21.15.8:0/254946468 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 188692367 0 0) 0x7f6f98155450 con 0x7f6f9814f5b0 2024-03-23T23:43:20.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.028+0000 7f6f95400640 1 -- 172.21.15.8:0/254946468 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f7c003530 con 0x7f6f9814f5b0 2024-03-23T23:43:20.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.028+0000 7f6f8d400640 1 -- 172.21.15.8:0/254946468 >> v2:172.21.15.196:3300/0 conn(0x7f6f9806df70 msgr2=0x7f6f9806ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:20.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.028+0000 7f6f8d400640 1 --2- 172.21.15.8:0/254946468 >> v2:172.21.15.196:3300/0 conn(0x7f6f9806df70 0x7f6f9806ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:20.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.028+0000 7f6f8d400640 1 -- 172.21.15.8:0/254946468 >> v1:172.21.15.8:6789/0 conn(0x7f6f9814f5b0 legacy=0x7f6f98152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:20.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.028+0000 7f6f8d400640 1 -- 172.21.15.8:0/254946468 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f98155cf0 con 0x7f6f980c3780 2024-03-23T23:43:20.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.032+0000 7f6f8d400640 1 --2- 172.21.15.8:0/254946468 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f980c3780 0x7f6f9814f070 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6f800097c0 tx=0x7f6f8001c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e27ab64642e55e9 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:20.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.032+0000 7f6f95400640 1 -- 172.21.15.8:0/254946468 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f800b0070 con 0x7f6f980c3780 2024-03-23T23:43:20.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.032+0000 7f6f95400640 1 -- 172.21.15.8:0/254946468 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f800ab600 con 0x7f6f980c3780 2024-03-23T23:43:20.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.032+0000 7f6f95400640 1 -- 172.21.15.8:0/254946468 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f800ab9d0 con 0x7f6f980c3780 2024-03-23T23:43:20.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.032+0000 7f6f9ce00640 1 -- 172.21.15.8:0/254946468 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f980c3780 msgr2=0x7f6f9814f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:20.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.032+0000 7f6f9ce00640 1 --2- 172.21.15.8:0/254946468 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f980c3780 0x7f6f9814f070 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6f800097c0 tx=0x7f6f8001c380 comp rx=0 tx=0).stop 2024-03-23T23:43:20.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.032+0000 7f6f9ce00640 1 -- 172.21.15.8:0/254946468 shutdown_connections 2024-03-23T23:43:20.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.032+0000 7f6f9ce00640 1 --2- 172.21.15.8:0/254946468 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f980c3780 0x7f6f9814f070 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:20.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.032+0000 7f6f9ce00640 1 --2- 172.21.15.8:0/254946468 >> v2:172.21.15.196:3300/0 conn(0x7f6f9806df70 0x7f6f9806ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:20.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.032+0000 7f6f9ce00640 1 -- 172.21.15.8:0/254946468 >> 172.21.15.8:0/254946468 conn(0x7f6f9806b170 msgr2=0x7f6f9806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:20.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.036+0000 7f6f9ce00640 1 -- 172.21.15.8:0/254946468 shutdown_connections 2024-03-23T23:43:20.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.036+0000 7f6f9ce00640 1 -- 172.21.15.8:0/254946468 wait complete. 2024-03-23T23:43:20.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.036+0000 7f6f9ce00640 1 Processor -- start 2024-03-23T23:43:20.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.036+0000 7f6f9ce00640 1 -- start start 2024-03-23T23:43:20.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.040+0000 7f6f9ce00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f9806df70 0x7f6f98147e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:20.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.040+0000 7f6f9ce00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f980c3780 0x7f6f981f17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:20.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.040+0000 7f6f9ce00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6f9814f5b0 0x7f6f98143620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:20.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.040+0000 7f6f9ce00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9806e4d0 con 0x7f6f980c3780 2024-03-23T23:43:20.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.040+0000 7f6f9ce00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9806e350 con 0x7f6f9814f5b0 2024-03-23T23:43:20.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.040+0000 7f6f9ce00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9815c780 con 0x7f6f9806df70 2024-03-23T23:43:20.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.040+0000 7f6f8d400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f980c3780 0x7f6f981f17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:20.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.040+0000 7f6f8d400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f980c3780 0x7f6f981f17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54790/0 (socket says 172.21.15.8:54790) 2024-03-23T23:43:20.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.040+0000 7f6f8d400640 1 -- 172.21.15.8:0/633889562 learned_addr learned my addr 172.21.15.8:0/633889562 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:20.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.040+0000 7f6f95e00640 1 --2- 172.21.15.8:0/633889562 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f9806df70 0x7f6f98147e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:20.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.040+0000 7f6f96800640 1 --2- 172.21.15.8:0/633889562 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6f9814f5b0 0x7f6f98143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:20.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.040+0000 7f6f8d400640 1 -- 172.21.15.8:0/633889562 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f9806df70 msgr2=0x7f6f98147e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:20.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.040+0000 7f6f8d400640 1 --2- 172.21.15.8:0/633889562 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f9806df70 0x7f6f98147e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:20.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.040+0000 7f6f8d400640 1 -- 172.21.15.8:0/633889562 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6f9814f5b0 msgr2=0x7f6f98143620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:20.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.040+0000 7f6f8d400640 1 --2- 172.21.15.8:0/633889562 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6f9814f5b0 0x7f6f98143620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:20.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.040+0000 7f6f8d400640 1 -- 172.21.15.8:0/633889562 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f98148350 con 0x7f6f980c3780 2024-03-23T23:43:20.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.040+0000 7f6f8d400640 1 --2- 172.21.15.8:0/633889562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f980c3780 0x7f6f981f17d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6f800ae040 tx=0x7f6f80019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:20.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.040+0000 7f6f8ea00640 1 -- 172.21.15.8:0/633889562 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f800b0040 con 0x7f6f980c3780 2024-03-23T23:43:20.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.040+0000 7f6f8ea00640 1 -- 172.21.15.8:0/633889562 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f800b9070 con 0x7f6f980c3780 2024-03-23T23:43:20.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.040+0000 7f6f8ea00640 1 -- 172.21.15.8:0/633889562 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f800b4690 con 0x7f6f980c3780 2024-03-23T23:43:20.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.040+0000 7f6f9ce00640 1 -- 172.21.15.8:0/633889562 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f9814ea30 con 0x7f6f980c3780 2024-03-23T23:43:20.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.040+0000 7f6f9ce00640 1 -- 172.21.15.8:0/633889562 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f981532f0 con 0x7f6f980c3780 2024-03-23T23:43:20.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.040+0000 7f6f9ce00640 1 -- 172.21.15.8:0/633889562 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f98068270 con 0x7f6f980c3780 2024-03-23T23:43:20.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.040+0000 7f6f8ea00640 1 -- 172.21.15.8:0/633889562 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f6f800b4830 con 0x7f6f980c3780 2024-03-23T23:43:20.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.044+0000 7f6f8ea00640 1 --2- 172.21.15.8:0/633889562 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6f74067660 0x7f6f74069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:20.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.044+0000 7f6f8ea00640 1 -- 172.21.15.8:0/633889562 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f6f8011f820 con 0x7f6f980c3780 2024-03-23T23:43:20.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.044+0000 7f6f95e00640 1 --2- 172.21.15.8:0/633889562 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6f74067660 0x7f6f74069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:20.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.044+0000 7f6f95e00640 1 --2- 172.21.15.8:0/633889562 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6f74067660 0x7f6f74069b20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009b60 tx=0x7f6f88009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:20.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.048+0000 7f6f8ea00640 1 -- 172.21.15.8:0/633889562 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f6f80016090 con 0x7f6f980c3780 2024-03-23T23:43:20.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.216+0000 7f6f9ce00640 1 -- 172.21.15.8:0/633889562 --> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f98147b70 con 0x7f6f74067660 2024-03-23T23:43:20.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.232+0000 7f6f8ea00640 1 -- 172.21.15.8:0/633889562 <== mgr.4098 v2:172.21.15.196:6832/1295060067 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+490301 (secure 0 0 0) 0x7f6f98147b70 con 0x7f6f74067660 2024-03-23T23:43:20.241 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:43:20.244 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-03-23T23:43:20.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.236+0000 7f6f9ce00640 1 -- 172.21.15.8:0/633889562 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6f74067660 msgr2=0x7f6f74069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:20.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.236+0000 7f6f9ce00640 1 --2- 172.21.15.8:0/633889562 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6f74067660 0x7f6f74069b20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009b60 tx=0x7f6f88009190 comp rx=0 tx=0).stop 2024-03-23T23:43:20.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.236+0000 7f6f9ce00640 1 -- 172.21.15.8:0/633889562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f980c3780 msgr2=0x7f6f981f17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:20.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.236+0000 7f6f9ce00640 1 --2- 172.21.15.8:0/633889562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f980c3780 0x7f6f981f17d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6f800ae040 tx=0x7f6f80019120 comp rx=0 tx=0).stop 2024-03-23T23:43:20.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.236+0000 7f6f9ce00640 1 -- 172.21.15.8:0/633889562 shutdown_connections 2024-03-23T23:43:20.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.236+0000 7f6f9ce00640 1 --2- 172.21.15.8:0/633889562 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6f9814f5b0 0x7f6f98143620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:20.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.236+0000 7f6f9ce00640 1 --2- 172.21.15.8:0/633889562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f980c3780 0x7f6f981f17d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:20.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.236+0000 7f6f9ce00640 1 --2- 172.21.15.8:0/633889562 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6f74067660 0x7f6f74069b20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:20.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.236+0000 7f6f9ce00640 1 --2- 172.21.15.8:0/633889562 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f9806df70 0x7f6f98147e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:20.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.240+0000 7f6f9ce00640 1 -- 172.21.15.8:0/633889562 >> 172.21.15.8:0/633889562 conn(0x7f6f9806b170 msgr2=0x7f6f98071020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:20.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.240+0000 7f6f9ce00640 1 -- 172.21.15.8:0/633889562 shutdown_connections 2024-03-23T23:43:20.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.240+0000 7f6f9ce00640 1 -- 172.21.15.8:0/633889562 wait complete. 2024-03-23T23:43:20.261 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-03-23T23:43:18.280471+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595696,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":253,"num_write_kb":2448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240272,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734448,"statfs":{"total":773094113280,"available":772848074752,"internally_reserved":0,"allocated":3383296,"data_stored":2000914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":508,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002583"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750876+0000","last_change":"2024-03-23T23:42:50.736219+0000","last_active":"2024-03-23T23:42:51.750876+0000","last_peered":"2024-03-23T23:42:51.750876+0000","last_clean":"2024-03-23T23:42:51.750876+0000","last_became_active":"2024-03-23T23:42:50.735940+0000","last_became_peered":"2024-03-23T23:42:50.735940+0000","last_unstale":"2024-03-23T23:42:51.750876+0000","last_undegraded":"2024-03-23T23:42:51.750876+0000","last_fullsized":"2024-03-23T23:42:51.750876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:11:44.111477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763488+0000","last_change":"2024-03-23T23:42:39.693858+0000","last_active":"2024-03-23T23:42:51.763488+0000","last_peered":"2024-03-23T23:42:51.763488+0000","last_clean":"2024-03-23T23:42:51.763488+0000","last_became_active":"2024-03-23T23:42:39.693636+0000","last_became_peered":"2024-03-23T23:42:39.693636+0000","last_unstale":"2024-03-23T23:42:51.763488+0000","last_undegraded":"2024-03-23T23:42:51.763488+0000","last_fullsized":"2024-03-23T23:42:51.763488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:44:07.213123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328567+0000","last_change":"2024-03-23T23:42:40.685708+0000","last_active":"2024-03-23T23:42:52.328567+0000","last_peered":"2024-03-23T23:42:52.328567+0000","last_clean":"2024-03-23T23:42:52.328567+0000","last_became_active":"2024-03-23T23:42:40.682755+0000","last_became_peered":"2024-03-23T23:42:40.682755+0000","last_unstale":"2024-03-23T23:42:52.328567+0000","last_undegraded":"2024-03-23T23:42:52.328567+0000","last_fullsized":"2024-03-23T23:42:52.328567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:04.633288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327590+0000","last_change":"2024-03-23T23:42:49.750108+0000","last_active":"2024-03-23T23:42:52.327590+0000","last_peered":"2024-03-23T23:42:52.327590+0000","last_clean":"2024-03-23T23:42:52.327590+0000","last_became_active":"2024-03-23T23:42:49.749634+0000","last_became_peered":"2024-03-23T23:42:49.749634+0000","last_unstale":"2024-03-23T23:42:52.327590+0000","last_undegraded":"2024-03-23T23:42:52.327590+0000","last_fullsized":"2024-03-23T23:42:52.327590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:49:16.758908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766376+0000","last_change":"2024-03-23T23:42:50.752450+0000","last_active":"2024-03-23T23:42:51.766376+0000","last_peered":"2024-03-23T23:42:51.766376+0000","last_clean":"2024-03-23T23:42:51.766376+0000","last_became_active":"2024-03-23T23:42:50.752078+0000","last_became_peered":"2024-03-23T23:42:50.752078+0000","last_unstale":"2024-03-23T23:42:51.766376+0000","last_undegraded":"2024-03-23T23:42:51.766376+0000","last_fullsized":"2024-03-23T23:42:51.766376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:28:43.677331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328677+0000","last_change":"2024-03-23T23:42:39.687108+0000","last_active":"2024-03-23T23:42:52.328677+0000","last_peered":"2024-03-23T23:42:52.328677+0000","last_clean":"2024-03-23T23:42:52.328677+0000","last_became_active":"2024-03-23T23:42:39.686875+0000","last_became_peered":"2024-03-23T23:42:39.686875+0000","last_unstale":"2024-03-23T23:42:52.328677+0000","last_undegraded":"2024-03-23T23:42:52.328677+0000","last_fullsized":"2024-03-23T23:42:52.328677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:05:52.079172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763410+0000","last_change":"2024-03-23T23:42:40.698746+0000","last_active":"2024-03-23T23:42:51.763410+0000","last_peered":"2024-03-23T23:42:51.763410+0000","last_clean":"2024-03-23T23:42:51.763410+0000","last_became_active":"2024-03-23T23:42:40.698003+0000","last_became_peered":"2024-03-23T23:42:40.698003+0000","last_unstale":"2024-03-23T23:42:51.763410+0000","last_undegraded":"2024-03-23T23:42:51.763410+0000","last_fullsized":"2024-03-23T23:42:51.763410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:53:46.437114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751376+0000","last_change":"2024-03-23T23:42:49.728923+0000","last_active":"2024-03-23T23:42:51.751376+0000","last_peered":"2024-03-23T23:42:51.751376+0000","last_clean":"2024-03-23T23:42:51.751376+0000","last_became_active":"2024-03-23T23:42:49.728261+0000","last_became_peered":"2024-03-23T23:42:49.728261+0000","last_unstale":"2024-03-23T23:42:51.751376+0000","last_undegraded":"2024-03-23T23:42:51.751376+0000","last_fullsized":"2024-03-23T23:42:51.751376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:22.375891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189476+0000","last_change":"2024-03-23T23:42:50.755852+0000","last_active":"2024-03-23T23:42:52.189476+0000","last_peered":"2024-03-23T23:42:52.189476+0000","last_clean":"2024-03-23T23:42:52.189476+0000","last_became_active":"2024-03-23T23:42:50.755600+0000","last_became_peered":"2024-03-23T23:42:50.755600+0000","last_unstale":"2024-03-23T23:42:52.189476+0000","last_undegraded":"2024-03-23T23:42:52.189476+0000","last_fullsized":"2024-03-23T23:42:52.189476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:29:47.303374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190128+0000","last_change":"2024-03-23T23:42:39.696690+0000","last_active":"2024-03-23T23:42:52.190128+0000","last_peered":"2024-03-23T23:42:52.190128+0000","last_clean":"2024-03-23T23:42:52.190128+0000","last_became_active":"2024-03-23T23:42:39.696342+0000","last_became_peered":"2024-03-23T23:42:39.696342+0000","last_unstale":"2024-03-23T23:42:52.190128+0000","last_undegraded":"2024-03-23T23:42:52.190128+0000","last_fullsized":"2024-03-23T23:42:52.190128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:42:37.702720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328460+0000","last_change":"2024-03-23T23:42:40.700355+0000","last_active":"2024-03-23T23:42:52.328460+0000","last_peered":"2024-03-23T23:42:52.328460+0000","last_clean":"2024-03-23T23:42:52.328460+0000","last_became_active":"2024-03-23T23:42:40.697668+0000","last_became_peered":"2024-03-23T23:42:40.697668+0000","last_unstale":"2024-03-23T23:42:52.328460+0000","last_undegraded":"2024-03-23T23:42:52.328460+0000","last_fullsized":"2024-03-23T23:42:52.328460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:23:43.515519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751380+0000","last_change":"2024-03-23T23:42:49.744792+0000","last_active":"2024-03-23T23:42:51.751380+0000","last_peered":"2024-03-23T23:42:51.751380+0000","last_clean":"2024-03-23T23:42:51.751380+0000","last_became_active":"2024-03-23T23:42:49.744561+0000","last_became_peered":"2024-03-23T23:42:49.744561+0000","last_unstale":"2024-03-23T23:42:51.751380+0000","last_undegraded":"2024-03-23T23:42:51.751380+0000","last_fullsized":"2024-03-23T23:42:51.751380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:07:58.222020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328699+0000","last_change":"2024-03-23T23:42:50.755575+0000","last_active":"2024-03-23T23:42:52.328699+0000","last_peered":"2024-03-23T23:42:52.328699+0000","last_clean":"2024-03-23T23:42:52.328699+0000","last_became_active":"2024-03-23T23:42:50.755337+0000","last_became_peered":"2024-03-23T23:42:50.755337+0000","last_unstale":"2024-03-23T23:42:52.328699+0000","last_undegraded":"2024-03-23T23:42:52.328699+0000","last_fullsized":"2024-03-23T23:42:52.328699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:13.911327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189958+0000","last_change":"2024-03-23T23:42:39.696707+0000","last_active":"2024-03-23T23:42:52.189958+0000","last_peered":"2024-03-23T23:42:52.189958+0000","last_clean":"2024-03-23T23:42:52.189958+0000","last_became_active":"2024-03-23T23:42:39.696401+0000","last_became_peered":"2024-03-23T23:42:39.696401+0000","last_unstale":"2024-03-23T23:42:52.189958+0000","last_undegraded":"2024-03-23T23:42:52.189958+0000","last_fullsized":"2024-03-23T23:42:52.189958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:55.757707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328921+0000","last_change":"2024-03-23T23:42:40.700389+0000","last_active":"2024-03-23T23:42:52.328921+0000","last_peered":"2024-03-23T23:42:52.328921+0000","last_clean":"2024-03-23T23:42:52.328921+0000","last_became_active":"2024-03-23T23:42:40.699770+0000","last_became_peered":"2024-03-23T23:42:40.699770+0000","last_unstale":"2024-03-23T23:42:52.328921+0000","last_undegraded":"2024-03-23T23:42:52.328921+0000","last_fullsized":"2024-03-23T23:42:52.328921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:27.675824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751083+0000","last_change":"2024-03-23T23:42:49.745710+0000","last_active":"2024-03-23T23:42:51.751083+0000","last_peered":"2024-03-23T23:42:51.751083+0000","last_clean":"2024-03-23T23:42:51.751083+0000","last_became_active":"2024-03-23T23:42:49.745526+0000","last_became_peered":"2024-03-23T23:42:49.745526+0000","last_unstale":"2024-03-23T23:42:51.751083+0000","last_undegraded":"2024-03-23T23:42:51.751083+0000","last_fullsized":"2024-03-23T23:42:51.751083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:05:26.746849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766631+0000","last_change":"2024-03-23T23:42:50.747274+0000","last_active":"2024-03-23T23:42:51.766631+0000","last_peered":"2024-03-23T23:42:51.766631+0000","last_clean":"2024-03-23T23:42:51.766631+0000","last_became_active":"2024-03-23T23:42:50.746937+0000","last_became_peered":"2024-03-23T23:42:50.746937+0000","last_unstale":"2024-03-23T23:42:51.766631+0000","last_undegraded":"2024-03-23T23:42:51.766631+0000","last_fullsized":"2024-03-23T23:42:51.766631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:19.610436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751450+0000","last_change":"2024-03-23T23:42:40.682467+0000","last_active":"2024-03-23T23:42:51.751450+0000","last_peered":"2024-03-23T23:42:51.751450+0000","last_clean":"2024-03-23T23:42:51.751450+0000","last_became_active":"2024-03-23T23:42:40.682192+0000","last_became_peered":"2024-03-23T23:42:40.682192+0000","last_unstale":"2024-03-23T23:42:51.751450+0000","last_undegraded":"2024-03-23T23:42:51.751450+0000","last_fullsized":"2024-03-23T23:42:51.751450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:37:24.839568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189778+0000","last_change":"2024-03-23T23:42:39.696528+0000","last_active":"2024-03-23T23:42:52.189778+0000","last_peered":"2024-03-23T23:42:52.189778+0000","last_clean":"2024-03-23T23:42:52.189778+0000","last_became_active":"2024-03-23T23:42:39.696207+0000","last_became_peered":"2024-03-23T23:42:39.696207+0000","last_unstale":"2024-03-23T23:42:52.189778+0000","last_undegraded":"2024-03-23T23:42:52.189778+0000","last_fullsized":"2024-03-23T23:42:52.189778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:02.190910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751687+0000","last_change":"2024-03-23T23:42:49.734156+0000","last_active":"2024-03-23T23:42:51.751687+0000","last_peered":"2024-03-23T23:42:51.751687+0000","last_clean":"2024-03-23T23:42:51.751687+0000","last_became_active":"2024-03-23T23:42:49.733888+0000","last_became_peered":"2024-03-23T23:42:49.733888+0000","last_unstale":"2024-03-23T23:42:51.751687+0000","last_undegraded":"2024-03-23T23:42:51.751687+0000","last_fullsized":"2024-03-23T23:42:51.751687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:23:52.568123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749858+0000","last_change":"2024-03-23T23:42:50.759749+0000","last_active":"2024-03-23T23:42:51.749858+0000","last_peered":"2024-03-23T23:42:51.749858+0000","last_clean":"2024-03-23T23:42:51.749858+0000","last_became_active":"2024-03-23T23:42:50.758670+0000","last_became_peered":"2024-03-23T23:42:50.758670+0000","last_unstale":"2024-03-23T23:42:51.749858+0000","last_undegraded":"2024-03-23T23:42:51.749858+0000","last_fullsized":"2024-03-23T23:42:51.749858+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:16:02.318732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327985+0000","last_change":"2024-03-23T23:42:40.674574+0000","last_active":"2024-03-23T23:42:52.327985+0000","last_peered":"2024-03-23T23:42:52.327985+0000","last_clean":"2024-03-23T23:42:52.327985+0000","last_became_active":"2024-03-23T23:42:40.674293+0000","last_became_peered":"2024-03-23T23:42:40.674293+0000","last_unstale":"2024-03-23T23:42:52.327985+0000","last_undegraded":"2024-03-23T23:42:52.327985+0000","last_fullsized":"2024-03-23T23:42:52.327985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:37:24.839568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767035+0000","last_change":"2024-03-23T23:42:39.683165+0000","last_active":"2024-03-23T23:42:51.767035+0000","last_peered":"2024-03-23T23:42:51.767035+0000","last_clean":"2024-03-23T23:42:51.767035+0000","last_became_active":"2024-03-23T23:42:39.680121+0000","last_became_peered":"2024-03-23T23:42:39.680121+0000","last_unstale":"2024-03-23T23:42:51.767035+0000","last_undegraded":"2024-03-23T23:42:51.767035+0000","last_fullsized":"2024-03-23T23:42:51.767035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:02.190910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752029+0000","last_change":"2024-03-23T23:42:49.745016+0000","last_active":"2024-03-23T23:42:51.752029+0000","last_peered":"2024-03-23T23:42:51.752029+0000","last_clean":"2024-03-23T23:42:51.752029+0000","last_became_active":"2024-03-23T23:42:49.744742+0000","last_became_peered":"2024-03-23T23:42:49.744742+0000","last_unstale":"2024-03-23T23:42:51.752029+0000","last_undegraded":"2024-03-23T23:42:51.752029+0000","last_fullsized":"2024-03-23T23:42:51.752029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:30.033743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751217+0000","last_change":"2024-03-23T23:42:50.749792+0000","last_active":"2024-03-23T23:42:51.751217+0000","last_peered":"2024-03-23T23:42:51.751217+0000","last_clean":"2024-03-23T23:42:51.751217+0000","last_became_active":"2024-03-23T23:42:50.749491+0000","last_became_peered":"2024-03-23T23:42:50.749491+0000","last_unstale":"2024-03-23T23:42:51.751217+0000","last_undegraded":"2024-03-23T23:42:51.751217+0000","last_fullsized":"2024-03-23T23:42:51.751217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:25:44.894505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327680+0000","last_change":"2024-03-23T23:42:40.682999+0000","last_active":"2024-03-23T23:42:52.327680+0000","last_peered":"2024-03-23T23:42:52.327680+0000","last_clean":"2024-03-23T23:42:52.327680+0000","last_became_active":"2024-03-23T23:42:40.682672+0000","last_became_peered":"2024-03-23T23:42:40.682672+0000","last_unstale":"2024-03-23T23:42:52.327680+0000","last_undegraded":"2024-03-23T23:42:52.327680+0000","last_fullsized":"2024-03-23T23:42:52.327680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:59:45.154553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767148+0000","last_change":"2024-03-23T23:42:39.691470+0000","last_active":"2024-03-23T23:42:51.767148+0000","last_peered":"2024-03-23T23:42:51.767148+0000","last_clean":"2024-03-23T23:42:51.767148+0000","last_became_active":"2024-03-23T23:42:39.691124+0000","last_became_peered":"2024-03-23T23:42:39.691124+0000","last_unstale":"2024-03-23T23:42:51.767148+0000","last_undegraded":"2024-03-23T23:42:51.767148+0000","last_fullsized":"2024-03-23T23:42:51.767148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:55.757707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767321+0000","last_change":"2024-03-23T23:42:49.750016+0000","last_active":"2024-03-23T23:42:51.767321+0000","last_peered":"2024-03-23T23:42:51.767321+0000","last_clean":"2024-03-23T23:42:51.767321+0000","last_became_active":"2024-03-23T23:42:49.749279+0000","last_became_peered":"2024-03-23T23:42:49.749279+0000","last_unstale":"2024-03-23T23:42:51.767321+0000","last_undegraded":"2024-03-23T23:42:51.767321+0000","last_fullsized":"2024-03-23T23:42:51.767321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:41:14.671834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328693+0000","last_change":"2024-03-23T23:42:50.753669+0000","last_active":"2024-03-23T23:42:52.328693+0000","last_peered":"2024-03-23T23:42:52.328693+0000","last_clean":"2024-03-23T23:42:52.328693+0000","last_became_active":"2024-03-23T23:42:50.752674+0000","last_became_peered":"2024-03-23T23:42:50.752674+0000","last_unstale":"2024-03-23T23:42:52.328693+0000","last_undegraded":"2024-03-23T23:42:52.328693+0000","last_fullsized":"2024-03-23T23:42:52.328693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:39:04.727316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751477+0000","last_change":"2024-03-23T23:42:40.685051+0000","last_active":"2024-03-23T23:42:51.751477+0000","last_peered":"2024-03-23T23:42:51.751477+0000","last_clean":"2024-03-23T23:42:51.751477+0000","last_became_active":"2024-03-23T23:42:40.684677+0000","last_became_peered":"2024-03-23T23:42:40.684677+0000","last_unstale":"2024-03-23T23:42:51.751477+0000","last_undegraded":"2024-03-23T23:42:51.751477+0000","last_fullsized":"2024-03-23T23:42:51.751477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:20.920978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189995+0000","last_change":"2024-03-23T23:42:39.695253+0000","last_active":"2024-03-23T23:42:52.189995+0000","last_peered":"2024-03-23T23:42:52.189995+0000","last_clean":"2024-03-23T23:42:52.189995+0000","last_became_active":"2024-03-23T23:42:39.694746+0000","last_became_peered":"2024-03-23T23:42:39.694746+0000","last_unstale":"2024-03-23T23:42:52.189995+0000","last_undegraded":"2024-03-23T23:42:52.189995+0000","last_fullsized":"2024-03-23T23:42:52.189995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:57.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752459+0000","last_change":"2024-03-23T23:42:49.724285+0000","last_active":"2024-03-23T23:42:51.752459+0000","last_peered":"2024-03-23T23:42:51.752459+0000","last_clean":"2024-03-23T23:42:51.752459+0000","last_became_active":"2024-03-23T23:42:49.724009+0000","last_became_peered":"2024-03-23T23:42:49.724009+0000","last_unstale":"2024-03-23T23:42:51.752459+0000","last_undegraded":"2024-03-23T23:42:51.752459+0000","last_fullsized":"2024-03-23T23:42:51.752459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:01:04.035970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327444+0000","last_change":"2024-03-23T23:42:50.746737+0000","last_active":"2024-03-23T23:42:52.327444+0000","last_peered":"2024-03-23T23:42:52.327444+0000","last_clean":"2024-03-23T23:42:52.327444+0000","last_became_active":"2024-03-23T23:42:50.746492+0000","last_became_peered":"2024-03-23T23:42:50.746492+0000","last_unstale":"2024-03-23T23:42:52.327444+0000","last_undegraded":"2024-03-23T23:42:52.327444+0000","last_fullsized":"2024-03-23T23:42:52.327444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:50.597847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763599+0000","last_change":"2024-03-23T23:42:40.680963+0000","last_active":"2024-03-23T23:42:51.763599+0000","last_peered":"2024-03-23T23:42:51.763599+0000","last_clean":"2024-03-23T23:42:51.763599+0000","last_became_active":"2024-03-23T23:42:40.680744+0000","last_became_peered":"2024-03-23T23:42:40.680744+0000","last_unstale":"2024-03-23T23:42:51.763599+0000","last_undegraded":"2024-03-23T23:42:51.763599+0000","last_fullsized":"2024-03-23T23:42:51.763599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:17:19.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.753179+0000","last_change":"2024-03-23T23:42:39.691813+0000","last_active":"2024-03-23T23:42:51.753179+0000","last_peered":"2024-03-23T23:42:51.753179+0000","last_clean":"2024-03-23T23:42:51.753179+0000","last_became_active":"2024-03-23T23:42:39.691519+0000","last_became_peered":"2024-03-23T23:42:39.691519+0000","last_unstale":"2024-03-23T23:42:51.753179+0000","last_undegraded":"2024-03-23T23:42:51.753179+0000","last_fullsized":"2024-03-23T23:42:51.753179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:27:41.386662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751110+0000","last_change":"2024-03-23T23:42:49.734197+0000","last_active":"2024-03-23T23:42:51.751110+0000","last_peered":"2024-03-23T23:42:51.751110+0000","last_clean":"2024-03-23T23:42:51.751110+0000","last_became_active":"2024-03-23T23:42:49.733715+0000","last_became_peered":"2024-03-23T23:42:49.733715+0000","last_unstale":"2024-03-23T23:42:51.751110+0000","last_undegraded":"2024-03-23T23:42:51.751110+0000","last_fullsized":"2024-03-23T23:42:51.751110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:36.728428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750902+0000","last_change":"2024-03-23T23:42:50.739957+0000","last_active":"2024-03-23T23:42:51.750902+0000","last_peered":"2024-03-23T23:42:51.750902+0000","last_clean":"2024-03-23T23:42:51.750902+0000","last_became_active":"2024-03-23T23:42:50.739706+0000","last_became_peered":"2024-03-23T23:42:50.739706+0000","last_unstale":"2024-03-23T23:42:51.750902+0000","last_undegraded":"2024-03-23T23:42:51.750902+0000","last_fullsized":"2024-03-23T23:42:51.750902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:49:17.763463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328339+0000","last_change":"2024-03-23T23:42:40.686865+0000","last_active":"2024-03-23T23:42:52.328339+0000","last_peered":"2024-03-23T23:42:52.328339+0000","last_clean":"2024-03-23T23:42:52.328339+0000","last_became_active":"2024-03-23T23:42:40.686582+0000","last_became_peered":"2024-03-23T23:42:40.686582+0000","last_unstale":"2024-03-23T23:42:52.328339+0000","last_undegraded":"2024-03-23T23:42:52.328339+0000","last_fullsized":"2024-03-23T23:42:52.328339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:05:17.694245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767041+0000","last_change":"2024-03-23T23:42:39.678962+0000","last_active":"2024-03-23T23:42:51.767041+0000","last_peered":"2024-03-23T23:42:51.767041+0000","last_clean":"2024-03-23T23:42:51.767041+0000","last_became_active":"2024-03-23T23:42:39.678603+0000","last_became_peered":"2024-03-23T23:42:39.678603+0000","last_unstale":"2024-03-23T23:42:51.767041+0000","last_undegraded":"2024-03-23T23:42:51.767041+0000","last_fullsized":"2024-03-23T23:42:51.767041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:43:46.206865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327329+0000","last_change":"2024-03-23T23:42:49.740561+0000","last_active":"2024-03-23T23:42:52.327329+0000","last_peered":"2024-03-23T23:42:52.327329+0000","last_clean":"2024-03-23T23:42:52.327329+0000","last_became_active":"2024-03-23T23:42:49.740290+0000","last_became_peered":"2024-03-23T23:42:49.740290+0000","last_unstale":"2024-03-23T23:42:52.327329+0000","last_undegraded":"2024-03-23T23:42:52.327329+0000","last_fullsized":"2024-03-23T23:42:52.327329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:21:24.160603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751249+0000","last_change":"2024-03-23T23:42:50.751107+0000","last_active":"2024-03-23T23:42:51.751249+0000","last_peered":"2024-03-23T23:42:51.751249+0000","last_clean":"2024-03-23T23:42:51.751249+0000","last_became_active":"2024-03-23T23:42:50.750859+0000","last_became_peered":"2024-03-23T23:42:50.750859+0000","last_unstale":"2024-03-23T23:42:51.751249+0000","last_undegraded":"2024-03-23T23:42:51.751249+0000","last_fullsized":"2024-03-23T23:42:51.751249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:49:17.763463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766837+0000","last_change":"2024-03-23T23:42:40.686486+0000","last_active":"2024-03-23T23:42:51.766837+0000","last_peered":"2024-03-23T23:42:51.766837+0000","last_clean":"2024-03-23T23:42:51.766837+0000","last_became_active":"2024-03-23T23:42:40.686186+0000","last_became_peered":"2024-03-23T23:42:40.686186+0000","last_unstale":"2024-03-23T23:42:51.766837+0000","last_undegraded":"2024-03-23T23:42:51.766837+0000","last_fullsized":"2024-03-23T23:42:51.766837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:46:30.427072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190217+0000","last_change":"2024-03-23T23:42:39.695099+0000","last_active":"2024-03-23T23:42:52.190217+0000","last_peered":"2024-03-23T23:42:52.190217+0000","last_clean":"2024-03-23T23:42:52.190217+0000","last_became_active":"2024-03-23T23:42:39.694720+0000","last_became_peered":"2024-03-23T23:42:39.694720+0000","last_unstale":"2024-03-23T23:42:52.190217+0000","last_undegraded":"2024-03-23T23:42:52.190217+0000","last_fullsized":"2024-03-23T23:42:52.190217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:58:07.880313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.762762+0000","last_change":"2024-03-23T23:42:49.739099+0000","last_active":"2024-03-23T23:42:51.762762+0000","last_peered":"2024-03-23T23:42:51.762762+0000","last_clean":"2024-03-23T23:42:51.762762+0000","last_became_active":"2024-03-23T23:42:49.738198+0000","last_became_peered":"2024-03-23T23:42:49.738198+0000","last_unstale":"2024-03-23T23:42:51.762762+0000","last_undegraded":"2024-03-23T23:42:51.762762+0000","last_fullsized":"2024-03-23T23:42:51.762762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:57:34.600362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.762957+0000","last_change":"2024-03-23T23:42:50.754941+0000","last_active":"2024-03-23T23:42:51.762957+0000","last_peered":"2024-03-23T23:42:51.762957+0000","last_clean":"2024-03-23T23:42:51.762957+0000","last_became_active":"2024-03-23T23:42:50.754585+0000","last_became_peered":"2024-03-23T23:42:50.754585+0000","last_unstale":"2024-03-23T23:42:51.762957+0000","last_undegraded":"2024-03-23T23:42:51.762957+0000","last_fullsized":"2024-03-23T23:42:51.762957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:42:23.236324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328954+0000","last_change":"2024-03-23T23:42:40.700610+0000","last_active":"2024-03-23T23:42:52.328954+0000","last_peered":"2024-03-23T23:42:52.328954+0000","last_clean":"2024-03-23T23:42:52.328954+0000","last_became_active":"2024-03-23T23:42:40.700112+0000","last_became_peered":"2024-03-23T23:42:40.700112+0000","last_unstale":"2024-03-23T23:42:52.328954+0000","last_undegraded":"2024-03-23T23:42:52.328954+0000","last_fullsized":"2024-03-23T23:42:52.328954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:07:49.169416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766866+0000","last_change":"2024-03-23T23:42:39.686509+0000","last_active":"2024-03-23T23:42:51.766866+0000","last_peered":"2024-03-23T23:42:51.766866+0000","last_clean":"2024-03-23T23:42:51.766866+0000","last_became_active":"2024-03-23T23:42:39.686094+0000","last_became_peered":"2024-03-23T23:42:39.686094+0000","last_unstale":"2024-03-23T23:42:51.766866+0000","last_undegraded":"2024-03-23T23:42:51.766866+0000","last_fullsized":"2024-03-23T23:42:51.766866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:57:20.394530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766601+0000","last_change":"2024-03-23T23:42:49.738274+0000","last_active":"2024-03-23T23:42:51.766601+0000","last_peered":"2024-03-23T23:42:51.766601+0000","last_clean":"2024-03-23T23:42:51.766601+0000","last_became_active":"2024-03-23T23:42:49.737916+0000","last_became_peered":"2024-03-23T23:42:49.737916+0000","last_unstale":"2024-03-23T23:42:51.766601+0000","last_undegraded":"2024-03-23T23:42:51.766601+0000","last_fullsized":"2024-03-23T23:42:51.766601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:18:12.997092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763279+0000","last_change":"2024-03-23T23:42:50.764148+0000","last_active":"2024-03-23T23:42:51.763279+0000","last_peered":"2024-03-23T23:42:51.763279+0000","last_clean":"2024-03-23T23:42:51.763279+0000","last_became_active":"2024-03-23T23:42:50.763768+0000","last_became_peered":"2024-03-23T23:42:50.763768+0000","last_unstale":"2024-03-23T23:42:51.763279+0000","last_undegraded":"2024-03-23T23:42:51.763279+0000","last_fullsized":"2024-03-23T23:42:51.763279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:52:48.699642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751565+0000","last_change":"2024-03-23T23:42:40.679988+0000","last_active":"2024-03-23T23:42:51.751565+0000","last_peered":"2024-03-23T23:42:51.751565+0000","last_clean":"2024-03-23T23:42:51.751565+0000","last_became_active":"2024-03-23T23:42:40.679488+0000","last_became_peered":"2024-03-23T23:42:40.679488+0000","last_unstale":"2024-03-23T23:42:51.751565+0000","last_undegraded":"2024-03-23T23:42:51.751565+0000","last_fullsized":"2024-03-23T23:42:51.751565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:10:32.251287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328493+0000","last_change":"2024-03-23T23:42:39.679741+0000","last_active":"2024-03-23T23:42:52.328493+0000","last_peered":"2024-03-23T23:42:52.328493+0000","last_clean":"2024-03-23T23:42:52.328493+0000","last_became_active":"2024-03-23T23:42:39.678864+0000","last_became_peered":"2024-03-23T23:42:39.678864+0000","last_unstale":"2024-03-23T23:42:52.328493+0000","last_undegraded":"2024-03-23T23:42:52.328493+0000","last_fullsized":"2024-03-23T23:42:52.328493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:50.559059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766763+0000","last_change":"2024-03-23T23:42:49.739837+0000","last_active":"2024-03-23T23:42:51.766763+0000","last_peered":"2024-03-23T23:42:51.766763+0000","last_clean":"2024-03-23T23:42:51.766763+0000","last_became_active":"2024-03-23T23:42:49.739570+0000","last_became_peered":"2024-03-23T23:42:49.739570+0000","last_unstale":"2024-03-23T23:42:51.766763+0000","last_undegraded":"2024-03-23T23:42:51.766763+0000","last_fullsized":"2024-03-23T23:42:51.766763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:57:34.600362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749980+0000","last_change":"2024-03-23T23:42:50.753912+0000","last_active":"2024-03-23T23:42:51.749980+0000","last_peered":"2024-03-23T23:42:51.749980+0000","last_clean":"2024-03-23T23:42:51.749980+0000","last_became_active":"2024-03-23T23:42:50.753629+0000","last_became_peered":"2024-03-23T23:42:50.753629+0000","last_unstale":"2024-03-23T23:42:51.749980+0000","last_undegraded":"2024-03-23T23:42:51.749980+0000","last_fullsized":"2024-03-23T23:42:51.749980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:40:32.748113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766326+0000","last_change":"2024-03-23T23:42:40.682840+0000","last_active":"2024-03-23T23:42:51.766326+0000","last_peered":"2024-03-23T23:42:51.766326+0000","last_clean":"2024-03-23T23:42:51.766326+0000","last_became_active":"2024-03-23T23:42:40.682391+0000","last_became_peered":"2024-03-23T23:42:40.682391+0000","last_unstale":"2024-03-23T23:42:51.766326+0000","last_undegraded":"2024-03-23T23:42:51.766326+0000","last_fullsized":"2024-03-23T23:42:51.766326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:42:14.952953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749558+0000","last_change":"2024-03-23T23:42:39.680763+0000","last_active":"2024-03-23T23:42:51.749558+0000","last_peered":"2024-03-23T23:42:51.749558+0000","last_clean":"2024-03-23T23:42:51.749558+0000","last_became_active":"2024-03-23T23:42:39.680494+0000","last_became_peered":"2024-03-23T23:42:39.680494+0000","last_unstale":"2024-03-23T23:42:51.749558+0000","last_undegraded":"2024-03-23T23:42:51.749558+0000","last_fullsized":"2024-03-23T23:42:51.749558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:57.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767406+0000","last_change":"2024-03-23T23:42:49.737456+0000","last_active":"2024-03-23T23:42:51.767406+0000","last_peered":"2024-03-23T23:42:51.767406+0000","last_clean":"2024-03-23T23:42:51.767406+0000","last_became_active":"2024-03-23T23:42:49.737196+0000","last_became_peered":"2024-03-23T23:42:49.737196+0000","last_unstale":"2024-03-23T23:42:51.767406+0000","last_undegraded":"2024-03-23T23:42:51.767406+0000","last_fullsized":"2024-03-23T23:42:51.767406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:49:42.789292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.329037+0000","last_change":"2024-03-23T23:42:50.763308+0000","last_active":"2024-03-23T23:42:52.329037+0000","last_peered":"2024-03-23T23:42:52.329037+0000","last_clean":"2024-03-23T23:42:52.329037+0000","last_became_active":"2024-03-23T23:42:50.763007+0000","last_became_peered":"2024-03-23T23:42:50.763007+0000","last_unstale":"2024-03-23T23:42:52.329037+0000","last_undegraded":"2024-03-23T23:42:52.329037+0000","last_fullsized":"2024-03-23T23:42:52.329037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:32:46.055472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.762549+0000","last_change":"2024-03-23T23:42:40.675570+0000","last_active":"2024-03-23T23:42:51.762549+0000","last_peered":"2024-03-23T23:42:51.762549+0000","last_clean":"2024-03-23T23:42:51.762549+0000","last_became_active":"2024-03-23T23:42:40.674390+0000","last_became_peered":"2024-03-23T23:42:40.674390+0000","last_unstale":"2024-03-23T23:42:51.762549+0000","last_undegraded":"2024-03-23T23:42:51.762549+0000","last_fullsized":"2024-03-23T23:42:51.762549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:31:34.412092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189672+0000","last_change":"2024-03-23T23:42:39.690057+0000","last_active":"2024-03-23T23:42:52.189672+0000","last_peered":"2024-03-23T23:42:52.189672+0000","last_clean":"2024-03-23T23:42:52.189672+0000","last_became_active":"2024-03-23T23:42:39.689763+0000","last_became_peered":"2024-03-23T23:42:39.689763+0000","last_unstale":"2024-03-23T23:42:52.189672+0000","last_undegraded":"2024-03-23T23:42:52.189672+0000","last_fullsized":"2024-03-23T23:42:52.189672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:01.607584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763516+0000","last_change":"2024-03-23T23:42:49.734213+0000","last_active":"2024-03-23T23:42:51.763516+0000","last_peered":"2024-03-23T23:42:51.763516+0000","last_clean":"2024-03-23T23:42:51.763516+0000","last_became_active":"2024-03-23T23:42:49.733115+0000","last_became_peered":"2024-03-23T23:42:49.733115+0000","last_unstale":"2024-03-23T23:42:51.763516+0000","last_undegraded":"2024-03-23T23:42:51.763516+0000","last_fullsized":"2024-03-23T23:42:51.763516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:18:12.997092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189689+0000","last_change":"2024-03-23T23:42:50.759000+0000","last_active":"2024-03-23T23:42:52.189689+0000","last_peered":"2024-03-23T23:42:52.189689+0000","last_clean":"2024-03-23T23:42:52.189689+0000","last_became_active":"2024-03-23T23:42:50.758552+0000","last_became_peered":"2024-03-23T23:42:50.758552+0000","last_unstale":"2024-03-23T23:42:52.189689+0000","last_undegraded":"2024-03-23T23:42:52.189689+0000","last_fullsized":"2024-03-23T23:42:52.189689+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:04:26.911514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327764+0000","last_change":"2024-03-23T23:42:40.700998+0000","last_active":"2024-03-23T23:42:52.327764+0000","last_peered":"2024-03-23T23:42:52.327764+0000","last_clean":"2024-03-23T23:42:52.327764+0000","last_became_active":"2024-03-23T23:42:40.700788+0000","last_became_peered":"2024-03-23T23:42:40.700788+0000","last_unstale":"2024-03-23T23:42:52.327764+0000","last_undegraded":"2024-03-23T23:42:52.327764+0000","last_fullsized":"2024-03-23T23:42:52.327764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:14:44.739525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328524+0000","last_change":"2024-03-23T23:42:39.687712+0000","last_active":"2024-03-23T23:42:52.328524+0000","last_peered":"2024-03-23T23:42:52.328524+0000","last_clean":"2024-03-23T23:42:52.328524+0000","last_became_active":"2024-03-23T23:42:39.687378+0000","last_became_peered":"2024-03-23T23:42:39.687378+0000","last_unstale":"2024-03-23T23:42:52.328524+0000","last_undegraded":"2024-03-23T23:42:52.328524+0000","last_fullsized":"2024-03-23T23:42:52.328524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:20:38.456655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189176+0000","last_change":"2024-03-23T23:42:27.940270+0000","last_active":"2024-03-23T23:42:52.189176+0000","last_peered":"2024-03-23T23:42:52.189176+0000","last_clean":"2024-03-23T23:42:52.189176+0000","last_became_active":"2024-03-23T23:42:27.939061+0000","last_became_peered":"2024-03-23T23:42:27.939061+0000","last_unstale":"2024-03-23T23:42:52.189176+0000","last_undegraded":"2024-03-23T23:42:52.189176+0000","last_fullsized":"2024-03-23T23:42:52.189176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:26.509742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:26.509742+0000","last_clean_scrub_stamp":"2024-03-23T23:42:26.509742+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:49.258623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752132+0000","last_change":"2024-03-23T23:42:49.729231+0000","last_active":"2024-03-23T23:42:51.752132+0000","last_peered":"2024-03-23T23:42:51.752132+0000","last_clean":"2024-03-23T23:42:51.752132+0000","last_became_active":"2024-03-23T23:42:49.728990+0000","last_became_peered":"2024-03-23T23:42:49.728990+0000","last_unstale":"2024-03-23T23:42:51.752132+0000","last_undegraded":"2024-03-23T23:42:51.752132+0000","last_fullsized":"2024-03-23T23:42:51.752132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:01:04.035970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749662+0000","last_change":"2024-03-23T23:42:50.757668+0000","last_active":"2024-03-23T23:42:51.749662+0000","last_peered":"2024-03-23T23:42:51.749662+0000","last_clean":"2024-03-23T23:42:51.749662+0000","last_became_active":"2024-03-23T23:42:50.756900+0000","last_became_peered":"2024-03-23T23:42:50.756900+0000","last_unstale":"2024-03-23T23:42:51.749662+0000","last_undegraded":"2024-03-23T23:42:51.749662+0000","last_fullsized":"2024-03-23T23:42:51.749662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:24:53.959288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190056+0000","last_change":"2024-03-23T23:42:40.711591+0000","last_active":"2024-03-23T23:42:52.190056+0000","last_peered":"2024-03-23T23:42:52.190056+0000","last_clean":"2024-03-23T23:42:52.190056+0000","last_became_active":"2024-03-23T23:42:40.711306+0000","last_became_peered":"2024-03-23T23:42:40.711306+0000","last_unstale":"2024-03-23T23:42:52.190056+0000","last_undegraded":"2024-03-23T23:42:52.190056+0000","last_fullsized":"2024-03-23T23:42:52.190056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:34:16.693372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749901+0000","last_change":"2024-03-23T23:42:39.684163+0000","last_active":"2024-03-23T23:42:51.749901+0000","last_peered":"2024-03-23T23:42:51.749901+0000","last_clean":"2024-03-23T23:42:51.749901+0000","last_became_active":"2024-03-23T23:42:39.683211+0000","last_became_peered":"2024-03-23T23:42:39.683211+0000","last_unstale":"2024-03-23T23:42:51.749901+0000","last_undegraded":"2024-03-23T23:42:51.749901+0000","last_fullsized":"2024-03-23T23:42:51.749901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:47:27.092873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751343+0000","last_change":"2024-03-23T23:42:49.735824+0000","last_active":"2024-03-23T23:42:51.751343+0000","last_peered":"2024-03-23T23:42:51.751343+0000","last_clean":"2024-03-23T23:42:51.751343+0000","last_became_active":"2024-03-23T23:42:49.735473+0000","last_became_peered":"2024-03-23T23:42:49.735473+0000","last_unstale":"2024-03-23T23:42:51.751343+0000","last_undegraded":"2024-03-23T23:42:51.751343+0000","last_fullsized":"2024-03-23T23:42:51.751343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:44:12.438729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749471+0000","last_change":"2024-03-23T23:42:50.745563+0000","last_active":"2024-03-23T23:42:51.749471+0000","last_peered":"2024-03-23T23:42:51.749471+0000","last_clean":"2024-03-23T23:42:51.749471+0000","last_became_active":"2024-03-23T23:42:50.745256+0000","last_became_peered":"2024-03-23T23:42:50.745256+0000","last_unstale":"2024-03-23T23:42:51.749471+0000","last_undegraded":"2024-03-23T23:42:51.749471+0000","last_fullsized":"2024-03-23T23:42:51.749471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:34:26.750531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328628+0000","last_change":"2024-03-23T23:42:40.700124+0000","last_active":"2024-03-23T23:42:52.328628+0000","last_peered":"2024-03-23T23:42:52.328628+0000","last_clean":"2024-03-23T23:42:52.328628+0000","last_became_active":"2024-03-23T23:42:40.697369+0000","last_became_peered":"2024-03-23T23:42:40.697369+0000","last_unstale":"2024-03-23T23:42:52.328628+0000","last_undegraded":"2024-03-23T23:42:52.328628+0000","last_fullsized":"2024-03-23T23:42:52.328628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:20.981139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767558+0000","last_change":"2024-03-23T23:42:39.681013+0000","last_active":"2024-03-23T23:42:51.767558+0000","last_peered":"2024-03-23T23:42:51.767558+0000","last_clean":"2024-03-23T23:42:51.767558+0000","last_became_active":"2024-03-23T23:42:39.680669+0000","last_became_peered":"2024-03-23T23:42:39.680669+0000","last_unstale":"2024-03-23T23:42:51.767558+0000","last_undegraded":"2024-03-23T23:42:51.767558+0000","last_fullsized":"2024-03-23T23:42:51.767558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:58:07.880313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.762672+0000","last_change":"2024-03-23T23:42:49.736747+0000","last_active":"2024-03-23T23:42:51.762672+0000","last_peered":"2024-03-23T23:42:51.762672+0000","last_clean":"2024-03-23T23:42:51.762672+0000","last_became_active":"2024-03-23T23:42:49.734508+0000","last_became_peered":"2024-03-23T23:42:49.734508+0000","last_unstale":"2024-03-23T23:42:51.762672+0000","last_undegraded":"2024-03-23T23:42:51.762672+0000","last_fullsized":"2024-03-23T23:42:51.762672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:54.356082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189347+0000","last_change":"2024-03-23T23:42:50.751141+0000","last_active":"2024-03-23T23:42:52.189347+0000","last_peered":"2024-03-23T23:42:52.189347+0000","last_clean":"2024-03-23T23:42:52.189347+0000","last_became_active":"2024-03-23T23:42:50.750269+0000","last_became_peered":"2024-03-23T23:42:50.750269+0000","last_unstale":"2024-03-23T23:42:52.189347+0000","last_undegraded":"2024-03-23T23:42:52.189347+0000","last_fullsized":"2024-03-23T23:42:52.189347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:46:10.784416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190299+0000","last_change":"2024-03-23T23:42:40.706713+0000","last_active":"2024-03-23T23:42:52.190299+0000","last_peered":"2024-03-23T23:42:52.190299+0000","last_clean":"2024-03-23T23:42:52.190299+0000","last_became_active":"2024-03-23T23:42:40.704328+0000","last_became_peered":"2024-03-23T23:42:40.704328+0000","last_unstale":"2024-03-23T23:42:52.190299+0000","last_undegraded":"2024-03-23T23:42:52.190299+0000","last_fullsized":"2024-03-23T23:42:52.190299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:15:52.261572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750011+0000","last_change":"2024-03-23T23:42:39.681906+0000","last_active":"2024-03-23T23:42:51.750011+0000","last_peered":"2024-03-23T23:42:51.750011+0000","last_clean":"2024-03-23T23:42:51.750011+0000","last_became_active":"2024-03-23T23:42:39.680506+0000","last_became_peered":"2024-03-23T23:42:39.680506+0000","last_unstale":"2024-03-23T23:42:51.750011+0000","last_undegraded":"2024-03-23T23:42:51.750011+0000","last_fullsized":"2024-03-23T23:42:51.750011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:44:07.213123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328020+0000","last_change":"2024-03-23T23:42:49.737735+0000","last_active":"2024-03-23T23:42:52.328020+0000","last_peered":"2024-03-23T23:42:52.328020+0000","last_clean":"2024-03-23T23:42:52.328020+0000","last_became_active":"2024-03-23T23:42:49.737434+0000","last_became_peered":"2024-03-23T23:42:49.737434+0000","last_unstale":"2024-03-23T23:42:52.328020+0000","last_undegraded":"2024-03-23T23:42:52.328020+0000","last_fullsized":"2024-03-23T23:42:52.328020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:58:10.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749338+0000","last_change":"2024-03-23T23:42:50.746922+0000","last_active":"2024-03-23T23:42:51.749338+0000","last_peered":"2024-03-23T23:42:51.749338+0000","last_clean":"2024-03-23T23:42:51.749338+0000","last_became_active":"2024-03-23T23:42:50.746105+0000","last_became_peered":"2024-03-23T23:42:50.746105+0000","last_unstale":"2024-03-23T23:42:51.749338+0000","last_undegraded":"2024-03-23T23:42:51.749338+0000","last_fullsized":"2024-03-23T23:42:51.749338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:46:40.484231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189958+0000","last_change":"2024-03-23T23:42:40.696584+0000","last_active":"2024-03-23T23:42:52.189958+0000","last_peered":"2024-03-23T23:42:52.189958+0000","last_clean":"2024-03-23T23:42:52.189958+0000","last_became_active":"2024-03-23T23:42:40.696141+0000","last_became_peered":"2024-03-23T23:42:40.696141+0000","last_unstale":"2024-03-23T23:42:52.189958+0000","last_undegraded":"2024-03-23T23:42:52.189958+0000","last_fullsized":"2024-03-23T23:42:52.189958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:45.303477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752716+0000","last_change":"2024-03-23T23:42:39.686863+0000","last_active":"2024-03-23T23:42:51.752716+0000","last_peered":"2024-03-23T23:42:51.752716+0000","last_clean":"2024-03-23T23:42:51.752716+0000","last_became_active":"2024-03-23T23:42:39.686491+0000","last_became_peered":"2024-03-23T23:42:39.686491+0000","last_unstale":"2024-03-23T23:42:51.752716+0000","last_undegraded":"2024-03-23T23:42:51.752716+0000","last_fullsized":"2024-03-23T23:42:51.752716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:38:13.752628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751016+0000","last_change":"2024-03-23T23:42:49.733982+0000","last_active":"2024-03-23T23:42:51.751016+0000","last_peered":"2024-03-23T23:42:51.751016+0000","last_clean":"2024-03-23T23:42:51.751016+0000","last_became_active":"2024-03-23T23:42:49.733389+0000","last_became_peered":"2024-03-23T23:42:49.733389+0000","last_unstale":"2024-03-23T23:42:51.751016+0000","last_undegraded":"2024-03-23T23:42:51.751016+0000","last_fullsized":"2024-03-23T23:42:51.751016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:13.685893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328287+0000","last_change":"2024-03-23T23:42:50.764083+0000","last_active":"2024-03-23T23:42:52.328287+0000","last_peered":"2024-03-23T23:42:52.328287+0000","last_clean":"2024-03-23T23:42:52.328287+0000","last_became_active":"2024-03-23T23:42:50.763871+0000","last_became_peered":"2024-03-23T23:42:50.763871+0000","last_unstale":"2024-03-23T23:42:52.328287+0000","last_undegraded":"2024-03-23T23:42:52.328287+0000","last_fullsized":"2024-03-23T23:42:52.328287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:32:46.055472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189656+0000","last_change":"2024-03-23T23:42:40.700961+0000","last_active":"2024-03-23T23:42:52.189656+0000","last_peered":"2024-03-23T23:42:52.189656+0000","last_clean":"2024-03-23T23:42:52.189656+0000","last_became_active":"2024-03-23T23:42:40.700800+0000","last_became_peered":"2024-03-23T23:42:40.700800+0000","last_unstale":"2024-03-23T23:42:52.189656+0000","last_undegraded":"2024-03-23T23:42:52.189656+0000","last_fullsized":"2024-03-23T23:42:52.189656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:54:27.641281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749328+0000","last_change":"2024-03-23T23:42:39.676075+0000","last_active":"2024-03-23T23:42:51.749328+0000","last_peered":"2024-03-23T23:42:51.749328+0000","last_clean":"2024-03-23T23:42:51.749328+0000","last_became_active":"2024-03-23T23:42:39.675770+0000","last_became_peered":"2024-03-23T23:42:39.675770+0000","last_unstale":"2024-03-23T23:42:51.749328+0000","last_undegraded":"2024-03-23T23:42:51.749328+0000","last_fullsized":"2024-03-23T23:42:51.749328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:24:11.933075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763597+0000","last_change":"2024-03-23T23:42:49.739529+0000","last_active":"2024-03-23T23:42:51.763597+0000","last_peered":"2024-03-23T23:42:51.763597+0000","last_clean":"2024-03-23T23:42:51.763597+0000","last_became_active":"2024-03-23T23:42:49.738053+0000","last_became_peered":"2024-03-23T23:42:49.738053+0000","last_unstale":"2024-03-23T23:42:51.763597+0000","last_undegraded":"2024-03-23T23:42:51.763597+0000","last_fullsized":"2024-03-23T23:42:51.763597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:52:57.561036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328637+0000","last_change":"2024-03-23T23:42:50.771347+0000","last_active":"2024-03-23T23:42:52.328637+0000","last_peered":"2024-03-23T23:42:52.328637+0000","last_clean":"2024-03-23T23:42:52.328637+0000","last_became_active":"2024-03-23T23:42:50.770998+0000","last_became_peered":"2024-03-23T23:42:50.770998+0000","last_unstale":"2024-03-23T23:42:52.328637+0000","last_undegraded":"2024-03-23T23:42:52.328637+0000","last_fullsized":"2024-03-23T23:42:52.328637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:57:04.394872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750921+0000","last_change":"2024-03-23T23:42:40.677314+0000","last_active":"2024-03-23T23:42:51.750921+0000","last_peered":"2024-03-23T23:42:51.750921+0000","last_clean":"2024-03-23T23:42:51.750921+0000","last_became_active":"2024-03-23T23:42:40.675416+0000","last_became_peered":"2024-03-23T23:42:40.675416+0000","last_unstale":"2024-03-23T23:42:51.750921+0000","last_undegraded":"2024-03-23T23:42:51.750921+0000","last_fullsized":"2024-03-23T23:42:51.750921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:01:06.338641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751663+0000","last_change":"2024-03-23T23:42:39.681827+0000","last_active":"2024-03-23T23:42:51.751663+0000","last_peered":"2024-03-23T23:42:51.751663+0000","last_clean":"2024-03-23T23:42:51.751663+0000","last_became_active":"2024-03-23T23:42:39.681418+0000","last_became_peered":"2024-03-23T23:42:39.681418+0000","last_unstale":"2024-03-23T23:42:51.751663+0000","last_undegraded":"2024-03-23T23:42:51.751663+0000","last_fullsized":"2024-03-23T23:42:51.751663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:50.559059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328221+0000","last_change":"2024-03-23T23:42:49.744708+0000","last_active":"2024-03-23T23:42:52.328221+0000","last_peered":"2024-03-23T23:42:52.328221+0000","last_clean":"2024-03-23T23:42:52.328221+0000","last_became_active":"2024-03-23T23:42:49.744422+0000","last_became_peered":"2024-03-23T23:42:49.744422+0000","last_unstale":"2024-03-23T23:42:52.328221+0000","last_undegraded":"2024-03-23T23:42:52.328221+0000","last_fullsized":"2024-03-23T23:42:52.328221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:25:43.889950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328641+0000","last_change":"2024-03-23T23:42:50.753064+0000","last_active":"2024-03-23T23:42:52.328641+0000","last_peered":"2024-03-23T23:42:52.328641+0000","last_clean":"2024-03-23T23:42:52.328641+0000","last_became_active":"2024-03-23T23:42:50.752783+0000","last_became_peered":"2024-03-23T23:42:50.752783+0000","last_unstale":"2024-03-23T23:42:52.328641+0000","last_undegraded":"2024-03-23T23:42:52.328641+0000","last_fullsized":"2024-03-23T23:42:52.328641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:39:49.888359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189741+0000","last_change":"2024-03-23T23:42:40.704046+0000","last_active":"2024-03-23T23:42:52.189741+0000","last_peered":"2024-03-23T23:42:52.189741+0000","last_clean":"2024-03-23T23:42:52.189741+0000","last_became_active":"2024-03-23T23:42:40.703787+0000","last_became_peered":"2024-03-23T23:42:40.703787+0000","last_unstale":"2024-03-23T23:42:52.189741+0000","last_undegraded":"2024-03-23T23:42:52.189741+0000","last_fullsized":"2024-03-23T23:42:52.189741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:16:16.737284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328439+0000","last_change":"2024-03-23T23:42:39.688483+0000","last_active":"2024-03-23T23:42:52.328439+0000","last_peered":"2024-03-23T23:42:52.328439+0000","last_clean":"2024-03-23T23:42:52.328439+0000","last_became_active":"2024-03-23T23:42:39.688141+0000","last_became_peered":"2024-03-23T23:42:39.688141+0000","last_unstale":"2024-03-23T23:42:52.328439+0000","last_undegraded":"2024-03-23T23:42:52.328439+0000","last_fullsized":"2024-03-23T23:42:52.328439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:32.254099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"25'8","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:43:16.912269+0000","last_change":"2024-03-23T23:42:49.749027+0000","last_active":"2024-03-23T23:43:16.912269+0000","last_peered":"2024-03-23T23:43:16.912269+0000","last_clean":"2024-03-23T23:43:16.912269+0000","last_became_active":"2024-03-23T23:42:49.748687+0000","last_became_peered":"2024-03-23T23:42:49.748687+0000","last_unstale":"2024-03-23T23:43:16.912269+0000","last_undegraded":"2024-03-23T23:43:16.912269+0000","last_fullsized":"2024-03-23T23:43:16.912269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:27.818117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1866,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328083+0000","last_change":"2024-03-23T23:42:50.752273+0000","last_active":"2024-03-23T23:42:52.328083+0000","last_peered":"2024-03-23T23:42:52.328083+0000","last_clean":"2024-03-23T23:42:52.328083+0000","last_became_active":"2024-03-23T23:42:50.751874+0000","last_became_peered":"2024-03-23T23:42:50.751874+0000","last_unstale":"2024-03-23T23:42:52.328083+0000","last_undegraded":"2024-03-23T23:42:52.328083+0000","last_fullsized":"2024-03-23T23:42:52.328083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:20:53.750917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.762660+0000","last_change":"2024-03-23T23:42:40.688909+0000","last_active":"2024-03-23T23:42:51.762660+0000","last_peered":"2024-03-23T23:42:51.762660+0000","last_clean":"2024-03-23T23:42:51.762660+0000","last_became_active":"2024-03-23T23:42:40.688636+0000","last_became_peered":"2024-03-23T23:42:40.688636+0000","last_unstale":"2024-03-23T23:42:51.762660+0000","last_undegraded":"2024-03-23T23:42:51.762660+0000","last_fullsized":"2024-03-23T23:42:51.762660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:26:16.171920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763113+0000","last_change":"2024-03-23T23:42:39.681926+0000","last_active":"2024-03-23T23:42:51.763113+0000","last_peered":"2024-03-23T23:42:51.763113+0000","last_clean":"2024-03-23T23:42:51.763113+0000","last_became_active":"2024-03-23T23:42:39.681028+0000","last_became_peered":"2024-03-23T23:42:39.681028+0000","last_unstale":"2024-03-23T23:42:51.763113+0000","last_undegraded":"2024-03-23T23:42:51.763113+0000","last_fullsized":"2024-03-23T23:42:51.763113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:24:11.933075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328871+0000","last_change":"2024-03-23T23:42:49.741915+0000","last_active":"2024-03-23T23:42:52.328871+0000","last_peered":"2024-03-23T23:42:52.328871+0000","last_clean":"2024-03-23T23:42:52.328871+0000","last_became_active":"2024-03-23T23:42:49.741650+0000","last_became_peered":"2024-03-23T23:42:49.741650+0000","last_unstale":"2024-03-23T23:42:52.328871+0000","last_undegraded":"2024-03-23T23:42:52.328871+0000","last_fullsized":"2024-03-23T23:42:52.328871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:11:43.106922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327956+0000","last_change":"2024-03-23T23:42:50.752979+0000","last_active":"2024-03-23T23:42:52.327956+0000","last_peered":"2024-03-23T23:42:52.327956+0000","last_clean":"2024-03-23T23:42:52.327956+0000","last_became_active":"2024-03-23T23:42:50.751848+0000","last_became_peered":"2024-03-23T23:42:50.751848+0000","last_unstale":"2024-03-23T23:42:52.327956+0000","last_undegraded":"2024-03-23T23:42:52.327956+0000","last_fullsized":"2024-03-23T23:42:52.327956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:39:04.727316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190024+0000","last_change":"2024-03-23T23:42:40.689988+0000","last_active":"2024-03-23T23:42:52.190024+0000","last_peered":"2024-03-23T23:42:52.190024+0000","last_clean":"2024-03-23T23:42:52.190024+0000","last_became_active":"2024-03-23T23:42:40.689477+0000","last_became_peered":"2024-03-23T23:42:40.689477+0000","last_unstale":"2024-03-23T23:42:52.190024+0000","last_undegraded":"2024-03-23T23:42:52.190024+0000","last_fullsized":"2024-03-23T23:42:52.190024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:46:30.427072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:43:14.610017+0000","last_change":"2024-03-23T23:42:39.689429+0000","last_active":"2024-03-23T23:43:14.610017+0000","last_peered":"2024-03-23T23:43:14.610017+0000","last_clean":"2024-03-23T23:43:14.610017+0000","last_became_active":"2024-03-23T23:42:39.688066+0000","last_became_peered":"2024-03-23T23:42:39.688066+0000","last_unstale":"2024-03-23T23:43:14.610017+0000","last_undegraded":"2024-03-23T23:43:14.610017+0000","last_fullsized":"2024-03-23T23:43:14.610017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:32.254099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1866,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766492+0000","last_change":"2024-03-23T23:42:49.733543+0000","last_active":"2024-03-23T23:42:51.766492+0000","last_peered":"2024-03-23T23:42:51.766492+0000","last_clean":"2024-03-23T23:42:51.766492+0000","last_became_active":"2024-03-23T23:42:49.733197+0000","last_became_peered":"2024-03-23T23:42:49.733197+0000","last_unstale":"2024-03-23T23:42:51.766492+0000","last_undegraded":"2024-03-23T23:42:51.766492+0000","last_fullsized":"2024-03-23T23:42:51.766492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:45:20.189501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766823+0000","last_change":"2024-03-23T23:42:50.756687+0000","last_active":"2024-03-23T23:42:51.766823+0000","last_peered":"2024-03-23T23:42:51.766823+0000","last_clean":"2024-03-23T23:42:51.766823+0000","last_became_active":"2024-03-23T23:42:50.756371+0000","last_became_peered":"2024-03-23T23:42:50.756371+0000","last_unstale":"2024-03-23T23:42:51.766823+0000","last_undegraded":"2024-03-23T23:42:51.766823+0000","last_fullsized":"2024-03-23T23:42:51.766823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:29:47.303374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752229+0000","last_change":"2024-03-23T23:42:40.683025+0000","last_active":"2024-03-23T23:42:51.752229+0000","last_peered":"2024-03-23T23:42:51.752229+0000","last_clean":"2024-03-23T23:42:51.752229+0000","last_became_active":"2024-03-23T23:42:40.682798+0000","last_became_peered":"2024-03-23T23:42:40.682798+0000","last_unstale":"2024-03-23T23:42:51.752229+0000","last_undegraded":"2024-03-23T23:42:51.752229+0000","last_fullsized":"2024-03-23T23:42:51.752229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:51.565112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767463+0000","last_change":"2024-03-23T23:42:39.681675+0000","last_active":"2024-03-23T23:42:51.767463+0000","last_peered":"2024-03-23T23:42:51.767463+0000","last_clean":"2024-03-23T23:42:51.767463+0000","last_became_active":"2024-03-23T23:42:39.681364+0000","last_became_peered":"2024-03-23T23:42:39.681364+0000","last_unstale":"2024-03-23T23:42:51.767463+0000","last_undegraded":"2024-03-23T23:42:51.767463+0000","last_fullsized":"2024-03-23T23:42:51.767463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:42:37.702720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751398+0000","last_change":"2024-03-23T23:42:49.723350+0000","last_active":"2024-03-23T23:42:51.751398+0000","last_peered":"2024-03-23T23:42:51.751398+0000","last_clean":"2024-03-23T23:42:51.751398+0000","last_became_active":"2024-03-23T23:42:49.723058+0000","last_became_peered":"2024-03-23T23:42:49.723058+0000","last_unstale":"2024-03-23T23:42:51.751398+0000","last_undegraded":"2024-03-23T23:42:51.751398+0000","last_fullsized":"2024-03-23T23:42:51.751398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:43:02.835034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751554+0000","last_change":"2024-03-23T23:42:50.746422+0000","last_active":"2024-03-23T23:42:51.751554+0000","last_peered":"2024-03-23T23:42:51.751554+0000","last_clean":"2024-03-23T23:42:51.751554+0000","last_became_active":"2024-03-23T23:42:50.746104+0000","last_became_peered":"2024-03-23T23:42:50.746104+0000","last_unstale":"2024-03-23T23:42:51.751554+0000","last_undegraded":"2024-03-23T23:42:51.751554+0000","last_fullsized":"2024-03-23T23:42:51.751554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:40:34.077584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763417+0000","last_change":"2024-03-23T23:42:40.700381+0000","last_active":"2024-03-23T23:42:51.763417+0000","last_peered":"2024-03-23T23:42:51.763417+0000","last_clean":"2024-03-23T23:42:51.763417+0000","last_became_active":"2024-03-23T23:42:40.698428+0000","last_became_peered":"2024-03-23T23:42:40.698428+0000","last_unstale":"2024-03-23T23:42:51.763417+0000","last_undegraded":"2024-03-23T23:42:51.763417+0000","last_fullsized":"2024-03-23T23:42:51.763417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:07:29.242921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328837+0000","last_change":"2024-03-23T23:42:39.691092+0000","last_active":"2024-03-23T23:42:52.328837+0000","last_peered":"2024-03-23T23:42:52.328837+0000","last_clean":"2024-03-23T23:42:52.328837+0000","last_became_active":"2024-03-23T23:42:39.687473+0000","last_became_peered":"2024-03-23T23:42:39.687473+0000","last_unstale":"2024-03-23T23:42:52.328837+0000","last_undegraded":"2024-03-23T23:42:52.328837+0000","last_fullsized":"2024-03-23T23:42:52.328837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:08:03.578884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327476+0000","last_change":"2024-03-23T23:42:49.748693+0000","last_active":"2024-03-23T23:42:52.327476+0000","last_peered":"2024-03-23T23:42:52.327476+0000","last_clean":"2024-03-23T23:42:52.327476+0000","last_became_active":"2024-03-23T23:42:49.748389+0000","last_became_peered":"2024-03-23T23:42:49.748389+0000","last_unstale":"2024-03-23T23:42:52.327476+0000","last_undegraded":"2024-03-23T23:42:52.327476+0000","last_fullsized":"2024-03-23T23:42:52.327476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:58:10.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189491+0000","last_change":"2024-03-23T23:42:50.749547+0000","last_active":"2024-03-23T23:42:52.189491+0000","last_peered":"2024-03-23T23:42:52.189491+0000","last_clean":"2024-03-23T23:42:52.189491+0000","last_became_active":"2024-03-23T23:42:50.749066+0000","last_became_peered":"2024-03-23T23:42:50.749066+0000","last_unstale":"2024-03-23T23:42:52.189491+0000","last_undegraded":"2024-03-23T23:42:52.189491+0000","last_fullsized":"2024-03-23T23:42:52.189491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:09:19.723830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328727+0000","last_change":"2024-03-23T23:42:40.708795+0000","last_active":"2024-03-23T23:42:52.328727+0000","last_peered":"2024-03-23T23:42:52.328727+0000","last_clean":"2024-03-23T23:42:52.328727+0000","last_became_active":"2024-03-23T23:42:40.708199+0000","last_became_peered":"2024-03-23T23:42:40.708199+0000","last_unstale":"2024-03-23T23:42:52.328727+0000","last_undegraded":"2024-03-23T23:42:52.328727+0000","last_fullsized":"2024-03-23T23:42:52.328727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:53.782430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.753135+0000","last_change":"2024-03-23T23:42:39.684669+0000","last_active":"2024-03-23T23:42:51.753135+0000","last_peered":"2024-03-23T23:42:51.753135+0000","last_clean":"2024-03-23T23:42:51.753135+0000","last_became_active":"2024-03-23T23:42:39.684360+0000","last_became_peered":"2024-03-23T23:42:39.684360+0000","last_unstale":"2024-03-23T23:42:51.753135+0000","last_undegraded":"2024-03-23T23:42:51.753135+0000","last_fullsized":"2024-03-23T23:42:51.753135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:19.914926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327466+0000","last_change":"2024-03-23T23:42:49.741577+0000","last_active":"2024-03-23T23:42:52.327466+0000","last_peered":"2024-03-23T23:42:52.327466+0000","last_clean":"2024-03-23T23:42:52.327466+0000","last_became_active":"2024-03-23T23:42:49.741270+0000","last_became_peered":"2024-03-23T23:42:49.741270+0000","last_unstale":"2024-03-23T23:42:52.327466+0000","last_undegraded":"2024-03-23T23:42:52.327466+0000","last_fullsized":"2024-03-23T23:42:52.327466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:11:43.106922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.753001+0000","last_change":"2024-03-23T23:42:50.751992+0000","last_active":"2024-03-23T23:42:51.753001+0000","last_peered":"2024-03-23T23:42:51.753001+0000","last_clean":"2024-03-23T23:42:51.753001+0000","last_became_active":"2024-03-23T23:42:50.748281+0000","last_became_peered":"2024-03-23T23:42:50.748281+0000","last_unstale":"2024-03-23T23:42:51.753001+0000","last_undegraded":"2024-03-23T23:42:51.753001+0000","last_fullsized":"2024-03-23T23:42:51.753001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:57.968968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763361+0000","last_change":"2024-03-23T23:42:49.741658+0000","last_active":"2024-03-23T23:42:51.763361+0000","last_peered":"2024-03-23T23:42:51.763361+0000","last_clean":"2024-03-23T23:42:51.763361+0000","last_became_active":"2024-03-23T23:42:49.740899+0000","last_became_peered":"2024-03-23T23:42:49.740899+0000","last_unstale":"2024-03-23T23:42:51.763361+0000","last_undegraded":"2024-03-23T23:42:51.763361+0000","last_fullsized":"2024-03-23T23:42:51.763361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:45:20.189501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766424+0000","last_change":"2024-03-23T23:42:40.679384+0000","last_active":"2024-03-23T23:42:51.766424+0000","last_peered":"2024-03-23T23:42:51.766424+0000","last_clean":"2024-03-23T23:42:51.766424+0000","last_became_active":"2024-03-23T23:42:40.679070+0000","last_became_peered":"2024-03-23T23:42:40.679070+0000","last_unstale":"2024-03-23T23:42:51.766424+0000","last_undegraded":"2024-03-23T23:42:51.766424+0000","last_fullsized":"2024-03-23T23:42:51.766424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:26:16.171920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328187+0000","last_change":"2024-03-23T23:42:39.682839+0000","last_active":"2024-03-23T23:42:52.328187+0000","last_peered":"2024-03-23T23:42:52.328187+0000","last_clean":"2024-03-23T23:42:52.328187+0000","last_became_active":"2024-03-23T23:42:39.682584+0000","last_became_peered":"2024-03-23T23:42:39.682584+0000","last_unstale":"2024-03-23T23:42:52.328187+0000","last_undegraded":"2024-03-23T23:42:52.328187+0000","last_fullsized":"2024-03-23T23:42:52.328187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:19.914926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763311+0000","last_change":"2024-03-23T23:42:50.752596+0000","last_active":"2024-03-23T23:42:51.763311+0000","last_peered":"2024-03-23T23:42:51.763311+0000","last_clean":"2024-03-23T23:42:51.763311+0000","last_became_active":"2024-03-23T23:42:50.751598+0000","last_became_peered":"2024-03-23T23:42:50.751598+0000","last_unstale":"2024-03-23T23:42:51.763311+0000","last_undegraded":"2024-03-23T23:42:51.763311+0000","last_fullsized":"2024-03-23T23:42:51.763311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:37:19.741781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.753080+0000","last_change":"2024-03-23T23:42:49.734629+0000","last_active":"2024-03-23T23:42:51.753080+0000","last_peered":"2024-03-23T23:42:51.753080+0000","last_clean":"2024-03-23T23:42:51.753080+0000","last_became_active":"2024-03-23T23:42:49.734309+0000","last_became_peered":"2024-03-23T23:42:49.734309+0000","last_unstale":"2024-03-23T23:42:51.753080+0000","last_undegraded":"2024-03-23T23:42:51.753080+0000","last_fullsized":"2024-03-23T23:42:51.753080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:46.760020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327687+0000","last_change":"2024-03-23T23:42:40.674605+0000","last_active":"2024-03-23T23:42:52.327687+0000","last_peered":"2024-03-23T23:42:52.327687+0000","last_clean":"2024-03-23T23:42:52.327687+0000","last_became_active":"2024-03-23T23:42:40.674366+0000","last_became_peered":"2024-03-23T23:42:40.674366+0000","last_unstale":"2024-03-23T23:42:52.327687+0000","last_undegraded":"2024-03-23T23:42:52.327687+0000","last_fullsized":"2024-03-23T23:42:52.327687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327666+0000","last_change":"2024-03-23T23:42:39.688646+0000","last_active":"2024-03-23T23:42:52.327666+0000","last_peered":"2024-03-23T23:42:52.327666+0000","last_clean":"2024-03-23T23:42:52.327666+0000","last_became_active":"2024-03-23T23:42:39.687489+0000","last_became_peered":"2024-03-23T23:42:39.687489+0000","last_unstale":"2024-03-23T23:42:52.327666+0000","last_undegraded":"2024-03-23T23:42:52.327666+0000","last_fullsized":"2024-03-23T23:42:52.327666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:07:12.649156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767201+0000","last_change":"2024-03-23T23:42:50.748511+0000","last_active":"2024-03-23T23:42:51.767201+0000","last_peered":"2024-03-23T23:42:51.767201+0000","last_clean":"2024-03-23T23:42:51.767201+0000","last_became_active":"2024-03-23T23:42:50.747154+0000","last_became_peered":"2024-03-23T23:42:50.747154+0000","last_unstale":"2024-03-23T23:42:51.767201+0000","last_undegraded":"2024-03-23T23:42:51.767201+0000","last_fullsized":"2024-03-23T23:42:51.767201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:09:19.723830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751549+0000","last_change":"2024-03-23T23:42:39.681458+0000","last_active":"2024-03-23T23:42:51.751549+0000","last_peered":"2024-03-23T23:42:51.751549+0000","last_clean":"2024-03-23T23:42:51.751549+0000","last_became_active":"2024-03-23T23:42:39.681158+0000","last_became_peered":"2024-03-23T23:42:39.681158+0000","last_unstale":"2024-03-23T23:42:51.751549+0000","last_undegraded":"2024-03-23T23:42:51.751549+0000","last_fullsized":"2024-03-23T23:42:51.751549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:08:03.578884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763042+0000","last_change":"2024-03-23T23:42:40.676571+0000","last_active":"2024-03-23T23:42:51.763042+0000","last_peered":"2024-03-23T23:42:51.763042+0000","last_clean":"2024-03-23T23:42:51.763042+0000","last_became_active":"2024-03-23T23:42:40.675877+0000","last_became_peered":"2024-03-23T23:42:40.675877+0000","last_unstale":"2024-03-23T23:42:51.763042+0000","last_undegraded":"2024-03-23T23:42:51.763042+0000","last_fullsized":"2024-03-23T23:42:51.763042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:52.220411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749759+0000","last_change":"2024-03-23T23:42:49.734208+0000","last_active":"2024-03-23T23:42:51.749759+0000","last_peered":"2024-03-23T23:42:51.749759+0000","last_clean":"2024-03-23T23:42:51.749759+0000","last_became_active":"2024-03-23T23:42:49.732943+0000","last_became_peered":"2024-03-23T23:42:49.732943+0000","last_unstale":"2024-03-23T23:42:51.749759+0000","last_undegraded":"2024-03-23T23:42:51.749759+0000","last_fullsized":"2024-03-23T23:42:51.749759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:43.683275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751832+0000","last_change":"2024-03-23T23:42:50.752722+0000","last_active":"2024-03-23T23:42:51.751832+0000","last_peered":"2024-03-23T23:42:51.751832+0000","last_clean":"2024-03-23T23:42:51.751832+0000","last_became_active":"2024-03-23T23:42:50.749400+0000","last_became_peered":"2024-03-23T23:42:50.749400+0000","last_unstale":"2024-03-23T23:42:51.751832+0000","last_undegraded":"2024-03-23T23:42:51.751832+0000","last_fullsized":"2024-03-23T23:42:51.751832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:16:44.027189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328094+0000","last_change":"2024-03-23T23:42:39.688422+0000","last_active":"2024-03-23T23:42:52.328094+0000","last_peered":"2024-03-23T23:42:52.328094+0000","last_clean":"2024-03-23T23:42:52.328094+0000","last_became_active":"2024-03-23T23:42:39.687423+0000","last_became_peered":"2024-03-23T23:42:39.687423+0000","last_unstale":"2024-03-23T23:42:52.328094+0000","last_undegraded":"2024-03-23T23:42:52.328094+0000","last_fullsized":"2024-03-23T23:42:52.328094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:20:38.456655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751184+0000","last_change":"2024-03-23T23:42:40.680801+0000","last_active":"2024-03-23T23:42:51.751184+0000","last_peered":"2024-03-23T23:42:51.751184+0000","last_clean":"2024-03-23T23:42:51.751184+0000","last_became_active":"2024-03-23T23:42:40.680511+0000","last_became_peered":"2024-03-23T23:42:40.680511+0000","last_unstale":"2024-03-23T23:42:51.751184+0000","last_undegraded":"2024-03-23T23:42:51.751184+0000","last_fullsized":"2024-03-23T23:42:51.751184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:27:42.392714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328321+0000","last_change":"2024-03-23T23:42:49.751291+0000","last_active":"2024-03-23T23:42:52.328321+0000","last_peered":"2024-03-23T23:42:52.328321+0000","last_clean":"2024-03-23T23:42:52.328321+0000","last_became_active":"2024-03-23T23:42:49.749695+0000","last_became_peered":"2024-03-23T23:42:49.749695+0000","last_unstale":"2024-03-23T23:42:52.328321+0000","last_undegraded":"2024-03-23T23:42:52.328321+0000","last_fullsized":"2024-03-23T23:42:52.328321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:40:33.073029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328522+0000","last_change":"2024-03-23T23:42:50.752672+0000","last_active":"2024-03-23T23:42:52.328522+0000","last_peered":"2024-03-23T23:42:52.328522+0000","last_clean":"2024-03-23T23:42:52.328522+0000","last_became_active":"2024-03-23T23:42:50.752394+0000","last_became_peered":"2024-03-23T23:42:50.752394+0000","last_unstale":"2024-03-23T23:42:52.328522+0000","last_undegraded":"2024-03-23T23:42:52.328522+0000","last_fullsized":"2024-03-23T23:42:52.328522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:51:01.385876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750919+0000","last_change":"2024-03-23T23:42:40.679042+0000","last_active":"2024-03-23T23:42:51.750919+0000","last_peered":"2024-03-23T23:42:51.750919+0000","last_clean":"2024-03-23T23:42:51.750919+0000","last_became_active":"2024-03-23T23:42:40.678518+0000","last_became_peered":"2024-03-23T23:42:40.678518+0000","last_unstale":"2024-03-23T23:42:51.750919+0000","last_undegraded":"2024-03-23T23:42:51.750919+0000","last_fullsized":"2024-03-23T23:42:51.750919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:12:14.359173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767231+0000","last_change":"2024-03-23T23:42:50.757132+0000","last_active":"2024-03-23T23:42:51.767231+0000","last_peered":"2024-03-23T23:42:51.767231+0000","last_clean":"2024-03-23T23:42:51.767231+0000","last_became_active":"2024-03-23T23:42:50.756813+0000","last_became_peered":"2024-03-23T23:42:50.756813+0000","last_unstale":"2024-03-23T23:42:51.767231+0000","last_undegraded":"2024-03-23T23:42:51.767231+0000","last_fullsized":"2024-03-23T23:42:51.767231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:04:26.911514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749494+0000","last_change":"2024-03-23T23:42:40.702411+0000","last_active":"2024-03-23T23:42:51.749494+0000","last_peered":"2024-03-23T23:42:51.749494+0000","last_clean":"2024-03-23T23:42:51.749494+0000","last_became_active":"2024-03-23T23:42:40.701398+0000","last_became_peered":"2024-03-23T23:42:40.701398+0000","last_unstale":"2024-03-23T23:42:51.749494+0000","last_undegraded":"2024-03-23T23:42:51.749494+0000","last_fullsized":"2024-03-23T23:42:51.749494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:03.196963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328386+0000","last_change":"2024-03-23T23:42:50.756769+0000","last_active":"2024-03-23T23:42:52.328386+0000","last_peered":"2024-03-23T23:42:52.328386+0000","last_clean":"2024-03-23T23:42:52.328386+0000","last_became_active":"2024-03-23T23:42:50.756503+0000","last_became_peered":"2024-03-23T23:42:50.756503+0000","last_unstale":"2024-03-23T23:42:52.328386+0000","last_undegraded":"2024-03-23T23:42:52.328386+0000","last_fullsized":"2024-03-23T23:42:52.328386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:50.597847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328394+0000","last_change":"2024-03-23T23:42:40.698519+0000","last_active":"2024-03-23T23:42:52.328394+0000","last_peered":"2024-03-23T23:42:52.328394+0000","last_clean":"2024-03-23T23:42:52.328394+0000","last_became_active":"2024-03-23T23:42:40.695218+0000","last_became_peered":"2024-03-23T23:42:40.695218+0000","last_unstale":"2024-03-23T23:42:52.328394+0000","last_undegraded":"2024-03-23T23:42:52.328394+0000","last_fullsized":"2024-03-23T23:42:52.328394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:00:54.983365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767039+0000","last_change":"2024-03-23T23:42:50.748726+0000","last_active":"2024-03-23T23:42:51.767039+0000","last_peered":"2024-03-23T23:42:51.767039+0000","last_clean":"2024-03-23T23:42:51.767039+0000","last_became_active":"2024-03-23T23:42:50.748105+0000","last_became_peered":"2024-03-23T23:42:50.748105+0000","last_unstale":"2024-03-23T23:42:51.767039+0000","last_undegraded":"2024-03-23T23:42:51.767039+0000","last_fullsized":"2024-03-23T23:42:51.767039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:54.910408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763001+0000","last_change":"2024-03-23T23:42:40.673293+0000","last_active":"2024-03-23T23:42:51.763001+0000","last_peered":"2024-03-23T23:42:51.763001+0000","last_clean":"2024-03-23T23:42:51.763001+0000","last_became_active":"2024-03-23T23:42:40.672910+0000","last_became_peered":"2024-03-23T23:42:40.672910+0000","last_unstale":"2024-03-23T23:42:51.763001+0000","last_undegraded":"2024-03-23T23:42:51.763001+0000","last_fullsized":"2024-03-23T23:42:51.763001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:42:14.952953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189476+0000","last_change":"2024-03-23T23:42:50.750291+0000","last_active":"2024-03-23T23:42:52.189476+0000","last_peered":"2024-03-23T23:42:52.189476+0000","last_clean":"2024-03-23T23:42:52.189476+0000","last_became_active":"2024-03-23T23:42:50.749908+0000","last_became_peered":"2024-03-23T23:42:50.749908+0000","last_unstale":"2024-03-23T23:42:52.189476+0000","last_undegraded":"2024-03-23T23:42:52.189476+0000","last_fullsized":"2024-03-23T23:42:52.189476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:54.910408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328216+0000","last_change":"2024-03-23T23:42:40.685370+0000","last_active":"2024-03-23T23:42:52.328216+0000","last_peered":"2024-03-23T23:42:52.328216+0000","last_clean":"2024-03-23T23:42:52.328216+0000","last_became_active":"2024-03-23T23:42:40.685120+0000","last_became_peered":"2024-03-23T23:42:40.685120+0000","last_unstale":"2024-03-23T23:42:52.328216+0000","last_undegraded":"2024-03-23T23:42:52.328216+0000","last_fullsized":"2024-03-23T23:42:52.328216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751268+0000","last_change":"2024-03-23T23:42:50.747361+0000","last_active":"2024-03-23T23:42:51.751268+0000","last_peered":"2024-03-23T23:42:51.751268+0000","last_clean":"2024-03-23T23:42:51.751268+0000","last_became_active":"2024-03-23T23:42:50.746310+0000","last_became_peered":"2024-03-23T23:42:50.746310+0000","last_unstale":"2024-03-23T23:42:51.751268+0000","last_undegraded":"2024-03-23T23:42:51.751268+0000","last_fullsized":"2024-03-23T23:42:51.751268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:57.968968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767365+0000","last_change":"2024-03-23T23:42:40.677168+0000","last_active":"2024-03-23T23:42:51.767365+0000","last_peered":"2024-03-23T23:42:51.767365+0000","last_clean":"2024-03-23T23:42:51.767365+0000","last_became_active":"2024-03-23T23:42:40.676912+0000","last_became_peered":"2024-03-23T23:42:40.676912+0000","last_unstale":"2024-03-23T23:42:51.767365+0000","last_undegraded":"2024-03-23T23:42:51.767365+0000","last_fullsized":"2024-03-23T23:42:51.767365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:17:19.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189346+0000","last_change":"2024-03-23T23:42:50.749305+0000","last_active":"2024-03-23T23:42:52.189346+0000","last_peered":"2024-03-23T23:42:52.189346+0000","last_clean":"2024-03-23T23:42:52.189346+0000","last_became_active":"2024-03-23T23:42:50.748798+0000","last_became_peered":"2024-03-23T23:42:50.748798+0000","last_unstale":"2024-03-23T23:42:52.189346+0000","last_undegraded":"2024-03-23T23:42:52.189346+0000","last_fullsized":"2024-03-23T23:42:52.189346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:19.610436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752528+0000","last_change":"2024-03-23T23:42:40.694420+0000","last_active":"2024-03-23T23:42:51.752528+0000","last_peered":"2024-03-23T23:42:51.752528+0000","last_clean":"2024-03-23T23:42:51.752528+0000","last_became_active":"2024-03-23T23:42:40.693867+0000","last_became_peered":"2024-03-23T23:42:40.693867+0000","last_unstale":"2024-03-23T23:42:51.752528+0000","last_undegraded":"2024-03-23T23:42:51.752528+0000","last_fullsized":"2024-03-23T23:42:51.752528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:54.557634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751411+0000","last_change":"2024-03-23T23:42:50.754149+0000","last_active":"2024-03-23T23:42:51.751411+0000","last_peered":"2024-03-23T23:42:51.751411+0000","last_clean":"2024-03-23T23:42:51.751411+0000","last_became_active":"2024-03-23T23:42:50.753471+0000","last_became_peered":"2024-03-23T23:42:50.753471+0000","last_unstale":"2024-03-23T23:42:51.751411+0000","last_undegraded":"2024-03-23T23:42:51.751411+0000","last_fullsized":"2024-03-23T23:42:51.751411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:28.822672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328282+0000","last_change":"2024-03-23T23:42:40.685177+0000","last_active":"2024-03-23T23:42:52.328282+0000","last_peered":"2024-03-23T23:42:52.328282+0000","last_clean":"2024-03-23T23:42:52.328282+0000","last_became_active":"2024-03-23T23:42:40.684495+0000","last_became_peered":"2024-03-23T23:42:40.684495+0000","last_unstale":"2024-03-23T23:42:52.328282+0000","last_undegraded":"2024-03-23T23:42:52.328282+0000","last_fullsized":"2024-03-23T23:42:52.328282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:27.675824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328493+0000","last_change":"2024-03-23T23:42:50.746438+0000","last_active":"2024-03-23T23:42:52.328493+0000","last_peered":"2024-03-23T23:42:52.328493+0000","last_clean":"2024-03-23T23:42:52.328493+0000","last_became_active":"2024-03-23T23:42:50.745771+0000","last_became_peered":"2024-03-23T23:42:50.745771+0000","last_unstale":"2024-03-23T23:42:52.328493+0000","last_undegraded":"2024-03-23T23:42:52.328493+0000","last_fullsized":"2024-03-23T23:42:52.328493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:22:17.484059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328084+0000","last_change":"2024-03-23T23:42:40.701852+0000","last_active":"2024-03-23T23:42:52.328084+0000","last_peered":"2024-03-23T23:42:52.328084+0000","last_clean":"2024-03-23T23:42:52.328084+0000","last_became_active":"2024-03-23T23:42:40.701566+0000","last_became_peered":"2024-03-23T23:42:40.701566+0000","last_unstale":"2024-03-23T23:42:52.328084+0000","last_undegraded":"2024-03-23T23:42:52.328084+0000","last_fullsized":"2024-03-23T23:42:52.328084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190034+0000","last_change":"2024-03-23T23:42:50.758879+0000","last_active":"2024-03-23T23:42:52.190034+0000","last_peered":"2024-03-23T23:42:52.190034+0000","last_clean":"2024-03-23T23:42:52.190034+0000","last_became_active":"2024-03-23T23:42:50.758564+0000","last_became_peered":"2024-03-23T23:42:50.758564+0000","last_unstale":"2024-03-23T23:42:52.190034+0000","last_undegraded":"2024-03-23T23:42:52.190034+0000","last_fullsized":"2024-03-23T23:42:52.190034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:11:29.268536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327548+0000","last_change":"2024-03-23T23:42:40.684899+0000","last_active":"2024-03-23T23:42:52.327548+0000","last_peered":"2024-03-23T23:42:52.327548+0000","last_clean":"2024-03-23T23:42:52.327548+0000","last_became_active":"2024-03-23T23:42:40.684603+0000","last_became_peered":"2024-03-23T23:42:40.684603+0000","last_unstale":"2024-03-23T23:42:52.327548+0000","last_undegraded":"2024-03-23T23:42:52.327548+0000","last_fullsized":"2024-03-23T23:42:52.327548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:54.557634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749737+0000","last_change":"2024-03-23T23:42:50.754096+0000","last_active":"2024-03-23T23:42:51.749737+0000","last_peered":"2024-03-23T23:42:51.749737+0000","last_clean":"2024-03-23T23:42:51.749737+0000","last_became_active":"2024-03-23T23:42:50.753602+0000","last_became_peered":"2024-03-23T23:42:50.753602+0000","last_unstale":"2024-03-23T23:42:51.749737+0000","last_undegraded":"2024-03-23T23:42:51.749737+0000","last_fullsized":"2024-03-23T23:42:51.749737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:16:26.794444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328338+0000","last_change":"2024-03-23T23:42:40.707800+0000","last_active":"2024-03-23T23:42:52.328338+0000","last_peered":"2024-03-23T23:42:52.328338+0000","last_clean":"2024-03-23T23:42:52.328338+0000","last_became_active":"2024-03-23T23:42:40.707528+0000","last_became_peered":"2024-03-23T23:42:40.707528+0000","last_unstale":"2024-03-23T23:42:52.328338+0000","last_undegraded":"2024-03-23T23:42:52.328338+0000","last_fullsized":"2024-03-23T23:42:52.328338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:03:24.275154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328659+0000","last_change":"2024-03-23T23:42:50.741324+0000","last_active":"2024-03-23T23:42:52.328659+0000","last_peered":"2024-03-23T23:42:52.328659+0000","last_clean":"2024-03-23T23:42:52.328659+0000","last_became_active":"2024-03-23T23:42:50.741065+0000","last_became_peered":"2024-03-23T23:42:50.741065+0000","last_unstale":"2024-03-23T23:42:52.328659+0000","last_undegraded":"2024-03-23T23:42:52.328659+0000","last_fullsized":"2024-03-23T23:42:52.328659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:13.911327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.762890+0000","last_change":"2024-03-23T23:42:40.689122+0000","last_active":"2024-03-23T23:42:51.762890+0000","last_peered":"2024-03-23T23:42:51.762890+0000","last_clean":"2024-03-23T23:42:51.762890+0000","last_became_active":"2024-03-23T23:42:40.688875+0000","last_became_peered":"2024-03-23T23:42:40.688875+0000","last_unstale":"2024-03-23T23:42:51.762890+0000","last_undegraded":"2024-03-23T23:42:51.762890+0000","last_fullsized":"2024-03-23T23:42:51.762890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:27:03.132032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.750979+0000","last_change":"2024-03-23T23:42:50.762055+0000","last_active":"2024-03-23T23:42:51.750979+0000","last_peered":"2024-03-23T23:42:51.750979+0000","last_clean":"2024-03-23T23:42:51.750979+0000","last_became_active":"2024-03-23T23:42:50.761762+0000","last_became_peered":"2024-03-23T23:42:50.761762+0000","last_unstale":"2024-03-23T23:42:51.750979+0000","last_undegraded":"2024-03-23T23:42:51.750979+0000","last_fullsized":"2024-03-23T23:42:51.750979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:28.822672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752195+0000","last_change":"2024-03-23T23:42:40.683701+0000","last_active":"2024-03-23T23:42:51.752195+0000","last_peered":"2024-03-23T23:42:51.752195+0000","last_clean":"2024-03-23T23:42:51.752195+0000","last_became_active":"2024-03-23T23:42:40.683377+0000","last_became_peered":"2024-03-23T23:42:40.683377+0000","last_unstale":"2024-03-23T23:42:51.752195+0000","last_undegraded":"2024-03-23T23:42:51.752195+0000","last_fullsized":"2024-03-23T23:42:51.752195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.751120+0000","last_change":"2024-03-23T23:42:50.754372+0000","last_active":"2024-03-23T23:42:51.751120+0000","last_peered":"2024-03-23T23:42:51.751120+0000","last_clean":"2024-03-23T23:42:51.751120+0000","last_became_active":"2024-03-23T23:42:50.754072+0000","last_became_peered":"2024-03-23T23:42:50.754072+0000","last_unstale":"2024-03-23T23:42:51.751120+0000","last_undegraded":"2024-03-23T23:42:51.751120+0000","last_fullsized":"2024-03-23T23:42:51.751120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:40:34.077584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190143+0000","last_change":"2024-03-23T23:42:40.689769+0000","last_active":"2024-03-23T23:42:52.190143+0000","last_peered":"2024-03-23T23:42:52.190143+0000","last_clean":"2024-03-23T23:42:52.190143+0000","last_became_active":"2024-03-23T23:42:40.689111+0000","last_became_peered":"2024-03-23T23:42:40.689111+0000","last_unstale":"2024-03-23T23:42:52.190143+0000","last_undegraded":"2024-03-23T23:42:52.190143+0000","last_fullsized":"2024-03-23T23:42:52.190143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:40:22.690954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328020+0000","last_change":"2024-03-23T23:42:50.759792+0000","last_active":"2024-03-23T23:42:52.328020+0000","last_peered":"2024-03-23T23:42:52.328020+0000","last_clean":"2024-03-23T23:42:52.328020+0000","last_became_active":"2024-03-23T23:42:50.759604+0000","last_became_peered":"2024-03-23T23:42:50.759604+0000","last_unstale":"2024-03-23T23:42:52.328020+0000","last_undegraded":"2024-03-23T23:42:52.328020+0000","last_fullsized":"2024-03-23T23:42:52.328020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:15:25.617521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749937+0000","last_change":"2024-03-23T23:42:40.690961+0000","last_active":"2024-03-23T23:42:51.749937+0000","last_peered":"2024-03-23T23:42:51.749937+0000","last_clean":"2024-03-23T23:42:51.749937+0000","last_became_active":"2024-03-23T23:42:40.690690+0000","last_became_peered":"2024-03-23T23:42:40.690690+0000","last_unstale":"2024-03-23T23:42:51.749937+0000","last_undegraded":"2024-03-23T23:42:51.749937+0000","last_fullsized":"2024-03-23T23:42:51.749937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:56.763759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.762557+0000","last_change":"2024-03-23T23:42:50.764821+0000","last_active":"2024-03-23T23:42:51.762557+0000","last_peered":"2024-03-23T23:42:51.762557+0000","last_clean":"2024-03-23T23:42:51.762557+0000","last_became_active":"2024-03-23T23:42:50.764563+0000","last_became_peered":"2024-03-23T23:42:50.764563+0000","last_unstale":"2024-03-23T23:42:51.762557+0000","last_undegraded":"2024-03-23T23:42:51.762557+0000","last_fullsized":"2024-03-23T23:42:51.762557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:48:24.982671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.329026+0000","last_change":"2024-03-23T23:42:40.708540+0000","last_active":"2024-03-23T23:42:52.329026+0000","last_peered":"2024-03-23T23:42:52.329026+0000","last_clean":"2024-03-23T23:42:52.329026+0000","last_became_active":"2024-03-23T23:42:40.708031+0000","last_became_peered":"2024-03-23T23:42:40.708031+0000","last_unstale":"2024-03-23T23:42:52.329026+0000","last_undegraded":"2024-03-23T23:42:52.329026+0000","last_fullsized":"2024-03-23T23:42:52.329026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:44:03.386124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766736+0000","last_change":"2024-03-23T23:42:50.771062+0000","last_active":"2024-03-23T23:42:51.766736+0000","last_peered":"2024-03-23T23:42:51.766736+0000","last_clean":"2024-03-23T23:42:51.766736+0000","last_became_active":"2024-03-23T23:42:50.770790+0000","last_became_peered":"2024-03-23T23:42:50.770790+0000","last_unstale":"2024-03-23T23:42:51.766736+0000","last_undegraded":"2024-03-23T23:42:51.766736+0000","last_fullsized":"2024-03-23T23:42:51.766736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:13:07.156401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328080+0000","last_change":"2024-03-23T23:42:40.697920+0000","last_active":"2024-03-23T23:42:52.328080+0000","last_peered":"2024-03-23T23:42:52.328080+0000","last_clean":"2024-03-23T23:42:52.328080+0000","last_became_active":"2024-03-23T23:42:40.697694+0000","last_became_peered":"2024-03-23T23:42:40.697694+0000","last_unstale":"2024-03-23T23:42:52.328080+0000","last_undegraded":"2024-03-23T23:42:52.328080+0000","last_fullsized":"2024-03-23T23:42:52.328080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752567+0000","last_change":"2024-03-23T23:42:50.751694+0000","last_active":"2024-03-23T23:42:51.752567+0000","last_peered":"2024-03-23T23:42:51.752567+0000","last_clean":"2024-03-23T23:42:51.752567+0000","last_became_active":"2024-03-23T23:42:50.751452+0000","last_became_peered":"2024-03-23T23:42:50.751452+0000","last_unstale":"2024-03-23T23:42:51.752567+0000","last_undegraded":"2024-03-23T23:42:51.752567+0000","last_fullsized":"2024-03-23T23:42:51.752567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:57:49.981068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.767129+0000","last_change":"2024-03-23T23:42:40.681928+0000","last_active":"2024-03-23T23:42:51.767129+0000","last_peered":"2024-03-23T23:42:51.767129+0000","last_clean":"2024-03-23T23:42:51.767129+0000","last_became_active":"2024-03-23T23:42:40.681337+0000","last_became_peered":"2024-03-23T23:42:40.681337+0000","last_unstale":"2024-03-23T23:42:51.767129+0000","last_undegraded":"2024-03-23T23:42:51.767129+0000","last_fullsized":"2024-03-23T23:42:51.767129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:52.220411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328332+0000","last_change":"2024-03-23T23:42:50.769003+0000","last_active":"2024-03-23T23:42:52.328332+0000","last_peered":"2024-03-23T23:42:52.328332+0000","last_clean":"2024-03-23T23:42:52.328332+0000","last_became_active":"2024-03-23T23:42:50.768695+0000","last_became_peered":"2024-03-23T23:42:50.768695+0000","last_unstale":"2024-03-23T23:42:52.328332+0000","last_undegraded":"2024-03-23T23:42:52.328332+0000","last_fullsized":"2024-03-23T23:42:52.328332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:17:11.847056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.762577+0000","last_change":"2024-03-23T23:42:40.680934+0000","last_active":"2024-03-23T23:42:51.762577+0000","last_peered":"2024-03-23T23:42:51.762577+0000","last_clean":"2024-03-23T23:42:51.762577+0000","last_became_active":"2024-03-23T23:42:40.680643+0000","last_became_peered":"2024-03-23T23:42:40.680643+0000","last_unstale":"2024-03-23T23:42:51.762577+0000","last_undegraded":"2024-03-23T23:42:51.762577+0000","last_fullsized":"2024-03-23T23:42:51.762577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:34.630671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189908+0000","last_change":"2024-03-23T23:42:50.762401+0000","last_active":"2024-03-23T23:42:52.189908+0000","last_peered":"2024-03-23T23:42:52.189908+0000","last_clean":"2024-03-23T23:42:52.189908+0000","last_became_active":"2024-03-23T23:42:50.762183+0000","last_became_peered":"2024-03-23T23:42:50.762183+0000","last_unstale":"2024-03-23T23:42:52.189908+0000","last_undegraded":"2024-03-23T23:42:52.189908+0000","last_fullsized":"2024-03-23T23:42:52.189908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:13:10.497921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327888+0000","last_change":"2024-03-23T23:42:40.682736+0000","last_active":"2024-03-23T23:42:52.327888+0000","last_peered":"2024-03-23T23:42:52.327888+0000","last_clean":"2024-03-23T23:42:52.327888+0000","last_became_active":"2024-03-23T23:42:40.682410+0000","last_became_peered":"2024-03-23T23:42:40.682410+0000","last_unstale":"2024-03-23T23:42:52.327888+0000","last_undegraded":"2024-03-23T23:42:52.327888+0000","last_fullsized":"2024-03-23T23:42:52.327888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:01:06.338641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327793+0000","last_change":"2024-03-23T23:42:50.749204+0000","last_active":"2024-03-23T23:42:52.327793+0000","last_peered":"2024-03-23T23:42:52.327793+0000","last_clean":"2024-03-23T23:42:52.327793+0000","last_became_active":"2024-03-23T23:42:50.748809+0000","last_became_peered":"2024-03-23T23:42:50.748809+0000","last_unstale":"2024-03-23T23:42:52.327793+0000","last_undegraded":"2024-03-23T23:42:52.327793+0000","last_fullsized":"2024-03-23T23:42:52.327793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:39:49.888359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752151+0000","last_change":"2024-03-23T23:42:40.682523+0000","last_active":"2024-03-23T23:42:51.752151+0000","last_peered":"2024-03-23T23:42:51.752151+0000","last_clean":"2024-03-23T23:42:51.752151+0000","last_became_active":"2024-03-23T23:42:40.682155+0000","last_became_peered":"2024-03-23T23:42:40.682155+0000","last_unstale":"2024-03-23T23:42:51.752151+0000","last_undegraded":"2024-03-23T23:42:51.752151+0000","last_fullsized":"2024-03-23T23:42:51.752151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:33.260151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749469+0000","last_change":"2024-03-23T23:42:50.746115+0000","last_active":"2024-03-23T23:42:51.749469+0000","last_peered":"2024-03-23T23:42:51.749469+0000","last_clean":"2024-03-23T23:42:51.749469+0000","last_became_active":"2024-03-23T23:42:50.745858+0000","last_became_peered":"2024-03-23T23:42:50.745858+0000","last_unstale":"2024-03-23T23:42:51.749469+0000","last_undegraded":"2024-03-23T23:42:51.749469+0000","last_fullsized":"2024-03-23T23:42:51.749469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:00:43.318455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752280+0000","last_change":"2024-03-23T23:42:40.702089+0000","last_active":"2024-03-23T23:42:51.752280+0000","last_peered":"2024-03-23T23:42:51.752280+0000","last_clean":"2024-03-23T23:42:51.752280+0000","last_became_active":"2024-03-23T23:42:40.701874+0000","last_became_peered":"2024-03-23T23:42:40.701874+0000","last_unstale":"2024-03-23T23:42:51.752280+0000","last_undegraded":"2024-03-23T23:42:51.752280+0000","last_fullsized":"2024-03-23T23:42:51.752280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189853+0000","last_change":"2024-03-23T23:42:50.773115+0000","last_active":"2024-03-23T23:42:52.189853+0000","last_peered":"2024-03-23T23:42:52.189853+0000","last_clean":"2024-03-23T23:42:52.189853+0000","last_became_active":"2024-03-23T23:42:50.772849+0000","last_became_peered":"2024-03-23T23:42:50.772849+0000","last_unstale":"2024-03-23T23:42:52.189853+0000","last_undegraded":"2024-03-23T23:42:52.189853+0000","last_fullsized":"2024-03-23T23:42:52.189853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:29:42.898728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752487+0000","last_change":"2024-03-23T23:42:40.703254+0000","last_active":"2024-03-23T23:42:51.752487+0000","last_peered":"2024-03-23T23:42:51.752487+0000","last_clean":"2024-03-23T23:42:51.752487+0000","last_became_active":"2024-03-23T23:42:40.702447+0000","last_became_peered":"2024-03-23T23:42:40.702447+0000","last_unstale":"2024-03-23T23:42:51.752487+0000","last_undegraded":"2024-03-23T23:42:51.752487+0000","last_fullsized":"2024-03-23T23:42:51.752487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:59:45.154553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328157+0000","last_change":"2024-03-23T23:42:50.748946+0000","last_active":"2024-03-23T23:42:52.328157+0000","last_peered":"2024-03-23T23:42:52.328157+0000","last_clean":"2024-03-23T23:42:52.328157+0000","last_became_active":"2024-03-23T23:42:50.745205+0000","last_became_peered":"2024-03-23T23:42:50.745205+0000","last_unstale":"2024-03-23T23:42:52.328157+0000","last_undegraded":"2024-03-23T23:42:52.328157+0000","last_fullsized":"2024-03-23T23:42:52.328157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:58:16.372010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190250+0000","last_change":"2024-03-23T23:42:40.714331+0000","last_active":"2024-03-23T23:42:52.190250+0000","last_peered":"2024-03-23T23:42:52.190250+0000","last_clean":"2024-03-23T23:42:52.190250+0000","last_became_active":"2024-03-23T23:42:40.713737+0000","last_became_peered":"2024-03-23T23:42:40.713737+0000","last_unstale":"2024-03-23T23:42:52.190250+0000","last_undegraded":"2024-03-23T23:42:52.190250+0000","last_fullsized":"2024-03-23T23:42:52.190250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:24:43.902129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328361+0000","last_change":"2024-03-23T23:42:50.746666+0000","last_active":"2024-03-23T23:42:52.328361+0000","last_peered":"2024-03-23T23:42:52.328361+0000","last_clean":"2024-03-23T23:42:52.328361+0000","last_became_active":"2024-03-23T23:42:50.746149+0000","last_became_peered":"2024-03-23T23:42:50.746149+0000","last_unstale":"2024-03-23T23:42:52.328361+0000","last_undegraded":"2024-03-23T23:42:52.328361+0000","last_fullsized":"2024-03-23T23:42:52.328361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:42:58.533499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327499+0000","last_change":"2024-03-23T23:42:40.710655+0000","last_active":"2024-03-23T23:42:52.327499+0000","last_peered":"2024-03-23T23:42:52.327499+0000","last_clean":"2024-03-23T23:42:52.327499+0000","last_became_active":"2024-03-23T23:42:40.710362+0000","last_became_peered":"2024-03-23T23:42:40.710362+0000","last_unstale":"2024-03-23T23:42:52.327499+0000","last_undegraded":"2024-03-23T23:42:52.327499+0000","last_fullsized":"2024-03-23T23:42:52.327499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:12:14.359173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.752890+0000","last_change":"2024-03-23T23:42:50.753397+0000","last_active":"2024-03-23T23:42:51.752890+0000","last_peered":"2024-03-23T23:42:51.752890+0000","last_clean":"2024-03-23T23:42:51.752890+0000","last_became_active":"2024-03-23T23:42:50.753085+0000","last_became_peered":"2024-03-23T23:42:50.753085+0000","last_unstale":"2024-03-23T23:42:51.752890+0000","last_undegraded":"2024-03-23T23:42:51.752890+0000","last_fullsized":"2024-03-23T23:42:51.752890+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:25:44.894505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189509+0000","last_change":"2024-03-23T23:42:40.689380+0000","last_active":"2024-03-23T23:42:52.189509+0000","last_peered":"2024-03-23T23:42:52.189509+0000","last_clean":"2024-03-23T23:42:52.189509+0000","last_became_active":"2024-03-23T23:42:40.689023+0000","last_became_peered":"2024-03-23T23:42:40.689023+0000","last_unstale":"2024-03-23T23:42:52.189509+0000","last_undegraded":"2024-03-23T23:42:52.189509+0000","last_fullsized":"2024-03-23T23:42:52.189509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:17:19.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766610+0000","last_change":"2024-03-23T23:42:50.756133+0000","last_active":"2024-03-23T23:42:51.766610+0000","last_peered":"2024-03-23T23:42:51.766610+0000","last_clean":"2024-03-23T23:42:51.766610+0000","last_became_active":"2024-03-23T23:42:50.755405+0000","last_became_peered":"2024-03-23T23:42:50.755405+0000","last_unstale":"2024-03-23T23:42:51.766610+0000","last_undegraded":"2024-03-23T23:42:51.766610+0000","last_fullsized":"2024-03-23T23:42:51.766610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:46:10.784416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328292+0000","last_change":"2024-03-23T23:42:40.698234+0000","last_active":"2024-03-23T23:42:52.328292+0000","last_peered":"2024-03-23T23:42:52.328292+0000","last_clean":"2024-03-23T23:42:52.328292+0000","last_became_active":"2024-03-23T23:42:40.695978+0000","last_became_peered":"2024-03-23T23:42:40.695978+0000","last_unstale":"2024-03-23T23:42:52.328292+0000","last_undegraded":"2024-03-23T23:42:52.328292+0000","last_fullsized":"2024-03-23T23:42:52.328292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:04.633288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328907+0000","last_change":"2024-03-23T23:42:50.752051+0000","last_active":"2024-03-23T23:42:52.328907+0000","last_peered":"2024-03-23T23:42:52.328907+0000","last_clean":"2024-03-23T23:42:52.328907+0000","last_became_active":"2024-03-23T23:42:50.751738+0000","last_became_peered":"2024-03-23T23:42:50.751738+0000","last_unstale":"2024-03-23T23:42:52.328907+0000","last_undegraded":"2024-03-23T23:42:52.328907+0000","last_fullsized":"2024-03-23T23:42:52.328907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:20:53.750917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189626+0000","last_change":"2024-03-23T23:42:40.698407+0000","last_active":"2024-03-23T23:42:52.189626+0000","last_peered":"2024-03-23T23:42:52.189626+0000","last_clean":"2024-03-23T23:42:52.189626+0000","last_became_active":"2024-03-23T23:42:40.698092+0000","last_became_peered":"2024-03-23T23:42:40.698092+0000","last_unstale":"2024-03-23T23:42:52.189626+0000","last_undegraded":"2024-03-23T23:42:52.189626+0000","last_fullsized":"2024-03-23T23:42:52.189626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:00:33.261296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.327627+0000","last_change":"2024-03-23T23:42:50.753000+0000","last_active":"2024-03-23T23:42:52.327627+0000","last_peered":"2024-03-23T23:42:52.327627+0000","last_clean":"2024-03-23T23:42:52.327627+0000","last_became_active":"2024-03-23T23:42:50.752614+0000","last_became_peered":"2024-03-23T23:42:50.752614+0000","last_unstale":"2024-03-23T23:42:52.327627+0000","last_undegraded":"2024-03-23T23:42:52.327627+0000","last_fullsized":"2024-03-23T23:42:52.327627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:57:04.394872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.328439+0000","last_change":"2024-03-23T23:42:40.700631+0000","last_active":"2024-03-23T23:42:52.328439+0000","last_peered":"2024-03-23T23:42:52.328439+0000","last_clean":"2024-03-23T23:42:52.328439+0000","last_became_active":"2024-03-23T23:42:40.697932+0000","last_became_peered":"2024-03-23T23:42:40.697932+0000","last_unstale":"2024-03-23T23:42:52.328439+0000","last_undegraded":"2024-03-23T23:42:52.328439+0000","last_fullsized":"2024-03-23T23:42:52.328439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:05:17.694245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.749336+0000","last_change":"2024-03-23T23:42:50.765991+0000","last_active":"2024-03-23T23:42:51.749336+0000","last_peered":"2024-03-23T23:42:51.749336+0000","last_clean":"2024-03-23T23:42:51.749336+0000","last_became_active":"2024-03-23T23:42:50.765716+0000","last_became_peered":"2024-03-23T23:42:50.765716+0000","last_unstale":"2024-03-23T23:42:51.749336+0000","last_undegraded":"2024-03-23T23:42:51.749336+0000","last_fullsized":"2024-03-23T23:42:51.749336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:49:52.067143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.763373+0000","last_change":"2024-03-23T23:42:40.683983+0000","last_active":"2024-03-23T23:42:51.763373+0000","last_peered":"2024-03-23T23:42:51.763373+0000","last_clean":"2024-03-23T23:42:51.763373+0000","last_became_active":"2024-03-23T23:42:40.683711+0000","last_became_peered":"2024-03-23T23:42:40.683711+0000","last_unstale":"2024-03-23T23:42:51.763373+0000","last_undegraded":"2024-03-23T23:42:51.763373+0000","last_fullsized":"2024-03-23T23:42:51.763373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:51:30.695597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189321+0000","last_change":"2024-03-23T23:42:50.766544+0000","last_active":"2024-03-23T23:42:52.189321+0000","last_peered":"2024-03-23T23:42:52.189321+0000","last_clean":"2024-03-23T23:42:52.189321+0000","last_became_active":"2024-03-23T23:42:50.766328+0000","last_became_peered":"2024-03-23T23:42:50.766328+0000","last_unstale":"2024-03-23T23:42:52.189321+0000","last_undegraded":"2024-03-23T23:42:52.189321+0000","last_fullsized":"2024-03-23T23:42:52.189321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:28:43.677331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:51.766986+0000","last_change":"2024-03-23T23:42:40.678622+0000","last_active":"2024-03-23T23:42:51.766986+0000","last_peered":"2024-03-23T23:42:51.766986+0000","last_clean":"2024-03-23T23:42:51.766986+0000","last_became_active":"2024-03-23T23:42:40.678325+0000","last_became_peered":"2024-03-23T23:42:40.678325+0000","last_unstale":"2024-03-23T23:42:51.766986+0000","last_undegraded":"2024-03-23T23:42:51.766986+0000","last_fullsized":"2024-03-23T23:42:51.766986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:54:27.641281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.189432+0000","last_change":"2024-03-23T23:42:50.750690+0000","last_active":"2024-03-23T23:42:52.189432+0000","last_peered":"2024-03-23T23:42:52.189432+0000","last_clean":"2024-03-23T23:42:52.189432+0000","last_became_active":"2024-03-23T23:42:50.750466+0000","last_became_peered":"2024-03-23T23:42:50.750466+0000","last_unstale":"2024-03-23T23:42:52.189432+0000","last_undegraded":"2024-03-23T23:42:52.189432+0000","last_fullsized":"2024-03-23T23:42:52.189432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:13:07.156401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T23:42:52.190227+0000","last_change":"2024-03-23T23:42:40.701959+0000","last_active":"2024-03-23T23:42:52.190227+0000","last_peered":"2024-03-23T23:42:52.190227+0000","last_clean":"2024-03-23T23:42:52.190227+0000","last_became_active":"2024-03-23T23:42:40.700855+0000","last_became_peered":"2024-03-23T23:42:40.700855+0000","last_unstale":"2024-03-23T23:42:52.190227+0000","last_undegraded":"2024-03-23T23:42:52.190227+0000","last_fullsized":"2024-03-23T23:42:52.190227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:49:42.009983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2664,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2664,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":103704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":101984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":101452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":286720,"data_stored":104976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":692262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542157,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":262144,"data_stored":101292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":282624,"data_stored":103016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542157,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":864256,"data_stored":692228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T23:43:20.268 INFO:tasks.mon_thrash.ceph_manager:clean! 2024-03-23T23:43:20.268 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:43:20.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.444+0000 7f6bbd400640 1 Processor -- start 2024-03-23T23:43:20.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.448+0000 7f6bbd400640 1 -- start start 2024-03-23T23:43:20.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.448+0000 7f6bbd400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6bb814f8f0 0x7f6bb806f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:20.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.448+0000 7f6bbd400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6bb8152e10 0x7f6bb806e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:20.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.448+0000 7f6bbd400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb8072d10 con 0x7f6bb806fa90 2024-03-23T23:43:20.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.448+0000 7f6bbd400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb8072fb0 con 0x7f6bb814f8f0 2024-03-23T23:43:20.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.448+0000 7f6bbd400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb806e380 con 0x7f6bb8152e10 2024-03-23T23:43:20.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.448+0000 7f6bb7e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6bb814f8f0 0x7f6bb806f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:20.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.448+0000 7f6baf400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6bb8152e10 0x7f6bb806e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:20.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.448+0000 7f6bbca00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f6bb806fa90 0x7f6bb8155980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:48904/0 (socket says 172.21.15.8:48904) 2024-03-23T23:43:20.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.448+0000 7f6bbca00640 1 -- 172.21.15.8:0/922992376 learned_addr learned my addr 172.21.15.8:0/922992376 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:43:20.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.448+0000 7f6bb7e00640 1 -- 172.21.15.8:0/922992376 >> v2:172.21.15.196:3300/0 conn(0x7f6bb8152e10 msgr2=0x7f6bb806e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:20.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.448+0000 7f6bb7e00640 1 --2- 172.21.15.8:0/922992376 >> v2:172.21.15.196:3300/0 conn(0x7f6bb8152e10 0x7f6bb806e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:20.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.448+0000 7f6bb7e00640 1 -- 172.21.15.8:0/922992376 >> v1:172.21.15.196:6789/0 conn(0x7f6bb806fa90 legacy=0x7f6bb8155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:20.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.448+0000 7f6bb7e00640 1 -- 172.21.15.8:0/922992376 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb81532f0 con 0x7f6bb814f8f0 2024-03-23T23:43:20.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.452+0000 7f6bb7e00640 1 --2- 172.21.15.8:0/922992376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bb814f8f0 0x7f6bb806f550 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6ba80097c0 tx=0x7f6ba801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc1aa2e40147f42 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:20.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.452+0000 7f6bb7400640 1 -- 172.21.15.8:0/922992376 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba80b0070 con 0x7f6bb814f8f0 2024-03-23T23:43:20.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.452+0000 7f6bb7400640 1 -- 172.21.15.8:0/922992376 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba80ab600 con 0x7f6bb814f8f0 2024-03-23T23:43:20.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.452+0000 7f6bb7400640 1 -- 172.21.15.8:0/922992376 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba80ab9d0 con 0x7f6bb814f8f0 2024-03-23T23:43:20.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.452+0000 7f6bbd400640 1 -- 172.21.15.8:0/922992376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bb814f8f0 msgr2=0x7f6bb806f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:20.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.452+0000 7f6bbd400640 1 --2- 172.21.15.8:0/922992376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bb814f8f0 0x7f6bb806f550 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6ba80097c0 tx=0x7f6ba801c3d0 comp rx=0 tx=0).stop 2024-03-23T23:43:20.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.452+0000 7f6bbd400640 1 -- 172.21.15.8:0/922992376 shutdown_connections 2024-03-23T23:43:20.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.452+0000 7f6bbd400640 1 --2- 172.21.15.8:0/922992376 >> v2:172.21.15.196:3300/0 conn(0x7f6bb8152e10 0x7f6bb806e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:20.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.452+0000 7f6bbd400640 1 --2- 172.21.15.8:0/922992376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bb814f8f0 0x7f6bb806f550 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:20.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.452+0000 7f6bbd400640 1 -- 172.21.15.8:0/922992376 >> 172.21.15.8:0/922992376 conn(0x7f6bb80c4a00 msgr2=0x7f6bb80c4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:20.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.452+0000 7f6bbd400640 1 -- 172.21.15.8:0/922992376 shutdown_connections 2024-03-23T23:43:20.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.452+0000 7f6bbd400640 1 -- 172.21.15.8:0/922992376 wait complete. 2024-03-23T23:43:20.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.456+0000 7f6bbd400640 1 Processor -- start 2024-03-23T23:43:20.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.456+0000 7f6bbd400640 1 -- start start 2024-03-23T23:43:20.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.456+0000 7f6bbd400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bb806fa90 0x7f6bb8149130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:20.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.456+0000 7f6bbd400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6bb814f8f0 0x7f6bb81ef400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:20.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.456+0000 7f6bbd400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6bb8152e10 0x7f6bb81ef940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:20.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.456+0000 7f6bbd400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb80c2590 con 0x7f6bb806fa90 2024-03-23T23:43:20.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.456+0000 7f6bbd400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb80c2410 con 0x7f6bb8152e10 2024-03-23T23:43:20.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.456+0000 7f6bbd400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb815fd30 con 0x7f6bb814f8f0 2024-03-23T23:43:20.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.456+0000 7f6bb7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bb806fa90 0x7f6bb8149130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:20.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.456+0000 7f6bb7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bb806fa90 0x7f6bb8149130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54808/0 (socket says 172.21.15.8:54808) 2024-03-23T23:43:20.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.456+0000 7f6bb7e00640 1 -- 172.21.15.8:0/2876298178 learned_addr learned my addr 172.21.15.8:0/2876298178 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:20.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.456+0000 7f6bbca00640 1 --2- 172.21.15.8:0/2876298178 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6bb8152e10 0x7f6bb81ef940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:20.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.456+0000 7f6baf400640 1 --2- 172.21.15.8:0/2876298178 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6bb814f8f0 0x7f6bb81ef400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:20.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.456+0000 7f6bb7e00640 1 -- 172.21.15.8:0/2876298178 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6bb814f8f0 msgr2=0x7f6bb81ef400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:20.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.456+0000 7f6bb7e00640 1 --2- 172.21.15.8:0/2876298178 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6bb814f8f0 0x7f6bb81ef400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:20.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.456+0000 7f6bb7e00640 1 -- 172.21.15.8:0/2876298178 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6bb8152e10 msgr2=0x7f6bb81ef940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:20.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.456+0000 7f6bb7e00640 1 --2- 172.21.15.8:0/2876298178 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6bb8152e10 0x7f6bb81ef940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:20.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.456+0000 7f6bb7e00640 1 -- 172.21.15.8:0/2876298178 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb814a370 con 0x7f6bb806fa90 2024-03-23T23:43:20.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.456+0000 7f6baf400640 1 --2- 172.21.15.8:0/2876298178 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6bb814f8f0 0x7f6bb81ef400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:43:20.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.456+0000 7f6bb7e00640 1 --2- 172.21.15.8:0/2876298178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bb806fa90 0x7f6bb8149130 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6ba80ae040 tx=0x7f6ba801ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:20.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.456+0000 7f6bb4c00640 1 -- 172.21.15.8:0/2876298178 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba80b0050 con 0x7f6bb806fa90 2024-03-23T23:43:20.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.456+0000 7f6bb4c00640 1 -- 172.21.15.8:0/2876298178 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba80bc070 con 0x7f6bb806fa90 2024-03-23T23:43:20.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.456+0000 7f6bbd400640 1 -- 172.21.15.8:0/2876298178 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb81458f0 con 0x7f6bb806fa90 2024-03-23T23:43:20.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.456+0000 7f6bb4c00640 1 -- 172.21.15.8:0/2876298178 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba80b5870 con 0x7f6bb806fa90 2024-03-23T23:43:20.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.456+0000 7f6bbd400640 1 -- 172.21.15.8:0/2876298178 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb814a090 con 0x7f6bb806fa90 2024-03-23T23:43:20.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.460+0000 7f6bbd400640 1 -- 172.21.15.8:0/2876298178 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb804f410 con 0x7f6bb806fa90 2024-03-23T23:43:20.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.460+0000 7f6bb4c00640 1 -- 172.21.15.8:0/2876298178 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f6ba80b5a10 con 0x7f6bb806fa90 2024-03-23T23:43:20.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.460+0000 7f6bb4c00640 1 --2- 172.21.15.8:0/2876298178 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6b94067660 0x7f6b94069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:20.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.460+0000 7f6bb4c00640 1 -- 172.21.15.8:0/2876298178 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f6ba8120cf0 con 0x7f6bb806fa90 2024-03-23T23:43:20.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.460+0000 7f6baf400640 1 --2- 172.21.15.8:0/2876298178 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6b94067660 0x7f6b94069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:20.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.460+0000 7f6baf400640 1 --2- 172.21.15.8:0/2876298178 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6b94067660 0x7f6b94069b20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80c1a20 tx=0x7f6ba0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:20.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.464+0000 7f6bb4c00640 1 -- 172.21.15.8:0/2876298178 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f6ba8016050 con 0x7f6bb806fa90 2024-03-23T23:43:20.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.632+0000 7f6bbd400640 1 -- 172.21.15.8:0/2876298178 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bb8149980 con 0x7f6bb806fa90 2024-03-23T23:43:20.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.636+0000 7f6bb4c00640 1 -- 172.21.15.8:0/2876298178 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20271 (secure 0 0 0) 0x7f6ba80f1720 con 0x7f6bb806fa90 2024-03-23T23:43:20.638 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:43:20.638 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":25,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","created":"2024-03-23T23:42:15.169430+0000","modified":"2024-03-23T23:42:51.739271+0000","last_up_change":"2024-03-23T23:42:26.509742+0000","last_in_change":"2024-03-23T23:42:17.662330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:42:26.327445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-23T23:42:38.218800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-23T23:42:39.054195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-23T23:42:48.327799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-23T23:42:49.113061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e967bf31-21d6-4d11-bc3d-0df8177a1b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6809","nonce":2187201732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6811","nonce":2187201732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6815","nonce":2187201732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6813","nonce":2187201732}]},"public_addr":"172.21.15.8:6809/2187201732","cluster_addr":"172.21.15.8:6811/2187201732","heartbeat_back_addr":"172.21.15.8:6815/2187201732","heartbeat_front_addr":"172.21.15.8:6813/2187201732","state":["exists","up"]},{"osd":1,"uuid":"c8e33701-7acd-4474-8402-d52461171fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6818","nonce":3205168010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6822","nonce":3205168010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6830","nonce":3205168010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6826","nonce":3205168010}]},"public_addr":"172.21.15.8:6818/3205168010","cluster_addr":"172.21.15.8:6822/3205168010","heartbeat_back_addr":"172.21.15.8:6830/3205168010","heartbeat_front_addr":"172.21.15.8:6826/3205168010","state":["exists","up"]},{"osd":2,"uuid":"ceebdbf7-4c2f-4757-b52d-fd8b20e77570","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6801","nonce":475463656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6803","nonce":475463656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6807","nonce":475463656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6805","nonce":475463656}]},"public_addr":"172.21.15.8:6801/475463656","cluster_addr":"172.21.15.8:6803/475463656","heartbeat_back_addr":"172.21.15.8:6807/475463656","heartbeat_front_addr":"172.21.15.8:6805/475463656","state":["exists","up"]},{"osd":3,"uuid":"89e258da-5767-429e-8441-edf877d2f3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6819","nonce":1514082871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6821","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6823","nonce":1514082871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6829","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6831","nonce":1514082871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6825","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6827","nonce":1514082871}]},"public_addr":"172.21.15.8:6819/1514082871","cluster_addr":"172.21.15.8:6823/1514082871","heartbeat_back_addr":"172.21.15.8:6831/1514082871","heartbeat_front_addr":"172.21.15.8:6827/1514082871","state":["exists","up"]},{"osd":4,"uuid":"2b7451ae-ea16-4f0a-ae50-04fde75e45ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6825","nonce":3516578147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6827","nonce":3516578147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6831","nonce":3516578147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6829","nonce":3516578147}]},"public_addr":"172.21.15.196:6825/3516578147","cluster_addr":"172.21.15.196:6827/3516578147","heartbeat_back_addr":"172.21.15.196:6831/3516578147","heartbeat_front_addr":"172.21.15.196:6829/3516578147","state":["exists","up"]},{"osd":5,"uuid":"e68a8914-e591-466a-bc9e-f2d7c67aac13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6802","nonce":830595758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6806","nonce":830595758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6814","nonce":830595758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6810","nonce":830595758}]},"public_addr":"172.21.15.196:6802/830595758","cluster_addr":"172.21.15.196:6806/830595758","heartbeat_back_addr":"172.21.15.196:6814/830595758","heartbeat_front_addr":"172.21.15.196:6810/830595758","state":["exists","up"]},{"osd":6,"uuid":"e47723c5-50a0-4cd8-92d9-01972072b422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6801","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6803","nonce":472639906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6805","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6807","nonce":472639906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6815","nonce":472639906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6811","nonce":472639906}]},"public_addr":"172.21.15.196:6803/472639906","cluster_addr":"172.21.15.196:6807/472639906","heartbeat_back_addr":"172.21.15.196:6815/472639906","heartbeat_front_addr":"172.21.15.196:6811/472639906","state":["exists","up"]},{"osd":7,"uuid":"e1e9113d-8005-47b3-9a75-9e701199f1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6817","nonce":4151820349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6819","nonce":4151820349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6823","nonce":4151820349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6821","nonce":4151820349}]},"public_addr":"172.21.15.196:6817/4151820349","cluster_addr":"172.21.15.196:6819/4151820349","heartbeat_back_addr":"172.21.15.196:6823/4151820349","heartbeat_front_addr":"172.21.15.196:6821/4151820349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.221790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.265974+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.190319+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.376359+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.329657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.402958+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.300703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.133121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:43:20.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.636+0000 7f6bbd400640 1 -- 172.21.15.8:0/2876298178 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6b94067660 msgr2=0x7f6b94069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:20.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.636+0000 7f6bbd400640 1 --2- 172.21.15.8:0/2876298178 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6b94067660 0x7f6b94069b20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80c1a20 tx=0x7f6ba0008040 comp rx=0 tx=0).stop 2024-03-23T23:43:20.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.636+0000 7f6bbd400640 1 -- 172.21.15.8:0/2876298178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bb806fa90 msgr2=0x7f6bb8149130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:20.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.636+0000 7f6bbd400640 1 --2- 172.21.15.8:0/2876298178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bb806fa90 0x7f6bb8149130 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6ba80ae040 tx=0x7f6ba801ac10 comp rx=0 tx=0).stop 2024-03-23T23:43:20.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.636+0000 7f6bbd400640 1 -- 172.21.15.8:0/2876298178 shutdown_connections 2024-03-23T23:43:20.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.636+0000 7f6bbd400640 1 --2- 172.21.15.8:0/2876298178 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6bb8152e10 0x7f6bb81ef940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:20.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.636+0000 7f6bbd400640 1 --2- 172.21.15.8:0/2876298178 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6b94067660 0x7f6b94069b20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:20.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.636+0000 7f6bbd400640 1 --2- 172.21.15.8:0/2876298178 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6bb814f8f0 0x7f6bb81ef400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:20.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.636+0000 7f6bbd400640 1 --2- 172.21.15.8:0/2876298178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bb806fa90 0x7f6bb8149130 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:20.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.636+0000 7f6bbd400640 1 -- 172.21.15.8:0/2876298178 >> 172.21.15.8:0/2876298178 conn(0x7f6bb80c4a00 msgr2=0x7f6bb814d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:20.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.636+0000 7f6bbd400640 1 -- 172.21.15.8:0/2876298178 shutdown_connections 2024-03-23T23:43:20.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.636+0000 7f6bbd400640 1 -- 172.21.15.8:0/2876298178 wait complete. 2024-03-23T23:43:20.659 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-23T23:42:26.327445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-03-23T23:42:38.218800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-03-23T23:42:39.054195+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-03-23T23:42:48.327799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-03-23T23:42:49.113061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-23T23:43:20.660 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-23T23:43:20.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.804+0000 7fb811600640 1 Processor -- start 2024-03-23T23:43:20.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.808+0000 7fb811600640 1 -- start start 2024-03-23T23:43:20.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.808+0000 7fb811600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb80c14d550 0x7fb80c071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:20.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.808+0000 7fb811600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb80c1535d0 0x7fb80c0adc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:20.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.808+0000 7fb811600640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb80c0c5b90 con 0x7fb80c0715c0 2024-03-23T23:43:20.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.808+0000 7fb811600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb80c0ad2a0 con 0x7fb80c1535d0 2024-03-23T23:43:20.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.808+0000 7fb811600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c0c5e70 con 0x7fb80c14d550 2024-03-23T23:43:20.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.808+0000 7fb80b400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fb80c0715c0 0x7fb80c156bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48126/0 (socket says 172.21.15.8:48126) 2024-03-23T23:43:20.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.808+0000 7fb80b400640 1 -- 172.21.15.8:0/3898373066 learned_addr learned my addr 172.21.15.8:0/3898373066 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:43:20.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.808+0000 7fb802000640 1 --2- 172.21.15.8:0/3898373066 >> v2:172.21.15.196:3300/0 conn(0x7fb80c1535d0 0x7fb80c0adc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:20.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.808+0000 7fb80aa00640 1 --2- 172.21.15.8:0/3898373066 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb80c14d550 0x7fb80c071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:20.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.808+0000 7fb80a000640 1 -- 172.21.15.8:0/3898373066 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2585296930 0 0) 0x7fb80c0c5b90 con 0x7fb80c0715c0 2024-03-23T23:43:20.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.808+0000 7fb80a000640 1 -- 172.21.15.8:0/3898373066 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7f0003530 con 0x7fb80c0715c0 2024-03-23T23:43:20.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.808+0000 7fb802000640 1 -- 172.21.15.8:0/3898373066 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb80c14d550 msgr2=0x7fb80c071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:20.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.808+0000 7fb802000640 1 --2- 172.21.15.8:0/3898373066 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb80c14d550 0x7fb80c071080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:20.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.808+0000 7fb802000640 1 -- 172.21.15.8:0/3898373066 >> v1:172.21.15.8:6789/0 conn(0x7fb80c0715c0 legacy=0x7fb80c156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:20.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.808+0000 7fb802000640 1 -- 172.21.15.8:0/3898373066 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80c0c6150 con 0x7fb80c1535d0 2024-03-23T23:43:20.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.812+0000 7fb802000640 1 --2- 172.21.15.8:0/3898373066 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb80c1535d0 0x7fb80c0adc70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40097c0 tx=0x7fb7f401c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e570eb679b1dbfe7 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:20.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.812+0000 7fb80a000640 1 -- 172.21.15.8:0/3898373066 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f40b0070 con 0x7fb80c1535d0 2024-03-23T23:43:20.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.812+0000 7fb80a000640 1 -- 172.21.15.8:0/3898373066 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f40ab600 con 0x7fb80c1535d0 2024-03-23T23:43:20.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.812+0000 7fb80a000640 1 -- 172.21.15.8:0/3898373066 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f40ab9d0 con 0x7fb80c1535d0 2024-03-23T23:43:20.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.812+0000 7fb811600640 1 -- 172.21.15.8:0/3898373066 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb80c1535d0 msgr2=0x7fb80c0adc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:20.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.812+0000 7fb811600640 1 --2- 172.21.15.8:0/3898373066 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb80c1535d0 0x7fb80c0adc70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40097c0 tx=0x7fb7f401c380 comp rx=0 tx=0).stop 2024-03-23T23:43:20.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.812+0000 7fb811600640 1 -- 172.21.15.8:0/3898373066 shutdown_connections 2024-03-23T23:43:20.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.812+0000 7fb811600640 1 --2- 172.21.15.8:0/3898373066 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb80c1535d0 0x7fb80c0adc70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:20.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.812+0000 7fb811600640 1 --2- 172.21.15.8:0/3898373066 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb80c14d550 0x7fb80c071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:20.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.812+0000 7fb811600640 1 -- 172.21.15.8:0/3898373066 >> 172.21.15.8:0/3898373066 conn(0x7fb80c0c8f60 msgr2=0x7fb80c0c9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:20.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.812+0000 7fb811600640 1 -- 172.21.15.8:0/3898373066 shutdown_connections 2024-03-23T23:43:20.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.812+0000 7fb811600640 1 -- 172.21.15.8:0/3898373066 wait complete. 2024-03-23T23:43:20.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.816+0000 7fb811600640 1 Processor -- start 2024-03-23T23:43:20.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.816+0000 7fb811600640 1 -- start start 2024-03-23T23:43:20.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.816+0000 7fb811600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb80c0715c0 0x7fb80c1ee450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:20.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.816+0000 7fb811600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb80c14d550 0x7fb80c14c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:20.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.816+0000 7fb811600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb80c1535d0 0x7fb80c1f21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:20.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.816+0000 7fb811600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c0ae540 con 0x7fb80c0715c0 2024-03-23T23:43:20.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.816+0000 7fb811600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c0ae3c0 con 0x7fb80c14d550 2024-03-23T23:43:20.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.816+0000 7fb811600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c160f70 con 0x7fb80c1535d0 2024-03-23T23:43:20.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.816+0000 7fb80aa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb80c0715c0 0x7fb80c1ee450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:20.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.816+0000 7fb80aa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb80c0715c0 0x7fb80c1ee450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54812/0 (socket says 172.21.15.8:54812) 2024-03-23T23:43:20.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.816+0000 7fb80aa00640 1 -- 172.21.15.8:0/3181892984 learned_addr learned my addr 172.21.15.8:0/3181892984 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:20.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.816+0000 7fb802000640 1 --2- 172.21.15.8:0/3181892984 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb80c14d550 0x7fb80c14c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:20.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.816+0000 7fb80b400640 1 --2- 172.21.15.8:0/3181892984 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb80c1535d0 0x7fb80c1f21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:20.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.816+0000 7fb80aa00640 1 -- 172.21.15.8:0/3181892984 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb80c1535d0 msgr2=0x7fb80c1f21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:20.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.816+0000 7fb80aa00640 1 --2- 172.21.15.8:0/3181892984 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb80c1535d0 0x7fb80c1f21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:20.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.816+0000 7fb80aa00640 1 -- 172.21.15.8:0/3181892984 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb80c14d550 msgr2=0x7fb80c14c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:20.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.816+0000 7fb80aa00640 1 --2- 172.21.15.8:0/3181892984 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb80c14d550 0x7fb80c14c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:20.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.816+0000 7fb80aa00640 1 -- 172.21.15.8:0/3181892984 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80c14a890 con 0x7fb80c0715c0 2024-03-23T23:43:20.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.816+0000 7fb80aa00640 1 --2- 172.21.15.8:0/3181892984 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb80c0715c0 0x7fb80c1ee450 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc00e930 tx=0x7fb7fc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:20.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.816+0000 7fb803400640 1 -- 172.21.15.8:0/3181892984 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc017070 con 0x7fb80c0715c0 2024-03-23T23:43:20.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.816+0000 7fb803400640 1 -- 172.21.15.8:0/3181892984 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7fc00ca00 con 0x7fb80c0715c0 2024-03-23T23:43:20.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.816+0000 7fb811600640 1 -- 172.21.15.8:0/3181892984 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb80c14ab70 con 0x7fb80c0715c0 2024-03-23T23:43:20.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.816+0000 7fb803400640 1 -- 172.21.15.8:0/3181892984 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc00cdb0 con 0x7fb80c0715c0 2024-03-23T23:43:20.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.816+0000 7fb811600640 1 -- 172.21.15.8:0/3181892984 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb80c1f19c0 con 0x7fb80c0715c0 2024-03-23T23:43:20.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.816+0000 7fb811600640 1 -- 172.21.15.8:0/3181892984 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb80c04f410 con 0x7fb80c0715c0 2024-03-23T23:43:20.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.820+0000 7fb803400640 1 -- 172.21.15.8:0/3181892984 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb7fc01a070 con 0x7fb80c0715c0 2024-03-23T23:43:20.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.820+0000 7fb803400640 1 --2- 172.21.15.8:0/3181892984 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb7e8067660 0x7fb7e8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:20.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.820+0000 7fb803400640 1 -- 172.21.15.8:0/3181892984 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fb7fc085fb0 con 0x7fb80c0715c0 2024-03-23T23:43:20.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.820+0000 7fb802000640 1 --2- 172.21.15.8:0/3181892984 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb7e8067660 0x7fb7e8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:20.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.820+0000 7fb802000640 1 --2- 172.21.15.8:0/3181892984 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb7e8067660 0x7fb7e8069b20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40ad000 tx=0x7fb7f4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:20.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:20.824+0000 7fb803400640 1 -- 172.21.15.8:0/3181892984 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fb7fc0562e0 con 0x7fb80c0715c0 2024-03-23T23:43:21.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.000+0000 7fb811600640 1 -- 172.21.15.8:0/3181892984 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb80c0c81f0 con 0x7fb80c0715c0 2024-03-23T23:43:21.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.000+0000 7fb803400640 1 -- 172.21.15.8:0/3181892984 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb7fc05a380 con 0x7fb80c0715c0 2024-03-23T23:43:21.002 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-03-23T23:43:21.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.000+0000 7fb811600640 1 -- 172.21.15.8:0/3181892984 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb7e8067660 msgr2=0x7fb7e8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:21.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.000+0000 7fb811600640 1 --2- 172.21.15.8:0/3181892984 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb7e8067660 0x7fb7e8069b20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40ad000 tx=0x7fb7f4008040 comp rx=0 tx=0).stop 2024-03-23T23:43:21.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.000+0000 7fb811600640 1 -- 172.21.15.8:0/3181892984 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb80c0715c0 msgr2=0x7fb80c1ee450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:21.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.000+0000 7fb811600640 1 --2- 172.21.15.8:0/3181892984 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb80c0715c0 0x7fb80c1ee450 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc00e930 tx=0x7fb7fc00edf0 comp rx=0 tx=0).stop 2024-03-23T23:43:21.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.000+0000 7fb811600640 1 -- 172.21.15.8:0/3181892984 shutdown_connections 2024-03-23T23:43:21.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.000+0000 7fb811600640 1 --2- 172.21.15.8:0/3181892984 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb7e8067660 0x7fb7e8069b20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:21.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.000+0000 7fb811600640 1 --2- 172.21.15.8:0/3181892984 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb80c1535d0 0x7fb80c1f21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:21.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.000+0000 7fb811600640 1 --2- 172.21.15.8:0/3181892984 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb80c14d550 0x7fb80c14c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:21.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.000+0000 7fb811600640 1 --2- 172.21.15.8:0/3181892984 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb80c0715c0 0x7fb80c1ee450 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:21.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.000+0000 7fb811600640 1 -- 172.21.15.8:0/3181892984 >> 172.21.15.8:0/3181892984 conn(0x7fb80c0c8f60 msgr2=0x7fb80c0c2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:21.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.000+0000 7fb811600640 1 -- 172.21.15.8:0/3181892984 shutdown_connections 2024-03-23T23:43:21.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.000+0000 7fb811600640 1 -- 172.21.15.8:0/3181892984 wait complete. 2024-03-23T23:43:21.031 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-03-23T23:43:21.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.172+0000 7f44bcc00640 1 Processor -- start 2024-03-23T23:43:21.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.172+0000 7f44bcc00640 1 -- start start 2024-03-23T23:43:21.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.172+0000 7f44bcc00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f44b8151000 0x7f44b81542c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:21.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.172+0000 7f44bcc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44b80c4fb0 0x7f44b80c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:21.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.172+0000 7f44bcc00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f44b80c73a0 0x7f44b80ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:21.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.172+0000 7f44bcc00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b80c84a0 con 0x7f44b8151000 2024-03-23T23:43:21.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.172+0000 7f44bcc00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b80c46a0 con 0x7f44b80c73a0 2024-03-23T23:43:21.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.172+0000 7f44bcc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b80c5770 con 0x7f44b80c4fb0 2024-03-23T23:43:21.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.172+0000 7f44b5e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f44b8151000 0x7f44b81542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:21.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.172+0000 7f44b5e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f44b8151000 0x7f44b81542c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54816/0 (socket says 172.21.15.8:54816) 2024-03-23T23:43:21.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.172+0000 7f44b5e00640 1 -- 172.21.15.8:0/1257506663 learned_addr learned my addr 172.21.15.8:0/1257506663 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:21.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.172+0000 7f44ad400640 1 --2- 172.21.15.8:0/1257506663 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44b80c4fb0 0x7f44b80c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:21.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.172+0000 7f44b6800640 1 --2- 172.21.15.8:0/1257506663 >> v2:172.21.15.196:3300/0 conn(0x7f44b80c73a0 0x7f44b80ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:21.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.172+0000 7f44b5e00640 1 -- 172.21.15.8:0/1257506663 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44b80c4fb0 msgr2=0x7f44b80c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:21.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.172+0000 7f44b5e00640 1 --2- 172.21.15.8:0/1257506663 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44b80c4fb0 0x7f44b80c6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:21.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.172+0000 7f44b5e00640 1 -- 172.21.15.8:0/1257506663 >> v2:172.21.15.196:3300/0 conn(0x7f44b80c73a0 msgr2=0x7f44b80ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:21.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.172+0000 7f44b5e00640 1 --2- 172.21.15.8:0/1257506663 >> v2:172.21.15.196:3300/0 conn(0x7f44b80c73a0 0x7f44b80ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:21.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.172+0000 7f44b5e00640 1 -- 172.21.15.8:0/1257506663 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b80c5490 con 0x7f44b8151000 2024-03-23T23:43:21.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.172+0000 7f44b6800640 1 --2- 172.21.15.8:0/1257506663 >> v2:172.21.15.196:3300/0 conn(0x7f44b80c73a0 0x7f44b80ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:43:21.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.176+0000 7f44b5e00640 1 --2- 172.21.15.8:0/1257506663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44b8151000 0x7f44b81542c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f44b80c7780 tx=0x7f44a801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b06f65be016b528 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:21.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.176+0000 7f44b5400640 1 -- 172.21.15.8:0/1257506663 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a80ab620 con 0x7f44b8151000 2024-03-23T23:43:21.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.176+0000 7f44b5400640 1 -- 172.21.15.8:0/1257506663 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a80b0070 con 0x7f44b8151000 2024-03-23T23:43:21.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.176+0000 7f44b5400640 1 -- 172.21.15.8:0/1257506663 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a80ab9e0 con 0x7f44b8151000 2024-03-23T23:43:21.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.176+0000 7f44bcc00640 1 -- 172.21.15.8:0/1257506663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44b8151000 msgr2=0x7f44b81542c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:21.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.176+0000 7f44bcc00640 1 --2- 172.21.15.8:0/1257506663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44b8151000 0x7f44b81542c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f44b80c7780 tx=0x7f44a801c460 comp rx=0 tx=0).stop 2024-03-23T23:43:21.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.176+0000 7f44bcc00640 1 -- 172.21.15.8:0/1257506663 shutdown_connections 2024-03-23T23:43:21.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.176+0000 7f44bcc00640 1 --2- 172.21.15.8:0/1257506663 >> v2:172.21.15.196:3300/0 conn(0x7f44b80c73a0 0x7f44b80ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:21.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.176+0000 7f44bcc00640 1 --2- 172.21.15.8:0/1257506663 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44b80c4fb0 0x7f44b80c6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:21.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.176+0000 7f44bcc00640 1 --2- 172.21.15.8:0/1257506663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44b8151000 0x7f44b81542c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:21.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.176+0000 7f44bcc00640 1 -- 172.21.15.8:0/1257506663 >> 172.21.15.8:0/1257506663 conn(0x7f44b80aad10 msgr2=0x7f44b80ab120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:21.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.176+0000 7f44bcc00640 1 -- 172.21.15.8:0/1257506663 shutdown_connections 2024-03-23T23:43:21.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.176+0000 7f44bcc00640 1 -- 172.21.15.8:0/1257506663 wait complete. 2024-03-23T23:43:21.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.180+0000 7f44bcc00640 1 Processor -- start 2024-03-23T23:43:21.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.180+0000 7f44bcc00640 1 -- start start 2024-03-23T23:43:21.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.180+0000 7f44bcc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44b80c4fb0 0x7f44b80c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:21.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.180+0000 7f44bcc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44b80c73a0 0x7f44b8148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:21.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.180+0000 7f44bcc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44b8151000 0x7f44b8148db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:21.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.180+0000 7f44bcc00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b80c3610 con 0x7f44b8151000 2024-03-23T23:43:21.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.180+0000 7f44bcc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b80c3490 con 0x7f44b80c4fb0 2024-03-23T23:43:21.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.180+0000 7f44bcc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b8157440 con 0x7f44b80c73a0 2024-03-23T23:43:21.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.180+0000 7f44b6800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44b8151000 0x7f44b8148db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:21.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.180+0000 7f44b6800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44b8151000 0x7f44b8148db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54826/0 (socket says 172.21.15.8:54826) 2024-03-23T23:43:21.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.180+0000 7f44b6800640 1 -- 172.21.15.8:0/3607861780 learned_addr learned my addr 172.21.15.8:0/3607861780 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:21.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.180+0000 7f44b5e00640 1 --2- 172.21.15.8:0/3607861780 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44b80c4fb0 0x7f44b80c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:21.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.180+0000 7f44ad400640 1 --2- 172.21.15.8:0/3607861780 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44b80c73a0 0x7f44b8148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:21.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.180+0000 7f44b6800640 1 -- 172.21.15.8:0/3607861780 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44b80c73a0 msgr2=0x7f44b8148870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:21.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.180+0000 7f44b6800640 1 --2- 172.21.15.8:0/3607861780 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44b80c73a0 0x7f44b8148870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:21.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.180+0000 7f44b6800640 1 -- 172.21.15.8:0/3607861780 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44b80c4fb0 msgr2=0x7f44b80c25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:21.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.180+0000 7f44b6800640 1 --2- 172.21.15.8:0/3607861780 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44b80c4fb0 0x7f44b80c25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:21.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.180+0000 7f44b6800640 1 -- 172.21.15.8:0/3607861780 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b81ee590 con 0x7f44b8151000 2024-03-23T23:43:21.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.180+0000 7f44b5e00640 1 --2- 172.21.15.8:0/3607861780 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44b80c4fb0 0x7f44b80c25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:43:21.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.180+0000 7f44ad400640 1 --2- 172.21.15.8:0/3607861780 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44b80c73a0 0x7f44b8148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:43:21.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.180+0000 7f44b6800640 1 --2- 172.21.15.8:0/3607861780 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44b8151000 0x7f44b8148db0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f44b000e5d0 tx=0x7f44b000ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:21.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.180+0000 7f44aea00640 1 -- 172.21.15.8:0/3607861780 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b0017070 con 0x7f44b8151000 2024-03-23T23:43:21.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.180+0000 7f44aea00640 1 -- 172.21.15.8:0/3607861780 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b0013610 con 0x7f44b8151000 2024-03-23T23:43:21.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.180+0000 7f44aea00640 1 -- 172.21.15.8:0/3607861780 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b000f040 con 0x7f44b8151000 2024-03-23T23:43:21.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.180+0000 7f44bcc00640 1 -- 172.21.15.8:0/3607861780 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b81ee870 con 0x7f44b8151000 2024-03-23T23:43:21.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.180+0000 7f44bcc00640 1 -- 172.21.15.8:0/3607861780 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b81492f0 con 0x7f44b8151000 2024-03-23T23:43:21.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.184+0000 7f44bcc00640 1 -- 172.21.15.8:0/3607861780 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b804f410 con 0x7f44b8151000 2024-03-23T23:43:21.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.184+0000 7f44aea00640 1 -- 172.21.15.8:0/3607861780 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f44b001a070 con 0x7f44b8151000 2024-03-23T23:43:21.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.184+0000 7f44aea00640 1 --2- 172.21.15.8:0/3607861780 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4494067660 0x7f4494069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:21.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.184+0000 7f44aea00640 1 -- 172.21.15.8:0/3607861780 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f44b0085850 con 0x7f44b8151000 2024-03-23T23:43:21.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.184+0000 7f44b5e00640 1 --2- 172.21.15.8:0/3607861780 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4494067660 0x7f4494069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:21.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.184+0000 7f44b5e00640 1 --2- 172.21.15.8:0/3607861780 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4494067660 0x7f4494069b20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f44a80af000 tx=0x7f44a80a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:21.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.188+0000 7f44aea00640 1 -- 172.21.15.8:0/3607861780 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f44b0055a20 con 0x7f44b8151000 2024-03-23T23:43:21.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.348+0000 7f44bcc00640 1 -- 172.21.15.8:0/3607861780 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7f44b8068310 con 0x7f44b8151000 2024-03-23T23:43:21.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.348+0000 7f44aea00640 1 -- 172.21.15.8:0/3607861780 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v26) v1 ==== 99+0+11 (secure 0 0 0) 0x7f44b0059ac0 con 0x7f44b8151000 2024-03-23T23:43:21.353 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-03-23T23:43:21.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.352+0000 7f44bcc00640 1 -- 172.21.15.8:0/3607861780 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4494067660 msgr2=0x7f4494069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:21.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.352+0000 7f44bcc00640 1 --2- 172.21.15.8:0/3607861780 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4494067660 0x7f4494069b20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f44a80af000 tx=0x7f44a80a7000 comp rx=0 tx=0).stop 2024-03-23T23:43:21.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.352+0000 7f44bcc00640 1 -- 172.21.15.8:0/3607861780 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44b8151000 msgr2=0x7f44b8148db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:21.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.352+0000 7f44bcc00640 1 --2- 172.21.15.8:0/3607861780 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44b8151000 0x7f44b8148db0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f44b000e5d0 tx=0x7f44b000ea90 comp rx=0 tx=0).stop 2024-03-23T23:43:21.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.352+0000 7f44bcc00640 1 -- 172.21.15.8:0/3607861780 shutdown_connections 2024-03-23T23:43:21.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.352+0000 7f44bcc00640 1 --2- 172.21.15.8:0/3607861780 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44b8151000 0x7f44b8148db0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:21.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.352+0000 7f44bcc00640 1 --2- 172.21.15.8:0/3607861780 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4494067660 0x7f4494069b20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:21.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.352+0000 7f44bcc00640 1 --2- 172.21.15.8:0/3607861780 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44b80c73a0 0x7f44b8148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:21.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.352+0000 7f44bcc00640 1 --2- 172.21.15.8:0/3607861780 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44b80c4fb0 0x7f44b80c25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:21.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.352+0000 7f44bcc00640 1 -- 172.21.15.8:0/3607861780 >> 172.21.15.8:0/3607861780 conn(0x7f44b80aad10 msgr2=0x7f44b81561d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:21.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.352+0000 7f44bcc00640 1 -- 172.21.15.8:0/3607861780 shutdown_connections 2024-03-23T23:43:21.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.352+0000 7f44bcc00640 1 -- 172.21.15.8:0/3607861780 wait complete. 2024-03-23T23:43:21.374 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-03-23T23:43:21.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.516+0000 7efdcdc00640 1 Processor -- start 2024-03-23T23:43:21.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.516+0000 7efdcdc00640 1 -- start start 2024-03-23T23:43:21.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.516+0000 7efdcdc00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7efdc8152ff0 0x7efdc80714f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:21.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.516+0000 7efdcdc00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7efdc8159860 0x7efdc806ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:21.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.516+0000 7efdcdc00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc8159dd0 con 0x7efdc806f190 2024-03-23T23:43:21.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.516+0000 7efdcdc00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc80701f0 con 0x7efdc8159860 2024-03-23T23:43:21.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.516+0000 7efdcdc00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc80704d0 con 0x7efdc8152ff0 2024-03-23T23:43:21.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.516+0000 7efdbfe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7efdc8159860 0x7efdc806ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:21.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.516+0000 7efdbfe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7efdc8159860 0x7efdc806ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54828/0 (socket says 172.21.15.8:54828) 2024-03-23T23:43:21.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.516+0000 7efdbfe00640 1 -- 172.21.15.8:0/2429474495 learned_addr learned my addr 172.21.15.8:0/2429474495 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:21.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.516+0000 7efdc6a00640 1 --2- 172.21.15.8:0/2429474495 >> v2:172.21.15.196:3300/0 conn(0x7efdc8152ff0 0x7efdc80714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:21.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.516+0000 7efdbfe00640 1 -- 172.21.15.8:0/2429474495 >> v2:172.21.15.196:3300/0 conn(0x7efdc8152ff0 msgr2=0x7efdc80714f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:21.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.516+0000 7efdbfe00640 1 --2- 172.21.15.8:0/2429474495 >> v2:172.21.15.196:3300/0 conn(0x7efdc8152ff0 0x7efdc80714f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:21.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.516+0000 7efdbfe00640 1 -- 172.21.15.8:0/2429474495 >> v1:172.21.15.8:6789/0 conn(0x7efdc806f190 legacy=0x7efdc80c2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:21.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.516+0000 7efdbfe00640 1 -- 172.21.15.8:0/2429474495 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc80707b0 con 0x7efdc8159860 2024-03-23T23:43:21.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.520+0000 7efdbfe00640 1 --2- 172.21.15.8:0/2429474495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdc8159860 0x7efdc806ec50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efdc80ab9c0 tx=0x7efdb001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb0e5c28eb537282 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:21.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.520+0000 7efdc6000640 1 -- 172.21.15.8:0/2429474495 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb00b0070 con 0x7efdc8159860 2024-03-23T23:43:21.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.520+0000 7efdc6000640 1 -- 172.21.15.8:0/2429474495 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb00ab600 con 0x7efdc8159860 2024-03-23T23:43:21.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.520+0000 7efdc6000640 1 -- 172.21.15.8:0/2429474495 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb00ab9d0 con 0x7efdc8159860 2024-03-23T23:43:21.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.520+0000 7efdcdc00640 1 -- 172.21.15.8:0/2429474495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdc8159860 msgr2=0x7efdc806ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:21.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.520+0000 7efdcdc00640 1 --2- 172.21.15.8:0/2429474495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdc8159860 0x7efdc806ec50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efdc80ab9c0 tx=0x7efdb001c490 comp rx=0 tx=0).stop 2024-03-23T23:43:21.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.520+0000 7efdcdc00640 1 -- 172.21.15.8:0/2429474495 shutdown_connections 2024-03-23T23:43:21.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.520+0000 7efdcdc00640 1 --2- 172.21.15.8:0/2429474495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdc8159860 0x7efdc806ec50 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:21.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.520+0000 7efdcdc00640 1 --2- 172.21.15.8:0/2429474495 >> v2:172.21.15.196:3300/0 conn(0x7efdc8152ff0 0x7efdc80714f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:21.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.520+0000 7efdcdc00640 1 -- 172.21.15.8:0/2429474495 >> 172.21.15.8:0/2429474495 conn(0x7efdc80aad10 msgr2=0x7efdc80ab120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:21.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.520+0000 7efdcdc00640 1 -- 172.21.15.8:0/2429474495 shutdown_connections 2024-03-23T23:43:21.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.520+0000 7efdcdc00640 1 -- 172.21.15.8:0/2429474495 wait complete. 2024-03-23T23:43:21.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.524+0000 7efdcdc00640 1 Processor -- start 2024-03-23T23:43:21.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.524+0000 7efdcdc00640 1 -- start start 2024-03-23T23:43:21.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.524+0000 7efdcdc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdc806f190 0x7efdc8149f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:21.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.524+0000 7efdcdc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efdc8152ff0 0x7efdc80a91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:21.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.524+0000 7efdcdc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efdc8159860 0x7efdc814d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:21.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.524+0000 7efdcdc00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc80c75a0 con 0x7efdc806f190 2024-03-23T23:43:21.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.524+0000 7efdcdc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc80c7420 con 0x7efdc8152ff0 2024-03-23T23:43:21.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.524+0000 7efdcdc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc8162a00 con 0x7efdc8159860 2024-03-23T23:43:21.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.524+0000 7efdc6a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdc806f190 0x7efdc8149f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:21.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.524+0000 7efdc6a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdc806f190 0x7efdc8149f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54836/0 (socket says 172.21.15.8:54836) 2024-03-23T23:43:21.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.524+0000 7efdc6a00640 1 -- 172.21.15.8:0/531356392 learned_addr learned my addr 172.21.15.8:0/531356392 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:21.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.524+0000 7efdbfe00640 1 --2- 172.21.15.8:0/531356392 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efdc8152ff0 0x7efdc80a91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:21.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.524+0000 7efdc7400640 1 --2- 172.21.15.8:0/531356392 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efdc8159860 0x7efdc814d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:21.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.524+0000 7efdc6a00640 1 -- 172.21.15.8:0/531356392 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efdc8159860 msgr2=0x7efdc814d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:21.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.524+0000 7efdc6a00640 1 --2- 172.21.15.8:0/531356392 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efdc8159860 0x7efdc814d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:21.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.524+0000 7efdc6a00640 1 -- 172.21.15.8:0/531356392 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efdc8152ff0 msgr2=0x7efdc80a91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:21.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.524+0000 7efdc6a00640 1 --2- 172.21.15.8:0/531356392 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efdc8152ff0 0x7efdc80a91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:21.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.524+0000 7efdc6a00640 1 -- 172.21.15.8:0/531356392 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc814ac20 con 0x7efdc806f190 2024-03-23T23:43:21.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.524+0000 7efdc6a00640 1 --2- 172.21.15.8:0/531356392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdc806f190 0x7efdc8149f90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efdb800e930 tx=0x7efdb800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:21.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.524+0000 7efdbea00640 1 -- 172.21.15.8:0/531356392 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb8017070 con 0x7efdc806f190 2024-03-23T23:43:21.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.524+0000 7efdbea00640 1 -- 172.21.15.8:0/531356392 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb800ca00 con 0x7efdc806f190 2024-03-23T23:43:21.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.524+0000 7efdcdc00640 1 -- 172.21.15.8:0/531356392 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc814a4d0 con 0x7efdc806f190 2024-03-23T23:43:21.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.524+0000 7efdbea00640 1 -- 172.21.15.8:0/531356392 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb800cdb0 con 0x7efdc806f190 2024-03-23T23:43:21.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.524+0000 7efdcdc00640 1 -- 172.21.15.8:0/531356392 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc814c300 con 0x7efdc806f190 2024-03-23T23:43:21.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.528+0000 7efdcdc00640 1 -- 172.21.15.8:0/531356392 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc8156830 con 0x7efdc806f190 2024-03-23T23:43:21.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.528+0000 7efdbea00640 1 -- 172.21.15.8:0/531356392 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7efdb801a070 con 0x7efdc806f190 2024-03-23T23:43:21.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.528+0000 7efdbea00640 1 --2- 172.21.15.8:0/531356392 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7efda4067660 0x7efda4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:21.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.528+0000 7efdbea00640 1 -- 172.21.15.8:0/531356392 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6666+0+0 (secure 0 0 0) 0x7efdb8085b80 con 0x7efdc806f190 2024-03-23T23:43:21.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.532+0000 7efdbfe00640 1 --2- 172.21.15.8:0/531356392 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7efda4067660 0x7efda4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:21.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.532+0000 7efdbfe00640 1 --2- 172.21.15.8:0/531356392 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7efda4067660 0x7efda4069b20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efdb00ad000 tx=0x7efdb00a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:21.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.536+0000 7efdbea00640 1 -- 172.21.15.8:0/531356392 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7efdb8055f40 con 0x7efdc806f190 2024-03-23T23:43:21.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.700+0000 7efdcdc00640 1 -- 172.21.15.8:0/531356392 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7efdc804f410 con 0x7efdc806f190 2024-03-23T23:43:21.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.700+0000 7efdbea00640 1 -- 172.21.15.8:0/531356392 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v26) v1 ==== 95+0+11 (secure 0 0 0) 0x7efdb8059fe0 con 0x7efdc806f190 2024-03-23T23:43:21.705 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-03-23T23:43:21.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.704+0000 7efdcdc00640 1 -- 172.21.15.8:0/531356392 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7efda4067660 msgr2=0x7efda4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:21.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.704+0000 7efdcdc00640 1 --2- 172.21.15.8:0/531356392 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7efda4067660 0x7efda4069b20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efdb00ad000 tx=0x7efdb00a6000 comp rx=0 tx=0).stop 2024-03-23T23:43:21.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.704+0000 7efdcdc00640 1 -- 172.21.15.8:0/531356392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdc806f190 msgr2=0x7efdc8149f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:21.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.704+0000 7efdcdc00640 1 --2- 172.21.15.8:0/531356392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdc806f190 0x7efdc8149f90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efdb800e930 tx=0x7efdb800edf0 comp rx=0 tx=0).stop 2024-03-23T23:43:21.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.704+0000 7efdcdc00640 1 -- 172.21.15.8:0/531356392 shutdown_connections 2024-03-23T23:43:21.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.704+0000 7efdcdc00640 1 --2- 172.21.15.8:0/531356392 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7efda4067660 0x7efda4069b20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:21.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.704+0000 7efdcdc00640 1 --2- 172.21.15.8:0/531356392 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efdc8159860 0x7efdc814d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:21.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.704+0000 7efdcdc00640 1 --2- 172.21.15.8:0/531356392 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efdc8152ff0 0x7efdc80a91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:21.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.704+0000 7efdcdc00640 1 --2- 172.21.15.8:0/531356392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdc806f190 0x7efdc8149f90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:21.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.704+0000 7efdcdc00640 1 -- 172.21.15.8:0/531356392 >> 172.21.15.8:0/531356392 conn(0x7efdc80aad10 msgr2=0x7efdc80c2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:21.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.704+0000 7efdcdc00640 1 -- 172.21.15.8:0/531356392 shutdown_connections 2024-03-23T23:43:21.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.704+0000 7efdcdc00640 1 -- 172.21.15.8:0/531356392 wait complete. 2024-03-23T23:43:21.726 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-03-23T23:43:21.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.868+0000 7f9e0c600640 1 Processor -- start 2024-03-23T23:43:21.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.868+0000 7f9e0c600640 1 -- start start 2024-03-23T23:43:21.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.872+0000 7f9e0c600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e04071270 0x7f9e040c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:21.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.872+0000 7f9e0c600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9e040ae290 0x7f9e0414d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:21.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.872+0000 7f9e0c600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e040c8620 con 0x7f9e040c5120 2024-03-23T23:43:21.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.872+0000 7f9e0c600640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e040c8900 con 0x7f9e040ae290 2024-03-23T23:43:21.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.872+0000 7f9e0c600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e040ad7b0 con 0x7f9e04071270 2024-03-23T23:43:21.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.872+0000 7f9e09200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9e040ae290 0x7f9e0414d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:21.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.872+0000 7f9e09200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9e040ae290 0x7f9e0414d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54850/0 (socket says 172.21.15.8:54850) 2024-03-23T23:43:21.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.872+0000 7f9e09200640 1 -- 172.21.15.8:0/1407514104 learned_addr learned my addr 172.21.15.8:0/1407514104 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:21.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.872+0000 7f9e09c00640 1 --2- 172.21.15.8:0/1407514104 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e04071270 0x7f9e040c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:21.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.872+0000 7f9e09200640 1 -- 172.21.15.8:0/1407514104 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e04071270 msgr2=0x7f9e040c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:21.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.872+0000 7f9e09200640 1 --2- 172.21.15.8:0/1407514104 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e04071270 0x7f9e040c7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:21.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.872+0000 7f9e09200640 1 -- 172.21.15.8:0/1407514104 >> v1:172.21.15.196:6789/0 conn(0x7f9e040c5120 legacy=0x7f9e04153670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:21.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.872+0000 7f9e09200640 1 -- 172.21.15.8:0/1407514104 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e040ada90 con 0x7f9e040ae290 2024-03-23T23:43:21.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.876+0000 7f9e09200640 1 --2- 172.21.15.8:0/1407514104 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e040ae290 0x7f9e0414d240 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9df0009870 tx=0x7f9df001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e4264c318dfbdd server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:21.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.876+0000 7f9e03e00640 1 -- 172.21.15.8:0/1407514104 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df00aa650 con 0x7f9e040ae290 2024-03-23T23:43:21.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.876+0000 7f9e03e00640 1 -- 172.21.15.8:0/1407514104 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df00af070 con 0x7f9e040ae290 2024-03-23T23:43:21.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.876+0000 7f9e03e00640 1 -- 172.21.15.8:0/1407514104 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df00aaa10 con 0x7f9e040ae290 2024-03-23T23:43:21.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.876+0000 7f9e0c600640 1 -- 172.21.15.8:0/1407514104 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e040ae290 msgr2=0x7f9e0414d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:21.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.876+0000 7f9e0c600640 1 --2- 172.21.15.8:0/1407514104 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e040ae290 0x7f9e0414d240 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9df0009870 tx=0x7f9df001c560 comp rx=0 tx=0).stop 2024-03-23T23:43:21.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.876+0000 7f9e0c600640 1 -- 172.21.15.8:0/1407514104 shutdown_connections 2024-03-23T23:43:21.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.876+0000 7f9e0c600640 1 --2- 172.21.15.8:0/1407514104 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e040ae290 0x7f9e0414d240 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:21.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.876+0000 7f9e0c600640 1 --2- 172.21.15.8:0/1407514104 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e04071270 0x7f9e040c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:21.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.876+0000 7f9e0c600640 1 -- 172.21.15.8:0/1407514104 >> 172.21.15.8:0/1407514104 conn(0x7f9e040aac80 msgr2=0x7f9e040ab090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:21.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.876+0000 7f9e0c600640 1 -- 172.21.15.8:0/1407514104 shutdown_connections 2024-03-23T23:43:21.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.876+0000 7f9e0c600640 1 -- 172.21.15.8:0/1407514104 wait complete. 2024-03-23T23:43:21.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.876+0000 7f9e0c600640 1 Processor -- start 2024-03-23T23:43:21.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.876+0000 7f9e0c600640 1 -- start start 2024-03-23T23:43:21.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.880+0000 7f9e0c600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e04071270 0x7f9e041ebbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:21.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.880+0000 7f9e0c600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e040c5120 0x7f9e040c3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:21.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.880+0000 7f9e0c600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e041ef130 0x7f9e040a9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:21.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.880+0000 7f9e0c600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e04153d80 con 0x7f9e041ef130 2024-03-23T23:43:21.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.880+0000 7f9e0c600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e040718a0 con 0x7f9e04071270 2024-03-23T23:43:21.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.880+0000 7f9e0c600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e04153f00 con 0x7f9e040c5120 2024-03-23T23:43:21.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.880+0000 7f9e0a600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e041ef130 0x7f9e040a9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:21.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.880+0000 7f9e09c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e04071270 0x7f9e041ebbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:21.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.880+0000 7f9e0a600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e041ef130 0x7f9e040a9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54866/0 (socket says 172.21.15.8:54866) 2024-03-23T23:43:21.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.880+0000 7f9e0a600640 1 -- 172.21.15.8:0/1530927506 learned_addr learned my addr 172.21.15.8:0/1530927506 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:21.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.880+0000 7f9e09200640 1 --2- 172.21.15.8:0/1530927506 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e040c5120 0x7f9e040c3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:21.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.880+0000 7f9e0a600640 1 -- 172.21.15.8:0/1530927506 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e040c5120 msgr2=0x7f9e040c3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:21.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.880+0000 7f9e0a600640 1 --2- 172.21.15.8:0/1530927506 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e040c5120 0x7f9e040c3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:21.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.880+0000 7f9e0a600640 1 -- 172.21.15.8:0/1530927506 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e04071270 msgr2=0x7f9e041ebbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:21.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.880+0000 7f9e0a600640 1 --2- 172.21.15.8:0/1530927506 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e04071270 0x7f9e041ebbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:21.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.880+0000 7f9e0a600640 1 -- 172.21.15.8:0/1530927506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e041ec210 con 0x7f9e041ef130 2024-03-23T23:43:21.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.880+0000 7f9e0a600640 1 --2- 172.21.15.8:0/1530927506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e041ef130 0x7f9e040a9fc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc00c760 tx=0x7f9dfc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:21.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.880+0000 7f9e01600640 1 -- 172.21.15.8:0/1530927506 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc003b80 con 0x7f9e041ef130 2024-03-23T23:43:21.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.880+0000 7f9e01600640 1 -- 172.21.15.8:0/1530927506 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dfc003d20 con 0x7f9e041ef130 2024-03-23T23:43:21.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.880+0000 7f9e01600640 1 -- 172.21.15.8:0/1530927506 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc00aa30 con 0x7f9e041ef130 2024-03-23T23:43:21.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.880+0000 7f9e0c600640 1 -- 172.21.15.8:0/1530927506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e041ec4f0 con 0x7f9e041ef130 2024-03-23T23:43:21.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.880+0000 7f9e0c600640 1 -- 172.21.15.8:0/1530927506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e041ecab0 con 0x7f9e041ef130 2024-03-23T23:43:21.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.880+0000 7f9e0c600640 1 -- 172.21.15.8:0/1530927506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e0404f410 con 0x7f9e041ef130 2024-03-23T23:43:21.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.884+0000 7f9e01600640 1 -- 172.21.15.8:0/1530927506 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f9dfc00abd0 con 0x7f9e041ef130 2024-03-23T23:43:21.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.888+0000 7f9e01600640 1 --2- 172.21.15.8:0/1530927506 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9de4067690 0x7f9de4069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:21.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.888+0000 7f9e01600640 1 -- 172.21.15.8:0/1530927506 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f9dfc0863d0 con 0x7f9e041ef130 2024-03-23T23:43:21.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.888+0000 7f9e09c00640 1 --2- 172.21.15.8:0/1530927506 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9de4067690 0x7f9de4069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:21.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.888+0000 7f9e09c00640 1 --2- 172.21.15.8:0/1530927506 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9de4067690 0x7f9de4069b50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9e041e9a00 tx=0x7f9df8009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:21.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:21.888+0000 7f9e01600640 1 -- 172.21.15.8:0/1530927506 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f9dfc0567b0 con 0x7f9e041ef130 2024-03-23T23:43:22.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.056+0000 7f9e0c600640 1 -- 172.21.15.8:0/1530927506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9e04143900 con 0x7f9e041ef130 2024-03-23T23:43:22.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.056+0000 7f9e01600640 1 -- 172.21.15.8:0/1530927506 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v27) v1 ==== 99+0+11 (secure 0 0 0) 0x7f9dfc05a850 con 0x7f9e041ef130 2024-03-23T23:43:22.061 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-03-23T23:43:22.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.060+0000 7f9e0c600640 1 -- 172.21.15.8:0/1530927506 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9de4067690 msgr2=0x7f9de4069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:22.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.060+0000 7f9e0c600640 1 --2- 172.21.15.8:0/1530927506 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9de4067690 0x7f9de4069b50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9e041e9a00 tx=0x7f9df8009190 comp rx=0 tx=0).stop 2024-03-23T23:43:22.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.060+0000 7f9e0c600640 1 -- 172.21.15.8:0/1530927506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e041ef130 msgr2=0x7f9e040a9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:22.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.060+0000 7f9e0c600640 1 --2- 172.21.15.8:0/1530927506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e041ef130 0x7f9e040a9fc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc00c760 tx=0x7f9dfc00cc20 comp rx=0 tx=0).stop 2024-03-23T23:43:22.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.060+0000 7f9e0c600640 1 -- 172.21.15.8:0/1530927506 shutdown_connections 2024-03-23T23:43:22.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.060+0000 7f9e0c600640 1 --2- 172.21.15.8:0/1530927506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e041ef130 0x7f9e040a9fc0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:22.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.060+0000 7f9e0c600640 1 --2- 172.21.15.8:0/1530927506 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9de4067690 0x7f9de4069b50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:22.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.060+0000 7f9e0c600640 1 --2- 172.21.15.8:0/1530927506 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e040c5120 0x7f9e040c3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:22.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.060+0000 7f9e0c600640 1 --2- 172.21.15.8:0/1530927506 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e04071270 0x7f9e041ebbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:22.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.060+0000 7f9e0c600640 1 -- 172.21.15.8:0/1530927506 >> 172.21.15.8:0/1530927506 conn(0x7f9e040aac80 msgr2=0x7f9e040c8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:22.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.060+0000 7f9e0c600640 1 -- 172.21.15.8:0/1530927506 shutdown_connections 2024-03-23T23:43:22.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.060+0000 7f9e0c600640 1 -- 172.21.15.8:0/1530927506 wait complete. 2024-03-23T23:43:22.081 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-03-23T23:43:22.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.232+0000 7f4b1ba00640 1 Processor -- start 2024-03-23T23:43:22.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.232+0000 7f4b1ba00640 1 -- start start 2024-03-23T23:43:22.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.232+0000 7f4b1ba00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b14151000 0x7f4b141542c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:22.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.232+0000 7f4b1ba00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4b140c86b0 0x7f4b140ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:22.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.232+0000 7f4b1ba00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b140c5770 con 0x7f4b140c4fb0 2024-03-23T23:43:22.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.232+0000 7f4b1ba00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b140c84a0 con 0x7f4b140c86b0 2024-03-23T23:43:22.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.232+0000 7f4b1ba00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b140c46a0 con 0x7f4b14151000 2024-03-23T23:43:22.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.232+0000 7f4b13e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f4b140c4fb0 0x7f4b140c6e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48156/0 (socket says 172.21.15.8:48156) 2024-03-23T23:43:22.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.232+0000 7f4b13e00640 1 -- 172.21.15.8:0/3531885029 learned_addr learned my addr 172.21.15.8:0/3531885029 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:43:22.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.232+0000 7f4b19000640 1 --2- 172.21.15.8:0/3531885029 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b14151000 0x7f4b141542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:22.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.232+0000 7f4b19a00640 1 --2- 172.21.15.8:0/3531885029 >> v2:172.21.15.196:3300/0 conn(0x7f4b140c86b0 0x7f4b140ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:22.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.236+0000 7f4b19000640 1 -- 172.21.15.8:0/3531885029 >> v2:172.21.15.196:3300/0 conn(0x7f4b140c86b0 msgr2=0x7f4b140ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:22.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.236+0000 7f4b19000640 1 --2- 172.21.15.8:0/3531885029 >> v2:172.21.15.196:3300/0 conn(0x7f4b140c86b0 0x7f4b140ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:22.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.236+0000 7f4b19000640 1 -- 172.21.15.8:0/3531885029 >> v1:172.21.15.8:6789/0 conn(0x7f4b140c4fb0 legacy=0x7f4b140c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:22.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.236+0000 7f4b13400640 1 -- 172.21.15.8:0/3531885029 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3166621811 0 0) 0x7f4b140c5770 con 0x7f4b140c4fb0 2024-03-23T23:43:22.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.236+0000 7f4b19000640 1 -- 172.21.15.8:0/3531885029 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b140c5490 con 0x7f4b14151000 2024-03-23T23:43:22.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.236+0000 7f4b19a00640 1 --2- 172.21.15.8:0/3531885029 >> v2:172.21.15.196:3300/0 conn(0x7f4b140c86b0 0x7f4b140ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:43:22.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.236+0000 7f4b19000640 1 --2- 172.21.15.8:0/3531885029 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b14151000 0x7f4b141542c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4b080097c0 tx=0x7f4b0801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f574a72fa5497024 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:22.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.236+0000 7f4b13400640 1 -- 172.21.15.8:0/3531885029 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b080b1070 con 0x7f4b14151000 2024-03-23T23:43:22.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.236+0000 7f4b13400640 1 -- 172.21.15.8:0/3531885029 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b080a8050 con 0x7f4b14151000 2024-03-23T23:43:22.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.236+0000 7f4b13400640 1 -- 172.21.15.8:0/3531885029 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b080ac860 con 0x7f4b14151000 2024-03-23T23:43:22.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.236+0000 7f4b1ba00640 1 -- 172.21.15.8:0/3531885029 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b14151000 msgr2=0x7f4b141542c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:22.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.236+0000 7f4b1ba00640 1 --2- 172.21.15.8:0/3531885029 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b14151000 0x7f4b141542c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4b080097c0 tx=0x7f4b0801c3e0 comp rx=0 tx=0).stop 2024-03-23T23:43:22.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.240+0000 7f4b1ba00640 1 -- 172.21.15.8:0/3531885029 shutdown_connections 2024-03-23T23:43:22.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.240+0000 7f4b1ba00640 1 --2- 172.21.15.8:0/3531885029 >> v2:172.21.15.196:3300/0 conn(0x7f4b140c86b0 0x7f4b140ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:22.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.240+0000 7f4b1ba00640 1 --2- 172.21.15.8:0/3531885029 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b14151000 0x7f4b141542c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:22.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.240+0000 7f4b1ba00640 1 -- 172.21.15.8:0/3531885029 >> 172.21.15.8:0/3531885029 conn(0x7f4b140aad10 msgr2=0x7f4b140ab120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:22.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.240+0000 7f4b1ba00640 1 -- 172.21.15.8:0/3531885029 shutdown_connections 2024-03-23T23:43:22.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.240+0000 7f4b1ba00640 1 -- 172.21.15.8:0/3531885029 wait complete. 2024-03-23T23:43:22.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.240+0000 7f4b1ba00640 1 Processor -- start 2024-03-23T23:43:22.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.240+0000 7f4b1ba00640 1 -- start start 2024-03-23T23:43:22.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.240+0000 7f4b1ba00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b140c4fb0 0x7f4b14157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:22.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.240+0000 7f4b1ba00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4b140c86b0 0x7f4b14070120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:22.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.240+0000 7f4b1ba00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b14151000 0x7f4b141edb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:22.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.240+0000 7f4b1ba00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b140c3490 con 0x7f4b14151000 2024-03-23T23:43:22.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.240+0000 7f4b1ba00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b140c7570 con 0x7f4b140c86b0 2024-03-23T23:43:22.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.240+0000 7f4b1ba00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b140c3610 con 0x7f4b140c4fb0 2024-03-23T23:43:22.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.240+0000 7f4b19a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b14151000 0x7f4b141edb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:22.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.240+0000 7f4b19a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b14151000 0x7f4b141edb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54882/0 (socket says 172.21.15.8:54882) 2024-03-23T23:43:22.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.240+0000 7f4b19a00640 1 -- 172.21.15.8:0/2156335619 learned_addr learned my addr 172.21.15.8:0/2156335619 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:22.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.240+0000 7f4b19000640 1 --2- 172.21.15.8:0/2156335619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b140c4fb0 0x7f4b14157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:22.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.240+0000 7f4b13e00640 1 --2- 172.21.15.8:0/2156335619 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4b140c86b0 0x7f4b14070120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:22.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.240+0000 7f4b19a00640 1 -- 172.21.15.8:0/2156335619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b140c4fb0 msgr2=0x7f4b14157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:22.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.240+0000 7f4b19a00640 1 --2- 172.21.15.8:0/2156335619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b140c4fb0 0x7f4b14157d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:22.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.240+0000 7f4b19a00640 1 -- 172.21.15.8:0/2156335619 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4b140c86b0 msgr2=0x7f4b14070120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:22.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.240+0000 7f4b19a00640 1 --2- 172.21.15.8:0/2156335619 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4b140c86b0 0x7f4b14070120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:22.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.240+0000 7f4b19a00640 1 -- 172.21.15.8:0/2156335619 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b140ae810 con 0x7f4b14151000 2024-03-23T23:43:22.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.240+0000 7f4b19a00640 1 --2- 172.21.15.8:0/2156335619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b14151000 0x7f4b141edb40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c00ef90 tx=0x7f4b0c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:22.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.240+0000 7f4b10c00640 1 -- 172.21.15.8:0/2156335619 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c018020 con 0x7f4b14151000 2024-03-23T23:43:22.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.240+0000 7f4b10c00640 1 -- 172.21.15.8:0/2156335619 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0c014480 con 0x7f4b14151000 2024-03-23T23:43:22.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.240+0000 7f4b10c00640 1 -- 172.21.15.8:0/2156335619 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c014870 con 0x7f4b14151000 2024-03-23T23:43:22.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.240+0000 7f4b1ba00640 1 -- 172.21.15.8:0/2156335619 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b1415c320 con 0x7f4b14151000 2024-03-23T23:43:22.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.244+0000 7f4b1ba00640 1 -- 172.21.15.8:0/2156335619 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b1415c5e0 con 0x7f4b14151000 2024-03-23T23:43:22.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.244+0000 7f4b1ba00640 1 -- 172.21.15.8:0/2156335619 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b1415c110 con 0x7f4b14151000 2024-03-23T23:43:22.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.244+0000 7f4b10c00640 1 -- 172.21.15.8:0/2156335619 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f4b0c01b020 con 0x7f4b14151000 2024-03-23T23:43:22.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.244+0000 7f4b10c00640 1 --2- 172.21.15.8:0/2156335619 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4af4067690 0x7f4af4069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:22.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.244+0000 7f4b10c00640 1 -- 172.21.15.8:0/2156335619 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f4b0c086930 con 0x7f4b14151000 2024-03-23T23:43:22.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.244+0000 7f4b19000640 1 --2- 172.21.15.8:0/2156335619 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4af4067690 0x7f4af4069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:22.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.244+0000 7f4b19000640 1 --2- 172.21.15.8:0/2156335619 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4af4067690 0x7f4af4069b50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4b080ae000 tx=0x7f4b080a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:22.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.248+0000 7f4b10c00640 1 -- 172.21.15.8:0/2156335619 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f4b0c022030 con 0x7f4b14151000 2024-03-23T23:43:22.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.412+0000 7f4b1ba00640 1 -- 172.21.15.8:0/2156335619 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) v1 -- 0x7f4b1404f410 con 0x7f4b14151000 2024-03-23T23:43:22.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.412+0000 7f4b10c00640 1 -- 172.21.15.8:0/2156335619 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v27) v1 ==== 95+0+11 (secure 0 0 0) 0x7f4b0c084e20 con 0x7f4b14151000 2024-03-23T23:43:22.416 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-03-23T23:43:22.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.416+0000 7f4b1ba00640 1 -- 172.21.15.8:0/2156335619 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4af4067690 msgr2=0x7f4af4069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:22.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.416+0000 7f4b1ba00640 1 --2- 172.21.15.8:0/2156335619 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4af4067690 0x7f4af4069b50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4b080ae000 tx=0x7f4b080a7000 comp rx=0 tx=0).stop 2024-03-23T23:43:22.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.416+0000 7f4b1ba00640 1 -- 172.21.15.8:0/2156335619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b14151000 msgr2=0x7f4b141edb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:22.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.416+0000 7f4b1ba00640 1 --2- 172.21.15.8:0/2156335619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b14151000 0x7f4b141edb40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c00ef90 tx=0x7f4b0c009f90 comp rx=0 tx=0).stop 2024-03-23T23:43:22.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.416+0000 7f4b1ba00640 1 -- 172.21.15.8:0/2156335619 shutdown_connections 2024-03-23T23:43:22.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.416+0000 7f4b1ba00640 1 --2- 172.21.15.8:0/2156335619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b14151000 0x7f4b141edb40 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:22.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.416+0000 7f4b1ba00640 1 --2- 172.21.15.8:0/2156335619 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4b140c86b0 0x7f4b14070120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:22.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.416+0000 7f4b1ba00640 1 --2- 172.21.15.8:0/2156335619 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4af4067690 0x7f4af4069b50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:22.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.416+0000 7f4b1ba00640 1 --2- 172.21.15.8:0/2156335619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b140c4fb0 0x7f4b14157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:22.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.416+0000 7f4b1ba00640 1 -- 172.21.15.8:0/2156335619 >> 172.21.15.8:0/2156335619 conn(0x7f4b140aad10 msgr2=0x7f4b14151f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:22.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.416+0000 7f4b1ba00640 1 -- 172.21.15.8:0/2156335619 shutdown_connections 2024-03-23T23:43:22.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.416+0000 7f4b1ba00640 1 -- 172.21.15.8:0/2156335619 wait complete. 2024-03-23T23:43:22.437 DEBUG:tasks.mon_thrash:Yielding 2024-03-23T23:43:22.437 INFO:teuthology.run_tasks:Running task workunit... 2024-03-23T23:43:22.622 INFO:tasks.workunit:Pulling workunits from ref 3be9a5c9bc793e11e2800a8c0c696e8b46742033 2024-03-23T23:43:22.622 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-23T23:43:22.623 INFO:tasks.workunit:timeout=3h 2024-03-23T23:43:22.623 INFO:tasks.workunit:cleanup=True 2024-03-23T23:43:22.623 DEBUG:teuthology.orchestra.run.smithi008:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-23T23:43:22.623 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T23:43:22.637 INFO:teuthology.orchestra.run.smithi008.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-03-23T23:43:22.637 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-03-23T23:43:22.637 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 2bh/43d Inode: 1 Links: 2 2024-03-23T23:43:22.637 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-23T23:43:22.638 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-03-23T23:43:22.638 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2024-03-23 23:42:40.686583070 +0000 2024-03-23T23:43:22.638 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2024-03-23 23:43:14.628955084 +0000 2024-03-23T23:43:22.638 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2024-03-23 23:42:40.686583070 +0000 2024-03-23T23:43:22.638 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-03-23T23:43:22.638 DEBUG:teuthology.orchestra.run.smithi008:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-03-23T23:43:22.710 DEBUG:teuthology.orchestra.run.smithi196:> stat -- /home/ubuntu/cephtest/mnt.1 2024-03-23T23:43:22.720 INFO:teuthology.orchestra.run.smithi196.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-03-23T23:43:22.720 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-03-23T23:43:22.720 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 2bh/43d Inode: 1 Links: 2 2024-03-23T23:43:22.720 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-23T23:43:22.721 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-03-23T23:43:22.721 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-03-23 23:42:50.749818580 +0000 2024-03-23T23:43:22.721 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-03-23 23:43:16.935185739 +0000 2024-03-23T23:43:22.721 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-03-23 23:42:50.749818580 +0000 2024-03-23T23:43:22.721 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-03-23T23:43:22.721 DEBUG:teuthology.orchestra.run.smithi196:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-03-23T23:43:22.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.772+0000 7f2d65400640 1 Processor -- start 2024-03-23T23:43:22.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.772+0000 7f2d65400640 1 -- start start 2024-03-23T23:43:22.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.776+0000 7f2d65400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d60152f10 0x7f2d60158c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:22.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.776+0000 7f2d65400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2d600c8740 0x7f2d60070f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:22.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.776+0000 7f2d65400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d6006d0f0 con 0x7f2d60071450 2024-03-23T23:43:22.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.776+0000 7f2d65400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d600c6dd0 con 0x7f2d600c8740 2024-03-23T23:43:22.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.776+0000 7f2d65400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d601591b0 con 0x7f2d60152f10 2024-03-23T23:43:22.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.776+0000 7f2d57e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2d600c8740 0x7f2d60070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:22.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.776+0000 7f2d57e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2d600c8740 0x7f2d60070f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48356/0 (socket says 172.21.15.8:48356) 2024-03-23T23:43:22.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.776+0000 7f2d57e00640 1 -- 172.21.15.8:0/698963428 learned_addr learned my addr 172.21.15.8:0/698963428 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:22.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.776+0000 7f2d64a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f2d60071450 0x7f2d6006d5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:54664/0 (socket says 172.21.15.8:54664) 2024-03-23T23:43:22.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.776+0000 7f2d5fe00640 1 --2- 172.21.15.8:0/698963428 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d60152f10 0x7f2d60158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:22.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.776+0000 7f2d57e00640 1 -- 172.21.15.8:0/698963428 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d60152f10 msgr2=0x7f2d60158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:22.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.776+0000 7f2d57e00640 1 --2- 172.21.15.8:0/698963428 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d60152f10 0x7f2d60158c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:22.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.776+0000 7f2d57e00640 1 -- 172.21.15.8:0/698963428 >> v1:172.21.15.8:6789/0 conn(0x7f2d60071450 legacy=0x7f2d6006d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:22.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.776+0000 7f2d57e00640 1 -- 172.21.15.8:0/698963428 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d601593e0 con 0x7f2d600c8740 2024-03-23T23:43:22.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.776+0000 7f2d5f400640 1 -- 172.21.15.8:0/698963428 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2512296069 0 0) 0x7f2d6006d0f0 con 0x7f2d60071450 2024-03-23T23:43:22.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.780+0000 7f2d57e00640 1 --2- 172.21.15.8:0/698963428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d600c8740 0x7f2d60070f10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2d48009870 tx=0x7f2d4801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=999ab30610563ad6 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:22.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.780+0000 7f2d5f400640 1 -- 172.21.15.8:0/698963428 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d480aa650 con 0x7f2d600c8740 2024-03-23T23:43:22.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.780+0000 7f2d5f400640 1 -- 172.21.15.8:0/698963428 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d480af070 con 0x7f2d600c8740 2024-03-23T23:43:22.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.780+0000 7f2d5f400640 1 -- 172.21.15.8:0/698963428 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d480aaa10 con 0x7f2d600c8740 2024-03-23T23:43:22.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.780+0000 7f2d65400640 1 -- 172.21.15.8:0/698963428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d600c8740 msgr2=0x7f2d60070f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:22.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.780+0000 7f2d65400640 1 --2- 172.21.15.8:0/698963428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d600c8740 0x7f2d60070f10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2d48009870 tx=0x7f2d4801c4d0 comp rx=0 tx=0).stop 2024-03-23T23:43:22.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.780+0000 7f2d65400640 1 -- 172.21.15.8:0/698963428 shutdown_connections 2024-03-23T23:43:22.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.780+0000 7f2d65400640 1 --2- 172.21.15.8:0/698963428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d600c8740 0x7f2d60070f10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:22.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.780+0000 7f2d65400640 1 --2- 172.21.15.8:0/698963428 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d60152f10 0x7f2d60158c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:22.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.780+0000 7f2d65400640 1 -- 172.21.15.8:0/698963428 >> 172.21.15.8:0/698963428 conn(0x7f2d600aac80 msgr2=0x7f2d600ab090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:22.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.780+0000 7f2d65400640 1 -- 172.21.15.8:0/698963428 shutdown_connections 2024-03-23T23:43:22.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.780+0000 7f2d65400640 1 -- 172.21.15.8:0/698963428 wait complete. 2024-03-23T23:43:22.785 DEBUG:teuthology.orchestra.run.smithi008:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 3be9a5c9bc793e11e2800a8c0c696e8b46742033 2024-03-23T23:43:22.786 DEBUG:teuthology.orchestra.run.smithi196:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 3be9a5c9bc793e11e2800a8c0c696e8b46742033 2024-03-23T23:43:22.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.784+0000 7f2d65400640 1 Processor -- start 2024-03-23T23:43:22.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.784+0000 7f2d65400640 1 -- start start 2024-03-23T23:43:22.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.784+0000 7f2d65400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2d60071450 0x7f2d60152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:22.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.784+0000 7f2d65400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d600c8740 0x7f2d6014f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:22.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.784+0000 7f2d65400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d60152f10 0x7f2d60158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:22.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.784+0000 7f2d65400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d60162a10 con 0x7f2d600c8740 2024-03-23T23:43:22.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.784+0000 7f2d65400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6006e110 con 0x7f2d60071450 2024-03-23T23:43:22.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.784+0000 7f2d65400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d60162b90 con 0x7f2d60152f10 2024-03-23T23:43:22.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.784+0000 7f2d57e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d600c8740 0x7f2d6014f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:22.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.784+0000 7f2d57e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d600c8740 0x7f2d6014f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48364/0 (socket says 172.21.15.8:48364) 2024-03-23T23:43:22.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.784+0000 7f2d57e00640 1 -- 172.21.15.8:0/989731378 learned_addr learned my addr 172.21.15.8:0/989731378 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:22.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.784+0000 7f2d64a00640 1 --2- 172.21.15.8:0/989731378 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d60152f10 0x7f2d60158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:22.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.784+0000 7f2d5fe00640 1 --2- 172.21.15.8:0/989731378 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2d60071450 0x7f2d60152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:22.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.784+0000 7f2d57e00640 1 -- 172.21.15.8:0/989731378 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d60152f10 msgr2=0x7f2d60158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:22.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.784+0000 7f2d57e00640 1 --2- 172.21.15.8:0/989731378 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d60152f10 0x7f2d60158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:22.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.784+0000 7f2d57e00640 1 -- 172.21.15.8:0/989731378 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2d60071450 msgr2=0x7f2d60152180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:22.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.784+0000 7f2d57e00640 1 --2- 172.21.15.8:0/989731378 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2d60071450 0x7f2d60152180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:22.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.784+0000 7f2d57e00640 1 -- 172.21.15.8:0/989731378 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6014cb40 con 0x7f2d600c8740 2024-03-23T23:43:22.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.784+0000 7f2d57e00640 1 --2- 172.21.15.8:0/989731378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d600c8740 0x7f2d6014f6b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2d480ac040 tx=0x7f2d4801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:22.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.784+0000 7f2d5cc00640 1 -- 172.21.15.8:0/989731378 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d480bd5f0 con 0x7f2d600c8740 2024-03-23T23:43:22.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.784+0000 7f2d5cc00640 1 -- 172.21.15.8:0/989731378 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d480a6040 con 0x7f2d600c8740 2024-03-23T23:43:22.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.784+0000 7f2d65400640 1 -- 172.21.15.8:0/989731378 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d601edfc0 con 0x7f2d600c8740 2024-03-23T23:43:22.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.784+0000 7f2d5cc00640 1 -- 172.21.15.8:0/989731378 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d480bd9f0 con 0x7f2d600c8740 2024-03-23T23:43:22.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.784+0000 7f2d65400640 1 -- 172.21.15.8:0/989731378 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d601ee560 con 0x7f2d600c8740 2024-03-23T23:43:22.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.788+0000 7f2d65400640 1 -- 172.21.15.8:0/989731378 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d6004f410 con 0x7f2d600c8740 2024-03-23T23:43:22.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.788+0000 7f2d5cc00640 1 -- 172.21.15.8:0/989731378 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f2d480c6440 con 0x7f2d600c8740 2024-03-23T23:43:22.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.788+0000 7f2d5cc00640 1 --2- 172.21.15.8:0/989731378 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2d3c067660 0x7f2d3c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:22.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.788+0000 7f2d5cc00640 1 -- 172.21.15.8:0/989731378 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f2d48120290 con 0x7f2d600c8740 2024-03-23T23:43:22.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.788+0000 7f2d5fe00640 1 --2- 172.21.15.8:0/989731378 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2d3c067660 0x7f2d3c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:22.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.792+0000 7f2d5fe00640 1 --2- 172.21.15.8:0/989731378 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2d3c067660 0x7f2d3c069b20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2d50009b60 tx=0x7f2d50009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:22.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:22.792+0000 7f2d5cc00640 1 -- 172.21.15.8:0/989731378 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f2d48016150 con 0x7f2d600c8740 2024-03-23T23:43:22.799 INFO:tasks.workunit.client.0.smithi008.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-23T23:43:22.839 INFO:tasks.workunit.client.1.smithi196.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-03-23T23:43:23.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.016+0000 7f2d65400640 1 -- 172.21.15.8:0/989731378 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d60158a90 con 0x7f2d600c8740 2024-03-23T23:43:23.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.016+0000 7f2d5cc00640 1 -- 172.21.15.8:0/989731378 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6245 (secure 0 0 0) 0x7f2d480f0610 con 0x7f2d600c8740 2024-03-23T23:43:23.017 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:43:23.018 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6836/3149325777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3149325777},{"type":"v1","addr":"172.21.15.196:6836","nonce":3149325777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6833/1542162403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1542162403},{"type":"v1","addr":"172.21.15.8:6833","nonce":1542162403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T23:42:40.070799+0000","modified":"2024-03-23T23:42:44.080269+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6837/3402347550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":3402347550},{"type":"v1","addr":"172.21.15.196:6837","nonce":3402347550}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T23:42:50.113972+0000","modified":"2024-03-23T23:42:54.152778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.8:6835/3531853933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3531853933},{"type":"v1","addr":"172.21.15.8:6835","nonce":3531853933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4269,"qdb_cluster":[4269]},"id":2}]} 2024-03-23T23:43:23.018 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 15 2024-03-23T23:43:23.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.016+0000 7f2d65400640 1 -- 172.21.15.8:0/989731378 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2d3c067660 msgr2=0x7f2d3c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:23.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.016+0000 7f2d65400640 1 --2- 172.21.15.8:0/989731378 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2d3c067660 0x7f2d3c069b20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2d50009b60 tx=0x7f2d50009190 comp rx=0 tx=0).stop 2024-03-23T23:43:23.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.016+0000 7f2d65400640 1 -- 172.21.15.8:0/989731378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d600c8740 msgr2=0x7f2d6014f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:23.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.016+0000 7f2d65400640 1 --2- 172.21.15.8:0/989731378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d600c8740 0x7f2d6014f6b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2d480ac040 tx=0x7f2d4801ad10 comp rx=0 tx=0).stop 2024-03-23T23:43:23.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.016+0000 7f2d65400640 1 -- 172.21.15.8:0/989731378 shutdown_connections 2024-03-23T23:43:23.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.016+0000 7f2d65400640 1 --2- 172.21.15.8:0/989731378 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2d3c067660 0x7f2d3c069b20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:23.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.016+0000 7f2d65400640 1 --2- 172.21.15.8:0/989731378 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d60152f10 0x7f2d60158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:23.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.016+0000 7f2d65400640 1 --2- 172.21.15.8:0/989731378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d600c8740 0x7f2d6014f6b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:23.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.016+0000 7f2d65400640 1 --2- 172.21.15.8:0/989731378 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2d60071450 0x7f2d60152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:23.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.016+0000 7f2d65400640 1 -- 172.21.15.8:0/989731378 >> 172.21.15.8:0/989731378 conn(0x7f2d600aac80 msgr2=0x7f2d600c4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:23.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.016+0000 7f2d65400640 1 -- 172.21.15.8:0/989731378 shutdown_connections 2024-03-23T23:43:23.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.016+0000 7f2d65400640 1 -- 172.21.15.8:0/989731378 wait complete. 2024-03-23T23:43:23.040 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2024-03-23T23:43:23.040 INFO:tasks.mon_thrash.mon_thrasher:seed: 1711237400, revive delay: 20.0, thrash delay: 10.0 thrash many: False, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2024-03-23T23:43:23.040 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T23:43:23.041 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:43:23.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.236+0000 7fac22a00640 1 Processor -- start 2024-03-23T23:43:23.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.236+0000 7fac22a00640 1 -- start start 2024-03-23T23:43:23.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.236+0000 7fac22a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fac1c0c31e0 0x7fac1c0c8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:23.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.236+0000 7fac22a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac1c0c6fa0 0x7fac1c0c5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:23.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.236+0000 7fac22a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fac1c0c5f80 0x7fac1c158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:23.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.236+0000 7fac22a00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac1c155c00 con 0x7fac1c0c31e0 2024-03-23T23:43:23.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.236+0000 7fac22a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac1c155ee0 con 0x7fac1c0c5f80 2024-03-23T23:43:23.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.236+0000 7fac22a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c1561c0 con 0x7fac1c0c6fa0 2024-03-23T23:43:23.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.236+0000 7fac1be00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fac1c0c31e0 0x7fac1c0c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:23.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.236+0000 7fac1be00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fac1c0c31e0 0x7fac1c0c8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48372/0 (socket says 172.21.15.8:48372) 2024-03-23T23:43:23.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.236+0000 7fac1be00640 1 -- 172.21.15.8:0/3341195986 learned_addr learned my addr 172.21.15.8:0/3341195986 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:23.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.236+0000 7fac1b400640 1 --2- 172.21.15.8:0/3341195986 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac1c0c6fa0 0x7fac1c0c5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:23.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.236+0000 7fac20a00640 1 --2- 172.21.15.8:0/3341195986 >> v2:172.21.15.196:3300/0 conn(0x7fac1c0c5f80 0x7fac1c158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:23.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.236+0000 7fac1be00640 1 -- 172.21.15.8:0/3341195986 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac1c0c6fa0 msgr2=0x7fac1c0c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:23.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.236+0000 7fac1be00640 1 --2- 172.21.15.8:0/3341195986 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac1c0c6fa0 0x7fac1c0c5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:23.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.236+0000 7fac1be00640 1 -- 172.21.15.8:0/3341195986 >> v2:172.21.15.196:3300/0 conn(0x7fac1c0c5f80 msgr2=0x7fac1c158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:23.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.236+0000 7fac1be00640 1 --2- 172.21.15.8:0/3341195986 >> v2:172.21.15.196:3300/0 conn(0x7fac1c0c5f80 0x7fac1c158ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:23.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.236+0000 7fac1be00640 1 -- 172.21.15.8:0/3341195986 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1c1564a0 con 0x7fac1c0c31e0 2024-03-23T23:43:23.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.240+0000 7fac1be00640 1 --2- 172.21.15.8:0/3341195986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac1c0c31e0 0x7fac1c0c8900 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fac0c009870 tx=0x7fac0c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f702fada6d3e222b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:23.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.240+0000 7fac1aa00640 1 -- 172.21.15.8:0/3341195986 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c0b0070 con 0x7fac1c0c31e0 2024-03-23T23:43:23.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.240+0000 7fac1aa00640 1 -- 172.21.15.8:0/3341195986 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0c0ab600 con 0x7fac1c0c31e0 2024-03-23T23:43:23.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.240+0000 7fac1aa00640 1 -- 172.21.15.8:0/3341195986 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c0ab9d0 con 0x7fac1c0c31e0 2024-03-23T23:43:23.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.240+0000 7fac22a00640 1 -- 172.21.15.8:0/3341195986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac1c0c31e0 msgr2=0x7fac1c0c8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:23.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.240+0000 7fac22a00640 1 --2- 172.21.15.8:0/3341195986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac1c0c31e0 0x7fac1c0c8900 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fac0c009870 tx=0x7fac0c01c3d0 comp rx=0 tx=0).stop 2024-03-23T23:43:23.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.240+0000 7fac22a00640 1 -- 172.21.15.8:0/3341195986 shutdown_connections 2024-03-23T23:43:23.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.240+0000 7fac22a00640 1 --2- 172.21.15.8:0/3341195986 >> v2:172.21.15.196:3300/0 conn(0x7fac1c0c5f80 0x7fac1c158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:23.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.240+0000 7fac22a00640 1 --2- 172.21.15.8:0/3341195986 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac1c0c6fa0 0x7fac1c0c5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:23.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.240+0000 7fac22a00640 1 --2- 172.21.15.8:0/3341195986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac1c0c31e0 0x7fac1c0c8900 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:23.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.240+0000 7fac22a00640 1 -- 172.21.15.8:0/3341195986 >> 172.21.15.8:0/3341195986 conn(0x7fac1c0743f0 msgr2=0x7fac1c074800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:23.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.240+0000 7fac22a00640 1 -- 172.21.15.8:0/3341195986 shutdown_connections 2024-03-23T23:43:23.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.244+0000 7fac22a00640 1 -- 172.21.15.8:0/3341195986 wait complete. 2024-03-23T23:43:23.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.244+0000 7fac22a00640 1 Processor -- start 2024-03-23T23:43:23.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.244+0000 7fac22a00640 1 -- start start 2024-03-23T23:43:23.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.244+0000 7fac22a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac1c0c31e0 0x7fac1c15c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:23.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.244+0000 7fac22a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac1c0c5f80 0x7fac1c157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:23.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.244+0000 7fac22a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac1c0c6fa0 0x7fac1c151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:23.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.244+0000 7fac22a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c0c93c0 con 0x7fac1c0c5f80 2024-03-23T23:43:23.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.244+0000 7fac22a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c0c9240 con 0x7fac1c0c31e0 2024-03-23T23:43:23.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.244+0000 7fac22a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c0c9540 con 0x7fac1c0c6fa0 2024-03-23T23:43:23.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.244+0000 7fac1b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac1c0c5f80 0x7fac1c157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:23.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.244+0000 7fac1be00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac1c0c31e0 0x7fac1c15c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:23.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.244+0000 7fac1be00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac1c0c31e0 0x7fac1c15c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:36184/0 (socket says 172.21.15.8:36184) 2024-03-23T23:43:23.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.244+0000 7fac20a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac1c0c6fa0 0x7fac1c151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:23.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.244+0000 7fac1be00640 1 -- 172.21.15.8:0/2687502265 learned_addr learned my addr 172.21.15.8:0/2687502265 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:23.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.244+0000 7fac1b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac1c0c5f80 0x7fac1c157c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48386/0 (socket says 172.21.15.8:48386) 2024-03-23T23:43:23.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.244+0000 7fac1be00640 1 -- 172.21.15.8:0/2687502265 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac1c0c6fa0 msgr2=0x7fac1c151cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:23.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.244+0000 7fac1be00640 1 --2- 172.21.15.8:0/2687502265 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac1c0c6fa0 0x7fac1c151cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:23.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.244+0000 7fac1be00640 1 -- 172.21.15.8:0/2687502265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac1c0c5f80 msgr2=0x7fac1c157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:23.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.244+0000 7fac1be00640 1 --2- 172.21.15.8:0/2687502265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac1c0c5f80 0x7fac1c157c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:23.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.244+0000 7fac1be00640 1 -- 172.21.15.8:0/2687502265 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1c1eeee0 con 0x7fac1c0c31e0 2024-03-23T23:43:23.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.244+0000 7fac1b400640 1 --2- 172.21.15.8:0/2687502265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac1c0c5f80 0x7fac1c157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:43:23.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.244+0000 7fac1be00640 1 --2- 172.21.15.8:0/2687502265 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac1c0c31e0 0x7fac1c15c470 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fac0c0ae040 tx=0x7fac0c01ac10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:23.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.248+0000 7fac13e00640 1 -- 172.21.15.8:0/2687502265 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c0ba020 con 0x7fac1c0c31e0 2024-03-23T23:43:23.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.248+0000 7fac13e00640 1 -- 172.21.15.8:0/2687502265 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0c0b6420 con 0x7fac1c0c31e0 2024-03-23T23:43:23.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.248+0000 7fac13e00640 1 -- 172.21.15.8:0/2687502265 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c0b0040 con 0x7fac1c0c31e0 2024-03-23T23:43:23.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.248+0000 7fac22a00640 1 -- 172.21.15.8:0/2687502265 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac1c0adb70 con 0x7fac1c0c31e0 2024-03-23T23:43:23.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.248+0000 7fac22a00640 1 -- 172.21.15.8:0/2687502265 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac1c0ae130 con 0x7fac1c0c31e0 2024-03-23T23:43:23.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.248+0000 7fac22a00640 1 -- 172.21.15.8:0/2687502265 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac1c0ae370 con 0x7fac1c0c31e0 2024-03-23T23:43:23.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.248+0000 7fac13e00640 1 -- 172.21.15.8:0/2687502265 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fac0c0bd020 con 0x7fac1c0c31e0 2024-03-23T23:43:23.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.252+0000 7fac13e00640 1 --2- 172.21.15.8:0/2687502265 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fabfc067660 0x7fabfc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:23.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.252+0000 7fac13e00640 1 -- 172.21.15.8:0/2687502265 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fac0c11fdc0 con 0x7fac1c0c31e0 2024-03-23T23:43:23.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.252+0000 7fac1b400640 1 --2- 172.21.15.8:0/2687502265 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fabfc067660 0x7fabfc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:23.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.252+0000 7fac1b400640 1 --2- 172.21.15.8:0/2687502265 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fabfc067660 0x7fabfc069b20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fac1c15fc90 tx=0x7fac08009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:23.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.252+0000 7fac13e00640 1 -- 172.21.15.8:0/2687502265 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fac1c0ae370 con 0x7fac1c0c31e0 2024-03-23T23:43:23.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.496+0000 7fac22a00640 1 -- 172.21.15.8:0/2687502265 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fac1c04f480 con 0x7fac1c0c31e0 2024-03-23T23:43:23.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.496+0000 7fac13e00640 1 -- 172.21.15.8:0/2687502265 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1560 (secure 0 0 0) 0x7fac0c0c4030 con 0x7fac1c0c31e0 2024-03-23T23:43:23.502 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":68,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:43:23.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.500+0000 7fac22a00640 1 -- 172.21.15.8:0/2687502265 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fabfc067660 msgr2=0x7fabfc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:23.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.500+0000 7fac22a00640 1 --2- 172.21.15.8:0/2687502265 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fabfc067660 0x7fabfc069b20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fac1c15fc90 tx=0x7fac08009190 comp rx=0 tx=0).stop 2024-03-23T23:43:23.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.500+0000 7fac22a00640 1 -- 172.21.15.8:0/2687502265 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac1c0c31e0 msgr2=0x7fac1c15c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:23.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.500+0000 7fac22a00640 1 --2- 172.21.15.8:0/2687502265 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac1c0c31e0 0x7fac1c15c470 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fac0c0ae040 tx=0x7fac0c01ac10 comp rx=0 tx=0).stop 2024-03-23T23:43:23.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.500+0000 7fac22a00640 1 -- 172.21.15.8:0/2687502265 shutdown_connections 2024-03-23T23:43:23.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.500+0000 7fac22a00640 1 --2- 172.21.15.8:0/2687502265 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fabfc067660 0x7fabfc069b20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:23.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.500+0000 7fac22a00640 1 --2- 172.21.15.8:0/2687502265 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac1c0c6fa0 0x7fac1c151cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:23.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.500+0000 7fac22a00640 1 --2- 172.21.15.8:0/2687502265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac1c0c5f80 0x7fac1c157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:23.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.500+0000 7fac22a00640 1 --2- 172.21.15.8:0/2687502265 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac1c0c31e0 0x7fac1c15c470 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:23.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.500+0000 7fac22a00640 1 -- 172.21.15.8:0/2687502265 >> 172.21.15.8:0/2687502265 conn(0x7fac1c0743f0 msgr2=0x7fac1c0a9520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:23.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.500+0000 7fac22a00640 1 -- 172.21.15.8:0/2687502265 shutdown_connections 2024-03-23T23:43:23.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.500+0000 7fac22a00640 1 -- 172.21.15.8:0/2687502265 wait complete. 2024-03-23T23:43:23.530 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T23:43:23.530 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-03-23T23:43:23.530 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T23:43:23.531 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:43:23.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.668+0000 7f6a48c00640 1 Processor -- start 2024-03-23T23:43:23.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.668+0000 7f6a48c00640 1 -- start start 2024-03-23T23:43:23.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.672+0000 7f6a48c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a4414d8b0 0x7f6a440c7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:23.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.672+0000 7f6a48c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6a44070b50 0x7f6a441541b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:23.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.672+0000 7f6a48c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a440c7670 con 0x7f6a440c5560 2024-03-23T23:43:23.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.672+0000 7f6a48c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a440c4830 con 0x7f6a44070b50 2024-03-23T23:43:23.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.672+0000 7f6a48c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a440c50d0 con 0x7f6a4414d8b0 2024-03-23T23:43:23.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.672+0000 7f6a3be00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6a44070b50 0x7f6a441541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:23.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.672+0000 7f6a41e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a4414d8b0 0x7f6a440c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:23.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.672+0000 7f6a42800640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f6a440c5560 0x7f6a4406ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:57456/0 (socket says 172.21.15.8:57456) 2024-03-23T23:43:23.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.672+0000 7f6a42800640 1 -- 172.21.15.8:0/4208866288 learned_addr learned my addr 172.21.15.8:0/4208866288 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:43:23.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.672+0000 7f6a3be00640 1 -- 172.21.15.8:0/4208866288 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a4414d8b0 msgr2=0x7f6a440c7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:23.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.672+0000 7f6a3be00640 1 --2- 172.21.15.8:0/4208866288 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a4414d8b0 0x7f6a440c7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:23.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.672+0000 7f6a3be00640 1 -- 172.21.15.8:0/4208866288 >> v1:172.21.15.196:6789/0 conn(0x7f6a440c5560 legacy=0x7f6a4406ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:23.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.672+0000 7f6a3be00640 1 -- 172.21.15.8:0/4208866288 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a441546f0 con 0x7f6a44070b50 2024-03-23T23:43:23.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.672+0000 7f6a3be00640 1 --2- 172.21.15.8:0/4208866288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6a44070b50 0x7f6a441541b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c0097c0 tx=0x7f6a2c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9424f469bbf5ccf server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:23.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.676+0000 7f6a41400640 1 -- 172.21.15.8:0/4208866288 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c0b0070 con 0x7f6a44070b50 2024-03-23T23:43:23.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.676+0000 7f6a41400640 1 -- 172.21.15.8:0/4208866288 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2c0ab600 con 0x7f6a44070b50 2024-03-23T23:43:23.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.676+0000 7f6a41400640 1 -- 172.21.15.8:0/4208866288 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c0ab9d0 con 0x7f6a44070b50 2024-03-23T23:43:23.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.676+0000 7f6a48c00640 1 -- 172.21.15.8:0/4208866288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6a44070b50 msgr2=0x7f6a441541b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:23.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.676+0000 7f6a48c00640 1 --2- 172.21.15.8:0/4208866288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6a44070b50 0x7f6a441541b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c0097c0 tx=0x7f6a2c01c4a0 comp rx=0 tx=0).stop 2024-03-23T23:43:23.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.676+0000 7f6a48c00640 1 -- 172.21.15.8:0/4208866288 shutdown_connections 2024-03-23T23:43:23.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.676+0000 7f6a48c00640 1 --2- 172.21.15.8:0/4208866288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6a44070b50 0x7f6a441541b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:23.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.676+0000 7f6a48c00640 1 --2- 172.21.15.8:0/4208866288 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a4414d8b0 0x7f6a440c7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:23.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.676+0000 7f6a48c00640 1 -- 172.21.15.8:0/4208866288 >> 172.21.15.8:0/4208866288 conn(0x7f6a440aafe0 msgr2=0x7f6a440ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:23.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.676+0000 7f6a48c00640 1 -- 172.21.15.8:0/4208866288 shutdown_connections 2024-03-23T23:43:23.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.676+0000 7f6a48c00640 1 -- 172.21.15.8:0/4208866288 wait complete. 2024-03-23T23:43:23.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.676+0000 7f6a48c00640 1 Processor -- start 2024-03-23T23:43:23.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.676+0000 7f6a48c00640 1 -- start start 2024-03-23T23:43:23.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.676+0000 7f6a48c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a44070b50 0x7f6a44150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:23.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.676+0000 7f6a48c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6a440c5560 0x7f6a440acd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:23.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.676+0000 7f6a48c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a4414d8b0 0x7f6a440ad280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:23.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.676+0000 7f6a48c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4406f590 con 0x7f6a4414d8b0 2024-03-23T23:43:23.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.676+0000 7f6a48c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4406f410 con 0x7f6a440c5560 2024-03-23T23:43:23.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.676+0000 7f6a48c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a440c5970 con 0x7f6a44070b50 2024-03-23T23:43:23.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.676+0000 7f6a42800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a4414d8b0 0x7f6a440ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:23.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.676+0000 7f6a42800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a4414d8b0 0x7f6a440ad280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48388/0 (socket says 172.21.15.8:48388) 2024-03-23T23:43:23.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.676+0000 7f6a41e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a44070b50 0x7f6a44150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:23.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.676+0000 7f6a42800640 1 -- 172.21.15.8:0/1235256087 learned_addr learned my addr 172.21.15.8:0/1235256087 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:23.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.676+0000 7f6a3be00640 1 --2- 172.21.15.8:0/1235256087 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6a440c5560 0x7f6a440acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:23.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.680+0000 7f6a3be00640 1 -- 172.21.15.8:0/1235256087 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a44070b50 msgr2=0x7f6a44150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:23.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.680+0000 7f6a3be00640 1 --2- 172.21.15.8:0/1235256087 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a44070b50 0x7f6a44150ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:23.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.680+0000 7f6a3be00640 1 -- 172.21.15.8:0/1235256087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a4414d8b0 msgr2=0x7f6a440ad280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:23.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.680+0000 7f6a3be00640 1 --2- 172.21.15.8:0/1235256087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a4414d8b0 0x7f6a440ad280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:23.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.680+0000 7f6a3be00640 1 -- 172.21.15.8:0/1235256087 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a440aee70 con 0x7f6a440c5560 2024-03-23T23:43:23.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.680+0000 7f6a42800640 1 --2- 172.21.15.8:0/1235256087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a4414d8b0 0x7f6a440ad280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:43:23.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.680+0000 7f6a3be00640 1 --2- 172.21.15.8:0/1235256087 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6a440c5560 0x7f6a440acd40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c0ab000 tx=0x7f6a2c019240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:23.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.680+0000 7f6a3a000640 1 -- 172.21.15.8:0/1235256087 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c0b8020 con 0x7f6a440c5560 2024-03-23T23:43:23.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.680+0000 7f6a3a000640 1 -- 172.21.15.8:0/1235256087 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2c0b4410 con 0x7f6a440c5560 2024-03-23T23:43:23.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.680+0000 7f6a3a000640 1 -- 172.21.15.8:0/1235256087 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c0b0040 con 0x7f6a440c5560 2024-03-23T23:43:23.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.680+0000 7f6a48c00640 1 -- 172.21.15.8:0/1235256087 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a441efc30 con 0x7f6a440c5560 2024-03-23T23:43:23.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.680+0000 7f6a48c00640 1 -- 172.21.15.8:0/1235256087 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a4414a630 con 0x7f6a440c5560 2024-03-23T23:43:23.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.680+0000 7f6a48c00640 1 --2- 172.21.15.8:0/1235256087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a441ebb80 0x7f6a441ebf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:23.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.680+0000 7f6a48c00640 1 -- 172.21.15.8:0/1235256087 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a440ad7c0 con 0x7f6a441ebb80 2024-03-23T23:43:23.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.680+0000 7f6a41e00640 1 --2- 172.21.15.8:0/1235256087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a441ebb80 0x7f6a441ebf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:23.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.680+0000 7f6a41e00640 1 -- 172.21.15.8:0/1235256087 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6a44068270 con 0x7f6a441ebb80 2024-03-23T23:43:23.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.680+0000 7f6a41e00640 1 --2- 172.21.15.8:0/1235256087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a441ebb80 0x7f6a441ebf60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6a34011900 tx=0x7f6a34011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:23.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.680+0000 7f6a3a000640 1 -- 172.21.15.8:0/1235256087 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a34019070 con 0x7f6a441ebb80 2024-03-23T23:43:23.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.680+0000 7f6a3a000640 1 -- 172.21.15.8:0/1235256087 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f6a34004300 con 0x7f6a441ebb80 2024-03-23T23:43:23.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.680+0000 7f6a3a000640 1 -- 172.21.15.8:0/1235256087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a441ebb80 msgr2=0x7f6a441ebf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:23.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.680+0000 7f6a3a000640 1 --2- 172.21.15.8:0/1235256087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a441ebb80 0x7f6a441ebf60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6a34011900 tx=0x7f6a34011dc0 comp rx=0 tx=0).stop 2024-03-23T23:43:23.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.680+0000 7f6a3a000640 1 -- 172.21.15.8:0/1235256087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a441ebb80 msgr2=0x7f6a441ebf60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:43:23.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.680+0000 7f6a3a000640 1 --2- 172.21.15.8:0/1235256087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a441ebb80 0x7f6a441ebf60 secure :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6a34011900 tx=0x7f6a34011dc0 comp rx=0 tx=0).stop 2024-03-23T23:43:23.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.680+0000 7f6a3a000640 1 -- 172.21.15.8:0/1235256087 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f6a2c0bb020 con 0x7f6a440c5560 2024-03-23T23:43:23.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.684+0000 7f6a3a000640 1 --2- 172.21.15.8:0/1235256087 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6a200670d0 0x7f6a20069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:23.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.684+0000 7f6a3a000640 1 -- 172.21.15.8:0/1235256087 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f6a2c11f680 con 0x7f6a440c5560 2024-03-23T23:43:23.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.684+0000 7f6a41e00640 1 --2- 172.21.15.8:0/1235256087 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6a200670d0 0x7f6a20069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:23.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.684+0000 7f6a41e00640 1 --2- 172.21.15.8:0/1235256087 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6a200670d0 0x7f6a20069590 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6a3400f6b0 tx=0x7f6a34008070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:23.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.688+0000 7f6a48c00640 1 --2- 172.21.15.8:0/1235256087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a441ec4a0 0x7f6a440a8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:23.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.688+0000 7f6a48c00640 1 -- 172.21.15.8:0/1235256087 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a441efa90 con 0x7f6a441ec4a0 2024-03-23T23:43:23.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.688+0000 7f6a42800640 1 --2- 172.21.15.8:0/1235256087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a441ec4a0 0x7f6a440a8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:23.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.688+0000 7f6a42800640 1 -- 172.21.15.8:0/1235256087 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6a440c3c30 con 0x7f6a441ec4a0 2024-03-23T23:43:23.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.688+0000 7f6a42800640 1 --2- 172.21.15.8:0/1235256087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a441ec4a0 0x7f6a440a8f20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c005c10 tx=0x7f6a3c00d830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:23.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.688+0000 7f6a3a000640 1 -- 172.21.15.8:0/1235256087 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c007320 con 0x7f6a441ec4a0 2024-03-23T23:43:23.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.688+0000 7f6a3a000640 1 -- 172.21.15.8:0/1235256087 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5184 (secure 0 0 0) 0x7f6a3c007320 con 0x7f6a441ec4a0 2024-03-23T23:43:23.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.688+0000 7f6a3a000640 1 -- 172.21.15.8:0/1235256087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a441ec4a0 msgr2=0x7f6a440a8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:23.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.688+0000 7f6a3a000640 1 --2- 172.21.15.8:0/1235256087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a441ec4a0 0x7f6a440a8f20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c005c10 tx=0x7f6a3c00d830 comp rx=0 tx=0).stop 2024-03-23T23:43:23.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.688+0000 7f6a3a000640 1 -- 172.21.15.8:0/1235256087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a441ec4a0 msgr2=0x7f6a440a8f20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:43:23.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.688+0000 7f6a3a000640 1 --2- 172.21.15.8:0/1235256087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a441ec4a0 0x7f6a440a8f20 secure :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c005c10 tx=0x7f6a3c00d830 comp rx=0 tx=0).stop 2024-03-23T23:43:23.692 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:43:23.692 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:43:23.692 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:43:23.692 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:43:23.692 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 4, 2024-03-23T23:43:23.692 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:43:23.693 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:43:23.693 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:43:23.693 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:43:23.693 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:43:23.693 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 68, 2024-03-23T23:43:23.693 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:43:23.693 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:43:23.693 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:43:23.693 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:43:23.693 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:43:23.693 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:43:23.693 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:43:23.694 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:43:23.694 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:43:23.694 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:43:23.694 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:43:23.694 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:43:23.694 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:43:23.694 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:43:23.694 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:43:23.694 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:43:23.695 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:43:23.695 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:43:23.695 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:43:23.695 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:43:23.695 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:43:23.695 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:43:23.695 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:43:23.695 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:43:23.695 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:43:23.695 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:43:23.696 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:43:23.696 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:43:23.696 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:43:23.696 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:23.696 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:43:23.696 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:43:23.696 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:43:23.696 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:43:23.696 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:43:23.696 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:43:23.697 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:43:23.697 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:43:23.697 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:43:23.697 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:43:23.697 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:43:23.697 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:43:23.697 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:43:23.697 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:43:23.697 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:43:23.697 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:43:23.698 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:43:23.698 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:43:23.698 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:43:23.698 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:43:23.698 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:43:23.698 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:43:23.698 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:43:23.698 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:43:23.698 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:43:23.698 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:43:23.698 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:43:23.699 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:43:23.699 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:43:23.699 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:43:23.699 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:23.699 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:43:23.699 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:23.699 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:43:23.699 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:43:23.699 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:43:23.699 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:43:23.700 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:23.700 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:43:23.700 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:43:23.700 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:43:23.700 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:23.700 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:23.700 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:43:23.700 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:43:23.700 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:43:23.700 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:23.700 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:43:23.701 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:23.701 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:43:23.701 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:43:23.701 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:43:23.701 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:43:23.701 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:43:23.701 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:23.701 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:23.701 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:43:23.702 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:43:23.702 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:43:23.702 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:43:23.702 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:23.702 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:43:23.702 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:43:23.702 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:43:23.702 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:23.702 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:23.702 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:43:23.702 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:43:23.703 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:43:23.703 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:23.703 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:43:23.703 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:23.703 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:43:23.703 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:43:23.703 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:43:23.703 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:43:23.703 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:43:23.703 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:23.704 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:23.704 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:43:23.704 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:43:23.704 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:43:23.704 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:43:23.704 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:23.704 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:43:23.704 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:43:23.704 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:43:23.704 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:23.704 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:23.705 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:43:23.705 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:43:23.705 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:43:23.705 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:23.705 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:43:23.705 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:23.705 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:43:23.705 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:43:23.705 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:43:23.705 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:43:23.705 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:43:23.706 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:23.706 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:43:23.706 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:23.706 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:43:23.706 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:43:23.706 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:23.706 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:43:23.706 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:43:23.706 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:43:23.707 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:23.707 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:43:23.707 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:43:23.707 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:23.707 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:43:23.707 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:43:23.707 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:43:23.707 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:23.707 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:43:23.707 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:43:23.708 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:23.708 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:43:23.708 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:43:23.708 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:43:23.708 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:23.708 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:43:23.708 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:43:23.708 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:23.708 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:43:23.708 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:43:23.708 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:43:23.709 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:23.709 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:23.709 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:43:23.709 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:43:23.709 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:43:23.709 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:23.709 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:43:23.709 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:43:23.709 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:23.709 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:43:23.709 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:43:23.710 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:43:23.710 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:23.710 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:43:23.710 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:23.710 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:43:23.710 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:43:23.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.688+0000 7f6a48c00640 1 -- 172.21.15.8:0/1235256087 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6a200670d0 msgr2=0x7f6a20069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:23.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.688+0000 7f6a48c00640 1 --2- 172.21.15.8:0/1235256087 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6a200670d0 0x7f6a20069590 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6a3400f6b0 tx=0x7f6a34008070 comp rx=0 tx=0).stop 2024-03-23T23:43:23.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.688+0000 7f6a48c00640 1 -- 172.21.15.8:0/1235256087 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6a440c5560 msgr2=0x7f6a440acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:23.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.688+0000 7f6a48c00640 1 --2- 172.21.15.8:0/1235256087 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6a440c5560 0x7f6a440acd40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c0ab000 tx=0x7f6a2c019240 comp rx=0 tx=0).stop 2024-03-23T23:43:23.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.688+0000 7f6a42800640 1 -- 172.21.15.8:0/1235256087 reap_dead start 2024-03-23T23:43:23.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.688+0000 7f6a42800640 1 -- 172.21.15.8:0/1235256087 reap_dead start 2024-03-23T23:43:23.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.688+0000 7f6a48c00640 1 -- 172.21.15.8:0/1235256087 shutdown_connections 2024-03-23T23:43:23.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.688+0000 7f6a48c00640 1 -- 172.21.15.8:0/1235256087 >> 172.21.15.8:0/1235256087 conn(0x7f6a440aafe0 msgr2=0x7f6a440c6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:23.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.688+0000 7f6a48c00640 1 -- 172.21.15.8:0/1235256087 shutdown_connections 2024-03-23T23:43:23.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.688+0000 7f6a48c00640 1 -- 172.21.15.8:0/1235256087 wait complete. 2024-03-23T23:43:23.713 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:43:23.713 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T23:43:23.713 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:43:23.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.852+0000 7fcf54c00640 1 Processor -- start 2024-03-23T23:43:23.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.852+0000 7fcf54c00640 1 -- start start 2024-03-23T23:43:23.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.856+0000 7fcf54c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf500c8a50 0x7fcf500c2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:23.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.856+0000 7fcf54c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fcf5006d6e0 0x7fcf50155a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:23.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.856+0000 7fcf54c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fcf500c2ba0 0x7fcf50155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:23.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.856+0000 7fcf54c00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf500c4740 con 0x7fcf5006d6e0 2024-03-23T23:43:23.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.856+0000 7fcf54c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf500c4340 con 0x7fcf500c2ba0 2024-03-23T23:43:23.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.856+0000 7fcf54c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf500c4060 con 0x7fcf500c8a50 2024-03-23T23:43:23.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.856+0000 7fcf45400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fcf5006d6e0 0x7fcf50155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:23.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.856+0000 7fcf4de00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf500c8a50 0x7fcf500c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:23.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.856+0000 7fcf45400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fcf5006d6e0 0x7fcf50155a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48396/0 (socket says 172.21.15.8:48396) 2024-03-23T23:43:23.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.856+0000 7fcf45400640 1 -- 172.21.15.8:0/1291858343 learned_addr learned my addr 172.21.15.8:0/1291858343 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:23.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.856+0000 7fcf4e800640 1 --2- 172.21.15.8:0/1291858343 >> v2:172.21.15.196:3300/0 conn(0x7fcf500c2ba0 0x7fcf50155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:23.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.856+0000 7fcf45400640 1 -- 172.21.15.8:0/1291858343 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf500c8a50 msgr2=0x7fcf500c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:23.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.856+0000 7fcf45400640 1 --2- 172.21.15.8:0/1291858343 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf500c8a50 0x7fcf500c2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:23.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.856+0000 7fcf45400640 1 -- 172.21.15.8:0/1291858343 >> v2:172.21.15.196:3300/0 conn(0x7fcf500c2ba0 msgr2=0x7fcf50155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:23.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.856+0000 7fcf45400640 1 --2- 172.21.15.8:0/1291858343 >> v2:172.21.15.196:3300/0 conn(0x7fcf500c2ba0 0x7fcf50155fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:23.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.856+0000 7fcf45400640 1 -- 172.21.15.8:0/1291858343 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf500c3570 con 0x7fcf5006d6e0 2024-03-23T23:43:23.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.856+0000 7fcf4de00640 1 --2- 172.21.15.8:0/1291858343 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf500c8a50 0x7fcf500c2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:43:23.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.856+0000 7fcf4e800640 1 --2- 172.21.15.8:0/1291858343 >> v2:172.21.15.196:3300/0 conn(0x7fcf500c2ba0 0x7fcf50155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:43:23.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.860+0000 7fcf45400640 1 --2- 172.21.15.8:0/1291858343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf5006d6e0 0x7fcf50155a60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcf500a8f20 tx=0x7fcf3801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a7a6568494833b5 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:23.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.860+0000 7fcf4d400640 1 -- 172.21.15.8:0/1291858343 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf380ab620 con 0x7fcf5006d6e0 2024-03-23T23:43:23.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.860+0000 7fcf4d400640 1 -- 172.21.15.8:0/1291858343 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf380b0070 con 0x7fcf5006d6e0 2024-03-23T23:43:23.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.860+0000 7fcf4d400640 1 -- 172.21.15.8:0/1291858343 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf380ab9e0 con 0x7fcf5006d6e0 2024-03-23T23:43:23.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.860+0000 7fcf54c00640 1 -- 172.21.15.8:0/1291858343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf5006d6e0 msgr2=0x7fcf50155a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:23.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.860+0000 7fcf54c00640 1 --2- 172.21.15.8:0/1291858343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf5006d6e0 0x7fcf50155a60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcf500a8f20 tx=0x7fcf3801c460 comp rx=0 tx=0).stop 2024-03-23T23:43:23.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.860+0000 7fcf54c00640 1 -- 172.21.15.8:0/1291858343 shutdown_connections 2024-03-23T23:43:23.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.860+0000 7fcf54c00640 1 --2- 172.21.15.8:0/1291858343 >> v2:172.21.15.196:3300/0 conn(0x7fcf500c2ba0 0x7fcf50155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:23.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.860+0000 7fcf54c00640 1 --2- 172.21.15.8:0/1291858343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf5006d6e0 0x7fcf50155a60 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:23.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.860+0000 7fcf54c00640 1 --2- 172.21.15.8:0/1291858343 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf500c8a50 0x7fcf500c2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:23.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.860+0000 7fcf54c00640 1 -- 172.21.15.8:0/1291858343 >> 172.21.15.8:0/1291858343 conn(0x7fcf500aafe0 msgr2=0x7fcf500ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:23.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.860+0000 7fcf54c00640 1 -- 172.21.15.8:0/1291858343 shutdown_connections 2024-03-23T23:43:23.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.860+0000 7fcf54c00640 1 -- 172.21.15.8:0/1291858343 wait complete. 2024-03-23T23:43:23.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.864+0000 7fcf54c00640 1 Processor -- start 2024-03-23T23:43:23.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.864+0000 7fcf54c00640 1 -- start start 2024-03-23T23:43:23.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.864+0000 7fcf54c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf500c2ba0 0x7fcf50152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:23.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.864+0000 7fcf54c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf500c8a50 0x7fcf501f1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:23.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.864+0000 7fcf54c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf5015efc0 0x7fcf501f1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:23.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.864+0000 7fcf54c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5006e360 con 0x7fcf500c2ba0 2024-03-23T23:43:23.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.864+0000 7fcf54c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5006e1e0 con 0x7fcf500c8a50 2024-03-23T23:43:23.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.864+0000 7fcf54c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf500c3c30 con 0x7fcf5015efc0 2024-03-23T23:43:23.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.864+0000 7fcf4de00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf500c2ba0 0x7fcf50152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:23.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.864+0000 7fcf4de00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf500c2ba0 0x7fcf50152770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48406/0 (socket says 172.21.15.8:48406) 2024-03-23T23:43:23.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.864+0000 7fcf4de00640 1 -- 172.21.15.8:0/2059919610 learned_addr learned my addr 172.21.15.8:0/2059919610 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:23.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.864+0000 7fcf45400640 1 --2- 172.21.15.8:0/2059919610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf500c8a50 0x7fcf501f1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:23.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.864+0000 7fcf4e800640 1 --2- 172.21.15.8:0/2059919610 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf5015efc0 0x7fcf501f1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:23.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.868+0000 7fcf4de00640 1 -- 172.21.15.8:0/2059919610 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf5015efc0 msgr2=0x7fcf501f1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:23.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.868+0000 7fcf4de00640 1 --2- 172.21.15.8:0/2059919610 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf5015efc0 0x7fcf501f1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:23.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.868+0000 7fcf4de00640 1 -- 172.21.15.8:0/2059919610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf500c8a50 msgr2=0x7fcf501f1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:23.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.868+0000 7fcf4de00640 1 --2- 172.21.15.8:0/2059919610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf500c8a50 0x7fcf501f1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:23.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.868+0000 7fcf4de00640 1 -- 172.21.15.8:0/2059919610 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5015e100 con 0x7fcf500c2ba0 2024-03-23T23:43:23.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.868+0000 7fcf4de00640 1 --2- 172.21.15.8:0/2059919610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf500c2ba0 0x7fcf50152770 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcf4000e980 tx=0x7fcf4000ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:23.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.868+0000 7fcf46a00640 1 -- 172.21.15.8:0/2059919610 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf40017070 con 0x7fcf500c2ba0 2024-03-23T23:43:23.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.868+0000 7fcf46a00640 1 -- 172.21.15.8:0/2059919610 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4000c940 con 0x7fcf500c2ba0 2024-03-23T23:43:23.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.868+0000 7fcf54c00640 1 -- 172.21.15.8:0/2059919610 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf501f14e0 con 0x7fcf500c2ba0 2024-03-23T23:43:23.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.868+0000 7fcf46a00640 1 -- 172.21.15.8:0/2059919610 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4000cd10 con 0x7fcf500c2ba0 2024-03-23T23:43:23.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.868+0000 7fcf54c00640 1 -- 172.21.15.8:0/2059919610 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf501516e0 con 0x7fcf500c2ba0 2024-03-23T23:43:23.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.868+0000 7fcf54c00640 1 --2- 172.21.15.8:0/2059919610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf5006d6e0 0x7fcf5015a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:23.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.868+0000 7fcf54c00640 1 -- 172.21.15.8:0/2059919610 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5015a8d0 con 0x7fcf5006d6e0 2024-03-23T23:43:23.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.868+0000 7fcf45400640 1 --2- 172.21.15.8:0/2059919610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf5006d6e0 0x7fcf5015a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:23.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.868+0000 7fcf45400640 1 -- 172.21.15.8:0/2059919610 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcf50068270 con 0x7fcf5006d6e0 2024-03-23T23:43:23.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.868+0000 7fcf45400640 1 --2- 172.21.15.8:0/2059919610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf5006d6e0 0x7fcf5015a390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcf50071cc0 tx=0x7fcf38019200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:23.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.868+0000 7fcf46a00640 1 -- 172.21.15.8:0/2059919610 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fcf4001a070 con 0x7fcf500c2ba0 2024-03-23T23:43:23.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.868+0000 7fcf46a00640 1 --2- 172.21.15.8:0/2059919610 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcf2c067660 0x7fcf2c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:23.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.868+0000 7fcf46a00640 1 -- 172.21.15.8:0/2059919610 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fcf400859c0 con 0x7fcf500c2ba0 2024-03-23T23:43:23.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.872+0000 7fcf46a00640 1 -- 172.21.15.8:0/2059919610 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf380abae0 con 0x7fcf5006d6e0 2024-03-23T23:43:23.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.872+0000 7fcf4e800640 1 --2- 172.21.15.8:0/2059919610 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcf2c067660 0x7fcf2c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:23.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.872+0000 7fcf46a00640 1 -- 172.21.15.8:0/2059919610 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fcf380b0040 con 0x7fcf5006d6e0 2024-03-23T23:43:23.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.872+0000 7fcf46a00640 1 -- 172.21.15.8:0/2059919610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf5006d6e0 msgr2=0x7fcf5015a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:23.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.872+0000 7fcf46a00640 1 --2- 172.21.15.8:0/2059919610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf5006d6e0 0x7fcf5015a390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcf50071cc0 tx=0x7fcf38019200 comp rx=0 tx=0).stop 2024-03-23T23:43:23.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.872+0000 7fcf46a00640 1 -- 172.21.15.8:0/2059919610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf5006d6e0 msgr2=0x7fcf5015a390 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:43:23.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.872+0000 7fcf46a00640 1 --2- 172.21.15.8:0/2059919610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf5006d6e0 0x7fcf5015a390 secure :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcf50071cc0 tx=0x7fcf38019200 comp rx=0 tx=0).stop 2024-03-23T23:43:23.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.872+0000 7fcf4e800640 1 --2- 172.21.15.8:0/2059919610 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcf2c067660 0x7fcf2c069b20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcf480112c0 tx=0x7fcf4800d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:23.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.876+0000 7fcf54c00640 1 --2- 172.21.15.8:0/2059919610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf501503c0 0x7fcf501507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:23.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.876+0000 7fcf54c00640 1 -- 172.21.15.8:0/2059919610 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf500c32b0 con 0x7fcf501503c0 2024-03-23T23:43:23.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.876+0000 7fcf45400640 1 --2- 172.21.15.8:0/2059919610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf501503c0 0x7fcf501507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:23.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.876+0000 7fcf45400640 1 -- 172.21.15.8:0/2059919610 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fcf50152cb0 con 0x7fcf501503c0 2024-03-23T23:43:23.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.876+0000 7fcf45400640 1 --2- 172.21.15.8:0/2059919610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf501503c0 0x7fcf501507a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcf3801ab10 tx=0x7fcf38009240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:23.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.876+0000 7fcf46a00640 1 -- 172.21.15.8:0/2059919610 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf380c9070 con 0x7fcf501503c0 2024-03-23T23:43:23.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.876+0000 7fcf46a00640 1 -- 172.21.15.8:0/2059919610 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5012 (secure 0 0 0) 0x7fcf380c5670 con 0x7fcf501503c0 2024-03-23T23:43:23.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.876+0000 7fcf46a00640 1 -- 172.21.15.8:0/2059919610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf501503c0 msgr2=0x7fcf501507a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:23.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.876+0000 7fcf46a00640 1 --2- 172.21.15.8:0/2059919610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf501503c0 0x7fcf501507a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcf3801ab10 tx=0x7fcf38009240 comp rx=0 tx=0).stop 2024-03-23T23:43:23.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.876+0000 7fcf46a00640 1 -- 172.21.15.8:0/2059919610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf501503c0 msgr2=0x7fcf501507a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:43:23.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.876+0000 7fcf46a00640 1 --2- 172.21.15.8:0/2059919610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf501503c0 0x7fcf501507a0 secure :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcf3801ab10 tx=0x7fcf38009240 comp rx=0 tx=0).stop 2024-03-23T23:43:23.881 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:43:23.881 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:43:23.881 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:43:23.881 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:43:23.881 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 4, 2024-03-23T23:43:23.881 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:43:23.881 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:43:23.881 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:43:23.881 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:43:23.882 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:43:23.882 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 68, 2024-03-23T23:43:23.882 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:43:23.882 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:43:23.882 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:43:23.882 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:43:23.882 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:43:23.882 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:43:23.882 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:43:23.882 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:43:23.882 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:43:23.882 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:43:23.883 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:43:23.883 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:43:23.883 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:43:23.883 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:43:23.883 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:43:23.883 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:43:23.883 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:43:23.883 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:43:23.883 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:43:23.883 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:43:23.884 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:43:23.884 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:43:23.884 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:43:23.884 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:43:23.884 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:43:23.884 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:43:23.884 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:43:23.884 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:43:23.884 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:43:23.884 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:23.884 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:43:23.884 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:43:23.884 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:43:23.885 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:43:23.885 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:43:23.885 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:43:23.885 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:43:23.885 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:43:23.885 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:43:23.885 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:43:23.885 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:43:23.885 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:43:23.885 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:43:23.885 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:43:23.885 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:43:23.885 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:43:23.885 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:43:23.886 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:43:23.886 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:43:23.886 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:43:23.886 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:43:23.886 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:43:23.886 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:43:23.886 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:43:23.886 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:43:23.886 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:43:23.886 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:43:23.886 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:43:23.886 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:43:23.886 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:43:23.886 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:23.887 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:43:23.887 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:23.887 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:43:23.887 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:43:23.887 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:43:23.887 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:43:23.887 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:23.887 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:43:23.887 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:43:23.887 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:43:23.887 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:23.887 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:23.887 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:43:23.887 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:43:23.888 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:43:23.888 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:23.888 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:43:23.888 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:23.888 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:43:23.888 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:43:23.888 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:43:23.888 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:43:23.888 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:43:23.888 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:23.888 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:23.888 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:43:23.888 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:43:23.889 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:43:23.889 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:43:23.889 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:23.889 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:43:23.889 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:43:23.889 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:43:23.889 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:23.889 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:23.889 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:43:23.889 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:43:23.889 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:43:23.889 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:23.889 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:43:23.889 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:23.890 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:43:23.890 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:43:23.890 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:43:23.890 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:43:23.890 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:43:23.890 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:23.890 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:23.890 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:43:23.890 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:43:23.890 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:43:23.890 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:43:23.890 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:23.890 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:43:23.891 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:43:23.891 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:43:23.891 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:23.891 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:23.891 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:43:23.891 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:43:23.891 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:43:23.891 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:23.891 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:43:23.892 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:23.892 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:43:23.892 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:43:23.892 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:43:23.892 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:43:23.892 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:43:23.892 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:23.892 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:43:23.892 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:23.892 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:43:23.892 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:43:23.892 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:23.892 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:43:23.893 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:43:23.893 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:43:23.893 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:23.893 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:43:23.893 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:43:23.893 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:23.893 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:43:23.893 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:43:23.893 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:43:23.893 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:23.893 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:43:23.893 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:43:23.893 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:23.893 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:43:23.894 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:43:23.894 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:43:23.894 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:23.894 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:43:23.894 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:43:23.894 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:23.894 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:43:23.894 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:43:23.894 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:43:23.894 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:23.894 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:23.894 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:43:23.894 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:43:23.894 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:43:23.895 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:23.895 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:43:23.895 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:23.895 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:43:23.895 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:43:23.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.880+0000 7fcf54c00640 1 -- 172.21.15.8:0/2059919610 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcf2c067660 msgr2=0x7fcf2c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:23.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.880+0000 7fcf54c00640 1 --2- 172.21.15.8:0/2059919610 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcf2c067660 0x7fcf2c069b20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcf480112c0 tx=0x7fcf4800d040 comp rx=0 tx=0).stop 2024-03-23T23:43:23.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.880+0000 7fcf54c00640 1 -- 172.21.15.8:0/2059919610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf500c2ba0 msgr2=0x7fcf50152770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:23.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.880+0000 7fcf54c00640 1 --2- 172.21.15.8:0/2059919610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf500c2ba0 0x7fcf50152770 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcf4000e980 tx=0x7fcf4000ed80 comp rx=0 tx=0).stop 2024-03-23T23:43:23.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.880+0000 7fcf4e800640 1 -- 172.21.15.8:0/2059919610 reap_dead start 2024-03-23T23:43:23.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.880+0000 7fcf4e800640 1 -- 172.21.15.8:0/2059919610 reap_dead start 2024-03-23T23:43:23.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.880+0000 7fcf54c00640 1 -- 172.21.15.8:0/2059919610 shutdown_connections 2024-03-23T23:43:23.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.880+0000 7fcf54c00640 1 -- 172.21.15.8:0/2059919610 >> 172.21.15.8:0/2059919610 conn(0x7fcf500aafe0 msgr2=0x7fcf5006fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:23.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.880+0000 7fcf54c00640 1 -- 172.21.15.8:0/2059919610 shutdown_connections 2024-03-23T23:43:23.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:23.880+0000 7fcf54c00640 1 -- 172.21.15.8:0/2059919610 wait complete. 2024-03-23T23:43:23.900 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:43:23.900 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T23:43:23.900 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:43:24.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.040+0000 7fe4b9a00640 1 Processor -- start 2024-03-23T23:43:24.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.040+0000 7fe4b9a00640 1 -- start start 2024-03-23T23:43:24.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.040+0000 7fe4b9a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe4b414fec0 0x7fe4b40c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:24.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.040+0000 7fe4b9a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe4b40aab30 0x7fe4b4152610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:24.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.040+0000 7fe4b9a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4b41502a0 con 0x7fe4b40c7a30 2024-03-23T23:43:24.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.040+0000 7fe4b9a00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b40c2970 con 0x7fe4b414fec0 2024-03-23T23:43:24.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.040+0000 7fe4b9a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b40c8420 con 0x7fe4b40aab30 2024-03-23T23:43:24.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.040+0000 7fe4b2a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe4b414fec0 0x7fe4b40c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:24.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.040+0000 7fe4b2a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe4b414fec0 0x7fe4b40c74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48410/0 (socket says 172.21.15.8:48410) 2024-03-23T23:43:24.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.040+0000 7fe4b2000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe4b40aab30 0x7fe4b4152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:24.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.040+0000 7fe4b2a00640 1 -- 172.21.15.8:0/2563275841 learned_addr learned my addr 172.21.15.8:0/2563275841 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:24.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.040+0000 7fe4b2a00640 1 -- 172.21.15.8:0/2563275841 >> v2:172.21.15.196:3300/0 conn(0x7fe4b40aab30 msgr2=0x7fe4b4152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:24.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.040+0000 7fe4b2a00640 1 --2- 172.21.15.8:0/2563275841 >> v2:172.21.15.196:3300/0 conn(0x7fe4b40aab30 0x7fe4b4152610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:24.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.040+0000 7fe4b2a00640 1 -- 172.21.15.8:0/2563275841 >> v1:172.21.15.196:6789/0 conn(0x7fe4b40c7a30 legacy=0x7fe4b40c3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:24.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.040+0000 7fe4b2a00640 1 -- 172.21.15.8:0/2563275841 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b40c3990 con 0x7fe4b414fec0 2024-03-23T23:43:24.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.040+0000 7fe4b2000640 1 --2- 172.21.15.8:0/2563275841 >> v2:172.21.15.196:3300/0 conn(0x7fe4b40aab30 0x7fe4b4152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:43:24.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.044+0000 7fe4b2a00640 1 --2- 172.21.15.8:0/2563275841 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4b414fec0 0x7fe4b40c74f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4009870 tx=0x7fe4a401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93fe7094fb2b2d6b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:24.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.044+0000 7fe4b1600640 1 -- 172.21.15.8:0/2563275841 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a40b2070 con 0x7fe4b414fec0 2024-03-23T23:43:24.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.044+0000 7fe4b1600640 1 -- 172.21.15.8:0/2563275841 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a40ad680 con 0x7fe4b414fec0 2024-03-23T23:43:24.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.044+0000 7fe4b1600640 1 -- 172.21.15.8:0/2563275841 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a40ada50 con 0x7fe4b414fec0 2024-03-23T23:43:24.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.044+0000 7fe4b9a00640 1 -- 172.21.15.8:0/2563275841 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4b414fec0 msgr2=0x7fe4b40c74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:24.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.044+0000 7fe4b9a00640 1 --2- 172.21.15.8:0/2563275841 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4b414fec0 0x7fe4b40c74f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4009870 tx=0x7fe4a401c490 comp rx=0 tx=0).stop 2024-03-23T23:43:24.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.044+0000 7fe4b9a00640 1 -- 172.21.15.8:0/2563275841 shutdown_connections 2024-03-23T23:43:24.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.044+0000 7fe4b9a00640 1 --2- 172.21.15.8:0/2563275841 >> v2:172.21.15.196:3300/0 conn(0x7fe4b40aab30 0x7fe4b4152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:24.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.044+0000 7fe4b9a00640 1 --2- 172.21.15.8:0/2563275841 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4b414fec0 0x7fe4b40c74f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:24.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.044+0000 7fe4b9a00640 1 -- 172.21.15.8:0/2563275841 >> 172.21.15.8:0/2563275841 conn(0x7fe4b406da60 msgr2=0x7fe4b40a9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:24.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.044+0000 7fe4b9a00640 1 -- 172.21.15.8:0/2563275841 shutdown_connections 2024-03-23T23:43:24.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.044+0000 7fe4b9a00640 1 -- 172.21.15.8:0/2563275841 wait complete. 2024-03-23T23:43:24.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.044+0000 7fe4b9a00640 1 Processor -- start 2024-03-23T23:43:24.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.048+0000 7fe4b9a00640 1 -- start start 2024-03-23T23:43:24.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.048+0000 7fe4b9a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe4b40aab30 0x7fe4b4071350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:24.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.048+0000 7fe4b9a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4b40c7a30 0x7fe4b413f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:24.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.048+0000 7fe4b9a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4b414fec0 0x7fe4b413fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:24.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.048+0000 7fe4b9a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b4152cd0 con 0x7fe4b414fec0 2024-03-23T23:43:24.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.048+0000 7fe4b9a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b4152b50 con 0x7fe4b40aab30 2024-03-23T23:43:24.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.048+0000 7fe4b9a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b4152e50 con 0x7fe4b40c7a30 2024-03-23T23:43:24.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.048+0000 7fe4b2a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe4b40aab30 0x7fe4b4071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:24.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.048+0000 7fe4b3400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4b414fec0 0x7fe4b413fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:24.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.048+0000 7fe4b2a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe4b40aab30 0x7fe4b4071350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:36254/0 (socket says 172.21.15.8:36254) 2024-03-23T23:43:24.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.048+0000 7fe4b2a00640 1 -- 172.21.15.8:0/2485704898 learned_addr learned my addr 172.21.15.8:0/2485704898 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:24.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.048+0000 7fe4b2000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4b40c7a30 0x7fe4b413f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:24.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.048+0000 7fe4b2a00640 1 -- 172.21.15.8:0/2485704898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4b40c7a30 msgr2=0x7fe4b413f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:24.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.048+0000 7fe4b2a00640 1 --2- 172.21.15.8:0/2485704898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4b40c7a30 0x7fe4b413f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:24.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.048+0000 7fe4b2a00640 1 -- 172.21.15.8:0/2485704898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4b414fec0 msgr2=0x7fe4b413fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:24.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.048+0000 7fe4b2a00640 1 --2- 172.21.15.8:0/2485704898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4b414fec0 0x7fe4b413fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:24.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.048+0000 7fe4b2a00640 1 -- 172.21.15.8:0/2485704898 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b41ef550 con 0x7fe4b40aab30 2024-03-23T23:43:24.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.048+0000 7fe4b3400640 1 --2- 172.21.15.8:0/2485704898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4b414fec0 0x7fe4b413fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:43:24.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.048+0000 7fe4b2a00640 1 --2- 172.21.15.8:0/2485704898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe4b40aab30 0x7fe4b4071350 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe4a40190a0 tx=0x7fe4a401acd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:24.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.048+0000 7fe4aaa00640 1 -- 172.21.15.8:0/2485704898 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a40bc020 con 0x7fe4b40aab30 2024-03-23T23:43:24.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.048+0000 7fe4aaa00640 1 -- 172.21.15.8:0/2485704898 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a40adbf0 con 0x7fe4b40aab30 2024-03-23T23:43:24.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.048+0000 7fe4b9a00640 1 -- 172.21.15.8:0/2485704898 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b414ad30 con 0x7fe4b40aab30 2024-03-23T23:43:24.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.048+0000 7fe4aaa00640 1 -- 172.21.15.8:0/2485704898 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a40b2040 con 0x7fe4b40aab30 2024-03-23T23:43:24.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.048+0000 7fe4b9a00640 1 -- 172.21.15.8:0/2485704898 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b414aa40 con 0x7fe4b40aab30 2024-03-23T23:43:24.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.048+0000 7fe4b9a00640 1 --2- 172.21.15.8:0/2485704898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4b414c800 0x7fe4b4149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:24.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.048+0000 7fe4b9a00640 1 -- 172.21.15.8:0/2485704898 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b41efb60 con 0x7fe4b414c800 2024-03-23T23:43:24.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.048+0000 7fe4b2000640 1 --2- 172.21.15.8:0/2485704898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4b414c800 0x7fe4b4149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:24.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.052+0000 7fe4b2000640 1 -- 172.21.15.8:0/2485704898 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe4b4068980 con 0x7fe4b414c800 2024-03-23T23:43:24.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.052+0000 7fe4b2000640 1 --2- 172.21.15.8:0/2485704898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4b414c800 0x7fe4b4149cb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe4b41610f0 tx=0x7fe4a0011d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:24.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.052+0000 7fe4aaa00640 1 -- 172.21.15.8:0/2485704898 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fe4a40bf020 con 0x7fe4b40aab30 2024-03-23T23:43:24.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.052+0000 7fe4aaa00640 1 --2- 172.21.15.8:0/2485704898 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe494067660 0x7fe494069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:24.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.052+0000 7fe4aaa00640 1 -- 172.21.15.8:0/2485704898 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fe4a411fb30 con 0x7fe4b40aab30 2024-03-23T23:43:24.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.052+0000 7fe4b3400640 1 --2- 172.21.15.8:0/2485704898 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe494067660 0x7fe494069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:24.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.052+0000 7fe4aaa00640 1 -- 172.21.15.8:0/2485704898 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a000fa40 con 0x7fe4b414c800 2024-03-23T23:43:24.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.052+0000 7fe4aaa00640 1 -- 172.21.15.8:0/2485704898 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fe4a000fbe0 con 0x7fe4b414c800 2024-03-23T23:43:24.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.052+0000 7fe4aaa00640 1 -- 172.21.15.8:0/2485704898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4b414c800 msgr2=0x7fe4b4149cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:24.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.052+0000 7fe4aaa00640 1 --2- 172.21.15.8:0/2485704898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4b414c800 0x7fe4b4149cb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe4b41610f0 tx=0x7fe4a0011d60 comp rx=0 tx=0).stop 2024-03-23T23:43:24.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.052+0000 7fe4aaa00640 1 -- 172.21.15.8:0/2485704898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4b414c800 msgr2=0x7fe4b4149cb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:43:24.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.052+0000 7fe4aaa00640 1 --2- 172.21.15.8:0/2485704898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4b414c800 0x7fe4b4149cb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:24.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.052+0000 7fe4b3400640 1 --2- 172.21.15.8:0/2485704898 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe494067660 0x7fe494069b20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac0012f0 tx=0x7fe4ac009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:24.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.064+0000 7fe4b9a00640 1 --2- 172.21.15.8:0/2485704898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4b4071890 0x7fe4b414a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:24.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.064+0000 7fe4b9a00640 1 -- 172.21.15.8:0/2485704898 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b4149930 con 0x7fe4b4071890 2024-03-23T23:43:24.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.064+0000 7fe4b2000640 1 --2- 172.21.15.8:0/2485704898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4b4071890 0x7fe4b414a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:24.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.064+0000 7fe4b2000640 1 -- 172.21.15.8:0/2485704898 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe4b4152790 con 0x7fe4b4071890 2024-03-23T23:43:24.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.068+0000 7fe4b2000640 1 --2- 172.21.15.8:0/2485704898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4b4071890 0x7fe4b414a1f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0012010 tx=0x7fe4a00046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:24.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.068+0000 7fe4aaa00640 1 -- 172.21.15.8:0/2485704898 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a00222e0 con 0x7fe4b4071890 2024-03-23T23:43:24.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.068+0000 7fe4aaa00640 1 -- 172.21.15.8:0/2485704898 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4869 (secure 0 0 0) 0x7fe4a002c400 con 0x7fe4b4071890 2024-03-23T23:43:24.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.068+0000 7fe4aaa00640 1 -- 172.21.15.8:0/2485704898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4b4071890 msgr2=0x7fe4b414a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:24.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.068+0000 7fe4aaa00640 1 --2- 172.21.15.8:0/2485704898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4b4071890 0x7fe4b414a1f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0012010 tx=0x7fe4a00046d0 comp rx=0 tx=0).stop 2024-03-23T23:43:24.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.068+0000 7fe4aaa00640 1 -- 172.21.15.8:0/2485704898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4b4071890 msgr2=0x7fe4b414a1f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:43:24.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.068+0000 7fe4aaa00640 1 --2- 172.21.15.8:0/2485704898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4b4071890 0x7fe4b414a1f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:24.070 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:43:24.070 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:43:24.070 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:43:24.070 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:43:24.070 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 4, 2024-03-23T23:43:24.070 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:43:24.071 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:43:24.071 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:43:24.071 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:43:24.071 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:43:24.071 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 68, 2024-03-23T23:43:24.071 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:43:24.071 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:43:24.071 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:43:24.071 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:43:24.071 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:43:24.071 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:43:24.071 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:43:24.071 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:43:24.072 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:43:24.072 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:43:24.072 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:43:24.072 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:43:24.072 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:43:24.072 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:43:24.072 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:43:24.072 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:43:24.072 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:43:24.072 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:43:24.072 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:43:24.072 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:43:24.073 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:43:24.073 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:43:24.073 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:43:24.073 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:43:24.073 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:43:24.073 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:43:24.073 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:43:24.073 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:43:24.073 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:43:24.073 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:24.074 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:43:24.074 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:43:24.074 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:43:24.074 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:43:24.074 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:43:24.074 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:43:24.074 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:43:24.074 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:43:24.074 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:43:24.074 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:43:24.075 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:43:24.075 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:43:24.075 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:43:24.075 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:43:24.075 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:43:24.075 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:43:24.075 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:43:24.075 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:43:24.075 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:43:24.075 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:43:24.075 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:43:24.076 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:43:24.076 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:43:24.076 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:43:24.076 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:43:24.076 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:43:24.076 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:43:24.076 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:43:24.076 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:43:24.076 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:43:24.076 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:24.077 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:43:24.077 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:24.077 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:43:24.077 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:43:24.077 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:43:24.077 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:43:24.077 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:24.077 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:43:24.077 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:43:24.077 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:43:24.078 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:24.078 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:24.078 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:43:24.078 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:43:24.078 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:43:24.078 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:24.078 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:43:24.078 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:24.078 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:43:24.078 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:43:24.078 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:43:24.079 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:43:24.079 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:43:24.079 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:24.079 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:24.079 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:43:24.079 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:43:24.079 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:43:24.079 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:43:24.080 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:24.080 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:43:24.080 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:43:24.080 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:43:24.080 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:24.080 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:24.080 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:43:24.080 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:43:24.080 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:43:24.081 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:24.081 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:43:24.081 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:24.081 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:43:24.081 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:43:24.081 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:43:24.081 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:43:24.081 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:43:24.081 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:24.081 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:24.082 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:43:24.082 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:43:24.082 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:43:24.082 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:43:24.082 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:24.082 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:43:24.082 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:43:24.082 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:43:24.082 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:24.082 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:24.082 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:43:24.083 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:43:24.083 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:43:24.083 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:24.083 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:43:24.083 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:24.083 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:43:24.083 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:43:24.083 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:43:24.084 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:43:24.084 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:43:24.084 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:24.084 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:43:24.084 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:24.084 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:43:24.084 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:43:24.084 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:24.084 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:43:24.084 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:43:24.084 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:43:24.085 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:24.085 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:43:24.085 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:43:24.085 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:24.085 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:43:24.085 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:43:24.085 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:43:24.085 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:24.085 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:43:24.085 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:43:24.085 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:24.085 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:43:24.085 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:43:24.086 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:43:24.086 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:24.086 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:43:24.086 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:43:24.086 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:24.086 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:43:24.086 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:43:24.086 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:43:24.086 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:24.086 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:43:24.086 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:24.086 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:43:24.086 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:43:24.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.068+0000 7fe4b9a00640 1 -- 172.21.15.8:0/2485704898 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe494067660 msgr2=0x7fe494069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:24.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.068+0000 7fe4b9a00640 1 --2- 172.21.15.8:0/2485704898 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe494067660 0x7fe494069b20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac0012f0 tx=0x7fe4ac009040 comp rx=0 tx=0).stop 2024-03-23T23:43:24.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.068+0000 7fe4b9a00640 1 -- 172.21.15.8:0/2485704898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe4b40aab30 msgr2=0x7fe4b4071350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:24.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.068+0000 7fe4b9a00640 1 --2- 172.21.15.8:0/2485704898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe4b40aab30 0x7fe4b4071350 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe4a40190a0 tx=0x7fe4a401acd0 comp rx=0 tx=0).stop 2024-03-23T23:43:24.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.068+0000 7fe4b3400640 1 -- 172.21.15.8:0/2485704898 reap_dead start 2024-03-23T23:43:24.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.068+0000 7fe4b3400640 1 -- 172.21.15.8:0/2485704898 reap_dead start 2024-03-23T23:43:24.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.068+0000 7fe4b9a00640 1 -- 172.21.15.8:0/2485704898 shutdown_connections 2024-03-23T23:43:24.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.068+0000 7fe4b9a00640 1 -- 172.21.15.8:0/2485704898 >> 172.21.15.8:0/2485704898 conn(0x7fe4b406da60 msgr2=0x7fe4b40a9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:24.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.068+0000 7fe4b9a00640 1 -- 172.21.15.8:0/2485704898 shutdown_connections 2024-03-23T23:43:24.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.068+0000 7fe4b9a00640 1 -- 172.21.15.8:0/2485704898 wait complete. 2024-03-23T23:43:24.089 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:43:24.090 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-03-23T23:43:24.090 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-03-23T23:43:24.090 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-03-23T23:43:24.090 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-03-23T23:43:24.090 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-23T23:43:24.090 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:43:24.114 INFO:tasks.ceph.mon.a:Stopped 2024-03-23T23:43:24.114 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-03-23T23:43:24.114 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:43:24.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.292+0000 7fa3a2c00640 1 Processor -- start 2024-03-23T23:43:24.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.292+0000 7fa3a2c00640 1 -- start start 2024-03-23T23:43:24.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.292+0000 7fa3a2c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa39c0c59d0 0x7fa39c155830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:24.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.292+0000 7fa3a2c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa39c06da30 0x7fa39c0c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:24.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.292+0000 7fa3a2c00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa39c155f30 con 0x7fa39c158da0 2024-03-23T23:43:24.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.292+0000 7fa3a2c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa39c0c62f0 con 0x7fa39c0c59d0 2024-03-23T23:43:24.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.292+0000 7fa3a2c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c1567d0 con 0x7fa39c06da30 2024-03-23T23:43:24.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.296+0000 7fa393e00640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7fa39c158da0 legacy=0x7fa39c06d320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:43:24.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.296+0000 7fa3a0c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa39c06da30 0x7fa39c0c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:24.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.296+0000 7fa3a0c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa39c06da30 0x7fa39c0c5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:43486/0 (socket says 172.21.15.8:43486) 2024-03-23T23:43:24.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.296+0000 7fa3a0c00640 1 -- 172.21.15.8:0/3706689402 learned_addr learned my addr 172.21.15.8:0/3706689402 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:24.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.296+0000 7fa39be00640 1 --2- 172.21.15.8:0/3706689402 >> v2:172.21.15.196:3300/0 conn(0x7fa39c0c59d0 0x7fa39c155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:24.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.296+0000 7fa3a0c00640 1 -- 172.21.15.8:0/3706689402 >> v2:172.21.15.196:3300/0 conn(0x7fa39c0c59d0 msgr2=0x7fa39c155830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:24.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.296+0000 7fa3a0c00640 1 --2- 172.21.15.8:0/3706689402 >> v2:172.21.15.196:3300/0 conn(0x7fa39c0c59d0 0x7fa39c155830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:24.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.296+0000 7fa3a0c00640 1 -- 172.21.15.8:0/3706689402 >> v1:172.21.15.8:6789/0 conn(0x7fa39c158da0 legacy=0x7fa39c06d320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:43:24.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.296+0000 7fa3a0c00640 1 -- 172.21.15.8:0/3706689402 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c156210 con 0x7fa39c06da30 2024-03-23T23:43:24.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.296+0000 7fa3a0c00640 1 --2- 172.21.15.8:0/3706689402 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa39c06da30 0x7fa39c0c5db0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa394009e50 tx=0x7fa39401c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52dac85b67c61889 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:24.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.296+0000 7fa39b400640 1 -- 172.21.15.8:0/3706689402 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3940a5890 con 0x7fa39c06da30 2024-03-23T23:43:24.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.296+0000 7fa39b400640 1 -- 172.21.15.8:0/3706689402 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3940a5a30 con 0x7fa39c06da30 2024-03-23T23:43:24.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.296+0000 7fa39b400640 1 -- 172.21.15.8:0/3706689402 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3940a5e00 con 0x7fa39c06da30 2024-03-23T23:43:24.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.300+0000 7fa3a2c00640 1 -- 172.21.15.8:0/3706689402 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa39c06da30 msgr2=0x7fa39c0c5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:24.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.300+0000 7fa3a2c00640 1 --2- 172.21.15.8:0/3706689402 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa39c06da30 0x7fa39c0c5db0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa394009e50 tx=0x7fa39401c9f0 comp rx=0 tx=0).stop 2024-03-23T23:43:24.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.300+0000 7fa3a2c00640 1 -- 172.21.15.8:0/3706689402 shutdown_connections 2024-03-23T23:43:24.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.300+0000 7fa3a2c00640 1 --2- 172.21.15.8:0/3706689402 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa39c06da30 0x7fa39c0c5db0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:24.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.300+0000 7fa3a2c00640 1 --2- 172.21.15.8:0/3706689402 >> v2:172.21.15.196:3300/0 conn(0x7fa39c0c59d0 0x7fa39c155830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:24.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.300+0000 7fa3a2c00640 1 -- 172.21.15.8:0/3706689402 >> 172.21.15.8:0/3706689402 conn(0x7fa39c0c8fe0 msgr2=0x7fa39c0c93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:24.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.300+0000 7fa3a2c00640 1 -- 172.21.15.8:0/3706689402 shutdown_connections 2024-03-23T23:43:24.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.300+0000 7fa3a2c00640 1 -- 172.21.15.8:0/3706689402 wait complete. 2024-03-23T23:43:24.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.300+0000 7fa3a2c00640 1 Processor -- start 2024-03-23T23:43:24.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.300+0000 7fa3a2c00640 1 -- start start 2024-03-23T23:43:24.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.300+0000 7fa3a2c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa39c06da30 0x7fa39c0ab990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:24.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.300+0000 7fa3a2c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa39c0c59d0 0x7fa39c0ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:24.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.300+0000 7fa3a2c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa39c158da0 0x7fa39c1f2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:24.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.300+0000 7fa3a2c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c153260 con 0x7fa39c06da30 2024-03-23T23:43:24.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.300+0000 7fa3a2c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c1530e0 con 0x7fa39c0c59d0 2024-03-23T23:43:24.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.300+0000 7fa3a2c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c1628f0 con 0x7fa39c158da0 2024-03-23T23:43:24.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.300+0000 7fa39be00640 1 -- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa39c06da30 msgr2=0x7fa39c0ab990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:43:24.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.300+0000 7fa39be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa39c06da30 0x7fa39c0ab990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:43:24.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.300+0000 7fa393e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa39c0c59d0 0x7fa39c0ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:24.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.300+0000 7fa3a0c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa39c158da0 0x7fa39c1f2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:24.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.300+0000 7fa393e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa39c0c59d0 0x7fa39c0ad1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:36332/0 (socket says 172.21.15.8:36332) 2024-03-23T23:43:24.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.300+0000 7fa3a0c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa39c158da0 0x7fa39c1f2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:43490/0 (socket says 172.21.15.8:43490) 2024-03-23T23:43:24.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.300+0000 7fa393e00640 1 -- 172.21.15.8:0/3930501669 learned_addr learned my addr 172.21.15.8:0/3930501669 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:24.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.304+0000 7fa393e00640 1 -- 172.21.15.8:0/3930501669 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa39c158da0 msgr2=0x7fa39c1f2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:24.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.304+0000 7fa393e00640 1 --2- 172.21.15.8:0/3930501669 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa39c158da0 0x7fa39c1f2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:24.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.304+0000 7fa393e00640 1 -- 172.21.15.8:0/3930501669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa39c06da30 msgr2=0x7fa39c0ab990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:43:24.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.304+0000 7fa393e00640 1 --2- 172.21.15.8:0/3930501669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa39c06da30 0x7fa39c0ab990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:24.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.304+0000 7fa393e00640 1 -- 172.21.15.8:0/3930501669 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c0c8dc0 con 0x7fa39c0c59d0 2024-03-23T23:43:24.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.304+0000 7fa3a0c00640 1 --2- 172.21.15.8:0/3930501669 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa39c158da0 0x7fa39c1f2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:43:24.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.304+0000 7fa393e00640 1 --2- 172.21.15.8:0/3930501669 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa39c0c59d0 0x7fa39c0ad1a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa38400b550 tx=0x7fa38400ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:24.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.304+0000 7fa398c00640 1 -- 172.21.15.8:0/3930501669 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa384003dd0 con 0x7fa39c0c59d0 2024-03-23T23:43:24.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.304+0000 7fa398c00640 1 -- 172.21.15.8:0/3930501669 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa384015070 con 0x7fa39c0c59d0 2024-03-23T23:43:24.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.304+0000 7fa398c00640 1 -- 172.21.15.8:0/3930501669 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa384005330 con 0x7fa39c0c59d0 2024-03-23T23:43:24.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.304+0000 7fa3a2c00640 1 -- 172.21.15.8:0/3930501669 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa39c0aafa0 con 0x7fa39c0c59d0 2024-03-23T23:43:24.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.304+0000 7fa3a2c00640 1 -- 172.21.15.8:0/3930501669 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa39c0ad6e0 con 0x7fa39c0c59d0 2024-03-23T23:43:24.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.304+0000 7fa3a2c00640 1 -- 172.21.15.8:0/3930501669 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa39c04f480 con 0x7fa39c0c59d0 2024-03-23T23:43:24.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.304+0000 7fa398c00640 1 -- 172.21.15.8:0/3930501669 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fa3840054d0 con 0x7fa39c0c59d0 2024-03-23T23:43:24.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.308+0000 7fa398c00640 1 --2- 172.21.15.8:0/3930501669 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa378067610 0x7fa378069ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:24.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.308+0000 7fa398c00640 1 -- 172.21.15.8:0/3930501669 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fa3840859b0 con 0x7fa39c0c59d0 2024-03-23T23:43:24.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.308+0000 7fa39be00640 1 --2- 172.21.15.8:0/3930501669 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa378067610 0x7fa378069ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:24.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.308+0000 7fa39be00640 1 --2- 172.21.15.8:0/3930501669 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa378067610 0x7fa378069ad0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa39c154860 tx=0x7fa38c009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:24.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.312+0000 7fa398c00640 1 -- 172.21.15.8:0/3930501669 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fa384056300 con 0x7fa39c0c59d0 2024-03-23T23:43:24.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.532+0000 7fa3a2c00640 1 -- 172.21.15.8:0/3930501669 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fa39c0c7580 con 0x7fa39c0c59d0 2024-03-23T23:43:24.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.532+0000 7fa398c00640 1 -- 172.21.15.8:0/3930501669 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1560 (secure 0 0 0) 0x7fa384055c00 con 0x7fa39c0c59d0 2024-03-23T23:43:24.534 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":69,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:43:24.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.532+0000 7fa3a2c00640 1 -- 172.21.15.8:0/3930501669 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa378067610 msgr2=0x7fa378069ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:24.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.532+0000 7fa3a2c00640 1 --2- 172.21.15.8:0/3930501669 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa378067610 0x7fa378069ad0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa39c154860 tx=0x7fa38c009190 comp rx=0 tx=0).stop 2024-03-23T23:43:24.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.532+0000 7fa3a2c00640 1 -- 172.21.15.8:0/3930501669 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa39c0c59d0 msgr2=0x7fa39c0ad1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:24.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.532+0000 7fa3a2c00640 1 --2- 172.21.15.8:0/3930501669 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa39c0c59d0 0x7fa39c0ad1a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa38400b550 tx=0x7fa38400ba10 comp rx=0 tx=0).stop 2024-03-23T23:43:24.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.532+0000 7fa3a2c00640 1 -- 172.21.15.8:0/3930501669 shutdown_connections 2024-03-23T23:43:24.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.532+0000 7fa3a2c00640 1 --2- 172.21.15.8:0/3930501669 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa378067610 0x7fa378069ad0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:24.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.532+0000 7fa3a2c00640 1 --2- 172.21.15.8:0/3930501669 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa39c158da0 0x7fa39c1f2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:24.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.532+0000 7fa3a2c00640 1 --2- 172.21.15.8:0/3930501669 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa39c0c59d0 0x7fa39c0ad1a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:24.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.532+0000 7fa3a2c00640 1 --2- 172.21.15.8:0/3930501669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa39c06da30 0x7fa39c0ab990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:24.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.532+0000 7fa3a2c00640 1 -- 172.21.15.8:0/3930501669 >> 172.21.15.8:0/3930501669 conn(0x7fa39c0c8fe0 msgr2=0x7fa39c0c93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:24.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.532+0000 7fa3a2c00640 1 -- 172.21.15.8:0/3930501669 shutdown_connections 2024-03-23T23:43:24.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:24.532+0000 7fa3a2c00640 1 -- 172.21.15.8:0/3930501669 wait complete. 2024-03-23T23:43:27.556 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:43:27.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.696+0000 7f6555600640 1 Processor -- start 2024-03-23T23:43:27.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.696+0000 7f6555600640 1 -- start start 2024-03-23T23:43:27.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.696+0000 7f6555600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65501509b0 0x7f65500a9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:27.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.696+0000 7f6555600640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6550150d90 con 0x7f6550153360 2024-03-23T23:43:27.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.696+0000 7f6555600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65500ac420 con 0x7f65500a99b0 2024-03-23T23:43:27.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.696+0000 7f6555600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65500abf90 con 0x7f65501509b0 2024-03-23T23:43:27.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.696+0000 7f6554c00640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f6550153360 legacy=0x7f655015dce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:43:27.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.696+0000 7f6547e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f65500a99b0 0x7f655006dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:57464/0 (socket says 172.21.15.8:57464) 2024-03-23T23:43:27.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.696+0000 7f6547e00640 1 -- 172.21.15.8:0/440031821 learned_addr learned my addr 172.21.15.8:0/440031821 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:43:27.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.696+0000 7f654fe00640 1 --2- 172.21.15.8:0/440031821 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65501509b0 0x7f65500a9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:27.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.696+0000 7f654f400640 1 -- 172.21.15.8:0/440031821 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 45388964 0 0) 0x7f65500ac420 con 0x7f65500a99b0 2024-03-23T23:43:27.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.696+0000 7f654f400640 1 -- 172.21.15.8:0/440031821 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6534003530 con 0x7f65500a99b0 2024-03-23T23:43:27.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.696+0000 7f654fe00640 1 -- 172.21.15.8:0/440031821 >> v1:172.21.15.196:6789/0 conn(0x7f65500a99b0 legacy=0x7f655006dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:27.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.696+0000 7f654f400640 1 -- 172.21.15.8:0/440031821 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1852356421 0 0) 0x7f6534003530 con 0x7f65500a99b0 2024-03-23T23:43:27.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.696+0000 7f654fe00640 1 -- 172.21.15.8:0/440031821 >> v1:172.21.15.8:6789/0 conn(0x7f6550153360 legacy=0x7f655015dce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:43:27.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.696+0000 7f654fe00640 1 -- 172.21.15.8:0/440031821 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65500ab380 con 0x7f65501509b0 2024-03-23T23:43:27.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.700+0000 7f654fe00640 1 --2- 172.21.15.8:0/440031821 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65501509b0 0x7f65500a9470 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6540009770 tx=0x7f654001c280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c0dc9a34a2b629a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:27.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.700+0000 7f654f400640 1 -- 172.21.15.8:0/440031821 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65400b0070 con 0x7f65501509b0 2024-03-23T23:43:27.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.700+0000 7f654f400640 1 -- 172.21.15.8:0/440031821 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65400ab400 con 0x7f65501509b0 2024-03-23T23:43:27.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.700+0000 7f654f400640 1 -- 172.21.15.8:0/440031821 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6538001680 con 0x7f65501509b0 2024-03-23T23:43:27.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.700+0000 7f6555600640 1 -- 172.21.15.8:0/440031821 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65501509b0 msgr2=0x7f65500a9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:27.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.700+0000 7f6555600640 1 --2- 172.21.15.8:0/440031821 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65501509b0 0x7f65500a9470 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6540009770 tx=0x7f654001c280 comp rx=0 tx=0).stop 2024-03-23T23:43:27.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.700+0000 7f6555600640 1 -- 172.21.15.8:0/440031821 shutdown_connections 2024-03-23T23:43:27.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.700+0000 7f6555600640 1 --2- 172.21.15.8:0/440031821 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65501509b0 0x7f65500a9470 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:27.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.700+0000 7f6555600640 1 -- 172.21.15.8:0/440031821 >> 172.21.15.8:0/440031821 conn(0x7f65500c6e10 msgr2=0x7f65500c7220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:27.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.700+0000 7f6555600640 1 -- 172.21.15.8:0/440031821 shutdown_connections 2024-03-23T23:43:27.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.700+0000 7f6555600640 1 -- 172.21.15.8:0/440031821 wait complete. 2024-03-23T23:43:27.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.700+0000 7f6555600640 1 Processor -- start 2024-03-23T23:43:27.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.700+0000 7f6555600640 1 -- start start 2024-03-23T23:43:27.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.704+0000 7f6555600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65500a99b0 0x7f65501524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:27.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.704+0000 7f6555600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65501509b0 0x7f6550151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:27.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.704+0000 7f6555600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6550153360 0x7f6550071e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:27.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.704+0000 7f6555600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6550161c20 con 0x7f65500a99b0 2024-03-23T23:43:27.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.704+0000 7f6555600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655006f060 con 0x7f65501509b0 2024-03-23T23:43:27.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.704+0000 7f6555600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6550161da0 con 0x7f6550153360 2024-03-23T23:43:27.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.704+0000 7f654fe00640 1 -- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65500a99b0 msgr2=0x7f65501524d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:43:27.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.704+0000 7f654fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65500a99b0 0x7f65501524d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:43:27.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.704+0000 7f6547e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65501509b0 0x7f6550151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:27.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.704+0000 7f6554c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6550153360 0x7f6550071e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:27.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.704+0000 7f6547e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65501509b0 0x7f6550151090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:36334/0 (socket says 172.21.15.8:36334) 2024-03-23T23:43:27.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.704+0000 7f6547e00640 1 -- 172.21.15.8:0/2897256646 learned_addr learned my addr 172.21.15.8:0/2897256646 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:27.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.704+0000 7f6547e00640 1 -- 172.21.15.8:0/2897256646 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6550153360 msgr2=0x7f6550071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:27.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.704+0000 7f6547e00640 1 --2- 172.21.15.8:0/2897256646 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6550153360 0x7f6550071e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:27.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.704+0000 7f6547e00640 1 -- 172.21.15.8:0/2897256646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65500a99b0 msgr2=0x7f65501524d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:43:27.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.704+0000 7f6547e00640 1 --2- 172.21.15.8:0/2897256646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65500a99b0 0x7f65501524d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:27.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.704+0000 7f6547e00640 1 -- 172.21.15.8:0/2897256646 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6550152a10 con 0x7f65501509b0 2024-03-23T23:43:27.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.704+0000 7f6547e00640 1 --2- 172.21.15.8:0/2897256646 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65501509b0 0x7f6550151090 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f653800c700 tx=0x7f653800cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:27.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.704+0000 7f654cc00640 1 -- 172.21.15.8:0/2897256646 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6538017070 con 0x7f65501509b0 2024-03-23T23:43:27.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.704+0000 7f654cc00640 1 -- 172.21.15.8:0/2897256646 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6538005ae0 con 0x7f65501509b0 2024-03-23T23:43:27.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.704+0000 7f654cc00640 1 -- 172.21.15.8:0/2897256646 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6538007070 con 0x7f65501509b0 2024-03-23T23:43:27.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.704+0000 7f6555600640 1 -- 172.21.15.8:0/2897256646 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6550072ba0 con 0x7f65501509b0 2024-03-23T23:43:27.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.704+0000 7f6555600640 1 -- 172.21.15.8:0/2897256646 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65501ef8d0 con 0x7f65501509b0 2024-03-23T23:43:27.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.704+0000 7f6555600640 1 -- 172.21.15.8:0/2897256646 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6550153180 con 0x7f65501509b0 2024-03-23T23:43:27.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.708+0000 7f654cc00640 1 -- 172.21.15.8:0/2897256646 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f653801a070 con 0x7f65501509b0 2024-03-23T23:43:27.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.708+0000 7f654cc00640 1 --2- 172.21.15.8:0/2897256646 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f652c067610 0x7f652c069ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:27.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.708+0000 7f654cc00640 1 -- 172.21.15.8:0/2897256646 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f6538084fe0 con 0x7f65501509b0 2024-03-23T23:43:27.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.708+0000 7f654fe00640 1 --2- 172.21.15.8:0/2897256646 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f652c067610 0x7f652c069ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:27.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.708+0000 7f654fe00640 1 --2- 172.21.15.8:0/2897256646 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f652c067610 0x7f652c069ad0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f65400ad000 tx=0x7f65400a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:27.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.712+0000 7f654cc00640 1 -- 172.21.15.8:0/2897256646 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f6550153180 con 0x7f65501509b0 2024-03-23T23:43:27.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.940+0000 7f6555600640 1 -- 172.21.15.8:0/2897256646 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f655004f410 con 0x7f65501509b0 2024-03-23T23:43:27.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.940+0000 7f654cc00640 1 -- 172.21.15.8:0/2897256646 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1560 (secure 0 0 0) 0x7f6538055280 con 0x7f65501509b0 2024-03-23T23:43:27.941 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":72,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:43:27.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.940+0000 7f6555600640 1 -- 172.21.15.8:0/2897256646 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f652c067610 msgr2=0x7f652c069ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:27.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.940+0000 7f6555600640 1 --2- 172.21.15.8:0/2897256646 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f652c067610 0x7f652c069ad0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f65400ad000 tx=0x7f65400a6000 comp rx=0 tx=0).stop 2024-03-23T23:43:27.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.940+0000 7f6555600640 1 -- 172.21.15.8:0/2897256646 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65501509b0 msgr2=0x7f6550151090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:27.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.940+0000 7f6555600640 1 --2- 172.21.15.8:0/2897256646 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65501509b0 0x7f6550151090 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f653800c700 tx=0x7f653800cbc0 comp rx=0 tx=0).stop 2024-03-23T23:43:27.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.940+0000 7f6555600640 1 -- 172.21.15.8:0/2897256646 shutdown_connections 2024-03-23T23:43:27.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.940+0000 7f6555600640 1 --2- 172.21.15.8:0/2897256646 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f652c067610 0x7f652c069ad0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:27.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.940+0000 7f6555600640 1 --2- 172.21.15.8:0/2897256646 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6550153360 0x7f6550071e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:27.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.940+0000 7f6555600640 1 --2- 172.21.15.8:0/2897256646 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65501509b0 0x7f6550151090 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:27.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.940+0000 7f6555600640 1 --2- 172.21.15.8:0/2897256646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65500a99b0 0x7f65501524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:27.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.940+0000 7f6555600640 1 -- 172.21.15.8:0/2897256646 >> 172.21.15.8:0/2897256646 conn(0x7f65500c6e10 msgr2=0x7f655014e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:27.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.940+0000 7f6555600640 1 -- 172.21.15.8:0/2897256646 shutdown_connections 2024-03-23T23:43:27.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:27.940+0000 7f6555600640 1 -- 172.21.15.8:0/2897256646 wait complete. 2024-03-23T23:43:30.964 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:43:31.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.104+0000 7f033e400640 1 Processor -- start 2024-03-23T23:43:31.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.104+0000 7f033e400640 1 -- start start 2024-03-23T23:43:31.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.104+0000 7f033e400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0338070e90 0x7f03381562c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:31.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.104+0000 7f033e400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03380ac250 0x7f033814c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:31.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.104+0000 7f033e400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0338152e10 con 0x7f03380c2ee0 2024-03-23T23:43:31.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.104+0000 7f033e400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0338155e30 con 0x7f0338070e90 2024-03-23T23:43:31.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.104+0000 7f033e400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03381530f0 con 0x7f03380ac250 2024-03-23T23:43:31.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.104+0000 7f0337400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f03380c2ee0 0x7f0338152630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:57474/0 (socket says 172.21.15.8:57474) 2024-03-23T23:43:31.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.104+0000 7f0337400640 1 -- 172.21.15.8:0/1423210740 learned_addr learned my addr 172.21.15.8:0/1423210740 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:43:31.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.104+0000 7f0337e00640 1 --2- 172.21.15.8:0/1423210740 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03380ac250 0x7f033814c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:31.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.104+0000 7f0336a00640 1 --2- 172.21.15.8:0/1423210740 >> v2:172.21.15.196:3300/0 conn(0x7f0338070e90 0x7f03381562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:31.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.104+0000 7f0337e00640 1 -- 172.21.15.8:0/1423210740 >> v2:172.21.15.196:3300/0 conn(0x7f0338070e90 msgr2=0x7f03381562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:31.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.104+0000 7f0337e00640 1 --2- 172.21.15.8:0/1423210740 >> v2:172.21.15.196:3300/0 conn(0x7f0338070e90 0x7f03381562c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:31.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.104+0000 7f0337e00640 1 -- 172.21.15.8:0/1423210740 >> v1:172.21.15.196:6789/0 conn(0x7f03380c2ee0 legacy=0x7f0338152630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:31.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.104+0000 7f0337e00640 1 -- 172.21.15.8:0/1423210740 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03381533d0 con 0x7f03380ac250 2024-03-23T23:43:31.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.104+0000 7f0336a00640 1 --2- 172.21.15.8:0/1423210740 >> v2:172.21.15.196:3300/0 conn(0x7f0338070e90 0x7f03381562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:43:31.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.108+0000 7f0337e00640 1 --2- 172.21.15.8:0/1423210740 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03380ac250 0x7f033814c270 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0330009d90 tx=0x7f033001c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2913993e6715f500 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:31.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.108+0000 7f0336000640 1 -- 172.21.15.8:0/1423210740 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03300b2070 con 0x7f03380ac250 2024-03-23T23:43:31.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.108+0000 7f0336000640 1 -- 172.21.15.8:0/1423210740 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03300a58b0 con 0x7f03380ac250 2024-03-23T23:43:31.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.108+0000 7f0336000640 1 -- 172.21.15.8:0/1423210740 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03300a5c80 con 0x7f03380ac250 2024-03-23T23:43:31.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.108+0000 7f033e400640 1 -- 172.21.15.8:0/1423210740 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03380ac250 msgr2=0x7f033814c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:31.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.108+0000 7f033e400640 1 --2- 172.21.15.8:0/1423210740 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03380ac250 0x7f033814c270 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0330009d90 tx=0x7f033001c8e0 comp rx=0 tx=0).stop 2024-03-23T23:43:31.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.108+0000 7f033e400640 1 -- 172.21.15.8:0/1423210740 shutdown_connections 2024-03-23T23:43:31.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.108+0000 7f033e400640 1 --2- 172.21.15.8:0/1423210740 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03380ac250 0x7f033814c270 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:31.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.108+0000 7f033e400640 1 --2- 172.21.15.8:0/1423210740 >> v2:172.21.15.196:3300/0 conn(0x7f0338070e90 0x7f03381562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:31.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.108+0000 7f033e400640 1 -- 172.21.15.8:0/1423210740 >> 172.21.15.8:0/1423210740 conn(0x7f033806b170 msgr2=0x7f033806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:31.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.108+0000 7f033e400640 1 -- 172.21.15.8:0/1423210740 shutdown_connections 2024-03-23T23:43:31.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.108+0000 7f033e400640 1 -- 172.21.15.8:0/1423210740 wait complete. 2024-03-23T23:43:31.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.108+0000 7f033e400640 1 Processor -- start 2024-03-23T23:43:31.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.108+0000 7f033e400640 1 -- start start 2024-03-23T23:43:31.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.112+0000 7f033e400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0338070e90 0x7f03381eeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:31.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.112+0000 7f033e400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03380ac250 0x7f03381f2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:31.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.112+0000 7f033e400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03380c2ee0 0x7f0338140a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:31.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.112+0000 7f033e400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033815f9e0 con 0x7f03380ac250 2024-03-23T23:43:31.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.112+0000 7f033e400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03380c34d0 con 0x7f0338070e90 2024-03-23T23:43:31.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.112+0000 7f033e400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033815fb60 con 0x7f03380c2ee0 2024-03-23T23:43:31.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.112+0000 7f0336a00640 1 -- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03380ac250 msgr2=0x7f03381f2830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:43:31.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.112+0000 7f0336a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03380ac250 0x7f03381f2830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:43:31.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.112+0000 7f0337400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0338070e90 0x7f03381eeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:31.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.112+0000 7f0337e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03380c2ee0 0x7f0338140a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:31.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.112+0000 7f0337400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0338070e90 0x7f03381eeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:36348/0 (socket says 172.21.15.8:36348) 2024-03-23T23:43:31.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.112+0000 7f0337400640 1 -- 172.21.15.8:0/2165792284 learned_addr learned my addr 172.21.15.8:0/2165792284 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:31.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.112+0000 7f0337400640 1 -- 172.21.15.8:0/2165792284 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03380c2ee0 msgr2=0x7f0338140a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:31.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.112+0000 7f0337400640 1 --2- 172.21.15.8:0/2165792284 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03380c2ee0 0x7f0338140a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:31.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.112+0000 7f0337400640 1 -- 172.21.15.8:0/2165792284 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03380ac250 msgr2=0x7f03381f2830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:43:31.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.112+0000 7f0337400640 1 --2- 172.21.15.8:0/2165792284 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03380ac250 0x7f03381f2830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:31.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.112+0000 7f0337400640 1 -- 172.21.15.8:0/2165792284 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03381f2070 con 0x7f0338070e90 2024-03-23T23:43:31.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.112+0000 7f0337400640 1 --2- 172.21.15.8:0/2165792284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0338070e90 0x7f03381eeb00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f032800c400 tx=0x7f032800c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:31.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.112+0000 7f032f400640 1 -- 172.21.15.8:0/2165792284 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0328017070 con 0x7f0338070e90 2024-03-23T23:43:31.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.112+0000 7f032f400640 1 -- 172.21.15.8:0/2165792284 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0328005cf0 con 0x7f0338070e90 2024-03-23T23:43:31.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.112+0000 7f032f400640 1 -- 172.21.15.8:0/2165792284 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03280072d0 con 0x7f0338070e90 2024-03-23T23:43:31.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.112+0000 7f033e400640 1 -- 172.21.15.8:0/2165792284 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03381401d0 con 0x7f0338070e90 2024-03-23T23:43:31.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.112+0000 7f033e400640 1 -- 172.21.15.8:0/2165792284 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0338152a50 con 0x7f0338070e90 2024-03-23T23:43:31.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.112+0000 7f033e400640 1 -- 172.21.15.8:0/2165792284 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f033804f480 con 0x7f0338070e90 2024-03-23T23:43:31.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.116+0000 7f032f400640 1 -- 172.21.15.8:0/2165792284 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f032801a070 con 0x7f0338070e90 2024-03-23T23:43:31.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.116+0000 7f032f400640 1 --2- 172.21.15.8:0/2165792284 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0318067610 0x7f0318069ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:31.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.116+0000 7f032f400640 1 -- 172.21.15.8:0/2165792284 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f0328085250 con 0x7f0338070e90 2024-03-23T23:43:31.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.116+0000 7f0336a00640 1 --2- 172.21.15.8:0/2165792284 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0318067610 0x7f0318069ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:31.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.116+0000 7f0336a00640 1 --2- 172.21.15.8:0/2165792284 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0318067610 0x7f0318069ad0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0338148aa0 tx=0x7f0324009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:31.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.120+0000 7f032f400640 1 -- 172.21.15.8:0/2165792284 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f0328055630 con 0x7f0338070e90 2024-03-23T23:43:31.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.336+0000 7f033e400640 1 -- 172.21.15.8:0/2165792284 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f03380724e0 con 0x7f0338070e90 2024-03-23T23:43:31.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.336+0000 7f032f400640 1 -- 172.21.15.8:0/2165792284 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1560 (secure 0 0 0) 0x7f03280596d0 con 0x7f0338070e90 2024-03-23T23:43:31.341 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":76,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:43:31.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.340+0000 7f033e400640 1 -- 172.21.15.8:0/2165792284 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0318067610 msgr2=0x7f0318069ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:31.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.340+0000 7f033e400640 1 --2- 172.21.15.8:0/2165792284 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0318067610 0x7f0318069ad0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0338148aa0 tx=0x7f0324009190 comp rx=0 tx=0).stop 2024-03-23T23:43:31.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.340+0000 7f033e400640 1 -- 172.21.15.8:0/2165792284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0338070e90 msgr2=0x7f03381eeb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:31.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.340+0000 7f033e400640 1 --2- 172.21.15.8:0/2165792284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0338070e90 0x7f03381eeb00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f032800c400 tx=0x7f032800c8c0 comp rx=0 tx=0).stop 2024-03-23T23:43:31.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.340+0000 7f033e400640 1 -- 172.21.15.8:0/2165792284 shutdown_connections 2024-03-23T23:43:31.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.340+0000 7f033e400640 1 --2- 172.21.15.8:0/2165792284 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0318067610 0x7f0318069ad0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:31.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.340+0000 7f033e400640 1 --2- 172.21.15.8:0/2165792284 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03380c2ee0 0x7f0338140a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:31.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.340+0000 7f033e400640 1 --2- 172.21.15.8:0/2165792284 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03380ac250 0x7f03381f2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:31.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.340+0000 7f033e400640 1 --2- 172.21.15.8:0/2165792284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0338070e90 0x7f03381eeb00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:31.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.340+0000 7f033e400640 1 -- 172.21.15.8:0/2165792284 >> 172.21.15.8:0/2165792284 conn(0x7f033806b170 msgr2=0x7f03380ab230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:31.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.340+0000 7f033e400640 1 -- 172.21.15.8:0/2165792284 shutdown_connections 2024-03-23T23:43:31.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:31.340+0000 7f033e400640 1 -- 172.21.15.8:0/2165792284 wait complete. 2024-03-23T23:43:34.363 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:43:34.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:34.500+0000 7f4510800640 1 Processor -- start 2024-03-23T23:43:34.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:34.500+0000 7f4510800640 1 -- start start 2024-03-23T23:43:34.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:34.500+0000 7f4510800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f45080c1b70 0x7f4508154220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:34.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:34.500+0000 7f4510800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450814a560 con 0x7f450814a180 2024-03-23T23:43:34.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:34.500+0000 7f4510800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45080c2070 con 0x7f450806e350 2024-03-23T23:43:34.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:34.500+0000 7f4510800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45080c2350 con 0x7f45080c1b70 2024-03-23T23:43:34.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:34.500+0000 7f450de00640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f450814a180 legacy=0x7f45080c3620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:43:34.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:34.504+0000 7f450d400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f45080c1b70 0x7f4508154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:34.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:34.504+0000 7f450d400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f45080c1b70 0x7f4508154220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:60184/0 (socket says 172.21.15.8:60184) 2024-03-23T23:43:34.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:34.504+0000 7f450e800640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f450806e350 0x7f450806e7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:40008/0 (socket says 172.21.15.8:40008) 2024-03-23T23:43:34.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:34.504+0000 7f450d400640 1 -- 172.21.15.8:0/3707776706 learned_addr learned my addr 172.21.15.8:0/3707776706 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:34.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:34.504+0000 7f450d400640 1 -- 172.21.15.8:0/3707776706 >> v2:172.21.15.196:3300/0 conn(0x7f45080c1b70 msgr2=0x7f4508154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:43:34.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:34.504+0000 7f450d400640 1 -- 172.21.15.8:0/3707776706 >> v2:172.21.15.196:3300/0 conn(0x7f45080c1b70 msgr2=0x7f4508154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:43:34.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:34.504+0000 7f450d400640 1 --2- 172.21.15.8:0/3707776706 >> v2:172.21.15.196:3300/0 conn(0x7f45080c1b70 0x7f4508154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:43:34.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:34.504+0000 7f450d400640 1 --2- 172.21.15.8:0/3707776706 >> v2:172.21.15.196:3300/0 conn(0x7f45080c1b70 0x7f4508154220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:43:34.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:34.708+0000 7f450de00640 1 -- 172.21.15.8:0/3707776706 >> v1:172.21.15.8:6789/0 conn(0x7f450814a180 legacy=0x7f45080c3620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:43:34.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:34.708+0000 7f450d400640 1 --2- 172.21.15.8:0/3707776706 >> v2:172.21.15.196:3300/0 conn(0x7f45080c1b70 0x7f4508154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:34.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:34.708+0000 7f450d400640 1 -- 172.21.15.8:0/3707776706 >> v2:172.21.15.196:3300/0 conn(0x7f45080c1b70 msgr2=0x7f4508154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:43:34.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:34.708+0000 7f450d400640 1 -- 172.21.15.8:0/3707776706 >> v2:172.21.15.196:3300/0 conn(0x7f45080c1b70 msgr2=0x7f4508154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:43:34.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:34.708+0000 7f450d400640 1 --2- 172.21.15.8:0/3707776706 >> v2:172.21.15.196:3300/0 conn(0x7f45080c1b70 0x7f4508154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:43:34.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:34.708+0000 7f450d400640 1 --2- 172.21.15.8:0/3707776706 >> v2:172.21.15.196:3300/0 conn(0x7f45080c1b70 0x7f4508154220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:43:35.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:35.112+0000 7f450de00640 1 -- 172.21.15.8:0/3707776706 >> v1:172.21.15.8:6789/0 conn(0x7f450814a180 legacy=0x7f45080c3620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:43:35.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:35.112+0000 7f450d400640 1 --2- 172.21.15.8:0/3707776706 >> v2:172.21.15.196:3300/0 conn(0x7f45080c1b70 0x7f4508154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:35.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:35.112+0000 7f450d400640 1 -- 172.21.15.8:0/3707776706 >> v2:172.21.15.196:3300/0 conn(0x7f45080c1b70 msgr2=0x7f4508154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:43:35.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:35.112+0000 7f450d400640 1 -- 172.21.15.8:0/3707776706 >> v2:172.21.15.196:3300/0 conn(0x7f45080c1b70 msgr2=0x7f4508154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:43:35.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:35.112+0000 7f450d400640 1 --2- 172.21.15.8:0/3707776706 >> v2:172.21.15.196:3300/0 conn(0x7f45080c1b70 0x7f4508154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:43:35.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:35.112+0000 7f450d400640 1 --2- 172.21.15.8:0/3707776706 >> v2:172.21.15.196:3300/0 conn(0x7f45080c1b70 0x7f4508154220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:43:35.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:35.916+0000 7f450de00640 1 -- 172.21.15.8:0/3707776706 >> v1:172.21.15.8:6789/0 conn(0x7f450814a180 legacy=0x7f45080c3620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:43:35.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:35.916+0000 7f450d400640 1 --2- 172.21.15.8:0/3707776706 >> v2:172.21.15.196:3300/0 conn(0x7f45080c1b70 0x7f4508154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:35.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:35.916+0000 7f450d400640 1 -- 172.21.15.8:0/3707776706 >> v2:172.21.15.196:3300/0 conn(0x7f45080c1b70 msgr2=0x7f4508154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:43:35.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:35.916+0000 7f450d400640 1 -- 172.21.15.8:0/3707776706 >> v2:172.21.15.196:3300/0 conn(0x7f45080c1b70 msgr2=0x7f4508154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:43:35.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:35.916+0000 7f450d400640 1 --2- 172.21.15.8:0/3707776706 >> v2:172.21.15.196:3300/0 conn(0x7f45080c1b70 0x7f4508154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:43:35.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:35.916+0000 7f450d400640 1 --2- 172.21.15.8:0/3707776706 >> v2:172.21.15.196:3300/0 conn(0x7f45080c1b70 0x7f4508154220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:43:37.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:37.500+0000 7f4503400640 1 -- 172.21.15.8:0/3707776706 >> v2:172.21.15.196:3300/0 conn(0x7f45080c1b70 msgr2=0x7f4508154220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:43:37.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:37.500+0000 7f4503400640 1 --2- 172.21.15.8:0/3707776706 >> v2:172.21.15.196:3300/0 conn(0x7f45080c1b70 0x7f4508154220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:37.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:37.500+0000 7f4503400640 1 -- 172.21.15.8:0/3707776706 >> v1:172.21.15.196:6789/0 conn(0x7f450806e350 legacy=0x7f450806e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:37.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:37.504+0000 7f4503400640 1 -- 172.21.15.8:0/3707776706 >> v1:172.21.15.8:6789/0 conn(0x7f450814a180 legacy=0x7f45080c3620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:43:37.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:37.504+0000 7f4503400640 1 --2- 172.21.15.8:0/3707776706 >> v2:172.21.15.8:3300/0 conn(0x7f44ec0036b0 0x7f44ec005b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:37.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:37.504+0000 7f4503400640 1 --2- 172.21.15.8:0/3707776706 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44ec006100 0x7f44ec0085c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:37.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:37.504+0000 7f4503400640 1 -- 172.21.15.8:0/3707776706 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45080c2350 con 0x7f44ec0036b0 2024-03-23T23:43:37.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:37.504+0000 7f4503400640 1 -- 172.21.15.8:0/3707776706 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec008cf0 con 0x7f44ec006100 2024-03-23T23:43:37.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:37.504+0000 7f450de00640 1 -- 172.21.15.8:0/3707776706 >> v2:172.21.15.8:3300/0 conn(0x7f44ec0036b0 msgr2=0x7f44ec005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:43:37.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:37.504+0000 7f450de00640 1 --2- 172.21.15.8:0/3707776706 >> v2:172.21.15.8:3300/0 conn(0x7f44ec0036b0 0x7f44ec005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:43:37.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:37.504+0000 7f450d400640 1 --2- 172.21.15.8:0/3707776706 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44ec006100 0x7f44ec0085c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:37.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:37.504+0000 7f450d400640 1 -- 172.21.15.8:0/3707776706 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44ec006100 msgr2=0x7f44ec0085c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:43:37.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:37.504+0000 7f450d400640 1 -- 172.21.15.8:0/3707776706 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44ec006100 msgr2=0x7f44ec0085c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:43:37.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:37.504+0000 7f450d400640 1 --2- 172.21.15.8:0/3707776706 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44ec006100 0x7f44ec0085c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:43:37.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:37.504+0000 7f450d400640 1 --2- 172.21.15.8:0/3707776706 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44ec006100 0x7f44ec0085c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:43:37.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:37.708+0000 7f450de00640 1 -- 172.21.15.8:0/3707776706 >> v2:172.21.15.8:3300/0 conn(0x7f44ec0036b0 msgr2=0x7f44ec005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:43:37.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:37.708+0000 7f450de00640 1 --2- 172.21.15.8:0/3707776706 >> v2:172.21.15.8:3300/0 conn(0x7f44ec0036b0 0x7f44ec005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:43:37.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:37.708+0000 7f450d400640 1 --2- 172.21.15.8:0/3707776706 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44ec006100 0x7f44ec0085c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:37.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:37.708+0000 7f450d400640 1 -- 172.21.15.8:0/3707776706 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44ec006100 msgr2=0x7f44ec0085c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:43:37.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:37.708+0000 7f450d400640 1 -- 172.21.15.8:0/3707776706 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44ec006100 msgr2=0x7f44ec0085c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:43:37.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:37.708+0000 7f450d400640 1 --2- 172.21.15.8:0/3707776706 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44ec006100 0x7f44ec0085c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:43:37.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:37.708+0000 7f450d400640 1 --2- 172.21.15.8:0/3707776706 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44ec006100 0x7f44ec0085c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:43:38.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.112+0000 7f450de00640 1 -- 172.21.15.8:0/3707776706 >> v2:172.21.15.8:3300/0 conn(0x7f44ec0036b0 msgr2=0x7f44ec005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:43:38.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.112+0000 7f450de00640 1 --2- 172.21.15.8:0/3707776706 >> v2:172.21.15.8:3300/0 conn(0x7f44ec0036b0 0x7f44ec005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:43:38.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.112+0000 7f450d400640 1 --2- 172.21.15.8:0/3707776706 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44ec006100 0x7f44ec0085c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:38.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.112+0000 7f450d400640 1 -- 172.21.15.8:0/3707776706 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44ec006100 msgr2=0x7f44ec0085c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:43:38.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.112+0000 7f450d400640 1 -- 172.21.15.8:0/3707776706 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44ec006100 msgr2=0x7f44ec0085c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:43:38.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.112+0000 7f450d400640 1 --2- 172.21.15.8:0/3707776706 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44ec006100 0x7f44ec0085c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:43:38.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.112+0000 7f450d400640 1 --2- 172.21.15.8:0/3707776706 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44ec006100 0x7f44ec0085c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:43:38.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.916+0000 7f450de00640 1 -- 172.21.15.8:0/3707776706 >> v2:172.21.15.8:3300/0 conn(0x7f44ec0036b0 msgr2=0x7f44ec005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:43:38.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.916+0000 7f450de00640 1 --2- 172.21.15.8:0/3707776706 >> v2:172.21.15.8:3300/0 conn(0x7f44ec0036b0 0x7f44ec005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:43:38.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.916+0000 7f450d400640 1 --2- 172.21.15.8:0/3707776706 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44ec006100 0x7f44ec0085c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:38.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.916+0000 7f450d400640 1 -- 172.21.15.8:0/3707776706 >> v2:172.21.15.8:3300/0 conn(0x7f44ec0036b0 msgr2=0x7f44ec005b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:43:38.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.916+0000 7f450d400640 1 --2- 172.21.15.8:0/3707776706 >> v2:172.21.15.8:3300/0 conn(0x7f44ec0036b0 0x7f44ec005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:38.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.916+0000 7f450d400640 1 -- 172.21.15.8:0/3707776706 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45080c2630 con 0x7f44ec006100 2024-03-23T23:43:38.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.916+0000 7f450d400640 1 --2- 172.21.15.8:0/3707776706 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44ec006100 0x7f44ec0085c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f44f8009100 tx=0x7f44f801dea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=756caece0edfb23d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:38.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.916+0000 7f450ca00640 1 -- 172.21.15.8:0/3707776706 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f80ac070 con 0x7f44ec006100 2024-03-23T23:43:38.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.916+0000 7f450ca00640 1 -- 172.21.15.8:0/3707776706 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f80aa070 con 0x7f44ec006100 2024-03-23T23:43:38.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.916+0000 7f450ca00640 1 -- 172.21.15.8:0/3707776706 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f800f040 con 0x7f44ec006100 2024-03-23T23:43:38.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.920+0000 7f4510800640 1 -- 172.21.15.8:0/3707776706 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44ec006100 msgr2=0x7f44ec0085c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:38.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.920+0000 7f4510800640 1 --2- 172.21.15.8:0/3707776706 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44ec006100 0x7f44ec0085c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f44f8009100 tx=0x7f44f801dea0 comp rx=0 tx=0).stop 2024-03-23T23:43:38.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.920+0000 7f450e800640 1 -- 172.21.15.8:0/3707776706 reap_dead start 2024-03-23T23:43:38.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.920+0000 7f4510800640 1 -- 172.21.15.8:0/3707776706 shutdown_connections 2024-03-23T23:43:38.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.920+0000 7f4510800640 1 -- 172.21.15.8:0/3707776706 >> 172.21.15.8:0/3707776706 conn(0x7f450806b170 msgr2=0x7f450806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:38.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.920+0000 7f4510800640 1 -- 172.21.15.8:0/3707776706 shutdown_connections 2024-03-23T23:43:38.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.920+0000 7f4510800640 1 -- 172.21.15.8:0/3707776706 wait complete. 2024-03-23T23:43:38.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.920+0000 7f4510800640 1 Processor -- start 2024-03-23T23:43:38.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.920+0000 7f4510800640 1 -- start start 2024-03-23T23:43:38.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.920+0000 7f4510800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44ec006100 0x7f45081ee8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:38.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.920+0000 7f4510800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45081566f0 0x7f450814a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:38.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.920+0000 7f4510800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4508146810 0x7f4508146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:38.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.920+0000 7f4510800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450806f030 con 0x7f4508146810 2024-03-23T23:43:38.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.920+0000 7f4510800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450806eeb0 con 0x7f45081566f0 2024-03-23T23:43:38.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.920+0000 7f4510800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45081617c0 con 0x7f44ec006100 2024-03-23T23:43:38.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.920+0000 7f450e800640 1 -- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4508146810 msgr2=0x7f4508146cc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:43:38.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.920+0000 7f450e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4508146810 0x7f4508146cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:43:38.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.920+0000 7f450de00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44ec006100 0x7f45081ee8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:38.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.920+0000 7f450d400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45081566f0 0x7f450814a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:38.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.920+0000 7f450de00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44ec006100 0x7f45081ee8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:37138/0 (socket says 172.21.15.8:37138) 2024-03-23T23:43:38.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.920+0000 7f450de00640 1 -- 172.21.15.8:0/938691554 learned_addr learned my addr 172.21.15.8:0/938691554 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:38.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.924+0000 7f450d400640 1 -- 172.21.15.8:0/938691554 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44ec006100 msgr2=0x7f45081ee8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:38.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.924+0000 7f450d400640 1 --2- 172.21.15.8:0/938691554 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44ec006100 0x7f45081ee8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:38.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.924+0000 7f450d400640 1 -- 172.21.15.8:0/938691554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4508146810 msgr2=0x7f4508146cc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:43:38.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.924+0000 7f450d400640 1 --2- 172.21.15.8:0/938691554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4508146810 0x7f4508146cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:38.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.924+0000 7f450d400640 1 -- 172.21.15.8:0/938691554 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450814ef70 con 0x7f45081566f0 2024-03-23T23:43:38.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.924+0000 7f450de00640 1 --2- 172.21.15.8:0/938691554 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44ec006100 0x7f45081ee8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:43:38.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.924+0000 7f450d400640 1 --2- 172.21.15.8:0/938691554 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45081566f0 0x7f450814a560 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f44ec008ec0 tx=0x7f44f8008b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:38.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.924+0000 7f4502000640 1 -- 172.21.15.8:0/938691554 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f80ac040 con 0x7f45081566f0 2024-03-23T23:43:38.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.924+0000 7f4502000640 1 -- 172.21.15.8:0/938691554 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f80b27b0 con 0x7f45081566f0 2024-03-23T23:43:38.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.924+0000 7f4510800640 1 -- 172.21.15.8:0/938691554 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45081ede10 con 0x7f45081566f0 2024-03-23T23:43:38.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.924+0000 7f4502000640 1 -- 172.21.15.8:0/938691554 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f80b2b60 con 0x7f45081566f0 2024-03-23T23:43:38.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.924+0000 7f4510800640 1 -- 172.21.15.8:0/938691554 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45081ee3d0 con 0x7f45081566f0 2024-03-23T23:43:38.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.924+0000 7f4510800640 1 -- 172.21.15.8:0/938691554 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f450804f480 con 0x7f45081566f0 2024-03-23T23:43:38.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.928+0000 7f4502000640 1 -- 172.21.15.8:0/938691554 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f44f80b2d00 con 0x7f45081566f0 2024-03-23T23:43:38.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.928+0000 7f4502000640 1 --2- 172.21.15.8:0/938691554 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f44ec068400 0x7f44ec06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:38.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.928+0000 7f4502000640 1 -- 172.21.15.8:0/938691554 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f44f81211a0 con 0x7f45081566f0 2024-03-23T23:43:38.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.928+0000 7f450de00640 1 --2- 172.21.15.8:0/938691554 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f44ec068400 0x7f44ec06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:38.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.928+0000 7f450de00640 1 --2- 172.21.15.8:0/938691554 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f44ec068400 0x7f44ec06a8c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f44fc009230 tx=0x7f44fc0091c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:38.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:38.932+0000 7f4502000640 1 -- 172.21.15.8:0/938691554 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f44f800a9d0 con 0x7f45081566f0 2024-03-23T23:43:39.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.152+0000 7f4510800640 1 -- 172.21.15.8:0/938691554 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f45080c3400 con 0x7f45081566f0 2024-03-23T23:43:39.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.152+0000 7f4502000640 1 -- 172.21.15.8:0/938691554 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7f44f80f1c10 con 0x7f45081566f0 2024-03-23T23:43:39.155 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":6,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:43:39.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.152+0000 7f4510800640 1 -- 172.21.15.8:0/938691554 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f44ec068400 msgr2=0x7f44ec06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:39.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.152+0000 7f4510800640 1 --2- 172.21.15.8:0/938691554 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f44ec068400 0x7f44ec06a8c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f44fc009230 tx=0x7f44fc0091c0 comp rx=0 tx=0).stop 2024-03-23T23:43:39.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.152+0000 7f4510800640 1 -- 172.21.15.8:0/938691554 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45081566f0 msgr2=0x7f450814a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:39.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.152+0000 7f4510800640 1 --2- 172.21.15.8:0/938691554 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45081566f0 0x7f450814a560 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f44ec008ec0 tx=0x7f44f8008b70 comp rx=0 tx=0).stop 2024-03-23T23:43:39.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.156+0000 7f4510800640 1 -- 172.21.15.8:0/938691554 shutdown_connections 2024-03-23T23:43:39.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.156+0000 7f4510800640 1 --2- 172.21.15.8:0/938691554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4508146810 0x7f4508146cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:39.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.156+0000 7f4510800640 1 --2- 172.21.15.8:0/938691554 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45081566f0 0x7f450814a560 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:39.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.156+0000 7f4510800640 1 --2- 172.21.15.8:0/938691554 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f44ec068400 0x7f44ec06a8c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:39.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.156+0000 7f4510800640 1 --2- 172.21.15.8:0/938691554 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44ec006100 0x7f45081ee8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:39.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.156+0000 7f4510800640 1 -- 172.21.15.8:0/938691554 >> 172.21.15.8:0/938691554 conn(0x7f450806b170 msgr2=0x7f45080c0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:39.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.156+0000 7f4510800640 1 -- 172.21.15.8:0/938691554 shutdown_connections 2024-03-23T23:43:39.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.156+0000 7f4510800640 1 -- 172.21.15.8:0/938691554 wait complete. 2024-03-23T23:43:39.177 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-03-23T23:43:39.177 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-03-23T23:43:39.177 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:43:39.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.316+0000 7f4988c00640 1 Processor -- start 2024-03-23T23:43:39.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.316+0000 7f4988c00640 1 -- start start 2024-03-23T23:43:39.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.316+0000 7f4988c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f49840c3d00 0x7f49840c4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:39.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.316+0000 7f4988c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4984152850 0x7f4984152c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:39.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.316+0000 7f4988c00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49840c2f70 con 0x7f498414fc70 2024-03-23T23:43:39.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.316+0000 7f4988c00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4984155e70 con 0x7f49840c3d00 2024-03-23T23:43:39.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.316+0000 7f4988c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4984156150 con 0x7f4984152850 2024-03-23T23:43:39.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.316+0000 7f4979400640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f49840c3d00 msgr2=0x7f49840c4160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:43:39.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.316+0000 7f4981e00640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f498414fc70 legacy=0x7f49840c3160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:43:39.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.316+0000 7f4979400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f49840c3d00 0x7f49840c4160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:43:39.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.320+0000 7f4982800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4984152850 0x7f4984152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:39.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.320+0000 7f4982800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4984152850 0x7f4984152c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:60240/0 (socket says 172.21.15.8:60240) 2024-03-23T23:43:39.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.320+0000 7f4982800640 1 -- 172.21.15.8:0/2417949192 learned_addr learned my addr 172.21.15.8:0/2417949192 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:39.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.320+0000 7f4982800640 1 -- 172.21.15.8:0/2417949192 >> v2:172.21.15.8:3300/0 conn(0x7f49840c3d00 msgr2=0x7f49840c4160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:43:39.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.320+0000 7f4982800640 1 --2- 172.21.15.8:0/2417949192 >> v2:172.21.15.8:3300/0 conn(0x7f49840c3d00 0x7f49840c4160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:39.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.320+0000 7f4982800640 1 -- 172.21.15.8:0/2417949192 >> v1:172.21.15.8:6789/0 conn(0x7f498414fc70 legacy=0x7f49840c3160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:43:39.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.320+0000 7f4982800640 1 -- 172.21.15.8:0/2417949192 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4984156430 con 0x7f4984152850 2024-03-23T23:43:39.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.320+0000 7f4982800640 1 --2- 172.21.15.8:0/2417949192 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4984152850 0x7f4984152c80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f498406de30 tx=0x7f497c01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b665cf95d2aa8ba5 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:39.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.320+0000 7f4981400640 1 -- 172.21.15.8:0/2417949192 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c0b0070 con 0x7f4984152850 2024-03-23T23:43:39.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.320+0000 7f4981400640 1 -- 172.21.15.8:0/2417949192 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497c0ab600 con 0x7f4984152850 2024-03-23T23:43:39.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.320+0000 7f4981400640 1 -- 172.21.15.8:0/2417949192 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c0ab9d0 con 0x7f4984152850 2024-03-23T23:43:39.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.324+0000 7f4988c00640 1 -- 172.21.15.8:0/2417949192 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4984152850 msgr2=0x7f4984152c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:39.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.324+0000 7f4988c00640 1 --2- 172.21.15.8:0/2417949192 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4984152850 0x7f4984152c80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f498406de30 tx=0x7f497c01c470 comp rx=0 tx=0).stop 2024-03-23T23:43:39.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.324+0000 7f4988c00640 1 -- 172.21.15.8:0/2417949192 shutdown_connections 2024-03-23T23:43:39.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.324+0000 7f4988c00640 1 --2- 172.21.15.8:0/2417949192 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4984152850 0x7f4984152c80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:39.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.324+0000 7f4988c00640 1 --2- 172.21.15.8:0/2417949192 >> v2:172.21.15.8:3300/0 conn(0x7f49840c3d00 0x7f49840c4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:39.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.324+0000 7f4988c00640 1 -- 172.21.15.8:0/2417949192 >> 172.21.15.8:0/2417949192 conn(0x7f498406b170 msgr2=0x7f498406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:39.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.324+0000 7f4988c00640 1 -- 172.21.15.8:0/2417949192 shutdown_connections 2024-03-23T23:43:39.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.324+0000 7f4988c00640 1 -- 172.21.15.8:0/2417949192 wait complete. 2024-03-23T23:43:39.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.324+0000 7f4988c00640 1 Processor -- start 2024-03-23T23:43:39.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.324+0000 7f4988c00640 1 -- start start 2024-03-23T23:43:39.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.324+0000 7f4988c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49840c3d00 0x7f49841f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:39.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.324+0000 7f4988c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f498414fc70 0x7f4984150550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:39.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.324+0000 7f4988c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4984152850 0x7f4984150a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:39.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.324+0000 7f4988c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498415f880 con 0x7f49840c3d00 2024-03-23T23:43:39.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.324+0000 7f4988c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4984150050 con 0x7f498414fc70 2024-03-23T23:43:39.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.324+0000 7f4988c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f498415fa00 con 0x7f4984152850 2024-03-23T23:43:39.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.324+0000 7f4981e00640 1 -- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49840c3d00 msgr2=0x7f49841f1eb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:43:39.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.324+0000 7f4981e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49840c3d00 0x7f49841f1eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:43:39.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.324+0000 7f4982800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4984152850 0x7f4984150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:39.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.324+0000 7f4979400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f498414fc70 0x7f4984150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:39.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.324+0000 7f4982800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4984152850 0x7f4984150a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:37152/0 (socket says 172.21.15.8:37152) 2024-03-23T23:43:39.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.324+0000 7f4982800640 1 -- 172.21.15.8:0/3211467472 learned_addr learned my addr 172.21.15.8:0/3211467472 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:39.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.324+0000 7f4982800640 1 -- 172.21.15.8:0/3211467472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f498414fc70 msgr2=0x7f4984150550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:39.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.324+0000 7f4982800640 1 --2- 172.21.15.8:0/3211467472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f498414fc70 0x7f4984150550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:39.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.324+0000 7f4982800640 1 -- 172.21.15.8:0/3211467472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49840c3d00 msgr2=0x7f49841f1eb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:43:39.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.324+0000 7f4982800640 1 --2- 172.21.15.8:0/3211467472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49840c3d00 0x7f49841f1eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:39.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.324+0000 7f4982800640 1 -- 172.21.15.8:0/3211467472 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4984068a10 con 0x7f4984152850 2024-03-23T23:43:39.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.324+0000 7f4982800640 1 --2- 172.21.15.8:0/3211467472 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4984152850 0x7f4984150a90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f497c01a0a0 tx=0x7f497c01acb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:39.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.328+0000 7f497aa00640 1 -- 172.21.15.8:0/3211467472 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c0ba020 con 0x7f4984152850 2024-03-23T23:43:39.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.328+0000 7f497aa00640 1 -- 172.21.15.8:0/3211467472 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497c0b6620 con 0x7f4984152850 2024-03-23T23:43:39.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.328+0000 7f4988c00640 1 -- 172.21.15.8:0/3211467472 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49841f2790 con 0x7f4984152850 2024-03-23T23:43:39.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.328+0000 7f497aa00640 1 -- 172.21.15.8:0/3211467472 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c0b0040 con 0x7f4984152850 2024-03-23T23:43:39.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.328+0000 7f4988c00640 1 -- 172.21.15.8:0/3211467472 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49841f2a30 con 0x7f4984152850 2024-03-23T23:43:39.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.328+0000 7f4988c00640 1 --2- 172.21.15.8:0/3211467472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f498414c610 0x7f4984154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:39.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.328+0000 7f4988c00640 1 -- 172.21.15.8:0/3211467472 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4984068270 con 0x7f498414c610 2024-03-23T23:43:39.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.328+0000 7f4981e00640 1 --2- 172.21.15.8:0/3211467472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f498414c610 0x7f4984154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:39.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.328+0000 7f4981e00640 1 -- 172.21.15.8:0/3211467472 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f49840c2ce0 con 0x7f498414c610 2024-03-23T23:43:39.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.328+0000 7f4981e00640 1 --2- 172.21.15.8:0/3211467472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f498414c610 0x7f4984154d10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f49740038c0 tx=0x7f497400b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:39.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.328+0000 7f497aa00640 1 -- 172.21.15.8:0/3211467472 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4974016070 con 0x7f498414c610 2024-03-23T23:43:39.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.328+0000 7f497aa00640 1 -- 172.21.15.8:0/3211467472 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f497c0bd020 con 0x7f4984152850 2024-03-23T23:43:39.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.328+0000 7f497aa00640 1 --2- 172.21.15.8:0/3211467472 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4960067590 0x7f4960069a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:39.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.328+0000 7f497aa00640 1 -- 172.21.15.8:0/3211467472 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f497c11fd50 con 0x7f4984152850 2024-03-23T23:43:39.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.328+0000 7f497aa00640 1 -- 172.21.15.8:0/3211467472 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f4974003d50 con 0x7f498414c610 2024-03-23T23:43:39.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.328+0000 7f497aa00640 1 -- 172.21.15.8:0/3211467472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f498414c610 msgr2=0x7f4984154d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:39.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.328+0000 7f497aa00640 1 --2- 172.21.15.8:0/3211467472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f498414c610 0x7f4984154d10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f49740038c0 tx=0x7f497400b8e0 comp rx=0 tx=0).stop 2024-03-23T23:43:39.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.328+0000 7f497aa00640 1 -- 172.21.15.8:0/3211467472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f498414c610 msgr2=0x7f4984154d10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:43:39.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.328+0000 7f497aa00640 1 --2- 172.21.15.8:0/3211467472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f498414c610 0x7f4984154d10 secure :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f49740038c0 tx=0x7f497400b8e0 comp rx=0 tx=0).stop 2024-03-23T23:43:39.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.328+0000 7f4979400640 1 --2- 172.21.15.8:0/3211467472 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4960067590 0x7f4960069a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:39.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.332+0000 7f4979400640 1 --2- 172.21.15.8:0/3211467472 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4960067590 0x7f4960069a50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f49840c82b0 tx=0x7f496c00d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:39.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.336+0000 7f4988c00640 1 --2- 172.21.15.8:0/3211467472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f49840ab290 0x7f49840ab6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:39.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.336+0000 7f4988c00640 1 -- 172.21.15.8:0/3211467472 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49840c1090 con 0x7f49840ab290 2024-03-23T23:43:39.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.336+0000 7f4981e00640 1 --2- 172.21.15.8:0/3211467472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f49840ab290 0x7f49840ab6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:39.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.336+0000 7f4981e00640 1 -- 172.21.15.8:0/3211467472 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f49840ad0e0 con 0x7f49840ab290 2024-03-23T23:43:39.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.336+0000 7f4981e00640 1 --2- 172.21.15.8:0/3211467472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f49840ab290 0x7f49840ab6a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f49740038c0 tx=0x7f49740059a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:39.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.336+0000 7f497aa00640 1 -- 172.21.15.8:0/3211467472 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49740054b0 con 0x7f49840ab290 2024-03-23T23:43:39.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.336+0000 7f497aa00640 1 -- 172.21.15.8:0/3211467472 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5172 (secure 0 0 0) 0x7f49740054b0 con 0x7f49840ab290 2024-03-23T23:43:39.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.336+0000 7f497aa00640 1 -- 172.21.15.8:0/3211467472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f49840ab290 msgr2=0x7f49840ab6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:39.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.336+0000 7f497aa00640 1 --2- 172.21.15.8:0/3211467472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f49840ab290 0x7f49840ab6a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f49740038c0 tx=0x7f49740059a0 comp rx=0 tx=0).stop 2024-03-23T23:43:39.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.336+0000 7f497aa00640 1 -- 172.21.15.8:0/3211467472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f49840ab290 msgr2=0x7f49840ab6a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:43:39.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.336+0000 7f497aa00640 1 --2- 172.21.15.8:0/3211467472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f49840ab290 0x7f49840ab6a0 secure :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f49740038c0 tx=0x7f49740059a0 comp rx=0 tx=0).stop 2024-03-23T23:43:39.341 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:43:39.341 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:43:39.341 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:43:39.341 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:43:39.341 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 6, 2024-03-23T23:43:39.341 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:43:39.341 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:43:39.341 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:43:39.341 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:43:39.341 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 0, 2024-03-23T23:43:39.341 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:43:39.341 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:43:39.342 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:43:39.342 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:43:39.342 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:43:39.342 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:43:39.342 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:43:39.342 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:43:39.342 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:43:39.342 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:43:39.342 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:43:39.342 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:43:39.342 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:43:39.342 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:43:39.342 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:43:39.343 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:43:39.343 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:43:39.343 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:43:39.343 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:43:39.343 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:43:39.343 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:43:39.343 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:43:39.343 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:43:39.343 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:43:39.343 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:43:39.343 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:43:39.343 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:43:39.343 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:43:39.343 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:43:39.344 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:39.344 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:43:39.344 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:43:39.344 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:43:39.344 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:43:39.344 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:43:39.344 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:43:39.344 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:43:39.344 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:43:39.344 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:43:39.344 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:43:39.344 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:43:39.344 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:43:39.344 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:43:39.345 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:43:39.345 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:43:39.345 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:43:39.345 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:43:39.345 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:43:39.345 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:43:39.345 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:43:39.345 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:43:39.345 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:43:39.345 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:43:39.345 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:43:39.345 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:43:39.345 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:43:39.345 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:43:39.346 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:43:39.346 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:43:39.346 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:43:39.346 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:39.346 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:43:39.346 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:39.346 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:43:39.346 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:43:39.346 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:43:39.346 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:43:39.346 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:39.346 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:43:39.346 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:43:39.346 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:43:39.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:39.347 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:39.347 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:43:39.347 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:43:39.347 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:43:39.347 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:39.347 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:43:39.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:39.347 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:43:39.347 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:43:39.347 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:43:39.347 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:43:39.347 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:43:39.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:39.348 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:39.348 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:43:39.348 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:43:39.348 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:43:39.348 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:43:39.348 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:39.348 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:43:39.348 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:43:39.348 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:43:39.348 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:39.348 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:39.348 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:43:39.349 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:43:39.349 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:43:39.349 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:39.349 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:43:39.349 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:39.349 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:43:39.349 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:43:39.349 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:43:39.349 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:43:39.349 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:43:39.349 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:39.349 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:39.349 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:43:39.349 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:43:39.350 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:43:39.350 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:43:39.350 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:39.350 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:43:39.350 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:43:39.350 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:43:39.350 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:39.350 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:39.350 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:43:39.350 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:43:39.350 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:43:39.350 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:39.350 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:43:39.351 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:39.351 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:43:39.351 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:43:39.351 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:43:39.351 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:43:39.351 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:43:39.351 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:39.351 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:43:39.351 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:39.351 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:43:39.351 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:43:39.351 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:39.351 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:43:39.352 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:43:39.352 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:43:39.352 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:39.352 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:43:39.352 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:43:39.352 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:39.352 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:43:39.352 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:43:39.352 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:43:39.352 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:39.352 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:43:39.352 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:43:39.352 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:39.353 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:43:39.353 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:43:39.353 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:43:39.353 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:39.353 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:43:39.353 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:43:39.353 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:39.353 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:43:39.353 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:43:39.353 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:43:39.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:39.353 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:39.353 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:43:39.354 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:43:39.354 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:43:39.354 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:39.354 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:43:39.354 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:43:39.354 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:39.354 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:43:39.354 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:43:39.354 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:43:39.354 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:39.354 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:43:39.355 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:39.355 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:43:39.355 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:43:39.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.336+0000 7f4988c00640 1 -- 172.21.15.8:0/3211467472 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4960067590 msgr2=0x7f4960069a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:39.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.336+0000 7f4988c00640 1 --2- 172.21.15.8:0/3211467472 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4960067590 0x7f4960069a50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f49840c82b0 tx=0x7f496c00d040 comp rx=0 tx=0).stop 2024-03-23T23:43:39.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.336+0000 7f4988c00640 1 -- 172.21.15.8:0/3211467472 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4984152850 msgr2=0x7f4984150a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:39.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.336+0000 7f4988c00640 1 --2- 172.21.15.8:0/3211467472 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4984152850 0x7f4984150a90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f497c01a0a0 tx=0x7f497c01acb0 comp rx=0 tx=0).stop 2024-03-23T23:43:39.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.336+0000 7f4982800640 1 -- 172.21.15.8:0/3211467472 reap_dead start 2024-03-23T23:43:39.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.336+0000 7f4982800640 1 -- 172.21.15.8:0/3211467472 reap_dead start 2024-03-23T23:43:39.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.336+0000 7f4988c00640 1 -- 172.21.15.8:0/3211467472 shutdown_connections 2024-03-23T23:43:39.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.336+0000 7f4988c00640 1 -- 172.21.15.8:0/3211467472 >> 172.21.15.8:0/3211467472 conn(0x7f498406b170 msgr2=0x7f49840c3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:39.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.340+0000 7f4988c00640 1 -- 172.21.15.8:0/3211467472 shutdown_connections 2024-03-23T23:43:39.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.340+0000 7f4988c00640 1 -- 172.21.15.8:0/3211467472 wait complete. 2024-03-23T23:43:39.359 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T23:43:39.359 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-03-23T23:43:39.359 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:43:39.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.500+0000 7fc328800640 1 Processor -- start 2024-03-23T23:43:39.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.500+0000 7fc328800640 1 -- start start 2024-03-23T23:43:39.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.500+0000 7fc328800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc32006d6e0 0x7fc320155a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:39.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.500+0000 7fc328800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc3200c4e40 0x7fc320155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:39.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.500+0000 7fc328800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3200c4340 con 0x7fc3200c8a50 2024-03-23T23:43:39.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.500+0000 7fc328800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3200c4740 con 0x7fc3200c4e40 2024-03-23T23:43:39.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.500+0000 7fc328800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3200c4060 con 0x7fc32006d6e0 2024-03-23T23:43:39.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.500+0000 7fc325e00640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7fc3200c8a50 legacy=0x7fc3200c2660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:43:39.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.500+0000 7fc325400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc32006d6e0 0x7fc320155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:39.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.500+0000 7fc326800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc3200c4e40 0x7fc320155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:39.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.500+0000 7fc325400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc32006d6e0 0x7fc320155a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:37162/0 (socket says 172.21.15.8:37162) 2024-03-23T23:43:39.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.500+0000 7fc325400640 1 -- 172.21.15.8:0/1841778410 learned_addr learned my addr 172.21.15.8:0/1841778410 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:39.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.500+0000 7fc325400640 1 -- 172.21.15.8:0/1841778410 >> v2:172.21.15.196:3300/0 conn(0x7fc3200c4e40 msgr2=0x7fc320155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:43:39.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.500+0000 7fc325400640 1 --2- 172.21.15.8:0/1841778410 >> v2:172.21.15.196:3300/0 conn(0x7fc3200c4e40 0x7fc320155fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:39.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.500+0000 7fc325400640 1 -- 172.21.15.8:0/1841778410 >> v1:172.21.15.8:6789/0 conn(0x7fc3200c8a50 legacy=0x7fc3200c2660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:43:39.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.500+0000 7fc325400640 1 -- 172.21.15.8:0/1841778410 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3200c3570 con 0x7fc32006d6e0 2024-03-23T23:43:39.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.504+0000 7fc325400640 1 --2- 172.21.15.8:0/1841778410 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc32006d6e0 0x7fc320155a60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc310009870 tx=0x7fc31001c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a94ad609bb2b7616 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:39.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.504+0000 7fc324a00640 1 -- 172.21.15.8:0/1841778410 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3100ab620 con 0x7fc32006d6e0 2024-03-23T23:43:39.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.504+0000 7fc324a00640 1 -- 172.21.15.8:0/1841778410 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3100b0070 con 0x7fc32006d6e0 2024-03-23T23:43:39.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.504+0000 7fc324a00640 1 -- 172.21.15.8:0/1841778410 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3100ab9e0 con 0x7fc32006d6e0 2024-03-23T23:43:39.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.504+0000 7fc328800640 1 -- 172.21.15.8:0/1841778410 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc32006d6e0 msgr2=0x7fc320155a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:39.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.504+0000 7fc328800640 1 --2- 172.21.15.8:0/1841778410 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc32006d6e0 0x7fc320155a60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc310009870 tx=0x7fc31001c460 comp rx=0 tx=0).stop 2024-03-23T23:43:39.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.504+0000 7fc328800640 1 -- 172.21.15.8:0/1841778410 shutdown_connections 2024-03-23T23:43:39.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.504+0000 7fc328800640 1 --2- 172.21.15.8:0/1841778410 >> v2:172.21.15.196:3300/0 conn(0x7fc3200c4e40 0x7fc320155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:39.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.504+0000 7fc328800640 1 --2- 172.21.15.8:0/1841778410 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc32006d6e0 0x7fc320155a60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:39.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.504+0000 7fc328800640 1 -- 172.21.15.8:0/1841778410 >> 172.21.15.8:0/1841778410 conn(0x7fc3200aafe0 msgr2=0x7fc3200ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:39.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.504+0000 7fc328800640 1 -- 172.21.15.8:0/1841778410 shutdown_connections 2024-03-23T23:43:39.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.504+0000 7fc328800640 1 -- 172.21.15.8:0/1841778410 wait complete. 2024-03-23T23:43:39.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.508+0000 7fc328800640 1 Processor -- start 2024-03-23T23:43:39.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.508+0000 7fc328800640 1 -- start start 2024-03-23T23:43:39.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.508+0000 7fc328800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3200c4e40 0x7fc320152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:39.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.508+0000 7fc328800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc3200c8a50 0x7fc320152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:39.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.508+0000 7fc328800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc3201edc10 0x7fc3201ee090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:39.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.508+0000 7fc328800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3200c8e30 con 0x7fc3200c4e40 2024-03-23T23:43:39.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.508+0000 7fc328800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32006e1e0 con 0x7fc3200c8a50 2024-03-23T23:43:39.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.508+0000 7fc328800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3201523a0 con 0x7fc3201edc10 2024-03-23T23:43:39.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.508+0000 7fc325e00640 1 -- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3200c4e40 msgr2=0x7fc320152830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:43:39.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.508+0000 7fc325e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3200c4e40 0x7fc320152830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:43:39.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.508+0000 7fc325400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc3200c8a50 0x7fc320152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:39.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.508+0000 7fc326800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc3201edc10 0x7fc3201ee090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:39.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.508+0000 7fc326800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc3201edc10 0x7fc3201ee090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:37168/0 (socket says 172.21.15.8:37168) 2024-03-23T23:43:39.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.508+0000 7fc326800640 1 -- 172.21.15.8:0/1263251820 learned_addr learned my addr 172.21.15.8:0/1263251820 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:39.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.508+0000 7fc325400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc3200c8a50 0x7fc320152d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:60284/0 (socket says 172.21.15.8:60284) 2024-03-23T23:43:39.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.508+0000 7fc326800640 1 -- 172.21.15.8:0/1263251820 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc3200c8a50 msgr2=0x7fc320152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:39.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.508+0000 7fc326800640 1 --2- 172.21.15.8:0/1263251820 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc3200c8a50 0x7fc320152d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:39.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.508+0000 7fc326800640 1 -- 172.21.15.8:0/1263251820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3200c4e40 msgr2=0x7fc320152830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:43:39.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.508+0000 7fc326800640 1 --2- 172.21.15.8:0/1263251820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3200c4e40 0x7fc320152830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:39.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.508+0000 7fc326800640 1 -- 172.21.15.8:0/1263251820 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3201eeb00 con 0x7fc3201edc10 2024-03-23T23:43:39.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.508+0000 7fc326800640 1 --2- 172.21.15.8:0/1263251820 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc3201edc10 0x7fc3201ee090 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc31c009dd0 tx=0x7fc31c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:39.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.508+0000 7fc31a000640 1 -- 172.21.15.8:0/1263251820 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c018020 con 0x7fc3201edc10 2024-03-23T23:43:39.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.508+0000 7fc31a000640 1 -- 172.21.15.8:0/1263251820 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31c014480 con 0x7fc3201edc10 2024-03-23T23:43:39.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.508+0000 7fc328800640 1 -- 172.21.15.8:0/1263251820 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc320157080 con 0x7fc3201edc10 2024-03-23T23:43:39.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.508+0000 7fc31a000640 1 -- 172.21.15.8:0/1263251820 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c014870 con 0x7fc3201edc10 2024-03-23T23:43:39.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.508+0000 7fc328800640 1 -- 172.21.15.8:0/1263251820 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc320157640 con 0x7fc3201edc10 2024-03-23T23:43:39.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.508+0000 7fc328800640 1 --2- 172.21.15.8:0/1263251820 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc3201ee5d0 0x7fc32014bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:39.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.508+0000 7fc328800640 1 -- 172.21.15.8:0/1263251820 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc320068270 con 0x7fc3201ee5d0 2024-03-23T23:43:39.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.512+0000 7fc325e00640 1 --2- 172.21.15.8:0/1263251820 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc3201ee5d0 0x7fc32014bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:39.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.512+0000 7fc325e00640 1 -- 172.21.15.8:0/1263251820 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc3200c8fb0 con 0x7fc3201ee5d0 2024-03-23T23:43:39.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.512+0000 7fc325e00640 1 --2- 172.21.15.8:0/1263251820 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc3201ee5d0 0x7fc32014bfc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc314003990 tx=0x7fc31400b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:39.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.512+0000 7fc31a000640 1 -- 172.21.15.8:0/1263251820 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc31c01b020 con 0x7fc3201edc10 2024-03-23T23:43:39.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.512+0000 7fc31a000640 1 --2- 172.21.15.8:0/1263251820 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc304067610 0x7fc304069ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:39.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.512+0000 7fc31a000640 1 -- 172.21.15.8:0/1263251820 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fc31c0865e0 con 0x7fc3201edc10 2024-03-23T23:43:39.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.512+0000 7fc325400640 1 --2- 172.21.15.8:0/1263251820 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc304067610 0x7fc304069ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:39.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.512+0000 7fc31a000640 1 -- 172.21.15.8:0/1263251820 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc314016070 con 0x7fc3201ee5d0 2024-03-23T23:43:39.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.512+0000 7fc31a000640 1 -- 172.21.15.8:0/1263251820 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fc314003dd0 con 0x7fc3201ee5d0 2024-03-23T23:43:39.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.512+0000 7fc31a000640 1 -- 172.21.15.8:0/1263251820 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc3201ee5d0 msgr2=0x7fc32014bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:39.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.512+0000 7fc31a000640 1 --2- 172.21.15.8:0/1263251820 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc3201ee5d0 0x7fc32014bfc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc314003990 tx=0x7fc31400b8e0 comp rx=0 tx=0).stop 2024-03-23T23:43:39.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.512+0000 7fc31a000640 1 -- 172.21.15.8:0/1263251820 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc3201ee5d0 msgr2=0x7fc32014bfc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:43:39.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.512+0000 7fc31a000640 1 --2- 172.21.15.8:0/1263251820 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc3201ee5d0 0x7fc32014bfc0 secure :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc314003990 tx=0x7fc31400b8e0 comp rx=0 tx=0).stop 2024-03-23T23:43:39.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.512+0000 7fc325400640 1 --2- 172.21.15.8:0/1263251820 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc304067610 0x7fc304069ad0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc3100af000 tx=0x7fc3100a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:39.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.524+0000 7fc328800640 1 --2- 172.21.15.8:0/1263251820 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc32006d6e0 0x7fc32014c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:39.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.524+0000 7fc328800640 1 -- 172.21.15.8:0/1263251820 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3200c32b0 con 0x7fc32006d6e0 2024-03-23T23:43:39.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.524+0000 7fc325e00640 1 --2- 172.21.15.8:0/1263251820 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc32006d6e0 0x7fc32014c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:39.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.528+0000 7fc325e00640 1 -- 172.21.15.8:0/1263251820 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc32006d230 con 0x7fc32006d6e0 2024-03-23T23:43:39.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.528+0000 7fc325e00640 1 --2- 172.21.15.8:0/1263251820 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc32006d6e0 0x7fc32014c500 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc314013000 tx=0x7fc3140059e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:39.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.528+0000 7fc31a000640 1 -- 172.21.15.8:0/1263251820 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc314016050 con 0x7fc32006d6e0 2024-03-23T23:43:39.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.528+0000 7fc31a000640 1 -- 172.21.15.8:0/1263251820 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5000 (secure 0 0 0) 0x7fc314017040 con 0x7fc32006d6e0 2024-03-23T23:43:39.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.528+0000 7fc31a000640 1 -- 172.21.15.8:0/1263251820 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc32006d6e0 msgr2=0x7fc32014c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:39.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.528+0000 7fc31a000640 1 --2- 172.21.15.8:0/1263251820 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc32006d6e0 0x7fc32014c500 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc314013000 tx=0x7fc3140059e0 comp rx=0 tx=0).stop 2024-03-23T23:43:39.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.528+0000 7fc31a000640 1 -- 172.21.15.8:0/1263251820 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc32006d6e0 msgr2=0x7fc32014c500 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:43:39.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.528+0000 7fc31a000640 1 --2- 172.21.15.8:0/1263251820 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc32006d6e0 0x7fc32014c500 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:39.530 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:43:39.530 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:43:39.530 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:43:39.530 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:43:39.530 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 6, 2024-03-23T23:43:39.531 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:43:39.531 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:43:39.531 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:43:39.531 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:43:39.531 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 0, 2024-03-23T23:43:39.531 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:43:39.531 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:43:39.531 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:43:39.531 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:43:39.531 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:43:39.531 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:43:39.532 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:43:39.532 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:43:39.532 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:43:39.532 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:43:39.532 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:43:39.532 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:43:39.532 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:43:39.532 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:43:39.532 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:43:39.532 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:43:39.532 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:43:39.532 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:43:39.533 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:43:39.533 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:43:39.533 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:43:39.533 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:43:39.533 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:43:39.533 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:43:39.533 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:43:39.533 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:43:39.533 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:43:39.533 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:43:39.533 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:43:39.534 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:39.534 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:43:39.534 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:43:39.534 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:43:39.534 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:43:39.534 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:43:39.534 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:43:39.534 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:43:39.534 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:43:39.534 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:43:39.534 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:43:39.534 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:43:39.535 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:43:39.535 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:43:39.535 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:43:39.535 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:43:39.535 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:43:39.535 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:43:39.535 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:43:39.535 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:43:39.535 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:43:39.535 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:43:39.535 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:43:39.536 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:43:39.536 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:43:39.536 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:43:39.536 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:43:39.536 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:43:39.536 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:43:39.536 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:43:39.536 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:43:39.536 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:39.536 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:43:39.536 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:39.536 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:43:39.536 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:43:39.537 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:43:39.537 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:43:39.537 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:39.537 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:43:39.537 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:43:39.537 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:43:39.537 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:39.537 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:39.537 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:43:39.537 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:43:39.537 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:43:39.537 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:39.537 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:43:39.537 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:39.538 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:43:39.538 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:43:39.538 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:43:39.538 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:43:39.538 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:43:39.538 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:39.538 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:39.538 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:43:39.538 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:43:39.538 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:43:39.538 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:43:39.538 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:39.538 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:43:39.539 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:43:39.539 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:43:39.539 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:39.539 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:39.539 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:43:39.539 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:43:39.539 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:43:39.539 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:39.539 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:43:39.539 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:39.539 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:43:39.539 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:43:39.539 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:43:39.539 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:43:39.540 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:43:39.540 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:39.540 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:39.540 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:43:39.540 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:43:39.540 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:43:39.540 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:43:39.540 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:39.540 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:43:39.540 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:43:39.540 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:43:39.540 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:39.540 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:39.540 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:43:39.541 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:43:39.541 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:43:39.541 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:39.541 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:43:39.541 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:39.541 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:43:39.541 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:43:39.541 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:43:39.541 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:43:39.541 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:43:39.541 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:39.541 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:43:39.541 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:39.541 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:43:39.542 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:43:39.542 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:39.542 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:43:39.542 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:43:39.542 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:43:39.542 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:39.542 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:43:39.542 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:43:39.542 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:39.542 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:43:39.542 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:43:39.542 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:43:39.542 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:39.542 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:43:39.543 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:43:39.543 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:39.543 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:43:39.543 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:43:39.543 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5 2024-03-23T23:43:39.543 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:39.543 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:43:39.543 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:43:39.544 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:39.544 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:43:39.544 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:43:39.544 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:43:39.544 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:39.544 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:43:39.544 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:43:39.544 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:43:39.544 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:43:39.544 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:43:39.544 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:43:39.544 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:43:39.544 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:43:39.544 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:43:39.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.528+0000 7fc328800640 1 -- 172.21.15.8:0/1263251820 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc304067610 msgr2=0x7fc304069ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:39.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.528+0000 7fc328800640 1 --2- 172.21.15.8:0/1263251820 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc304067610 0x7fc304069ad0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc3100af000 tx=0x7fc3100a7000 comp rx=0 tx=0).stop 2024-03-23T23:43:39.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.528+0000 7fc328800640 1 -- 172.21.15.8:0/1263251820 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc3201edc10 msgr2=0x7fc3201ee090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:39.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.528+0000 7fc328800640 1 --2- 172.21.15.8:0/1263251820 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc3201edc10 0x7fc3201ee090 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc31c009dd0 tx=0x7fc31c00c490 comp rx=0 tx=0).stop 2024-03-23T23:43:39.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.528+0000 7fc326800640 1 -- 172.21.15.8:0/1263251820 reap_dead start 2024-03-23T23:43:39.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.528+0000 7fc326800640 1 -- 172.21.15.8:0/1263251820 reap_dead start 2024-03-23T23:43:39.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.528+0000 7fc328800640 1 -- 172.21.15.8:0/1263251820 shutdown_connections 2024-03-23T23:43:39.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.528+0000 7fc328800640 1 -- 172.21.15.8:0/1263251820 >> 172.21.15.8:0/1263251820 conn(0x7fc3200aafe0 msgr2=0x7fc3200703f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:39.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.528+0000 7fc328800640 1 -- 172.21.15.8:0/1263251820 shutdown_connections 2024-03-23T23:43:39.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:39.528+0000 7fc328800640 1 -- 172.21.15.8:0/1263251820 wait complete. 2024-03-23T23:43:39.548 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T23:43:39.548 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-03-23T23:43:40.555 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:43:40.560 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:43:59.549 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-03-23T23:43:59.550 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-03-23T23:43:59.550 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-23T23:43:59.550 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-23T23:43:59.554 INFO:tasks.ceph.mon.a:Started 2024-03-23T23:43:59.554 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T23:43:59.554 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:43:59.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.712+0000 7f44dae00640 1 Processor -- start 2024-03-23T23:43:59.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.712+0000 7f44dae00640 1 -- start start 2024-03-23T23:43:59.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.716+0000 7f44dae00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44d4071030 0x7f44d40abf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:59.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.716+0000 7f44dae00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f44d40c4af0 0x7f44d4157180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:59.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.716+0000 7f44dae00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44d40c86a0 con 0x7f44d40c89b0 2024-03-23T23:43:59.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.716+0000 7f44dae00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44d40c52a0 con 0x7f44d40c4af0 2024-03-23T23:43:59.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.716+0000 7f44dae00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d40c5580 con 0x7f44d4071030 2024-03-23T23:43:59.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.716+0000 7f44da400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f44d40c4af0 0x7f44d4157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:59.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.716+0000 7f44da400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f44d40c4af0 0x7f44d4157180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34540/0 (socket says 172.21.15.8:34540) 2024-03-23T23:43:59.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.716+0000 7f44da400640 1 -- 172.21.15.8:0/3602675919 learned_addr learned my addr 172.21.15.8:0/3602675919 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:59.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.716+0000 7f44d9a00640 1 --2- 172.21.15.8:0/3602675919 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44d4071030 0x7f44d40abf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:59.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.716+0000 7f44d9000640 1 --1- 172.21.15.8:0/3602675919 >> v1:172.21.15.8:6789/0 conn(0x7f44d40c89b0 0x7f44d40c7f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:55082/0 (socket says 172.21.15.8:55082) 2024-03-23T23:43:59.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.716+0000 7f44da400640 1 -- 172.21.15.8:0/3602675919 >> v2:172.21.15.8:3300/0 conn(0x7f44d40c4af0 msgr2=0x7f44d4157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T23:43:59.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.716+0000 7f44da400640 1 -- 172.21.15.8:0/3602675919 >> v2:172.21.15.8:3300/0 conn(0x7f44d40c4af0 msgr2=0x7f44d4157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:43:59.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.716+0000 7f44da400640 1 --2- 172.21.15.8:0/3602675919 >> v2:172.21.15.8:3300/0 conn(0x7f44d40c4af0 0x7f44d4157180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:43:59.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.716+0000 7f44da400640 1 --2- 172.21.15.8:0/3602675919 >> v2:172.21.15.8:3300/0 conn(0x7f44d40c4af0 0x7f44d4157180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:43:59.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.716+0000 7f44d9a00640 1 -- 172.21.15.8:0/3602675919 >> v2:172.21.15.8:3300/0 conn(0x7f44d40c4af0 msgr2=0x7f44d4157180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:43:59.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.716+0000 7f44d9a00640 1 --2- 172.21.15.8:0/3602675919 >> v2:172.21.15.8:3300/0 conn(0x7f44d40c4af0 0x7f44d4157180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:59.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.716+0000 7f44d9a00640 1 -- 172.21.15.8:0/3602675919 >> v1:172.21.15.8:6789/0 conn(0x7f44d40c89b0 legacy=0x7f44d40c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:59.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.716+0000 7f44d9a00640 1 -- 172.21.15.8:0/3602675919 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d40c7790 con 0x7f44d4071030 2024-03-23T23:43:59.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.720+0000 7f44d9a00640 1 --2- 172.21.15.8:0/3602675919 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44d4071030 0x7f44d40abf30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f44c800dbe0 tx=0x7f44c8020720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36674526923dad7 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:59.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.720+0000 7f44d3e00640 1 -- 172.21.15.8:0/3602675919 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c80b0070 con 0x7f44d4071030 2024-03-23T23:43:59.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.720+0000 7f44d3e00640 1 -- 172.21.15.8:0/3602675919 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c800d0d0 con 0x7f44d4071030 2024-03-23T23:43:59.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.720+0000 7f44d3e00640 1 -- 172.21.15.8:0/3602675919 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c80ac680 con 0x7f44d4071030 2024-03-23T23:43:59.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.720+0000 7f44dae00640 1 -- 172.21.15.8:0/3602675919 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44d4071030 msgr2=0x7f44d40abf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:59.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.720+0000 7f44dae00640 1 --2- 172.21.15.8:0/3602675919 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44d4071030 0x7f44d40abf30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f44c800dbe0 tx=0x7f44c8020720 comp rx=0 tx=0).stop 2024-03-23T23:43:59.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.720+0000 7f44dae00640 1 -- 172.21.15.8:0/3602675919 shutdown_connections 2024-03-23T23:43:59.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.720+0000 7f44dae00640 1 --2- 172.21.15.8:0/3602675919 >> v2:172.21.15.8:3300/0 conn(0x7f44d40c4af0 0x7f44d4157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:59.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.720+0000 7f44dae00640 1 --2- 172.21.15.8:0/3602675919 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44d4071030 0x7f44d40abf30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:59.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.720+0000 7f44dae00640 1 -- 172.21.15.8:0/3602675919 >> 172.21.15.8:0/3602675919 conn(0x7f44d40aac30 msgr2=0x7f44d40ab040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:59.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.720+0000 7f44dae00640 1 -- 172.21.15.8:0/3602675919 shutdown_connections 2024-03-23T23:43:59.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.720+0000 7f44dae00640 1 -- 172.21.15.8:0/3602675919 wait complete. 2024-03-23T23:43:59.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.720+0000 7f44dae00640 1 Processor -- start 2024-03-23T23:43:59.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.720+0000 7f44dae00640 1 -- start start 2024-03-23T23:43:59.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.724+0000 7f44dae00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44d4071030 0x7f44d40ae140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:59.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.724+0000 7f44dae00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44d40c4af0 0x7f44d4149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:59.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.724+0000 7f44dae00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44d40c89b0 0x7f44d41ed370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:59.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.724+0000 7f44dae00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d4157ad0 con 0x7f44d40c4af0 2024-03-23T23:43:59.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.724+0000 7f44dae00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d4071620 con 0x7f44d4071030 2024-03-23T23:43:59.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.724+0000 7f44dae00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d415e930 con 0x7f44d40c89b0 2024-03-23T23:43:59.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.724+0000 7f44d9000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44d40c4af0 0x7f44d4149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:59.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.724+0000 7f44d9a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44d4071030 0x7f44d40ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:59.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.724+0000 7f44d9000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44d40c4af0 0x7f44d4149710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34554/0 (socket says 172.21.15.8:34554) 2024-03-23T23:43:59.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.724+0000 7f44d9000640 1 -- 172.21.15.8:0/2065466786 learned_addr learned my addr 172.21.15.8:0/2065466786 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:43:59.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.724+0000 7f44d9a00640 1 --2- 172.21.15.8:0/2065466786 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44d4071030 0x7f44d40ae140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:43630/0 (socket says 172.21.15.8:43630) 2024-03-23T23:43:59.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.724+0000 7f44da400640 1 --2- 172.21.15.8:0/2065466786 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44d40c89b0 0x7f44d41ed370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:59.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.724+0000 7f44d9000640 1 -- 172.21.15.8:0/2065466786 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44d40c4af0 msgr2=0x7f44d4149710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-03-23T23:43:59.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.724+0000 7f44d9000640 1 -- 172.21.15.8:0/2065466786 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44d40c4af0 msgr2=0x7f44d4149710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T23:43:59.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.724+0000 7f44d9000640 1 --2- 172.21.15.8:0/2065466786 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44d40c4af0 0x7f44d4149710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:43:59.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.724+0000 7f44d9000640 1 --2- 172.21.15.8:0/2065466786 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44d40c4af0 0x7f44d4149710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:43:59.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.724+0000 7f44d9a00640 1 -- 172.21.15.8:0/2065466786 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44d40c89b0 msgr2=0x7f44d41ed370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:59.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.724+0000 7f44d9a00640 1 --2- 172.21.15.8:0/2065466786 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44d40c89b0 0x7f44d41ed370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:59.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.724+0000 7f44d9a00640 1 -- 172.21.15.8:0/2065466786 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44d40c4af0 msgr2=0x7f44d4149710 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:43:59.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.724+0000 7f44d9a00640 1 --2- 172.21.15.8:0/2065466786 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44d40c4af0 0x7f44d4149710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:59.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.724+0000 7f44d9a00640 1 -- 172.21.15.8:0/2065466786 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d4149c50 con 0x7f44d4071030 2024-03-23T23:43:59.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.724+0000 7f44d9a00640 1 --2- 172.21.15.8:0/2065466786 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44d4071030 0x7f44d40ae140 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f44c80af000 tx=0x7f44c801d4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:59.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.724+0000 7f44d1600640 1 -- 172.21.15.8:0/2065466786 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c80b0040 con 0x7f44d4071030 2024-03-23T23:43:59.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.724+0000 7f44d1600640 1 -- 172.21.15.8:0/2065466786 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c80b5650 con 0x7f44d4071030 2024-03-23T23:43:59.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.724+0000 7f44d1600640 1 -- 172.21.15.8:0/2065466786 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c8006e20 con 0x7f44d4071030 2024-03-23T23:43:59.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.724+0000 7f44dae00640 1 -- 172.21.15.8:0/2065466786 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44d40ad3e0 con 0x7f44d4071030 2024-03-23T23:43:59.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.724+0000 7f44dae00640 1 -- 172.21.15.8:0/2065466786 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d40adc20 con 0x7f44d4071030 2024-03-23T23:43:59.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.724+0000 7f44dae00640 1 -- 172.21.15.8:0/2065466786 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44d404f410 con 0x7f44d4071030 2024-03-23T23:43:59.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.728+0000 7f44d1600640 1 -- 172.21.15.8:0/2065466786 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f44c80b3070 con 0x7f44d4071030 2024-03-23T23:43:59.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.728+0000 7f44d1600640 1 --2- 172.21.15.8:0/2065466786 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f44b4067660 0x7f44b4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:43:59.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.728+0000 7f44d1600640 1 -- 172.21.15.8:0/2065466786 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f44c8124070 con 0x7f44d4071030 2024-03-23T23:43:59.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.728+0000 7f44d9000640 1 --2- 172.21.15.8:0/2065466786 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f44b4067660 0x7f44b4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:43:59.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.728+0000 7f44d9000640 1 --2- 172.21.15.8:0/2065466786 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f44b4067660 0x7f44b4069b20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f44c0007fd0 tx=0x7f44c0007d40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:43:59.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.732+0000 7f44d1600640 1 -- 172.21.15.8:0/2065466786 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f44d40ad3e0 con 0x7f44d4071030 2024-03-23T23:43:59.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.964+0000 7f44dae00640 1 -- 172.21.15.8:0/2065466786 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f44d40ab410 con 0x7f44d4071030 2024-03-23T23:43:59.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.964+0000 7f44d1600640 1 -- 172.21.15.8:0/2065466786 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1560 (secure 0 0 0) 0x7f44c801a3a0 con 0x7f44d4071030 2024-03-23T23:43:59.968 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:43:59.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.968+0000 7f44dae00640 1 -- 172.21.15.8:0/2065466786 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f44b4067660 msgr2=0x7f44b4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:59.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.968+0000 7f44dae00640 1 --2- 172.21.15.8:0/2065466786 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f44b4067660 0x7f44b4069b20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f44c0007fd0 tx=0x7f44c0007d40 comp rx=0 tx=0).stop 2024-03-23T23:43:59.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.968+0000 7f44dae00640 1 -- 172.21.15.8:0/2065466786 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44d4071030 msgr2=0x7f44d40ae140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:43:59.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.968+0000 7f44dae00640 1 --2- 172.21.15.8:0/2065466786 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44d4071030 0x7f44d40ae140 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f44c80af000 tx=0x7f44c801d4c0 comp rx=0 tx=0).stop 2024-03-23T23:43:59.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.968+0000 7f44dae00640 1 -- 172.21.15.8:0/2065466786 shutdown_connections 2024-03-23T23:43:59.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.968+0000 7f44dae00640 1 --2- 172.21.15.8:0/2065466786 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f44b4067660 0x7f44b4069b20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:59.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.968+0000 7f44dae00640 1 --2- 172.21.15.8:0/2065466786 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44d40c89b0 0x7f44d41ed370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:59.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.968+0000 7f44dae00640 1 --2- 172.21.15.8:0/2065466786 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44d40c4af0 0x7f44d4149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:59.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.968+0000 7f44dae00640 1 --2- 172.21.15.8:0/2065466786 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44d4071030 0x7f44d40ae140 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:43:59.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.968+0000 7f44dae00640 1 -- 172.21.15.8:0/2065466786 >> 172.21.15.8:0/2065466786 conn(0x7f44d40aac30 msgr2=0x7f44d40a9320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:43:59.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.968+0000 7f44dae00640 1 -- 172.21.15.8:0/2065466786 shutdown_connections 2024-03-23T23:43:59.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:43:59.968+0000 7f44dae00640 1 -- 172.21.15.8:0/2065466786 wait complete. 2024-03-23T23:43:59.993 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T23:43:59.993 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T23:43:59.993 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:44:00.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.148+0000 7fc19a200640 1 Processor -- start 2024-03-23T23:44:00.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.148+0000 7fc19a200640 1 -- start start 2024-03-23T23:44:00.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.148+0000 7fc19a200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc194072010 0x7fc1940aab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:00.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.148+0000 7fc19a200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc194153f20 0x7fc1941543b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:00.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.148+0000 7fc19a200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1941578b0 con 0x7fc194150e10 2024-03-23T23:44:00.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.148+0000 7fc19a200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc194153a90 con 0x7fc194153f20 2024-03-23T23:44:00.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.148+0000 7fc19a200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc194157b50 con 0x7fc194072010 2024-03-23T23:44:00.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.148+0000 7fc193e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc194153f20 0x7fc1941543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:00.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.148+0000 7fc193e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc194153f20 0x7fc1941543b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:43658/0 (socket says 172.21.15.8:43658) 2024-03-23T23:44:00.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.148+0000 7fc193e00640 1 -- 172.21.15.8:0/2653087411 learned_addr learned my addr 172.21.15.8:0/2653087411 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:44:00.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.148+0000 7fc18be00640 1 --2- 172.21.15.8:0/2653087411 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc194072010 0x7fc1940aab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:00.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.152+0000 7fc193e00640 1 -- 172.21.15.8:0/2653087411 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc194072010 msgr2=0x7fc1940aab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:44:00.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.152+0000 7fc193e00640 1 --2- 172.21.15.8:0/2653087411 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc194072010 0x7fc1940aab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:00.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.152+0000 7fc193e00640 1 -- 172.21.15.8:0/2653087411 >> v1:172.21.15.196:6789/0 conn(0x7fc194150e10 legacy=0x7fc1940ad6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:00.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.152+0000 7fc193e00640 1 -- 172.21.15.8:0/2653087411 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1941511f0 con 0x7fc194153f20 2024-03-23T23:44:00.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.152+0000 7fc193e00640 1 --2- 172.21.15.8:0/2653087411 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc194153f20 0x7fc1941543b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009e50 tx=0x7fc18c01c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8af59c29da28c98 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:00.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.152+0000 7fc192a00640 1 -- 172.21.15.8:0/2653087411 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c0a5770 con 0x7fc194153f20 2024-03-23T23:44:00.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.156+0000 7fc192a00640 1 -- 172.21.15.8:0/2653087411 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18c0a5910 con 0x7fc194153f20 2024-03-23T23:44:00.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.156+0000 7fc192a00640 1 -- 172.21.15.8:0/2653087411 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c0a5ce0 con 0x7fc194153f20 2024-03-23T23:44:00.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.156+0000 7fc19a200640 1 -- 172.21.15.8:0/2653087411 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc194153f20 msgr2=0x7fc1941543b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:00.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.156+0000 7fc19a200640 1 --2- 172.21.15.8:0/2653087411 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc194153f20 0x7fc1941543b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009e50 tx=0x7fc18c01c9a0 comp rx=0 tx=0).stop 2024-03-23T23:44:00.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.156+0000 7fc19a200640 1 -- 172.21.15.8:0/2653087411 shutdown_connections 2024-03-23T23:44:00.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.156+0000 7fc19a200640 1 --2- 172.21.15.8:0/2653087411 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc194153f20 0x7fc1941543b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:00.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.156+0000 7fc19a200640 1 --2- 172.21.15.8:0/2653087411 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc194072010 0x7fc1940aab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:00.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.156+0000 7fc19a200640 1 -- 172.21.15.8:0/2653087411 >> 172.21.15.8:0/2653087411 conn(0x7fc1940c8280 msgr2=0x7fc1940c8690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:44:00.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.156+0000 7fc19a200640 1 -- 172.21.15.8:0/2653087411 shutdown_connections 2024-03-23T23:44:00.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.156+0000 7fc19a200640 1 -- 172.21.15.8:0/2653087411 wait complete. 2024-03-23T23:44:00.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.156+0000 7fc19a200640 1 Processor -- start 2024-03-23T23:44:00.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.156+0000 7fc19a200640 1 -- start start 2024-03-23T23:44:00.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.156+0000 7fc19a200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc194072010 0x7fc194151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:00.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.156+0000 7fc19a200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc194150e10 0x7fc1940c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:00.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.160+0000 7fc19a200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc194153f20 0x7fc194154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:00.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.160+0000 7fc19a200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1940adf40 con 0x7fc194150e10 2024-03-23T23:44:00.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.160+0000 7fc19a200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1940addc0 con 0x7fc194072010 2024-03-23T23:44:00.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.160+0000 7fc19a200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc19406ed20 con 0x7fc194153f20 2024-03-23T23:44:00.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.160+0000 7fc18be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc194150e10 0x7fc1940c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:00.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.160+0000 7fc193400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc194072010 0x7fc194151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:00.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.160+0000 7fc18be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc194150e10 0x7fc1940c74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34558/0 (socket says 172.21.15.8:34558) 2024-03-23T23:44:00.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.160+0000 7fc18be00640 1 -- 172.21.15.8:0/1050185857 learned_addr learned my addr 172.21.15.8:0/1050185857 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:44:00.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.160+0000 7fc193e00640 1 --2- 172.21.15.8:0/1050185857 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc194153f20 0x7fc194154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:00.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.160+0000 7fc18be00640 1 -- 172.21.15.8:0/1050185857 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc194153f20 msgr2=0x7fc194154be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:00.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.160+0000 7fc18be00640 1 --2- 172.21.15.8:0/1050185857 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc194153f20 0x7fc194154be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:00.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.160+0000 7fc18be00640 1 -- 172.21.15.8:0/1050185857 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc194072010 msgr2=0x7fc194151680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:00.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.160+0000 7fc18be00640 1 --2- 172.21.15.8:0/1050185857 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc194072010 0x7fc194151680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:00.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.160+0000 7fc18be00640 1 -- 172.21.15.8:0/1050185857 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc194151bc0 con 0x7fc194150e10 2024-03-23T23:44:00.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.160+0000 7fc193e00640 1 --2- 172.21.15.8:0/1050185857 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc194153f20 0x7fc194154be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:44:00.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.160+0000 7fc18be00640 1 --2- 172.21.15.8:0/1050185857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc194150e10 0x7fc1940c74f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc17c00e840 tx=0x7fc17c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:00.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.160+0000 7fc18b400640 1 -- 172.21.15.8:0/1050185857 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c017070 con 0x7fc194150e10 2024-03-23T23:44:00.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.160+0000 7fc18b400640 1 -- 172.21.15.8:0/1050185857 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17c00ee90 con 0x7fc194150e10 2024-03-23T23:44:00.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.160+0000 7fc19a200640 1 -- 172.21.15.8:0/1050185857 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc194156e60 con 0x7fc194150e10 2024-03-23T23:44:00.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.160+0000 7fc18b400640 1 -- 172.21.15.8:0/1050185857 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c00cb20 con 0x7fc194150e10 2024-03-23T23:44:00.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.160+0000 7fc19a200640 1 -- 172.21.15.8:0/1050185857 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc194150160 con 0x7fc194150e10 2024-03-23T23:44:00.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.160+0000 7fc19a200640 1 --2- 172.21.15.8:0/1050185857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1940c7e80 0x7fc19413eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:00.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.160+0000 7fc19a200640 1 -- 172.21.15.8:0/1050185857 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc194068980 con 0x7fc1940c7e80 2024-03-23T23:44:00.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.160+0000 7fc193400640 1 --2- 172.21.15.8:0/1050185857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1940c7e80 0x7fc19413eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:00.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.160+0000 7fc193400640 1 -- 172.21.15.8:0/1050185857 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc19415df70 con 0x7fc1940c7e80 2024-03-23T23:44:00.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.160+0000 7fc193400640 1 --2- 172.21.15.8:0/1050185857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1940c7e80 0x7fc19413eab0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc18400f540 tx=0x7fc18400fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:00.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.164+0000 7fc18b400640 1 -- 172.21.15.8:0/1050185857 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc184019070 con 0x7fc1940c7e80 2024-03-23T23:44:00.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.164+0000 7fc18b400640 1 -- 172.21.15.8:0/1050185857 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fc184005320 con 0x7fc1940c7e80 2024-03-23T23:44:00.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.164+0000 7fc18b400640 1 -- 172.21.15.8:0/1050185857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1940c7e80 msgr2=0x7fc19413eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:00.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.164+0000 7fc18b400640 1 --2- 172.21.15.8:0/1050185857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1940c7e80 0x7fc19413eab0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc18400f540 tx=0x7fc18400fa00 comp rx=0 tx=0).stop 2024-03-23T23:44:00.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.164+0000 7fc18b400640 1 -- 172.21.15.8:0/1050185857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1940c7e80 msgr2=0x7fc19413eab0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:44:00.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.164+0000 7fc18b400640 1 --2- 172.21.15.8:0/1050185857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1940c7e80 0x7fc19413eab0 secure :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc18400f540 tx=0x7fc18400fa00 comp rx=0 tx=0).stop 2024-03-23T23:44:00.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.164+0000 7fc18b400640 1 -- 172.21.15.8:0/1050185857 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc17c01a070 con 0x7fc194150e10 2024-03-23T23:44:00.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.164+0000 7fc18b400640 1 --2- 172.21.15.8:0/1050185857 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc170067170 0x7fc170069630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:00.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.164+0000 7fc18b400640 1 -- 172.21.15.8:0/1050185857 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fc17c0859d0 con 0x7fc194150e10 2024-03-23T23:44:00.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.164+0000 7fc193400640 1 --2- 172.21.15.8:0/1050185857 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc170067170 0x7fc170069630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:00.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.168+0000 7fc193400640 1 --2- 172.21.15.8:0/1050185857 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc170067170 0x7fc170069630 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc184010010 tx=0x7fc184004000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:00.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.168+0000 7fc19a200640 1 --2- 172.21.15.8:0/1050185857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1940c6ee0 0x7fc19413eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:00.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.168+0000 7fc19a200640 1 -- 172.21.15.8:0/1050185857 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19406f070 con 0x7fc1940c6ee0 2024-03-23T23:44:00.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.172+0000 7fc193e00640 1 --2- 172.21.15.8:0/1050185857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1940c6ee0 0x7fc19413eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:00.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.172+0000 7fc193e00640 1 -- 172.21.15.8:0/1050185857 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc194157030 con 0x7fc1940c6ee0 2024-03-23T23:44:00.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.172+0000 7fc193e00640 1 --2- 172.21.15.8:0/1050185857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1940c6ee0 0x7fc19413eff0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc1940754b0 tx=0x7fc18c019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:00.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.172+0000 7fc18b400640 1 -- 172.21.15.8:0/1050185857 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c009510 con 0x7fc1940c6ee0 2024-03-23T23:44:00.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.172+0000 7fc18b400640 1 -- 172.21.15.8:0/1050185857 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4531 (secure 0 0 0) 0x7fc18c0c0430 con 0x7fc1940c6ee0 2024-03-23T23:44:00.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.172+0000 7fc18b400640 1 -- 172.21.15.8:0/1050185857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1940c6ee0 msgr2=0x7fc19413eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:00.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.172+0000 7fc18b400640 1 --2- 172.21.15.8:0/1050185857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1940c6ee0 0x7fc19413eff0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc1940754b0 tx=0x7fc18c019740 comp rx=0 tx=0).stop 2024-03-23T23:44:00.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.172+0000 7fc18b400640 1 -- 172.21.15.8:0/1050185857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1940c6ee0 msgr2=0x7fc19413eff0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:44:00.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.172+0000 7fc18b400640 1 --2- 172.21.15.8:0/1050185857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1940c6ee0 0x7fc19413eff0 secure :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc1940754b0 tx=0x7fc18c019740 comp rx=0 tx=0).stop 2024-03-23T23:44:00.174 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:44:00.174 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:44:00.175 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:44:00.175 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:44:00.175 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 10, 2024-03-23T23:44:00.175 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:44:00.175 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:44:00.175 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:44:00.175 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:44:00.175 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:00.176 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 0, 2024-03-23T23:44:00.176 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:44:00.176 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:44:00.176 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:44:00.176 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:44:00.176 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:44:00.176 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:44:00.176 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:44:00.176 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:44:00.176 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:44:00.177 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:44:00.177 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:44:00.177 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:44:00.177 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:44:00.177 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:44:00.177 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:00.177 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:44:00.177 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:44:00.177 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:44:00.177 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:44:00.177 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:44:00.178 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:44:00.178 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:44:00.178 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:44:00.178 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:44:00.178 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:44:00.178 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:44:00.178 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:44:00.178 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:44:00.178 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:00.178 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.178 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:44:00.178 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:44:00.179 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:44:00.179 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:44:00.179 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:44:00.179 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:44:00.179 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:44:00.179 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:44:00.179 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:44:00.179 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:44:00.179 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:44:00.179 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:44:00.179 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:44:00.179 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:44:00.179 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:44:00.180 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:44:00.180 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:44:00.180 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:44:00.180 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:44:00.180 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:44:00.180 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:44:00.180 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:44:00.180 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:44:00.180 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:44:00.180 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:44:00.180 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:44:00.180 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:44:00.180 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:44:00.181 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:00.181 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:44:00.181 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.181 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:44:00.181 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.181 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:44:00.181 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:44:00.181 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:44:00.181 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:44:00.181 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.181 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:44:00.181 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:44:00.181 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:00.181 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.182 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.182 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:44:00.182 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:44:00.182 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:00.182 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:00.182 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:00.182 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.182 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:44:00.182 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:44:00.182 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:44:00.182 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:44:00.182 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:44:00.182 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.183 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.183 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:44:00.183 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:44:00.183 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:44:00.183 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:44:00.183 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.183 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:44:00.183 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:44:00.183 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:00.183 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.183 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.183 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:44:00.183 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:44:00.184 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:00.184 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:00.184 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:00.184 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.184 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:44:00.184 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:44:00.184 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:44:00.184 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:44:00.184 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:44:00.184 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.184 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.184 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:44:00.184 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:44:00.185 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:44:00.185 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:44:00.185 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.185 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:44:00.185 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:44:00.185 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:00.185 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.185 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.185 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:44:00.185 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:44:00.185 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:00.185 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:00.185 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:00.186 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.186 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:44:00.186 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:44:00.186 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:44:00.186 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:44:00.186 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:44:00.186 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:00.186 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:00.186 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.186 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:44:00.186 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:44:00.186 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.186 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:44:00.187 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:00.187 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:44:00.187 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:00.187 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:00.187 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:44:00.187 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.187 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:44:00.187 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:00.187 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:44:00.187 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:00.187 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:00.187 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.187 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:44:00.187 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:44:00.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.172+0000 7fc19a200640 1 -- 172.21.15.8:0/1050185857 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc170067170 msgr2=0x7fc170069630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:00.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.172+0000 7fc19a200640 1 --2- 172.21.15.8:0/1050185857 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc170067170 0x7fc170069630 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc184010010 tx=0x7fc184004000 comp rx=0 tx=0).stop 2024-03-23T23:44:00.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.172+0000 7fc19a200640 1 -- 172.21.15.8:0/1050185857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc194150e10 msgr2=0x7fc1940c74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:00.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.172+0000 7fc19a200640 1 --2- 172.21.15.8:0/1050185857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc194150e10 0x7fc1940c74f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc17c00e840 tx=0x7fc17c00ec40 comp rx=0 tx=0).stop 2024-03-23T23:44:00.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.172+0000 7fc193e00640 1 -- 172.21.15.8:0/1050185857 reap_dead start 2024-03-23T23:44:00.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.172+0000 7fc193e00640 1 -- 172.21.15.8:0/1050185857 reap_dead start 2024-03-23T23:44:00.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.172+0000 7fc19a200640 1 -- 172.21.15.8:0/1050185857 shutdown_connections 2024-03-23T23:44:00.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.172+0000 7fc19a200640 1 -- 172.21.15.8:0/1050185857 >> 172.21.15.8:0/1050185857 conn(0x7fc1940c8280 msgr2=0x7fc1940c4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:44:00.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.172+0000 7fc19a200640 1 -- 172.21.15.8:0/1050185857 shutdown_connections 2024-03-23T23:44:00.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.172+0000 7fc19a200640 1 -- 172.21.15.8:0/1050185857 wait complete. 2024-03-23T23:44:00.193 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:44:00.193 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T23:44:00.193 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:44:00.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.340+0000 7ff11ce00640 1 Processor -- start 2024-03-23T23:44:00.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.340+0000 7ff11ce00640 1 -- start start 2024-03-23T23:44:00.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.340+0000 7ff11ce00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff1181574e0 0x7ff1180c5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:00.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.340+0000 7ff11ce00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1180c8690 con 0x7ff118156a70 2024-03-23T23:44:00.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.340+0000 7ff11ce00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff11806eaa0 con 0x7ff1180c5db0 2024-03-23T23:44:00.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.340+0000 7ff11ce00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff118150fa0 con 0x7ff1181574e0 2024-03-23T23:44:00.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.340+0000 7ff117400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff1181574e0 0x7ff1180c5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:00.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.340+0000 7ff10fe00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff118156a70 0x7ff1180ae630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:55094/0 (socket says 172.21.15.8:55094) 2024-03-23T23:44:00.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.340+0000 7ff10fe00640 1 -- 172.21.15.8:0/2321934781 learned_addr learned my addr 172.21.15.8:0/2321934781 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:44:00.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.344+0000 7ff117400640 1 -- 172.21.15.8:0/2321934781 >> v1:172.21.15.196:6789/0 conn(0x7ff1180c5db0 legacy=0x7ff11815de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:00.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.344+0000 7ff116a00640 1 -- 172.21.15.8:0/2321934781 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2021584810 0 0) 0x7ff11806eaa0 con 0x7ff1180c5db0 2024-03-23T23:44:00.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.344+0000 7ff117400640 1 -- 172.21.15.8:0/2321934781 >> v1:172.21.15.8:6789/0 conn(0x7ff118156a70 legacy=0x7ff1180ae630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:00.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.344+0000 7ff117400640 1 -- 172.21.15.8:0/2321934781 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11806ed80 con 0x7ff1181574e0 2024-03-23T23:44:00.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.344+0000 7ff117400640 1 --2- 172.21.15.8:0/2321934781 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1181574e0 0x7ff1180c5870 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff1080097c0 tx=0x7ff10801bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5700aa39fd4e429b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:00.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.344+0000 7ff116a00640 1 -- 172.21.15.8:0/2321934781 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1080a8630 con 0x7ff1181574e0 2024-03-23T23:44:00.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.344+0000 7ff116a00640 1 -- 172.21.15.8:0/2321934781 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1080a87d0 con 0x7ff1181574e0 2024-03-23T23:44:00.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.344+0000 7ff116a00640 1 -- 172.21.15.8:0/2321934781 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1080a8ba0 con 0x7ff1181574e0 2024-03-23T23:44:00.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.348+0000 7ff11ce00640 1 -- 172.21.15.8:0/2321934781 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1181574e0 msgr2=0x7ff1180c5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:00.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.348+0000 7ff11ce00640 1 --2- 172.21.15.8:0/2321934781 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1181574e0 0x7ff1180c5870 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff1080097c0 tx=0x7ff10801bf80 comp rx=0 tx=0).stop 2024-03-23T23:44:00.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.348+0000 7ff11ce00640 1 -- 172.21.15.8:0/2321934781 shutdown_connections 2024-03-23T23:44:00.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.348+0000 7ff11ce00640 1 --2- 172.21.15.8:0/2321934781 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1181574e0 0x7ff1180c5870 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:00.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.348+0000 7ff11ce00640 1 -- 172.21.15.8:0/2321934781 >> 172.21.15.8:0/2321934781 conn(0x7ff1180c8de0 msgr2=0x7ff1180c91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:44:00.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.348+0000 7ff11ce00640 1 -- 172.21.15.8:0/2321934781 shutdown_connections 2024-03-23T23:44:00.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.348+0000 7ff11ce00640 1 -- 172.21.15.8:0/2321934781 wait complete. 2024-03-23T23:44:00.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.348+0000 7ff11ce00640 1 Processor -- start 2024-03-23T23:44:00.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.348+0000 7ff11ce00640 1 -- start start 2024-03-23T23:44:00.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.348+0000 7ff11ce00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1180c5db0 0x7ff118148b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:00.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.348+0000 7ff11ce00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff118156a70 0x7ff1181ef610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:00.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.348+0000 7ff11ce00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1181574e0 0x7ff1181efb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:00.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.348+0000 7ff11ce00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1181628f0 con 0x7ff1181574e0 2024-03-23T23:44:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.348+0000 7ff11ce00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff118162770 con 0x7ff1180c5db0 2024-03-23T23:44:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.348+0000 7ff11ce00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff118162a70 con 0x7ff118156a70 2024-03-23T23:44:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.348+0000 7ff117400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1180c5db0 0x7ff118148b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.348+0000 7ff117400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1180c5db0 0x7ff118148b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:43666/0 (socket says 172.21.15.8:43666) 2024-03-23T23:44:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.348+0000 7ff117400640 1 -- 172.21.15.8:0/2199284533 learned_addr learned my addr 172.21.15.8:0/2199284533 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:44:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.348+0000 7ff117e00640 1 --2- 172.21.15.8:0/2199284533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1181574e0 0x7ff1181efb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.348+0000 7ff10fe00640 1 --2- 172.21.15.8:0/2199284533 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff118156a70 0x7ff1181ef610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.348+0000 7ff117400640 1 -- 172.21.15.8:0/2199284533 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff118156a70 msgr2=0x7ff1181ef610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.348+0000 7ff117400640 1 --2- 172.21.15.8:0/2199284533 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff118156a70 0x7ff1181ef610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.348+0000 7ff117400640 1 -- 172.21.15.8:0/2199284533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1181574e0 msgr2=0x7ff1181efb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.348+0000 7ff117400640 1 --2- 172.21.15.8:0/2199284533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1181574e0 0x7ff1181efb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.348+0000 7ff117400640 1 -- 172.21.15.8:0/2199284533 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1181f2b10 con 0x7ff1180c5db0 2024-03-23T23:44:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.348+0000 7ff117e00640 1 --2- 172.21.15.8:0/2199284533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1181574e0 0x7ff1181efb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:44:00.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.352+0000 7ff117400640 1 --2- 172.21.15.8:0/2199284533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1180c5db0 0x7ff118148b40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff108019dc0 tx=0x7ff10801a7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:00.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.352+0000 7ff10f400640 1 -- 172.21.15.8:0/2199284533 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1080be070 con 0x7ff1180c5db0 2024-03-23T23:44:00.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.352+0000 7ff10f400640 1 -- 172.21.15.8:0/2199284533 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1080b0840 con 0x7ff1180c5db0 2024-03-23T23:44:00.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.352+0000 7ff11ce00640 1 -- 172.21.15.8:0/2199284533 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1181f2df0 con 0x7ff1180c5db0 2024-03-23T23:44:00.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.352+0000 7ff10f400640 1 -- 172.21.15.8:0/2199284533 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1080b0c30 con 0x7ff1180c5db0 2024-03-23T23:44:00.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.352+0000 7ff11ce00640 1 -- 172.21.15.8:0/2199284533 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1181f33b0 con 0x7ff1180c5db0 2024-03-23T23:44:00.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.352+0000 7ff11ce00640 1 --2- 172.21.15.8:0/2199284533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff11814cae0 0x7ff118141d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:00.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.352+0000 7ff11ce00640 1 -- 172.21.15.8:0/2199284533 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff118142a50 con 0x7ff11814cae0 2024-03-23T23:44:00.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.352+0000 7ff10fe00640 1 --2- 172.21.15.8:0/2199284533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff11814cae0 0x7ff118141d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:00.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.352+0000 7ff10fe00640 1 -- 172.21.15.8:0/2199284533 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff1181ef460 con 0x7ff11814cae0 2024-03-23T23:44:00.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.352+0000 7ff10fe00640 1 --2- 172.21.15.8:0/2199284533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff11814cae0 0x7ff118141d20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff118150880 tx=0x7ff100001b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:00.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.352+0000 7ff10f400640 1 -- 172.21.15.8:0/2199284533 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff100001d20 con 0x7ff11814cae0 2024-03-23T23:44:00.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.352+0000 7ff10f400640 1 -- 172.21.15.8:0/2199284533 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff1080c1070 con 0x7ff1180c5db0 2024-03-23T23:44:00.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.352+0000 7ff10f400640 1 --2- 172.21.15.8:0/2199284533 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff0f4067560 0x7ff0f4069a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:00.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.356+0000 7ff10f400640 1 -- 172.21.15.8:0/2199284533 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7ff10811f5d0 con 0x7ff1180c5db0 2024-03-23T23:44:00.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.356+0000 7ff10f400640 1 -- 172.21.15.8:0/2199284533 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7ff100018070 con 0x7ff11814cae0 2024-03-23T23:44:00.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.356+0000 7ff10f400640 1 -- 172.21.15.8:0/2199284533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff11814cae0 msgr2=0x7ff118141d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:00.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.356+0000 7ff10f400640 1 --2- 172.21.15.8:0/2199284533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff11814cae0 0x7ff118141d20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff118150880 tx=0x7ff100001b30 comp rx=0 tx=0).stop 2024-03-23T23:44:00.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.356+0000 7ff10f400640 1 -- 172.21.15.8:0/2199284533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff11814cae0 msgr2=0x7ff118141d20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:44:00.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.356+0000 7ff10f400640 1 --2- 172.21.15.8:0/2199284533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff11814cae0 0x7ff118141d20 secure :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff118150880 tx=0x7ff100001b30 comp rx=0 tx=0).stop 2024-03-23T23:44:00.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.356+0000 7ff117e00640 1 --2- 172.21.15.8:0/2199284533 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff0f4067560 0x7ff0f4069a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:00.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.356+0000 7ff117e00640 1 --2- 172.21.15.8:0/2199284533 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff0f4067560 0x7ff0f4069a20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff118152100 tx=0x7ff110009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:00.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.360+0000 7ff11ce00640 1 --2- 172.21.15.8:0/2199284533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff11814c3f0 0x7ff118142260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:00.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.360+0000 7ff11ce00640 1 -- 172.21.15.8:0/2199284533 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff118068790 con 0x7ff11814c3f0 2024-03-23T23:44:00.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.360+0000 7ff10fe00640 1 --2- 172.21.15.8:0/2199284533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff11814c3f0 0x7ff118142260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:00.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.360+0000 7ff10fe00640 1 -- 172.21.15.8:0/2199284533 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff11804f410 con 0x7ff11814c3f0 2024-03-23T23:44:00.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.360+0000 7ff10fe00640 1 --2- 172.21.15.8:0/2199284533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff11814c3f0 0x7ff118142260 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff100007810 tx=0x7ff1000012c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:00.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.360+0000 7ff10f400640 1 -- 172.21.15.8:0/2199284533 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff100013600 con 0x7ff11814c3f0 2024-03-23T23:44:00.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.364+0000 7ff10f400640 1 -- 172.21.15.8:0/2199284533 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5182 (secure 0 0 0) 0x7ff100013600 con 0x7ff11814c3f0 2024-03-23T23:44:00.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.364+0000 7ff10f400640 1 -- 172.21.15.8:0/2199284533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff11814c3f0 msgr2=0x7ff118142260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:00.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.364+0000 7ff10f400640 1 --2- 172.21.15.8:0/2199284533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff11814c3f0 0x7ff118142260 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff100007810 tx=0x7ff1000012c0 comp rx=0 tx=0).stop 2024-03-23T23:44:00.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.364+0000 7ff10f400640 1 -- 172.21.15.8:0/2199284533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff11814c3f0 msgr2=0x7ff118142260 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:44:00.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.364+0000 7ff10f400640 1 --2- 172.21.15.8:0/2199284533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff11814c3f0 0x7ff118142260 secure :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff100007810 tx=0x7ff1000012c0 comp rx=0 tx=0).stop 2024-03-23T23:44:00.365 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:44:00.365 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:44:00.365 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:44:00.365 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:44:00.365 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 10, 2024-03-23T23:44:00.366 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:44:00.366 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:44:00.366 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:44:00.366 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:44:00.366 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:00.366 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 0, 2024-03-23T23:44:00.366 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:44:00.366 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:44:00.366 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:44:00.366 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:44:00.366 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:44:00.366 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:44:00.367 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:44:00.367 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:44:00.367 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:44:00.367 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:44:00.367 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:44:00.367 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:44:00.367 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:44:00.367 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:44:00.367 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:00.367 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:44:00.367 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:44:00.367 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:44:00.367 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:44:00.368 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:44:00.368 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:44:00.368 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:44:00.368 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:44:00.368 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:44:00.368 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:44:00.368 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:44:00.368 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:44:00.368 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:44:00.368 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:00.368 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.368 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:44:00.368 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:44:00.369 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:44:00.369 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:44:00.369 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:44:00.369 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:44:00.369 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:44:00.369 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:44:00.369 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:44:00.369 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:44:00.369 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:44:00.369 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:44:00.369 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:44:00.369 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:44:00.369 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:44:00.370 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:44:00.370 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:44:00.370 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:44:00.370 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:44:00.370 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:44:00.370 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:44:00.370 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:44:00.370 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:44:00.370 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:44:00.370 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:44:00.370 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:44:00.370 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:44:00.371 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:44:00.371 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:00.371 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:44:00.371 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.371 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:44:00.371 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.371 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:44:00.371 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:44:00.371 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:44:00.371 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:44:00.371 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.371 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:44:00.372 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:44:00.372 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:00.372 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.372 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.372 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:44:00.372 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:44:00.372 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:00.372 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:00.372 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:00.372 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.372 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:44:00.372 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:44:00.372 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:44:00.373 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:44:00.373 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:44:00.373 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.373 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.373 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:44:00.373 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:44:00.373 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:44:00.373 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:44:00.373 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.373 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:44:00.373 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:44:00.373 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:00.373 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.374 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.374 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:44:00.374 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:44:00.374 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:00.374 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:00.374 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:00.374 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.374 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:44:00.374 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:44:00.374 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:44:00.374 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:44:00.374 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:44:00.374 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.374 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.375 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:44:00.375 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:44:00.375 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:44:00.375 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:44:00.375 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.375 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:44:00.375 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:44:00.375 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:00.375 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.375 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.375 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:44:00.375 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:44:00.375 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:00.376 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:00.376 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:00.376 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.376 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:44:00.376 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:44:00.376 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:44:00.376 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:44:00.376 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:44:00.376 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:00.376 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:00.376 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.376 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:44:00.376 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:44:00.376 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.377 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:44:00.377 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:00.377 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:44:00.377 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:00.377 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:00.377 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:44:00.377 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.377 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:44:00.377 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:00.377 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:44:00.377 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:00.377 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:00.377 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:44:00.377 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.378 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:44:00.378 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:00.378 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:44:00.378 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:00.378 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:00.378 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:44:00.378 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.378 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:44:00.378 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:00.378 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:44:00.378 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.378 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.378 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:44:00.378 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:00.379 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5 2024-03-23T23:44:00.379 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:00.379 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:00.379 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:44:00.379 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.379 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:44:00.379 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:00.379 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:44:00.379 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:00.379 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:00.379 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.379 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:44:00.379 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:44:00.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.364+0000 7ff11ce00640 1 -- 172.21.15.8:0/2199284533 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff0f4067560 msgr2=0x7ff0f4069a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:00.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.364+0000 7ff11ce00640 1 --2- 172.21.15.8:0/2199284533 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff0f4067560 0x7ff0f4069a20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff118152100 tx=0x7ff110009040 comp rx=0 tx=0).stop 2024-03-23T23:44:00.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.364+0000 7ff11ce00640 1 -- 172.21.15.8:0/2199284533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1180c5db0 msgr2=0x7ff118148b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:00.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.364+0000 7ff11ce00640 1 --2- 172.21.15.8:0/2199284533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1180c5db0 0x7ff118148b40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff108019dc0 tx=0x7ff10801a7c0 comp rx=0 tx=0).stop 2024-03-23T23:44:00.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.364+0000 7ff117e00640 1 -- 172.21.15.8:0/2199284533 reap_dead start 2024-03-23T23:44:00.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.364+0000 7ff117e00640 1 -- 172.21.15.8:0/2199284533 reap_dead start 2024-03-23T23:44:00.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.364+0000 7ff11ce00640 1 -- 172.21.15.8:0/2199284533 shutdown_connections 2024-03-23T23:44:00.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.364+0000 7ff11ce00640 1 -- 172.21.15.8:0/2199284533 >> 172.21.15.8:0/2199284533 conn(0x7ff1180c8de0 msgr2=0x7ff118067100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:44:00.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.364+0000 7ff11ce00640 1 -- 172.21.15.8:0/2199284533 shutdown_connections 2024-03-23T23:44:00.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.364+0000 7ff11ce00640 1 -- 172.21.15.8:0/2199284533 wait complete. 2024-03-23T23:44:00.384 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:44:00.384 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T23:44:00.385 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:44:00.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.524+0000 7f68ac400640 1 Processor -- start 2024-03-23T23:44:00.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.524+0000 7f68ac400640 1 -- start start 2024-03-23T23:44:00.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.528+0000 7f68ac400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f68a406d6e0 0x7f68a4155a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:00.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.528+0000 7f68ac400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a40c4340 con 0x7f68a40c4e40 2024-03-23T23:44:00.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.528+0000 7f68ac400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a40c4060 con 0x7f68a40c8a50 2024-03-23T23:44:00.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.528+0000 7f68ac400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68a40c4740 con 0x7f68a406d6e0 2024-03-23T23:44:00.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.528+0000 7f68a9000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f68a406d6e0 0x7f68a4155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:00.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.528+0000 7f68aa400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f68a40c4e40 0x7f68a4160300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:55102/0 (socket says 172.21.15.8:55102) 2024-03-23T23:44:00.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.528+0000 7f68aa400640 1 -- 172.21.15.8:0/1155134892 learned_addr learned my addr 172.21.15.8:0/1155134892 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:44:00.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.528+0000 7f68a9000640 1 -- 172.21.15.8:0/1155134892 >> v1:172.21.15.196:6789/0 conn(0x7f68a40c8a50 legacy=0x7f68a40c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:00.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.528+0000 7f68a9000640 1 -- 172.21.15.8:0/1155134892 >> v1:172.21.15.8:6789/0 conn(0x7f68a40c4e40 legacy=0x7f68a4160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:00.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.528+0000 7f68a9000640 1 -- 172.21.15.8:0/1155134892 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a40c3570 con 0x7f68a406d6e0 2024-03-23T23:44:00.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.532+0000 7f68a9000640 1 --2- 172.21.15.8:0/1155134892 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68a406d6e0 0x7f68a4155a60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f68900097c0 tx=0x7f689001bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8105f5d7d888a6ae server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:00.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.532+0000 7f68a3e00640 1 -- 172.21.15.8:0/1155134892 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68900aa660 con 0x7f68a406d6e0 2024-03-23T23:44:00.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.532+0000 7f68a3e00640 1 -- 172.21.15.8:0/1155134892 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68900af070 con 0x7f68a406d6e0 2024-03-23T23:44:00.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.532+0000 7f68a3e00640 1 -- 172.21.15.8:0/1155134892 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68900aaa20 con 0x7f68a406d6e0 2024-03-23T23:44:00.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.532+0000 7f68ac400640 1 -- 172.21.15.8:0/1155134892 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68a406d6e0 msgr2=0x7f68a4155a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:00.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.532+0000 7f68ac400640 1 --2- 172.21.15.8:0/1155134892 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68a406d6e0 0x7f68a4155a60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f68900097c0 tx=0x7f689001bf50 comp rx=0 tx=0).stop 2024-03-23T23:44:00.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.536+0000 7f68ac400640 1 -- 172.21.15.8:0/1155134892 shutdown_connections 2024-03-23T23:44:00.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.536+0000 7f68ac400640 1 --2- 172.21.15.8:0/1155134892 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68a406d6e0 0x7f68a4155a60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:00.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.536+0000 7f68ac400640 1 -- 172.21.15.8:0/1155134892 >> 172.21.15.8:0/1155134892 conn(0x7f68a40aafe0 msgr2=0x7f68a40ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:44:00.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.536+0000 7f68ac400640 1 -- 172.21.15.8:0/1155134892 shutdown_connections 2024-03-23T23:44:00.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.536+0000 7f68ac400640 1 -- 172.21.15.8:0/1155134892 wait complete. 2024-03-23T23:44:00.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.536+0000 7f68ac400640 1 Processor -- start 2024-03-23T23:44:00.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.536+0000 7f68ac400640 1 -- start start 2024-03-23T23:44:00.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.536+0000 7f68ac400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f68a40c4e40 0x7f68a40ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:00.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.536+0000 7f68ac400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f68a40c8a50 0x7f68a41598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:00.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.536+0000 7f68ac400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68a40ac070 0x7f68a4147f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:00.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.536+0000 7f68ac400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a40c3db0 con 0x7f68a40ac070 2024-03-23T23:44:00.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.536+0000 7f68ac400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a40c3c30 con 0x7f68a40c4e40 2024-03-23T23:44:00.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.536+0000 7f68ac400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a4164a60 con 0x7f68a40c8a50 2024-03-23T23:44:00.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.536+0000 7f68aa400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68a40ac070 0x7f68a4147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:00.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.536+0000 7f68aa400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68a40ac070 0x7f68a4147f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34602/0 (socket says 172.21.15.8:34602) 2024-03-23T23:44:00.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.536+0000 7f68aa400640 1 -- 172.21.15.8:0/961937406 learned_addr learned my addr 172.21.15.8:0/961937406 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:44:00.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.536+0000 7f68a9a00640 1 --2- 172.21.15.8:0/961937406 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f68a40c4e40 0x7f68a40ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:00.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.536+0000 7f68a9000640 1 --2- 172.21.15.8:0/961937406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f68a40c8a50 0x7f68a41598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:00.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.536+0000 7f68a9a00640 1 -- 172.21.15.8:0/961937406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f68a40c8a50 msgr2=0x7f68a41598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:00.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.536+0000 7f68a9a00640 1 --2- 172.21.15.8:0/961937406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f68a40c8a50 0x7f68a41598b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:00.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.536+0000 7f68a9a00640 1 -- 172.21.15.8:0/961937406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68a40ac070 msgr2=0x7f68a4147f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:00.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.536+0000 7f68a9a00640 1 --2- 172.21.15.8:0/961937406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68a40ac070 0x7f68a4147f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:00.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.536+0000 7f68a9a00640 1 -- 172.21.15.8:0/961937406 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a40ade30 con 0x7f68a40c4e40 2024-03-23T23:44:00.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.536+0000 7f68aa400640 1 --2- 172.21.15.8:0/961937406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68a40ac070 0x7f68a4147f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:44:00.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.536+0000 7f68a9a00640 1 --2- 172.21.15.8:0/961937406 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f68a40c4e40 0x7f68a40ad8f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f689800c3c0 tx=0x7f689800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:00.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.540+0000 7f68a1600640 1 -- 172.21.15.8:0/961937406 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6898017070 con 0x7f68a40c4e40 2024-03-23T23:44:00.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.540+0000 7f68a1600640 1 -- 172.21.15.8:0/961937406 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68980052d0 con 0x7f68a40c4e40 2024-03-23T23:44:00.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.540+0000 7f68ac400640 1 -- 172.21.15.8:0/961937406 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a4157a60 con 0x7f68a40c4e40 2024-03-23T23:44:00.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.540+0000 7f68a1600640 1 -- 172.21.15.8:0/961937406 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6898003840 con 0x7f68a40c4e40 2024-03-23T23:44:00.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.540+0000 7f68ac400640 1 -- 172.21.15.8:0/961937406 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a4157780 con 0x7f68a40c4e40 2024-03-23T23:44:00.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.540+0000 7f68ac400640 1 --2- 172.21.15.8:0/961937406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f68a406d6e0 0x7f68a41484c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:00.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.540+0000 7f68ac400640 1 -- 172.21.15.8:0/961937406 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a4068270 con 0x7f68a406d6e0 2024-03-23T23:44:00.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.540+0000 7f68a9000640 1 --2- 172.21.15.8:0/961937406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f68a406d6e0 0x7f68a41484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:00.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.540+0000 7f68a9000640 1 -- 172.21.15.8:0/961937406 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f68a40c32b0 con 0x7f68a406d6e0 2024-03-23T23:44:00.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.540+0000 7f68a9000640 1 --2- 172.21.15.8:0/961937406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f68a406d6e0 0x7f68a41484c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f68a406c100 tx=0x7f6890019010 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:00.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.540+0000 7f68a1600640 1 -- 172.21.15.8:0/961937406 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68900c0480 con 0x7f68a406d6e0 2024-03-23T23:44:00.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.540+0000 7f68a1600640 1 -- 172.21.15.8:0/961937406 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f689801a070 con 0x7f68a40c4e40 2024-03-23T23:44:00.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.544+0000 7f68a1600640 1 --2- 172.21.15.8:0/961937406 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6884067590 0x7f6884069a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:00.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.544+0000 7f68a1600640 1 -- 172.21.15.8:0/961937406 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f6898084de0 con 0x7f68a40c4e40 2024-03-23T23:44:00.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.544+0000 7f68a1600640 1 -- 172.21.15.8:0/961937406 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f68900af040 con 0x7f68a406d6e0 2024-03-23T23:44:00.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.544+0000 7f68a1600640 1 -- 172.21.15.8:0/961937406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f68a406d6e0 msgr2=0x7f68a41484c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:00.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.544+0000 7f68a1600640 1 --2- 172.21.15.8:0/961937406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f68a406d6e0 0x7f68a41484c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f68a406c100 tx=0x7f6890019010 comp rx=0 tx=0).stop 2024-03-23T23:44:00.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.544+0000 7f68a1600640 1 -- 172.21.15.8:0/961937406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f68a406d6e0 msgr2=0x7f68a41484c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:44:00.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.544+0000 7f68a1600640 1 --2- 172.21.15.8:0/961937406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f68a406d6e0 0x7f68a41484c0 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f68a406c100 tx=0x7f6890019010 comp rx=0 tx=0).stop 2024-03-23T23:44:00.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.544+0000 7f68aa400640 1 --2- 172.21.15.8:0/961937406 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6884067590 0x7f6884069a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:00.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.544+0000 7f68aa400640 1 --2- 172.21.15.8:0/961937406 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6884067590 0x7f6884069a50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f689c007fd0 tx=0x7f689c0018f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:00.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.548+0000 7f68ac400640 1 --2- 172.21.15.8:0/961937406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f68a4159010 0x7f68a414dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:00.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.548+0000 7f68ac400640 1 -- 172.21.15.8:0/961937406 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a40aac30 con 0x7f68a4159010 2024-03-23T23:44:00.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.548+0000 7f68a9000640 1 --2- 172.21.15.8:0/961937406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f68a4159010 0x7f68a414dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:00.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.548+0000 7f68a9000640 1 -- 172.21.15.8:0/961937406 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f68a406e5b0 con 0x7f68a4159010 2024-03-23T23:44:00.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.552+0000 7f68a9000640 1 --2- 172.21.15.8:0/961937406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f68a4159010 0x7f68a414dcb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6890019d90 tx=0x7f6890009190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:00.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.552+0000 7f68a1600640 1 -- 172.21.15.8:0/961937406 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68900c0ad0 con 0x7f68a4159010 2024-03-23T23:44:00.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.552+0000 7f68a1600640 1 -- 172.21.15.8:0/961937406 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5012 (secure 0 0 0) 0x7f6890003620 con 0x7f68a4159010 2024-03-23T23:44:00.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.552+0000 7f68a1600640 1 -- 172.21.15.8:0/961937406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f68a4159010 msgr2=0x7f68a414dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:00.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.552+0000 7f68a1600640 1 --2- 172.21.15.8:0/961937406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f68a4159010 0x7f68a414dcb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6890019d90 tx=0x7f6890009190 comp rx=0 tx=0).stop 2024-03-23T23:44:00.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.552+0000 7f68a1600640 1 -- 172.21.15.8:0/961937406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f68a4159010 msgr2=0x7f68a414dcb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:44:00.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.552+0000 7f68a1600640 1 --2- 172.21.15.8:0/961937406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f68a4159010 0x7f68a414dcb0 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6890019d90 tx=0x7f6890009190 comp rx=0 tx=0).stop 2024-03-23T23:44:00.554 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:44:00.554 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:44:00.554 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:44:00.555 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:44:00.555 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 10, 2024-03-23T23:44:00.555 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:44:00.555 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:44:00.555 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:44:00.555 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:44:00.555 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:00.555 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 0, 2024-03-23T23:44:00.555 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:44:00.555 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:44:00.555 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:44:00.555 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:44:00.555 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:44:00.555 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:44:00.556 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:44:00.556 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:44:00.556 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:44:00.556 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:44:00.556 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:44:00.556 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:44:00.556 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:44:00.556 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:44:00.556 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:00.556 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:44:00.556 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:44:00.556 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:44:00.557 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:44:00.557 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:44:00.557 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:44:00.557 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:44:00.557 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:44:00.557 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:44:00.557 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:44:00.557 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:44:00.557 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:44:00.557 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:44:00.557 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:00.557 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.557 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:44:00.557 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:44:00.558 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:44:00.558 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:44:00.558 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:44:00.558 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:44:00.558 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:44:00.558 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:44:00.558 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:44:00.558 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:44:00.558 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:44:00.558 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:44:00.558 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:44:00.558 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:44:00.558 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:44:00.559 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:44:00.559 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:44:00.559 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:44:00.559 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:44:00.559 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:44:00.559 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:44:00.559 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:44:00.559 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:44:00.559 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:44:00.559 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:44:00.559 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:44:00.559 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:44:00.559 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:44:00.559 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:00.560 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:44:00.560 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.560 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:44:00.560 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.560 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:44:00.560 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:44:00.560 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:44:00.560 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:44:00.560 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.560 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:44:00.560 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:44:00.560 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:00.561 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.561 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.561 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:44:00.561 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:44:00.561 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:00.561 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:00.561 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:00.561 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.561 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:44:00.561 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:44:00.561 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:44:00.561 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:44:00.561 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:44:00.561 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.562 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.562 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:44:00.562 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:44:00.562 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:44:00.562 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:44:00.562 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.562 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:44:00.562 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:44:00.562 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:00.562 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.562 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.562 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:44:00.562 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:44:00.563 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:00.563 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:00.563 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:00.563 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.563 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:44:00.563 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:44:00.563 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:44:00.563 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:44:00.563 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:44:00.563 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.563 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.563 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:44:00.563 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:44:00.563 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:44:00.564 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:44:00.564 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.564 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:44:00.564 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:44:00.564 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:00.564 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.564 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.564 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:44:00.564 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:44:00.564 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:00.564 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:00.564 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:00.564 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.564 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:44:00.564 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:44:00.565 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:44:00.565 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:44:00.565 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:44:00.565 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:00.565 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:00.565 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.565 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:44:00.565 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:44:00.565 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.565 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:44:00.565 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:00.565 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:44:00.565 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:00.565 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:00.565 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:44:00.566 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.566 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:44:00.566 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:00.566 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:44:00.566 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:00.566 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:00.566 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:44:00.566 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.566 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:44:00.566 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:00.566 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5 2024-03-23T23:44:00.566 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:00.566 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:00.567 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:44:00.567 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.567 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:44:00.567 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:00.567 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:44:00.567 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.567 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:00.567 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:44:00.567 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:00.567 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:44:00.567 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:00.567 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:00.567 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:00.567 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:44:00.568 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:44:00.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.552+0000 7f68ac400640 1 -- 172.21.15.8:0/961937406 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6884067590 msgr2=0x7f6884069a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:00.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.552+0000 7f68ac400640 1 --2- 172.21.15.8:0/961937406 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6884067590 0x7f6884069a50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f689c007fd0 tx=0x7f689c0018f0 comp rx=0 tx=0).stop 2024-03-23T23:44:00.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.552+0000 7f68ac400640 1 -- 172.21.15.8:0/961937406 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f68a40c4e40 msgr2=0x7f68a40ad8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:00.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.552+0000 7f68ac400640 1 --2- 172.21.15.8:0/961937406 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f68a40c4e40 0x7f68a40ad8f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f689800c3c0 tx=0x7f689800c880 comp rx=0 tx=0).stop 2024-03-23T23:44:00.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.552+0000 7f68aa400640 1 -- 172.21.15.8:0/961937406 reap_dead start 2024-03-23T23:44:00.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.552+0000 7f68ac400640 1 -- 172.21.15.8:0/961937406 shutdown_connections 2024-03-23T23:44:00.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.552+0000 7f68ac400640 1 --2- 172.21.15.8:0/961937406 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f68a40c4e40 0x7f68a40ad8f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:00.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.552+0000 7f68ac400640 1 -- 172.21.15.8:0/961937406 >> 172.21.15.8:0/961937406 conn(0x7f68a40aafe0 msgr2=0x7f68a40c6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:44:00.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.552+0000 7f68ac400640 1 -- 172.21.15.8:0/961937406 shutdown_connections 2024-03-23T23:44:00.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.552+0000 7f68ac400640 1 -- 172.21.15.8:0/961937406 wait complete. 2024-03-23T23:44:00.580 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:44:00.580 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-03-23T23:44:00.580 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-03-23T23:44:00.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.736+0000 7fa01b000640 1 Processor -- start 2024-03-23T23:44:00.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.740+0000 7fa01b000640 1 -- start start 2024-03-23T23:44:00.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.740+0000 7fa01b000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa014156ee0 0x7fa014073230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:00.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.740+0000 7fa01b000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa0140ac270 0x7fa0140ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:00.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.740+0000 7fa01b000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa014073770 con 0x7fa014149bd0 2024-03-23T23:44:00.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.740+0000 7fa01b000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0140aa390 con 0x7fa0140ac270 2024-03-23T23:44:00.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.740+0000 7fa01b000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa01406e720 con 0x7fa014156ee0 2024-03-23T23:44:00.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.740+0000 7fa019000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa0140ac270 0x7fa0140ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:00.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.740+0000 7fa019000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa0140ac270 0x7fa0140ac6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34604/0 (socket says 172.21.15.8:34604) 2024-03-23T23:44:00.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.740+0000 7fa019000640 1 -- 172.21.15.8:0/262742002 learned_addr learned my addr 172.21.15.8:0/262742002 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:44:00.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.740+0000 7fa013e00640 1 --2- 172.21.15.8:0/262742002 >> v2:172.21.15.196:3300/0 conn(0x7fa014156ee0 0x7fa014073230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:00.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.740+0000 7fa019000640 1 -- 172.21.15.8:0/262742002 >> v2:172.21.15.196:3300/0 conn(0x7fa014156ee0 msgr2=0x7fa014073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:44:00.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.740+0000 7fa019000640 1 --2- 172.21.15.8:0/262742002 >> v2:172.21.15.196:3300/0 conn(0x7fa014156ee0 0x7fa014073230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:00.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.740+0000 7fa019000640 1 -- 172.21.15.8:0/262742002 >> v1:172.21.15.196:6789/0 conn(0x7fa014149bd0 legacy=0x7fa01414a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:00.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.740+0000 7fa019000640 1 -- 172.21.15.8:0/262742002 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01406ea00 con 0x7fa0140ac270 2024-03-23T23:44:00.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.744+0000 7fa019000640 1 --2- 172.21.15.8:0/262742002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0140ac270 0x7fa0140ac6e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa0140c8280 tx=0x7fa00c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb59e2cfa70ecd7e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:00.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.744+0000 7fa012a00640 1 -- 172.21.15.8:0/262742002 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c0a57f0 con 0x7fa0140ac270 2024-03-23T23:44:00.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.744+0000 7fa012a00640 1 -- 172.21.15.8:0/262742002 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00c0a5990 con 0x7fa0140ac270 2024-03-23T23:44:00.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.744+0000 7fa012a00640 1 -- 172.21.15.8:0/262742002 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c0a5d60 con 0x7fa0140ac270 2024-03-23T23:44:00.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.744+0000 7fa01b000640 1 -- 172.21.15.8:0/262742002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0140ac270 msgr2=0x7fa0140ac6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:00.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.744+0000 7fa01b000640 1 --2- 172.21.15.8:0/262742002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0140ac270 0x7fa0140ac6e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa0140c8280 tx=0x7fa00c01c930 comp rx=0 tx=0).stop 2024-03-23T23:44:00.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.744+0000 7fa01b000640 1 -- 172.21.15.8:0/262742002 shutdown_connections 2024-03-23T23:44:00.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.744+0000 7fa01b000640 1 --2- 172.21.15.8:0/262742002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0140ac270 0x7fa0140ac6e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:00.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.744+0000 7fa01b000640 1 --2- 172.21.15.8:0/262742002 >> v2:172.21.15.196:3300/0 conn(0x7fa014156ee0 0x7fa014073230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:00.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.744+0000 7fa01b000640 1 -- 172.21.15.8:0/262742002 >> 172.21.15.8:0/262742002 conn(0x7fa01406b170 msgr2=0x7fa01406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:44:00.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.744+0000 7fa01b000640 1 -- 172.21.15.8:0/262742002 shutdown_connections 2024-03-23T23:44:00.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.744+0000 7fa01b000640 1 -- 172.21.15.8:0/262742002 wait complete. 2024-03-23T23:44:00.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.744+0000 7fa01b000640 1 Processor -- start 2024-03-23T23:44:00.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.744+0000 7fa01b000640 1 -- start start 2024-03-23T23:44:00.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.748+0000 7fa01b000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0140ac270 0x7fa0141ebb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:00.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.748+0000 7fa01b000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa014149bd0 0x7fa01414a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:00.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.748+0000 7fa01b000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa014156ee0 0x7fa014144840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:00.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.748+0000 7fa01b000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0141579f0 con 0x7fa014156ee0 2024-03-23T23:44:00.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.748+0000 7fa01b000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa014157870 con 0x7fa014149bd0 2024-03-23T23:44:00.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.748+0000 7fa01b000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0141572c0 con 0x7fa0140ac270 2024-03-23T23:44:00.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.748+0000 7fa019000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa014156ee0 0x7fa014144840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:00.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.748+0000 7fa013e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0140ac270 0x7fa0141ebb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:00.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.748+0000 7fa013e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0140ac270 0x7fa0141ebb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:46684/0 (socket says 172.21.15.8:46684) 2024-03-23T23:44:00.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.748+0000 7fa013e00640 1 -- 172.21.15.8:0/590408046 learned_addr learned my addr 172.21.15.8:0/590408046 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:44:00.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.748+0000 7fa013400640 1 --2- 172.21.15.8:0/590408046 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa014149bd0 0x7fa01414a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:00.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.748+0000 7fa019000640 1 -- 172.21.15.8:0/590408046 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0140ac270 msgr2=0x7fa0141ebb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:00.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.748+0000 7fa019000640 1 --2- 172.21.15.8:0/590408046 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0140ac270 0x7fa0141ebb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:00.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.748+0000 7fa019000640 1 -- 172.21.15.8:0/590408046 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa014149bd0 msgr2=0x7fa01414a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:00.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.748+0000 7fa019000640 1 --2- 172.21.15.8:0/590408046 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa014149bd0 0x7fa01414a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:00.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.748+0000 7fa019000640 1 -- 172.21.15.8:0/590408046 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01414f700 con 0x7fa014156ee0 2024-03-23T23:44:00.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.748+0000 7fa019000640 1 --2- 172.21.15.8:0/590408046 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa014156ee0 0x7fa014144840 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa00c0ab000 tx=0x7fa00c0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:00.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.748+0000 7fa00be00640 1 -- 172.21.15.8:0/590408046 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c0bc030 con 0x7fa014156ee0 2024-03-23T23:44:00.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.748+0000 7fa00be00640 1 -- 172.21.15.8:0/590408046 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00c0b8470 con 0x7fa014156ee0 2024-03-23T23:44:00.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.748+0000 7fa01b000640 1 -- 172.21.15.8:0/590408046 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa01414f9e0 con 0x7fa014156ee0 2024-03-23T23:44:00.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.748+0000 7fa00be00640 1 -- 172.21.15.8:0/590408046 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c0b8860 con 0x7fa014156ee0 2024-03-23T23:44:00.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.748+0000 7fa01b000640 1 -- 172.21.15.8:0/590408046 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa01414ffa0 con 0x7fa014156ee0 2024-03-23T23:44:00.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.748+0000 7fa01b000640 1 -- 172.21.15.8:0/590408046 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa014068270 con 0x7fa014156ee0 2024-03-23T23:44:00.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.752+0000 7fa00be00640 1 -- 172.21.15.8:0/590408046 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fa00c0bf070 con 0x7fa014156ee0 2024-03-23T23:44:00.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.752+0000 7fa00be00640 1 --2- 172.21.15.8:0/590408046 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9ff4067660 0x7f9ff4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:00.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.752+0000 7fa00be00640 1 -- 172.21.15.8:0/590408046 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fa00c1207b0 con 0x7fa014156ee0 2024-03-23T23:44:00.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.752+0000 7fa013e00640 1 --2- 172.21.15.8:0/590408046 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9ff4067660 0x7f9ff4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:00.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.752+0000 7fa013e00640 1 --2- 172.21.15.8:0/590408046 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9ff4067660 0x7f9ff4069b20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa004009b80 tx=0x7fa004009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:00.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.756+0000 7fa00be00640 1 -- 172.21.15.8:0/590408046 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fa00c0c6070 con 0x7fa014156ee0 2024-03-23T23:44:00.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.992+0000 7fa01b000640 1 -- 172.21.15.8:0/590408046 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fa0140733d0 con 0x7fa014156ee0 2024-03-23T23:44:00.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.992+0000 7fa00be00640 1 -- 172.21.15.8:0/590408046 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fa00c0165e0 con 0x7fa014156ee0 2024-03-23T23:44:00.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.996+0000 7fa01b000640 1 -- 172.21.15.8:0/590408046 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9ff4067660 msgr2=0x7f9ff4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:00.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.996+0000 7fa01b000640 1 --2- 172.21.15.8:0/590408046 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9ff4067660 0x7f9ff4069b20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa004009b80 tx=0x7fa004009190 comp rx=0 tx=0).stop 2024-03-23T23:44:00.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.996+0000 7fa01b000640 1 -- 172.21.15.8:0/590408046 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa014156ee0 msgr2=0x7fa014144840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:00.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.996+0000 7fa01b000640 1 --2- 172.21.15.8:0/590408046 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa014156ee0 0x7fa014144840 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa00c0ab000 tx=0x7fa00c0196d0 comp rx=0 tx=0).stop 2024-03-23T23:44:00.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.996+0000 7fa01b000640 1 -- 172.21.15.8:0/590408046 shutdown_connections 2024-03-23T23:44:00.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.996+0000 7fa01b000640 1 --2- 172.21.15.8:0/590408046 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa014156ee0 0x7fa014144840 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:00.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.996+0000 7fa01b000640 1 --2- 172.21.15.8:0/590408046 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa014149bd0 0x7fa01414a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:00.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.996+0000 7fa01b000640 1 --2- 172.21.15.8:0/590408046 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9ff4067660 0x7f9ff4069b20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:00.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.996+0000 7fa01b000640 1 --2- 172.21.15.8:0/590408046 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0140ac270 0x7fa0141ebb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:00.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.996+0000 7fa01b000640 1 -- 172.21.15.8:0/590408046 >> 172.21.15.8:0/590408046 conn(0x7fa01406b170 msgr2=0x7fa014156070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:44:00.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.996+0000 7fa01b000640 1 -- 172.21.15.8:0/590408046 shutdown_connections 2024-03-23T23:44:00.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:00.996+0000 7fa01b000640 1 -- 172.21.15.8:0/590408046 wait complete. 2024-03-23T23:44:01.019 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-03-23T23:44:10.610 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:44:10.615 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:44:11.019 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T23:44:11.020 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:44:11.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.192+0000 7fddff800640 1 Processor -- start 2024-03-23T23:44:11.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.192+0000 7fddff800640 1 -- start start 2024-03-23T23:44:11.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.196+0000 7fddff800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fddf8152ef0 0x7fddf806b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:11.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.196+0000 7fddff800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fddf80c3520 0x7fddf8160180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:11.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.196+0000 7fddff800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf80aaa80 con 0x7fddf80a9500 2024-03-23T23:44:11.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.196+0000 7fddff800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf81532d0 con 0x7fddf80c3520 2024-03-23T23:44:11.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.196+0000 7fddff800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf80aad60 con 0x7fddf8152ef0 2024-03-23T23:44:11.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.196+0000 7fddf7e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fddf80a9500 0x7fddf8155f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:45782/0 (socket says 172.21.15.8:45782) 2024-03-23T23:44:11.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.196+0000 7fddf7e00640 1 -- 172.21.15.8:0/2364171594 learned_addr learned my addr 172.21.15.8:0/2364171594 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:44:11.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.196+0000 7fddfce00640 1 --2- 172.21.15.8:0/2364171594 >> v2:172.21.15.196:3300/0 conn(0x7fddf8152ef0 0x7fddf806b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:11.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.196+0000 7fddfd800640 1 --2- 172.21.15.8:0/2364171594 >> v2:172.21.15.8:3300/0 conn(0x7fddf80c3520 0x7fddf8160180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:11.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.196+0000 7fddfd800640 1 -- 172.21.15.8:0/2364171594 >> v2:172.21.15.196:3300/0 conn(0x7fddf8152ef0 msgr2=0x7fddf806b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:44:11.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.196+0000 7fddfd800640 1 --2- 172.21.15.8:0/2364171594 >> v2:172.21.15.196:3300/0 conn(0x7fddf8152ef0 0x7fddf806b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:11.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.196+0000 7fddfd800640 1 -- 172.21.15.8:0/2364171594 >> v1:172.21.15.196:6789/0 conn(0x7fddf80a9500 legacy=0x7fddf8155f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:11.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.196+0000 7fddfd800640 1 -- 172.21.15.8:0/2364171594 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf8155a30 con 0x7fddf80c3520 2024-03-23T23:44:11.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.196+0000 7fddf7400640 1 -- 172.21.15.8:0/2364171594 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1323108806 0 0) 0x7fddf80aaa80 con 0x7fddf80a9500 2024-03-23T23:44:11.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.200+0000 7fddfd800640 1 --2- 172.21.15.8:0/2364171594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddf80c3520 0x7fddf8160180 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fddf80c90e0 tx=0x7fdde001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a6be744ba8b40d4 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:11.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.200+0000 7fddf7400640 1 -- 172.21.15.8:0/2364171594 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde00b0070 con 0x7fddf80c3520 2024-03-23T23:44:11.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.200+0000 7fddf7400640 1 -- 172.21.15.8:0/2364171594 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde00ab600 con 0x7fddf80c3520 2024-03-23T23:44:11.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.200+0000 7fddf7400640 1 -- 172.21.15.8:0/2364171594 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde00ab9d0 con 0x7fddf80c3520 2024-03-23T23:44:11.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.200+0000 7fddff800640 1 -- 172.21.15.8:0/2364171594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddf80c3520 msgr2=0x7fddf8160180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:11.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.200+0000 7fddff800640 1 --2- 172.21.15.8:0/2364171594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddf80c3520 0x7fddf8160180 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fddf80c90e0 tx=0x7fdde001c410 comp rx=0 tx=0).stop 2024-03-23T23:44:11.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.200+0000 7fddff800640 1 -- 172.21.15.8:0/2364171594 shutdown_connections 2024-03-23T23:44:11.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.200+0000 7fddff800640 1 --2- 172.21.15.8:0/2364171594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddf80c3520 0x7fddf8160180 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:11.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.200+0000 7fddff800640 1 --2- 172.21.15.8:0/2364171594 >> v2:172.21.15.196:3300/0 conn(0x7fddf8152ef0 0x7fddf806b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:11.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.200+0000 7fddff800640 1 -- 172.21.15.8:0/2364171594 >> 172.21.15.8:0/2364171594 conn(0x7fddf80c4c10 msgr2=0x7fddf80c5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:44:11.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.200+0000 7fddff800640 1 -- 172.21.15.8:0/2364171594 shutdown_connections 2024-03-23T23:44:11.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.200+0000 7fddff800640 1 -- 172.21.15.8:0/2364171594 wait complete. 2024-03-23T23:44:11.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.200+0000 7fddff800640 1 Processor -- start 2024-03-23T23:44:11.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.200+0000 7fddff800640 1 -- start start 2024-03-23T23:44:11.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.204+0000 7fddff800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fddf80a9500 0x7fddf81efcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:11.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.204+0000 7fddff800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddf80c3520 0x7fddf81f2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:11.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.204+0000 7fddff800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fddf8152ef0 0x7fddf80c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:11.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.204+0000 7fddff800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf8162ee0 con 0x7fddf80c3520 2024-03-23T23:44:11.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.204+0000 7fddff800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf80a9b90 con 0x7fddf8152ef0 2024-03-23T23:44:11.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.204+0000 7fddff800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf8163060 con 0x7fddf80a9500 2024-03-23T23:44:11.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.204+0000 7fddfce00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fddf80a9500 0x7fddf81efcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:11.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.204+0000 7fddfce00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fddf80a9500 0x7fddf81efcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:52468/0 (socket says 172.21.15.8:52468) 2024-03-23T23:44:11.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.204+0000 7fddfce00640 1 -- 172.21.15.8:0/3740700305 learned_addr learned my addr 172.21.15.8:0/3740700305 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:44:11.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.204+0000 7fddf7e00640 1 --2- 172.21.15.8:0/3740700305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddf80c3520 0x7fddf81f2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:11.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.204+0000 7fddfd800640 1 --2- 172.21.15.8:0/3740700305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fddf8152ef0 0x7fddf80c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:11.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.204+0000 7fddfce00640 1 -- 172.21.15.8:0/3740700305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fddf8152ef0 msgr2=0x7fddf80c70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:11.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.204+0000 7fddfce00640 1 --2- 172.21.15.8:0/3740700305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fddf8152ef0 0x7fddf80c70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:11.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.204+0000 7fddfce00640 1 -- 172.21.15.8:0/3740700305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddf80c3520 msgr2=0x7fddf81f2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:11.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.204+0000 7fddfce00640 1 --2- 172.21.15.8:0/3740700305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddf80c3520 0x7fddf81f2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:11.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.204+0000 7fddfce00640 1 -- 172.21.15.8:0/3740700305 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf806f910 con 0x7fddf80a9500 2024-03-23T23:44:11.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.204+0000 7fddfce00640 1 --2- 172.21.15.8:0/3740700305 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fddf80a9500 0x7fddf81efcf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fddf0007ef0 tx=0x7fddf000e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:11.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.204+0000 7fddf4c00640 1 -- 172.21.15.8:0/3740700305 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf0014620 con 0x7fddf80a9500 2024-03-23T23:44:11.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.204+0000 7fddf4c00640 1 -- 172.21.15.8:0/3740700305 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf0019070 con 0x7fddf80a9500 2024-03-23T23:44:11.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.204+0000 7fddf4c00640 1 -- 172.21.15.8:0/3740700305 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf0014a00 con 0x7fddf80a9500 2024-03-23T23:44:11.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.204+0000 7fddff800640 1 -- 172.21.15.8:0/3740700305 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf806fbf0 con 0x7fddf80a9500 2024-03-23T23:44:11.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.204+0000 7fddff800640 1 -- 172.21.15.8:0/3740700305 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf81ee990 con 0x7fddf80a9500 2024-03-23T23:44:11.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.208+0000 7fddff800640 1 -- 172.21.15.8:0/3740700305 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf804f480 con 0x7fddf80a9500 2024-03-23T23:44:11.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.208+0000 7fddf4c00640 1 -- 172.21.15.8:0/3740700305 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fddf0014ba0 con 0x7fddf80a9500 2024-03-23T23:44:11.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.208+0000 7fddf4c00640 1 --2- 172.21.15.8:0/3740700305 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fddd4067660 0x7fddd4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:11.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.208+0000 7fddf4c00640 1 -- 172.21.15.8:0/3740700305 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fddf0054770 con 0x7fddf80a9500 2024-03-23T23:44:11.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.208+0000 7fddf7e00640 1 --2- 172.21.15.8:0/3740700305 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fddd4067660 0x7fddd4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:11.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.212+0000 7fddf7e00640 1 --2- 172.21.15.8:0/3740700305 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fddd4067660 0x7fddd4069b20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fddf80ab0e0 tx=0x7fdde8007c10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:11.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.216+0000 7fddf4c00640 1 -- 172.21.15.8:0/3740700305 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fddf0056dd0 con 0x7fddf80a9500 2024-03-23T23:44:11.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.532+0000 7fddff800640 1 -- 172.21.15.8:0/3740700305 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fddf81519a0 con 0x7fddf80a9500 2024-03-23T23:44:11.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.532+0000 7fddf4c00640 1 -- 172.21.15.8:0/3740700305 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1561 (secure 0 0 0) 0x7fddf00566d0 con 0x7fddf80a9500 2024-03-23T23:44:11.534 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:44:11.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.532+0000 7fddff800640 1 -- 172.21.15.8:0/3740700305 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fddd4067660 msgr2=0x7fddd4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:11.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.532+0000 7fddff800640 1 --2- 172.21.15.8:0/3740700305 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fddd4067660 0x7fddd4069b20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fddf80ab0e0 tx=0x7fdde8007c10 comp rx=0 tx=0).stop 2024-03-23T23:44:11.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.532+0000 7fddff800640 1 -- 172.21.15.8:0/3740700305 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fddf80a9500 msgr2=0x7fddf81efcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:11.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.532+0000 7fddff800640 1 --2- 172.21.15.8:0/3740700305 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fddf80a9500 0x7fddf81efcf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fddf0007ef0 tx=0x7fddf000e4b0 comp rx=0 tx=0).stop 2024-03-23T23:44:11.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.532+0000 7fddff800640 1 -- 172.21.15.8:0/3740700305 shutdown_connections 2024-03-23T23:44:11.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.532+0000 7fddff800640 1 --2- 172.21.15.8:0/3740700305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fddf8152ef0 0x7fddf80c70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:11.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.532+0000 7fddff800640 1 --2- 172.21.15.8:0/3740700305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddf80c3520 0x7fddf81f2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:11.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.532+0000 7fddff800640 1 --2- 172.21.15.8:0/3740700305 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fddd4067660 0x7fddd4069b20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:11.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.532+0000 7fddff800640 1 --2- 172.21.15.8:0/3740700305 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fddf80a9500 0x7fddf81efcf0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:11.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.532+0000 7fddff800640 1 -- 172.21.15.8:0/3740700305 >> 172.21.15.8:0/3740700305 conn(0x7fddf80c4c10 msgr2=0x7fddf8072ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:44:11.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.532+0000 7fddff800640 1 -- 172.21.15.8:0/3740700305 shutdown_connections 2024-03-23T23:44:11.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.532+0000 7fddff800640 1 -- 172.21.15.8:0/3740700305 wait complete. 2024-03-23T23:44:11.559 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T23:44:11.559 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-03-23T23:44:11.559 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T23:44:11.560 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:44:11.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.744+0000 7fb05e800640 1 Processor -- start 2024-03-23T23:44:11.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.744+0000 7fb05e800640 1 -- start start 2024-03-23T23:44:11.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.748+0000 7fb05e800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb05814d4a0 0x7fb0580ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:11.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.748+0000 7fb05e800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb058153ee0 0x7fb0580abe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:11.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.748+0000 7fb05e800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0580c2af0 con 0x7fb0580aa6f0 2024-03-23T23:44:11.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.748+0000 7fb05e800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0580c2100 con 0x7fb058153ee0 2024-03-23T23:44:11.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.748+0000 7fb05e800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb058074520 con 0x7fb05814d4a0 2024-03-23T23:44:11.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.748+0000 7fb05de00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb058153ee0 0x7fb0580abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:11.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.748+0000 7fb05d400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb05814d4a0 0x7fb0580ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:11.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.748+0000 7fb05de00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb058153ee0 0x7fb0580abe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45534/0 (socket says 172.21.15.8:45534) 2024-03-23T23:44:11.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.748+0000 7fb05d400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb05814d4a0 0x7fb0580ad0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:54966/0 (socket says 172.21.15.8:54966) 2024-03-23T23:44:11.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.748+0000 7fb05de00640 1 -- 172.21.15.8:0/544206429 learned_addr learned my addr 172.21.15.8:0/544206429 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:44:11.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.748+0000 7fb05de00640 1 -- 172.21.15.8:0/544206429 >> v2:172.21.15.196:3300/0 conn(0x7fb05814d4a0 msgr2=0x7fb0580ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:44:11.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.748+0000 7fb05de00640 1 --2- 172.21.15.8:0/544206429 >> v2:172.21.15.196:3300/0 conn(0x7fb05814d4a0 0x7fb0580ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:11.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.748+0000 7fb05de00640 1 -- 172.21.15.8:0/544206429 >> v1:172.21.15.196:6789/0 conn(0x7fb0580aa6f0 legacy=0x7fb0580c23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:11.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.748+0000 7fb05de00640 1 -- 172.21.15.8:0/544206429 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb058074800 con 0x7fb058153ee0 2024-03-23T23:44:11.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.748+0000 7fb05d400640 1 --2- 172.21.15.8:0/544206429 >> v2:172.21.15.196:3300/0 conn(0x7fb05814d4a0 0x7fb0580ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:44:11.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.752+0000 7fb05de00640 1 --2- 172.21.15.8:0/544206429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb058153ee0 0x7fb0580abe00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb058070a20 tx=0x7fb05001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0368b46590c17d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:11.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.752+0000 7fb057e00640 1 -- 172.21.15.8:0/544206429 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0500a5620 con 0x7fb058153ee0 2024-03-23T23:44:11.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.752+0000 7fb057e00640 1 -- 172.21.15.8:0/544206429 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0500a57c0 con 0x7fb058153ee0 2024-03-23T23:44:11.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.752+0000 7fb057e00640 1 -- 172.21.15.8:0/544206429 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0500a5b90 con 0x7fb058153ee0 2024-03-23T23:44:11.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.752+0000 7fb05e800640 1 -- 172.21.15.8:0/544206429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb058153ee0 msgr2=0x7fb0580abe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:11.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.752+0000 7fb05e800640 1 --2- 172.21.15.8:0/544206429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb058153ee0 0x7fb0580abe00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb058070a20 tx=0x7fb05001c960 comp rx=0 tx=0).stop 2024-03-23T23:44:11.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.752+0000 7fb05e800640 1 -- 172.21.15.8:0/544206429 shutdown_connections 2024-03-23T23:44:11.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.752+0000 7fb05e800640 1 --2- 172.21.15.8:0/544206429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb058153ee0 0x7fb0580abe00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:11.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.752+0000 7fb05e800640 1 --2- 172.21.15.8:0/544206429 >> v2:172.21.15.196:3300/0 conn(0x7fb05814d4a0 0x7fb0580ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:11.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.752+0000 7fb05e800640 1 -- 172.21.15.8:0/544206429 >> 172.21.15.8:0/544206429 conn(0x7fb0580c4060 msgr2=0x7fb0580c4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:44:11.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.752+0000 7fb05e800640 1 -- 172.21.15.8:0/544206429 shutdown_connections 2024-03-23T23:44:11.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.752+0000 7fb05e800640 1 -- 172.21.15.8:0/544206429 wait complete. 2024-03-23T23:44:11.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.756+0000 7fb05e800640 1 Processor -- start 2024-03-23T23:44:11.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.756+0000 7fb05e800640 1 -- start start 2024-03-23T23:44:11.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.756+0000 7fb05e800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0580aa6f0 0x7fb0581ef1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:11.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.756+0000 7fb05e800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb05814d4a0 0x7fb058146d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:11.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.756+0000 7fb05e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb058153ee0 0x7fb058142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:11.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.756+0000 7fb05e800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05815e240 con 0x7fb058153ee0 2024-03-23T23:44:11.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.756+0000 7fb05e800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05815e0c0 con 0x7fb05814d4a0 2024-03-23T23:44:11.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.756+0000 7fb05e800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb05815e3c0 con 0x7fb0580aa6f0 2024-03-23T23:44:11.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.756+0000 7fb05d400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0580aa6f0 0x7fb0581ef1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:11.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.760+0000 7fb05d400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0580aa6f0 0x7fb0581ef1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:52480/0 (socket says 172.21.15.8:52480) 2024-03-23T23:44:11.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.760+0000 7fb05de00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb058153ee0 0x7fb058142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:11.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.760+0000 7fb05d400640 1 -- 172.21.15.8:0/1173984148 learned_addr learned my addr 172.21.15.8:0/1173984148 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:44:11.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.760+0000 7fb05ca00640 1 --2- 172.21.15.8:0/1173984148 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb05814d4a0 0x7fb058146d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:11.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.760+0000 7fb05d400640 1 -- 172.21.15.8:0/1173984148 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb05814d4a0 msgr2=0x7fb058146d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:11.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.760+0000 7fb05d400640 1 --2- 172.21.15.8:0/1173984148 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb05814d4a0 0x7fb058146d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:11.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.760+0000 7fb05d400640 1 -- 172.21.15.8:0/1173984148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb058153ee0 msgr2=0x7fb058142550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:11.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.760+0000 7fb05d400640 1 --2- 172.21.15.8:0/1173984148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb058153ee0 0x7fb058142550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:11.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.760+0000 7fb05d400640 1 -- 172.21.15.8:0/1173984148 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0581ee710 con 0x7fb0580aa6f0 2024-03-23T23:44:11.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.760+0000 7fb05d400640 1 --2- 172.21.15.8:0/1173984148 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0580aa6f0 0x7fb0581ef1b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00ebe0 tx=0x7fb04c00c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:11.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.760+0000 7fb055600640 1 -- 172.21.15.8:0/1173984148 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c017070 con 0x7fb0580aa6f0 2024-03-23T23:44:11.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.760+0000 7fb055600640 1 -- 172.21.15.8:0/1173984148 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04c00cc30 con 0x7fb0580aa6f0 2024-03-23T23:44:11.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.760+0000 7fb055600640 1 -- 172.21.15.8:0/1173984148 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c013470 con 0x7fb0580aa6f0 2024-03-23T23:44:11.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.760+0000 7fb05e800640 1 -- 172.21.15.8:0/1173984148 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb058150e40 con 0x7fb0580aa6f0 2024-03-23T23:44:11.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.760+0000 7fb05e800640 1 -- 172.21.15.8:0/1173984148 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0581ee9b0 con 0x7fb0580aa6f0 2024-03-23T23:44:11.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.760+0000 7fb05e800640 1 --2- 172.21.15.8:0/1173984148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0581436f0 0x7fb0581eebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:11.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.760+0000 7fb05e800640 1 -- 172.21.15.8:0/1173984148 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb058068790 con 0x7fb0581436f0 2024-03-23T23:44:11.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.760+0000 7fb05ca00640 1 --2- 172.21.15.8:0/1173984148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0581436f0 0x7fb0581eebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:11.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.760+0000 7fb05ca00640 1 -- 172.21.15.8:0/1173984148 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb05804f410 con 0x7fb0581436f0 2024-03-23T23:44:11.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.760+0000 7fb05ca00640 1 --2- 172.21.15.8:0/1173984148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0581436f0 0x7fb0581eebb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb0581476a0 tx=0x7fb04400f9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:11.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.764+0000 7fb055600640 1 -- 172.21.15.8:0/1173984148 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb044019070 con 0x7fb0581436f0 2024-03-23T23:44:11.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.764+0000 7fb055600640 1 -- 172.21.15.8:0/1173984148 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb04c01a070 con 0x7fb0580aa6f0 2024-03-23T23:44:11.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.764+0000 7fb055600640 1 --2- 172.21.15.8:0/1173984148 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb038067560 0x7fb038069a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:11.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.764+0000 7fb055600640 1 -- 172.21.15.8:0/1173984148 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fb04c085ae0 con 0x7fb0580aa6f0 2024-03-23T23:44:11.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.764+0000 7fb055600640 1 -- 172.21.15.8:0/1173984148 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fb044005320 con 0x7fb0581436f0 2024-03-23T23:44:11.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.764+0000 7fb055600640 1 -- 172.21.15.8:0/1173984148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0581436f0 msgr2=0x7fb0581eebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:11.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.764+0000 7fb055600640 1 --2- 172.21.15.8:0/1173984148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0581436f0 0x7fb0581eebb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb0581476a0 tx=0x7fb04400f9d0 comp rx=0 tx=0).stop 2024-03-23T23:44:11.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.764+0000 7fb055600640 1 -- 172.21.15.8:0/1173984148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0581436f0 msgr2=0x7fb0581eebb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:44:11.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.764+0000 7fb055600640 1 --2- 172.21.15.8:0/1173984148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0581436f0 0x7fb0581eebb0 secure :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb0581476a0 tx=0x7fb04400f9d0 comp rx=0 tx=0).stop 2024-03-23T23:44:11.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.764+0000 7fb05de00640 1 --2- 172.21.15.8:0/1173984148 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb038067560 0x7fb038069a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:11.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.764+0000 7fb05de00640 1 --2- 172.21.15.8:0/1173984148 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb038067560 0x7fb038069a20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb0500ae000 tx=0x7fb0500a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:11.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.776+0000 7fb05e800640 1 --2- 172.21.15.8:0/1173984148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb05814c3f0 0x7fb05814c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:11.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.776+0000 7fb05e800640 1 -- 172.21.15.8:0/1173984148 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05814cd30 con 0x7fb05814c3f0 2024-03-23T23:44:11.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.776+0000 7fb05ca00640 1 --2- 172.21.15.8:0/1173984148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb05814c3f0 0x7fb05814c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:11.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.776+0000 7fb05ca00640 1 -- 172.21.15.8:0/1173984148 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb05806c520 con 0x7fb05814c3f0 2024-03-23T23:44:11.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.776+0000 7fb05ca00640 1 --2- 172.21.15.8:0/1173984148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb05814c3f0 0x7fb05814c7f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb0581ef0f0 tx=0x7fb044007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:11.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.776+0000 7fb055600640 1 -- 172.21.15.8:0/1173984148 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb044007540 con 0x7fb05814c3f0 2024-03-23T23:44:11.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.776+0000 7fb055600640 1 -- 172.21.15.8:0/1173984148 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4532 (secure 0 0 0) 0x7fb044007540 con 0x7fb05814c3f0 2024-03-23T23:44:11.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.776+0000 7fb055600640 1 -- 172.21.15.8:0/1173984148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb05814c3f0 msgr2=0x7fb05814c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:11.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.776+0000 7fb055600640 1 --2- 172.21.15.8:0/1173984148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb05814c3f0 0x7fb05814c7f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb0581ef0f0 tx=0x7fb044007f90 comp rx=0 tx=0).stop 2024-03-23T23:44:11.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.776+0000 7fb055600640 1 -- 172.21.15.8:0/1173984148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb05814c3f0 msgr2=0x7fb05814c7f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:44:11.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.776+0000 7fb055600640 1 --2- 172.21.15.8:0/1173984148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb05814c3f0 0x7fb05814c7f0 secure :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb0581ef0f0 tx=0x7fb044007f90 comp rx=0 tx=0).stop 2024-03-23T23:44:11.781 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:44:11.781 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:44:11.781 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:44:11.781 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:44:11.781 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 10, 2024-03-23T23:44:11.781 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:44:11.781 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:44:11.781 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:44:11.781 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:44:11.781 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:11.781 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 11, 2024-03-23T23:44:11.782 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:44:11.782 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:44:11.782 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:44:11.782 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:44:11.782 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:44:11.782 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:44:11.782 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:44:11.782 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:44:11.782 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:44:11.782 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:44:11.782 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:44:11.782 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:44:11.783 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:44:11.783 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:44:11.783 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:11.783 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:44:11.783 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:44:11.783 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:44:11.783 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:44:11.783 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:44:11.783 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:44:11.783 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:44:11.783 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:44:11.783 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:44:11.783 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:44:11.783 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:44:11.784 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:44:11.784 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:44:11.784 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:11.784 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:11.784 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:44:11.784 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:44:11.784 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:44:11.784 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:44:11.784 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:44:11.784 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:44:11.784 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:44:11.784 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:44:11.784 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:44:11.784 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:44:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:44:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:44:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:44:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:44:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:44:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:44:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:44:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:44:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:44:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:44:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:44:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:44:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:44:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:44:11.786 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:44:11.786 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:44:11.786 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:44:11.786 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:44:11.786 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:11.786 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:44:11.786 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:11.786 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:44:11.786 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:11.786 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:44:11.786 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:44:11.786 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:44:11.786 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:44:11.787 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:11.787 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:44:11.787 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:44:11.787 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:11.787 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:11.787 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:11.787 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:44:11.787 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:44:11.787 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:11.787 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:11.787 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:11.788 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:11.788 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:44:11.788 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:44:11.788 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:44:11.788 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:44:11.788 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:44:11.788 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:11.788 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:11.788 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:44:11.788 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:44:11.788 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:44:11.788 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:44:11.788 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:11.788 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:44:11.789 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:44:11.789 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:11.789 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:11.789 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:11.789 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:44:11.789 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:44:11.789 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:11.789 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:11.789 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:11.789 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:11.789 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:44:11.789 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:44:11.789 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:44:11.789 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:44:11.790 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:44:11.790 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:11.790 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:11.790 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:44:11.790 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:44:11.790 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:44:11.790 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:44:11.790 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:11.790 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:44:11.790 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:44:11.790 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:11.790 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:11.791 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:11.791 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:44:11.791 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:44:11.791 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:11.791 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:11.791 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:11.791 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:11.791 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:44:11.791 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:44:11.791 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:44:11.791 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:44:11.791 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:44:11.792 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:11.792 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:11.792 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:11.792 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:44:11.792 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:44:11.792 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:11.792 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:44:11.792 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:11.792 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:44:11.792 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:11.792 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:11.792 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:44:11.793 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:11.793 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:44:11.793 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:11.793 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:44:11.793 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:11.793 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:11.793 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:11.793 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:44:11.793 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:44:11.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.776+0000 7fb05e800640 1 -- 172.21.15.8:0/1173984148 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb038067560 msgr2=0x7fb038069a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:11.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.776+0000 7fb05e800640 1 --2- 172.21.15.8:0/1173984148 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb038067560 0x7fb038069a20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb0500ae000 tx=0x7fb0500a7070 comp rx=0 tx=0).stop 2024-03-23T23:44:11.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.776+0000 7fb05e800640 1 -- 172.21.15.8:0/1173984148 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0580aa6f0 msgr2=0x7fb0581ef1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:11.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.776+0000 7fb05e800640 1 --2- 172.21.15.8:0/1173984148 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0580aa6f0 0x7fb0581ef1b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00ebe0 tx=0x7fb04c00c520 comp rx=0 tx=0).stop 2024-03-23T23:44:11.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.780+0000 7fb05de00640 1 -- 172.21.15.8:0/1173984148 reap_dead start 2024-03-23T23:44:11.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.780+0000 7fb05de00640 1 -- 172.21.15.8:0/1173984148 reap_dead start 2024-03-23T23:44:11.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.780+0000 7fb05e800640 1 -- 172.21.15.8:0/1173984148 shutdown_connections 2024-03-23T23:44:11.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.780+0000 7fb05e800640 1 -- 172.21.15.8:0/1173984148 >> 172.21.15.8:0/1173984148 conn(0x7fb0580c4060 msgr2=0x7fb058147bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:44:11.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.780+0000 7fb05e800640 1 -- 172.21.15.8:0/1173984148 shutdown_connections 2024-03-23T23:44:11.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:11.780+0000 7fb05e800640 1 -- 172.21.15.8:0/1173984148 wait complete. 2024-03-23T23:44:11.806 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:44:11.806 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T23:44:11.806 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:44:12.007 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.004+0000 7fcecfe00640 1 Processor -- start 2024-03-23T23:44:12.007 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.004+0000 7fcecfe00640 1 -- start start 2024-03-23T23:44:12.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.008+0000 7fcecfe00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fced00c2400 0x7fced0070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:12.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.008+0000 7fcecfe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fced00c27e0 0x7fced0155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:12.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.008+0000 7fcecfe00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced00c9350 con 0x7fced00c2c60 2024-03-23T23:44:12.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.008+0000 7fcecfe00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced00c9630 con 0x7fced00c2400 2024-03-23T23:44:12.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.008+0000 7fcecfe00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced00c6c70 con 0x7fced00c27e0 2024-03-23T23:44:12.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.008+0000 7fcecea00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fced00c2400 0x7fced0070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:12.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.008+0000 7fcece000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fced00c27e0 0x7fced0155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:12.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.008+0000 7fcecea00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fced00c2400 0x7fced0070a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:54984/0 (socket says 172.21.15.8:54984) 2024-03-23T23:44:12.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.008+0000 7fcece000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fced00c27e0 0x7fced0155fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:52482/0 (socket says 172.21.15.8:52482) 2024-03-23T23:44:12.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.008+0000 7fcecea00640 1 -- 172.21.15.8:0/44124201 learned_addr learned my addr 172.21.15.8:0/44124201 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:44:12.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.008+0000 7fcecea00640 1 -- 172.21.15.8:0/44124201 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fced00c27e0 msgr2=0x7fced0155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:44:12.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.008+0000 7fcecea00640 1 --2- 172.21.15.8:0/44124201 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fced00c27e0 0x7fced0155fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:12.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.008+0000 7fcecea00640 1 -- 172.21.15.8:0/44124201 >> v1:172.21.15.196:6789/0 conn(0x7fced00c2c60 legacy=0x7fced01564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:12.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.008+0000 7fcecea00640 1 -- 172.21.15.8:0/44124201 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced00c6f50 con 0x7fced00c2400 2024-03-23T23:44:12.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.008+0000 7fcece000640 1 --2- 172.21.15.8:0/44124201 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fced00c27e0 0x7fced0155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:44:12.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.012+0000 7fcecea00640 1 --2- 172.21.15.8:0/44124201 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced00c2400 0x7fced0070a90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcec0009870 tx=0x7fcec001c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f398437b548f8034 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:12.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.012+0000 7fcecd600640 1 -- 172.21.15.8:0/44124201 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec00b0070 con 0x7fced00c2400 2024-03-23T23:44:12.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.012+0000 7fcecd600640 1 -- 172.21.15.8:0/44124201 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec00ab600 con 0x7fced00c2400 2024-03-23T23:44:12.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.012+0000 7fcecd600640 1 -- 172.21.15.8:0/44124201 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec00ab9d0 con 0x7fced00c2400 2024-03-23T23:44:12.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.012+0000 7fcecfe00640 1 -- 172.21.15.8:0/44124201 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced00c2400 msgr2=0x7fced0070a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:12.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.012+0000 7fcecfe00640 1 --2- 172.21.15.8:0/44124201 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced00c2400 0x7fced0070a90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcec0009870 tx=0x7fcec001c4d0 comp rx=0 tx=0).stop 2024-03-23T23:44:12.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.012+0000 7fcecfe00640 1 -- 172.21.15.8:0/44124201 shutdown_connections 2024-03-23T23:44:12.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.012+0000 7fcecfe00640 1 --2- 172.21.15.8:0/44124201 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fced00c27e0 0x7fced0155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:12.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.012+0000 7fcecfe00640 1 --2- 172.21.15.8:0/44124201 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced00c2400 0x7fced0070a90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:12.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.012+0000 7fcecfe00640 1 -- 172.21.15.8:0/44124201 >> 172.21.15.8:0/44124201 conn(0x7fced00aab20 msgr2=0x7fced00aaf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:44:12.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.012+0000 7fcecfe00640 1 -- 172.21.15.8:0/44124201 shutdown_connections 2024-03-23T23:44:12.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.012+0000 7fcecfe00640 1 -- 172.21.15.8:0/44124201 wait complete. 2024-03-23T23:44:12.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.016+0000 7fcecfe00640 1 Processor -- start 2024-03-23T23:44:12.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.016+0000 7fcecfe00640 1 -- start start 2024-03-23T23:44:12.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.016+0000 7fcecfe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fced00c2400 0x7fced0157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:12.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.016+0000 7fcecfe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fced00c27e0 0x7fced014def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:12.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.016+0000 7fcecfe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced00c2c60 0x7fced014d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:12.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.020+0000 7fcecfe00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced00c8010 con 0x7fced00c2400 2024-03-23T23:44:12.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.020+0000 7fcecfe00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced00c7e90 con 0x7fced00c2c60 2024-03-23T23:44:12.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.020+0000 7fcecfe00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced01eef30 con 0x7fced00c27e0 2024-03-23T23:44:12.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.020+0000 7fcece000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fced00c27e0 0x7fced014def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:12.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.020+0000 7fcecea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fced00c2400 0x7fced0157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:12.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.020+0000 7fcece000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fced00c27e0 0x7fced014def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:52498/0 (socket says 172.21.15.8:52498) 2024-03-23T23:44:12.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.020+0000 7fcece000640 1 -- 172.21.15.8:0/2867270339 learned_addr learned my addr 172.21.15.8:0/2867270339 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:44:12.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.020+0000 7fcecf400640 1 --2- 172.21.15.8:0/2867270339 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced00c2c60 0x7fced014d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:12.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.020+0000 7fcece000640 1 -- 172.21.15.8:0/2867270339 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced00c2c60 msgr2=0x7fced014d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:12.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.020+0000 7fcece000640 1 --2- 172.21.15.8:0/2867270339 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced00c2c60 0x7fced014d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:12.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.020+0000 7fcece000640 1 -- 172.21.15.8:0/2867270339 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fced00c2400 msgr2=0x7fced0157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:12.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.020+0000 7fcece000640 1 --2- 172.21.15.8:0/2867270339 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fced00c2400 0x7fced0157e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:12.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.020+0000 7fcece000640 1 -- 172.21.15.8:0/2867270339 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced0152d40 con 0x7fced00c27e0 2024-03-23T23:44:12.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.020+0000 7fcecf400640 1 --2- 172.21.15.8:0/2867270339 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced00c2c60 0x7fced014d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:44:12.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.020+0000 7fcecea00640 1 --2- 172.21.15.8:0/2867270339 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fced00c2400 0x7fced0157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:44:12.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.020+0000 7fcece000640 1 --2- 172.21.15.8:0/2867270339 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fced00c27e0 0x7fced014def0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00e9b0 tx=0x7fcebc00ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:12.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.020+0000 7fcec6a00640 1 -- 172.21.15.8:0/2867270339 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc017070 con 0x7fced00c27e0 2024-03-23T23:44:12.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.020+0000 7fcec6a00640 1 -- 172.21.15.8:0/2867270339 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcebc00ca00 con 0x7fced00c27e0 2024-03-23T23:44:12.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.020+0000 7fcecfe00640 1 -- 172.21.15.8:0/2867270339 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced01583b0 con 0x7fced00c27e0 2024-03-23T23:44:12.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.020+0000 7fcec6a00640 1 -- 172.21.15.8:0/2867270339 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc00cdd0 con 0x7fced00c27e0 2024-03-23T23:44:12.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.020+0000 7fcecfe00640 1 -- 172.21.15.8:0/2867270339 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced0152a60 con 0x7fced00c27e0 2024-03-23T23:44:12.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.020+0000 7fcecfe00640 1 --2- 172.21.15.8:0/2867270339 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced014f450 0x7fced014d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:12.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.020+0000 7fcecfe00640 1 -- 172.21.15.8:0/2867270339 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced014dd50 con 0x7fced014f450 2024-03-23T23:44:12.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.020+0000 7fcecea00640 1 --2- 172.21.15.8:0/2867270339 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced014f450 0x7fced014d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:12.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.020+0000 7fcecea00640 1 -- 172.21.15.8:0/2867270339 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fced0157c30 con 0x7fced014f450 2024-03-23T23:44:12.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.024+0000 7fcecea00640 1 --2- 172.21.15.8:0/2867270339 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced014f450 0x7fced014d810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fced00af080 tx=0x7fcec0019270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:12.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.024+0000 7fcec6a00640 1 -- 172.21.15.8:0/2867270339 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fcebc01a070 con 0x7fced00c27e0 2024-03-23T23:44:12.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.024+0000 7fcec6a00640 1 --2- 172.21.15.8:0/2867270339 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fceb0067660 0x7fceb0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:12.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.024+0000 7fcec6a00640 1 -- 172.21.15.8:0/2867270339 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fcebc085300 con 0x7fced00c27e0 2024-03-23T23:44:12.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.024+0000 7fcecf400640 1 --2- 172.21.15.8:0/2867270339 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fceb0067660 0x7fceb0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:12.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.024+0000 7fcec6a00640 1 -- 172.21.15.8:0/2867270339 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec00b0040 con 0x7fced014f450 2024-03-23T23:44:12.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.024+0000 7fcec6a00640 1 -- 172.21.15.8:0/2867270339 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fcec00b5640 con 0x7fced014f450 2024-03-23T23:44:12.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.024+0000 7fcec6a00640 1 -- 172.21.15.8:0/2867270339 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced014f450 msgr2=0x7fced014d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:12.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.024+0000 7fcec6a00640 1 --2- 172.21.15.8:0/2867270339 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced014f450 0x7fced014d810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fced00af080 tx=0x7fcec0019270 comp rx=0 tx=0).stop 2024-03-23T23:44:12.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.024+0000 7fcec6a00640 1 -- 172.21.15.8:0/2867270339 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced014f450 msgr2=0x7fced014d810 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:44:12.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.024+0000 7fcec6a00640 1 --2- 172.21.15.8:0/2867270339 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced014f450 0x7fced014d810 secure :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fced00af080 tx=0x7fcec0019270 comp rx=0 tx=0).stop 2024-03-23T23:44:12.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.024+0000 7fcecf400640 1 --2- 172.21.15.8:0/2867270339 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fceb0067660 0x7fceb0069b20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcec80012f0 tx=0x7fcec8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:12.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.036+0000 7fcecfe00640 1 --2- 172.21.15.8:0/2867270339 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced0156e50 0x7fced0157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:12.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.036+0000 7fcecfe00640 1 -- 172.21.15.8:0/2867270339 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced00c8190 con 0x7fced0156e50 2024-03-23T23:44:12.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.036+0000 7fcecea00640 1 --2- 172.21.15.8:0/2867270339 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced0156e50 0x7fced0157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:12.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.036+0000 7fcecea00640 1 -- 172.21.15.8:0/2867270339 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fced0159330 con 0x7fced0156e50 2024-03-23T23:44:12.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.036+0000 7fcecea00640 1 --2- 172.21.15.8:0/2867270339 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced0156e50 0x7fced0157260 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcec0009870 tx=0x7fcec0009240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:12.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.040+0000 7fcec6a00640 1 -- 172.21.15.8:0/2867270339 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec00b0070 con 0x7fced0156e50 2024-03-23T23:44:12.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.040+0000 7fcec6a00640 1 -- 172.21.15.8:0/2867270339 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5183 (secure 0 0 0) 0x7fcec00c0620 con 0x7fced0156e50 2024-03-23T23:44:12.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.040+0000 7fcec6a00640 1 -- 172.21.15.8:0/2867270339 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced0156e50 msgr2=0x7fced0157260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:12.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.040+0000 7fcec6a00640 1 --2- 172.21.15.8:0/2867270339 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced0156e50 0x7fced0157260 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcec0009870 tx=0x7fcec0009240 comp rx=0 tx=0).stop 2024-03-23T23:44:12.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.040+0000 7fcec6a00640 1 -- 172.21.15.8:0/2867270339 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced0156e50 msgr2=0x7fced0157260 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:44:12.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.040+0000 7fcec6a00640 1 --2- 172.21.15.8:0/2867270339 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced0156e50 0x7fced0157260 secure :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcec0009870 tx=0x7fcec0009240 comp rx=0 tx=0).stop 2024-03-23T23:44:12.041 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:44:12.042 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:44:12.042 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:44:12.042 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:44:12.042 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 10, 2024-03-23T23:44:12.042 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:44:12.042 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:44:12.042 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:44:12.042 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:44:12.042 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:12.042 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 12, 2024-03-23T23:44:12.042 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:44:12.043 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:44:12.043 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:44:12.043 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:44:12.043 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:44:12.043 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:44:12.043 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:44:12.043 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:44:12.043 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:44:12.043 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:44:12.043 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:44:12.043 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:44:12.043 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:44:12.043 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:44:12.044 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:12.044 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:44:12.044 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:44:12.044 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:44:12.044 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:44:12.044 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:44:12.044 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:44:12.044 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:44:12.044 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:44:12.044 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:44:12.044 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:44:12.044 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:44:12.045 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:44:12.045 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:44:12.045 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:12.045 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:12.045 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:44:12.045 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:44:12.045 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:44:12.045 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:44:12.045 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:44:12.045 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:44:12.045 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:44:12.045 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:44:12.045 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:44:12.045 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:44:12.046 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:44:12.046 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:44:12.046 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:44:12.046 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:44:12.046 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:44:12.046 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:44:12.046 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:44:12.046 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:44:12.046 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:44:12.046 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:44:12.046 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:44:12.046 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:44:12.047 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:44:12.047 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:44:12.047 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:44:12.047 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:44:12.047 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:44:12.047 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:44:12.047 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:12.047 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:44:12.047 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:12.047 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:44:12.047 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:12.047 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:44:12.047 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:44:12.047 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:44:12.048 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:44:12.048 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:12.048 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:44:12.048 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:44:12.048 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:12.048 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:12.048 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:12.048 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:44:12.048 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:44:12.048 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:12.048 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:12.048 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:12.048 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:12.049 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:44:12.049 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:44:12.049 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:44:12.049 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:44:12.049 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:44:12.049 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:12.049 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:12.049 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:44:12.049 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:44:12.049 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:44:12.049 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:44:12.049 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:12.049 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:44:12.049 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:44:12.050 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:12.050 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:12.050 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:12.050 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:44:12.050 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:44:12.050 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:12.050 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:12.050 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:12.050 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:12.050 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:44:12.050 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:44:12.050 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:44:12.050 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:44:12.051 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:44:12.051 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:12.051 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:12.051 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:44:12.051 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:44:12.051 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:44:12.051 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:44:12.051 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:12.051 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:44:12.051 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:44:12.051 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:12.051 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:12.051 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:12.051 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:44:12.052 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:44:12.052 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:12.052 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:12.052 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:12.052 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:12.052 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:44:12.052 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:44:12.052 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:44:12.052 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:44:12.052 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:44:12.052 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:12.052 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:12.052 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:12.053 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:44:12.053 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:44:12.053 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:12.053 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:44:12.053 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:12.053 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:44:12.053 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:12.053 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:12.053 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:44:12.053 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:12.053 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:44:12.053 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:12.053 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:44:12.054 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:12.054 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:12.054 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:44:12.054 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:12.054 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:44:12.054 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:12.054 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:44:12.054 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:12.054 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:12.054 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:44:12.054 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:12.054 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:44:12.054 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:12.055 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:44:12.055 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:12.055 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:12.055 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:44:12.055 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:12.055 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:44:12.055 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:12.055 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:12.055 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:44:12.055 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:12.055 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:44:12.055 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:12.056 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:44:12.056 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:12.056 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:12.056 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:12.056 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:44:12.056 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:44:12.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.040+0000 7fcecfe00640 1 -- 172.21.15.8:0/2867270339 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fceb0067660 msgr2=0x7fceb0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:12.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.040+0000 7fcecfe00640 1 --2- 172.21.15.8:0/2867270339 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fceb0067660 0x7fceb0069b20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcec80012f0 tx=0x7fcec8009040 comp rx=0 tx=0).stop 2024-03-23T23:44:12.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.040+0000 7fcecfe00640 1 -- 172.21.15.8:0/2867270339 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fced00c27e0 msgr2=0x7fced014def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:12.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.040+0000 7fcecfe00640 1 --2- 172.21.15.8:0/2867270339 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fced00c27e0 0x7fced014def0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00e9b0 tx=0x7fcebc00ee70 comp rx=0 tx=0).stop 2024-03-23T23:44:12.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.040+0000 7fcecf400640 1 -- 172.21.15.8:0/2867270339 reap_dead start 2024-03-23T23:44:12.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.040+0000 7fcecfe00640 1 -- 172.21.15.8:0/2867270339 shutdown_connections 2024-03-23T23:44:12.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.040+0000 7fcecfe00640 1 --2- 172.21.15.8:0/2867270339 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fced00c27e0 0x7fced014def0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:12.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.040+0000 7fcecfe00640 1 -- 172.21.15.8:0/2867270339 >> 172.21.15.8:0/2867270339 conn(0x7fced00aab20 msgr2=0x7fced006dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:44:12.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.040+0000 7fcecfe00640 1 -- 172.21.15.8:0/2867270339 shutdown_connections 2024-03-23T23:44:12.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.040+0000 7fcecfe00640 1 -- 172.21.15.8:0/2867270339 wait complete. 2024-03-23T23:44:12.060 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:44:12.060 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T23:44:12.061 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:44:12.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.240+0000 7fa509a00640 1 Processor -- start 2024-03-23T23:44:12.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.240+0000 7fa509a00640 1 -- start start 2024-03-23T23:44:12.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.240+0000 7fa509a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa504149bd0 0x7fa50414a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:12.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.240+0000 7fa509a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa5040ac270 0x7fa5040ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:12.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.240+0000 7fa509a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50414a5a0 con 0x7fa504156ee0 2024-03-23T23:44:12.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.240+0000 7fa509a00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5040aa390 con 0x7fa5040ac270 2024-03-23T23:44:12.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.240+0000 7fa509a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa50406e720 con 0x7fa504149bd0 2024-03-23T23:44:12.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.244+0000 7fa502000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa504149bd0 0x7fa50414a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:12.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.244+0000 7fa502a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fa504156ee0 0x7fa504073230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41648/0 (socket says 172.21.15.8:41648) 2024-03-23T23:44:12.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.244+0000 7fa502a00640 1 -- 172.21.15.8:0/656703541 learned_addr learned my addr 172.21.15.8:0/656703541 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:44:12.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.244+0000 7fa503400640 1 --2- 172.21.15.8:0/656703541 >> v2:172.21.15.8:3300/0 conn(0x7fa5040ac270 0x7fa5040ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:12.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.244+0000 7fa503400640 1 -- 172.21.15.8:0/656703541 >> v2:172.21.15.196:3300/0 conn(0x7fa504149bd0 msgr2=0x7fa50414a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:44:12.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.244+0000 7fa503400640 1 --2- 172.21.15.8:0/656703541 >> v2:172.21.15.196:3300/0 conn(0x7fa504149bd0 0x7fa50414a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:12.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.244+0000 7fa503400640 1 -- 172.21.15.8:0/656703541 >> v1:172.21.15.8:6789/0 conn(0x7fa504156ee0 legacy=0x7fa504073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:12.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.244+0000 7fa503400640 1 -- 172.21.15.8:0/656703541 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50406ea00 con 0x7fa5040ac270 2024-03-23T23:44:12.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.248+0000 7fa503400640 1 --2- 172.21.15.8:0/656703541 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5040ac270 0x7fa5040ac6e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa50406f680 tx=0x7fa4fc020c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec467044d7d38771 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:12.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.248+0000 7fa501600640 1 -- 172.21.15.8:0/656703541 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc0b6070 con 0x7fa5040ac270 2024-03-23T23:44:12.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.248+0000 7fa501600640 1 -- 172.21.15.8:0/656703541 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4fc0a9b50 con 0x7fa5040ac270 2024-03-23T23:44:12.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.248+0000 7fa501600640 1 -- 172.21.15.8:0/656703541 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc0b1440 con 0x7fa5040ac270 2024-03-23T23:44:12.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.248+0000 7fa509a00640 1 -- 172.21.15.8:0/656703541 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5040ac270 msgr2=0x7fa5040ac6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:12.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.248+0000 7fa509a00640 1 --2- 172.21.15.8:0/656703541 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5040ac270 0x7fa5040ac6e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa50406f680 tx=0x7fa4fc020c80 comp rx=0 tx=0).stop 2024-03-23T23:44:12.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.248+0000 7fa509a00640 1 -- 172.21.15.8:0/656703541 shutdown_connections 2024-03-23T23:44:12.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.248+0000 7fa509a00640 1 --2- 172.21.15.8:0/656703541 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5040ac270 0x7fa5040ac6e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:12.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.248+0000 7fa509a00640 1 --2- 172.21.15.8:0/656703541 >> v2:172.21.15.196:3300/0 conn(0x7fa504149bd0 0x7fa50414a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:12.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.248+0000 7fa509a00640 1 -- 172.21.15.8:0/656703541 >> 172.21.15.8:0/656703541 conn(0x7fa50406b170 msgr2=0x7fa50406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:44:12.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.248+0000 7fa509a00640 1 -- 172.21.15.8:0/656703541 shutdown_connections 2024-03-23T23:44:12.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.248+0000 7fa509a00640 1 -- 172.21.15.8:0/656703541 wait complete. 2024-03-23T23:44:12.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.252+0000 7fa509a00640 1 Processor -- start 2024-03-23T23:44:12.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.252+0000 7fa509a00640 1 -- start start 2024-03-23T23:44:12.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.252+0000 7fa509a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa5040ac270 0x7fa504145f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:12.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.252+0000 7fa509a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa504149bd0 0x7fa5041ec750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:12.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.252+0000 7fa509a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa504156ee0 0x7fa5041ecc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.252+0000 7fa509a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5041579f0 con 0x7fa504149bd0 2024-03-23T23:44:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.252+0000 7fa509a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa504157870 con 0x7fa5040ac270 2024-03-23T23:44:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.252+0000 7fa509a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5041572c0 con 0x7fa504156ee0 2024-03-23T23:44:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.252+0000 7fa502a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa5040ac270 0x7fa504145f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.252+0000 7fa502000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa504149bd0 0x7fa5041ec750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.252+0000 7fa502a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa5040ac270 0x7fa504145f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:55040/0 (socket says 172.21.15.8:55040) 2024-03-23T23:44:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.252+0000 7fa502a00640 1 -- 172.21.15.8:0/2422084516 learned_addr learned my addr 172.21.15.8:0/2422084516 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:44:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.256+0000 7fa503400640 1 --2- 172.21.15.8:0/2422084516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa504156ee0 0x7fa5041ecc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:12.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.256+0000 7fa502000640 1 -- 172.21.15.8:0/2422084516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa504156ee0 msgr2=0x7fa5041ecc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:12.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.256+0000 7fa502000640 1 --2- 172.21.15.8:0/2422084516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa504156ee0 0x7fa5041ecc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:12.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.256+0000 7fa502000640 1 -- 172.21.15.8:0/2422084516 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa5040ac270 msgr2=0x7fa504145f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:12.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.256+0000 7fa502000640 1 --2- 172.21.15.8:0/2422084516 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa5040ac270 0x7fa504145f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:12.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.256+0000 7fa502000640 1 -- 172.21.15.8:0/2422084516 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50414de80 con 0x7fa504149bd0 2024-03-23T23:44:12.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.256+0000 7fa502000640 1 --2- 172.21.15.8:0/2422084516 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa504149bd0 0x7fa5041ec750 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa4f000e870 tx=0x7fa4f000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:12.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.256+0000 7fa4faa00640 1 -- 172.21.15.8:0/2422084516 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f0017070 con 0x7fa504149bd0 2024-03-23T23:44:12.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.256+0000 7fa4faa00640 1 -- 172.21.15.8:0/2422084516 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f000c940 con 0x7fa504149bd0 2024-03-23T23:44:12.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.256+0000 7fa4faa00640 1 -- 172.21.15.8:0/2422084516 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f000ccf0 con 0x7fa504149bd0 2024-03-23T23:44:12.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.256+0000 7fa509a00640 1 -- 172.21.15.8:0/2422084516 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa50414e160 con 0x7fa504149bd0 2024-03-23T23:44:12.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.256+0000 7fa509a00640 1 -- 172.21.15.8:0/2422084516 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50414e6f0 con 0x7fa504149bd0 2024-03-23T23:44:12.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.256+0000 7fa509a00640 1 --2- 172.21.15.8:0/2422084516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa5041e9ea0 0x7fa5041ea310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:12.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.256+0000 7fa509a00640 1 -- 172.21.15.8:0/2422084516 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50414ea40 con 0x7fa5041e9ea0 2024-03-23T23:44:12.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.256+0000 7fa502a00640 1 --2- 172.21.15.8:0/2422084516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa5041e9ea0 0x7fa5041ea310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:12.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.256+0000 7fa502a00640 1 -- 172.21.15.8:0/2422084516 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa504068270 con 0x7fa5041e9ea0 2024-03-23T23:44:12.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.256+0000 7fa502a00640 1 --2- 172.21.15.8:0/2422084516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa5041e9ea0 0x7fa5041ea310 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa4f40014a0 tx=0x7fa4f40018a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:12.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.256+0000 7fa4faa00640 1 -- 172.21.15.8:0/2422084516 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fa4f001a070 con 0x7fa504149bd0 2024-03-23T23:44:12.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.260+0000 7fa4faa00640 1 --2- 172.21.15.8:0/2422084516 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa4e4067690 0x7fa4e4069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:12.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.260+0000 7fa4faa00640 1 -- 172.21.15.8:0/2422084516 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fa4f0085b20 con 0x7fa504149bd0 2024-03-23T23:44:12.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.260+0000 7fa503400640 1 --2- 172.21.15.8:0/2422084516 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa4e4067690 0x7fa4e4069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:12.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.260+0000 7fa4faa00640 1 -- 172.21.15.8:0/2422084516 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4011580 con 0x7fa5041e9ea0 2024-03-23T23:44:12.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.260+0000 7fa4faa00640 1 -- 172.21.15.8:0/2422084516 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fa4f4018070 con 0x7fa5041e9ea0 2024-03-23T23:44:12.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.260+0000 7fa4faa00640 1 -- 172.21.15.8:0/2422084516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa5041e9ea0 msgr2=0x7fa5041ea310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:12.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.260+0000 7fa4faa00640 1 --2- 172.21.15.8:0/2422084516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa5041e9ea0 0x7fa5041ea310 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa4f40014a0 tx=0x7fa4f40018a0 comp rx=0 tx=0).stop 2024-03-23T23:44:12.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.260+0000 7fa4faa00640 1 -- 172.21.15.8:0/2422084516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa5041e9ea0 msgr2=0x7fa5041ea310 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:44:12.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.260+0000 7fa4faa00640 1 --2- 172.21.15.8:0/2422084516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa5041e9ea0 0x7fa5041ea310 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa4f40014a0 tx=0x7fa4f40018a0 comp rx=0 tx=0).stop 2024-03-23T23:44:12.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.260+0000 7fa503400640 1 --2- 172.21.15.8:0/2422084516 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa4e4067690 0x7fa4e4069b50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc0b3000 tx=0x7fa4fc0ab070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:12.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.272+0000 7fa509a00640 1 --2- 172.21.15.8:0/2422084516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa504150a50 0x7fa5041ea850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:12.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.272+0000 7fa509a00640 1 -- 172.21.15.8:0/2422084516 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5040c1e00 con 0x7fa504150a50 2024-03-23T23:44:12.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.272+0000 7fa502a00640 1 --2- 172.21.15.8:0/2422084516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa504150a50 0x7fa5041ea850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:12.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.272+0000 7fa502a00640 1 -- 172.21.15.8:0/2422084516 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa50414a170 con 0x7fa504150a50 2024-03-23T23:44:12.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.272+0000 7fa502a00640 1 --2- 172.21.15.8:0/2422084516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa504150a50 0x7fa5041ea850 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa4f40014a0 tx=0x7fa4f4000ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:12.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.272+0000 7fa4faa00640 1 -- 172.21.15.8:0/2422084516 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4011df0 con 0x7fa504150a50 2024-03-23T23:44:12.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.272+0000 7fa4faa00640 1 -- 172.21.15.8:0/2422084516 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5013 (secure 0 0 0) 0x7fa4f4011df0 con 0x7fa504150a50 2024-03-23T23:44:12.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.272+0000 7fa4faa00640 1 -- 172.21.15.8:0/2422084516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa504150a50 msgr2=0x7fa5041ea850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:12.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.272+0000 7fa4faa00640 1 --2- 172.21.15.8:0/2422084516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa504150a50 0x7fa5041ea850 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa4f40014a0 tx=0x7fa4f4000ee0 comp rx=0 tx=0).stop 2024-03-23T23:44:12.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.272+0000 7fa4faa00640 1 -- 172.21.15.8:0/2422084516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa504150a50 msgr2=0x7fa5041ea850 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:44:12.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.272+0000 7fa4faa00640 1 --2- 172.21.15.8:0/2422084516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa504150a50 0x7fa5041ea850 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa4f40014a0 tx=0x7fa4f4000ee0 comp rx=0 tx=0).stop 2024-03-23T23:44:12.277 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:44:12.277 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:44:12.277 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:44:12.277 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:44:12.277 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 10, 2024-03-23T23:44:12.277 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:44:12.278 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:44:12.278 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:44:12.278 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:44:12.278 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:12.278 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 12, 2024-03-23T23:44:12.278 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:44:12.278 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:44:12.278 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:44:12.278 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:44:12.278 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:44:12.278 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:44:12.278 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:44:12.278 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:44:12.279 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:44:12.279 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:44:12.279 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:44:12.279 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:44:12.279 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:44:12.279 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:44:12.279 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:12.279 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:44:12.279 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:44:12.279 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:44:12.279 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:44:12.279 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:44:12.279 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:44:12.279 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:44:12.280 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:44:12.280 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:44:12.280 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:44:12.280 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:44:12.280 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:44:12.280 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:44:12.280 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:12.280 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:12.280 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:44:12.280 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:44:12.280 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:44:12.280 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:44:12.280 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:44:12.280 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:44:12.281 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:44:12.281 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:44:12.281 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:44:12.281 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:44:12.281 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:44:12.281 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:44:12.281 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:44:12.281 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:44:12.281 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:44:12.281 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:44:12.281 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:44:12.281 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:44:12.281 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:44:12.281 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:44:12.282 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:44:12.282 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:44:12.282 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:44:12.282 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:44:12.282 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:44:12.282 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:44:12.282 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:44:12.282 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:44:12.282 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:12.282 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:44:12.282 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:12.282 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:44:12.283 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:12.283 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:44:12.283 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:44:12.283 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:44:12.283 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:44:12.283 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:12.283 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:44:12.283 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:44:12.283 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:12.283 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:12.283 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:12.283 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:44:12.283 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:44:12.283 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:12.284 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:12.284 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:12.284 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:12.284 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:44:12.284 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:44:12.284 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:44:12.284 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:44:12.284 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:44:12.284 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:12.284 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:12.284 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:44:12.284 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:44:12.284 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:44:12.284 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:44:12.285 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:12.285 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:44:12.285 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:44:12.285 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:12.285 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:12.285 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:12.285 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:44:12.285 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:44:12.285 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:12.285 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:12.285 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:12.285 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:12.285 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:44:12.286 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:44:12.286 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:44:12.286 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:44:12.286 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:44:12.286 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:12.286 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:12.286 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:44:12.286 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:44:12.286 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:44:12.286 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:44:12.286 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:12.286 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:44:12.286 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:44:12.287 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:12.287 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:12.287 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:12.287 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:44:12.287 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:44:12.287 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:12.287 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:12.287 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:12.287 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:12.287 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:44:12.287 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:44:12.287 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:44:12.287 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:44:12.287 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:44:12.288 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:12.288 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:12.288 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:12.288 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:44:12.288 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:44:12.288 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:12.288 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:44:12.288 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:12.288 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:44:12.288 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:12.289 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:12.289 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:44:12.289 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:12.289 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:44:12.289 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:12.289 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:44:12.289 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:12.289 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:12.289 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:44:12.289 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:12.289 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:44:12.289 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:12.289 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5 2024-03-23T23:44:12.290 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:12.290 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:12.290 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:44:12.290 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:12.290 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:44:12.290 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:12.290 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:44:12.290 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:12.290 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:12.290 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:44:12.290 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:12.290 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:44:12.290 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:12.290 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:12.291 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:12.291 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:44:12.291 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:44:12.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.276+0000 7fa509a00640 1 -- 172.21.15.8:0/2422084516 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa4e4067690 msgr2=0x7fa4e4069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:12.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.276+0000 7fa509a00640 1 --2- 172.21.15.8:0/2422084516 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa4e4067690 0x7fa4e4069b50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc0b3000 tx=0x7fa4fc0ab070 comp rx=0 tx=0).stop 2024-03-23T23:44:12.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.276+0000 7fa509a00640 1 -- 172.21.15.8:0/2422084516 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa504149bd0 msgr2=0x7fa5041ec750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:12.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.276+0000 7fa509a00640 1 --2- 172.21.15.8:0/2422084516 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa504149bd0 0x7fa5041ec750 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa4f000e870 tx=0x7fa4f000ed30 comp rx=0 tx=0).stop 2024-03-23T23:44:12.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.276+0000 7fa503400640 1 -- 172.21.15.8:0/2422084516 reap_dead start 2024-03-23T23:44:12.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.276+0000 7fa503400640 1 -- 172.21.15.8:0/2422084516 reap_dead start 2024-03-23T23:44:12.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.276+0000 7fa509a00640 1 -- 172.21.15.8:0/2422084516 shutdown_connections 2024-03-23T23:44:12.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.276+0000 7fa509a00640 1 -- 172.21.15.8:0/2422084516 >> 172.21.15.8:0/2422084516 conn(0x7fa50406b170 msgr2=0x7fa50406b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:44:12.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.276+0000 7fa509a00640 1 -- 172.21.15.8:0/2422084516 shutdown_connections 2024-03-23T23:44:12.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:12.276+0000 7fa509a00640 1 -- 172.21.15.8:0/2422084516 wait complete. 2024-03-23T23:44:12.303 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:44:12.303 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-03-23T23:44:12.303 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['c'] 2024-03-23T23:44:12.303 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-03-23T23:44:12.303 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-03-23T23:44:12.304 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-23T23:44:12.304 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:44:12.333 INFO:tasks.ceph.mon.b:Stopped 2024-03-23T23:44:12.333 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-03-23T23:44:12.333 INFO:tasks.ceph.mon.c:Sent signal 19 2024-03-23T23:44:12.334 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-03-23T23:44:27.334 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-03-23T23:44:27.335 INFO:tasks.ceph.mon.c:Sent signal 18 2024-03-23T23:44:27.335 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-03-23T23:44:27.335 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:44:27.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:27.564+0000 7f4d86200640 1 Processor -- start 2024-03-23T23:44:27.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:27.564+0000 7f4d86200640 1 -- start start 2024-03-23T23:44:27.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:27.564+0000 7f4d86200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4d800c4840 0x7f4d800c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:27.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:27.564+0000 7f4d86200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4d80071750 0x7f4d800c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:27.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:27.564+0000 7f4d86200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d800c8c00 con 0x7f4d80159a20 2024-03-23T23:44:27.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:27.564+0000 7f4d86200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d800c8ee0 con 0x7f4d800c4840 2024-03-23T23:44:27.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:27.564+0000 7f4d86200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d800c3bf0 con 0x7f4d80071750 2024-03-23T23:44:27.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:27.564+0000 7f4d7fe00640 1 -- >> v2:172.21.15.196:3300/0 conn(0x7f4d80071750 msgr2=0x7f4d800c5fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:44:27.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:27.564+0000 7f4d7fe00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4d80071750 0x7f4d800c5fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:44:27.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:27.564+0000 7f4d7f400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f4d80159a20 0x7f4d800c7900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:55536/0 (socket says 172.21.15.8:55536) 2024-03-23T23:44:27.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:27.564+0000 7f4d7ea00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4d800c4840 0x7f4d800c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:27.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:27.564+0000 7f4d7f400640 1 -- 172.21.15.8:0/3354805013 learned_addr learned my addr 172.21.15.8:0/3354805013 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:44:27.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:27.564+0000 7f4d7ea00640 1 -- 172.21.15.8:0/3354805013 >> v2:172.21.15.8:3300/0 conn(0x7f4d800c4840 msgr2=0x7f4d800c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:44:27.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:27.564+0000 7f4d7ea00640 1 -- 172.21.15.8:0/3354805013 >> v2:172.21.15.8:3300/0 conn(0x7f4d800c4840 msgr2=0x7f4d800c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:44:27.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:27.564+0000 7f4d7ea00640 1 --2- 172.21.15.8:0/3354805013 >> v2:172.21.15.8:3300/0 conn(0x7f4d800c4840 0x7f4d800c5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:44:27.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:27.564+0000 7f4d7ea00640 1 --2- 172.21.15.8:0/3354805013 >> v2:172.21.15.8:3300/0 conn(0x7f4d800c4840 0x7f4d800c5a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:44:27.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:27.768+0000 7f4d7fe00640 1 -- 172.21.15.8:0/3354805013 >> v2:172.21.15.196:3300/0 conn(0x7f4d80071750 msgr2=0x7f4d800c5fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:44:27.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:27.768+0000 7f4d7fe00640 1 --2- 172.21.15.8:0/3354805013 >> v2:172.21.15.196:3300/0 conn(0x7f4d80071750 0x7f4d800c5fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:44:27.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:27.768+0000 7f4d7ea00640 1 --2- 172.21.15.8:0/3354805013 >> v2:172.21.15.8:3300/0 conn(0x7f4d800c4840 0x7f4d800c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:27.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:27.768+0000 7f4d7ea00640 1 -- 172.21.15.8:0/3354805013 >> v2:172.21.15.8:3300/0 conn(0x7f4d800c4840 msgr2=0x7f4d800c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T23:44:27.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:27.768+0000 7f4d7ea00640 1 -- 172.21.15.8:0/3354805013 >> v2:172.21.15.8:3300/0 conn(0x7f4d800c4840 msgr2=0x7f4d800c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:44:27.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:27.768+0000 7f4d7ea00640 1 --2- 172.21.15.8:0/3354805013 >> v2:172.21.15.8:3300/0 conn(0x7f4d800c4840 0x7f4d800c5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:44:27.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:27.768+0000 7f4d7ea00640 1 --2- 172.21.15.8:0/3354805013 >> v2:172.21.15.8:3300/0 conn(0x7f4d800c4840 0x7f4d800c5a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:44:28.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:28.172+0000 7f4d7fe00640 1 -- 172.21.15.8:0/3354805013 >> v2:172.21.15.196:3300/0 conn(0x7f4d80071750 msgr2=0x7f4d800c5fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:44:28.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:28.172+0000 7f4d7fe00640 1 --2- 172.21.15.8:0/3354805013 >> v2:172.21.15.196:3300/0 conn(0x7f4d80071750 0x7f4d800c5fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:44:28.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:28.172+0000 7f4d7ea00640 1 --2- 172.21.15.8:0/3354805013 >> v2:172.21.15.8:3300/0 conn(0x7f4d800c4840 0x7f4d800c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:28.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:28.172+0000 7f4d7ea00640 1 -- 172.21.15.8:0/3354805013 >> v2:172.21.15.8:3300/0 conn(0x7f4d800c4840 msgr2=0x7f4d800c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:44:28.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:28.172+0000 7f4d7ea00640 1 -- 172.21.15.8:0/3354805013 >> v2:172.21.15.8:3300/0 conn(0x7f4d800c4840 msgr2=0x7f4d800c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:44:28.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:28.172+0000 7f4d7ea00640 1 --2- 172.21.15.8:0/3354805013 >> v2:172.21.15.8:3300/0 conn(0x7f4d800c4840 0x7f4d800c5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:44:28.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:28.172+0000 7f4d7ea00640 1 --2- 172.21.15.8:0/3354805013 >> v2:172.21.15.8:3300/0 conn(0x7f4d800c4840 0x7f4d800c5a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:44:28.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:28.976+0000 7f4d7fe00640 1 -- 172.21.15.8:0/3354805013 >> v2:172.21.15.196:3300/0 conn(0x7f4d80071750 msgr2=0x7f4d800c5fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:44:28.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:28.976+0000 7f4d7fe00640 1 --2- 172.21.15.8:0/3354805013 >> v2:172.21.15.196:3300/0 conn(0x7f4d80071750 0x7f4d800c5fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:44:28.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:28.976+0000 7f4d7ea00640 1 --2- 172.21.15.8:0/3354805013 >> v2:172.21.15.8:3300/0 conn(0x7f4d800c4840 0x7f4d800c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:28.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:28.976+0000 7f4d7ea00640 1 -- 172.21.15.8:0/3354805013 >> v2:172.21.15.8:3300/0 conn(0x7f4d800c4840 msgr2=0x7f4d800c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T23:44:28.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:28.976+0000 7f4d7ea00640 1 -- 172.21.15.8:0/3354805013 >> v2:172.21.15.8:3300/0 conn(0x7f4d800c4840 msgr2=0x7f4d800c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:44:28.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:28.976+0000 7f4d7ea00640 1 --2- 172.21.15.8:0/3354805013 >> v2:172.21.15.8:3300/0 conn(0x7f4d800c4840 0x7f4d800c5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:44:28.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:28.976+0000 7f4d7ea00640 1 --2- 172.21.15.8:0/3354805013 >> v2:172.21.15.8:3300/0 conn(0x7f4d800c4840 0x7f4d800c5a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:44:30.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:30.564+0000 7f4d7cc00640 1 -- 172.21.15.8:0/3354805013 >> v2:172.21.15.196:3300/0 conn(0x7f4d80071750 msgr2=0x7f4d800c5fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:44:30.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:30.564+0000 7f4d7cc00640 1 --2- 172.21.15.8:0/3354805013 >> v2:172.21.15.196:3300/0 conn(0x7f4d80071750 0x7f4d800c5fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:30.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:30.564+0000 7f4d7cc00640 1 -- 172.21.15.8:0/3354805013 >> v2:172.21.15.8:3300/0 conn(0x7f4d800c4840 msgr2=0x7f4d800c5a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:44:30.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:30.564+0000 7f4d7cc00640 1 --2- 172.21.15.8:0/3354805013 >> v2:172.21.15.8:3300/0 conn(0x7f4d800c4840 0x7f4d800c5a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:30.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:30.564+0000 7f4d7cc00640 1 -- 172.21.15.8:0/3354805013 >> v1:172.21.15.8:6789/0 conn(0x7f4d80159a20 legacy=0x7f4d800c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:30.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:30.564+0000 7f4d7cc00640 1 --2- 172.21.15.8:0/3354805013 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d600036c0 0x7f4d60005b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:30.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:30.564+0000 7f4d7cc00640 1 -- 172.21.15.8:0/3354805013 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d800c3ed0 con 0x7f4d60006240 2024-03-23T23:44:30.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:30.564+0000 7f4d7cc00640 1 -- 172.21.15.8:0/3354805013 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d800c8ee0 con 0x7f4d600036c0 2024-03-23T23:44:30.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:30.564+0000 7f4d7ea00640 1 -- 172.21.15.8:0/3354805013 >> v1:172.21.15.196:6789/0 conn(0x7f4d60006240 legacy=0x7f4d60008700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-03-23T23:44:30.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:30.564+0000 7f4d7f400640 1 --2- 172.21.15.8:0/3354805013 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d600036c0 0x7f4d60005b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:30.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:30.564+0000 7f4d7f400640 1 -- 172.21.15.8:0/3354805013 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d600036c0 msgr2=0x7f4d60005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:44:30.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:30.564+0000 7f4d7f400640 1 -- 172.21.15.8:0/3354805013 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d600036c0 msgr2=0x7f4d60005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:44:30.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:30.564+0000 7f4d7f400640 1 --2- 172.21.15.8:0/3354805013 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d600036c0 0x7f4d60005b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:44:30.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:30.564+0000 7f4d7f400640 1 --2- 172.21.15.8:0/3354805013 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d600036c0 0x7f4d60005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:44:30.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:30.768+0000 7f4d7ea00640 1 -- 172.21.15.8:0/3354805013 >> v1:172.21.15.196:6789/0 conn(0x7f4d60006240 legacy=0x7f4d60008700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-03-23T23:44:30.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:30.768+0000 7f4d7f400640 1 --2- 172.21.15.8:0/3354805013 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d600036c0 0x7f4d60005b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:30.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:30.768+0000 7f4d7f400640 1 -- 172.21.15.8:0/3354805013 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d600036c0 msgr2=0x7f4d60005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:44:30.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:30.768+0000 7f4d7f400640 1 -- 172.21.15.8:0/3354805013 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d600036c0 msgr2=0x7f4d60005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:44:30.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:30.768+0000 7f4d7f400640 1 --2- 172.21.15.8:0/3354805013 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d600036c0 0x7f4d60005b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:44:30.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:30.768+0000 7f4d7f400640 1 --2- 172.21.15.8:0/3354805013 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d600036c0 0x7f4d60005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:44:31.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:31.172+0000 7f4d7ea00640 1 -- 172.21.15.8:0/3354805013 >> v1:172.21.15.196:6789/0 conn(0x7f4d60006240 legacy=0x7f4d60008700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-03-23T23:44:31.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:31.172+0000 7f4d7f400640 1 --2- 172.21.15.8:0/3354805013 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d600036c0 0x7f4d60005b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:31.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:31.172+0000 7f4d7f400640 1 -- 172.21.15.8:0/3354805013 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d600036c0 msgr2=0x7f4d60005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:44:31.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:31.172+0000 7f4d7f400640 1 -- 172.21.15.8:0/3354805013 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d600036c0 msgr2=0x7f4d60005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:44:31.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:31.172+0000 7f4d7f400640 1 --2- 172.21.15.8:0/3354805013 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d600036c0 0x7f4d60005b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:44:31.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:31.172+0000 7f4d7f400640 1 --2- 172.21.15.8:0/3354805013 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d600036c0 0x7f4d60005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:44:31.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:31.976+0000 7f4d7ea00640 1 -- 172.21.15.8:0/3354805013 >> v1:172.21.15.196:6789/0 conn(0x7f4d60006240 legacy=0x7f4d60008700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-03-23T23:44:31.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:31.976+0000 7f4d7f400640 1 --2- 172.21.15.8:0/3354805013 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d600036c0 0x7f4d60005b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:31.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:31.976+0000 7f4d7f400640 1 -- 172.21.15.8:0/3354805013 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d600036c0 msgr2=0x7f4d60005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:44:31.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:31.976+0000 7f4d7f400640 1 -- 172.21.15.8:0/3354805013 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d600036c0 msgr2=0x7f4d60005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:44:31.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:31.976+0000 7f4d7f400640 1 --2- 172.21.15.8:0/3354805013 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d600036c0 0x7f4d60005b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:44:31.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:31.976+0000 7f4d7f400640 1 --2- 172.21.15.8:0/3354805013 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d600036c0 0x7f4d60005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:44:33.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.564+0000 7f4d7cc00640 1 -- 172.21.15.8:0/3354805013 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d600036c0 msgr2=0x7f4d60005b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:44:33.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.564+0000 7f4d7cc00640 1 --2- 172.21.15.8:0/3354805013 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d600036c0 0x7f4d60005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:33.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.564+0000 7f4d7cc00640 1 -- 172.21.15.8:0/3354805013 >> v1:172.21.15.196:6789/0 conn(0x7f4d60006240 legacy=0x7f4d60008700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:44:33.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.564+0000 7f4d7cc00640 1 --2- 172.21.15.8:0/3354805013 >> v2:172.21.15.8:3300/0 conn(0x7f4d800c4840 0x7f4d60009fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:33.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.564+0000 7f4d7fe00640 1 -- 172.21.15.8:0/3354805013 reap_dead start 2024-03-23T23:44:33.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.564+0000 7f4d7cc00640 1 --2- 172.21.15.8:0/3354805013 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d600104e0 0x7f4d600128d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:33.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.564+0000 7f4d7cc00640 1 -- 172.21.15.8:0/3354805013 --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d6000b0a0 con 0x7f4d80159a20 2024-03-23T23:44:33.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.564+0000 7f4d7cc00640 1 -- 172.21.15.8:0/3354805013 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d800c8ee0 con 0x7f4d800c4840 2024-03-23T23:44:33.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.564+0000 7f4d7cc00640 1 -- 172.21.15.8:0/3354805013 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d800c3bf0 con 0x7f4d600104e0 2024-03-23T23:44:33.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.564+0000 7f4d7f400640 1 --2- 172.21.15.8:0/3354805013 >> v2:172.21.15.8:3300/0 conn(0x7f4d800c4840 0x7f4d60009fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:33.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.568+0000 7f4d7fe00640 1 --2- 172.21.15.8:0/3354805013 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d600104e0 0x7f4d600128d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:33.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.568+0000 7f4d7f400640 1 -- 172.21.15.8:0/3354805013 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d600104e0 msgr2=0x7f4d600128d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:44:33.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.568+0000 7f4d7f400640 1 --2- 172.21.15.8:0/3354805013 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d600104e0 0x7f4d600128d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:33.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.568+0000 7f4d7f400640 1 -- 172.21.15.8:0/3354805013 >> v1:172.21.15.8:6789/0 conn(0x7f4d80159a20 legacy=0x7f4d6000a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:33.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.568+0000 7f4d7f400640 1 -- 172.21.15.8:0/3354805013 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d800c3ed0 con 0x7f4d800c4840 2024-03-23T23:44:33.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.568+0000 7f4d7e000640 1 -- 172.21.15.8:0/3354805013 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894788640 0 0) 0x7f4d6000b0a0 con 0x7f4d80159a20 2024-03-23T23:44:33.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.572+0000 7f4d7f400640 1 --2- 172.21.15.8:0/3354805013 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d800c4840 0x7f4d60009fa0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4d70007fd0 tx=0x7f4d7001cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a88d1856ec40483b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:33.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.572+0000 7f4d7e000640 1 -- 172.21.15.8:0/3354805013 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d700ab070 con 0x7f4d800c4840 2024-03-23T23:44:33.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.572+0000 7f4d7e000640 1 -- 172.21.15.8:0/3354805013 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d700a5ba0 con 0x7f4d800c4840 2024-03-23T23:44:33.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.572+0000 7f4d86200640 1 -- 172.21.15.8:0/3354805013 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d800c4840 msgr2=0x7f4d60009fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:33.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.572+0000 7f4d86200640 1 --2- 172.21.15.8:0/3354805013 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d800c4840 0x7f4d60009fa0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4d70007fd0 tx=0x7f4d7001cf40 comp rx=0 tx=0).stop 2024-03-23T23:44:33.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.572+0000 7f4d7e000640 1 -- 172.21.15.8:0/3354805013 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d700af400 con 0x7f4d800c4840 2024-03-23T23:44:33.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.572+0000 7f4d86200640 1 -- 172.21.15.8:0/3354805013 shutdown_connections 2024-03-23T23:44:33.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.572+0000 7f4d86200640 1 --2- 172.21.15.8:0/3354805013 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d600104e0 0x7f4d600128d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:33.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.572+0000 7f4d86200640 1 --2- 172.21.15.8:0/3354805013 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d800c4840 0x7f4d60009fa0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:33.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.572+0000 7f4d86200640 1 -- 172.21.15.8:0/3354805013 >> 172.21.15.8:0/3354805013 conn(0x7f4d800c9150 msgr2=0x7f4d800c9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:44:33.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.572+0000 7f4d86200640 1 -- 172.21.15.8:0/3354805013 shutdown_connections 2024-03-23T23:44:33.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.572+0000 7f4d86200640 1 -- 172.21.15.8:0/3354805013 wait complete. 2024-03-23T23:44:33.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.576+0000 7f4d86200640 1 Processor -- start 2024-03-23T23:44:33.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.576+0000 7f4d86200640 1 -- start start 2024-03-23T23:44:33.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.576+0000 7f4d86200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d600104e0 0x7f4d8006ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:33.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.576+0000 7f4d86200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d800c4840 0x7f4d800a80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:33.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.576+0000 7f4d86200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d80159a20 0x7f4d801535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:33.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.576+0000 7f4d86200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d800c5e20 con 0x7f4d800c4840 2024-03-23T23:44:33.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.576+0000 7f4d86200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d800c5ca0 con 0x7f4d600104e0 2024-03-23T23:44:33.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.576+0000 7f4d86200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d800c5fa0 con 0x7f4d80159a20 2024-03-23T23:44:33.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.576+0000 7f4d7f400640 1 -- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d600104e0 msgr2=0x7f4d8006ff00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:44:33.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.576+0000 7f4d7f400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d600104e0 0x7f4d8006ff00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:44:33.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.580+0000 7f4d7fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d80159a20 0x7f4d801535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:33.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.580+0000 7f4d7fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d80159a20 0x7f4d801535d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:53426/0 (socket says 172.21.15.8:53426) 2024-03-23T23:44:33.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.580+0000 7f4d7fe00640 1 -- 172.21.15.8:0/1512977520 learned_addr learned my addr 172.21.15.8:0/1512977520 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:44:33.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.580+0000 7f4d7ea00640 1 --2- 172.21.15.8:0/1512977520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d800c4840 0x7f4d800a80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:33.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.580+0000 7f4d7fe00640 1 -- 172.21.15.8:0/1512977520 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d600104e0 msgr2=0x7f4d8006ff00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:44:33.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.580+0000 7f4d7fe00640 1 --2- 172.21.15.8:0/1512977520 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d600104e0 0x7f4d8006ff00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:33.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.580+0000 7f4d7fe00640 1 -- 172.21.15.8:0/1512977520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d800c4840 msgr2=0x7f4d800a80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:33.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.580+0000 7f4d7fe00640 1 --2- 172.21.15.8:0/1512977520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d800c4840 0x7f4d800a80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:33.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.580+0000 7f4d7fe00640 1 -- 172.21.15.8:0/1512977520 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d801f2b80 con 0x7f4d80159a20 2024-03-23T23:44:33.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.580+0000 7f4d7fe00640 1 --2- 172.21.15.8:0/1512977520 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d80159a20 0x7f4d801535d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4d60009f40 tx=0x7f4d7800d720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:33.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.580+0000 7f4d77400640 1 -- 172.21.15.8:0/1512977520 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7800fdf0 con 0x7f4d80159a20 2024-03-23T23:44:33.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.580+0000 7f4d77400640 1 -- 172.21.15.8:0/1512977520 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d78014070 con 0x7f4d80159a20 2024-03-23T23:44:33.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.580+0000 7f4d77400640 1 -- 172.21.15.8:0/1512977520 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d780196b0 con 0x7f4d80159a20 2024-03-23T23:44:33.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.580+0000 7f4d86200640 1 -- 172.21.15.8:0/1512977520 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d801f2e20 con 0x7f4d80159a20 2024-03-23T23:44:33.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.580+0000 7f4d86200640 1 -- 172.21.15.8:0/1512977520 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d801f33e0 con 0x7f4d80159a20 2024-03-23T23:44:33.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.580+0000 7f4d86200640 1 -- 172.21.15.8:0/1512977520 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d8004f480 con 0x7f4d80159a20 2024-03-23T23:44:33.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.584+0000 7f4d77400640 1 -- 172.21.15.8:0/1512977520 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f4d78019850 con 0x7f4d80159a20 2024-03-23T23:44:33.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.584+0000 7f4d77400640 1 --2- 172.21.15.8:0/1512977520 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4d60068550 0x7f4d6006aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:33.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.584+0000 7f4d77400640 1 -- 172.21.15.8:0/1512977520 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f4d78086b80 con 0x7f4d80159a20 2024-03-23T23:44:33.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.584+0000 7f4d7f400640 1 --2- 172.21.15.8:0/1512977520 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4d60068550 0x7f4d6006aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:33.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.584+0000 7f4d7f400640 1 --2- 172.21.15.8:0/1512977520 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4d60068550 0x7f4d6006aa10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4d700b0000 tx=0x7f4d70010040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:33.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:33.592+0000 7f4d77400640 1 -- 172.21.15.8:0/1512977520 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f4d78057430 con 0x7f4d80159a20 2024-03-23T23:44:34.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.040+0000 7f4d86200640 1 -- 172.21.15.8:0/1512977520 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f4d800c7190 con 0x7f4d80159a20 2024-03-23T23:44:34.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.044+0000 7f4d77400640 1 -- 172.21.15.8:0/1512977520 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1554 (secure 0 0 0) 0x7f4d78056d30 con 0x7f4d80159a20 2024-03-23T23:44:34.045 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":12,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:44:34.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.044+0000 7f4d86200640 1 -- 172.21.15.8:0/1512977520 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4d60068550 msgr2=0x7f4d6006aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:34.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.044+0000 7f4d86200640 1 --2- 172.21.15.8:0/1512977520 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4d60068550 0x7f4d6006aa10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4d700b0000 tx=0x7f4d70010040 comp rx=0 tx=0).stop 2024-03-23T23:44:34.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.044+0000 7f4d86200640 1 -- 172.21.15.8:0/1512977520 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d80159a20 msgr2=0x7f4d801535d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:34.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.044+0000 7f4d86200640 1 --2- 172.21.15.8:0/1512977520 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d80159a20 0x7f4d801535d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4d60009f40 tx=0x7f4d7800d720 comp rx=0 tx=0).stop 2024-03-23T23:44:34.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.044+0000 7f4d86200640 1 -- 172.21.15.8:0/1512977520 shutdown_connections 2024-03-23T23:44:34.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.044+0000 7f4d86200640 1 --2- 172.21.15.8:0/1512977520 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4d60068550 0x7f4d6006aa10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:34.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.044+0000 7f4d86200640 1 --2- 172.21.15.8:0/1512977520 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d80159a20 0x7f4d801535d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:34.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.044+0000 7f4d86200640 1 --2- 172.21.15.8:0/1512977520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d800c4840 0x7f4d800a80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:34.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.044+0000 7f4d86200640 1 --2- 172.21.15.8:0/1512977520 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d600104e0 0x7f4d8006ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:34.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.044+0000 7f4d86200640 1 -- 172.21.15.8:0/1512977520 >> 172.21.15.8:0/1512977520 conn(0x7f4d800c9150 msgr2=0x7f4d800a8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:44:34.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.044+0000 7f4d86200640 1 -- 172.21.15.8:0/1512977520 shutdown_connections 2024-03-23T23:44:34.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.044+0000 7f4d86200640 1 -- 172.21.15.8:0/1512977520 wait complete. 2024-03-23T23:44:34.077 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-03-23T23:44:34.077 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-03-23T23:44:34.077 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:44:34.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.312+0000 7fcf6f600640 1 Processor -- start 2024-03-23T23:44:34.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.312+0000 7fcf6f600640 1 -- start start 2024-03-23T23:44:34.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.312+0000 7fcf6f600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fcf680c3600 0x7fcf680c2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:34.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.312+0000 7fcf6f600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf68071a30 0x7fcf68156c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:34.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.312+0000 7fcf6f600640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf6815acc0 con 0x7fcf680c3f60 2024-03-23T23:44:34.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.312+0000 7fcf6f600640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf6815a830 con 0x7fcf680c3600 2024-03-23T23:44:34.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.312+0000 7fcf6f600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf68071ec0 con 0x7fcf68071a30 2024-03-23T23:44:34.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.312+0000 7fcf67e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fcf680c3600 0x7fcf680c2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:34.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.312+0000 7fcf67e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fcf680c3600 0x7fcf680c2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51698/0 (socket says 172.21.15.8:51698) 2024-03-23T23:44:34.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.312+0000 7fcf67e00640 1 -- 172.21.15.8:0/3511679814 learned_addr learned my addr 172.21.15.8:0/3511679814 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:44:34.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.312+0000 7fcf6cc00640 1 --1- 172.21.15.8:0/3511679814 >> v1:172.21.15.8:6789/0 conn(0x7fcf680c3f60 0x7fcf680c1c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:49988/0 (socket says 172.21.15.8:49988) 2024-03-23T23:44:34.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.312+0000 7fcf6d600640 1 --2- 172.21.15.8:0/3511679814 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf68071a30 0x7fcf68156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:34.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.316+0000 7fcf6d600640 1 -- 172.21.15.8:0/3511679814 >> v2:172.21.15.8:3300/0 conn(0x7fcf680c3600 msgr2=0x7fcf680c2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:44:34.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.316+0000 7fcf6d600640 1 --2- 172.21.15.8:0/3511679814 >> v2:172.21.15.8:3300/0 conn(0x7fcf680c3600 0x7fcf680c2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:34.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.316+0000 7fcf6d600640 1 -- 172.21.15.8:0/3511679814 >> v1:172.21.15.8:6789/0 conn(0x7fcf680c3f60 legacy=0x7fcf680c1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:34.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.316+0000 7fcf6d600640 1 -- 172.21.15.8:0/3511679814 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf68159f00 con 0x7fcf68071a30 2024-03-23T23:44:34.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.320+0000 7fcf6d600640 1 --2- 172.21.15.8:0/3511679814 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf68071a30 0x7fcf68156c30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcf6815a9b0 tx=0x7fcf6001c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b441585a8b1c9fbf server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:34.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.320+0000 7fcf67400640 1 -- 172.21.15.8:0/3511679814 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf600b2070 con 0x7fcf68071a30 2024-03-23T23:44:34.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.320+0000 7fcf67400640 1 -- 172.21.15.8:0/3511679814 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf600a5780 con 0x7fcf68071a30 2024-03-23T23:44:34.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.320+0000 7fcf67400640 1 -- 172.21.15.8:0/3511679814 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf600b2070 con 0x7fcf68071a30 2024-03-23T23:44:34.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.320+0000 7fcf6f600640 1 -- 172.21.15.8:0/3511679814 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf68071a30 msgr2=0x7fcf68156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:34.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.320+0000 7fcf6f600640 1 --2- 172.21.15.8:0/3511679814 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf68071a30 0x7fcf68156c30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcf6815a9b0 tx=0x7fcf6001c8c0 comp rx=0 tx=0).stop 2024-03-23T23:44:34.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.320+0000 7fcf6f600640 1 -- 172.21.15.8:0/3511679814 shutdown_connections 2024-03-23T23:44:34.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.320+0000 7fcf6f600640 1 --2- 172.21.15.8:0/3511679814 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf68071a30 0x7fcf68156c30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:34.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.320+0000 7fcf6f600640 1 --2- 172.21.15.8:0/3511679814 >> v2:172.21.15.8:3300/0 conn(0x7fcf680c3600 0x7fcf680c2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:34.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.320+0000 7fcf6f600640 1 -- 172.21.15.8:0/3511679814 >> 172.21.15.8:0/3511679814 conn(0x7fcf6806b170 msgr2=0x7fcf6806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:44:34.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.320+0000 7fcf6f600640 1 -- 172.21.15.8:0/3511679814 shutdown_connections 2024-03-23T23:44:34.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.320+0000 7fcf6f600640 1 -- 172.21.15.8:0/3511679814 wait complete. 2024-03-23T23:44:34.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.324+0000 7fcf6f600640 1 Processor -- start 2024-03-23T23:44:34.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.324+0000 7fcf6f600640 1 -- start start 2024-03-23T23:44:34.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.324+0000 7fcf6f600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf68071a30 0x7fcf680ac3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:34.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.324+0000 7fcf6f600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf680c3600 0x7fcf680ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:34.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.324+0000 7fcf6f600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf680c3f60 0x7fcf681f6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:34.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.324+0000 7fcf6f600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf68157700 con 0x7fcf680c3f60 2024-03-23T23:44:34.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.324+0000 7fcf6f600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf68157580 con 0x7fcf68071a30 2024-03-23T23:44:34.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.324+0000 7fcf6f600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf680c4340 con 0x7fcf680c3600 2024-03-23T23:44:34.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.324+0000 7fcf6cc00640 1 -- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf68071a30 msgr2=0x7fcf680ac3b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:44:34.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.324+0000 7fcf6cc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf68071a30 0x7fcf680ac3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:44:34.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.324+0000 7fcf6d600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf680c3f60 0x7fcf681f6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:34.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.324+0000 7fcf67e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf680c3600 0x7fcf680ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:34.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.324+0000 7fcf6d600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf680c3f60 0x7fcf681f6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51706/0 (socket says 172.21.15.8:51706) 2024-03-23T23:44:34.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.324+0000 7fcf6d600640 1 -- 172.21.15.8:0/78272324 learned_addr learned my addr 172.21.15.8:0/78272324 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:44:34.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.328+0000 7fcf6d600640 1 -- 172.21.15.8:0/78272324 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf680c3600 msgr2=0x7fcf680ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:34.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.328+0000 7fcf6d600640 1 --2- 172.21.15.8:0/78272324 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf680c3600 0x7fcf680ac8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:34.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.328+0000 7fcf6d600640 1 -- 172.21.15.8:0/78272324 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf68071a30 msgr2=0x7fcf680ac3b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:44:34.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.328+0000 7fcf6d600640 1 --2- 172.21.15.8:0/78272324 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf68071a30 0x7fcf680ac3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:34.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.328+0000 7fcf6d600640 1 -- 172.21.15.8:0/78272324 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6814b790 con 0x7fcf680c3f60 2024-03-23T23:44:34.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.328+0000 7fcf67e00640 1 --2- 172.21.15.8:0/78272324 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf680c3600 0x7fcf680ac8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:44:34.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.328+0000 7fcf6d600640 1 --2- 172.21.15.8:0/78272324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf680c3f60 0x7fcf681f6470 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcf600b0040 tx=0x7fcf60019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:34.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.328+0000 7fcf64c00640 1 -- 172.21.15.8:0/78272324 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf600b2070 con 0x7fcf680c3f60 2024-03-23T23:44:34.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.328+0000 7fcf64c00640 1 -- 172.21.15.8:0/78272324 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf600bc070 con 0x7fcf680c3f60 2024-03-23T23:44:34.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.328+0000 7fcf64c00640 1 -- 172.21.15.8:0/78272324 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf60004040 con 0x7fcf680c3f60 2024-03-23T23:44:34.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.328+0000 7fcf6f600640 1 -- 172.21.15.8:0/78272324 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf6814b1d0 con 0x7fcf680c3f60 2024-03-23T23:44:34.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.328+0000 7fcf6f600640 1 -- 172.21.15.8:0/78272324 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf680abe90 con 0x7fcf680c3f60 2024-03-23T23:44:34.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.328+0000 7fcf6f600640 1 --2- 172.21.15.8:0/78272324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf680c61f0 0x7fcf681f69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:34.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.328+0000 7fcf6f600640 1 -- 172.21.15.8:0/78272324 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf680ac0d0 con 0x7fcf680c61f0 2024-03-23T23:44:34.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.328+0000 7fcf6cc00640 1 --2- 172.21.15.8:0/78272324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf680c61f0 0x7fcf681f69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:34.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.328+0000 7fcf6cc00640 1 -- 172.21.15.8:0/78272324 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcf681f6ef0 con 0x7fcf680c61f0 2024-03-23T23:44:34.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.332+0000 7fcf6cc00640 1 --2- 172.21.15.8:0/78272324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf680c61f0 0x7fcf681f69b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c00c310 tx=0x7fcf5c00c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:34.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.332+0000 7fcf64c00640 1 -- 172.21.15.8:0/78272324 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fcf600a5600 con 0x7fcf680c3f60 2024-03-23T23:44:34.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.332+0000 7fcf64c00640 1 --2- 172.21.15.8:0/78272324 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcf48067610 0x7fcf48069ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:34.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.332+0000 7fcf64c00640 1 -- 172.21.15.8:0/78272324 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fcf60120660 con 0x7fcf680c3f60 2024-03-23T23:44:34.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.332+0000 7fcf64c00640 1 -- 172.21.15.8:0/78272324 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c0074e0 con 0x7fcf680c61f0 2024-03-23T23:44:34.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.332+0000 7fcf64c00640 1 -- 172.21.15.8:0/78272324 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fcf5c007680 con 0x7fcf680c61f0 2024-03-23T23:44:34.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.332+0000 7fcf64c00640 1 -- 172.21.15.8:0/78272324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf680c61f0 msgr2=0x7fcf681f69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:34.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.332+0000 7fcf64c00640 1 --2- 172.21.15.8:0/78272324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf680c61f0 0x7fcf681f69b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c00c310 tx=0x7fcf5c00c7d0 comp rx=0 tx=0).stop 2024-03-23T23:44:34.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.332+0000 7fcf64c00640 1 -- 172.21.15.8:0/78272324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf680c61f0 msgr2=0x7fcf681f69b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:44:34.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.332+0000 7fcf64c00640 1 --2- 172.21.15.8:0/78272324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf680c61f0 0x7fcf681f69b0 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c00c310 tx=0x7fcf5c00c7d0 comp rx=0 tx=0).stop 2024-03-23T23:44:34.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.332+0000 7fcf67e00640 1 --2- 172.21.15.8:0/78272324 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcf48067610 0x7fcf48069ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:34.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.332+0000 7fcf67e00640 1 --2- 172.21.15.8:0/78272324 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcf48067610 0x7fcf48069ad0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcf6806bae0 tx=0x7fcf54009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:34.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.344+0000 7fcf6f600640 1 --2- 172.21.15.8:0/78272324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf681f2ca0 0x7fcf681f30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:34.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.344+0000 7fcf6f600640 1 -- 172.21.15.8:0/78272324 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf68068270 con 0x7fcf681f2ca0 2024-03-23T23:44:34.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.344+0000 7fcf6cc00640 1 --2- 172.21.15.8:0/78272324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf681f2ca0 0x7fcf681f30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:34.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.344+0000 7fcf6cc00640 1 -- 172.21.15.8:0/78272324 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fcf681541f0 con 0x7fcf681f2ca0 2024-03-23T23:44:34.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.348+0000 7fcf6cc00640 1 --2- 172.21.15.8:0/78272324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf681f2ca0 0x7fcf681f30b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c013000 tx=0x7fcf5c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:34.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.348+0000 7fcf64c00640 1 -- 172.21.15.8:0/78272324 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c01a9a0 con 0x7fcf681f2ca0 2024-03-23T23:44:34.350 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:44:34.350 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:44:34.350 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:44:34.350 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:44:34.350 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 12, 2024-03-23T23:44:34.350 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:44:34.350 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:44:34.350 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:44:34.350 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:34.351 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 2, 2024-03-23T23:44:34.351 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:44:34.351 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:44:34.351 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:44:34.351 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:44:34.351 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:44:34.351 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:44:34.351 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:44:34.351 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:44:34.352 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:44:34.352 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:44:34.352 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:44:34.352 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:44:34.352 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:44:34.352 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:44:34.352 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:34.352 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:44:34.352 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:44:34.352 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:44:34.352 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:44:34.352 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:44:34.352 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:44:34.352 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:44:34.353 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:44:34.353 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:44:34.353 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:44:34.353 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:44:34.353 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:44:34.353 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:44:34.353 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:34.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:34.353 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:44:34.353 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:44:34.353 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:44:34.354 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:44:34.354 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:44:34.354 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:44:34.354 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:44:34.354 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:44:34.354 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:44:34.354 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:44:34.354 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:44:34.354 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:44:34.354 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:44:34.354 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:44:34.354 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:44:34.355 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:44:34.355 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:44:34.355 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:44:34.355 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:44:34.355 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:44:34.355 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:44:34.355 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:44:34.355 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:44:34.355 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:44:34.355 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:44:34.355 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:44:34.355 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:44:34.355 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:44:34.355 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:34.356 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:44:34.356 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:34.356 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:44:34.356 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:34.356 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:44:34.356 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:44:34.356 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:44:34.356 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:44:34.356 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:34.356 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:44:34.356 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:44:34.356 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:34.357 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:34.357 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:34.357 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:44:34.357 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:44:34.357 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:34.357 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:34.357 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:34.357 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:34.357 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:44:34.357 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:44:34.357 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:44:34.357 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:44:34.358 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:44:34.358 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:34.358 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:34.358 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:44:34.358 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:44:34.358 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:44:34.358 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:44:34.358 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:34.358 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:44:34.358 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:44:34.358 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:34.358 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:34.358 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:34.359 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:44:34.359 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:44:34.359 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:34.359 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:34.359 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:34.359 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:34.359 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:44:34.359 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:44:34.359 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:44:34.359 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:44:34.359 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:44:34.359 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:34.359 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:34.359 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:44:34.360 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:44:34.360 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:44:34.360 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:44:34.360 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:34.360 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:44:34.360 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:44:34.360 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:34.360 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:34.360 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:34.360 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:44:34.360 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:44:34.360 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:34.360 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:34.361 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:34.361 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:34.361 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:44:34.361 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:44:34.361 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:44:34.361 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:44:34.361 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:44:34.361 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:34.361 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:34.361 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:34.361 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:44:34.361 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:44:34.361 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:34.362 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:44:34.362 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:34.362 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:44:34.362 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:34.362 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:34.362 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:44:34.362 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:34.362 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:44:34.362 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:34.362 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:44:34.362 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:34.362 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:34.362 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:44:34.363 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:34.363 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:44:34.363 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:34.363 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:44:34.363 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:34.363 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:34.363 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:44:34.363 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:34.363 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:44:34.363 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:34.363 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:44:34.363 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:34.363 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:34.363 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:44:34.364 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:34.364 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:44:34.364 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:34.364 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:34.364 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:44:34.364 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:34.364 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:44:34.364 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:34.364 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:44:34.364 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:34.364 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:34.364 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:34.364 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:44:34.365 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:44:34.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.348+0000 7fcf64c00640 1 -- 172.21.15.8:0/78272324 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5173 (secure 0 0 0) 0x7fcf5c0123f0 con 0x7fcf681f2ca0 2024-03-23T23:44:34.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.348+0000 7fcf64c00640 1 -- 172.21.15.8:0/78272324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf681f2ca0 msgr2=0x7fcf681f30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:34.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.348+0000 7fcf64c00640 1 --2- 172.21.15.8:0/78272324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf681f2ca0 0x7fcf681f30b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c013000 tx=0x7fcf5c000bd0 comp rx=0 tx=0).stop 2024-03-23T23:44:34.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.348+0000 7fcf64c00640 1 -- 172.21.15.8:0/78272324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf681f2ca0 msgr2=0x7fcf681f30b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:44:34.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.348+0000 7fcf64c00640 1 --2- 172.21.15.8:0/78272324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf681f2ca0 0x7fcf681f30b0 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c013000 tx=0x7fcf5c000bd0 comp rx=0 tx=0).stop 2024-03-23T23:44:34.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.348+0000 7fcf6f600640 1 -- 172.21.15.8:0/78272324 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcf48067610 msgr2=0x7fcf48069ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:34.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.348+0000 7fcf6f600640 1 --2- 172.21.15.8:0/78272324 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcf48067610 0x7fcf48069ad0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcf6806bae0 tx=0x7fcf54009240 comp rx=0 tx=0).stop 2024-03-23T23:44:34.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.348+0000 7fcf6f600640 1 -- 172.21.15.8:0/78272324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf680c3f60 msgr2=0x7fcf681f6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:34.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.348+0000 7fcf6f600640 1 --2- 172.21.15.8:0/78272324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf680c3f60 0x7fcf681f6470 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcf600b0040 tx=0x7fcf60019660 comp rx=0 tx=0).stop 2024-03-23T23:44:34.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.348+0000 7fcf6d600640 1 -- 172.21.15.8:0/78272324 reap_dead start 2024-03-23T23:44:34.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.348+0000 7fcf6d600640 1 -- 172.21.15.8:0/78272324 reap_dead start 2024-03-23T23:44:34.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.348+0000 7fcf6f600640 1 -- 172.21.15.8:0/78272324 shutdown_connections 2024-03-23T23:44:34.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.348+0000 7fcf6f600640 1 -- 172.21.15.8:0/78272324 >> 172.21.15.8:0/78272324 conn(0x7fcf6806b170 msgr2=0x7fcf68155510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:44:34.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.348+0000 7fcf6f600640 1 -- 172.21.15.8:0/78272324 shutdown_connections 2024-03-23T23:44:34.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.348+0000 7fcf6f600640 1 -- 172.21.15.8:0/78272324 wait complete. 2024-03-23T23:44:34.381 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T23:44:34.381 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-03-23T23:44:34.382 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:44:34.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.616+0000 7f061b200640 1 Processor -- start 2024-03-23T23:44:34.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.616+0000 7f061b200640 1 -- start start 2024-03-23T23:44:34.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.616+0000 7f061b200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f061c1574e0 0x7f061c0c5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:34.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.616+0000 7f061b200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f061c156a70 0x7f061c0ae630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:34.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.616+0000 7f061b200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f061c0c8690 con 0x7f061c0c5db0 2024-03-23T23:44:34.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.616+0000 7f061b200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f061c150fa0 con 0x7f061c156a70 2024-03-23T23:44:34.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.616+0000 7f061b200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061c06e850 con 0x7f061c1574e0 2024-03-23T23:44:34.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.620+0000 7f0613e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f061c156a70 0x7f061c0ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:34.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.620+0000 7f0619e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f061c1574e0 0x7f061c0c5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:34.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.620+0000 7f0613e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f061c156a70 0x7f061c0ae630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51730/0 (socket says 172.21.15.8:51730) 2024-03-23T23:44:34.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.620+0000 7f0613e00640 1 -- 172.21.15.8:0/1813545728 learned_addr learned my addr 172.21.15.8:0/1813545728 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:44:34.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.620+0000 7f0613e00640 1 -- 172.21.15.8:0/1813545728 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f061c1574e0 msgr2=0x7f061c0c5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:44:34.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.620+0000 7f0613e00640 1 --2- 172.21.15.8:0/1813545728 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f061c1574e0 0x7f061c0c5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:34.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.620+0000 7f0613e00640 1 -- 172.21.15.8:0/1813545728 >> v1:172.21.15.8:6789/0 conn(0x7f061c0c5db0 legacy=0x7f061c1534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:34.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.620+0000 7f0613e00640 1 -- 172.21.15.8:0/1813545728 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061c06eaa0 con 0x7f061c156a70 2024-03-23T23:44:34.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.624+0000 7f0613e00640 1 --2- 172.21.15.8:0/1813545728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f061c156a70 0x7f061c0ae630 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0604009870 tx=0x7f060401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45aed4e11b79fa1d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:34.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.624+0000 7f0619400640 1 -- 172.21.15.8:0/1813545728 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06040b0070 con 0x7f061c156a70 2024-03-23T23:44:34.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.624+0000 7f0619400640 1 -- 172.21.15.8:0/1813545728 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06040ab600 con 0x7f061c156a70 2024-03-23T23:44:34.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.624+0000 7f0619400640 1 -- 172.21.15.8:0/1813545728 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06040ab9d0 con 0x7f061c156a70 2024-03-23T23:44:34.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.624+0000 7f061b200640 1 -- 172.21.15.8:0/1813545728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f061c156a70 msgr2=0x7f061c0ae630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:34.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.624+0000 7f061b200640 1 --2- 172.21.15.8:0/1813545728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f061c156a70 0x7f061c0ae630 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0604009870 tx=0x7f060401c440 comp rx=0 tx=0).stop 2024-03-23T23:44:34.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.624+0000 7f061b200640 1 -- 172.21.15.8:0/1813545728 shutdown_connections 2024-03-23T23:44:34.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.624+0000 7f061b200640 1 --2- 172.21.15.8:0/1813545728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f061c156a70 0x7f061c0ae630 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:34.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.624+0000 7f061b200640 1 --2- 172.21.15.8:0/1813545728 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f061c1574e0 0x7f061c0c5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:34.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.624+0000 7f061b200640 1 -- 172.21.15.8:0/1813545728 >> 172.21.15.8:0/1813545728 conn(0x7f061c0c8de0 msgr2=0x7f061c0c91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:44:34.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.624+0000 7f061b200640 1 -- 172.21.15.8:0/1813545728 shutdown_connections 2024-03-23T23:44:34.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.624+0000 7f061b200640 1 -- 172.21.15.8:0/1813545728 wait complete. 2024-03-23T23:44:34.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.628+0000 7f061b200640 1 Processor -- start 2024-03-23T23:44:34.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.628+0000 7f061b200640 1 -- start start 2024-03-23T23:44:34.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.628+0000 7f061b200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f061c0c5db0 0x7f061c0a8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:34.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.628+0000 7f061b200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f061c156a70 0x7f061c14f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:34.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.628+0000 7f061b200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f061c1574e0 0x7f061c14fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:34.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.628+0000 7f061b200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061c0aecf0 con 0x7f061c1574e0 2024-03-23T23:44:34.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.628+0000 7f061b200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061c0aeb70 con 0x7f061c156a70 2024-03-23T23:44:34.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.628+0000 7f061b200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061c0aee70 con 0x7f061c0c5db0 2024-03-23T23:44:34.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.628+0000 7f0613e00640 1 -- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f061c156a70 msgr2=0x7f061c14f4d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:44:34.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.628+0000 7f0613e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f061c156a70 0x7f061c14f4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:44:34.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.628+0000 7f0619e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f061c0c5db0 0x7f061c0a8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:34.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.632+0000 7f061a800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f061c1574e0 0x7f061c14fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:34.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.632+0000 7f061a800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f061c1574e0 0x7f061c14fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51738/0 (socket says 172.21.15.8:51738) 2024-03-23T23:44:34.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.632+0000 7f0619e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f061c0c5db0 0x7f061c0a8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:53458/0 (socket says 172.21.15.8:53458) 2024-03-23T23:44:34.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.632+0000 7f061a800640 1 -- 172.21.15.8:0/1498579811 learned_addr learned my addr 172.21.15.8:0/1498579811 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:44:34.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.632+0000 7f061a800640 1 -- 172.21.15.8:0/1498579811 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f061c0c5db0 msgr2=0x7f061c0a8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:34.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.632+0000 7f061a800640 1 --2- 172.21.15.8:0/1498579811 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f061c0c5db0 0x7f061c0a8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:34.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.632+0000 7f061a800640 1 -- 172.21.15.8:0/1498579811 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f061c156a70 msgr2=0x7f061c14f4d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:44:34.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.632+0000 7f061a800640 1 --2- 172.21.15.8:0/1498579811 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f061c156a70 0x7f061c14f4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:44:34.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.632+0000 7f061a800640 1 -- 172.21.15.8:0/1498579811 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061c0aba10 con 0x7f061c1574e0 2024-03-23T23:44:34.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.632+0000 7f061a800640 1 --2- 172.21.15.8:0/1498579811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f061c1574e0 0x7f061c14fa10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f061400c760 tx=0x7f061400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:34.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.632+0000 7f0612000640 1 -- 172.21.15.8:0/1498579811 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0614003b80 con 0x7f061c1574e0 2024-03-23T23:44:34.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.632+0000 7f0612000640 1 -- 172.21.15.8:0/1498579811 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0614003d20 con 0x7f061c1574e0 2024-03-23T23:44:34.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.632+0000 7f0612000640 1 -- 172.21.15.8:0/1498579811 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061400aa30 con 0x7f061c1574e0 2024-03-23T23:44:34.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.632+0000 7f061b200640 1 -- 172.21.15.8:0/1498579811 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f061c1ee420 con 0x7f061c1574e0 2024-03-23T23:44:34.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.632+0000 7f061b200640 1 -- 172.21.15.8:0/1498579811 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f061c1ee9e0 con 0x7f061c1574e0 2024-03-23T23:44:34.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.632+0000 7f061b200640 1 --2- 172.21.15.8:0/1498579811 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f061c1eebe0 0x7f061c0aa850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:34.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.632+0000 7f061b200640 1 -- 172.21.15.8:0/1498579811 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061c1ef1c0 con 0x7f061c1eebe0 2024-03-23T23:44:34.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.636+0000 7f0619e00640 1 --2- 172.21.15.8:0/1498579811 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f061c1eebe0 0x7f061c0aa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:34.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.636+0000 7f0619e00640 1 -- 172.21.15.8:0/1498579811 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f061c0c3660 con 0x7f061c1eebe0 2024-03-23T23:44:34.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.636+0000 7f0619e00640 1 --2- 172.21.15.8:0/1498579811 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f061c1eebe0 0x7f061c0aa850 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f060c0119d0 tx=0x7f060c011e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:34.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.636+0000 7f0612000640 1 -- 172.21.15.8:0/1498579811 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060c019070 con 0x7f061c1eebe0 2024-03-23T23:44:34.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.636+0000 7f0612000640 1 -- 172.21.15.8:0/1498579811 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f061400abd0 con 0x7f061c1574e0 2024-03-23T23:44:34.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.636+0000 7f0612000640 1 --2- 172.21.15.8:0/1498579811 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f05f8067560 0x7f05f8069a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:34.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.636+0000 7f0612000640 1 -- 172.21.15.8:0/1498579811 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f0614085960 con 0x7f061c1574e0 2024-03-23T23:44:34.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.636+0000 7f0612000640 1 -- 172.21.15.8:0/1498579811 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f060c004300 con 0x7f061c1eebe0 2024-03-23T23:44:34.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.636+0000 7f0612000640 1 -- 172.21.15.8:0/1498579811 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f061c1eebe0 msgr2=0x7f061c0aa850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:34.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.636+0000 7f0612000640 1 --2- 172.21.15.8:0/1498579811 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f061c1eebe0 0x7f061c0aa850 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f060c0119d0 tx=0x7f060c011e90 comp rx=0 tx=0).stop 2024-03-23T23:44:34.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.636+0000 7f0612000640 1 -- 172.21.15.8:0/1498579811 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f061c1eebe0 msgr2=0x7f061c0aa850 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:44:34.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.636+0000 7f0612000640 1 --2- 172.21.15.8:0/1498579811 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f061c1eebe0 0x7f061c0aa850 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f060c0119d0 tx=0x7f060c011e90 comp rx=0 tx=0).stop 2024-03-23T23:44:34.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.640+0000 7f0613e00640 1 --2- 172.21.15.8:0/1498579811 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f05f8067560 0x7f05f8069a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:34.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.640+0000 7f0613e00640 1 --2- 172.21.15.8:0/1498579811 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f05f8067560 0x7f05f8069a20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f06040ad000 tx=0x7f0604008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:34.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.652+0000 7f061b200640 1 --2- 172.21.15.8:0/1498579811 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f061c0a8fd0 0x7f061c0aad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:44:34.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.652+0000 7f061b200640 1 -- 172.21.15.8:0/1498579811 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061c04f410 con 0x7f061c0a8fd0 2024-03-23T23:44:34.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.652+0000 7f0619e00640 1 --2- 172.21.15.8:0/1498579811 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f061c0a8fd0 0x7f061c0aad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:44:34.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.652+0000 7f0619e00640 1 -- 172.21.15.8:0/1498579811 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f061c0c8340 con 0x7f061c0a8fd0 2024-03-23T23:44:34.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.652+0000 7f0619e00640 1 --2- 172.21.15.8:0/1498579811 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f061c0a8fd0 0x7f061c0aad90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f060c0119d0 tx=0x7f060c0046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:44:34.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.652+0000 7f0612000640 1 -- 172.21.15.8:0/1498579811 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060c01e450 con 0x7f061c0a8fd0 2024-03-23T23:44:34.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.652+0000 7f0612000640 1 -- 172.21.15.8:0/1498579811 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5171 (secure 0 0 0) 0x7f060c0283a0 con 0x7f061c0a8fd0 2024-03-23T23:44:34.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.652+0000 7f0612000640 1 -- 172.21.15.8:0/1498579811 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f061c0a8fd0 msgr2=0x7f061c0aad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:34.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.652+0000 7f0612000640 1 --2- 172.21.15.8:0/1498579811 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f061c0a8fd0 0x7f061c0aad90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f060c0119d0 tx=0x7f060c0046d0 comp rx=0 tx=0).stop 2024-03-23T23:44:34.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.652+0000 7f0612000640 1 -- 172.21.15.8:0/1498579811 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f061c0a8fd0 msgr2=0x7f061c0aad90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:44:34.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.652+0000 7f0612000640 1 --2- 172.21.15.8:0/1498579811 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f061c0a8fd0 0x7f061c0aad90 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f060c0119d0 tx=0x7f060c0046d0 comp rx=0 tx=0).stop 2024-03-23T23:44:34.656 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:44:34.656 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:44:34.656 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:44:34.656 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:44:34.656 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 12, 2024-03-23T23:44:34.656 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:44:34.656 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:44:34.656 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:44:34.656 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:34.656 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 2, 2024-03-23T23:44:34.656 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:44:34.657 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:44:34.657 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:44:34.657 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:44:34.657 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:44:34.657 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:44:34.657 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:44:34.657 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:44:34.657 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:44:34.657 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:44:34.657 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:44:34.657 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:44:34.657 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:44:34.657 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:44:34.658 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:34.658 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:44:34.658 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:44:34.658 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:44:34.658 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:44:34.658 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:44:34.658 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:44:34.658 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:44:34.658 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:44:34.658 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:44:34.658 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:44:34.658 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:44:34.658 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:44:34.659 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:44:34.659 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:34.659 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:34.659 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:44:34.659 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:44:34.659 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:44:34.659 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:44:34.659 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:44:34.659 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:44:34.659 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:44:34.659 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:44:34.659 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:44:34.659 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:44:34.659 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:44:34.660 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:44:34.660 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:44:34.660 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:44:34.660 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:44:34.660 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:44:34.660 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:44:34.660 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:44:34.660 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:44:34.660 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:44:34.660 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:44:34.660 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:44:34.660 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:44:34.661 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:44:34.661 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:44:34.661 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:44:34.661 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:44:34.661 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:44:34.661 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:34.661 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:44:34.661 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:34.661 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:44:34.661 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:34.661 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:44:34.661 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:44:34.661 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:44:34.661 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:44:34.662 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:34.662 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:44:34.662 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:44:34.662 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:34.662 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:34.662 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:34.662 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:44:34.662 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:44:34.662 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:34.662 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:34.662 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:34.662 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:34.662 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:44:34.663 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:44:34.663 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:44:34.663 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:44:34.663 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:44:34.663 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:34.663 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:34.663 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:44:34.663 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:44:34.663 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:44:34.663 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:44:34.664 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:34.664 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:44:34.664 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:44:34.664 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:34.664 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:34.664 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:34.664 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:44:34.664 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:44:34.664 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:34.664 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:34.664 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:34.664 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:34.664 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:44:34.664 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:44:34.664 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:44:34.665 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:44:34.665 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:44:34.665 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:34.665 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:34.665 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:44:34.665 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:44:34.665 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:44:34.665 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:44:34.665 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:34.665 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:44:34.665 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:44:34.665 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:34.665 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:34.665 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:34.665 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:44:34.666 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:44:34.666 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:44:34.666 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:34.666 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:34.666 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:34.666 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:44:34.666 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:44:34.666 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:44:34.666 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:44:34.666 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:44:34.666 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:34.666 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:34.666 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:34.667 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:44:34.667 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:44:34.667 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:34.667 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:44:34.667 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:34.667 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:44:34.667 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:34.668 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:34.668 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:44:34.668 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:34.668 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:44:34.668 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:34.668 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:44:34.668 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:34.668 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:34.668 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:44:34.668 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:34.668 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:44:34.668 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:34.668 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 7 2024-03-23T23:44:34.668 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:34.668 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:34.669 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:44:34.669 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:34.669 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:44:34.669 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:34.669 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:44:34.669 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:34.669 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:34.669 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:44:34.669 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:34.669 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5 2024-03-23T23:44:34.669 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:34.669 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:44:34.669 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:44:34.669 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:44:34.670 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:44:34.670 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:44:34.670 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:44:34.670 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:44:34.670 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:44:34.670 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:44:34.670 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:44:34.670 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:44:34.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.652+0000 7f061b200640 1 -- 172.21.15.8:0/1498579811 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f05f8067560 msgr2=0x7f05f8069a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:34.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.652+0000 7f061b200640 1 --2- 172.21.15.8:0/1498579811 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f05f8067560 0x7f05f8069a20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f06040ad000 tx=0x7f0604008040 comp rx=0 tx=0).stop 2024-03-23T23:44:34.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.652+0000 7f061b200640 1 -- 172.21.15.8:0/1498579811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f061c1574e0 msgr2=0x7f061c14fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:44:34.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.652+0000 7f061b200640 1 --2- 172.21.15.8:0/1498579811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f061c1574e0 0x7f061c14fa10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f061400c760 tx=0x7f061400cc20 comp rx=0 tx=0).stop 2024-03-23T23:44:34.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.652+0000 7f061a800640 1 -- 172.21.15.8:0/1498579811 reap_dead start 2024-03-23T23:44:34.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.652+0000 7f061a800640 1 -- 172.21.15.8:0/1498579811 reap_dead start 2024-03-23T23:44:34.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.656+0000 7f061b200640 1 -- 172.21.15.8:0/1498579811 shutdown_connections 2024-03-23T23:44:34.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.656+0000 7f061b200640 1 -- 172.21.15.8:0/1498579811 >> 172.21.15.8:0/1498579811 conn(0x7f061c0c8de0 msgr2=0x7f061c15f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:44:34.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.656+0000 7f061b200640 1 -- 172.21.15.8:0/1498579811 shutdown_connections 2024-03-23T23:44:34.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:44:34.656+0000 7f061b200640 1 -- 172.21.15.8:0/1498579811 wait complete. 2024-03-23T23:44:34.685 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T23:44:34.685 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-03-23T23:44:41.397 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:44:41.401 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:44:43.778 INFO:tasks.workunit.client.0.smithi008.stderr:Updating files: 64% (7912/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-03-23T23:44:44.171 INFO:tasks.workunit.client.1.smithi196.stderr:Updating files: 67% (8235/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-03-23T23:44:44.533 INFO:tasks.workunit.client.0.smithi008.stderr:Note: switching to '3be9a5c9bc793e11e2800a8c0c696e8b46742033'. 2024-03-23T23:44:44.534 INFO:tasks.workunit.client.0.smithi008.stderr: 2024-03-23T23:44:44.534 INFO:tasks.workunit.client.0.smithi008.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-23T23:44:44.534 INFO:tasks.workunit.client.0.smithi008.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-23T23:44:44.534 INFO:tasks.workunit.client.0.smithi008.stderr:state without impacting any branches by switching back to a branch. 2024-03-23T23:44:44.534 INFO:tasks.workunit.client.0.smithi008.stderr: 2024-03-23T23:44:44.534 INFO:tasks.workunit.client.0.smithi008.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-23T23:44:44.534 INFO:tasks.workunit.client.0.smithi008.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-23T23:44:44.534 INFO:tasks.workunit.client.0.smithi008.stderr: 2024-03-23T23:44:44.534 INFO:tasks.workunit.client.0.smithi008.stderr: git switch -c 2024-03-23T23:44:44.534 INFO:tasks.workunit.client.0.smithi008.stderr: 2024-03-23T23:44:44.535 INFO:tasks.workunit.client.0.smithi008.stderr:Or undo this operation with: 2024-03-23T23:44:44.535 INFO:tasks.workunit.client.0.smithi008.stderr: 2024-03-23T23:44:44.535 INFO:tasks.workunit.client.0.smithi008.stderr: git switch - 2024-03-23T23:44:44.535 INFO:tasks.workunit.client.0.smithi008.stderr: 2024-03-23T23:44:44.535 INFO:tasks.workunit.client.0.smithi008.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-23T23:44:44.535 INFO:tasks.workunit.client.0.smithi008.stderr: 2024-03-23T23:44:44.535 INFO:tasks.workunit.client.0.smithi008.stderr:HEAD is now at 3be9a5c9bc7 dummy commit #1 2024-03-23T23:44:44.542 DEBUG:teuthology.orchestra.run.smithi008:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-23T23:44:44.551 INFO:tasks.workunit.client.0.smithi008.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-23T23:44:44.554 INFO:tasks.workunit.client.0.smithi008.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-23T23:44:44.554 INFO:tasks.workunit.client.0.smithi008.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-23T23:44:44.580 INFO:tasks.workunit.client.1.smithi196.stderr:Note: switching to '3be9a5c9bc793e11e2800a8c0c696e8b46742033'. 2024-03-23T23:44:44.580 INFO:tasks.workunit.client.1.smithi196.stderr: 2024-03-23T23:44:44.580 INFO:tasks.workunit.client.1.smithi196.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-23T23:44:44.580 INFO:tasks.workunit.client.1.smithi196.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-23T23:44:44.580 INFO:tasks.workunit.client.1.smithi196.stderr:state without impacting any branches by switching back to a branch. 2024-03-23T23:44:44.580 INFO:tasks.workunit.client.1.smithi196.stderr: 2024-03-23T23:44:44.580 INFO:tasks.workunit.client.1.smithi196.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-23T23:44:44.580 INFO:tasks.workunit.client.1.smithi196.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-23T23:44:44.580 INFO:tasks.workunit.client.1.smithi196.stderr: 2024-03-23T23:44:44.580 INFO:tasks.workunit.client.1.smithi196.stderr: git switch -c 2024-03-23T23:44:44.580 INFO:tasks.workunit.client.1.smithi196.stderr: 2024-03-23T23:44:44.581 INFO:tasks.workunit.client.1.smithi196.stderr:Or undo this operation with: 2024-03-23T23:44:44.581 INFO:tasks.workunit.client.1.smithi196.stderr: 2024-03-23T23:44:44.581 INFO:tasks.workunit.client.1.smithi196.stderr: git switch - 2024-03-23T23:44:44.581 INFO:tasks.workunit.client.1.smithi196.stderr: 2024-03-23T23:44:44.581 INFO:tasks.workunit.client.1.smithi196.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-23T23:44:44.581 INFO:tasks.workunit.client.1.smithi196.stderr: 2024-03-23T23:44:44.581 INFO:tasks.workunit.client.1.smithi196.stderr:HEAD is now at 3be9a5c9bc7 dummy commit #1 2024-03-23T23:44:44.588 DEBUG:teuthology.orchestra.run.smithi196:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-03-23T23:44:44.596 INFO:tasks.workunit.client.1.smithi196.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-23T23:44:44.599 INFO:tasks.workunit.client.1.smithi196.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-03-23T23:44:44.599 INFO:tasks.workunit.client.1.smithi196.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-23T23:44:45.242 INFO:tasks.workunit.client.0.smithi008.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-23T23:44:45.333 INFO:tasks.workunit.client.0.smithi008.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-23T23:44:45.361 INFO:tasks.workunit.client.1.smithi196.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-23T23:44:45.407 INFO:tasks.workunit.client.0.smithi008.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-23T23:44:45.409 INFO:tasks.workunit.client.0.smithi008.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-23T23:44:45.409 INFO:tasks.workunit.client.0.smithi008.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-23T23:44:45.439 INFO:tasks.workunit.client.1.smithi196.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-23T23:44:45.464 INFO:tasks.workunit.client.0.smithi008.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-23T23:44:45.470 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-23T23:44:45.470 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-23T23:44:45.502 INFO:tasks.workunit.client.1.smithi196.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-03-23T23:44:45.505 INFO:tasks.workunit.client.1.smithi196.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-03-23T23:44:45.505 INFO:tasks.workunit.client.1.smithi196.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-23T23:44:45.520 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2024-03-23T23:44:45.521 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-03-23T23:44:45.522 DEBUG:teuthology.orchestra.run.smithi008:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3be9a5c9bc793e11e2800a8c0c696e8b46742033 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-03-23T23:44:45.558 INFO:tasks.workunit.client.1.smithi196.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-03-23T23:44:45.564 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-23T23:44:45.564 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-03-23T23:44:45.582 INFO:tasks.workunit.client.0.smithi008.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-03-23T23:44:45.584 INFO:tasks.workunit.client.0.smithi008.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/suites 2024-03-23T23:44:45.584 INFO:tasks.workunit.client.0.smithi008.stderr:+ trap -- retry EXIT 2024-03-23T23:44:45.584 INFO:tasks.workunit.client.0.smithi008.stderr:+ rm -rf ffsb 2024-03-23T23:44:45.585 INFO:tasks.workunit.client.0.smithi008.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2024-03-23T23:44:45.590 INFO:tasks.workunit.client.0.smithi008.stderr:Cloning into 'ffsb'... 2024-03-23T23:44:45.619 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.1... 2024-03-23T23:44:45.621 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-03-23T23:44:45.621 DEBUG:teuthology.orchestra.run.smithi196:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3be9a5c9bc793e11e2800a8c0c696e8b46742033 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/ffsb.sh 2024-03-23T23:44:45.687 INFO:tasks.workunit.client.1.smithi196.stderr:++ dirname /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/ffsb.sh 2024-03-23T23:44:45.688 INFO:tasks.workunit.client.1.smithi196.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.1/qa/workunits/suites 2024-03-23T23:44:45.689 INFO:tasks.workunit.client.1.smithi196.stderr:+ trap -- retry EXIT 2024-03-23T23:44:45.689 INFO:tasks.workunit.client.1.smithi196.stderr:+ rm -rf ffsb 2024-03-23T23:44:45.691 INFO:tasks.workunit.client.1.smithi196.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2024-03-23T23:44:45.696 INFO:tasks.workunit.client.1.smithi196.stderr:Cloning into 'ffsb'... 2024-03-23T23:44:47.232 INFO:tasks.workunit.client.0.smithi008.stderr:+ trap - EXIT 2024-03-23T23:44:47.232 INFO:tasks.workunit.client.0.smithi008.stderr:+ cd ffsb 2024-03-23T23:44:47.232 INFO:tasks.workunit.client.0.smithi008.stderr:+ ./configure 2024-03-23T23:44:47.373 INFO:tasks.workunit.client.1.smithi196.stderr:+ trap - EXIT 2024-03-23T23:44:47.373 INFO:tasks.workunit.client.1.smithi196.stderr:+ cd ffsb 2024-03-23T23:44:47.373 INFO:tasks.workunit.client.1.smithi196.stderr:+ ./configure 2024-03-23T23:44:47.546 INFO:tasks.workunit.client.0.smithi008.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-03-23T23:44:47.655 INFO:tasks.workunit.client.1.smithi196.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-03-23T23:44:48.559 INFO:tasks.workunit.client.0.smithi008.stdout:checking whether build environment is sane... yes 2024-03-23T23:44:48.579 INFO:tasks.workunit.client.0.smithi008.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-03-23T23:44:48.580 INFO:tasks.workunit.client.0.smithi008.stdout:checking for gawk... gawk 2024-03-23T23:44:48.601 INFO:tasks.workunit.client.0.smithi008.stdout:checking whether make sets $(MAKE)... yes 2024-03-23T23:44:48.668 INFO:tasks.workunit.client.1.smithi196.stdout:checking whether build environment is sane... yes 2024-03-23T23:44:48.673 INFO:tasks.workunit.client.0.smithi008.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-03-23T23:44:48.673 INFO:tasks.workunit.client.0.smithi008.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-03-23T23:44:48.691 INFO:tasks.workunit.client.0.smithi008.stdout:checking for style of include used by make... GNU 2024-03-23T23:44:48.693 INFO:tasks.workunit.client.1.smithi196.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-03-23T23:44:48.693 INFO:tasks.workunit.client.1.smithi196.stdout:checking for gawk... gawk 2024-03-23T23:44:48.702 INFO:tasks.workunit.client.0.smithi008.stdout:checking for gcc... gcc 2024-03-23T23:44:48.716 INFO:tasks.workunit.client.1.smithi196.stdout:checking whether make sets $(MAKE)... yes 2024-03-23T23:44:48.789 INFO:tasks.workunit.client.0.smithi008.stdout:checking for C compiler default output file name... a.out 2024-03-23T23:44:48.792 INFO:tasks.workunit.client.1.smithi196.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-03-23T23:44:48.792 INFO:tasks.workunit.client.1.smithi196.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-03-23T23:44:48.794 INFO:tasks.workunit.client.0.smithi008.stdout:checking whether the C compiler works... yes 2024-03-23T23:44:48.800 INFO:tasks.workunit.client.0.smithi008.stdout:checking whether we are cross compiling... no 2024-03-23T23:44:48.811 INFO:tasks.workunit.client.1.smithi196.stdout:checking for style of include used by make... GNU 2024-03-23T23:44:48.822 INFO:tasks.workunit.client.1.smithi196.stdout:checking for gcc... gcc 2024-03-23T23:44:48.865 INFO:tasks.workunit.client.0.smithi008.stdout:checking for suffix of executables... 2024-03-23T23:44:48.910 INFO:tasks.workunit.client.1.smithi196.stdout:checking for C compiler default output file name... a.out 2024-03-23T23:44:48.914 INFO:tasks.workunit.client.1.smithi196.stdout:checking whether the C compiler works... yes 2024-03-23T23:44:48.921 INFO:tasks.workunit.client.1.smithi196.stdout:checking whether we are cross compiling... no 2024-03-23T23:44:48.923 INFO:tasks.workunit.client.0.smithi008.stdout:checking for suffix of object files... o 2024-03-23T23:44:48.980 INFO:tasks.workunit.client.1.smithi196.stdout:checking for suffix of executables... 2024-03-23T23:44:48.992 INFO:tasks.workunit.client.0.smithi008.stdout:checking whether we are using the GNU C compiler... yes 2024-03-23T23:44:49.041 INFO:tasks.workunit.client.1.smithi196.stdout:checking for suffix of object files... o 2024-03-23T23:44:49.068 INFO:tasks.workunit.client.0.smithi008.stdout:checking whether gcc accepts -g... yes 2024-03-23T23:44:49.112 INFO:tasks.workunit.client.1.smithi196.stdout:checking whether we are using the GNU C compiler... yes 2024-03-23T23:44:49.186 INFO:tasks.workunit.client.1.smithi196.stdout:checking whether gcc accepts -g... yes 2024-03-23T23:44:49.198 INFO:tasks.workunit.client.0.smithi008.stdout:checking for gcc option to accept ISO C89... none needed 2024-03-23T23:44:49.351 INFO:tasks.workunit.client.1.smithi196.stdout:checking for gcc option to accept ISO C89... none needed 2024-03-23T23:44:49.386 INFO:tasks.workunit.client.0.smithi008.stdout:checking dependency style of gcc... gcc3 2024-03-23T23:44:49.511 INFO:tasks.workunit.client.0.smithi008.stdout:checking how to run the C preprocessor... gcc -E 2024-03-23T23:44:49.538 INFO:tasks.workunit.client.1.smithi196.stdout:checking dependency style of gcc... gcc3 2024-03-23T23:44:49.622 INFO:tasks.workunit.client.0.smithi008.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-03-23T23:44:49.625 INFO:tasks.workunit.client.0.smithi008.stdout:checking for egrep... /usr/bin/grep -E 2024-03-23T23:44:49.645 INFO:tasks.workunit.client.0.smithi008.stdout:checking for AIX... no 2024-03-23T23:44:49.654 INFO:tasks.workunit.client.0.smithi008.stdout:checking for gcc... (cached) gcc 2024-03-23T23:44:49.659 INFO:tasks.workunit.client.1.smithi196.stdout:checking how to run the C preprocessor... gcc -E 2024-03-23T23:44:49.673 INFO:tasks.workunit.client.0.smithi008.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-03-23T23:44:49.675 INFO:tasks.workunit.client.0.smithi008.stdout:checking whether gcc accepts -g... (cached) yes 2024-03-23T23:44:49.675 INFO:tasks.workunit.client.0.smithi008.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-03-23T23:44:49.675 INFO:tasks.workunit.client.0.smithi008.stdout:checking dependency style of gcc... (cached) gcc3 2024-03-23T23:44:49.768 INFO:tasks.workunit.client.1.smithi196.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-03-23T23:44:49.771 INFO:tasks.workunit.client.1.smithi196.stdout:checking for egrep... /usr/bin/grep -E 2024-03-23T23:44:49.794 INFO:tasks.workunit.client.1.smithi196.stdout:checking for AIX... no 2024-03-23T23:44:49.797 INFO:tasks.workunit.client.0.smithi008.stdout:checking for main in -lm... yes 2024-03-23T23:44:49.801 INFO:tasks.workunit.client.1.smithi196.stdout:checking for gcc... (cached) gcc 2024-03-23T23:44:49.818 INFO:tasks.workunit.client.1.smithi196.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-03-23T23:44:49.819 INFO:tasks.workunit.client.1.smithi196.stdout:checking whether gcc accepts -g... (cached) yes 2024-03-23T23:44:49.820 INFO:tasks.workunit.client.1.smithi196.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-03-23T23:44:49.820 INFO:tasks.workunit.client.1.smithi196.stdout:checking dependency style of gcc... (cached) gcc3 2024-03-23T23:44:49.898 INFO:tasks.workunit.client.0.smithi008.stdout:checking for main in -lpthread... yes 2024-03-23T23:44:49.937 INFO:tasks.workunit.client.1.smithi196.stdout:checking for main in -lm... yes 2024-03-23T23:44:50.053 INFO:tasks.workunit.client.1.smithi196.stdout:checking for main in -lpthread... yes 2024-03-23T23:44:50.180 INFO:tasks.workunit.client.0.smithi008.stdout:checking for ANSI C header files... yes 2024-03-23T23:44:50.279 INFO:tasks.workunit.client.0.smithi008.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-03-23T23:44:50.340 INFO:tasks.workunit.client.1.smithi196.stdout:checking for ANSI C header files... yes 2024-03-23T23:44:50.368 INFO:tasks.workunit.client.0.smithi008.stdout:checking for sys/types.h... yes 2024-03-23T23:44:50.433 INFO:tasks.workunit.client.1.smithi196.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-03-23T23:44:50.466 INFO:tasks.workunit.client.0.smithi008.stdout:checking for sys/stat.h... yes 2024-03-23T23:44:50.526 INFO:tasks.workunit.client.1.smithi196.stdout:checking for sys/types.h... yes 2024-03-23T23:44:50.562 INFO:tasks.workunit.client.0.smithi008.stdout:checking for stdlib.h... yes 2024-03-23T23:44:50.619 INFO:tasks.workunit.client.1.smithi196.stdout:checking for sys/stat.h... yes 2024-03-23T23:44:50.661 INFO:tasks.workunit.client.0.smithi008.stdout:checking for string.h... yes 2024-03-23T23:44:50.717 INFO:tasks.workunit.client.1.smithi196.stdout:checking for stdlib.h... yes 2024-03-23T23:44:50.762 INFO:tasks.workunit.client.0.smithi008.stdout:checking for memory.h... yes 2024-03-23T23:44:50.946 INFO:tasks.workunit.client.1.smithi196.stdout:checking for string.h... yes 2024-03-23T23:44:51.007 INFO:tasks.workunit.client.0.smithi008.stdout:checking for strings.h... yes 2024-03-23T23:44:51.045 INFO:tasks.workunit.client.1.smithi196.stdout:checking for memory.h... yes 2024-03-23T23:44:51.108 INFO:tasks.workunit.client.0.smithi008.stdout:checking for inttypes.h... yes 2024-03-23T23:44:51.147 INFO:tasks.workunit.client.1.smithi196.stdout:checking for strings.h... yes 2024-03-23T23:44:51.207 INFO:tasks.workunit.client.0.smithi008.stdout:checking for stdint.h... yes 2024-03-23T23:44:51.247 INFO:tasks.workunit.client.1.smithi196.stdout:checking for inttypes.h... yes 2024-03-23T23:44:51.322 INFO:tasks.workunit.client.0.smithi008.stdout:checking for unistd.h... yes 2024-03-23T23:44:51.348 INFO:tasks.workunit.client.1.smithi196.stdout:checking for stdint.h... yes 2024-03-23T23:44:51.443 INFO:tasks.workunit.client.0.smithi008.stdout:checking pthread.h usability... yes 2024-03-23T23:44:51.451 INFO:tasks.workunit.client.1.smithi196.stdout:checking for unistd.h... yes 2024-03-23T23:44:51.497 INFO:tasks.workunit.client.0.smithi008.stdout:checking pthread.h presence... yes 2024-03-23T23:44:51.498 INFO:tasks.workunit.client.0.smithi008.stdout:checking for pthread.h... yes 2024-03-23T23:44:51.569 INFO:tasks.workunit.client.1.smithi196.stdout:checking pthread.h usability... yes 2024-03-23T23:44:51.604 INFO:tasks.workunit.client.0.smithi008.stdout:checking fcntl.h usability... yes 2024-03-23T23:44:51.623 INFO:tasks.workunit.client.1.smithi196.stdout:checking pthread.h presence... yes 2024-03-23T23:44:51.624 INFO:tasks.workunit.client.1.smithi196.stdout:checking for pthread.h... yes 2024-03-23T23:44:51.656 INFO:tasks.workunit.client.0.smithi008.stdout:checking fcntl.h presence... yes 2024-03-23T23:44:51.657 INFO:tasks.workunit.client.0.smithi008.stdout:checking for fcntl.h... yes 2024-03-23T23:44:51.730 INFO:tasks.workunit.client.1.smithi196.stdout:checking fcntl.h usability... yes 2024-03-23T23:44:51.760 INFO:tasks.workunit.client.0.smithi008.stdout:checking limits.h usability... yes 2024-03-23T23:44:51.781 INFO:tasks.workunit.client.1.smithi196.stdout:checking fcntl.h presence... yes 2024-03-23T23:44:51.782 INFO:tasks.workunit.client.1.smithi196.stdout:checking for fcntl.h... yes 2024-03-23T23:44:51.824 INFO:tasks.workunit.client.0.smithi008.stdout:checking limits.h presence... yes 2024-03-23T23:44:51.825 INFO:tasks.workunit.client.0.smithi008.stdout:checking for limits.h... yes 2024-03-23T23:44:51.842 INFO:tasks.workunit.client.0.smithi008.stdout:checking for stdint.h... (cached) yes 2024-03-23T23:44:51.913 INFO:tasks.workunit.client.1.smithi196.stdout:checking limits.h usability... yes 2024-03-23T23:44:51.959 INFO:tasks.workunit.client.0.smithi008.stdout:checking sys/time.h usability... yes 2024-03-23T23:44:51.964 INFO:tasks.workunit.client.1.smithi196.stdout:checking limits.h presence... yes 2024-03-23T23:44:51.965 INFO:tasks.workunit.client.1.smithi196.stdout:checking for limits.h... yes 2024-03-23T23:44:51.982 INFO:tasks.workunit.client.1.smithi196.stdout:checking for stdint.h... (cached) yes 2024-03-23T23:44:52.014 INFO:tasks.workunit.client.0.smithi008.stdout:checking sys/time.h presence... yes 2024-03-23T23:44:52.014 INFO:tasks.workunit.client.0.smithi008.stdout:checking for sys/time.h... yes 2024-03-23T23:44:52.027 INFO:tasks.workunit.client.0.smithi008.stdout:checking for unistd.h... (cached) yes 2024-03-23T23:44:52.076 INFO:tasks.workunit.client.1.smithi196.stdout:checking sys/time.h usability... yes 2024-03-23T23:44:52.129 INFO:tasks.workunit.client.1.smithi196.stdout:checking sys/time.h presence... yes 2024-03-23T23:44:52.129 INFO:tasks.workunit.client.1.smithi196.stdout:checking for sys/time.h... yes 2024-03-23T23:44:52.137 INFO:tasks.workunit.client.0.smithi008.stdout:checking sys/vfs.h usability... yes 2024-03-23T23:44:52.145 INFO:tasks.workunit.client.1.smithi196.stdout:checking for unistd.h... (cached) yes 2024-03-23T23:44:52.189 INFO:tasks.workunit.client.0.smithi008.stdout:checking sys/vfs.h presence... yes 2024-03-23T23:44:52.190 INFO:tasks.workunit.client.0.smithi008.stdout:checking for sys/vfs.h... yes 2024-03-23T23:44:52.245 INFO:tasks.workunit.client.1.smithi196.stdout:checking sys/vfs.h usability... yes 2024-03-23T23:44:52.296 INFO:tasks.workunit.client.1.smithi196.stdout:checking sys/vfs.h presence... yes 2024-03-23T23:44:52.297 INFO:tasks.workunit.client.1.smithi196.stdout:checking for sys/vfs.h... yes 2024-03-23T23:44:52.303 INFO:tasks.workunit.client.0.smithi008.stdout:checking sys/limits.h usability... no 2024-03-23T23:44:52.359 INFO:tasks.workunit.client.0.smithi008.stdout:checking sys/limits.h presence... no 2024-03-23T23:44:52.359 INFO:tasks.workunit.client.0.smithi008.stdout:checking for sys/limits.h... no 2024-03-23T23:44:52.402 INFO:tasks.workunit.client.1.smithi196.stdout:checking sys/limits.h usability... no 2024-03-23T23:44:52.438 INFO:tasks.workunit.client.0.smithi008.stdout:checking for an ANSI C-conforming const... yes 2024-03-23T23:44:52.454 INFO:tasks.workunit.client.1.smithi196.stdout:checking sys/limits.h presence... no 2024-03-23T23:44:52.455 INFO:tasks.workunit.client.1.smithi196.stdout:checking for sys/limits.h... no 2024-03-23T23:44:52.515 INFO:tasks.workunit.client.0.smithi008.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-03-23T23:44:52.518 INFO:tasks.workunit.client.0.smithi008.stdout:checking for function prototypes... yes 2024-03-23T23:44:52.536 INFO:tasks.workunit.client.1.smithi196.stdout:checking for an ANSI C-conforming const... yes 2024-03-23T23:44:52.590 INFO:tasks.workunit.client.0.smithi008.stdout:checking whether setvbuf arguments are reversed... no 2024-03-23T23:44:52.615 INFO:tasks.workunit.client.1.smithi196.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-03-23T23:44:52.618 INFO:tasks.workunit.client.1.smithi196.stdout:checking for function prototypes... yes 2024-03-23T23:44:52.687 INFO:tasks.workunit.client.1.smithi196.stdout:checking whether setvbuf arguments are reversed... no 2024-03-23T23:44:52.709 INFO:tasks.workunit.client.0.smithi008.stdout:checking for system... yes 2024-03-23T23:44:52.806 INFO:tasks.workunit.client.1.smithi196.stdout:checking for system... yes 2024-03-23T23:44:52.842 INFO:tasks.workunit.client.0.smithi008.stdout:checking for gettimeofday... yes 2024-03-23T23:44:52.934 INFO:tasks.workunit.client.1.smithi196.stdout:checking for gettimeofday... yes 2024-03-23T23:44:52.974 INFO:tasks.workunit.client.0.smithi008.stdout:checking for mkdir... yes 2024-03-23T23:44:53.058 INFO:tasks.workunit.client.1.smithi196.stdout:checking for mkdir... yes 2024-03-23T23:44:53.103 INFO:tasks.workunit.client.0.smithi008.stdout:checking for strerror... yes 2024-03-23T23:44:53.186 INFO:tasks.workunit.client.1.smithi196.stdout:checking for strerror... yes 2024-03-23T23:44:53.227 INFO:tasks.workunit.client.0.smithi008.stdout:checking for open64... yes 2024-03-23T23:44:53.311 INFO:tasks.workunit.client.1.smithi196.stdout:checking for open64... yes 2024-03-23T23:44:53.348 INFO:tasks.workunit.client.0.smithi008.stdout:checking for stat64... yes 2024-03-23T23:44:53.441 INFO:tasks.workunit.client.1.smithi196.stdout:checking for stat64... yes 2024-03-23T23:44:53.480 INFO:tasks.workunit.client.0.smithi008.stdout:checking for fseeko64... yes 2024-03-23T23:44:53.577 INFO:tasks.workunit.client.1.smithi196.stdout:checking for fseeko64... yes 2024-03-23T23:44:53.627 INFO:tasks.workunit.client.0.smithi008.stdout:checking for lrand48_r... yes 2024-03-23T23:44:53.717 INFO:tasks.workunit.client.1.smithi196.stdout:checking for lrand48_r... yes 2024-03-23T23:44:53.755 INFO:tasks.workunit.client.0.smithi008.stdout:checking for srand48_r... yes 2024-03-23T23:44:53.809 INFO:tasks.workunit.client.0.smithi008.stdout:configure: creating ./config.status 2024-03-23T23:44:53.846 INFO:tasks.workunit.client.1.smithi196.stdout:checking for srand48_r... yes 2024-03-23T23:44:53.901 INFO:tasks.workunit.client.1.smithi196.stdout:configure: creating ./config.status 2024-03-23T23:44:54.063 INFO:tasks.workunit.client.0.smithi008.stdout:config.status: creating Makefile 2024-03-23T23:44:54.102 INFO:tasks.workunit.client.0.smithi008.stdout:config.status: creating config.h 2024-03-23T23:44:54.146 INFO:tasks.workunit.client.1.smithi196.stdout:config.status: creating Makefile 2024-03-23T23:44:54.158 INFO:tasks.workunit.client.0.smithi008.stdout:config.status: executing depfiles commands 2024-03-23T23:44:54.184 INFO:tasks.workunit.client.1.smithi196.stdout:config.status: creating config.h 2024-03-23T23:44:54.237 INFO:tasks.workunit.client.1.smithi196.stdout:config.status: executing depfiles commands 2024-03-23T23:44:54.306 INFO:tasks.workunit.client.0.smithi008.stdout:config.status: executing default commands 2024-03-23T23:44:54.377 INFO:tasks.workunit.client.0.smithi008.stderr:+ make 2024-03-23T23:44:54.390 INFO:tasks.workunit.client.1.smithi196.stdout:config.status: executing default commands 2024-03-23T23:44:54.394 INFO:tasks.workunit.client.0.smithi008.stdout:cd . && /bin/bash /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run aclocal-1.10 2024-03-23T23:44:54.399 INFO:tasks.workunit.client.0.smithi008.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-03-23T23:44:54.401 INFO:tasks.workunit.client.0.smithi008.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-03-23T23:44:54.401 INFO:tasks.workunit.client.0.smithi008.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-03-23T23:44:54.401 INFO:tasks.workunit.client.0.smithi008.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-03-23T23:44:54.401 INFO:tasks.workunit.client.0.smithi008.stderr: any GNU archive site. 2024-03-23T23:44:54.405 INFO:tasks.workunit.client.0.smithi008.stdout: cd . && /bin/bash /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2024-03-23T23:44:54.408 INFO:tasks.workunit.client.0.smithi008.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-03-23T23:44:54.410 INFO:tasks.workunit.client.0.smithi008.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-03-23T23:44:54.411 INFO:tasks.workunit.client.0.smithi008.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-03-23T23:44:54.411 INFO:tasks.workunit.client.0.smithi008.stderr: You might want to install the `Automake' and `Perl' packages. 2024-03-23T23:44:54.411 INFO:tasks.workunit.client.0.smithi008.stderr: Grab them from any GNU archive site. 2024-03-23T23:44:54.461 INFO:tasks.workunit.client.0.smithi008.stdout:cd . && /bin/bash /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoconf 2024-03-23T23:44:54.462 INFO:tasks.workunit.client.1.smithi196.stderr:+ make 2024-03-23T23:44:54.480 INFO:tasks.workunit.client.1.smithi196.stdout:cd . && /bin/bash /home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing --run aclocal-1.10 2024-03-23T23:44:54.485 INFO:tasks.workunit.client.1.smithi196.stderr:/home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-03-23T23:44:54.486 INFO:tasks.workunit.client.1.smithi196.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-03-23T23:44:54.487 INFO:tasks.workunit.client.1.smithi196.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-03-23T23:44:54.487 INFO:tasks.workunit.client.1.smithi196.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-03-23T23:44:54.487 INFO:tasks.workunit.client.1.smithi196.stderr: any GNU archive site. 2024-03-23T23:44:54.490 INFO:tasks.workunit.client.1.smithi196.stdout: cd . && /bin/bash /home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing --run automake-1.10 --gnu 2024-03-23T23:44:54.493 INFO:tasks.workunit.client.1.smithi196.stderr:/home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-03-23T23:44:54.495 INFO:tasks.workunit.client.1.smithi196.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-03-23T23:44:54.495 INFO:tasks.workunit.client.1.smithi196.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-03-23T23:44:54.495 INFO:tasks.workunit.client.1.smithi196.stderr: You might want to install the `Automake' and `Perl' packages. 2024-03-23T23:44:54.495 INFO:tasks.workunit.client.1.smithi196.stderr: Grab them from any GNU archive site. 2024-03-23T23:44:54.544 INFO:tasks.workunit.client.1.smithi196.stdout:cd . && /bin/bash /home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing --run autoconf 2024-03-23T23:44:54.651 INFO:tasks.workunit.client.0.smithi008.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-03-23T23:44:54.651 INFO:tasks.workunit.client.0.smithi008.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-03-23T23:44:54.651 INFO:tasks.workunit.client.0.smithi008.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-03-23T23:44:54.652 INFO:tasks.workunit.client.0.smithi008.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-03-23T23:44:54.686 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-03-23T23:44:54.686 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-03-23T23:44:54.686 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-23T23:44:54.687 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-23T23:44:54.691 INFO:tasks.ceph.mon.b:Started 2024-03-23T23:44:54.691 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-03-23T23:44:54.691 INFO:tasks.ceph.mon.c:Sent signal 19 2024-03-23T23:44:54.691 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-03-23T23:44:54.725 INFO:tasks.workunit.client.1.smithi196.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-03-23T23:44:54.725 INFO:tasks.workunit.client.1.smithi196.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-03-23T23:44:54.725 INFO:tasks.workunit.client.1.smithi196.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-03-23T23:44:54.725 INFO:tasks.workunit.client.1.smithi196.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-03-23T23:44:54.761 INFO:tasks.workunit.client.0.smithi008.stderr:configure.in:4: warning: The macro `AC_FOREACH' is obsolete. 2024-03-23T23:44:54.761 INFO:tasks.workunit.client.0.smithi008.stderr:configure.in:4: You should run autoupdate. 2024-03-23T23:44:54.761 INFO:tasks.workunit.client.0.smithi008.stderr:./lib/autoconf/general.m4:191: AC_FOREACH is expanded from... 2024-03-23T23:44:54.761 INFO:tasks.workunit.client.0.smithi008.stderr:aclocal.m4:684: _AM_SET_OPTIONS is expanded from... 2024-03-23T23:44:54.761 INFO:tasks.workunit.client.0.smithi008.stderr:aclocal.m4:410: AM_INIT_AUTOMAKE is expanded from... 2024-03-23T23:44:54.761 INFO:tasks.workunit.client.0.smithi008.stderr:configure.in:4: the top level 2024-03-23T23:44:54.761 INFO:tasks.workunit.client.0.smithi008.stderr:configure.in:6: warning: The macro `AM_CONFIG_HEADER' is obsolete. 2024-03-23T23:44:54.761 INFO:tasks.workunit.client.0.smithi008.stderr:configure.in:6: You should run autoupdate. 2024-03-23T23:44:54.761 INFO:tasks.workunit.client.0.smithi008.stderr:aclocal.m4:383: AM_CONFIG_HEADER is expanded from... 2024-03-23T23:44:54.761 INFO:tasks.workunit.client.0.smithi008.stderr:configure.in:6: the top level 2024-03-23T23:44:54.761 INFO:tasks.workunit.client.0.smithi008.stderr:configure.in:10: warning: The macro `AC_AIX' is obsolete. 2024-03-23T23:44:54.761 INFO:tasks.workunit.client.0.smithi008.stderr:configure.in:10: You should run autoupdate. 2024-03-23T23:44:54.761 INFO:tasks.workunit.client.0.smithi008.stderr:./lib/autoconf/specific.m4:540: AC_AIX is expanded from... 2024-03-23T23:44:54.762 INFO:tasks.workunit.client.0.smithi008.stderr:configure.in:10: the top level 2024-03-23T23:44:54.762 INFO:tasks.workunit.client.0.smithi008.stderr:configure.in:36: warning: The macro `AC_HEADER_STDC' is obsolete. 2024-03-23T23:44:54.762 INFO:tasks.workunit.client.0.smithi008.stderr:configure.in:36: You should run autoupdate. 2024-03-23T23:44:54.762 INFO:tasks.workunit.client.0.smithi008.stderr:./lib/autoconf/headers.m4:704: AC_HEADER_STDC is expanded from... 2024-03-23T23:44:54.762 INFO:tasks.workunit.client.0.smithi008.stderr:configure.in:36: the top level 2024-03-23T23:44:54.762 INFO:tasks.workunit.client.0.smithi008.stderr:configure.in:42: warning: The macro `AC_HEADER_TIME' is obsolete. 2024-03-23T23:44:54.762 INFO:tasks.workunit.client.0.smithi008.stderr:configure.in:42: You should run autoupdate. 2024-03-23T23:44:54.762 INFO:tasks.workunit.client.0.smithi008.stderr:./lib/autoconf/headers.m4:743: AC_HEADER_TIME is expanded from... 2024-03-23T23:44:54.762 INFO:tasks.workunit.client.0.smithi008.stderr:configure.in:42: the top level 2024-03-23T23:44:54.762 INFO:tasks.workunit.client.0.smithi008.stderr:configure.in:45: warning: The macro `AC_FUNC_SETVBUF_REVERSED' is obsolete. Remove it and all references to SETVBUF_REVERSED. 2024-03-23T23:44:54.762 INFO:tasks.workunit.client.0.smithi008.stderr:./lib/autoconf/functions.m4:1766: AC_FUNC_SETVBUF_REVERSED is expanded from... 2024-03-23T23:44:54.762 INFO:tasks.workunit.client.0.smithi008.stderr:configure.in:45: the top level 2024-03-23T23:44:54.762 INFO:tasks.workunit.client.0.smithi008.stderr:configure.in:50: warning: AC_OUTPUT should be used without arguments. 2024-03-23T23:44:54.762 INFO:tasks.workunit.client.0.smithi008.stderr:configure.in:50: You should run autoupdate. 2024-03-23T23:44:54.847 INFO:tasks.workunit.client.1.smithi196.stderr:configure.in:4: warning: The macro `AC_FOREACH' is obsolete. 2024-03-23T23:44:54.847 INFO:tasks.workunit.client.1.smithi196.stderr:configure.in:4: You should run autoupdate. 2024-03-23T23:44:54.847 INFO:tasks.workunit.client.1.smithi196.stderr:./lib/autoconf/general.m4:191: AC_FOREACH is expanded from... 2024-03-23T23:44:54.847 INFO:tasks.workunit.client.1.smithi196.stderr:aclocal.m4:684: _AM_SET_OPTIONS is expanded from... 2024-03-23T23:44:54.847 INFO:tasks.workunit.client.1.smithi196.stderr:aclocal.m4:410: AM_INIT_AUTOMAKE is expanded from... 2024-03-23T23:44:54.847 INFO:tasks.workunit.client.1.smithi196.stderr:configure.in:4: the top level 2024-03-23T23:44:54.847 INFO:tasks.workunit.client.1.smithi196.stderr:configure.in:6: warning: The macro `AM_CONFIG_HEADER' is obsolete. 2024-03-23T23:44:54.848 INFO:tasks.workunit.client.1.smithi196.stderr:configure.in:6: You should run autoupdate. 2024-03-23T23:44:54.848 INFO:tasks.workunit.client.1.smithi196.stderr:aclocal.m4:383: AM_CONFIG_HEADER is expanded from... 2024-03-23T23:44:54.848 INFO:tasks.workunit.client.1.smithi196.stderr:configure.in:6: the top level 2024-03-23T23:44:54.848 INFO:tasks.workunit.client.1.smithi196.stderr:configure.in:10: warning: The macro `AC_AIX' is obsolete. 2024-03-23T23:44:54.848 INFO:tasks.workunit.client.1.smithi196.stderr:configure.in:10: You should run autoupdate. 2024-03-23T23:44:54.848 INFO:tasks.workunit.client.1.smithi196.stderr:./lib/autoconf/specific.m4:540: AC_AIX is expanded from... 2024-03-23T23:44:54.848 INFO:tasks.workunit.client.1.smithi196.stderr:configure.in:10: the top level 2024-03-23T23:44:54.848 INFO:tasks.workunit.client.1.smithi196.stderr:configure.in:36: warning: The macro `AC_HEADER_STDC' is obsolete. 2024-03-23T23:44:54.848 INFO:tasks.workunit.client.1.smithi196.stderr:configure.in:36: You should run autoupdate. 2024-03-23T23:44:54.848 INFO:tasks.workunit.client.1.smithi196.stderr:./lib/autoconf/headers.m4:704: AC_HEADER_STDC is expanded from... 2024-03-23T23:44:54.848 INFO:tasks.workunit.client.1.smithi196.stderr:configure.in:36: the top level 2024-03-23T23:44:54.848 INFO:tasks.workunit.client.1.smithi196.stderr:configure.in:42: warning: The macro `AC_HEADER_TIME' is obsolete. 2024-03-23T23:44:54.848 INFO:tasks.workunit.client.1.smithi196.stderr:configure.in:42: You should run autoupdate. 2024-03-23T23:44:54.849 INFO:tasks.workunit.client.1.smithi196.stderr:./lib/autoconf/headers.m4:743: AC_HEADER_TIME is expanded from... 2024-03-23T23:44:54.849 INFO:tasks.workunit.client.1.smithi196.stderr:configure.in:42: the top level 2024-03-23T23:44:54.849 INFO:tasks.workunit.client.1.smithi196.stderr:configure.in:45: warning: The macro `AC_FUNC_SETVBUF_REVERSED' is obsolete. Remove it and all references to SETVBUF_REVERSED. 2024-03-23T23:44:54.849 INFO:tasks.workunit.client.1.smithi196.stderr:./lib/autoconf/functions.m4:1766: AC_FUNC_SETVBUF_REVERSED is expanded from... 2024-03-23T23:44:54.849 INFO:tasks.workunit.client.1.smithi196.stderr:configure.in:45: the top level 2024-03-23T23:44:54.849 INFO:tasks.workunit.client.1.smithi196.stderr:configure.in:50: warning: AC_OUTPUT should be used without arguments. 2024-03-23T23:44:54.849 INFO:tasks.workunit.client.1.smithi196.stderr:configure.in:50: You should run autoupdate. 2024-03-23T23:44:54.855 INFO:tasks.workunit.client.0.smithi008.stdout:/bin/bash ./config.status --recheck 2024-03-23T23:44:54.911 INFO:tasks.workunit.client.1.smithi196.stdout:/bin/bash ./config.status --recheck 2024-03-23T23:44:54.988 INFO:tasks.workunit.client.0.smithi008.stdout:running CONFIG_SHELL=/bin/bash /bin/bash ./configure --no-create --no-recursion 2024-03-23T23:44:55.053 INFO:tasks.workunit.client.1.smithi196.stdout:running CONFIG_SHELL=/bin/bash /bin/bash ./configure --no-create --no-recursion 2024-03-23T23:44:55.206 INFO:tasks.workunit.client.0.smithi008.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-03-23T23:44:56.221 INFO:tasks.workunit.client.0.smithi008.stdout:checking whether build environment is sane... yes 2024-03-23T23:44:56.236 INFO:tasks.workunit.client.0.smithi008.stdout:checking for a race-free mkdir -p... /usr/bin/mkdir -p 2024-03-23T23:44:56.236 INFO:tasks.workunit.client.0.smithi008.stdout:checking for gawk... gawk 2024-03-23T23:44:56.259 INFO:tasks.workunit.client.0.smithi008.stdout:checking whether make sets $(MAKE)... yes 2024-03-23T23:44:56.331 INFO:tasks.workunit.client.0.smithi008.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-03-23T23:44:56.331 INFO:tasks.workunit.client.0.smithi008.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-03-23T23:44:56.348 INFO:tasks.workunit.client.0.smithi008.stdout:checking for style of include used by make... GNU 2024-03-23T23:44:56.359 INFO:tasks.workunit.client.0.smithi008.stdout:checking for gcc... gcc 2024-03-23T23:44:56.533 INFO:tasks.workunit.client.0.smithi008.stdout:checking whether the C compiler works... yes 2024-03-23T23:44:56.533 INFO:tasks.workunit.client.0.smithi008.stdout:checking for C compiler default output file name... a.out 2024-03-23T23:44:56.598 INFO:tasks.workunit.client.0.smithi008.stdout:checking for suffix of executables... 2024-03-23T23:44:56.667 INFO:tasks.workunit.client.0.smithi008.stdout:checking whether we are cross compiling... no 2024-03-23T23:44:56.724 INFO:tasks.workunit.client.0.smithi008.stdout:checking for suffix of object files... o 2024-03-23T23:44:56.777 INFO:tasks.workunit.client.0.smithi008.stdout:checking whether the compiler supports GNU C... yes 2024-03-23T23:44:56.838 INFO:tasks.workunit.client.0.smithi008.stdout:checking whether gcc accepts -g... yes 2024-03-23T23:44:56.919 INFO:tasks.workunit.client.0.smithi008.stdout:checking for gcc option to enable C11 features... none needed 2024-03-23T23:44:57.093 INFO:tasks.workunit.client.0.smithi008.stdout:checking dependency style of gcc... gcc3 2024-03-23T23:44:57.141 INFO:tasks.workunit.client.0.smithi008.stdout:checking for stdio.h... yes 2024-03-23T23:44:57.197 INFO:tasks.workunit.client.0.smithi008.stdout:checking for stdlib.h... yes 2024-03-23T23:44:57.255 INFO:tasks.workunit.client.0.smithi008.stdout:checking for string.h... yes 2024-03-23T23:44:57.316 INFO:tasks.workunit.client.0.smithi008.stdout:checking for inttypes.h... yes 2024-03-23T23:44:57.374 INFO:tasks.workunit.client.0.smithi008.stdout:checking for stdint.h... yes 2024-03-23T23:44:57.434 INFO:tasks.workunit.client.0.smithi008.stdout:checking for strings.h... yes 2024-03-23T23:44:57.495 INFO:tasks.workunit.client.0.smithi008.stdout:checking for sys/stat.h... yes 2024-03-23T23:44:57.557 INFO:tasks.workunit.client.0.smithi008.stdout:checking for sys/types.h... yes 2024-03-23T23:44:57.620 INFO:tasks.workunit.client.0.smithi008.stdout:checking for unistd.h... yes 2024-03-23T23:44:57.697 INFO:tasks.workunit.client.0.smithi008.stdout:checking for wchar.h... yes 2024-03-23T23:44:57.772 INFO:tasks.workunit.client.0.smithi008.stdout:checking for minix/config.h... no 2024-03-23T23:44:57.836 INFO:tasks.workunit.client.0.smithi008.stdout:checking for sys/time.h... yes 2024-03-23T23:44:57.911 INFO:tasks.workunit.client.0.smithi008.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-03-23T23:44:57.969 INFO:tasks.workunit.client.0.smithi008.stdout:checking whether _XOPEN_SOURCE should be defined... no 2024-03-23T23:44:57.971 INFO:tasks.workunit.client.0.smithi008.stdout:checking for gcc... (cached) gcc 2024-03-23T23:44:58.084 INFO:tasks.workunit.client.0.smithi008.stdout:checking whether the compiler supports GNU C... (cached) yes 2024-03-23T23:44:58.084 INFO:tasks.workunit.client.0.smithi008.stdout:checking whether gcc accepts -g... (cached) yes 2024-03-23T23:44:58.084 INFO:tasks.workunit.client.0.smithi008.stdout:checking for gcc option to enable C11 features... (cached) none needed 2024-03-23T23:44:58.085 INFO:tasks.workunit.client.0.smithi008.stdout:checking dependency style of gcc... (cached) gcc3 2024-03-23T23:44:58.170 INFO:tasks.workunit.client.0.smithi008.stdout:checking for main in -lm... yes 2024-03-23T23:44:58.254 INFO:tasks.workunit.client.0.smithi008.stdout:checking for main in -lpthread... yes 2024-03-23T23:44:58.258 INFO:tasks.workunit.client.0.smithi008.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-03-23T23:44:58.260 INFO:tasks.workunit.client.0.smithi008.stdout:checking for egrep... /usr/bin/grep -E 2024-03-23T23:44:58.328 INFO:tasks.workunit.client.0.smithi008.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-03-23T23:44:58.417 INFO:tasks.workunit.client.0.smithi008.stdout:checking for pthread.h... yes 2024-03-23T23:44:58.486 INFO:tasks.workunit.client.0.smithi008.stdout:checking for fcntl.h... yes 2024-03-23T23:44:58.551 INFO:tasks.workunit.client.0.smithi008.stdout:checking for limits.h... yes 2024-03-23T23:44:58.552 INFO:tasks.workunit.client.0.smithi008.stdout:checking for stdint.h... (cached) yes 2024-03-23T23:44:58.552 INFO:tasks.workunit.client.0.smithi008.stdout:checking for sys/time.h... (cached) yes 2024-03-23T23:44:58.552 INFO:tasks.workunit.client.0.smithi008.stdout:checking for unistd.h... (cached) yes 2024-03-23T23:44:58.617 INFO:tasks.workunit.client.0.smithi008.stdout:checking for sys/vfs.h... yes 2024-03-23T23:44:58.690 INFO:tasks.workunit.client.0.smithi008.stdout:checking for sys/limits.h... no 2024-03-23T23:44:58.744 INFO:tasks.workunit.client.0.smithi008.stdout:checking for an ANSI C-conforming const... yes 2024-03-23T23:44:58.838 INFO:tasks.workunit.client.0.smithi008.stdout:checking for system... yes 2024-03-23T23:44:58.922 INFO:tasks.workunit.client.0.smithi008.stdout:checking for gettimeofday... yes 2024-03-23T23:44:59.007 INFO:tasks.workunit.client.0.smithi008.stdout:checking for mkdir... yes 2024-03-23T23:44:59.089 INFO:tasks.workunit.client.0.smithi008.stdout:checking for strerror... yes 2024-03-23T23:44:59.175 INFO:tasks.workunit.client.0.smithi008.stdout:checking for open64... yes 2024-03-23T23:44:59.261 INFO:tasks.workunit.client.0.smithi008.stdout:checking for stat64... yes 2024-03-23T23:44:59.349 INFO:tasks.workunit.client.0.smithi008.stdout:checking for fseeko64... yes 2024-03-23T23:44:59.437 INFO:tasks.workunit.client.0.smithi008.stdout:checking for lrand48_r... yes 2024-03-23T23:44:59.538 INFO:tasks.workunit.client.0.smithi008.stdout:checking for srand48_r... yes 2024-03-23T23:44:59.569 INFO:tasks.workunit.client.0.smithi008.stdout:configure: creating ./config.status 2024-03-23T23:44:59.708 INFO:tasks.workunit.client.0.smithi008.stdout: /bin/bash ./config.status 2024-03-23T23:44:59.816 INFO:tasks.workunit.client.0.smithi008.stdout:config.status: creating Makefile 2024-03-23T23:44:59.848 INFO:tasks.workunit.client.0.smithi008.stdout:config.status: creating config.h 2024-03-23T23:44:59.884 INFO:tasks.workunit.client.0.smithi008.stdout:config.status: executing depfiles commands 2024-03-23T23:44:59.913 INFO:tasks.workunit.client.0.smithi008.stdout:config.status: executing default commands 2024-03-23T23:44:59.948 INFO:tasks.workunit.client.0.smithi008.stdout:cd . && /bin/bash /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoheader 2024-03-23T23:45:00.012 INFO:tasks.workunit.client.0.smithi008.stderr:autoheader: warning: autoconf input should be named 'configure.ac', not 'configure.in' 2024-03-23T23:45:00.103 INFO:tasks.workunit.client.0.smithi008.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-03-23T23:45:00.103 INFO:tasks.workunit.client.0.smithi008.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-03-23T23:45:00.103 INFO:tasks.workunit.client.0.smithi008.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-03-23T23:45:00.104 INFO:tasks.workunit.client.0.smithi008.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-03-23T23:45:00.231 INFO:tasks.workunit.client.0.smithi008.stdout:rm -f stamp-h1 2024-03-23T23:45:00.237 INFO:tasks.workunit.client.0.smithi008.stdout:touch config.h.in 2024-03-23T23:45:00.243 INFO:tasks.workunit.client.0.smithi008.stdout:cd . && /bin/bash ./config.status config.h 2024-03-23T23:45:00.333 INFO:tasks.workunit.client.0.smithi008.stdout:config.status: creating config.h 2024-03-23T23:45:00.383 INFO:tasks.workunit.client.0.smithi008.stdout:make all-am 2024-03-23T23:45:00.390 INFO:tasks.workunit.client.0.smithi008.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-03-23T23:45:00.391 INFO:tasks.workunit.client.0.smithi008.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-03-23T23:45:00.570 INFO:tasks.workunit.client.0.smithi008.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-03-23T23:45:00.580 INFO:tasks.workunit.client.0.smithi008.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-03-23T23:45:00.698 INFO:tasks.workunit.client.0.smithi008.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-03-23T23:45:00.709 INFO:tasks.workunit.client.0.smithi008.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-03-23T23:45:00.835 INFO:tasks.workunit.client.0.smithi008.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-03-23T23:45:00.844 INFO:tasks.workunit.client.0.smithi008.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-03-23T23:45:00.985 INFO:tasks.workunit.client.0.smithi008.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-03-23T23:45:01.090 INFO:tasks.workunit.client.0.smithi008.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-03-23T23:45:01.274 INFO:tasks.workunit.client.0.smithi008.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-03-23T23:45:01.284 INFO:tasks.workunit.client.0.smithi008.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-03-23T23:45:01.369 INFO:tasks.workunit.client.0.smithi008.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-03-23T23:45:01.378 INFO:tasks.workunit.client.0.smithi008.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-03-23T23:45:01.443 INFO:tasks.workunit.client.0.smithi008.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-03-23T23:45:01.452 INFO:tasks.workunit.client.0.smithi008.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-03-23T23:45:01.527 INFO:tasks.workunit.client.0.smithi008.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-03-23T23:45:01.536 INFO:tasks.workunit.client.0.smithi008.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-03-23T23:45:01.768 INFO:tasks.workunit.client.0.smithi008.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-03-23T23:45:01.778 INFO:tasks.workunit.client.0.smithi008.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-03-23T23:45:01.985 INFO:tasks.workunit.client.0.smithi008.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-03-23T23:45:01.994 INFO:tasks.workunit.client.0.smithi008.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-03-23T23:45:02.208 INFO:tasks.workunit.client.0.smithi008.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-03-23T23:45:02.216 INFO:tasks.workunit.client.0.smithi008.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-03-23T23:45:02.321 INFO:tasks.workunit.client.0.smithi008.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-03-23T23:45:02.330 INFO:tasks.workunit.client.0.smithi008.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-03-23T23:45:02.383 INFO:tasks.workunit.client.0.smithi008.stderr:ffsb_op.c: In function 'print_op_results': 2024-03-23T23:45:02.383 INFO:tasks.workunit.client.0.smithi008.stderr:ffsb_op.c:83:37: warning: embedded '\0' in format [-Wformat-contains-nul] 2024-03-23T23:45:02.383 INFO:tasks.workunit.client.0.smithi008.stderr: 83 | sprintf(buf, "%s/sec\0", buf); 2024-03-23T23:45:02.383 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~ 2024-03-23T23:45:02.383 INFO:tasks.workunit.client.0.smithi008.stderr:ffsb_op.c:86:33: warning: embedded '\0' in format [-Wformat-contains-nul] 2024-03-23T23:45:02.383 INFO:tasks.workunit.client.0.smithi008.stderr: 86 | sprintf(buf, "NA\0"); 2024-03-23T23:45:02.383 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~ 2024-03-23T23:45:02.399 INFO:tasks.workunit.client.0.smithi008.stderr:ffsb_op.c: In function 'print_results': 2024-03-23T23:45:02.399 INFO:tasks.workunit.client.0.smithi008.stderr:ffsb_op.c:83:33: warning: '/sec' directive writing 4 bytes into a region of size between 1 and 256 [-Wformat-overflow=] 2024-03-23T23:45:02.399 INFO:tasks.workunit.client.0.smithi008.stderr: 83 | sprintf(buf, "%s/sec\0", buf); 2024-03-23T23:45:02.399 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~ 2024-03-23T23:45:02.399 INFO:tasks.workunit.client.0.smithi008.stderr:In file included from /usr/include/stdio.h:894, 2024-03-23T23:45:02.400 INFO:tasks.workunit.client.0.smithi008.stderr: from ffsb_op.c:20: 2024-03-23T23:45:02.400 INFO:tasks.workunit.client.0.smithi008.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 5 and 260 bytes into a destination of size 256 2024-03-23T23:45:02.400 INFO:tasks.workunit.client.0.smithi008.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-03-23T23:45:02.400 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-23T23:45:02.400 INFO:tasks.workunit.client.0.smithi008.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-03-23T23:45:02.400 INFO:tasks.workunit.client.0.smithi008.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-23T23:45:02.400 INFO:tasks.workunit.client.0.smithi008.stderr: 40 | __va_arg_pack ()); 2024-03-23T23:45:02.400 INFO:tasks.workunit.client.0.smithi008.stderr: | ~~~~~~~~~~~~~~~~~ 2024-03-23T23:45:02.441 INFO:tasks.workunit.client.0.smithi008.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-03-23T23:45:02.451 INFO:tasks.workunit.client.0.smithi008.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-03-23T23:45:02.603 INFO:tasks.workunit.client.0.smithi008.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-03-23T23:45:02.612 INFO:tasks.workunit.client.0.smithi008.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-03-23T23:45:02.669 INFO:tasks.workunit.client.0.smithi008.stderr:In file included from parser.h:22, 2024-03-23T23:45:02.670 INFO:tasks.workunit.client.0.smithi008.stderr: from parser.c:25: 2024-03-23T23:45:02.670 INFO:tasks.workunit.client.0.smithi008.stderr:parser.c: In function 'init_filesys': 2024-03-23T23:45:02.670 INFO:tasks.workunit.client.0.smithi008.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-03-23T23:45:02.670 INFO:tasks.workunit.client.0.smithi008.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-03-23T23:45:02.670 INFO:tasks.workunit.client.0.smithi008.stderr: | ^ 2024-03-23T23:45:02.670 INFO:tasks.workunit.client.0.smithi008.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-03-23T23:45:02.670 INFO:tasks.workunit.client.0.smithi008.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-03-23T23:45:02.670 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~ 2024-03-23T23:45:02.670 INFO:tasks.workunit.client.0.smithi008.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-03-23T23:45:02.670 INFO:tasks.workunit.client.0.smithi008.stderr: 36 | container_of(ptr, type, member) 2024-03-23T23:45:02.671 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~~~~~ 2024-03-23T23:45:02.671 INFO:tasks.workunit.client.0.smithi008.stderr:list.h:39:20: note: in expansion of macro 'list_entry' 2024-03-23T23:45:02.671 INFO:tasks.workunit.client.0.smithi008.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-03-23T23:45:02.671 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~~~ 2024-03-23T23:45:02.671 INFO:tasks.workunit.client.0.smithi008.stderr:parser.c:934:17: note: in expansion of macro 'list_for_each_entry' 2024-03-23T23:45:02.671 INFO:tasks.workunit.client.0.smithi008.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-03-23T23:45:02.671 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-03-23T23:45:02.671 INFO:tasks.workunit.client.0.smithi008.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-03-23T23:45:02.671 INFO:tasks.workunit.client.0.smithi008.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-03-23T23:45:02.671 INFO:tasks.workunit.client.0.smithi008.stderr: | ^ 2024-03-23T23:45:02.671 INFO:tasks.workunit.client.0.smithi008.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-03-23T23:45:02.671 INFO:tasks.workunit.client.0.smithi008.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-03-23T23:45:02.671 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~ 2024-03-23T23:45:02.671 INFO:tasks.workunit.client.0.smithi008.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-03-23T23:45:02.672 INFO:tasks.workunit.client.0.smithi008.stderr: 36 | container_of(ptr, type, member) 2024-03-23T23:45:02.672 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~~~~~ 2024-03-23T23:45:02.672 INFO:tasks.workunit.client.0.smithi008.stderr:list.h:41:20: note: in expansion of macro 'list_entry' 2024-03-23T23:45:02.672 INFO:tasks.workunit.client.0.smithi008.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-03-23T23:45:02.672 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~~~ 2024-03-23T23:45:02.672 INFO:tasks.workunit.client.0.smithi008.stderr:parser.c:934:17: note: in expansion of macro 'list_for_each_entry' 2024-03-23T23:45:02.672 INFO:tasks.workunit.client.0.smithi008.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-03-23T23:45:02.672 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-03-23T23:45:02.672 INFO:tasks.workunit.client.0.smithi008.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-03-23T23:45:02.672 INFO:tasks.workunit.client.0.smithi008.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-03-23T23:45:02.672 INFO:tasks.workunit.client.0.smithi008.stderr: | ^ 2024-03-23T23:45:02.672 INFO:tasks.workunit.client.0.smithi008.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-03-23T23:45:02.672 INFO:tasks.workunit.client.0.smithi008.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-03-23T23:45:02.672 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~ 2024-03-23T23:45:02.673 INFO:tasks.workunit.client.0.smithi008.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-03-23T23:45:02.673 INFO:tasks.workunit.client.0.smithi008.stderr: 36 | container_of(ptr, type, member) 2024-03-23T23:45:02.673 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~~~~~ 2024-03-23T23:45:02.673 INFO:tasks.workunit.client.0.smithi008.stderr:list.h:39:20: note: in expansion of macro 'list_entry' 2024-03-23T23:45:02.673 INFO:tasks.workunit.client.0.smithi008.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-03-23T23:45:02.673 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~~~ 2024-03-23T23:45:02.673 INFO:tasks.workunit.client.0.smithi008.stderr:parser.c:941:17: note: in expansion of macro 'list_for_each_entry' 2024-03-23T23:45:02.673 INFO:tasks.workunit.client.0.smithi008.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-03-23T23:45:02.673 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-03-23T23:45:02.673 INFO:tasks.workunit.client.0.smithi008.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-03-23T23:45:02.673 INFO:tasks.workunit.client.0.smithi008.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-03-23T23:45:02.673 INFO:tasks.workunit.client.0.smithi008.stderr: | ^ 2024-03-23T23:45:02.673 INFO:tasks.workunit.client.0.smithi008.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-03-23T23:45:02.673 INFO:tasks.workunit.client.0.smithi008.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-03-23T23:45:02.674 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~ 2024-03-23T23:45:02.674 INFO:tasks.workunit.client.0.smithi008.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-03-23T23:45:02.674 INFO:tasks.workunit.client.0.smithi008.stderr: 36 | container_of(ptr, type, member) 2024-03-23T23:45:02.674 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~~~~~ 2024-03-23T23:45:02.674 INFO:tasks.workunit.client.0.smithi008.stderr:list.h:41:20: note: in expansion of macro 'list_entry' 2024-03-23T23:45:02.674 INFO:tasks.workunit.client.0.smithi008.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-03-23T23:45:02.674 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~~~ 2024-03-23T23:45:02.674 INFO:tasks.workunit.client.0.smithi008.stderr:parser.c:941:17: note: in expansion of macro 'list_for_each_entry' 2024-03-23T23:45:02.674 INFO:tasks.workunit.client.0.smithi008.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-03-23T23:45:02.674 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-03-23T23:45:02.674 INFO:tasks.workunit.client.0.smithi008.stderr:parser.c: In function 'init_tg_stats': 2024-03-23T23:45:02.674 INFO:tasks.workunit.client.0.smithi008.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-03-23T23:45:02.674 INFO:tasks.workunit.client.0.smithi008.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-03-23T23:45:02.675 INFO:tasks.workunit.client.0.smithi008.stderr: | ^ 2024-03-23T23:45:02.675 INFO:tasks.workunit.client.0.smithi008.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-03-23T23:45:02.675 INFO:tasks.workunit.client.0.smithi008.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-03-23T23:45:02.675 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~ 2024-03-23T23:45:02.675 INFO:tasks.workunit.client.0.smithi008.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-03-23T23:45:02.675 INFO:tasks.workunit.client.0.smithi008.stderr: 36 | container_of(ptr, type, member) 2024-03-23T23:45:02.675 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~~~~~ 2024-03-23T23:45:02.675 INFO:tasks.workunit.client.0.smithi008.stderr:list.h:39:20: note: in expansion of macro 'list_entry' 2024-03-23T23:45:02.675 INFO:tasks.workunit.client.0.smithi008.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-03-23T23:45:02.675 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~~~ 2024-03-23T23:45:02.675 INFO:tasks.workunit.client.0.smithi008.stderr:parser.c:971:41: note: in expansion of macro 'list_for_each_entry' 2024-03-23T23:45:02.675 INFO:tasks.workunit.client.0.smithi008.stderr: 971 | list_for_each_entry(tmp_list, 2024-03-23T23:45:02.675 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-03-23T23:45:02.675 INFO:tasks.workunit.client.0.smithi008.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-03-23T23:45:02.676 INFO:tasks.workunit.client.0.smithi008.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-03-23T23:45:02.676 INFO:tasks.workunit.client.0.smithi008.stderr: | ^ 2024-03-23T23:45:02.676 INFO:tasks.workunit.client.0.smithi008.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-03-23T23:45:02.676 INFO:tasks.workunit.client.0.smithi008.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-03-23T23:45:02.676 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~ 2024-03-23T23:45:02.676 INFO:tasks.workunit.client.0.smithi008.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-03-23T23:45:02.676 INFO:tasks.workunit.client.0.smithi008.stderr: 36 | container_of(ptr, type, member) 2024-03-23T23:45:02.676 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~~~~~ 2024-03-23T23:45:02.676 INFO:tasks.workunit.client.0.smithi008.stderr:list.h:41:20: note: in expansion of macro 'list_entry' 2024-03-23T23:45:02.676 INFO:tasks.workunit.client.0.smithi008.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-03-23T23:45:02.676 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~~~ 2024-03-23T23:45:02.676 INFO:tasks.workunit.client.0.smithi008.stderr:parser.c:971:41: note: in expansion of macro 'list_for_each_entry' 2024-03-23T23:45:02.676 INFO:tasks.workunit.client.0.smithi008.stderr: 971 | list_for_each_entry(tmp_list, 2024-03-23T23:45:02.677 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-03-23T23:45:02.677 INFO:tasks.workunit.client.0.smithi008.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-03-23T23:45:02.677 INFO:tasks.workunit.client.0.smithi008.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-03-23T23:45:02.677 INFO:tasks.workunit.client.0.smithi008.stderr: | ^ 2024-03-23T23:45:02.677 INFO:tasks.workunit.client.0.smithi008.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-03-23T23:45:02.677 INFO:tasks.workunit.client.0.smithi008.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-03-23T23:45:02.677 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~ 2024-03-23T23:45:02.677 INFO:tasks.workunit.client.0.smithi008.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-03-23T23:45:02.677 INFO:tasks.workunit.client.0.smithi008.stderr: 36 | container_of(ptr, type, member) 2024-03-23T23:45:02.677 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~~~~~ 2024-03-23T23:45:02.677 INFO:tasks.workunit.client.0.smithi008.stderr:list.h:39:20: note: in expansion of macro 'list_entry' 2024-03-23T23:45:02.677 INFO:tasks.workunit.client.0.smithi008.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-03-23T23:45:02.677 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~~~ 2024-03-23T23:45:02.677 INFO:tasks.workunit.client.0.smithi008.stderr:parser.c:980:41: note: in expansion of macro 'list_for_each_entry' 2024-03-23T23:45:02.677 INFO:tasks.workunit.client.0.smithi008.stderr: 980 | list_for_each_entry(tmp_list, 2024-03-23T23:45:02.678 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-03-23T23:45:02.678 INFO:tasks.workunit.client.0.smithi008.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-03-23T23:45:02.678 INFO:tasks.workunit.client.0.smithi008.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-03-23T23:45:02.678 INFO:tasks.workunit.client.0.smithi008.stderr: | ^ 2024-03-23T23:45:02.678 INFO:tasks.workunit.client.0.smithi008.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-03-23T23:45:02.678 INFO:tasks.workunit.client.0.smithi008.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-03-23T23:45:02.678 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~ 2024-03-23T23:45:02.678 INFO:tasks.workunit.client.0.smithi008.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-03-23T23:45:02.678 INFO:tasks.workunit.client.0.smithi008.stderr: 36 | container_of(ptr, type, member) 2024-03-23T23:45:02.678 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~~~~~ 2024-03-23T23:45:02.678 INFO:tasks.workunit.client.0.smithi008.stderr:list.h:41:20: note: in expansion of macro 'list_entry' 2024-03-23T23:45:02.678 INFO:tasks.workunit.client.0.smithi008.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-03-23T23:45:02.678 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~~~ 2024-03-23T23:45:02.679 INFO:tasks.workunit.client.0.smithi008.stderr:parser.c:980:41: note: in expansion of macro 'list_for_each_entry' 2024-03-23T23:45:02.679 INFO:tasks.workunit.client.0.smithi008.stderr: 980 | list_for_each_entry(tmp_list, 2024-03-23T23:45:02.679 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-03-23T23:45:02.720 INFO:tasks.workunit.client.0.smithi008.stderr:parser.c: In function 'get_optstr': 2024-03-23T23:45:02.721 INFO:tasks.workunit.client.0.smithi008.stderr:parser.c:206:23: warning: 'strnlen' specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-03-23T23:45:02.721 INFO:tasks.workunit.client.0.smithi008.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-03-23T23:45:02.721 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-03-23T23:45:02.721 INFO:tasks.workunit.client.0.smithi008.stderr:parser.c:200:14: note: source object declared here 2024-03-23T23:45:02.721 INFO:tasks.workunit.client.0.smithi008.stderr: 200 | char temp[BUFSIZE]; 2024-03-23T23:45:02.721 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~ 2024-03-23T23:45:02.737 INFO:tasks.workunit.client.0.smithi008.stderr:In file included from /usr/include/string.h:535, 2024-03-23T23:45:02.737 INFO:tasks.workunit.client.0.smithi008.stderr: from parser.c:19: 2024-03-23T23:45:02.737 INFO:tasks.workunit.client.0.smithi008.stderr:In function 'memcpy', 2024-03-23T23:45:02.737 INFO:tasks.workunit.client.0.smithi008.stderr: inlined from 'size64_convert' at parser.c:119:2: 2024-03-23T23:45:02.737 INFO:tasks.workunit.client.0.smithi008.stderr:/usr/include/x86_64-linux-gnu/bits/string_fortified.h:29:10: warning: '__builtin_memcpy' reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-03-23T23:45:02.737 INFO:tasks.workunit.client.0.smithi008.stderr: 29 | return __builtin___memcpy_chk (__dest, __src, __len, 2024-03-23T23:45:02.737 INFO:tasks.workunit.client.0.smithi008.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-23T23:45:02.737 INFO:tasks.workunit.client.0.smithi008.stderr: 30 | __glibc_objsize0 (__dest)); 2024-03-23T23:45:02.738 INFO:tasks.workunit.client.0.smithi008.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-23T23:45:03.046 INFO:tasks.workunit.client.0.smithi008.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-03-23T23:45:03.055 INFO:tasks.workunit.client.0.smithi008.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-03-23T23:45:03.147 INFO:tasks.workunit.client.0.smithi008.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-03-23T23:45:03.156 INFO:tasks.workunit.client.0.smithi008.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-03-23T23:45:03.279 INFO:tasks.workunit.client.0.smithi008.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-03-23T23:45:03.288 INFO:tasks.workunit.client.0.smithi008.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-03-23T23:45:03.335 INFO:tasks.workunit.client.0.smithi008.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-03-23T23:45:03.346 INFO:tasks.workunit.client.0.smithi008.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-03-23T23:45:03.414 INFO:tasks.workunit.client.0.smithi008.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-03-23T23:45:03.414 INFO:tasks.workunit.client.0.smithi008.stderr:+ cd .. 2024-03-23T23:45:03.415 INFO:tasks.workunit.client.0.smithi008.stderr:+ mkdir tmp 2024-03-23T23:45:03.418 INFO:tasks.workunit.client.0.smithi008.stderr:+ cd tmp 2024-03-23T23:45:03.418 INFO:tasks.workunit.client.0.smithi008.stderr:+ for f in $mydir/*.ffsb 2024-03-23T23:45:03.418 INFO:tasks.workunit.client.0.smithi008.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/random_write.32.ffsb 2024-03-23T23:45:03.420 INFO:tasks.workunit.client.0.smithi008.stdout:FFSB version 6.0-RC2 started 2024-03-23T23:45:03.420 INFO:tasks.workunit.client.0.smithi008.stdout: 2024-03-23T23:45:03.425 INFO:tasks.workunit.client.0.smithi008.stdout:benchmark time = 300 2024-03-23T23:45:03.426 INFO:tasks.workunit.client.0.smithi008.stdout:ThreadGroup 0 2024-03-23T23:45:03.426 INFO:tasks.workunit.client.0.smithi008.stdout:================ 2024-03-23T23:45:03.426 INFO:tasks.workunit.client.0.smithi008.stdout: num_threads = 32 2024-03-23T23:45:03.426 INFO:tasks.workunit.client.0.smithi008.stdout: 2024-03-23T23:45:03.426 INFO:tasks.workunit.client.0.smithi008.stdout: read_random = off 2024-03-23T23:45:03.426 INFO:tasks.workunit.client.0.smithi008.stdout: read_size = 0 (0B) 2024-03-23T23:45:03.426 INFO:tasks.workunit.client.0.smithi008.stdout: read_blocksize = 0 (0B) 2024-03-23T23:45:03.426 INFO:tasks.workunit.client.0.smithi008.stdout: read_skip = off 2024-03-23T23:45:03.426 INFO:tasks.workunit.client.0.smithi008.stdout: read_skipsize = 0 (0B) 2024-03-23T23:45:03.426 INFO:tasks.workunit.client.0.smithi008.stdout: 2024-03-23T23:45:03.426 INFO:tasks.workunit.client.0.smithi008.stdout: write_random = on 2024-03-23T23:45:03.426 INFO:tasks.workunit.client.0.smithi008.stdout: write_size = 5242880 (5MB) 2024-03-23T23:45:03.427 INFO:tasks.workunit.client.0.smithi008.stdout: fsync_file = 0 2024-03-23T23:45:03.427 INFO:tasks.workunit.client.0.smithi008.stdout: write_blocksize = 4096 (4KB) 2024-03-23T23:45:03.427 INFO:tasks.workunit.client.0.smithi008.stdout: wait time = 0 2024-03-23T23:45:03.427 INFO:tasks.workunit.client.0.smithi008.stdout: 2024-03-23T23:45:03.427 INFO:tasks.workunit.client.0.smithi008.stdout: op weights 2024-03-23T23:45:03.427 INFO:tasks.workunit.client.0.smithi008.stdout: read = 0 (0.00%) 2024-03-23T23:45:03.427 INFO:tasks.workunit.client.0.smithi008.stdout: readall = 0 (0.00%) 2024-03-23T23:45:03.427 INFO:tasks.workunit.client.0.smithi008.stdout: write = 1 (100.00%) 2024-03-23T23:45:03.427 INFO:tasks.workunit.client.0.smithi008.stdout: create = 0 (0.00%) 2024-03-23T23:45:03.427 INFO:tasks.workunit.client.0.smithi008.stdout: append = 0 (0.00%) 2024-03-23T23:45:03.427 INFO:tasks.workunit.client.0.smithi008.stdout: delete = 0 (0.00%) 2024-03-23T23:45:03.427 INFO:tasks.workunit.client.0.smithi008.stdout: metaop = 0 (0.00%) 2024-03-23T23:45:03.427 INFO:tasks.workunit.client.0.smithi008.stdout: createdir = 0 (0.00%) 2024-03-23T23:45:03.427 INFO:tasks.workunit.client.0.smithi008.stdout: stat = 0 (0.00%) 2024-03-23T23:45:03.428 INFO:tasks.workunit.client.0.smithi008.stdout: writeall = 0 (0.00%) 2024-03-23T23:45:03.428 INFO:tasks.workunit.client.0.smithi008.stdout: writeall_fsync = 0 (0.00%) 2024-03-23T23:45:03.428 INFO:tasks.workunit.client.0.smithi008.stdout: open_close = 0 (0.00%) 2024-03-23T23:45:03.428 INFO:tasks.workunit.client.0.smithi008.stdout: write_fsync = 0 (0.00%) 2024-03-23T23:45:03.428 INFO:tasks.workunit.client.0.smithi008.stdout: create_fsync = 0 (0.00%) 2024-03-23T23:45:03.428 INFO:tasks.workunit.client.0.smithi008.stdout: append_fsync = 0 (0.00%) 2024-03-23T23:45:03.428 INFO:tasks.workunit.client.0.smithi008.stdout: 2024-03-23T23:45:03.428 INFO:tasks.workunit.client.0.smithi008.stdout:FileSystem . 2024-03-23T23:45:03.428 INFO:tasks.workunit.client.0.smithi008.stdout:========== 2024-03-23T23:45:03.428 INFO:tasks.workunit.client.0.smithi008.stdout: num_dirs = 0 2024-03-23T23:45:03.428 INFO:tasks.workunit.client.0.smithi008.stdout: starting files = 128 2024-03-23T23:45:03.428 INFO:tasks.workunit.client.0.smithi008.stdout: 2024-03-23T23:45:03.428 INFO:tasks.workunit.client.0.smithi008.stdout: min file size = 104857600 (100MB) 2024-03-23T23:45:03.428 INFO:tasks.workunit.client.0.smithi008.stdout: max file size = 104857600 (100MB) 2024-03-23T23:45:03.429 INFO:tasks.workunit.client.0.smithi008.stdout: directio = off 2024-03-23T23:45:03.429 INFO:tasks.workunit.client.0.smithi008.stdout: alignedio = on 2024-03-23T23:45:03.429 INFO:tasks.workunit.client.0.smithi008.stdout: bufferedio = off 2024-03-23T23:45:03.429 INFO:tasks.workunit.client.0.smithi008.stdout: 2024-03-23T23:45:03.429 INFO:tasks.workunit.client.0.smithi008.stdout: aging is off 2024-03-23T23:45:03.429 INFO:tasks.workunit.client.0.smithi008.stdout: current utilization = 0.00% 2024-03-23T23:45:03.429 INFO:tasks.workunit.client.0.smithi008.stdout: 2024-03-23T23:45:03.429 INFO:tasks.workunit.client.0.smithi008.stdout:checking existing fs: . 2024-03-23T23:45:03.429 INFO:tasks.workunit.client.0.smithi008.stdout:recreating new fileset 2024-03-23T23:45:03.430 INFO:tasks.workunit.client.0.smithi008.stderr:opendir: No such file or directory 2024-03-23T23:45:09.692 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-03-23T23:45:09.692 INFO:tasks.ceph.mon.c:Sent signal 18 2024-03-23T23:45:09.693 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T23:45:09.693 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:45:09.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:09.919+0000 7f4101000640 1 Processor -- start 2024-03-23T23:45:09.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:09.919+0000 7f4101000640 1 -- start start 2024-03-23T23:45:09.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:09.923+0000 7f4101000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f40fc08bb30 0x7f40fc0ab740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:09.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:09.923+0000 7f4101000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f40fc162f60 0x7f40fc0abc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:09.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:09.923+0000 7f4101000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40fc072fd0 con 0x7f40fc0710f0 2024-03-23T23:45:09.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:09.927+0000 7f40f9e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f40fc0710f0 0x7f40fc15f4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39248/0 (socket says 172.21.15.8:39248) 2024-03-23T23:45:09.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:09.927+0000 7f40f9e00640 1 -- 172.21.15.8:0/581867999 learned_addr learned my addr 172.21.15.8:0/581867999 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:45:09.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:09.927+0000 7f40f1400640 1 --2- 172.21.15.8:0/581867999 >> v2:172.21.15.196:3300/0 conn(0x7f40fc08bb30 0x7f40fc0ab740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:09.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:09.927+0000 7f40fa800640 1 --2- 172.21.15.8:0/581867999 >> v2:172.21.15.8:3300/0 conn(0x7f40fc162f60 0x7f40fc0abc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:09.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:09.927+0000 7f4101000640 1 -- 172.21.15.8:0/581867999 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40fc1634d0 con 0x7f40fc162f60 2024-03-23T23:45:09.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:09.927+0000 7f4101000640 1 -- 172.21.15.8:0/581867999 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40fc0ab2b0 con 0x7f40fc08bb30 2024-03-23T23:45:09.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:09.927+0000 7f40fa800640 1 -- 172.21.15.8:0/581867999 >> v2:172.21.15.8:3300/0 conn(0x7f40fc162f60 msgr2=0x7f40fc0abc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:45:09.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:09.927+0000 7f40fa800640 1 -- 172.21.15.8:0/581867999 >> v2:172.21.15.8:3300/0 conn(0x7f40fc162f60 msgr2=0x7f40fc0abc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:45:09.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:09.927+0000 7f40fa800640 1 --2- 172.21.15.8:0/581867999 >> v2:172.21.15.8:3300/0 conn(0x7f40fc162f60 0x7f40fc0abc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:45:09.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:09.927+0000 7f40fa800640 1 --2- 172.21.15.8:0/581867999 >> v2:172.21.15.8:3300/0 conn(0x7f40fc162f60 0x7f40fc0abc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:45:09.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:09.927+0000 7f40f1400640 1 -- 172.21.15.8:0/581867999 >> v2:172.21.15.196:3300/0 conn(0x7f40fc08bb30 msgr2=0x7f40fc0ab740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:45:09.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:09.927+0000 7f40f1400640 1 -- 172.21.15.8:0/581867999 >> v2:172.21.15.196:3300/0 conn(0x7f40fc08bb30 msgr2=0x7f40fc0ab740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:45:09.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:09.927+0000 7f40f1400640 1 --2- 172.21.15.8:0/581867999 >> v2:172.21.15.196:3300/0 conn(0x7f40fc08bb30 0x7f40fc0ab740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:45:09.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:09.927+0000 7f40f1400640 1 --2- 172.21.15.8:0/581867999 >> v2:172.21.15.196:3300/0 conn(0x7f40fc08bb30 0x7f40fc0ab740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:45:10.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:10.131+0000 7f40fa800640 1 --2- 172.21.15.8:0/581867999 >> v2:172.21.15.8:3300/0 conn(0x7f40fc162f60 0x7f40fc0abc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:10.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:10.131+0000 7f40f1400640 1 --2- 172.21.15.8:0/581867999 >> v2:172.21.15.196:3300/0 conn(0x7f40fc08bb30 0x7f40fc0ab740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:10.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:10.131+0000 7f40fa800640 1 -- 172.21.15.8:0/581867999 >> v2:172.21.15.8:3300/0 conn(0x7f40fc162f60 msgr2=0x7f40fc0abc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:45:10.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:10.131+0000 7f40fa800640 1 -- 172.21.15.8:0/581867999 >> v2:172.21.15.8:3300/0 conn(0x7f40fc162f60 msgr2=0x7f40fc0abc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:45:10.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:10.131+0000 7f40fa800640 1 --2- 172.21.15.8:0/581867999 >> v2:172.21.15.8:3300/0 conn(0x7f40fc162f60 0x7f40fc0abc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:45:10.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:10.131+0000 7f40f1400640 1 -- 172.21.15.8:0/581867999 >> v2:172.21.15.196:3300/0 conn(0x7f40fc08bb30 msgr2=0x7f40fc0ab740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:45:10.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:10.131+0000 7f40f1400640 1 -- 172.21.15.8:0/581867999 >> v2:172.21.15.196:3300/0 conn(0x7f40fc08bb30 msgr2=0x7f40fc0ab740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:45:10.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:10.131+0000 7f40f1400640 1 --2- 172.21.15.8:0/581867999 >> v2:172.21.15.196:3300/0 conn(0x7f40fc08bb30 0x7f40fc0ab740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:45:10.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:10.131+0000 7f40f1400640 1 --2- 172.21.15.8:0/581867999 >> v2:172.21.15.196:3300/0 conn(0x7f40fc08bb30 0x7f40fc0ab740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:45:10.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:10.131+0000 7f40fa800640 1 --2- 172.21.15.8:0/581867999 >> v2:172.21.15.8:3300/0 conn(0x7f40fc162f60 0x7f40fc0abc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:45:10.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:10.535+0000 7f40f1400640 1 --2- 172.21.15.8:0/581867999 >> v2:172.21.15.196:3300/0 conn(0x7f40fc08bb30 0x7f40fc0ab740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:10.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:10.535+0000 7f40fa800640 1 --2- 172.21.15.8:0/581867999 >> v2:172.21.15.8:3300/0 conn(0x7f40fc162f60 0x7f40fc0abc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:10.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:10.535+0000 7f40f1400640 1 -- 172.21.15.8:0/581867999 >> v2:172.21.15.196:3300/0 conn(0x7f40fc08bb30 msgr2=0x7f40fc0ab740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:45:10.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:10.535+0000 7f40f1400640 1 -- 172.21.15.8:0/581867999 >> v2:172.21.15.196:3300/0 conn(0x7f40fc08bb30 msgr2=0x7f40fc0ab740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:45:10.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:10.535+0000 7f40f1400640 1 --2- 172.21.15.8:0/581867999 >> v2:172.21.15.196:3300/0 conn(0x7f40fc08bb30 0x7f40fc0ab740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:45:10.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:10.535+0000 7f40f1400640 1 --2- 172.21.15.8:0/581867999 >> v2:172.21.15.196:3300/0 conn(0x7f40fc08bb30 0x7f40fc0ab740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:45:10.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:10.535+0000 7f40fa800640 1 -- 172.21.15.8:0/581867999 >> v2:172.21.15.8:3300/0 conn(0x7f40fc162f60 msgr2=0x7f40fc0abc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:45:10.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:10.535+0000 7f40fa800640 1 -- 172.21.15.8:0/581867999 >> v2:172.21.15.8:3300/0 conn(0x7f40fc162f60 msgr2=0x7f40fc0abc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:45:10.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:10.535+0000 7f40fa800640 1 --2- 172.21.15.8:0/581867999 >> v2:172.21.15.8:3300/0 conn(0x7f40fc162f60 0x7f40fc0abc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:45:10.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:10.535+0000 7f40fa800640 1 --2- 172.21.15.8:0/581867999 >> v2:172.21.15.8:3300/0 conn(0x7f40fc162f60 0x7f40fc0abc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:45:11.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:11.339+0000 7f40f1400640 1 --2- 172.21.15.8:0/581867999 >> v2:172.21.15.196:3300/0 conn(0x7f40fc08bb30 0x7f40fc0ab740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:11.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:11.339+0000 7f40f1400640 1 -- 172.21.15.8:0/581867999 >> v2:172.21.15.196:3300/0 conn(0x7f40fc08bb30 msgr2=0x7f40fc0ab740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:45:11.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:11.339+0000 7f40f1400640 1 -- 172.21.15.8:0/581867999 >> v2:172.21.15.196:3300/0 conn(0x7f40fc08bb30 msgr2=0x7f40fc0ab740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:45:11.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:11.339+0000 7f40f1400640 1 --2- 172.21.15.8:0/581867999 >> v2:172.21.15.196:3300/0 conn(0x7f40fc08bb30 0x7f40fc0ab740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:45:11.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:11.339+0000 7f40f1400640 1 --2- 172.21.15.8:0/581867999 >> v2:172.21.15.196:3300/0 conn(0x7f40fc08bb30 0x7f40fc0ab740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:45:11.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:11.343+0000 7f40fa800640 1 --2- 172.21.15.8:0/581867999 >> v2:172.21.15.8:3300/0 conn(0x7f40fc162f60 0x7f40fc0abc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:11.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:11.343+0000 7f40fa800640 1 -- 172.21.15.8:0/581867999 >> v2:172.21.15.8:3300/0 conn(0x7f40fc162f60 msgr2=0x7f40fc0abc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:45:11.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:11.343+0000 7f40fa800640 1 -- 172.21.15.8:0/581867999 >> v2:172.21.15.8:3300/0 conn(0x7f40fc162f60 msgr2=0x7f40fc0abc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:45:11.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:11.343+0000 7f40fa800640 1 --2- 172.21.15.8:0/581867999 >> v2:172.21.15.8:3300/0 conn(0x7f40fc162f60 0x7f40fc0abc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:45:11.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:11.343+0000 7f40fa800640 1 --2- 172.21.15.8:0/581867999 >> v2:172.21.15.8:3300/0 conn(0x7f40fc162f60 0x7f40fc0abc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:45:11.453 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:45:11.458 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:45:12.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:12.923+0000 7f40f3e00640 1 -- 172.21.15.8:0/581867999 >> v2:172.21.15.196:3300/0 conn(0x7f40fc08bb30 msgr2=0x7f40fc0ab740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:45:12.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:12.923+0000 7f40f3e00640 1 --2- 172.21.15.8:0/581867999 >> v2:172.21.15.196:3300/0 conn(0x7f40fc08bb30 0x7f40fc0ab740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:12.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:12.923+0000 7f40f3e00640 1 -- 172.21.15.8:0/581867999 >> v2:172.21.15.8:3300/0 conn(0x7f40fc162f60 msgr2=0x7f40fc0abc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:45:12.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:12.923+0000 7f40f3e00640 1 --2- 172.21.15.8:0/581867999 >> v2:172.21.15.8:3300/0 conn(0x7f40fc162f60 0x7f40fc0abc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:12.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:12.923+0000 7f40f3e00640 1 -- 172.21.15.8:0/581867999 >> v1:172.21.15.8:6789/0 conn(0x7f40fc0710f0 legacy=0x7f40fc15f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:12.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:12.923+0000 7f40f3e00640 1 --2- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 0x7f40d8009800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:12.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:12.923+0000 7f40f3e00640 1 -- 172.21.15.8:0/581867999 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40fc0732b0 con 0x7f40d80036f0 2024-03-23T23:45:12.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:12.923+0000 7f40f3e00640 1 -- 172.21.15.8:0/581867999 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc1634d0 con 0x7f40d8007340 2024-03-23T23:45:12.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:12.927+0000 7f40f1400640 1 --2- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 0x7f40d8009800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:12.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:12.927+0000 7f40f1400640 1 -- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 msgr2=0x7f40d8009800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:45:12.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:12.927+0000 7f40f1400640 1 -- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 msgr2=0x7f40d8009800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:45:12.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:12.927+0000 7f40f1400640 1 --2- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 0x7f40d8009800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:45:12.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:12.927+0000 7f40f1400640 1 --2- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 0x7f40d8009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:45:13.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:13.131+0000 7f40f1400640 1 --2- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 0x7f40d8009800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:13.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:13.131+0000 7f40f1400640 1 -- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 msgr2=0x7f40d8009800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:45:13.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:13.131+0000 7f40f1400640 1 -- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 msgr2=0x7f40d8009800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:45:13.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:13.131+0000 7f40f1400640 1 --2- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 0x7f40d8009800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:45:13.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:13.131+0000 7f40f1400640 1 --2- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 0x7f40d8009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:45:13.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:13.535+0000 7f40f1400640 1 --2- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 0x7f40d8009800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:13.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:13.535+0000 7f40f1400640 1 -- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 msgr2=0x7f40d8009800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:45:13.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:13.535+0000 7f40f1400640 1 -- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 msgr2=0x7f40d8009800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:45:13.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:13.535+0000 7f40f1400640 1 --2- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 0x7f40d8009800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:45:13.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:13.535+0000 7f40f1400640 1 --2- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 0x7f40d8009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:45:14.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.343+0000 7f40f1400640 1 --2- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 0x7f40d8009800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:14.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.343+0000 7f40f1400640 1 -- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 msgr2=0x7f40d8009800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:45:14.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.343+0000 7f40f1400640 1 -- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 msgr2=0x7f40d8009800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:45:14.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.343+0000 7f40f1400640 1 --2- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 0x7f40d8009800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:45:14.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.343+0000 7f40f1400640 1 --2- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 0x7f40d8009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:45:14.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.415+0000 7f40f9400640 1 -- 172.21.15.8:0/581867999 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 961182439 0 0) 0x7f40fc0732b0 con 0x7f40d80036f0 2024-03-23T23:45:14.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.415+0000 7f40f9400640 1 -- 172.21.15.8:0/581867999 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40e0003530 con 0x7f40d80036f0 2024-03-23T23:45:14.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.419+0000 7f40f9400640 1 -- 172.21.15.8:0/581867999 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3449590983 0 0) 0x7f40e0003530 con 0x7f40d80036f0 2024-03-23T23:45:14.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.419+0000 7f40f9400640 1 -- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 msgr2=0x7f40d8009800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:45:14.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.419+0000 7f40f9400640 1 --2- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 0x7f40d8009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:14.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.419+0000 7f40f9400640 1 -- 172.21.15.8:0/581867999 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d800aff0 con 0x7f40d80036f0 2024-03-23T23:45:14.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.419+0000 7f40f9400640 1 -- 172.21.15.8:0/581867999 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7f40ec001700 con 0x7f40d80036f0 2024-03-23T23:45:14.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.419+0000 7f40f9400640 1 -- 172.21.15.8:0/581867999 >> v1:172.21.15.196:6789/0 conn(0x7f40d80036f0 legacy=0x7f40d8005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:14.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.419+0000 7f40f9400640 1 --2- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40e0003a30 0x7f40e0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:14.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.419+0000 7f40f9400640 1 --2- 172.21.15.8:0/581867999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e0004810 0x7f40e0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:14.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.419+0000 7f40f9400640 1 --2- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 0x7f40e000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:14.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.419+0000 7f40f9400640 1 -- 172.21.15.8:0/581867999 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc1634d0 con 0x7f40e0004810 2024-03-23T23:45:14.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.419+0000 7f40f9400640 1 -- 172.21.15.8:0/581867999 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e0005610 con 0x7f40e0003a30 2024-03-23T23:45:14.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.419+0000 7f40f9400640 1 -- 172.21.15.8:0/581867999 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e000bf10 con 0x7f40d8007340 2024-03-23T23:45:14.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.419+0000 7f40fa800640 1 -- 172.21.15.8:0/581867999 reap_dead start 2024-03-23T23:45:14.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.423+0000 7f40f1400640 1 --2- 172.21.15.8:0/581867999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e0004810 0x7f40e0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:14.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.423+0000 7f40f9e00640 1 --2- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40e0003a30 0x7f40e0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:14.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.423+0000 7f40fa800640 1 --2- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 0x7f40e000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:14.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.423+0000 7f40f1400640 1 -- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 msgr2=0x7f40e000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:45:14.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.423+0000 7f40f1400640 1 --2- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 0x7f40e000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:14.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.423+0000 7f40f1400640 1 -- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40e0003a30 msgr2=0x7f40e0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:45:14.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.423+0000 7f40f1400640 1 --2- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40e0003a30 0x7f40e0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:14.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.423+0000 7f40f1400640 1 -- 172.21.15.8:0/581867999 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d800aff0 con 0x7f40e0004810 2024-03-23T23:45:14.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.427+0000 7f40f1400640 1 --2- 172.21.15.8:0/581867999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e0004810 0x7f40e0004c90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f40e4012e20 tx=0x7f40e40203b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6081571d14f8b09e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:14.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.427+0000 7f40f9400640 1 -- 172.21.15.8:0/581867999 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e40b4070 con 0x7f40e0004810 2024-03-23T23:45:14.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.427+0000 7f40f9400640 1 -- 172.21.15.8:0/581867999 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e40af600 con 0x7f40e0004810 2024-03-23T23:45:14.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.427+0000 7f40f9400640 1 -- 172.21.15.8:0/581867999 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e4012ad0 con 0x7f40e0004810 2024-03-23T23:45:14.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.427+0000 7f4101000640 1 -- 172.21.15.8:0/581867999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e0004810 msgr2=0x7f40e0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:14.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.427+0000 7f4101000640 1 --2- 172.21.15.8:0/581867999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e0004810 0x7f40e0004c90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f40e4012e20 tx=0x7f40e40203b0 comp rx=0 tx=0).stop 2024-03-23T23:45:14.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.427+0000 7f4101000640 1 -- 172.21.15.8:0/581867999 shutdown_connections 2024-03-23T23:45:14.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.427+0000 7f4101000640 1 --2- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 0x7f40e000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:14.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.427+0000 7f4101000640 1 --2- 172.21.15.8:0/581867999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e0004810 0x7f40e0004c90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:14.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.427+0000 7f4101000640 1 --2- 172.21.15.8:0/581867999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40e0003a30 0x7f40e0003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:14.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.427+0000 7f4101000640 1 -- 172.21.15.8:0/581867999 >> 172.21.15.8:0/581867999 conn(0x7f40fc0c7170 msgr2=0x7f40fc0c7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:45:14.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.427+0000 7f4101000640 1 -- 172.21.15.8:0/581867999 shutdown_connections 2024-03-23T23:45:14.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.431+0000 7f4101000640 1 -- 172.21.15.8:0/581867999 wait complete. 2024-03-23T23:45:14.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.431+0000 7f4101000640 1 Processor -- start 2024-03-23T23:45:14.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.431+0000 7f4101000640 1 -- start start 2024-03-23T23:45:14.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.435+0000 7f4101000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 0x7f40fc15ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:14.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.435+0000 7f4101000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40e0003a30 0x7f40fc160cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:14.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.435+0000 7f4101000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e0004810 0x7f40fc1fa580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:14.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.435+0000 7f4101000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc0ab720 con 0x7f40e0004810 2024-03-23T23:45:14.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.435+0000 7f4101000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc15fef0 con 0x7f40e0003a30 2024-03-23T23:45:14.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.435+0000 7f4101000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc0ab8a0 con 0x7f40d8007340 2024-03-23T23:45:14.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.435+0000 7f40f9e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 0x7f40fc15ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:14.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.435+0000 7f40f9e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 0x7f40fc15ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:33638/0 (socket says 172.21.15.8:33638) 2024-03-23T23:45:14.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.435+0000 7f40f9e00640 1 -- 172.21.15.8:0/3449624899 learned_addr learned my addr 172.21.15.8:0/3449624899 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:45:14.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.435+0000 7f40f1400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40e0003a30 0x7f40fc160cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:14.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.435+0000 7f40fa800640 1 --2- 172.21.15.8:0/3449624899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e0004810 0x7f40fc1fa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:14.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.435+0000 7f40f9e00640 1 -- 172.21.15.8:0/3449624899 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 msgr2=0x7f40fc15ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-03-23T23:45:14.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.435+0000 7f40f9e00640 1 -- 172.21.15.8:0/3449624899 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 msgr2=0x7f40fc15ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T23:45:14.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.435+0000 7f40f9e00640 1 --2- 172.21.15.8:0/3449624899 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 0x7f40fc15ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:45:14.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.435+0000 7f40f9e00640 1 --2- 172.21.15.8:0/3449624899 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 0x7f40fc15ae10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:45:14.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.435+0000 7f40f1400640 1 -- 172.21.15.8:0/3449624899 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 msgr2=0x7f40fc15ae10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:45:14.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.435+0000 7f40f1400640 1 --2- 172.21.15.8:0/3449624899 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 0x7f40fc15ae10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:14.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.435+0000 7f40f1400640 1 -- 172.21.15.8:0/3449624899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e0004810 msgr2=0x7f40fc1fa580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:14.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.435+0000 7f40f1400640 1 --2- 172.21.15.8:0/3449624899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e0004810 0x7f40fc1fa580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:14.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.435+0000 7f40f1400640 1 -- 172.21.15.8:0/3449624899 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40fc160350 con 0x7f40e0003a30 2024-03-23T23:45:14.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.435+0000 7f40f1400640 1 --2- 172.21.15.8:0/3449624899 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40e0003a30 0x7f40fc160cf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f40e40af000 tx=0x7f40e0005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:14.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.435+0000 7f40f2a00640 1 -- 172.21.15.8:0/3449624899 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e40c6020 con 0x7f40e0003a30 2024-03-23T23:45:14.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.435+0000 7f40f2a00640 1 -- 172.21.15.8:0/3449624899 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e40af7b0 con 0x7f40e0003a30 2024-03-23T23:45:14.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.435+0000 7f40f2a00640 1 -- 172.21.15.8:0/3449624899 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e40b4040 con 0x7f40e0003a30 2024-03-23T23:45:14.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.435+0000 7f4101000640 1 -- 172.21.15.8:0/3449624899 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40fc160630 con 0x7f40e0003a30 2024-03-23T23:45:14.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.435+0000 7f4101000640 1 -- 172.21.15.8:0/3449624899 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40fc15be10 con 0x7f40e0003a30 2024-03-23T23:45:14.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.439+0000 7f4101000640 1 -- 172.21.15.8:0/3449624899 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40fc04f480 con 0x7f40e0003a30 2024-03-23T23:45:14.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.439+0000 7f40f2a00640 1 -- 172.21.15.8:0/3449624899 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f40e40c9020 con 0x7f40e0003a30 2024-03-23T23:45:14.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.439+0000 7f40f2a00640 1 --2- 172.21.15.8:0/3449624899 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f40d80682a0 0x7f40d806a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:14.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.439+0000 7f40f2a00640 1 -- 172.21.15.8:0/3449624899 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f40e4129ba0 con 0x7f40e0003a30 2024-03-23T23:45:14.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.439+0000 7f40f9e00640 1 --2- 172.21.15.8:0/3449624899 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f40d80682a0 0x7f40d806a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:14.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.439+0000 7f40f9e00640 1 --2- 172.21.15.8:0/3449624899 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f40d80682a0 0x7f40d806a760 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f40ec007fd0 tx=0x7f40ec009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:14.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.447+0000 7f40f2a00640 1 -- 172.21.15.8:0/3449624899 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f40e40d0070 con 0x7f40e0003a30 2024-03-23T23:45:14.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.771+0000 7f4101000640 1 -- 172.21.15.8:0/3449624899 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f40fc0c6160 con 0x7f40e0003a30 2024-03-23T23:45:14.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.771+0000 7f40f2a00640 1 -- 172.21.15.8:0/3449624899 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1560 (secure 0 0 0) 0x7f40e4018040 con 0x7f40e0003a30 2024-03-23T23:45:14.774 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":18,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:45:14.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.775+0000 7f4101000640 1 -- 172.21.15.8:0/3449624899 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f40d80682a0 msgr2=0x7f40d806a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:14.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.775+0000 7f4101000640 1 --2- 172.21.15.8:0/3449624899 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f40d80682a0 0x7f40d806a760 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f40ec007fd0 tx=0x7f40ec009040 comp rx=0 tx=0).stop 2024-03-23T23:45:14.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.775+0000 7f4101000640 1 -- 172.21.15.8:0/3449624899 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40e0003a30 msgr2=0x7f40fc160cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:14.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.775+0000 7f4101000640 1 --2- 172.21.15.8:0/3449624899 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40e0003a30 0x7f40fc160cf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f40e40af000 tx=0x7f40e0005840 comp rx=0 tx=0).stop 2024-03-23T23:45:14.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.775+0000 7f4101000640 1 -- 172.21.15.8:0/3449624899 shutdown_connections 2024-03-23T23:45:14.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.775+0000 7f4101000640 1 --2- 172.21.15.8:0/3449624899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e0004810 0x7f40fc1fa580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:14.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.775+0000 7f4101000640 1 --2- 172.21.15.8:0/3449624899 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40e0003a30 0x7f40fc160cf0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:14.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.775+0000 7f4101000640 1 --2- 172.21.15.8:0/3449624899 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f40d80682a0 0x7f40d806a760 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:14.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.775+0000 7f4101000640 1 --2- 172.21.15.8:0/3449624899 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40d8007340 0x7f40fc15ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:14.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.775+0000 7f4101000640 1 -- 172.21.15.8:0/3449624899 >> 172.21.15.8:0/3449624899 conn(0x7f40fc0c7170 msgr2=0x7f40fc0c4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:45:14.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.775+0000 7f4101000640 1 -- 172.21.15.8:0/3449624899 shutdown_connections 2024-03-23T23:45:14.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:14.775+0000 7f4101000640 1 -- 172.21.15.8:0/3449624899 wait complete. 2024-03-23T23:45:14.803 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T23:45:14.804 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T23:45:14.804 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:45:15.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.003+0000 7f3c14600640 1 Processor -- start 2024-03-23T23:45:15.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.003+0000 7f3c14600640 1 -- start start 2024-03-23T23:45:15.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.007+0000 7f3c14600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3c0c0c2f10 0x7f3c0c0c3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:15.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.007+0000 7f3c14600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c0c153250 0x7f3c0c158f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:15.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.007+0000 7f3c14600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c0c0c4510 con 0x7f3c0c0c4080 2024-03-23T23:45:15.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.007+0000 7f3c14600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c0c0c4790 con 0x7f3c0c0c2f10 2024-03-23T23:45:15.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.007+0000 7f3c14600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c0c07d0 con 0x7f3c0c153250 2024-03-23T23:45:15.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.007+0000 7f3c12600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c0c153250 0x7f3c0c158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:15.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.007+0000 7f3c12600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c0c153250 0x7f3c0c158f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:33640/0 (socket says 172.21.15.8:33640) 2024-03-23T23:45:15.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.007+0000 7f3c12600640 1 -- 172.21.15.8:0/2552127682 learned_addr learned my addr 172.21.15.8:0/2552127682 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:45:15.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.007+0000 7f3c11c00640 1 --2- 172.21.15.8:0/2552127682 >> v2:172.21.15.196:3300/0 conn(0x7f3c0c0c2f10 0x7f3c0c0c3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:15.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.007+0000 7f3c12600640 1 -- 172.21.15.8:0/2552127682 >> v2:172.21.15.196:3300/0 conn(0x7f3c0c0c2f10 msgr2=0x7f3c0c0c3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:45:15.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.007+0000 7f3c12600640 1 --2- 172.21.15.8:0/2552127682 >> v2:172.21.15.196:3300/0 conn(0x7f3c0c0c2f10 0x7f3c0c0c3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:15.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.007+0000 7f3c12600640 1 -- 172.21.15.8:0/2552127682 >> v1:172.21.15.196:6789/0 conn(0x7f3c0c0c4080 legacy=0x7f3c0c152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:15.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.007+0000 7f3c12600640 1 -- 172.21.15.8:0/2552127682 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0c0c0ab0 con 0x7f3c0c153250 2024-03-23T23:45:15.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.011+0000 7f3c12600640 1 --2- 172.21.15.8:0/2552127682 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c0c153250 0x7f3c0c158f00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3c04009e50 tx=0x7f3c0401c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fe7c649537856b8 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:15.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.011+0000 7f3c0be00640 1 -- 172.21.15.8:0/2552127682 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c040a56a0 con 0x7f3c0c153250 2024-03-23T23:45:15.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.011+0000 7f3c0be00640 1 -- 172.21.15.8:0/2552127682 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c040a5840 con 0x7f3c0c153250 2024-03-23T23:45:15.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.011+0000 7f3c0be00640 1 -- 172.21.15.8:0/2552127682 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c040a5c10 con 0x7f3c0c153250 2024-03-23T23:45:15.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.011+0000 7f3c14600640 1 -- 172.21.15.8:0/2552127682 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c0c153250 msgr2=0x7f3c0c158f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:15.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.011+0000 7f3c14600640 1 --2- 172.21.15.8:0/2552127682 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c0c153250 0x7f3c0c158f00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3c04009e50 tx=0x7f3c0401c910 comp rx=0 tx=0).stop 2024-03-23T23:45:15.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.011+0000 7f3c14600640 1 -- 172.21.15.8:0/2552127682 shutdown_connections 2024-03-23T23:45:15.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.011+0000 7f3c14600640 1 --2- 172.21.15.8:0/2552127682 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c0c153250 0x7f3c0c158f00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:15.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.011+0000 7f3c14600640 1 --2- 172.21.15.8:0/2552127682 >> v2:172.21.15.196:3300/0 conn(0x7f3c0c0c2f10 0x7f3c0c0c3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:15.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.015+0000 7f3c14600640 1 -- 172.21.15.8:0/2552127682 >> 172.21.15.8:0/2552127682 conn(0x7f3c0c06b170 msgr2=0x7f3c0c06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:45:15.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.015+0000 7f3c14600640 1 -- 172.21.15.8:0/2552127682 shutdown_connections 2024-03-23T23:45:15.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.015+0000 7f3c14600640 1 -- 172.21.15.8:0/2552127682 wait complete. 2024-03-23T23:45:15.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.015+0000 7f3c14600640 1 Processor -- start 2024-03-23T23:45:15.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.015+0000 7f3c14600640 1 -- start start 2024-03-23T23:45:15.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.019+0000 7f3c14600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c0c0c2f10 0x7f3c0c1ee8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:15.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.019+0000 7f3c14600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c0c0c4080 0x7f3c0c1ef370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:15.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.019+0000 7f3c14600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c0c153250 0x7f3c0c140680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:15.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.019+0000 7f3c14600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c159850 con 0x7f3c0c0c4080 2024-03-23T23:45:15.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.019+0000 7f3c14600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c0c32f0 con 0x7f3c0c153250 2024-03-23T23:45:15.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.019+0000 7f3c14600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c147490 con 0x7f3c0c0c2f10 2024-03-23T23:45:15.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.019+0000 7f3c11200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c0c0c4080 0x7f3c0c1ef370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:15.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.019+0000 7f3c11c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c0c0c2f10 0x7f3c0c1ee8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:15.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.019+0000 7f3c11200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c0c0c4080 0x7f3c0c1ef370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57586/0 (socket says 172.21.15.8:57586) 2024-03-23T23:45:15.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.019+0000 7f3c12600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c0c153250 0x7f3c0c140680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:15.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.019+0000 7f3c11200640 1 -- 172.21.15.8:0/1851128323 learned_addr learned my addr 172.21.15.8:0/1851128323 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:45:15.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.019+0000 7f3c12600640 1 -- 172.21.15.8:0/1851128323 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c0c0c2f10 msgr2=0x7f3c0c1ee8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:15.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.019+0000 7f3c12600640 1 --2- 172.21.15.8:0/1851128323 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c0c0c2f10 0x7f3c0c1ee8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:15.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.019+0000 7f3c12600640 1 -- 172.21.15.8:0/1851128323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c0c0c4080 msgr2=0x7f3c0c1ef370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:15.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.019+0000 7f3c12600640 1 --2- 172.21.15.8:0/1851128323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c0c0c4080 0x7f3c0c1ef370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:15.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.019+0000 7f3c12600640 1 -- 172.21.15.8:0/1851128323 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0c147770 con 0x7f3c0c153250 2024-03-23T23:45:15.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.019+0000 7f3c12600640 1 --2- 172.21.15.8:0/1851128323 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c0c153250 0x7f3c0c140680 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c0c0950 tx=0x7f3c040196b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:15.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.019+0000 7f3c09600640 1 -- 172.21.15.8:0/1851128323 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c040bc070 con 0x7f3c0c153250 2024-03-23T23:45:15.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.019+0000 7f3c09600640 1 -- 172.21.15.8:0/1851128323 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c040b8640 con 0x7f3c0c153250 2024-03-23T23:45:15.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.019+0000 7f3c14600640 1 -- 172.21.15.8:0/1851128323 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c0c147a50 con 0x7f3c0c153250 2024-03-23T23:45:15.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.019+0000 7f3c09600640 1 -- 172.21.15.8:0/1851128323 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c04009510 con 0x7f3c0c153250 2024-03-23T23:45:15.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.019+0000 7f3c14600640 1 -- 172.21.15.8:0/1851128323 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c0c148dc0 con 0x7f3c0c153250 2024-03-23T23:45:15.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.023+0000 7f3c14600640 1 --2- 172.21.15.8:0/1851128323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c0c1ef8b0 0x7f3c0c155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:15.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.023+0000 7f3c14600640 1 -- 172.21.15.8:0/1851128323 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c1599d0 con 0x7f3c0c1ef8b0 2024-03-23T23:45:15.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.023+0000 7f3c09600640 1 -- 172.21.15.8:0/1851128323 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3c040b8a30 con 0x7f3c0c153250 2024-03-23T23:45:15.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.023+0000 7f3c11c00640 1 --2- 172.21.15.8:0/1851128323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c0c1ef8b0 0x7f3c0c155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:15.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.023+0000 7f3c11c00640 1 -- 172.21.15.8:0/1851128323 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3c0c0c4c70 con 0x7f3c0c1ef8b0 2024-03-23T23:45:15.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.023+0000 7f3c11c00640 1 --2- 172.21.15.8:0/1851128323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c0c1ef8b0 0x7f3c0c155ea0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80119d0 tx=0x7f3bf8011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:15.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.023+0000 7f3c09600640 1 --2- 172.21.15.8:0/1851128323 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3bec067690 0x7f3bec069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:15.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.023+0000 7f3c09600640 1 -- 172.21.15.8:0/1851128323 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f3c04120590 con 0x7f3c0c153250 2024-03-23T23:45:15.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.023+0000 7f3c11200640 1 --2- 172.21.15.8:0/1851128323 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3bec067690 0x7f3bec069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:15.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.027+0000 7f3c09600640 1 -- 172.21.15.8:0/1851128323 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8019070 con 0x7f3c0c1ef8b0 2024-03-23T23:45:15.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.027+0000 7f3c09600640 1 -- 172.21.15.8:0/1851128323 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f3bf8004300 con 0x7f3c0c1ef8b0 2024-03-23T23:45:15.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.027+0000 7f3c09600640 1 -- 172.21.15.8:0/1851128323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c0c1ef8b0 msgr2=0x7f3c0c155ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:15.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.027+0000 7f3c09600640 1 --2- 172.21.15.8:0/1851128323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c0c1ef8b0 0x7f3c0c155ea0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80119d0 tx=0x7f3bf8011e90 comp rx=0 tx=0).stop 2024-03-23T23:45:15.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.027+0000 7f3c09600640 1 -- 172.21.15.8:0/1851128323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c0c1ef8b0 msgr2=0x7f3c0c155ea0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:45:15.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.027+0000 7f3c09600640 1 --2- 172.21.15.8:0/1851128323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c0c1ef8b0 0x7f3c0c155ea0 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80119d0 tx=0x7f3bf8011e90 comp rx=0 tx=0).stop 2024-03-23T23:45:15.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.027+0000 7f3c11200640 1 --2- 172.21.15.8:0/1851128323 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3bec067690 0x7f3bec069b50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c1eee20 tx=0x7f3c00009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:15.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.039+0000 7f3c14600640 1 --2- 172.21.15.8:0/1851128323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c0c140bc0 0x7f3c0c1563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:15.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.039+0000 7f3c14600640 1 -- 172.21.15.8:0/1851128323 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c147f70 con 0x7f3c0c140bc0 2024-03-23T23:45:15.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.039+0000 7f3c11c00640 1 --2- 172.21.15.8:0/1851128323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c0c140bc0 0x7f3c0c1563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:15.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.039+0000 7f3c11c00640 1 -- 172.21.15.8:0/1851128323 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3c0c068270 con 0x7f3c0c140bc0 2024-03-23T23:45:15.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.043+0000 7f3c11c00640 1 --2- 172.21.15.8:0/1851128323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c0c140bc0 0x7f3c0c1563e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80119d0 tx=0x7f3bf80046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:15.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.043+0000 7f3c09600640 1 -- 172.21.15.8:0/1851128323 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8019040 con 0x7f3c0c140bc0 2024-03-23T23:45:15.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.043+0000 7f3c09600640 1 -- 172.21.15.8:0/1851128323 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5184 (secure 0 0 0) 0x7f3bf801e450 con 0x7f3c0c140bc0 2024-03-23T23:45:15.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.043+0000 7f3c09600640 1 -- 172.21.15.8:0/1851128323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c0c140bc0 msgr2=0x7f3c0c1563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:15.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.043+0000 7f3c09600640 1 --2- 172.21.15.8:0/1851128323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c0c140bc0 0x7f3c0c1563e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80119d0 tx=0x7f3bf80046d0 comp rx=0 tx=0).stop 2024-03-23T23:45:15.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.043+0000 7f3c09600640 1 -- 172.21.15.8:0/1851128323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c0c140bc0 msgr2=0x7f3c0c1563e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:45:15.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.043+0000 7f3c09600640 1 --2- 172.21.15.8:0/1851128323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c0c140bc0 0x7f3c0c1563e0 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80119d0 tx=0x7f3bf80046d0 comp rx=0 tx=0).stop 2024-03-23T23:45:15.047 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:45:15.047 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:45:15.047 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:45:15.047 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:45:15.047 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 18, 2024-03-23T23:45:15.047 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:45:15.047 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:45:15.047 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:45:15.047 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:45:15.047 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:15.047 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 0, 2024-03-23T23:45:15.048 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:45:15.048 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:45:15.048 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:45:15.048 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:45:15.048 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:45:15.048 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:45:15.048 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:45:15.048 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:45:15.048 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:45:15.048 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:45:15.048 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:45:15.048 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:45:15.048 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:45:15.048 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:45:15.049 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:15.049 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:45:15.049 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:45:15.049 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:45:15.049 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:45:15.049 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:45:15.049 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:45:15.049 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:45:15.049 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:45:15.049 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:45:15.049 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:45:15.049 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:45:15.049 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:45:15.049 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:45:15.050 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:15.050 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.050 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:45:15.050 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:45:15.050 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:45:15.050 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:45:15.050 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:45:15.050 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:45:15.050 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:45:15.050 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:45:15.050 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:45:15.050 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:45:15.050 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:45:15.051 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:45:15.051 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:45:15.051 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:45:15.051 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:45:15.051 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:45:15.051 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:45:15.051 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:45:15.051 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:45:15.051 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:45:15.051 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:45:15.051 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:45:15.051 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:45:15.051 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:45:15.052 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:45:15.052 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:45:15.052 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:45:15.052 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:45:15.052 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:15.052 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:45:15.052 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.052 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:45:15.052 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.052 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:45:15.052 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:45:15.052 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:45:15.052 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:45:15.052 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.053 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:45:15.053 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:45:15.053 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:15.053 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.053 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.053 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:45:15.053 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:45:15.053 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:15.053 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:15.053 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:15.053 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.053 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:45:15.053 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:45:15.053 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:45:15.054 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:45:15.054 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:45:15.054 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.054 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.054 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:45:15.054 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:45:15.054 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:45:15.054 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:45:15.054 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.054 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:45:15.054 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:45:15.054 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:15.054 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.055 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.055 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:45:15.055 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:45:15.055 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:15.055 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:15.055 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:15.055 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.055 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:45:15.055 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:45:15.055 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:45:15.055 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:45:15.055 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:45:15.055 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.055 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.056 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:45:15.056 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:45:15.056 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:45:15.056 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:45:15.056 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.056 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:45:15.056 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:45:15.056 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:15.056 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.056 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.056 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:45:15.056 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:45:15.056 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:15.056 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:15.057 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:15.057 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.057 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:45:15.057 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:45:15.057 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:45:15.057 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:45:15.057 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:45:15.057 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:15.057 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:15.057 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.057 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:45:15.057 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:45:15.057 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.058 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:45:15.058 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:15.058 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:45:15.058 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:15.058 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:15.058 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:45:15.058 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.058 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:45:15.058 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:15.058 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:45:15.058 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:15.059 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:15.059 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:45:15.059 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.059 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:45:15.059 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:15.059 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:45:15.059 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:15.059 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:15.059 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:45:15.059 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.059 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:45:15.059 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:15.059 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:45:15.059 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.060 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.060 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:45:15.060 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:15.060 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:45:15.060 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:15.060 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:15.060 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:45:15.060 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.060 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:45:15.060 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:15.060 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:45:15.060 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:15.061 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:15.061 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.061 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:45:15.061 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:45:15.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.043+0000 7f3c14600640 1 -- 172.21.15.8:0/1851128323 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3bec067690 msgr2=0x7f3bec069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:15.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.043+0000 7f3c14600640 1 --2- 172.21.15.8:0/1851128323 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3bec067690 0x7f3bec069b50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c1eee20 tx=0x7f3c00009040 comp rx=0 tx=0).stop 2024-03-23T23:45:15.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.043+0000 7f3c14600640 1 -- 172.21.15.8:0/1851128323 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c0c153250 msgr2=0x7f3c0c140680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:15.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.043+0000 7f3c14600640 1 --2- 172.21.15.8:0/1851128323 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c0c153250 0x7f3c0c140680 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c0c0950 tx=0x7f3c040196b0 comp rx=0 tx=0).stop 2024-03-23T23:45:15.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.043+0000 7f3c12600640 1 -- 172.21.15.8:0/1851128323 reap_dead start 2024-03-23T23:45:15.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.043+0000 7f3c12600640 1 -- 172.21.15.8:0/1851128323 reap_dead start 2024-03-23T23:45:15.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.043+0000 7f3c14600640 1 -- 172.21.15.8:0/1851128323 shutdown_connections 2024-03-23T23:45:15.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.043+0000 7f3c14600640 1 -- 172.21.15.8:0/1851128323 >> 172.21.15.8:0/1851128323 conn(0x7f3c0c06b170 msgr2=0x7f3c0c150f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:45:15.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.047+0000 7f3c14600640 1 -- 172.21.15.8:0/1851128323 shutdown_connections 2024-03-23T23:45:15.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.047+0000 7f3c14600640 1 -- 172.21.15.8:0/1851128323 wait complete. 2024-03-23T23:45:15.083 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:45:15.084 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T23:45:15.084 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:45:15.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.259+0000 7f669e600640 1 Processor -- start 2024-03-23T23:45:15.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.259+0000 7f669e600640 1 -- start start 2024-03-23T23:45:15.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.263+0000 7f669e600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6698159da0 0x7f669815af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:15.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.263+0000 7f669e600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f66980c3060 0x7f669815a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:15.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.263+0000 7f669e600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66980c34d0 con 0x7f66980c76a0 2024-03-23T23:45:15.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.263+0000 7f669e600640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f669806dc30 con 0x7f6698159da0 2024-03-23T23:45:15.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.263+0000 7f669e600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f669806def0 con 0x7f66980c3060 2024-03-23T23:45:15.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.263+0000 7f669d200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6698159da0 0x7f669815af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:15.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.263+0000 7f669d200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6698159da0 0x7f669815af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57606/0 (socket says 172.21.15.8:57606) 2024-03-23T23:45:15.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.263+0000 7f6697e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f66980c3060 0x7f669815a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:15.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.263+0000 7f669d200640 1 -- 172.21.15.8:0/4039013134 learned_addr learned my addr 172.21.15.8:0/4039013134 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:45:15.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.263+0000 7f669d200640 1 -- 172.21.15.8:0/4039013134 >> v2:172.21.15.196:3300/0 conn(0x7f66980c3060 msgr2=0x7f669815a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:45:15.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.263+0000 7f669d200640 1 --2- 172.21.15.8:0/4039013134 >> v2:172.21.15.196:3300/0 conn(0x7f66980c3060 0x7f669815a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:15.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.263+0000 7f669d200640 1 -- 172.21.15.8:0/4039013134 >> v1:172.21.15.196:6789/0 conn(0x7f66980c76a0 legacy=0x7f6698156c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:15.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.263+0000 7f669d200640 1 -- 172.21.15.8:0/4039013134 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669815a9e0 con 0x7f6698159da0 2024-03-23T23:45:15.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.267+0000 7f669d200640 1 --2- 172.21.15.8:0/4039013134 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6698159da0 0x7f669815af40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f66980abc50 tx=0x7f668c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=669c092581ca86d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:15.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.267+0000 7f6697400640 1 -- 172.21.15.8:0/4039013134 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c0b5070 con 0x7f6698159da0 2024-03-23T23:45:15.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.267+0000 7f6697400640 1 -- 172.21.15.8:0/4039013134 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668c0a8a10 con 0x7f6698159da0 2024-03-23T23:45:15.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.267+0000 7f6697400640 1 -- 172.21.15.8:0/4039013134 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c0a8de0 con 0x7f6698159da0 2024-03-23T23:45:15.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.267+0000 7f669e600640 1 -- 172.21.15.8:0/4039013134 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6698159da0 msgr2=0x7f669815af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:15.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.267+0000 7f669e600640 1 --2- 172.21.15.8:0/4039013134 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6698159da0 0x7f669815af40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f66980abc50 tx=0x7f668c01ed10 comp rx=0 tx=0).stop 2024-03-23T23:45:15.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.267+0000 7f669e600640 1 -- 172.21.15.8:0/4039013134 shutdown_connections 2024-03-23T23:45:15.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.267+0000 7f669e600640 1 --2- 172.21.15.8:0/4039013134 >> v2:172.21.15.196:3300/0 conn(0x7f66980c3060 0x7f669815a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:15.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.267+0000 7f669e600640 1 --2- 172.21.15.8:0/4039013134 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6698159da0 0x7f669815af40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:15.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.267+0000 7f669e600640 1 -- 172.21.15.8:0/4039013134 >> 172.21.15.8:0/4039013134 conn(0x7f66980c8de0 msgr2=0x7f66980c91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:45:15.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.267+0000 7f669e600640 1 -- 172.21.15.8:0/4039013134 shutdown_connections 2024-03-23T23:45:15.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.267+0000 7f669e600640 1 -- 172.21.15.8:0/4039013134 wait complete. 2024-03-23T23:45:15.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.267+0000 7f669e600640 1 Processor -- start 2024-03-23T23:45:15.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.267+0000 7f669e600640 1 -- start start 2024-03-23T23:45:15.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.271+0000 7f669e600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66980c3060 0x7f66981f3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:15.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.271+0000 7f669e600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f66980c76a0 0x7f669814ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:15.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.271+0000 7f669e600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6698159da0 0x7f669814bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:15.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.271+0000 7f669e600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669815a6c0 con 0x7f66980c3060 2024-03-23T23:45:15.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.271+0000 7f669e600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66980c88e0 con 0x7f66980c76a0 2024-03-23T23:45:15.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.271+0000 7f669e600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669806c430 con 0x7f6698159da0 2024-03-23T23:45:15.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.271+0000 7f669d200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66980c3060 0x7f66981f3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:15.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.271+0000 7f669d200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66980c3060 0x7f66981f3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57608/0 (socket says 172.21.15.8:57608) 2024-03-23T23:45:15.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.271+0000 7f669d200640 1 -- 172.21.15.8:0/427832326 learned_addr learned my addr 172.21.15.8:0/427832326 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:45:15.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.271+0000 7f6697e00640 1 --2- 172.21.15.8:0/427832326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f66980c76a0 0x7f669814ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:15.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.271+0000 7f669dc00640 1 --2- 172.21.15.8:0/427832326 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6698159da0 0x7f669814bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:15.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.271+0000 7f669d200640 1 -- 172.21.15.8:0/427832326 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6698159da0 msgr2=0x7f669814bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:15.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.271+0000 7f669d200640 1 --2- 172.21.15.8:0/427832326 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6698159da0 0x7f669814bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:15.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.271+0000 7f669d200640 1 -- 172.21.15.8:0/427832326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f66980c76a0 msgr2=0x7f669814ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:15.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.271+0000 7f669d200640 1 --2- 172.21.15.8:0/427832326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f66980c76a0 0x7f669814ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:15.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.271+0000 7f669d200640 1 -- 172.21.15.8:0/427832326 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669814c9f0 con 0x7f66980c3060 2024-03-23T23:45:15.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.271+0000 7f6697e00640 1 --2- 172.21.15.8:0/427832326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f66980c76a0 0x7f669814ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:45:15.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.271+0000 7f669d200640 1 --2- 172.21.15.8:0/427832326 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66980c3060 0x7f66981f3190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f668c01b920 tx=0x7f668c01bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:15.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.271+0000 7f6694c00640 1 -- 172.21.15.8:0/427832326 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c0b5070 con 0x7f66980c3060 2024-03-23T23:45:15.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.271+0000 7f6694c00640 1 -- 172.21.15.8:0/427832326 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668c0b0b40 con 0x7f66980c3060 2024-03-23T23:45:15.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.271+0000 7f6694c00640 1 -- 172.21.15.8:0/427832326 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c0bb410 con 0x7f66980c3060 2024-03-23T23:45:15.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.271+0000 7f669e600640 1 -- 172.21.15.8:0/427832326 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6698158900 con 0x7f66980c3060 2024-03-23T23:45:15.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.271+0000 7f669e600640 1 -- 172.21.15.8:0/427832326 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6698158ec0 con 0x7f66980c3060 2024-03-23T23:45:15.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.271+0000 7f668a000640 1 --2- 172.21.15.8:0/427832326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6698158460 0x7f669814c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:15.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.271+0000 7f668a000640 1 -- 172.21.15.8:0/427832326 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6698068790 con 0x7f6698158460 2024-03-23T23:45:15.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.271+0000 7f6697e00640 1 --2- 172.21.15.8:0/427832326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6698158460 0x7f669814c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:15.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.271+0000 7f6697e00640 1 -- 172.21.15.8:0/427832326 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f669804f410 con 0x7f6698158460 2024-03-23T23:45:15.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.275+0000 7f6697e00640 1 --2- 172.21.15.8:0/427832326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6698158460 0x7f669814c0b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6698155f90 tx=0x7f6684010f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:15.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.275+0000 7f6694c00640 1 -- 172.21.15.8:0/427832326 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6684018020 con 0x7f6698158460 2024-03-23T23:45:15.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.275+0000 7f6694c00640 1 -- 172.21.15.8:0/427832326 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f6684004300 con 0x7f6698158460 2024-03-23T23:45:15.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.275+0000 7f6694c00640 1 -- 172.21.15.8:0/427832326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6698158460 msgr2=0x7f669814c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:15.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.275+0000 7f6694c00640 1 --2- 172.21.15.8:0/427832326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6698158460 0x7f669814c0b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6698155f90 tx=0x7f6684010f40 comp rx=0 tx=0).stop 2024-03-23T23:45:15.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.275+0000 7f6694c00640 1 -- 172.21.15.8:0/427832326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6698158460 msgr2=0x7f669814c0b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:45:15.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.275+0000 7f6694c00640 1 --2- 172.21.15.8:0/427832326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6698158460 0x7f669814c0b0 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6698155f90 tx=0x7f6684010f40 comp rx=0 tx=0).stop 2024-03-23T23:45:15.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.275+0000 7f6694c00640 1 -- 172.21.15.8:0/427832326 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f668c0c2060 con 0x7f66980c3060 2024-03-23T23:45:15.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.275+0000 7f6694c00640 1 --2- 172.21.15.8:0/427832326 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6678067260 0x7f6678069720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:15.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.275+0000 7f6694c00640 1 -- 172.21.15.8:0/427832326 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f668c122d70 con 0x7f66980c3060 2024-03-23T23:45:15.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.275+0000 7f6697e00640 1 --2- 172.21.15.8:0/427832326 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6678067260 0x7f6678069720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:15.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.279+0000 7f6697e00640 1 --2- 172.21.15.8:0/427832326 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6678067260 0x7f6678069720 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6684010f80 tx=0x7f6684014000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:15.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.283+0000 7f668a000640 1 --2- 172.21.15.8:0/427832326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6698150a50 0x7f6698150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:15.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.283+0000 7f668a000640 1 -- 172.21.15.8:0/427832326 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66981f36d0 con 0x7f6698150a50 2024-03-23T23:45:15.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.287+0000 7f669dc00640 1 --2- 172.21.15.8:0/427832326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6698150a50 0x7f6698150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:15.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.287+0000 7f669dc00640 1 -- 172.21.15.8:0/427832326 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f66980c8340 con 0x7f6698150a50 2024-03-23T23:45:15.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.287+0000 7f669dc00640 1 --2- 172.21.15.8:0/427832326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6698150a50 0x7f6698150e30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f669000f8b0 tx=0x7f669000fd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:15.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.287+0000 7f6694c00640 1 -- 172.21.15.8:0/427832326 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6690006d70 con 0x7f6698150a50 2024-03-23T23:45:15.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.287+0000 7f6694c00640 1 -- 172.21.15.8:0/427832326 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4529 (secure 0 0 0) 0x7f6690003980 con 0x7f6698150a50 2024-03-23T23:45:15.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.287+0000 7f6694c00640 1 -- 172.21.15.8:0/427832326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6698150a50 msgr2=0x7f6698150e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:15.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.287+0000 7f6694c00640 1 --2- 172.21.15.8:0/427832326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6698150a50 0x7f6698150e30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f669000f8b0 tx=0x7f669000fd70 comp rx=0 tx=0).stop 2024-03-23T23:45:15.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.287+0000 7f6694c00640 1 -- 172.21.15.8:0/427832326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6698150a50 msgr2=0x7f6698150e30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:45:15.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.287+0000 7f6694c00640 1 --2- 172.21.15.8:0/427832326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6698150a50 0x7f6698150e30 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f669000f8b0 tx=0x7f669000fd70 comp rx=0 tx=0).stop 2024-03-23T23:45:15.292 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:45:15.292 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:45:15.292 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:45:15.292 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:45:15.292 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 18, 2024-03-23T23:45:15.292 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:45:15.293 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:45:15.293 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:45:15.293 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:45:15.293 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:15.293 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 0, 2024-03-23T23:45:15.293 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:45:15.293 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:45:15.293 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:45:15.293 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:45:15.293 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:45:15.293 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:45:15.293 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:45:15.293 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:45:15.294 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:45:15.294 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:45:15.294 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:45:15.294 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:45:15.294 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:45:15.294 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:45:15.294 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:15.294 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:45:15.294 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:45:15.294 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:45:15.294 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:45:15.294 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:45:15.295 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:45:15.295 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:45:15.295 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:45:15.295 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:45:15.295 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:45:15.295 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:45:15.295 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:45:15.295 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:45:15.295 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:15.295 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.295 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:45:15.295 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:45:15.295 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:45:15.296 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:45:15.296 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:45:15.296 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:45:15.296 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:45:15.296 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:45:15.296 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:45:15.296 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:45:15.296 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:45:15.296 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:45:15.296 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:45:15.296 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:45:15.296 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:45:15.296 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:45:15.296 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:45:15.296 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:45:15.297 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:45:15.297 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:45:15.297 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:45:15.297 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:45:15.297 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:45:15.297 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:45:15.297 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:45:15.297 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:45:15.297 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:45:15.297 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:45:15.297 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:15.297 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:45:15.297 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.297 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:45:15.297 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.298 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:45:15.298 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:45:15.298 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:45:15.298 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:45:15.298 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.298 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:45:15.298 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:45:15.298 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:15.298 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.298 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.298 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:45:15.298 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:45:15.298 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:15.299 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:15.299 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:15.299 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.299 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:45:15.299 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:45:15.299 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:45:15.299 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:45:15.299 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:45:15.299 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.299 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.299 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:45:15.299 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:45:15.299 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:45:15.299 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:45:15.300 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.300 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:45:15.300 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:45:15.300 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:15.300 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.300 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.300 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:45:15.300 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:45:15.300 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:15.300 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:15.300 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:15.300 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.300 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:45:15.300 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:45:15.301 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:45:15.301 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:45:15.301 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:45:15.301 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.301 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.301 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:45:15.301 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:45:15.301 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:45:15.301 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:45:15.301 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.301 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:45:15.301 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:45:15.301 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:15.302 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.302 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.302 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:45:15.302 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:45:15.302 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:15.302 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:15.302 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:15.302 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.302 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:45:15.302 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:45:15.302 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:45:15.302 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:45:15.302 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:45:15.303 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:15.303 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:15.303 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.303 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:45:15.303 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:45:15.303 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.303 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:45:15.303 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:15.303 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:45:15.303 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:15.303 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:15.303 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:45:15.303 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.304 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:45:15.304 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:15.304 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:45:15.304 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:15.304 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:15.304 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.304 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:45:15.304 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:45:15.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.287+0000 7f668a000640 1 -- 172.21.15.8:0/427832326 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6678067260 msgr2=0x7f6678069720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:15.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.287+0000 7f668a000640 1 --2- 172.21.15.8:0/427832326 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6678067260 0x7f6678069720 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6684010f80 tx=0x7f6684014000 comp rx=0 tx=0).stop 2024-03-23T23:45:15.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.287+0000 7f668a000640 1 -- 172.21.15.8:0/427832326 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66980c3060 msgr2=0x7f66981f3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:15.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.287+0000 7f668a000640 1 --2- 172.21.15.8:0/427832326 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66980c3060 0x7f66981f3190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f668c01b920 tx=0x7f668c01bab0 comp rx=0 tx=0).stop 2024-03-23T23:45:15.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.287+0000 7f669dc00640 1 -- 172.21.15.8:0/427832326 reap_dead start 2024-03-23T23:45:15.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.291+0000 7f668a000640 1 -- 172.21.15.8:0/427832326 shutdown_connections 2024-03-23T23:45:15.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.291+0000 7f668a000640 1 -- 172.21.15.8:0/427832326 >> 172.21.15.8:0/427832326 conn(0x7f66980c8de0 msgr2=0x7f669806e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:45:15.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.291+0000 7f668a000640 1 -- 172.21.15.8:0/427832326 shutdown_connections 2024-03-23T23:45:15.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.291+0000 7f668a000640 1 -- 172.21.15.8:0/427832326 wait complete. 2024-03-23T23:45:15.312 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:45:15.312 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T23:45:15.312 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:45:15.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.523+0000 7f30e5400640 1 Processor -- start 2024-03-23T23:45:15.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.523+0000 7f30e5400640 1 -- start start 2024-03-23T23:45:15.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.527+0000 7f30e5400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f30e014d730 0x7f30e00aaac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:15.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.527+0000 7f30e5400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e01547b0 con 0x7f30e01570f0 2024-03-23T23:45:15.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.527+0000 7f30e5400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e006edb0 con 0x7f30e006fba0 2024-03-23T23:45:15.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.527+0000 7f30e5400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30e00c9230 con 0x7f30e014d730 2024-03-23T23:45:15.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.527+0000 7f30df200640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f30e01570f0 0x7f30e0157580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39474/0 (socket says 172.21.15.8:39474) 2024-03-23T23:45:15.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.527+0000 7f30df200640 1 -- 172.21.15.8:0/2340781284 learned_addr learned my addr 172.21.15.8:0/2340781284 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:45:15.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.527+0000 7f30de800640 1 --2- 172.21.15.8:0/2340781284 >> v2:172.21.15.196:3300/0 conn(0x7f30e014d730 0x7f30e00aaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:15.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.527+0000 7f30de800640 1 -- 172.21.15.8:0/2340781284 >> v1:172.21.15.196:6789/0 conn(0x7f30e006fba0 legacy=0x7f30e00ad6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:15.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.527+0000 7f30de800640 1 -- 172.21.15.8:0/2340781284 >> v1:172.21.15.8:6789/0 conn(0x7f30e01570f0 legacy=0x7f30e0157580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:15.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.527+0000 7f30dd400640 1 -- 172.21.15.8:0/2340781284 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 389647194 0 0) 0x7f30e01547b0 con 0x7f30e01570f0 2024-03-23T23:45:15.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.527+0000 7f30de800640 1 -- 172.21.15.8:0/2340781284 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e006f090 con 0x7f30e014d730 2024-03-23T23:45:15.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.531+0000 7f30de800640 1 --2- 172.21.15.8:0/2340781284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f30e014d730 0x7f30e00aaac0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f30d00097c0 tx=0x7f30d001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7a75e915bc8e632 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:15.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.531+0000 7f30dd400640 1 -- 172.21.15.8:0/2340781284 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d00b0070 con 0x7f30e014d730 2024-03-23T23:45:15.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.531+0000 7f30dd400640 1 -- 172.21.15.8:0/2340781284 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d00ab600 con 0x7f30e014d730 2024-03-23T23:45:15.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.531+0000 7f30dd400640 1 -- 172.21.15.8:0/2340781284 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d00ab9d0 con 0x7f30e014d730 2024-03-23T23:45:15.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.531+0000 7f30e5400640 1 -- 172.21.15.8:0/2340781284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f30e014d730 msgr2=0x7f30e00aaac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:15.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.531+0000 7f30e5400640 1 --2- 172.21.15.8:0/2340781284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f30e014d730 0x7f30e00aaac0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f30d00097c0 tx=0x7f30d001c4a0 comp rx=0 tx=0).stop 2024-03-23T23:45:15.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.531+0000 7f30e5400640 1 -- 172.21.15.8:0/2340781284 shutdown_connections 2024-03-23T23:45:15.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.531+0000 7f30e5400640 1 --2- 172.21.15.8:0/2340781284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f30e014d730 0x7f30e00aaac0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:15.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.531+0000 7f30e5400640 1 -- 172.21.15.8:0/2340781284 >> 172.21.15.8:0/2340781284 conn(0x7f30e00c82f0 msgr2=0x7f30e00c8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:45:15.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.531+0000 7f30e5400640 1 -- 172.21.15.8:0/2340781284 shutdown_connections 2024-03-23T23:45:15.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.531+0000 7f30e5400640 1 -- 172.21.15.8:0/2340781284 wait complete. 2024-03-23T23:45:15.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.535+0000 7f30e5400640 1 Processor -- start 2024-03-23T23:45:15.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.535+0000 7f30e5400640 1 -- start start 2024-03-23T23:45:15.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.535+0000 7f30e5400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30e006fba0 0x7f30e00c1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:15.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.535+0000 7f30e5400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30e014d730 0x7f30e0139ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:15.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.535+0000 7f30e5400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f30e01570f0 0x7f30e0139ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:15.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.535+0000 7f30e5400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e00adf40 con 0x7f30e006fba0 2024-03-23T23:45:15.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.535+0000 7f30e5400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e00addc0 con 0x7f30e01570f0 2024-03-23T23:45:15.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.535+0000 7f30e5400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e014db10 con 0x7f30e014d730 2024-03-23T23:45:15.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.535+0000 7f30dde00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30e014d730 0x7f30e0139ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:15.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.535+0000 7f30de800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30e006fba0 0x7f30e00c1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:15.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.535+0000 7f30df200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f30e01570f0 0x7f30e0139ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:15.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.535+0000 7f30dde00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30e014d730 0x7f30e0139ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:33672/0 (socket says 172.21.15.8:33672) 2024-03-23T23:45:15.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.535+0000 7f30dde00640 1 -- 172.21.15.8:0/3144965308 learned_addr learned my addr 172.21.15.8:0/3144965308 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:45:15.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.535+0000 7f30df200640 1 -- 172.21.15.8:0/3144965308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30e014d730 msgr2=0x7f30e0139ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:15.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.535+0000 7f30df200640 1 --2- 172.21.15.8:0/3144965308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30e014d730 0x7f30e0139ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:15.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.535+0000 7f30df200640 1 -- 172.21.15.8:0/3144965308 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30e006fba0 msgr2=0x7f30e00c1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:15.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.535+0000 7f30df200640 1 --2- 172.21.15.8:0/3144965308 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30e006fba0 0x7f30e00c1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:15.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.535+0000 7f30df200640 1 -- 172.21.15.8:0/3144965308 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e01f1c40 con 0x7f30e01570f0 2024-03-23T23:45:15.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.539+0000 7f30df200640 1 --2- 172.21.15.8:0/3144965308 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f30e01570f0 0x7f30e0139ff0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f30d800c750 tx=0x7f30d800cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:15.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.539+0000 7f30d6a00640 1 -- 172.21.15.8:0/3144965308 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d8018070 con 0x7f30e01570f0 2024-03-23T23:45:15.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.539+0000 7f30d6a00640 1 -- 172.21.15.8:0/3144965308 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d8004d80 con 0x7f30e01570f0 2024-03-23T23:45:15.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.539+0000 7f30d6a00640 1 -- 172.21.15.8:0/3144965308 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d800a880 con 0x7f30e01570f0 2024-03-23T23:45:15.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.539+0000 7f30e5400640 1 -- 172.21.15.8:0/3144965308 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e01f1f20 con 0x7f30e01570f0 2024-03-23T23:45:15.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.539+0000 7f30e5400640 1 -- 172.21.15.8:0/3144965308 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e0153240 con 0x7f30e01570f0 2024-03-23T23:45:15.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.547+0000 7f30d6a00640 1 -- 172.21.15.8:0/3144965308 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f30d801b070 con 0x7f30e01570f0 2024-03-23T23:45:15.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.547+0000 7f30d6a00640 1 --2- 172.21.15.8:0/3144965308 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f30c0067760 0x7f30c0069c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:15.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.547+0000 7f30d6a00640 1 -- 172.21.15.8:0/3144965308 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f30d80851b0 con 0x7f30e01570f0 2024-03-23T23:45:15.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.555+0000 7f30de800640 1 --2- 172.21.15.8:0/3144965308 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f30c0067760 0x7f30c0069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:15.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.555+0000 7f30de800640 1 --2- 172.21.15.8:0/3144965308 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f30c0067760 0x7f30c0069c20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f30d00ad000 tx=0x7f30d00a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:15.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.559+0000 7f30e5400640 1 --2- 172.21.15.8:0/3144965308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30e0147da0 0x7f30e0151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:15.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.559+0000 7f30e5400640 1 -- 172.21.15.8:0/3144965308 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e0151690 con 0x7f30e0147da0 2024-03-23T23:45:15.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.559+0000 7f30dde00640 1 --2- 172.21.15.8:0/3144965308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30e0147da0 0x7f30e0151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:15.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.563+0000 7f30dde00640 1 -- 172.21.15.8:0/3144965308 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f30e0068270 con 0x7f30e0147da0 2024-03-23T23:45:15.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.563+0000 7f30dde00640 1 --2- 172.21.15.8:0/3144965308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30e0147da0 0x7f30e0151d50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f30cc00e500 tx=0x7f30cc00e9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:15.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.563+0000 7f30d6a00640 1 -- 172.21.15.8:0/3144965308 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc018070 con 0x7f30e0147da0 2024-03-23T23:45:15.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.563+0000 7f30d6a00640 1 -- 172.21.15.8:0/3144965308 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f30cc0052e0 con 0x7f30e0147da0 2024-03-23T23:45:15.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.563+0000 7f30d6a00640 1 -- 172.21.15.8:0/3144965308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30e0147da0 msgr2=0x7f30e0151d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:15.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.563+0000 7f30d6a00640 1 --2- 172.21.15.8:0/3144965308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30e0147da0 0x7f30e0151d50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f30cc00e500 tx=0x7f30cc00e9c0 comp rx=0 tx=0).stop 2024-03-23T23:45:15.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.563+0000 7f30d6a00640 1 -- 172.21.15.8:0/3144965308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30e0147da0 msgr2=0x7f30e0151d50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:45:15.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.563+0000 7f30d6a00640 1 --2- 172.21.15.8:0/3144965308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30e0147da0 0x7f30e0151d50 secure :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f30cc00e500 tx=0x7f30cc00e9c0 comp rx=0 tx=0).stop 2024-03-23T23:45:15.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.575+0000 7f30e5400640 1 --2- 172.21.15.8:0/3144965308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30e0152830 0x7f30e0152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:15.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.575+0000 7f30e5400640 1 -- 172.21.15.8:0/3144965308 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e0156950 con 0x7f30e0152830 2024-03-23T23:45:15.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.575+0000 7f30dde00640 1 --2- 172.21.15.8:0/3144965308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30e0152830 0x7f30e0152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:15.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.575+0000 7f30dde00640 1 -- 172.21.15.8:0/3144965308 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f30e0151a00 con 0x7f30e0152830 2024-03-23T23:45:15.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.575+0000 7f30dde00640 1 --2- 172.21.15.8:0/3144965308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30e0152830 0x7f30e0152290 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f30cc015000 tx=0x7f30cc001130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:15.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.575+0000 7f30d6a00640 1 -- 172.21.15.8:0/3144965308 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc018050 con 0x7f30e0152830 2024-03-23T23:45:15.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.575+0000 7f30d6a00640 1 -- 172.21.15.8:0/3144965308 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5182 (secure 0 0 0) 0x7f30cc019040 con 0x7f30e0152830 2024-03-23T23:45:15.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.575+0000 7f30d6a00640 1 -- 172.21.15.8:0/3144965308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30e0152830 msgr2=0x7f30e0152290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:15.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.575+0000 7f30d6a00640 1 --2- 172.21.15.8:0/3144965308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30e0152830 0x7f30e0152290 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f30cc015000 tx=0x7f30cc001130 comp rx=0 tx=0).stop 2024-03-23T23:45:15.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.575+0000 7f30d6a00640 1 -- 172.21.15.8:0/3144965308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30e0152830 msgr2=0x7f30e0152290 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:45:15.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.575+0000 7f30d6a00640 1 --2- 172.21.15.8:0/3144965308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30e0152830 0x7f30e0152290 secure :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f30cc015000 tx=0x7f30cc001130 comp rx=0 tx=0).stop 2024-03-23T23:45:15.579 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:45:15.580 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:45:15.580 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:45:15.580 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:45:15.580 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 18, 2024-03-23T23:45:15.580 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:45:15.580 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:45:15.580 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:45:15.580 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:45:15.580 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:15.580 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 0, 2024-03-23T23:45:15.580 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:45:15.580 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:45:15.580 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:45:15.581 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:45:15.581 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:45:15.581 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:45:15.581 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:45:15.581 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:45:15.581 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:45:15.581 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:45:15.581 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:45:15.581 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:45:15.581 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:45:15.581 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:45:15.581 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:15.582 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:45:15.582 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:45:15.582 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:45:15.582 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:45:15.582 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:45:15.582 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:45:15.582 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:45:15.582 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:45:15.582 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:45:15.582 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:45:15.582 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:45:15.582 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:45:15.583 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:45:15.583 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:15.583 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.583 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:45:15.583 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:45:15.583 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:45:15.583 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:45:15.583 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:45:15.583 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:45:15.583 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:45:15.583 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:45:15.583 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:45:15.583 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:45:15.583 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:45:15.584 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:45:15.584 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:45:15.584 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:45:15.584 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:45:15.584 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:45:15.584 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:45:15.584 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:45:15.584 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:45:15.584 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:45:15.584 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:45:15.584 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:45:15.584 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:45:15.584 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:45:15.584 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:45:15.585 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:45:15.585 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:45:15.585 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:45:15.585 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:15.585 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:45:15.585 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.585 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:45:15.585 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.585 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:45:15.585 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:45:15.585 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:45:15.585 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:45:15.585 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.586 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:45:15.586 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:45:15.586 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:15.586 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.586 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.586 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:45:15.586 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:45:15.586 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:15.586 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:15.586 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:15.586 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.586 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:45:15.586 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:45:15.587 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:45:15.587 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:45:15.587 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:45:15.587 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.587 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.587 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:45:15.587 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:45:15.587 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:45:15.587 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:45:15.587 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.587 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:45:15.587 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:45:15.587 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:15.587 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.588 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.588 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:45:15.588 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:45:15.588 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:15.588 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:15.588 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:15.588 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.588 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:45:15.588 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:45:15.588 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:45:15.588 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:45:15.588 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:45:15.588 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.589 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.589 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:45:15.589 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:45:15.589 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:45:15.589 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:45:15.589 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.589 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:45:15.589 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:45:15.589 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:15.589 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.589 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.589 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:45:15.589 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:45:15.589 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:15.590 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:15.590 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:15.590 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.590 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:45:15.590 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:45:15.590 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:45:15.590 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:45:15.590 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:45:15.590 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:15.590 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:15.590 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.590 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:45:15.590 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:45:15.591 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.591 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:45:15.591 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:15.591 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:45:15.591 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:15.591 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:15.591 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:45:15.591 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.591 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:45:15.591 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:15.591 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:45:15.591 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:15.591 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:15.592 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:45:15.592 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.592 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:45:15.592 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:15.592 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 7 2024-03-23T23:45:15.592 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:15.592 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:15.592 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:45:15.592 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.592 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:45:15.592 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:15.592 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:45:15.592 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.592 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.593 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:45:15.593 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:15.593 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5 2024-03-23T23:45:15.593 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:15.593 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:15.593 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:45:15.593 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:15.593 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:45:15.593 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:15.593 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:45:15.593 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:15.594 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:15.594 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:15.594 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:45:15.594 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:45:15.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.575+0000 7f30e5400640 1 -- 172.21.15.8:0/3144965308 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f30c0067760 msgr2=0x7f30c0069c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:15.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.575+0000 7f30e5400640 1 --2- 172.21.15.8:0/3144965308 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f30c0067760 0x7f30c0069c20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f30d00ad000 tx=0x7f30d00a6000 comp rx=0 tx=0).stop 2024-03-23T23:45:15.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.575+0000 7f30e5400640 1 -- 172.21.15.8:0/3144965308 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f30e01570f0 msgr2=0x7f30e0139ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:15.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.575+0000 7f30e5400640 1 --2- 172.21.15.8:0/3144965308 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f30e01570f0 0x7f30e0139ff0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f30d800c750 tx=0x7f30d800cc10 comp rx=0 tx=0).stop 2024-03-23T23:45:15.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.575+0000 7f30df200640 1 -- 172.21.15.8:0/3144965308 reap_dead start 2024-03-23T23:45:15.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.575+0000 7f30e5400640 1 -- 172.21.15.8:0/3144965308 shutdown_connections 2024-03-23T23:45:15.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.575+0000 7f30e5400640 1 --2- 172.21.15.8:0/3144965308 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f30e01570f0 0x7f30e0139ff0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:15.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.575+0000 7f30e5400640 1 -- 172.21.15.8:0/3144965308 >> 172.21.15.8:0/3144965308 conn(0x7f30e00c82f0 msgr2=0x7f30e00c2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:45:15.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.575+0000 7f30e5400640 1 -- 172.21.15.8:0/3144965308 shutdown_connections 2024-03-23T23:45:15.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.575+0000 7f30e5400640 1 -- 172.21.15.8:0/3144965308 wait complete. 2024-03-23T23:45:15.609 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:45:15.609 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-03-23T23:45:15.610 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-03-23T23:45:15.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.899+0000 7faefac00640 1 Processor -- start 2024-03-23T23:45:15.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.899+0000 7faefac00640 1 -- start start 2024-03-23T23:45:15.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.903+0000 7faefac00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faef4152de0 0x7faef406f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:15.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.903+0000 7faefac00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7faef406edc0 0x7faef4155e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:15.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.903+0000 7faefac00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faef41598b0 con 0x7faef40c14a0 2024-03-23T23:45:15.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.903+0000 7faefac00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faef41531c0 con 0x7faef406edc0 2024-03-23T23:45:15.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.903+0000 7faefac00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef4159b90 con 0x7faef4152de0 2024-03-23T23:45:15.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.903+0000 7faef8e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7faef40c14a0 0x7faef4155710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39480/0 (socket says 172.21.15.8:39480) 2024-03-23T23:45:15.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.903+0000 7faef8e00640 1 -- 172.21.15.8:0/5615744 learned_addr learned my addr 172.21.15.8:0/5615744 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:45:15.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.903+0000 7faefa200640 1 --2- 172.21.15.8:0/5615744 >> v2:172.21.15.8:3300/0 conn(0x7faef406edc0 0x7faef4155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:15.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.903+0000 7faef9800640 1 --2- 172.21.15.8:0/5615744 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faef4152de0 0x7faef406f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:15.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.903+0000 7faefa200640 1 -- 172.21.15.8:0/5615744 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faef4152de0 msgr2=0x7faef406f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:45:15.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.903+0000 7faefa200640 1 --2- 172.21.15.8:0/5615744 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faef4152de0 0x7faef406f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:15.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.903+0000 7faefa200640 1 -- 172.21.15.8:0/5615744 >> v1:172.21.15.8:6789/0 conn(0x7faef40c14a0 legacy=0x7faef4155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:15.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.903+0000 7faefa200640 1 -- 172.21.15.8:0/5615744 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef40c2030 con 0x7faef406edc0 2024-03-23T23:45:15.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.903+0000 7faef3e00640 1 -- 172.21.15.8:0/5615744 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 199432511 0 0) 0x7faef41598b0 con 0x7faef40c14a0 2024-03-23T23:45:15.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.911+0000 7faefa200640 1 --2- 172.21.15.8:0/5615744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faef406edc0 0x7faef4155e20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faee80097c0 tx=0x7faee801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbe98bab13fe9424 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:15.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.911+0000 7faef3e00640 1 -- 172.21.15.8:0/5615744 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee80b0070 con 0x7faef406edc0 2024-03-23T23:45:15.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.911+0000 7faef3e00640 1 -- 172.21.15.8:0/5615744 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee80ab600 con 0x7faef406edc0 2024-03-23T23:45:15.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.911+0000 7faef3e00640 1 -- 172.21.15.8:0/5615744 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee80ab9d0 con 0x7faef406edc0 2024-03-23T23:45:15.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.911+0000 7faefac00640 1 -- 172.21.15.8:0/5615744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faef406edc0 msgr2=0x7faef4155e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:15.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.911+0000 7faefac00640 1 --2- 172.21.15.8:0/5615744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faef406edc0 0x7faef4155e20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faee80097c0 tx=0x7faee801c410 comp rx=0 tx=0).stop 2024-03-23T23:45:15.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.911+0000 7faefac00640 1 -- 172.21.15.8:0/5615744 shutdown_connections 2024-03-23T23:45:15.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.911+0000 7faefac00640 1 --2- 172.21.15.8:0/5615744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faef406edc0 0x7faef4155e20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:15.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.911+0000 7faefac00640 1 --2- 172.21.15.8:0/5615744 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faef4152de0 0x7faef406f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:15.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.911+0000 7faefac00640 1 -- 172.21.15.8:0/5615744 >> 172.21.15.8:0/5615744 conn(0x7faef406c280 msgr2=0x7faef406c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:45:15.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.911+0000 7faefac00640 1 -- 172.21.15.8:0/5615744 shutdown_connections 2024-03-23T23:45:15.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.911+0000 7faefac00640 1 -- 172.21.15.8:0/5615744 wait complete. 2024-03-23T23:45:15.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.915+0000 7faefac00640 1 Processor -- start 2024-03-23T23:45:15.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.915+0000 7faefac00640 1 -- start start 2024-03-23T23:45:15.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.915+0000 7faefac00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faef406edc0 0x7faef414fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:15.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.915+0000 7faefac00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faef40c14a0 0x7faef40ac9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:15.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.915+0000 7faefac00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faef4152de0 0x7faef4150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:15.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.915+0000 7faefac00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef4162a30 con 0x7faef40c14a0 2024-03-23T23:45:15.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.915+0000 7faefac00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef41628b0 con 0x7faef4152de0 2024-03-23T23:45:15.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.915+0000 7faefac00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef4162bb0 con 0x7faef406edc0 2024-03-23T23:45:15.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.919+0000 7faef9800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faef406edc0 0x7faef414fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:15.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.919+0000 7faef9800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faef406edc0 0x7faef414fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:33712/0 (socket says 172.21.15.8:33712) 2024-03-23T23:45:15.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.919+0000 7faef9800640 1 -- 172.21.15.8:0/2741173150 learned_addr learned my addr 172.21.15.8:0/2741173150 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:45:15.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.919+0000 7faefa200640 1 --2- 172.21.15.8:0/2741173150 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faef4152de0 0x7faef4150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:15.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.919+0000 7faef8e00640 1 --2- 172.21.15.8:0/2741173150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faef40c14a0 0x7faef40ac9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:15.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.919+0000 7faef9800640 1 -- 172.21.15.8:0/2741173150 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faef4152de0 msgr2=0x7faef4150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:15.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.919+0000 7faef9800640 1 --2- 172.21.15.8:0/2741173150 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faef4152de0 0x7faef4150600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:15.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.919+0000 7faef9800640 1 -- 172.21.15.8:0/2741173150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faef40c14a0 msgr2=0x7faef40ac9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:15.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.919+0000 7faef9800640 1 --2- 172.21.15.8:0/2741173150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faef40c14a0 0x7faef40ac9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:15.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.919+0000 7faef9800640 1 -- 172.21.15.8:0/2741173150 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef4152660 con 0x7faef406edc0 2024-03-23T23:45:15.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.919+0000 7faef8e00640 1 --2- 172.21.15.8:0/2741173150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faef40c14a0 0x7faef40ac9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:45:15.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.919+0000 7faef9800640 1 --2- 172.21.15.8:0/2741173150 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faef406edc0 0x7faef414fec0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faeec00efc0 tx=0x7faeec00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:15.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.919+0000 7faef1600640 1 -- 172.21.15.8:0/2741173150 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec018020 con 0x7faef406edc0 2024-03-23T23:45:15.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.919+0000 7faefac00640 1 -- 172.21.15.8:0/2741173150 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faef4150400 con 0x7faef406edc0 2024-03-23T23:45:15.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.919+0000 7faef1600640 1 -- 172.21.15.8:0/2741173150 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeec014480 con 0x7faef406edc0 2024-03-23T23:45:15.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.919+0000 7faefac00640 1 -- 172.21.15.8:0/2741173150 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faef415fb80 con 0x7faef406edc0 2024-03-23T23:45:15.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.919+0000 7faef1600640 1 -- 172.21.15.8:0/2741173150 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec014850 con 0x7faef406edc0 2024-03-23T23:45:15.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.919+0000 7faefac00640 1 -- 172.21.15.8:0/2741173150 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed00052a0 con 0x7faef406edc0 2024-03-23T23:45:15.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.923+0000 7faef1600640 1 -- 172.21.15.8:0/2741173150 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7faeec01b020 con 0x7faef406edc0 2024-03-23T23:45:15.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.923+0000 7faef1600640 1 --2- 172.21.15.8:0/2741173150 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7faed4067660 0x7faed4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:15.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.923+0000 7faef1600640 1 -- 172.21.15.8:0/2741173150 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7faeec0866d0 con 0x7faef406edc0 2024-03-23T23:45:15.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.923+0000 7faef8e00640 1 --2- 172.21.15.8:0/2741173150 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7faed4067660 0x7faed4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:15.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.927+0000 7faef8e00640 1 --2- 172.21.15.8:0/2741173150 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7faed4067660 0x7faed4069b20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7faef40ad810 tx=0x7faee0007c80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:15.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:15.931+0000 7faef1600640 1 -- 172.21.15.8:0/2741173150 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7faeec022070 con 0x7faef406edc0 2024-03-23T23:45:16.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:16.395+0000 7faefac00640 1 -- 172.21.15.8:0/2741173150 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7faed0005da0 con 0x7faef406edc0 2024-03-23T23:45:16.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:16.395+0000 7faef1600640 1 -- 172.21.15.8:0/2741173150 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7faef4150400 con 0x7faef406edc0 2024-03-23T23:45:16.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:16.399+0000 7faefac00640 1 -- 172.21.15.8:0/2741173150 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7faed4067660 msgr2=0x7faed4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:16.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:16.399+0000 7faefac00640 1 --2- 172.21.15.8:0/2741173150 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7faed4067660 0x7faed4069b20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7faef40ad810 tx=0x7faee0007c80 comp rx=0 tx=0).stop 2024-03-23T23:45:16.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:16.399+0000 7faefac00640 1 -- 172.21.15.8:0/2741173150 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faef406edc0 msgr2=0x7faef414fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:16.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:16.399+0000 7faefac00640 1 --2- 172.21.15.8:0/2741173150 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faef406edc0 0x7faef414fec0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faeec00efc0 tx=0x7faeec00c490 comp rx=0 tx=0).stop 2024-03-23T23:45:16.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:16.399+0000 7faefac00640 1 -- 172.21.15.8:0/2741173150 shutdown_connections 2024-03-23T23:45:16.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:16.399+0000 7faefac00640 1 --2- 172.21.15.8:0/2741173150 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faef4152de0 0x7faef4150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:16.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:16.399+0000 7faefac00640 1 --2- 172.21.15.8:0/2741173150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faef40c14a0 0x7faef40ac9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:16.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:16.399+0000 7faefac00640 1 --2- 172.21.15.8:0/2741173150 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7faed4067660 0x7faed4069b20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:16.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:16.399+0000 7faefac00640 1 --2- 172.21.15.8:0/2741173150 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faef406edc0 0x7faef414fec0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:16.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:16.399+0000 7faefac00640 1 -- 172.21.15.8:0/2741173150 >> 172.21.15.8:0/2741173150 conn(0x7faef406c280 msgr2=0x7faef40c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:45:16.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:16.399+0000 7faefac00640 1 -- 172.21.15.8:0/2741173150 shutdown_connections 2024-03-23T23:45:16.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:16.399+0000 7faefac00640 1 -- 172.21.15.8:0/2741173150 wait complete. 2024-03-23T23:45:16.425 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-03-23T23:45:18.518 INFO:tasks.workunit.client.1.smithi196.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-03-23T23:45:19.535 INFO:tasks.workunit.client.1.smithi196.stdout:checking whether build environment is sane... yes 2024-03-23T23:45:19.552 INFO:tasks.workunit.client.1.smithi196.stdout:checking for a race-free mkdir -p... /usr/bin/mkdir -p 2024-03-23T23:45:19.553 INFO:tasks.workunit.client.1.smithi196.stdout:checking for gawk... gawk 2024-03-23T23:45:19.581 INFO:tasks.workunit.client.1.smithi196.stdout:checking whether make sets $(MAKE)... yes 2024-03-23T23:45:19.665 INFO:tasks.workunit.client.1.smithi196.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-03-23T23:45:19.665 INFO:tasks.workunit.client.1.smithi196.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-03-23T23:45:19.685 INFO:tasks.workunit.client.1.smithi196.stdout:checking for style of include used by make... GNU 2024-03-23T23:45:19.699 INFO:tasks.workunit.client.1.smithi196.stdout:checking for gcc... gcc 2024-03-23T23:45:19.997 INFO:tasks.workunit.client.1.smithi196.stdout:checking whether the C compiler works... yes 2024-03-23T23:45:19.997 INFO:tasks.workunit.client.1.smithi196.stdout:checking for C compiler default output file name... a.out 2024-03-23T23:45:20.091 INFO:tasks.workunit.client.1.smithi196.stdout:checking for suffix of executables... 2024-03-23T23:45:20.234 INFO:tasks.workunit.client.1.smithi196.stdout:checking whether we are cross compiling... no 2024-03-23T23:45:20.322 INFO:tasks.workunit.client.1.smithi196.stdout:checking for suffix of object files... o 2024-03-23T23:45:20.394 INFO:tasks.workunit.client.1.smithi196.stdout:checking whether the compiler supports GNU C... yes 2024-03-23T23:45:20.469 INFO:tasks.workunit.client.1.smithi196.stdout:checking whether gcc accepts -g... yes 2024-03-23T23:45:20.598 INFO:tasks.workunit.client.1.smithi196.stdout:checking for gcc option to enable C11 features... none needed 2024-03-23T23:45:20.873 INFO:tasks.workunit.client.1.smithi196.stdout:checking dependency style of gcc... gcc3 2024-03-23T23:45:21.022 INFO:tasks.workunit.client.1.smithi196.stdout:checking for stdio.h... yes 2024-03-23T23:45:21.103 INFO:tasks.workunit.client.1.smithi196.stdout:checking for stdlib.h... yes 2024-03-23T23:45:21.203 INFO:tasks.workunit.client.1.smithi196.stdout:checking for string.h... yes 2024-03-23T23:45:21.299 INFO:tasks.workunit.client.1.smithi196.stdout:checking for inttypes.h... yes 2024-03-23T23:45:21.445 INFO:tasks.workunit.client.1.smithi196.stdout:checking for stdint.h... yes 2024-03-23T23:45:21.585 INFO:tasks.workunit.client.1.smithi196.stdout:checking for strings.h... yes 2024-03-23T23:45:21.674 INFO:tasks.workunit.client.1.smithi196.stdout:checking for sys/stat.h... yes 2024-03-23T23:45:21.800 INFO:tasks.workunit.client.1.smithi196.stdout:checking for sys/types.h... yes 2024-03-23T23:45:21.929 INFO:tasks.workunit.client.1.smithi196.stdout:checking for unistd.h... yes 2024-03-23T23:45:22.103 INFO:tasks.workunit.client.1.smithi196.stdout:checking for wchar.h... yes 2024-03-23T23:45:22.213 INFO:tasks.workunit.client.1.smithi196.stdout:checking for minix/config.h... no 2024-03-23T23:45:22.302 INFO:tasks.workunit.client.1.smithi196.stdout:checking for sys/time.h... yes 2024-03-23T23:45:22.411 INFO:tasks.workunit.client.1.smithi196.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-03-23T23:45:22.579 INFO:tasks.workunit.client.1.smithi196.stdout:checking whether _XOPEN_SOURCE should be defined... no 2024-03-23T23:45:22.582 INFO:tasks.workunit.client.1.smithi196.stdout:checking for gcc... (cached) gcc 2024-03-23T23:45:22.864 INFO:tasks.workunit.client.1.smithi196.stdout:checking whether the compiler supports GNU C... (cached) yes 2024-03-23T23:45:22.864 INFO:tasks.workunit.client.1.smithi196.stdout:checking whether gcc accepts -g... (cached) yes 2024-03-23T23:45:22.864 INFO:tasks.workunit.client.1.smithi196.stdout:checking for gcc option to enable C11 features... (cached) none needed 2024-03-23T23:45:22.864 INFO:tasks.workunit.client.1.smithi196.stdout:checking dependency style of gcc... (cached) gcc3 2024-03-23T23:45:22.992 INFO:tasks.workunit.client.1.smithi196.stdout:checking for main in -lm... yes 2024-03-23T23:45:23.136 INFO:tasks.workunit.client.1.smithi196.stdout:checking for main in -lpthread... yes 2024-03-23T23:45:23.141 INFO:tasks.workunit.client.1.smithi196.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-03-23T23:45:23.144 INFO:tasks.workunit.client.1.smithi196.stdout:checking for egrep... /usr/bin/grep -E 2024-03-23T23:45:23.281 INFO:tasks.workunit.client.1.smithi196.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-03-23T23:45:23.450 INFO:tasks.workunit.client.1.smithi196.stdout:checking for pthread.h... yes 2024-03-23T23:45:23.541 INFO:tasks.workunit.client.1.smithi196.stdout:checking for fcntl.h... yes 2024-03-23T23:45:23.666 INFO:tasks.workunit.client.1.smithi196.stdout:checking for limits.h... yes 2024-03-23T23:45:23.668 INFO:tasks.workunit.client.1.smithi196.stdout:checking for stdint.h... (cached) yes 2024-03-23T23:45:23.668 INFO:tasks.workunit.client.1.smithi196.stdout:checking for sys/time.h... (cached) yes 2024-03-23T23:45:23.668 INFO:tasks.workunit.client.1.smithi196.stdout:checking for unistd.h... (cached) yes 2024-03-23T23:45:23.786 INFO:tasks.workunit.client.1.smithi196.stdout:checking for sys/vfs.h... yes 2024-03-23T23:45:23.944 INFO:tasks.workunit.client.1.smithi196.stdout:checking for sys/limits.h... no 2024-03-23T23:45:24.105 INFO:tasks.workunit.client.1.smithi196.stdout:checking for an ANSI C-conforming const... yes 2024-03-23T23:45:24.306 INFO:tasks.workunit.client.1.smithi196.stdout:checking for system... yes 2024-03-23T23:45:24.411 INFO:tasks.workunit.client.1.smithi196.stdout:checking for gettimeofday... yes 2024-03-23T23:45:24.545 INFO:tasks.workunit.client.1.smithi196.stdout:checking for mkdir... yes 2024-03-23T23:45:24.666 INFO:tasks.workunit.client.1.smithi196.stdout:checking for strerror... yes 2024-03-23T23:45:24.779 INFO:tasks.workunit.client.1.smithi196.stdout:checking for open64... yes 2024-03-23T23:45:24.908 INFO:tasks.workunit.client.1.smithi196.stdout:checking for stat64... yes 2024-03-23T23:45:25.132 INFO:tasks.workunit.client.1.smithi196.stdout:checking for fseeko64... yes 2024-03-23T23:45:25.350 INFO:tasks.workunit.client.1.smithi196.stdout:checking for lrand48_r... yes 2024-03-23T23:45:25.489 INFO:tasks.workunit.client.1.smithi196.stdout:checking for srand48_r... yes 2024-03-23T23:45:25.529 INFO:tasks.workunit.client.1.smithi196.stdout:configure: creating ./config.status 2024-03-23T23:45:25.712 INFO:tasks.workunit.client.1.smithi196.stdout: /bin/bash ./config.status 2024-03-23T23:45:25.898 INFO:tasks.workunit.client.1.smithi196.stdout:config.status: creating Makefile 2024-03-23T23:45:25.950 INFO:tasks.workunit.client.1.smithi196.stdout:config.status: creating config.h 2024-03-23T23:45:25.992 INFO:tasks.workunit.client.1.smithi196.stdout:config.status: executing depfiles commands 2024-03-23T23:45:26.028 INFO:tasks.workunit.client.1.smithi196.stdout:config.status: executing default commands 2024-03-23T23:45:26.076 INFO:tasks.workunit.client.1.smithi196.stdout:cd . && /bin/bash /home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing --run autoheader 2024-03-23T23:45:26.156 INFO:tasks.workunit.client.1.smithi196.stderr:autoheader: warning: autoconf input should be named 'configure.ac', not 'configure.in' 2024-03-23T23:45:26.269 INFO:tasks.workunit.client.1.smithi196.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-03-23T23:45:26.270 INFO:tasks.workunit.client.1.smithi196.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-03-23T23:45:26.270 INFO:tasks.workunit.client.1.smithi196.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-03-23T23:45:26.270 INFO:tasks.workunit.client.1.smithi196.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-03-23T23:45:26.426 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T23:45:26.426 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:45:26.473 INFO:tasks.workunit.client.1.smithi196.stdout:rm -f stamp-h1 2024-03-23T23:45:26.482 INFO:tasks.workunit.client.1.smithi196.stdout:touch config.h.in 2024-03-23T23:45:26.492 INFO:tasks.workunit.client.1.smithi196.stdout:cd . && /bin/bash ./config.status config.h 2024-03-23T23:45:26.653 INFO:tasks.workunit.client.1.smithi196.stdout:config.status: creating config.h 2024-03-23T23:45:26.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.651+0000 7f456c800640 1 Processor -- start 2024-03-23T23:45:26.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.651+0000 7f456c800640 1 -- start start 2024-03-23T23:45:26.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.655+0000 7f456c800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4564070e90 0x7f4564152630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:26.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.655+0000 7f456c800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4564152b70 con 0x7f45640ac250 2024-03-23T23:45:26.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.655+0000 7f456c800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4564152e10 con 0x7f45641562c0 2024-03-23T23:45:26.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.655+0000 7f456c800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4564155e30 con 0x7f4564070e90 2024-03-23T23:45:26.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.655+0000 7f4569e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4564070e90 0x7f4564152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:26.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.655+0000 7f4569e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4564070e90 0x7f4564152630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:48828/0 (socket says 172.21.15.8:48828) 2024-03-23T23:45:26.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.655+0000 7f4569e00640 1 -- 172.21.15.8:0/2844626812 learned_addr learned my addr 172.21.15.8:0/2844626812 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:45:26.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.655+0000 7f456a800640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f45641562c0 0x7f456414c270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:44322/0 (socket says 172.21.15.8:44322) 2024-03-23T23:45:26.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.655+0000 7f4569e00640 1 -- 172.21.15.8:0/2844626812 >> v1:172.21.15.196:6789/0 conn(0x7f45641562c0 legacy=0x7f456414c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:26.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.655+0000 7f4569e00640 1 -- 172.21.15.8:0/2844626812 >> v1:172.21.15.8:6789/0 conn(0x7f45640ac250 legacy=0x7f45640c2ee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:45:26.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.655+0000 7f4569e00640 1 -- 172.21.15.8:0/2844626812 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4564158fa0 con 0x7f4564070e90 2024-03-23T23:45:26.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.659+0000 7f4569e00640 1 --2- 172.21.15.8:0/2844626812 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4564070e90 0x7f4564152630 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4558011f90 tx=0x7f455802d390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8d9a27d4d13022c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:26.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.663+0000 7f4568a00640 1 -- 172.21.15.8:0/2844626812 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45580c2070 con 0x7f4564070e90 2024-03-23T23:45:26.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.663+0000 7f4568a00640 1 -- 172.21.15.8:0/2844626812 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45580110d0 con 0x7f4564070e90 2024-03-23T23:45:26.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.663+0000 7f4568a00640 1 -- 172.21.15.8:0/2844626812 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45580114a0 con 0x7f4564070e90 2024-03-23T23:45:26.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.663+0000 7f456c800640 1 -- 172.21.15.8:0/2844626812 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4564070e90 msgr2=0x7f4564152630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:26.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.663+0000 7f456c800640 1 --2- 172.21.15.8:0/2844626812 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4564070e90 0x7f4564152630 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4558011f90 tx=0x7f455802d390 comp rx=0 tx=0).stop 2024-03-23T23:45:26.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.663+0000 7f456c800640 1 -- 172.21.15.8:0/2844626812 shutdown_connections 2024-03-23T23:45:26.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.663+0000 7f456c800640 1 --2- 172.21.15.8:0/2844626812 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4564070e90 0x7f4564152630 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:26.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.663+0000 7f456c800640 1 -- 172.21.15.8:0/2844626812 >> 172.21.15.8:0/2844626812 conn(0x7f456406b170 msgr2=0x7f456406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:45:26.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.663+0000 7f456c800640 1 -- 172.21.15.8:0/2844626812 shutdown_connections 2024-03-23T23:45:26.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.667+0000 7f456c800640 1 -- 172.21.15.8:0/2844626812 wait complete. 2024-03-23T23:45:26.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.667+0000 7f456c800640 1 Processor -- start 2024-03-23T23:45:26.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.667+0000 7f456c800640 1 -- start start 2024-03-23T23:45:26.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.671+0000 7f456c800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4564070e90 0x7f4564147770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:26.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.671+0000 7f456c800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45640ac250 0x7f4564147cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:26.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.671+0000 7f456c800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45641562c0 0x7f45640c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:26.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.671+0000 7f456c800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456414cb00 con 0x7f4564070e90 2024-03-23T23:45:26.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.671+0000 7f456c800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456414c980 con 0x7f45640ac250 2024-03-23T23:45:26.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.671+0000 7f456c800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456415f9d0 con 0x7f45641562c0 2024-03-23T23:45:26.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.671+0000 7f456a800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45641562c0 0x7f45640c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:26.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.671+0000 7f456a800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45641562c0 0x7f45640c5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:40208/0 (socket says 172.21.15.8:40208) 2024-03-23T23:45:26.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.671+0000 7f456a800640 1 -- 172.21.15.8:0/3208838077 learned_addr learned my addr 172.21.15.8:0/3208838077 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:45:26.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.671+0000 7f4569e00640 1 --2- 172.21.15.8:0/3208838077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4564070e90 0x7f4564147770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:26.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.671+0000 7f4569400640 1 --2- 172.21.15.8:0/3208838077 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45640ac250 0x7f4564147cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:26.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.671+0000 7f4569e00640 1 -- 172.21.15.8:0/3208838077 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45641562c0 msgr2=0x7f45640c5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:26.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.671+0000 7f4569e00640 1 --2- 172.21.15.8:0/3208838077 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45641562c0 0x7f45640c5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:26.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.671+0000 7f4569e00640 1 -- 172.21.15.8:0/3208838077 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45640ac250 msgr2=0x7f4564147cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:26.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.671+0000 7f4569e00640 1 --2- 172.21.15.8:0/3208838077 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45640ac250 0x7f4564147cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:26.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.671+0000 7f4569e00640 1 -- 172.21.15.8:0/3208838077 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4564154520 con 0x7f4564070e90 2024-03-23T23:45:26.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.671+0000 7f4569e00640 1 --2- 172.21.15.8:0/3208838077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4564070e90 0x7f4564147770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f45580bc000 tx=0x7f455802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:26.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.671+0000 7f455e000640 1 -- 172.21.15.8:0/3208838077 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45580cc020 con 0x7f4564070e90 2024-03-23T23:45:26.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.671+0000 7f455e000640 1 -- 172.21.15.8:0/3208838077 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455800fc00 con 0x7f4564070e90 2024-03-23T23:45:26.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.671+0000 7f455e000640 1 -- 172.21.15.8:0/3208838077 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45580cc020 con 0x7f4564070e90 2024-03-23T23:45:26.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.671+0000 7f456c800640 1 -- 172.21.15.8:0/3208838077 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45641eac20 con 0x7f4564070e90 2024-03-23T23:45:26.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.671+0000 7f456c800640 1 -- 172.21.15.8:0/3208838077 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45641eaf00 con 0x7f4564070e90 2024-03-23T23:45:26.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.675+0000 7f456c800640 1 -- 172.21.15.8:0/3208838077 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f456404f480 con 0x7f4564070e90 2024-03-23T23:45:26.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.675+0000 7f455e000640 1 -- 172.21.15.8:0/3208838077 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f45580cf020 con 0x7f4564070e90 2024-03-23T23:45:26.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.679+0000 7f455e000640 1 --2- 172.21.15.8:0/3208838077 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4548067860 0x7f4548069d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:26.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.679+0000 7f455e000640 1 -- 172.21.15.8:0/3208838077 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f4558130860 con 0x7f4564070e90 2024-03-23T23:45:26.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.679+0000 7f4569400640 1 --2- 172.21.15.8:0/3208838077 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4548067860 0x7f4548069d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:26.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.679+0000 7f4569400640 1 --2- 172.21.15.8:0/3208838077 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4548067860 0x7f4548069d20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f45641496b0 tx=0x7f45600094f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:26.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:26.691+0000 7f455e000640 1 -- 172.21.15.8:0/3208838077 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f45580d6030 con 0x7f4564070e90 2024-03-23T23:45:26.770 INFO:tasks.workunit.client.1.smithi196.stdout:make all-am 2024-03-23T23:45:26.777 INFO:tasks.workunit.client.1.smithi196.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb' 2024-03-23T23:45:26.777 INFO:tasks.workunit.client.1.smithi196.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-03-23T23:45:27.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.035+0000 7f456c800640 1 -- 172.21.15.8:0/3208838077 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f456406b960 con 0x7f4564070e90 2024-03-23T23:45:27.043 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":18,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:45:27.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.039+0000 7f455e000640 1 -- 172.21.15.8:0/3208838077 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1561 (secure 0 0 0) 0x7f4558027010 con 0x7f4564070e90 2024-03-23T23:45:27.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.043+0000 7f456c800640 1 -- 172.21.15.8:0/3208838077 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4548067860 msgr2=0x7f4548069d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:27.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.043+0000 7f456c800640 1 --2- 172.21.15.8:0/3208838077 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4548067860 0x7f4548069d20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f45641496b0 tx=0x7f45600094f0 comp rx=0 tx=0).stop 2024-03-23T23:45:27.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.043+0000 7f456c800640 1 -- 172.21.15.8:0/3208838077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4564070e90 msgr2=0x7f4564147770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:27.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.043+0000 7f456c800640 1 --2- 172.21.15.8:0/3208838077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4564070e90 0x7f4564147770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f45580bc000 tx=0x7f455802a130 comp rx=0 tx=0).stop 2024-03-23T23:45:27.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.043+0000 7f456c800640 1 -- 172.21.15.8:0/3208838077 shutdown_connections 2024-03-23T23:45:27.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.043+0000 7f456c800640 1 --2- 172.21.15.8:0/3208838077 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4548067860 0x7f4548069d20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:27.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.043+0000 7f456c800640 1 --2- 172.21.15.8:0/3208838077 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45641562c0 0x7f45640c5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:27.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.043+0000 7f456c800640 1 --2- 172.21.15.8:0/3208838077 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45640ac250 0x7f4564147cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:27.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.043+0000 7f456c800640 1 --2- 172.21.15.8:0/3208838077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4564070e90 0x7f4564147770 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:27.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.043+0000 7f456c800640 1 -- 172.21.15.8:0/3208838077 >> 172.21.15.8:0/3208838077 conn(0x7f456406b170 msgr2=0x7f45640c3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:45:27.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.043+0000 7f456c800640 1 -- 172.21.15.8:0/3208838077 shutdown_connections 2024-03-23T23:45:27.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.043+0000 7f456c800640 1 -- 172.21.15.8:0/3208838077 wait complete. 2024-03-23T23:45:27.064 INFO:tasks.workunit.client.1.smithi196.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-03-23T23:45:27.077 INFO:tasks.workunit.client.1.smithi196.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-03-23T23:45:27.098 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T23:45:27.099 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-03-23T23:45:27.099 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T23:45:27.099 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:45:27.272 INFO:tasks.workunit.client.1.smithi196.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-03-23T23:45:27.293 INFO:tasks.workunit.client.1.smithi196.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-03-23T23:45:27.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.351+0000 7fc6ac200640 1 Processor -- start 2024-03-23T23:45:27.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.351+0000 7fc6ac200640 1 -- start start 2024-03-23T23:45:27.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.351+0000 7fc6ac200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6a40c1d20 0x7fc6a40c2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:27.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.351+0000 7fc6ac200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc6a4072890 0x7fc6a40c2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:27.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.351+0000 7fc6ac200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a40c0740 con 0x7fc6a4153060 2024-03-23T23:45:27.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.351+0000 7fc6ac200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a40c0a20 con 0x7fc6a4072890 2024-03-23T23:45:27.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.351+0000 7fc6ac200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a40c0d00 con 0x7fc6a40c1d20 2024-03-23T23:45:27.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.351+0000 7fc6a8e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6a40c1d20 0x7fc6a40c2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:27.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.355+0000 7fc6a8e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6a40c1d20 0x7fc6a40c2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:40210/0 (socket says 172.21.15.8:40210) 2024-03-23T23:45:27.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.355+0000 7fc6a8e00640 1 -- 172.21.15.8:0/1142601792 learned_addr learned my addr 172.21.15.8:0/1142601792 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:45:27.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.355+0000 7fc6a8e00640 1 -- 172.21.15.8:0/1142601792 >> v2:172.21.15.8:3300/0 conn(0x7fc6a4072890 msgr2=0x7fc6a40c2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:45:27.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.355+0000 7fc6a8e00640 1 --2- 172.21.15.8:0/1142601792 >> v2:172.21.15.8:3300/0 conn(0x7fc6a4072890 0x7fc6a40c2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:27.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.355+0000 7fc6a8e00640 1 -- 172.21.15.8:0/1142601792 >> v1:172.21.15.8:6789/0 conn(0x7fc6a4153060 legacy=0x7fc6a40c3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:45:27.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.355+0000 7fc6a8e00640 1 -- 172.21.15.8:0/1142601792 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a40c0fe0 con 0x7fc6a40c1d20 2024-03-23T23:45:27.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.355+0000 7fc6a8e00640 1 --2- 172.21.15.8:0/1142601792 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6a40c1d20 0x7fc6a40c2770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc690009870 tx=0x7fc69001c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eaa3870681611e32 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:27.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.359+0000 7fc6a3e00640 1 -- 172.21.15.8:0/1142601792 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6900b2070 con 0x7fc6a40c1d20 2024-03-23T23:45:27.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.359+0000 7fc6a3e00640 1 -- 172.21.15.8:0/1142601792 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6900a9070 con 0x7fc6a40c1d20 2024-03-23T23:45:27.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.359+0000 7fc6a3e00640 1 -- 172.21.15.8:0/1142601792 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6900ad880 con 0x7fc6a40c1d20 2024-03-23T23:45:27.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.359+0000 7fc6ac200640 1 -- 172.21.15.8:0/1142601792 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6a40c1d20 msgr2=0x7fc6a40c2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:27.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.359+0000 7fc6ac200640 1 --2- 172.21.15.8:0/1142601792 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6a40c1d20 0x7fc6a40c2770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc690009870 tx=0x7fc69001c490 comp rx=0 tx=0).stop 2024-03-23T23:45:27.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.359+0000 7fc6ac200640 1 -- 172.21.15.8:0/1142601792 shutdown_connections 2024-03-23T23:45:27.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.359+0000 7fc6ac200640 1 --2- 172.21.15.8:0/1142601792 >> v2:172.21.15.8:3300/0 conn(0x7fc6a4072890 0x7fc6a40c2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:27.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.359+0000 7fc6ac200640 1 --2- 172.21.15.8:0/1142601792 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6a40c1d20 0x7fc6a40c2770 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:27.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.359+0000 7fc6ac200640 1 -- 172.21.15.8:0/1142601792 >> 172.21.15.8:0/1142601792 conn(0x7fc6a40a9870 msgr2=0x7fc6a406b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:45:27.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.359+0000 7fc6ac200640 1 -- 172.21.15.8:0/1142601792 shutdown_connections 2024-03-23T23:45:27.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.359+0000 7fc6ac200640 1 -- 172.21.15.8:0/1142601792 wait complete. 2024-03-23T23:45:27.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.359+0000 7fc6ac200640 1 Processor -- start 2024-03-23T23:45:27.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.359+0000 7fc6ac200640 1 -- start start 2024-03-23T23:45:27.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.359+0000 7fc6ac200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6a4072890 0x7fc6a414b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:27.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.359+0000 7fc6ac200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6a40c1d20 0x7fc6a4150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:27.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.359+0000 7fc6ac200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6a4153060 0x7fc6a41f2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:27.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.359+0000 7fc6ac200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a4162e50 con 0x7fc6a4153060 2024-03-23T23:45:27.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.359+0000 7fc6ac200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a4162cd0 con 0x7fc6a40c1d20 2024-03-23T23:45:27.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.359+0000 7fc6ac200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a4162fd0 con 0x7fc6a4072890 2024-03-23T23:45:27.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.359+0000 7fc6a9800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6a4072890 0x7fc6a414b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:27.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.363+0000 7fc6a9800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6a4072890 0x7fc6a414b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:40212/0 (socket says 172.21.15.8:40212) 2024-03-23T23:45:27.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.363+0000 7fc6a9800640 1 -- 172.21.15.8:0/417740199 learned_addr learned my addr 172.21.15.8:0/417740199 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:45:27.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.363+0000 7fc6a8e00640 1 --2- 172.21.15.8:0/417740199 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6a40c1d20 0x7fc6a4150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:27.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.363+0000 7fc6aa200640 1 --2- 172.21.15.8:0/417740199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6a4153060 0x7fc6a41f2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:27.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.363+0000 7fc6a9800640 1 -- 172.21.15.8:0/417740199 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6a40c1d20 msgr2=0x7fc6a4150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:27.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.363+0000 7fc6a9800640 1 --2- 172.21.15.8:0/417740199 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6a40c1d20 0x7fc6a4150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:27.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.363+0000 7fc6a9800640 1 -- 172.21.15.8:0/417740199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6a4153060 msgr2=0x7fc6a41f2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:27.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.363+0000 7fc6a9800640 1 --2- 172.21.15.8:0/417740199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6a4153060 0x7fc6a41f2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:27.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.363+0000 7fc6a9800640 1 -- 172.21.15.8:0/417740199 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a40aa8e0 con 0x7fc6a4072890 2024-03-23T23:45:27.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.363+0000 7fc6a9800640 1 --2- 172.21.15.8:0/417740199 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6a4072890 0x7fc6a414b920 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc69800b3e0 tx=0x7fc69800b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:27.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.363+0000 7fc6a1600640 1 -- 172.21.15.8:0/417740199 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc698015020 con 0x7fc6a4072890 2024-03-23T23:45:27.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.363+0000 7fc6a1600640 1 -- 172.21.15.8:0/417740199 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc698011850 con 0x7fc6a4072890 2024-03-23T23:45:27.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.363+0000 7fc6a1600640 1 -- 172.21.15.8:0/417740199 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc698011c40 con 0x7fc6a4072890 2024-03-23T23:45:27.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.363+0000 7fc6ac200640 1 -- 172.21.15.8:0/417740199 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a40ad020 con 0x7fc6a4072890 2024-03-23T23:45:27.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.363+0000 7fc6ac200640 1 -- 172.21.15.8:0/417740199 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a41f2600 con 0x7fc6a4072890 2024-03-23T23:45:27.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.363+0000 7fc6ac200640 1 --2- 172.21.15.8:0/417740199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6a40ac8c0 0x7fc6a414a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:27.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.363+0000 7fc6ac200640 1 -- 172.21.15.8:0/417740199 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a41f2840 con 0x7fc6a40ac8c0 2024-03-23T23:45:27.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.363+0000 7fc6a1600640 1 -- 172.21.15.8:0/417740199 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc698018020 con 0x7fc6a4072890 2024-03-23T23:45:27.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.367+0000 7fc6a8e00640 1 --2- 172.21.15.8:0/417740199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6a40ac8c0 0x7fc6a414a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:27.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.367+0000 7fc6a8e00640 1 -- 172.21.15.8:0/417740199 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc6a4068270 con 0x7fc6a40ac8c0 2024-03-23T23:45:27.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.367+0000 7fc6a8e00640 1 --2- 172.21.15.8:0/417740199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6a40ac8c0 0x7fc6a414a7f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc6a40c82a0 tx=0x7fc690019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:27.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.367+0000 7fc6a1600640 1 --2- 172.21.15.8:0/417740199 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc684067760 0x7fc684069c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:27.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.367+0000 7fc6a1600640 1 -- 172.21.15.8:0/417740199 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fc6980856d0 con 0x7fc6a4072890 2024-03-23T23:45:27.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.367+0000 7fc6a1600640 1 -- 172.21.15.8:0/417740199 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6900bd070 con 0x7fc6a40ac8c0 2024-03-23T23:45:27.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.367+0000 7fc6a1600640 1 -- 172.21.15.8:0/417740199 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fc6900a9040 con 0x7fc6a40ac8c0 2024-03-23T23:45:27.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.367+0000 7fc6a1600640 1 -- 172.21.15.8:0/417740199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6a40ac8c0 msgr2=0x7fc6a414a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:27.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.367+0000 7fc6a1600640 1 --2- 172.21.15.8:0/417740199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6a40ac8c0 0x7fc6a414a7f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc6a40c82a0 tx=0x7fc690019230 comp rx=0 tx=0).stop 2024-03-23T23:45:27.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.367+0000 7fc6a1600640 1 -- 172.21.15.8:0/417740199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6a40ac8c0 msgr2=0x7fc6a414a7f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:45:27.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.367+0000 7fc6a1600640 1 --2- 172.21.15.8:0/417740199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6a40ac8c0 0x7fc6a414a7f0 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc6a40c82a0 tx=0x7fc690019230 comp rx=0 tx=0).stop 2024-03-23T23:45:27.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.371+0000 7fc6aa200640 1 --2- 172.21.15.8:0/417740199 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc684067760 0x7fc684069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:27.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.371+0000 7fc6aa200640 1 --2- 172.21.15.8:0/417740199 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc684067760 0x7fc684069c20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc6a40aaf90 tx=0x7fc69c011e60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:27.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.383+0000 7fc6ac200640 1 --2- 172.21.15.8:0/417740199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6a40aa390 0x7fc6a414ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:27.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.383+0000 7fc6ac200640 1 -- 172.21.15.8:0/417740199 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a40731f0 con 0x7fc6a40aa390 2024-03-23T23:45:27.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.383+0000 7fc6a8e00640 1 --2- 172.21.15.8:0/417740199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6a40aa390 0x7fc6a414ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:27.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.383+0000 7fc6a8e00640 1 -- 172.21.15.8:0/417740199 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc6a4073640 con 0x7fc6a40aa390 2024-03-23T23:45:27.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.383+0000 7fc6a8e00640 1 --2- 172.21.15.8:0/417740199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6a40aa390 0x7fc6a414ad30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc69001ab40 tx=0x7fc690008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:27.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.383+0000 7fc6a1600640 1 -- 172.21.15.8:0/417740199 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6900b2040 con 0x7fc6a40aa390 2024-03-23T23:45:27.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.383+0000 7fc6a1600640 1 -- 172.21.15.8:0/417740199 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5185 (secure 0 0 0) 0x7fc6900b7900 con 0x7fc6a40aa390 2024-03-23T23:45:27.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.383+0000 7fc6a1600640 1 -- 172.21.15.8:0/417740199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6a40aa390 msgr2=0x7fc6a414ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:27.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.383+0000 7fc6a1600640 1 --2- 172.21.15.8:0/417740199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6a40aa390 0x7fc6a414ad30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc69001ab40 tx=0x7fc690008040 comp rx=0 tx=0).stop 2024-03-23T23:45:27.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.383+0000 7fc6a1600640 1 -- 172.21.15.8:0/417740199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6a40aa390 msgr2=0x7fc6a414ad30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:45:27.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.383+0000 7fc6a1600640 1 --2- 172.21.15.8:0/417740199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6a40aa390 0x7fc6a414ad30 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc69001ab40 tx=0x7fc690008040 comp rx=0 tx=0).stop 2024-03-23T23:45:27.389 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:45:27.389 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:45:27.389 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:45:27.389 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:45:27.389 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 18, 2024-03-23T23:45:27.389 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:45:27.389 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:45:27.389 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:45:27.389 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:45:27.389 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:27.390 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 12, 2024-03-23T23:45:27.390 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:45:27.390 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:45:27.390 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:45:27.390 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:45:27.390 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:45:27.390 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:45:27.390 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:45:27.390 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:45:27.390 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:45:27.390 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:45:27.390 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:45:27.390 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:45:27.390 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:45:27.391 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:45:27.391 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:27.391 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:45:27.391 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:45:27.391 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:45:27.391 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:45:27.391 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:45:27.391 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:45:27.391 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:45:27.391 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:45:27.391 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:45:27.391 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:45:27.391 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:45:27.391 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:45:27.392 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:45:27.392 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:27.392 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.392 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:45:27.392 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:45:27.392 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:45:27.392 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:45:27.392 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:45:27.392 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:45:27.392 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:45:27.392 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:45:27.392 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:45:27.392 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:45:27.392 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:45:27.393 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:45:27.393 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:45:27.393 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:45:27.393 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:45:27.393 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:45:27.393 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:45:27.393 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:45:27.393 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:45:27.393 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:45:27.393 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:45:27.393 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:45:27.393 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:45:27.393 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:45:27.393 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:45:27.394 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:45:27.394 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:45:27.394 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:45:27.394 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:27.394 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:45:27.394 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.394 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:45:27.394 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.394 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:45:27.394 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:45:27.394 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:45:27.394 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:45:27.394 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.395 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:45:27.395 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:45:27.395 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:27.395 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.395 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.395 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:45:27.395 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:45:27.395 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:27.395 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:27.395 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:27.395 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.395 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:45:27.395 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:45:27.395 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:45:27.396 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:45:27.396 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:45:27.396 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.396 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.396 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:45:27.396 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:45:27.396 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:45:27.396 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:45:27.396 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.396 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:45:27.396 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:45:27.396 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:27.396 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.396 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.397 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:45:27.397 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:45:27.397 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:27.397 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:27.397 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:27.397 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.397 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:45:27.397 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:45:27.397 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:45:27.397 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:45:27.397 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:45:27.397 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.397 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.397 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:45:27.398 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:45:27.398 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:45:27.398 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:45:27.398 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.398 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:45:27.398 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:45:27.398 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:27.398 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.398 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.398 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:45:27.398 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:45:27.398 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:27.398 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:27.398 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:27.399 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.399 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:45:27.399 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:45:27.399 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:45:27.399 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:45:27.399 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:45:27.399 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:27.399 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:27.399 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.399 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:45:27.399 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:45:27.399 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.399 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:45:27.399 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:27.400 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:45:27.400 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:27.400 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:27.400 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:45:27.400 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.400 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:45:27.400 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:27.400 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:45:27.400 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:27.400 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:27.400 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:45:27.400 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.400 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:45:27.400 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:27.401 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:45:27.401 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:27.401 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:27.401 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:45:27.401 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.401 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:45:27.401 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:27.401 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:45:27.401 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.401 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.401 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:45:27.401 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:27.401 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:45:27.401 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:27.402 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:27.402 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:45:27.402 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.402 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:45:27.402 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:27.402 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:45:27.402 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:27.402 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:27.402 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.402 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:45:27.402 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:45:27.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.387+0000 7fc6ac200640 1 -- 172.21.15.8:0/417740199 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc684067760 msgr2=0x7fc684069c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:27.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.387+0000 7fc6ac200640 1 --2- 172.21.15.8:0/417740199 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc684067760 0x7fc684069c20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc6a40aaf90 tx=0x7fc69c011e60 comp rx=0 tx=0).stop 2024-03-23T23:45:27.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.387+0000 7fc6ac200640 1 -- 172.21.15.8:0/417740199 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6a4072890 msgr2=0x7fc6a414b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:27.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.387+0000 7fc6ac200640 1 --2- 172.21.15.8:0/417740199 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6a4072890 0x7fc6a414b920 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc69800b3e0 tx=0x7fc69800b8a0 comp rx=0 tx=0).stop 2024-03-23T23:45:27.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.387+0000 7fc6aa200640 1 -- 172.21.15.8:0/417740199 reap_dead start 2024-03-23T23:45:27.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.387+0000 7fc6aa200640 1 -- 172.21.15.8:0/417740199 reap_dead start 2024-03-23T23:45:27.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.387+0000 7fc6ac200640 1 -- 172.21.15.8:0/417740199 shutdown_connections 2024-03-23T23:45:27.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.387+0000 7fc6ac200640 1 -- 172.21.15.8:0/417740199 >> 172.21.15.8:0/417740199 conn(0x7fc6a40a9870 msgr2=0x7fc6a406b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:45:27.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.387+0000 7fc6ac200640 1 -- 172.21.15.8:0/417740199 shutdown_connections 2024-03-23T23:45:27.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.387+0000 7fc6ac200640 1 -- 172.21.15.8:0/417740199 wait complete. 2024-03-23T23:45:27.408 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:45:27.408 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T23:45:27.408 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:45:27.489 INFO:tasks.workunit.client.1.smithi196.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-03-23T23:45:27.537 INFO:tasks.workunit.client.1.smithi196.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-03-23T23:45:27.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.639+0000 7f9097200640 1 Processor -- start 2024-03-23T23:45:27.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.639+0000 7f9097200640 1 -- start start 2024-03-23T23:45:27.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.639+0000 7f9097200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9090152ef0 0x7f9090071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:27.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.639+0000 7f9097200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90900724e0 0x7f9090155980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:27.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.639+0000 7f9097200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9090072b40 con 0x7f909006fd80 2024-03-23T23:45:27.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.639+0000 7f9097200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9090159eb0 con 0x7f9090152ef0 2024-03-23T23:45:27.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.639+0000 7f9097200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9090159a20 con 0x7f90900724e0 2024-03-23T23:45:27.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.639+0000 7f908fe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9090152ef0 0x7f9090071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:27.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.639+0000 7f908fe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9090152ef0 0x7f9090071fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59630/0 (socket says 172.21.15.8:59630) 2024-03-23T23:45:27.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.639+0000 7f908fe00640 1 -- 172.21.15.8:0/2715795828 learned_addr learned my addr 172.21.15.8:0/2715795828 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:45:27.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.639+0000 7f908f400640 1 --2- 172.21.15.8:0/2715795828 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90900724e0 0x7f9090155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:27.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.643+0000 7f908fe00640 1 -- 172.21.15.8:0/2715795828 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90900724e0 msgr2=0x7f9090155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:45:27.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.643+0000 7f908fe00640 1 --2- 172.21.15.8:0/2715795828 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90900724e0 0x7f9090155980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:27.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.643+0000 7f908fe00640 1 -- 172.21.15.8:0/2715795828 >> v1:172.21.15.196:6789/0 conn(0x7f909006fd80 legacy=0x7f9090155ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:27.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.643+0000 7f908fe00640 1 -- 172.21.15.8:0/2715795828 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90901590f0 con 0x7f9090152ef0 2024-03-23T23:45:27.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.643+0000 7f908fe00640 1 --2- 172.21.15.8:0/2715795828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9090152ef0 0x7f9090071fa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9080009870 tx=0x7f908001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5465fe5696a325ac server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:27.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.643+0000 7f908ea00640 1 -- 172.21.15.8:0/2715795828 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90800b0070 con 0x7f9090152ef0 2024-03-23T23:45:27.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.643+0000 7f908ea00640 1 -- 172.21.15.8:0/2715795828 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90800ab600 con 0x7f9090152ef0 2024-03-23T23:45:27.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.643+0000 7f908ea00640 1 -- 172.21.15.8:0/2715795828 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90800ab9d0 con 0x7f9090152ef0 2024-03-23T23:45:27.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.647+0000 7f9097200640 1 -- 172.21.15.8:0/2715795828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9090152ef0 msgr2=0x7f9090071fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:27.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.647+0000 7f9097200640 1 --2- 172.21.15.8:0/2715795828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9090152ef0 0x7f9090071fa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9080009870 tx=0x7f908001c440 comp rx=0 tx=0).stop 2024-03-23T23:45:27.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.647+0000 7f9097200640 1 -- 172.21.15.8:0/2715795828 shutdown_connections 2024-03-23T23:45:27.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.647+0000 7f9097200640 1 --2- 172.21.15.8:0/2715795828 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90900724e0 0x7f9090155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:27.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.647+0000 7f9097200640 1 --2- 172.21.15.8:0/2715795828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9090152ef0 0x7f9090071fa0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:27.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.647+0000 7f9097200640 1 -- 172.21.15.8:0/2715795828 >> 172.21.15.8:0/2715795828 conn(0x7f909006c280 msgr2=0x7f909006c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:45:27.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.647+0000 7f9097200640 1 -- 172.21.15.8:0/2715795828 shutdown_connections 2024-03-23T23:45:27.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.647+0000 7f9097200640 1 -- 172.21.15.8:0/2715795828 wait complete. 2024-03-23T23:45:27.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.647+0000 7f9097200640 1 Processor -- start 2024-03-23T23:45:27.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.647+0000 7f9097200640 1 -- start start 2024-03-23T23:45:27.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.651+0000 7f9097200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f909006fd80 0x7f90900c2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:27.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.651+0000 7f9097200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90900724e0 0x7f90900c3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:27.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.651+0000 7f9097200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9090152ef0 0x7f90900c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:27.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.651+0000 7f9097200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90900c1ff0 con 0x7f90900724e0 2024-03-23T23:45:27.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.651+0000 7f9097200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90900c1e70 con 0x7f9090152ef0 2024-03-23T23:45:27.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.651+0000 7f9097200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909006ee00 con 0x7f909006fd80 2024-03-23T23:45:27.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.651+0000 7f908f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90900724e0 0x7f90900c3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:27.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.651+0000 7f908fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f909006fd80 0x7f90900c2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:27.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.651+0000 7f908f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90900724e0 0x7f90900c3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59634/0 (socket says 172.21.15.8:59634) 2024-03-23T23:45:27.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.651+0000 7f908fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f909006fd80 0x7f90900c2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:40238/0 (socket says 172.21.15.8:40238) 2024-03-23T23:45:27.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.651+0000 7f908f400640 1 -- 172.21.15.8:0/2310292594 learned_addr learned my addr 172.21.15.8:0/2310292594 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:45:27.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.651+0000 7f9095200640 1 --2- 172.21.15.8:0/2310292594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9090152ef0 0x7f90900c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:27.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.651+0000 7f908f400640 1 -- 172.21.15.8:0/2310292594 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f909006fd80 msgr2=0x7f90900c2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:27.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.651+0000 7f908f400640 1 --2- 172.21.15.8:0/2310292594 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f909006fd80 0x7f90900c2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:27.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.651+0000 7f908f400640 1 -- 172.21.15.8:0/2310292594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9090152ef0 msgr2=0x7f90900c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:27.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.651+0000 7f908f400640 1 --2- 172.21.15.8:0/2310292594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9090152ef0 0x7f90900c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:27.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.651+0000 7f908f400640 1 -- 172.21.15.8:0/2310292594 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90900c31a0 con 0x7f90900724e0 2024-03-23T23:45:27.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.651+0000 7f908f400640 1 --2- 172.21.15.8:0/2310292594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90900724e0 0x7f90900c3d80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f907c00d800 tx=0x7f907c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:27.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.651+0000 7f9087e00640 1 -- 172.21.15.8:0/2310292594 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c00b6c0 con 0x7f90900724e0 2024-03-23T23:45:27.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.651+0000 7f9087e00640 1 -- 172.21.15.8:0/2310292594 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907c019070 con 0x7f90900724e0 2024-03-23T23:45:27.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.651+0000 7f9087e00640 1 -- 172.21.15.8:0/2310292594 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c00ba60 con 0x7f90900724e0 2024-03-23T23:45:27.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.651+0000 7f9097200640 1 -- 172.21.15.8:0/2310292594 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9090072180 con 0x7f90900724e0 2024-03-23T23:45:27.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.651+0000 7f9097200640 1 -- 172.21.15.8:0/2310292594 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90901545b0 con 0x7f90900724e0 2024-03-23T23:45:27.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.651+0000 7f9097200640 1 --2- 172.21.15.8:0/2310292594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9090154c00 0x7f909014c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:27.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.651+0000 7f9097200640 1 -- 172.21.15.8:0/2310292594 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90900c4800 con 0x7f9090154c00 2024-03-23T23:45:27.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.651+0000 7f908fe00640 1 --2- 172.21.15.8:0/2310292594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9090154c00 0x7f909014c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:27.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.655+0000 7f908fe00640 1 -- 172.21.15.8:0/2310292594 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9090068270 con 0x7f9090154c00 2024-03-23T23:45:27.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.655+0000 7f9087e00640 1 -- 172.21.15.8:0/2310292594 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f907c00bc00 con 0x7f90900724e0 2024-03-23T23:45:27.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.655+0000 7f908fe00640 1 --2- 172.21.15.8:0/2310292594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9090154c00 0x7f909014c870 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f90900c2ab0 tx=0x7f90800191e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:27.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.655+0000 7f9087e00640 1 --2- 172.21.15.8:0/2310292594 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9070067690 0x7f9070069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:27.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.655+0000 7f9087e00640 1 -- 172.21.15.8:0/2310292594 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f907c085f40 con 0x7f90900724e0 2024-03-23T23:45:27.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.655+0000 7f9087e00640 1 -- 172.21.15.8:0/2310292594 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90800b0040 con 0x7f9090154c00 2024-03-23T23:45:27.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.655+0000 7f9087e00640 1 -- 172.21.15.8:0/2310292594 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f90800b5440 con 0x7f9090154c00 2024-03-23T23:45:27.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.655+0000 7f9087e00640 1 -- 172.21.15.8:0/2310292594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9090154c00 msgr2=0x7f909014c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:27.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.655+0000 7f9087e00640 1 --2- 172.21.15.8:0/2310292594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9090154c00 0x7f909014c870 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f90900c2ab0 tx=0x7f90800191e0 comp rx=0 tx=0).stop 2024-03-23T23:45:27.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.655+0000 7f9087e00640 1 -- 172.21.15.8:0/2310292594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9090154c00 msgr2=0x7f909014c870 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:45:27.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.655+0000 7f9087e00640 1 --2- 172.21.15.8:0/2310292594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9090154c00 0x7f909014c870 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:27.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.655+0000 7f9095200640 1 --2- 172.21.15.8:0/2310292594 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9070067690 0x7f9070069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:27.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.655+0000 7f9095200640 1 --2- 172.21.15.8:0/2310292594 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9070067690 0x7f9070069b50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9090154200 tx=0x7f9088009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:27.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.663+0000 7f9097200640 1 --2- 172.21.15.8:0/2310292594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f909014cdb0 0x7f90901f1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:27.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.663+0000 7f9097200640 1 -- 172.21.15.8:0/2310292594 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90900ad3c0 con 0x7f909014cdb0 2024-03-23T23:45:27.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.663+0000 7f908fe00640 1 --2- 172.21.15.8:0/2310292594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f909014cdb0 0x7f90901f1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:27.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.667+0000 7f908fe00640 1 -- 172.21.15.8:0/2310292594 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f90900c1c50 con 0x7f909014cdb0 2024-03-23T23:45:27.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.667+0000 7f908fe00640 1 --2- 172.21.15.8:0/2310292594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f909014cdb0 0x7f90901f1920 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f908001a070 tx=0x7f9080009240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:27.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.667+0000 7f9087e00640 1 -- 172.21.15.8:0/2310292594 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90800b0070 con 0x7f909014cdb0 2024-03-23T23:45:27.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.667+0000 7f9087e00640 1 -- 172.21.15.8:0/2310292594 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4530 (secure 0 0 0) 0x7f90800c5070 con 0x7f909014cdb0 2024-03-23T23:45:27.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.667+0000 7f9087e00640 1 -- 172.21.15.8:0/2310292594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f909014cdb0 msgr2=0x7f90901f1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:27.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.667+0000 7f9087e00640 1 --2- 172.21.15.8:0/2310292594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f909014cdb0 0x7f90901f1920 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f908001a070 tx=0x7f9080009240 comp rx=0 tx=0).stop 2024-03-23T23:45:27.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.667+0000 7f9087e00640 1 -- 172.21.15.8:0/2310292594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f909014cdb0 msgr2=0x7f90901f1920 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:45:27.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.667+0000 7f9087e00640 1 --2- 172.21.15.8:0/2310292594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f909014cdb0 0x7f90901f1920 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f908001a070 tx=0x7f9080009240 comp rx=0 tx=0).stop 2024-03-23T23:45:27.671 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:45:27.672 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:45:27.672 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:45:27.672 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:45:27.672 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 18, 2024-03-23T23:45:27.672 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:45:27.672 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:45:27.672 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:45:27.672 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:45:27.672 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:27.672 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 12, 2024-03-23T23:45:27.672 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:45:27.673 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:45:27.673 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:45:27.673 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:45:27.673 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:45:27.673 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:45:27.673 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:45:27.673 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:45:27.673 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:45:27.673 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:45:27.673 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:45:27.673 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:45:27.673 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:45:27.673 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:45:27.674 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:27.674 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:45:27.674 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:45:27.674 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:45:27.674 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:45:27.674 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:45:27.674 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:45:27.674 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:45:27.674 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:45:27.674 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:45:27.674 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:45:27.674 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:45:27.674 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:45:27.675 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:45:27.675 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:27.675 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.675 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:45:27.675 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:45:27.675 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:45:27.675 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:45:27.675 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:45:27.675 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:45:27.675 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:45:27.675 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:45:27.675 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:45:27.675 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:45:27.675 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:45:27.676 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:45:27.676 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:45:27.676 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:45:27.676 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:45:27.676 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:45:27.676 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:45:27.676 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:45:27.676 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:45:27.676 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:45:27.676 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:45:27.676 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:45:27.677 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:45:27.677 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:45:27.677 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:45:27.677 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:45:27.677 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:45:27.677 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:45:27.677 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:27.677 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:45:27.677 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.677 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:45:27.677 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.677 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:45:27.677 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:45:27.677 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:45:27.678 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:45:27.678 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.678 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:45:27.678 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:45:27.678 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:27.678 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.678 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.678 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:45:27.678 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:45:27.678 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:27.678 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:27.678 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:27.678 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.679 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:45:27.679 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:45:27.679 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:45:27.679 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:45:27.679 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:45:27.679 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.679 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.679 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:45:27.679 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:45:27.679 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:45:27.679 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:45:27.679 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.679 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:45:27.679 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:45:27.680 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:27.680 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.680 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.680 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:45:27.680 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:45:27.680 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:27.680 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:27.680 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:27.680 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.680 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:45:27.680 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:45:27.680 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:45:27.680 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:45:27.681 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:45:27.681 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.681 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.681 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:45:27.681 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:45:27.681 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:45:27.681 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:45:27.681 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.681 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:45:27.681 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:45:27.681 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:27.681 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.681 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.681 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:45:27.682 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:45:27.682 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:27.682 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:27.682 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:27.682 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.682 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:45:27.682 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:45:27.682 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:45:27.682 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:45:27.682 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:45:27.682 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:27.682 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:27.682 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.682 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:45:27.683 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:45:27.683 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.683 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:45:27.683 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:27.683 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:45:27.683 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:27.683 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:27.683 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:45:27.683 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.683 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:45:27.683 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:27.683 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:45:27.684 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:27.684 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:27.684 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.684 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:45:27.684 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:45:27.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.667+0000 7f9097200640 1 -- 172.21.15.8:0/2310292594 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9070067690 msgr2=0x7f9070069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:27.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.667+0000 7f9097200640 1 --2- 172.21.15.8:0/2310292594 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9070067690 0x7f9070069b50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9090154200 tx=0x7f9088009040 comp rx=0 tx=0).stop 2024-03-23T23:45:27.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.667+0000 7f9097200640 1 -- 172.21.15.8:0/2310292594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90900724e0 msgr2=0x7f90900c3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:27.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.667+0000 7f9097200640 1 --2- 172.21.15.8:0/2310292594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90900724e0 0x7f90900c3d80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f907c00d800 tx=0x7f907c00dcc0 comp rx=0 tx=0).stop 2024-03-23T23:45:27.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.667+0000 7f9095200640 1 -- 172.21.15.8:0/2310292594 reap_dead start 2024-03-23T23:45:27.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.667+0000 7f9095200640 1 -- 172.21.15.8:0/2310292594 reap_dead start 2024-03-23T23:45:27.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.667+0000 7f9097200640 1 -- 172.21.15.8:0/2310292594 shutdown_connections 2024-03-23T23:45:27.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.667+0000 7f9097200640 1 -- 172.21.15.8:0/2310292594 >> 172.21.15.8:0/2310292594 conn(0x7f909006c280 msgr2=0x7f90900c81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:45:27.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.667+0000 7f9097200640 1 -- 172.21.15.8:0/2310292594 shutdown_connections 2024-03-23T23:45:27.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.667+0000 7f9097200640 1 -- 172.21.15.8:0/2310292594 wait complete. 2024-03-23T23:45:27.698 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:45:27.698 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T23:45:27.698 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:45:27.737 INFO:tasks.workunit.client.1.smithi196.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-03-23T23:45:27.752 INFO:tasks.workunit.client.1.smithi196.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-03-23T23:45:27.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.907+0000 7fc1b1000640 1 Processor -- start 2024-03-23T23:45:27.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.907+0000 7fc1b1000640 1 -- start start 2024-03-23T23:45:27.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.911+0000 7fc1b1000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc1ac072890 0x7fc1ac0c2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:27.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.911+0000 7fc1a9e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fc1ac153060 0x7fc1ac0c3d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:44334/0 (socket says 172.21.15.8:44334) 2024-03-23T23:45:27.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.911+0000 7fc1a9e00640 1 -- 172.21.15.8:0/798675814 learned_addr learned my addr 172.21.15.8:0/798675814 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:45:27.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.911+0000 7fc1aa800640 1 --2- 172.21.15.8:0/798675814 >> v2:172.21.15.8:3300/0 conn(0x7fc1ac072890 0x7fc1ac0c2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:27.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.911+0000 7fc1b1000640 1 -- 172.21.15.8:0/798675814 --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1ac0c0740 con 0x7fc1ac0c1d20 2024-03-23T23:45:27.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.911+0000 7fc1b1000640 1 -- 172.21.15.8:0/798675814 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1ac0c0a20 con 0x7fc1ac153060 2024-03-23T23:45:27.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.915+0000 7fc1b1000640 1 -- 172.21.15.8:0/798675814 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1ac0c0d00 con 0x7fc1ac072890 2024-03-23T23:45:27.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.915+0000 7fc1a8a00640 1 -- 172.21.15.8:0/798675814 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2702839723 0 0) 0x7fc1ac0c0a20 con 0x7fc1ac153060 2024-03-23T23:45:27.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.915+0000 7fc1aa800640 1 -- 172.21.15.8:0/798675814 >> v1:172.21.15.196:6789/0 conn(0x7fc1ac153060 legacy=0x7fc1ac0c3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:27.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.915+0000 7fc1aa800640 1 -- 172.21.15.8:0/798675814 >> v1:172.21.15.8:6789/0 conn(0x7fc1ac0c1d20 legacy=0x7fc1ac0c2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:27.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.915+0000 7fc1aa800640 1 -- 172.21.15.8:0/798675814 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ac0c0fe0 con 0x7fc1ac072890 2024-03-23T23:45:27.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.919+0000 7fc1aa800640 1 --2- 172.21.15.8:0/798675814 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1ac072890 0x7fc1ac0c2e80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009d90 tx=0x7fc1a401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6bd8c9051bc6280 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:27.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.919+0000 7fc1a8a00640 1 -- 172.21.15.8:0/798675814 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a40b2070 con 0x7fc1ac072890 2024-03-23T23:45:27.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.919+0000 7fc1a8a00640 1 -- 172.21.15.8:0/798675814 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a40a57c0 con 0x7fc1ac072890 2024-03-23T23:45:27.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.919+0000 7fc1a8a00640 1 -- 172.21.15.8:0/798675814 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a40a5b90 con 0x7fc1ac072890 2024-03-23T23:45:27.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.919+0000 7fc1b1000640 1 -- 172.21.15.8:0/798675814 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1ac072890 msgr2=0x7fc1ac0c2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:27.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.919+0000 7fc1b1000640 1 --2- 172.21.15.8:0/798675814 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1ac072890 0x7fc1ac0c2e80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009d90 tx=0x7fc1a401c8e0 comp rx=0 tx=0).stop 2024-03-23T23:45:27.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.919+0000 7fc1b1000640 1 -- 172.21.15.8:0/798675814 shutdown_connections 2024-03-23T23:45:27.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.919+0000 7fc1b1000640 1 --2- 172.21.15.8:0/798675814 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1ac072890 0x7fc1ac0c2e80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:27.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.919+0000 7fc1b1000640 1 -- 172.21.15.8:0/798675814 >> 172.21.15.8:0/798675814 conn(0x7fc1ac0a9870 msgr2=0x7fc1ac06b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:45:27.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.923+0000 7fc1b1000640 1 -- 172.21.15.8:0/798675814 shutdown_connections 2024-03-23T23:45:27.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.923+0000 7fc1b1000640 1 -- 172.21.15.8:0/798675814 wait complete. 2024-03-23T23:45:27.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.923+0000 7fc1b1000640 1 Processor -- start 2024-03-23T23:45:27.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.923+0000 7fc1b1000640 1 -- start start 2024-03-23T23:45:27.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.923+0000 7fc1b1000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1ac072890 0x7fc1ac151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:27.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.923+0000 7fc1b1000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1ac0c1d20 0x7fc1ac14ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:27.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.923+0000 7fc1b1000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1ac153060 0x7fc1ac14b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:27.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.923+0000 7fc1b1000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac163c50 con 0x7fc1ac0c1d20 2024-03-23T23:45:27.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.923+0000 7fc1b1000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac163ad0 con 0x7fc1ac153060 2024-03-23T23:45:27.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.923+0000 7fc1b1000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac163dd0 con 0x7fc1ac072890 2024-03-23T23:45:27.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.923+0000 7fc1a9e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1ac072890 0x7fc1ac151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:27.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.923+0000 7fc1a9e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1ac072890 0x7fc1ac151d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:40244/0 (socket says 172.21.15.8:40244) 2024-03-23T23:45:27.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.923+0000 7fc1a9e00640 1 -- 172.21.15.8:0/3076851433 learned_addr learned my addr 172.21.15.8:0/3076851433 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:45:27.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.927+0000 7fc1aa800640 1 --2- 172.21.15.8:0/3076851433 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1ac153060 0x7fc1ac14b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:27.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.927+0000 7fc1a9e00640 1 -- 172.21.15.8:0/3076851433 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1ac153060 msgr2=0x7fc1ac14b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:27.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.927+0000 7fc1a9e00640 1 --2- 172.21.15.8:0/3076851433 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1ac153060 0x7fc1ac14b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:27.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.927+0000 7fc1a9e00640 1 -- 172.21.15.8:0/3076851433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1ac0c1d20 msgr2=0x7fc1ac14ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:27.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.931+0000 7fc1a9400640 1 --2- 172.21.15.8:0/3076851433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1ac0c1d20 0x7fc1ac14ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:27.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.931+0000 7fc1a9e00640 1 --2- 172.21.15.8:0/3076851433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1ac0c1d20 0x7fc1ac14ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:27.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.931+0000 7fc1a9e00640 1 -- 172.21.15.8:0/3076851433 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ac0c60d0 con 0x7fc1ac072890 2024-03-23T23:45:27.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.931+0000 7fc1a9400640 1 --2- 172.21.15.8:0/3076851433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1ac0c1d20 0x7fc1ac14ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:45:27.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.935+0000 7fc1a9e00640 1 --2- 172.21.15.8:0/3076851433 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1ac072890 0x7fc1ac151d00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00c3f0 tx=0x7fc19c00c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:27.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.935+0000 7fc1a2000640 1 -- 172.21.15.8:0/3076851433 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c0074e0 con 0x7fc1ac072890 2024-03-23T23:45:27.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.935+0000 7fc1a2000640 1 -- 172.21.15.8:0/3076851433 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19c0047f0 con 0x7fc1ac072890 2024-03-23T23:45:27.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.939+0000 7fc1a2000640 1 -- 172.21.15.8:0/3076851433 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c0076a0 con 0x7fc1ac072890 2024-03-23T23:45:27.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.943+0000 7fc1b1000640 1 -- 172.21.15.8:0/3076851433 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1ac14b900 con 0x7fc1ac072890 2024-03-23T23:45:27.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.943+0000 7fc1b1000640 1 -- 172.21.15.8:0/3076851433 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ac1f2870 con 0x7fc1ac072890 2024-03-23T23:45:27.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.947+0000 7fc1a2000640 1 -- 172.21.15.8:0/3076851433 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc19c011070 con 0x7fc1ac072890 2024-03-23T23:45:27.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.947+0000 7fc1a2000640 1 --2- 172.21.15.8:0/3076851433 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc18c067760 0x7fc18c069c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:27.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.947+0000 7fc1a2000640 1 -- 172.21.15.8:0/3076851433 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fc19c0856d0 con 0x7fc1ac072890 2024-03-23T23:45:27.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.951+0000 7fc1a9400640 1 --2- 172.21.15.8:0/3076851433 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc18c067760 0x7fc18c069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:27.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.963+0000 7fc1b1000640 1 --2- 172.21.15.8:0/3076851433 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1ac1f2ab0 0x7fc1ac140680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:27.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.963+0000 7fc1b1000640 1 -- 172.21.15.8:0/3076851433 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac0aa390 con 0x7fc1ac1f2ab0 2024-03-23T23:45:27.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.963+0000 7fc1aa800640 1 --2- 172.21.15.8:0/3076851433 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1ac1f2ab0 0x7fc1ac140680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:27.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.963+0000 7fc1aa800640 1 -- 172.21.15.8:0/3076851433 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc1ac14a560 con 0x7fc1ac1f2ab0 2024-03-23T23:45:27.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.963+0000 7fc1aa800640 1 --2- 172.21.15.8:0/3076851433 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1ac1f2ab0 0x7fc1ac140680 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac06ef20 tx=0x7fc1a4019680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:27.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.963+0000 7fc1a2000640 1 -- 172.21.15.8:0/3076851433 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a40be070 con 0x7fc1ac1f2ab0 2024-03-23T23:45:27.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.963+0000 7fc1a2000640 1 -- 172.21.15.8:0/3076851433 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fc1a40b3040 con 0x7fc1ac1f2ab0 2024-03-23T23:45:27.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.963+0000 7fc1a2000640 1 -- 172.21.15.8:0/3076851433 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1ac1f2ab0 msgr2=0x7fc1ac140680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:27.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.963+0000 7fc1a2000640 1 --2- 172.21.15.8:0/3076851433 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1ac1f2ab0 0x7fc1ac140680 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac06ef20 tx=0x7fc1a4019680 comp rx=0 tx=0).stop 2024-03-23T23:45:27.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.963+0000 7fc1a2000640 1 -- 172.21.15.8:0/3076851433 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1ac1f2ab0 msgr2=0x7fc1ac140680 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:45:27.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.963+0000 7fc1a2000640 1 --2- 172.21.15.8:0/3076851433 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1ac1f2ab0 0x7fc1ac140680 secure :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac06ef20 tx=0x7fc1a4019680 comp rx=0 tx=0).stop 2024-03-23T23:45:27.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.967+0000 7fc1a9400640 1 --2- 172.21.15.8:0/3076851433 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc18c067760 0x7fc18c069c20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac14c210 tx=0x7fc198009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:27.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.979+0000 7fc1b1000640 1 --2- 172.21.15.8:0/3076851433 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1ac0c6c80 0x7fc1ac140bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:27.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.979+0000 7fc1b1000640 1 -- 172.21.15.8:0/3076851433 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac068270 con 0x7fc1ac0c6c80 2024-03-23T23:45:27.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.979+0000 7fc1aa800640 1 --2- 172.21.15.8:0/3076851433 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1ac0c6c80 0x7fc1ac140bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:27.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.979+0000 7fc1aa800640 1 -- 172.21.15.8:0/3076851433 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc1ac0ad3c0 con 0x7fc1ac0c6c80 2024-03-23T23:45:27.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.979+0000 7fc1aa800640 1 --2- 172.21.15.8:0/3076851433 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1ac0c6c80 0x7fc1ac140bc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc1a40194f0 tx=0x7fc1a40a7000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:27.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.983+0000 7fc1a2000640 1 -- 172.21.15.8:0/3076851433 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a40b2040 con 0x7fc1ac0c6c80 2024-03-23T23:45:27.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.983+0000 7fc1a2000640 1 -- 172.21.15.8:0/3076851433 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5183 (secure 0 0 0) 0x7fc1a4003fd0 con 0x7fc1ac0c6c80 2024-03-23T23:45:27.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.983+0000 7fc1a2000640 1 -- 172.21.15.8:0/3076851433 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1ac0c6c80 msgr2=0x7fc1ac140bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:27.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.983+0000 7fc1a2000640 1 --2- 172.21.15.8:0/3076851433 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1ac0c6c80 0x7fc1ac140bc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc1a40194f0 tx=0x7fc1a40a7000 comp rx=0 tx=0).stop 2024-03-23T23:45:27.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.983+0000 7fc1a2000640 1 -- 172.21.15.8:0/3076851433 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1ac0c6c80 msgr2=0x7fc1ac140bc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:45:27.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.983+0000 7fc1a2000640 1 --2- 172.21.15.8:0/3076851433 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1ac0c6c80 0x7fc1ac140bc0 secure :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc1a40194f0 tx=0x7fc1a40a7000 comp rx=0 tx=0).stop 2024-03-23T23:45:27.986 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:45:27.987 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:45:27.987 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:45:27.987 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:45:27.987 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 18, 2024-03-23T23:45:27.987 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:45:27.987 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:45:27.987 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:45:27.987 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:45:27.988 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:27.988 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 13, 2024-03-23T23:45:27.988 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:45:27.988 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:45:27.988 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:45:27.988 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:45:27.988 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:45:27.988 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:45:27.988 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:45:27.988 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:45:27.988 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:45:27.988 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:45:27.989 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:45:27.989 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:45:27.989 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:45:27.989 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:45:27.989 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:27.989 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:45:27.989 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:45:27.989 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:45:27.989 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:45:27.989 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:45:27.989 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:45:27.989 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:45:27.989 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:45:27.990 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:45:27.990 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:45:27.990 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:45:27.990 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:45:27.990 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:45:27.991 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:27.991 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.991 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:45:27.991 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:45:27.991 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:45:27.991 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:45:27.991 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:45:27.991 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:45:27.991 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:45:27.991 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:45:27.991 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:45:27.991 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:45:27.992 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:45:27.992 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:45:27.992 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:45:27.992 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:45:27.992 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:45:27.992 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:45:27.992 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:45:27.992 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:45:27.992 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:45:27.992 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:45:27.992 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:45:27.992 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:45:27.992 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:45:27.993 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:45:27.993 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:45:27.993 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:45:27.993 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:45:27.993 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:45:27.993 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:27.993 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:45:27.993 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.993 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:45:27.993 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.993 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:45:27.993 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:45:27.993 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:45:27.994 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:45:27.994 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.994 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:45:27.994 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:45:27.994 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:27.994 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.994 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.994 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:45:27.994 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:45:27.994 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:27.994 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:27.994 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:27.994 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.995 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:45:27.995 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:45:27.995 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:45:27.995 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:45:27.995 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:45:27.995 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.995 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.995 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:45:27.995 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:45:27.995 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:45:27.995 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:45:27.995 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.995 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:45:27.996 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:45:27.996 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:27.996 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.996 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.996 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:45:27.996 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:45:27.996 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:27.996 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:27.996 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:27.996 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.996 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:45:27.996 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:45:27.996 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:45:27.996 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:45:27.997 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:45:27.997 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.997 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.997 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:45:27.997 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:45:27.997 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:45:27.997 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:45:27.997 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.997 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:45:27.997 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:45:27.997 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:27.997 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.997 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.998 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:45:27.998 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:45:27.998 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:27.998 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:27.998 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:27.998 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.998 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:45:27.998 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:45:27.998 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:45:27.998 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:45:27.998 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:45:27.998 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:27.998 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:27.999 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:27.999 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:45:27.999 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:45:27.999 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.999 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:45:27.999 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:27.999 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:45:27.999 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:27.999 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:27.999 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:45:27.999 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:27.999 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:45:27.999 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:28.000 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:45:28.000 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:28.000 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:28.000 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:45:28.000 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:28.000 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:45:28.000 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:28.000 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 7 2024-03-23T23:45:28.000 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:28.000 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:28.001 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:45:28.001 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:28.001 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:45:28.001 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:28.001 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:45:28.001 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:28.001 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:28.001 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:45:28.001 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:28.001 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 6 2024-03-23T23:45:28.001 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:28.001 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:28.002 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:45:28.002 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:28.002 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:45:28.002 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:28.002 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:45:28.002 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:28.002 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:28.002 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:28.002 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:45:28.002 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:45:28.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.983+0000 7fc1b1000640 1 -- 172.21.15.8:0/3076851433 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc18c067760 msgr2=0x7fc18c069c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:28.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.983+0000 7fc1b1000640 1 --2- 172.21.15.8:0/3076851433 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc18c067760 0x7fc18c069c20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac14c210 tx=0x7fc198009040 comp rx=0 tx=0).stop 2024-03-23T23:45:28.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.983+0000 7fc1b1000640 1 -- 172.21.15.8:0/3076851433 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1ac072890 msgr2=0x7fc1ac151d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:28.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.983+0000 7fc1b1000640 1 --2- 172.21.15.8:0/3076851433 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1ac072890 0x7fc1ac151d00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00c3f0 tx=0x7fc19c00c8b0 comp rx=0 tx=0).stop 2024-03-23T23:45:28.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.983+0000 7fc1aa800640 1 -- 172.21.15.8:0/3076851433 reap_dead start 2024-03-23T23:45:28.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.983+0000 7fc1b1000640 1 -- 172.21.15.8:0/3076851433 shutdown_connections 2024-03-23T23:45:28.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.983+0000 7fc1b1000640 1 -- 172.21.15.8:0/3076851433 >> 172.21.15.8:0/3076851433 conn(0x7fc1ac0a9870 msgr2=0x7fc1ac0c3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:45:28.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.983+0000 7fc1b1000640 1 -- 172.21.15.8:0/3076851433 shutdown_connections 2024-03-23T23:45:28.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:27.983+0000 7fc1b1000640 1 -- 172.21.15.8:0/3076851433 wait complete. 2024-03-23T23:45:28.004 INFO:tasks.workunit.client.1.smithi196.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-03-23T23:45:28.010 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:45:28.011 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-03-23T23:45:28.011 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['c'] 2024-03-23T23:45:28.011 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-03-23T23:45:28.011 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-03-23T23:45:28.012 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-23T23:45:28.012 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:45:28.012 INFO:tasks.workunit.client.1.smithi196.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-03-23T23:45:28.042 INFO:tasks.ceph.mon.a:Stopped 2024-03-23T23:45:28.042 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-03-23T23:45:28.042 INFO:tasks.ceph.mon.c:Sent signal 19 2024-03-23T23:45:28.043 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-03-23T23:45:28.192 INFO:tasks.workunit.client.1.smithi196.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-03-23T23:45:28.212 INFO:tasks.workunit.client.1.smithi196.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-03-23T23:45:28.333 INFO:tasks.workunit.client.1.smithi196.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-03-23T23:45:28.352 INFO:tasks.workunit.client.1.smithi196.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-03-23T23:45:28.552 INFO:tasks.workunit.client.1.smithi196.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-03-23T23:45:28.565 INFO:tasks.workunit.client.1.smithi196.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-03-23T23:45:28.858 INFO:tasks.workunit.client.1.smithi196.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-03-23T23:45:28.887 INFO:tasks.workunit.client.1.smithi196.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-03-23T23:45:29.159 INFO:tasks.workunit.client.1.smithi196.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-03-23T23:45:29.188 INFO:tasks.workunit.client.1.smithi196.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-03-23T23:45:29.510 INFO:tasks.workunit.client.1.smithi196.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-03-23T23:45:29.521 INFO:tasks.workunit.client.1.smithi196.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-03-23T23:45:29.717 INFO:tasks.workunit.client.1.smithi196.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-03-23T23:45:29.748 INFO:tasks.workunit.client.1.smithi196.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-03-23T23:45:29.865 INFO:tasks.workunit.client.1.smithi196.stderr:ffsb_op.c: In function 'print_op_results': 2024-03-23T23:45:29.865 INFO:tasks.workunit.client.1.smithi196.stderr:ffsb_op.c:83:37: warning: embedded '\0' in format [-Wformat-contains-nul] 2024-03-23T23:45:29.865 INFO:tasks.workunit.client.1.smithi196.stderr: 83 | sprintf(buf, "%s/sec\0", buf); 2024-03-23T23:45:29.865 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~ 2024-03-23T23:45:29.865 INFO:tasks.workunit.client.1.smithi196.stderr:ffsb_op.c:86:33: warning: embedded '\0' in format [-Wformat-contains-nul] 2024-03-23T23:45:29.865 INFO:tasks.workunit.client.1.smithi196.stderr: 86 | sprintf(buf, "NA\0"); 2024-03-23T23:45:29.865 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~ 2024-03-23T23:45:29.885 INFO:tasks.workunit.client.1.smithi196.stderr:ffsb_op.c: In function 'print_results': 2024-03-23T23:45:29.885 INFO:tasks.workunit.client.1.smithi196.stderr:ffsb_op.c:83:33: warning: '/sec' directive writing 4 bytes into a region of size between 1 and 256 [-Wformat-overflow=] 2024-03-23T23:45:29.885 INFO:tasks.workunit.client.1.smithi196.stderr: 83 | sprintf(buf, "%s/sec\0", buf); 2024-03-23T23:45:29.885 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~ 2024-03-23T23:45:29.886 INFO:tasks.workunit.client.1.smithi196.stderr:In file included from /usr/include/stdio.h:894, 2024-03-23T23:45:29.886 INFO:tasks.workunit.client.1.smithi196.stderr: from ffsb_op.c:20: 2024-03-23T23:45:29.886 INFO:tasks.workunit.client.1.smithi196.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 5 and 260 bytes into a destination of size 256 2024-03-23T23:45:29.886 INFO:tasks.workunit.client.1.smithi196.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-03-23T23:45:29.886 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-23T23:45:29.886 INFO:tasks.workunit.client.1.smithi196.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-03-23T23:45:29.886 INFO:tasks.workunit.client.1.smithi196.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-23T23:45:29.886 INFO:tasks.workunit.client.1.smithi196.stderr: 40 | __va_arg_pack ()); 2024-03-23T23:45:29.886 INFO:tasks.workunit.client.1.smithi196.stderr: | ~~~~~~~~~~~~~~~~~ 2024-03-23T23:45:29.948 INFO:tasks.workunit.client.1.smithi196.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-03-23T23:45:29.975 INFO:tasks.workunit.client.1.smithi196.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-03-23T23:45:30.184 INFO:tasks.workunit.client.1.smithi196.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-03-23T23:45:30.204 INFO:tasks.workunit.client.1.smithi196.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-03-23T23:45:30.285 INFO:tasks.workunit.client.1.smithi196.stderr:In file included from parser.h:22, 2024-03-23T23:45:30.285 INFO:tasks.workunit.client.1.smithi196.stderr: from parser.c:25: 2024-03-23T23:45:30.285 INFO:tasks.workunit.client.1.smithi196.stderr:parser.c: In function 'init_filesys': 2024-03-23T23:45:30.286 INFO:tasks.workunit.client.1.smithi196.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-03-23T23:45:30.286 INFO:tasks.workunit.client.1.smithi196.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-03-23T23:45:30.286 INFO:tasks.workunit.client.1.smithi196.stderr: | ^ 2024-03-23T23:45:30.286 INFO:tasks.workunit.client.1.smithi196.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-03-23T23:45:30.286 INFO:tasks.workunit.client.1.smithi196.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-03-23T23:45:30.286 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~ 2024-03-23T23:45:30.286 INFO:tasks.workunit.client.1.smithi196.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-03-23T23:45:30.286 INFO:tasks.workunit.client.1.smithi196.stderr: 36 | container_of(ptr, type, member) 2024-03-23T23:45:30.286 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~~~~~ 2024-03-23T23:45:30.286 INFO:tasks.workunit.client.1.smithi196.stderr:list.h:39:20: note: in expansion of macro 'list_entry' 2024-03-23T23:45:30.286 INFO:tasks.workunit.client.1.smithi196.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-03-23T23:45:30.286 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~~~ 2024-03-23T23:45:30.287 INFO:tasks.workunit.client.1.smithi196.stderr:parser.c:934:17: note: in expansion of macro 'list_for_each_entry' 2024-03-23T23:45:30.287 INFO:tasks.workunit.client.1.smithi196.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-03-23T23:45:30.287 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-03-23T23:45:30.288 INFO:tasks.workunit.client.1.smithi196.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-03-23T23:45:30.288 INFO:tasks.workunit.client.1.smithi196.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-03-23T23:45:30.288 INFO:tasks.workunit.client.1.smithi196.stderr: | ^ 2024-03-23T23:45:30.288 INFO:tasks.workunit.client.1.smithi196.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-03-23T23:45:30.288 INFO:tasks.workunit.client.1.smithi196.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-03-23T23:45:30.288 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~ 2024-03-23T23:45:30.288 INFO:tasks.workunit.client.1.smithi196.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-03-23T23:45:30.288 INFO:tasks.workunit.client.1.smithi196.stderr: 36 | container_of(ptr, type, member) 2024-03-23T23:45:30.289 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~~~~~ 2024-03-23T23:45:30.289 INFO:tasks.workunit.client.1.smithi196.stderr:list.h:41:20: note: in expansion of macro 'list_entry' 2024-03-23T23:45:30.289 INFO:tasks.workunit.client.1.smithi196.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-03-23T23:45:30.289 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~~~ 2024-03-23T23:45:30.289 INFO:tasks.workunit.client.1.smithi196.stderr:parser.c:934:17: note: in expansion of macro 'list_for_each_entry' 2024-03-23T23:45:30.289 INFO:tasks.workunit.client.1.smithi196.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-03-23T23:45:30.289 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-03-23T23:45:30.289 INFO:tasks.workunit.client.1.smithi196.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-03-23T23:45:30.289 INFO:tasks.workunit.client.1.smithi196.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-03-23T23:45:30.289 INFO:tasks.workunit.client.1.smithi196.stderr: | ^ 2024-03-23T23:45:30.289 INFO:tasks.workunit.client.1.smithi196.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-03-23T23:45:30.289 INFO:tasks.workunit.client.1.smithi196.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-03-23T23:45:30.289 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~ 2024-03-23T23:45:30.289 INFO:tasks.workunit.client.1.smithi196.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-03-23T23:45:30.290 INFO:tasks.workunit.client.1.smithi196.stderr: 36 | container_of(ptr, type, member) 2024-03-23T23:45:30.290 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~~~~~ 2024-03-23T23:45:30.290 INFO:tasks.workunit.client.1.smithi196.stderr:list.h:39:20: note: in expansion of macro 'list_entry' 2024-03-23T23:45:30.290 INFO:tasks.workunit.client.1.smithi196.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-03-23T23:45:30.290 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~~~ 2024-03-23T23:45:30.290 INFO:tasks.workunit.client.1.smithi196.stderr:parser.c:941:17: note: in expansion of macro 'list_for_each_entry' 2024-03-23T23:45:30.290 INFO:tasks.workunit.client.1.smithi196.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-03-23T23:45:30.290 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-03-23T23:45:30.290 INFO:tasks.workunit.client.1.smithi196.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-03-23T23:45:30.290 INFO:tasks.workunit.client.1.smithi196.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-03-23T23:45:30.290 INFO:tasks.workunit.client.1.smithi196.stderr: | ^ 2024-03-23T23:45:30.290 INFO:tasks.workunit.client.1.smithi196.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-03-23T23:45:30.291 INFO:tasks.workunit.client.1.smithi196.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-03-23T23:45:30.291 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~ 2024-03-23T23:45:30.291 INFO:tasks.workunit.client.1.smithi196.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-03-23T23:45:30.291 INFO:tasks.workunit.client.1.smithi196.stderr: 36 | container_of(ptr, type, member) 2024-03-23T23:45:30.291 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~~~~~ 2024-03-23T23:45:30.291 INFO:tasks.workunit.client.1.smithi196.stderr:list.h:41:20: note: in expansion of macro 'list_entry' 2024-03-23T23:45:30.291 INFO:tasks.workunit.client.1.smithi196.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-03-23T23:45:30.291 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~~~ 2024-03-23T23:45:30.291 INFO:tasks.workunit.client.1.smithi196.stderr:parser.c:941:17: note: in expansion of macro 'list_for_each_entry' 2024-03-23T23:45:30.292 INFO:tasks.workunit.client.1.smithi196.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-03-23T23:45:30.292 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-03-23T23:45:30.292 INFO:tasks.workunit.client.1.smithi196.stderr:parser.c: In function 'init_tg_stats': 2024-03-23T23:45:30.292 INFO:tasks.workunit.client.1.smithi196.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-03-23T23:45:30.292 INFO:tasks.workunit.client.1.smithi196.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-03-23T23:45:30.292 INFO:tasks.workunit.client.1.smithi196.stderr: | ^ 2024-03-23T23:45:30.292 INFO:tasks.workunit.client.1.smithi196.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-03-23T23:45:30.292 INFO:tasks.workunit.client.1.smithi196.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-03-23T23:45:30.292 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~ 2024-03-23T23:45:30.292 INFO:tasks.workunit.client.1.smithi196.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-03-23T23:45:30.292 INFO:tasks.workunit.client.1.smithi196.stderr: 36 | container_of(ptr, type, member) 2024-03-23T23:45:30.292 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~~~~~ 2024-03-23T23:45:30.292 INFO:tasks.workunit.client.1.smithi196.stderr:list.h:39:20: note: in expansion of macro 'list_entry' 2024-03-23T23:45:30.293 INFO:tasks.workunit.client.1.smithi196.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-03-23T23:45:30.293 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~~~ 2024-03-23T23:45:30.293 INFO:tasks.workunit.client.1.smithi196.stderr:parser.c:971:41: note: in expansion of macro 'list_for_each_entry' 2024-03-23T23:45:30.293 INFO:tasks.workunit.client.1.smithi196.stderr: 971 | list_for_each_entry(tmp_list, 2024-03-23T23:45:30.293 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-03-23T23:45:30.293 INFO:tasks.workunit.client.1.smithi196.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-03-23T23:45:30.293 INFO:tasks.workunit.client.1.smithi196.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-03-23T23:45:30.293 INFO:tasks.workunit.client.1.smithi196.stderr: | ^ 2024-03-23T23:45:30.293 INFO:tasks.workunit.client.1.smithi196.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-03-23T23:45:30.293 INFO:tasks.workunit.client.1.smithi196.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-03-23T23:45:30.293 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~ 2024-03-23T23:45:30.293 INFO:tasks.workunit.client.1.smithi196.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-03-23T23:45:30.293 INFO:tasks.workunit.client.1.smithi196.stderr: 36 | container_of(ptr, type, member) 2024-03-23T23:45:30.294 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~~~~~ 2024-03-23T23:45:30.294 INFO:tasks.workunit.client.1.smithi196.stderr:list.h:41:20: note: in expansion of macro 'list_entry' 2024-03-23T23:45:30.294 INFO:tasks.workunit.client.1.smithi196.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-03-23T23:45:30.294 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~~~ 2024-03-23T23:45:30.294 INFO:tasks.workunit.client.1.smithi196.stderr:parser.c:971:41: note: in expansion of macro 'list_for_each_entry' 2024-03-23T23:45:30.294 INFO:tasks.workunit.client.1.smithi196.stderr: 971 | list_for_each_entry(tmp_list, 2024-03-23T23:45:30.294 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-03-23T23:45:30.294 INFO:tasks.workunit.client.1.smithi196.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-03-23T23:45:30.294 INFO:tasks.workunit.client.1.smithi196.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-03-23T23:45:30.294 INFO:tasks.workunit.client.1.smithi196.stderr: | ^ 2024-03-23T23:45:30.294 INFO:tasks.workunit.client.1.smithi196.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-03-23T23:45:30.294 INFO:tasks.workunit.client.1.smithi196.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-03-23T23:45:30.294 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~ 2024-03-23T23:45:30.295 INFO:tasks.workunit.client.1.smithi196.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-03-23T23:45:30.295 INFO:tasks.workunit.client.1.smithi196.stderr: 36 | container_of(ptr, type, member) 2024-03-23T23:45:30.295 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~~~~~ 2024-03-23T23:45:30.295 INFO:tasks.workunit.client.1.smithi196.stderr:list.h:39:20: note: in expansion of macro 'list_entry' 2024-03-23T23:45:30.295 INFO:tasks.workunit.client.1.smithi196.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-03-23T23:45:30.295 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~~~ 2024-03-23T23:45:30.295 INFO:tasks.workunit.client.1.smithi196.stderr:parser.c:980:41: note: in expansion of macro 'list_for_each_entry' 2024-03-23T23:45:30.295 INFO:tasks.workunit.client.1.smithi196.stderr: 980 | list_for_each_entry(tmp_list, 2024-03-23T23:45:30.295 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-03-23T23:45:30.295 INFO:tasks.workunit.client.1.smithi196.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-03-23T23:45:30.295 INFO:tasks.workunit.client.1.smithi196.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-03-23T23:45:30.296 INFO:tasks.workunit.client.1.smithi196.stderr: | ^ 2024-03-23T23:45:30.296 INFO:tasks.workunit.client.1.smithi196.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-03-23T23:45:30.296 INFO:tasks.workunit.client.1.smithi196.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-03-23T23:45:30.296 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~ 2024-03-23T23:45:30.296 INFO:tasks.workunit.client.1.smithi196.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-03-23T23:45:30.296 INFO:tasks.workunit.client.1.smithi196.stderr: 36 | container_of(ptr, type, member) 2024-03-23T23:45:30.296 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~~~~~ 2024-03-23T23:45:30.296 INFO:tasks.workunit.client.1.smithi196.stderr:list.h:41:20: note: in expansion of macro 'list_entry' 2024-03-23T23:45:30.296 INFO:tasks.workunit.client.1.smithi196.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-03-23T23:45:30.296 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~~~ 2024-03-23T23:45:30.296 INFO:tasks.workunit.client.1.smithi196.stderr:parser.c:980:41: note: in expansion of macro 'list_for_each_entry' 2024-03-23T23:45:30.296 INFO:tasks.workunit.client.1.smithi196.stderr: 980 | list_for_each_entry(tmp_list, 2024-03-23T23:45:30.296 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-03-23T23:45:30.353 INFO:tasks.workunit.client.1.smithi196.stderr:parser.c: In function 'get_optstr': 2024-03-23T23:45:30.353 INFO:tasks.workunit.client.1.smithi196.stderr:parser.c:206:23: warning: 'strnlen' specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-03-23T23:45:30.353 INFO:tasks.workunit.client.1.smithi196.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-03-23T23:45:30.354 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-03-23T23:45:30.354 INFO:tasks.workunit.client.1.smithi196.stderr:parser.c:200:14: note: source object declared here 2024-03-23T23:45:30.354 INFO:tasks.workunit.client.1.smithi196.stderr: 200 | char temp[BUFSIZE]; 2024-03-23T23:45:30.354 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~ 2024-03-23T23:45:30.377 INFO:tasks.workunit.client.1.smithi196.stderr:In file included from /usr/include/string.h:535, 2024-03-23T23:45:30.378 INFO:tasks.workunit.client.1.smithi196.stderr: from parser.c:19: 2024-03-23T23:45:30.378 INFO:tasks.workunit.client.1.smithi196.stderr:In function 'memcpy', 2024-03-23T23:45:30.378 INFO:tasks.workunit.client.1.smithi196.stderr: inlined from 'size64_convert' at parser.c:119:2: 2024-03-23T23:45:30.378 INFO:tasks.workunit.client.1.smithi196.stderr:/usr/include/x86_64-linux-gnu/bits/string_fortified.h:29:10: warning: '__builtin_memcpy' reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-03-23T23:45:30.378 INFO:tasks.workunit.client.1.smithi196.stderr: 29 | return __builtin___memcpy_chk (__dest, __src, __len, 2024-03-23T23:45:30.378 INFO:tasks.workunit.client.1.smithi196.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-23T23:45:30.378 INFO:tasks.workunit.client.1.smithi196.stderr: 30 | __glibc_objsize0 (__dest)); 2024-03-23T23:45:30.378 INFO:tasks.workunit.client.1.smithi196.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-23T23:45:30.817 INFO:tasks.workunit.client.1.smithi196.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-03-23T23:45:30.830 INFO:tasks.workunit.client.1.smithi196.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-03-23T23:45:30.973 INFO:tasks.workunit.client.1.smithi196.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-03-23T23:45:30.987 INFO:tasks.workunit.client.1.smithi196.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-03-23T23:45:31.170 INFO:tasks.workunit.client.1.smithi196.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-03-23T23:45:31.189 INFO:tasks.workunit.client.1.smithi196.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-03-23T23:45:31.253 INFO:tasks.workunit.client.1.smithi196.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-03-23T23:45:31.284 INFO:tasks.workunit.client.1.smithi196.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-03-23T23:45:31.381 INFO:tasks.workunit.client.1.smithi196.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb' 2024-03-23T23:45:31.382 INFO:tasks.workunit.client.1.smithi196.stderr:+ cd .. 2024-03-23T23:45:31.382 INFO:tasks.workunit.client.1.smithi196.stderr:+ mkdir tmp 2024-03-23T23:45:31.387 INFO:tasks.workunit.client.1.smithi196.stderr:+ cd tmp 2024-03-23T23:45:31.387 INFO:tasks.workunit.client.1.smithi196.stderr:+ for f in $mydir/*.ffsb 2024-03-23T23:45:31.387 INFO:tasks.workunit.client.1.smithi196.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/random_write.32.ffsb 2024-03-23T23:45:31.396 INFO:tasks.workunit.client.1.smithi196.stdout:FFSB version 6.0-RC2 started 2024-03-23T23:45:31.396 INFO:tasks.workunit.client.1.smithi196.stdout: 2024-03-23T23:45:31.408 INFO:tasks.workunit.client.1.smithi196.stdout:benchmark time = 300 2024-03-23T23:45:31.408 INFO:tasks.workunit.client.1.smithi196.stdout:ThreadGroup 0 2024-03-23T23:45:31.409 INFO:tasks.workunit.client.1.smithi196.stdout:================ 2024-03-23T23:45:31.409 INFO:tasks.workunit.client.1.smithi196.stdout: num_threads = 32 2024-03-23T23:45:31.409 INFO:tasks.workunit.client.1.smithi196.stdout: 2024-03-23T23:45:31.409 INFO:tasks.workunit.client.1.smithi196.stdout: read_random = off 2024-03-23T23:45:31.409 INFO:tasks.workunit.client.1.smithi196.stdout: read_size = 0 (0B) 2024-03-23T23:45:31.409 INFO:tasks.workunit.client.1.smithi196.stdout: read_blocksize = 0 (0B) 2024-03-23T23:45:31.409 INFO:tasks.workunit.client.1.smithi196.stdout: read_skip = off 2024-03-23T23:45:31.409 INFO:tasks.workunit.client.1.smithi196.stdout: read_skipsize = 0 (0B) 2024-03-23T23:45:31.409 INFO:tasks.workunit.client.1.smithi196.stdout: 2024-03-23T23:45:31.409 INFO:tasks.workunit.client.1.smithi196.stdout: write_random = on 2024-03-23T23:45:31.409 INFO:tasks.workunit.client.1.smithi196.stdout: write_size = 5242880 (5MB) 2024-03-23T23:45:31.409 INFO:tasks.workunit.client.1.smithi196.stdout: fsync_file = 0 2024-03-23T23:45:31.409 INFO:tasks.workunit.client.1.smithi196.stdout: write_blocksize = 4096 (4KB) 2024-03-23T23:45:31.410 INFO:tasks.workunit.client.1.smithi196.stdout: wait time = 0 2024-03-23T23:45:31.410 INFO:tasks.workunit.client.1.smithi196.stdout: 2024-03-23T23:45:31.410 INFO:tasks.workunit.client.1.smithi196.stdout: op weights 2024-03-23T23:45:31.410 INFO:tasks.workunit.client.1.smithi196.stdout: read = 0 (0.00%) 2024-03-23T23:45:31.410 INFO:tasks.workunit.client.1.smithi196.stdout: readall = 0 (0.00%) 2024-03-23T23:45:31.410 INFO:tasks.workunit.client.1.smithi196.stdout: write = 1 (100.00%) 2024-03-23T23:45:31.410 INFO:tasks.workunit.client.1.smithi196.stdout: create = 0 (0.00%) 2024-03-23T23:45:31.410 INFO:tasks.workunit.client.1.smithi196.stdout: append = 0 (0.00%) 2024-03-23T23:45:31.410 INFO:tasks.workunit.client.1.smithi196.stdout: delete = 0 (0.00%) 2024-03-23T23:45:31.410 INFO:tasks.workunit.client.1.smithi196.stdout: metaop = 0 (0.00%) 2024-03-23T23:45:31.410 INFO:tasks.workunit.client.1.smithi196.stdout: createdir = 0 (0.00%) 2024-03-23T23:45:31.410 INFO:tasks.workunit.client.1.smithi196.stdout: stat = 0 (0.00%) 2024-03-23T23:45:31.410 INFO:tasks.workunit.client.1.smithi196.stdout: writeall = 0 (0.00%) 2024-03-23T23:45:31.411 INFO:tasks.workunit.client.1.smithi196.stdout: writeall_fsync = 0 (0.00%) 2024-03-23T23:45:31.411 INFO:tasks.workunit.client.1.smithi196.stdout: open_close = 0 (0.00%) 2024-03-23T23:45:31.411 INFO:tasks.workunit.client.1.smithi196.stdout: write_fsync = 0 (0.00%) 2024-03-23T23:45:31.411 INFO:tasks.workunit.client.1.smithi196.stdout: create_fsync = 0 (0.00%) 2024-03-23T23:45:31.411 INFO:tasks.workunit.client.1.smithi196.stdout: append_fsync = 0 (0.00%) 2024-03-23T23:45:31.411 INFO:tasks.workunit.client.1.smithi196.stdout: 2024-03-23T23:45:31.411 INFO:tasks.workunit.client.1.smithi196.stdout:FileSystem . 2024-03-23T23:45:31.411 INFO:tasks.workunit.client.1.smithi196.stdout:========== 2024-03-23T23:45:31.411 INFO:tasks.workunit.client.1.smithi196.stdout: num_dirs = 0 2024-03-23T23:45:31.411 INFO:tasks.workunit.client.1.smithi196.stdout: starting files = 128 2024-03-23T23:45:31.411 INFO:tasks.workunit.client.1.smithi196.stdout: 2024-03-23T23:45:31.411 INFO:tasks.workunit.client.1.smithi196.stdout: min file size = 104857600 (100MB) 2024-03-23T23:45:31.411 INFO:tasks.workunit.client.1.smithi196.stdout: max file size = 104857600 (100MB) 2024-03-23T23:45:31.412 INFO:tasks.workunit.client.1.smithi196.stdout: directio = off 2024-03-23T23:45:31.412 INFO:tasks.workunit.client.1.smithi196.stdout: alignedio = on 2024-03-23T23:45:31.412 INFO:tasks.workunit.client.1.smithi196.stdout: bufferedio = off 2024-03-23T23:45:31.412 INFO:tasks.workunit.client.1.smithi196.stdout: 2024-03-23T23:45:31.412 INFO:tasks.workunit.client.1.smithi196.stdout: aging is off 2024-03-23T23:45:42.821 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:45:42.826 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:45:43.043 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-03-23T23:45:43.044 INFO:tasks.ceph.mon.c:Sent signal 18 2024-03-23T23:45:43.044 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-03-23T23:45:43.044 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:45:43.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:43.303+0000 7ff03ec00640 1 Processor -- start 2024-03-23T23:45:43.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:43.303+0000 7ff03ec00640 1 -- start start 2024-03-23T23:45:43.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:43.307+0000 7ff03ec00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff0380c28d0 0x7ff038156330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:43.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:43.307+0000 7ff03ec00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0380a7fe0 con 0x7ff0380a87a0 2024-03-23T23:45:43.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:43.307+0000 7ff03ec00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0380a7d00 con 0x7ff0380c8930 2024-03-23T23:45:43.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:43.307+0000 7ff03ec00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0380c2cb0 con 0x7ff0380c28d0 2024-03-23T23:45:43.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:43.307+0000 7ff03ce00640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7ff0380a87a0 legacy=0x7ff03806cf40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:45:43.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:43.307+0000 7ff03d800640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7ff0380c28d0 msgr2=0x7ff038156330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:45:43.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:43.307+0000 7ff03d800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff0380c28d0 0x7ff038156330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:45:43.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:43.307+0000 7ff03e200640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7ff0380c8930 0x7ff038070f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:58128/0 (socket says 172.21.15.8:58128) 2024-03-23T23:45:43.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:43.307+0000 7ff03e200640 1 -- 172.21.15.8:0/3549280880 learned_addr learned my addr 172.21.15.8:0/3549280880 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:45:43.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:43.511+0000 7ff03d800640 1 -- 172.21.15.8:0/3549280880 >> v2:172.21.15.8:3300/0 conn(0x7ff0380c28d0 msgr2=0x7ff038156330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:45:43.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:43.511+0000 7ff03ce00640 1 -- 172.21.15.8:0/3549280880 >> v1:172.21.15.8:6789/0 conn(0x7ff0380a87a0 legacy=0x7ff03806cf40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:45:43.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:43.511+0000 7ff03d800640 1 --2- 172.21.15.8:0/3549280880 >> v2:172.21.15.8:3300/0 conn(0x7ff0380c28d0 0x7ff038156330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:45:43.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:43.915+0000 7ff03d800640 1 -- 172.21.15.8:0/3549280880 >> v2:172.21.15.8:3300/0 conn(0x7ff0380c28d0 msgr2=0x7ff038156330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:45:43.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:43.915+0000 7ff03ce00640 1 -- 172.21.15.8:0/3549280880 >> v1:172.21.15.8:6789/0 conn(0x7ff0380a87a0 legacy=0x7ff03806cf40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:45:43.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:43.915+0000 7ff03d800640 1 --2- 172.21.15.8:0/3549280880 >> v2:172.21.15.8:3300/0 conn(0x7ff0380c28d0 0x7ff038156330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:45:44.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:44.719+0000 7ff03d800640 1 -- 172.21.15.8:0/3549280880 >> v2:172.21.15.8:3300/0 conn(0x7ff0380c28d0 msgr2=0x7ff038156330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:45:44.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:44.719+0000 7ff03ce00640 1 -- 172.21.15.8:0/3549280880 >> v1:172.21.15.8:6789/0 conn(0x7ff0380a87a0 legacy=0x7ff03806cf40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:45:44.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:44.719+0000 7ff03d800640 1 --2- 172.21.15.8:0/3549280880 >> v2:172.21.15.8:3300/0 conn(0x7ff0380c28d0 0x7ff038156330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:45:46.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.307+0000 7ff036a00640 1 -- 172.21.15.8:0/3549280880 >> v2:172.21.15.8:3300/0 conn(0x7ff0380c28d0 msgr2=0x7ff038156330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:45:46.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.307+0000 7ff036a00640 1 --2- 172.21.15.8:0/3549280880 >> v2:172.21.15.8:3300/0 conn(0x7ff0380c28d0 0x7ff038156330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:46.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.307+0000 7ff036a00640 1 -- 172.21.15.8:0/3549280880 >> v1:172.21.15.196:6789/0 conn(0x7ff0380c8930 legacy=0x7ff038070f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:46.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.307+0000 7ff036a00640 1 -- 172.21.15.8:0/3549280880 >> v1:172.21.15.8:6789/0 conn(0x7ff0380a87a0 legacy=0x7ff03806cf40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:45:46.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.307+0000 7ff036a00640 1 --2- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0180036d0 0x7ff018005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:46.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.307+0000 7ff036a00640 1 --2- 172.21.15.8:0/3549280880 >> v2:172.21.15.196:3300/0 conn(0x7ff018006220 0x7ff0180086e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:46.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.307+0000 7ff036a00640 1 -- 172.21.15.8:0/3549280880 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0380c2cb0 con 0x7ff018006220 2024-03-23T23:45:46.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.307+0000 7ff036a00640 1 -- 172.21.15.8:0/3549280880 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff018008d90 con 0x7ff0180036d0 2024-03-23T23:45:46.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.307+0000 7ff03d800640 1 --2- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0180036d0 0x7ff018005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:46.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.307+0000 7ff03ce00640 1 --2- 172.21.15.8:0/3549280880 >> v2:172.21.15.196:3300/0 conn(0x7ff018006220 0x7ff0180086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:46.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.307+0000 7ff03d800640 1 -- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0180036d0 msgr2=0x7ff018005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:45:46.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.307+0000 7ff03d800640 1 -- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0180036d0 msgr2=0x7ff018005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:45:46.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.307+0000 7ff03d800640 1 --2- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0180036d0 0x7ff018005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:45:46.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.307+0000 7ff03ce00640 1 -- 172.21.15.8:0/3549280880 >> v2:172.21.15.196:3300/0 conn(0x7ff018006220 msgr2=0x7ff0180086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:45:46.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.307+0000 7ff03ce00640 1 -- 172.21.15.8:0/3549280880 >> v2:172.21.15.196:3300/0 conn(0x7ff018006220 msgr2=0x7ff0180086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:45:46.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.307+0000 7ff03ce00640 1 --2- 172.21.15.8:0/3549280880 >> v2:172.21.15.196:3300/0 conn(0x7ff018006220 0x7ff0180086e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:45:46.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.307+0000 7ff03ce00640 1 --2- 172.21.15.8:0/3549280880 >> v2:172.21.15.196:3300/0 conn(0x7ff018006220 0x7ff0180086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:45:46.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.307+0000 7ff03d800640 1 --2- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0180036d0 0x7ff018005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:45:46.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.511+0000 7ff03ce00640 1 --2- 172.21.15.8:0/3549280880 >> v2:172.21.15.196:3300/0 conn(0x7ff018006220 0x7ff0180086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:46.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.511+0000 7ff03d800640 1 --2- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0180036d0 0x7ff018005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:46.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.511+0000 7ff03d800640 1 -- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0180036d0 msgr2=0x7ff018005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:45:46.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.511+0000 7ff03d800640 1 -- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0180036d0 msgr2=0x7ff018005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:45:46.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.511+0000 7ff03d800640 1 --2- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0180036d0 0x7ff018005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:45:46.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.511+0000 7ff03d800640 1 --2- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0180036d0 0x7ff018005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:45:46.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.511+0000 7ff03ce00640 1 -- 172.21.15.8:0/3549280880 >> v2:172.21.15.196:3300/0 conn(0x7ff018006220 msgr2=0x7ff0180086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:45:46.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.511+0000 7ff03ce00640 1 -- 172.21.15.8:0/3549280880 >> v2:172.21.15.196:3300/0 conn(0x7ff018006220 msgr2=0x7ff0180086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:45:46.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.511+0000 7ff03ce00640 1 --2- 172.21.15.8:0/3549280880 >> v2:172.21.15.196:3300/0 conn(0x7ff018006220 0x7ff0180086e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:45:46.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.511+0000 7ff03ce00640 1 --2- 172.21.15.8:0/3549280880 >> v2:172.21.15.196:3300/0 conn(0x7ff018006220 0x7ff0180086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:45:46.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.915+0000 7ff03ce00640 1 --2- 172.21.15.8:0/3549280880 >> v2:172.21.15.196:3300/0 conn(0x7ff018006220 0x7ff0180086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:46.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.915+0000 7ff03d800640 1 --2- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0180036d0 0x7ff018005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:46.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.915+0000 7ff03d800640 1 -- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0180036d0 msgr2=0x7ff018005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:45:46.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.915+0000 7ff03d800640 1 -- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0180036d0 msgr2=0x7ff018005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:45:46.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.915+0000 7ff03d800640 1 --2- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0180036d0 0x7ff018005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:45:46.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.915+0000 7ff03d800640 1 --2- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0180036d0 0x7ff018005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:45:46.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.915+0000 7ff03ce00640 1 -- 172.21.15.8:0/3549280880 >> v2:172.21.15.196:3300/0 conn(0x7ff018006220 msgr2=0x7ff0180086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:45:46.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.915+0000 7ff03ce00640 1 -- 172.21.15.8:0/3549280880 >> v2:172.21.15.196:3300/0 conn(0x7ff018006220 msgr2=0x7ff0180086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:45:46.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.915+0000 7ff03ce00640 1 --2- 172.21.15.8:0/3549280880 >> v2:172.21.15.196:3300/0 conn(0x7ff018006220 0x7ff0180086e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:45:46.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:46.915+0000 7ff03ce00640 1 --2- 172.21.15.8:0/3549280880 >> v2:172.21.15.196:3300/0 conn(0x7ff018006220 0x7ff0180086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:45:47.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:47.719+0000 7ff03ce00640 1 --2- 172.21.15.8:0/3549280880 >> v2:172.21.15.196:3300/0 conn(0x7ff018006220 0x7ff0180086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:47.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:47.719+0000 7ff03d800640 1 --2- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0180036d0 0x7ff018005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:47.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:47.719+0000 7ff03ce00640 1 -- 172.21.15.8:0/3549280880 >> v2:172.21.15.196:3300/0 conn(0x7ff018006220 msgr2=0x7ff0180086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:45:47.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:47.719+0000 7ff03ce00640 1 -- 172.21.15.8:0/3549280880 >> v2:172.21.15.196:3300/0 conn(0x7ff018006220 msgr2=0x7ff0180086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:45:47.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:47.719+0000 7ff03ce00640 1 --2- 172.21.15.8:0/3549280880 >> v2:172.21.15.196:3300/0 conn(0x7ff018006220 0x7ff0180086e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:45:47.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:47.719+0000 7ff03d800640 1 -- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0180036d0 msgr2=0x7ff018005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:45:47.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:47.719+0000 7ff03d800640 1 -- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0180036d0 msgr2=0x7ff018005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:45:47.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:47.719+0000 7ff03d800640 1 --2- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0180036d0 0x7ff018005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:45:47.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:47.719+0000 7ff03ce00640 1 --2- 172.21.15.8:0/3549280880 >> v2:172.21.15.196:3300/0 conn(0x7ff018006220 0x7ff0180086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:45:47.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:47.719+0000 7ff03d800640 1 --2- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0180036d0 0x7ff018005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:45:48.068 INFO:tasks.workunit.client.1.smithi196.stdout: current utilization = 0.00% 2024-03-23T23:45:48.068 INFO:tasks.workunit.client.1.smithi196.stdout: 2024-03-23T23:45:48.068 INFO:tasks.workunit.client.1.smithi196.stdout:checking existing fs: . 2024-03-23T23:45:48.462 INFO:tasks.workunit.client.1.smithi196.stdout:recreating new fileset 2024-03-23T23:45:48.462 INFO:tasks.workunit.client.1.smithi196.stderr:opendir: No such file or directory 2024-03-23T23:45:49.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff036a00640 1 -- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0180036d0 msgr2=0x7ff018005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:45:49.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff036a00640 1 --2- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0180036d0 0x7ff018005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:49.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff036a00640 1 -- 172.21.15.8:0/3549280880 >> v2:172.21.15.196:3300/0 conn(0x7ff018006220 msgr2=0x7ff0180086e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:45:49.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff036a00640 1 --2- 172.21.15.8:0/3549280880 >> v2:172.21.15.196:3300/0 conn(0x7ff018006220 0x7ff0180086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:49.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff03e200640 1 -- 172.21.15.8:0/3549280880 reap_dead start 2024-03-23T23:45:49.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff036a00640 1 --2- 172.21.15.8:0/3549280880 >> v2:172.21.15.8:3300/0 conn(0x7ff018003af0 0x7ff018006650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:49.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff036a00640 1 -- 172.21.15.8:0/3549280880 --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff038155850 con 0x7ff0380a87a0 2024-03-23T23:45:49.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff036a00640 1 -- 172.21.15.8:0/3549280880 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0380a7fe0 con 0x7ff018006b90 2024-03-23T23:45:49.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff036a00640 1 -- 172.21.15.8:0/3549280880 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0380c2cb0 con 0x7ff018003af0 2024-03-23T23:45:49.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff03d800640 1 -- 172.21.15.8:0/3549280880 >> v1:172.21.15.8:6789/0 conn(0x7ff0380a87a0 legacy=0x7ff01800b260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:45:49.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff03ce00640 1 -- 172.21.15.8:0/3549280880 >> v2:172.21.15.8:3300/0 conn(0x7ff018003af0 msgr2=0x7ff018006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:45:49.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff03ce00640 1 --2- 172.21.15.8:0/3549280880 >> v2:172.21.15.8:3300/0 conn(0x7ff018003af0 0x7ff018006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:45:49.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff037e00640 1 -- 172.21.15.8:0/3549280880 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1204986478 0 0) 0x7ff0380a7fe0 con 0x7ff018006b90 2024-03-23T23:45:49.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff037e00640 1 -- 172.21.15.8:0/3549280880 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff020003530 con 0x7ff018006b90 2024-03-23T23:45:49.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff037e00640 1 -- 172.21.15.8:0/3549280880 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4087522523 0 0) 0x7ff020003530 con 0x7ff018006b90 2024-03-23T23:45:49.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff037e00640 1 -- 172.21.15.8:0/3549280880 >> v2:172.21.15.8:3300/0 conn(0x7ff018003af0 msgr2=0x7ff018006650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:45:49.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff037e00640 1 --2- 172.21.15.8:0/3549280880 >> v2:172.21.15.8:3300/0 conn(0x7ff018003af0 0x7ff018006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:49.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff037e00640 1 -- 172.21.15.8:0/3549280880 >> v1:172.21.15.8:6789/0 conn(0x7ff0380a87a0 legacy=0x7ff01800b260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:45:49.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff037e00640 1 -- 172.21.15.8:0/3549280880 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff018008910 con 0x7ff018006b90 2024-03-23T23:45:49.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff037e00640 1 -- 172.21.15.8:0/3549280880 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7ff030001880 con 0x7ff018006b90 2024-03-23T23:45:49.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff037e00640 1 -- 172.21.15.8:0/3549280880 >> v1:172.21.15.196:6789/0 conn(0x7ff018006b90 legacy=0x7ff018007040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:49.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff037e00640 1 --2- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0200039c0 0x7ff020003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:49.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff037e00640 1 --2- 172.21.15.8:0/3549280880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff020004810 0x7ff020004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:49.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff037e00640 1 --2- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0200052f0 0x7ff02000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:49.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff037e00640 1 -- 172.21.15.8:0/3549280880 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0380c2cb0 con 0x7ff020004810 2024-03-23T23:45:49.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff037e00640 1 -- 172.21.15.8:0/3549280880 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02000c240 con 0x7ff0200039c0 2024-03-23T23:45:49.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff037e00640 1 -- 172.21.15.8:0/3549280880 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff02000c440 con 0x7ff0200052f0 2024-03-23T23:45:49.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff03ce00640 1 -- 172.21.15.8:0/3549280880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff020004810 msgr2=0x7ff020004c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:45:49.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff03ce00640 1 --2- 172.21.15.8:0/3549280880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff020004810 0x7ff020004c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:45:49.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff03d800640 1 --2- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0200039c0 0x7ff020003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:49.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff03e200640 1 --2- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0200052f0 0x7ff02000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:49.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff03d800640 1 -- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0200052f0 msgr2=0x7ff02000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:45:49.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.307+0000 7ff03d800640 1 --2- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0200052f0 0x7ff02000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:49.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.311+0000 7ff03d800640 1 -- 172.21.15.8:0/3549280880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff020004810 msgr2=0x7ff020004c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:45:49.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.311+0000 7ff03d800640 1 --2- 172.21.15.8:0/3549280880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff020004810 0x7ff020004c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:49.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.311+0000 7ff03d800640 1 -- 172.21.15.8:0/3549280880 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff020003530 con 0x7ff0200039c0 2024-03-23T23:45:49.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.311+0000 7ff03e200640 1 -- 172.21.15.8:0/3549280880 reap_dead start 2024-03-23T23:45:49.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.311+0000 7ff03d800640 1 --2- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0200039c0 0x7ff020003dc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0038c0 tx=0x7ff02c01d8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecd596bdc1e6e0e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:49.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.311+0000 7ff037e00640 1 -- 172.21.15.8:0/3549280880 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c009b40 con 0x7ff0200039c0 2024-03-23T23:45:49.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.311+0000 7ff037e00640 1 -- 172.21.15.8:0/3549280880 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02c0a76e0 con 0x7ff0200039c0 2024-03-23T23:45:49.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.311+0000 7ff037e00640 1 -- 172.21.15.8:0/3549280880 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c0a7ad0 con 0x7ff0200039c0 2024-03-23T23:45:49.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.315+0000 7ff03ec00640 1 -- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0200039c0 msgr2=0x7ff020003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:49.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.315+0000 7ff03ec00640 1 --2- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0200039c0 0x7ff020003dc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0038c0 tx=0x7ff02c01d8a0 comp rx=0 tx=0).stop 2024-03-23T23:45:49.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.315+0000 7ff03ec00640 1 -- 172.21.15.8:0/3549280880 shutdown_connections 2024-03-23T23:45:49.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.315+0000 7ff03ec00640 1 --2- 172.21.15.8:0/3549280880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0200039c0 0x7ff020003dc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:49.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.315+0000 7ff03ec00640 1 -- 172.21.15.8:0/3549280880 >> 172.21.15.8:0/3549280880 conn(0x7ff0380aac30 msgr2=0x7ff0380ab040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:45:49.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.315+0000 7ff03ec00640 1 -- 172.21.15.8:0/3549280880 shutdown_connections 2024-03-23T23:45:49.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.315+0000 7ff03ec00640 1 -- 172.21.15.8:0/3549280880 wait complete. 2024-03-23T23:45:49.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.315+0000 7ff03ec00640 1 Processor -- start 2024-03-23T23:45:49.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.315+0000 7ff03ec00640 1 -- start start 2024-03-23T23:45:49.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.319+0000 7ff03ec00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0200039c0 0x7ff038152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:49.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.319+0000 7ff03ec00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff038156ab0 0x7ff0381590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:49.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.319+0000 7ff03ec00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0381595e0 0x7ff0381ee780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:49.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.319+0000 7ff03ec00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0380a8250 con 0x7ff0200039c0 2024-03-23T23:45:49.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.319+0000 7ff03ec00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff038155e10 con 0x7ff038156ab0 2024-03-23T23:45:49.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.319+0000 7ff03ec00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0380a83d0 con 0x7ff0381595e0 2024-03-23T23:45:49.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.319+0000 7ff03d800640 1 -- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0200039c0 msgr2=0x7ff038152c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:45:49.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.319+0000 7ff03d800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0200039c0 0x7ff038152c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:45:49.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.319+0000 7ff03ce00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff038156ab0 0x7ff0381590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:49.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.319+0000 7ff03ce00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff038156ab0 0x7ff0381590a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:55646/0 (socket says 172.21.15.8:55646) 2024-03-23T23:45:49.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.319+0000 7ff03ce00640 1 -- 172.21.15.8:0/3238538993 learned_addr learned my addr 172.21.15.8:0/3238538993 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:45:49.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.319+0000 7ff03e200640 1 --2- 172.21.15.8:0/3238538993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0381595e0 0x7ff0381ee780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:49.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.319+0000 7ff03ce00640 1 -- 172.21.15.8:0/3238538993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0381595e0 msgr2=0x7ff0381ee780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:49.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.319+0000 7ff03ce00640 1 --2- 172.21.15.8:0/3238538993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0381595e0 0x7ff0381ee780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:49.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.319+0000 7ff03ce00640 1 -- 172.21.15.8:0/3238538993 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0200039c0 msgr2=0x7ff038152c20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:45:49.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.319+0000 7ff03ce00640 1 --2- 172.21.15.8:0/3238538993 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0200039c0 0x7ff038152c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:49.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.319+0000 7ff03ce00640 1 -- 172.21.15.8:0/3238538993 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0381eb280 con 0x7ff038156ab0 2024-03-23T23:45:49.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.319+0000 7ff03e200640 1 --2- 172.21.15.8:0/3238538993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0381595e0 0x7ff0381ee780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:45:49.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.319+0000 7ff03ce00640 1 --2- 172.21.15.8:0/3238538993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff038156ab0 0x7ff0381590a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff024009810 tx=0x7ff024009c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:49.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.319+0000 7ff035600640 1 -- 172.21.15.8:0/3238538993 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02401b070 con 0x7ff038156ab0 2024-03-23T23:45:49.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.319+0000 7ff035600640 1 -- 172.21.15.8:0/3238538993 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02400abe0 con 0x7ff038156ab0 2024-03-23T23:45:49.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.319+0000 7ff035600640 1 -- 172.21.15.8:0/3238538993 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff024016410 con 0x7ff038156ab0 2024-03-23T23:45:49.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.319+0000 7ff03ec00640 1 -- 172.21.15.8:0/3238538993 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0381eb560 con 0x7ff038156ab0 2024-03-23T23:45:49.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.319+0000 7ff03ec00640 1 -- 172.21.15.8:0/3238538993 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0381ebb20 con 0x7ff038156ab0 2024-03-23T23:45:49.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.319+0000 7ff03ec00640 1 -- 172.21.15.8:0/3238538993 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff03804f410 con 0x7ff038156ab0 2024-03-23T23:45:49.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.323+0000 7ff035600640 1 -- 172.21.15.8:0/3238538993 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff02401e070 con 0x7ff038156ab0 2024-03-23T23:45:49.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.323+0000 7ff035600640 1 --2- 172.21.15.8:0/3238538993 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff01806b920 0x7ff01806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:49.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.323+0000 7ff035600640 1 -- 172.21.15.8:0/3238538993 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7ff024085900 con 0x7ff038156ab0 2024-03-23T23:45:49.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.323+0000 7ff03d800640 1 --2- 172.21.15.8:0/3238538993 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff01806b920 0x7ff01806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:49.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.323+0000 7ff03d800640 1 --2- 172.21.15.8:0/3238538993 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff01806b920 0x7ff01806dde0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0b0000 tx=0x7ff02c005cb0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:49.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.327+0000 7ff035600640 1 -- 172.21.15.8:0/3238538993 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7ff024056230 con 0x7ff038156ab0 2024-03-23T23:45:49.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.819+0000 7ff03ec00640 1 -- 172.21.15.8:0/3238538993 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff0380a7fe0 con 0x7ff038156ab0 2024-03-23T23:45:49.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.819+0000 7ff035600640 1 -- 172.21.15.8:0/3238538993 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1554 (secure 0 0 0) 0x7ff024055b30 con 0x7ff038156ab0 2024-03-23T23:45:49.824 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":20,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:45:49.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.823+0000 7ff03ec00640 1 -- 172.21.15.8:0/3238538993 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff01806b920 msgr2=0x7ff01806dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:49.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.823+0000 7ff03ec00640 1 --2- 172.21.15.8:0/3238538993 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff01806b920 0x7ff01806dde0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0b0000 tx=0x7ff02c005cb0 comp rx=0 tx=0).stop 2024-03-23T23:45:49.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.823+0000 7ff03ec00640 1 -- 172.21.15.8:0/3238538993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff038156ab0 msgr2=0x7ff0381590a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:49.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.823+0000 7ff03ec00640 1 --2- 172.21.15.8:0/3238538993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff038156ab0 0x7ff0381590a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff024009810 tx=0x7ff024009c10 comp rx=0 tx=0).stop 2024-03-23T23:45:49.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.823+0000 7ff03ec00640 1 -- 172.21.15.8:0/3238538993 shutdown_connections 2024-03-23T23:45:49.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.823+0000 7ff03ec00640 1 --2- 172.21.15.8:0/3238538993 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff01806b920 0x7ff01806dde0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:49.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.823+0000 7ff03ec00640 1 --2- 172.21.15.8:0/3238538993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0381595e0 0x7ff0381ee780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:49.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.823+0000 7ff03ec00640 1 --2- 172.21.15.8:0/3238538993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff038156ab0 0x7ff0381590a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:49.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.823+0000 7ff03ec00640 1 --2- 172.21.15.8:0/3238538993 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0200039c0 0x7ff038152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:49.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.823+0000 7ff03ec00640 1 -- 172.21.15.8:0/3238538993 >> 172.21.15.8:0/3238538993 conn(0x7ff0380aac30 msgr2=0x7ff0380a9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:45:49.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.823+0000 7ff03ec00640 1 -- 172.21.15.8:0/3238538993 shutdown_connections 2024-03-23T23:45:49.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:49.823+0000 7ff03ec00640 1 -- 172.21.15.8:0/3238538993 wait complete. 2024-03-23T23:45:49.868 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-03-23T23:45:49.869 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-03-23T23:45:49.869 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:45:50.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.171+0000 7fca37200640 1 Processor -- start 2024-03-23T23:45:50.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.171+0000 7fca37200640 1 -- start start 2024-03-23T23:45:50.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.171+0000 7fca37200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fca3814ef10 0x7fca380c1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:50.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.171+0000 7fca37200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fca38072ff0 0x7fca38151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:50.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.171+0000 7fca36800640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7fca38072ff0 msgr2=0x7fca38151ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:45:50.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.171+0000 7fca36800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fca38072ff0 0x7fca38151ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:45:50.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.171+0000 7fca37200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca3806e1d0 con 0x7fca3806dcb0 2024-03-23T23:45:50.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.171+0000 7fca35e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fca3814ef10 0x7fca380c1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:50.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.175+0000 7fca37200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca3806d940 con 0x7fca38072ff0 2024-03-23T23:45:50.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.175+0000 7fca37200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca38152510 con 0x7fca3814ef10 2024-03-23T23:45:50.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.175+0000 7fca35400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fca3806dcb0 0x7fca381517b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:58152/0 (socket says 172.21.15.8:58152) 2024-03-23T23:45:50.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.179+0000 7fca35400640 1 -- 172.21.15.8:0/3289616328 learned_addr learned my addr 172.21.15.8:0/3289616328 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:45:50.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.179+0000 7fca34a00640 1 -- 172.21.15.8:0/3289616328 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1040437091 0 0) 0x7fca3806e1d0 con 0x7fca3806dcb0 2024-03-23T23:45:50.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.179+0000 7fca34a00640 1 -- 172.21.15.8:0/3289616328 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca1c005740 con 0x7fca3806dcb0 2024-03-23T23:45:50.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.179+0000 7fca35e00640 1 -- 172.21.15.8:0/3289616328 >> v2:172.21.15.8:3300/0 conn(0x7fca38072ff0 msgr2=0x7fca38151ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:45:50.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.179+0000 7fca35e00640 1 --2- 172.21.15.8:0/3289616328 >> v2:172.21.15.8:3300/0 conn(0x7fca38072ff0 0x7fca38151ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:50.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.179+0000 7fca35e00640 1 -- 172.21.15.8:0/3289616328 >> v1:172.21.15.196:6789/0 conn(0x7fca3806dcb0 legacy=0x7fca381517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:50.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.183+0000 7fca35e00640 1 -- 172.21.15.8:0/3289616328 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca3806d180 con 0x7fca3814ef10 2024-03-23T23:45:50.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.191+0000 7fca35e00640 1 --2- 172.21.15.8:0/3289616328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fca3814ef10 0x7fca380c1ad0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fca28009fd0 tx=0x7fca2801c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86416cf849aebcf1 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:50.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.195+0000 7fca34a00640 1 -- 172.21.15.8:0/3289616328 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca280a9620 con 0x7fca3814ef10 2024-03-23T23:45:50.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.195+0000 7fca34a00640 1 -- 172.21.15.8:0/3289616328 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca280a97c0 con 0x7fca3814ef10 2024-03-23T23:45:50.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.195+0000 7fca34a00640 1 -- 172.21.15.8:0/3289616328 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca280a9b90 con 0x7fca3814ef10 2024-03-23T23:45:50.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.195+0000 7fca37200640 1 -- 172.21.15.8:0/3289616328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fca3814ef10 msgr2=0x7fca380c1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:50.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.195+0000 7fca37200640 1 --2- 172.21.15.8:0/3289616328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fca3814ef10 0x7fca380c1ad0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fca28009fd0 tx=0x7fca2801c540 comp rx=0 tx=0).stop 2024-03-23T23:45:50.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.195+0000 7fca37200640 1 -- 172.21.15.8:0/3289616328 shutdown_connections 2024-03-23T23:45:50.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.195+0000 7fca37200640 1 --2- 172.21.15.8:0/3289616328 >> v2:172.21.15.8:3300/0 conn(0x7fca38072ff0 0x7fca38151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:50.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.195+0000 7fca37200640 1 --2- 172.21.15.8:0/3289616328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fca3814ef10 0x7fca380c1ad0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:50.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.195+0000 7fca37200640 1 -- 172.21.15.8:0/3289616328 >> 172.21.15.8:0/3289616328 conn(0x7fca3806b170 msgr2=0x7fca3806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:45:50.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.195+0000 7fca37200640 1 -- 172.21.15.8:0/3289616328 shutdown_connections 2024-03-23T23:45:50.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.195+0000 7fca37200640 1 -- 172.21.15.8:0/3289616328 wait complete. 2024-03-23T23:45:50.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.199+0000 7fca37200640 1 Processor -- start 2024-03-23T23:45:50.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.199+0000 7fca37200640 1 -- start start 2024-03-23T23:45:50.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.203+0000 7fca37200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca3806dcb0 0x7fca38152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:50.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.203+0000 7fca37200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fca38072ff0 0x7fca380c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:50.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.203+0000 7fca37200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca3815ba50 0x7fca381fca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:50.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.203+0000 7fca36800640 1 -- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca3815ba50 msgr2=0x7fca381fca10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:45:50.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.203+0000 7fca36800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca3815ba50 0x7fca381fca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:45:50.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.203+0000 7fca35400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fca38072ff0 0x7fca380c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:50.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.203+0000 7fca35400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fca38072ff0 0x7fca380c28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:53466/0 (socket says 172.21.15.8:53466) 2024-03-23T23:45:50.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.203+0000 7fca35400640 1 -- 172.21.15.8:0/701791115 learned_addr learned my addr 172.21.15.8:0/701791115 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:45:50.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.203+0000 7fca35e00640 1 --2- 172.21.15.8:0/701791115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca3806dcb0 0x7fca38152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:50.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.203+0000 7fca37200640 1 -- 172.21.15.8:0/701791115 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3815ec40 con 0x7fca3815ba50 2024-03-23T23:45:50.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.211+0000 7fca37200640 1 -- 172.21.15.8:0/701791115 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3815eac0 con 0x7fca3806dcb0 2024-03-23T23:45:50.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.211+0000 7fca37200640 1 -- 172.21.15.8:0/701791115 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3815edc0 con 0x7fca38072ff0 2024-03-23T23:45:50.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.211+0000 7fca35e00640 1 -- 172.21.15.8:0/701791115 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fca38072ff0 msgr2=0x7fca380c28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:50.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.211+0000 7fca35e00640 1 --2- 172.21.15.8:0/701791115 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fca38072ff0 0x7fca380c28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:50.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.211+0000 7fca35e00640 1 -- 172.21.15.8:0/701791115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca3815ba50 msgr2=0x7fca381fca10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:45:50.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.211+0000 7fca35e00640 1 --2- 172.21.15.8:0/701791115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca3815ba50 0x7fca381fca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:50.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.211+0000 7fca35e00640 1 -- 172.21.15.8:0/701791115 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca38153100 con 0x7fca3806dcb0 2024-03-23T23:45:50.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.211+0000 7fca35e00640 1 --2- 172.21.15.8:0/701791115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca3806dcb0 0x7fca38152b20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fca280aa000 tx=0x7fca2801ad80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:50.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.211+0000 7fca2e000640 1 -- 172.21.15.8:0/701791115 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca280ba410 con 0x7fca3806dcb0 2024-03-23T23:45:50.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.211+0000 7fca37200640 1 -- 172.21.15.8:0/701791115 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca381fed60 con 0x7fca3806dcb0 2024-03-23T23:45:50.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.211+0000 7fca37200640 1 -- 172.21.15.8:0/701791115 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca381ff320 con 0x7fca3806dcb0 2024-03-23T23:45:50.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.211+0000 7fca2e000640 1 -- 172.21.15.8:0/701791115 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca280ba5b0 con 0x7fca3806dcb0 2024-03-23T23:45:50.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.211+0000 7fca2e000640 1 -- 172.21.15.8:0/701791115 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca280ba9a0 con 0x7fca3806dcb0 2024-03-23T23:45:50.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.215+0000 7fca37200640 1 --2- 172.21.15.8:0/701791115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca10002a80 0x7fca10004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:50.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.215+0000 7fca37200640 1 -- 172.21.15.8:0/701791115 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca10007ed0 con 0x7fca10002a80 2024-03-23T23:45:50.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.215+0000 7fca35400640 1 --2- 172.21.15.8:0/701791115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca10002a80 0x7fca10004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:50.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.215+0000 7fca35400640 1 -- 172.21.15.8:0/701791115 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fca100080d0 con 0x7fca10002a80 2024-03-23T23:45:50.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.215+0000 7fca35400640 1 --2- 172.21.15.8:0/701791115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca10002a80 0x7fca10004f40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fca38150ef0 tx=0x7fca2400fc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:50.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.215+0000 7fca2e000640 1 -- 172.21.15.8:0/701791115 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca240058c0 con 0x7fca10002a80 2024-03-23T23:45:50.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.215+0000 7fca2e000640 1 -- 172.21.15.8:0/701791115 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fca280b93b0 con 0x7fca3806dcb0 2024-03-23T23:45:50.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.219+0000 7fca2e000640 1 --2- 172.21.15.8:0/701791115 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fca18067560 0x7fca18069a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:50.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.219+0000 7fca2e000640 1 -- 172.21.15.8:0/701791115 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fca24018070 con 0x7fca10002a80 2024-03-23T23:45:50.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.219+0000 7fca2e000640 1 -- 172.21.15.8:0/701791115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca10002a80 msgr2=0x7fca10004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:50.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.219+0000 7fca2e000640 1 --2- 172.21.15.8:0/701791115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca10002a80 0x7fca10004f40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fca38150ef0 tx=0x7fca2400fc00 comp rx=0 tx=0).stop 2024-03-23T23:45:50.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.219+0000 7fca2e000640 1 -- 172.21.15.8:0/701791115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca10002a80 msgr2=0x7fca10004f40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:45:50.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.219+0000 7fca2e000640 1 --2- 172.21.15.8:0/701791115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca10002a80 0x7fca10004f40 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fca38150ef0 tx=0x7fca2400fc00 comp rx=0 tx=0).stop 2024-03-23T23:45:50.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.219+0000 7fca2e000640 1 -- 172.21.15.8:0/701791115 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fca2811f7b0 con 0x7fca3806dcb0 2024-03-23T23:45:50.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.219+0000 7fca36800640 1 --2- 172.21.15.8:0/701791115 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fca18067560 0x7fca18069a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:50.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.219+0000 7fca36800640 1 --2- 172.21.15.8:0/701791115 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fca18067560 0x7fca18069a20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fca38073430 tx=0x7fca30009210 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:50.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.239+0000 7fca37200640 1 --2- 172.21.15.8:0/701791115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca100016a0 0x7fca10001b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:50.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.243+0000 7fca37200640 1 -- 172.21.15.8:0/701791115 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1000a3f0 con 0x7fca100016a0 2024-03-23T23:45:50.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.243+0000 7fca35400640 1 --2- 172.21.15.8:0/701791115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca100016a0 0x7fca10001b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:50.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.243+0000 7fca35400640 1 -- 172.21.15.8:0/701791115 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fca10002070 con 0x7fca100016a0 2024-03-23T23:45:50.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.243+0000 7fca35400640 1 --2- 172.21.15.8:0/701791115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca100016a0 0x7fca10001b30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fca380aca80 tx=0x7fca24000ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:50.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.243+0000 7fca2e000640 1 -- 172.21.15.8:0/701791115 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca240070d0 con 0x7fca100016a0 2024-03-23T23:45:50.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.243+0000 7fca2e000640 1 -- 172.21.15.8:0/701791115 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4663 (secure 0 0 0) 0x7fca24007270 con 0x7fca100016a0 2024-03-23T23:45:50.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.243+0000 7fca2e000640 1 -- 172.21.15.8:0/701791115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca100016a0 msgr2=0x7fca10001b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:50.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.243+0000 7fca2e000640 1 --2- 172.21.15.8:0/701791115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca100016a0 0x7fca10001b30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fca380aca80 tx=0x7fca24000ee0 comp rx=0 tx=0).stop 2024-03-23T23:45:50.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.243+0000 7fca2e000640 1 -- 172.21.15.8:0/701791115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca100016a0 msgr2=0x7fca10001b30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:45:50.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.243+0000 7fca2e000640 1 --2- 172.21.15.8:0/701791115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca100016a0 0x7fca10001b30 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fca380aca80 tx=0x7fca24000ee0 comp rx=0 tx=0).stop 2024-03-23T23:45:50.252 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:45:50.252 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:45:50.252 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:45:50.252 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:45:50.253 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 20, 2024-03-23T23:45:50.253 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:45:50.253 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:45:50.253 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:45:50.253 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:50.253 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 2, 2024-03-23T23:45:50.253 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:45:50.253 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:45:50.253 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:45:50.253 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:45:50.253 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:45:50.253 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:45:50.253 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:45:50.254 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:45:50.254 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:45:50.254 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:45:50.254 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:45:50.254 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:45:50.254 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:45:50.254 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:45:50.254 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:50.254 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:45:50.254 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:45:50.255 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:45:50.255 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:45:50.255 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:45:50.255 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:45:50.255 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:45:50.255 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:45:50.255 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:45:50.255 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:45:50.255 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:45:50.255 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:45:50.255 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:45:50.255 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:50.255 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:50.256 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:45:50.256 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:45:50.256 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:45:50.256 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:45:50.256 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:45:50.256 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:45:50.256 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:45:50.256 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:45:50.256 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:45:50.256 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:45:50.256 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:45:50.256 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:45:50.256 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:45:50.256 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:45:50.257 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:45:50.257 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:45:50.257 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:45:50.257 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:45:50.257 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:45:50.257 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:45:50.257 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:45:50.257 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:45:50.257 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:45:50.257 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:45:50.257 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:45:50.257 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:45:50.257 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:45:50.257 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:45:50.258 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:50.258 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:45:50.258 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:50.258 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:45:50.258 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:50.258 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:45:50.258 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:45:50.258 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:45:50.258 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:45:50.258 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:50.258 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:45:50.259 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:45:50.259 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:50.259 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:50.259 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:50.259 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:45:50.259 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:45:50.259 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:50.259 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:50.259 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:50.259 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:50.260 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:45:50.260 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:45:50.260 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:45:50.260 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:45:50.260 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:45:50.260 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:50.260 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:50.260 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:45:50.260 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:45:50.260 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:45:50.261 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:45:50.261 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:50.261 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:45:50.261 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:45:50.261 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:50.261 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:50.261 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:50.261 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:45:50.261 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:45:50.261 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:50.261 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:50.262 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:50.262 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:50.262 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:45:50.262 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:45:50.262 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:45:50.262 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:45:50.262 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:45:50.262 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:50.262 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:50.262 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:45:50.262 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:45:50.263 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:45:50.263 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:45:50.263 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:50.263 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:45:50.263 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:45:50.263 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:50.263 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:50.263 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:50.263 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:45:50.263 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:45:50.264 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:50.264 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:50.264 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:50.264 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:50.264 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:45:50.264 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:45:50.264 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:45:50.264 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:45:50.264 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:45:50.265 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:50.265 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:50.265 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:50.265 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:45:50.265 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:45:50.265 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:50.265 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:45:50.265 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:50.265 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:45:50.265 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:50.265 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:50.266 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:45:50.266 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:50.266 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:45:50.266 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:50.266 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:45:50.266 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:50.266 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:50.266 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:45:50.266 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:50.266 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:45:50.266 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:50.267 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:50.267 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:50.267 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:45:50.267 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:45:50.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.251+0000 7fca37200640 1 -- 172.21.15.8:0/701791115 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fca18067560 msgr2=0x7fca18069a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:50.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.251+0000 7fca37200640 1 --2- 172.21.15.8:0/701791115 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fca18067560 0x7fca18069a20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fca38073430 tx=0x7fca30009210 comp rx=0 tx=0).stop 2024-03-23T23:45:50.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.255+0000 7fca37200640 1 -- 172.21.15.8:0/701791115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca3806dcb0 msgr2=0x7fca38152b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:50.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.255+0000 7fca36800640 1 -- 172.21.15.8:0/701791115 reap_dead start 2024-03-23T23:45:50.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.255+0000 7fca37200640 1 --2- 172.21.15.8:0/701791115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca3806dcb0 0x7fca38152b20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fca280aa000 tx=0x7fca2801ad80 comp rx=0 tx=0).stop 2024-03-23T23:45:50.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.255+0000 7fca36800640 1 -- 172.21.15.8:0/701791115 reap_dead start 2024-03-23T23:45:50.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.259+0000 7fca37200640 1 -- 172.21.15.8:0/701791115 shutdown_connections 2024-03-23T23:45:50.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.259+0000 7fca37200640 1 -- 172.21.15.8:0/701791115 >> 172.21.15.8:0/701791115 conn(0x7fca3806b170 msgr2=0x7fca380c67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:45:50.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.263+0000 7fca37200640 1 -- 172.21.15.8:0/701791115 shutdown_connections 2024-03-23T23:45:50.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.263+0000 7fca37200640 1 -- 172.21.15.8:0/701791115 wait complete. 2024-03-23T23:45:50.314 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T23:45:50.314 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-03-23T23:45:50.314 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:45:50.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.551+0000 7f6e95e00640 1 Processor -- start 2024-03-23T23:45:50.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.551+0000 7f6e95e00640 1 -- start start 2024-03-23T23:45:50.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.551+0000 7f6e95e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e9014d8b0 0x7f6e900c7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:50.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.551+0000 7f6e95e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6e90070b50 0x7f6e901541b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:50.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.555+0000 7f6e95e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e900c7670 con 0x7f6e900c5560 2024-03-23T23:45:50.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.555+0000 7f6e95e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e900c4830 con 0x7f6e90070b50 2024-03-23T23:45:50.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.555+0000 7f6e95e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e900c50d0 con 0x7f6e9014d8b0 2024-03-23T23:45:50.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.555+0000 7f6e87e00640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f6e90070b50 msgr2=0x7f6e901541b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:45:50.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.555+0000 7f6e87e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6e90070b50 0x7f6e901541b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:45:50.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.555+0000 7f6e8f400640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f6e900c5560 legacy=0x7f6e9006ed00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:45:50.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.555+0000 7f6e8ea00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e9014d8b0 0x7f6e900c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:50.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.555+0000 7f6e8ea00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e9014d8b0 0x7f6e900c7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:53476/0 (socket says 172.21.15.8:53476) 2024-03-23T23:45:50.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.555+0000 7f6e8ea00640 1 -- 172.21.15.8:0/2201317733 learned_addr learned my addr 172.21.15.8:0/2201317733 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:45:50.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.555+0000 7f6e8ea00640 1 -- 172.21.15.8:0/2201317733 >> v2:172.21.15.8:3300/0 conn(0x7f6e90070b50 msgr2=0x7f6e901541b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:45:50.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.555+0000 7f6e8ea00640 1 --2- 172.21.15.8:0/2201317733 >> v2:172.21.15.8:3300/0 conn(0x7f6e90070b50 0x7f6e901541b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:50.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.555+0000 7f6e8ea00640 1 -- 172.21.15.8:0/2201317733 >> v1:172.21.15.8:6789/0 conn(0x7f6e900c5560 legacy=0x7f6e9006ed00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:45:50.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.555+0000 7f6e8ea00640 1 -- 172.21.15.8:0/2201317733 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e901546f0 con 0x7f6e9014d8b0 2024-03-23T23:45:50.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.559+0000 7f6e8ea00640 1 --2- 172.21.15.8:0/2201317733 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e9014d8b0 0x7f6e900c7130 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6e80009870 tx=0x7f6e8001c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12707f9465ce32fe server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:50.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.559+0000 7f6e8e000640 1 -- 172.21.15.8:0/2201317733 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e800b0070 con 0x7f6e9014d8b0 2024-03-23T23:45:50.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.559+0000 7f6e8e000640 1 -- 172.21.15.8:0/2201317733 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e800ab600 con 0x7f6e9014d8b0 2024-03-23T23:45:50.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.559+0000 7f6e8e000640 1 -- 172.21.15.8:0/2201317733 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e800ab9d0 con 0x7f6e9014d8b0 2024-03-23T23:45:50.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.559+0000 7f6e95e00640 1 -- 172.21.15.8:0/2201317733 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e9014d8b0 msgr2=0x7f6e900c7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:50.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.559+0000 7f6e95e00640 1 --2- 172.21.15.8:0/2201317733 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e9014d8b0 0x7f6e900c7130 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6e80009870 tx=0x7f6e8001c540 comp rx=0 tx=0).stop 2024-03-23T23:45:50.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.563+0000 7f6e95e00640 1 -- 172.21.15.8:0/2201317733 shutdown_connections 2024-03-23T23:45:50.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.563+0000 7f6e95e00640 1 --2- 172.21.15.8:0/2201317733 >> v2:172.21.15.8:3300/0 conn(0x7f6e90070b50 0x7f6e901541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:50.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.563+0000 7f6e95e00640 1 --2- 172.21.15.8:0/2201317733 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e9014d8b0 0x7f6e900c7130 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:50.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.563+0000 7f6e95e00640 1 -- 172.21.15.8:0/2201317733 >> 172.21.15.8:0/2201317733 conn(0x7f6e900aafe0 msgr2=0x7f6e900ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:45:50.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.563+0000 7f6e95e00640 1 -- 172.21.15.8:0/2201317733 shutdown_connections 2024-03-23T23:45:50.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.563+0000 7f6e95e00640 1 -- 172.21.15.8:0/2201317733 wait complete. 2024-03-23T23:45:50.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.567+0000 7f6e95e00640 1 Processor -- start 2024-03-23T23:45:50.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.567+0000 7f6e95e00640 1 -- start start 2024-03-23T23:45:50.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.567+0000 7f6e95e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e90070b50 0x7f6e900ae120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:50.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.567+0000 7f6e95e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6e900c5560 0x7f6e90153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:50.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.567+0000 7f6e95e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e9014d8b0 0x7f6e900ac930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:50.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.567+0000 7f6e95e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9006f590 con 0x7f6e9014d8b0 2024-03-23T23:45:50.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.567+0000 7f6e95e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9006f410 con 0x7f6e900c5560 2024-03-23T23:45:50.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.567+0000 7f6e95e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e900c59f0 con 0x7f6e90070b50 2024-03-23T23:45:50.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.567+0000 7f6e8f400640 1 -- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e9014d8b0 msgr2=0x7f6e900ac930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:45:50.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.567+0000 7f6e8f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e9014d8b0 0x7f6e900ac930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:45:50.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.571+0000 7f6e8ea00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e90070b50 0x7f6e900ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:50.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.571+0000 7f6e87e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6e900c5560 0x7f6e90153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:50.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.571+0000 7f6e8ea00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e90070b50 0x7f6e900ae120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:53488/0 (socket says 172.21.15.8:53488) 2024-03-23T23:45:50.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.571+0000 7f6e8ea00640 1 -- 172.21.15.8:0/1209087619 learned_addr learned my addr 172.21.15.8:0/1209087619 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:45:50.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.571+0000 7f6e8ea00640 1 -- 172.21.15.8:0/1209087619 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6e900c5560 msgr2=0x7f6e90153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:50.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.571+0000 7f6e8ea00640 1 --2- 172.21.15.8:0/1209087619 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6e900c5560 0x7f6e90153250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:50.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.571+0000 7f6e8ea00640 1 -- 172.21.15.8:0/1209087619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e9014d8b0 msgr2=0x7f6e900ac930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:45:50.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.571+0000 7f6e8ea00640 1 --2- 172.21.15.8:0/1209087619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e9014d8b0 0x7f6e900ac930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:45:50.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.571+0000 7f6e8ea00640 1 -- 172.21.15.8:0/1209087619 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e901515a0 con 0x7f6e90070b50 2024-03-23T23:45:50.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.571+0000 7f6e8ea00640 1 --2- 172.21.15.8:0/1209087619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e90070b50 0x7f6e900ae120 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6e8001abf0 tx=0x7f6e8001ad80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:50.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.571+0000 7f6e87400640 1 -- 172.21.15.8:0/1209087619 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e800ba020 con 0x7f6e90070b50 2024-03-23T23:45:50.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.571+0000 7f6e87400640 1 -- 172.21.15.8:0/1209087619 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e800b6620 con 0x7f6e90070b50 2024-03-23T23:45:50.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.571+0000 7f6e95e00640 1 -- 172.21.15.8:0/1209087619 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e900aeb90 con 0x7f6e90070b50 2024-03-23T23:45:50.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.571+0000 7f6e95e00640 1 -- 172.21.15.8:0/1209087619 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e900ac410 con 0x7f6e90070b50 2024-03-23T23:45:50.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.571+0000 7f6e87400640 1 -- 172.21.15.8:0/1209087619 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e800b0040 con 0x7f6e90070b50 2024-03-23T23:45:50.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.575+0000 7f6e95e00640 1 --2- 172.21.15.8:0/1209087619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e900ace70 0x7f6e900a8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:50.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.575+0000 7f6e95e00640 1 -- 172.21.15.8:0/1209087619 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e900ae960 con 0x7f6e900ace70 2024-03-23T23:45:50.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.579+0000 7f6e87400640 1 -- 172.21.15.8:0/1209087619 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f6e800bd020 con 0x7f6e90070b50 2024-03-23T23:45:50.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.579+0000 7f6e87400640 1 --2- 172.21.15.8:0/1209087619 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6e6c067610 0x7f6e6c069ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:50.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.579+0000 7f6e87400640 1 -- 172.21.15.8:0/1209087619 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f6e8011ff90 con 0x7f6e90070b50 2024-03-23T23:45:50.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.583+0000 7f6e87e00640 1 --2- 172.21.15.8:0/1209087619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e900ace70 0x7f6e900a8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:50.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.583+0000 7f6e8f400640 1 --2- 172.21.15.8:0/1209087619 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6e6c067610 0x7f6e6c069ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:50.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.583+0000 7f6e87e00640 1 -- 172.21.15.8:0/1209087619 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6e900ac650 con 0x7f6e900ace70 2024-03-23T23:45:50.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.583+0000 7f6e87e00640 1 --2- 172.21.15.8:0/1209087619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e900ace70 0x7f6e900a8030 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6e7800d700 tx=0x7f6e7800dbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:50.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.583+0000 7f6e8f400640 1 --2- 172.21.15.8:0/1209087619 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6e6c067610 0x7f6e6c069ad0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6e88003cc0 tx=0x7f6e880091f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:50.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.583+0000 7f6e87400640 1 -- 172.21.15.8:0/1209087619 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e780039c0 con 0x7f6e900ace70 2024-03-23T23:45:50.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.583+0000 7f6e87400640 1 -- 172.21.15.8:0/1209087619 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f6e78017070 con 0x7f6e900ace70 2024-03-23T23:45:50.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.583+0000 7f6e87400640 1 -- 172.21.15.8:0/1209087619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e900ace70 msgr2=0x7f6e900a8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:50.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.583+0000 7f6e87400640 1 --2- 172.21.15.8:0/1209087619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e900ace70 0x7f6e900a8030 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6e7800d700 tx=0x7f6e7800dbc0 comp rx=0 tx=0).stop 2024-03-23T23:45:50.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.583+0000 7f6e87400640 1 -- 172.21.15.8:0/1209087619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e900ace70 msgr2=0x7f6e900a8030 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:45:50.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.583+0000 7f6e87400640 1 --2- 172.21.15.8:0/1209087619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e900ace70 0x7f6e900a8030 secure :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6e7800d700 tx=0x7f6e7800dbc0 comp rx=0 tx=0).stop 2024-03-23T23:45:50.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.599+0000 7f6e95e00640 1 --2- 172.21.15.8:0/1209087619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e900ad250 0x7f6e900a8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:45:50.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.599+0000 7f6e95e00640 1 -- 172.21.15.8:0/1209087619 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e90068270 con 0x7f6e900ad250 2024-03-23T23:45:50.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.599+0000 7f6e87e00640 1 --2- 172.21.15.8:0/1209087619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e900ad250 0x7f6e900a8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:45:50.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.599+0000 7f6e87e00640 1 -- 172.21.15.8:0/1209087619 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6e900c3c30 con 0x7f6e900ad250 2024-03-23T23:45:50.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.599+0000 7f6e87e00640 1 --2- 172.21.15.8:0/1209087619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e900ad250 0x7f6e900a8570 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6e78016000 tx=0x7f6e780059e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:45:50.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.599+0000 7f6e87400640 1 -- 172.21.15.8:0/1209087619 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7801cb50 con 0x7f6e900ad250 2024-03-23T23:45:50.604 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:45:50.604 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:45:50.604 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:45:50.604 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:45:50.604 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 20, 2024-03-23T23:45:50.604 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:45:50.604 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:45:50.604 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:45:50.604 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:50.604 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 2, 2024-03-23T23:45:50.604 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:45:50.605 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:45:50.605 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:45:50.605 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:45:50.605 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:45:50.605 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:45:50.605 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:45:50.605 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:45:50.605 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:45:50.605 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:45:50.605 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:45:50.606 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:45:50.606 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:45:50.606 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:45:50.606 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:50.606 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:45:50.606 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:45:50.606 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:45:50.606 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:45:50.606 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:45:50.606 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:45:50.606 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:45:50.606 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:45:50.607 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:45:50.607 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:45:50.607 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:45:50.607 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:45:50.607 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:45:50.607 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:50.607 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:50.607 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:45:50.607 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:45:50.607 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:45:50.607 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:45:50.607 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:45:50.607 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:45:50.608 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:45:50.608 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:45:50.608 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:45:50.608 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:45:50.608 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:45:50.608 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:45:50.608 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:45:50.608 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:45:50.608 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:45:50.608 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:45:50.608 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:45:50.608 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:45:50.608 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:45:50.608 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:45:50.609 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:45:50.609 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:45:50.609 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:45:50.609 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:45:50.609 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:45:50.609 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:45:50.609 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:45:50.609 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:45:50.609 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:50.609 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:45:50.609 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:50.609 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:45:50.609 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:50.610 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:45:50.610 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:45:50.610 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:45:50.610 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:45:50.610 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:50.610 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:45:50.610 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:45:50.610 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:50.610 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:50.610 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:50.610 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:45:50.610 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:45:50.610 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:50.611 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:50.611 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:50.611 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:50.611 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:45:50.611 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:45:50.611 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:45:50.611 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:45:50.611 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:45:50.611 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:50.611 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:50.611 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:45:50.611 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:45:50.611 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:45:50.612 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:45:50.612 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:50.612 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:45:50.612 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:45:50.612 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:50.612 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:50.612 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:50.612 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:45:50.612 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:45:50.612 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:50.612 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:50.612 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:50.612 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:50.612 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:45:50.613 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:45:50.613 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:45:50.613 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:45:50.613 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:45:50.613 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:50.613 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:50.613 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:45:50.613 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:45:50.613 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:45:50.613 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:45:50.613 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:50.613 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:45:50.613 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:45:50.614 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:50.614 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:50.614 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:50.614 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:45:50.614 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:45:50.614 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:45:50.614 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:50.614 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:50.614 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:50.614 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:45:50.614 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:45:50.614 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:45:50.614 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:45:50.615 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:45:50.615 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:50.615 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:50.615 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:50.615 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:45:50.615 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:45:50.615 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:50.615 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:45:50.615 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:50.615 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:45:50.615 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:50.615 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:50.616 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:45:50.616 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:50.616 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:45:50.616 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:50.616 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:45:50.616 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:50.616 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:50.616 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:45:50.616 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:50.616 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:45:50.616 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:50.616 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 8 2024-03-23T23:45:50.616 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:50.617 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:50.617 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:45:50.617 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:50.617 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:45:50.617 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:50.617 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:45:50.617 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:50.617 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:50.617 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:45:50.617 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:50.617 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 6 2024-03-23T23:45:50.617 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:50.617 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:45:50.618 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:45:50.618 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:45:50.618 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:45:50.618 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:45:50.618 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:45:50.618 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:45:50.618 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:45:50.618 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:45:50.618 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:45:50.618 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:45:50.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.599+0000 7f6e87400640 1 -- 172.21.15.8:0/1209087619 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5171 (secure 0 0 0) 0x7f6e7800b730 con 0x7f6e900ad250 2024-03-23T23:45:50.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.599+0000 7f6e87400640 1 -- 172.21.15.8:0/1209087619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e900ad250 msgr2=0x7f6e900a8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:50.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.599+0000 7f6e87400640 1 --2- 172.21.15.8:0/1209087619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e900ad250 0x7f6e900a8570 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6e78016000 tx=0x7f6e780059e0 comp rx=0 tx=0).stop 2024-03-23T23:45:50.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.599+0000 7f6e87400640 1 -- 172.21.15.8:0/1209087619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e900ad250 msgr2=0x7f6e900a8570 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:45:50.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.599+0000 7f6e87400640 1 --2- 172.21.15.8:0/1209087619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e900ad250 0x7f6e900a8570 secure :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6e78016000 tx=0x7f6e780059e0 comp rx=0 tx=0).stop 2024-03-23T23:45:50.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.599+0000 7f6e95e00640 1 -- 172.21.15.8:0/1209087619 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6e6c067610 msgr2=0x7f6e6c069ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:50.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.599+0000 7f6e95e00640 1 --2- 172.21.15.8:0/1209087619 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6e6c067610 0x7f6e6c069ad0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6e88003cc0 tx=0x7f6e880091f0 comp rx=0 tx=0).stop 2024-03-23T23:45:50.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.599+0000 7f6e95e00640 1 -- 172.21.15.8:0/1209087619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e90070b50 msgr2=0x7f6e900ae120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:45:50.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.599+0000 7f6e95e00640 1 --2- 172.21.15.8:0/1209087619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6e90070b50 0x7f6e900ae120 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6e8001abf0 tx=0x7f6e8001ad80 comp rx=0 tx=0).stop 2024-03-23T23:45:50.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.599+0000 7f6e8f400640 1 -- 172.21.15.8:0/1209087619 reap_dead start 2024-03-23T23:45:50.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.599+0000 7f6e8f400640 1 -- 172.21.15.8:0/1209087619 reap_dead start 2024-03-23T23:45:50.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.599+0000 7f6e95e00640 1 -- 172.21.15.8:0/1209087619 shutdown_connections 2024-03-23T23:45:50.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.599+0000 7f6e95e00640 1 -- 172.21.15.8:0/1209087619 >> 172.21.15.8:0/1209087619 conn(0x7f6e900aafe0 msgr2=0x7f6e900c7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:45:50.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.603+0000 7f6e95e00640 1 -- 172.21.15.8:0/1209087619 shutdown_connections 2024-03-23T23:45:50.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:45:50.603+0000 7f6e95e00640 1 -- 172.21.15.8:0/1209087619 wait complete. 2024-03-23T23:45:50.630 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T23:45:50.630 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-03-23T23:45:54.670 INFO:tasks.workunit.client.0.smithi008.stdout:fs setup took 51 secs 2024-03-23T23:46:08.766 INFO:tasks.workunit.client.0.smithi008.stdout:Syncing()...14 sec 2024-03-23T23:46:08.768 INFO:tasks.workunit.client.0.smithi008.stdout:Starting Actual Benchmark At: Sat Mar 23 23:46:08 2024 2024-03-23T23:46:08.768 INFO:tasks.workunit.client.0.smithi008.stdout: 2024-03-23T23:46:10.630 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-03-23T23:46:10.630 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-03-23T23:46:10.631 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-23T23:46:10.631 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-23T23:46:10.665 INFO:tasks.ceph.mon.a:Started 2024-03-23T23:46:10.665 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-03-23T23:46:10.665 INFO:tasks.ceph.mon.c:Sent signal 19 2024-03-23T23:46:10.665 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-03-23T23:46:12.880 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:46:12.895 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:46:25.666 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-03-23T23:46:25.667 INFO:tasks.ceph.mon.c:Sent signal 18 2024-03-23T23:46:25.667 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T23:46:25.667 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:46:26.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.071+0000 7f9aa1200640 1 Processor -- start 2024-03-23T23:46:26.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.075+0000 7f9aa1200640 1 -- start start 2024-03-23T23:46:26.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.075+0000 7f9aa1200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9a9c0710f0 0x7f9a9c15a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:26.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.075+0000 7f9aa1200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9a9c0aa390 0x7f9a9c157010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:26.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.075+0000 7f9aa1200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a9c072f40 con 0x7f9a9c0c1d40 2024-03-23T23:46:26.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.075+0000 7f9aa1200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a9c0ab420 con 0x7f9a9c0aa390 2024-03-23T23:46:26.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.075+0000 7f9aa1200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9c0ab9c0 con 0x7f9a9c0710f0 2024-03-23T23:46:26.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.079+0000 7f9a9a800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9a9c0aa390 0x7f9a9c157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:26.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.083+0000 7f9a9a800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9a9c0aa390 0x7f9a9c157010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49266/0 (socket says 172.21.15.8:49266) 2024-03-23T23:46:26.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.083+0000 7f9a9a800640 1 -- 172.21.15.8:0/1649994701 learned_addr learned my addr 172.21.15.8:0/1649994701 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:46:26.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.083+0000 7f9a9a800640 1 -- 172.21.15.8:0/1649994701 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9a9c0710f0 msgr2=0x7f9a9c15a7f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:46:26.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.083+0000 7f9a9a800640 1 --2- 172.21.15.8:0/1649994701 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9a9c0710f0 0x7f9a9c15a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:26.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.083+0000 7f9a9a800640 1 -- 172.21.15.8:0/1649994701 >> v1:172.21.15.196:6789/0 conn(0x7f9a9c0c1d40 legacy=0x7f9a9c0abe50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:46:26.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.083+0000 7f9a9a800640 1 -- 172.21.15.8:0/1649994701 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a9c0ab690 con 0x7f9a9c0aa390 2024-03-23T23:46:26.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.095+0000 7f9a9a800640 1 --2- 172.21.15.8:0/1649994701 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a9c0aa390 0x7f9a9c157010 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9a9400b1a0 tx=0x7f9a9401cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c04a6d63ab8be5e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:26.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.095+0000 7f9a98a00640 1 -- 172.21.15.8:0/1649994701 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a940a5960 con 0x7f9a9c0aa390 2024-03-23T23:46:26.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.095+0000 7f9a98a00640 1 -- 172.21.15.8:0/1649994701 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a940a5b00 con 0x7f9a9c0aa390 2024-03-23T23:46:26.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.095+0000 7f9a98a00640 1 -- 172.21.15.8:0/1649994701 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a940a5960 con 0x7f9a9c0aa390 2024-03-23T23:46:26.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.099+0000 7f9aa1200640 1 -- 172.21.15.8:0/1649994701 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a9c0aa390 msgr2=0x7f9a9c157010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:26.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.099+0000 7f9aa1200640 1 --2- 172.21.15.8:0/1649994701 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a9c0aa390 0x7f9a9c157010 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9a9400b1a0 tx=0x7f9a9401cbc0 comp rx=0 tx=0).stop 2024-03-23T23:46:26.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.099+0000 7f9aa1200640 1 -- 172.21.15.8:0/1649994701 shutdown_connections 2024-03-23T23:46:26.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.099+0000 7f9aa1200640 1 --2- 172.21.15.8:0/1649994701 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a9c0aa390 0x7f9a9c157010 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:26.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.099+0000 7f9aa1200640 1 --2- 172.21.15.8:0/1649994701 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9a9c0710f0 0x7f9a9c15a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:26.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.099+0000 7f9aa1200640 1 -- 172.21.15.8:0/1649994701 >> 172.21.15.8:0/1649994701 conn(0x7f9a9c0c7170 msgr2=0x7f9a9c0c7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:46:26.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.099+0000 7f9aa1200640 1 -- 172.21.15.8:0/1649994701 shutdown_connections 2024-03-23T23:46:26.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.099+0000 7f9aa1200640 1 -- 172.21.15.8:0/1649994701 wait complete. 2024-03-23T23:46:26.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.103+0000 7f9aa1200640 1 Processor -- start 2024-03-23T23:46:26.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.103+0000 7f9aa1200640 1 -- start start 2024-03-23T23:46:26.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.107+0000 7f9aa1200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9a9c0710f0 0x7f9a9c15d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:26.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.107+0000 7f9aa1200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9a9c0aa390 0x7f9a9c155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:26.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.107+0000 7f9aa1200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a9c0c1d40 0x7f9a9c0c3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:26.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.107+0000 7f9a9a800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a9c0c1d40 0x7f9a9c0c3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:26.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.107+0000 7f9a9a800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a9c0c1d40 0x7f9a9c0c3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49268/0 (socket says 172.21.15.8:49268) 2024-03-23T23:46:26.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.107+0000 7f9a99400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9a9c0aa390 0x7f9a9c155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:26.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.107+0000 7f9a9a800640 1 -- 172.21.15.8:0/339284964 learned_addr learned my addr 172.21.15.8:0/339284964 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:46:26.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.107+0000 7f9aa1200640 1 -- 172.21.15.8:0/339284964 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9c0ac6e0 con 0x7f9a9c0c1d40 2024-03-23T23:46:26.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.107+0000 7f9aa1200640 1 -- 172.21.15.8:0/339284964 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9c0ac560 con 0x7f9a9c0aa390 2024-03-23T23:46:26.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.107+0000 7f9aa1200640 1 -- 172.21.15.8:0/339284964 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9c0714d0 con 0x7f9a9c0710f0 2024-03-23T23:46:26.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.107+0000 7f9a99400640 1 -- 172.21.15.8:0/339284964 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9a9c0710f0 msgr2=0x7f9a9c15d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:26.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.107+0000 7f9a99400640 1 --2- 172.21.15.8:0/339284964 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9a9c0710f0 0x7f9a9c15d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:26.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.111+0000 7f9a99400640 1 -- 172.21.15.8:0/339284964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a9c0c1d40 msgr2=0x7f9a9c0c3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:26.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.111+0000 7f9a99400640 1 --2- 172.21.15.8:0/339284964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a9c0c1d40 0x7f9a9c0c3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:26.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.111+0000 7f9a99400640 1 -- 172.21.15.8:0/339284964 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a9c1f5bb0 con 0x7f9a9c0aa390 2024-03-23T23:46:26.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.111+0000 7f9a99400640 1 --2- 172.21.15.8:0/339284964 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9a9c0aa390 0x7f9a9c155f50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9a88009fd0 tx=0x7f9a8800b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:26.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.111+0000 7f9a92000640 1 -- 172.21.15.8:0/339284964 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a88015020 con 0x7f9a9c0aa390 2024-03-23T23:46:26.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.115+0000 7f9a92000640 1 -- 172.21.15.8:0/339284964 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a88011830 con 0x7f9a9c0aa390 2024-03-23T23:46:26.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.115+0000 7f9a92000640 1 -- 172.21.15.8:0/339284964 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a88011c00 con 0x7f9a9c0aa390 2024-03-23T23:46:26.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.115+0000 7f9aa1200640 1 -- 172.21.15.8:0/339284964 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a9c1f5e50 con 0x7f9a9c0aa390 2024-03-23T23:46:26.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.115+0000 7f9aa1200640 1 -- 172.21.15.8:0/339284964 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a9c1f6410 con 0x7f9a9c0aa390 2024-03-23T23:46:26.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.119+0000 7f9aa1200640 1 -- 172.21.15.8:0/339284964 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a9c1f6ad0 con 0x7f9a9c0aa390 2024-03-23T23:46:26.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.123+0000 7f9a92000640 1 -- 172.21.15.8:0/339284964 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f9a88018020 con 0x7f9a9c0aa390 2024-03-23T23:46:26.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.127+0000 7f9a92000640 1 --2- 172.21.15.8:0/339284964 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9a7c067660 0x7f9a7c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:26.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.127+0000 7f9a92000640 1 -- 172.21.15.8:0/339284964 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f9a88085d70 con 0x7f9a9c0aa390 2024-03-23T23:46:26.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.127+0000 7f9a99e00640 1 --2- 172.21.15.8:0/339284964 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9a7c067660 0x7f9a7c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:26.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.131+0000 7f9a99e00640 1 --2- 172.21.15.8:0/339284964 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9a7c067660 0x7f9a7c069b20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c001500 tx=0x7f9a8c007a60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:26.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.147+0000 7f9a92000640 1 -- 172.21.15.8:0/339284964 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f9a9c1f6ad0 con 0x7f9a9c0aa390 2024-03-23T23:46:26.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.843+0000 7f9aa1200640 1 -- 172.21.15.8:0/339284964 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f9a9c0aad70 con 0x7f9a9c0aa390 2024-03-23T23:46:26.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.847+0000 7f9a92000640 1 -- 172.21.15.8:0/339284964 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1560 (secure 0 0 0) 0x7f9a8801f020 con 0x7f9a9c0aa390 2024-03-23T23:46:26.847 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:46:26.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.855+0000 7f9aa1200640 1 -- 172.21.15.8:0/339284964 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9a7c067660 msgr2=0x7f9a7c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:26.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.855+0000 7f9aa1200640 1 --2- 172.21.15.8:0/339284964 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9a7c067660 0x7f9a7c069b20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c001500 tx=0x7f9a8c007a60 comp rx=0 tx=0).stop 2024-03-23T23:46:26.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.855+0000 7f9aa1200640 1 -- 172.21.15.8:0/339284964 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9a9c0aa390 msgr2=0x7f9a9c155f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:26.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.855+0000 7f9aa1200640 1 --2- 172.21.15.8:0/339284964 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9a9c0aa390 0x7f9a9c155f50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9a88009fd0 tx=0x7f9a8800b870 comp rx=0 tx=0).stop 2024-03-23T23:46:26.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.855+0000 7f9aa1200640 1 -- 172.21.15.8:0/339284964 shutdown_connections 2024-03-23T23:46:26.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.855+0000 7f9aa1200640 1 --2- 172.21.15.8:0/339284964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a9c0c1d40 0x7f9a9c0c3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:26.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.855+0000 7f9aa1200640 1 --2- 172.21.15.8:0/339284964 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9a9c0aa390 0x7f9a9c155f50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:26.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.855+0000 7f9aa1200640 1 --2- 172.21.15.8:0/339284964 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9a7c067660 0x7f9a7c069b20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:26.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.855+0000 7f9aa1200640 1 --2- 172.21.15.8:0/339284964 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9a9c0710f0 0x7f9a9c15d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:26.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.855+0000 7f9aa1200640 1 -- 172.21.15.8:0/339284964 >> 172.21.15.8:0/339284964 conn(0x7f9a9c0c7170 msgr2=0x7f9a9c0abe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:46:26.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.855+0000 7f9aa1200640 1 -- 172.21.15.8:0/339284964 shutdown_connections 2024-03-23T23:46:26.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:26.855+0000 7f9aa1200640 1 -- 172.21.15.8:0/339284964 wait complete. 2024-03-23T23:46:26.900 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T23:46:26.900 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T23:46:26.901 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:46:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.407+0000 7fb9a6a00640 1 Processor -- start 2024-03-23T23:46:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.407+0000 7fb9a6a00640 1 -- start start 2024-03-23T23:46:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.411+0000 7fb9a6a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb9980496e0 0x7fb99804ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.411+0000 7fb9a6a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb998006a10 0x7fb998006e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.411+0000 7fb9a6a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb998046970 con 0x7fb99800b080 2024-03-23T23:46:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.411+0000 7fb9a6a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9980d6fa0 con 0x7fb9980496e0 2024-03-23T23:46:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.411+0000 7fb9a6a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9980d74d0 con 0x7fb998006a10 2024-03-23T23:46:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.411+0000 7fb9a5600640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fb99800b080 0x7fb9980d39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:37224/0 (socket says 172.21.15.8:37224) 2024-03-23T23:46:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.411+0000 7fb9a5600640 1 -- 172.21.15.8:0/1523446410 learned_addr learned my addr 172.21.15.8:0/1523446410 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:46:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.415+0000 7fb9a6000640 1 --2- 172.21.15.8:0/1523446410 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb998006a10 0x7fb998006e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:27.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.415+0000 7fb9a6000640 1 -- 172.21.15.8:0/1523446410 >> v2:172.21.15.196:3300/0 conn(0x7fb9980496e0 msgr2=0x7fb99804ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:46:27.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.415+0000 7fb9a6000640 1 --2- 172.21.15.8:0/1523446410 >> v2:172.21.15.196:3300/0 conn(0x7fb9980496e0 0x7fb99804ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:27.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.415+0000 7fb9a6000640 1 -- 172.21.15.8:0/1523446410 >> v1:172.21.15.196:6789/0 conn(0x7fb99800b080 legacy=0x7fb9980d39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:27.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.415+0000 7fb9a6000640 1 -- 172.21.15.8:0/1523446410 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb99802e0d0 con 0x7fb998006a10 2024-03-23T23:46:27.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.427+0000 7fb9a6000640 1 --2- 172.21.15.8:0/1523446410 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb998006a10 0x7fb998006e80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb9a002d610 tx=0x7fb9a0098350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=789fd36e27666d6b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:27.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.427+0000 7fb99fe00640 1 -- 172.21.15.8:0/1523446410 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a012c070 con 0x7fb998006a10 2024-03-23T23:46:27.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.427+0000 7fb99fe00640 1 -- 172.21.15.8:0/1523446410 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a0127620 con 0x7fb998006a10 2024-03-23T23:46:27.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.427+0000 7fb99fe00640 1 -- 172.21.15.8:0/1523446410 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a0127ad0 con 0x7fb998006a10 2024-03-23T23:46:27.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.431+0000 7fb9a6a00640 1 -- 172.21.15.8:0/1523446410 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb998006a10 msgr2=0x7fb998006e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:27.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.431+0000 7fb9a6a00640 1 --2- 172.21.15.8:0/1523446410 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb998006a10 0x7fb998006e80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb9a002d610 tx=0x7fb9a0098350 comp rx=0 tx=0).stop 2024-03-23T23:46:27.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.443+0000 7fb9a6a00640 1 -- 172.21.15.8:0/1523446410 shutdown_connections 2024-03-23T23:46:27.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.443+0000 7fb9a6a00640 1 --2- 172.21.15.8:0/1523446410 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb998006a10 0x7fb998006e80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:27.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.443+0000 7fb9a6a00640 1 --2- 172.21.15.8:0/1523446410 >> v2:172.21.15.196:3300/0 conn(0x7fb9980496e0 0x7fb99804ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:27.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.443+0000 7fb9a6a00640 1 -- 172.21.15.8:0/1523446410 >> 172.21.15.8:0/1523446410 conn(0x7fb998005ef0 msgr2=0x7fb998006300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:46:27.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.455+0000 7fb9a6a00640 1 -- 172.21.15.8:0/1523446410 shutdown_connections 2024-03-23T23:46:27.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.455+0000 7fb9a6a00640 1 -- 172.21.15.8:0/1523446410 wait complete. 2024-03-23T23:46:27.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.459+0000 7fb9a6a00640 1 Processor -- start 2024-03-23T23:46:27.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.463+0000 7fb9a6a00640 1 -- start start 2024-03-23T23:46:27.464 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.467+0000 7fb9a6a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb998006a10 0x7fb9980cc140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:27.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.467+0000 7fb9a6a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb99800b080 0x7fb9980d9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:27.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.467+0000 7fb9a6a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9980496e0 0x7fb998043ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:27.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.467+0000 7fb9a4c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb99800b080 0x7fb9980d9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:27.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.467+0000 7fb9a4c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb99800b080 0x7fb9980d9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:49154/0 (socket says 172.21.15.8:49154) 2024-03-23T23:46:27.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.467+0000 7fb9a5600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb998006a10 0x7fb9980cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:27.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.467+0000 7fb9a5600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb998006a10 0x7fb9980cc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:45482/0 (socket says 172.21.15.8:45482) 2024-03-23T23:46:27.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.467+0000 7fb9a4c00640 1 -- 172.21.15.8:0/1925094930 learned_addr learned my addr 172.21.15.8:0/1925094930 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:46:27.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.467+0000 7fb9a6a00640 1 -- 172.21.15.8:0/1925094930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9980462f0 con 0x7fb9980496e0 2024-03-23T23:46:27.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.467+0000 7fb9a6a00640 1 -- 172.21.15.8:0/1925094930 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb998046ce0 con 0x7fb998006a10 2024-03-23T23:46:27.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.467+0000 7fb9a6a00640 1 -- 172.21.15.8:0/1925094930 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb998046470 con 0x7fb99800b080 2024-03-23T23:46:27.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.467+0000 7fb9a6000640 1 --2- 172.21.15.8:0/1925094930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9980496e0 0x7fb998043ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:27.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.467+0000 7fb9a4c00640 1 -- 172.21.15.8:0/1925094930 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb998006a10 msgr2=0x7fb9980cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:27.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.467+0000 7fb9a4c00640 1 --2- 172.21.15.8:0/1925094930 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb998006a10 0x7fb9980cc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:27.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.467+0000 7fb9a4c00640 1 -- 172.21.15.8:0/1925094930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9980496e0 msgr2=0x7fb998043ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:27.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.467+0000 7fb9a4c00640 1 --2- 172.21.15.8:0/1925094930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9980496e0 0x7fb998043ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:27.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.467+0000 7fb9a4c00640 1 -- 172.21.15.8:0/1925094930 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9980d7df0 con 0x7fb99800b080 2024-03-23T23:46:27.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.467+0000 7fb9a6000640 1 --2- 172.21.15.8:0/1925094930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9980496e0 0x7fb998043ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:46:27.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.467+0000 7fb9a4c00640 1 --2- 172.21.15.8:0/1925094930 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb99800b080 0x7fb9980d9130 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb98c00b440 tx=0x7fb98c00b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:27.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.471+0000 7fb99d600640 1 -- 172.21.15.8:0/1925094930 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c015020 con 0x7fb99800b080 2024-03-23T23:46:27.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.471+0000 7fb99d600640 1 -- 172.21.15.8:0/1925094930 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb98c011890 con 0x7fb99800b080 2024-03-23T23:46:27.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.471+0000 7fb99d600640 1 -- 172.21.15.8:0/1925094930 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c011c60 con 0x7fb99800b080 2024-03-23T23:46:27.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.471+0000 7fb9a6a00640 1 -- 172.21.15.8:0/1925094930 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9980d80d0 con 0x7fb99800b080 2024-03-23T23:46:27.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.471+0000 7fb9a6a00640 1 -- 172.21.15.8:0/1925094930 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9980d5300 con 0x7fb99800b080 2024-03-23T23:46:27.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.475+0000 7fb9a6a00640 1 --2- 172.21.15.8:0/1925094930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9980440e0 0x7fb9980444c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:27.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.475+0000 7fb9a6a00640 1 -- 172.21.15.8:0/1925094930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb998007420 con 0x7fb9980440e0 2024-03-23T23:46:27.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.479+0000 7fb99d600640 1 -- 172.21.15.8:0/1925094930 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb98c018020 con 0x7fb99800b080 2024-03-23T23:46:27.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.483+0000 7fb9a5600640 1 --2- 172.21.15.8:0/1925094930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9980440e0 0x7fb9980444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:27.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.483+0000 7fb9a5600640 1 -- 172.21.15.8:0/1925094930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb9980d6bd0 con 0x7fb9980440e0 2024-03-23T23:46:27.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.483+0000 7fb99d600640 1 --2- 172.21.15.8:0/1925094930 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb980067730 0x7fb980069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:27.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.483+0000 7fb99d600640 1 -- 172.21.15.8:0/1925094930 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fb98c085c40 con 0x7fb99800b080 2024-03-23T23:46:27.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.491+0000 7fb9a5600640 1 --2- 172.21.15.8:0/1925094930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9980440e0 0x7fb9980444c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb99400e400 tx=0x7fb99400e8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:27.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.495+0000 7fb9a6000640 1 --2- 172.21.15.8:0/1925094930 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb980067730 0x7fb980069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:27.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.503+0000 7fb99d600640 1 -- 172.21.15.8:0/1925094930 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb994019070 con 0x7fb9980440e0 2024-03-23T23:46:27.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.507+0000 7fb9a6000640 1 --2- 172.21.15.8:0/1925094930 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb980067730 0x7fb980069bf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb9980dab50 tx=0x7fb9a0122000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:27.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.507+0000 7fb99d600640 1 -- 172.21.15.8:0/1925094930 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fb994005ad0 con 0x7fb9980440e0 2024-03-23T23:46:27.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.507+0000 7fb99d600640 1 -- 172.21.15.8:0/1925094930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9980440e0 msgr2=0x7fb9980444c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:27.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.507+0000 7fb99d600640 1 --2- 172.21.15.8:0/1925094930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9980440e0 0x7fb9980444c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb99400e400 tx=0x7fb99400e8c0 comp rx=0 tx=0).stop 2024-03-23T23:46:27.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.507+0000 7fb99d600640 1 -- 172.21.15.8:0/1925094930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9980440e0 msgr2=0x7fb9980444c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:46:27.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.507+0000 7fb99d600640 1 --2- 172.21.15.8:0/1925094930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9980440e0 0x7fb9980444c0 secure :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb99400e400 tx=0x7fb99400e8c0 comp rx=0 tx=0).stop 2024-03-23T23:46:27.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.539+0000 7fb9a6a00640 1 --2- 172.21.15.8:0/1925094930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9980c4530 0x7fb9980c4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:27.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.539+0000 7fb9a6a00640 1 -- 172.21.15.8:0/1925094930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb998008ef0 con 0x7fb9980c4530 2024-03-23T23:46:27.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.539+0000 7fb9a5600640 1 --2- 172.21.15.8:0/1925094930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9980c4530 0x7fb9980c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:27.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.543+0000 7fb9a5600640 1 -- 172.21.15.8:0/1925094930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb998005220 con 0x7fb9980c4530 2024-03-23T23:46:27.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.555+0000 7fb9a5600640 1 --2- 172.21.15.8:0/1925094930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9980c4530 0x7fb9980c4940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb994009010 tx=0x7fb994000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:27.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.559+0000 7fb99d600640 1 -- 172.21.15.8:0/1925094930 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb994019040 con 0x7fb9980c4530 2024-03-23T23:46:27.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.559+0000 7fb99d600640 1 -- 172.21.15.8:0/1925094930 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4531 (secure 0 0 0) 0x7fb9940047f0 con 0x7fb9980c4530 2024-03-23T23:46:27.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.559+0000 7fb99d600640 1 -- 172.21.15.8:0/1925094930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9980c4530 msgr2=0x7fb9980c4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:27.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.559+0000 7fb99d600640 1 --2- 172.21.15.8:0/1925094930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9980c4530 0x7fb9980c4940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb994009010 tx=0x7fb994000ee0 comp rx=0 tx=0).stop 2024-03-23T23:46:27.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.559+0000 7fb99d600640 1 -- 172.21.15.8:0/1925094930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9980c4530 msgr2=0x7fb9980c4940 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:46:27.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.559+0000 7fb99d600640 1 --2- 172.21.15.8:0/1925094930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9980c4530 0x7fb9980c4940 secure :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb994009010 tx=0x7fb994000ee0 comp rx=0 tx=0).stop 2024-03-23T23:46:27.569 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:46:27.569 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:46:27.569 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:46:27.569 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:46:27.569 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 28, 2024-03-23T23:46:27.569 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:46:27.569 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:46:27.569 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:46:27.569 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:46:27.570 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:27.570 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 1, 2024-03-23T23:46:27.570 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:46:27.570 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:46:27.570 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:46:27.570 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:46:27.570 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:46:27.570 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:46:27.570 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:46:27.571 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:46:27.571 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:46:27.571 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:46:27.571 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:46:27.571 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:46:27.571 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:46:27.571 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:46:27.572 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:27.572 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:46:27.572 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:46:27.572 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:46:27.572 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:46:27.572 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:46:27.572 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:46:27.572 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:46:27.572 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:46:27.572 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:46:27.572 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:46:27.572 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:46:27.573 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:46:27.573 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:46:27.573 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:27.573 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:27.573 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:46:27.573 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:46:27.573 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:46:27.573 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:46:27.573 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:46:27.573 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:46:27.573 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:46:27.573 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:46:27.573 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:46:27.574 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:46:27.574 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:46:27.574 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:46:27.574 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:46:27.574 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:46:27.574 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:46:27.574 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:46:27.574 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:46:27.574 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:46:27.574 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:46:27.574 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:46:27.575 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:46:27.575 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:46:27.575 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:46:27.575 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:46:27.575 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:46:27.575 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:46:27.575 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:46:27.575 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:46:27.575 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:27.575 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:46:27.575 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:27.575 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:46:27.576 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:27.577 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:46:27.577 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:46:27.577 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:46:27.577 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:46:27.577 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:27.577 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:46:27.578 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:46:27.578 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:27.578 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:27.578 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:27.578 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:46:27.578 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:46:27.578 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:27.578 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:27.578 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:27.578 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:27.578 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:46:27.579 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:46:27.579 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:46:27.579 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:46:27.579 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:46:27.579 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:27.579 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:27.579 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:46:27.579 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:46:27.579 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:46:27.579 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:46:27.579 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:27.579 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:46:27.580 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:46:27.580 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:27.580 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:27.580 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:27.580 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:46:27.580 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:46:27.580 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:27.580 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:27.580 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:27.580 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:27.581 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:46:27.581 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:46:27.581 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:46:27.581 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:46:27.581 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:46:27.581 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:27.581 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:27.581 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:46:27.581 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:46:27.581 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:46:27.581 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:46:27.581 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:27.582 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:46:27.582 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:46:27.582 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:27.582 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:27.582 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:27.582 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:46:27.582 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:46:27.582 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:27.582 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:27.582 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:27.582 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:27.583 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:46:27.583 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:46:27.583 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:46:27.583 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:46:27.583 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:46:27.583 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:27.583 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:27.583 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:27.583 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:46:27.583 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:46:27.583 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:27.584 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:46:27.584 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:46:27.584 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:46:27.584 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:27.584 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:27.584 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:46:27.584 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:27.584 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:46:27.584 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:46:27.584 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:46:27.584 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:27.585 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:27.585 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:27.585 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:46:27.585 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:46:27.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.583+0000 7fb9a6a00640 1 -- 172.21.15.8:0/1925094930 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb980067730 msgr2=0x7fb980069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:27.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.583+0000 7fb9a6a00640 1 --2- 172.21.15.8:0/1925094930 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb980067730 0x7fb980069bf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb9980dab50 tx=0x7fb9a0122000 comp rx=0 tx=0).stop 2024-03-23T23:46:27.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.583+0000 7fb9a6a00640 1 -- 172.21.15.8:0/1925094930 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb99800b080 msgr2=0x7fb9980d9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:27.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.583+0000 7fb9a6a00640 1 --2- 172.21.15.8:0/1925094930 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb99800b080 0x7fb9980d9130 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb98c00b440 tx=0x7fb98c00b900 comp rx=0 tx=0).stop 2024-03-23T23:46:27.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.583+0000 7fb9a6000640 1 -- 172.21.15.8:0/1925094930 reap_dead start 2024-03-23T23:46:27.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.583+0000 7fb9a6000640 1 -- 172.21.15.8:0/1925094930 reap_dead start 2024-03-23T23:46:27.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.587+0000 7fb9a6a00640 1 -- 172.21.15.8:0/1925094930 shutdown_connections 2024-03-23T23:46:27.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.587+0000 7fb9a6a00640 1 -- 172.21.15.8:0/1925094930 >> 172.21.15.8:0/1925094930 conn(0x7fb998005ef0 msgr2=0x7fb99802bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:46:27.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.587+0000 7fb9a6a00640 1 -- 172.21.15.8:0/1925094930 shutdown_connections 2024-03-23T23:46:27.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:27.587+0000 7fb9a6a00640 1 -- 172.21.15.8:0/1925094930 wait complete. 2024-03-23T23:46:27.666 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:46:27.666 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T23:46:27.666 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:46:28.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.019+0000 7f1b1e600640 1 Processor -- start 2024-03-23T23:46:28.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.019+0000 7f1b1e600640 1 -- start start 2024-03-23T23:46:28.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.019+0000 7f1b1e600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1b1815dc60 0x7f1b1815a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:28.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.019+0000 7f1b1e600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b180a9470 0x7f1b1815a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:28.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.019+0000 7f1b1e600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b1806f660 con 0x7f1b18157270 2024-03-23T23:46:28.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.019+0000 7f1b1e600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b18159d70 con 0x7f1b1815dc60 2024-03-23T23:46:28.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.019+0000 7f1b1e600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1806f900 con 0x7f1b180a9470 2024-03-23T23:46:28.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.019+0000 7f1b17e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b180a9470 0x7f1b1815a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:28.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.019+0000 7f1b17e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b180a9470 0x7f1b1815a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:49162/0 (socket says 172.21.15.8:49162) 2024-03-23T23:46:28.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.019+0000 7f1b17e00640 1 -- 172.21.15.8:0/2715142075 learned_addr learned my addr 172.21.15.8:0/2715142075 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:46:28.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.019+0000 7f1b17e00640 1 -- 172.21.15.8:0/2715142075 >> v2:172.21.15.196:3300/0 conn(0x7f1b1815dc60 msgr2=0x7f1b1815a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:46:28.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.019+0000 7f1b17e00640 1 --2- 172.21.15.8:0/2715142075 >> v2:172.21.15.196:3300/0 conn(0x7f1b1815dc60 0x7f1b1815a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:28.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.019+0000 7f1b17e00640 1 -- 172.21.15.8:0/2715142075 >> v1:172.21.15.196:6789/0 conn(0x7f1b18157270 legacy=0x7f1b180c4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:28.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.019+0000 7f1b17e00640 1 -- 172.21.15.8:0/2715142075 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b18157650 con 0x7f1b180a9470 2024-03-23T23:46:28.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.023+0000 7f1b17e00640 1 --2- 172.21.15.8:0/2715142075 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b180a9470 0x7f1b1815a790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1b10009e50 tx=0x7f1b1001d420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d766d32fe1ce0950 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:28.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.027+0000 7f1b16000640 1 -- 172.21.15.8:0/2715142075 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b100a5860 con 0x7f1b180a9470 2024-03-23T23:46:28.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.027+0000 7f1b16000640 1 -- 172.21.15.8:0/2715142075 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b100a5a00 con 0x7f1b180a9470 2024-03-23T23:46:28.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.027+0000 7f1b16000640 1 -- 172.21.15.8:0/2715142075 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b100a5860 con 0x7f1b180a9470 2024-03-23T23:46:28.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.027+0000 7f1b1e600640 1 -- 172.21.15.8:0/2715142075 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b180a9470 msgr2=0x7f1b1815a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:28.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.027+0000 7f1b1e600640 1 --2- 172.21.15.8:0/2715142075 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b180a9470 0x7f1b1815a790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1b10009e50 tx=0x7f1b1001d420 comp rx=0 tx=0).stop 2024-03-23T23:46:28.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.027+0000 7f1b1e600640 1 -- 172.21.15.8:0/2715142075 shutdown_connections 2024-03-23T23:46:28.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.027+0000 7f1b1e600640 1 --2- 172.21.15.8:0/2715142075 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b180a9470 0x7f1b1815a790 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:28.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.027+0000 7f1b1e600640 1 --2- 172.21.15.8:0/2715142075 >> v2:172.21.15.196:3300/0 conn(0x7f1b1815dc60 0x7f1b1815a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:28.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.027+0000 7f1b1e600640 1 -- 172.21.15.8:0/2715142075 >> 172.21.15.8:0/2715142075 conn(0x7f1b1806c280 msgr2=0x7f1b1806c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:46:28.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.027+0000 7f1b1e600640 1 -- 172.21.15.8:0/2715142075 shutdown_connections 2024-03-23T23:46:28.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.027+0000 7f1b1e600640 1 -- 172.21.15.8:0/2715142075 wait complete. 2024-03-23T23:46:28.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.031+0000 7f1b1e600640 1 Processor -- start 2024-03-23T23:46:28.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.031+0000 7f1b1e600640 1 -- start start 2024-03-23T23:46:28.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.031+0000 7f1b1e600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b180a9470 0x7f1b18158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:28.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.031+0000 7f1b1e600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1b18157270 0x7f1b180ab190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:28.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.031+0000 7f1b1e600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b1815dc60 0x7f1b180ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:28.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.035+0000 7f1b1e600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b18072120 con 0x7f1b1815dc60 2024-03-23T23:46:28.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.035+0000 7f1b1e600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b18071fa0 con 0x7f1b18157270 2024-03-23T23:46:28.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.035+0000 7f1b1e600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b180c2690 con 0x7f1b180a9470 2024-03-23T23:46:28.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.035+0000 7f1b17e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b1815dc60 0x7f1b180ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:28.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.035+0000 7f1b17e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b1815dc60 0x7f1b180ab6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49312/0 (socket says 172.21.15.8:49312) 2024-03-23T23:46:28.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.035+0000 7f1b17e00640 1 -- 172.21.15.8:0/2831247183 learned_addr learned my addr 172.21.15.8:0/2831247183 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:46:28.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.035+0000 7f1b17e00640 1 -- 172.21.15.8:0/2831247183 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b180a9470 msgr2=0x7f1b18158d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:46:28.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.035+0000 7f1b16a00640 1 --2- 172.21.15.8:0/2831247183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1b18157270 0x7f1b180ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:28.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.035+0000 7f1b17400640 1 --2- 172.21.15.8:0/2831247183 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b180a9470 0x7f1b18158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:28.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.035+0000 7f1b17e00640 1 --2- 172.21.15.8:0/2831247183 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b180a9470 0x7f1b18158d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:28.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.035+0000 7f1b17e00640 1 -- 172.21.15.8:0/2831247183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1b18157270 msgr2=0x7f1b180ab190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:28.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.035+0000 7f1b17e00640 1 --2- 172.21.15.8:0/2831247183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1b18157270 0x7f1b180ab190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:28.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.035+0000 7f1b17e00640 1 -- 172.21.15.8:0/2831247183 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b18153dd0 con 0x7f1b1815dc60 2024-03-23T23:46:28.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.035+0000 7f1b16a00640 1 --2- 172.21.15.8:0/2831247183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1b18157270 0x7f1b180ab190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:46:28.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.035+0000 7f1b17e00640 1 --2- 172.21.15.8:0/2831247183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b1815dc60 0x7f1b180ab6d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1b10009e50 tx=0x7f1b10019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:28.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.035+0000 7f1b0f400640 1 -- 172.21.15.8:0/2831247183 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b100bc020 con 0x7f1b1815dc60 2024-03-23T23:46:28.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.035+0000 7f1b0f400640 1 -- 172.21.15.8:0/2831247183 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b10007800 con 0x7f1b1815dc60 2024-03-23T23:46:28.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.035+0000 7f1b0f400640 1 -- 172.21.15.8:0/2831247183 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b100a5860 con 0x7f1b1815dc60 2024-03-23T23:46:28.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.035+0000 7f1b1e600640 1 -- 172.21.15.8:0/2831247183 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b18154070 con 0x7f1b1815dc60 2024-03-23T23:46:28.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.035+0000 7f1b1e600640 1 -- 172.21.15.8:0/2831247183 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b181592c0 con 0x7f1b1815dc60 2024-03-23T23:46:28.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.039+0000 7f1b1e600640 1 --2- 172.21.15.8:0/2831247183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1af0002a80 0x7f1af0004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:28.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.039+0000 7f1b1e600640 1 -- 172.21.15.8:0/2831247183 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af0007ed0 con 0x7f1af0002a80 2024-03-23T23:46:28.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.039+0000 7f1b17400640 1 --2- 172.21.15.8:0/2831247183 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b180a9470 0x7f1b18158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:46:28.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.039+0000 7f1b17400640 1 --2- 172.21.15.8:0/2831247183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1af0002a80 0x7f1af0004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:28.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.039+0000 7f1b17400640 1 -- 172.21.15.8:0/2831247183 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1af00080d0 con 0x7f1af0002a80 2024-03-23T23:46:28.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.039+0000 7f1b0f400640 1 -- 172.21.15.8:0/2831247183 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f1b100bf020 con 0x7f1b1815dc60 2024-03-23T23:46:28.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.039+0000 7f1b0f400640 1 --2- 172.21.15.8:0/2831247183 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1af80676e0 0x7f1af8069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:28.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.039+0000 7f1b0f400640 1 -- 172.21.15.8:0/2831247183 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f1b100ef1c0 con 0x7f1b1815dc60 2024-03-23T23:46:28.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.043+0000 7f1b17400640 1 --2- 172.21.15.8:0/2831247183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1af0002a80 0x7f1af0004f40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1b08000f70 tx=0x7f1b0800d880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:28.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.043+0000 7f1b16a00640 1 --2- 172.21.15.8:0/2831247183 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1af80676e0 0x7f1af8069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:28.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.043+0000 7f1b0f400640 1 -- 172.21.15.8:0/2831247183 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b08016020 con 0x7f1af0002a80 2024-03-23T23:46:28.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.043+0000 7f1b0f400640 1 -- 172.21.15.8:0/2831247183 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f1b08012800 con 0x7f1af0002a80 2024-03-23T23:46:28.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.043+0000 7f1b0f400640 1 -- 172.21.15.8:0/2831247183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1af0002a80 msgr2=0x7f1af0004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:28.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.043+0000 7f1b0f400640 1 --2- 172.21.15.8:0/2831247183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1af0002a80 0x7f1af0004f40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1b08000f70 tx=0x7f1b0800d880 comp rx=0 tx=0).stop 2024-03-23T23:46:28.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.043+0000 7f1b0f400640 1 -- 172.21.15.8:0/2831247183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1af0002a80 msgr2=0x7f1af0004f40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:46:28.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.043+0000 7f1b0f400640 1 --2- 172.21.15.8:0/2831247183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1af0002a80 0x7f1af0004f40 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1b08000f70 tx=0x7f1b0800d880 comp rx=0 tx=0).stop 2024-03-23T23:46:28.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.043+0000 7f1b16a00640 1 --2- 172.21.15.8:0/2831247183 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1af80676e0 0x7f1af8069ba0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400a870 tx=0x7f1b04008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:28.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.055+0000 7f1b1e600640 1 --2- 172.21.15.8:0/2831247183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1af0006ec0 0x7f1af0007350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:28.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.055+0000 7f1b1e600640 1 -- 172.21.15.8:0/2831247183 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af000a4b0 con 0x7f1af0006ec0 2024-03-23T23:46:28.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.055+0000 7f1b17400640 1 --2- 172.21.15.8:0/2831247183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1af0006ec0 0x7f1af0007350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:28.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.055+0000 7f1b17400640 1 -- 172.21.15.8:0/2831247183 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1af0007890 con 0x7f1af0006ec0 2024-03-23T23:46:28.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.055+0000 7f1b17400640 1 --2- 172.21.15.8:0/2831247183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1af0006ec0 0x7f1af0007350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1b08000f70 tx=0x7f1b08000ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:28.057 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:46:28.058 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:46:28.058 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:46:28.058 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:46:28.058 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 28, 2024-03-23T23:46:28.058 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:46:28.058 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:46:28.058 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:46:28.059 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:46:28.059 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:28.059 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 2, 2024-03-23T23:46:28.059 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:46:28.059 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:46:28.059 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:46:28.059 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:46:28.059 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:46:28.059 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:46:28.060 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:46:28.060 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:46:28.060 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:46:28.060 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:46:28.060 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:46:28.060 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:46:28.060 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:46:28.060 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:46:28.060 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:28.061 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:46:28.061 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:46:28.061 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:46:28.061 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:46:28.061 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:46:28.061 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:46:28.061 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:46:28.062 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:46:28.062 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:46:28.062 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:46:28.062 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:46:28.062 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:46:28.062 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:46:28.062 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:28.062 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:28.062 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:46:28.063 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:46:28.063 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:46:28.063 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:46:28.063 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:46:28.063 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:46:28.063 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:46:28.063 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:46:28.063 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:46:28.063 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:46:28.063 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:46:28.063 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:46:28.063 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:46:28.063 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:46:28.064 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:46:28.064 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:46:28.064 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:46:28.064 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:46:28.064 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:46:28.064 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:46:28.064 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:46:28.064 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:46:28.064 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:46:28.064 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:46:28.064 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:46:28.064 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:46:28.064 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:46:28.064 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:46:28.065 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:28.065 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:46:28.065 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:28.065 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:46:28.065 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:28.065 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:46:28.065 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:46:28.065 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:46:28.065 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:46:28.065 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:28.065 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:46:28.065 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:46:28.065 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:28.065 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:28.066 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:28.066 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:46:28.066 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:46:28.066 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:28.066 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:28.066 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:28.066 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:28.066 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:46:28.066 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:46:28.066 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:46:28.066 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:46:28.066 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:46:28.066 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:28.067 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:28.067 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:46:28.067 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:46:28.067 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:46:28.067 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:46:28.067 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:28.067 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:46:28.067 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:46:28.067 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:28.067 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:28.067 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:28.067 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:46:28.067 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:46:28.068 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:28.068 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:28.068 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:28.068 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:28.068 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:46:28.068 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:46:28.068 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:46:28.068 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:46:28.068 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:46:28.068 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:28.068 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:28.068 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:46:28.068 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:46:28.069 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:46:28.069 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:46:28.069 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:28.069 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:46:28.069 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:46:28.069 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:28.069 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:28.069 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:28.069 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:46:28.069 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:46:28.069 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:28.069 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:28.069 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:28.070 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:28.070 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:46:28.070 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:46:28.070 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:46:28.070 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:46:28.070 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:46:28.070 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:28.070 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:28.070 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:28.070 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:46:28.070 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:46:28.070 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:28.070 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:46:28.071 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:46:28.071 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:46:28.071 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:28.071 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:28.071 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:46:28.071 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:28.071 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:46:28.071 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:46:28.071 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:46:28.071 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:28.071 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:28.072 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:46:28.072 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:46:28.072 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:46:28.072 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:28.072 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:28.072 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:28.072 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:46:28.072 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:46:28.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.059+0000 7f1b0f400640 1 -- 172.21.15.8:0/2831247183 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b08026680 con 0x7f1af0006ec0 2024-03-23T23:46:28.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.059+0000 7f1b0f400640 1 -- 172.21.15.8:0/2831247183 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4672 (secure 0 0 0) 0x7f1b0801b420 con 0x7f1af0006ec0 2024-03-23T23:46:28.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.059+0000 7f1b0f400640 1 -- 172.21.15.8:0/2831247183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1af0006ec0 msgr2=0x7f1af0007350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:28.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.059+0000 7f1b0f400640 1 --2- 172.21.15.8:0/2831247183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1af0006ec0 0x7f1af0007350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1b08000f70 tx=0x7f1b08000ee0 comp rx=0 tx=0).stop 2024-03-23T23:46:28.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.059+0000 7f1b0f400640 1 -- 172.21.15.8:0/2831247183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1af0006ec0 msgr2=0x7f1af0007350 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:46:28.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.059+0000 7f1b0f400640 1 --2- 172.21.15.8:0/2831247183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1af0006ec0 0x7f1af0007350 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1b08000f70 tx=0x7f1b08000ee0 comp rx=0 tx=0).stop 2024-03-23T23:46:28.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.059+0000 7f1b1e600640 1 -- 172.21.15.8:0/2831247183 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1af80676e0 msgr2=0x7f1af8069ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:28.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.059+0000 7f1b1e600640 1 --2- 172.21.15.8:0/2831247183 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1af80676e0 0x7f1af8069ba0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400a870 tx=0x7f1b04008040 comp rx=0 tx=0).stop 2024-03-23T23:46:28.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.059+0000 7f1b1e600640 1 -- 172.21.15.8:0/2831247183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b1815dc60 msgr2=0x7f1b180ab6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:28.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.059+0000 7f1b1e600640 1 --2- 172.21.15.8:0/2831247183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b1815dc60 0x7f1b180ab6d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1b10009e50 tx=0x7f1b10019760 comp rx=0 tx=0).stop 2024-03-23T23:46:28.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.063+0000 7f1b17e00640 1 -- 172.21.15.8:0/2831247183 reap_dead start 2024-03-23T23:46:28.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.063+0000 7f1b17e00640 1 -- 172.21.15.8:0/2831247183 reap_dead start 2024-03-23T23:46:28.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.063+0000 7f1b1e600640 1 -- 172.21.15.8:0/2831247183 shutdown_connections 2024-03-23T23:46:28.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.063+0000 7f1b1e600640 1 -- 172.21.15.8:0/2831247183 >> 172.21.15.8:0/2831247183 conn(0x7f1b1806c280 msgr2=0x7f1b1806c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:46:28.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.063+0000 7f1b1e600640 1 -- 172.21.15.8:0/2831247183 shutdown_connections 2024-03-23T23:46:28.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.063+0000 7f1b1e600640 1 -- 172.21.15.8:0/2831247183 wait complete. 2024-03-23T23:46:28.103 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:46:28.104 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T23:46:28.104 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:46:28.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.579+0000 7f3973e00640 1 Processor -- start 2024-03-23T23:46:28.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.579+0000 7f3973e00640 1 -- start start 2024-03-23T23:46:28.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.579+0000 7f3973e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f396c0d7970 0x7f396c0070d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:28.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.579+0000 7f3973e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f396c0498b0 0x7f396c00a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:28.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.579+0000 7f3973e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f396c007610 0x7f396c00a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:28.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.579+0000 7f3973e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f396c048180 con 0x7f396c0d7970 2024-03-23T23:46:28.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.579+0000 7f3973e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f396c0db2d0 con 0x7f396c0498b0 2024-03-23T23:46:28.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.579+0000 7f3973e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f396c0dad50 con 0x7f396c007610 2024-03-23T23:46:28.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.579+0000 7f3972a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f396c0d7970 0x7f396c0070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:28.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.579+0000 7f3979800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f396c007610 0x7f396c00a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:28.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.579+0000 7f3979800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f396c007610 0x7f396c00a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:49184/0 (socket says 172.21.15.8:49184) 2024-03-23T23:46:28.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.579+0000 7f3979800640 1 -- 172.21.15.8:0/2580847478 learned_addr learned my addr 172.21.15.8:0/2580847478 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:46:28.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.579+0000 7f3972a00640 1 -- 172.21.15.8:0/2580847478 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f396c007610 msgr2=0x7f396c00a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:46:28.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.579+0000 7f3972a00640 1 --2- 172.21.15.8:0/2580847478 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f396c007610 0x7f396c00a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:28.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.579+0000 7f3972a00640 1 -- 172.21.15.8:0/2580847478 >> v2:172.21.15.196:3300/0 conn(0x7f396c0498b0 msgr2=0x7f396c00a440 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-23T23:46:28.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.579+0000 7f3972a00640 1 --2- 172.21.15.8:0/2580847478 >> v2:172.21.15.196:3300/0 conn(0x7f396c0498b0 0x7f396c00a440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:28.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.579+0000 7f3972a00640 1 -- 172.21.15.8:0/2580847478 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396c0d7d50 con 0x7f396c0d7970 2024-03-23T23:46:28.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.583+0000 7f3972a00640 1 --2- 172.21.15.8:0/2580847478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f396c0d7970 0x7f396c0070d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f396c02b2f0 tx=0x7f396401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e47cb375de4aa8 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:28.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.583+0000 7f3971600640 1 -- 172.21.15.8:0/2580847478 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39640b0070 con 0x7f396c0d7970 2024-03-23T23:46:28.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.587+0000 7f3971600640 1 -- 172.21.15.8:0/2580847478 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39640ab600 con 0x7f396c0d7970 2024-03-23T23:46:28.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.587+0000 7f3971600640 1 -- 172.21.15.8:0/2580847478 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39640ab9d0 con 0x7f396c0d7970 2024-03-23T23:46:28.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.587+0000 7f3973e00640 1 -- 172.21.15.8:0/2580847478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f396c0d7970 msgr2=0x7f396c0070d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:28.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.587+0000 7f3973e00640 1 --2- 172.21.15.8:0/2580847478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f396c0d7970 0x7f396c0070d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f396c02b2f0 tx=0x7f396401c3e0 comp rx=0 tx=0).stop 2024-03-23T23:46:28.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.587+0000 7f3973e00640 1 -- 172.21.15.8:0/2580847478 shutdown_connections 2024-03-23T23:46:28.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.587+0000 7f3973e00640 1 --2- 172.21.15.8:0/2580847478 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f396c007610 0x7f396c00a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:28.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.587+0000 7f3973e00640 1 --2- 172.21.15.8:0/2580847478 >> v2:172.21.15.196:3300/0 conn(0x7f396c0498b0 0x7f396c00a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:28.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.587+0000 7f3973e00640 1 --2- 172.21.15.8:0/2580847478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f396c0d7970 0x7f396c0070d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:28.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.587+0000 7f3973e00640 1 -- 172.21.15.8:0/2580847478 >> 172.21.15.8:0/2580847478 conn(0x7f396c048430 msgr2=0x7f396c048840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:46:28.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.587+0000 7f3973e00640 1 -- 172.21.15.8:0/2580847478 shutdown_connections 2024-03-23T23:46:28.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.587+0000 7f3973e00640 1 -- 172.21.15.8:0/2580847478 wait complete. 2024-03-23T23:46:28.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.595+0000 7f3973e00640 1 Processor -- start 2024-03-23T23:46:28.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.611+0000 7f3973e00640 1 -- start start 2024-03-23T23:46:28.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.615+0000 7f3973e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f396c007610 0x7f396c0d3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:28.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.615+0000 7f3973e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f396c0498b0 0x7f396c041aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:28.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.619+0000 7f3972a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f396c007610 0x7f396c0d3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:28.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.619+0000 7f3973e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f396c0d7970 0x7f396c041fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:28.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.619+0000 7f3972a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f396c007610 0x7f396c0d3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:49198/0 (socket says 172.21.15.8:49198) 2024-03-23T23:46:28.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.619+0000 7f3973e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396c046ba0 con 0x7f396c0d7970 2024-03-23T23:46:28.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.619+0000 7f3973e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396c046a20 con 0x7f396c0498b0 2024-03-23T23:46:28.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.619+0000 7f3973e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f396c0de120 con 0x7f396c007610 2024-03-23T23:46:28.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.619+0000 7f3972a00640 1 -- 172.21.15.8:0/4045028049 learned_addr learned my addr 172.21.15.8:0/4045028049 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:46:28.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.623+0000 7f3979800640 1 --2- 172.21.15.8:0/4045028049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f396c0d7970 0x7f396c041fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:28.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.623+0000 7f3972a00640 1 -- 172.21.15.8:0/4045028049 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f396c0498b0 msgr2=0x7f396c041aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:28.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.623+0000 7f3972a00640 1 --2- 172.21.15.8:0/4045028049 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f396c0498b0 0x7f396c041aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:28.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.623+0000 7f3972a00640 1 -- 172.21.15.8:0/4045028049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f396c0d7970 msgr2=0x7f396c041fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:28.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.623+0000 7f3972a00640 1 --2- 172.21.15.8:0/4045028049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f396c0d7970 0x7f396c041fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:28.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.623+0000 7f3972a00640 1 -- 172.21.15.8:0/4045028049 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396c17ad30 con 0x7f396c007610 2024-03-23T23:46:28.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.623+0000 7f3979800640 1 --2- 172.21.15.8:0/4045028049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f396c0d7970 0x7f396c041fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:46:28.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.623+0000 7f3972a00640 1 --2- 172.21.15.8:0/4045028049 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f396c007610 0x7f396c0d3100 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f396401aa90 tx=0x7f3964019180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:28.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.627+0000 7f396aa00640 1 -- 172.21.15.8:0/4045028049 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39640b8020 con 0x7f396c007610 2024-03-23T23:46:28.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.627+0000 7f3973e00640 1 -- 172.21.15.8:0/4045028049 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f396c17b010 con 0x7f396c007610 2024-03-23T23:46:28.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.627+0000 7f3973e00640 1 -- 172.21.15.8:0/4045028049 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f396c17b5d0 con 0x7f396c007610 2024-03-23T23:46:28.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.631+0000 7f395fe00640 1 --2- 172.21.15.8:0/4045028049 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f396c0d8530 0x7f396c0d8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:28.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.631+0000 7f396aa00640 1 -- 172.21.15.8:0/4045028049 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39640ab5a0 con 0x7f396c007610 2024-03-23T23:46:28.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.631+0000 7f395fe00640 1 -- 172.21.15.8:0/4045028049 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f396c0054a0 con 0x7f396c0d8530 2024-03-23T23:46:28.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.631+0000 7f396aa00640 1 -- 172.21.15.8:0/4045028049 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39640b8020 con 0x7f396c007610 2024-03-23T23:46:28.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.631+0000 7f3972000640 1 --2- 172.21.15.8:0/4045028049 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f396c0d8530 0x7f396c0d8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:28.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.631+0000 7f3972000640 1 -- 172.21.15.8:0/4045028049 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f396c00b800 con 0x7f396c0d8530 2024-03-23T23:46:28.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.639+0000 7f3972000640 1 --2- 172.21.15.8:0/4045028049 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f396c0d8530 0x7f396c0d8910 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f396c03f010 tx=0x7f396000b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:28.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.639+0000 7f396aa00640 1 -- 172.21.15.8:0/4045028049 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f39640bb020 con 0x7f396c007610 2024-03-23T23:46:28.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.643+0000 7f396aa00640 1 --2- 172.21.15.8:0/4045028049 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3954067860 0x7f3954069d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:28.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.643+0000 7f396aa00640 1 -- 172.21.15.8:0/4045028049 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f396411f220 con 0x7f396c007610 2024-03-23T23:46:28.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.647+0000 7f3979800640 1 --2- 172.21.15.8:0/4045028049 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3954067860 0x7f3954069d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:28.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.647+0000 7f396aa00640 1 -- 172.21.15.8:0/4045028049 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3960015020 con 0x7f396c0d8530 2024-03-23T23:46:28.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.647+0000 7f396aa00640 1 -- 172.21.15.8:0/4045028049 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f3960011830 con 0x7f396c0d8530 2024-03-23T23:46:28.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.647+0000 7f396aa00640 1 -- 172.21.15.8:0/4045028049 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f396c0d8530 msgr2=0x7f396c0d8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:28.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.647+0000 7f396aa00640 1 --2- 172.21.15.8:0/4045028049 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f396c0d8530 0x7f396c0d8910 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f396c03f010 tx=0x7f396000b7a0 comp rx=0 tx=0).stop 2024-03-23T23:46:28.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.651+0000 7f396aa00640 1 -- 172.21.15.8:0/4045028049 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f396c0d8530 msgr2=0x7f396c0d8910 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:46:28.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.651+0000 7f396aa00640 1 --2- 172.21.15.8:0/4045028049 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f396c0d8530 0x7f396c0d8910 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:28.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.655+0000 7f3979800640 1 --2- 172.21.15.8:0/4045028049 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3954067860 0x7f3954069d20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3974075bc0 tx=0x7f3974062d80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:28.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.663+0000 7f395fe00640 1 --2- 172.21.15.8:0/4045028049 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f396c0d8e50 0x7f396c02c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:28.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.663+0000 7f395fe00640 1 -- 172.21.15.8:0/4045028049 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f396c0d9230 con 0x7f396c0d8e50 2024-03-23T23:46:28.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.667+0000 7f3972000640 1 --2- 172.21.15.8:0/4045028049 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f396c0d8e50 0x7f396c02c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:28.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.667+0000 7f3972000640 1 -- 172.21.15.8:0/4045028049 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f396c006d90 con 0x7f396c0d8e50 2024-03-23T23:46:28.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.667+0000 7f3972000640 1 --2- 172.21.15.8:0/4045028049 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f396c0d8e50 0x7f396c02c3a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3960013000 tx=0x7f3960004760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:28.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.671+0000 7f396aa00640 1 -- 172.21.15.8:0/4045028049 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3960015030 con 0x7f396c0d8e50 2024-03-23T23:46:28.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.671+0000 7f396aa00640 1 -- 172.21.15.8:0/4045028049 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5182 (secure 0 0 0) 0x7f3960026640 con 0x7f396c0d8e50 2024-03-23T23:46:28.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.671+0000 7f396aa00640 1 -- 172.21.15.8:0/4045028049 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f396c0d8e50 msgr2=0x7f396c02c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:28.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.671+0000 7f396aa00640 1 --2- 172.21.15.8:0/4045028049 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f396c0d8e50 0x7f396c02c3a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3960013000 tx=0x7f3960004760 comp rx=0 tx=0).stop 2024-03-23T23:46:28.673 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:46:28.673 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:46:28.673 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:46:28.673 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:46:28.673 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 28, 2024-03-23T23:46:28.673 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:46:28.673 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:46:28.673 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:46:28.674 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:46:28.674 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:28.674 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 2, 2024-03-23T23:46:28.674 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:46:28.674 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:46:28.674 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:46:28.674 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:46:28.674 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:46:28.674 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:46:28.675 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:46:28.675 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:46:28.675 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:46:28.675 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:46:28.675 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:46:28.675 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:46:28.675 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:46:28.675 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:46:28.675 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:28.675 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:46:28.676 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:46:28.676 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:46:28.676 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:46:28.676 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:46:28.676 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:46:28.676 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:46:28.676 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:46:28.676 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:46:28.676 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:46:28.676 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:46:28.677 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:46:28.677 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:46:28.677 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:28.677 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:28.677 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:46:28.677 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:46:28.677 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:46:28.677 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:46:28.677 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:46:28.677 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:46:28.678 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:46:28.678 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:46:28.678 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:46:28.678 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:46:28.678 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:46:28.678 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:46:28.678 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:46:28.678 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:46:28.678 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:46:28.678 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:46:28.679 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:46:28.679 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:46:28.679 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:46:28.679 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:46:28.679 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:46:28.679 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:46:28.679 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:46:28.679 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:46:28.679 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:46:28.679 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:46:28.679 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:46:28.680 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:46:28.680 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:28.680 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:46:28.680 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:28.680 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:46:28.680 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:28.680 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:46:28.680 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:46:28.680 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:46:28.680 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:46:28.681 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:28.681 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:46:28.681 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:46:28.681 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:28.681 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:28.681 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:28.681 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:46:28.681 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:46:28.681 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:28.681 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:28.681 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:28.682 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:28.682 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:46:28.682 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:46:28.682 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:46:28.682 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:46:28.682 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:46:28.682 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:28.682 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:28.682 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:46:28.683 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:46:28.683 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:46:28.683 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:46:28.683 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:28.683 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:46:28.683 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:46:28.683 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:28.683 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:28.683 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:28.683 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:46:28.683 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:46:28.684 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:28.684 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:28.684 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:28.684 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:28.684 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:46:28.684 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:46:28.684 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:46:28.684 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:46:28.684 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:46:28.684 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:28.685 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:28.685 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:46:28.685 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:46:28.685 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:46:28.685 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:46:28.685 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:28.685 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:46:28.685 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:46:28.685 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:28.685 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:28.686 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:28.686 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:46:28.686 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:46:28.686 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:28.686 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:28.686 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:28.686 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:28.686 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:46:28.686 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:46:28.686 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:46:28.686 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:46:28.687 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:46:28.687 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:28.687 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:28.687 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:28.687 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:46:28.687 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:46:28.687 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:28.687 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:46:28.687 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:46:28.687 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:46:28.687 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:28.688 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:28.688 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:46:28.688 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:28.688 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:46:28.688 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:46:28.688 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:46:28.688 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:28.688 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:28.688 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:46:28.688 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:28.688 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:46:28.689 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:46:28.689 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 8 2024-03-23T23:46:28.689 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:28.689 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:28.689 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:46:28.689 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:28.689 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:46:28.689 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:46:28.689 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:46:28.689 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:28.689 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:28.689 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:46:28.690 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:46:28.690 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 6 2024-03-23T23:46:28.690 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:28.690 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:28.690 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:46:28.690 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:28.690 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:46:28.690 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:46:28.690 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:46:28.690 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:28.690 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:28.690 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:28.690 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:46:28.691 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:46:28.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.671+0000 7f396aa00640 1 -- 172.21.15.8:0/4045028049 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f396c0d8e50 msgr2=0x7f396c02c3a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:46:28.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.671+0000 7f396aa00640 1 --2- 172.21.15.8:0/4045028049 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f396c0d8e50 0x7f396c02c3a0 secure :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3960013000 tx=0x7f3960004760 comp rx=0 tx=0).stop 2024-03-23T23:46:28.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.671+0000 7f395fe00640 1 -- 172.21.15.8:0/4045028049 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3954067860 msgr2=0x7f3954069d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:28.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.671+0000 7f395fe00640 1 --2- 172.21.15.8:0/4045028049 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3954067860 0x7f3954069d20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3974075bc0 tx=0x7f3974062d80 comp rx=0 tx=0).stop 2024-03-23T23:46:28.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.671+0000 7f3979800640 1 -- 172.21.15.8:0/4045028049 reap_dead start 2024-03-23T23:46:28.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.671+0000 7f395fe00640 1 -- 172.21.15.8:0/4045028049 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f396c007610 msgr2=0x7f396c0d3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:28.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.671+0000 7f395fe00640 1 --2- 172.21.15.8:0/4045028049 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f396c007610 0x7f396c0d3100 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f396401aa90 tx=0x7f3964019180 comp rx=0 tx=0).stop 2024-03-23T23:46:28.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.675+0000 7f395fe00640 1 -- 172.21.15.8:0/4045028049 shutdown_connections 2024-03-23T23:46:28.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.675+0000 7f395fe00640 1 --2- 172.21.15.8:0/4045028049 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f396c007610 0x7f396c0d3100 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:28.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.675+0000 7f395fe00640 1 -- 172.21.15.8:0/4045028049 >> 172.21.15.8:0/4045028049 conn(0x7f396c048430 msgr2=0x7f396c04b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:46:28.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.675+0000 7f395fe00640 1 -- 172.21.15.8:0/4045028049 shutdown_connections 2024-03-23T23:46:28.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:28.675+0000 7f395fe00640 1 -- 172.21.15.8:0/4045028049 wait complete. 2024-03-23T23:46:28.730 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:46:28.730 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-03-23T23:46:28.730 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-03-23T23:46:29.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.007+0000 7f06b2e00640 1 Processor -- start 2024-03-23T23:46:29.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.007+0000 7f06b2e00640 1 -- start start 2024-03-23T23:46:29.007 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.007+0000 7f06b2e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f06ac06cc90 0x7f06ac159110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:29.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.007+0000 7f06b2e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ac15acb0 con 0x7f06ac159650 2024-03-23T23:46:29.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.007+0000 7f06b2e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ac06c990 con 0x7f06ac0c3e10 2024-03-23T23:46:29.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.007+0000 7f06b2e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ac0c6dd0 con 0x7f06ac06cc90 2024-03-23T23:46:29.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.011+0000 7f06b1000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f06ac06cc90 0x7f06ac159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:29.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.011+0000 7f06b1000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f06ac06cc90 0x7f06ac159110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:45556/0 (socket says 172.21.15.8:45556) 2024-03-23T23:46:29.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.011+0000 7f06b1000640 1 -- 172.21.15.8:0/1984736690 learned_addr learned my addr 172.21.15.8:0/1984736690 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:46:29.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.015+0000 7f06b1000640 1 -- 172.21.15.8:0/1984736690 >> v1:172.21.15.196:6789/0 conn(0x7f06ac0c3e10 legacy=0x7f06ac06c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:46:29.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.015+0000 7f06b1000640 1 -- 172.21.15.8:0/1984736690 >> v1:172.21.15.8:6789/0 conn(0x7f06ac159650 legacy=0x7f06ac1645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:46:29.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.015+0000 7f06b1000640 1 -- 172.21.15.8:0/1984736690 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ac0ab810 con 0x7f06ac06cc90 2024-03-23T23:46:29.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.031+0000 7f06b1000640 1 --2- 172.21.15.8:0/1984736690 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f06ac06cc90 0x7f06ac159110 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009e50 tx=0x7f06a401c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c73bba13279a916 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:29.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.035+0000 7f06abe00640 1 -- 172.21.15.8:0/1984736690 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a40a5660 con 0x7f06ac06cc90 2024-03-23T23:46:29.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.035+0000 7f06abe00640 1 -- 172.21.15.8:0/1984736690 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a40a5800 con 0x7f06ac06cc90 2024-03-23T23:46:29.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.035+0000 7f06abe00640 1 -- 172.21.15.8:0/1984736690 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a40a5bd0 con 0x7f06ac06cc90 2024-03-23T23:46:29.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.035+0000 7f06b2e00640 1 -- 172.21.15.8:0/1984736690 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f06ac06cc90 msgr2=0x7f06ac159110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:29.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.035+0000 7f06b2e00640 1 --2- 172.21.15.8:0/1984736690 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f06ac06cc90 0x7f06ac159110 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009e50 tx=0x7f06a401c890 comp rx=0 tx=0).stop 2024-03-23T23:46:29.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.035+0000 7f06b2e00640 1 -- 172.21.15.8:0/1984736690 shutdown_connections 2024-03-23T23:46:29.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.035+0000 7f06b2e00640 1 --2- 172.21.15.8:0/1984736690 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f06ac06cc90 0x7f06ac159110 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:29.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.035+0000 7f06b2e00640 1 -- 172.21.15.8:0/1984736690 >> 172.21.15.8:0/1984736690 conn(0x7f06ac0aac80 msgr2=0x7f06ac0ab090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:46:29.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.039+0000 7f06b2e00640 1 -- 172.21.15.8:0/1984736690 shutdown_connections 2024-03-23T23:46:29.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.039+0000 7f06b2e00640 1 -- 172.21.15.8:0/1984736690 wait complete. 2024-03-23T23:46:29.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.039+0000 7f06b2e00640 1 Processor -- start 2024-03-23T23:46:29.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.043+0000 7f06b2e00640 1 -- start start 2024-03-23T23:46:29.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.047+0000 7f06b2e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f06ac06cc90 0x7f06ac15bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:29.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.047+0000 7f06b2e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f06ac0c3e10 0x7f06ac1580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:29.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.051+0000 7f06b2e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06ac159650 0x7f06ac158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:29.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.051+0000 7f06b2e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac0c4f00 con 0x7f06ac159650 2024-03-23T23:46:29.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.051+0000 7f06b2e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac159ac0 con 0x7f06ac06cc90 2024-03-23T23:46:29.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.051+0000 7f06b2e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac0c5080 con 0x7f06ac0c3e10 2024-03-23T23:46:29.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.051+0000 7f06b1000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f06ac0c3e10 0x7f06ac1580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:29.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.051+0000 7f06b2400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06ac159650 0x7f06ac158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:29.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.051+0000 7f06b1000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f06ac0c3e10 0x7f06ac1580c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:49228/0 (socket says 172.21.15.8:49228) 2024-03-23T23:46:29.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.051+0000 7f06b1000640 1 -- 172.21.15.8:0/1687221964 learned_addr learned my addr 172.21.15.8:0/1687221964 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:46:29.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.051+0000 7f06b2400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06ac159650 0x7f06ac158600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49332/0 (socket says 172.21.15.8:49332) 2024-03-23T23:46:29.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.051+0000 7f06b2400640 1 -- 172.21.15.8:0/1687221964 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f06ac0c3e10 msgr2=0x7f06ac1580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:29.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.051+0000 7f06b2400640 1 --2- 172.21.15.8:0/1687221964 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f06ac0c3e10 0x7f06ac1580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:29.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.051+0000 7f06b2400640 1 -- 172.21.15.8:0/1687221964 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f06ac06cc90 msgr2=0x7f06ac15bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:29.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.051+0000 7f06b2400640 1 --2- 172.21.15.8:0/1687221964 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f06ac06cc90 0x7f06ac15bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:29.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.051+0000 7f06b2400640 1 -- 172.21.15.8:0/1687221964 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ac0c13f0 con 0x7f06ac159650 2024-03-23T23:46:29.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.051+0000 7f06b2400640 1 --2- 172.21.15.8:0/1687221964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06ac159650 0x7f06ac158600 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f06a000c410 tx=0x7f06a000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:29.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.051+0000 7f06a9600640 1 -- 172.21.15.8:0/1687221964 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a0017070 con 0x7f06ac159650 2024-03-23T23:46:29.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.051+0000 7f06a9600640 1 -- 172.21.15.8:0/1687221964 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a0003600 con 0x7f06ac159650 2024-03-23T23:46:29.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.051+0000 7f06b2e00640 1 -- 172.21.15.8:0/1687221964 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06ac0c16d0 con 0x7f06ac159650 2024-03-23T23:46:29.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.051+0000 7f06a9600640 1 -- 172.21.15.8:0/1687221964 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a0003a30 con 0x7f06ac159650 2024-03-23T23:46:29.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.051+0000 7f06b2e00640 1 -- 172.21.15.8:0/1687221964 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ac0c1c90 con 0x7f06ac159650 2024-03-23T23:46:29.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.059+0000 7f06a9600640 1 -- 172.21.15.8:0/1687221964 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f06a0003bd0 con 0x7f06ac159650 2024-03-23T23:46:29.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.059+0000 7f06a9600640 1 --2- 172.21.15.8:0/1687221964 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f068c067660 0x7f068c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:29.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.059+0000 7f06a9600640 1 -- 172.21.15.8:0/1687221964 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f06a0084e80 con 0x7f06ac159650 2024-03-23T23:46:29.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.059+0000 7f06b1a00640 1 --2- 172.21.15.8:0/1687221964 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f068c067660 0x7f068c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:29.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.063+0000 7f06b2e00640 1 -- 172.21.15.8:0/1687221964 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06ac04f410 con 0x7f06ac159650 2024-03-23T23:46:29.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.067+0000 7f06b1a00640 1 --2- 172.21.15.8:0/1687221964 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f068c067660 0x7f068c069b20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f06ac164ef0 tx=0x7f06980079c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:29.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.079+0000 7f06a9600640 1 -- 172.21.15.8:0/1687221964 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f06a0055050 con 0x7f06ac159650 2024-03-23T23:46:29.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.691+0000 7f06b2e00640 1 -- 172.21.15.8:0/1687221964 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f06ac0a9300 con 0x7f06ac159650 2024-03-23T23:46:29.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.711+0000 7f06a9600640 1 -- 172.21.15.8:0/1687221964 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f06a00590f0 con 0x7f06ac159650 2024-03-23T23:46:29.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.727+0000 7f06b2e00640 1 -- 172.21.15.8:0/1687221964 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f068c067660 msgr2=0x7f068c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:29.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.727+0000 7f06b2e00640 1 --2- 172.21.15.8:0/1687221964 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f068c067660 0x7f068c069b20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f06ac164ef0 tx=0x7f06980079c0 comp rx=0 tx=0).stop 2024-03-23T23:46:29.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.727+0000 7f06b2e00640 1 -- 172.21.15.8:0/1687221964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06ac159650 msgr2=0x7f06ac158600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:29.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.727+0000 7f06b2e00640 1 --2- 172.21.15.8:0/1687221964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06ac159650 0x7f06ac158600 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f06a000c410 tx=0x7f06a000c8d0 comp rx=0 tx=0).stop 2024-03-23T23:46:29.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.731+0000 7f06b2e00640 1 -- 172.21.15.8:0/1687221964 shutdown_connections 2024-03-23T23:46:29.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.731+0000 7f06b2e00640 1 --2- 172.21.15.8:0/1687221964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06ac159650 0x7f06ac158600 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:29.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.731+0000 7f06b2e00640 1 --2- 172.21.15.8:0/1687221964 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f068c067660 0x7f068c069b20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:29.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.731+0000 7f06b2e00640 1 --2- 172.21.15.8:0/1687221964 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f06ac0c3e10 0x7f06ac1580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:29.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.731+0000 7f06b2e00640 1 --2- 172.21.15.8:0/1687221964 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f06ac06cc90 0x7f06ac15bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:29.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.731+0000 7f06b2e00640 1 -- 172.21.15.8:0/1687221964 >> 172.21.15.8:0/1687221964 conn(0x7f06ac0aac80 msgr2=0x7f06ac1655f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:46:29.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.743+0000 7f06b2e00640 1 -- 172.21.15.8:0/1687221964 shutdown_connections 2024-03-23T23:46:29.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:29.747+0000 7f06b2e00640 1 -- 172.21.15.8:0/1687221964 wait complete. 2024-03-23T23:46:29.832 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-03-23T23:46:39.833 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T23:46:39.833 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:46:40.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.310+0000 7fc94ce00640 1 Processor -- start 2024-03-23T23:46:40.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.310+0000 7fc94ce00640 1 -- start start 2024-03-23T23:46:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.314+0000 7fc94ce00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc9480710f0 0x7fc94815a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.318+0000 7fc945e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc9480710f0 0x7fc94815a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.318+0000 7fc945e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc9480710f0 0x7fc94815a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:52392/0 (socket says 172.21.15.8:52392) 2024-03-23T23:46:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.318+0000 7fc945400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fc9480c1d40 0x7fc9480abe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:49958/0 (socket says 172.21.15.8:49958) 2024-03-23T23:46:40.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.318+0000 7fc945e00640 1 -- 172.21.15.8:0/2471244520 learned_addr learned my addr 172.21.15.8:0/2471244520 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:46:40.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.318+0000 7fc94ce00640 1 --2- 172.21.15.8:0/2471244520 >> v2:172.21.15.196:3300/0 conn(0x7fc9480aa390 0x7fc948157010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:40.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.318+0000 7fc946800640 1 --2- 172.21.15.8:0/2471244520 >> v2:172.21.15.196:3300/0 conn(0x7fc9480aa390 0x7fc948157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:40.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.318+0000 7fc94ce00640 1 -- 172.21.15.8:0/2471244520 --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc948072f40 con 0x7fc9480c1d40 2024-03-23T23:46:40.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.318+0000 7fc94ce00640 1 -- 172.21.15.8:0/2471244520 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9480ab420 con 0x7fc9480aa390 2024-03-23T23:46:40.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.318+0000 7fc94ce00640 1 -- 172.21.15.8:0/2471244520 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9480ab9c0 con 0x7fc9480710f0 2024-03-23T23:46:40.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.322+0000 7fc945e00640 1 -- 172.21.15.8:0/2471244520 >> v2:172.21.15.196:3300/0 conn(0x7fc9480aa390 msgr2=0x7fc948157010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:46:40.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.322+0000 7fc945e00640 1 --2- 172.21.15.8:0/2471244520 >> v2:172.21.15.196:3300/0 conn(0x7fc9480aa390 0x7fc948157010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:40.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.322+0000 7fc945e00640 1 -- 172.21.15.8:0/2471244520 >> v1:172.21.15.8:6789/0 conn(0x7fc9480c1d40 legacy=0x7fc9480abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:40.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.322+0000 7fc945e00640 1 -- 172.21.15.8:0/2471244520 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9480ab690 con 0x7fc9480710f0 2024-03-23T23:46:40.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.322+0000 7fc946800640 1 --2- 172.21.15.8:0/2471244520 >> v2:172.21.15.196:3300/0 conn(0x7fc9480aa390 0x7fc948157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:46:40.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.334+0000 7fc945e00640 1 --2- 172.21.15.8:0/2471244520 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc9480710f0 0x7fc94815a7f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc938009870 tx=0x7fc93801c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cba0f4ac39c8e45 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:40.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.338+0000 7fc944a00640 1 -- 172.21.15.8:0/2471244520 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9380b1070 con 0x7fc9480710f0 2024-03-23T23:46:40.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.338+0000 7fc944a00640 1 -- 172.21.15.8:0/2471244520 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9380a8050 con 0x7fc9480710f0 2024-03-23T23:46:40.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.338+0000 7fc944a00640 1 -- 172.21.15.8:0/2471244520 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9380ac860 con 0x7fc9480710f0 2024-03-23T23:46:40.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.342+0000 7fc94ce00640 1 -- 172.21.15.8:0/2471244520 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc9480710f0 msgr2=0x7fc94815a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:40.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.342+0000 7fc94ce00640 1 --2- 172.21.15.8:0/2471244520 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc9480710f0 0x7fc94815a7f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc938009870 tx=0x7fc93801c4d0 comp rx=0 tx=0).stop 2024-03-23T23:46:40.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.342+0000 7fc94ce00640 1 -- 172.21.15.8:0/2471244520 shutdown_connections 2024-03-23T23:46:40.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.342+0000 7fc94ce00640 1 --2- 172.21.15.8:0/2471244520 >> v2:172.21.15.196:3300/0 conn(0x7fc9480aa390 0x7fc948157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:40.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.342+0000 7fc94ce00640 1 --2- 172.21.15.8:0/2471244520 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc9480710f0 0x7fc94815a7f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:40.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.342+0000 7fc94ce00640 1 -- 172.21.15.8:0/2471244520 >> 172.21.15.8:0/2471244520 conn(0x7fc9480c7170 msgr2=0x7fc9480c7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:46:40.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.342+0000 7fc94ce00640 1 -- 172.21.15.8:0/2471244520 shutdown_connections 2024-03-23T23:46:40.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.342+0000 7fc94ce00640 1 -- 172.21.15.8:0/2471244520 wait complete. 2024-03-23T23:46:40.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.346+0000 7fc94ce00640 1 Processor -- start 2024-03-23T23:46:40.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.346+0000 7fc94ce00640 1 -- start start 2024-03-23T23:46:40.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.350+0000 7fc94ce00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc9480710f0 0x7fc94814d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:40.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.350+0000 7fc94ce00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9480aa390 0x7fc9480c3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:40.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.350+0000 7fc94ce00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9480c1d40 0x7fc948151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:40.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.350+0000 7fc94ce00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9480ac6e0 con 0x7fc9480aa390 2024-03-23T23:46:40.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.350+0000 7fc94ce00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9480ac560 con 0x7fc9480c1d40 2024-03-23T23:46:40.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.350+0000 7fc94ce00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9480714d0 con 0x7fc9480710f0 2024-03-23T23:46:40.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.350+0000 7fc946800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9480c1d40 0x7fc948151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:40.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.350+0000 7fc946800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9480c1d40 0x7fc948151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:36764/0 (socket says 172.21.15.8:36764) 2024-03-23T23:46:40.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.350+0000 7fc946800640 1 -- 172.21.15.8:0/2579679803 learned_addr learned my addr 172.21.15.8:0/2579679803 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:46:40.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.350+0000 7fc945400640 1 --2- 172.21.15.8:0/2579679803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9480aa390 0x7fc9480c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:40.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.350+0000 7fc946800640 1 -- 172.21.15.8:0/2579679803 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc9480710f0 msgr2=0x7fc94814d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:40.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.350+0000 7fc946800640 1 --2- 172.21.15.8:0/2579679803 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc9480710f0 0x7fc94814d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:40.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.350+0000 7fc946800640 1 -- 172.21.15.8:0/2579679803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9480aa390 msgr2=0x7fc9480c3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:40.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.350+0000 7fc946800640 1 --2- 172.21.15.8:0/2579679803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9480aa390 0x7fc9480c3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:40.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.350+0000 7fc946800640 1 -- 172.21.15.8:0/2579679803 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9481f6d20 con 0x7fc9480c1d40 2024-03-23T23:46:40.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.350+0000 7fc945400640 1 --2- 172.21.15.8:0/2579679803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9480aa390 0x7fc9480c3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:46:40.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.358+0000 7fc946800640 1 --2- 172.21.15.8:0/2579679803 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9480c1d40 0x7fc948151470 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc94000cc90 tx=0x7fc94000a650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:40.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.366+0000 7fc93e000640 1 -- 172.21.15.8:0/2579679803 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc940003ba0 con 0x7fc9480c1d40 2024-03-23T23:46:40.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.366+0000 7fc93e000640 1 -- 172.21.15.8:0/2579679803 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc940003d60 con 0x7fc9480c1d40 2024-03-23T23:46:40.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.366+0000 7fc93e000640 1 -- 172.21.15.8:0/2579679803 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc940004260 con 0x7fc9480c1d40 2024-03-23T23:46:40.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.366+0000 7fc94ce00640 1 -- 172.21.15.8:0/2579679803 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9481f5f60 con 0x7fc9480c1d40 2024-03-23T23:46:40.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.366+0000 7fc94ce00640 1 -- 172.21.15.8:0/2579679803 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9481f6520 con 0x7fc9480c1d40 2024-03-23T23:46:40.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.370+0000 7fc94ce00640 1 -- 172.21.15.8:0/2579679803 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc94804f480 con 0x7fc9480c1d40 2024-03-23T23:46:40.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.370+0000 7fc93e000640 1 -- 172.21.15.8:0/2579679803 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc940004400 con 0x7fc9480c1d40 2024-03-23T23:46:40.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.374+0000 7fc93e000640 1 --2- 172.21.15.8:0/2579679803 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc928067760 0x7fc928069c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:40.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.374+0000 7fc93e000640 1 -- 172.21.15.8:0/2579679803 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fc9400869b0 con 0x7fc9480c1d40 2024-03-23T23:46:40.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.374+0000 7fc93e000640 1 -- 172.21.15.8:0/2579679803 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fc940014030 con 0x7fc9480c1d40 2024-03-23T23:46:40.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.378+0000 7fc945e00640 1 --2- 172.21.15.8:0/2579679803 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc928067760 0x7fc928069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:40.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:40.382+0000 7fc945e00640 1 --2- 172.21.15.8:0/2579679803 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc928067760 0x7fc928069c20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc9380ae000 tx=0x7fc938008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:41.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.190+0000 7fc94ce00640 1 -- 172.21.15.8:0/2579679803 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc9480aad70 con 0x7fc9480c1d40 2024-03-23T23:46:41.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.202+0000 7fc93e000640 1 -- 172.21.15.8:0/2579679803 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1561 (secure 0 0 0) 0x7fc940056c90 con 0x7fc9480c1d40 2024-03-23T23:46:41.201 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:46:41.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.202+0000 7fc94ce00640 1 -- 172.21.15.8:0/2579679803 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc928067760 msgr2=0x7fc928069c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:41.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.202+0000 7fc94ce00640 1 --2- 172.21.15.8:0/2579679803 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc928067760 0x7fc928069c20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc9380ae000 tx=0x7fc938008040 comp rx=0 tx=0).stop 2024-03-23T23:46:41.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.202+0000 7fc94ce00640 1 -- 172.21.15.8:0/2579679803 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9480c1d40 msgr2=0x7fc948151470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:41.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.202+0000 7fc94ce00640 1 --2- 172.21.15.8:0/2579679803 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9480c1d40 0x7fc948151470 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc94000cc90 tx=0x7fc94000a650 comp rx=0 tx=0).stop 2024-03-23T23:46:41.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.206+0000 7fc94ce00640 1 -- 172.21.15.8:0/2579679803 shutdown_connections 2024-03-23T23:46:41.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.206+0000 7fc94ce00640 1 --2- 172.21.15.8:0/2579679803 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9480c1d40 0x7fc948151470 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:41.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.206+0000 7fc94ce00640 1 --2- 172.21.15.8:0/2579679803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9480aa390 0x7fc9480c3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:41.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.206+0000 7fc94ce00640 1 --2- 172.21.15.8:0/2579679803 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc928067760 0x7fc928069c20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:41.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.206+0000 7fc94ce00640 1 --2- 172.21.15.8:0/2579679803 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc9480710f0 0x7fc94814d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:41.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.206+0000 7fc94ce00640 1 -- 172.21.15.8:0/2579679803 >> 172.21.15.8:0/2579679803 conn(0x7fc9480c7170 msgr2=0x7fc94806e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:46:41.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.206+0000 7fc94ce00640 1 -- 172.21.15.8:0/2579679803 shutdown_connections 2024-03-23T23:46:41.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.206+0000 7fc94ce00640 1 -- 172.21.15.8:0/2579679803 wait complete. 2024-03-23T23:46:41.252 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T23:46:41.252 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-03-23T23:46:41.252 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T23:46:41.252 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:46:41.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.638+0000 7fdbf1000640 1 Processor -- start 2024-03-23T23:46:41.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.638+0000 7fdbf1000640 1 -- start start 2024-03-23T23:46:41.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.642+0000 7fdbf1000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fdbec1572c0 0x7fdbec15db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:41.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.646+0000 7fdbf1000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fdbec06cbe0 0x7fdbec06d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:41.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.646+0000 7fdbeb400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fdbec1572c0 0x7fdbec15db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:41.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.646+0000 7fdbebe00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fdbec06cbe0 0x7fdbec06d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:41.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.646+0000 7fdbebe00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fdbec06cbe0 0x7fdbec06d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:36770/0 (socket says 172.21.15.8:36770) 2024-03-23T23:46:41.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.646+0000 7fdbebe00640 1 -- 172.21.15.8:0/883756075 learned_addr learned my addr 172.21.15.8:0/883756075 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:46:41.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.646+0000 7fdbf1000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbec15e070 con 0x7fdbec0c8eb0 2024-03-23T23:46:41.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.646+0000 7fdbf1000640 1 -- 172.21.15.8:0/883756075 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbec1576a0 con 0x7fdbec1572c0 2024-03-23T23:46:41.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.646+0000 7fdbf1000640 1 -- 172.21.15.8:0/883756075 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbec06c750 con 0x7fdbec06cbe0 2024-03-23T23:46:41.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.646+0000 7fdbebe00640 1 -- 172.21.15.8:0/883756075 >> v2:172.21.15.8:3300/0 conn(0x7fdbec1572c0 msgr2=0x7fdbec15db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:46:41.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.646+0000 7fdbebe00640 1 --2- 172.21.15.8:0/883756075 >> v2:172.21.15.8:3300/0 conn(0x7fdbec1572c0 0x7fdbec15db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:41.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.646+0000 7fdbebe00640 1 -- 172.21.15.8:0/883756075 >> v1:172.21.15.196:6789/0 conn(0x7fdbec0c8eb0 legacy=0x7fdbec0c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:41.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.646+0000 7fdbebe00640 1 -- 172.21.15.8:0/883756075 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbec0c7a60 con 0x7fdbec06cbe0 2024-03-23T23:46:41.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.654+0000 7fdbebe00640 1 --2- 172.21.15.8:0/883756075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdbec06cbe0 0x7fdbec06d010 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdbec0b0f90 tx=0x7fdbdc01c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d966888b4f864a50 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:41.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.654+0000 7fdbea000640 1 -- 172.21.15.8:0/883756075 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc0a5710 con 0x7fdbec06cbe0 2024-03-23T23:46:41.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.654+0000 7fdbea000640 1 -- 172.21.15.8:0/883756075 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbdc0a58b0 con 0x7fdbec06cbe0 2024-03-23T23:46:41.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.654+0000 7fdbf1000640 1 -- 172.21.15.8:0/883756075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdbec06cbe0 msgr2=0x7fdbec06d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:41.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.654+0000 7fdbea000640 1 -- 172.21.15.8:0/883756075 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc0a5710 con 0x7fdbec06cbe0 2024-03-23T23:46:41.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.658+0000 7fdbf1000640 1 --2- 172.21.15.8:0/883756075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdbec06cbe0 0x7fdbec06d010 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdbec0b0f90 tx=0x7fdbdc01c960 comp rx=0 tx=0).stop 2024-03-23T23:46:41.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.658+0000 7fdbf1000640 1 -- 172.21.15.8:0/883756075 shutdown_connections 2024-03-23T23:46:41.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.658+0000 7fdbf1000640 1 --2- 172.21.15.8:0/883756075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdbec06cbe0 0x7fdbec06d010 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:41.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.658+0000 7fdbf1000640 1 --2- 172.21.15.8:0/883756075 >> v2:172.21.15.8:3300/0 conn(0x7fdbec1572c0 0x7fdbec15db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:41.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.658+0000 7fdbf1000640 1 -- 172.21.15.8:0/883756075 >> 172.21.15.8:0/883756075 conn(0x7fdbec0cb180 msgr2=0x7fdbec0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:46:41.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.658+0000 7fdbf1000640 1 -- 172.21.15.8:0/883756075 shutdown_connections 2024-03-23T23:46:41.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.658+0000 7fdbf1000640 1 -- 172.21.15.8:0/883756075 wait complete. 2024-03-23T23:46:41.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.662+0000 7fdbf1000640 1 Processor -- start 2024-03-23T23:46:41.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.662+0000 7fdbf1000640 1 -- start start 2024-03-23T23:46:41.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.662+0000 7fdbf1000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdbec06cbe0 0x7fdbec1fb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:41.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.666+0000 7fdbf1000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdbec0c8eb0 0x7fdbec0b0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:41.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.666+0000 7fdbf1000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbec1572c0 0x7fdbec1560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:41.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.670+0000 7fdbeaa00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdbec0c8eb0 0x7fdbec0b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:41.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.670+0000 7fdbeaa00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdbec0c8eb0 0x7fdbec0b0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:36772/0 (socket says 172.21.15.8:36772) 2024-03-23T23:46:41.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.670+0000 7fdbeaa00640 1 -- 172.21.15.8:0/603404907 learned_addr learned my addr 172.21.15.8:0/603404907 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:46:41.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.670+0000 7fdbf1000640 1 -- 172.21.15.8:0/603404907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec0c9580 con 0x7fdbec1572c0 2024-03-23T23:46:41.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.670+0000 7fdbf1000640 1 -- 172.21.15.8:0/603404907 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec06d550 con 0x7fdbec0c8eb0 2024-03-23T23:46:41.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.670+0000 7fdbebe00640 1 --2- 172.21.15.8:0/603404907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbec1572c0 0x7fdbec1560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:41.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.670+0000 7fdbeb400640 1 --2- 172.21.15.8:0/603404907 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdbec06cbe0 0x7fdbec1fb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:41.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.670+0000 7fdbf1000640 1 -- 172.21.15.8:0/603404907 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec0c6040 con 0x7fdbec06cbe0 2024-03-23T23:46:41.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.670+0000 7fdbeaa00640 1 -- 172.21.15.8:0/603404907 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdbec06cbe0 msgr2=0x7fdbec1fb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:41.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.670+0000 7fdbeaa00640 1 --2- 172.21.15.8:0/603404907 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdbec06cbe0 0x7fdbec1fb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:41.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.670+0000 7fdbeaa00640 1 -- 172.21.15.8:0/603404907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbec1572c0 msgr2=0x7fdbec1560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:41.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.670+0000 7fdbeaa00640 1 --2- 172.21.15.8:0/603404907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbec1572c0 0x7fdbec1560e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:41.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.670+0000 7fdbeaa00640 1 -- 172.21.15.8:0/603404907 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbec158330 con 0x7fdbec0c8eb0 2024-03-23T23:46:41.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.678+0000 7fdbeaa00640 1 --2- 172.21.15.8:0/603404907 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdbec0c8eb0 0x7fdbec0b0020 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdbd800c500 tx=0x7fdbd800c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:41.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.678+0000 7fdbe3400640 1 -- 172.21.15.8:0/603404907 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8016020 con 0x7fdbec0c8eb0 2024-03-23T23:46:41.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.678+0000 7fdbe3400640 1 -- 172.21.15.8:0/603404907 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd8005220 con 0x7fdbec0c8eb0 2024-03-23T23:46:41.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.678+0000 7fdbe3400640 1 -- 172.21.15.8:0/603404907 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8007030 con 0x7fdbec0c8eb0 2024-03-23T23:46:41.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.678+0000 7fdbf1000640 1 -- 172.21.15.8:0/603404907 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbec158610 con 0x7fdbec0c8eb0 2024-03-23T23:46:41.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.678+0000 7fdbf1000640 1 -- 172.21.15.8:0/603404907 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbec0c4fe0 con 0x7fdbec0c8eb0 2024-03-23T23:46:41.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.682+0000 7fdbf1000640 1 --2- 172.21.15.8:0/603404907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbec157c60 0x7fdbec156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:41.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.682+0000 7fdbf1000640 1 -- 172.21.15.8:0/603404907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec04f410 con 0x7fdbec157c60 2024-03-23T23:46:41.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.682+0000 7fdbeb400640 1 --2- 172.21.15.8:0/603404907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbec157c60 0x7fdbec156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:41.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.686+0000 7fdbeb400640 1 -- 172.21.15.8:0/603404907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdbec072680 con 0x7fdbec157c60 2024-03-23T23:46:41.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.686+0000 7fdbeb400640 1 --2- 172.21.15.8:0/603404907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbec157c60 0x7fdbec156620 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdbe40107f0 tx=0x7fdbe4010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:41.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.686+0000 7fdbe3400640 1 -- 172.21.15.8:0/603404907 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fdbd80071f0 con 0x7fdbec0c8eb0 2024-03-23T23:46:41.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.686+0000 7fdbe3400640 1 --2- 172.21.15.8:0/603404907 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdbcc0676b0 0x7fdbcc069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:41.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.690+0000 7fdbe3400640 1 -- 172.21.15.8:0/603404907 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe4018070 con 0x7fdbec157c60 2024-03-23T23:46:41.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.690+0000 7fdbebe00640 1 --2- 172.21.15.8:0/603404907 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdbcc0676b0 0x7fdbcc069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:41.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.690+0000 7fdbe3400640 1 -- 172.21.15.8:0/603404907 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fdbd8085510 con 0x7fdbec0c8eb0 2024-03-23T23:46:41.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.690+0000 7fdbe3400640 1 -- 172.21.15.8:0/603404907 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fdbe400ea30 con 0x7fdbec157c60 2024-03-23T23:46:41.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.690+0000 7fdbe3400640 1 -- 172.21.15.8:0/603404907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbec157c60 msgr2=0x7fdbec156620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:41.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.690+0000 7fdbe3400640 1 --2- 172.21.15.8:0/603404907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbec157c60 0x7fdbec156620 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdbe40107f0 tx=0x7fdbe4010cb0 comp rx=0 tx=0).stop 2024-03-23T23:46:41.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.690+0000 7fdbebe00640 1 --2- 172.21.15.8:0/603404907 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdbcc0676b0 0x7fdbcc069b70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc0ae000 tx=0x7fdbdc0a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:41.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.690+0000 7fdbe3400640 1 -- 172.21.15.8:0/603404907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbec157c60 msgr2=0x7fdbec156620 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:46:41.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.690+0000 7fdbe3400640 1 --2- 172.21.15.8:0/603404907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbec157c60 0x7fdbec156620 secure :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdbe40107f0 tx=0x7fdbe4010cb0 comp rx=0 tx=0).stop 2024-03-23T23:46:41.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.722+0000 7fdbf1000640 1 --2- 172.21.15.8:0/603404907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbec1fde60 0x7fdbec1fe270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:41.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.722+0000 7fdbeb400640 1 --2- 172.21.15.8:0/603404907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbec1fde60 0x7fdbec1fe270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:41.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.722+0000 7fdbf1000640 1 -- 172.21.15.8:0/603404907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec156b60 con 0x7fdbec1fde60 2024-03-23T23:46:41.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.722+0000 7fdbeb400640 1 -- 172.21.15.8:0/603404907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fdbec0c44a0 con 0x7fdbec1fde60 2024-03-23T23:46:41.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.726+0000 7fdbeb400640 1 --2- 172.21.15.8:0/603404907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbec1fde60 0x7fdbec1fe270 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdbe40107f0 tx=0x7fdbe40046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:41.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.726+0000 7fdbe3400640 1 -- 172.21.15.8:0/603404907 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe402b020 con 0x7fdbec1fde60 2024-03-23T23:46:41.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.726+0000 7fdbe3400640 1 -- 172.21.15.8:0/603404907 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4532 (secure 0 0 0) 0x7fdbe4014430 con 0x7fdbec1fde60 2024-03-23T23:46:41.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.726+0000 7fdbe3400640 1 -- 172.21.15.8:0/603404907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbec1fde60 msgr2=0x7fdbec1fe270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:41.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.726+0000 7fdbe3400640 1 --2- 172.21.15.8:0/603404907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbec1fde60 0x7fdbec1fe270 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdbe40107f0 tx=0x7fdbe40046d0 comp rx=0 tx=0).stop 2024-03-23T23:46:41.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.726+0000 7fdbe3400640 1 -- 172.21.15.8:0/603404907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbec1fde60 msgr2=0x7fdbec1fe270 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:46:41.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.726+0000 7fdbe3400640 1 --2- 172.21.15.8:0/603404907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbec1fde60 0x7fdbec1fe270 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdbe40107f0 tx=0x7fdbe40046d0 comp rx=0 tx=0).stop 2024-03-23T23:46:41.728 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:46:41.728 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:46:41.728 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:46:41.728 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:46:41.728 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 28, 2024-03-23T23:46:41.728 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:46:41.728 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:46:41.728 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:46:41.728 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:46:41.729 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:41.729 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 15, 2024-03-23T23:46:41.729 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:46:41.729 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:46:41.729 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:46:41.729 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:46:41.729 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:46:41.729 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:46:41.729 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:46:41.729 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:46:41.729 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:46:41.729 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:46:41.729 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:46:41.730 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:46:41.730 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:46:41.730 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:46:41.730 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:41.730 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:46:41.730 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:46:41.730 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:46:41.730 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:46:41.730 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:46:41.730 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:46:41.730 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:46:41.730 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:46:41.731 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:46:41.731 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:46:41.731 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:46:41.731 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:46:41.731 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:46:41.731 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:41.731 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:41.731 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:46:41.731 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:46:41.731 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:46:41.731 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:46:41.731 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:46:41.731 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:46:41.732 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:46:41.732 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:46:41.732 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:46:41.732 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:46:41.732 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:46:41.732 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:46:41.732 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:46:41.732 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:46:41.732 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:46:41.732 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:46:41.732 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:46:41.732 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:46:41.732 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:46:41.733 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:46:41.733 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:46:41.733 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:46:41.733 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:46:41.733 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:46:41.733 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:46:41.733 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:46:41.733 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:46:41.733 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:46:41.733 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:41.733 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:46:41.733 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:41.733 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:46:41.733 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:41.734 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:46:41.734 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:46:41.734 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:46:41.734 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:46:41.734 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:41.734 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:46:41.734 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:46:41.734 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:41.734 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:41.734 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:41.734 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:46:41.734 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:46:41.734 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:41.735 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:41.735 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:41.735 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:41.735 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:46:41.735 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:46:41.735 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:46:41.735 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:46:41.735 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:46:41.735 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:41.735 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:41.735 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:46:41.735 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:46:41.735 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:46:41.736 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:46:41.736 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:41.736 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:46:41.736 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:46:41.736 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:41.736 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:41.736 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:41.736 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:46:41.736 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:46:41.736 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:41.736 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:41.736 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:41.736 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:41.737 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:46:41.737 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:46:41.737 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:46:41.737 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:46:41.737 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:46:41.737 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:41.737 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:41.737 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:46:41.737 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:46:41.737 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:46:41.737 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:46:41.737 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:41.737 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:46:41.737 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:46:41.738 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:41.738 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:41.738 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:41.738 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:46:41.738 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:46:41.738 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:41.738 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:41.738 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:41.738 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:41.738 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:46:41.738 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:46:41.738 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:46:41.738 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:46:41.739 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:46:41.739 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:41.739 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:41.739 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:41.739 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:46:41.739 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:46:41.739 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:41.739 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:46:41.739 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:46:41.739 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:46:41.739 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:41.739 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:41.739 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:46:41.740 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:41.740 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:46:41.740 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:46:41.740 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:46:41.740 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:41.740 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:41.740 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:41.740 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:46:41.740 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:46:41.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.726+0000 7fdbf1000640 1 -- 172.21.15.8:0/603404907 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdbcc0676b0 msgr2=0x7fdbcc069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:41.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.726+0000 7fdbf1000640 1 --2- 172.21.15.8:0/603404907 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdbcc0676b0 0x7fdbcc069b70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc0ae000 tx=0x7fdbdc0a7070 comp rx=0 tx=0).stop 2024-03-23T23:46:41.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.726+0000 7fdbebe00640 1 -- 172.21.15.8:0/603404907 reap_dead start 2024-03-23T23:46:41.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.726+0000 7fdbf1000640 1 -- 172.21.15.8:0/603404907 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdbec0c8eb0 msgr2=0x7fdbec0b0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:41.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.726+0000 7fdbf1000640 1 --2- 172.21.15.8:0/603404907 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdbec0c8eb0 0x7fdbec0b0020 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdbd800c500 tx=0x7fdbd800c9c0 comp rx=0 tx=0).stop 2024-03-23T23:46:41.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.730+0000 7fdbf1000640 1 -- 172.21.15.8:0/603404907 shutdown_connections 2024-03-23T23:46:41.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.730+0000 7fdbf1000640 1 --2- 172.21.15.8:0/603404907 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdbec0c8eb0 0x7fdbec0b0020 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdbd800c500 tx=0x7fdbd800c9c0 comp rx=0 tx=0).stop 2024-03-23T23:46:41.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.730+0000 7fdbf1000640 1 -- 172.21.15.8:0/603404907 >> 172.21.15.8:0/603404907 conn(0x7fdbec0cb180 msgr2=0x7fdbec15b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:46:41.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.730+0000 7fdbf1000640 1 -- 172.21.15.8:0/603404907 shutdown_connections 2024-03-23T23:46:41.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:41.730+0000 7fdbf1000640 1 -- 172.21.15.8:0/603404907 wait complete. 2024-03-23T23:46:41.856 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:46:41.856 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T23:46:41.856 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:46:42.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.206+0000 7f8c50000640 1 Processor -- start 2024-03-23T23:46:42.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.206+0000 7f8c50000640 1 -- start start 2024-03-23T23:46:42.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.210+0000 7f8c50000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8c480acc40 0x7f8c48152220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:42.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.210+0000 7f8c4d600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8c480acc40 0x7f8c48152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:42.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.210+0000 7f8c4d600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8c480acc40 0x7f8c48152220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42826/0 (socket says 172.21.15.8:42826) 2024-03-23T23:46:42.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.210+0000 7f8c4d600640 1 -- 172.21.15.8:0/4135663761 learned_addr learned my addr 172.21.15.8:0/4135663761 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:46:42.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.210+0000 7f8c50000640 1 -- 172.21.15.8:0/4135663761 --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c4806cf20 con 0x7f8c4806e0d0 2024-03-23T23:46:42.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.210+0000 7f8c50000640 1 -- 172.21.15.8:0/4135663761 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c4806d200 con 0x7f8c48152c90 2024-03-23T23:46:42.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.210+0000 7f8c50000640 1 -- 172.21.15.8:0/4135663761 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c4806dce0 con 0x7f8c480acc40 2024-03-23T23:46:42.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.210+0000 7f8c47e00640 1 -- 172.21.15.8:0/4135663761 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1049272022 0 0) 0x7f8c4806cf20 con 0x7f8c4806e0d0 2024-03-23T23:46:42.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.210+0000 7f8c47e00640 1 -- 172.21.15.8:0/4135663761 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c30003530 con 0x7f8c4806e0d0 2024-03-23T23:46:42.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.214+0000 7f8c47e00640 1 -- 172.21.15.8:0/4135663761 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2949780833 0 0) 0x7f8c4806d200 con 0x7f8c48152c90 2024-03-23T23:46:42.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.214+0000 7f8c47e00640 1 -- 172.21.15.8:0/4135663761 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c4806cf20 con 0x7f8c48152c90 2024-03-23T23:46:42.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.214+0000 7f8c47e00640 1 -- 172.21.15.8:0/4135663761 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3054348484 0 0) 0x7f8c30003530 con 0x7f8c4806e0d0 2024-03-23T23:46:42.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.214+0000 7f8c47e00640 1 -- 172.21.15.8:0/4135663761 >> v2:172.21.15.8:3300/0 conn(0x7f8c480acc40 msgr2=0x7f8c48152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:46:42.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.214+0000 7f8c47e00640 1 --2- 172.21.15.8:0/4135663761 >> v2:172.21.15.8:3300/0 conn(0x7f8c480acc40 0x7f8c48152220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:42.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.214+0000 7f8c47e00640 1 -- 172.21.15.8:0/4135663761 >> v1:172.21.15.196:6789/0 conn(0x7f8c48152c90 legacy=0x7f8c48153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:42.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.214+0000 7f8c47e00640 1 -- 172.21.15.8:0/4135663761 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4806d4e0 con 0x7f8c4806e0d0 2024-03-23T23:46:42.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.214+0000 7f8c47e00640 1 -- 172.21.15.8:0/4135663761 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7f8c34001600 con 0x7f8c4806e0d0 2024-03-23T23:46:42.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.214+0000 7f8c47e00640 1 -- 172.21.15.8:0/4135663761 >> v1:172.21.15.8:6789/0 conn(0x7f8c4806e0d0 legacy=0x7f8c480c2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:42.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.214+0000 7f8c47e00640 1 --2- 172.21.15.8:0/4135663761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c30003b50 0x7f8c30003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:42.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.214+0000 7f8c47e00640 1 --2- 172.21.15.8:0/4135663761 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c3000f1b0 0x7f8c300115a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:42.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.214+0000 7f8c47e00640 1 --2- 172.21.15.8:0/4135663761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c30011b50 0x7f8c30014010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:42.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.214+0000 7f8c47e00640 1 -- 172.21.15.8:0/4135663761 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4806dce0 con 0x7f8c30011b50 2024-03-23T23:46:42.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.214+0000 7f8c47e00640 1 -- 172.21.15.8:0/4135663761 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c300148f0 con 0x7f8c30003b50 2024-03-23T23:46:42.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.214+0000 7f8c47e00640 1 -- 172.21.15.8:0/4135663761 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c30014af0 con 0x7f8c3000f1b0 2024-03-23T23:46:42.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.214+0000 7f8c4cc00640 1 --2- 172.21.15.8:0/4135663761 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c3000f1b0 0x7f8c300115a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:42.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.214+0000 7f8c4d600640 1 --2- 172.21.15.8:0/4135663761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c30003b50 0x7f8c30003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:42.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.214+0000 7f8c4e000640 1 --2- 172.21.15.8:0/4135663761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c30011b50 0x7f8c30014010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:42.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.218+0000 7f8c4cc00640 1 -- 172.21.15.8:0/4135663761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c30003b50 msgr2=0x7f8c30003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:46:42.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.218+0000 7f8c4cc00640 1 --2- 172.21.15.8:0/4135663761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c30003b50 0x7f8c30003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:42.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.218+0000 7f8c4cc00640 1 -- 172.21.15.8:0/4135663761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c30011b50 msgr2=0x7f8c30014010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:46:42.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.218+0000 7f8c4cc00640 1 --2- 172.21.15.8:0/4135663761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c30011b50 0x7f8c30014010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:42.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.218+0000 7f8c4cc00640 1 -- 172.21.15.8:0/4135663761 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4806d4e0 con 0x7f8c3000f1b0 2024-03-23T23:46:42.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.218+0000 7f8c4e000640 1 --2- 172.21.15.8:0/4135663761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c30011b50 0x7f8c30014010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:46:42.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.218+0000 7f8c4e000640 1 -- 172.21.15.8:0/4135663761 reap_dead start 2024-03-23T23:46:42.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.218+0000 7f8c4d600640 1 --2- 172.21.15.8:0/4135663761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c30003b50 0x7f8c30003f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:46:42.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.230+0000 7f8c4cc00640 1 --2- 172.21.15.8:0/4135663761 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c3000f1b0 0x7f8c300115a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8c34007fd0 tx=0x7f8c3401cb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd46a3e65c4d2378 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:42.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.234+0000 7f8c47e00640 1 -- 172.21.15.8:0/4135663761 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c340b2070 con 0x7f8c3000f1b0 2024-03-23T23:46:42.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.234+0000 7f8c47e00640 1 -- 172.21.15.8:0/4135663761 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c340a5a20 con 0x7f8c3000f1b0 2024-03-23T23:46:42.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.234+0000 7f8c47e00640 1 -- 172.21.15.8:0/4135663761 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c34007be0 con 0x7f8c3000f1b0 2024-03-23T23:46:42.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.238+0000 7f8c50000640 1 -- 172.21.15.8:0/4135663761 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c3000f1b0 msgr2=0x7f8c300115a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:42.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.238+0000 7f8c50000640 1 --2- 172.21.15.8:0/4135663761 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c3000f1b0 0x7f8c300115a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8c34007fd0 tx=0x7f8c3401cb00 comp rx=0 tx=0).stop 2024-03-23T23:46:42.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.238+0000 7f8c50000640 1 -- 172.21.15.8:0/4135663761 shutdown_connections 2024-03-23T23:46:42.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.238+0000 7f8c50000640 1 --2- 172.21.15.8:0/4135663761 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c3000f1b0 0x7f8c300115a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:42.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.238+0000 7f8c50000640 1 -- 172.21.15.8:0/4135663761 >> 172.21.15.8:0/4135663761 conn(0x7f8c480c3a60 msgr2=0x7f8c480c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:46:42.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.238+0000 7f8c50000640 1 -- 172.21.15.8:0/4135663761 shutdown_connections 2024-03-23T23:46:42.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.242+0000 7f8c50000640 1 -- 172.21.15.8:0/4135663761 wait complete. 2024-03-23T23:46:42.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.246+0000 7f8c50000640 1 Processor -- start 2024-03-23T23:46:42.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.254+0000 7f8c50000640 1 -- start start 2024-03-23T23:46:42.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.254+0000 7f8c50000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c3000f1b0 0x7f8c4814f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:42.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.254+0000 7f8c50000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c4814bad0 0x7f8c480c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:42.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.254+0000 7f8c50000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c481ea660 0x7f8c481408d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:42.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.254+0000 7f8c50000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c480ad020 con 0x7f8c3000f1b0 2024-03-23T23:46:42.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.254+0000 7f8c50000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4806ed10 con 0x7f8c481ea660 2024-03-23T23:46:42.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.254+0000 7f8c50000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4806efd0 con 0x7f8c4814bad0 2024-03-23T23:46:42.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.254+0000 7f8c4e000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c481ea660 0x7f8c481408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:42.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.254+0000 7f8c4e000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c481ea660 0x7f8c481408d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:36786/0 (socket says 172.21.15.8:36786) 2024-03-23T23:46:42.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.254+0000 7f8c4e000640 1 -- 172.21.15.8:0/1236704305 learned_addr learned my addr 172.21.15.8:0/1236704305 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:46:42.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.258+0000 7f8c4e000640 1 -- 172.21.15.8:0/1236704305 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c4814bad0 msgr2=0x7f8c480c55a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:46:42.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.258+0000 7f8c4e000640 1 --2- 172.21.15.8:0/1236704305 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c4814bad0 0x7f8c480c55a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:42.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.258+0000 7f8c4e000640 1 -- 172.21.15.8:0/1236704305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c3000f1b0 msgr2=0x7f8c4814f610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:46:42.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.258+0000 7f8c4e000640 1 --2- 172.21.15.8:0/1236704305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c3000f1b0 0x7f8c4814f610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:42.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.258+0000 7f8c4e000640 1 -- 172.21.15.8:0/1236704305 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c480bcfc0 con 0x7f8c481ea660 2024-03-23T23:46:42.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.262+0000 7f8c4e000640 1 --2- 172.21.15.8:0/1236704305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c481ea660 0x7f8c481408d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8c480c4aa0 tx=0x7f8c40012c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:42.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.262+0000 7f8c45600640 1 -- 172.21.15.8:0/1236704305 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c40011040 con 0x7f8c481ea660 2024-03-23T23:46:42.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.262+0000 7f8c45600640 1 -- 172.21.15.8:0/1236704305 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c40006db0 con 0x7f8c481ea660 2024-03-23T23:46:42.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.262+0000 7f8c45600640 1 -- 172.21.15.8:0/1236704305 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c40001c50 con 0x7f8c481ea660 2024-03-23T23:46:42.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.266+0000 7f8c50000640 1 -- 172.21.15.8:0/1236704305 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c480bd2a0 con 0x7f8c481ea660 2024-03-23T23:46:42.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.266+0000 7f8c50000640 1 -- 172.21.15.8:0/1236704305 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c481e9e60 con 0x7f8c481ea660 2024-03-23T23:46:42.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.270+0000 7f8c45600640 1 -- 172.21.15.8:0/1236704305 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f8c40010ac0 con 0x7f8c481ea660 2024-03-23T23:46:42.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.270+0000 7f8c3aa00640 1 --2- 172.21.15.8:0/1236704305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c1c002a80 0x7f8c1c004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:42.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.270+0000 7f8c3aa00640 1 -- 172.21.15.8:0/1236704305 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c007ed0 con 0x7f8c1c002a80 2024-03-23T23:46:42.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.270+0000 7f8c45600640 1 --2- 172.21.15.8:0/1236704305 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8c28067690 0x7f8c28069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:42.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.270+0000 7f8c45600640 1 -- 172.21.15.8:0/1236704305 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f8c40088b90 con 0x7f8c481ea660 2024-03-23T23:46:42.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.270+0000 7f8c4d600640 1 --2- 172.21.15.8:0/1236704305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c1c002a80 0x7f8c1c004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:42.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.270+0000 7f8c4d600640 1 -- 172.21.15.8:0/1236704305 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8c1c0080d0 con 0x7f8c1c002a80 2024-03-23T23:46:42.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.270+0000 7f8c4d600640 1 --2- 172.21.15.8:0/1236704305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c1c002a80 0x7f8c1c004f40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8c481508f0 tx=0x7f8c3c00b4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:42.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.270+0000 7f8c45600640 1 -- 172.21.15.8:0/1236704305 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c00dc00 con 0x7f8c1c002a80 2024-03-23T23:46:42.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.278+0000 7f8c45600640 1 -- 172.21.15.8:0/1236704305 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f8c3c01c070 con 0x7f8c1c002a80 2024-03-23T23:46:42.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.278+0000 7f8c45600640 1 -- 172.21.15.8:0/1236704305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c1c002a80 msgr2=0x7f8c1c004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:42.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.278+0000 7f8c45600640 1 --2- 172.21.15.8:0/1236704305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c1c002a80 0x7f8c1c004f40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8c481508f0 tx=0x7f8c3c00b4b0 comp rx=0 tx=0).stop 2024-03-23T23:46:42.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.278+0000 7f8c45600640 1 -- 172.21.15.8:0/1236704305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c1c002a80 msgr2=0x7f8c1c004f40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:46:42.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.278+0000 7f8c45600640 1 --2- 172.21.15.8:0/1236704305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c1c002a80 0x7f8c1c004f40 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8c481508f0 tx=0x7f8c3c00b4b0 comp rx=0 tx=0).stop 2024-03-23T23:46:42.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.278+0000 7f8c4cc00640 1 --2- 172.21.15.8:0/1236704305 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8c28067690 0x7f8c28069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:42.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.278+0000 7f8c4cc00640 1 --2- 172.21.15.8:0/1236704305 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8c28067690 0x7f8c28069b50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8c340af000 tx=0x7f8c340a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:42.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.310+0000 7f8c3aa00640 1 --2- 172.21.15.8:0/1236704305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c1c006ec0 0x7f8c1c007350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:42.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.310+0000 7f8c3aa00640 1 -- 172.21.15.8:0/1236704305 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c00a4b0 con 0x7f8c1c006ec0 2024-03-23T23:46:42.320 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:46:42.320 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:46:42.320 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:46:42.320 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:46:42.320 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 28, 2024-03-23T23:46:42.320 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:46:42.320 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:46:42.320 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:46:42.320 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:46:42.320 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:42.320 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 16, 2024-03-23T23:46:42.321 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:46:42.321 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:46:42.321 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:46:42.321 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:46:42.321 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:46:42.321 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:46:42.321 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:46:42.321 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:46:42.321 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:46:42.321 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:46:42.321 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:46:42.321 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:46:42.321 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:46:42.322 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:46:42.322 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:42.322 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:46:42.322 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:46:42.322 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:46:42.322 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:46:42.322 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:46:42.322 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:46:42.322 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:46:42.322 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:46:42.322 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:46:42.322 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:46:42.323 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:46:42.323 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:46:42.323 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:46:42.323 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:42.323 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:42.323 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:46:42.323 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:46:42.323 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:46:42.323 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:46:42.323 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:46:42.323 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:46:42.324 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:46:42.324 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:46:42.324 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:46:42.324 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:46:42.324 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:46:42.324 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:46:42.324 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:46:42.324 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:46:42.324 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:46:42.324 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:46:42.324 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:46:42.324 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:46:42.325 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:46:42.325 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:46:42.325 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:46:42.325 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:46:42.325 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:46:42.325 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:46:42.325 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:46:42.325 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:46:42.325 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:46:42.325 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:46:42.325 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:42.325 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:46:42.326 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:42.326 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:46:42.326 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:42.326 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:46:42.326 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:46:42.326 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:46:42.326 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:46:42.326 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:42.326 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:46:42.326 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:46:42.326 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:42.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:42.327 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:42.327 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:46:42.327 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:46:42.327 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:42.327 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:42.327 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:42.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:42.327 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:46:42.327 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:46:42.327 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:46:42.327 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:46:42.328 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:46:42.328 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:42.328 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:42.328 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:46:42.328 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:46:42.328 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:46:42.328 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:46:42.328 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:42.328 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:46:42.328 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:46:42.328 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:42.328 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:42.329 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:42.329 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:46:42.329 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:46:42.329 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:42.329 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:42.329 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:42.329 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:42.329 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:46:42.329 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:46:42.329 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:46:42.329 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:46:42.329 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:46:42.329 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:42.329 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:42.330 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:46:42.330 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:46:42.330 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:46:42.330 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:46:42.330 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:42.330 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:46:42.330 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:46:42.330 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:42.330 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:42.330 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:42.330 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:46:42.330 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:46:42.331 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:42.331 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:42.331 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:42.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:42.331 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:46:42.331 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:46:42.331 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:46:42.331 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:46:42.331 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:46:42.331 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:42.331 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:42.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:42.332 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:46:42.332 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:46:42.332 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:42.332 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:46:42.332 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:46:42.332 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:46:42.332 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:42.332 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:42.332 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:46:42.332 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:42.332 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:46:42.332 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:46:42.332 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:46:42.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:42.333 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:42.333 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:46:42.333 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:46:42.333 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:46:42.333 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:42.333 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:42.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:42.333 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:46:42.333 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:46:42.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.314+0000 7f8c4d600640 1 --2- 172.21.15.8:0/1236704305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c1c006ec0 0x7f8c1c007350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:42.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.314+0000 7f8c4d600640 1 -- 172.21.15.8:0/1236704305 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8c1c007890 con 0x7f8c1c006ec0 2024-03-23T23:46:42.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.314+0000 7f8c4d600640 1 --2- 172.21.15.8:0/1236704305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c1c006ec0 0x7f8c1c007350 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c01b000 tx=0x7f8c3c0046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:42.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.314+0000 7f8c45600640 1 -- 172.21.15.8:0/1236704305 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c0217c0 con 0x7f8c1c006ec0 2024-03-23T23:46:42.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.314+0000 7f8c45600640 1 -- 172.21.15.8:0/1236704305 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4673 (secure 0 0 0) 0x7f8c3c021960 con 0x7f8c1c006ec0 2024-03-23T23:46:42.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.314+0000 7f8c45600640 1 -- 172.21.15.8:0/1236704305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c1c006ec0 msgr2=0x7f8c1c007350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:42.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.314+0000 7f8c45600640 1 --2- 172.21.15.8:0/1236704305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c1c006ec0 0x7f8c1c007350 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c01b000 tx=0x7f8c3c0046d0 comp rx=0 tx=0).stop 2024-03-23T23:46:42.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.314+0000 7f8c45600640 1 -- 172.21.15.8:0/1236704305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c1c006ec0 msgr2=0x7f8c1c007350 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:46:42.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.314+0000 7f8c45600640 1 --2- 172.21.15.8:0/1236704305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c1c006ec0 0x7f8c1c007350 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c01b000 tx=0x7f8c3c0046d0 comp rx=0 tx=0).stop 2024-03-23T23:46:42.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.314+0000 7f8c50000640 1 -- 172.21.15.8:0/1236704305 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8c28067690 msgr2=0x7f8c28069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:42.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.314+0000 7f8c50000640 1 --2- 172.21.15.8:0/1236704305 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8c28067690 0x7f8c28069b50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8c340af000 tx=0x7f8c340a7000 comp rx=0 tx=0).stop 2024-03-23T23:46:42.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.314+0000 7f8c50000640 1 -- 172.21.15.8:0/1236704305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c481ea660 msgr2=0x7f8c481408d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:42.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.314+0000 7f8c50000640 1 --2- 172.21.15.8:0/1236704305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c481ea660 0x7f8c481408d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8c480c4aa0 tx=0x7f8c40012c20 comp rx=0 tx=0).stop 2024-03-23T23:46:42.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.314+0000 7f8c4e000640 1 -- 172.21.15.8:0/1236704305 reap_dead start 2024-03-23T23:46:42.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.314+0000 7f8c4e000640 1 -- 172.21.15.8:0/1236704305 reap_dead start 2024-03-23T23:46:42.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.318+0000 7f8c50000640 1 -- 172.21.15.8:0/1236704305 shutdown_connections 2024-03-23T23:46:42.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.318+0000 7f8c50000640 1 -- 172.21.15.8:0/1236704305 >> 172.21.15.8:0/1236704305 conn(0x7f8c480c3a60 msgr2=0x7f8c480aac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:46:42.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.318+0000 7f8c50000640 1 -- 172.21.15.8:0/1236704305 shutdown_connections 2024-03-23T23:46:42.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.322+0000 7f8c50000640 1 -- 172.21.15.8:0/1236704305 wait complete. 2024-03-23T23:46:42.413 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:46:42.413 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T23:46:42.413 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:46:42.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.798+0000 7f57d1000640 1 Processor -- start 2024-03-23T23:46:42.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.798+0000 7f57d1000640 1 -- start start 2024-03-23T23:46:42.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.802+0000 7f57d1000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f57c40dbd50 0x7f57c403e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:42.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.802+0000 7f57d1000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f57c404b310 0x7f57c4006df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:42.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.802+0000 7f57d1000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c402e160 con 0x7f57c403ecf0 2024-03-23T23:46:42.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.802+0000 7f57d1000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c40480c0 con 0x7f57c40dbd50 2024-03-23T23:46:42.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.802+0000 7f57d1000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c4047540 con 0x7f57c404b310 2024-03-23T23:46:42.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.810+0000 7f57cb400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f57c40dbd50 0x7f57c403e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:42.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.810+0000 7f57cb400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f57c40dbd50 0x7f57c403e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57396/0 (socket says 172.21.15.8:57396) 2024-03-23T23:46:42.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.810+0000 7f57cb400640 1 -- 172.21.15.8:0/2145327890 learned_addr learned my addr 172.21.15.8:0/2145327890 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:46:42.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.814+0000 7f57caa00640 1 --2- 172.21.15.8:0/2145327890 >> v2:172.21.15.196:3300/0 conn(0x7f57c404b310 0x7f57c4006df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:42.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.814+0000 7f57cb400640 1 -- 172.21.15.8:0/2145327890 >> v2:172.21.15.196:3300/0 conn(0x7f57c404b310 msgr2=0x7f57c4006df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:46:42.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.814+0000 7f57cb400640 1 --2- 172.21.15.8:0/2145327890 >> v2:172.21.15.196:3300/0 conn(0x7f57c404b310 0x7f57c4006df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:42.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.814+0000 7f57cb400640 1 -- 172.21.15.8:0/2145327890 >> v1:172.21.15.8:6789/0 conn(0x7f57c403ecf0 legacy=0x7f57c40496e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:46:42.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.814+0000 7f57cb400640 1 -- 172.21.15.8:0/2145327890 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c4047820 con 0x7f57c40dbd50 2024-03-23T23:46:42.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.838+0000 7f57cb400640 1 --2- 172.21.15.8:0/2145327890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57c40dbd50 0x7f57c403e7b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f57cc075bc0 tx=0x7f57cc098370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc908e0e7a81231 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:42.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.846+0000 7f57ca000640 1 -- 172.21.15.8:0/2145327890 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc12c070 con 0x7f57c40dbd50 2024-03-23T23:46:42.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.846+0000 7f57ca000640 1 -- 172.21.15.8:0/2145327890 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57cc127640 con 0x7f57c40dbd50 2024-03-23T23:46:42.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.846+0000 7f57ca000640 1 -- 172.21.15.8:0/2145327890 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc127ab0 con 0x7f57c40dbd50 2024-03-23T23:46:42.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.854+0000 7f57d1000640 1 -- 172.21.15.8:0/2145327890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57c40dbd50 msgr2=0x7f57c403e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:42.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.854+0000 7f57d1000640 1 --2- 172.21.15.8:0/2145327890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57c40dbd50 0x7f57c403e7b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f57cc075bc0 tx=0x7f57cc098370 comp rx=0 tx=0).stop 2024-03-23T23:46:42.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.862+0000 7f57d1000640 1 -- 172.21.15.8:0/2145327890 shutdown_connections 2024-03-23T23:46:42.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.862+0000 7f57d1000640 1 --2- 172.21.15.8:0/2145327890 >> v2:172.21.15.196:3300/0 conn(0x7f57c404b310 0x7f57c4006df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:42.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.862+0000 7f57d1000640 1 --2- 172.21.15.8:0/2145327890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57c40dbd50 0x7f57c403e7b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:42.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.862+0000 7f57d1000640 1 -- 172.21.15.8:0/2145327890 >> 172.21.15.8:0/2145327890 conn(0x7f57c4005ef0 msgr2=0x7f57c4006300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:46:42.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.870+0000 7f57d1000640 1 -- 172.21.15.8:0/2145327890 shutdown_connections 2024-03-23T23:46:42.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.870+0000 7f57d1000640 1 -- 172.21.15.8:0/2145327890 wait complete. 2024-03-23T23:46:42.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.870+0000 7f57d1000640 1 Processor -- start 2024-03-23T23:46:42.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.882+0000 7f57d1000640 1 -- start start 2024-03-23T23:46:42.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.886+0000 7f57d1000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57c403ecf0 0x7f57c40d3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:42.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.886+0000 7f57d1000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57c404b310 0x7f57c40ddf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:42.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.886+0000 7f57d1000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57c40dbd50 0x7f57c417aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:42.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.886+0000 7f57cb400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57c403ecf0 0x7f57c40d3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:42.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.886+0000 7f57cb400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57c403ecf0 0x7f57c40d3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:58630/0 (socket says 172.21.15.8:58630) 2024-03-23T23:46:42.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.886+0000 7f57caa00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57c404b310 0x7f57c40ddf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:42.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.886+0000 7f57cb400640 1 -- 172.21.15.8:0/4206848087 learned_addr learned my addr 172.21.15.8:0/4206848087 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:46:42.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.886+0000 7f57d1000640 1 -- 172.21.15.8:0/4206848087 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c40dc130 con 0x7f57c40dbd50 2024-03-23T23:46:42.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.886+0000 7f57d1000640 1 -- 172.21.15.8:0/4206848087 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c40dc450 con 0x7f57c403ecf0 2024-03-23T23:46:42.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.886+0000 7f57d1000640 1 -- 172.21.15.8:0/4206848087 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c40dc2b0 con 0x7f57c404b310 2024-03-23T23:46:42.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.886+0000 7f57cb400640 1 -- 172.21.15.8:0/4206848087 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57c404b310 msgr2=0x7f57c40ddf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:42.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.886+0000 7f57cb400640 1 --2- 172.21.15.8:0/4206848087 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57c404b310 0x7f57c40ddf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:42.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.886+0000 7f57cb400640 1 -- 172.21.15.8:0/4206848087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57c40dbd50 msgr2=0x7f57c417aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:42.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.886+0000 7f57cb400640 1 --2- 172.21.15.8:0/4206848087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57c40dbd50 0x7f57c417aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:42.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.886+0000 7f57cb400640 1 -- 172.21.15.8:0/4206848087 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c40e2020 con 0x7f57c403ecf0 2024-03-23T23:46:42.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.886+0000 7f57caa00640 1 --2- 172.21.15.8:0/4206848087 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57c404b310 0x7f57c40ddf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:46:42.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.890+0000 7f57cb400640 1 --2- 172.21.15.8:0/4206848087 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57c403ecf0 0x7f57c40d3620 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f57cc050720 tx=0x7f57cc095210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:42.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.890+0000 7f57bf400640 1 -- 172.21.15.8:0/4206848087 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc137020 con 0x7f57c403ecf0 2024-03-23T23:46:42.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.890+0000 7f57d1000640 1 -- 172.21.15.8:0/4206848087 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c4178070 con 0x7f57c403ecf0 2024-03-23T23:46:42.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.890+0000 7f57d1000640 1 -- 172.21.15.8:0/4206848087 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c40e1d40 con 0x7f57c403ecf0 2024-03-23T23:46:42.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.890+0000 7f57bf400640 1 -- 172.21.15.8:0/4206848087 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57cc12d040 con 0x7f57c403ecf0 2024-03-23T23:46:42.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.890+0000 7f57bf400640 1 -- 172.21.15.8:0/4206848087 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc137020 con 0x7f57c403ecf0 2024-03-23T23:46:42.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.894+0000 7f57bf400640 1 -- 172.21.15.8:0/4206848087 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f57cc13a020 con 0x7f57c403ecf0 2024-03-23T23:46:42.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.894+0000 7f57bf400640 1 --2- 172.21.15.8:0/4206848087 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f57ac067860 0x7f57ac069d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:42.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.894+0000 7f57bf400640 1 -- 172.21.15.8:0/4206848087 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f57cc169f70 con 0x7f57c403ecf0 2024-03-23T23:46:42.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.898+0000 7f57bcc00640 1 --2- 172.21.15.8:0/4206848087 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57a8002a80 0x7f57a8004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:42.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.898+0000 7f57bcc00640 1 -- 172.21.15.8:0/4206848087 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a8007ed0 con 0x7f57a8002a80 2024-03-23T23:46:42.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.902+0000 7f57cbe00640 1 --2- 172.21.15.8:0/4206848087 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57a8002a80 0x7f57a8004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:42.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.902+0000 7f57cbe00640 1 -- 172.21.15.8:0/4206848087 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f57a80080d0 con 0x7f57a8002a80 2024-03-23T23:46:42.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.906+0000 7f57caa00640 1 --2- 172.21.15.8:0/4206848087 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f57ac067860 0x7f57ac069d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:42.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.906+0000 7f57cbe00640 1 --2- 172.21.15.8:0/4206848087 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57a8002a80 0x7f57a8004f40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f57c000c310 tx=0x7f57c000c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:42.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.906+0000 7f57bf400640 1 -- 172.21.15.8:0/4206848087 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c0007020 con 0x7f57a8002a80 2024-03-23T23:46:42.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.906+0000 7f57bf400640 1 -- 172.21.15.8:0/4206848087 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f57c00071c0 con 0x7f57a8002a80 2024-03-23T23:46:42.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.906+0000 7f57bf400640 1 -- 172.21.15.8:0/4206848087 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57a8002a80 msgr2=0x7f57a8004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:42.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.910+0000 7f57bf400640 1 --2- 172.21.15.8:0/4206848087 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57a8002a80 0x7f57a8004f40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f57c000c310 tx=0x7f57c000c7d0 comp rx=0 tx=0).stop 2024-03-23T23:46:42.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.910+0000 7f57bf400640 1 -- 172.21.15.8:0/4206848087 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57a8002a80 msgr2=0x7f57a8004f40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:46:42.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.910+0000 7f57bf400640 1 --2- 172.21.15.8:0/4206848087 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57a8002a80 0x7f57a8004f40 secure :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f57c000c310 tx=0x7f57c000c7d0 comp rx=0 tx=0).stop 2024-03-23T23:46:42.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.910+0000 7f57caa00640 1 --2- 172.21.15.8:0/4206848087 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f57ac067860 0x7f57ac069d20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f57c402bf60 tx=0x7f57b8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:42.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.934+0000 7f57bcc00640 1 --2- 172.21.15.8:0/4206848087 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57a8006ef0 0x7f57a8007380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:42.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.942+0000 7f57bcc00640 1 -- 172.21.15.8:0/4206848087 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a800a4b0 con 0x7f57a8006ef0 2024-03-23T23:46:42.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.942+0000 7f57cbe00640 1 --2- 172.21.15.8:0/4206848087 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57a8006ef0 0x7f57a8007380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:42.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.946+0000 7f57cbe00640 1 -- 172.21.15.8:0/4206848087 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f57a80078c0 con 0x7f57a8006ef0 2024-03-23T23:46:42.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.946+0000 7f57cbe00640 1 --2- 172.21.15.8:0/4206848087 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57a8006ef0 0x7f57a8007380 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f57c000cfd0 tx=0x7f57c0001030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:42.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.950+0000 7f57bf400640 1 -- 172.21.15.8:0/4206848087 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c0019670 con 0x7f57a8006ef0 2024-03-23T23:46:42.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.950+0000 7f57bf400640 1 -- 172.21.15.8:0/4206848087 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5183 (secure 0 0 0) 0x7f57c0019810 con 0x7f57a8006ef0 2024-03-23T23:46:42.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.950+0000 7f57bf400640 1 -- 172.21.15.8:0/4206848087 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57a8006ef0 msgr2=0x7f57a8007380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:42.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.950+0000 7f57bf400640 1 --2- 172.21.15.8:0/4206848087 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57a8006ef0 0x7f57a8007380 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f57c000cfd0 tx=0x7f57c0001030 comp rx=0 tx=0).stop 2024-03-23T23:46:42.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.950+0000 7f57bf400640 1 -- 172.21.15.8:0/4206848087 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57a8006ef0 msgr2=0x7f57a8007380 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:46:42.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.950+0000 7f57bf400640 1 --2- 172.21.15.8:0/4206848087 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57a8006ef0 0x7f57a8007380 secure :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f57c000cfd0 tx=0x7f57c0001030 comp rx=0 tx=0).stop 2024-03-23T23:46:42.953 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:46:42.953 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:46:42.953 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:46:42.953 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:46:42.953 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 28, 2024-03-23T23:46:42.953 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:46:42.953 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:46:42.953 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:46:42.953 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:46:42.953 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:42.954 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 17, 2024-03-23T23:46:42.954 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:46:42.954 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:46:42.954 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:46:42.954 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:46:42.954 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:46:42.954 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:46:42.954 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:46:42.954 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:46:42.954 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:46:42.954 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:46:42.954 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:46:42.955 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:46:42.955 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:46:42.955 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:46:42.955 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:42.955 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:46:42.955 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:46:42.955 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:46:42.955 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:46:42.955 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:46:42.955 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:46:42.955 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:46:42.955 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:46:42.955 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:46:42.955 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:46:42.956 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:46:42.956 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:46:42.956 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:46:42.956 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:42.956 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:42.956 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:46:42.956 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:46:42.956 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:46:42.956 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:46:42.956 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:46:42.956 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:46:42.956 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:46:42.956 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:46:42.957 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:46:42.957 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:46:42.957 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:46:42.957 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:46:42.957 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:46:42.957 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:46:42.957 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:46:42.957 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:46:42.957 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:46:42.957 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:46:42.957 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:46:42.957 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:46:42.957 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:46:42.957 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:46:42.958 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:46:42.958 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:46:42.958 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:46:42.958 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:46:42.958 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:46:42.958 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:46:42.958 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:42.958 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:46:42.958 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:42.958 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:46:42.958 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:42.958 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:46:42.959 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:46:42.959 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:46:42.959 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:46:42.959 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:42.959 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:46:42.959 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:46:42.959 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:42.959 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:42.959 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:42.959 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:46:42.959 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:46:42.959 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:42.959 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:42.960 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:42.960 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:42.960 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:46:42.960 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:46:42.960 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:46:42.960 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:46:42.960 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:46:42.960 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:42.960 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:42.960 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:46:42.960 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:46:42.960 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:46:42.960 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:46:42.960 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:42.961 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:46:42.961 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:46:42.961 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:42.961 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:42.961 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:42.961 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:46:42.961 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:46:42.961 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:42.961 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:42.961 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:42.961 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:42.962 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:46:42.962 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:46:42.962 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:46:42.962 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:46:42.962 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:46:42.962 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:42.962 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:42.962 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:46:42.962 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:46:42.962 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:46:42.962 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:46:42.962 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:42.963 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:46:42.963 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:46:42.963 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:42.963 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:42.963 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:42.963 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:46:42.963 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:46:42.963 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:42.963 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:42.963 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:42.963 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:42.964 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:46:42.964 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:46:42.964 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:46:42.964 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:46:42.964 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:46:42.964 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:42.964 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:42.964 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:42.964 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:46:42.964 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:46:42.964 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:42.964 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:46:42.964 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:46:42.965 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:46:42.965 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:42.965 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:42.965 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:46:42.965 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:42.965 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:46:42.965 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:46:42.965 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:46:42.965 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:42.965 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:42.965 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:46:42.965 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:42.966 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:46:42.966 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:46:42.966 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 8 2024-03-23T23:46:42.966 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:42.966 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:42.966 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:46:42.966 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:42.966 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:46:42.966 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:46:42.966 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:46:42.966 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:42.966 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:42.966 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:46:42.967 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:46:42.967 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5 2024-03-23T23:46:42.967 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:42.967 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:42.967 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:46:42.967 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:42.967 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:46:42.967 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:46:42.967 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:46:42.967 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:42.967 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:42.967 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:42.967 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:46:42.967 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:46:42.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.958+0000 7f57bcc00640 1 -- 172.21.15.8:0/4206848087 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f57ac067860 msgr2=0x7f57ac069d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:42.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.958+0000 7f57bcc00640 1 --2- 172.21.15.8:0/4206848087 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f57ac067860 0x7f57ac069d20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f57c402bf60 tx=0x7f57b8008040 comp rx=0 tx=0).stop 2024-03-23T23:46:42.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.958+0000 7f57bcc00640 1 -- 172.21.15.8:0/4206848087 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57c403ecf0 msgr2=0x7f57c40d3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:42.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.958+0000 7f57bcc00640 1 --2- 172.21.15.8:0/4206848087 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57c403ecf0 0x7f57c40d3620 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f57cc050720 tx=0x7f57cc095210 comp rx=0 tx=0).stop 2024-03-23T23:46:42.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.958+0000 7f57cbe00640 1 -- 172.21.15.8:0/4206848087 reap_dead start 2024-03-23T23:46:42.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.966+0000 7f57bcc00640 1 -- 172.21.15.8:0/4206848087 shutdown_connections 2024-03-23T23:46:42.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.966+0000 7f57bcc00640 1 -- 172.21.15.8:0/4206848087 >> 172.21.15.8:0/4206848087 conn(0x7f57c4005ef0 msgr2=0x7f57c404a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:46:42.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.970+0000 7f57bcc00640 1 -- 172.21.15.8:0/4206848087 shutdown_connections 2024-03-23T23:46:42.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:42.970+0000 7f57bcc00640 1 -- 172.21.15.8:0/4206848087 wait complete. 2024-03-23T23:46:43.026 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:46:43.026 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-03-23T23:46:43.026 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-03-23T23:46:43.026 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-03-23T23:46:43.026 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-03-23T23:46:43.026 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-23T23:46:43.026 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:46:43.078 INFO:tasks.ceph.mon.a:Stopped 2024-03-23T23:46:43.078 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-03-23T23:46:43.078 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:46:43.086 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:46:43.128 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:46:43.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.442+0000 7f4bdb000640 1 Processor -- start 2024-03-23T23:46:43.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.442+0000 7f4bdb000640 1 -- start start 2024-03-23T23:46:43.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.450+0000 7f4bdb000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4bd4153630 0x7f4bd4157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:43.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.450+0000 7f4bdb000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4bd40c3ab0 0x7f4bd406ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:43.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.450+0000 7f4bd3e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f4bd40c36d0 0x7f4bd406e630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:58328/0 (socket says 172.21.15.8:58328) 2024-03-23T23:46:43.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.450+0000 7f4bd9000640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f4bd40c3ab0 msgr2=0x7f4bd406ed40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:46:43.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.450+0000 7f4bd9000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4bd40c3ab0 0x7f4bd406ed40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:46:43.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.450+0000 7f4bd3400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4bd4153630 0x7f4bd4157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:43.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.450+0000 7f4bd3400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4bd4153630 0x7f4bd4157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:58640/0 (socket says 172.21.15.8:58640) 2024-03-23T23:46:43.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.450+0000 7f4bd3e00640 1 -- 172.21.15.8:0/550797311 learned_addr learned my addr 172.21.15.8:0/550797311 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:46:43.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.450+0000 7f4bdb000640 1 -- 172.21.15.8:0/550797311 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bd4153bb0 con 0x7f4bd40c36d0 2024-03-23T23:46:43.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.450+0000 7f4bdb000640 1 -- 172.21.15.8:0/550797311 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd40c3f40 con 0x7f4bd40c3ab0 2024-03-23T23:46:43.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.450+0000 7f4bdb000640 1 -- 172.21.15.8:0/550797311 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd4153e70 con 0x7f4bd4153630 2024-03-23T23:46:43.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.450+0000 7f4bd2a00640 1 -- 172.21.15.8:0/550797311 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 206452909 0 0) 0x7f4bd4153bb0 con 0x7f4bd40c36d0 2024-03-23T23:46:43.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.450+0000 7f4bd2a00640 1 -- 172.21.15.8:0/550797311 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bb8003530 con 0x7f4bd40c36d0 2024-03-23T23:46:43.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.450+0000 7f4bd3400640 1 -- 172.21.15.8:0/550797311 >> v2:172.21.15.8:3300/0 conn(0x7f4bd40c3ab0 msgr2=0x7f4bd406ed40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:46:43.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.450+0000 7f4bd3400640 1 --2- 172.21.15.8:0/550797311 >> v2:172.21.15.8:3300/0 conn(0x7f4bd40c3ab0 0x7f4bd406ed40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:43.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.450+0000 7f4bd3400640 1 -- 172.21.15.8:0/550797311 >> v1:172.21.15.196:6789/0 conn(0x7f4bd40c36d0 legacy=0x7f4bd406e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:43.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.450+0000 7f4bd3400640 1 -- 172.21.15.8:0/550797311 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd4154150 con 0x7f4bd4153630 2024-03-23T23:46:43.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.458+0000 7f4bd3400640 1 --2- 172.21.15.8:0/550797311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4bd4153630 0x7f4bd4157770 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00097c0 tx=0x7f4bc001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89a5d34aa5108bc5 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:43.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.462+0000 7f4bd2a00640 1 -- 172.21.15.8:0/550797311 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc00b1070 con 0x7f4bd4153630 2024-03-23T23:46:43.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.462+0000 7f4bd2a00640 1 -- 172.21.15.8:0/550797311 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc00ac620 con 0x7f4bd4153630 2024-03-23T23:46:43.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.462+0000 7f4bd2a00640 1 -- 172.21.15.8:0/550797311 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc00ac9f0 con 0x7f4bd4153630 2024-03-23T23:46:43.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.466+0000 7f4bdb000640 1 -- 172.21.15.8:0/550797311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4bd4153630 msgr2=0x7f4bd4157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:43.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.466+0000 7f4bdb000640 1 --2- 172.21.15.8:0/550797311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4bd4153630 0x7f4bd4157770 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00097c0 tx=0x7f4bc001c3c0 comp rx=0 tx=0).stop 2024-03-23T23:46:43.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.466+0000 7f4bdb000640 1 -- 172.21.15.8:0/550797311 shutdown_connections 2024-03-23T23:46:43.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.466+0000 7f4bdb000640 1 --2- 172.21.15.8:0/550797311 >> v2:172.21.15.8:3300/0 conn(0x7f4bd40c3ab0 0x7f4bd406ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:43.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.466+0000 7f4bdb000640 1 --2- 172.21.15.8:0/550797311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4bd4153630 0x7f4bd4157770 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:43.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.466+0000 7f4bdb000640 1 -- 172.21.15.8:0/550797311 >> 172.21.15.8:0/550797311 conn(0x7f4bd406b170 msgr2=0x7f4bd406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:46:43.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.470+0000 7f4bdb000640 1 -- 172.21.15.8:0/550797311 shutdown_connections 2024-03-23T23:46:43.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.470+0000 7f4bdb000640 1 -- 172.21.15.8:0/550797311 wait complete. 2024-03-23T23:46:43.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.470+0000 7f4bdb000640 1 Processor -- start 2024-03-23T23:46:43.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.474+0000 7f4bdb000640 1 -- start start 2024-03-23T23:46:43.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.474+0000 7f4bdb000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bd40c36d0 0x7f4bd41f2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:43.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.474+0000 7f4bdb000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4bd40c3ab0 0x7f4bd4071110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:43.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.474+0000 7f4bdb000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4bd4153630 0x7f4bd41ef7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:43.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.474+0000 7f4bdb000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd40c4410 con 0x7f4bd40c36d0 2024-03-23T23:46:43.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.474+0000 7f4bdb000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd40c4290 con 0x7f4bd40c3ab0 2024-03-23T23:46:43.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.474+0000 7f4bdb000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd4150f20 con 0x7f4bd4153630 2024-03-23T23:46:43.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.474+0000 7f4bd3e00640 1 -- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bd40c36d0 msgr2=0x7f4bd41f2f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:46:43.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.474+0000 7f4bd3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bd40c36d0 0x7f4bd41f2f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:46:43.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.474+0000 7f4bd9000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4bd4153630 0x7f4bd41ef7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:43.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.474+0000 7f4bd9000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4bd4153630 0x7f4bd41ef7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:50140/0 (socket says 172.21.15.8:50140) 2024-03-23T23:46:43.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.474+0000 7f4bd9000640 1 -- 172.21.15.8:0/233390646 learned_addr learned my addr 172.21.15.8:0/233390646 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:46:43.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.474+0000 7f4bd9000640 1 -- 172.21.15.8:0/233390646 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4bd40c3ab0 msgr2=0x7f4bd4071110 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-23T23:46:43.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.474+0000 7f4bd9000640 1 --2- 172.21.15.8:0/233390646 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4bd40c3ab0 0x7f4bd4071110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:43.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.474+0000 7f4bd9000640 1 -- 172.21.15.8:0/233390646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bd40c36d0 msgr2=0x7f4bd41f2f60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:46:43.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.474+0000 7f4bd9000640 1 --2- 172.21.15.8:0/233390646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bd40c36d0 0x7f4bd41f2f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:43.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.474+0000 7f4bd9000640 1 -- 172.21.15.8:0/233390646 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd414d0f0 con 0x7f4bd4153630 2024-03-23T23:46:43.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.490+0000 7f4bd9000640 1 --2- 172.21.15.8:0/233390646 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4bd4153630 0x7f4bd41ef7b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc00b410 tx=0x7f4bcc00b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:43.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.490+0000 7f4bcbe00640 1 -- 172.21.15.8:0/233390646 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc017070 con 0x7f4bd4153630 2024-03-23T23:46:43.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.490+0000 7f4bcbe00640 1 -- 172.21.15.8:0/233390646 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bcc003df0 con 0x7f4bd4153630 2024-03-23T23:46:43.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.490+0000 7f4bcbe00640 1 -- 172.21.15.8:0/233390646 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc0062f0 con 0x7f4bd4153630 2024-03-23T23:46:43.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.490+0000 7f4bdb000640 1 -- 172.21.15.8:0/233390646 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd41f24a0 con 0x7f4bd4153630 2024-03-23T23:46:43.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.490+0000 7f4bdb000640 1 -- 172.21.15.8:0/233390646 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd41f2760 con 0x7f4bd4153630 2024-03-23T23:46:43.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.494+0000 7f4bcbe00640 1 -- 172.21.15.8:0/233390646 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f4bcc006490 con 0x7f4bd4153630 2024-03-23T23:46:43.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.494+0000 7f4bcbe00640 1 --2- 172.21.15.8:0/233390646 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4bb4067640 0x7f4bb4069b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:43.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.494+0000 7f4bcbe00640 1 -- 172.21.15.8:0/233390646 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f4bcc084d30 con 0x7f4bd4153630 2024-03-23T23:46:43.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.498+0000 7f4bdb000640 1 -- 172.21.15.8:0/233390646 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bac0052a0 con 0x7f4bd4153630 2024-03-23T23:46:43.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.498+0000 7f4bd3e00640 1 --2- 172.21.15.8:0/233390646 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4bb4067640 0x7f4bb4069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:43.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.510+0000 7f4bd3e00640 1 --2- 172.21.15.8:0/233390646 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4bb4067640 0x7f4bb4069b00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4000f90 tx=0x7f4bc4001780 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:43.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:43.514+0000 7f4bcbe00640 1 -- 172.21.15.8:0/233390646 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f4bcc055550 con 0x7f4bd4153630 2024-03-23T23:46:44.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:44.242+0000 7f4bdb000640 1 -- 172.21.15.8:0/233390646 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f4bac005590 con 0x7f4bd4153630 2024-03-23T23:46:44.248 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:46:44.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:44.246+0000 7f4bcbe00640 1 -- 172.21.15.8:0/233390646 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1561 (secure 0 0 0) 0x7f4bcc054e50 con 0x7f4bd4153630 2024-03-23T23:46:44.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:44.254+0000 7f4bdb000640 1 -- 172.21.15.8:0/233390646 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4bb4067640 msgr2=0x7f4bb4069b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:44.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:44.254+0000 7f4bdb000640 1 --2- 172.21.15.8:0/233390646 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4bb4067640 0x7f4bb4069b00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4000f90 tx=0x7f4bc4001780 comp rx=0 tx=0).stop 2024-03-23T23:46:44.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:44.254+0000 7f4bdb000640 1 -- 172.21.15.8:0/233390646 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4bd4153630 msgr2=0x7f4bd41ef7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:44.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:44.254+0000 7f4bdb000640 1 --2- 172.21.15.8:0/233390646 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4bd4153630 0x7f4bd41ef7b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc00b410 tx=0x7f4bcc00b8d0 comp rx=0 tx=0).stop 2024-03-23T23:46:44.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:44.258+0000 7f4bdb000640 1 -- 172.21.15.8:0/233390646 shutdown_connections 2024-03-23T23:46:44.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:44.258+0000 7f4bdb000640 1 --2- 172.21.15.8:0/233390646 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4bb4067640 0x7f4bb4069b00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:44.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:44.258+0000 7f4bdb000640 1 --2- 172.21.15.8:0/233390646 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4bd4153630 0x7f4bd41ef7b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:44.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:44.258+0000 7f4bdb000640 1 --2- 172.21.15.8:0/233390646 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4bd40c3ab0 0x7f4bd4071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:44.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:44.258+0000 7f4bdb000640 1 --2- 172.21.15.8:0/233390646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bd40c36d0 0x7f4bd41f2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:44.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:44.258+0000 7f4bdb000640 1 -- 172.21.15.8:0/233390646 >> 172.21.15.8:0/233390646 conn(0x7f4bd406b170 msgr2=0x7f4bd40c1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:46:44.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:44.258+0000 7f4bdb000640 1 -- 172.21.15.8:0/233390646 shutdown_connections 2024-03-23T23:46:44.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:44.258+0000 7f4bdb000640 1 -- 172.21.15.8:0/233390646 wait complete. 2024-03-23T23:46:47.322 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:46:47.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:47.702+0000 7f9eb7200640 1 Processor -- start 2024-03-23T23:46:47.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:47.702+0000 7f9eb7200640 1 -- start start 2024-03-23T23:46:47.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:47.706+0000 7f9eb7200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9eb004db10 0x7f9eb000e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:47.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:47.706+0000 7f9eb7200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eb00dae60 con 0x7f9eb00d7b00 2024-03-23T23:46:47.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:47.706+0000 7f9eb7200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eb00db140 con 0x7f9eb00432a0 2024-03-23T23:46:47.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:47.706+0000 7f9eb7200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eb004abe0 con 0x7f9eb004db10 2024-03-23T23:46:47.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:47.706+0000 7f9eb5e00640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f9eb00d7b00 legacy=0x7f9eb0007230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:46:47.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:47.710+0000 7f9eb6800640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f9eb00432a0 0x7f9eb000e720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:58340/0 (socket says 172.21.15.8:58340) 2024-03-23T23:46:47.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:47.710+0000 7f9eb6800640 1 -- 172.21.15.8:0/434823833 learned_addr learned my addr 172.21.15.8:0/434823833 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:46:47.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:47.714+0000 7f9eb5400640 1 -- 172.21.15.8:0/434823833 >> v2:172.21.15.8:3300/0 conn(0x7f9eb004db10 msgr2=0x7f9eb000e1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:46:47.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:47.714+0000 7f9eb5400640 1 --2- 172.21.15.8:0/434823833 >> v2:172.21.15.8:3300/0 conn(0x7f9eb004db10 0x7f9eb000e1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:46:47.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:47.914+0000 7f9eb5e00640 1 -- 172.21.15.8:0/434823833 >> v1:172.21.15.8:6789/0 conn(0x7f9eb00d7b00 legacy=0x7f9eb0007230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:46:47.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:47.922+0000 7f9eb5400640 1 -- 172.21.15.8:0/434823833 >> v2:172.21.15.8:3300/0 conn(0x7f9eb004db10 msgr2=0x7f9eb000e1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:46:47.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:47.922+0000 7f9eb5400640 1 --2- 172.21.15.8:0/434823833 >> v2:172.21.15.8:3300/0 conn(0x7f9eb004db10 0x7f9eb000e1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:46:48.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:48.322+0000 7f9eb5e00640 1 -- 172.21.15.8:0/434823833 >> v1:172.21.15.8:6789/0 conn(0x7f9eb00d7b00 legacy=0x7f9eb0007230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:46:48.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:48.326+0000 7f9eb5400640 1 -- 172.21.15.8:0/434823833 >> v2:172.21.15.8:3300/0 conn(0x7f9eb004db10 msgr2=0x7f9eb000e1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:46:48.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:48.326+0000 7f9eb5400640 1 --2- 172.21.15.8:0/434823833 >> v2:172.21.15.8:3300/0 conn(0x7f9eb004db10 0x7f9eb000e1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:46:49.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:49.130+0000 7f9eb5400640 1 -- 172.21.15.8:0/434823833 >> v2:172.21.15.8:3300/0 conn(0x7f9eb004db10 msgr2=0x7f9eb000e1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:46:49.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:49.130+0000 7f9eb5400640 1 --2- 172.21.15.8:0/434823833 >> v2:172.21.15.8:3300/0 conn(0x7f9eb004db10 0x7f9eb000e1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:46:49.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:49.130+0000 7f9eb5e00640 1 -- 172.21.15.8:0/434823833 >> v1:172.21.15.8:6789/0 conn(0x7f9eb00d7b00 legacy=0x7f9eb0007230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:46:50.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.710+0000 7f9eaf400640 1 -- 172.21.15.8:0/434823833 >> v2:172.21.15.8:3300/0 conn(0x7f9eb004db10 msgr2=0x7f9eb000e1e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:46:50.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.710+0000 7f9eaf400640 1 --2- 172.21.15.8:0/434823833 >> v2:172.21.15.8:3300/0 conn(0x7f9eb004db10 0x7f9eb000e1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:50.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.710+0000 7f9eaf400640 1 -- 172.21.15.8:0/434823833 >> v1:172.21.15.196:6789/0 conn(0x7f9eb00432a0 legacy=0x7f9eb000e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:50.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.710+0000 7f9eaf400640 1 -- 172.21.15.8:0/434823833 >> v1:172.21.15.8:6789/0 conn(0x7f9eb00d7b00 legacy=0x7f9eb0007230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:46:50.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.710+0000 7f9eaf400640 1 --2- 172.21.15.8:0/434823833 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e980036d0 0x7f9e98005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:50.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.710+0000 7f9eaf400640 1 --2- 172.21.15.8:0/434823833 >> v2:172.21.15.196:3300/0 conn(0x7f9e980061b0 0x7f9e98008670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:50.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.710+0000 7f9eaf400640 1 -- 172.21.15.8:0/434823833 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eb004abe0 con 0x7f9e980061b0 2024-03-23T23:46:50.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.710+0000 7f9eaf400640 1 -- 172.21.15.8:0/434823833 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e98008d20 con 0x7f9e980036d0 2024-03-23T23:46:50.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.714+0000 7f9eb5e00640 1 --2- 172.21.15.8:0/434823833 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e980036d0 0x7f9e98005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:50.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.714+0000 7f9eb5e00640 1 -- 172.21.15.8:0/434823833 >> v2:172.21.15.196:3300/0 conn(0x7f9e980061b0 msgr2=0x7f9e98008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:46:50.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.714+0000 7f9eb5400640 1 --2- 172.21.15.8:0/434823833 >> v2:172.21.15.196:3300/0 conn(0x7f9e980061b0 0x7f9e98008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:50.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.714+0000 7f9eb5e00640 1 --2- 172.21.15.8:0/434823833 >> v2:172.21.15.196:3300/0 conn(0x7f9e980061b0 0x7f9e98008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:50.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.714+0000 7f9eb5e00640 1 -- 172.21.15.8:0/434823833 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb004a590 con 0x7f9e980036d0 2024-03-23T23:46:50.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.714+0000 7f9eb5400640 1 --2- 172.21.15.8:0/434823833 >> v2:172.21.15.196:3300/0 conn(0x7f9e980061b0 0x7f9e98008670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:46:50.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.730+0000 7f9eb5e00640 1 --2- 172.21.15.8:0/434823833 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e980036d0 0x7f9e98005b20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9eb804f930 tx=0x7f9eb8098540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0b6bacbd66bc98c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:50.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.730+0000 7f9eb4a00640 1 -- 172.21.15.8:0/434823833 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb806c050 con 0x7f9e980036d0 2024-03-23T23:46:50.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.734+0000 7f9eb4a00640 1 -- 172.21.15.8:0/434823833 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb8126420 con 0x7f9e980036d0 2024-03-23T23:46:50.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.734+0000 7f9eb4a00640 1 -- 172.21.15.8:0/434823833 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb806c050 con 0x7f9e980036d0 2024-03-23T23:46:50.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.738+0000 7f9eb7200640 1 -- 172.21.15.8:0/434823833 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e980036d0 msgr2=0x7f9e98005b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:50.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.738+0000 7f9eb7200640 1 --2- 172.21.15.8:0/434823833 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e980036d0 0x7f9e98005b20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9eb804f930 tx=0x7f9eb8098540 comp rx=0 tx=0).stop 2024-03-23T23:46:50.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.738+0000 7f9eb6800640 1 -- 172.21.15.8:0/434823833 reap_dead start 2024-03-23T23:46:50.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.742+0000 7f9eb7200640 1 -- 172.21.15.8:0/434823833 shutdown_connections 2024-03-23T23:46:50.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.742+0000 7f9eb7200640 1 -- 172.21.15.8:0/434823833 >> 172.21.15.8:0/434823833 conn(0x7f9eb004c690 msgr2=0x7f9eb004caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:46:50.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.742+0000 7f9eb7200640 1 -- 172.21.15.8:0/434823833 shutdown_connections 2024-03-23T23:46:50.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.742+0000 7f9eb7200640 1 -- 172.21.15.8:0/434823833 wait complete. 2024-03-23T23:46:50.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.746+0000 7f9eb7200640 1 Processor -- start 2024-03-23T23:46:50.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.750+0000 7f9eb7200640 1 -- start start 2024-03-23T23:46:50.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.754+0000 7f9eb7200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e980036d0 0x7f9eb00db630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:50.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.754+0000 7f9eb7200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9eb0046260 0x7f9eb017cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:50.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.754+0000 7f9eb7200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9eb0045a00 0x7f9eb00449f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:50.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.754+0000 7f9eb7200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb000fcd0 con 0x7f9eb0045a00 2024-03-23T23:46:50.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.754+0000 7f9eb7200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb000ee30 con 0x7f9eb0046260 2024-03-23T23:46:50.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.754+0000 7f9eb7200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb0007940 con 0x7f9e980036d0 2024-03-23T23:46:50.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.754+0000 7f9eb6800640 1 -- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9eb0045a00 msgr2=0x7f9eb00449f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:46:50.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.754+0000 7f9eb6800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9eb0045a00 0x7f9eb00449f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:46:50.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.754+0000 7f9eb5400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9eb0046260 0x7f9eb017cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:50.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.754+0000 7f9eb5400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9eb0046260 0x7f9eb017cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:58654/0 (socket says 172.21.15.8:58654) 2024-03-23T23:46:50.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.754+0000 7f9eb5400640 1 -- 172.21.15.8:0/1881176575 learned_addr learned my addr 172.21.15.8:0/1881176575 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:46:50.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.758+0000 7f9eb5e00640 1 --2- 172.21.15.8:0/1881176575 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e980036d0 0x7f9eb00db630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:50.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.762+0000 7f9eb5e00640 1 -- 172.21.15.8:0/1881176575 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9eb0046260 msgr2=0x7f9eb017cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:50.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.762+0000 7f9eb5e00640 1 --2- 172.21.15.8:0/1881176575 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9eb0046260 0x7f9eb017cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:50.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.762+0000 7f9eb5e00640 1 -- 172.21.15.8:0/1881176575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9eb0045a00 msgr2=0x7f9eb00449f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:46:50.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.762+0000 7f9eb5e00640 1 --2- 172.21.15.8:0/1881176575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9eb0045a00 0x7f9eb00449f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:50.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.762+0000 7f9eb5e00640 1 -- 172.21.15.8:0/1881176575 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb017d460 con 0x7f9e980036d0 2024-03-23T23:46:50.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.766+0000 7f9eb5e00640 1 --2- 172.21.15.8:0/1881176575 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e980036d0 0x7f9eb00db630 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9eb802d610 tx=0x7f9eb80953e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:50.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.766+0000 7f9eae000640 1 -- 172.21.15.8:0/1881176575 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb806c040 con 0x7f9e980036d0 2024-03-23T23:46:50.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.766+0000 7f9eae000640 1 -- 172.21.15.8:0/1881176575 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb81313f0 con 0x7f9e980036d0 2024-03-23T23:46:50.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.766+0000 7f9eae000640 1 -- 172.21.15.8:0/1881176575 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb81317a0 con 0x7f9e980036d0 2024-03-23T23:46:50.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.770+0000 7f9eb7200640 1 -- 172.21.15.8:0/1881176575 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eb0043950 con 0x7f9e980036d0 2024-03-23T23:46:50.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.770+0000 7f9eb7200640 1 -- 172.21.15.8:0/1881176575 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eb0043f10 con 0x7f9e980036d0 2024-03-23T23:46:50.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.778+0000 7f9ea3400640 1 -- 172.21.15.8:0/1881176575 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eb00052d0 con 0x7f9e980036d0 2024-03-23T23:46:50.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.786+0000 7f9eae000640 1 -- 172.21.15.8:0/1881176575 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f9eb8131940 con 0x7f9e980036d0 2024-03-23T23:46:50.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.790+0000 7f9eae000640 1 --2- 172.21.15.8:0/1881176575 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9e9806abb0 0x7f9e9806d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:50.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.790+0000 7f9eae000640 1 -- 172.21.15.8:0/1881176575 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f9eb819be70 con 0x7f9e980036d0 2024-03-23T23:46:50.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.794+0000 7f9eb5400640 1 --2- 172.21.15.8:0/1881176575 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9e9806abb0 0x7f9e9806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:50.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.806+0000 7f9eae000640 1 -- 172.21.15.8:0/1881176575 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f9eb8135020 con 0x7f9e980036d0 2024-03-23T23:46:50.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:50.806+0000 7f9eb5400640 1 --2- 172.21.15.8:0/1881176575 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9e9806abb0 0x7f9e9806d070 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000f340 tx=0x7f9ea800a540 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:51.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:51.682+0000 7f9ea3400640 1 -- 172.21.15.8:0/1881176575 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f9eb000fab0 con 0x7f9e980036d0 2024-03-23T23:46:51.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:51.686+0000 7f9eae000640 1 -- 172.21.15.8:0/1881176575 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1561 (secure 0 0 0) 0x7f9eb8092420 con 0x7f9e980036d0 2024-03-23T23:46:51.688 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:46:51.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:51.690+0000 7f9ea3400640 1 -- 172.21.15.8:0/1881176575 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9e9806abb0 msgr2=0x7f9e9806d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:51.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:51.690+0000 7f9ea3400640 1 --2- 172.21.15.8:0/1881176575 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9e9806abb0 0x7f9e9806d070 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000f340 tx=0x7f9ea800a540 comp rx=0 tx=0).stop 2024-03-23T23:46:51.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:51.690+0000 7f9ea3400640 1 -- 172.21.15.8:0/1881176575 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e980036d0 msgr2=0x7f9eb00db630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:51.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:51.690+0000 7f9ea3400640 1 --2- 172.21.15.8:0/1881176575 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e980036d0 0x7f9eb00db630 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9eb802d610 tx=0x7f9eb80953e0 comp rx=0 tx=0).stop 2024-03-23T23:46:51.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:51.694+0000 7f9ea3400640 1 -- 172.21.15.8:0/1881176575 shutdown_connections 2024-03-23T23:46:51.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:51.694+0000 7f9ea3400640 1 --2- 172.21.15.8:0/1881176575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9eb0045a00 0x7f9eb00449f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:51.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:51.694+0000 7f9ea3400640 1 --2- 172.21.15.8:0/1881176575 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9eb0046260 0x7f9eb017cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:51.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:51.694+0000 7f9ea3400640 1 --2- 172.21.15.8:0/1881176575 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9e9806abb0 0x7f9e9806d070 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:51.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:51.694+0000 7f9ea3400640 1 --2- 172.21.15.8:0/1881176575 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e980036d0 0x7f9eb00db630 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:51.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:51.694+0000 7f9ea3400640 1 -- 172.21.15.8:0/1881176575 >> 172.21.15.8:0/1881176575 conn(0x7f9eb004c690 msgr2=0x7f9eb00d6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:46:51.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:51.694+0000 7f9ea3400640 1 -- 172.21.15.8:0/1881176575 shutdown_connections 2024-03-23T23:46:51.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:51.694+0000 7f9ea3400640 1 -- 172.21.15.8:0/1881176575 wait complete. 2024-03-23T23:46:54.741 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:46:55.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:55.146+0000 7f5119200640 1 Processor -- start 2024-03-23T23:46:55.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:55.146+0000 7f5119200640 1 -- start start 2024-03-23T23:46:55.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:55.146+0000 7f5119200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f51140aa390 0x7f511406caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:55.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:55.146+0000 7f5111e00640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f51140aa390 msgr2=0x7f511406caf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:46:55.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:55.146+0000 7f5111e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f51140aa390 0x7f511406caf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:46:55.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:55.146+0000 7f5119200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f511414b5a0 0x7f511414ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:55.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:55.146+0000 7f5119200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51141550b0 con 0x7f511406f140 2024-03-23T23:46:55.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:55.146+0000 7f5119200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5114155390 con 0x7f51140aa390 2024-03-23T23:46:55.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:55.146+0000 7f5119200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5114155670 con 0x7f511414b5a0 2024-03-23T23:46:55.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:55.146+0000 7f5111400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f511406f140 0x7f51140c3c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:57826/0 (socket says 172.21.15.8:57826) 2024-03-23T23:46:55.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:55.150+0000 7f5111400640 1 -- 172.21.15.8:0/4282424904 learned_addr learned my addr 172.21.15.8:0/4282424904 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:46:55.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:55.150+0000 7f5112800640 1 --2- 172.21.15.8:0/4282424904 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f511414b5a0 0x7f511414ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:55.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:55.158+0000 7f5112800640 1 -- 172.21.15.8:0/4282424904 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f511414b5a0 msgr2=0x7f511414ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:46:55.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:55.158+0000 7f5112800640 1 -- 172.21.15.8:0/4282424904 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f511414b5a0 msgr2=0x7f511414ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:46:55.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:55.158+0000 7f5112800640 1 --2- 172.21.15.8:0/4282424904 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f511414b5a0 0x7f511414ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:46:55.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:55.158+0000 7f5112800640 1 --2- 172.21.15.8:0/4282424904 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f511414b5a0 0x7f511414ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:46:55.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:55.350+0000 7f5111e00640 1 -- 172.21.15.8:0/4282424904 >> v2:172.21.15.8:3300/0 conn(0x7f51140aa390 msgr2=0x7f511406caf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:46:55.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:55.350+0000 7f5111e00640 1 --2- 172.21.15.8:0/4282424904 >> v2:172.21.15.8:3300/0 conn(0x7f51140aa390 0x7f511406caf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:46:55.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:55.366+0000 7f5112800640 1 --2- 172.21.15.8:0/4282424904 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f511414b5a0 0x7f511414ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:55.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:55.370+0000 7f5112800640 1 -- 172.21.15.8:0/4282424904 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f511414b5a0 msgr2=0x7f511414ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:46:55.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:55.370+0000 7f5112800640 1 -- 172.21.15.8:0/4282424904 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f511414b5a0 msgr2=0x7f511414ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:46:55.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:55.370+0000 7f5112800640 1 --2- 172.21.15.8:0/4282424904 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f511414b5a0 0x7f511414ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:46:55.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:55.370+0000 7f5112800640 1 --2- 172.21.15.8:0/4282424904 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f511414b5a0 0x7f511414ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:46:55.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:55.754+0000 7f5111e00640 1 -- 172.21.15.8:0/4282424904 >> v2:172.21.15.8:3300/0 conn(0x7f51140aa390 msgr2=0x7f511406caf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:46:55.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:55.754+0000 7f5111e00640 1 --2- 172.21.15.8:0/4282424904 >> v2:172.21.15.8:3300/0 conn(0x7f51140aa390 0x7f511406caf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:46:55.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:55.774+0000 7f5112800640 1 --2- 172.21.15.8:0/4282424904 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f511414b5a0 0x7f511414ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:55.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:55.774+0000 7f5112800640 1 -- 172.21.15.8:0/4282424904 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f511414b5a0 msgr2=0x7f511414ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:46:55.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:55.774+0000 7f5112800640 1 -- 172.21.15.8:0/4282424904 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f511414b5a0 msgr2=0x7f511414ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:46:55.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:55.774+0000 7f5112800640 1 --2- 172.21.15.8:0/4282424904 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f511414b5a0 0x7f511414ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:46:55.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:55.774+0000 7f5112800640 1 --2- 172.21.15.8:0/4282424904 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f511414b5a0 0x7f511414ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:46:56.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:56.558+0000 7f5111e00640 1 -- 172.21.15.8:0/4282424904 >> v2:172.21.15.8:3300/0 conn(0x7f51140aa390 msgr2=0x7f511406caf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:46:56.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:56.558+0000 7f5111e00640 1 --2- 172.21.15.8:0/4282424904 >> v2:172.21.15.8:3300/0 conn(0x7f51140aa390 0x7f511406caf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:46:56.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:56.586+0000 7f5112800640 1 --2- 172.21.15.8:0/4282424904 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f511414b5a0 0x7f511414ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:56.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:56.594+0000 7f5112800640 1 -- 172.21.15.8:0/4282424904 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f511414b5a0 msgr2=0x7f511414ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:46:56.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:56.594+0000 7f5112800640 1 -- 172.21.15.8:0/4282424904 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f511414b5a0 msgr2=0x7f511414ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:46:56.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:56.594+0000 7f5112800640 1 --2- 172.21.15.8:0/4282424904 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f511414b5a0 0x7f511414ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:46:56.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:56.594+0000 7f5112800640 1 --2- 172.21.15.8:0/4282424904 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f511414b5a0 0x7f511414ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:46:57.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.166+0000 7f5110a00640 1 -- 172.21.15.8:0/4282424904 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513400321 0 0) 0x7f51141550b0 con 0x7f511406f140 2024-03-23T23:46:57.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.166+0000 7f5110a00640 1 -- 172.21.15.8:0/4282424904 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50f8003530 con 0x7f511406f140 2024-03-23T23:46:57.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.174+0000 7f5110a00640 1 -- 172.21.15.8:0/4282424904 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 296689809 0 0) 0x7f50f8003530 con 0x7f511406f140 2024-03-23T23:46:57.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.174+0000 7f5110a00640 1 -- 172.21.15.8:0/4282424904 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f511414b5a0 msgr2=0x7f511414ba10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:46:57.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.174+0000 7f5110a00640 1 --2- 172.21.15.8:0/4282424904 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f511414b5a0 0x7f511414ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:57.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.174+0000 7f5110a00640 1 -- 172.21.15.8:0/4282424904 >> v2:172.21.15.8:3300/0 conn(0x7f51140aa390 msgr2=0x7f511406caf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:46:57.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.174+0000 7f5110a00640 1 --2- 172.21.15.8:0/4282424904 >> v2:172.21.15.8:3300/0 conn(0x7f51140aa390 0x7f511406caf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:57.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.174+0000 7f5110a00640 1 -- 172.21.15.8:0/4282424904 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5114155950 con 0x7f511406f140 2024-03-23T23:46:57.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.174+0000 7f5110a00640 1 -- 172.21.15.8:0/4282424904 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7f5100001620 con 0x7f511406f140 2024-03-23T23:46:57.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.174+0000 7f5110a00640 1 -- 172.21.15.8:0/4282424904 >> v1:172.21.15.196:6789/0 conn(0x7f511406f140 legacy=0x7f51140c3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:57.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.174+0000 7f5110a00640 1 --2- 172.21.15.8:0/4282424904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50f8003a70 0x7f50f8003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:57.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.174+0000 7f5110a00640 1 --2- 172.21.15.8:0/4282424904 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50f8004810 0x7f50f8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:57.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.178+0000 7f5110a00640 1 --2- 172.21.15.8:0/4282424904 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f511414b5a0 0x7f50f80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:57.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.178+0000 7f5111e00640 1 -- 172.21.15.8:0/4282424904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50f8003a70 msgr2=0x7f50f8003eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:46:57.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.178+0000 7f5111e00640 1 --2- 172.21.15.8:0/4282424904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50f8003a70 0x7f50f8003eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:46:57.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.178+0000 7f5110a00640 1 -- 172.21.15.8:0/4282424904 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5114155390 con 0x7f50f8003a70 2024-03-23T23:46:57.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.178+0000 7f5110a00640 1 -- 172.21.15.8:0/4282424904 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5114155670 con 0x7f50f8004810 2024-03-23T23:46:57.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.178+0000 7f5110a00640 1 -- 172.21.15.8:0/4282424904 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f80059a0 con 0x7f511414b5a0 2024-03-23T23:46:57.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.178+0000 7f5112800640 1 --2- 172.21.15.8:0/4282424904 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f511414b5a0 0x7f50f80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:57.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.182+0000 7f5111400640 1 --2- 172.21.15.8:0/4282424904 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50f8004810 0x7f50f8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:57.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.186+0000 7f5112800640 1 -- 172.21.15.8:0/4282424904 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50f8004810 msgr2=0x7f50f8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:46:57.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.186+0000 7f5112800640 1 --2- 172.21.15.8:0/4282424904 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50f8004810 0x7f50f8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:57.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.186+0000 7f5112800640 1 -- 172.21.15.8:0/4282424904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50f8003a70 msgr2=0x7f50f8003eb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:46:57.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.186+0000 7f5112800640 1 --2- 172.21.15.8:0/4282424904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50f8003a70 0x7f50f8003eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:57.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.186+0000 7f5112800640 1 -- 172.21.15.8:0/4282424904 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5114155950 con 0x7f511414b5a0 2024-03-23T23:46:57.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.198+0000 7f5112800640 1 --2- 172.21.15.8:0/4282424904 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f511414b5a0 0x7f50f80051d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f510c0099c0 tx=0x7f510c01cfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=169076ee729ec53d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:57.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.202+0000 7f5110a00640 1 -- 172.21.15.8:0/4282424904 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c0ab070 con 0x7f511414b5a0 2024-03-23T23:46:57.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.206+0000 7f5110a00640 1 -- 172.21.15.8:0/4282424904 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510c0a5e40 con 0x7f511414b5a0 2024-03-23T23:46:57.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.206+0000 7f5110a00640 1 -- 172.21.15.8:0/4282424904 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c009640 con 0x7f511414b5a0 2024-03-23T23:46:57.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.206+0000 7f5119200640 1 -- 172.21.15.8:0/4282424904 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f511414b5a0 msgr2=0x7f50f80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:57.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.206+0000 7f5119200640 1 --2- 172.21.15.8:0/4282424904 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f511414b5a0 0x7f50f80051d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f510c0099c0 tx=0x7f510c01cfa0 comp rx=0 tx=0).stop 2024-03-23T23:46:57.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.206+0000 7f5112800640 1 -- 172.21.15.8:0/4282424904 reap_dead start 2024-03-23T23:46:57.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.206+0000 7f5119200640 1 -- 172.21.15.8:0/4282424904 shutdown_connections 2024-03-23T23:46:57.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.206+0000 7f5119200640 1 -- 172.21.15.8:0/4282424904 >> 172.21.15.8:0/4282424904 conn(0x7f511406b170 msgr2=0x7f511406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:46:57.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.206+0000 7f5119200640 1 -- 172.21.15.8:0/4282424904 shutdown_connections 2024-03-23T23:46:57.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.206+0000 7f5119200640 1 -- 172.21.15.8:0/4282424904 wait complete. 2024-03-23T23:46:57.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.222+0000 7f5119200640 1 Processor -- start 2024-03-23T23:46:57.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.222+0000 7f5119200640 1 -- start start 2024-03-23T23:46:57.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.226+0000 7f5119200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f511414b5a0 0x7f511414e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:57.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.226+0000 7f5111e00640 1 -- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f511414b5a0 msgr2=0x7f511414e470 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:46:57.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.226+0000 7f5111e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f511414b5a0 0x7f511414e470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:46:57.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.226+0000 7f5119200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51141460e0 0x7f51141489f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:57.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.226+0000 7f5119200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f51141df5b0 0x7f51141dfa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:57.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.226+0000 7f5119200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51140c4490 con 0x7f511414b5a0 2024-03-23T23:46:57.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.226+0000 7f5119200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51140c4310 con 0x7f51141df5b0 2024-03-23T23:46:57.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.226+0000 7f5119200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51141521c0 con 0x7f51141460e0 2024-03-23T23:46:57.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.230+0000 7f5112800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f51141df5b0 0x7f51141dfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:57.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.230+0000 7f5112800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f51141df5b0 0x7f51141dfa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:39914/0 (socket says 172.21.15.8:39914) 2024-03-23T23:46:57.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.230+0000 7f5112800640 1 -- 172.21.15.8:0/854881106 learned_addr learned my addr 172.21.15.8:0/854881106 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:46:57.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.234+0000 7f5111400640 1 --2- 172.21.15.8:0/854881106 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51141460e0 0x7f51141489f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:57.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.242+0000 7f5111400640 1 -- 172.21.15.8:0/854881106 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f51141df5b0 msgr2=0x7f51141dfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:57.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.242+0000 7f5111400640 1 --2- 172.21.15.8:0/854881106 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f51141df5b0 0x7f51141dfa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:57.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.242+0000 7f5111400640 1 -- 172.21.15.8:0/854881106 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f511414b5a0 msgr2=0x7f511414e470 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:46:57.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.242+0000 7f5111400640 1 --2- 172.21.15.8:0/854881106 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f511414b5a0 0x7f511414e470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:57.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.242+0000 7f5111400640 1 -- 172.21.15.8:0/854881106 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511414c3b0 con 0x7f51141460e0 2024-03-23T23:46:57.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.242+0000 7f5111400640 1 --2- 172.21.15.8:0/854881106 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51141460e0 0x7f51141489f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f510000e7d0 tx=0x7f510000ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:57.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.254+0000 7f510a000640 1 -- 172.21.15.8:0/854881106 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51000014b0 con 0x7f51141460e0 2024-03-23T23:46:57.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.254+0000 7f510a000640 1 -- 172.21.15.8:0/854881106 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5100018070 con 0x7f51141460e0 2024-03-23T23:46:57.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.254+0000 7f510a000640 1 -- 172.21.15.8:0/854881106 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510000cab0 con 0x7f51141460e0 2024-03-23T23:46:57.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.254+0000 7f5119200640 1 -- 172.21.15.8:0/854881106 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51141ed390 con 0x7f51141460e0 2024-03-23T23:46:57.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.254+0000 7f5119200640 1 -- 172.21.15.8:0/854881106 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51141ed950 con 0x7f51141460e0 2024-03-23T23:46:57.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.258+0000 7f50ff400640 1 -- 172.21.15.8:0/854881106 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f511404f480 con 0x7f51141460e0 2024-03-23T23:46:57.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.266+0000 7f510a000640 1 -- 172.21.15.8:0/854881106 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f510000cc50 con 0x7f51141460e0 2024-03-23T23:46:57.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.266+0000 7f510a000640 1 --2- 172.21.15.8:0/854881106 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f50f4067690 0x7f50f4069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:57.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.266+0000 7f510a000640 1 -- 172.21.15.8:0/854881106 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f5100086450 con 0x7f51141460e0 2024-03-23T23:46:57.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.266+0000 7f5111e00640 1 --2- 172.21.15.8:0/854881106 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f50f4067690 0x7f50f4069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:57.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.270+0000 7f5111e00640 1 --2- 172.21.15.8:0/854881106 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f50f4067690 0x7f50f4069b50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5104003990 tx=0x7f5104009210 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:57.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:57.282+0000 7f510a000640 1 -- 172.21.15.8:0/854881106 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f5100056cf0 con 0x7f51141460e0 2024-03-23T23:46:58.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.002+0000 7f50ff400640 1 -- 172.21.15.8:0/854881106 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f51140c37b0 con 0x7f51141460e0 2024-03-23T23:46:58.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.006+0000 7f510a000640 1 -- 172.21.15.8:0/854881106 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1554 (secure 0 0 0) 0x7f51000565f0 con 0x7f51141460e0 2024-03-23T23:46:58.012 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":32,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:46:58.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.030+0000 7f50ff400640 1 -- 172.21.15.8:0/854881106 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f50f4067690 msgr2=0x7f50f4069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:58.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.030+0000 7f50ff400640 1 --2- 172.21.15.8:0/854881106 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f50f4067690 0x7f50f4069b50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5104003990 tx=0x7f5104009210 comp rx=0 tx=0).stop 2024-03-23T23:46:58.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.030+0000 7f50ff400640 1 -- 172.21.15.8:0/854881106 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51141460e0 msgr2=0x7f51141489f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:58.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.030+0000 7f50ff400640 1 --2- 172.21.15.8:0/854881106 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51141460e0 0x7f51141489f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f510000e7d0 tx=0x7f510000ec90 comp rx=0 tx=0).stop 2024-03-23T23:46:58.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.030+0000 7f50ff400640 1 -- 172.21.15.8:0/854881106 shutdown_connections 2024-03-23T23:46:58.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.030+0000 7f50ff400640 1 --2- 172.21.15.8:0/854881106 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f51141df5b0 0x7f51141dfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:58.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.030+0000 7f50ff400640 1 --2- 172.21.15.8:0/854881106 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f50f4067690 0x7f50f4069b50 secure :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5104003990 tx=0x7f5104009210 comp rx=0 tx=0).stop 2024-03-23T23:46:58.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.030+0000 7f50ff400640 1 --2- 172.21.15.8:0/854881106 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51141460e0 0x7f51141489f0 secure :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f510000e7d0 tx=0x7f510000ec90 comp rx=0 tx=0).stop 2024-03-23T23:46:58.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.030+0000 7f50ff400640 1 --2- 172.21.15.8:0/854881106 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f511414b5a0 0x7f511414e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:58.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.030+0000 7f50ff400640 1 -- 172.21.15.8:0/854881106 >> 172.21.15.8:0/854881106 conn(0x7f511406b170 msgr2=0x7f51140c3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:46:58.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.042+0000 7f50ff400640 1 -- 172.21.15.8:0/854881106 shutdown_connections 2024-03-23T23:46:58.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.042+0000 7f50ff400640 1 -- 172.21.15.8:0/854881106 wait complete. 2024-03-23T23:46:58.119 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-03-23T23:46:58.119 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-03-23T23:46:58.119 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:46:58.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.478+0000 7fdeb7e00640 1 Processor -- start 2024-03-23T23:46:58.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.486+0000 7fdeb7e00640 1 -- start start 2024-03-23T23:46:58.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.490+0000 7fdeb7e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fdeb00dbce0 0x7fdeb00e2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:58.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.490+0000 7fdeb7e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fdeb000b0c0 0x7fdeb0006f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:58.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.490+0000 7fdeb7e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdeb0007440 0x7fdeb00ded20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:58.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.490+0000 7fdeb7e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb00e2c50 con 0x7fdeb000b0c0 2024-03-23T23:46:58.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.490+0000 7fdeb7e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb00de870 con 0x7fdeb00dbce0 2024-03-23T23:46:58.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.490+0000 7fdeb7e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb0047620 con 0x7fdeb0007440 2024-03-23T23:46:58.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.490+0000 7fdeb6a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fdeb00dbce0 0x7fdeb00e2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:58.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.498+0000 7fdeb6000640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7fdeb000b0c0 msgr2=0x7fdeb0006f00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:46:58.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.498+0000 7fdeb6000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fdeb000b0c0 0x7fdeb0006f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:46:58.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.502+0000 7fdeb6a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fdeb00dbce0 0x7fdeb00e2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:39924/0 (socket says 172.21.15.8:39924) 2024-03-23T23:46:58.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.502+0000 7fdeb6a00640 1 -- 172.21.15.8:0/2140461991 learned_addr learned my addr 172.21.15.8:0/2140461991 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:46:58.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.506+0000 7fdeb6a00640 1 -- 172.21.15.8:0/2140461991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdeb0007440 msgr2=0x7fdeb00ded20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:46:58.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.506+0000 7fdeb6a00640 1 --2- 172.21.15.8:0/2140461991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdeb0007440 0x7fdeb00ded20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:58.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.506+0000 7fdeb6a00640 1 -- 172.21.15.8:0/2140461991 >> v2:172.21.15.8:3300/0 conn(0x7fdeb000b0c0 msgr2=0x7fdeb0006f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:46:58.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.506+0000 7fdeb6a00640 1 --2- 172.21.15.8:0/2140461991 >> v2:172.21.15.8:3300/0 conn(0x7fdeb000b0c0 0x7fdeb0006f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:58.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.506+0000 7fdeb6a00640 1 -- 172.21.15.8:0/2140461991 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb0047900 con 0x7fdeb00dbce0 2024-03-23T23:46:58.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.534+0000 7fdeb6a00640 1 --2- 172.21.15.8:0/2140461991 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdeb00dbce0 0x7fdeb00e2710 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000c000 tx=0x7fdea401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24c0aab2370b1673 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:58.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.538+0000 7fdeb5600640 1 -- 172.21.15.8:0/2140461991 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea40b1070 con 0x7fdeb00dbce0 2024-03-23T23:46:58.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.538+0000 7fdeb5600640 1 -- 172.21.15.8:0/2140461991 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea40a8050 con 0x7fdeb00dbce0 2024-03-23T23:46:58.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.538+0000 7fdeb5600640 1 -- 172.21.15.8:0/2140461991 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea40ac860 con 0x7fdeb00dbce0 2024-03-23T23:46:58.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.542+0000 7fdeb7e00640 1 -- 172.21.15.8:0/2140461991 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdeb00dbce0 msgr2=0x7fdeb00e2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:58.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.542+0000 7fdeb7e00640 1 --2- 172.21.15.8:0/2140461991 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdeb00dbce0 0x7fdeb00e2710 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000c000 tx=0x7fdea401c4a0 comp rx=0 tx=0).stop 2024-03-23T23:46:58.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.542+0000 7fdeb7e00640 1 -- 172.21.15.8:0/2140461991 shutdown_connections 2024-03-23T23:46:58.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.542+0000 7fdeb7e00640 1 --2- 172.21.15.8:0/2140461991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdeb0007440 0x7fdeb00ded20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:58.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.542+0000 7fdeb7e00640 1 --2- 172.21.15.8:0/2140461991 >> v2:172.21.15.8:3300/0 conn(0x7fdeb000b0c0 0x7fdeb0006f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:58.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.542+0000 7fdeb7e00640 1 --2- 172.21.15.8:0/2140461991 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdeb00dbce0 0x7fdeb00e2710 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:58.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.542+0000 7fdeb7e00640 1 -- 172.21.15.8:0/2140461991 >> 172.21.15.8:0/2140461991 conn(0x7fdeb0048260 msgr2=0x7fdeb0048670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:46:58.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.542+0000 7fdeb7e00640 1 -- 172.21.15.8:0/2140461991 shutdown_connections 2024-03-23T23:46:58.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.542+0000 7fdeb7e00640 1 -- 172.21.15.8:0/2140461991 wait complete. 2024-03-23T23:46:58.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.550+0000 7fdeb7e00640 1 Processor -- start 2024-03-23T23:46:58.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.550+0000 7fdeb7e00640 1 -- start start 2024-03-23T23:46:58.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.550+0000 7fdeb7e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdeb0007440 0x7fdeb003fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:58.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.550+0000 7fdeb7e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdeb000b0c0 0x7fdeb0030200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:58.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.554+0000 7fdeb7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdeb00dbce0 0x7fdeb00d2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:58.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.554+0000 7fdeb7e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb00dfc50 con 0x7fdeb00dbce0 2024-03-23T23:46:58.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.554+0000 7fdeb7e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb00df670 con 0x7fdeb000b0c0 2024-03-23T23:46:58.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.554+0000 7fdeb7e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb00dc0c0 con 0x7fdeb0007440 2024-03-23T23:46:58.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.554+0000 7fdeb7400640 1 -- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdeb00dbce0 msgr2=0x7fdeb00d2af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:46:58.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.554+0000 7fdeb7400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdeb00dbce0 0x7fdeb00d2af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:46:58.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.554+0000 7fdeb6000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdeb000b0c0 0x7fdeb0030200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:58.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.554+0000 7fdeb6000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdeb000b0c0 0x7fdeb0030200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:39930/0 (socket says 172.21.15.8:39930) 2024-03-23T23:46:58.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.554+0000 7fdeb6000640 1 -- 172.21.15.8:0/3864878068 learned_addr learned my addr 172.21.15.8:0/3864878068 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:46:58.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.554+0000 7fdeb6a00640 1 --2- 172.21.15.8:0/3864878068 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdeb0007440 0x7fdeb003fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:58.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.554+0000 7fdeb6000640 1 -- 172.21.15.8:0/3864878068 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdeb0007440 msgr2=0x7fdeb003fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:58.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.554+0000 7fdeb6000640 1 --2- 172.21.15.8:0/3864878068 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdeb0007440 0x7fdeb003fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:58.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.554+0000 7fdeb6000640 1 -- 172.21.15.8:0/3864878068 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdeb00dbce0 msgr2=0x7fdeb00d2af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:46:58.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.554+0000 7fdeb6000640 1 --2- 172.21.15.8:0/3864878068 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdeb00dbce0 0x7fdeb00d2af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:58.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.554+0000 7fdeb6000640 1 -- 172.21.15.8:0/3864878068 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb00da4e0 con 0x7fdeb000b0c0 2024-03-23T23:46:58.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.558+0000 7fdeb6000640 1 --2- 172.21.15.8:0/3864878068 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdeb000b0c0 0x7fdeb0030200 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8050260 tx=0x7fdeb80736e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:58.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.566+0000 7fdeaf400640 1 -- 172.21.15.8:0/3864878068 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb806c050 con 0x7fdeb000b0c0 2024-03-23T23:46:58.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.566+0000 7fdeaf400640 1 -- 172.21.15.8:0/3864878068 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb808f030 con 0x7fdeb000b0c0 2024-03-23T23:46:58.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.566+0000 7fdeaf400640 1 -- 172.21.15.8:0/3864878068 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8072cf0 con 0x7fdeb000b0c0 2024-03-23T23:46:58.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.566+0000 7fdeb7e00640 1 -- 172.21.15.8:0/3864878068 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb00da7c0 con 0x7fdeb000b0c0 2024-03-23T23:46:58.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.566+0000 7fdeb7e00640 1 -- 172.21.15.8:0/3864878068 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb00dad80 con 0x7fdeb000b0c0 2024-03-23T23:46:58.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.582+0000 7fdeb7e00640 1 --2- 172.21.15.8:0/3864878068 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdeb0045700 0x7fdeb00d3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:58.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.582+0000 7fdeb7e00640 1 -- 172.21.15.8:0/3864878068 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb00052d0 con 0x7fdeb0045700 2024-03-23T23:46:58.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.582+0000 7fdeaf400640 1 -- 172.21.15.8:0/3864878068 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fdeb8094420 con 0x7fdeb000b0c0 2024-03-23T23:46:58.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.586+0000 7fdeaf400640 1 --2- 172.21.15.8:0/3864878068 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fde98067660 0x7fde98069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:58.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.586+0000 7fdeaf400640 1 -- 172.21.15.8:0/3864878068 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fdeb8101420 con 0x7fdeb000b0c0 2024-03-23T23:46:58.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.586+0000 7fdeb6a00640 1 --2- 172.21.15.8:0/3864878068 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdeb0045700 0x7fdeb00d3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:58.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.590+0000 7fdeb6a00640 1 -- 172.21.15.8:0/3864878068 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdeb003ef90 con 0x7fdeb0045700 2024-03-23T23:46:58.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.590+0000 7fdeb6a00640 1 --2- 172.21.15.8:0/3864878068 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdeb0045700 0x7fdeb00d3030 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdea40ae000 tx=0x7fdea401ace0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:58.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.594+0000 7fdeaf400640 1 -- 172.21.15.8:0/3864878068 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea40bc020 con 0x7fdeb0045700 2024-03-23T23:46:58.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.594+0000 7fdeaf400640 1 -- 172.21.15.8:0/3864878068 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fdea40a8040 con 0x7fdeb0045700 2024-03-23T23:46:58.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.598+0000 7fdeb7400640 1 --2- 172.21.15.8:0/3864878068 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fde98067660 0x7fde98069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:58.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.598+0000 7fdeaf400640 1 -- 172.21.15.8:0/3864878068 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdeb0045700 msgr2=0x7fdeb00d3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:58.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.598+0000 7fdeaf400640 1 --2- 172.21.15.8:0/3864878068 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdeb0045700 0x7fdeb00d3030 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdea40ae000 tx=0x7fdea401ace0 comp rx=0 tx=0).stop 2024-03-23T23:46:58.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.598+0000 7fdeaf400640 1 -- 172.21.15.8:0/3864878068 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdeb0045700 msgr2=0x7fdeb00d3030 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:46:58.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.598+0000 7fdeaf400640 1 --2- 172.21.15.8:0/3864878068 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdeb0045700 0x7fdeb00d3030 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdea40ae000 tx=0x7fdea401ace0 comp rx=0 tx=0).stop 2024-03-23T23:46:58.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.602+0000 7fdeb7400640 1 --2- 172.21.15.8:0/3864878068 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fde98067660 0x7fde98069b20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdea8000f60 tx=0x7fdea8007a40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:58.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.626+0000 7fdeb7e00640 1 --2- 172.21.15.8:0/3864878068 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdeb00dafc0 0x7fdeb0183230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:58.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.626+0000 7fdeb7e00640 1 -- 172.21.15.8:0/3864878068 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb000b860 con 0x7fdeb00dafc0 2024-03-23T23:46:58.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.626+0000 7fdeb6a00640 1 --2- 172.21.15.8:0/3864878068 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdeb00dafc0 0x7fdeb0183230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:58.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.630+0000 7fdeb6a00640 1 -- 172.21.15.8:0/3864878068 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fdeb0004fb0 con 0x7fdeb00dafc0 2024-03-23T23:46:58.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.630+0000 7fdeb6a00640 1 --2- 172.21.15.8:0/3864878068 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdeb00dafc0 0x7fdeb0183230 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdea401c4e0 tx=0x7fdea4019240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:58.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.630+0000 7fdeaf400640 1 -- 172.21.15.8:0/3864878068 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea40bc040 con 0x7fdeb00dafc0 2024-03-23T23:46:58.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.634+0000 7fdeaf400640 1 -- 172.21.15.8:0/3864878068 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4663 (secure 0 0 0) 0x7fdea40b2040 con 0x7fdeb00dafc0 2024-03-23T23:46:58.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.634+0000 7fdeaf400640 1 -- 172.21.15.8:0/3864878068 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdeb00dafc0 msgr2=0x7fdeb0183230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:58.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.634+0000 7fdeaf400640 1 --2- 172.21.15.8:0/3864878068 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdeb00dafc0 0x7fdeb0183230 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdea401c4e0 tx=0x7fdea4019240 comp rx=0 tx=0).stop 2024-03-23T23:46:58.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.634+0000 7fdeaf400640 1 -- 172.21.15.8:0/3864878068 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdeb00dafc0 msgr2=0x7fdeb0183230 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:46:58.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.634+0000 7fdeaf400640 1 --2- 172.21.15.8:0/3864878068 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdeb00dafc0 0x7fdeb0183230 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdea401c4e0 tx=0x7fdea4019240 comp rx=0 tx=0).stop 2024-03-23T23:46:58.634 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:46:58.634 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:46:58.635 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:46:58.635 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:46:58.635 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 32, 2024-03-23T23:46:58.635 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:46:58.635 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:46:58.635 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:46:58.635 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:58.635 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 1, 2024-03-23T23:46:58.635 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:46:58.635 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:46:58.635 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:46:58.635 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:46:58.635 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:46:58.636 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:46:58.636 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:46:58.636 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:46:58.636 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:46:58.636 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:46:58.636 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:46:58.636 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:46:58.636 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:46:58.636 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:46:58.637 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:58.637 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:46:58.637 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:46:58.637 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:46:58.637 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:46:58.637 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:46:58.637 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:46:58.637 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:46:58.637 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:46:58.637 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:46:58.637 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:46:58.637 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:46:58.637 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:46:58.638 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:46:58.638 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:58.638 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:58.638 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:46:58.638 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:46:58.638 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:46:58.638 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:46:58.638 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:46:58.638 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:46:58.638 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:46:58.639 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:46:58.639 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:46:58.639 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:46:58.639 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:46:58.639 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:46:58.639 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:46:58.639 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:46:58.639 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:46:58.639 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:46:58.639 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:46:58.639 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:46:58.640 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:46:58.640 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:46:58.640 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:46:58.640 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:46:58.640 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:46:58.640 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:46:58.640 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:46:58.640 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:46:58.640 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:46:58.640 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:46:58.640 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:58.640 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:46:58.641 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:58.641 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:46:58.641 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:58.641 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:46:58.641 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:46:58.641 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:46:58.641 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:46:58.641 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:58.641 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:46:58.641 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:46:58.641 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:58.641 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:58.641 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:58.642 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:46:58.642 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:46:58.642 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:58.642 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:58.642 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:58.642 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:58.642 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:46:58.642 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:46:58.642 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:46:58.642 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:46:58.642 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:46:58.642 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:58.642 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:58.643 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:46:58.643 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:46:58.643 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:46:58.643 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:46:58.643 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:58.643 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:46:58.643 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:46:58.643 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:58.643 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:58.643 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:58.643 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:46:58.643 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:46:58.643 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:58.644 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:58.644 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:58.644 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:58.644 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:46:58.644 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:46:58.644 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:46:58.644 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:46:58.644 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:46:58.644 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:58.645 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:58.645 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:46:58.645 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:46:58.645 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:46:58.645 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:46:58.645 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:58.645 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:46:58.645 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:46:58.645 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:58.645 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:58.645 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:58.645 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:46:58.645 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:46:58.646 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:58.646 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:58.646 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:58.646 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:58.646 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:46:58.646 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:46:58.646 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:46:58.646 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:46:58.646 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:46:58.646 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:58.646 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:58.646 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:58.646 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:46:58.647 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:46:58.647 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:58.647 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:46:58.647 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:46:58.647 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:46:58.647 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:58.647 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:58.647 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:46:58.647 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:58.647 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:46:58.647 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:46:58.647 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:46:58.648 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:58.648 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:58.648 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:46:58.648 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:46:58.648 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:46:58.648 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:58.648 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:58.648 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:58.648 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:46:58.648 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:46:58.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.646+0000 7fdeb7e00640 1 -- 172.21.15.8:0/3864878068 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fde98067660 msgr2=0x7fde98069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:58.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.646+0000 7fdeb7e00640 1 --2- 172.21.15.8:0/3864878068 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fde98067660 0x7fde98069b20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdea8000f60 tx=0x7fdea8007a40 comp rx=0 tx=0).stop 2024-03-23T23:46:58.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.646+0000 7fdeb7e00640 1 -- 172.21.15.8:0/3864878068 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdeb000b0c0 msgr2=0x7fdeb0030200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:58.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.646+0000 7fdeb7e00640 1 --2- 172.21.15.8:0/3864878068 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdeb000b0c0 0x7fdeb0030200 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8050260 tx=0x7fdeb80736e0 comp rx=0 tx=0).stop 2024-03-23T23:46:58.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.646+0000 7fdeb7400640 1 -- 172.21.15.8:0/3864878068 reap_dead start 2024-03-23T23:46:58.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.646+0000 7fdeb7400640 1 -- 172.21.15.8:0/3864878068 reap_dead start 2024-03-23T23:46:58.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.650+0000 7fdeb7e00640 1 -- 172.21.15.8:0/3864878068 shutdown_connections 2024-03-23T23:46:58.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.650+0000 7fdeb7e00640 1 -- 172.21.15.8:0/3864878068 >> 172.21.15.8:0/3864878068 conn(0x7fdeb0048260 msgr2=0x7fdeb004b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:46:58.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.662+0000 7fdeb7e00640 1 -- 172.21.15.8:0/3864878068 shutdown_connections 2024-03-23T23:46:58.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:58.662+0000 7fdeb7e00640 1 -- 172.21.15.8:0/3864878068 wait complete. 2024-03-23T23:46:58.844 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T23:46:58.844 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-03-23T23:46:58.845 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:46:59.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.278+0000 7f0bc5000640 1 Processor -- start 2024-03-23T23:46:59.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.278+0000 7f0bc5000640 1 -- start start 2024-03-23T23:46:59.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.286+0000 7f0bc5000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bc00ad2b0 0x7f0bc00ad710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:59.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.286+0000 7f0bc5000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0bc015a370 0x7f0bc015a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:59.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.286+0000 7f0bc5000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc00c6320 con 0x7f0bc01575b0 2024-03-23T23:46:59.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.286+0000 7f0bc5000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc006cbd0 con 0x7f0bc015a370 2024-03-23T23:46:59.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.286+0000 7f0bc5000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc00c9a70 con 0x7f0bc00ad2b0 2024-03-23T23:46:59.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.286+0000 7f0bbde00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f0bc01575b0 0x7f0bc00c5c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:57836/0 (socket says 172.21.15.8:57836) 2024-03-23T23:46:59.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.286+0000 7f0bbde00640 1 -- 172.21.15.8:0/915656154 learned_addr learned my addr 172.21.15.8:0/915656154 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:46:59.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.286+0000 7f0bbe800640 1 --2- 172.21.15.8:0/915656154 >> v2:172.21.15.196:3300/0 conn(0x7f0bc015a370 0x7f0bc015a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:59.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.294+0000 7f0bbe800640 1 -- 172.21.15.8:0/915656154 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bc00ad2b0 msgr2=0x7f0bc00ad710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:46:59.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.294+0000 7f0bbe800640 1 --2- 172.21.15.8:0/915656154 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bc00ad2b0 0x7f0bc00ad710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:59.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.294+0000 7f0bbe800640 1 -- 172.21.15.8:0/915656154 >> v1:172.21.15.196:6789/0 conn(0x7f0bc01575b0 legacy=0x7f0bc00c5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:46:59.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.294+0000 7f0bbe800640 1 -- 172.21.15.8:0/915656154 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc0157990 con 0x7f0bc015a370 2024-03-23T23:46:59.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.330+0000 7f0bbe800640 1 --2- 172.21.15.8:0/915656154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0bc015a370 0x7f0bc015a800 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8009d90 tx=0x7f0bb801c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76862059e55529d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:59.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.350+0000 7f0bbca00640 1 -- 172.21.15.8:0/915656154 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb80b2070 con 0x7f0bc015a370 2024-03-23T23:46:59.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.350+0000 7f0bbca00640 1 -- 172.21.15.8:0/915656154 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb80a57a0 con 0x7f0bc015a370 2024-03-23T23:46:59.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.350+0000 7f0bbca00640 1 -- 172.21.15.8:0/915656154 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb80a5b70 con 0x7f0bc015a370 2024-03-23T23:46:59.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.354+0000 7f0bc5000640 1 -- 172.21.15.8:0/915656154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0bc015a370 msgr2=0x7f0bc015a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:59.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.354+0000 7f0bc5000640 1 --2- 172.21.15.8:0/915656154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0bc015a370 0x7f0bc015a800 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8009d90 tx=0x7f0bb801c8e0 comp rx=0 tx=0).stop 2024-03-23T23:46:59.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.354+0000 7f0bc5000640 1 -- 172.21.15.8:0/915656154 shutdown_connections 2024-03-23T23:46:59.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.354+0000 7f0bc5000640 1 --2- 172.21.15.8:0/915656154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0bc015a370 0x7f0bc015a800 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:59.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.354+0000 7f0bc5000640 1 --2- 172.21.15.8:0/915656154 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bc00ad2b0 0x7f0bc00ad710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:59.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.354+0000 7f0bc5000640 1 -- 172.21.15.8:0/915656154 >> 172.21.15.8:0/915656154 conn(0x7f0bc00cb690 msgr2=0x7f0bc00cbaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:46:59.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.358+0000 7f0bc5000640 1 -- 172.21.15.8:0/915656154 shutdown_connections 2024-03-23T23:46:59.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.358+0000 7f0bc5000640 1 -- 172.21.15.8:0/915656154 wait complete. 2024-03-23T23:46:59.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.362+0000 7f0bc5000640 1 Processor -- start 2024-03-23T23:46:59.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.362+0000 7f0bc5000640 1 -- start start 2024-03-23T23:46:59.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.362+0000 7f0bc5000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bc00ad2b0 0x7f0bc015be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:59.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.370+0000 7f0bc5000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bc01575b0 0x7f0bc015c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:59.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.370+0000 7f0bc5000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0bc015a370 0x7f0bc0154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:59.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.370+0000 7f0bc5000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc00c7a90 con 0x7f0bc01575b0 2024-03-23T23:46:59.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.370+0000 7f0bc5000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc00ca560 con 0x7f0bc015a370 2024-03-23T23:46:59.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.370+0000 7f0bc5000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc015ad40 con 0x7f0bc00ad2b0 2024-03-23T23:46:59.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.370+0000 7f0bbd400640 1 -- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bc01575b0 msgr2=0x7f0bc015c370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:46:59.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.370+0000 7f0bbd400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bc01575b0 0x7f0bc015c370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:46:59.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.370+0000 7f0bbe800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0bc015a370 0x7f0bc0154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:59.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.370+0000 7f0bbe800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0bc015a370 0x7f0bc0154150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:39964/0 (socket says 172.21.15.8:39964) 2024-03-23T23:46:59.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.370+0000 7f0bbe800640 1 -- 172.21.15.8:0/3713864732 learned_addr learned my addr 172.21.15.8:0/3713864732 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:46:59.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.370+0000 7f0bbde00640 1 --2- 172.21.15.8:0/3713864732 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bc00ad2b0 0x7f0bc015be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:59.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.378+0000 7f0bbde00640 1 -- 172.21.15.8:0/3713864732 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0bc015a370 msgr2=0x7f0bc0154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:59.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.378+0000 7f0bbde00640 1 --2- 172.21.15.8:0/3713864732 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0bc015a370 0x7f0bc0154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:59.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.378+0000 7f0bbde00640 1 -- 172.21.15.8:0/3713864732 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bc01575b0 msgr2=0x7f0bc015c370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:46:59.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.378+0000 7f0bbde00640 1 --2- 172.21.15.8:0/3713864732 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bc01575b0 0x7f0bc015c370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:46:59.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.378+0000 7f0bbde00640 1 -- 172.21.15.8:0/3713864732 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc015b860 con 0x7f0bc00ad2b0 2024-03-23T23:46:59.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.378+0000 7f0bbde00640 1 --2- 172.21.15.8:0/3713864732 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bc00ad2b0 0x7f0bc015be30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000c370 tx=0x7f0bb000c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:59.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.382+0000 7f0bb6000640 1 -- 172.21.15.8:0/3713864732 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0017070 con 0x7f0bc00ad2b0 2024-03-23T23:46:59.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.382+0000 7f0bc5000640 1 -- 172.21.15.8:0/3713864732 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc01f2390 con 0x7f0bc00ad2b0 2024-03-23T23:46:59.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.382+0000 7f0bc5000640 1 -- 172.21.15.8:0/3713864732 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc01f2650 con 0x7f0bc00ad2b0 2024-03-23T23:46:59.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.382+0000 7f0bb6000640 1 -- 172.21.15.8:0/3713864732 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb0005cf0 con 0x7f0bc00ad2b0 2024-03-23T23:46:59.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.382+0000 7f0bb6000640 1 -- 172.21.15.8:0/3713864732 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb00072d0 con 0x7f0bc00ad2b0 2024-03-23T23:46:59.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.386+0000 7f0bc5000640 1 --2- 172.21.15.8:0/3713864732 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b98002a80 0x7f0b98004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:59.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.386+0000 7f0bc5000640 1 -- 172.21.15.8:0/3713864732 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b98007ed0 con 0x7f0b98002a80 2024-03-23T23:46:59.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.390+0000 7f0bbd400640 1 --2- 172.21.15.8:0/3713864732 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b98002a80 0x7f0b98004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:59.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.390+0000 7f0bbd400640 1 -- 172.21.15.8:0/3713864732 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0b980080d0 con 0x7f0b98002a80 2024-03-23T23:46:59.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.390+0000 7f0bbd400640 1 --2- 172.21.15.8:0/3713864732 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b98002a80 0x7f0b98004f40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0068d70 tx=0x7f0bac00c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:59.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.394+0000 7f0bb6000640 1 -- 172.21.15.8:0/3713864732 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f0bb001a070 con 0x7f0bc00ad2b0 2024-03-23T23:46:59.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.398+0000 7f0bb6000640 1 --2- 172.21.15.8:0/3713864732 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0ba0067610 0x7f0ba0069ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:59.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.398+0000 7f0bb6000640 1 -- 172.21.15.8:0/3713864732 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f0bb0053160 con 0x7f0bc00ad2b0 2024-03-23T23:46:59.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.398+0000 7f0bb6000640 1 -- 172.21.15.8:0/3713864732 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bac017070 con 0x7f0b98002a80 2024-03-23T23:46:59.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.398+0000 7f0bbe800640 1 --2- 172.21.15.8:0/3713864732 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0ba0067610 0x7f0ba0069ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:59.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.402+0000 7f0bbe800640 1 --2- 172.21.15.8:0/3713864732 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0ba0067610 0x7f0ba0069ad0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0bb80194f0 tx=0x7f0bb80a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:59.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.402+0000 7f0bb6000640 1 -- 172.21.15.8:0/3713864732 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f0bac005c60 con 0x7f0b98002a80 2024-03-23T23:46:59.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.402+0000 7f0bb6000640 1 -- 172.21.15.8:0/3713864732 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b98002a80 msgr2=0x7f0b98004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:59.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.402+0000 7f0bb6000640 1 --2- 172.21.15.8:0/3713864732 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b98002a80 0x7f0b98004f40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0068d70 tx=0x7f0bac00c7a0 comp rx=0 tx=0).stop 2024-03-23T23:46:59.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.402+0000 7f0bb6000640 1 -- 172.21.15.8:0/3713864732 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b98002a80 msgr2=0x7f0b98004f40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:46:59.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.402+0000 7f0bb6000640 1 --2- 172.21.15.8:0/3713864732 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b98002a80 0x7f0b98004f40 secure :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0068d70 tx=0x7f0bac00c7a0 comp rx=0 tx=0).stop 2024-03-23T23:46:59.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.426+0000 7f0bc5000640 1 --2- 172.21.15.8:0/3713864732 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b98006f10 0x7f0b980073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:46:59.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.426+0000 7f0bc5000640 1 -- 172.21.15.8:0/3713864732 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9800a4b0 con 0x7f0b98006f10 2024-03-23T23:46:59.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.426+0000 7f0bbd400640 1 --2- 172.21.15.8:0/3713864732 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b98006f10 0x7f0b980073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:46:59.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.430+0000 7f0bbd400640 1 -- 172.21.15.8:0/3713864732 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0b980078e0 con 0x7f0b98006f10 2024-03-23T23:46:59.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.430+0000 7f0bbd400640 1 --2- 172.21.15.8:0/3713864732 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b98006f10 0x7f0b980073a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0068d70 tx=0x7f0bac000f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:46:59.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.430+0000 7f0bb6000640 1 -- 172.21.15.8:0/3713864732 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bac0076d0 con 0x7f0b98006f10 2024-03-23T23:46:59.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.430+0000 7f0bb6000640 1 -- 172.21.15.8:0/3713864732 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5171 (secure 0 0 0) 0x7f0bac005e10 con 0x7f0b98006f10 2024-03-23T23:46:59.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.430+0000 7f0bb6000640 1 -- 172.21.15.8:0/3713864732 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b98006f10 msgr2=0x7f0b980073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:59.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.430+0000 7f0bb6000640 1 --2- 172.21.15.8:0/3713864732 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b98006f10 0x7f0b980073a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0068d70 tx=0x7f0bac000f90 comp rx=0 tx=0).stop 2024-03-23T23:46:59.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.430+0000 7f0bb6000640 1 -- 172.21.15.8:0/3713864732 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b98006f10 msgr2=0x7f0b980073a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:46:59.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.430+0000 7f0bb6000640 1 --2- 172.21.15.8:0/3713864732 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b98006f10 0x7f0b980073a0 secure :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0068d70 tx=0x7f0bac000f90 comp rx=0 tx=0).stop 2024-03-23T23:46:59.432 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:46:59.432 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:46:59.432 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:46:59.432 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:46:59.432 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 32, 2024-03-23T23:46:59.432 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:46:59.432 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:46:59.432 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:46:59.432 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:59.432 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 2, 2024-03-23T23:46:59.432 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:46:59.432 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:46:59.433 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:46:59.433 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:46:59.433 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:46:59.433 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:46:59.433 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:46:59.433 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:46:59.433 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:46:59.433 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:46:59.433 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:46:59.433 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:46:59.433 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:46:59.433 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:46:59.433 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:59.433 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:46:59.434 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:46:59.434 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:46:59.434 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:46:59.434 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:46:59.434 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:46:59.434 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:46:59.434 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:46:59.434 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:46:59.434 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:46:59.434 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:46:59.434 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:46:59.435 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:46:59.435 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:59.435 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:59.435 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:46:59.435 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:46:59.435 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:46:59.435 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:46:59.435 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:46:59.435 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:46:59.435 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:46:59.435 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:46:59.435 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:46:59.435 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:46:59.435 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:46:59.435 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:46:59.436 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:46:59.436 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:46:59.436 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:46:59.436 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:46:59.436 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:46:59.436 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:46:59.436 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:46:59.436 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:46:59.436 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:46:59.436 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:46:59.436 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:46:59.436 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:46:59.436 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:46:59.436 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:46:59.437 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:46:59.437 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:46:59.437 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:59.437 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:46:59.437 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:59.437 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:46:59.437 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:59.437 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:46:59.437 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:46:59.437 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:46:59.437 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:46:59.437 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:59.437 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:46:59.438 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:46:59.438 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:59.438 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:59.438 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:59.438 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:46:59.438 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:46:59.438 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:59.438 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:59.438 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:59.438 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:59.438 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:46:59.438 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:46:59.438 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:46:59.439 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:46:59.439 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:46:59.439 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:59.439 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:59.439 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:46:59.439 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:46:59.439 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:46:59.439 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:46:59.439 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:59.439 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:46:59.439 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:46:59.439 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:59.439 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:59.439 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:59.440 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:46:59.440 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:46:59.440 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:59.440 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:59.440 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:59.440 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:59.440 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:46:59.440 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:46:59.440 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:46:59.440 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:46:59.440 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:46:59.440 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:59.440 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:59.440 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:46:59.441 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:46:59.441 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:46:59.441 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:46:59.441 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:59.441 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:46:59.441 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:46:59.441 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:59.441 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:59.441 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:59.441 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:46:59.441 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:46:59.441 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:46:59.442 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:59.442 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:59.442 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:59.442 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:46:59.442 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:46:59.442 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:46:59.442 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:46:59.442 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:46:59.442 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:59.442 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:59.442 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:59.442 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:46:59.442 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:46:59.443 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:59.443 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:46:59.443 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:46:59.443 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:46:59.443 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:59.443 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:59.443 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:46:59.443 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:59.443 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:46:59.443 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:46:59.443 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:46:59.443 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:59.443 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:59.443 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:46:59.444 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:59.444 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:46:59.444 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:46:59.444 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 8 2024-03-23T23:46:59.444 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:59.444 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:59.444 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:46:59.444 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:59.444 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:46:59.444 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:46:59.444 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:46:59.444 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:59.444 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:59.444 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:46:59.444 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:46:59.445 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 6 2024-03-23T23:46:59.445 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:59.445 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:46:59.445 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:46:59.445 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:46:59.445 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:46:59.445 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:46:59.445 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:46:59.445 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:46:59.445 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:46:59.445 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:46:59.445 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:46:59.445 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:46:59.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.438+0000 7f0bc5000640 1 -- 172.21.15.8:0/3713864732 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0ba0067610 msgr2=0x7f0ba0069ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:59.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.438+0000 7f0bc5000640 1 --2- 172.21.15.8:0/3713864732 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0ba0067610 0x7f0ba0069ad0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0bb80194f0 tx=0x7f0bb80a7070 comp rx=0 tx=0).stop 2024-03-23T23:46:59.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.438+0000 7f0bc5000640 1 -- 172.21.15.8:0/3713864732 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bc00ad2b0 msgr2=0x7f0bc015be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:46:59.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.438+0000 7f0bc5000640 1 --2- 172.21.15.8:0/3713864732 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bc00ad2b0 0x7f0bc015be30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000c370 tx=0x7f0bb000c830 comp rx=0 tx=0).stop 2024-03-23T23:46:59.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.438+0000 7f0bbe800640 1 -- 172.21.15.8:0/3713864732 reap_dead start 2024-03-23T23:46:59.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.438+0000 7f0bbe800640 1 -- 172.21.15.8:0/3713864732 reap_dead start 2024-03-23T23:46:59.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.438+0000 7f0bc5000640 1 -- 172.21.15.8:0/3713864732 shutdown_connections 2024-03-23T23:46:59.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.438+0000 7f0bc5000640 1 -- 172.21.15.8:0/3713864732 >> 172.21.15.8:0/3713864732 conn(0x7f0bc00cb690 msgr2=0x7f0bc0157d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:46:59.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.450+0000 7f0bc5000640 1 -- 172.21.15.8:0/3713864732 shutdown_connections 2024-03-23T23:46:59.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:46:59.450+0000 7f0bc5000640 1 -- 172.21.15.8:0/3713864732 wait complete. 2024-03-23T23:46:59.518 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T23:46:59.518 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-03-23T23:47:13.225 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:47:13.230 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:47:19.518 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-03-23T23:47:19.519 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-03-23T23:47:19.519 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-23T23:47:19.519 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-23T23:47:19.522 INFO:tasks.ceph.mon.a:Started 2024-03-23T23:47:19.523 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T23:47:19.523 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:47:19.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.894+0000 7f8ea0400640 1 Processor -- start 2024-03-23T23:47:19.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.894+0000 7f8ea0400640 1 -- start start 2024-03-23T23:47:19.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.894+0000 7f8ea0400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8e980c1d40 0x7f8e980abe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:19.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.894+0000 7f8ea0400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e980aa390 0x7f8e98157010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:19.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.894+0000 7f8ea0400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e98072f40 con 0x7f8e980710f0 2024-03-23T23:47:19.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.894+0000 7f8ea0400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e980ab420 con 0x7f8e980c1d40 2024-03-23T23:47:19.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.894+0000 7f8ea0400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e980ab9c0 con 0x7f8e980aa390 2024-03-23T23:47:19.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.898+0000 7f8e9da00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f8e980710f0 0x7f8e9815a7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:45948/0 (socket says 172.21.15.8:45948) 2024-03-23T23:47:19.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.898+0000 7f8e9da00640 1 -- 172.21.15.8:0/2158325999 learned_addr learned my addr 172.21.15.8:0/2158325999 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:47:19.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.898+0000 7f8e9e400640 1 --2- 172.21.15.8:0/2158325999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e980aa390 0x7f8e98157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:19.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.898+0000 7f8e9d000640 1 --2- 172.21.15.8:0/2158325999 >> v2:172.21.15.196:3300/0 conn(0x7f8e980c1d40 0x7f8e980abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:19.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.902+0000 7f8e9e400640 1 -- 172.21.15.8:0/2158325999 >> v2:172.21.15.196:3300/0 conn(0x7f8e980c1d40 msgr2=0x7f8e980abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:47:19.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.902+0000 7f8e9e400640 1 --2- 172.21.15.8:0/2158325999 >> v2:172.21.15.196:3300/0 conn(0x7f8e980c1d40 0x7f8e980abe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:19.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.902+0000 7f8e9e400640 1 -- 172.21.15.8:0/2158325999 >> v1:172.21.15.8:6789/0 conn(0x7f8e980710f0 legacy=0x7f8e9815a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:19.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.902+0000 7f8e9e400640 1 -- 172.21.15.8:0/2158325999 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e980ab690 con 0x7f8e980aa390 2024-03-23T23:47:19.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.910+0000 7f8e9e400640 1 --2- 172.21.15.8:0/2158325999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e980aa390 0x7f8e98157010 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8e90009d90 tx=0x7f8e9001c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5aa616b731a3db20 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:19.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.910+0000 7f8e97e00640 1 -- 172.21.15.8:0/2158325999 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e900b2070 con 0x7f8e980aa390 2024-03-23T23:47:19.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.910+0000 7f8e97e00640 1 -- 172.21.15.8:0/2158325999 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e900a5990 con 0x7f8e980aa390 2024-03-23T23:47:19.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.910+0000 7f8e97e00640 1 -- 172.21.15.8:0/2158325999 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e900a5d60 con 0x7f8e980aa390 2024-03-23T23:47:19.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.910+0000 7f8ea0400640 1 -- 172.21.15.8:0/2158325999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e980aa390 msgr2=0x7f8e98157010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:19.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.910+0000 7f8ea0400640 1 --2- 172.21.15.8:0/2158325999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e980aa390 0x7f8e98157010 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8e90009d90 tx=0x7f8e9001c8b0 comp rx=0 tx=0).stop 2024-03-23T23:47:19.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.910+0000 7f8ea0400640 1 -- 172.21.15.8:0/2158325999 shutdown_connections 2024-03-23T23:47:19.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.910+0000 7f8ea0400640 1 --2- 172.21.15.8:0/2158325999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e980aa390 0x7f8e98157010 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:19.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.910+0000 7f8ea0400640 1 --2- 172.21.15.8:0/2158325999 >> v2:172.21.15.196:3300/0 conn(0x7f8e980c1d40 0x7f8e980abe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:19.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.910+0000 7f8ea0400640 1 -- 172.21.15.8:0/2158325999 >> 172.21.15.8:0/2158325999 conn(0x7f8e980c7170 msgr2=0x7f8e980c7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:47:19.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.914+0000 7f8ea0400640 1 -- 172.21.15.8:0/2158325999 shutdown_connections 2024-03-23T23:47:19.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.914+0000 7f8ea0400640 1 -- 172.21.15.8:0/2158325999 wait complete. 2024-03-23T23:47:19.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.914+0000 7f8ea0400640 1 Processor -- start 2024-03-23T23:47:19.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.914+0000 7f8ea0400640 1 -- start start 2024-03-23T23:47:19.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.918+0000 7f8ea0400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e980710f0 0x7f8e98154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:19.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.918+0000 7f8ea0400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e980aa390 0x7f8e9815bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:19.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.918+0000 7f8ea0400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e980c1d40 0x7f8e9815ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:19.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.918+0000 7f8e9e400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e980c1d40 0x7f8e9815ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:19.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.918+0000 7f8e9e400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e980c1d40 0x7f8e9815ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46372/0 (socket says 172.21.15.8:46372) 2024-03-23T23:47:19.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.918+0000 7f8e9e400640 1 -- 172.21.15.8:0/1839439654 learned_addr learned my addr 172.21.15.8:0/1839439654 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:47:19.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.918+0000 7f8ea0400640 1 -- 172.21.15.8:0/1839439654 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e98071650 con 0x7f8e980c1d40 2024-03-23T23:47:19.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.918+0000 7f8ea0400640 1 -- 172.21.15.8:0/1839439654 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e980714d0 con 0x7f8e980aa390 2024-03-23T23:47:19.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.918+0000 7f8ea0400640 1 -- 172.21.15.8:0/1839439654 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e98166f10 con 0x7f8e980710f0 2024-03-23T23:47:19.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.918+0000 7f8e9da00640 1 --2- 172.21.15.8:0/1839439654 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e980710f0 0x7f8e98154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:19.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.918+0000 7f8e9e400640 1 -- 172.21.15.8:0/1839439654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e980c1d40 msgr2=0x7f8e9815ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-03-23T23:47:19.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.918+0000 7f8e9e400640 1 -- 172.21.15.8:0/1839439654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e980c1d40 msgr2=0x7f8e9815ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T23:47:19.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.918+0000 7f8e9e400640 1 --2- 172.21.15.8:0/1839439654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e980c1d40 0x7f8e9815ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:47:19.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.918+0000 7f8e9e400640 1 --2- 172.21.15.8:0/1839439654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e980c1d40 0x7f8e9815ef80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:47:19.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.922+0000 7f8e9d000640 1 --2- 172.21.15.8:0/1839439654 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e980aa390 0x7f8e9815bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:19.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.922+0000 7f8e9d000640 1 -- 172.21.15.8:0/1839439654 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e980710f0 msgr2=0x7f8e98154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:19.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.922+0000 7f8e9d000640 1 --2- 172.21.15.8:0/1839439654 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e980710f0 0x7f8e98154c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:19.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.922+0000 7f8e9d000640 1 -- 172.21.15.8:0/1839439654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e980c1d40 msgr2=0x7f8e9815ef80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:47:19.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.922+0000 7f8e9d000640 1 --2- 172.21.15.8:0/1839439654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e980c1d40 0x7f8e9815ef80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:19.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.922+0000 7f8e9d000640 1 -- 172.21.15.8:0/1839439654 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e981553b0 con 0x7f8e980aa390 2024-03-23T23:47:19.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.922+0000 7f8e9da00640 1 --2- 172.21.15.8:0/1839439654 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e980710f0 0x7f8e98154c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:47:19.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.926+0000 7f8e9d000640 1 --2- 172.21.15.8:0/1839439654 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e980aa390 0x7f8e9815bd80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8e8400e840 tx=0x7f8e8400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:19.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.930+0000 7f8e95600640 1 -- 172.21.15.8:0/1839439654 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e84017070 con 0x7f8e980aa390 2024-03-23T23:47:19.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.930+0000 7f8e95600640 1 -- 172.21.15.8:0/1839439654 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8400c730 con 0x7f8e980aa390 2024-03-23T23:47:19.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.930+0000 7f8e95600640 1 -- 172.21.15.8:0/1839439654 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8400cb00 con 0x7f8e980aa390 2024-03-23T23:47:19.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.930+0000 7f8ea0400640 1 -- 172.21.15.8:0/1839439654 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e980c1330 con 0x7f8e980aa390 2024-03-23T23:47:19.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.930+0000 7f8ea0400640 1 -- 172.21.15.8:0/1839439654 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e98154730 con 0x7f8e980aa390 2024-03-23T23:47:19.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.934+0000 7f8ea0400640 1 -- 172.21.15.8:0/1839439654 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e9804f480 con 0x7f8e980aa390 2024-03-23T23:47:19.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.934+0000 7f8e95600640 1 -- 172.21.15.8:0/1839439654 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f8e8401a070 con 0x7f8e980aa390 2024-03-23T23:47:19.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.938+0000 7f8e95600640 1 --2- 172.21.15.8:0/1839439654 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8e78067760 0x7f8e78069c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:19.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.938+0000 7f8e95600640 1 -- 172.21.15.8:0/1839439654 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f8e84085a00 con 0x7f8e980aa390 2024-03-23T23:47:19.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.938+0000 7f8e9da00640 1 --2- 172.21.15.8:0/1839439654 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8e78067760 0x7f8e78069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:19.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.942+0000 7f8e9da00640 1 --2- 172.21.15.8:0/1839439654 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8e78067760 0x7f8e78069c20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c005890 tx=0x7f8e8c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:19.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:19.978+0000 7f8e95600640 1 -- 172.21.15.8:0/1839439654 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f8e84056330 con 0x7f8e980aa390 2024-03-23T23:47:20.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:20.550+0000 7f8ea0400640 1 -- 172.21.15.8:0/1839439654 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f8e980aad70 con 0x7f8e980aa390 2024-03-23T23:47:21.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.294+0000 7f8e95600640 1 -- 172.21.15.8:0/1839439654 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1560 (secure 0 0 0) 0x7f8e84055c30 con 0x7f8e980aa390 2024-03-23T23:47:21.297 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":36,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:47:21.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.314+0000 7f8ea0400640 1 -- 172.21.15.8:0/1839439654 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8e78067760 msgr2=0x7f8e78069c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:21.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.314+0000 7f8ea0400640 1 --2- 172.21.15.8:0/1839439654 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8e78067760 0x7f8e78069c20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c005890 tx=0x7f8e8c009040 comp rx=0 tx=0).stop 2024-03-23T23:47:21.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.314+0000 7f8ea0400640 1 -- 172.21.15.8:0/1839439654 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e980aa390 msgr2=0x7f8e9815bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:21.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.314+0000 7f8ea0400640 1 --2- 172.21.15.8:0/1839439654 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e980aa390 0x7f8e9815bd80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8e8400e840 tx=0x7f8e8400ed00 comp rx=0 tx=0).stop 2024-03-23T23:47:21.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.326+0000 7f8ea0400640 1 -- 172.21.15.8:0/1839439654 shutdown_connections 2024-03-23T23:47:21.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.326+0000 7f8ea0400640 1 --2- 172.21.15.8:0/1839439654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e980c1d40 0x7f8e9815ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:21.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.326+0000 7f8ea0400640 1 --2- 172.21.15.8:0/1839439654 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e980aa390 0x7f8e9815bd80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:21.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.326+0000 7f8ea0400640 1 --2- 172.21.15.8:0/1839439654 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8e78067760 0x7f8e78069c20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:21.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.326+0000 7f8ea0400640 1 --2- 172.21.15.8:0/1839439654 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e980710f0 0x7f8e98154c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:21.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.326+0000 7f8ea0400640 1 -- 172.21.15.8:0/1839439654 >> 172.21.15.8:0/1839439654 conn(0x7f8e980c7170 msgr2=0x7f8e98159890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:47:21.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.330+0000 7f8ea0400640 1 -- 172.21.15.8:0/1839439654 shutdown_connections 2024-03-23T23:47:21.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.338+0000 7f8ea0400640 1 -- 172.21.15.8:0/1839439654 wait complete. 2024-03-23T23:47:21.397 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T23:47:21.397 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T23:47:21.398 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:47:21.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.742+0000 7fd773e00640 1 Processor -- start 2024-03-23T23:47:21.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.742+0000 7fd773e00640 1 -- start start 2024-03-23T23:47:21.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.742+0000 7fd773e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd77406ec20 0x7fd774072fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:21.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.742+0000 7fd773e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd77414ebb0 0x7fd77414f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:21.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.742+0000 7fd773e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd774152360 con 0x7fd77406f160 2024-03-23T23:47:21.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.742+0000 7fd773e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd77406db60 con 0x7fd77406ec20 2024-03-23T23:47:21.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.742+0000 7fd773e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd774152640 con 0x7fd77414ebb0 2024-03-23T23:47:21.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.746+0000 7fd772a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd77406f160 0x7fd7740715d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:45950/0 (socket says 172.21.15.8:45950) 2024-03-23T23:47:21.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.746+0000 7fd772a00640 1 -- 172.21.15.8:0/1635091828 learned_addr learned my addr 172.21.15.8:0/1635091828 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:47:21.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.750+0000 7fd771600640 1 -- 172.21.15.8:0/1635091828 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 591509835 0 0) 0x7fd774152360 con 0x7fd77406f160 2024-03-23T23:47:21.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.750+0000 7fd771600640 1 -- 172.21.15.8:0/1635091828 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd758003530 con 0x7fd77406f160 2024-03-23T23:47:21.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.750+0000 7fd771600640 1 -- 172.21.15.8:0/1635091828 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2881392613 0 0) 0x7fd758003530 con 0x7fd77406f160 2024-03-23T23:47:21.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.750+0000 7fd773400640 1 --2- 172.21.15.8:0/1635091828 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd77414ebb0 0x7fd77414f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:21.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.750+0000 7fd771600640 1 -- 172.21.15.8:0/1635091828 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd77414ebb0 msgr2=0x7fd77414f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:47:21.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.750+0000 7fd771600640 1 --2- 172.21.15.8:0/1635091828 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd77414ebb0 0x7fd77414f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:21.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.750+0000 7fd771600640 1 -- 172.21.15.8:0/1635091828 >> v2:172.21.15.196:3300/0 conn(0x7fd77406ec20 msgr2=0x7fd774072fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:47:21.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.750+0000 7fd771600640 1 --2- 172.21.15.8:0/1635091828 >> v2:172.21.15.196:3300/0 conn(0x7fd77406ec20 0x7fd774072fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:21.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.750+0000 7fd771600640 1 -- 172.21.15.8:0/1635091828 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7740c1ad0 con 0x7fd77406f160 2024-03-23T23:47:21.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.750+0000 7fd771600640 1 -- 172.21.15.8:0/1635091828 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7fd764001680 con 0x7fd77406f160 2024-03-23T23:47:21.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.750+0000 7fd771600640 1 -- 172.21.15.8:0/1635091828 >> v1:172.21.15.8:6789/0 conn(0x7fd77406f160 legacy=0x7fd7740715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:21.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.750+0000 7fd771600640 1 --2- 172.21.15.8:0/1635091828 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7580039c0 0x7fd758003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:21.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.750+0000 7fd771600640 1 --2- 172.21.15.8:0/1635091828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd758004810 0x7fd758004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:21.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.750+0000 7fd771600640 1 --2- 172.21.15.8:0/1635091828 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7580052f0 0x7fd75800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:21.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.750+0000 7fd771600640 1 -- 172.21.15.8:0/1635091828 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77406db60 con 0x7fd758004810 2024-03-23T23:47:21.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.750+0000 7fd771600640 1 -- 172.21.15.8:0/1635091828 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd774152640 con 0x7fd7580039c0 2024-03-23T23:47:21.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.750+0000 7fd771600640 1 -- 172.21.15.8:0/1635091828 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75800c200 con 0x7fd7580052f0 2024-03-23T23:47:21.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.750+0000 7fd773400640 1 --2- 172.21.15.8:0/1635091828 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd77414ebb0 0x7fd77414f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:47:21.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.750+0000 7fd772000640 1 --2- 172.21.15.8:0/1635091828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd758004810 0x7fd758004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:21.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.750+0000 7fd773400640 1 --2- 172.21.15.8:0/1635091828 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7580052f0 0x7fd75800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:21.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.750+0000 7fd772000640 1 -- 172.21.15.8:0/1635091828 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7580052f0 msgr2=0x7fd75800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:47:21.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.750+0000 7fd772000640 1 --2- 172.21.15.8:0/1635091828 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7580052f0 0x7fd75800b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:21.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.750+0000 7fd772000640 1 -- 172.21.15.8:0/1635091828 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7580039c0 msgr2=0x7fd758003de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:47:21.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.750+0000 7fd772000640 1 --2- 172.21.15.8:0/1635091828 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7580039c0 0x7fd758003de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:21.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.750+0000 7fd772000640 1 -- 172.21.15.8:0/1635091828 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd758003530 con 0x7fd758004810 2024-03-23T23:47:21.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.754+0000 7fd772000640 1 --2- 172.21.15.8:0/1635091828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd758004810 0x7fd758004c90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd760009860 tx=0x7fd76001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cbeaf5be2dd30eb server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:21.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.754+0000 7fd771600640 1 -- 172.21.15.8:0/1635091828 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7600b0070 con 0x7fd758004810 2024-03-23T23:47:21.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.754+0000 7fd771600640 1 -- 172.21.15.8:0/1635091828 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7600ab620 con 0x7fd758004810 2024-03-23T23:47:21.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.754+0000 7fd771600640 1 -- 172.21.15.8:0/1635091828 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd760009460 con 0x7fd758004810 2024-03-23T23:47:21.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.758+0000 7fd773e00640 1 -- 172.21.15.8:0/1635091828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd758004810 msgr2=0x7fd758004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:21.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.758+0000 7fd773e00640 1 --2- 172.21.15.8:0/1635091828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd758004810 0x7fd758004c90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd760009860 tx=0x7fd76001c3a0 comp rx=0 tx=0).stop 2024-03-23T23:47:21.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.758+0000 7fd773400640 1 -- 172.21.15.8:0/1635091828 reap_dead start 2024-03-23T23:47:21.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.758+0000 7fd773e00640 1 -- 172.21.15.8:0/1635091828 shutdown_connections 2024-03-23T23:47:21.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.758+0000 7fd773e00640 1 -- 172.21.15.8:0/1635091828 >> 172.21.15.8:0/1635091828 conn(0x7fd77406b170 msgr2=0x7fd77406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:47:21.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.758+0000 7fd773e00640 1 -- 172.21.15.8:0/1635091828 shutdown_connections 2024-03-23T23:47:21.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.758+0000 7fd773e00640 1 -- 172.21.15.8:0/1635091828 wait complete. 2024-03-23T23:47:21.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.766+0000 7fd773e00640 1 Processor -- start 2024-03-23T23:47:21.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.766+0000 7fd773e00640 1 -- start start 2024-03-23T23:47:21.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.774+0000 7fd773e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd758004810 0x7fd7741544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:21.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.774+0000 7fd773e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd774155810 0x7fd7740abdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:21.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.774+0000 7fd773e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7741527c0 0x7fd7740c08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:21.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.774+0000 7fd773e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7740c1ca0 con 0x7fd7741527c0 2024-03-23T23:47:21.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.774+0000 7fd773e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77414f2f0 con 0x7fd774155810 2024-03-23T23:47:21.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.774+0000 7fd773e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7740c1e20 con 0x7fd758004810 2024-03-23T23:47:21.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.774+0000 7fd772a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd758004810 0x7fd7741544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:21.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.774+0000 7fd773400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7741527c0 0x7fd7740c08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:21.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.774+0000 7fd773400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7741527c0 0x7fd7740c08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46402/0 (socket says 172.21.15.8:46402) 2024-03-23T23:47:21.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.774+0000 7fd773400640 1 -- 172.21.15.8:0/1417408866 learned_addr learned my addr 172.21.15.8:0/1417408866 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:47:21.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.778+0000 7fd772000640 1 --2- 172.21.15.8:0/1417408866 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd774155810 0x7fd7740abdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:21.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.778+0000 7fd772a00640 1 -- 172.21.15.8:0/1417408866 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd774155810 msgr2=0x7fd7740abdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:21.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.778+0000 7fd772a00640 1 --2- 172.21.15.8:0/1417408866 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd774155810 0x7fd7740abdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:21.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.778+0000 7fd772a00640 1 -- 172.21.15.8:0/1417408866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7741527c0 msgr2=0x7fd7740c08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:21.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.778+0000 7fd772a00640 1 --2- 172.21.15.8:0/1417408866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7741527c0 0x7fd7740c08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:21.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.778+0000 7fd772a00640 1 -- 172.21.15.8:0/1417408866 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7740bcad0 con 0x7fd758004810 2024-03-23T23:47:21.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.778+0000 7fd772a00640 1 --2- 172.21.15.8:0/1417408866 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd758004810 0x7fd7741544f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd7640058b0 tx=0x7fd76400fb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:21.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.782+0000 7fd76aa00640 1 -- 172.21.15.8:0/1417408866 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76401b070 con 0x7fd758004810 2024-03-23T23:47:21.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.782+0000 7fd76aa00640 1 -- 172.21.15.8:0/1417408866 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd764007af0 con 0x7fd758004810 2024-03-23T23:47:21.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.782+0000 7fd76aa00640 1 -- 172.21.15.8:0/1417408866 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76400a0d0 con 0x7fd758004810 2024-03-23T23:47:21.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.782+0000 7fd773e00640 1 -- 172.21.15.8:0/1417408866 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd774155180 con 0x7fd758004810 2024-03-23T23:47:21.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.782+0000 7fd773e00640 1 -- 172.21.15.8:0/1417408866 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd774153cf0 con 0x7fd758004810 2024-03-23T23:47:21.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.794+0000 7fd773e00640 1 --2- 172.21.15.8:0/1417408866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd774152bd0 0x7fd7740c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:21.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.794+0000 7fd773e00640 1 -- 172.21.15.8:0/1417408866 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd774154a30 con 0x7fd774152bd0 2024-03-23T23:47:21.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.802+0000 7fd76aa00640 1 -- 172.21.15.8:0/1417408866 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd76401e070 con 0x7fd758004810 2024-03-23T23:47:21.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.802+0000 7fd76aa00640 1 --2- 172.21.15.8:0/1417408866 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd754067730 0x7fd754069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:21.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.802+0000 7fd76aa00640 1 -- 172.21.15.8:0/1417408866 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fd7640880c0 con 0x7fd758004810 2024-03-23T23:47:21.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.810+0000 7fd772000640 1 --2- 172.21.15.8:0/1417408866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd774152bd0 0x7fd7740c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:21.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.810+0000 7fd773400640 1 --2- 172.21.15.8:0/1417408866 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd754067730 0x7fd754069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:21.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.814+0000 7fd773400640 1 --2- 172.21.15.8:0/1417408866 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd754067730 0x7fd754069bf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd77406c1b0 tx=0x7fd76c004ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:21.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.826+0000 7fd772000640 1 -- 172.21.15.8:0/1417408866 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd7740c1350 con 0x7fd774152bd0 2024-03-23T23:47:21.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.846+0000 7fd772000640 1 --2- 172.21.15.8:0/1417408866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd774152bd0 0x7fd7740c0e10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd77406f080 tx=0x7fd758005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:21.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.846+0000 7fd76aa00640 1 -- 172.21.15.8:0/1417408866 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7600bb070 con 0x7fd774152bd0 2024-03-23T23:47:21.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.850+0000 7fd76aa00640 1 -- 172.21.15.8:0/1417408866 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fd760003600 con 0x7fd774152bd0 2024-03-23T23:47:21.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.850+0000 7fd76aa00640 1 -- 172.21.15.8:0/1417408866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd774152bd0 msgr2=0x7fd7740c0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:21.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.850+0000 7fd76aa00640 1 --2- 172.21.15.8:0/1417408866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd774152bd0 0x7fd7740c0e10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd77406f080 tx=0x7fd758005840 comp rx=0 tx=0).stop 2024-03-23T23:47:21.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.850+0000 7fd76aa00640 1 -- 172.21.15.8:0/1417408866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd774152bd0 msgr2=0x7fd7740c0e10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:47:21.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.850+0000 7fd76aa00640 1 --2- 172.21.15.8:0/1417408866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd774152bd0 0x7fd7740c0e10 secure :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd77406f080 tx=0x7fd758005840 comp rx=0 tx=0).stop 2024-03-23T23:47:21.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.874+0000 7fd773e00640 1 --2- 172.21.15.8:0/1417408866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd774134a00 0x7fd774134de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:21.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.874+0000 7fd773e00640 1 -- 172.21.15.8:0/1417408866 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd774068790 con 0x7fd774134a00 2024-03-23T23:47:21.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.874+0000 7fd772000640 1 --2- 172.21.15.8:0/1417408866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd774134a00 0x7fd774134de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:21.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.878+0000 7fd772000640 1 -- 172.21.15.8:0/1417408866 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd77404f410 con 0x7fd774134a00 2024-03-23T23:47:21.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.878+0000 7fd772000640 1 --2- 172.21.15.8:0/1417408866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd774134a00 0x7fd774134de0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd7600ae040 tx=0x7fd7600a6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:21.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.886+0000 7fd76aa00640 1 -- 172.21.15.8:0/1417408866 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7600b0040 con 0x7fd774134a00 2024-03-23T23:47:21.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.886+0000 7fd76aa00640 1 -- 172.21.15.8:0/1417408866 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4531 (secure 0 0 0) 0x7fd7600b77d0 con 0x7fd774134a00 2024-03-23T23:47:21.886 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:47:21.886 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:47:21.886 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:47:21.886 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:47:21.886 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 36, 2024-03-23T23:47:21.887 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:47:21.887 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:47:21.887 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:47:21.887 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:47:21.887 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:21.887 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 0, 2024-03-23T23:47:21.887 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:47:21.887 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:47:21.887 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:47:21.887 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:47:21.887 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:47:21.887 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:47:21.887 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:47:21.887 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:47:21.887 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:47:21.888 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:47:21.888 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:47:21.888 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:47:21.888 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:47:21.888 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:47:21.888 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:21.888 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:47:21.888 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:47:21.888 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:47:21.888 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:47:21.888 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:47:21.888 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:47:21.888 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:47:21.889 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:47:21.889 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:47:21.889 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:47:21.889 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:47:21.889 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:47:21.889 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:47:21.889 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:21.889 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:21.890 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:47:21.890 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:47:21.890 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:47:21.890 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:47:21.890 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:47:21.890 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:47:21.890 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:47:21.890 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:47:21.890 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:47:21.890 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:47:21.890 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:47:21.890 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:47:21.890 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:47:21.891 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:47:21.891 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:47:21.891 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:47:21.891 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:47:21.891 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:47:21.891 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:47:21.891 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:47:21.891 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:47:21.891 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:47:21.891 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:47:21.891 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:47:21.891 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:47:21.891 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:47:21.891 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:47:21.892 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:47:21.892 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:21.892 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:47:21.892 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:21.892 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:47:21.892 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:21.892 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:47:21.892 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:47:21.892 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:47:21.892 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:47:21.892 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:21.892 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:47:21.892 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:47:21.893 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:21.893 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:21.893 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:21.893 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:47:21.893 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:47:21.893 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:21.893 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:21.893 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:21.893 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:21.893 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:47:21.893 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:47:21.893 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:47:21.893 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:47:21.893 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:47:21.894 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:21.894 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:21.894 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:47:21.894 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:47:21.894 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:47:21.894 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:47:21.894 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:21.894 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:47:21.894 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:47:21.894 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:21.894 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:21.894 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:21.894 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:47:21.895 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:47:21.895 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:21.895 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:21.895 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:21.895 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:21.895 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:47:21.895 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:47:21.895 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:47:21.895 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:47:21.895 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:47:21.895 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:21.895 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:21.895 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:47:21.896 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:47:21.896 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:47:21.896 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:47:21.896 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:21.896 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:47:21.896 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:47:21.896 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:21.896 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:21.896 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:21.896 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:47:21.896 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:47:21.896 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:21.896 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:21.896 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:21.897 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:21.897 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:47:21.897 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:47:21.897 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:47:21.897 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:47:21.897 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:47:21.897 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:21.897 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:21.897 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:21.897 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:47:21.897 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:47:21.897 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:21.897 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:47:21.898 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:21.898 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:47:21.898 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:21.898 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:21.898 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:47:21.898 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:21.898 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:47:21.898 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:21.898 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:47:21.898 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:21.898 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:21.898 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:21.899 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:47:21.899 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:47:21.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.886+0000 7fd76aa00640 1 -- 172.21.15.8:0/1417408866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd774134a00 msgr2=0x7fd774134de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:21.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.886+0000 7fd76aa00640 1 --2- 172.21.15.8:0/1417408866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd774134a00 0x7fd774134de0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd7600ae040 tx=0x7fd7600a6000 comp rx=0 tx=0).stop 2024-03-23T23:47:21.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.886+0000 7fd76aa00640 1 -- 172.21.15.8:0/1417408866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd774134a00 msgr2=0x7fd774134de0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:47:21.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.886+0000 7fd76aa00640 1 --2- 172.21.15.8:0/1417408866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd774134a00 0x7fd774134de0 secure :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd7600ae040 tx=0x7fd7600a6000 comp rx=0 tx=0).stop 2024-03-23T23:47:21.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.886+0000 7fd773e00640 1 -- 172.21.15.8:0/1417408866 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd754067730 msgr2=0x7fd754069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:21.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.886+0000 7fd773e00640 1 --2- 172.21.15.8:0/1417408866 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd754067730 0x7fd754069bf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd77406c1b0 tx=0x7fd76c004ac0 comp rx=0 tx=0).stop 2024-03-23T23:47:21.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.886+0000 7fd773e00640 1 -- 172.21.15.8:0/1417408866 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd758004810 msgr2=0x7fd7741544f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:21.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.886+0000 7fd773e00640 1 --2- 172.21.15.8:0/1417408866 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd758004810 0x7fd7741544f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd7640058b0 tx=0x7fd76400fb90 comp rx=0 tx=0).stop 2024-03-23T23:47:21.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.886+0000 7fd773400640 1 -- 172.21.15.8:0/1417408866 reap_dead start 2024-03-23T23:47:21.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.886+0000 7fd773400640 1 -- 172.21.15.8:0/1417408866 reap_dead start 2024-03-23T23:47:21.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.886+0000 7fd773e00640 1 -- 172.21.15.8:0/1417408866 shutdown_connections 2024-03-23T23:47:21.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.886+0000 7fd773e00640 1 -- 172.21.15.8:0/1417408866 >> 172.21.15.8:0/1417408866 conn(0x7fd77406b170 msgr2=0x7fd7740715b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:47:21.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.890+0000 7fd773e00640 1 -- 172.21.15.8:0/1417408866 shutdown_connections 2024-03-23T23:47:21.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:21.890+0000 7fd773e00640 1 -- 172.21.15.8:0/1417408866 wait complete. 2024-03-23T23:47:21.933 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:47:21.933 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T23:47:21.934 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:47:22.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.318+0000 7f0e81000640 1 Processor -- start 2024-03-23T23:47:22.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.322+0000 7f0e81000640 1 -- start start 2024-03-23T23:47:22.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.322+0000 7f0e81000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0e7c14ede0 0x7f0e7c072b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:22.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.322+0000 7f0e81000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e7c1522b0 0x7f0e7c0c2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:22.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.322+0000 7f0e81000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e7c06ccc0 con 0x7f0e7c0c2820 2024-03-23T23:47:22.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.322+0000 7f0e81000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e7c0c3760 con 0x7f0e7c14ede0 2024-03-23T23:47:22.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.322+0000 7f0e81000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c151710 con 0x7f0e7c1522b0 2024-03-23T23:47:22.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.326+0000 7f0e7aa00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f0e7c0c2820 0x7f0e7c151ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:42884/0 (socket says 172.21.15.8:42884) 2024-03-23T23:47:22.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.326+0000 7f0e7aa00640 1 -- 172.21.15.8:0/177350747 learned_addr learned my addr 172.21.15.8:0/177350747 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:47:22.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.326+0000 7f0e7b400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0e7c14ede0 0x7f0e7c072b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:22.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.326+0000 7f0e7b400640 1 -- 172.21.15.8:0/177350747 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e7c1522b0 msgr2=0x7f0e7c0c2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:47:22.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.326+0000 7f0e7b400640 1 --2- 172.21.15.8:0/177350747 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e7c1522b0 0x7f0e7c0c2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:22.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.326+0000 7f0e7b400640 1 -- 172.21.15.8:0/177350747 >> v1:172.21.15.196:6789/0 conn(0x7f0e7c0c2820 legacy=0x7f0e7c151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:47:22.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.326+0000 7f0e7b400640 1 -- 172.21.15.8:0/177350747 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7c06cfa0 con 0x7f0e7c14ede0 2024-03-23T23:47:22.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.334+0000 7f0e7b400640 1 --2- 172.21.15.8:0/177350747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e7c14ede0 0x7f0e7c072b30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c009d90 tx=0x7f0e6c01c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48e7ee8ec21f3212 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:22.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.338+0000 7f0e7a000640 1 -- 172.21.15.8:0/177350747 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c0b2070 con 0x7f0e7c14ede0 2024-03-23T23:47:22.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.338+0000 7f0e7a000640 1 -- 172.21.15.8:0/177350747 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6c0a57b0 con 0x7f0e7c14ede0 2024-03-23T23:47:22.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.338+0000 7f0e7a000640 1 -- 172.21.15.8:0/177350747 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c0a5b80 con 0x7f0e7c14ede0 2024-03-23T23:47:22.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.342+0000 7f0e81000640 1 -- 172.21.15.8:0/177350747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e7c14ede0 msgr2=0x7f0e7c072b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:22.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.342+0000 7f0e81000640 1 --2- 172.21.15.8:0/177350747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e7c14ede0 0x7f0e7c072b30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c009d90 tx=0x7f0e6c01c930 comp rx=0 tx=0).stop 2024-03-23T23:47:22.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.342+0000 7f0e81000640 1 -- 172.21.15.8:0/177350747 shutdown_connections 2024-03-23T23:47:22.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.342+0000 7f0e81000640 1 --2- 172.21.15.8:0/177350747 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e7c1522b0 0x7f0e7c0c2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:22.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.342+0000 7f0e81000640 1 --2- 172.21.15.8:0/177350747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e7c14ede0 0x7f0e7c072b30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:22.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.342+0000 7f0e81000640 1 -- 172.21.15.8:0/177350747 >> 172.21.15.8:0/177350747 conn(0x7f0e7c0c3910 msgr2=0x7f0e7c0c3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:47:22.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.342+0000 7f0e81000640 1 -- 172.21.15.8:0/177350747 shutdown_connections 2024-03-23T23:47:22.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.342+0000 7f0e81000640 1 -- 172.21.15.8:0/177350747 wait complete. 2024-03-23T23:47:22.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.346+0000 7f0e81000640 1 Processor -- start 2024-03-23T23:47:22.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.346+0000 7f0e81000640 1 -- start start 2024-03-23T23:47:22.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.350+0000 7f0e81000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e7c0c2820 0x7f0e7c154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:22.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.350+0000 7f0e81000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e7c14ede0 0x7f0e7c1f4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:22.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.350+0000 7f0e81000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e7c1522b0 0x7f0e7c15a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:22.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.350+0000 7f0e81000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c06c940 con 0x7f0e7c14ede0 2024-03-23T23:47:22.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.350+0000 7f0e81000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c070be0 con 0x7f0e7c1522b0 2024-03-23T23:47:22.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.350+0000 7f0e81000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c160b30 con 0x7f0e7c0c2820 2024-03-23T23:47:22.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.350+0000 7f0e7be00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e7c1522b0 0x7f0e7c15a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:22.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.350+0000 7f0e7be00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e7c1522b0 0x7f0e7c15a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:44154/0 (socket says 172.21.15.8:44154) 2024-03-23T23:47:22.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.350+0000 7f0e7be00640 1 -- 172.21.15.8:0/4012226115 learned_addr learned my addr 172.21.15.8:0/4012226115 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:47:22.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.350+0000 7f0e7b400640 1 --2- 172.21.15.8:0/4012226115 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e7c0c2820 0x7f0e7c154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:22.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.354+0000 7f0e7aa00640 1 --2- 172.21.15.8:0/4012226115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e7c14ede0 0x7f0e7c1f4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:22.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.354+0000 7f0e7b400640 1 -- 172.21.15.8:0/4012226115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e7c1522b0 msgr2=0x7f0e7c15a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:22.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.354+0000 7f0e7b400640 1 --2- 172.21.15.8:0/4012226115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e7c1522b0 0x7f0e7c15a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:22.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.354+0000 7f0e7b400640 1 -- 172.21.15.8:0/4012226115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e7c14ede0 msgr2=0x7f0e7c1f4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:22.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.354+0000 7f0e7b400640 1 --2- 172.21.15.8:0/4012226115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e7c14ede0 0x7f0e7c1f4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:22.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.354+0000 7f0e7b400640 1 -- 172.21.15.8:0/4012226115 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7c0a9470 con 0x7f0e7c0c2820 2024-03-23T23:47:22.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.362+0000 7f0e7b400640 1 --2- 172.21.15.8:0/4012226115 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e7c0c2820 0x7f0e7c154fc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c073410 tx=0x7f0e6c0196d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:22.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.374+0000 7f0e73400640 1 -- 172.21.15.8:0/4012226115 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c0bd020 con 0x7f0e7c0c2820 2024-03-23T23:47:22.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.374+0000 7f0e73400640 1 -- 172.21.15.8:0/4012226115 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6c0b3040 con 0x7f0e7c0c2820 2024-03-23T23:47:22.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.374+0000 7f0e73400640 1 -- 172.21.15.8:0/4012226115 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c0b2070 con 0x7f0e7c0c2820 2024-03-23T23:47:22.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.374+0000 7f0e81000640 1 -- 172.21.15.8:0/4012226115 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e7c0a9750 con 0x7f0e7c0c2820 2024-03-23T23:47:22.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.378+0000 7f0e81000640 1 -- 172.21.15.8:0/4012226115 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e7c1544e0 con 0x7f0e7c0c2820 2024-03-23T23:47:22.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.378+0000 7f0e73400640 1 -- 172.21.15.8:0/4012226115 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f0e6c0c0020 con 0x7f0e7c0c2820 2024-03-23T23:47:22.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.378+0000 7f0e70c00640 1 --2- 172.21.15.8:0/4012226115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e50002a80 0x7f0e50004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:22.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.378+0000 7f0e70c00640 1 -- 172.21.15.8:0/4012226115 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e50007ed0 con 0x7f0e50002a80 2024-03-23T23:47:22.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.378+0000 7f0e7aa00640 1 --2- 172.21.15.8:0/4012226115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e50002a80 0x7f0e50004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:22.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.382+0000 7f0e73400640 1 --2- 172.21.15.8:0/4012226115 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0e5c0676b0 0x7f0e5c069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:22.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.382+0000 7f0e73400640 1 -- 172.21.15.8:0/4012226115 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f0e6c002020 con 0x7f0e7c0c2820 2024-03-23T23:47:22.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.382+0000 7f0e7be00640 1 --2- 172.21.15.8:0/4012226115 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0e5c0676b0 0x7f0e5c069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:22.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.382+0000 7f0e7aa00640 1 -- 172.21.15.8:0/4012226115 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0e500080d0 con 0x7f0e50002a80 2024-03-23T23:47:22.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.386+0000 7f0e7be00640 1 --2- 172.21.15.8:0/4012226115 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0e5c0676b0 0x7f0e5c069b70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0e740099d0 tx=0x7f0e74009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:22.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.390+0000 7f0e7aa00640 1 --2- 172.21.15.8:0/4012226115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e50002a80 0x7f0e50004f40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c155620 tx=0x7f0e6800ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:22.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.394+0000 7f0e73400640 1 -- 172.21.15.8:0/4012226115 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e68017070 con 0x7f0e50002a80 2024-03-23T23:47:22.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.394+0000 7f0e73400640 1 -- 172.21.15.8:0/4012226115 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f0e6800c770 con 0x7f0e50002a80 2024-03-23T23:47:22.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.394+0000 7f0e73400640 1 -- 172.21.15.8:0/4012226115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e50002a80 msgr2=0x7f0e50004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:22.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.394+0000 7f0e73400640 1 --2- 172.21.15.8:0/4012226115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e50002a80 0x7f0e50004f40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c155620 tx=0x7f0e6800ec00 comp rx=0 tx=0).stop 2024-03-23T23:47:22.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.394+0000 7f0e73400640 1 -- 172.21.15.8:0/4012226115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e50002a80 msgr2=0x7f0e50004f40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:47:22.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.394+0000 7f0e73400640 1 --2- 172.21.15.8:0/4012226115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e50002a80 0x7f0e50004f40 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c155620 tx=0x7f0e6800ec00 comp rx=0 tx=0).stop 2024-03-23T23:47:22.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.426+0000 7f0e70c00640 1 --2- 172.21.15.8:0/4012226115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e50006f10 0x7f0e500073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:22.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.426+0000 7f0e70c00640 1 -- 172.21.15.8:0/4012226115 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5000a4b0 con 0x7f0e50006f10 2024-03-23T23:47:22.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.426+0000 7f0e7aa00640 1 --2- 172.21.15.8:0/4012226115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e50006f10 0x7f0e500073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:22.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.434+0000 7f0e7aa00640 1 -- 172.21.15.8:0/4012226115 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0e500078e0 con 0x7f0e50006f10 2024-03-23T23:47:22.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.442+0000 7f0e7aa00640 1 --2- 172.21.15.8:0/4012226115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e50006f10 0x7f0e500073a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0e68019000 tx=0x7f0e680058e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:22.451 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:47:22.451 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:47:22.451 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:47:22.451 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:47:22.451 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 36, 2024-03-23T23:47:22.451 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:47:22.451 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:47:22.451 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:47:22.451 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:47:22.451 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:22.451 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 1, 2024-03-23T23:47:22.451 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:47:22.452 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:47:22.452 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:47:22.452 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:47:22.452 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:47:22.452 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:47:22.452 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:47:22.452 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:47:22.452 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:47:22.452 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:47:22.452 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:47:22.452 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:47:22.452 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:47:22.453 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:47:22.453 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:22.453 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:47:22.453 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:47:22.453 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:47:22.453 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:47:22.453 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:47:22.453 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:47:22.453 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:47:22.453 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:47:22.453 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:47:22.453 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:47:22.453 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:47:22.453 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:47:22.453 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:47:22.454 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:22.454 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:22.454 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:47:22.454 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:47:22.454 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:47:22.454 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:47:22.454 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:47:22.454 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:47:22.454 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:47:22.454 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:47:22.454 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:47:22.454 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:47:22.454 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:47:22.455 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:47:22.455 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:47:22.455 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:47:22.455 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:47:22.455 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:47:22.455 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:47:22.455 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:47:22.455 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:47:22.455 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:47:22.455 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:47:22.455 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:47:22.455 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:47:22.455 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:47:22.455 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:47:22.456 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:47:22.456 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:47:22.456 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:47:22.456 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:22.456 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:47:22.456 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:22.456 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:47:22.456 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:22.456 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:47:22.456 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:47:22.456 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:47:22.456 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:47:22.456 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:22.456 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:47:22.456 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:47:22.457 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:22.457 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:22.457 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:22.457 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:47:22.457 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:47:22.457 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:22.457 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:22.457 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:22.457 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:22.457 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:47:22.457 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:47:22.457 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:47:22.457 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:47:22.457 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:47:22.458 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:22.458 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:22.458 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:47:22.458 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:47:22.458 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:47:22.458 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:47:22.458 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:22.458 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:47:22.458 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:47:22.458 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:22.458 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:22.458 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:22.458 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:47:22.459 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:47:22.460 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:22.460 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:22.460 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:22.460 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:22.460 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:47:22.460 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:47:22.460 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:47:22.460 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:47:22.460 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:47:22.460 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:22.460 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:22.460 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:47:22.461 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:47:22.461 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:47:22.461 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:47:22.461 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:22.461 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:47:22.461 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:47:22.461 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:22.461 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:22.461 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:22.461 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:47:22.461 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:47:22.461 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:22.462 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:22.462 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:22.462 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:22.462 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:47:22.462 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:47:22.462 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:47:22.462 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:47:22.462 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:47:22.462 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:22.462 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:22.462 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:22.462 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:47:22.462 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:47:22.463 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:22.463 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:47:22.463 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:22.463 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:47:22.463 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:22.463 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:22.463 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:47:22.463 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:22.463 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:47:22.463 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:22.463 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:47:22.463 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:22.463 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:22.463 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:47:22.464 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:22.464 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:47:22.464 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:22.464 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:22.464 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:22.464 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:47:22.464 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:47:22.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.450+0000 7f0e73400640 1 -- 172.21.15.8:0/4012226115 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e68017070 con 0x7f0e50006f10 2024-03-23T23:47:22.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.450+0000 7f0e73400640 1 -- 172.21.15.8:0/4012226115 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4672 (secure 0 0 0) 0x7f0e68006250 con 0x7f0e50006f10 2024-03-23T23:47:22.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.450+0000 7f0e73400640 1 -- 172.21.15.8:0/4012226115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e50006f10 msgr2=0x7f0e500073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:22.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.450+0000 7f0e73400640 1 --2- 172.21.15.8:0/4012226115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e50006f10 0x7f0e500073a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0e68019000 tx=0x7f0e680058e0 comp rx=0 tx=0).stop 2024-03-23T23:47:22.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.450+0000 7f0e73400640 1 -- 172.21.15.8:0/4012226115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e50006f10 msgr2=0x7f0e500073a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:47:22.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.450+0000 7f0e73400640 1 --2- 172.21.15.8:0/4012226115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e50006f10 0x7f0e500073a0 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0e68019000 tx=0x7f0e680058e0 comp rx=0 tx=0).stop 2024-03-23T23:47:22.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.450+0000 7f0e70c00640 1 -- 172.21.15.8:0/4012226115 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0e5c0676b0 msgr2=0x7f0e5c069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:22.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.450+0000 7f0e70c00640 1 --2- 172.21.15.8:0/4012226115 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0e5c0676b0 0x7f0e5c069b70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0e740099d0 tx=0x7f0e74009190 comp rx=0 tx=0).stop 2024-03-23T23:47:22.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.450+0000 7f0e70c00640 1 -- 172.21.15.8:0/4012226115 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e7c0c2820 msgr2=0x7f0e7c154fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:22.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.450+0000 7f0e70c00640 1 --2- 172.21.15.8:0/4012226115 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e7c0c2820 0x7f0e7c154fc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c073410 tx=0x7f0e6c0196d0 comp rx=0 tx=0).stop 2024-03-23T23:47:22.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.450+0000 7f0e7be00640 1 -- 172.21.15.8:0/4012226115 reap_dead start 2024-03-23T23:47:22.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.450+0000 7f0e7be00640 1 -- 172.21.15.8:0/4012226115 reap_dead start 2024-03-23T23:47:22.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.454+0000 7f0e70c00640 1 -- 172.21.15.8:0/4012226115 shutdown_connections 2024-03-23T23:47:22.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.454+0000 7f0e70c00640 1 -- 172.21.15.8:0/4012226115 >> 172.21.15.8:0/4012226115 conn(0x7f0e7c0c3910 msgr2=0x7f0e7c0c3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:47:22.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.454+0000 7f0e70c00640 1 -- 172.21.15.8:0/4012226115 shutdown_connections 2024-03-23T23:47:22.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:22.458+0000 7f0e70c00640 1 -- 172.21.15.8:0/4012226115 wait complete. 2024-03-23T23:47:22.621 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:47:22.622 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T23:47:22.622 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:47:23.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.134+0000 7f20f3200640 1 Processor -- start 2024-03-23T23:47:23.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.134+0000 7f20f3200640 1 -- start start 2024-03-23T23:47:23.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.138+0000 7f20f3200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f20ec0c6dd0 0x7f20ec1508e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:23.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.138+0000 7f20f3200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20ec0c4670 con 0x7f20ec0711a0 2024-03-23T23:47:23.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.138+0000 7f20f2800640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f20ec0c8a40 0x7f20ec15dea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:54812/0 (socket says 172.21.15.8:54812) 2024-03-23T23:47:23.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.138+0000 7f20f2800640 1 -- 172.21.15.8:0/570679581 learned_addr learned my addr 172.21.15.8:0/570679581 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:47:23.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.138+0000 7f20f1400640 1 --2- 172.21.15.8:0/570679581 >> v2:172.21.15.196:3300/0 conn(0x7f20ec0c6dd0 0x7f20ec1508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:23.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.138+0000 7f20f3200640 1 -- 172.21.15.8:0/570679581 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20ec0c4b90 con 0x7f20ec0c8a40 2024-03-23T23:47:23.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.138+0000 7f20f3200640 1 -- 172.21.15.8:0/570679581 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20ec0c4940 con 0x7f20ec0c6dd0 2024-03-23T23:47:23.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.138+0000 7f20f1400640 1 -- 172.21.15.8:0/570679581 >> v1:172.21.15.196:6789/0 conn(0x7f20ec0c8a40 legacy=0x7f20ec15dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:23.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.138+0000 7f20f1400640 1 -- 172.21.15.8:0/570679581 >> v1:172.21.15.8:6789/0 conn(0x7f20ec0711a0 legacy=0x7f20ec153cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:47:23.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.138+0000 7f20f1400640 1 -- 172.21.15.8:0/570679581 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec0c52d0 con 0x7f20ec0c6dd0 2024-03-23T23:47:23.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.150+0000 7f20f1400640 1 --2- 172.21.15.8:0/570679581 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f20ec0c6dd0 0x7f20ec1508e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0097c0 tx=0x7f20dc01c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72644aabe335574d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:23.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.154+0000 7f20f0a00640 1 -- 172.21.15.8:0/570679581 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc0b0070 con 0x7f20ec0c6dd0 2024-03-23T23:47:23.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.154+0000 7f20f0a00640 1 -- 172.21.15.8:0/570679581 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20dc0ab600 con 0x7f20ec0c6dd0 2024-03-23T23:47:23.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.154+0000 7f20f0a00640 1 -- 172.21.15.8:0/570679581 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc0a4e60 con 0x7f20ec0c6dd0 2024-03-23T23:47:23.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.158+0000 7f20f3200640 1 -- 172.21.15.8:0/570679581 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f20ec0c6dd0 msgr2=0x7f20ec1508e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:23.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.158+0000 7f20f3200640 1 --2- 172.21.15.8:0/570679581 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f20ec0c6dd0 0x7f20ec1508e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0097c0 tx=0x7f20dc01c3d0 comp rx=0 tx=0).stop 2024-03-23T23:47:23.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.162+0000 7f20f3200640 1 -- 172.21.15.8:0/570679581 shutdown_connections 2024-03-23T23:47:23.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.162+0000 7f20f3200640 1 --2- 172.21.15.8:0/570679581 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f20ec0c6dd0 0x7f20ec1508e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:23.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.162+0000 7f20f3200640 1 -- 172.21.15.8:0/570679581 >> 172.21.15.8:0/570679581 conn(0x7f20ec0aac80 msgr2=0x7f20ec0ab090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:47:23.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.162+0000 7f20f3200640 1 -- 172.21.15.8:0/570679581 shutdown_connections 2024-03-23T23:47:23.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.162+0000 7f20f3200640 1 -- 172.21.15.8:0/570679581 wait complete. 2024-03-23T23:47:23.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.182+0000 7f20f3200640 1 Processor -- start 2024-03-23T23:47:23.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.194+0000 7f20f3200640 1 -- start start 2024-03-23T23:47:23.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.194+0000 7f20f3200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f20ec0711a0 0x7f20ec1f3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:23.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.194+0000 7f20f3200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f20ec0c6dd0 0x7f20ec0ad100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:23.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.194+0000 7f20f3200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20ec0c8a40 0x7f20ec14a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:23.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.194+0000 7f20f3200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec153830 con 0x7f20ec0c8a40 2024-03-23T23:47:23.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.194+0000 7f20f3200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec1545e0 con 0x7f20ec0711a0 2024-03-23T23:47:23.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.194+0000 7f20f3200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec071580 con 0x7f20ec0c6dd0 2024-03-23T23:47:23.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.198+0000 7f20f1400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f20ec0c6dd0 0x7f20ec0ad100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:23.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.198+0000 7f20f1e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f20ec0711a0 0x7f20ec1f3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:23.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.198+0000 7f20f1e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f20ec0711a0 0x7f20ec1f3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:42948/0 (socket says 172.21.15.8:42948) 2024-03-23T23:47:23.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.198+0000 7f20f1e00640 1 -- 172.21.15.8:0/2491984956 learned_addr learned my addr 172.21.15.8:0/2491984956 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:47:23.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.198+0000 7f20f2800640 1 --2- 172.21.15.8:0/2491984956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20ec0c8a40 0x7f20ec14a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:23.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.202+0000 7f20f1e00640 1 -- 172.21.15.8:0/2491984956 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f20ec0c6dd0 msgr2=0x7f20ec0ad100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:23.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.202+0000 7f20f1e00640 1 --2- 172.21.15.8:0/2491984956 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f20ec0c6dd0 0x7f20ec0ad100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:23.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.202+0000 7f20f1e00640 1 -- 172.21.15.8:0/2491984956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20ec0c8a40 msgr2=0x7f20ec14a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:23.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.202+0000 7f20f1e00640 1 --2- 172.21.15.8:0/2491984956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20ec0c8a40 0x7f20ec14a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:23.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.202+0000 7f20f1e00640 1 -- 172.21.15.8:0/2491984956 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec0aa420 con 0x7f20ec0711a0 2024-03-23T23:47:23.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.206+0000 7f20f1e00640 1 --2- 172.21.15.8:0/2491984956 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f20ec0711a0 0x7f20ec1f3f30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f20e000c490 tx=0x7f20e0001e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:23.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.206+0000 7f20e6000640 1 -- 172.21.15.8:0/2491984956 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e0017070 con 0x7f20ec0711a0 2024-03-23T23:47:23.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.210+0000 7f20e6000640 1 -- 172.21.15.8:0/2491984956 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e0003600 con 0x7f20ec0711a0 2024-03-23T23:47:23.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.210+0000 7f20e6000640 1 -- 172.21.15.8:0/2491984956 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e0003a30 con 0x7f20ec0711a0 2024-03-23T23:47:23.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.214+0000 7f20f3200640 1 -- 172.21.15.8:0/2491984956 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20ec0ae070 con 0x7f20ec0711a0 2024-03-23T23:47:23.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.214+0000 7f20f3200640 1 -- 172.21.15.8:0/2491984956 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20ec0ae630 con 0x7f20ec0711a0 2024-03-23T23:47:23.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.226+0000 7f20f3200640 1 --2- 172.21.15.8:0/2491984956 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f20ec0ac990 0x7f20ec14a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:23.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.226+0000 7f20f3200640 1 -- 172.21.15.8:0/2491984956 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec068790 con 0x7f20ec0ac990 2024-03-23T23:47:23.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.226+0000 7f20e6000640 1 -- 172.21.15.8:0/2491984956 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f20e0003bd0 con 0x7f20ec0711a0 2024-03-23T23:47:23.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.230+0000 7f20e6000640 1 --2- 172.21.15.8:0/2491984956 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f20d0067660 0x7f20d0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:23.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.230+0000 7f20e6000640 1 -- 172.21.15.8:0/2491984956 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f20e0084e80 con 0x7f20ec0711a0 2024-03-23T23:47:23.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.230+0000 7f20f1400640 1 --2- 172.21.15.8:0/2491984956 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f20ec0ac990 0x7f20ec14a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:23.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.234+0000 7f20f1400640 1 -- 172.21.15.8:0/2491984956 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f20ec04f410 con 0x7f20ec0ac990 2024-03-23T23:47:23.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.234+0000 7f20f2800640 1 --2- 172.21.15.8:0/2491984956 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f20d0067660 0x7f20d0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:23.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.234+0000 7f20f1400640 1 --2- 172.21.15.8:0/2491984956 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f20ec0ac990 0x7f20ec14a950 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f20ec06bdf0 tx=0x7f20dc01ac10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:23.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.242+0000 7f20f2800640 1 --2- 172.21.15.8:0/2491984956 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f20d0067660 0x7f20d0069b20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f20e80012f0 tx=0x7f20e8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:23.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.246+0000 7f20e6000640 1 -- 172.21.15.8:0/2491984956 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc0bb070 con 0x7f20ec0ac990 2024-03-23T23:47:23.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.246+0000 7f20e6000640 1 -- 172.21.15.8:0/2491984956 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f20dc0abd50 con 0x7f20ec0ac990 2024-03-23T23:47:23.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.246+0000 7f20e6000640 1 -- 172.21.15.8:0/2491984956 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f20ec0ac990 msgr2=0x7f20ec14a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:23.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.246+0000 7f20e6000640 1 --2- 172.21.15.8:0/2491984956 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f20ec0ac990 0x7f20ec14a950 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f20ec06bdf0 tx=0x7f20dc01ac10 comp rx=0 tx=0).stop 2024-03-23T23:47:23.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.246+0000 7f20e6000640 1 -- 172.21.15.8:0/2491984956 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f20ec0ac990 msgr2=0x7f20ec14a950 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:47:23.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.246+0000 7f20e6000640 1 --2- 172.21.15.8:0/2491984956 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f20ec0ac990 0x7f20ec14a950 secure :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f20ec06bdf0 tx=0x7f20dc01ac10 comp rx=0 tx=0).stop 2024-03-23T23:47:23.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.258+0000 7f20f3200640 1 --2- 172.21.15.8:0/2491984956 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f20ec1f6290 0x7f20ec1f6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:23.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.258+0000 7f20f3200640 1 -- 172.21.15.8:0/2491984956 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec1540d0 con 0x7f20ec1f6290 2024-03-23T23:47:23.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.262+0000 7f20f1400640 1 --2- 172.21.15.8:0/2491984956 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f20ec1f6290 0x7f20ec1f6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:23.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.266+0000 7f20f1400640 1 -- 172.21.15.8:0/2491984956 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f20ec0c82a0 con 0x7f20ec1f6290 2024-03-23T23:47:23.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.270+0000 7f20f1400640 1 --2- 172.21.15.8:0/2491984956 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f20ec1f6290 0x7f20ec1f6670 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f20dc018fe0 tx=0x7f20dc0a8000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:23.276 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:47:23.276 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:47:23.276 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:47:23.276 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:47:23.276 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 36, 2024-03-23T23:47:23.276 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:47:23.276 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:47:23.276 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:47:23.276 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:47:23.277 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:23.277 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 1, 2024-03-23T23:47:23.277 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:47:23.277 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:47:23.277 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:47:23.277 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:47:23.277 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:47:23.277 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:47:23.277 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:47:23.277 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:47:23.277 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:47:23.277 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:47:23.277 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:47:23.278 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:47:23.278 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:47:23.278 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:47:23.278 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:23.278 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:47:23.278 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:47:23.278 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:47:23.278 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:47:23.278 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:47:23.278 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:47:23.278 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:47:23.278 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:47:23.279 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:47:23.279 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:47:23.279 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:47:23.279 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:47:23.279 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:47:23.279 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:23.279 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:23.279 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:47:23.279 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:47:23.279 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:47:23.279 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:47:23.279 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:47:23.279 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:47:23.279 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:47:23.280 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:47:23.280 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:47:23.280 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:47:23.280 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:47:23.280 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:47:23.280 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:47:23.280 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:47:23.280 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:47:23.280 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:47:23.280 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:47:23.280 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:47:23.280 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:47:23.280 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:47:23.280 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:47:23.280 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:47:23.280 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:47:23.281 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:47:23.281 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:47:23.281 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:47:23.281 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:47:23.281 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:47:23.281 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:23.281 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:47:23.281 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:23.281 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:47:23.281 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:23.281 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:47:23.281 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:47:23.282 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:47:23.282 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:47:23.282 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:23.282 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:47:23.282 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:47:23.282 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:23.282 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:23.282 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:23.282 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:47:23.282 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:47:23.282 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:23.282 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:23.282 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:23.283 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:23.283 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:47:23.283 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:47:23.283 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:47:23.283 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:47:23.283 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:47:23.283 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:23.283 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:23.283 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:47:23.283 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:47:23.283 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:47:23.283 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:47:23.283 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:23.283 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:47:23.284 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:47:23.284 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:23.284 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:23.284 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:23.284 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:47:23.284 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:47:23.284 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:23.284 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:23.284 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:23.284 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:23.284 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:47:23.284 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:47:23.284 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:47:23.284 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:47:23.285 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:47:23.285 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:23.285 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:23.285 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:47:23.285 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:47:23.285 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:47:23.285 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:47:23.285 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:23.285 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:47:23.285 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:47:23.285 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:23.285 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:23.285 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:23.285 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:47:23.286 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:47:23.286 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:23.286 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:23.286 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:23.286 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:23.286 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:47:23.286 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:47:23.286 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:47:23.286 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:47:23.286 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:47:23.286 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:23.286 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:23.286 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:23.287 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:47:23.287 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:47:23.287 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:23.287 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:47:23.287 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:23.287 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:47:23.287 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:23.287 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:23.287 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:47:23.287 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:23.287 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:47:23.287 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:23.287 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:47:23.288 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:23.288 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:23.288 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:47:23.288 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:23.288 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:47:23.288 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:23.288 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 8 2024-03-23T23:47:23.288 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:23.288 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:23.288 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:47:23.288 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:23.288 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:47:23.288 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:23.288 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:47:23.289 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:23.289 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:23.289 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:47:23.289 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:23.289 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:47:23.289 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:23.289 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:23.289 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:47:23.289 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:23.289 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:47:23.289 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:23.289 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:47:23.289 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:23.289 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:23.290 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:23.290 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:47:23.290 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:47:23.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.274+0000 7f20e6000640 1 -- 172.21.15.8:0/2491984956 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc0bb040 con 0x7f20ec1f6290 2024-03-23T23:47:23.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.274+0000 7f20e6000640 1 -- 172.21.15.8:0/2491984956 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5182 (secure 0 0 0) 0x7f20dc0bf610 con 0x7f20ec1f6290 2024-03-23T23:47:23.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.274+0000 7f20e6000640 1 -- 172.21.15.8:0/2491984956 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f20ec1f6290 msgr2=0x7f20ec1f6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:23.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.274+0000 7f20e6000640 1 --2- 172.21.15.8:0/2491984956 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f20ec1f6290 0x7f20ec1f6670 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f20dc018fe0 tx=0x7f20dc0a8000 comp rx=0 tx=0).stop 2024-03-23T23:47:23.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.274+0000 7f20e6000640 1 -- 172.21.15.8:0/2491984956 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f20ec1f6290 msgr2=0x7f20ec1f6670 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:47:23.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.274+0000 7f20e6000640 1 --2- 172.21.15.8:0/2491984956 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f20ec1f6290 0x7f20ec1f6670 secure :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f20dc018fe0 tx=0x7f20dc0a8000 comp rx=0 tx=0).stop 2024-03-23T23:47:23.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.282+0000 7f20f3200640 1 -- 172.21.15.8:0/2491984956 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f20d0067660 msgr2=0x7f20d0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:23.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.282+0000 7f20f3200640 1 --2- 172.21.15.8:0/2491984956 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f20d0067660 0x7f20d0069b20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f20e80012f0 tx=0x7f20e8009040 comp rx=0 tx=0).stop 2024-03-23T23:47:23.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.282+0000 7f20f3200640 1 -- 172.21.15.8:0/2491984956 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f20ec0711a0 msgr2=0x7f20ec1f3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:23.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.282+0000 7f20f3200640 1 --2- 172.21.15.8:0/2491984956 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f20ec0711a0 0x7f20ec1f3f30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f20e000c490 tx=0x7f20e0001e80 comp rx=0 tx=0).stop 2024-03-23T23:47:23.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.286+0000 7f20f2800640 1 -- 172.21.15.8:0/2491984956 reap_dead start 2024-03-23T23:47:23.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.286+0000 7f20f2800640 1 -- 172.21.15.8:0/2491984956 reap_dead start 2024-03-23T23:47:23.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.286+0000 7f20f3200640 1 -- 172.21.15.8:0/2491984956 shutdown_connections 2024-03-23T23:47:23.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.286+0000 7f20f3200640 1 -- 172.21.15.8:0/2491984956 >> 172.21.15.8:0/2491984956 conn(0x7f20ec0aac80 msgr2=0x7f20ec0c71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:47:23.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.286+0000 7f20f3200640 1 -- 172.21.15.8:0/2491984956 shutdown_connections 2024-03-23T23:47:23.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.286+0000 7f20f3200640 1 -- 172.21.15.8:0/2491984956 wait complete. 2024-03-23T23:47:23.329 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:47:23.329 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-03-23T23:47:23.329 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-03-23T23:47:23.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.674+0000 7f2776e00640 1 Processor -- start 2024-03-23T23:47:23.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.674+0000 7f2776e00640 1 -- start start 2024-03-23T23:47:23.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.678+0000 7f2776e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2770154410 0x7f27700c6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:23.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.678+0000 7f2776e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27700c3bc0 0x7f27700c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:23.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.678+0000 7f2776e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27700c7a20 con 0x7f2770153810 2024-03-23T23:47:23.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.678+0000 7f2776e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27701547f0 con 0x7f2770154410 2024-03-23T23:47:23.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.678+0000 7f2776e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27700c4080 con 0x7f27700c3bc0 2024-03-23T23:47:23.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.678+0000 7f2774e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f2770153810 0x7f2770157420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34972/0 (socket says 172.21.15.8:34972) 2024-03-23T23:47:23.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.678+0000 7f2774e00640 1 -- 172.21.15.8:0/2755091006 learned_addr learned my addr 172.21.15.8:0/2755091006 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:47:23.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.678+0000 7f276fe00640 1 --2- 172.21.15.8:0/2755091006 >> v2:172.21.15.196:3300/0 conn(0x7f2770154410 0x7f27700c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:23.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.678+0000 7f276ea00640 1 -- 172.21.15.8:0/2755091006 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2253451101 0 0) 0x7f27700c7a20 con 0x7f2770153810 2024-03-23T23:47:23.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.678+0000 7f276ea00640 1 -- 172.21.15.8:0/2755091006 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2754003530 con 0x7f2770153810 2024-03-23T23:47:23.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.682+0000 7f276f400640 1 --2- 172.21.15.8:0/2755091006 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27700c3bc0 0x7f27700c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:23.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.682+0000 7f276f400640 1 -- 172.21.15.8:0/2755091006 >> v2:172.21.15.196:3300/0 conn(0x7f2770154410 msgr2=0x7f27700c6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:47:23.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.682+0000 7f276f400640 1 --2- 172.21.15.8:0/2755091006 >> v2:172.21.15.196:3300/0 conn(0x7f2770154410 0x7f27700c6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:23.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.682+0000 7f276f400640 1 -- 172.21.15.8:0/2755091006 >> v1:172.21.15.8:6789/0 conn(0x7f2770153810 legacy=0x7f2770157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:23.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.682+0000 7f276f400640 1 -- 172.21.15.8:0/2755091006 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27700c4360 con 0x7f27700c3bc0 2024-03-23T23:47:23.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.686+0000 7f276f400640 1 --2- 172.21.15.8:0/2755091006 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27700c3bc0 0x7f27700c4a40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f275c0097c0 tx=0x7f275c01c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f30633d5ec554947 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:23.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.694+0000 7f276ea00640 1 -- 172.21.15.8:0/2755091006 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c0b0070 con 0x7f27700c3bc0 2024-03-23T23:47:23.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.694+0000 7f276ea00640 1 -- 172.21.15.8:0/2755091006 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275c0ab400 con 0x7f27700c3bc0 2024-03-23T23:47:23.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.694+0000 7f276ea00640 1 -- 172.21.15.8:0/2755091006 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c0ab7d0 con 0x7f27700c3bc0 2024-03-23T23:47:23.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.694+0000 7f2776e00640 1 -- 172.21.15.8:0/2755091006 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27700c3bc0 msgr2=0x7f27700c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:23.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.694+0000 7f2776e00640 1 --2- 172.21.15.8:0/2755091006 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27700c3bc0 0x7f27700c4a40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f275c0097c0 tx=0x7f275c01c410 comp rx=0 tx=0).stop 2024-03-23T23:47:23.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.694+0000 7f2776e00640 1 -- 172.21.15.8:0/2755091006 shutdown_connections 2024-03-23T23:47:23.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.694+0000 7f2776e00640 1 --2- 172.21.15.8:0/2755091006 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27700c3bc0 0x7f27700c4a40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:23.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.694+0000 7f2776e00640 1 --2- 172.21.15.8:0/2755091006 >> v2:172.21.15.196:3300/0 conn(0x7f2770154410 0x7f27700c6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:23.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.694+0000 7f2776e00640 1 -- 172.21.15.8:0/2755091006 >> 172.21.15.8:0/2755091006 conn(0x7f27700743f0 msgr2=0x7f2770074800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:47:23.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.698+0000 7f2776e00640 1 -- 172.21.15.8:0/2755091006 shutdown_connections 2024-03-23T23:47:23.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.698+0000 7f2776e00640 1 -- 172.21.15.8:0/2755091006 wait complete. 2024-03-23T23:47:23.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.702+0000 7f2776e00640 1 Processor -- start 2024-03-23T23:47:23.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.702+0000 7f2776e00640 1 -- start start 2024-03-23T23:47:23.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.706+0000 7f2776e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27700c3bc0 0x7f27701f32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:23.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.706+0000 7f2776e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2770153810 0x7f27700ab1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:23.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.706+0000 7f2776e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2770154410 0x7f27701f6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:23.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.706+0000 7f2776e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2770163060 con 0x7f2770154410 2024-03-23T23:47:23.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.706+0000 7f2776e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2770162ee0 con 0x7f27700c3bc0 2024-03-23T23:47:23.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.706+0000 7f2776e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27701631e0 con 0x7f2770153810 2024-03-23T23:47:23.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.706+0000 7f276fe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27700c3bc0 0x7f27701f32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:23.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.706+0000 7f276fe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27700c3bc0 0x7f27701f32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:42972/0 (socket says 172.21.15.8:42972) 2024-03-23T23:47:23.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.706+0000 7f276fe00640 1 -- 172.21.15.8:0/3670511277 learned_addr learned my addr 172.21.15.8:0/3670511277 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:47:23.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.710+0000 7f276f400640 1 --2- 172.21.15.8:0/3670511277 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2770153810 0x7f27700ab1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:23.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.710+0000 7f2774e00640 1 --2- 172.21.15.8:0/3670511277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2770154410 0x7f27701f6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:23.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.710+0000 7f276fe00640 1 -- 172.21.15.8:0/3670511277 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2770153810 msgr2=0x7f27700ab1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:23.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.710+0000 7f276fe00640 1 --2- 172.21.15.8:0/3670511277 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2770153810 0x7f27700ab1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:23.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.710+0000 7f276fe00640 1 -- 172.21.15.8:0/3670511277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2770154410 msgr2=0x7f27701f6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:23.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.710+0000 7f276fe00640 1 --2- 172.21.15.8:0/3670511277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2770154410 0x7f27701f6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:23.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.710+0000 7f276fe00640 1 -- 172.21.15.8:0/3670511277 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27701f2860 con 0x7f27700c3bc0 2024-03-23T23:47:23.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.710+0000 7f2774e00640 1 --2- 172.21.15.8:0/3670511277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2770154410 0x7f27701f6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:47:23.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.714+0000 7f276fe00640 1 --2- 172.21.15.8:0/3670511277 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27700c3bc0 0x7f27701f32d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f276000efc0 tx=0x7f276000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:23.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.714+0000 7f2767e00640 1 -- 172.21.15.8:0/3670511277 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2760018020 con 0x7f27700c3bc0 2024-03-23T23:47:23.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.714+0000 7f2776e00640 1 -- 172.21.15.8:0/3670511277 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27700ab8d0 con 0x7f27700c3bc0 2024-03-23T23:47:23.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.718+0000 7f2776e00640 1 -- 172.21.15.8:0/3670511277 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27701f2db0 con 0x7f27700c3bc0 2024-03-23T23:47:23.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.714+0000 7f2767e00640 1 -- 172.21.15.8:0/3670511277 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2760014480 con 0x7f27700c3bc0 2024-03-23T23:47:23.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.718+0000 7f2767e00640 1 -- 172.21.15.8:0/3670511277 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2760014850 con 0x7f27700c3bc0 2024-03-23T23:47:23.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.718+0000 7f2776e00640 1 -- 172.21.15.8:0/3670511277 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27480052a0 con 0x7f27700c3bc0 2024-03-23T23:47:23.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.722+0000 7f2767e00640 1 -- 172.21.15.8:0/3670511277 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f276001b020 con 0x7f27700c3bc0 2024-03-23T23:47:23.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.722+0000 7f2767e00640 1 --2- 172.21.15.8:0/3670511277 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f27500676b0 0x7f2750069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:23.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.722+0000 7f2767e00640 1 -- 172.21.15.8:0/3670511277 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f2760086960 con 0x7f27700c3bc0 2024-03-23T23:47:23.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.738+0000 7f276f400640 1 --2- 172.21.15.8:0/3670511277 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f27500676b0 0x7f2750069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:23.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.738+0000 7f2767e00640 1 -- 172.21.15.8:0/3670511277 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f2760022030 con 0x7f27700c3bc0 2024-03-23T23:47:23.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:23.746+0000 7f276f400640 1 --2- 172.21.15.8:0/3670511277 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f27500676b0 0x7f2750069b70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f275c0ad000 tx=0x7f275c0a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:24.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:24.390+0000 7f2776e00640 1 -- 172.21.15.8:0/3670511277 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f2748005860 con 0x7f27700c3bc0 2024-03-23T23:47:24.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:24.410+0000 7f2767e00640 1 -- 172.21.15.8:0/3670511277 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f2760010040 con 0x7f27700c3bc0 2024-03-23T23:47:24.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:24.434+0000 7f2776e00640 1 -- 172.21.15.8:0/3670511277 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f27500676b0 msgr2=0x7f2750069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:24.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:24.434+0000 7f2776e00640 1 --2- 172.21.15.8:0/3670511277 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f27500676b0 0x7f2750069b70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f275c0ad000 tx=0x7f275c0a6000 comp rx=0 tx=0).stop 2024-03-23T23:47:24.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:24.434+0000 7f2776e00640 1 -- 172.21.15.8:0/3670511277 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27700c3bc0 msgr2=0x7f27701f32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:24.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:24.434+0000 7f2776e00640 1 --2- 172.21.15.8:0/3670511277 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27700c3bc0 0x7f27701f32d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f276000efc0 tx=0x7f276000c490 comp rx=0 tx=0).stop 2024-03-23T23:47:24.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:24.434+0000 7f2776e00640 1 -- 172.21.15.8:0/3670511277 shutdown_connections 2024-03-23T23:47:24.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:24.434+0000 7f2776e00640 1 --2- 172.21.15.8:0/3670511277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2770154410 0x7f27701f6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:24.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:24.434+0000 7f2776e00640 1 --2- 172.21.15.8:0/3670511277 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f27500676b0 0x7f2750069b70 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:24.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:24.434+0000 7f2776e00640 1 --2- 172.21.15.8:0/3670511277 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2770153810 0x7f27700ab1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:24.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:24.434+0000 7f2776e00640 1 --2- 172.21.15.8:0/3670511277 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27700c3bc0 0x7f27701f32d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:24.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:24.434+0000 7f2776e00640 1 -- 172.21.15.8:0/3670511277 >> 172.21.15.8:0/3670511277 conn(0x7f27700743f0 msgr2=0x7f27700ae070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:47:24.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:24.438+0000 7f2776e00640 1 -- 172.21.15.8:0/3670511277 shutdown_connections 2024-03-23T23:47:24.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:24.438+0000 7f2776e00640 1 -- 172.21.15.8:0/3670511277 wait complete. 2024-03-23T23:47:24.517 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-03-23T23:47:34.518 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T23:47:34.518 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:47:34.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.906+0000 7f3491600640 1 Processor -- start 2024-03-23T23:47:34.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.906+0000 7f3491600640 1 -- start start 2024-03-23T23:47:34.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.910+0000 7f3491600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f348c14ebe0 0x7f348c072b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:34.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.910+0000 7f348a000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f348c14ebe0 0x7f348c072b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:34.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.910+0000 7f3489600640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f348c152150 0x7f348c0c1ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:36054/0 (socket says 172.21.15.8:36054) 2024-03-23T23:47:34.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.910+0000 7f3489600640 1 -- 172.21.15.8:0/527585854 learned_addr learned my addr 172.21.15.8:0/527585854 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:47:34.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.910+0000 7f3491600640 1 -- 172.21.15.8:0/527585854 --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f348c073100 con 0x7f348c0c46f0 2024-03-23T23:47:34.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.910+0000 7f3491600640 1 -- 172.21.15.8:0/527585854 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f348c0733e0 con 0x7f348c152150 2024-03-23T23:47:34.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.910+0000 7f3491600640 1 -- 172.21.15.8:0/527585854 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f348c154c60 con 0x7f348c14ebe0 2024-03-23T23:47:34.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.910+0000 7f348be00640 1 -- 172.21.15.8:0/527585854 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4138442378 0 0) 0x7f348c0733e0 con 0x7f348c152150 2024-03-23T23:47:34.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.914+0000 7f348be00640 1 -- 172.21.15.8:0/527585854 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3484005770 con 0x7f348c152150 2024-03-23T23:47:34.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.914+0000 7f348a000640 1 -- 172.21.15.8:0/527585854 >> v1:172.21.15.196:6789/0 conn(0x7f348c152150 legacy=0x7f348c0c1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:34.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.914+0000 7f348a000640 1 -- 172.21.15.8:0/527585854 >> v1:172.21.15.8:6789/0 conn(0x7f348c0c46f0 legacy=0x7f348c0aa520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:34.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.914+0000 7f348a000640 1 -- 172.21.15.8:0/527585854 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348c154eb0 con 0x7f348c14ebe0 2024-03-23T23:47:34.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.918+0000 7f348a000640 1 --2- 172.21.15.8:0/527585854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f348c14ebe0 0x7f348c072b20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f347800abc0 tx=0x7f347801d2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71eb587b5c50834c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:34.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.922+0000 7f348be00640 1 -- 172.21.15.8:0/527585854 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34780b2070 con 0x7f348c14ebe0 2024-03-23T23:47:34.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.922+0000 7f348be00640 1 -- 172.21.15.8:0/527585854 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34780a5920 con 0x7f348c14ebe0 2024-03-23T23:47:34.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.922+0000 7f348be00640 1 -- 172.21.15.8:0/527585854 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347800b040 con 0x7f348c14ebe0 2024-03-23T23:47:34.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.922+0000 7f3491600640 1 -- 172.21.15.8:0/527585854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f348c14ebe0 msgr2=0x7f348c072b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:34.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.922+0000 7f3491600640 1 --2- 172.21.15.8:0/527585854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f348c14ebe0 0x7f348c072b20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f347800abc0 tx=0x7f347801d2c0 comp rx=0 tx=0).stop 2024-03-23T23:47:34.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.922+0000 7f3491600640 1 -- 172.21.15.8:0/527585854 shutdown_connections 2024-03-23T23:47:34.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.922+0000 7f3491600640 1 --2- 172.21.15.8:0/527585854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f348c14ebe0 0x7f348c072b20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:34.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.922+0000 7f3491600640 1 -- 172.21.15.8:0/527585854 >> 172.21.15.8:0/527585854 conn(0x7f348c0c3bd0 msgr2=0x7f348c0c3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:47:34.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.922+0000 7f3491600640 1 -- 172.21.15.8:0/527585854 shutdown_connections 2024-03-23T23:47:34.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.922+0000 7f3491600640 1 -- 172.21.15.8:0/527585854 wait complete. 2024-03-23T23:47:34.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.926+0000 7f3491600640 1 Processor -- start 2024-03-23T23:47:34.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.926+0000 7f3491600640 1 -- start start 2024-03-23T23:47:34.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.930+0000 7f3491600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f348c0c46f0 0x7f348c14a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:34.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.930+0000 7f3491600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f348c14ebe0 0x7f348c150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:34.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.930+0000 7f3491600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f348c152150 0x7f348c1ed130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:34.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.930+0000 7f3489600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f348c14ebe0 0x7f348c150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:34.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.930+0000 7f3489600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f348c14ebe0 0x7f348c150540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:42296/0 (socket says 172.21.15.8:42296) 2024-03-23T23:47:34.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.930+0000 7f3489600640 1 -- 172.21.15.8:0/1853561708 learned_addr learned my addr 172.21.15.8:0/1853561708 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:47:34.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.930+0000 7f348a000640 1 --2- 172.21.15.8:0/1853561708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f348c0c46f0 0x7f348c14a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:34.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.930+0000 7f348aa00640 1 --2- 172.21.15.8:0/1853561708 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f348c152150 0x7f348c1ed130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:34.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.930+0000 7f3491600640 1 -- 172.21.15.8:0/1853561708 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c0aadb0 con 0x7f348c0c46f0 2024-03-23T23:47:34.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.930+0000 7f3491600640 1 -- 172.21.15.8:0/1853561708 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c0aac30 con 0x7f348c14ebe0 2024-03-23T23:47:34.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.930+0000 7f3491600640 1 -- 172.21.15.8:0/1853561708 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348c14efc0 con 0x7f348c152150 2024-03-23T23:47:34.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.934+0000 7f348a000640 1 -- 172.21.15.8:0/1853561708 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f348c152150 msgr2=0x7f348c1ed130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:34.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.934+0000 7f348a000640 1 --2- 172.21.15.8:0/1853561708 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f348c152150 0x7f348c1ed130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:34.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.934+0000 7f348a000640 1 -- 172.21.15.8:0/1853561708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f348c14ebe0 msgr2=0x7f348c150540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:34.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.934+0000 7f348a000640 1 --2- 172.21.15.8:0/1853561708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f348c14ebe0 0x7f348c150540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:34.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.934+0000 7f348a000640 1 -- 172.21.15.8:0/1853561708 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348c0c1470 con 0x7f348c0c46f0 2024-03-23T23:47:34.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.934+0000 7f348a000640 1 --2- 172.21.15.8:0/1853561708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f348c0c46f0 0x7f348c14a910 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f348c0753a0 tx=0x7f3478019600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.938+0000 7f3482a00640 1 -- 172.21.15.8:0/1853561708 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34780b5780 con 0x7f348c0c46f0 2024-03-23T23:47:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.938+0000 7f3482a00640 1 -- 172.21.15.8:0/1853561708 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34780b9030 con 0x7f348c0c46f0 2024-03-23T23:47:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.938+0000 7f3482a00640 1 -- 172.21.15.8:0/1853561708 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34780b5b20 con 0x7f348c0c46f0 2024-03-23T23:47:34.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.938+0000 7f3491600640 1 -- 172.21.15.8:0/1853561708 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f348c1e9bc0 con 0x7f348c0c46f0 2024-03-23T23:47:34.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.938+0000 7f3491600640 1 -- 172.21.15.8:0/1853561708 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348c1e9e80 con 0x7f348c0c46f0 2024-03-23T23:47:34.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.942+0000 7f3477e00640 1 -- 172.21.15.8:0/1853561708 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f348c068270 con 0x7f348c0c46f0 2024-03-23T23:47:34.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.950+0000 7f3482a00640 1 -- 172.21.15.8:0/1853561708 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f34780a57e0 con 0x7f348c0c46f0 2024-03-23T23:47:34.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.954+0000 7f3482a00640 1 --2- 172.21.15.8:0/1853561708 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f346c067730 0x7f346c069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:34.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.954+0000 7f3482a00640 1 -- 172.21.15.8:0/1853561708 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f34781240b0 con 0x7f348c0c46f0 2024-03-23T23:47:34.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.954+0000 7f3489600640 1 --2- 172.21.15.8:0/1853561708 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f346c067730 0x7f346c069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:34.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.954+0000 7f3489600640 1 --2- 172.21.15.8:0/1853561708 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f346c067730 0x7f346c069bf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f348c072fb0 tx=0x7f3470007eb0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:34.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:34.962+0000 7f3482a00640 1 -- 172.21.15.8:0/1853561708 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f34780165a0 con 0x7f348c0c46f0 2024-03-23T23:47:35.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:35.726+0000 7f3477e00640 1 -- 172.21.15.8:0/1853561708 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f348c071150 con 0x7f348c0c46f0 2024-03-23T23:47:35.728 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":36,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:47:35.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:35.726+0000 7f3482a00640 1 -- 172.21.15.8:0/1853561708 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1561 (secure 0 0 0) 0x7f34780f4390 con 0x7f348c0c46f0 2024-03-23T23:47:35.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:35.730+0000 7f3477e00640 1 -- 172.21.15.8:0/1853561708 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f346c067730 msgr2=0x7f346c069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:35.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:35.730+0000 7f3477e00640 1 --2- 172.21.15.8:0/1853561708 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f346c067730 0x7f346c069bf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f348c072fb0 tx=0x7f3470007eb0 comp rx=0 tx=0).stop 2024-03-23T23:47:35.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:35.734+0000 7f3477e00640 1 -- 172.21.15.8:0/1853561708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f348c0c46f0 msgr2=0x7f348c14a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:35.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:35.734+0000 7f3477e00640 1 --2- 172.21.15.8:0/1853561708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f348c0c46f0 0x7f348c14a910 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f348c0753a0 tx=0x7f3478019600 comp rx=0 tx=0).stop 2024-03-23T23:47:35.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:35.734+0000 7f3477e00640 1 -- 172.21.15.8:0/1853561708 shutdown_connections 2024-03-23T23:47:35.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:35.734+0000 7f3477e00640 1 --2- 172.21.15.8:0/1853561708 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f346c067730 0x7f346c069bf0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:35.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:35.734+0000 7f3477e00640 1 --2- 172.21.15.8:0/1853561708 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f348c152150 0x7f348c1ed130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:35.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:35.734+0000 7f3477e00640 1 --2- 172.21.15.8:0/1853561708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f348c14ebe0 0x7f348c150540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:35.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:35.734+0000 7f3477e00640 1 --2- 172.21.15.8:0/1853561708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f348c0c46f0 0x7f348c14a910 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:35.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:35.734+0000 7f3477e00640 1 -- 172.21.15.8:0/1853561708 >> 172.21.15.8:0/1853561708 conn(0x7f348c0c3bd0 msgr2=0x7f348c0c19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:47:35.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:35.734+0000 7f3477e00640 1 -- 172.21.15.8:0/1853561708 shutdown_connections 2024-03-23T23:47:35.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:35.734+0000 7f3477e00640 1 -- 172.21.15.8:0/1853561708 wait complete. 2024-03-23T23:47:35.852 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T23:47:35.852 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-03-23T23:47:35.853 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T23:47:35.853 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:47:36.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.158+0000 7f117ee00640 1 Processor -- start 2024-03-23T23:47:36.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.158+0000 7f117ee00640 1 -- start start 2024-03-23T23:47:36.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.162+0000 7f117ee00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f117814ef10 0x7f11780c1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:36.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.162+0000 7f117ee00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1178072ff0 0x7f1178151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:36.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.162+0000 7f117ee00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f117806e1d0 con 0x7f117806dcb0 2024-03-23T23:47:36.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.162+0000 7f117ee00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f117806d940 con 0x7f117814ef10 2024-03-23T23:47:36.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.162+0000 7f117ee00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1178152510 con 0x7f1178072ff0 2024-03-23T23:47:36.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.162+0000 7f117da00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f117814ef10 0x7f11780c1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:36.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.162+0000 7f117da00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f117814ef10 0x7f11780c1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40198/0 (socket says 172.21.15.8:40198) 2024-03-23T23:47:36.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.162+0000 7f117da00640 1 -- 172.21.15.8:0/3170965544 learned_addr learned my addr 172.21.15.8:0/3170965544 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:47:36.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.162+0000 7f117da00640 1 -- 172.21.15.8:0/3170965544 >> v2:172.21.15.196:3300/0 conn(0x7f1178072ff0 msgr2=0x7f1178151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:47:36.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.162+0000 7f117e400640 1 --2- 172.21.15.8:0/3170965544 >> v2:172.21.15.196:3300/0 conn(0x7f1178072ff0 0x7f1178151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:36.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.162+0000 7f117da00640 1 --2- 172.21.15.8:0/3170965544 >> v2:172.21.15.196:3300/0 conn(0x7f1178072ff0 0x7f1178151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:36.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.162+0000 7f117da00640 1 -- 172.21.15.8:0/3170965544 >> v1:172.21.15.196:6789/0 conn(0x7f117806dcb0 legacy=0x7f11781517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:47:36.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.162+0000 7f117da00640 1 -- 172.21.15.8:0/3170965544 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117806d180 con 0x7f117814ef10 2024-03-23T23:47:36.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.162+0000 7f117e400640 1 --2- 172.21.15.8:0/3170965544 >> v2:172.21.15.196:3300/0 conn(0x7f1178072ff0 0x7f1178151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:47:36.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.170+0000 7f117da00640 1 --2- 172.21.15.8:0/3170965544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f117814ef10 0x7f11780c1ad0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f117806f950 tx=0x7f116c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60ebb82d2363efab server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:36.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.178+0000 7f1177e00640 1 -- 172.21.15.8:0/3170965544 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c0b2070 con 0x7f117814ef10 2024-03-23T23:47:36.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.178+0000 7f1177e00640 1 -- 172.21.15.8:0/3170965544 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116c0a9070 con 0x7f117814ef10 2024-03-23T23:47:36.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.178+0000 7f1177e00640 1 -- 172.21.15.8:0/3170965544 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c0ad880 con 0x7f117814ef10 2024-03-23T23:47:36.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.182+0000 7f117ee00640 1 -- 172.21.15.8:0/3170965544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f117814ef10 msgr2=0x7f11780c1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:36.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.182+0000 7f117ee00640 1 --2- 172.21.15.8:0/3170965544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f117814ef10 0x7f11780c1ad0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f117806f950 tx=0x7f116c01c450 comp rx=0 tx=0).stop 2024-03-23T23:47:36.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.182+0000 7f117ee00640 1 -- 172.21.15.8:0/3170965544 shutdown_connections 2024-03-23T23:47:36.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.182+0000 7f117ee00640 1 --2- 172.21.15.8:0/3170965544 >> v2:172.21.15.196:3300/0 conn(0x7f1178072ff0 0x7f1178151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:36.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.182+0000 7f117ee00640 1 --2- 172.21.15.8:0/3170965544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f117814ef10 0x7f11780c1ad0 secure :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f117806f950 tx=0x7f116c01c450 comp rx=0 tx=0).stop 2024-03-23T23:47:36.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.182+0000 7f117ee00640 1 -- 172.21.15.8:0/3170965544 >> 172.21.15.8:0/3170965544 conn(0x7f117806b170 msgr2=0x7f117806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:47:36.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.182+0000 7f117ee00640 1 -- 172.21.15.8:0/3170965544 shutdown_connections 2024-03-23T23:47:36.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.182+0000 7f117ee00640 1 -- 172.21.15.8:0/3170965544 wait complete. 2024-03-23T23:47:36.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.186+0000 7f117ee00640 1 Processor -- start 2024-03-23T23:47:36.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.186+0000 7f117ee00640 1 -- start start 2024-03-23T23:47:36.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.186+0000 7f117ee00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f117806dcb0 0x7f1178150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:36.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.186+0000 7f117ee00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1178072ff0 0x7f1178147e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:36.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.186+0000 7f117ee00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11780aa160 0x7f11781507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:36.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.186+0000 7f117ee00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117815e8b0 con 0x7f1178072ff0 2024-03-23T23:47:36.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.186+0000 7f117ee00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117806bea0 con 0x7f117806dcb0 2024-03-23T23:47:36.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.186+0000 7f117ee00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f117815ea30 con 0x7f11780aa160 2024-03-23T23:47:36.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.194+0000 7f117e400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11780aa160 0x7f11781507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:36.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.194+0000 7f117da00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f117806dcb0 0x7f1178150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:36.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.194+0000 7f117da00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f117806dcb0 0x7f1178150130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:42312/0 (socket says 172.21.15.8:42312) 2024-03-23T23:47:36.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.194+0000 7f117da00640 1 -- 172.21.15.8:0/1022642347 learned_addr learned my addr 172.21.15.8:0/1022642347 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:47:36.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.194+0000 7f117e400640 1 --2- 172.21.15.8:0/1022642347 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11780aa160 0x7f11781507c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:34800/0 (socket says 172.21.15.8:34800) 2024-03-23T23:47:36.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.194+0000 7f117d000640 1 --2- 172.21.15.8:0/1022642347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1178072ff0 0x7f1178147e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:36.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.194+0000 7f117da00640 1 -- 172.21.15.8:0/1022642347 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11780aa160 msgr2=0x7f11781507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:36.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.194+0000 7f117da00640 1 --2- 172.21.15.8:0/1022642347 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11780aa160 0x7f11781507c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:36.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.194+0000 7f117da00640 1 -- 172.21.15.8:0/1022642347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1178072ff0 msgr2=0x7f1178147e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:36.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.194+0000 7f117da00640 1 --2- 172.21.15.8:0/1022642347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1178072ff0 0x7f1178147e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:36.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.194+0000 7f117da00640 1 -- 172.21.15.8:0/1022642347 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117814f6c0 con 0x7f117806dcb0 2024-03-23T23:47:36.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.198+0000 7f117e400640 1 --2- 172.21.15.8:0/1022642347 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11780aa160 0x7f11781507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:47:36.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.198+0000 7f117da00640 1 --2- 172.21.15.8:0/1022642347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f117806dcb0 0x7f1178150130 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f116c019060 tx=0x7f116c01ac90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:36.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.202+0000 7f1175600640 1 -- 172.21.15.8:0/1022642347 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c0b2040 con 0x7f117806dcb0 2024-03-23T23:47:36.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.202+0000 7f1175600640 1 -- 172.21.15.8:0/1022642347 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116c0be070 con 0x7f117806dcb0 2024-03-23T23:47:36.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.202+0000 7f1175600640 1 -- 172.21.15.8:0/1022642347 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c0b8660 con 0x7f117806dcb0 2024-03-23T23:47:36.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.202+0000 7f117ee00640 1 -- 172.21.15.8:0/1022642347 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f117814bf00 con 0x7f117806dcb0 2024-03-23T23:47:36.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.202+0000 7f117ee00640 1 -- 172.21.15.8:0/1022642347 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1178148730 con 0x7f117806dcb0 2024-03-23T23:47:36.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.206+0000 7f117ee00640 1 --2- 172.21.15.8:0/1022642347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1178146350 0x7f1178151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:36.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.206+0000 7f117ee00640 1 -- 172.21.15.8:0/1022642347 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117814fb00 con 0x7f1178146350 2024-03-23T23:47:36.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.206+0000 7f1175600640 1 -- 172.21.15.8:0/1022642347 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f116c0ab070 con 0x7f117806dcb0 2024-03-23T23:47:36.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.206+0000 7f117d000640 1 --2- 172.21.15.8:0/1022642347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1178146350 0x7f1178151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:36.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.206+0000 7f1175600640 1 --2- 172.21.15.8:0/1022642347 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1158067730 0x7f1158069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:36.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.206+0000 7f1175600640 1 -- 172.21.15.8:0/1022642347 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f116c11fbd0 con 0x7f117806dcb0 2024-03-23T23:47:36.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.210+0000 7f117d000640 1 -- 172.21.15.8:0/1022642347 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1178152230 con 0x7f1178146350 2024-03-23T23:47:36.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.210+0000 7f117d000640 1 --2- 172.21.15.8:0/1022642347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1178146350 0x7f1178151280 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f117814e530 tx=0x7f116400f9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:36.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.210+0000 7f117e400640 1 --2- 172.21.15.8:0/1022642347 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1158067730 0x7f1158069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:36.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.218+0000 7f1175600640 1 -- 172.21.15.8:0/1022642347 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11640052e0 con 0x7f1178146350 2024-03-23T23:47:36.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.222+0000 7f117e400640 1 --2- 172.21.15.8:0/1022642347 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1158067730 0x7f1158069bf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f11780aa570 tx=0x7f11700073f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:36.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.230+0000 7f1175600640 1 -- 172.21.15.8:0/1022642347 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f1164018070 con 0x7f1178146350 2024-03-23T23:47:36.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.230+0000 7f1175600640 1 -- 172.21.15.8:0/1022642347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1178146350 msgr2=0x7f1178151280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:36.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.230+0000 7f1175600640 1 --2- 172.21.15.8:0/1022642347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1178146350 0x7f1178151280 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f117814e530 tx=0x7f116400f9d0 comp rx=0 tx=0).stop 2024-03-23T23:47:36.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.230+0000 7f1175600640 1 -- 172.21.15.8:0/1022642347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1178146350 msgr2=0x7f1178151280 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:47:36.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.230+0000 7f1175600640 1 --2- 172.21.15.8:0/1022642347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1178146350 0x7f1178151280 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f117814e530 tx=0x7f116400f9d0 comp rx=0 tx=0).stop 2024-03-23T23:47:36.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.258+0000 7f117ee00640 1 --2- 172.21.15.8:0/1022642347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11781517c0 0x7f11781f62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:36.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.258+0000 7f117ee00640 1 -- 172.21.15.8:0/1022642347 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117806cf60 con 0x7f11781517c0 2024-03-23T23:47:36.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.262+0000 7f117d000640 1 --2- 172.21.15.8:0/1022642347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11781517c0 0x7f11781f62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:36.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.262+0000 7f117d000640 1 -- 172.21.15.8:0/1022642347 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1178072280 con 0x7f11781517c0 2024-03-23T23:47:36.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.270+0000 7f117d000640 1 --2- 172.21.15.8:0/1022642347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11781517c0 0x7f11781f62f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1164000c10 tx=0x7f1164001030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:36.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.270+0000 7f1175600640 1 -- 172.21.15.8:0/1022642347 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1164003950 con 0x7f11781517c0 2024-03-23T23:47:36.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.270+0000 7f1175600640 1 -- 172.21.15.8:0/1022642347 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4532 (secure 0 0 0) 0x7f1164003af0 con 0x7f11781517c0 2024-03-23T23:47:36.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.270+0000 7f1175600640 1 -- 172.21.15.8:0/1022642347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11781517c0 msgr2=0x7f11781f62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:36.272 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:47:36.272 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:47:36.272 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:47:36.272 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:47:36.272 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 36, 2024-03-23T23:47:36.273 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:47:36.273 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:47:36.273 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:47:36.273 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:47:36.273 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:36.273 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 14, 2024-03-23T23:47:36.273 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:47:36.273 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:47:36.273 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:47:36.273 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:47:36.274 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:47:36.274 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:47:36.274 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:47:36.274 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:47:36.274 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:47:36.274 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:47:36.274 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:47:36.274 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:47:36.274 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:47:36.274 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:47:36.274 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:36.274 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:47:36.274 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:47:36.275 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:47:36.275 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:47:36.275 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:47:36.275 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:47:36.275 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:47:36.275 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:47:36.275 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:47:36.275 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:47:36.275 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:47:36.275 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:47:36.275 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:47:36.275 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:36.275 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:36.275 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:47:36.276 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:47:36.276 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:47:36.276 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:47:36.276 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:47:36.276 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:47:36.276 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:47:36.276 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:47:36.276 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:47:36.276 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:47:36.276 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:47:36.276 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:47:36.276 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:47:36.276 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:47:36.277 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:47:36.277 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:47:36.277 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:47:36.277 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:47:36.277 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:47:36.277 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:47:36.277 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:47:36.277 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:47:36.277 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:47:36.277 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:47:36.277 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:47:36.277 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:47:36.277 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:47:36.277 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:47:36.278 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:36.278 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:47:36.278 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:36.278 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:47:36.278 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:36.278 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:47:36.278 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:47:36.278 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:47:36.278 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:47:36.278 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:36.278 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:47:36.278 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:47:36.279 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:36.279 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:36.279 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:36.279 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:47:36.279 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:47:36.279 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:36.279 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:36.279 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:36.279 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:36.279 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:47:36.279 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:47:36.279 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:47:36.279 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:47:36.279 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:47:36.280 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:36.280 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:36.280 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:47:36.280 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:47:36.280 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:47:36.280 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:47:36.280 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:36.280 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:47:36.280 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:47:36.280 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:36.280 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:36.280 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:36.280 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:47:36.281 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:47:36.281 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:36.281 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:36.281 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:36.281 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:36.281 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:47:36.281 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:47:36.281 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:47:36.281 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:47:36.281 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:47:36.281 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:36.281 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:36.281 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:47:36.282 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:47:36.282 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:47:36.282 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:47:36.282 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:36.282 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:47:36.282 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:47:36.282 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:36.282 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:36.282 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:36.282 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:47:36.282 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:47:36.282 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:36.282 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:36.283 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:36.283 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:36.283 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:47:36.283 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:47:36.283 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:47:36.283 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:47:36.283 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:47:36.283 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:36.283 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:36.283 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:36.283 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:47:36.283 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:47:36.283 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:36.283 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:47:36.283 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:36.284 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:47:36.284 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:36.284 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:36.284 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:47:36.284 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:36.284 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:47:36.284 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:36.284 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:47:36.284 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:36.284 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:36.284 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:36.284 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:47:36.284 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:47:36.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.270+0000 7f1175600640 1 --2- 172.21.15.8:0/1022642347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11781517c0 0x7f11781f62f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1164000c10 tx=0x7f1164001030 comp rx=0 tx=0).stop 2024-03-23T23:47:36.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.274+0000 7f1175600640 1 -- 172.21.15.8:0/1022642347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11781517c0 msgr2=0x7f11781f62f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:47:36.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.274+0000 7f1175600640 1 --2- 172.21.15.8:0/1022642347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11781517c0 0x7f11781f62f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:36.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.278+0000 7f116aa00640 1 -- 172.21.15.8:0/1022642347 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1158067730 msgr2=0x7f1158069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:36.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.278+0000 7f116aa00640 1 --2- 172.21.15.8:0/1022642347 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1158067730 0x7f1158069bf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f11780aa570 tx=0x7f11700073f0 comp rx=0 tx=0).stop 2024-03-23T23:47:36.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.278+0000 7f116aa00640 1 -- 172.21.15.8:0/1022642347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f117806dcb0 msgr2=0x7f1178150130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:36.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.278+0000 7f116aa00640 1 --2- 172.21.15.8:0/1022642347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f117806dcb0 0x7f1178150130 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f116c019060 tx=0x7f116c01ac90 comp rx=0 tx=0).stop 2024-03-23T23:47:36.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.282+0000 7f117e400640 1 -- 172.21.15.8:0/1022642347 reap_dead start 2024-03-23T23:47:36.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.282+0000 7f117e400640 1 -- 172.21.15.8:0/1022642347 reap_dead start 2024-03-23T23:47:36.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.282+0000 7f116aa00640 1 -- 172.21.15.8:0/1022642347 shutdown_connections 2024-03-23T23:47:36.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.282+0000 7f116aa00640 1 -- 172.21.15.8:0/1022642347 >> 172.21.15.8:0/1022642347 conn(0x7f117806b170 msgr2=0x7f117814c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:47:36.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.282+0000 7f116aa00640 1 -- 172.21.15.8:0/1022642347 shutdown_connections 2024-03-23T23:47:36.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.282+0000 7f116aa00640 1 -- 172.21.15.8:0/1022642347 wait complete. 2024-03-23T23:47:36.327 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:47:36.328 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T23:47:36.328 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:47:36.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.698+0000 7f9e12400640 1 Processor -- start 2024-03-23T23:47:36.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.698+0000 7f9e12400640 1 -- start start 2024-03-23T23:47:36.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.702+0000 7f9e12400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e0c154410 0x7f9e0c0c6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:36.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.702+0000 7f9e12400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9e0c0c3bc0 0x7f9e0c0c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:36.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.702+0000 7f9e12400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e0c06e290 con 0x7f9e0c153810 2024-03-23T23:47:36.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.702+0000 7f9e12400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e0c1547f0 con 0x7f9e0c0c3bc0 2024-03-23T23:47:36.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.702+0000 7f9e12400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c0c7a20 con 0x7f9e0c154410 2024-03-23T23:47:36.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.702+0000 7f9e0b400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e0c154410 0x7f9e0c0c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:36.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.702+0000 7f9e0b400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e0c154410 0x7f9e0c0c6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:34804/0 (socket says 172.21.15.8:34804) 2024-03-23T23:47:36.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.702+0000 7f9e0b400640 1 -- 172.21.15.8:0/3518533685 learned_addr learned my addr 172.21.15.8:0/3518533685 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:47:36.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.706+0000 7f9e0aa00640 1 --2- 172.21.15.8:0/3518533685 >> v2:172.21.15.196:3300/0 conn(0x7f9e0c0c3bc0 0x7f9e0c0c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:36.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.710+0000 7f9e0a000640 1 -- 172.21.15.8:0/3518533685 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 680721725 0 0) 0x7f9e0c06e290 con 0x7f9e0c153810 2024-03-23T23:47:36.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.710+0000 7f9e0a000640 1 -- 172.21.15.8:0/3518533685 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9df0003530 con 0x7f9e0c153810 2024-03-23T23:47:36.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.714+0000 7f9e0aa00640 1 -- 172.21.15.8:0/3518533685 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e0c154410 msgr2=0x7f9e0c0c6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:47:36.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.714+0000 7f9e0aa00640 1 --2- 172.21.15.8:0/3518533685 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e0c154410 0x7f9e0c0c6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:36.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.714+0000 7f9e0aa00640 1 -- 172.21.15.8:0/3518533685 >> v1:172.21.15.196:6789/0 conn(0x7f9e0c153810 legacy=0x7f9e0c157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:36.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.714+0000 7f9e0aa00640 1 -- 172.21.15.8:0/3518533685 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c0c4080 con 0x7f9e0c0c3bc0 2024-03-23T23:47:36.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.726+0000 7f9e0aa00640 1 --2- 172.21.15.8:0/3518533685 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e0c0c3bc0 0x7f9e0c0c4a40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9df80097c0 tx=0x7f9df801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=171c74023d99ba2 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:36.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.726+0000 7f9e0a000640 1 -- 172.21.15.8:0/3518533685 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df80b0070 con 0x7f9e0c0c3bc0 2024-03-23T23:47:36.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.726+0000 7f9e0a000640 1 -- 172.21.15.8:0/3518533685 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df80ab600 con 0x7f9e0c0c3bc0 2024-03-23T23:47:36.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.726+0000 7f9e0a000640 1 -- 172.21.15.8:0/3518533685 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df80ab9d0 con 0x7f9e0c0c3bc0 2024-03-23T23:47:36.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.730+0000 7f9e12400640 1 -- 172.21.15.8:0/3518533685 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e0c0c3bc0 msgr2=0x7f9e0c0c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:36.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.730+0000 7f9e12400640 1 --2- 172.21.15.8:0/3518533685 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e0c0c3bc0 0x7f9e0c0c4a40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9df80097c0 tx=0x7f9df801c450 comp rx=0 tx=0).stop 2024-03-23T23:47:36.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.730+0000 7f9e12400640 1 -- 172.21.15.8:0/3518533685 shutdown_connections 2024-03-23T23:47:36.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.730+0000 7f9e12400640 1 --2- 172.21.15.8:0/3518533685 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e0c0c3bc0 0x7f9e0c0c4a40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:36.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.730+0000 7f9e12400640 1 --2- 172.21.15.8:0/3518533685 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e0c154410 0x7f9e0c0c6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:36.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.730+0000 7f9e12400640 1 -- 172.21.15.8:0/3518533685 >> 172.21.15.8:0/3518533685 conn(0x7f9e0c0743f0 msgr2=0x7f9e0c074800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:47:36.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.730+0000 7f9e12400640 1 -- 172.21.15.8:0/3518533685 shutdown_connections 2024-03-23T23:47:36.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.730+0000 7f9e12400640 1 -- 172.21.15.8:0/3518533685 wait complete. 2024-03-23T23:47:36.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.734+0000 7f9e12400640 1 Processor -- start 2024-03-23T23:47:36.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.738+0000 7f9e12400640 1 -- start start 2024-03-23T23:47:36.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.738+0000 7f9e12400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e0c0c3bc0 0x7f9e0c06dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:36.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.738+0000 7f9e12400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e0c153810 0x7f9e0c148ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:36.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.738+0000 7f9e12400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e0c154410 0x7f9e0c1f2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:36.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.738+0000 7f9e12400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c15ea40 con 0x7f9e0c153810 2024-03-23T23:47:36.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.738+0000 7f9e12400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c15e8c0 con 0x7f9e0c0c3bc0 2024-03-23T23:47:36.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.738+0000 7f9e12400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c15ebc0 con 0x7f9e0c154410 2024-03-23T23:47:36.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.738+0000 7f9e0be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e0c154410 0x7f9e0c1f2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:36.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.738+0000 7f9e0be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e0c154410 0x7f9e0c1f2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:34806/0 (socket says 172.21.15.8:34806) 2024-03-23T23:47:36.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.738+0000 7f9e0be00640 1 -- 172.21.15.8:0/1328900242 learned_addr learned my addr 172.21.15.8:0/1328900242 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:47:36.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.742+0000 7f9e0b400640 1 --2- 172.21.15.8:0/1328900242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e0c0c3bc0 0x7f9e0c06dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:36.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.742+0000 7f9e0be00640 1 -- 172.21.15.8:0/1328900242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e0c0c3bc0 msgr2=0x7f9e0c06dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:36.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.742+0000 7f9e0be00640 1 --2- 172.21.15.8:0/1328900242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e0c0c3bc0 0x7f9e0c06dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:36.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.742+0000 7f9e0be00640 1 -- 172.21.15.8:0/1328900242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e0c153810 msgr2=0x7f9e0c148ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:36.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.742+0000 7f9e0be00640 1 --2- 172.21.15.8:0/1328900242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e0c153810 0x7f9e0c148ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:36.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.742+0000 7f9e0be00640 1 -- 172.21.15.8:0/1328900242 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c161250 con 0x7f9e0c154410 2024-03-23T23:47:36.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.742+0000 7f9e0be00640 1 --2- 172.21.15.8:0/1328900242 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e0c154410 0x7f9e0c1f2e80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9e0400c770 tx=0x7f9e0400cc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:36.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.746+0000 7f9e03400640 1 -- 172.21.15.8:0/1328900242 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e04003b80 con 0x7f9e0c154410 2024-03-23T23:47:36.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.746+0000 7f9e03400640 1 -- 172.21.15.8:0/1328900242 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e04003d20 con 0x7f9e0c154410 2024-03-23T23:47:36.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.746+0000 7f9e03400640 1 -- 172.21.15.8:0/1328900242 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0400aa90 con 0x7f9e0c154410 2024-03-23T23:47:36.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.746+0000 7f9e12400640 1 -- 172.21.15.8:0/1328900242 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e0c1f7050 con 0x7f9e0c154410 2024-03-23T23:47:36.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.746+0000 7f9e12400640 1 -- 172.21.15.8:0/1328900242 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e0c15f530 con 0x7f9e0c154410 2024-03-23T23:47:36.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.750+0000 7f9e12400640 1 --2- 172.21.15.8:0/1328900242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e0c0ae0a0 0x7f9e0c145560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:36.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.750+0000 7f9e12400640 1 -- 172.21.15.8:0/1328900242 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c1f6e00 con 0x7f9e0c0ae0a0 2024-03-23T23:47:36.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.754+0000 7f9e0b400640 1 --2- 172.21.15.8:0/1328900242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e0c0ae0a0 0x7f9e0c145560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:36.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.770+0000 7f9e0b400640 1 -- 172.21.15.8:0/1328900242 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9e0c068270 con 0x7f9e0c0ae0a0 2024-03-23T23:47:36.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.774+0000 7f9e0b400640 1 --2- 172.21.15.8:0/1328900242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e0c0ae0a0 0x7f9e0c145560 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc00f580 tx=0x7f9dfc00fa40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:36.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.774+0000 7f9e03400640 1 -- 172.21.15.8:0/1328900242 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc019030 con 0x7f9e0c0ae0a0 2024-03-23T23:47:36.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.778+0000 7f9e03400640 1 -- 172.21.15.8:0/1328900242 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f9dfc004020 con 0x7f9e0c0ae0a0 2024-03-23T23:47:36.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.778+0000 7f9e03400640 1 -- 172.21.15.8:0/1328900242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e0c0ae0a0 msgr2=0x7f9e0c145560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:36.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.778+0000 7f9e03400640 1 --2- 172.21.15.8:0/1328900242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e0c0ae0a0 0x7f9e0c145560 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc00f580 tx=0x7f9dfc00fa40 comp rx=0 tx=0).stop 2024-03-23T23:47:36.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.778+0000 7f9e03400640 1 -- 172.21.15.8:0/1328900242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e0c0ae0a0 msgr2=0x7f9e0c145560 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:47:36.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.778+0000 7f9e03400640 1 --2- 172.21.15.8:0/1328900242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e0c0ae0a0 0x7f9e0c145560 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc00f580 tx=0x7f9dfc00fa40 comp rx=0 tx=0).stop 2024-03-23T23:47:36.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.782+0000 7f9e03400640 1 -- 172.21.15.8:0/1328900242 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f9e0400ac30 con 0x7f9e0c154410 2024-03-23T23:47:36.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.786+0000 7f9e03400640 1 --2- 172.21.15.8:0/1328900242 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9dec067260 0x7f9dec069720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:36.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.786+0000 7f9e03400640 1 -- 172.21.15.8:0/1328900242 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f9e04085c30 con 0x7f9e0c154410 2024-03-23T23:47:36.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.794+0000 7f9e0b400640 1 --2- 172.21.15.8:0/1328900242 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9dec067260 0x7f9dec069720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:36.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.798+0000 7f9e12400640 1 --2- 172.21.15.8:0/1328900242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e0c15f900 0x7f9e0c145aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:36.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.798+0000 7f9e12400640 1 -- 172.21.15.8:0/1328900242 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c0c3230 con 0x7f9e0c15f900 2024-03-23T23:47:36.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.798+0000 7f9e0b400640 1 --2- 172.21.15.8:0/1328900242 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9dec067260 0x7f9dec069720 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc008010 tx=0x7f9dfc014000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:36.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.802+0000 7f9e0aa00640 1 --2- 172.21.15.8:0/1328900242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e0c15f900 0x7f9e0c145aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:36.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.802+0000 7f9e0aa00640 1 -- 172.21.15.8:0/1328900242 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9e0c152510 con 0x7f9e0c15f900 2024-03-23T23:47:36.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.810+0000 7f9e0aa00640 1 --2- 172.21.15.8:0/1328900242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e0c15f900 0x7f9e0c145aa0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c067f70 tx=0x7f9df80aba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:36.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.814+0000 7f9e03400640 1 -- 172.21.15.8:0/1328900242 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df80b9030 con 0x7f9e0c15f900 2024-03-23T23:47:36.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.818+0000 7f9e03400640 1 -- 172.21.15.8:0/1328900242 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4843 (secure 0 0 0) 0x7f9df80093e0 con 0x7f9e0c15f900 2024-03-23T23:47:36.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.818+0000 7f9e03400640 1 -- 172.21.15.8:0/1328900242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e0c15f900 msgr2=0x7f9e0c145aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:36.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.818+0000 7f9e03400640 1 --2- 172.21.15.8:0/1328900242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e0c15f900 0x7f9e0c145aa0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c067f70 tx=0x7f9df80aba10 comp rx=0 tx=0).stop 2024-03-23T23:47:36.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.818+0000 7f9e03400640 1 -- 172.21.15.8:0/1328900242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e0c15f900 msgr2=0x7f9e0c145aa0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:47:36.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.818+0000 7f9e03400640 1 --2- 172.21.15.8:0/1328900242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e0c15f900 0x7f9e0c145aa0 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c067f70 tx=0x7f9df80aba10 comp rx=0 tx=0).stop 2024-03-23T23:47:36.817 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:47:36.818 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:47:36.818 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:47:36.818 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:47:36.818 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 36, 2024-03-23T23:47:36.818 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:47:36.819 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:47:36.819 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:47:36.819 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:47:36.819 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:36.819 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 15, 2024-03-23T23:47:36.819 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:47:36.819 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:47:36.819 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:47:36.819 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:47:36.819 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:47:36.819 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:47:36.820 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:47:36.820 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:47:36.820 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:47:36.820 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:47:36.820 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:47:36.820 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:47:36.820 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:47:36.820 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:47:36.820 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:36.820 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:47:36.820 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:47:36.820 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:47:36.820 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:47:36.821 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:47:36.821 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:47:36.821 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:47:36.821 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:47:36.821 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:47:36.821 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:47:36.821 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:47:36.821 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:47:36.821 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:47:36.821 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:36.821 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:36.821 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:47:36.821 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:47:36.821 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:47:36.822 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:47:36.822 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:47:36.822 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:47:36.822 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:47:36.822 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:47:36.822 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:47:36.822 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:47:36.822 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:47:36.822 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:47:36.822 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:47:36.822 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:47:36.822 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:47:36.822 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:47:36.823 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:47:36.823 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:47:36.823 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:47:36.823 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:47:36.823 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:47:36.823 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:47:36.823 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:47:36.823 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:47:36.823 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:47:36.823 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:47:36.823 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:47:36.823 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:47:36.823 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:36.823 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:47:36.824 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:36.824 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:47:36.824 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:36.824 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:47:36.824 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:47:36.824 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:47:36.824 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:47:36.824 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:36.824 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:47:36.824 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:47:36.824 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:36.824 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:36.824 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:36.824 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:47:36.825 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:47:36.825 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:36.825 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:36.825 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:36.825 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:36.825 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:47:36.825 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:47:36.825 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:47:36.825 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:47:36.825 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:47:36.825 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:36.825 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:36.825 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:47:36.826 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:47:36.826 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:47:36.826 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:47:36.826 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:36.826 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:47:36.826 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:47:36.826 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:36.826 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:36.826 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:36.826 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:47:36.826 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:47:36.826 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:36.826 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:36.827 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:36.827 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:36.827 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:47:36.827 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:47:36.827 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:47:36.827 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:47:36.827 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:47:36.827 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:36.827 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:36.827 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:47:36.827 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:47:36.827 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:47:36.827 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:47:36.827 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:36.828 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:47:36.828 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:47:36.828 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:36.828 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:36.828 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:36.828 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:47:36.828 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:47:36.828 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:36.828 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:36.828 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:36.828 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:36.828 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:47:36.828 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:47:36.828 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:47:36.829 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:47:36.829 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:47:36.829 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:36.829 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:36.829 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:36.829 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:47:36.829 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:47:36.829 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:36.829 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:47:36.829 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:36.829 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:47:36.829 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:36.829 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:36.830 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:47:36.830 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:36.830 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:47:36.830 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:36.830 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:47:36.830 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:36.830 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:36.830 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:47:36.830 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:36.830 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:47:36.830 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:36.830 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:47:36.830 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:36.830 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:36.831 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:47:36.831 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:36.831 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:47:36.831 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:36.831 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:36.831 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:36.831 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:47:36.831 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:47:36.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.818+0000 7f9e12400640 1 -- 172.21.15.8:0/1328900242 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9dec067260 msgr2=0x7f9dec069720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:36.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.818+0000 7f9e12400640 1 --2- 172.21.15.8:0/1328900242 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9dec067260 0x7f9dec069720 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc008010 tx=0x7f9dfc014000 comp rx=0 tx=0).stop 2024-03-23T23:47:36.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.818+0000 7f9e0be00640 1 -- 172.21.15.8:0/1328900242 reap_dead start 2024-03-23T23:47:36.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.818+0000 7f9e12400640 1 -- 172.21.15.8:0/1328900242 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e0c154410 msgr2=0x7f9e0c1f2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:36.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.818+0000 7f9e12400640 1 --2- 172.21.15.8:0/1328900242 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e0c154410 0x7f9e0c1f2e80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9e0400c770 tx=0x7f9e0400cc30 comp rx=0 tx=0).stop 2024-03-23T23:47:36.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.818+0000 7f9e0be00640 1 -- 172.21.15.8:0/1328900242 reap_dead start 2024-03-23T23:47:36.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.818+0000 7f9e12400640 1 -- 172.21.15.8:0/1328900242 shutdown_connections 2024-03-23T23:47:36.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.818+0000 7f9e12400640 1 -- 172.21.15.8:0/1328900242 >> 172.21.15.8:0/1328900242 conn(0x7f9e0c0743f0 msgr2=0x7f9e0c0747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:47:36.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.818+0000 7f9e12400640 1 -- 172.21.15.8:0/1328900242 shutdown_connections 2024-03-23T23:47:36.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:36.826+0000 7f9e12400640 1 -- 172.21.15.8:0/1328900242 wait complete. 2024-03-23T23:47:36.968 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:47:36.968 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T23:47:36.968 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:47:37.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.246+0000 7f09a7400640 1 Processor -- start 2024-03-23T23:47:37.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.246+0000 7f09a7400640 1 -- start start 2024-03-23T23:47:37.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.246+0000 7f09a7400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09a006df70 0x7f09a006ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:37.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.246+0000 7f09a7400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f09a0152230 0x7f09a0152680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:37.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.246+0000 7f09a7400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09a0155450 con 0x7f09a00c3780 2024-03-23T23:47:37.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.246+0000 7f09a7400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a0155730 con 0x7f09a0152230 2024-03-23T23:47:37.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.246+0000 7f09a7400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a0155a10 con 0x7f09a006df70 2024-03-23T23:47:37.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.246+0000 7f09a4a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09a006df70 0x7f09a006ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:37.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.246+0000 7f09a4a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09a006df70 0x7f09a006ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:34812/0 (socket says 172.21.15.8:34812) 2024-03-23T23:47:37.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.246+0000 7f09a4a00640 1 -- 172.21.15.8:0/888479234 learned_addr learned my addr 172.21.15.8:0/888479234 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:47:37.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.250+0000 7f09a5400640 1 --2- 172.21.15.8:0/888479234 >> v2:172.21.15.8:3300/0 conn(0x7f09a0152230 0x7f09a0152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:37.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.250+0000 7f09a5400640 1 -- 172.21.15.8:0/888479234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09a006df70 msgr2=0x7f09a006ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:47:37.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.250+0000 7f09a5400640 1 --2- 172.21.15.8:0/888479234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09a006df70 0x7f09a006ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:37.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.250+0000 7f09a5400640 1 -- 172.21.15.8:0/888479234 >> v1:172.21.15.8:6789/0 conn(0x7f09a00c3780 legacy=0x7f09a014f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:37.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.250+0000 7f09a5400640 1 -- 172.21.15.8:0/888479234 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a0155cf0 con 0x7f09a0152230 2024-03-23T23:47:37.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.254+0000 7f09a5400640 1 --2- 172.21.15.8:0/888479234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09a0152230 0x7f09a0152680 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0998009d90 tx=0x7f099801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f2fcdb47a163be9 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:37.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.254+0000 7f099f400640 1 -- 172.21.15.8:0/888479234 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09980b2070 con 0x7f09a0152230 2024-03-23T23:47:37.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.254+0000 7f099f400640 1 -- 172.21.15.8:0/888479234 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09980a5780 con 0x7f09a0152230 2024-03-23T23:47:37.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.254+0000 7f09a7400640 1 -- 172.21.15.8:0/888479234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09a0152230 msgr2=0x7f09a0152680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:37.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.254+0000 7f09a7400640 1 --2- 172.21.15.8:0/888479234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09a0152230 0x7f09a0152680 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0998009d90 tx=0x7f099801c850 comp rx=0 tx=0).stop 2024-03-23T23:47:37.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.258+0000 7f09a7400640 1 -- 172.21.15.8:0/888479234 shutdown_connections 2024-03-23T23:47:37.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.258+0000 7f09a7400640 1 --2- 172.21.15.8:0/888479234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09a0152230 0x7f09a0152680 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:37.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.258+0000 7f09a7400640 1 --2- 172.21.15.8:0/888479234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09a006df70 0x7f09a006ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:37.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.258+0000 7f09a7400640 1 -- 172.21.15.8:0/888479234 >> 172.21.15.8:0/888479234 conn(0x7f09a006b170 msgr2=0x7f09a006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:47:37.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.258+0000 7f09a7400640 1 -- 172.21.15.8:0/888479234 shutdown_connections 2024-03-23T23:47:37.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.258+0000 7f09a7400640 1 -- 172.21.15.8:0/888479234 wait complete. 2024-03-23T23:47:37.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.258+0000 7f09a7400640 1 Processor -- start 2024-03-23T23:47:37.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.258+0000 7f09a7400640 1 -- start start 2024-03-23T23:47:37.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.262+0000 7f09a7400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09a006df70 0x7f09a00c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:37.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.262+0000 7f09a7400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09a00c3780 0x7f09a00c5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:37.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.262+0000 7f09a7400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09a0152230 0x7f09a00c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:37.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.262+0000 7f09a7400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a006e4d0 con 0x7f09a006df70 2024-03-23T23:47:37.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.262+0000 7f09a7400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a006e350 con 0x7f09a00c3780 2024-03-23T23:47:37.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.262+0000 7f09a7400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a015e790 con 0x7f09a0152230 2024-03-23T23:47:37.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.262+0000 7f09a4a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09a006df70 0x7f09a00c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:37.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.262+0000 7f09a4a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09a006df70 0x7f09a00c7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40256/0 (socket says 172.21.15.8:40256) 2024-03-23T23:47:37.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.262+0000 7f09a4a00640 1 -- 172.21.15.8:0/2345352169 learned_addr learned my addr 172.21.15.8:0/2345352169 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:47:37.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.262+0000 7f09a5400640 1 --2- 172.21.15.8:0/2345352169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09a0152230 0x7f09a00c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:37.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.266+0000 7f09a4a00640 1 -- 172.21.15.8:0/2345352169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09a0152230 msgr2=0x7f09a00c5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:37.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.266+0000 7f09a4a00640 1 --2- 172.21.15.8:0/2345352169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09a0152230 0x7f09a00c5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:37.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.266+0000 7f09a4a00640 1 -- 172.21.15.8:0/2345352169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09a00c3780 msgr2=0x7f09a00c5870 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-23T23:47:37.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.266+0000 7f09a4a00640 1 --2- 172.21.15.8:0/2345352169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09a00c3780 0x7f09a00c5870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:37.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.266+0000 7f09a4a00640 1 -- 172.21.15.8:0/2345352169 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a014a5f0 con 0x7f09a006df70 2024-03-23T23:47:37.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.266+0000 7f09a4a00640 1 --2- 172.21.15.8:0/2345352169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09a006df70 0x7f09a00c7a80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f098c012a90 tx=0x7f098c012f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:37.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.266+0000 7f099cc00640 1 -- 172.21.15.8:0/2345352169 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c00fa10 con 0x7f09a006df70 2024-03-23T23:47:37.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.266+0000 7f099cc00640 1 -- 172.21.15.8:0/2345352169 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098c01d070 con 0x7f09a006df70 2024-03-23T23:47:37.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.266+0000 7f099cc00640 1 -- 172.21.15.8:0/2345352169 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c00fdd0 con 0x7f09a006df70 2024-03-23T23:47:37.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.266+0000 7f09a7400640 1 -- 172.21.15.8:0/2345352169 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a014eaf0 con 0x7f09a006df70 2024-03-23T23:47:37.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.266+0000 7f09a7400640 1 -- 172.21.15.8:0/2345352169 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a014e810 con 0x7f09a006df70 2024-03-23T23:47:37.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.266+0000 7f09a7400640 1 --2- 172.21.15.8:0/2345352169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09a014d970 0x7f09a01e9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:37.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.266+0000 7f09a7400640 1 -- 172.21.15.8:0/2345352169 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a00c8180 con 0x7f09a014d970 2024-03-23T23:47:37.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.270+0000 7f099cc00640 1 -- 172.21.15.8:0/2345352169 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f098c017070 con 0x7f09a006df70 2024-03-23T23:47:37.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.274+0000 7f099cc00640 1 --2- 172.21.15.8:0/2345352169 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0980067660 0x7f0980069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:37.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.274+0000 7f099cc00640 1 -- 172.21.15.8:0/2345352169 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f098c053150 con 0x7f09a006df70 2024-03-23T23:47:37.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.274+0000 7f099fe00640 1 --2- 172.21.15.8:0/2345352169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09a014d970 0x7f09a01e9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:37.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.274+0000 7f09a5400640 1 --2- 172.21.15.8:0/2345352169 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0980067660 0x7f0980069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:37.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.282+0000 7f099fe00640 1 -- 172.21.15.8:0/2345352169 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f09a0068270 con 0x7f09a014d970 2024-03-23T23:47:37.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.282+0000 7f099fe00640 1 --2- 172.21.15.8:0/2345352169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09a014d970 0x7f09a01e9e20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f09a0151600 tx=0x7f099400c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:37.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.286+0000 7f099cc00640 1 -- 172.21.15.8:0/2345352169 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09940052d0 con 0x7f09a014d970 2024-03-23T23:47:37.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.286+0000 7f099cc00640 1 -- 172.21.15.8:0/2345352169 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f0994005470 con 0x7f09a014d970 2024-03-23T23:47:37.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.286+0000 7f099cc00640 1 -- 172.21.15.8:0/2345352169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09a014d970 msgr2=0x7f09a01e9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:37.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.286+0000 7f099cc00640 1 --2- 172.21.15.8:0/2345352169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09a014d970 0x7f09a01e9e20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f09a0151600 tx=0x7f099400c7a0 comp rx=0 tx=0).stop 2024-03-23T23:47:37.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.286+0000 7f099cc00640 1 -- 172.21.15.8:0/2345352169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09a014d970 msgr2=0x7f09a01e9e20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:47:37.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.286+0000 7f099cc00640 1 --2- 172.21.15.8:0/2345352169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09a014d970 0x7f09a01e9e20 secure :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f09a0151600 tx=0x7f099400c7a0 comp rx=0 tx=0).stop 2024-03-23T23:47:37.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.290+0000 7f09a5400640 1 --2- 172.21.15.8:0/2345352169 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0980067660 0x7f0980069b20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f09980af000 tx=0x7f09980a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:37.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.310+0000 7f09a7400640 1 --2- 172.21.15.8:0/2345352169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09a01ea360 0x7f09a01ed0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:37.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.310+0000 7f09a7400640 1 -- 172.21.15.8:0/2345352169 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a006ead0 con 0x7f09a01ea360 2024-03-23T23:47:37.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.318+0000 7f099fe00640 1 --2- 172.21.15.8:0/2345352169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09a01ea360 0x7f09a01ed0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:37.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.322+0000 7f099fe00640 1 -- 172.21.15.8:0/2345352169 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f09a006b7a0 con 0x7f09a01ea360 2024-03-23T23:47:37.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.322+0000 7f099fe00640 1 --2- 172.21.15.8:0/2345352169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09a01ea360 0x7f09a01ed0c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0994004000 tx=0x7f0994000bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:37.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.322+0000 7f099cc00640 1 -- 172.21.15.8:0/2345352169 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0994011650 con 0x7f09a01ea360 2024-03-23T23:47:37.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.322+0000 7f099cc00640 1 -- 172.21.15.8:0/2345352169 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5183 (secure 0 0 0) 0x7f0994011650 con 0x7f09a01ea360 2024-03-23T23:47:37.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.322+0000 7f099cc00640 1 -- 172.21.15.8:0/2345352169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09a01ea360 msgr2=0x7f09a01ed0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:37.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.322+0000 7f099cc00640 1 --2- 172.21.15.8:0/2345352169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09a01ea360 0x7f09a01ed0c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0994004000 tx=0x7f0994000bd0 comp rx=0 tx=0).stop 2024-03-23T23:47:37.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.322+0000 7f099cc00640 1 -- 172.21.15.8:0/2345352169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09a01ea360 msgr2=0x7f09a01ed0c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:47:37.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.322+0000 7f099cc00640 1 --2- 172.21.15.8:0/2345352169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09a01ea360 0x7f09a01ed0c0 secure :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0994004000 tx=0x7f0994000bd0 comp rx=0 tx=0).stop 2024-03-23T23:47:37.324 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:47:37.324 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:47:37.325 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:47:37.325 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:47:37.325 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 36, 2024-03-23T23:47:37.325 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:47:37.325 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:47:37.325 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:47:37.325 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:47:37.325 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:37.325 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 16, 2024-03-23T23:47:37.325 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:47:37.325 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:47:37.325 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:47:37.325 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:47:37.325 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:47:37.326 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:47:37.326 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:47:37.326 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:47:37.326 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:47:37.326 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:47:37.326 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:47:37.326 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:47:37.326 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:47:37.326 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:47:37.326 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:37.326 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:47:37.326 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:47:37.327 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:47:37.327 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:47:37.327 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:47:37.327 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:47:37.327 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:47:37.327 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:47:37.327 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:47:37.327 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:47:37.327 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:47:37.327 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:47:37.327 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:47:37.327 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:37.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:37.327 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:47:37.328 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:47:37.328 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:47:37.328 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:47:37.328 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:47:37.328 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:47:37.328 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:47:37.328 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:47:37.328 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:47:37.328 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:47:37.328 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:47:37.328 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:47:37.328 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:47:37.328 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:47:37.329 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:47:37.329 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:47:37.329 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:47:37.329 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:47:37.329 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:47:37.329 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:47:37.329 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:47:37.329 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:47:37.329 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:47:37.329 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:47:37.329 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:47:37.329 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:47:37.329 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:47:37.330 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:47:37.330 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:37.330 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:47:37.330 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:37.330 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:47:37.330 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:37.330 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:47:37.330 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:47:37.330 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:47:37.330 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:47:37.330 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:37.330 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:47:37.330 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:47:37.331 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:37.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:37.331 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:37.331 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:47:37.331 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:47:37.331 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:37.331 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:37.331 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:37.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:37.331 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:47:37.331 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:47:37.331 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:47:37.331 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:47:37.332 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:47:37.332 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:37.332 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:37.332 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:47:37.332 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:47:37.332 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:47:37.332 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:47:37.332 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:37.332 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:47:37.332 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:47:37.332 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:37.332 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:37.332 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:37.332 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:47:37.333 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:47:37.333 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:37.333 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:37.333 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:37.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:37.333 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:47:37.333 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:47:37.333 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:47:37.333 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:47:37.333 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:47:37.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:37.333 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:37.333 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:47:37.334 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:47:37.334 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:47:37.334 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:47:37.334 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:37.334 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:47:37.334 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:47:37.334 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:37.334 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:37.334 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:37.334 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:47:37.334 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:47:37.334 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:37.334 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:37.335 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:37.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:37.335 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:47:37.335 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:47:37.335 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:47:37.335 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:47:37.335 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:47:37.335 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:37.335 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:37.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:37.335 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:47:37.335 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:47:37.335 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:37.336 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:47:37.336 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:37.336 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:47:37.336 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:37.336 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:37.336 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:47:37.336 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:37.336 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:47:37.336 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:37.336 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:47:37.336 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:37.336 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:37.336 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:47:37.336 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:37.337 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:47:37.337 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:37.337 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 8 2024-03-23T23:47:37.337 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:37.337 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:37.337 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:47:37.337 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:37.337 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:47:37.337 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:37.337 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:47:37.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:37.337 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:37.337 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:47:37.337 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:37.338 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:47:37.338 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:37.338 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:37.338 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:47:37.338 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:37.338 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:47:37.338 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:37.338 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:47:37.338 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:37.338 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:37.338 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:37.338 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:47:37.338 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:47:37.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.322+0000 7f09a7400640 1 -- 172.21.15.8:0/2345352169 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0980067660 msgr2=0x7f0980069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:37.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.322+0000 7f09a7400640 1 --2- 172.21.15.8:0/2345352169 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0980067660 0x7f0980069b20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f09980af000 tx=0x7f09980a7070 comp rx=0 tx=0).stop 2024-03-23T23:47:37.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.326+0000 7f09a5400640 1 -- 172.21.15.8:0/2345352169 reap_dead start 2024-03-23T23:47:37.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.326+0000 7f09a7400640 1 -- 172.21.15.8:0/2345352169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09a006df70 msgr2=0x7f09a00c7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:37.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.326+0000 7f09a7400640 1 --2- 172.21.15.8:0/2345352169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09a006df70 0x7f09a00c7a80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f098c012a90 tx=0x7f098c012f50 comp rx=0 tx=0).stop 2024-03-23T23:47:37.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.326+0000 7f09a7400640 1 -- 172.21.15.8:0/2345352169 shutdown_connections 2024-03-23T23:47:37.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.326+0000 7f09a7400640 1 --2- 172.21.15.8:0/2345352169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09a006df70 0x7f09a00c7a80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:37.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.326+0000 7f09a7400640 1 -- 172.21.15.8:0/2345352169 >> 172.21.15.8:0/2345352169 conn(0x7f09a006b170 msgr2=0x7f09a014af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:47:37.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.326+0000 7f09a7400640 1 -- 172.21.15.8:0/2345352169 shutdown_connections 2024-03-23T23:47:37.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.326+0000 7f09a7400640 1 -- 172.21.15.8:0/2345352169 wait complete. 2024-03-23T23:47:37.383 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:47:37.383 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-03-23T23:47:37.383 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-03-23T23:47:37.384 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-03-23T23:47:37.384 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-03-23T23:47:37.384 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-23T23:47:37.384 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:47:37.454 INFO:tasks.ceph.mon.c:Stopped 2024-03-23T23:47:37.455 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-03-23T23:47:37.455 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:47:37.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.854+0000 7f77cbe00640 1 Processor -- start 2024-03-23T23:47:37.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.854+0000 7f77cbe00640 1 -- start start 2024-03-23T23:47:37.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.858+0000 7f77cbe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f77c406caf0 0x7f77c41520c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:37.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.858+0000 7f77cbe00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c4155e70 con 0x7f77c40aa390 2024-03-23T23:47:37.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.858+0000 7f77cbe00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c41550b0 con 0x7f77c40c3e60 2024-03-23T23:47:37.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.858+0000 7f77cbe00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77c4155390 con 0x7f77c406caf0 2024-03-23T23:47:37.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.858+0000 7f77c9400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f77c40c3e60 0x7f77c414b5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:36090/0 (socket says 172.21.15.8:36090) 2024-03-23T23:47:37.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.858+0000 7f77c9400640 1 -- 172.21.15.8:0/3045417199 learned_addr learned my addr 172.21.15.8:0/3045417199 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:47:37.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.858+0000 7f77c9e00640 1 --2- 172.21.15.8:0/3045417199 >> v2:172.21.15.8:3300/0 conn(0x7f77c406caf0 0x7f77c41520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:37.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.862+0000 7f77c3e00640 1 -- 172.21.15.8:0/3045417199 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1844351357 0 0) 0x7f77c4155e70 con 0x7f77c40aa390 2024-03-23T23:47:37.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.862+0000 7f77c3e00640 1 -- 172.21.15.8:0/3045417199 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77ac007940 con 0x7f77c40aa390 2024-03-23T23:47:37.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.862+0000 7f77c9e00640 1 -- 172.21.15.8:0/3045417199 >> v1:172.21.15.196:6789/0 conn(0x7f77c40c3e60 legacy=0x7f77c414b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:37.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.862+0000 7f77c9e00640 1 -- 172.21.15.8:0/3045417199 >> v1:172.21.15.8:6789/0 conn(0x7f77c40aa390 legacy=0x7f77c41519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:37.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.862+0000 7f77c9e00640 1 -- 172.21.15.8:0/3045417199 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c4155670 con 0x7f77c406caf0 2024-03-23T23:47:37.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.870+0000 7f77c9e00640 1 --2- 172.21.15.8:0/3045417199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77c406caf0 0x7f77c41520c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f77b800d050 tx=0x7f77b8024ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e19cf90d0ad55e51 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:37.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.870+0000 7f77c3e00640 1 -- 172.21.15.8:0/3045417199 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b80bb070 con 0x7f77c406caf0 2024-03-23T23:47:37.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.870+0000 7f77c3e00640 1 -- 172.21.15.8:0/3045417199 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b80b6410 con 0x7f77c406caf0 2024-03-23T23:47:37.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.870+0000 7f77c3e00640 1 -- 172.21.15.8:0/3045417199 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b80bb070 con 0x7f77c406caf0 2024-03-23T23:47:37.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.870+0000 7f77cbe00640 1 -- 172.21.15.8:0/3045417199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77c406caf0 msgr2=0x7f77c41520c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:37.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.870+0000 7f77cbe00640 1 --2- 172.21.15.8:0/3045417199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77c406caf0 0x7f77c41520c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f77b800d050 tx=0x7f77b8024ee0 comp rx=0 tx=0).stop 2024-03-23T23:47:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.870+0000 7f77cbe00640 1 -- 172.21.15.8:0/3045417199 shutdown_connections 2024-03-23T23:47:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.874+0000 7f77cbe00640 1 --2- 172.21.15.8:0/3045417199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77c406caf0 0x7f77c41520c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:37.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.874+0000 7f77cbe00640 1 -- 172.21.15.8:0/3045417199 >> 172.21.15.8:0/3045417199 conn(0x7f77c406b170 msgr2=0x7f77c406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:47:37.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.878+0000 7f77cbe00640 1 -- 172.21.15.8:0/3045417199 shutdown_connections 2024-03-23T23:47:37.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.882+0000 7f77cbe00640 1 -- 172.21.15.8:0/3045417199 wait complete. 2024-03-23T23:47:37.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.882+0000 7f77cbe00640 1 Processor -- start 2024-03-23T23:47:37.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.890+0000 7f77cbe00640 1 -- start start 2024-03-23T23:47:37.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.890+0000 7f77cbe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77c406caf0 0x7f77c41fe160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:37.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.890+0000 7f77cbe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f77c40aa390 0x7f77c41fe6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:37.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.890+0000 7f77cbe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f77c40c3e60 0x7f77c4149eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:37.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.890+0000 7f77cbe00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c414be30 con 0x7f77c406caf0 2024-03-23T23:47:37.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.890+0000 7f77cbe00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c414bcb0 con 0x7f77c40c3e60 2024-03-23T23:47:37.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.890+0000 7f77cbe00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c40c4240 con 0x7f77c40aa390 2024-03-23T23:47:37.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.890+0000 7f77c9400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77c406caf0 0x7f77c41fe160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:37.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.890+0000 7f77c9400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77c406caf0 0x7f77c41fe160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40336/0 (socket says 172.21.15.8:40336) 2024-03-23T23:47:37.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.890+0000 7f77c9400640 1 -- 172.21.15.8:0/901932553 learned_addr learned my addr 172.21.15.8:0/901932553 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:47:37.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.894+0000 7f77c9e00640 1 --2- 172.21.15.8:0/901932553 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f77c40c3e60 0x7f77c4149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:37.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.894+0000 7f77c9e00640 1 -- 172.21.15.8:0/901932553 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f77c40aa390 msgr2=0x7f77c41fe6a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:47:37.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.894+0000 7f77c9e00640 1 --2- 172.21.15.8:0/901932553 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f77c40aa390 0x7f77c41fe6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:37.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.894+0000 7f77c9e00640 1 -- 172.21.15.8:0/901932553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77c406caf0 msgr2=0x7f77c41fe160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:37.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.894+0000 7f77c9e00640 1 --2- 172.21.15.8:0/901932553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77c406caf0 0x7f77c41fe160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:37.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.894+0000 7f77c9e00640 1 -- 172.21.15.8:0/901932553 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c414c650 con 0x7f77c40c3e60 2024-03-23T23:47:37.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.898+0000 7f77c9e00640 1 --2- 172.21.15.8:0/901932553 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f77c40c3e60 0x7f77c4149eb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f77c40c4a00 tx=0x7f77b8021c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:37.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.898+0000 7f77c1600640 1 -- 172.21.15.8:0/901932553 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b80bb020 con 0x7f77c40c3e60 2024-03-23T23:47:37.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.898+0000 7f77c1600640 1 -- 172.21.15.8:0/901932553 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b80165b0 con 0x7f77c40c3e60 2024-03-23T23:47:37.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.898+0000 7f77c1600640 1 -- 172.21.15.8:0/901932553 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b8013070 con 0x7f77c40c3e60 2024-03-23T23:47:37.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.898+0000 7f77cbe00640 1 -- 172.21.15.8:0/901932553 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c414dcc0 con 0x7f77c40c3e60 2024-03-23T23:47:37.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.898+0000 7f77cbe00640 1 -- 172.21.15.8:0/901932553 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c414ab10 con 0x7f77c40c3e60 2024-03-23T23:47:37.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.902+0000 7f77cbe00640 1 -- 172.21.15.8:0/901932553 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c404f480 con 0x7f77c40c3e60 2024-03-23T23:47:37.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.906+0000 7f77c1600640 1 -- 172.21.15.8:0/901932553 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f77b80be020 con 0x7f77c40c3e60 2024-03-23T23:47:37.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.906+0000 7f77c1600640 1 --2- 172.21.15.8:0/901932553 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f77a4067660 0x7f77a4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:37.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.906+0000 7f77c1600640 1 -- 172.21.15.8:0/901932553 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f77b811fb00 con 0x7f77c40c3e60 2024-03-23T23:47:37.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.918+0000 7f77c9400640 1 --2- 172.21.15.8:0/901932553 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f77a4067660 0x7f77a4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:37.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.922+0000 7f77c1600640 1 -- 172.21.15.8:0/901932553 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f77b80c5070 con 0x7f77c40c3e60 2024-03-23T23:47:37.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:37.922+0000 7f77c9400640 1 --2- 172.21.15.8:0/901932553 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f77a4067660 0x7f77a4069b20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f77b0005890 tx=0x7f77b0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:38.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:38.650+0000 7f77cbe00640 1 -- 172.21.15.8:0/901932553 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f77c404f480 con 0x7f77c40c3e60 2024-03-23T23:47:38.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:38.650+0000 7f77c1600640 1 -- 172.21.15.8:0/901932553 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1561 (secure 0 0 0) 0x7f77b801eb90 con 0x7f77c40c3e60 2024-03-23T23:47:38.654 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":36,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:47:38.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:38.658+0000 7f77b6a00640 1 -- 172.21.15.8:0/901932553 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f77a4067660 msgr2=0x7f77a4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:38.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:38.658+0000 7f77b6a00640 1 --2- 172.21.15.8:0/901932553 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f77a4067660 0x7f77a4069b20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f77b0005890 tx=0x7f77b0009040 comp rx=0 tx=0).stop 2024-03-23T23:47:38.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:38.658+0000 7f77b6a00640 1 -- 172.21.15.8:0/901932553 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f77c40c3e60 msgr2=0x7f77c4149eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:38.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:38.658+0000 7f77b6a00640 1 --2- 172.21.15.8:0/901932553 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f77c40c3e60 0x7f77c4149eb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f77c40c4a00 tx=0x7f77b8021c80 comp rx=0 tx=0).stop 2024-03-23T23:47:38.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:38.658+0000 7f77b6a00640 1 -- 172.21.15.8:0/901932553 shutdown_connections 2024-03-23T23:47:38.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:38.658+0000 7f77b6a00640 1 --2- 172.21.15.8:0/901932553 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f77c40c3e60 0x7f77c4149eb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:38.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:38.658+0000 7f77b6a00640 1 --2- 172.21.15.8:0/901932553 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f77a4067660 0x7f77a4069b20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:38.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:38.658+0000 7f77b6a00640 1 --2- 172.21.15.8:0/901932553 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f77c40aa390 0x7f77c41fe6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:38.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:38.658+0000 7f77b6a00640 1 --2- 172.21.15.8:0/901932553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77c406caf0 0x7f77c41fe160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:38.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:38.658+0000 7f77b6a00640 1 -- 172.21.15.8:0/901932553 >> 172.21.15.8:0/901932553 conn(0x7f77c406b170 msgr2=0x7f77c4070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:47:38.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:38.658+0000 7f77b6a00640 1 -- 172.21.15.8:0/901932553 shutdown_connections 2024-03-23T23:47:38.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:38.658+0000 7f77b6a00640 1 -- 172.21.15.8:0/901932553 wait complete. 2024-03-23T23:47:41.724 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:47:42.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.018+0000 7f05c2200640 1 Processor -- start 2024-03-23T23:47:42.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.018+0000 7f05c2200640 1 -- start start 2024-03-23T23:47:42.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.018+0000 7f05c2200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05bc0c3e60 0x7f05bc06caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:42.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.018+0000 7f05c2200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f05bc0aa390 0x7f05bc14b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:42.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.018+0000 7f05c2200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05bc155e70 con 0x7f05bc14bae0 2024-03-23T23:47:42.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.022+0000 7f05c2200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05bc1550b0 con 0x7f05bc0aa390 2024-03-23T23:47:42.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.022+0000 7f05c2200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc155390 con 0x7f05bc0c3e60 2024-03-23T23:47:42.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.022+0000 7f05bbe00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f05bc14bae0 0x7f05bc1519b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42394/0 (socket says 172.21.15.8:42394) 2024-03-23T23:47:42.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.022+0000 7f05bbe00640 1 -- 172.21.15.8:0/1981134533 learned_addr learned my addr 172.21.15.8:0/1981134533 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:47:42.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.022+0000 7f05baa00640 1 --2- 172.21.15.8:0/1981134533 >> v2:172.21.15.8:3300/0 conn(0x7f05bc0aa390 0x7f05bc14b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:42.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.026+0000 7f05bb400640 1 -- 172.21.15.8:0/1981134533 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05bc0c3e60 msgr2=0x7f05bc06caf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:47:42.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.026+0000 7f05bb400640 1 --2- 172.21.15.8:0/1981134533 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05bc0c3e60 0x7f05bc06caf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:47:42.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.026+0000 7f05baa00640 1 -- 172.21.15.8:0/1981134533 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05bc0c3e60 msgr2=0x7f05bc06caf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:47:42.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.026+0000 7f05baa00640 1 --2- 172.21.15.8:0/1981134533 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05bc0c3e60 0x7f05bc06caf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:42.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.026+0000 7f05baa00640 1 -- 172.21.15.8:0/1981134533 >> v1:172.21.15.8:6789/0 conn(0x7f05bc14bae0 legacy=0x7f05bc1519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:42.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.026+0000 7f05baa00640 1 -- 172.21.15.8:0/1981134533 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05bc155670 con 0x7f05bc0aa390 2024-03-23T23:47:42.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.034+0000 7f05baa00640 1 --2- 172.21.15.8:0/1981134533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05bc0aa390 0x7f05bc14b5a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f05ac0087c0 tx=0x7f05ac01e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7f22345541830e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:42.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.034+0000 7f05ba000640 1 -- 172.21.15.8:0/1981134533 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac0ad070 con 0x7f05bc0aa390 2024-03-23T23:47:42.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.038+0000 7f05ba000640 1 -- 172.21.15.8:0/1981134533 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ac0a79d0 con 0x7f05bc0aa390 2024-03-23T23:47:42.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.038+0000 7f05c2200640 1 -- 172.21.15.8:0/1981134533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05bc0aa390 msgr2=0x7f05bc14b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:42.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.038+0000 7f05ba000640 1 -- 172.21.15.8:0/1981134533 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac0ad070 con 0x7f05bc0aa390 2024-03-23T23:47:42.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.038+0000 7f05c2200640 1 --2- 172.21.15.8:0/1981134533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05bc0aa390 0x7f05bc14b5a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f05ac0087c0 tx=0x7f05ac01e940 comp rx=0 tx=0).stop 2024-03-23T23:47:42.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.042+0000 7f05c2200640 1 -- 172.21.15.8:0/1981134533 shutdown_connections 2024-03-23T23:47:42.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.042+0000 7f05c2200640 1 --2- 172.21.15.8:0/1981134533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05bc0aa390 0x7f05bc14b5a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:42.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.042+0000 7f05c2200640 1 --2- 172.21.15.8:0/1981134533 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05bc0c3e60 0x7f05bc06caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:42.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.042+0000 7f05c2200640 1 -- 172.21.15.8:0/1981134533 >> 172.21.15.8:0/1981134533 conn(0x7f05bc06b170 msgr2=0x7f05bc06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:47:42.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.042+0000 7f05c2200640 1 -- 172.21.15.8:0/1981134533 shutdown_connections 2024-03-23T23:47:42.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.046+0000 7f05c2200640 1 -- 172.21.15.8:0/1981134533 wait complete. 2024-03-23T23:47:42.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.054+0000 7f05c2200640 1 Processor -- start 2024-03-23T23:47:42.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.058+0000 7f05c2200640 1 -- start start 2024-03-23T23:47:42.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.058+0000 7f05c2200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05bc0aa390 0x7f05bc14a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:42.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.058+0000 7f05c2200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05bc0c3e60 0x7f05bc14e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:42.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.058+0000 7f05c2200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05bc14bae0 0x7f05bc1fb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:42.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.058+0000 7f05c2200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc0c4240 con 0x7f05bc0aa390 2024-03-23T23:47:42.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.058+0000 7f05c2200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc1524d0 con 0x7f05bc0c3e60 2024-03-23T23:47:42.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.058+0000 7f05c2200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc0c43c0 con 0x7f05bc14bae0 2024-03-23T23:47:42.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.062+0000 7f05bbe00640 1 -- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05bc14bae0 msgr2=0x7f05bc1fb4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:47:42.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.062+0000 7f05bbe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05bc14bae0 0x7f05bc1fb4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:47:42.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.062+0000 7f05bb400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05bc0aa390 0x7f05bc14a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:42.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.062+0000 7f05bb400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05bc0aa390 0x7f05bc14a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40344/0 (socket says 172.21.15.8:40344) 2024-03-23T23:47:42.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.062+0000 7f05bb400640 1 -- 172.21.15.8:0/1782270631 learned_addr learned my addr 172.21.15.8:0/1782270631 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:47:42.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.062+0000 7f05bb400640 1 -- 172.21.15.8:0/1782270631 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05bc14bae0 msgr2=0x7f05bc1fb4a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:47:42.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.062+0000 7f05bb400640 1 --2- 172.21.15.8:0/1782270631 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05bc14bae0 0x7f05bc1fb4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:42.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.062+0000 7f05bb400640 1 -- 172.21.15.8:0/1782270631 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05bc0c3e60 msgr2=0x7f05bc14e350 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-23T23:47:42.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.062+0000 7f05bb400640 1 --2- 172.21.15.8:0/1782270631 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05bc0c3e60 0x7f05bc14e350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:42.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.062+0000 7f05bb400640 1 -- 172.21.15.8:0/1782270631 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05bc1fbfc0 con 0x7f05bc0aa390 2024-03-23T23:47:42.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.070+0000 7f05bb400640 1 --2- 172.21.15.8:0/1782270631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05bc0aa390 0x7f05bc14a490 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f05a800b550 tx=0x7f05a800ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:42.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.082+0000 7f05b3400640 1 -- 172.21.15.8:0/1782270631 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a8003d00 con 0x7f05bc0aa390 2024-03-23T23:47:42.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.082+0000 7f05b3400640 1 -- 172.21.15.8:0/1782270631 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a8015070 con 0x7f05bc0aa390 2024-03-23T23:47:42.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.082+0000 7f05b3400640 1 -- 172.21.15.8:0/1782270631 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a8005330 con 0x7f05bc0aa390 2024-03-23T23:47:42.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.086+0000 7f05c2200640 1 -- 172.21.15.8:0/1782270631 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05bc1fc260 con 0x7f05bc0aa390 2024-03-23T23:47:42.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.086+0000 7f05c2200640 1 -- 172.21.15.8:0/1782270631 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05bc0c5290 con 0x7f05bc0aa390 2024-03-23T23:47:42.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.086+0000 7f05b0c00640 1 -- 172.21.15.8:0/1782270631 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05bc04f480 con 0x7f05bc0aa390 2024-03-23T23:47:42.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.106+0000 7f05b3400640 1 -- 172.21.15.8:0/1782270631 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f05a80054d0 con 0x7f05bc0aa390 2024-03-23T23:47:42.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.114+0000 7f05b3400640 1 --2- 172.21.15.8:0/1782270631 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f059c067660 0x7f059c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:42.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.118+0000 7f05baa00640 1 --2- 172.21.15.8:0/1782270631 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f059c067660 0x7f059c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:42.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.126+0000 7f05b3400640 1 -- 172.21.15.8:0/1782270631 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f05a80865a0 con 0x7f05bc0aa390 2024-03-23T23:47:42.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.126+0000 7f05b3400640 1 -- 172.21.15.8:0/1782270631 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f05a80869c0 con 0x7f05bc0aa390 2024-03-23T23:47:42.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.130+0000 7f05baa00640 1 --2- 172.21.15.8:0/1782270631 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f059c067660 0x7f059c069b20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f05ac0b2000 tx=0x7f05ac0a9070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:42.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.858+0000 7f05b0c00640 1 -- 172.21.15.8:0/1782270631 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f05bc0c37b0 con 0x7f05bc0aa390 2024-03-23T23:47:42.864 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":36,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:47:42.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.862+0000 7f05b3400640 1 -- 172.21.15.8:0/1782270631 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1561 (secure 0 0 0) 0x7f05a8056ed0 con 0x7f05bc0aa390 2024-03-23T23:47:42.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.874+0000 7f05b0c00640 1 -- 172.21.15.8:0/1782270631 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f059c067660 msgr2=0x7f059c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:42.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.874+0000 7f05b0c00640 1 --2- 172.21.15.8:0/1782270631 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f059c067660 0x7f059c069b20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f05ac0b2000 tx=0x7f05ac0a9070 comp rx=0 tx=0).stop 2024-03-23T23:47:42.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.874+0000 7f05b0c00640 1 -- 172.21.15.8:0/1782270631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05bc0aa390 msgr2=0x7f05bc14a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:42.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.874+0000 7f05b0c00640 1 --2- 172.21.15.8:0/1782270631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05bc0aa390 0x7f05bc14a490 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f05a800b550 tx=0x7f05a800ba10 comp rx=0 tx=0).stop 2024-03-23T23:47:42.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.874+0000 7f05b0c00640 1 -- 172.21.15.8:0/1782270631 shutdown_connections 2024-03-23T23:47:42.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.874+0000 7f05b0c00640 1 --2- 172.21.15.8:0/1782270631 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f059c067660 0x7f059c069b20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:42.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.878+0000 7f05b0c00640 1 --2- 172.21.15.8:0/1782270631 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05bc14bae0 0x7f05bc1fb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:42.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.878+0000 7f05b0c00640 1 --2- 172.21.15.8:0/1782270631 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05bc0c3e60 0x7f05bc14e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:42.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.878+0000 7f05b0c00640 1 --2- 172.21.15.8:0/1782270631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05bc0aa390 0x7f05bc14a490 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:42.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.878+0000 7f05b0c00640 1 -- 172.21.15.8:0/1782270631 >> 172.21.15.8:0/1782270631 conn(0x7f05bc06b170 msgr2=0x7f05bc06b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:47:42.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.882+0000 7f05b0c00640 1 -- 172.21.15.8:0/1782270631 shutdown_connections 2024-03-23T23:47:42.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:42.882+0000 7f05b0c00640 1 -- 172.21.15.8:0/1782270631 wait complete. 2024-03-23T23:47:43.425 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:47:43.433 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:47:46.065 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:47:46.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.518+0000 7fd7f1000640 1 Processor -- start 2024-03-23T23:47:46.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.518+0000 7fd7f1000640 1 -- start start 2024-03-23T23:47:46.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.522+0000 7fd7f1000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd7ec14f840 0x7fd7ec1564a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:46.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.522+0000 7fd7f1000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7ec073180 0x7fd7ec0c05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:46.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.522+0000 7fd7f1000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7ec155a00 con 0x7fd7ec0722f0 2024-03-23T23:47:46.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.522+0000 7fd7f1000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7ec156010 con 0x7fd7ec14f840 2024-03-23T23:47:46.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.522+0000 7fd7f1000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec0c2520 con 0x7fd7ec073180 2024-03-23T23:47:46.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.522+0000 7fd7ea800640 1 -- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7ec073180 msgr2=0x7fd7ec0c05a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:47:46.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.522+0000 7fd7ea800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7ec073180 0x7fd7ec0c05a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:47:46.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.522+0000 7fd7e9e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd7ec14f840 0x7fd7ec1564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:46.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.522+0000 7fd7e9400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd7ec0722f0 0x7fd7ec0c1e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46900/0 (socket says 172.21.15.8:46900) 2024-03-23T23:47:46.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.522+0000 7fd7e9400640 1 -- 172.21.15.8:0/3014979155 learned_addr learned my addr 172.21.15.8:0/3014979155 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:47:46.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.522+0000 7fd7e9e00640 1 -- 172.21.15.8:0/3014979155 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7ec073180 msgr2=0x7fd7ec0c05a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:47:46.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.522+0000 7fd7e9e00640 1 --2- 172.21.15.8:0/3014979155 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7ec073180 0x7fd7ec0c05a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:46.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.522+0000 7fd7e9e00640 1 -- 172.21.15.8:0/3014979155 >> v1:172.21.15.8:6789/0 conn(0x7fd7ec0722f0 legacy=0x7fd7ec0c1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:46.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.522+0000 7fd7e9e00640 1 -- 172.21.15.8:0/3014979155 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec0c3710 con 0x7fd7ec14f840 2024-03-23T23:47:46.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.530+0000 7fd7e9e00640 1 --2- 172.21.15.8:0/3014979155 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7ec14f840 0x7fd7ec1564a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec156190 tx=0x7fd7dc01ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5097c0a2f60ba6 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:46.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.530+0000 7fd7e8a00640 1 -- 172.21.15.8:0/3014979155 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc0b0070 con 0x7fd7ec14f840 2024-03-23T23:47:46.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.530+0000 7fd7e8a00640 1 -- 172.21.15.8:0/3014979155 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7dc0ab600 con 0x7fd7ec14f840 2024-03-23T23:47:46.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.530+0000 7fd7e8a00640 1 -- 172.21.15.8:0/3014979155 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc0ab9d0 con 0x7fd7ec14f840 2024-03-23T23:47:46.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.530+0000 7fd7f1000640 1 -- 172.21.15.8:0/3014979155 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7ec14f840 msgr2=0x7fd7ec1564a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:46.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.530+0000 7fd7f1000640 1 --2- 172.21.15.8:0/3014979155 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7ec14f840 0x7fd7ec1564a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec156190 tx=0x7fd7dc01ce20 comp rx=0 tx=0).stop 2024-03-23T23:47:46.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.534+0000 7fd7f1000640 1 -- 172.21.15.8:0/3014979155 shutdown_connections 2024-03-23T23:47:46.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.534+0000 7fd7f1000640 1 --2- 172.21.15.8:0/3014979155 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7ec073180 0x7fd7ec0c05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:46.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.534+0000 7fd7f1000640 1 --2- 172.21.15.8:0/3014979155 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7ec14f840 0x7fd7ec1564a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:46.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.534+0000 7fd7f1000640 1 -- 172.21.15.8:0/3014979155 >> 172.21.15.8:0/3014979155 conn(0x7fd7ec0c7170 msgr2=0x7fd7ec0c7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:47:46.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.534+0000 7fd7f1000640 1 -- 172.21.15.8:0/3014979155 shutdown_connections 2024-03-23T23:47:46.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.534+0000 7fd7f1000640 1 -- 172.21.15.8:0/3014979155 wait complete. 2024-03-23T23:47:46.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.534+0000 7fd7f1000640 1 Processor -- start 2024-03-23T23:47:46.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.538+0000 7fd7f1000640 1 -- start start 2024-03-23T23:47:46.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.538+0000 7fd7f1000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7ec0722f0 0x7fd7ec158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:46.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.538+0000 7fd7f1000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7ec073180 0x7fd7ec153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:46.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.538+0000 7fd7e9e00640 1 -- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7ec0722f0 msgr2=0x7fd7ec158d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:47:46.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.538+0000 7fd7e9e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7ec0722f0 0x7fd7ec158d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:47:46.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.538+0000 7fd7f1000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7ec14f840 0x7fd7ec14ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:46.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.538+0000 7fd7e9400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7ec073180 0x7fd7ec153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:46.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.538+0000 7fd7e9400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7ec073180 0x7fd7ec153240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55784/0 (socket says 172.21.15.8:55784) 2024-03-23T23:47:46.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.538+0000 7fd7e9400640 1 -- 172.21.15.8:0/1430921252 learned_addr learned my addr 172.21.15.8:0/1430921252 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:47:46.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.538+0000 7fd7f1000640 1 -- 172.21.15.8:0/1430921252 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec14fda0 con 0x7fd7ec073180 2024-03-23T23:47:46.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.538+0000 7fd7f1000640 1 -- 172.21.15.8:0/1430921252 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec14fc20 con 0x7fd7ec14f840 2024-03-23T23:47:46.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.538+0000 7fd7f1000640 1 -- 172.21.15.8:0/1430921252 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec06f290 con 0x7fd7ec0722f0 2024-03-23T23:47:46.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.542+0000 7fd7ea800640 1 --2- 172.21.15.8:0/1430921252 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7ec14f840 0x7fd7ec14ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:46.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.542+0000 7fd7e9400640 1 -- 172.21.15.8:0/1430921252 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7ec0722f0 msgr2=0x7fd7ec158d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:47:46.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.542+0000 7fd7e9400640 1 --2- 172.21.15.8:0/1430921252 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7ec0722f0 0x7fd7ec158d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:46.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.542+0000 7fd7e9400640 1 -- 172.21.15.8:0/1430921252 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7ec14f840 msgr2=0x7fd7ec14ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:46.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.542+0000 7fd7e9400640 1 --2- 172.21.15.8:0/1430921252 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7ec14f840 0x7fd7ec14ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:46.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.542+0000 7fd7e9400640 1 -- 172.21.15.8:0/1430921252 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec152a80 con 0x7fd7ec073180 2024-03-23T23:47:46.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.542+0000 7fd7e9400640 1 --2- 172.21.15.8:0/1430921252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7ec073180 0x7fd7ec153240 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd7d800c500 tx=0x7fd7d800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:46.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.542+0000 7fd7e2000640 1 -- 172.21.15.8:0/1430921252 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d8017070 con 0x7fd7ec073180 2024-03-23T23:47:46.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.542+0000 7fd7e2000640 1 -- 172.21.15.8:0/1430921252 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d8005cf0 con 0x7fd7ec073180 2024-03-23T23:47:46.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.542+0000 7fd7e2000640 1 -- 172.21.15.8:0/1430921252 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d80072f0 con 0x7fd7ec073180 2024-03-23T23:47:46.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.542+0000 7fd7f1000640 1 -- 172.21.15.8:0/1430921252 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7ec159330 con 0x7fd7ec073180 2024-03-23T23:47:46.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.542+0000 7fd7f1000640 1 -- 172.21.15.8:0/1430921252 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7ec0c6920 con 0x7fd7ec073180 2024-03-23T23:47:46.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.546+0000 7fd7e2000640 1 -- 172.21.15.8:0/1430921252 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd7d801a070 con 0x7fd7ec073180 2024-03-23T23:47:46.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.550+0000 7fd7d7400640 1 -- 172.21.15.8:0/1430921252 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c00052a0 con 0x7fd7ec073180 2024-03-23T23:47:46.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.550+0000 7fd7e2000640 1 --2- 172.21.15.8:0/1430921252 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd7cc067690 0x7fd7cc069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:46.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.554+0000 7fd7e2000640 1 -- 172.21.15.8:0/1430921252 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fd7d8053250 con 0x7fd7ec073180 2024-03-23T23:47:46.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.554+0000 7fd7e9e00640 1 --2- 172.21.15.8:0/1430921252 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd7cc067690 0x7fd7cc069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:46.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.558+0000 7fd7e9e00640 1 --2- 172.21.15.8:0/1430921252 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd7cc067690 0x7fd7cc069b50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc0ad000 tx=0x7fd7dc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:46.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:46.574+0000 7fd7e2000640 1 -- 172.21.15.8:0/1430921252 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fd7d80551b0 con 0x7fd7ec073180 2024-03-23T23:47:47.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:47.454+0000 7fd7d7400640 1 -- 172.21.15.8:0/1430921252 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd7c0005860 con 0x7fd7ec073180 2024-03-23T23:47:49.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:49.586+0000 7fd7e0c00640 1 -- 172.21.15.8:0/1430921252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7ec073180 msgr2=0x7fd7ec153240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:49.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:49.586+0000 7fd7e0c00640 1 --2- 172.21.15.8:0/1430921252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7ec073180 0x7fd7ec153240 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd7d800c500 tx=0x7fd7d800c9c0 comp rx=0 tx=0).stop 2024-03-23T23:47:49.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:49.586+0000 7fd7e0c00640 1 --2- 172.21.15.8:0/1430921252 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7ec0722f0 0x7fd7ec158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:49.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:49.590+0000 7fd7e0c00640 1 --2- 172.21.15.8:0/1430921252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7ec158390 0x7fd7ec156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:49.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:49.590+0000 7fd7e0c00640 1 --2- 172.21.15.8:0/1430921252 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7ec14f840 0x7fd7ec14ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:49.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:49.590+0000 7fd7e0c00640 1 -- 172.21.15.8:0/1430921252 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec0c1380 con 0x7fd7ec158390 2024-03-23T23:47:49.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:49.590+0000 7fd7e0c00640 1 -- 172.21.15.8:0/1430921252 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec14c1c0 con 0x7fd7ec14f840 2024-03-23T23:47:49.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:49.590+0000 7fd7e0c00640 1 -- 172.21.15.8:0/1430921252 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec068310 con 0x7fd7ec0722f0 2024-03-23T23:47:49.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:49.590+0000 7fd7e9400640 1 -- 172.21.15.8:0/1430921252 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7ec0722f0 msgr2=0x7fd7ec158d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:47:49.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:49.590+0000 7fd7e9400640 1 --2- 172.21.15.8:0/1430921252 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7ec0722f0 0x7fd7ec158d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:47:49.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:49.590+0000 7fd7ea800640 1 --2- 172.21.15.8:0/1430921252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7ec158390 0x7fd7ec156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:49.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:49.590+0000 7fd7ea800640 1 -- 172.21.15.8:0/1430921252 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7ec0722f0 msgr2=0x7fd7ec158d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:47:49.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:49.590+0000 7fd7ea800640 1 --2- 172.21.15.8:0/1430921252 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7ec0722f0 0x7fd7ec158d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:49.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:49.590+0000 7fd7ea800640 1 -- 172.21.15.8:0/1430921252 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7ec14f840 msgr2=0x7fd7ec14ac90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:47:49.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:49.590+0000 7fd7ea800640 1 --2- 172.21.15.8:0/1430921252 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7ec14f840 0x7fd7ec14ac90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:49.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:49.590+0000 7fd7ea800640 1 -- 172.21.15.8:0/1430921252 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+}) v3 -- 0x7fd7ec0008e0 con 0x7fd7ec158390 2024-03-23T23:47:49.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:49.590+0000 7fd7ea800640 1 -- 172.21.15.8:0/1430921252 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd7e400b3f0 con 0x7fd7ec158390 2024-03-23T23:47:49.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:49.590+0000 7fd7ea800640 1 --2- 172.21.15.8:0/1430921252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7ec158390 0x7fd7ec156ce0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd7e400b760 tx=0x7fd7d8007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:49.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:49.594+0000 7fd7e2000640 1 -- 172.21.15.8:0/1430921252 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e401b020 con 0x7fd7ec158390 2024-03-23T23:47:49.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:49.594+0000 7fd7e2000640 1 -- 172.21.15.8:0/1430921252 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e4007a00 con 0x7fd7ec158390 2024-03-23T23:47:49.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:49.594+0000 7fd7e2000640 1 -- 172.21.15.8:0/1430921252 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd7e4007bb0 con 0x7fd7ec158390 2024-03-23T23:47:51.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:51.846+0000 7fd7e2000640 1 -- 172.21.15.8:0/1430921252 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1554 (secure 0 0 0) 0x7fd7e4054970 con 0x7fd7ec158390 2024-03-23T23:47:51.852 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":40,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:47:51.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:51.854+0000 7fd7d7400640 1 -- 172.21.15.8:0/1430921252 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd7cc067690 msgr2=0x7fd7cc069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:51.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:51.854+0000 7fd7d7400640 1 --2- 172.21.15.8:0/1430921252 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd7cc067690 0x7fd7cc069b50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc0ad000 tx=0x7fd7dc008040 comp rx=0 tx=0).stop 2024-03-23T23:47:51.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:51.854+0000 7fd7d7400640 1 -- 172.21.15.8:0/1430921252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7ec158390 msgr2=0x7fd7ec156ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:51.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:51.854+0000 7fd7d7400640 1 --2- 172.21.15.8:0/1430921252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7ec158390 0x7fd7ec156ce0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd7e400b760 tx=0x7fd7d8007f90 comp rx=0 tx=0).stop 2024-03-23T23:47:51.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:51.854+0000 7fd7d7400640 1 -- 172.21.15.8:0/1430921252 shutdown_connections 2024-03-23T23:47:51.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:51.854+0000 7fd7d7400640 1 --2- 172.21.15.8:0/1430921252 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7ec14f840 0x7fd7ec14ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:51.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:51.854+0000 7fd7d7400640 1 --2- 172.21.15.8:0/1430921252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7ec158390 0x7fd7ec156ce0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:51.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:51.854+0000 7fd7d7400640 1 --2- 172.21.15.8:0/1430921252 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7ec0722f0 0x7fd7ec158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:51.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:51.854+0000 7fd7d7400640 1 --2- 172.21.15.8:0/1430921252 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd7cc067690 0x7fd7cc069b50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:51.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:51.854+0000 7fd7d7400640 1 -- 172.21.15.8:0/1430921252 >> 172.21.15.8:0/1430921252 conn(0x7fd7ec0c7170 msgr2=0x7fd7ec06df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:47:51.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:51.854+0000 7fd7d7400640 1 -- 172.21.15.8:0/1430921252 shutdown_connections 2024-03-23T23:47:51.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:51.854+0000 7fd7d7400640 1 -- 172.21.15.8:0/1430921252 wait complete. 2024-03-23T23:47:51.926 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-03-23T23:47:51.926 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-03-23T23:47:51.926 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:47:52.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.226+0000 7f14ba800640 1 Processor -- start 2024-03-23T23:47:52.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.230+0000 7f14ba800640 1 -- start start 2024-03-23T23:47:52.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.234+0000 7f14ba800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f14b40c3f60 0x7f14b40c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:52.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.234+0000 7f14ba800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b40711c0 con 0x7f14b4157790 2024-03-23T23:47:52.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.234+0000 7f14ba800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b40714a0 con 0x7f14b4073260 2024-03-23T23:47:52.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.234+0000 7f14ba800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b40736e0 con 0x7f14b40c3f60 2024-03-23T23:47:52.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.234+0000 7f14b3400640 1 -- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f14b40c3f60 msgr2=0x7f14b40c34d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:47:52.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.234+0000 7f14b3400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f14b40c3f60 0x7f14b40c34d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:47:52.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.238+0000 7f14b3e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f14b4157790 0x7f14b415d400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46912/0 (socket says 172.21.15.8:46912) 2024-03-23T23:47:52.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.238+0000 7f14b3e00640 1 -- 172.21.15.8:0/4201891490 learned_addr learned my addr 172.21.15.8:0/4201891490 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:47:52.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.246+0000 7f14b2000640 1 -- 172.21.15.8:0/4201891490 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4236198454 0 0) 0x7f14b40711c0 con 0x7f14b4157790 2024-03-23T23:47:52.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.246+0000 7f14b2000640 1 -- 172.21.15.8:0/4201891490 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1498003530 con 0x7f14b4157790 2024-03-23T23:47:52.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.246+0000 7f14b2000640 1 -- 172.21.15.8:0/4201891490 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 198715727 0 0) 0x7f14b40714a0 con 0x7f14b4073260 2024-03-23T23:47:52.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.246+0000 7f14b2000640 1 -- 172.21.15.8:0/4201891490 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14b40711c0 con 0x7f14b4073260 2024-03-23T23:47:52.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.246+0000 7f14b2000640 1 -- 172.21.15.8:0/4201891490 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 202606997 0 0) 0x7f14b40711c0 con 0x7f14b4073260 2024-03-23T23:47:52.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.246+0000 7f14b2000640 1 -- 172.21.15.8:0/4201891490 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f14b40c3f60 msgr2=0x7f14b40c34d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:47:52.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.246+0000 7f14b2000640 1 --2- 172.21.15.8:0/4201891490 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f14b40c3f60 0x7f14b40c34d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:52.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.246+0000 7f14b2000640 1 -- 172.21.15.8:0/4201891490 >> v1:172.21.15.8:6789/0 conn(0x7f14b4157790 legacy=0x7f14b415d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:52.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.246+0000 7f14b2000640 1 -- 172.21.15.8:0/4201891490 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b4071780 con 0x7f14b4073260 2024-03-23T23:47:52.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.246+0000 7f14b2000640 1 -- 172.21.15.8:0/4201891490 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7f14a00015e0 con 0x7f14b4073260 2024-03-23T23:47:52.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.246+0000 7f14b2000640 1 -- 172.21.15.8:0/4201891490 >> v1:172.21.15.196:6789/0 conn(0x7f14b4073260 legacy=0x7f14b4157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:52.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.246+0000 7f14b2000640 1 --2- 172.21.15.8:0/4201891490 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1498004be0 0x7f1498004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:52.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.246+0000 7f14b2000640 1 --2- 172.21.15.8:0/4201891490 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14980037b0 0x7f1498003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:52.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.246+0000 7f14b2000640 1 --2- 172.21.15.8:0/4201891490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1498004240 0x7f149800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:52.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.246+0000 7f14b2000640 1 -- 172.21.15.8:0/4201891490 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b40736e0 con 0x7f1498004240 2024-03-23T23:47:52.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.246+0000 7f14b2000640 1 -- 172.21.15.8:0/4201891490 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149800c1c0 con 0x7f14980037b0 2024-03-23T23:47:52.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.246+0000 7f14b2000640 1 -- 172.21.15.8:0/4201891490 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149800c3c0 con 0x7f1498004be0 2024-03-23T23:47:52.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.246+0000 7f14b3e00640 1 --2- 172.21.15.8:0/4201891490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1498004240 0x7f149800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:52.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.250+0000 7f14b2a00640 1 --2- 172.21.15.8:0/4201891490 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14980037b0 0x7f1498003c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:52.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.250+0000 7f14b3e00640 1 -- 172.21.15.8:0/4201891490 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1498004be0 msgr2=0x7f1498004fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:47:52.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.250+0000 7f14b3e00640 1 --2- 172.21.15.8:0/4201891490 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1498004be0 0x7f1498004fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:52.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.250+0000 7f14b3e00640 1 -- 172.21.15.8:0/4201891490 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14980037b0 msgr2=0x7f1498003c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:47:52.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.250+0000 7f14b3e00640 1 --2- 172.21.15.8:0/4201891490 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14980037b0 0x7f1498003c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:52.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.250+0000 7f14b3e00640 1 -- 172.21.15.8:0/4201891490 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b4071780 con 0x7f1498004240 2024-03-23T23:47:52.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.278+0000 7f14b3e00640 1 --2- 172.21.15.8:0/4201891490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1498004240 0x7f149800b9d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00a7e0 tx=0x7f14ac01d2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c994bec5e2a1d67f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:52.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.282+0000 7f14b2000640 1 -- 172.21.15.8:0/4201891490 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac00a3b0 con 0x7f1498004240 2024-03-23T23:47:52.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.282+0000 7f14b2000640 1 -- 172.21.15.8:0/4201891490 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ac0072f0 con 0x7f1498004240 2024-03-23T23:47:52.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.282+0000 7f14b2000640 1 -- 172.21.15.8:0/4201891490 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac007720 con 0x7f1498004240 2024-03-23T23:47:52.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.282+0000 7f14ba800640 1 -- 172.21.15.8:0/4201891490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1498004240 msgr2=0x7f149800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:52.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.282+0000 7f14ba800640 1 --2- 172.21.15.8:0/4201891490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1498004240 0x7f149800b9d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00a7e0 tx=0x7f14ac01d2c0 comp rx=0 tx=0).stop 2024-03-23T23:47:52.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.282+0000 7f14b3e00640 1 -- 172.21.15.8:0/4201891490 reap_dead start 2024-03-23T23:47:52.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.306+0000 7f14ba800640 1 -- 172.21.15.8:0/4201891490 shutdown_connections 2024-03-23T23:47:52.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.306+0000 7f14ba800640 1 -- 172.21.15.8:0/4201891490 >> 172.21.15.8:0/4201891490 conn(0x7f14b40a9870 msgr2=0x7f14b406b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:47:52.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.330+0000 7f14ba800640 1 -- 172.21.15.8:0/4201891490 shutdown_connections 2024-03-23T23:47:52.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.330+0000 7f14ba800640 1 -- 172.21.15.8:0/4201891490 wait complete. 2024-03-23T23:47:52.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.330+0000 7f14ba800640 1 Processor -- start 2024-03-23T23:47:52.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.334+0000 7f14ba800640 1 -- start start 2024-03-23T23:47:52.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.354+0000 7f14ba800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1498004240 0x7f14b4159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:52.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.358+0000 7f14ba800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14b4128710 0x7f14b414d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:52.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.358+0000 7f14ba800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14b4152300 0x7f14b41fae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:52.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.358+0000 7f14b2a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14b4128710 0x7f14b414d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:52.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.358+0000 7f14b2a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14b4128710 0x7f14b414d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:32984/0 (socket says 172.21.15.8:32984) 2024-03-23T23:47:52.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.358+0000 7f14b2a00640 1 -- 172.21.15.8:0/817829245 learned_addr learned my addr 172.21.15.8:0/817829245 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:47:52.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.362+0000 7f14ba800640 1 -- 172.21.15.8:0/817829245 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b40c34d0 con 0x7f14b4152300 2024-03-23T23:47:52.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.362+0000 7f14ba800640 1 -- 172.21.15.8:0/817829245 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b415e130 con 0x7f14b4128710 2024-03-23T23:47:52.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.362+0000 7f14ba800640 1 -- 172.21.15.8:0/817829245 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b40c3650 con 0x7f1498004240 2024-03-23T23:47:52.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.362+0000 7f14b3e00640 1 --2- 172.21.15.8:0/817829245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14b4152300 0x7f14b41fae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:52.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.358+0000 7f14b3400640 1 -- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1498004240 msgr2=0x7f14b4159f50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:47:52.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.362+0000 7f14b3400640 1 --2- 172.21.15.8:0/817829245 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1498004240 0x7f14b4159f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:47:52.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.366+0000 7f14b3e00640 1 -- 172.21.15.8:0/817829245 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1498004240 msgr2=0x7f14b4159f50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:47:52.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.366+0000 7f14b3e00640 1 --2- 172.21.15.8:0/817829245 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1498004240 0x7f14b4159f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:52.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.366+0000 7f14b3e00640 1 -- 172.21.15.8:0/817829245 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14b4128710 msgr2=0x7f14b414d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:52.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.366+0000 7f14b3e00640 1 --2- 172.21.15.8:0/817829245 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14b4128710 0x7f14b414d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:52.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.366+0000 7f14b3e00640 1 -- 172.21.15.8:0/817829245 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b414d300 con 0x7f14b4152300 2024-03-23T23:47:52.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.366+0000 7f14b2a00640 1 --2- 172.21.15.8:0/817829245 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14b4128710 0x7f14b414d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:47:52.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.370+0000 7f14b3e00640 1 --2- 172.21.15.8:0/817829245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14b4152300 0x7f14b41fae20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f14ac001bb0 tx=0x7f1498005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:52.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.374+0000 7f14ab400640 1 -- 172.21.15.8:0/817829245 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac00a3b0 con 0x7f14b4152300 2024-03-23T23:47:52.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.374+0000 7f14ab400640 1 -- 172.21.15.8:0/817829245 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ac0070d0 con 0x7f14b4152300 2024-03-23T23:47:52.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.374+0000 7f14ab400640 1 -- 172.21.15.8:0/817829245 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac0079c0 con 0x7f14b4152300 2024-03-23T23:47:52.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.382+0000 7f14ba800640 1 -- 172.21.15.8:0/817829245 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b41fedd0 con 0x7f14b4152300 2024-03-23T23:47:52.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.382+0000 7f14ba800640 1 -- 172.21.15.8:0/817829245 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b4152780 con 0x7f14b4152300 2024-03-23T23:47:52.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.382+0000 7f14ba800640 1 --2- 172.21.15.8:0/817829245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14b41fb360 0x7f14b41491c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:52.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.382+0000 7f14b3400640 1 --2- 172.21.15.8:0/817829245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14b41fb360 0x7f14b41491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:52.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.382+0000 7f14ba800640 1 -- 172.21.15.8:0/817829245 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b4159ac0 con 0x7f14b41fb360 2024-03-23T23:47:52.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.386+0000 7f14b3400640 1 -- 172.21.15.8:0/817829245 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f14b4068270 con 0x7f14b41fb360 2024-03-23T23:47:52.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.386+0000 7f14b3400640 1 --2- 172.21.15.8:0/817829245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14b41fb360 0x7f14b41491c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f14b40c3cd0 tx=0x7f14a400b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:52.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.386+0000 7f14ab400640 1 -- 172.21.15.8:0/817829245 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4016070 con 0x7f14b41fb360 2024-03-23T23:47:52.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.386+0000 7f14ab400640 1 -- 172.21.15.8:0/817829245 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f14a4003dd0 con 0x7f14b41fb360 2024-03-23T23:47:52.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.386+0000 7f14ab400640 1 -- 172.21.15.8:0/817829245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14b41fb360 msgr2=0x7f14b41491c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:52.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.386+0000 7f14ab400640 1 --2- 172.21.15.8:0/817829245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14b41fb360 0x7f14b41491c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f14b40c3cd0 tx=0x7f14a400b810 comp rx=0 tx=0).stop 2024-03-23T23:47:52.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.386+0000 7f14ab400640 1 -- 172.21.15.8:0/817829245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14b41fb360 msgr2=0x7f14b41491c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:47:52.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.386+0000 7f14ab400640 1 --2- 172.21.15.8:0/817829245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14b41fb360 0x7f14b41491c0 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f14b40c3cd0 tx=0x7f14a400b810 comp rx=0 tx=0).stop 2024-03-23T23:47:52.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.390+0000 7f14ab400640 1 -- 172.21.15.8:0/817829245 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f14ac001780 con 0x7f14b4152300 2024-03-23T23:47:52.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.390+0000 7f14ab400640 1 --2- 172.21.15.8:0/817829245 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1494067140 0x7f1494069600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:52.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.390+0000 7f14ab400640 1 -- 172.21.15.8:0/817829245 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f14ac120230 con 0x7f14b4152300 2024-03-23T23:47:52.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.394+0000 7f14b3400640 1 --2- 172.21.15.8:0/817829245 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1494067140 0x7f1494069600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:52.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.398+0000 7f14b3400640 1 --2- 172.21.15.8:0/817829245 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1494067140 0x7f1494069600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f14a4000c10 tx=0x7f14a4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:52.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.402+0000 7f14ba800640 1 --2- 172.21.15.8:0/817829245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14b4149700 0x7f14b4157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:52.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.406+0000 7f14ba800640 1 -- 172.21.15.8:0/817829245 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b4154750 con 0x7f14b4149700 2024-03-23T23:47:52.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.406+0000 7f14b2a00640 1 --2- 172.21.15.8:0/817829245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14b4149700 0x7f14b4157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:52.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.406+0000 7f14b2a00640 1 -- 172.21.15.8:0/817829245 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f14b40c20f0 con 0x7f14b4149700 2024-03-23T23:47:52.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.406+0000 7f14b2a00640 1 --2- 172.21.15.8:0/817829245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14b4149700 0x7f14b4157be0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f14a000e760 tx=0x7f14a000ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:52.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.406+0000 7f14ab400640 1 -- 172.21.15.8:0/817829245 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a000ee70 con 0x7f14b4149700 2024-03-23T23:47:52.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.410+0000 7f14ab400640 1 -- 172.21.15.8:0/817829245 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4860 (secure 0 0 0) 0x7f14a0005300 con 0x7f14b4149700 2024-03-23T23:47:52.417 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:47:52.417 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:47:52.417 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:47:52.417 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:47:52.417 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 40, 2024-03-23T23:47:52.417 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:47:52.417 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:47:52.417 INFO:teuthology.orchestra.run.smithi008.stdout: 1 2024-03-23T23:47:52.417 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:52.417 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 0, 2024-03-23T23:47:52.417 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:47:52.417 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:47:52.417 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:47:52.418 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:47:52.418 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:47:52.418 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:47:52.418 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:47:52.418 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:47:52.418 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:47:52.418 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:47:52.418 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:47:52.418 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:47:52.418 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:47:52.418 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:47:52.418 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:52.418 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:47:52.419 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:47:52.419 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:47:52.419 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:47:52.419 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:47:52.419 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:47:52.419 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:47:52.419 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:47:52.419 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:47:52.419 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:47:52.419 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:47:52.419 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:47:52.419 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:47:52.419 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:52.420 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:52.420 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:47:52.420 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:47:52.420 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:47:52.420 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:47:52.420 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:47:52.420 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:47:52.420 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:47:52.420 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:47:52.420 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:47:52.420 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:47:52.420 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:47:52.420 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:47:52.421 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:47:52.421 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:47:52.421 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:47:52.421 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:47:52.421 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:47:52.421 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:47:52.421 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:47:52.421 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:47:52.421 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:47:52.421 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:47:52.422 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:47:52.422 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:47:52.422 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:47:52.422 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:47:52.422 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:47:52.422 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:47:52.422 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:52.422 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:47:52.422 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:52.422 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:47:52.422 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:52.422 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:47:52.422 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:47:52.423 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:47:52.423 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:47:52.423 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:52.423 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:47:52.423 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:47:52.423 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:52.423 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:52.423 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:52.423 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:47:52.423 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:47:52.423 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:52.423 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:52.423 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:52.424 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:52.424 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:47:52.424 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:47:52.424 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:47:52.424 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:47:52.424 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:47:52.424 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:52.424 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:52.424 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:47:52.424 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:47:52.424 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:47:52.424 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:47:52.424 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:52.424 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:47:52.425 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:47:52.425 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:52.425 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:52.425 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:52.425 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:47:52.425 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:47:52.425 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:52.425 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:52.425 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:52.425 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:52.425 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:47:52.425 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:47:52.425 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:47:52.425 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:47:52.426 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:47:52.426 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:52.426 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:52.426 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:47:52.426 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:47:52.426 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:47:52.426 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:47:52.426 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:52.426 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:47:52.426 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:47:52.426 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:52.426 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:52.427 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:52.427 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:47:52.427 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:47:52.427 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:52.427 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:52.427 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:52.427 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:52.427 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:47:52.427 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:47:52.427 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:47:52.427 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:47:52.427 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:47:52.427 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:52.427 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:52.428 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:52.428 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:47:52.428 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:47:52.428 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:52.428 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:47:52.428 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:52.428 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:47:52.428 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:52.428 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:52.428 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:47:52.428 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:52.428 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:47:52.428 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:52.429 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:47:52.429 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:52.429 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:52.429 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:47:52.429 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:52.429 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:47:52.429 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:52.429 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5 2024-03-23T23:47:52.429 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:52.429 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:52.429 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:47:52.429 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:52.429 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:47:52.429 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:52.430 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:47:52.430 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:52.430 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:52.430 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:52.430 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:47:52.430 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:47:52.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.410+0000 7f14ab400640 1 -- 172.21.15.8:0/817829245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14b4149700 msgr2=0x7f14b4157be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:52.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.418+0000 7f14ba800640 1 -- 172.21.15.8:0/817829245 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1494067140 msgr2=0x7f1494069600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:52.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.418+0000 7f14ba800640 1 --2- 172.21.15.8:0/817829245 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1494067140 0x7f1494069600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f14a4000c10 tx=0x7f14a4008030 comp rx=0 tx=0).stop 2024-03-23T23:47:52.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.422+0000 7f14ab400640 1 --2- 172.21.15.8:0/817829245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14b4149700 0x7f14b4157be0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f14a000e760 tx=0x7f14a000ec20 comp rx=0 tx=0).stop 2024-03-23T23:47:52.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.422+0000 7f14ab400640 1 -- 172.21.15.8:0/817829245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14b4149700 msgr2=0x7f14b4157be0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:47:52.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.422+0000 7f14ab400640 1 --2- 172.21.15.8:0/817829245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14b4149700 0x7f14b4157be0 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f14a000e760 tx=0x7f14a000ec20 comp rx=0 tx=0).stop 2024-03-23T23:47:52.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.426+0000 7f14ba800640 1 -- 172.21.15.8:0/817829245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14b4152300 msgr2=0x7f14b41fae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:52.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.426+0000 7f14ba800640 1 --2- 172.21.15.8:0/817829245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14b4152300 0x7f14b41fae20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f14ac001bb0 tx=0x7f1498005840 comp rx=0 tx=0).stop 2024-03-23T23:47:52.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.426+0000 7f14b3e00640 1 -- 172.21.15.8:0/817829245 reap_dead start 2024-03-23T23:47:52.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.426+0000 7f14b3e00640 1 -- 172.21.15.8:0/817829245 reap_dead start 2024-03-23T23:47:52.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.426+0000 7f14ba800640 1 -- 172.21.15.8:0/817829245 shutdown_connections 2024-03-23T23:47:52.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.426+0000 7f14ba800640 1 -- 172.21.15.8:0/817829245 >> 172.21.15.8:0/817829245 conn(0x7f14b40a9870 msgr2=0x7f14b406b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:47:52.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.438+0000 7f14ba800640 1 -- 172.21.15.8:0/817829245 shutdown_connections 2024-03-23T23:47:52.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.438+0000 7f14ba800640 1 -- 172.21.15.8:0/817829245 wait complete. 2024-03-23T23:47:52.480 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T23:47:52.481 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-03-23T23:47:52.481 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:47:52.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.838+0000 7f9175400640 1 Processor -- start 2024-03-23T23:47:52.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.842+0000 7f9175400640 1 -- start start 2024-03-23T23:47:52.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.846+0000 7f9175400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f917014ede0 0x7f9170072b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:52.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.846+0000 7f9175400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91701522b0 0x7f91700c2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:52.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.846+0000 7f9175400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f917006ccc0 con 0x7f91700c2820 2024-03-23T23:47:52.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.846+0000 7f9175400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91700c3760 con 0x7f917014ede0 2024-03-23T23:47:52.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.846+0000 7f9175400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9170151710 con 0x7f91701522b0 2024-03-23T23:47:52.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.846+0000 7f9174a00640 1 -- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91701522b0 msgr2=0x7f91700c2c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:47:52.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.846+0000 7f9174a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91701522b0 0x7f91700c2c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:47:52.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.850+0000 7f916fe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f917014ede0 0x7f9170072b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:52.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.850+0000 7f9167400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f91700c2820 0x7f9170151ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:47274/0 (socket says 172.21.15.8:47274) 2024-03-23T23:47:52.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.850+0000 7f9167400640 1 -- 172.21.15.8:0/353445730 learned_addr learned my addr 172.21.15.8:0/353445730 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:47:52.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.850+0000 7f916f400640 1 -- 172.21.15.8:0/353445730 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2198473835 0 0) 0x7f917006ccc0 con 0x7f91700c2820 2024-03-23T23:47:52.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.850+0000 7f916fe00640 1 -- 172.21.15.8:0/353445730 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91701522b0 msgr2=0x7f91700c2c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:47:52.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.850+0000 7f916fe00640 1 --2- 172.21.15.8:0/353445730 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91701522b0 0x7f91700c2c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:52.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.850+0000 7f916fe00640 1 -- 172.21.15.8:0/353445730 >> v1:172.21.15.8:6789/0 conn(0x7f91700c2820 legacy=0x7f9170151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:52.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.850+0000 7f916fe00640 1 -- 172.21.15.8:0/353445730 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917006cfa0 con 0x7f917014ede0 2024-03-23T23:47:52.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.862+0000 7f916fe00640 1 --2- 172.21.15.8:0/353445730 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f917014ede0 0x7f9170072b30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f91580097c0 tx=0x7f915801c5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2196ba6056f1a580 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:52.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.870+0000 7f916f400640 1 -- 172.21.15.8:0/353445730 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91580aa660 con 0x7f917014ede0 2024-03-23T23:47:52.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.870+0000 7f916f400640 1 -- 172.21.15.8:0/353445730 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91580af070 con 0x7f917014ede0 2024-03-23T23:47:52.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.870+0000 7f916f400640 1 -- 172.21.15.8:0/353445730 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91580aaa60 con 0x7f917014ede0 2024-03-23T23:47:52.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.874+0000 7f9175400640 1 -- 172.21.15.8:0/353445730 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f917014ede0 msgr2=0x7f9170072b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:52.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.874+0000 7f9175400640 1 --2- 172.21.15.8:0/353445730 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f917014ede0 0x7f9170072b30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f91580097c0 tx=0x7f915801c5f0 comp rx=0 tx=0).stop 2024-03-23T23:47:52.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.874+0000 7f9175400640 1 -- 172.21.15.8:0/353445730 shutdown_connections 2024-03-23T23:47:52.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.874+0000 7f9175400640 1 --2- 172.21.15.8:0/353445730 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91701522b0 0x7f91700c2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:52.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.874+0000 7f9175400640 1 --2- 172.21.15.8:0/353445730 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f917014ede0 0x7f9170072b30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:52.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.874+0000 7f9175400640 1 -- 172.21.15.8:0/353445730 >> 172.21.15.8:0/353445730 conn(0x7f91700c3910 msgr2=0x7f91700c3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:47:52.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.878+0000 7f9175400640 1 -- 172.21.15.8:0/353445730 shutdown_connections 2024-03-23T23:47:52.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.878+0000 7f9175400640 1 -- 172.21.15.8:0/353445730 wait complete. 2024-03-23T23:47:52.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.878+0000 7f9175400640 1 Processor -- start 2024-03-23T23:47:52.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.882+0000 7f9175400640 1 -- start start 2024-03-23T23:47:52.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.886+0000 7f9175400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91700c2820 0x7f91701408f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:52.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.886+0000 7f9175400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f917014ede0 0x7f9170144b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:52.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.886+0000 7f9175400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91701522b0 0x7f917013ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:52.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.886+0000 7f9174a00640 1 -- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91701522b0 msgr2=0x7f917013ec10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:47:52.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.886+0000 7f9174a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91701522b0 0x7f917013ec10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:47:52.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.886+0000 7f9167400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f917014ede0 0x7f9170144b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:52.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.886+0000 7f9167400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f917014ede0 0x7f9170144b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:56048/0 (socket says 172.21.15.8:56048) 2024-03-23T23:47:52.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.886+0000 7f9167400640 1 -- 172.21.15.8:0/298619417 learned_addr learned my addr 172.21.15.8:0/298619417 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:47:52.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.890+0000 7f916fe00640 1 --2- 172.21.15.8:0/298619417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91700c2820 0x7f91701408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:52.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.890+0000 7f9175400640 1 -- 172.21.15.8:0/298619417 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917006c940 con 0x7f91700c2820 2024-03-23T23:47:52.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.890+0000 7f9175400640 1 -- 172.21.15.8:0/298619417 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9170070be0 con 0x7f917014ede0 2024-03-23T23:47:52.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.890+0000 7f9175400640 1 -- 172.21.15.8:0/298619417 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917015e790 con 0x7f91701522b0 2024-03-23T23:47:52.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.894+0000 7f916fe00640 1 -- 172.21.15.8:0/298619417 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91701522b0 msgr2=0x7f917013ec10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:47:52.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.894+0000 7f916fe00640 1 --2- 172.21.15.8:0/298619417 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91701522b0 0x7f917013ec10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:52.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.894+0000 7f916fe00640 1 -- 172.21.15.8:0/298619417 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f917014ede0 msgr2=0x7f9170144b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:52.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.894+0000 7f916fe00640 1 --2- 172.21.15.8:0/298619417 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f917014ede0 0x7f9170144b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:52.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.894+0000 7f916fe00640 1 -- 172.21.15.8:0/298619417 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9170141d00 con 0x7f91700c2820 2024-03-23T23:47:52.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.894+0000 7f916fe00640 1 --2- 172.21.15.8:0/298619417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91700c2820 0x7f91701408f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f91580ab000 tx=0x7f915801ae30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:52.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.898+0000 7f916cc00640 1 -- 172.21.15.8:0/298619417 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91580be610 con 0x7f91700c2820 2024-03-23T23:47:52.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.898+0000 7f916cc00640 1 -- 172.21.15.8:0/298619417 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91580be7f0 con 0x7f91700c2820 2024-03-23T23:47:52.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.898+0000 7f916cc00640 1 -- 172.21.15.8:0/298619417 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91580bebe0 con 0x7f91700c2820 2024-03-23T23:47:52.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.898+0000 7f9175400640 1 -- 172.21.15.8:0/298619417 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91700a9610 con 0x7f91700c2820 2024-03-23T23:47:52.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.898+0000 7f9175400640 1 -- 172.21.15.8:0/298619417 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91700a9bd0 con 0x7f91700c2820 2024-03-23T23:47:52.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.902+0000 7f9175400640 1 --2- 172.21.15.8:0/298619417 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9148002a80 0x7f9148004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:52.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.902+0000 7f9175400640 1 -- 172.21.15.8:0/298619417 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9148007ed0 con 0x7f9148002a80 2024-03-23T23:47:52.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.918+0000 7f916cc00640 1 -- 172.21.15.8:0/298619417 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f91580bc020 con 0x7f91700c2820 2024-03-23T23:47:52.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.918+0000 7f916cc00640 1 --2- 172.21.15.8:0/298619417 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f914c067660 0x7f914c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:52.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.918+0000 7f916cc00640 1 -- 172.21.15.8:0/298619417 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f9158120200 con 0x7f91700c2820 2024-03-23T23:47:52.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.922+0000 7f9167400640 1 --2- 172.21.15.8:0/298619417 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9148002a80 0x7f9148004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:52.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.922+0000 7f9167400640 1 -- 172.21.15.8:0/298619417 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f91480080d0 con 0x7f9148002a80 2024-03-23T23:47:52.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.926+0000 7f9174a00640 1 --2- 172.21.15.8:0/298619417 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f914c067660 0x7f914c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:52.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.930+0000 7f9167400640 1 --2- 172.21.15.8:0/298619417 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9148002a80 0x7f9148004f40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f91701ee7f0 tx=0x7f9160001f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:52.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.930+0000 7f9174a00640 1 --2- 172.21.15.8:0/298619417 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f914c067660 0x7f914c069b20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f917014f780 tx=0x7f9168003c20 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:52.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.942+0000 7f916cc00640 1 -- 172.21.15.8:0/298619417 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91600020c0 con 0x7f9148002a80 2024-03-23T23:47:52.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.942+0000 7f916cc00640 1 -- 172.21.15.8:0/298619417 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f9160018070 con 0x7f9148002a80 2024-03-23T23:47:52.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.942+0000 7f916cc00640 1 -- 172.21.15.8:0/298619417 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9148002a80 msgr2=0x7f9148004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:52.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.942+0000 7f916cc00640 1 --2- 172.21.15.8:0/298619417 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9148002a80 0x7f9148004f40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f91701ee7f0 tx=0x7f9160001f90 comp rx=0 tx=0).stop 2024-03-23T23:47:52.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.942+0000 7f916cc00640 1 -- 172.21.15.8:0/298619417 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9148002a80 msgr2=0x7f9148004f40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:47:52.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:52.942+0000 7f916cc00640 1 --2- 172.21.15.8:0/298619417 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9148002a80 0x7f9148004f40 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f91701ee7f0 tx=0x7f9160001f90 comp rx=0 tx=0).stop 2024-03-23T23:47:53.007 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:53.006+0000 7f9175400640 1 --2- 172.21.15.8:0/298619417 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9148006ec0 0x7f9148007350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:47:53.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:53.006+0000 7f9175400640 1 -- 172.21.15.8:0/298619417 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914800a4b0 con 0x7f9148006ec0 2024-03-23T23:47:53.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:53.006+0000 7f9167400640 1 --2- 172.21.15.8:0/298619417 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9148006ec0 0x7f9148007350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:47:53.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:53.026+0000 7f9167400640 1 -- 172.21.15.8:0/298619417 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9148007890 con 0x7f9148006ec0 2024-03-23T23:47:53.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:53.026+0000 7f9167400640 1 --2- 172.21.15.8:0/298619417 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9148006ec0 0x7f9148007350 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f91701ee7f0 tx=0x7f9160001340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:47:53.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:53.030+0000 7f916cc00640 1 -- 172.21.15.8:0/298619417 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9160028640 con 0x7f9148006ec0 2024-03-23T23:47:53.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:53.030+0000 7f916cc00640 1 -- 172.21.15.8:0/298619417 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5171 (secure 0 0 0) 0x7f916001ee50 con 0x7f9148006ec0 2024-03-23T23:47:53.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:53.030+0000 7f916cc00640 1 -- 172.21.15.8:0/298619417 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9148006ec0 msgr2=0x7f9148007350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:53.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:53.030+0000 7f916cc00640 1 --2- 172.21.15.8:0/298619417 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9148006ec0 0x7f9148007350 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f91701ee7f0 tx=0x7f9160001340 comp rx=0 tx=0).stop 2024-03-23T23:47:53.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:53.030+0000 7f916cc00640 1 -- 172.21.15.8:0/298619417 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9148006ec0 msgr2=0x7f9148007350 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:47:53.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:53.030+0000 7f916cc00640 1 --2- 172.21.15.8:0/298619417 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9148006ec0 0x7f9148007350 secure :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f91701ee7f0 tx=0x7f9160001340 comp rx=0 tx=0).stop 2024-03-23T23:47:53.033 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:47:53.033 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:47:53.033 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:47:53.033 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:47:53.033 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 40, 2024-03-23T23:47:53.033 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:47:53.033 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:47:53.033 INFO:teuthology.orchestra.run.smithi008.stdout: 1 2024-03-23T23:47:53.033 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:53.033 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 1, 2024-03-23T23:47:53.034 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:47:53.034 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:47:53.034 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:47:53.034 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:47:53.034 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:47:53.034 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:47:53.034 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:47:53.034 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:47:53.034 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:47:53.034 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:47:53.034 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:47:53.034 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:47:53.035 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:47:53.035 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:47:53.035 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:53.035 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:47:53.035 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:47:53.035 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:47:53.035 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:47:53.035 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:47:53.035 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:47:53.035 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:47:53.035 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:47:53.035 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:47:53.035 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:47:53.035 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:47:53.036 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:47:53.036 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:47:53.036 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:53.036 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:53.036 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:47:53.036 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:47:53.036 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:47:53.036 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:47:53.036 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:47:53.036 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:47:53.036 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:47:53.036 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:47:53.036 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:47:53.037 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:47:53.037 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:47:53.037 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:47:53.037 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:47:53.037 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:47:53.037 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:47:53.037 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:47:53.037 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:47:53.037 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:47:53.037 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:47:53.037 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:47:53.037 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:47:53.037 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:47:53.037 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:47:53.038 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:47:53.038 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:47:53.038 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:47:53.038 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:47:53.038 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:47:53.038 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:53.038 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:47:53.038 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:53.038 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:47:53.038 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:53.038 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:47:53.038 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:47:53.038 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:47:53.039 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:47:53.039 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:53.039 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:47:53.039 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:47:53.039 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:53.039 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:53.039 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:53.039 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:47:53.039 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:47:53.039 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:53.039 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:53.039 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:53.039 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:53.040 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:47:53.040 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:47:53.040 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:47:53.040 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:47:53.040 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:47:53.040 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:53.040 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:53.040 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:47:53.040 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:47:53.040 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:47:53.040 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:47:53.040 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:53.040 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:47:53.041 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:47:53.041 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:53.041 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:53.041 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:53.041 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:47:53.041 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:47:53.041 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:53.041 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:53.041 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:53.041 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:53.041 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:47:53.041 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:47:53.041 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:47:53.041 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:47:53.042 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:47:53.042 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:53.042 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:53.042 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:47:53.042 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:47:53.042 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:47:53.042 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:47:53.042 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:53.042 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:47:53.042 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:47:53.042 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:53.043 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:53.043 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:53.043 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:47:53.043 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:47:53.043 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:47:53.043 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:53.043 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:53.043 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:53.043 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:47:53.043 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:47:53.043 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:47:53.043 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:47:53.043 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:47:53.043 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:53.044 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:53.044 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:53.044 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:47:53.044 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:47:53.044 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:53.044 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:47:53.044 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:53.044 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:47:53.044 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:53.044 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:53.044 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:47:53.044 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:53.045 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:47:53.045 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:53.045 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:47:53.045 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:53.045 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:53.045 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:47:53.045 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:53.045 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:47:53.045 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:53.045 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:47:53.045 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:53.045 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:53.045 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:47:53.046 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:53.046 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:47:53.046 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:53.046 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:47:53.046 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:53.046 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:53.046 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:47:53.046 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:53.046 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:47:53.046 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:53.046 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:47:53.046 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:47:53.047 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:47:53.047 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:47:53.047 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:47:53.047 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:47:53.047 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:47:53.047 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:47:53.047 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:47:53.047 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:47:53.047 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:47:53.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:53.034+0000 7f9175400640 1 -- 172.21.15.8:0/298619417 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f914c067660 msgr2=0x7f914c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:53.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:53.034+0000 7f9175400640 1 --2- 172.21.15.8:0/298619417 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f914c067660 0x7f914c069b20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f917014f780 tx=0x7f9168003c20 comp rx=0 tx=0).stop 2024-03-23T23:47:53.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:53.034+0000 7f9175400640 1 -- 172.21.15.8:0/298619417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91700c2820 msgr2=0x7f91701408f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:47:53.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:53.034+0000 7f9175400640 1 --2- 172.21.15.8:0/298619417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91700c2820 0x7f91701408f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f91580ab000 tx=0x7f915801ae30 comp rx=0 tx=0).stop 2024-03-23T23:47:53.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:53.034+0000 7f9174a00640 1 -- 172.21.15.8:0/298619417 reap_dead start 2024-03-23T23:47:53.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:53.034+0000 7f9175400640 1 -- 172.21.15.8:0/298619417 shutdown_connections 2024-03-23T23:47:53.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:53.034+0000 7f9175400640 1 --2- 172.21.15.8:0/298619417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91700c2820 0x7f91701408f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:47:53.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:53.034+0000 7f9175400640 1 -- 172.21.15.8:0/298619417 >> 172.21.15.8:0/298619417 conn(0x7f91700c3910 msgr2=0x7f9170145580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:47:53.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:53.034+0000 7f9175400640 1 -- 172.21.15.8:0/298619417 shutdown_connections 2024-03-23T23:47:53.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:47:53.034+0000 7f9175400640 1 -- 172.21.15.8:0/298619417 wait complete. 2024-03-23T23:47:53.113 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T23:47:53.113 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-03-23T23:48:13.114 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-03-23T23:48:13.114 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-03-23T23:48:13.115 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-23T23:48:13.115 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-23T23:48:13.119 INFO:tasks.ceph.mon.c:Started 2024-03-23T23:48:13.119 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T23:48:13.120 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:48:13.493 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:48:13.497 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:48:13.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.561+0000 7fb077e00640 1 Processor -- start 2024-03-23T23:48:13.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.561+0000 7fb077e00640 1 -- start start 2024-03-23T23:48:13.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.561+0000 7fb077e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb078157180 0x7fb07815a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:13.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.561+0000 7fb077e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb078070be0 0x7fb0780c2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:13.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.561+0000 7fb077e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb078159b90 con 0x7fb078071040 2024-03-23T23:48:13.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.561+0000 7fb077e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb078157560 con 0x7fb078070be0 2024-03-23T23:48:13.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.561+0000 7fb077e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07806ccf0 con 0x7fb078157180 2024-03-23T23:48:13.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.565+0000 7fb076000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb078070be0 0x7fb0780c2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:13.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.565+0000 7fb076000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb078070be0 0x7fb0780c2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50258/0 (socket says 172.21.15.8:50258) 2024-03-23T23:48:13.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.565+0000 7fb076000640 1 -- 172.21.15.8:0/3556123894 learned_addr learned my addr 172.21.15.8:0/3556123894 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:48:13.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.565+0000 7fb076000640 1 -- 172.21.15.8:0/3556123894 >> v2:172.21.15.196:3300/0 conn(0x7fb078157180 msgr2=0x7fb07815a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:48:13.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.565+0000 7fb076000640 1 --2- 172.21.15.8:0/3556123894 >> v2:172.21.15.196:3300/0 conn(0x7fb078157180 0x7fb07815a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:13.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.565+0000 7fb076000640 1 -- 172.21.15.8:0/3556123894 >> v1:172.21.15.196:6789/0 conn(0x7fb078071040 legacy=0x7fb07815cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:48:13.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.565+0000 7fb076000640 1 -- 172.21.15.8:0/3556123894 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb078159e70 con 0x7fb078070be0 2024-03-23T23:48:13.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.573+0000 7fb076000640 1 --2- 172.21.15.8:0/3556123894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb078070be0 0x7fb0780c2820 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb07806f790 tx=0x7fb06401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a5416886401adc server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:13.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.577+0000 7fb075600640 1 -- 172.21.15.8:0/3556123894 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0640b0070 con 0x7fb078070be0 2024-03-23T23:48:13.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.577+0000 7fb075600640 1 -- 172.21.15.8:0/3556123894 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0640ab600 con 0x7fb078070be0 2024-03-23T23:48:13.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.577+0000 7fb075600640 1 -- 172.21.15.8:0/3556123894 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0640aba10 con 0x7fb078070be0 2024-03-23T23:48:13.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.581+0000 7fb077e00640 1 -- 172.21.15.8:0/3556123894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb078070be0 msgr2=0x7fb0780c2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:13.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.581+0000 7fb077e00640 1 --2- 172.21.15.8:0/3556123894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb078070be0 0x7fb0780c2820 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb07806f790 tx=0x7fb06401c500 comp rx=0 tx=0).stop 2024-03-23T23:48:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.581+0000 7fb077e00640 1 -- 172.21.15.8:0/3556123894 shutdown_connections 2024-03-23T23:48:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.581+0000 7fb077e00640 1 --2- 172.21.15.8:0/3556123894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb078070be0 0x7fb0780c2820 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.581+0000 7fb077e00640 1 --2- 172.21.15.8:0/3556123894 >> v2:172.21.15.196:3300/0 conn(0x7fb078157180 0x7fb07815a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.581+0000 7fb077e00640 1 -- 172.21.15.8:0/3556123894 >> 172.21.15.8:0/3556123894 conn(0x7fb0780c3910 msgr2=0x7fb0780c3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:48:13.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.581+0000 7fb077e00640 1 -- 172.21.15.8:0/3556123894 shutdown_connections 2024-03-23T23:48:13.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.581+0000 7fb077e00640 1 -- 172.21.15.8:0/3556123894 wait complete. 2024-03-23T23:48:13.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.585+0000 7fb077e00640 1 Processor -- start 2024-03-23T23:48:13.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.589+0000 7fb077e00640 1 -- start start 2024-03-23T23:48:13.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.589+0000 7fb077e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb078070be0 0x7fb0781429d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:13.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.589+0000 7fb077e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb078071040 0x7fb07815bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:13.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.597+0000 7fb077e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb078157180 0x7fb07815c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:13.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.597+0000 7fb077e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07806c940 con 0x7fb078071040 2024-03-23T23:48:13.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.597+0000 7fb077e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07815a1e0 con 0x7fb078157180 2024-03-23T23:48:13.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.597+0000 7fb077e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07806cac0 con 0x7fb078070be0 2024-03-23T23:48:13.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.597+0000 7fb076000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb078071040 0x7fb07815bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:13.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.597+0000 7fb076000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb078071040 0x7fb07815bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50270/0 (socket says 172.21.15.8:50270) 2024-03-23T23:48:13.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.597+0000 7fb076000640 1 -- 172.21.15.8:0/2914664362 learned_addr learned my addr 172.21.15.8:0/2914664362 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:48:13.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.597+0000 7fb076000640 1 -- 172.21.15.8:0/2914664362 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb078070be0 msgr2=0x7fb0781429d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:13.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.597+0000 7fb076000640 1 --2- 172.21.15.8:0/2914664362 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb078070be0 0x7fb0781429d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:13.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.597+0000 7fb076000640 1 -- 172.21.15.8:0/2914664362 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb078157180 msgr2=0x7fb07815c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:13.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.597+0000 7fb076000640 1 --2- 172.21.15.8:0/2914664362 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb078157180 0x7fb07815c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:13.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.597+0000 7fb076000640 1 -- 172.21.15.8:0/2914664362 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07806c410 con 0x7fb078071040 2024-03-23T23:48:13.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.597+0000 7fb076000640 1 --2- 172.21.15.8:0/2914664362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb078071040 0x7fb07815bc80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb0640ae040 tx=0x7fb06401ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:13.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.605+0000 7fb06f400640 1 -- 172.21.15.8:0/2914664362 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0640ba020 con 0x7fb078071040 2024-03-23T23:48:13.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.609+0000 7fb06f400640 1 -- 172.21.15.8:0/2914664362 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0640b66e0 con 0x7fb078071040 2024-03-23T23:48:13.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.609+0000 7fb06f400640 1 -- 172.21.15.8:0/2914664362 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0640b0040 con 0x7fb078071040 2024-03-23T23:48:13.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.609+0000 7fb077e00640 1 -- 172.21.15.8:0/2914664362 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0780c5be0 con 0x7fb078071040 2024-03-23T23:48:13.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.609+0000 7fb077e00640 1 -- 172.21.15.8:0/2914664362 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0781594f0 con 0x7fb078071040 2024-03-23T23:48:13.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.609+0000 7fb077e00640 1 -- 172.21.15.8:0/2914664362 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0500052a0 con 0x7fb078071040 2024-03-23T23:48:13.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.621+0000 7fb06f400640 1 -- 172.21.15.8:0/2914664362 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb0640bd020 con 0x7fb078071040 2024-03-23T23:48:13.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.625+0000 7fb06f400640 1 --2- 172.21.15.8:0/2914664362 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb05c0677c0 0x7fb05c069c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:13.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.625+0000 7fb06f400640 1 -- 172.21.15.8:0/2914664362 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fb0641203c0 con 0x7fb078071040 2024-03-23T23:48:13.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.625+0000 7fb076a00640 1 --2- 172.21.15.8:0/2914664362 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb05c0677c0 0x7fb05c069c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:13.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.625+0000 7fb076a00640 1 --2- 172.21.15.8:0/2914664362 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb05c0677c0 0x7fb05c069c80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb07815d180 tx=0x7fb068006c00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:13.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:13.645+0000 7fb06f400640 1 -- 172.21.15.8:0/2914664362 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fb0640c4030 con 0x7fb078071040 2024-03-23T23:48:14.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:14.129+0000 7fb077e00640 1 -- 172.21.15.8:0/2914664362 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb050005590 con 0x7fb078071040 2024-03-23T23:48:14.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:14.133+0000 7fb06f400640 1 -- 172.21.15.8:0/2914664362 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1555 (secure 0 0 0) 0x7fb0640c4030 con 0x7fb078071040 2024-03-23T23:48:14.133 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":40,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:48:14.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:14.141+0000 7fb077e00640 1 -- 172.21.15.8:0/2914664362 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb05c0677c0 msgr2=0x7fb05c069c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:14.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:14.141+0000 7fb077e00640 1 --2- 172.21.15.8:0/2914664362 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb05c0677c0 0x7fb05c069c80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb07815d180 tx=0x7fb068006c00 comp rx=0 tx=0).stop 2024-03-23T23:48:14.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:14.141+0000 7fb077e00640 1 -- 172.21.15.8:0/2914664362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb078071040 msgr2=0x7fb07815bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:14.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:14.141+0000 7fb077e00640 1 --2- 172.21.15.8:0/2914664362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb078071040 0x7fb07815bc80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb0640ae040 tx=0x7fb06401ad40 comp rx=0 tx=0).stop 2024-03-23T23:48:14.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:14.153+0000 7fb077e00640 1 -- 172.21.15.8:0/2914664362 shutdown_connections 2024-03-23T23:48:14.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:14.153+0000 7fb077e00640 1 --2- 172.21.15.8:0/2914664362 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb078157180 0x7fb07815c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:14.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:14.153+0000 7fb077e00640 1 --2- 172.21.15.8:0/2914664362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb078071040 0x7fb07815bc80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:14.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:14.153+0000 7fb077e00640 1 --2- 172.21.15.8:0/2914664362 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb05c0677c0 0x7fb05c069c80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:14.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:14.153+0000 7fb077e00640 1 --2- 172.21.15.8:0/2914664362 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb078070be0 0x7fb0781429d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:14.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:14.153+0000 7fb077e00640 1 -- 172.21.15.8:0/2914664362 >> 172.21.15.8:0/2914664362 conn(0x7fb0780c3910 msgr2=0x7fb07806d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:48:14.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:14.157+0000 7fb077e00640 1 -- 172.21.15.8:0/2914664362 shutdown_connections 2024-03-23T23:48:14.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:14.157+0000 7fb077e00640 1 -- 172.21.15.8:0/2914664362 wait complete. 2024-03-23T23:48:17.234 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:48:17.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.701+0000 7fd572c00640 1 Processor -- start 2024-03-23T23:48:17.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.701+0000 7fd572c00640 1 -- start start 2024-03-23T23:48:17.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.713+0000 7fd572c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd56c0710f0 0x7fd56c15a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:17.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.725+0000 7fd572c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd56c0aa390 0x7fd56c157010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:17.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.725+0000 7fd572c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd56c072f40 con 0x7fd56c0c1d40 2024-03-23T23:48:17.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.725+0000 7fd572c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd56c0ab420 con 0x7fd56c0710f0 2024-03-23T23:48:17.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.725+0000 7fd572c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c0ab9c0 con 0x7fd56c0aa390 2024-03-23T23:48:17.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.729+0000 7fd56b400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fd56c0c1d40 0x7fd56c0abe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:52914/0 (socket says 172.21.15.8:52914) 2024-03-23T23:48:17.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.729+0000 7fd56b400640 1 -- 172.21.15.8:0/2260048454 learned_addr learned my addr 172.21.15.8:0/2260048454 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:48:17.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.729+0000 7fd56be00640 1 --2- 172.21.15.8:0/2260048454 >> v2:172.21.15.196:3300/0 conn(0x7fd56c0710f0 0x7fd56c15a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:17.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.729+0000 7fd56be00640 1 -- 172.21.15.8:0/2260048454 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd56c0aa390 msgr2=0x7fd56c157010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-23T23:48:17.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.729+0000 7fd56be00640 1 --2- 172.21.15.8:0/2260048454 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd56c0aa390 0x7fd56c157010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:17.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.729+0000 7fd56be00640 1 -- 172.21.15.8:0/2260048454 >> v1:172.21.15.196:6789/0 conn(0x7fd56c0c1d40 legacy=0x7fd56c0abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:17.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.729+0000 7fd56be00640 1 -- 172.21.15.8:0/2260048454 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56c0ab690 con 0x7fd56c0710f0 2024-03-23T23:48:17.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.737+0000 7fd56be00640 1 --2- 172.21.15.8:0/2260048454 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd56c0710f0 0x7fd56c15a7f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd55c0097c0 tx=0x7fd55c01c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23229aa0dd217b3b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:17.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.737+0000 7fd56aa00640 1 -- 172.21.15.8:0/2260048454 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55c0b0070 con 0x7fd56c0710f0 2024-03-23T23:48:17.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.737+0000 7fd56aa00640 1 -- 172.21.15.8:0/2260048454 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd55c0ab600 con 0x7fd56c0710f0 2024-03-23T23:48:17.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.737+0000 7fd56aa00640 1 -- 172.21.15.8:0/2260048454 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55c0ab9d0 con 0x7fd56c0710f0 2024-03-23T23:48:17.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.749+0000 7fd572c00640 1 -- 172.21.15.8:0/2260048454 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd56c0710f0 msgr2=0x7fd56c15a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:17.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.749+0000 7fd572c00640 1 --2- 172.21.15.8:0/2260048454 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd56c0710f0 0x7fd56c15a7f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd55c0097c0 tx=0x7fd55c01c430 comp rx=0 tx=0).stop 2024-03-23T23:48:17.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.761+0000 7fd572c00640 1 -- 172.21.15.8:0/2260048454 shutdown_connections 2024-03-23T23:48:17.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.761+0000 7fd572c00640 1 --2- 172.21.15.8:0/2260048454 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd56c0aa390 0x7fd56c157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:17.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.761+0000 7fd572c00640 1 --2- 172.21.15.8:0/2260048454 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd56c0710f0 0x7fd56c15a7f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:17.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.761+0000 7fd572c00640 1 -- 172.21.15.8:0/2260048454 >> 172.21.15.8:0/2260048454 conn(0x7fd56c0c7170 msgr2=0x7fd56c0c7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:48:17.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.773+0000 7fd572c00640 1 -- 172.21.15.8:0/2260048454 shutdown_connections 2024-03-23T23:48:17.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.773+0000 7fd572c00640 1 -- 172.21.15.8:0/2260048454 wait complete. 2024-03-23T23:48:17.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.773+0000 7fd572c00640 1 Processor -- start 2024-03-23T23:48:17.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.789+0000 7fd572c00640 1 -- start start 2024-03-23T23:48:17.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.789+0000 7fd572c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd56c0710f0 0x7fd56c0c4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:17.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.797+0000 7fd572c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd56c0aa390 0x7fd56c14d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:17.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.797+0000 7fd572c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd56c0c1d40 0x7fd56c158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:17.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.797+0000 7fd572c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c0ac6e0 con 0x7fd56c0c1d40 2024-03-23T23:48:17.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.797+0000 7fd572c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c0ac560 con 0x7fd56c0aa390 2024-03-23T23:48:17.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.797+0000 7fd572c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c0714d0 con 0x7fd56c0710f0 2024-03-23T23:48:17.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.797+0000 7fd56be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd56c0710f0 0x7fd56c0c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:17.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.797+0000 7fd56be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd56c0710f0 0x7fd56c0c4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:42576/0 (socket says 172.21.15.8:42576) 2024-03-23T23:48:17.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.797+0000 7fd56be00640 1 -- 172.21.15.8:0/1465834171 learned_addr learned my addr 172.21.15.8:0/1465834171 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:48:17.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.797+0000 7fd56be00640 1 -- 172.21.15.8:0/1465834171 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd56c0710f0 msgr2=0x7fd56c0c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-03-23T23:48:17.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.797+0000 7fd56be00640 1 -- 172.21.15.8:0/1465834171 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd56c0710f0 msgr2=0x7fd56c0c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T23:48:17.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.797+0000 7fd56be00640 1 --2- 172.21.15.8:0/1465834171 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd56c0710f0 0x7fd56c0c4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:48:17.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.797+0000 7fd56be00640 1 --2- 172.21.15.8:0/1465834171 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd56c0710f0 0x7fd56c0c4010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:48:17.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.801+0000 7fd570c00640 1 --2- 172.21.15.8:0/1465834171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd56c0c1d40 0x7fd56c158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:17.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.801+0000 7fd570c00640 1 -- 172.21.15.8:0/1465834171 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd56c0710f0 msgr2=0x7fd56c0c4010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:48:17.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.801+0000 7fd570c00640 1 --2- 172.21.15.8:0/1465834171 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd56c0710f0 0x7fd56c0c4010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:17.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.801+0000 7fd570c00640 1 -- 172.21.15.8:0/1465834171 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd56c0aa390 msgr2=0x7fd56c14d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:17.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.801+0000 7fd570c00640 1 --2- 172.21.15.8:0/1465834171 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd56c0aa390 0x7fd56c14d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:17.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.801+0000 7fd570c00640 1 -- 172.21.15.8:0/1465834171 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56c1f3840 con 0x7fd56c0c1d40 2024-03-23T23:48:17.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.813+0000 7fd570c00640 1 --2- 172.21.15.8:0/1465834171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd56c0c1d40 0x7fd56c158e90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd56400be20 tx=0x7fd56400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:17.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.817+0000 7fd563e00640 1 -- 172.21.15.8:0/1465834171 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd564019070 con 0x7fd56c0c1d40 2024-03-23T23:48:17.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.817+0000 7fd563e00640 1 -- 172.21.15.8:0/1465834171 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56400ce10 con 0x7fd56c0c1d40 2024-03-23T23:48:17.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.817+0000 7fd563e00640 1 -- 172.21.15.8:0/1465834171 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd564014680 con 0x7fd56c0c1d40 2024-03-23T23:48:17.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.829+0000 7fd572c00640 1 -- 172.21.15.8:0/1465834171 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd56c1f3b20 con 0x7fd56c0c1d40 2024-03-23T23:48:17.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.829+0000 7fd572c00640 1 -- 172.21.15.8:0/1465834171 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd56c0c3800 con 0x7fd56c0c1d40 2024-03-23T23:48:17.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.829+0000 7fd572c00640 1 -- 172.21.15.8:0/1465834171 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd56c15a5a0 con 0x7fd56c0c1d40 2024-03-23T23:48:17.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.849+0000 7fd563e00640 1 -- 172.21.15.8:0/1465834171 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd56401c070 con 0x7fd56c0c1d40 2024-03-23T23:48:17.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.849+0000 7fd563e00640 1 --2- 172.21.15.8:0/1465834171 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd54c0676b0 0x7fd54c069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:17.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.849+0000 7fd563e00640 1 -- 172.21.15.8:0/1465834171 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fd564085f40 con 0x7fd56c0c1d40 2024-03-23T23:48:17.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.853+0000 7fd56be00640 1 --2- 172.21.15.8:0/1465834171 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd54c0676b0 0x7fd54c069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:17.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.869+0000 7fd56be00640 1 --2- 172.21.15.8:0/1465834171 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd54c0676b0 0x7fd54c069b70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd55c01aae0 tx=0x7fd55c0a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:17.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:17.873+0000 7fd563e00640 1 -- 172.21.15.8:0/1465834171 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fd564023020 con 0x7fd56c0c1d40 2024-03-23T23:48:18.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.569+0000 7fd572c00640 1 -- 172.21.15.8:0/1465834171 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd56c0aad70 con 0x7fd56c0c1d40 2024-03-23T23:48:18.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.569+0000 7fd563e00640 1 -- 172.21.15.8:0/1465834171 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1560 (secure 0 0 0) 0x7fd564056970 con 0x7fd56c0c1d40 2024-03-23T23:48:18.573 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":42,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:48:18.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.573+0000 7fd572c00640 1 -- 172.21.15.8:0/1465834171 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd54c0676b0 msgr2=0x7fd54c069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:18.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.573+0000 7fd572c00640 1 --2- 172.21.15.8:0/1465834171 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd54c0676b0 0x7fd54c069b70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd55c01aae0 tx=0x7fd55c0a6000 comp rx=0 tx=0).stop 2024-03-23T23:48:18.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.573+0000 7fd572c00640 1 -- 172.21.15.8:0/1465834171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd56c0c1d40 msgr2=0x7fd56c158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:18.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.577+0000 7fd572c00640 1 --2- 172.21.15.8:0/1465834171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd56c0c1d40 0x7fd56c158e90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd56400be20 tx=0x7fd56400bf10 comp rx=0 tx=0).stop 2024-03-23T23:48:18.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.577+0000 7fd572c00640 1 -- 172.21.15.8:0/1465834171 shutdown_connections 2024-03-23T23:48:18.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.577+0000 7fd572c00640 1 --2- 172.21.15.8:0/1465834171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd56c0c1d40 0x7fd56c158e90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:18.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.577+0000 7fd572c00640 1 --2- 172.21.15.8:0/1465834171 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd56c0aa390 0x7fd56c14d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:18.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.577+0000 7fd572c00640 1 --2- 172.21.15.8:0/1465834171 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd54c0676b0 0x7fd54c069b70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:18.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.577+0000 7fd572c00640 1 --2- 172.21.15.8:0/1465834171 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd56c0710f0 0x7fd56c0c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:18.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.577+0000 7fd572c00640 1 -- 172.21.15.8:0/1465834171 >> 172.21.15.8:0/1465834171 conn(0x7fd56c0c7170 msgr2=0x7fd56c0abe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:48:18.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.577+0000 7fd572c00640 1 -- 172.21.15.8:0/1465834171 shutdown_connections 2024-03-23T23:48:18.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.577+0000 7fd572c00640 1 -- 172.21.15.8:0/1465834171 wait complete. 2024-03-23T23:48:18.616 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T23:48:18.617 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T23:48:18.617 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:48:18.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.857+0000 7f44c6600640 1 Processor -- start 2024-03-23T23:48:18.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.861+0000 7f44c6600640 1 -- start start 2024-03-23T23:48:18.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.861+0000 7f44c6600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f44c0151f90 0x7f44c006e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:18.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.861+0000 7f44bea00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f44c0151f90 0x7f44c006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:18.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.861+0000 7f44bf400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f44c0151bb0 0x7f44c00c1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:52920/0 (socket says 172.21.15.8:52920) 2024-03-23T23:48:18.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.861+0000 7f44bea00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f44c0151f90 0x7f44c006e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50294/0 (socket says 172.21.15.8:50294) 2024-03-23T23:48:18.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.865+0000 7f44bf400640 1 -- 172.21.15.8:0/181371475 learned_addr learned my addr 172.21.15.8:0/181371475 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:48:18.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.865+0000 7f44c6600640 1 -- 172.21.15.8:0/181371475 --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c0071b60 con 0x7f44c0152400 2024-03-23T23:48:18.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.865+0000 7f44c6600640 1 -- 172.21.15.8:0/181371475 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c0071e40 con 0x7f44c0151bb0 2024-03-23T23:48:18.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.865+0000 7f44c6600640 1 -- 172.21.15.8:0/181371475 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44c0072120 con 0x7f44c0151f90 2024-03-23T23:48:18.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.865+0000 7f44be000640 1 -- 172.21.15.8:0/181371475 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942262436 0 0) 0x7f44c0071b60 con 0x7f44c0152400 2024-03-23T23:48:18.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.865+0000 7f44be000640 1 -- 172.21.15.8:0/181371475 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44a4003530 con 0x7f44c0152400 2024-03-23T23:48:18.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.865+0000 7f44bea00640 1 -- 172.21.15.8:0/181371475 >> v1:172.21.15.196:6789/0 conn(0x7f44c0151bb0 legacy=0x7f44c00c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:18.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.865+0000 7f44bea00640 1 -- 172.21.15.8:0/181371475 >> v1:172.21.15.8:6789/0 conn(0x7f44c0152400 legacy=0x7f44c014eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:18.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.865+0000 7f44bea00640 1 -- 172.21.15.8:0/181371475 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c00c3590 con 0x7f44c0151f90 2024-03-23T23:48:18.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.869+0000 7f44bea00640 1 --2- 172.21.15.8:0/181371475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c0151f90 0x7f44c006e340 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f44ac0097c0 tx=0x7f44ac01c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55e27c453910db49 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:18.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.869+0000 7f44be000640 1 -- 172.21.15.8:0/181371475 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac0b0070 con 0x7f44c0151f90 2024-03-23T23:48:18.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.873+0000 7f44be000640 1 -- 172.21.15.8:0/181371475 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ac0ab600 con 0x7f44c0151f90 2024-03-23T23:48:18.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.873+0000 7f44be000640 1 -- 172.21.15.8:0/181371475 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac0ab9b0 con 0x7f44c0151f90 2024-03-23T23:48:18.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.873+0000 7f44c6600640 1 -- 172.21.15.8:0/181371475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c0151f90 msgr2=0x7f44c006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:18.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.873+0000 7f44c6600640 1 --2- 172.21.15.8:0/181371475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c0151f90 0x7f44c006e340 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f44ac0097c0 tx=0x7f44ac01c340 comp rx=0 tx=0).stop 2024-03-23T23:48:18.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.877+0000 7f44c6600640 1 -- 172.21.15.8:0/181371475 shutdown_connections 2024-03-23T23:48:18.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.877+0000 7f44c6600640 1 --2- 172.21.15.8:0/181371475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c0151f90 0x7f44c006e340 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:18.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.877+0000 7f44c6600640 1 -- 172.21.15.8:0/181371475 >> 172.21.15.8:0/181371475 conn(0x7f44c00a9870 msgr2=0x7f44c006b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:48:18.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.881+0000 7f44c6600640 1 -- 172.21.15.8:0/181371475 shutdown_connections 2024-03-23T23:48:18.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.881+0000 7f44c6600640 1 -- 172.21.15.8:0/181371475 wait complete. 2024-03-23T23:48:18.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.881+0000 7f44c6600640 1 Processor -- start 2024-03-23T23:48:18.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.885+0000 7f44c6600640 1 -- start start 2024-03-23T23:48:18.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.885+0000 7f44c6600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44c0151bb0 0x7f44c0145220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:18.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.885+0000 7f44c6600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44c0151f90 0x7f44c00c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:18.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.885+0000 7f44c6600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c0152400 0x7f44c0160b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:18.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.889+0000 7f44c6600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c006ec50 con 0x7f44c0152400 2024-03-23T23:48:18.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.889+0000 7f44c6600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c006ead0 con 0x7f44c0151bb0 2024-03-23T23:48:18.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.889+0000 7f44c6600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c015fa30 con 0x7f44c0151f90 2024-03-23T23:48:18.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.889+0000 7f44bf400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44c0151bb0 0x7f44c0145220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:18.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.889+0000 7f44bf400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44c0151bb0 0x7f44c0145220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:34780/0 (socket says 172.21.15.8:34780) 2024-03-23T23:48:18.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.889+0000 7f44bf400640 1 -- 172.21.15.8:0/1106225012 learned_addr learned my addr 172.21.15.8:0/1106225012 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:48:18.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.889+0000 7f44bfe00640 1 --2- 172.21.15.8:0/1106225012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c0152400 0x7f44c0160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:18.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.889+0000 7f44bf400640 1 -- 172.21.15.8:0/1106225012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44c0151f90 msgr2=0x7f44c00c58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:18.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.889+0000 7f44bf400640 1 --2- 172.21.15.8:0/1106225012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44c0151f90 0x7f44c00c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:18.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.889+0000 7f44bf400640 1 -- 172.21.15.8:0/1106225012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c0152400 msgr2=0x7f44c0160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:18.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.889+0000 7f44bf400640 1 --2- 172.21.15.8:0/1106225012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c0152400 0x7f44c0160b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:18.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.889+0000 7f44bf400640 1 -- 172.21.15.8:0/1106225012 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c0160040 con 0x7f44c0151bb0 2024-03-23T23:48:18.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.889+0000 7f44bf400640 1 --2- 172.21.15.8:0/1106225012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44c0151bb0 0x7f44c0145220 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f44b000afd0 tx=0x7f44b0007610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:18.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.889+0000 7f44b7400640 1 -- 172.21.15.8:0/1106225012 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b0021070 con 0x7f44c0151bb0 2024-03-23T23:48:18.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.889+0000 7f44b7400640 1 -- 172.21.15.8:0/1106225012 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b0008040 con 0x7f44c0151bb0 2024-03-23T23:48:18.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.889+0000 7f44b7400640 1 -- 172.21.15.8:0/1106225012 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b0014250 con 0x7f44c0151bb0 2024-03-23T23:48:18.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.889+0000 7f44c6600640 1 -- 172.21.15.8:0/1106225012 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c00c6a60 con 0x7f44c0151bb0 2024-03-23T23:48:18.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.889+0000 7f44c6600640 1 -- 172.21.15.8:0/1106225012 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c013bef0 con 0x7f44c0151bb0 2024-03-23T23:48:18.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.893+0000 7f44b7400640 1 -- 172.21.15.8:0/1106225012 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f44b0024070 con 0x7f44c0151bb0 2024-03-23T23:48:18.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.893+0000 7f44b4c00640 1 --2- 172.21.15.8:0/1106225012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4498002a80 0x7f4498004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:18.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.893+0000 7f44b4c00640 1 -- 172.21.15.8:0/1106225012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4498007ed0 con 0x7f4498002a80 2024-03-23T23:48:18.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.893+0000 7f44bea00640 1 --2- 172.21.15.8:0/1106225012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4498002a80 0x7f4498004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:18.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.897+0000 7f44bea00640 1 -- 172.21.15.8:0/1106225012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f44980080d0 con 0x7f4498002a80 2024-03-23T23:48:18.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.901+0000 7f44bea00640 1 --2- 172.21.15.8:0/1106225012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4498002a80 0x7f4498004f40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f44c0072ae0 tx=0x7f44ac003b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:18.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.901+0000 7f44b7400640 1 --2- 172.21.15.8:0/1106225012 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f44a0067660 0x7f44a0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:18.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.901+0000 7f44b7400640 1 -- 172.21.15.8:0/1106225012 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f44b008db40 con 0x7f44c0151bb0 2024-03-23T23:48:18.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.905+0000 7f44b7400640 1 -- 172.21.15.8:0/1106225012 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac0b8020 con 0x7f4498002a80 2024-03-23T23:48:18.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.905+0000 7f44b7400640 1 -- 172.21.15.8:0/1106225012 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f44ac003e40 con 0x7f4498002a80 2024-03-23T23:48:18.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.905+0000 7f44b7400640 1 -- 172.21.15.8:0/1106225012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4498002a80 msgr2=0x7f4498004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:18.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.905+0000 7f44b7400640 1 --2- 172.21.15.8:0/1106225012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4498002a80 0x7f4498004f40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f44c0072ae0 tx=0x7f44ac003b50 comp rx=0 tx=0).stop 2024-03-23T23:48:18.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.905+0000 7f44bfe00640 1 --2- 172.21.15.8:0/1106225012 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f44a0067660 0x7f44a0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:18.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.905+0000 7f44b7400640 1 -- 172.21.15.8:0/1106225012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4498002a80 msgr2=0x7f4498004f40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:48:18.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.905+0000 7f44b7400640 1 --2- 172.21.15.8:0/1106225012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4498002a80 0x7f4498004f40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:18.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.905+0000 7f44bfe00640 1 --2- 172.21.15.8:0/1106225012 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f44a0067660 0x7f44a0069b20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f44c0139b10 tx=0x7f44b8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:18.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.921+0000 7f44b4c00640 1 --2- 172.21.15.8:0/1106225012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4498006f40 0x7f44980073d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:18.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.921+0000 7f44b4c00640 1 -- 172.21.15.8:0/1106225012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449800a4b0 con 0x7f4498006f40 2024-03-23T23:48:18.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.925+0000 7f44bea00640 1 --2- 172.21.15.8:0/1106225012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4498006f40 0x7f44980073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:18.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.925+0000 7f44bea00640 1 -- 172.21.15.8:0/1106225012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f4498007910 con 0x7f4498006f40 2024-03-23T23:48:18.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.925+0000 7f44bea00640 1 --2- 172.21.15.8:0/1106225012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4498006f40 0x7f44980073d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f44ac000c10 tx=0x7f44ac0a8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:18.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.929+0000 7f44b7400640 1 -- 172.21.15.8:0/1106225012 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac0b8070 con 0x7f4498006f40 2024-03-23T23:48:18.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.929+0000 7f44b7400640 1 -- 172.21.15.8:0/1106225012 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4871 (secure 0 0 0) 0x7f44ac0093e0 con 0x7f4498006f40 2024-03-23T23:48:18.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.929+0000 7f44b7400640 1 -- 172.21.15.8:0/1106225012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4498006f40 msgr2=0x7f44980073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:18.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.929+0000 7f44b7400640 1 --2- 172.21.15.8:0/1106225012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4498006f40 0x7f44980073d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f44ac000c10 tx=0x7f44ac0a8000 comp rx=0 tx=0).stop 2024-03-23T23:48:18.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.929+0000 7f44b7400640 1 -- 172.21.15.8:0/1106225012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4498006f40 msgr2=0x7f44980073d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:48:18.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.929+0000 7f44b7400640 1 --2- 172.21.15.8:0/1106225012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4498006f40 0x7f44980073d0 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f44ac000c10 tx=0x7f44ac0a8000 comp rx=0 tx=0).stop 2024-03-23T23:48:18.931 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:48:18.931 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:48:18.931 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:48:18.931 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:48:18.931 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 42, 2024-03-23T23:48:18.931 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:48:18.931 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:48:18.932 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:48:18.932 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:48:18.932 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:18.932 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 0, 2024-03-23T23:48:18.932 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:48:18.932 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:48:18.932 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:48:18.932 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:48:18.932 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:48:18.932 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:48:18.932 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:48:18.932 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:48:18.932 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:48:18.932 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:48:18.933 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:48:18.933 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:48:18.933 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:48:18.933 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:48:18.933 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:18.933 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:48:18.933 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:48:18.933 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:48:18.933 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:48:18.933 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:48:18.933 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:48:18.933 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:48:18.933 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:48:18.933 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:48:18.934 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:48:18.934 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:48:18.934 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:48:18.934 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:48:18.934 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:18.934 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:18.934 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:48:18.934 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:48:18.934 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:48:18.934 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:48:18.934 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:48:18.934 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:48:18.934 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:48:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:48:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:48:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:48:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:48:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:48:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:48:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:48:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:48:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:48:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:48:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:48:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:48:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:48:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:48:18.936 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:48:18.936 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:48:18.936 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:48:18.936 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:48:18.936 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:48:18.936 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:48:18.936 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:48:18.936 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:18.936 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:48:18.936 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:18.936 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:48:18.936 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:18.936 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:48:18.936 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:48:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:48:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:48:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:48:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:48:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:48:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:48:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:48:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:48:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:48:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:48:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:48:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:48:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:48:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:48:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:48:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:48:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:48:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:18.939 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:18.939 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:18.939 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:48:18.939 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:48:18.939 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:18.939 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:18.939 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:18.939 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:18.939 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:48:18.939 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:48:18.939 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:48:18.939 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:48:18.939 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:48:18.939 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:18.940 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:18.940 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:48:18.940 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:48:18.940 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:48:18.940 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:48:18.940 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:18.940 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:48:18.940 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:48:18.940 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:18.940 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:18.940 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:18.940 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:48:18.940 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:48:18.940 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:48:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:48:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:48:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:48:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:48:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:48:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:48:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:48:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:48:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:48:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:48:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:48:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:48:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:48:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:48:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:48:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:48:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:48:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:18.944 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:48:18.944 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:48:18.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.929+0000 7f44b4c00640 1 -- 172.21.15.8:0/1106225012 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f44a0067660 msgr2=0x7f44a0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:18.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.929+0000 7f44b4c00640 1 --2- 172.21.15.8:0/1106225012 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f44a0067660 0x7f44a0069b20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f44c0139b10 tx=0x7f44b8009040 comp rx=0 tx=0).stop 2024-03-23T23:48:18.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.929+0000 7f44b4c00640 1 -- 172.21.15.8:0/1106225012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44c0151bb0 msgr2=0x7f44c0145220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:18.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.929+0000 7f44b4c00640 1 --2- 172.21.15.8:0/1106225012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44c0151bb0 0x7f44c0145220 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f44b000afd0 tx=0x7f44b0007610 comp rx=0 tx=0).stop 2024-03-23T23:48:18.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.929+0000 7f44bfe00640 1 -- 172.21.15.8:0/1106225012 reap_dead start 2024-03-23T23:48:18.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.929+0000 7f44bfe00640 1 -- 172.21.15.8:0/1106225012 reap_dead start 2024-03-23T23:48:18.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.933+0000 7f44b4c00640 1 -- 172.21.15.8:0/1106225012 shutdown_connections 2024-03-23T23:48:18.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.933+0000 7f44b4c00640 1 -- 172.21.15.8:0/1106225012 >> 172.21.15.8:0/1106225012 conn(0x7f44c00a9870 msgr2=0x7f44c00c3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:48:18.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.933+0000 7f44b4c00640 1 -- 172.21.15.8:0/1106225012 shutdown_connections 2024-03-23T23:48:18.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:18.933+0000 7f44b4c00640 1 -- 172.21.15.8:0/1106225012 wait complete. 2024-03-23T23:48:18.981 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:48:18.981 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T23:48:18.982 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:48:19.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.365+0000 7f0c5fe00640 1 Processor -- start 2024-03-23T23:48:19.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.365+0000 7f0c5fe00640 1 -- start start 2024-03-23T23:48:19.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.373+0000 7f0c5fe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0c581622f0 0x7f0c5808b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:19.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.373+0000 7f0c5fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0c580c1c70 0x7f0c580c3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:19.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.373+0000 7f0c5fe00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0c580c4240 0x7f0c581626d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:19.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.373+0000 7f0c5fe00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c580c3750 con 0x7f0c581622f0 2024-03-23T23:48:19.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.373+0000 7f0c5fe00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c580c3400 con 0x7f0c580c4240 2024-03-23T23:48:19.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.373+0000 7f0c5fe00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c580712d0 con 0x7f0c580c1c70 2024-03-23T23:48:19.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.373+0000 7f0c5de00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0c580c4240 0x7f0c581626d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:19.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.373+0000 7f0c5de00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0c580c4240 0x7f0c581626d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:34784/0 (socket says 172.21.15.8:34784) 2024-03-23T23:48:19.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.373+0000 7f0c5de00640 1 -- 172.21.15.8:0/1351338959 learned_addr learned my addr 172.21.15.8:0/1351338959 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:48:19.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.373+0000 7f0c5d400640 1 --2- 172.21.15.8:0/1351338959 >> v2:172.21.15.8:3300/0 conn(0x7f0c581622f0 0x7f0c5808b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:19.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.373+0000 7f0c5de00640 1 -- 172.21.15.8:0/1351338959 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0c580c1c70 msgr2=0x7f0c580c3d00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-23T23:48:19.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.373+0000 7f0c5de00640 1 --2- 172.21.15.8:0/1351338959 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0c580c1c70 0x7f0c580c3d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:19.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.373+0000 7f0c5de00640 1 -- 172.21.15.8:0/1351338959 >> v2:172.21.15.8:3300/0 conn(0x7f0c581622f0 msgr2=0x7f0c5808b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:48:19.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.373+0000 7f0c5de00640 1 --2- 172.21.15.8:0/1351338959 >> v2:172.21.15.8:3300/0 conn(0x7f0c581622f0 0x7f0c5808b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:19.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.373+0000 7f0c5de00640 1 -- 172.21.15.8:0/1351338959 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c580715b0 con 0x7f0c580c4240 2024-03-23T23:48:19.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.373+0000 7f0c5d400640 1 --2- 172.21.15.8:0/1351338959 >> v2:172.21.15.8:3300/0 conn(0x7f0c581622f0 0x7f0c5808b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:48:19.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.381+0000 7f0c5de00640 1 --2- 172.21.15.8:0/1351338959 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c580c4240 0x7f0c581626d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0c5806d0c0 tx=0x7f0c4c01c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a52bda9d2f8e3eff server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:19.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.381+0000 7f0c57e00640 1 -- 172.21.15.8:0/1351338959 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c0aa5f0 con 0x7f0c580c4240 2024-03-23T23:48:19.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.381+0000 7f0c57e00640 1 -- 172.21.15.8:0/1351338959 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4c0af070 con 0x7f0c580c4240 2024-03-23T23:48:19.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.381+0000 7f0c57e00640 1 -- 172.21.15.8:0/1351338959 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c0aa9b0 con 0x7f0c580c4240 2024-03-23T23:48:19.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.385+0000 7f0c5fe00640 1 -- 172.21.15.8:0/1351338959 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c580c4240 msgr2=0x7f0c581626d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:19.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.385+0000 7f0c5fe00640 1 --2- 172.21.15.8:0/1351338959 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c580c4240 0x7f0c581626d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0c5806d0c0 tx=0x7f0c4c01c4b0 comp rx=0 tx=0).stop 2024-03-23T23:48:19.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.385+0000 7f0c5fe00640 1 -- 172.21.15.8:0/1351338959 shutdown_connections 2024-03-23T23:48:19.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.385+0000 7f0c5fe00640 1 --2- 172.21.15.8:0/1351338959 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c580c4240 0x7f0c581626d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:19.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.385+0000 7f0c5fe00640 1 --2- 172.21.15.8:0/1351338959 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0c580c1c70 0x7f0c580c3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:19.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.385+0000 7f0c5fe00640 1 --2- 172.21.15.8:0/1351338959 >> v2:172.21.15.8:3300/0 conn(0x7f0c581622f0 0x7f0c5808b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:19.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.385+0000 7f0c5fe00640 1 -- 172.21.15.8:0/1351338959 >> 172.21.15.8:0/1351338959 conn(0x7f0c580a9870 msgr2=0x7f0c5806b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:48:19.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.385+0000 7f0c5fe00640 1 -- 172.21.15.8:0/1351338959 shutdown_connections 2024-03-23T23:48:19.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.385+0000 7f0c5fe00640 1 -- 172.21.15.8:0/1351338959 wait complete. 2024-03-23T23:48:19.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.389+0000 7f0c5fe00640 1 Processor -- start 2024-03-23T23:48:19.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.389+0000 7f0c5fe00640 1 -- start start 2024-03-23T23:48:19.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.397+0000 7f0c5fe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c580c1c70 0x7f0c580c6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:19.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.397+0000 7f0c5d400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c580c1c70 0x7f0c580c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:19.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.397+0000 7f0c5d400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c580c1c70 0x7f0c580c6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:34786/0 (socket says 172.21.15.8:34786) 2024-03-23T23:48:19.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.397+0000 7f0c5d400640 1 -- 172.21.15.8:0/2000211993 learned_addr learned my addr 172.21.15.8:0/2000211993 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:48:19.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.397+0000 7f0c5fe00640 1 --2- 172.21.15.8:0/2000211993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0c580c4240 0x7f0c5815ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:19.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.401+0000 7f0c5fe00640 1 --2- 172.21.15.8:0/2000211993 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c581622f0 0x7f0c5815bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:19.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.401+0000 7f0c5ca00640 1 --2- 172.21.15.8:0/2000211993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0c580c4240 0x7f0c5815ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:19.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.401+0000 7f0c5fe00640 1 -- 172.21.15.8:0/2000211993 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c58166960 con 0x7f0c581622f0 2024-03-23T23:48:19.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.401+0000 7f0c5de00640 1 --2- 172.21.15.8:0/2000211993 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c581622f0 0x7f0c5815bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:19.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.401+0000 7f0c5fe00640 1 -- 172.21.15.8:0/2000211993 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c581667e0 con 0x7f0c580c1c70 2024-03-23T23:48:19.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.401+0000 7f0c5fe00640 1 -- 172.21.15.8:0/2000211993 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c58166ae0 con 0x7f0c580c4240 2024-03-23T23:48:19.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.401+0000 7f0c5ca00640 1 -- 172.21.15.8:0/2000211993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c580c1c70 msgr2=0x7f0c580c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:19.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.401+0000 7f0c5ca00640 1 --2- 172.21.15.8:0/2000211993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c580c1c70 0x7f0c580c6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:19.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.405+0000 7f0c5ca00640 1 -- 172.21.15.8:0/2000211993 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c581622f0 msgr2=0x7f0c5815bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:19.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.405+0000 7f0c5ca00640 1 --2- 172.21.15.8:0/2000211993 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c581622f0 0x7f0c5815bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:19.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.405+0000 7f0c5ca00640 1 -- 172.21.15.8:0/2000211993 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c580c4070 con 0x7f0c580c4240 2024-03-23T23:48:19.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.405+0000 7f0c5de00640 1 --2- 172.21.15.8:0/2000211993 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c581622f0 0x7f0c5815bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:48:19.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.409+0000 7f0c5ca00640 1 --2- 172.21.15.8:0/2000211993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0c580c4240 0x7f0c5815ba50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0c5000be20 tx=0x7f0c50009f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:19.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.429+0000 7f0c55600640 1 -- 172.21.15.8:0/2000211993 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c50019070 con 0x7f0c580c4240 2024-03-23T23:48:19.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.429+0000 7f0c55600640 1 -- 172.21.15.8:0/2000211993 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c50014440 con 0x7f0c580c4240 2024-03-23T23:48:19.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.429+0000 7f0c55600640 1 -- 172.21.15.8:0/2000211993 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c50014870 con 0x7f0c580c4240 2024-03-23T23:48:19.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.429+0000 7f0c5fe00640 1 -- 172.21.15.8:0/2000211993 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c5815c4d0 con 0x7f0c580c4240 2024-03-23T23:48:19.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.429+0000 7f0c5fe00640 1 -- 172.21.15.8:0/2000211993 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c58200330 con 0x7f0c580c4240 2024-03-23T23:48:19.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.433+0000 7f0c5fe00640 1 --2- 172.21.15.8:0/2000211993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c580acd20 0x7f0c58200530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:19.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.433+0000 7f0c5fe00640 1 -- 172.21.15.8:0/2000211993 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c582035a0 con 0x7f0c580acd20 2024-03-23T23:48:19.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.437+0000 7f0c55600640 1 -- 172.21.15.8:0/2000211993 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f0c5001c070 con 0x7f0c580c4240 2024-03-23T23:48:19.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.441+0000 7f0c55600640 1 --2- 172.21.15.8:0/2000211993 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0c38067730 0x7f0c38069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:19.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.441+0000 7f0c55600640 1 -- 172.21.15.8:0/2000211993 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f0c50085c10 con 0x7f0c580c4240 2024-03-23T23:48:19.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.445+0000 7f0c5de00640 1 --2- 172.21.15.8:0/2000211993 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0c38067730 0x7f0c38069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:19.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.449+0000 7f0c5d400640 1 --2- 172.21.15.8:0/2000211993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c580acd20 0x7f0c58200530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:19.464 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.457+0000 7f0c5d400640 1 -- 172.21.15.8:0/2000211993 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0c58068270 con 0x7f0c580acd20 2024-03-23T23:48:19.464 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.457+0000 7f0c5d400640 1 --2- 172.21.15.8:0/2000211993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c580acd20 0x7f0c58200530 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0c44011830 tx=0x7f0c44011cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:19.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.461+0000 7f0c5de00640 1 --2- 172.21.15.8:0/2000211993 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0c38067730 0x7f0c38069bf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c0ae000 tx=0x7f0c4c0a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:19.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.465+0000 7f0c55600640 1 -- 172.21.15.8:0/2000211993 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c44019020 con 0x7f0c580acd20 2024-03-23T23:48:19.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.469+0000 7f0c55600640 1 -- 172.21.15.8:0/2000211993 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f0c44009e10 con 0x7f0c580acd20 2024-03-23T23:48:19.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.469+0000 7f0c55600640 1 -- 172.21.15.8:0/2000211993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c580acd20 msgr2=0x7f0c58200530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:19.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.469+0000 7f0c55600640 1 --2- 172.21.15.8:0/2000211993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c580acd20 0x7f0c58200530 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0c44011830 tx=0x7f0c44011cf0 comp rx=0 tx=0).stop 2024-03-23T23:48:19.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.469+0000 7f0c55600640 1 -- 172.21.15.8:0/2000211993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c580acd20 msgr2=0x7f0c58200530 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:48:19.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.469+0000 7f0c55600640 1 --2- 172.21.15.8:0/2000211993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c580acd20 0x7f0c58200530 secure :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0c44011830 tx=0x7f0c44011cf0 comp rx=0 tx=0).stop 2024-03-23T23:48:19.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.513+0000 7f0c5fe00640 1 --2- 172.21.15.8:0/2000211993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c58200a70 0x7f0c581fcd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:19.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.513+0000 7f0c5fe00640 1 -- 172.21.15.8:0/2000211993 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c58200e80 con 0x7f0c58200a70 2024-03-23T23:48:19.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.517+0000 7f0c5d400640 1 --2- 172.21.15.8:0/2000211993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c58200a70 0x7f0c581fcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:19.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.521+0000 7f0c5d400640 1 -- 172.21.15.8:0/2000211993 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0c5815fc20 con 0x7f0c58200a70 2024-03-23T23:48:19.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.525+0000 7f0c5d400640 1 --2- 172.21.15.8:0/2000211993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c58200a70 0x7f0c581fcd20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0c44011830 tx=0x7f0c440046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:19.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.529+0000 7f0c55600640 1 -- 172.21.15.8:0/2000211993 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c44019040 con 0x7f0c58200a70 2024-03-23T23:48:19.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.529+0000 7f0c55600640 1 -- 172.21.15.8:0/2000211993 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5182 (secure 0 0 0) 0x7f0c44020220 con 0x7f0c58200a70 2024-03-23T23:48:19.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.529+0000 7f0c55600640 1 -- 172.21.15.8:0/2000211993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c58200a70 msgr2=0x7f0c581fcd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:19.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.529+0000 7f0c55600640 1 --2- 172.21.15.8:0/2000211993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c58200a70 0x7f0c581fcd20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0c44011830 tx=0x7f0c440046d0 comp rx=0 tx=0).stop 2024-03-23T23:48:19.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.529+0000 7f0c55600640 1 -- 172.21.15.8:0/2000211993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c58200a70 msgr2=0x7f0c581fcd20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:48:19.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.529+0000 7f0c55600640 1 --2- 172.21.15.8:0/2000211993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c58200a70 0x7f0c581fcd20 secure :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0c44011830 tx=0x7f0c440046d0 comp rx=0 tx=0).stop 2024-03-23T23:48:19.530 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:48:19.530 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:48:19.530 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:48:19.530 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:48:19.531 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 42, 2024-03-23T23:48:19.531 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:48:19.531 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:48:19.531 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:48:19.531 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:48:19.531 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:19.531 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 1, 2024-03-23T23:48:19.531 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:48:19.531 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:48:19.531 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:48:19.531 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:48:19.531 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:48:19.532 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:48:19.532 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:48:19.532 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:48:19.532 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:48:19.532 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:48:19.532 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:48:19.532 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:48:19.532 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:48:19.532 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:48:19.533 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:19.533 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:48:19.533 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:48:19.533 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:48:19.533 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:48:19.533 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:48:19.533 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:48:19.533 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:48:19.533 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:48:19.533 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:48:19.533 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:48:19.534 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:48:19.534 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:48:19.534 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:48:19.534 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:19.534 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:19.534 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:48:19.534 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:48:19.534 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:48:19.534 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:48:19.535 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:48:19.535 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:48:19.535 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:48:19.535 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:48:19.535 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:48:19.535 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:48:19.535 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:48:19.535 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:48:19.535 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:48:19.535 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:48:19.536 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:48:19.536 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:48:19.536 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:48:19.536 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:48:19.536 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:48:19.536 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:48:19.536 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:48:19.536 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:48:19.536 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:48:19.536 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:48:19.537 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:48:19.537 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:48:19.537 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:48:19.537 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:48:19.537 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:19.537 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:48:19.537 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:19.537 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:48:19.537 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:19.537 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:48:19.537 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:48:19.538 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:48:19.538 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:48:19.538 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:19.538 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:48:19.538 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:48:19.538 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:19.538 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:19.538 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:19.538 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:48:19.538 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:48:19.539 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:19.539 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:19.539 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:19.539 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:19.539 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:48:19.539 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:48:19.539 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:48:19.540 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:48:19.540 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:48:19.540 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:19.540 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:19.540 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:48:19.540 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:48:19.540 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:48:19.540 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:48:19.540 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:19.540 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:48:19.541 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:48:19.541 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:19.541 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:19.541 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:19.541 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:48:19.541 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:48:19.541 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:19.541 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:19.541 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:19.541 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:19.542 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:48:19.542 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:48:19.542 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:48:19.542 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:48:19.542 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:48:19.542 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:19.542 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:19.542 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:48:19.542 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:48:19.542 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:48:19.543 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:48:19.543 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:19.543 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:48:19.543 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:48:19.543 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:19.543 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:19.543 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:19.543 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:48:19.543 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:48:19.543 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:19.544 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:19.544 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:19.544 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:19.544 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:48:19.544 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:48:19.544 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:48:19.544 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:48:19.544 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:48:19.544 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:19.544 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:19.544 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:19.544 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:48:19.545 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:48:19.545 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:19.545 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:48:19.545 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:19.545 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:48:19.545 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:19.545 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:19.545 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:48:19.545 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:19.545 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:48:19.546 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:19.546 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:48:19.546 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:19.546 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:19.546 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:48:19.546 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:19.546 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:48:19.546 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:19.546 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:48:19.547 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:19.547 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:19.547 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:48:19.547 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:19.547 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:48:19.547 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:19.547 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:48:19.547 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:19.547 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:19.547 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:48:19.548 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:19.548 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:48:19.548 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:19.548 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:19.548 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:48:19.548 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:19.548 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:48:19.548 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:19.548 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:48:19.548 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:19.548 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:19.548 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:19.549 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:48:19.549 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:48:19.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.545+0000 7f0c5fe00640 1 -- 172.21.15.8:0/2000211993 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0c38067730 msgr2=0x7f0c38069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:19.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.545+0000 7f0c5fe00640 1 --2- 172.21.15.8:0/2000211993 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0c38067730 0x7f0c38069bf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c0ae000 tx=0x7f0c4c0a7000 comp rx=0 tx=0).stop 2024-03-23T23:48:19.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.545+0000 7f0c5fe00640 1 -- 172.21.15.8:0/2000211993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0c580c4240 msgr2=0x7f0c5815ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:19.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.545+0000 7f0c5fe00640 1 --2- 172.21.15.8:0/2000211993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0c580c4240 0x7f0c5815ba50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0c5000be20 tx=0x7f0c50009f70 comp rx=0 tx=0).stop 2024-03-23T23:48:19.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.545+0000 7f0c5de00640 1 -- 172.21.15.8:0/2000211993 reap_dead start 2024-03-23T23:48:19.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.545+0000 7f0c5de00640 1 -- 172.21.15.8:0/2000211993 reap_dead start 2024-03-23T23:48:19.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.549+0000 7f0c5fe00640 1 -- 172.21.15.8:0/2000211993 shutdown_connections 2024-03-23T23:48:19.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.549+0000 7f0c5fe00640 1 -- 172.21.15.8:0/2000211993 >> 172.21.15.8:0/2000211993 conn(0x7f0c580a9870 msgr2=0x7f0c5808b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:48:19.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.549+0000 7f0c5fe00640 1 -- 172.21.15.8:0/2000211993 shutdown_connections 2024-03-23T23:48:19.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:19.549+0000 7f0c5fe00640 1 -- 172.21.15.8:0/2000211993 wait complete. 2024-03-23T23:48:19.635 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:48:19.636 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T23:48:19.636 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:48:20.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.061+0000 7f050a000640 1 Processor -- start 2024-03-23T23:48:20.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.061+0000 7f050a000640 1 -- start start 2024-03-23T23:48:20.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.065+0000 7f050a000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0504151bb0 0x7f05040c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:20.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.065+0000 7f050a000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f050406ea50 0x7f050414eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:20.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.065+0000 7f050a000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05040c21f0 con 0x7f0504151f90 2024-03-23T23:48:20.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.065+0000 7f050a000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0504071b60 con 0x7f050406ea50 2024-03-23T23:48:20.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.065+0000 7f050a000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0504071e40 con 0x7f0504151bb0 2024-03-23T23:48:20.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.069+0000 7f0503e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f050406ea50 0x7f050414eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:20.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.069+0000 7f0503e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f050406ea50 0x7f050414eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:34818/0 (socket says 172.21.15.8:34818) 2024-03-23T23:48:20.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.069+0000 7f0503e00640 1 -- 172.21.15.8:0/2849810258 learned_addr learned my addr 172.21.15.8:0/2849810258 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:48:20.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.073+0000 7f0503400640 1 --2- 172.21.15.8:0/2849810258 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0504151bb0 0x7f05040c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:20.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.077+0000 7f0503400640 1 -- 172.21.15.8:0/2849810258 >> v2:172.21.15.196:3300/0 conn(0x7f050406ea50 msgr2=0x7f050414eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:48:20.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.077+0000 7f0503400640 1 --2- 172.21.15.8:0/2849810258 >> v2:172.21.15.196:3300/0 conn(0x7f050406ea50 0x7f050414eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:20.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.077+0000 7f0503400640 1 -- 172.21.15.8:0/2849810258 >> v1:172.21.15.196:6789/0 conn(0x7f0504151f90 legacy=0x7f050406e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:20.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.077+0000 7f0503400640 1 -- 172.21.15.8:0/2849810258 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0504072120 con 0x7f0504151bb0 2024-03-23T23:48:20.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.097+0000 7f0503400640 1 --2- 172.21.15.8:0/2849810258 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0504151bb0 0x7f05040c1cb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f04f000dbe0 tx=0x7f04f00206b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1225f913ad6f4e67 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:20.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.113+0000 7f0502000640 1 -- 172.21.15.8:0/2849810258 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f000d2d0 con 0x7f0504151bb0 2024-03-23T23:48:20.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.113+0000 7f0502000640 1 -- 172.21.15.8:0/2849810258 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f00b3070 con 0x7f0504151bb0 2024-03-23T23:48:20.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.113+0000 7f0502000640 1 -- 172.21.15.8:0/2849810258 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f00ae670 con 0x7f0504151bb0 2024-03-23T23:48:20.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.117+0000 7f050a000640 1 -- 172.21.15.8:0/2849810258 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0504151bb0 msgr2=0x7f05040c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:20.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.117+0000 7f050a000640 1 --2- 172.21.15.8:0/2849810258 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0504151bb0 0x7f05040c1cb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f04f000dbe0 tx=0x7f04f00206b0 comp rx=0 tx=0).stop 2024-03-23T23:48:20.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.125+0000 7f050a000640 1 -- 172.21.15.8:0/2849810258 shutdown_connections 2024-03-23T23:48:20.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.125+0000 7f050a000640 1 --2- 172.21.15.8:0/2849810258 >> v2:172.21.15.196:3300/0 conn(0x7f050406ea50 0x7f050414eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:20.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.125+0000 7f050a000640 1 --2- 172.21.15.8:0/2849810258 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0504151bb0 0x7f05040c1cb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:20.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.125+0000 7f050a000640 1 -- 172.21.15.8:0/2849810258 >> 172.21.15.8:0/2849810258 conn(0x7f05040a9870 msgr2=0x7f050406b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:48:20.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.129+0000 7f050a000640 1 -- 172.21.15.8:0/2849810258 shutdown_connections 2024-03-23T23:48:20.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.133+0000 7f050a000640 1 -- 172.21.15.8:0/2849810258 wait complete. 2024-03-23T23:48:20.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.137+0000 7f050a000640 1 Processor -- start 2024-03-23T23:48:20.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.141+0000 7f050a000640 1 -- start start 2024-03-23T23:48:20.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.141+0000 7f050a000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f050406ea50 0x7f0504141570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:20.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.145+0000 7f0503400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f050406ea50 0x7f0504141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:20.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.145+0000 7f0503400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f050406ea50 0x7f0504141570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50362/0 (socket says 172.21.15.8:50362) 2024-03-23T23:48:20.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.145+0000 7f0503400640 1 -- 172.21.15.8:0/1839794204 learned_addr learned my addr 172.21.15.8:0/1839794204 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:48:20.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.145+0000 7f050a000640 1 --2- 172.21.15.8:0/1839794204 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0504151bb0 0x7f05041fe960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:20.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.145+0000 7f050a000640 1 --2- 172.21.15.8:0/1839794204 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0504151f90 0x7f05041feea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:20.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.145+0000 7f050a000640 1 -- 172.21.15.8:0/1839794204 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050414f440 con 0x7f050406ea50 2024-03-23T23:48:20.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.145+0000 7f050a000640 1 -- 172.21.15.8:0/1839794204 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050414f2c0 con 0x7f0504151bb0 2024-03-23T23:48:20.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.145+0000 7f050a000640 1 -- 172.21.15.8:0/1839794204 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0504140e20 con 0x7f0504151f90 2024-03-23T23:48:20.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.149+0000 7f0503e00640 1 --2- 172.21.15.8:0/1839794204 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0504151f90 0x7f05041feea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:20.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.149+0000 7f0503400640 1 -- 172.21.15.8:0/1839794204 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0504151f90 msgr2=0x7f05041feea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:20.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.149+0000 7f0503400640 1 --2- 172.21.15.8:0/1839794204 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0504151f90 0x7f05041feea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:20.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.149+0000 7f0503400640 1 -- 172.21.15.8:0/1839794204 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0504151bb0 msgr2=0x7f05041fe960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:20.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.149+0000 7f0503400640 1 --2- 172.21.15.8:0/1839794204 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0504151bb0 0x7f05041fe960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:20.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.149+0000 7f0503400640 1 -- 172.21.15.8:0/1839794204 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05041ff510 con 0x7f050406ea50 2024-03-23T23:48:20.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.153+0000 7f0503400640 1 --2- 172.21.15.8:0/1839794204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f050406ea50 0x7f0504141570 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f04f001ed60 tx=0x7f04f001eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:20.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.153+0000 7f04fb400640 1 -- 172.21.15.8:0/1839794204 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f00bd020 con 0x7f050406ea50 2024-03-23T23:48:20.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.153+0000 7f04fb400640 1 -- 172.21.15.8:0/1839794204 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f00aa040 con 0x7f050406ea50 2024-03-23T23:48:20.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.157+0000 7f04fb400640 1 -- 172.21.15.8:0/1839794204 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f0005da0 con 0x7f050406ea50 2024-03-23T23:48:20.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.157+0000 7f050a000640 1 -- 172.21.15.8:0/1839794204 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05040c5560 con 0x7f050406ea50 2024-03-23T23:48:20.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.157+0000 7f050a000640 1 -- 172.21.15.8:0/1839794204 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05041ff7f0 con 0x7f050406ea50 2024-03-23T23:48:20.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.161+0000 7f050a000640 1 --2- 172.21.15.8:0/1839794204 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05041f8d80 0x7f050413ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:20.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.161+0000 7f050a000640 1 -- 172.21.15.8:0/1839794204 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050414f5c0 con 0x7f05041f8d80 2024-03-23T23:48:20.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.161+0000 7f0502a00640 1 --2- 172.21.15.8:0/1839794204 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05041f8d80 0x7f050413ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:20.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.169+0000 7f04fb400640 1 -- 172.21.15.8:0/1839794204 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f04f0006020 con 0x7f050406ea50 2024-03-23T23:48:20.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.169+0000 7f0502a00640 1 -- 172.21.15.8:0/1839794204 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f05040c5bb0 con 0x7f05041f8d80 2024-03-23T23:48:20.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.177+0000 7f04fb400640 1 --2- 172.21.15.8:0/1839794204 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f04e4067690 0x7f04e4069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:20.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.181+0000 7f04fb400640 1 -- 172.21.15.8:0/1839794204 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f04f0120010 con 0x7f050406ea50 2024-03-23T23:48:20.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.181+0000 7f0502a00640 1 --2- 172.21.15.8:0/1839794204 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05041f8d80 0x7f050413ce10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f050413f7e0 tx=0x7f04f400c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:20.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.181+0000 7f04fb400640 1 -- 172.21.15.8:0/1839794204 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f4005280 con 0x7f05041f8d80 2024-03-23T23:48:20.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.181+0000 7f0503e00640 1 --2- 172.21.15.8:0/1839794204 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f04e4067690 0x7f04e4069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:20.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.189+0000 7f0503e00640 1 --2- 172.21.15.8:0/1839794204 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f04e4067690 0x7f04e4069b50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f04fc009440 tx=0x7f04fc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:20.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.201+0000 7f04fb400640 1 -- 172.21.15.8:0/1839794204 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f04f4005280 con 0x7f05041f8d80 2024-03-23T23:48:20.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.201+0000 7f04fb400640 1 -- 172.21.15.8:0/1839794204 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05041f8d80 msgr2=0x7f050413ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:20.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.201+0000 7f04fb400640 1 --2- 172.21.15.8:0/1839794204 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05041f8d80 0x7f050413ce10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f050413f7e0 tx=0x7f04f400c810 comp rx=0 tx=0).stop 2024-03-23T23:48:20.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.201+0000 7f04fb400640 1 -- 172.21.15.8:0/1839794204 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05041f8d80 msgr2=0x7f050413ce10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:48:20.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.201+0000 7f04fb400640 1 --2- 172.21.15.8:0/1839794204 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05041f8d80 0x7f050413ce10 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f050413f7e0 tx=0x7f04f400c810 comp rx=0 tx=0).stop 2024-03-23T23:48:20.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.237+0000 7f050a000640 1 --2- 172.21.15.8:0/1839794204 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0504141020 0x7f050413d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:20.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.237+0000 7f050a000640 1 -- 172.21.15.8:0/1839794204 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0504140a70 con 0x7f0504141020 2024-03-23T23:48:20.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.245+0000 7f0502a00640 1 --2- 172.21.15.8:0/1839794204 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0504141020 0x7f050413d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:20.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.253+0000 7f0502a00640 1 -- 172.21.15.8:0/1839794204 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f050406e440 con 0x7f0504141020 2024-03-23T23:48:20.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.253+0000 7f0502a00640 1 --2- 172.21.15.8:0/1839794204 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0504141020 0x7f050413d350 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f04f4007000 tx=0x7f04f4001130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:20.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.265+0000 7f04fb400640 1 -- 172.21.15.8:0/1839794204 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f4017040 con 0x7f0504141020 2024-03-23T23:48:20.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.265+0000 7f04fb400640 1 -- 172.21.15.8:0/1839794204 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4529 (secure 0 0 0) 0x7f04f40067e0 con 0x7f0504141020 2024-03-23T23:48:20.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.265+0000 7f04fb400640 1 -- 172.21.15.8:0/1839794204 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0504141020 msgr2=0x7f050413d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:20.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.265+0000 7f04fb400640 1 --2- 172.21.15.8:0/1839794204 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0504141020 0x7f050413d350 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f04f4007000 tx=0x7f04f4001130 comp rx=0 tx=0).stop 2024-03-23T23:48:20.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.265+0000 7f04fb400640 1 -- 172.21.15.8:0/1839794204 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0504141020 msgr2=0x7f050413d350 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:48:20.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.265+0000 7f04fb400640 1 --2- 172.21.15.8:0/1839794204 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0504141020 0x7f050413d350 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f04f4007000 tx=0x7f04f4001130 comp rx=0 tx=0).stop 2024-03-23T23:48:20.278 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:48:20.278 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:48:20.278 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:48:20.278 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:48:20.278 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 42, 2024-03-23T23:48:20.278 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:48:20.278 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:48:20.278 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:48:20.278 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:48:20.279 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:20.279 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 1, 2024-03-23T23:48:20.279 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:48:20.279 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:48:20.279 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:48:20.279 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:48:20.279 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:48:20.279 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:48:20.279 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:48:20.279 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:48:20.279 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:48:20.279 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:48:20.279 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:48:20.280 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:48:20.280 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:48:20.280 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:48:20.280 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:20.280 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:48:20.280 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:48:20.280 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:48:20.280 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:48:20.280 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:48:20.280 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:48:20.280 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:48:20.280 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:48:20.280 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:48:20.280 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:48:20.281 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:48:20.281 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:48:20.281 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:48:20.281 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:20.281 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:20.281 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:48:20.281 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:48:20.281 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:48:20.281 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:48:20.281 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:48:20.281 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:48:20.281 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:48:20.281 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:48:20.282 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:48:20.282 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:48:20.282 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:48:20.282 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:48:20.282 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:48:20.282 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:48:20.282 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:48:20.282 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:48:20.282 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:48:20.282 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:48:20.282 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:48:20.282 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:48:20.282 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:48:20.283 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:48:20.283 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:48:20.283 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:48:20.283 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:48:20.283 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:48:20.283 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:48:20.283 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:48:20.283 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:20.283 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:48:20.283 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:20.283 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:48:20.283 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:20.284 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:48:20.284 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:48:20.284 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:48:20.284 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:48:20.284 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:20.284 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:48:20.284 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:48:20.284 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:20.284 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:20.284 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:20.284 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:48:20.284 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:48:20.284 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:20.285 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:20.285 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:20.285 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:20.285 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:48:20.285 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:48:20.285 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:48:20.285 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:48:20.285 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:48:20.285 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:20.285 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:20.285 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:48:20.285 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:48:20.285 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:48:20.286 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:48:20.286 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:20.286 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:48:20.286 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:48:20.286 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:20.286 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:20.286 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:20.286 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:48:20.286 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:48:20.286 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:20.286 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:20.286 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:20.286 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:20.287 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:48:20.287 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:48:20.287 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:48:20.287 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:48:20.287 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:48:20.287 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:20.287 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:20.287 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:48:20.287 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:48:20.287 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:48:20.287 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:48:20.287 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:20.287 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:48:20.288 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:48:20.288 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:20.288 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:20.288 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:20.288 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:48:20.288 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:48:20.288 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:20.288 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:20.288 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:20.288 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:20.288 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:48:20.288 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:48:20.288 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:48:20.289 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:48:20.289 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:48:20.289 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:20.289 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:20.289 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:20.289 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:48:20.289 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:48:20.289 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:20.289 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:48:20.289 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:20.289 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:48:20.289 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:20.289 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:20.289 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:48:20.290 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:20.290 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:48:20.290 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:20.290 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:48:20.290 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:20.290 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:20.290 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:20.290 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:48:20.290 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:48:20.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.277+0000 7f050a000640 1 -- 172.21.15.8:0/1839794204 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f04e4067690 msgr2=0x7f04e4069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:20.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.277+0000 7f050a000640 1 --2- 172.21.15.8:0/1839794204 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f04e4067690 0x7f04e4069b50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f04fc009440 tx=0x7f04fc009040 comp rx=0 tx=0).stop 2024-03-23T23:48:20.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.277+0000 7f050a000640 1 -- 172.21.15.8:0/1839794204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f050406ea50 msgr2=0x7f0504141570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:20.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.277+0000 7f050a000640 1 --2- 172.21.15.8:0/1839794204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f050406ea50 0x7f0504141570 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f04f001ed60 tx=0x7f04f001eef0 comp rx=0 tx=0).stop 2024-03-23T23:48:20.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.277+0000 7f0503e00640 1 -- 172.21.15.8:0/1839794204 reap_dead start 2024-03-23T23:48:20.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.277+0000 7f0503e00640 1 -- 172.21.15.8:0/1839794204 reap_dead start 2024-03-23T23:48:20.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.277+0000 7f050a000640 1 -- 172.21.15.8:0/1839794204 shutdown_connections 2024-03-23T23:48:20.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.277+0000 7f050a000640 1 -- 172.21.15.8:0/1839794204 >> 172.21.15.8:0/1839794204 conn(0x7f05040a9870 msgr2=0x7f050406b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:48:20.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.281+0000 7f050a000640 1 -- 172.21.15.8:0/1839794204 shutdown_connections 2024-03-23T23:48:20.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.281+0000 7f050a000640 1 -- 172.21.15.8:0/1839794204 wait complete. 2024-03-23T23:48:20.322 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:48:20.323 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-03-23T23:48:20.323 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-03-23T23:48:20.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.601+0000 7fdef0400640 1 Processor -- start 2024-03-23T23:48:20.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.601+0000 7fdef0400640 1 -- start start 2024-03-23T23:48:20.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.601+0000 7fdef0400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdee80725b0 0x7fdee80c1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:20.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.601+0000 7fdef0400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fdee80715c0 0x7fdee80c2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:20.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.601+0000 7fdef0400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdee80711b0 con 0x7fdee814efa0 2024-03-23T23:48:20.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.601+0000 7fdef0400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdee8152930 con 0x7fdee80715c0 2024-03-23T23:48:20.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.601+0000 7fdef0400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee81524a0 con 0x7fdee80725b0 2024-03-23T23:48:20.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.605+0000 7fdee7e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdee80725b0 0x7fdee80c1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:20.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.605+0000 7fdeeda00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fdee80715c0 0x7fdee80c2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:20.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.605+0000 7fdeeda00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fdee80715c0 0x7fdee80c2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:34832/0 (socket says 172.21.15.8:34832) 2024-03-23T23:48:20.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.605+0000 7fdeeda00640 1 -- 172.21.15.8:0/3950392233 learned_addr learned my addr 172.21.15.8:0/3950392233 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:48:20.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.609+0000 7fdeeda00640 1 -- 172.21.15.8:0/3950392233 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdee80725b0 msgr2=0x7fdee80c1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:48:20.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.609+0000 7fdeeda00640 1 --2- 172.21.15.8:0/3950392233 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdee80725b0 0x7fdee80c1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:20.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.609+0000 7fdeeda00640 1 -- 172.21.15.8:0/3950392233 >> v1:172.21.15.8:6789/0 conn(0x7fdee814efa0 legacy=0x7fdee80aa7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:20.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.609+0000 7fdeeda00640 1 -- 172.21.15.8:0/3950392233 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee814f380 con 0x7fdee80715c0 2024-03-23T23:48:20.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.613+0000 7fdeeda00640 1 --2- 172.21.15.8:0/3950392233 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdee80715c0 0x7fdee80c2010 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009e50 tx=0x7fdedc01ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d651fdece8a719d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:20.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.617+0000 7fdee7400640 1 -- 172.21.15.8:0/3950392233 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc0a5700 con 0x7fdee80715c0 2024-03-23T23:48:20.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.617+0000 7fdee7400640 1 -- 172.21.15.8:0/3950392233 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdedc0a58a0 con 0x7fdee80715c0 2024-03-23T23:48:20.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.617+0000 7fdee7400640 1 -- 172.21.15.8:0/3950392233 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc0a5c70 con 0x7fdee80715c0 2024-03-23T23:48:20.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.625+0000 7fdef0400640 1 -- 172.21.15.8:0/3950392233 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdee80715c0 msgr2=0x7fdee80c2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:20.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.625+0000 7fdef0400640 1 --2- 172.21.15.8:0/3950392233 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdee80715c0 0x7fdee80c2010 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009e50 tx=0x7fdedc01ca30 comp rx=0 tx=0).stop 2024-03-23T23:48:20.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.629+0000 7fdef0400640 1 -- 172.21.15.8:0/3950392233 shutdown_connections 2024-03-23T23:48:20.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.629+0000 7fdef0400640 1 --2- 172.21.15.8:0/3950392233 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdee80715c0 0x7fdee80c2010 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:20.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.629+0000 7fdef0400640 1 --2- 172.21.15.8:0/3950392233 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdee80725b0 0x7fdee80c1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:20.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.629+0000 7fdef0400640 1 -- 172.21.15.8:0/3950392233 >> 172.21.15.8:0/3950392233 conn(0x7fdee80c3bd0 msgr2=0x7fdee80c3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:48:20.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.629+0000 7fdef0400640 1 -- 172.21.15.8:0/3950392233 shutdown_connections 2024-03-23T23:48:20.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.633+0000 7fdef0400640 1 -- 172.21.15.8:0/3950392233 wait complete. 2024-03-23T23:48:20.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.637+0000 7fdef0400640 1 Processor -- start 2024-03-23T23:48:20.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.645+0000 7fdef0400640 1 -- start start 2024-03-23T23:48:20.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.649+0000 7fdef0400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdee80715c0 0x7fdee8145d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:20.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.649+0000 7fdef0400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdee814efa0 0x7fdee814cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:20.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.649+0000 7fdef0400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdee814d180 0x7fdee8149e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:20.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.649+0000 7fdef0400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee80aaec0 con 0x7fdee814efa0 2024-03-23T23:48:20.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.649+0000 7fdef0400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee80c2550 con 0x7fdee80715c0 2024-03-23T23:48:20.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.649+0000 7fdef0400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee80ab040 con 0x7fdee814d180 2024-03-23T23:48:20.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.653+0000 7fdeed000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdee80715c0 0x7fdee8145d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:20.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.653+0000 7fdeed000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdee80715c0 0x7fdee8145d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:34836/0 (socket says 172.21.15.8:34836) 2024-03-23T23:48:20.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.653+0000 7fdeed000640 1 -- 172.21.15.8:0/932538895 learned_addr learned my addr 172.21.15.8:0/932538895 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:48:20.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.653+0000 7fdeeda00640 1 --2- 172.21.15.8:0/932538895 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdee814d180 0x7fdee8149e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:20.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.657+0000 7fdee7e00640 1 --2- 172.21.15.8:0/932538895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdee814efa0 0x7fdee814cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:20.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.657+0000 7fdeeda00640 1 -- 172.21.15.8:0/932538895 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdee80715c0 msgr2=0x7fdee8145d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:20.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.657+0000 7fdeeda00640 1 --2- 172.21.15.8:0/932538895 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdee80715c0 0x7fdee8145d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:20.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.657+0000 7fdeeda00640 1 -- 172.21.15.8:0/932538895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdee814efa0 msgr2=0x7fdee814cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:20.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.657+0000 7fdeeda00640 1 --2- 172.21.15.8:0/932538895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdee814efa0 0x7fdee814cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:20.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.657+0000 7fdeeda00640 1 -- 172.21.15.8:0/932538895 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee806ea80 con 0x7fdee814d180 2024-03-23T23:48:20.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.657+0000 7fdee7e00640 1 --2- 172.21.15.8:0/932538895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdee814efa0 0x7fdee814cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:48:20.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.661+0000 7fdeeda00640 1 --2- 172.21.15.8:0/932538895 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdee814d180 0x7fdee8149e80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdee806c270 tx=0x7fdedc0197d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:20.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.669+0000 7fdee5600640 1 -- 172.21.15.8:0/932538895 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc0bc030 con 0x7fdee814d180 2024-03-23T23:48:20.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.669+0000 7fdee5600640 1 -- 172.21.15.8:0/932538895 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdedc0b8470 con 0x7fdee814d180 2024-03-23T23:48:20.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.669+0000 7fdee5600640 1 -- 172.21.15.8:0/932538895 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc009510 con 0x7fdee814d180 2024-03-23T23:48:20.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.673+0000 7fdef0400640 1 -- 172.21.15.8:0/932538895 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdee81ef2b0 con 0x7fdee814d180 2024-03-23T23:48:20.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.673+0000 7fdef0400640 1 -- 172.21.15.8:0/932538895 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdee814b7e0 con 0x7fdee814d180 2024-03-23T23:48:20.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.673+0000 7fdedaa00640 1 -- 172.21.15.8:0/932538895 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdebc0052a0 con 0x7fdee814d180 2024-03-23T23:48:20.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.677+0000 7fdee5600640 1 -- 172.21.15.8:0/932538895 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fdedc0bf070 con 0x7fdee814d180 2024-03-23T23:48:20.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.677+0000 7fdee5600640 1 --2- 172.21.15.8:0/932538895 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdec8067730 0x7fdec8069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:20.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.677+0000 7fdee5600640 1 -- 172.21.15.8:0/932538895 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fdedc120d80 con 0x7fdee814d180 2024-03-23T23:48:20.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.681+0000 7fdeed000640 1 --2- 172.21.15.8:0/932538895 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdec8067730 0x7fdec8069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:20.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.689+0000 7fdee5600640 1 -- 172.21.15.8:0/932538895 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fdedc016620 con 0x7fdee814d180 2024-03-23T23:48:20.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:20.693+0000 7fdeed000640 1 --2- 172.21.15.8:0/932538895 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdec8067730 0x7fdec8069bf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fded4007fd0 tx=0x7fded4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:21.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:21.385+0000 7fdedaa00640 1 -- 172.21.15.8:0/932538895 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fdebc005da0 con 0x7fdee814d180 2024-03-23T23:48:21.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:21.421+0000 7fdee5600640 1 -- 172.21.15.8:0/932538895 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fdedc0f16b0 con 0x7fdee814d180 2024-03-23T23:48:21.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:21.429+0000 7fdedaa00640 1 -- 172.21.15.8:0/932538895 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdec8067730 msgr2=0x7fdec8069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:21.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:21.433+0000 7fdedaa00640 1 --2- 172.21.15.8:0/932538895 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdec8067730 0x7fdec8069bf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fded4007fd0 tx=0x7fded4009040 comp rx=0 tx=0).stop 2024-03-23T23:48:21.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:21.433+0000 7fdedaa00640 1 -- 172.21.15.8:0/932538895 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdee814d180 msgr2=0x7fdee8149e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:21.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:21.433+0000 7fdedaa00640 1 --2- 172.21.15.8:0/932538895 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdee814d180 0x7fdee8149e80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdee806c270 tx=0x7fdedc0197d0 comp rx=0 tx=0).stop 2024-03-23T23:48:21.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:21.433+0000 7fdedaa00640 1 -- 172.21.15.8:0/932538895 shutdown_connections 2024-03-23T23:48:21.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:21.433+0000 7fdedaa00640 1 --2- 172.21.15.8:0/932538895 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdec8067730 0x7fdec8069bf0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:21.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:21.433+0000 7fdedaa00640 1 --2- 172.21.15.8:0/932538895 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdee814d180 0x7fdee8149e80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:21.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:21.433+0000 7fdedaa00640 1 --2- 172.21.15.8:0/932538895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdee814efa0 0x7fdee814cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:21.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:21.433+0000 7fdedaa00640 1 --2- 172.21.15.8:0/932538895 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdee80715c0 0x7fdee8145d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:21.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:21.433+0000 7fdedaa00640 1 -- 172.21.15.8:0/932538895 >> 172.21.15.8:0/932538895 conn(0x7fdee80c3bd0 msgr2=0x7fdee80c19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:48:21.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:21.433+0000 7fdedaa00640 1 -- 172.21.15.8:0/932538895 shutdown_connections 2024-03-23T23:48:21.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:21.433+0000 7fdedaa00640 1 -- 172.21.15.8:0/932538895 wait complete. 2024-03-23T23:48:21.581 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-03-23T23:48:31.582 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T23:48:31.583 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:48:31.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.933+0000 7f3b89000640 1 Processor -- start 2024-03-23T23:48:31.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.937+0000 7f3b89000640 1 -- start start 2024-03-23T23:48:31.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.937+0000 7f3b89000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3b84071ba0 0x7f3b84070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:31.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.937+0000 7f3b89000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3b840c30b0 0x7f3b8414ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:31.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.937+0000 7f3b89000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b840712b0 con 0x7f3b8414f010 2024-03-23T23:48:31.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.937+0000 7f3b89000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b841519e0 con 0x7f3b84071ba0 2024-03-23T23:48:31.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.937+0000 7f3b89000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b84151cc0 con 0x7f3b840c30b0 2024-03-23T23:48:31.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.937+0000 7f3b82a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3b840c30b0 0x7f3b8414ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:31.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.937+0000 7f3b82a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3b840c30b0 0x7f3b8414ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:40964/0 (socket says 172.21.15.8:40964) 2024-03-23T23:48:31.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.937+0000 7f3b82a00640 1 -- 172.21.15.8:0/336135393 learned_addr learned my addr 172.21.15.8:0/336135393 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:48:31.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.941+0000 7f3b82a00640 1 -- 172.21.15.8:0/336135393 >> v2:172.21.15.196:3300/0 conn(0x7f3b84071ba0 msgr2=0x7f3b84070cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:48:31.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.941+0000 7f3b82a00640 1 --2- 172.21.15.8:0/336135393 >> v2:172.21.15.196:3300/0 conn(0x7f3b84071ba0 0x7f3b84070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:31.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.941+0000 7f3b82a00640 1 -- 172.21.15.8:0/336135393 >> v1:172.21.15.8:6789/0 conn(0x7f3b8414f010 legacy=0x7f3b8406ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:31.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.941+0000 7f3b82a00640 1 -- 172.21.15.8:0/336135393 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b840c2d80 con 0x7f3b840c30b0 2024-03-23T23:48:31.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.945+0000 7f3b82a00640 1 --2- 172.21.15.8:0/336135393 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3b840c30b0 0x7f3b8414ead0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c0091e0 tx=0x7f3b7c01d700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a874f89c8d0a6b2 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:31.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.945+0000 7f3b82000640 1 -- 172.21.15.8:0/336135393 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c0a9640 con 0x7f3b840c30b0 2024-03-23T23:48:31.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.945+0000 7f3b82000640 1 -- 172.21.15.8:0/336135393 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7c0a97e0 con 0x7f3b840c30b0 2024-03-23T23:48:31.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.945+0000 7f3b82000640 1 -- 172.21.15.8:0/336135393 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c0a9bb0 con 0x7f3b840c30b0 2024-03-23T23:48:31.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.949+0000 7f3b89000640 1 -- 172.21.15.8:0/336135393 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3b840c30b0 msgr2=0x7f3b8414ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:31.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.949+0000 7f3b89000640 1 --2- 172.21.15.8:0/336135393 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3b840c30b0 0x7f3b8414ead0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c0091e0 tx=0x7f3b7c01d700 comp rx=0 tx=0).stop 2024-03-23T23:48:31.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.949+0000 7f3b89000640 1 -- 172.21.15.8:0/336135393 shutdown_connections 2024-03-23T23:48:31.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.949+0000 7f3b89000640 1 --2- 172.21.15.8:0/336135393 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3b840c30b0 0x7f3b8414ead0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:31.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.949+0000 7f3b89000640 1 --2- 172.21.15.8:0/336135393 >> v2:172.21.15.196:3300/0 conn(0x7f3b84071ba0 0x7f3b84070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:31.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.949+0000 7f3b89000640 1 -- 172.21.15.8:0/336135393 >> 172.21.15.8:0/336135393 conn(0x7f3b840c6b70 msgr2=0x7f3b840c6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:48:31.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.949+0000 7f3b89000640 1 -- 172.21.15.8:0/336135393 shutdown_connections 2024-03-23T23:48:31.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.949+0000 7f3b89000640 1 -- 172.21.15.8:0/336135393 wait complete. 2024-03-23T23:48:31.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.953+0000 7f3b89000640 1 Processor -- start 2024-03-23T23:48:31.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.953+0000 7f3b89000640 1 -- start start 2024-03-23T23:48:31.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.953+0000 7f3b89000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b84071ba0 0x7f3b841f04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:31.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.953+0000 7f3b89000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3b840c30b0 0x7f3b8414bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:31.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.953+0000 7f3b89000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3b8414f010 0x7f3b84148fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:31.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.953+0000 7f3b89000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8415e830 con 0x7f3b84071ba0 2024-03-23T23:48:31.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.953+0000 7f3b89000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b84072190 con 0x7f3b8414f010 2024-03-23T23:48:31.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.953+0000 7f3b89000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8415e9b0 con 0x7f3b840c30b0 2024-03-23T23:48:31.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.953+0000 7f3b83400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b84071ba0 0x7f3b841f04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:31.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.953+0000 7f3b83400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b84071ba0 0x7f3b841f04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43004/0 (socket says 172.21.15.8:43004) 2024-03-23T23:48:31.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.953+0000 7f3b83400640 1 -- 172.21.15.8:0/2423373498 learned_addr learned my addr 172.21.15.8:0/2423373498 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:48:31.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.953+0000 7f3b83e00640 1 --2- 172.21.15.8:0/2423373498 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3b8414f010 0x7f3b84148fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:31.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.953+0000 7f3b83e00640 1 -- 172.21.15.8:0/2423373498 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3b840c30b0 msgr2=0x7f3b8414bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:31.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.953+0000 7f3b83e00640 1 --2- 172.21.15.8:0/2423373498 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3b840c30b0 0x7f3b8414bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:31.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.957+0000 7f3b83e00640 1 -- 172.21.15.8:0/2423373498 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b84071ba0 msgr2=0x7f3b841f04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:31.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.957+0000 7f3b83e00640 1 --2- 172.21.15.8:0/2423373498 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b84071ba0 0x7f3b841f04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:31.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.957+0000 7f3b83e00640 1 -- 172.21.15.8:0/2423373498 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b84149520 con 0x7f3b8414f010 2024-03-23T23:48:31.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.957+0000 7f3b83e00640 1 --2- 172.21.15.8:0/2423373498 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3b8414f010 0x7f3b84148fe0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3b7400c730 tx=0x7f3b7400cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:31.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.957+0000 7f3b7b400640 1 -- 172.21.15.8:0/2423373498 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b74016020 con 0x7f3b8414f010 2024-03-23T23:48:31.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.957+0000 7f3b89000640 1 -- 172.21.15.8:0/2423373498 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b84149aa0 con 0x7f3b8414f010 2024-03-23T23:48:31.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.957+0000 7f3b7b400640 1 -- 172.21.15.8:0/2423373498 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b74006d60 con 0x7f3b8414f010 2024-03-23T23:48:31.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.957+0000 7f3b89000640 1 -- 172.21.15.8:0/2423373498 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b841ef9e0 con 0x7f3b8414f010 2024-03-23T23:48:31.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.957+0000 7f3b7b400640 1 -- 172.21.15.8:0/2423373498 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b74016020 con 0x7f3b8414f010 2024-03-23T23:48:31.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.965+0000 7f3b89000640 1 -- 172.21.15.8:0/2423373498 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b84075800 con 0x7f3b8414f010 2024-03-23T23:48:31.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.969+0000 7f3b7b400640 1 -- 172.21.15.8:0/2423373498 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3b74003980 con 0x7f3b8414f010 2024-03-23T23:48:31.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.973+0000 7f3b7b400640 1 --2- 172.21.15.8:0/2423373498 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3b60067860 0x7f3b60069d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:31.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.973+0000 7f3b7b400640 1 -- 172.21.15.8:0/2423373498 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f3b740854a0 con 0x7f3b8414f010 2024-03-23T23:48:31.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.977+0000 7f3b83400640 1 --2- 172.21.15.8:0/2423373498 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3b60067860 0x7f3b60069d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:31.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.989+0000 7f3b83400640 1 --2- 172.21.15.8:0/2423373498 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3b60067860 0x7f3b60069d20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c0099b0 tx=0x7f3b6c009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:31.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:31.993+0000 7f3b7b400640 1 -- 172.21.15.8:0/2423373498 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f3b74020020 con 0x7f3b8414f010 2024-03-23T23:48:32.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:32.973+0000 7f3b89000640 1 -- 172.21.15.8:0/2423373498 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f3b8406c180 con 0x7f3b8414f010 2024-03-23T23:48:32.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:32.973+0000 7f3b7b400640 1 -- 172.21.15.8:0/2423373498 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1561 (secure 0 0 0) 0x7f3b74003c70 con 0x7f3b8414f010 2024-03-23T23:48:32.975 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":42,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:48:32.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:32.981+0000 7f3b89000640 1 -- 172.21.15.8:0/2423373498 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3b60067860 msgr2=0x7f3b60069d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:32.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:32.981+0000 7f3b89000640 1 --2- 172.21.15.8:0/2423373498 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3b60067860 0x7f3b60069d20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c0099b0 tx=0x7f3b6c009190 comp rx=0 tx=0).stop 2024-03-23T23:48:32.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:32.981+0000 7f3b89000640 1 -- 172.21.15.8:0/2423373498 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3b8414f010 msgr2=0x7f3b84148fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:32.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:32.981+0000 7f3b89000640 1 --2- 172.21.15.8:0/2423373498 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3b8414f010 0x7f3b84148fe0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3b7400c730 tx=0x7f3b7400cbf0 comp rx=0 tx=0).stop 2024-03-23T23:48:32.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:32.981+0000 7f3b89000640 1 -- 172.21.15.8:0/2423373498 shutdown_connections 2024-03-23T23:48:32.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:32.981+0000 7f3b89000640 1 --2- 172.21.15.8:0/2423373498 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3b8414f010 0x7f3b84148fe0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:32.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:32.981+0000 7f3b89000640 1 --2- 172.21.15.8:0/2423373498 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3b60067860 0x7f3b60069d20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:32.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:32.981+0000 7f3b89000640 1 --2- 172.21.15.8:0/2423373498 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3b840c30b0 0x7f3b8414bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:32.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:32.981+0000 7f3b89000640 1 --2- 172.21.15.8:0/2423373498 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b84071ba0 0x7f3b841f04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:32.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:32.981+0000 7f3b89000640 1 -- 172.21.15.8:0/2423373498 >> 172.21.15.8:0/2423373498 conn(0x7f3b840c6b70 msgr2=0x7f3b8415b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:48:32.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:32.985+0000 7f3b89000640 1 -- 172.21.15.8:0/2423373498 shutdown_connections 2024-03-23T23:48:32.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:32.985+0000 7f3b89000640 1 -- 172.21.15.8:0/2423373498 wait complete. 2024-03-23T23:48:33.043 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T23:48:33.043 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-03-23T23:48:33.043 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T23:48:33.044 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:48:33.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.393+0000 7fd8bfe00640 1 Processor -- start 2024-03-23T23:48:33.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.393+0000 7fd8bfe00640 1 -- start start 2024-03-23T23:48:33.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.397+0000 7fd8bfe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd8c014ef10 0x7fd8c00c1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:33.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.401+0000 7fd8bfe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8c0072ff0 0x7fd8c0151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:33.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.401+0000 7fd8bfe00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c006e1d0 con 0x7fd8c006dcb0 2024-03-23T23:48:33.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.401+0000 7fd8bfe00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c006d940 con 0x7fd8c014ef10 2024-03-23T23:48:33.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.401+0000 7fd8bfe00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c0152510 con 0x7fd8c0072ff0 2024-03-23T23:48:33.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.409+0000 7fd8bea00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd8c014ef10 0x7fd8c00c1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:33.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.409+0000 7fd8bea00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd8c014ef10 0x7fd8c00c1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54718/0 (socket says 172.21.15.8:54718) 2024-03-23T23:48:33.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.409+0000 7fd8bea00640 1 -- 172.21.15.8:0/1101781828 learned_addr learned my addr 172.21.15.8:0/1101781828 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:48:33.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.409+0000 7fd8bf400640 1 --2- 172.21.15.8:0/1101781828 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8c0072ff0 0x7fd8c0151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:33.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.413+0000 7fd8bea00640 1 -- 172.21.15.8:0/1101781828 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8c0072ff0 msgr2=0x7fd8c0151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:48:33.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.413+0000 7fd8bea00640 1 --2- 172.21.15.8:0/1101781828 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8c0072ff0 0x7fd8c0151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:33.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.413+0000 7fd8bea00640 1 -- 172.21.15.8:0/1101781828 >> v1:172.21.15.196:6789/0 conn(0x7fd8c006dcb0 legacy=0x7fd8c01517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:33.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.413+0000 7fd8bea00640 1 -- 172.21.15.8:0/1101781828 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c006d180 con 0x7fd8c014ef10 2024-03-23T23:48:33.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.421+0000 7fd8bea00640 1 --2- 172.21.15.8:0/1101781828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8c014ef10 0x7fd8c00c1ad0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009bd0 tx=0x7fd8b801ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57450c568f47349e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:33.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.421+0000 7fd8bd600640 1 -- 172.21.15.8:0/1101781828 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b80a7b70 con 0x7fd8c014ef10 2024-03-23T23:48:33.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.421+0000 7fd8bd600640 1 -- 172.21.15.8:0/1101781828 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b80a7d10 con 0x7fd8c014ef10 2024-03-23T23:48:33.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.421+0000 7fd8bd600640 1 -- 172.21.15.8:0/1101781828 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b80a7b70 con 0x7fd8c014ef10 2024-03-23T23:48:33.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.425+0000 7fd8bfe00640 1 -- 172.21.15.8:0/1101781828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8c014ef10 msgr2=0x7fd8c00c1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:33.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.429+0000 7fd8bfe00640 1 --2- 172.21.15.8:0/1101781828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8c014ef10 0x7fd8c00c1ad0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009bd0 tx=0x7fd8b801ee70 comp rx=0 tx=0).stop 2024-03-23T23:48:33.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.437+0000 7fd8bfe00640 1 -- 172.21.15.8:0/1101781828 shutdown_connections 2024-03-23T23:48:33.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.437+0000 7fd8bfe00640 1 --2- 172.21.15.8:0/1101781828 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8c0072ff0 0x7fd8c0151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:33.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.437+0000 7fd8bfe00640 1 --2- 172.21.15.8:0/1101781828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8c014ef10 0x7fd8c00c1ad0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:33.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.437+0000 7fd8bfe00640 1 -- 172.21.15.8:0/1101781828 >> 172.21.15.8:0/1101781828 conn(0x7fd8c006b170 msgr2=0x7fd8c006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:48:33.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.449+0000 7fd8bfe00640 1 -- 172.21.15.8:0/1101781828 shutdown_connections 2024-03-23T23:48:33.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.453+0000 7fd8bfe00640 1 -- 172.21.15.8:0/1101781828 wait complete. 2024-03-23T23:48:33.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.453+0000 7fd8bfe00640 1 Processor -- start 2024-03-23T23:48:33.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.469+0000 7fd8bfe00640 1 -- start start 2024-03-23T23:48:33.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.477+0000 7fd8bfe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8c006dcb0 0x7fd8c014d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:33.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.477+0000 7fd8bfe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8c0072ff0 0x7fd8c0147bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:33.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.477+0000 7fd8bfe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8c014ef10 0x7fd8c01480f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:33.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.477+0000 7fd8bfe00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c015ec40 con 0x7fd8c0072ff0 2024-03-23T23:48:33.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.477+0000 7fd8bfe00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c015eac0 con 0x7fd8c014ef10 2024-03-23T23:48:33.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.477+0000 7fd8bfe00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c015edc0 con 0x7fd8c006dcb0 2024-03-23T23:48:33.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.481+0000 7fd8bf400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8c014ef10 0x7fd8c01480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:33.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.481+0000 7fd8bf400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8c014ef10 0x7fd8c01480f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:56888/0 (socket says 172.21.15.8:56888) 2024-03-23T23:48:33.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.481+0000 7fd8bf400640 1 -- 172.21.15.8:0/3389844742 learned_addr learned my addr 172.21.15.8:0/3389844742 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:48:33.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.481+0000 7fd8bf400640 1 -- 172.21.15.8:0/3389844742 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8c006dcb0 msgr2=0x7fd8c014d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:33.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.481+0000 7fd8bf400640 1 --2- 172.21.15.8:0/3389844742 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8c006dcb0 0x7fd8c014d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:33.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.481+0000 7fd8bf400640 1 -- 172.21.15.8:0/3389844742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8c0072ff0 msgr2=0x7fd8c0147bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:33.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.481+0000 7fd8bf400640 1 --2- 172.21.15.8:0/3389844742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8c0072ff0 0x7fd8c0147bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:33.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.481+0000 7fd8bf400640 1 -- 172.21.15.8:0/3389844742 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c00728b0 con 0x7fd8c014ef10 2024-03-23T23:48:33.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.485+0000 7fd8bf400640 1 --2- 172.21.15.8:0/3389844742 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8c014ef10 0x7fd8c01480f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd8b000d830 tx=0x7fd8b000dcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:33.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.485+0000 7fd8b6a00640 1 -- 172.21.15.8:0/3389844742 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b000b6c0 con 0x7fd8c014ef10 2024-03-23T23:48:33.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.485+0000 7fd8b6a00640 1 -- 172.21.15.8:0/3389844742 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b0019070 con 0x7fd8c014ef10 2024-03-23T23:48:33.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.485+0000 7fd8b6a00640 1 -- 172.21.15.8:0/3389844742 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b000bac0 con 0x7fd8c014ef10 2024-03-23T23:48:33.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.485+0000 7fd8bfe00640 1 -- 172.21.15.8:0/3389844742 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c00c2d00 con 0x7fd8c014ef10 2024-03-23T23:48:33.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.485+0000 7fd8bfe00640 1 -- 172.21.15.8:0/3389844742 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c01eafa0 con 0x7fd8c014ef10 2024-03-23T23:48:33.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.489+0000 7fd8bfe00640 1 --2- 172.21.15.8:0/3389844742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8c015aca0 0x7fd8c01eb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:33.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.489+0000 7fd8bfe00640 1 -- 172.21.15.8:0/3389844742 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c004f410 con 0x7fd8c015aca0 2024-03-23T23:48:33.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.493+0000 7fd8bea00640 1 --2- 172.21.15.8:0/3389844742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8c015aca0 0x7fd8c01eb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:33.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.493+0000 7fd8bea00640 1 -- 172.21.15.8:0/3389844742 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd8c0071aa0 con 0x7fd8c015aca0 2024-03-23T23:48:33.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.493+0000 7fd8bea00640 1 --2- 172.21.15.8:0/3389844742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8c015aca0 0x7fd8c01eb280 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd8c006cb80 tx=0x7fd8b800edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:33.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.493+0000 7fd8b6a00640 1 -- 172.21.15.8:0/3389844742 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b80bb070 con 0x7fd8c015aca0 2024-03-23T23:48:33.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.497+0000 7fd8b6a00640 1 -- 172.21.15.8:0/3389844742 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fd8b8009510 con 0x7fd8c015aca0 2024-03-23T23:48:33.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.497+0000 7fd8b6a00640 1 -- 172.21.15.8:0/3389844742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8c015aca0 msgr2=0x7fd8c01eb280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:33.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.497+0000 7fd8b6a00640 1 --2- 172.21.15.8:0/3389844742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8c015aca0 0x7fd8c01eb280 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd8c006cb80 tx=0x7fd8b800edb0 comp rx=0 tx=0).stop 2024-03-23T23:48:33.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.497+0000 7fd8b6a00640 1 -- 172.21.15.8:0/3389844742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8c015aca0 msgr2=0x7fd8c01eb280 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:48:33.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.497+0000 7fd8b6a00640 1 --2- 172.21.15.8:0/3389844742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8c015aca0 0x7fd8c01eb280 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd8c006cb80 tx=0x7fd8b800edb0 comp rx=0 tx=0).stop 2024-03-23T23:48:33.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.505+0000 7fd8b6a00640 1 -- 172.21.15.8:0/3389844742 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd8b000bc60 con 0x7fd8c014ef10 2024-03-23T23:48:33.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.505+0000 7fd8b6a00640 1 --2- 172.21.15.8:0/3389844742 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd8a00671c0 0x7fd8a0069680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:33.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.505+0000 7fd8b6a00640 1 -- 172.21.15.8:0/3389844742 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fd8b0086060 con 0x7fd8c014ef10 2024-03-23T23:48:33.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.509+0000 7fd8bea00640 1 --2- 172.21.15.8:0/3389844742 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd8a00671c0 0x7fd8a0069680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:33.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.529+0000 7fd8bea00640 1 --2- 172.21.15.8:0/3389844742 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd8a00671c0 0x7fd8a0069680 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd8c015b080 tx=0x7fd8b8008000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:33.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.565+0000 7fd8bfe00640 1 --2- 172.21.15.8:0/3389844742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8c0148890 0x7fd8c00ab3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:33.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.565+0000 7fd8be000640 1 --2- 172.21.15.8:0/3389844742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8c0148890 0x7fd8c00ab3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:33.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.565+0000 7fd8bfe00640 1 -- 172.21.15.8:0/3389844742 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c006cf60 con 0x7fd8c0148890 2024-03-23T23:48:33.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.573+0000 7fd8be000640 1 -- 172.21.15.8:0/3389844742 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd8c0148630 con 0x7fd8c0148890 2024-03-23T23:48:33.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.577+0000 7fd8be000640 1 --2- 172.21.15.8:0/3389844742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8c0148890 0x7fd8c00ab3b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0156520 tx=0x7fd8ac00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:33.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.577+0000 7fd8b6a00640 1 -- 172.21.15.8:0/3389844742 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac005270 con 0x7fd8c0148890 2024-03-23T23:48:33.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.577+0000 7fd8b6a00640 1 -- 172.21.15.8:0/3389844742 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4872 (secure 0 0 0) 0x7fd8ac00ce50 con 0x7fd8c0148890 2024-03-23T23:48:33.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.577+0000 7fd8b6a00640 1 -- 172.21.15.8:0/3389844742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8c0148890 msgr2=0x7fd8c00ab3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:33.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.577+0000 7fd8b6a00640 1 --2- 172.21.15.8:0/3389844742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8c0148890 0x7fd8c00ab3b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0156520 tx=0x7fd8ac00cb10 comp rx=0 tx=0).stop 2024-03-23T23:48:33.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.577+0000 7fd8b6a00640 1 -- 172.21.15.8:0/3389844742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8c0148890 msgr2=0x7fd8c00ab3b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:48:33.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.577+0000 7fd8b6a00640 1 --2- 172.21.15.8:0/3389844742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8c0148890 0x7fd8c00ab3b0 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0156520 tx=0x7fd8ac00cb10 comp rx=0 tx=0).stop 2024-03-23T23:48:33.580 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:48:33.580 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:48:33.580 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:48:33.580 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:48:33.580 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 42, 2024-03-23T23:48:33.580 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:48:33.580 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:48:33.580 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:48:33.581 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:48:33.581 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:33.581 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 15, 2024-03-23T23:48:33.581 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:48:33.581 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:48:33.581 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:48:33.581 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:48:33.581 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:48:33.581 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:48:33.581 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:48:33.582 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:48:33.582 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:48:33.582 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:48:33.582 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:48:33.582 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:48:33.582 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:48:33.582 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:48:33.582 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:33.582 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:48:33.582 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:48:33.582 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:48:33.582 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:48:33.582 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:48:33.583 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:48:33.583 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:48:33.583 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:48:33.583 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:48:33.583 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:48:33.583 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:48:33.583 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:48:33.583 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:48:33.583 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:33.583 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:33.583 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:48:33.583 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:48:33.583 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:48:33.584 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:48:33.584 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:48:33.584 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:48:33.584 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:48:33.584 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:48:33.584 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:48:33.584 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:48:33.584 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:48:33.584 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:48:33.584 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:48:33.584 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:48:33.584 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:48:33.584 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:48:33.584 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:48:33.585 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:48:33.585 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:48:33.585 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:48:33.585 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:48:33.585 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:48:33.585 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:48:33.585 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:48:33.585 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:48:33.585 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:48:33.585 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:48:33.585 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:48:33.585 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:33.585 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:48:33.585 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:33.586 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:48:33.586 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:33.586 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:48:33.586 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:48:33.586 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:48:33.586 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:48:33.586 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:33.586 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:48:33.586 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:48:33.586 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:33.586 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:33.586 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:33.586 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:48:33.587 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:48:33.587 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:33.587 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:33.587 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:33.587 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:33.587 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:48:33.587 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:48:33.587 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:48:33.587 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:48:33.587 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:48:33.587 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:33.587 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:33.587 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:48:33.587 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:48:33.588 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:48:33.588 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:48:33.588 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:33.588 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:48:33.588 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:48:33.588 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:33.588 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:33.588 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:33.588 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:48:33.588 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:48:33.588 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:33.588 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:33.588 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:33.588 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:33.589 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:48:33.589 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:48:33.589 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:48:33.589 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:48:33.589 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:48:33.589 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:33.589 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:33.589 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:48:33.589 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:48:33.589 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:48:33.589 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:48:33.589 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:33.589 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:48:33.589 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:48:33.590 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:33.590 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:33.590 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:33.590 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:48:33.590 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:48:33.590 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:33.590 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:33.590 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:33.590 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:33.590 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:48:33.590 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:48:33.590 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:48:33.590 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:48:33.590 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:48:33.591 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:33.591 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:33.591 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:33.591 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:48:33.591 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:48:33.591 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:33.591 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:48:33.591 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:33.591 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:48:33.591 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:33.591 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:33.591 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:48:33.591 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:33.592 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:48:33.592 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:33.592 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:48:33.592 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:33.592 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:33.592 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:48:33.592 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:33.592 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:48:33.592 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:33.592 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:48:33.592 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:33.592 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:33.592 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:48:33.592 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:33.593 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:48:33.593 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:33.593 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:48:33.593 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:33.593 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:33.593 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:33.593 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:48:33.593 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:48:33.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.577+0000 7fd8bfe00640 1 -- 172.21.15.8:0/3389844742 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd8a00671c0 msgr2=0x7fd8a0069680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:33.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.577+0000 7fd8bfe00640 1 --2- 172.21.15.8:0/3389844742 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd8a00671c0 0x7fd8a0069680 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd8c015b080 tx=0x7fd8b8008000 comp rx=0 tx=0).stop 2024-03-23T23:48:33.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.577+0000 7fd8bfe00640 1 -- 172.21.15.8:0/3389844742 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8c014ef10 msgr2=0x7fd8c01480f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:33.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.577+0000 7fd8bfe00640 1 --2- 172.21.15.8:0/3389844742 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8c014ef10 0x7fd8c01480f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd8b000d830 tx=0x7fd8b000dcf0 comp rx=0 tx=0).stop 2024-03-23T23:48:33.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.581+0000 7fd8bf400640 1 -- 172.21.15.8:0/3389844742 reap_dead start 2024-03-23T23:48:33.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.581+0000 7fd8bf400640 1 -- 172.21.15.8:0/3389844742 reap_dead start 2024-03-23T23:48:33.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.581+0000 7fd8bfe00640 1 -- 172.21.15.8:0/3389844742 shutdown_connections 2024-03-23T23:48:33.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.581+0000 7fd8bfe00640 1 -- 172.21.15.8:0/3389844742 >> 172.21.15.8:0/3389844742 conn(0x7fd8c006b170 msgr2=0x7fd8c014aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:48:33.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.581+0000 7fd8bfe00640 1 -- 172.21.15.8:0/3389844742 shutdown_connections 2024-03-23T23:48:33.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.581+0000 7fd8bfe00640 1 -- 172.21.15.8:0/3389844742 wait complete. 2024-03-23T23:48:33.659 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:48:33.659 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T23:48:33.659 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:48:34.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:33.997+0000 7f03a0200640 1 Processor -- start 2024-03-23T23:48:34.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.001+0000 7f03a0200640 1 -- start start 2024-03-23T23:48:34.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.001+0000 7f03a0200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f03980c3f60 0x7f0398071a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:34.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.001+0000 7f03a0200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f03980c2380 0x7f0398156c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:34.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.001+0000 7f03a0200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f039815acc0 con 0x7f03980c3600 2024-03-23T23:48:34.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.001+0000 7f03a0200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f039815a830 con 0x7f03980c2380 2024-03-23T23:48:34.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.001+0000 7f03a0200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0398159f00 con 0x7f03980c3f60 2024-03-23T23:48:34.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.001+0000 7f039d800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f03980c3f60 0x7f0398071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:34.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.001+0000 7f039ce00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f03980c3600 0x7f03980c1c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:50628/0 (socket says 172.21.15.8:50628) 2024-03-23T23:48:34.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.001+0000 7f039ce00640 1 -- 172.21.15.8:0/2510618551 learned_addr learned my addr 172.21.15.8:0/2510618551 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:48:34.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.005+0000 7f039e200640 1 --2- 172.21.15.8:0/2510618551 >> v2:172.21.15.8:3300/0 conn(0x7f03980c2380 0x7f0398156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:34.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.005+0000 7f039e200640 1 -- 172.21.15.8:0/2510618551 >> v2:172.21.15.196:3300/0 conn(0x7f03980c3f60 msgr2=0x7f0398071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:48:34.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.005+0000 7f039e200640 1 --2- 172.21.15.8:0/2510618551 >> v2:172.21.15.196:3300/0 conn(0x7f03980c3f60 0x7f0398071a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:34.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.005+0000 7f039e200640 1 -- 172.21.15.8:0/2510618551 >> v1:172.21.15.196:6789/0 conn(0x7f03980c3600 legacy=0x7f03980c1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:34.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.005+0000 7f039e200640 1 -- 172.21.15.8:0/2510618551 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039815a1e0 con 0x7f03980c2380 2024-03-23T23:48:34.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.017+0000 7f039e200640 1 --2- 172.21.15.8:0/2510618551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03980c2380 0x7f0398156c30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f03980c8280 tx=0x7f039001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8cbdc189c91e982 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:34.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.017+0000 7f0397e00640 1 -- 172.21.15.8:0/2510618551 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03900ad070 con 0x7f03980c2380 2024-03-23T23:48:34.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.017+0000 7f0397e00640 1 -- 172.21.15.8:0/2510618551 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03900a9650 con 0x7f03980c2380 2024-03-23T23:48:34.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.017+0000 7f0397e00640 1 -- 172.21.15.8:0/2510618551 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03900a9a20 con 0x7f03980c2380 2024-03-23T23:48:34.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.017+0000 7f03a0200640 1 -- 172.21.15.8:0/2510618551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03980c2380 msgr2=0x7f0398156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:34.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.017+0000 7f03a0200640 1 --2- 172.21.15.8:0/2510618551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03980c2380 0x7f0398156c30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f03980c8280 tx=0x7f039001c8c0 comp rx=0 tx=0).stop 2024-03-23T23:48:34.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.021+0000 7f03a0200640 1 -- 172.21.15.8:0/2510618551 shutdown_connections 2024-03-23T23:48:34.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.021+0000 7f03a0200640 1 --2- 172.21.15.8:0/2510618551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03980c2380 0x7f0398156c30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:34.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.021+0000 7f03a0200640 1 --2- 172.21.15.8:0/2510618551 >> v2:172.21.15.196:3300/0 conn(0x7f03980c3f60 0x7f0398071a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:34.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.021+0000 7f03a0200640 1 -- 172.21.15.8:0/2510618551 >> 172.21.15.8:0/2510618551 conn(0x7f039806b170 msgr2=0x7f039806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:48:34.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.021+0000 7f03a0200640 1 -- 172.21.15.8:0/2510618551 shutdown_connections 2024-03-23T23:48:34.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.021+0000 7f03a0200640 1 -- 172.21.15.8:0/2510618551 wait complete. 2024-03-23T23:48:34.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.025+0000 7f03a0200640 1 Processor -- start 2024-03-23T23:48:34.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.025+0000 7f03a0200640 1 -- start start 2024-03-23T23:48:34.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.025+0000 7f03a0200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f03980c2380 0x7f03981526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:34.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.025+0000 7f03a0200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03980c3600 0x7f03981518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:34.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.025+0000 7f03a0200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03980c3f60 0x7f039813ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:34.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.025+0000 7f03a0200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03980c44c0 con 0x7f03980c3f60 2024-03-23T23:48:34.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.025+0000 7f03a0200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03980c4340 con 0x7f03980c2380 2024-03-23T23:48:34.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.025+0000 7f03a0200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0398164ea0 con 0x7f03980c3600 2024-03-23T23:48:34.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.025+0000 7f039e200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03980c3f60 0x7f039813ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:34.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.025+0000 7f039ce00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03980c3600 0x7f03981518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:34.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.025+0000 7f039e200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03980c3f60 0x7f039813ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54754/0 (socket says 172.21.15.8:54754) 2024-03-23T23:48:34.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.025+0000 7f039e200640 1 -- 172.21.15.8:0/1772799113 learned_addr learned my addr 172.21.15.8:0/1772799113 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:48:34.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.025+0000 7f039e200640 1 -- 172.21.15.8:0/1772799113 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03980c3600 msgr2=0x7f03981518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:34.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.025+0000 7f039e200640 1 --2- 172.21.15.8:0/1772799113 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03980c3600 0x7f03981518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:34.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.025+0000 7f039e200640 1 -- 172.21.15.8:0/1772799113 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f03980c2380 msgr2=0x7f03981526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:34.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.025+0000 7f039e200640 1 --2- 172.21.15.8:0/1772799113 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f03980c2380 0x7f03981526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:34.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.025+0000 7f039e200640 1 -- 172.21.15.8:0/1772799113 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03980aa530 con 0x7f03980c3f60 2024-03-23T23:48:34.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.029+0000 7f039e200640 1 --2- 172.21.15.8:0/1772799113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03980c3f60 0x7f039813ea10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f039001cda0 tx=0x7f0390019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:34.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.029+0000 7f0395600640 1 -- 172.21.15.8:0/1772799113 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03900ad040 con 0x7f03980c3f60 2024-03-23T23:48:34.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.029+0000 7f0395600640 1 -- 172.21.15.8:0/1772799113 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03900b2860 con 0x7f03980c3f60 2024-03-23T23:48:34.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.029+0000 7f0395600640 1 -- 172.21.15.8:0/1772799113 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03900b2c10 con 0x7f03980c3f60 2024-03-23T23:48:34.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.029+0000 7f03a0200640 1 -- 172.21.15.8:0/1772799113 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03980aa810 con 0x7f03980c3f60 2024-03-23T23:48:34.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.029+0000 7f03a0200640 1 -- 172.21.15.8:0/1772799113 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03980c6d90 con 0x7f03980c3f60 2024-03-23T23:48:34.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.029+0000 7f03a0200640 1 --2- 172.21.15.8:0/1772799113 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f03980accd0 0x7f039813ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:34.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.029+0000 7f03a0200640 1 -- 172.21.15.8:0/1772799113 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0398068270 con 0x7f03980accd0 2024-03-23T23:48:34.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.029+0000 7f039d800640 1 --2- 172.21.15.8:0/1772799113 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f03980accd0 0x7f039813ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:34.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.029+0000 7f039d800640 1 -- 172.21.15.8:0/1772799113 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f03980c1fc0 con 0x7f03980accd0 2024-03-23T23:48:34.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.033+0000 7f039d800640 1 --2- 172.21.15.8:0/1772799113 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f03980accd0 0x7f039813ef50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0398071ac0 tx=0x7f038c00d960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:34.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.033+0000 7f0395600640 1 -- 172.21.15.8:0/1772799113 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c0125f0 con 0x7f03980accd0 2024-03-23T23:48:34.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.033+0000 7f0395600640 1 -- 172.21.15.8:0/1772799113 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f03900b0070 con 0x7f03980c3f60 2024-03-23T23:48:34.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.033+0000 7f0395600640 1 --2- 172.21.15.8:0/1772799113 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f03780675b0 0x7f0378069a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:34.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.037+0000 7f0395600640 1 -- 172.21.15.8:0/1772799113 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f0390120b50 con 0x7f03980c3f60 2024-03-23T23:48:34.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.037+0000 7f039ce00640 1 --2- 172.21.15.8:0/1772799113 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f03780675b0 0x7f0378069a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:34.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.037+0000 7f0395600640 1 -- 172.21.15.8:0/1772799113 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f038c019070 con 0x7f03980accd0 2024-03-23T23:48:34.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.037+0000 7f0395600640 1 -- 172.21.15.8:0/1772799113 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f03980accd0 msgr2=0x7f039813ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:34.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.037+0000 7f0395600640 1 --2- 172.21.15.8:0/1772799113 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f03980accd0 0x7f039813ef50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0398071ac0 tx=0x7f038c00d960 comp rx=0 tx=0).stop 2024-03-23T23:48:34.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.037+0000 7f0395600640 1 -- 172.21.15.8:0/1772799113 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f03980accd0 msgr2=0x7f039813ef50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:48:34.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.037+0000 7f0395600640 1 --2- 172.21.15.8:0/1772799113 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f03980accd0 0x7f039813ef50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:34.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.037+0000 7f039ce00640 1 --2- 172.21.15.8:0/1772799113 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f03780675b0 0x7f0378069a70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0398164360 tx=0x7f0384009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:34.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.049+0000 7f03a0200640 1 --2- 172.21.15.8:0/1772799113 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0398151de0 0x7f039813f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:34.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.049+0000 7f03a0200640 1 -- 172.21.15.8:0/1772799113 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03980c1ce0 con 0x7f0398151de0 2024-03-23T23:48:34.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.049+0000 7f039d800640 1 --2- 172.21.15.8:0/1772799113 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0398151de0 0x7f039813f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:34.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.053+0000 7f039d800640 1 -- 172.21.15.8:0/1772799113 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0398072570 con 0x7f0398151de0 2024-03-23T23:48:34.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.053+0000 7f039d800640 1 --2- 172.21.15.8:0/1772799113 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0398151de0 0x7f039813f490 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f038c018000 tx=0x7f038c0046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:34.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.053+0000 7f0395600640 1 -- 172.21.15.8:0/1772799113 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c012c60 con 0x7f0398151de0 2024-03-23T23:48:34.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.057+0000 7f0395600640 1 -- 172.21.15.8:0/1772799113 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5183 (secure 0 0 0) 0x7f038c012e00 con 0x7f0398151de0 2024-03-23T23:48:34.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.057+0000 7f0395600640 1 -- 172.21.15.8:0/1772799113 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0398151de0 msgr2=0x7f039813f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:34.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.057+0000 7f0395600640 1 --2- 172.21.15.8:0/1772799113 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0398151de0 0x7f039813f490 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f038c018000 tx=0x7f038c0046d0 comp rx=0 tx=0).stop 2024-03-23T23:48:34.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.057+0000 7f0395600640 1 -- 172.21.15.8:0/1772799113 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0398151de0 msgr2=0x7f039813f490 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:48:34.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.057+0000 7f0395600640 1 --2- 172.21.15.8:0/1772799113 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0398151de0 0x7f039813f490 secure :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f038c018000 tx=0x7f038c0046d0 comp rx=0 tx=0).stop 2024-03-23T23:48:34.061 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:48:34.061 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:48:34.061 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:48:34.061 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:48:34.061 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 42, 2024-03-23T23:48:34.061 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:48:34.061 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:48:34.061 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:48:34.061 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:48:34.061 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:34.062 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 15, 2024-03-23T23:48:34.062 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:48:34.062 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:48:34.062 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:48:34.062 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:48:34.062 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:48:34.062 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:48:34.062 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:48:34.062 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:48:34.062 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:48:34.062 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:48:34.062 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:48:34.062 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:48:34.063 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:48:34.063 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:48:34.063 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:34.063 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:48:34.063 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:48:34.063 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:48:34.063 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:48:34.063 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:48:34.063 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:48:34.063 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:48:34.063 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:48:34.063 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:48:34.063 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:48:34.064 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:48:34.064 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:48:34.064 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:48:34.064 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:34.064 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:34.064 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:48:34.064 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:48:34.064 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:48:34.064 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:48:34.064 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:48:34.064 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:48:34.064 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:48:34.065 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:48:34.065 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:48:34.065 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:48:34.065 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:48:34.065 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:48:34.065 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:48:34.065 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:48:34.065 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:48:34.065 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:48:34.065 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:48:34.066 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:48:34.066 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:48:34.066 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:48:34.066 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:48:34.066 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:48:34.066 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:48:34.066 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:48:34.066 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:48:34.066 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:48:34.066 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:48:34.066 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:48:34.066 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:34.066 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:48:34.066 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:34.067 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:48:34.067 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:34.067 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:48:34.067 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:48:34.067 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:48:34.067 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:48:34.067 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:34.067 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:48:34.067 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:48:34.067 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:34.067 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:34.067 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:34.067 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:48:34.068 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:48:34.068 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:34.068 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:34.068 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:34.068 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:34.068 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:48:34.068 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:48:34.068 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:48:34.068 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:48:34.068 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:48:34.068 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:34.068 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:34.068 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:48:34.068 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:48:34.069 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:48:34.069 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:48:34.069 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:34.069 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:48:34.069 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:48:34.069 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:34.069 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:34.069 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:34.069 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:48:34.069 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:48:34.069 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:34.069 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:34.070 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:34.070 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:34.070 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:48:34.070 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:48:34.070 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:48:34.070 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:48:34.070 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:48:34.070 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:34.070 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:34.070 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:48:34.070 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:48:34.070 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:48:34.070 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:48:34.071 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:34.071 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:48:34.071 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:48:34.071 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:34.071 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:34.071 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:34.071 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:48:34.071 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:48:34.071 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:34.071 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:34.071 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:34.071 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:34.071 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:48:34.072 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:48:34.072 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:48:34.072 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:48:34.072 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:48:34.072 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:34.072 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:34.072 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:34.072 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:48:34.072 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:48:34.072 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:34.072 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:48:34.072 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:34.072 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:48:34.072 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:34.073 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:34.073 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:48:34.073 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:34.073 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:48:34.073 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:34.073 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:48:34.073 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:34.073 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:34.073 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:48:34.073 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:34.073 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:48:34.073 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:34.073 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:48:34.073 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:34.074 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:34.074 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:48:34.074 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:34.074 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:48:34.074 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:34.074 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:48:34.074 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:34.074 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:34.074 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:48:34.074 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:34.074 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:48:34.074 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:34.074 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:34.075 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:48:34.075 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:34.075 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:48:34.075 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:34.075 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:48:34.075 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:34.075 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:34.075 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:34.075 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:48:34.075 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:48:34.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.061+0000 7f03a0200640 1 -- 172.21.15.8:0/1772799113 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f03780675b0 msgr2=0x7f0378069a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:34.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.061+0000 7f03a0200640 1 --2- 172.21.15.8:0/1772799113 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f03780675b0 0x7f0378069a70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0398164360 tx=0x7f0384009040 comp rx=0 tx=0).stop 2024-03-23T23:48:34.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.061+0000 7f03a0200640 1 -- 172.21.15.8:0/1772799113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03980c3f60 msgr2=0x7f039813ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:34.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.061+0000 7f03a0200640 1 --2- 172.21.15.8:0/1772799113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03980c3f60 0x7f039813ea10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f039001cda0 tx=0x7f0390019660 comp rx=0 tx=0).stop 2024-03-23T23:48:34.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.061+0000 7f039e200640 1 -- 172.21.15.8:0/1772799113 reap_dead start 2024-03-23T23:48:34.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.061+0000 7f039e200640 1 -- 172.21.15.8:0/1772799113 reap_dead start 2024-03-23T23:48:34.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.061+0000 7f03a0200640 1 -- 172.21.15.8:0/1772799113 shutdown_connections 2024-03-23T23:48:34.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.061+0000 7f03a0200640 1 -- 172.21.15.8:0/1772799113 >> 172.21.15.8:0/1772799113 conn(0x7f039806b170 msgr2=0x7f03981595e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:48:34.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.061+0000 7f03a0200640 1 -- 172.21.15.8:0/1772799113 shutdown_connections 2024-03-23T23:48:34.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.061+0000 7f03a0200640 1 -- 172.21.15.8:0/1772799113 wait complete. 2024-03-23T23:48:34.155 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:48:34.155 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T23:48:34.155 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:48:34.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.485+0000 7f15d9600640 1 Processor -- start 2024-03-23T23:48:34.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.489+0000 7f15d9600640 1 -- start start 2024-03-23T23:48:34.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.489+0000 7f15d9600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15cc0da360 0x7f15cc0e1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:34.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.489+0000 7f15d9600640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15cc0da7f0 con 0x7f15cc0d3ae0 2024-03-23T23:48:34.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.489+0000 7f15d9600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15cc04b330 con 0x7f15cc00a9c0 2024-03-23T23:48:34.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.489+0000 7f15d9600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc046980 con 0x7f15cc0da360 2024-03-23T23:48:34.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.493+0000 7f15d2a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f15cc0d3ae0 0x7f15cc006f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:33110/0 (socket says 172.21.15.8:33110) 2024-03-23T23:48:34.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.493+0000 7f15d2a00640 1 -- 172.21.15.8:0/2416404794 learned_addr learned my addr 172.21.15.8:0/2416404794 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:48:34.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.493+0000 7f15d1600640 1 -- 172.21.15.8:0/2416404794 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 360536743 0 0) 0x7f15cc0da7f0 con 0x7f15cc0d3ae0 2024-03-23T23:48:34.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.493+0000 7f15d1600640 1 -- 172.21.15.8:0/2416404794 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15b8004640 con 0x7f15cc0d3ae0 2024-03-23T23:48:34.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.493+0000 7f15d3400640 1 --2- 172.21.15.8:0/2416404794 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15cc0da360 0x7f15cc0e1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:34.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.501+0000 7f15d1600640 1 -- 172.21.15.8:0/2416404794 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3283490103 0 0) 0x7f15cc04b330 con 0x7f15cc00a9c0 2024-03-23T23:48:34.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.501+0000 7f15d1600640 1 -- 172.21.15.8:0/2416404794 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15cc0da7f0 con 0x7f15cc00a9c0 2024-03-23T23:48:34.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.501+0000 7f15d1600640 1 -- 172.21.15.8:0/2416404794 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4137709251 0 0) 0x7f15b8004640 con 0x7f15cc0d3ae0 2024-03-23T23:48:34.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.501+0000 7f15d1600640 1 -- 172.21.15.8:0/2416404794 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15cc0da360 msgr2=0x7f15cc0e1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:48:34.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.501+0000 7f15d1600640 1 --2- 172.21.15.8:0/2416404794 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15cc0da360 0x7f15cc0e1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:34.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.501+0000 7f15d1600640 1 -- 172.21.15.8:0/2416404794 >> v1:172.21.15.196:6789/0 conn(0x7f15cc00a9c0 legacy=0x7f15cc0d9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:34.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.501+0000 7f15d1600640 1 -- 172.21.15.8:0/2416404794 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15cc046330 con 0x7f15cc0d3ae0 2024-03-23T23:48:34.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.501+0000 7f15d1600640 1 -- 172.21.15.8:0/2416404794 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7f15d404fc60 con 0x7f15cc0d3ae0 2024-03-23T23:48:34.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.501+0000 7f15d1600640 1 -- 172.21.15.8:0/2416404794 >> v1:172.21.15.8:6789/0 conn(0x7f15cc0d3ae0 legacy=0x7f15cc006f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:34.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.501+0000 7f15d1600640 1 --2- 172.21.15.8:0/2416404794 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f15b8004c90 0x7f15b8005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:34.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.501+0000 7f15d1600640 1 --2- 172.21.15.8:0/2416404794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15b8005920 0x7f15b8005da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:34.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.501+0000 7f15d1600640 1 --2- 172.21.15.8:0/2416404794 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15cc0da360 0x7f15b80062e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:34.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.501+0000 7f15d1600640 1 -- 172.21.15.8:0/2416404794 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc046980 con 0x7f15b8005920 2024-03-23T23:48:34.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.501+0000 7f15d1600640 1 -- 172.21.15.8:0/2416404794 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b8003560 con 0x7f15b8004c90 2024-03-23T23:48:34.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.501+0000 7f15d1600640 1 -- 172.21.15.8:0/2416404794 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b8003760 con 0x7f15cc0da360 2024-03-23T23:48:34.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.505+0000 7f15d2a00640 1 --2- 172.21.15.8:0/2416404794 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f15b8004c90 0x7f15b8005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:34.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.505+0000 7f15d3400640 1 --2- 172.21.15.8:0/2416404794 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15cc0da360 0x7f15b80062e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:34.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.509+0000 7f15d2a00640 1 -- 172.21.15.8:0/2416404794 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15cc0da360 msgr2=0x7f15b80062e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:48:34.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.509+0000 7f15d2a00640 1 --2- 172.21.15.8:0/2416404794 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15cc0da360 0x7f15b80062e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:34.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.509+0000 7f15d2a00640 1 -- 172.21.15.8:0/2416404794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15b8005920 msgr2=0x7f15b8005da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:48:34.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.509+0000 7f15d2a00640 1 --2- 172.21.15.8:0/2416404794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15b8005920 0x7f15b8005da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:34.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.509+0000 7f15d2a00640 1 -- 172.21.15.8:0/2416404794 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15cc046330 con 0x7f15b8004c90 2024-03-23T23:48:34.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.529+0000 7f15d2a00640 1 --2- 172.21.15.8:0/2416404794 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f15b8004c90 0x7f15b8005090 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f15d4069390 tx=0x7f15d4098ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f731e8fcfeaa9fd4 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:34.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.533+0000 7f15d1600640 1 -- 172.21.15.8:0/2416404794 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d406c050 con 0x7f15b8004c90 2024-03-23T23:48:34.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.533+0000 7f15d1600640 1 -- 172.21.15.8:0/2416404794 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d4125070 con 0x7f15b8004c90 2024-03-23T23:48:34.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.533+0000 7f15d1600640 1 -- 172.21.15.8:0/2416404794 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d4068270 con 0x7f15b8004c90 2024-03-23T23:48:34.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.533+0000 7f15d9600640 1 -- 172.21.15.8:0/2416404794 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f15b8004c90 msgr2=0x7f15b8005090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:34.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.533+0000 7f15d9600640 1 --2- 172.21.15.8:0/2416404794 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f15b8004c90 0x7f15b8005090 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f15d4069390 tx=0x7f15d4098ca0 comp rx=0 tx=0).stop 2024-03-23T23:48:34.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.537+0000 7f15d3400640 1 -- 172.21.15.8:0/2416404794 reap_dead start 2024-03-23T23:48:34.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.545+0000 7f15d9600640 1 -- 172.21.15.8:0/2416404794 shutdown_connections 2024-03-23T23:48:34.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.545+0000 7f15d9600640 1 -- 172.21.15.8:0/2416404794 >> 172.21.15.8:0/2416404794 conn(0x7f15cc048290 msgr2=0x7f15cc0486a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:48:34.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.545+0000 7f15d9600640 1 -- 172.21.15.8:0/2416404794 shutdown_connections 2024-03-23T23:48:34.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.545+0000 7f15d9600640 1 -- 172.21.15.8:0/2416404794 wait complete. 2024-03-23T23:48:34.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.557+0000 7f15d9600640 1 Processor -- start 2024-03-23T23:48:34.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.565+0000 7f15d9600640 1 -- start start 2024-03-23T23:48:34.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.573+0000 7f15d9600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15b8004c90 0x7f15cc16f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:34.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.573+0000 7f15d9600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f15cc02fcf0 0x7f15cc0ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:34.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.573+0000 7f15d9600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15cc0ccfe0 0x7f15cc1721f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:34.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.573+0000 7f15d9600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc0077c0 con 0x7f15b8004c90 2024-03-23T23:48:34.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.573+0000 7f15d9600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc007640 con 0x7f15cc02fcf0 2024-03-23T23:48:34.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.573+0000 7f15d9600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc04af50 con 0x7f15cc0ccfe0 2024-03-23T23:48:34.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.573+0000 7f15d3400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15cc0ccfe0 0x7f15cc1721f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:34.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.577+0000 7f15d3400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15cc0ccfe0 0x7f15cc1721f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:37118/0 (socket says 172.21.15.8:37118) 2024-03-23T23:48:34.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.577+0000 7f15d3400640 1 -- 172.21.15.8:0/1314978004 learned_addr learned my addr 172.21.15.8:0/1314978004 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:48:34.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.577+0000 7f15d3400640 1 -- 172.21.15.8:0/1314978004 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f15cc02fcf0 msgr2=0x7f15cc0ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:34.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.577+0000 7f15d3400640 1 --2- 172.21.15.8:0/1314978004 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f15cc02fcf0 0x7f15cc0ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:34.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.577+0000 7f15d3400640 1 -- 172.21.15.8:0/1314978004 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15b8004c90 msgr2=0x7f15cc16f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:34.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.577+0000 7f15d3400640 1 --2- 172.21.15.8:0/1314978004 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15b8004c90 0x7f15cc16f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:34.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.577+0000 7f15d3400640 1 -- 172.21.15.8:0/1314978004 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15cc0d8e10 con 0x7f15cc0ccfe0 2024-03-23T23:48:34.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.585+0000 7f15d3400640 1 --2- 172.21.15.8:0/1314978004 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15cc0ccfe0 0x7f15cc1721f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f15cc047960 tx=0x7f15c0011860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:34.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.585+0000 7f15caa00640 1 -- 172.21.15.8:0/1314978004 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c0004440 con 0x7f15cc0ccfe0 2024-03-23T23:48:34.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.585+0000 7f15caa00640 1 -- 172.21.15.8:0/1314978004 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c0003620 con 0x7f15cc0ccfe0 2024-03-23T23:48:34.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.585+0000 7f15caa00640 1 -- 172.21.15.8:0/1314978004 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c0003a10 con 0x7f15cc0ccfe0 2024-03-23T23:48:34.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.593+0000 7f15d9600640 1 -- 172.21.15.8:0/1314978004 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15cc0d90f0 con 0x7f15cc0ccfe0 2024-03-23T23:48:34.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.593+0000 7f15d9600640 1 -- 172.21.15.8:0/1314978004 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15cc0d96b0 con 0x7f15cc0ccfe0 2024-03-23T23:48:34.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.597+0000 7f15d9600640 1 --2- 172.21.15.8:0/1314978004 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15cc172730 0x7f15cc172b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:34.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.597+0000 7f15d9600640 1 -- 172.21.15.8:0/1314978004 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc0cd460 con 0x7f15cc172730 2024-03-23T23:48:34.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.597+0000 7f15d2a00640 1 --2- 172.21.15.8:0/1314978004 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15cc172730 0x7f15cc172b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:34.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.605+0000 7f15caa00640 1 -- 172.21.15.8:0/1314978004 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f15c0003bb0 con 0x7f15cc0ccfe0 2024-03-23T23:48:34.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.605+0000 7f15caa00640 1 --2- 172.21.15.8:0/1314978004 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f15b40676d0 0x7f15b4069b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:34.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.609+0000 7f15d2a00640 1 -- 172.21.15.8:0/1314978004 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f15cc0d8bc0 con 0x7f15cc172730 2024-03-23T23:48:34.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.609+0000 7f15caa00640 1 -- 172.21.15.8:0/1314978004 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f15c0096d40 con 0x7f15cc0ccfe0 2024-03-23T23:48:34.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.609+0000 7f15d2a00640 1 --2- 172.21.15.8:0/1314978004 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15cc172730 0x7f15cc172b10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f15d4068100 tx=0x7f15d4098ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:34.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.613+0000 7f15caa00640 1 -- 172.21.15.8:0/1314978004 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d4136020 con 0x7f15cc172730 2024-03-23T23:48:34.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.613+0000 7f15caa00640 1 -- 172.21.15.8:0/1314978004 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f15d4125030 con 0x7f15cc172730 2024-03-23T23:48:34.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.613+0000 7f15caa00640 1 -- 172.21.15.8:0/1314978004 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15cc172730 msgr2=0x7f15cc172b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:34.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.613+0000 7f15caa00640 1 --2- 172.21.15.8:0/1314978004 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15cc172730 0x7f15cc172b10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f15d4068100 tx=0x7f15d4098ca0 comp rx=0 tx=0).stop 2024-03-23T23:48:34.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.613+0000 7f15caa00640 1 -- 172.21.15.8:0/1314978004 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15cc172730 msgr2=0x7f15cc172b10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:48:34.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.613+0000 7f15caa00640 1 --2- 172.21.15.8:0/1314978004 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15cc172730 0x7f15cc172b10 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f15d4068100 tx=0x7f15d4098ca0 comp rx=0 tx=0).stop 2024-03-23T23:48:34.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.617+0000 7f15d2000640 1 --2- 172.21.15.8:0/1314978004 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f15b40676d0 0x7f15b4069b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:34.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.621+0000 7f15d2000640 1 --2- 172.21.15.8:0/1314978004 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f15b40676d0 0x7f15b4069b90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f15c4007fd0 tx=0x7f15c4007940 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:34.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.653+0000 7f15d9600640 1 --2- 172.21.15.8:0/1314978004 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15cc0d75d0 0x7f15cc0d79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:34.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.653+0000 7f15d9600640 1 -- 172.21.15.8:0/1314978004 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc005300 con 0x7f15cc0d75d0 2024-03-23T23:48:34.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.653+0000 7f15d2a00640 1 --2- 172.21.15.8:0/1314978004 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15cc0d75d0 0x7f15cc0d79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:34.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.657+0000 7f15d2a00640 1 -- 172.21.15.8:0/1314978004 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f15cc046ba0 con 0x7f15cc0d75d0 2024-03-23T23:48:34.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.661+0000 7f15d2a00640 1 --2- 172.21.15.8:0/1314978004 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15cc0d75d0 0x7f15cc0d79e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f15d40756d0 tx=0x7f15d4123070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:34.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.661+0000 7f15caa00640 1 -- 172.21.15.8:0/1314978004 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d4136040 con 0x7f15cc0d75d0 2024-03-23T23:48:34.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.661+0000 7f15caa00640 1 -- 172.21.15.8:0/1314978004 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4530 (secure 0 0 0) 0x7f15d413da60 con 0x7f15cc0d75d0 2024-03-23T23:48:34.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.661+0000 7f15caa00640 1 -- 172.21.15.8:0/1314978004 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15cc0d75d0 msgr2=0x7f15cc0d79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:34.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.661+0000 7f15caa00640 1 --2- 172.21.15.8:0/1314978004 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15cc0d75d0 0x7f15cc0d79e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f15d40756d0 tx=0x7f15d4123070 comp rx=0 tx=0).stop 2024-03-23T23:48:34.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.661+0000 7f15caa00640 1 -- 172.21.15.8:0/1314978004 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15cc0d75d0 msgr2=0x7f15cc0d79e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:48:34.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.661+0000 7f15caa00640 1 --2- 172.21.15.8:0/1314978004 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15cc0d75d0 0x7f15cc0d79e0 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f15d40756d0 tx=0x7f15d4123070 comp rx=0 tx=0).stop 2024-03-23T23:48:34.670 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:48:34.670 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:48:34.670 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:48:34.670 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:48:34.670 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 42, 2024-03-23T23:48:34.670 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:48:34.670 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:48:34.671 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:48:34.671 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:48:34.671 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:34.671 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 16, 2024-03-23T23:48:34.671 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:48:34.671 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:48:34.671 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:48:34.671 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:48:34.671 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:48:34.671 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:48:34.671 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:48:34.671 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:48:34.671 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:48:34.672 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:48:34.672 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:48:34.672 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:48:34.672 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:48:34.672 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:48:34.672 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:34.672 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:48:34.672 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:48:34.672 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:48:34.672 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:48:34.672 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:48:34.672 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:48:34.672 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:48:34.673 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:48:34.673 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:48:34.673 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:48:34.673 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:48:34.673 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:48:34.673 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:48:34.673 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:34.673 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:34.673 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:48:34.673 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:48:34.673 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:48:34.673 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:48:34.673 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:48:34.674 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:48:34.674 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:48:34.674 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:48:34.674 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:48:34.674 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:48:34.674 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:48:34.674 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:48:34.674 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:48:34.674 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:48:34.674 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:48:34.674 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:48:34.674 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:48:34.675 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:48:34.675 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:48:34.675 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:48:34.675 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:48:34.675 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:48:34.675 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:48:34.675 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:48:34.675 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:48:34.675 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:48:34.675 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:48:34.675 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:48:34.675 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:34.675 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:48:34.676 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:34.676 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:48:34.676 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:34.676 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:48:34.676 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:48:34.676 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:48:34.676 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:48:34.676 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:34.676 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:48:34.676 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:48:34.676 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:34.676 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:34.676 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:34.677 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:48:34.677 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:48:34.677 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:34.677 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:34.677 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:34.677 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:34.677 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:48:34.677 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:48:34.677 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:48:34.677 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:48:34.677 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:48:34.677 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:34.677 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:34.678 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:48:34.678 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:48:34.678 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:48:34.678 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:48:34.678 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:34.678 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:48:34.678 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:48:34.678 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:34.678 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:34.678 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:34.678 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:48:34.678 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:48:34.678 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:34.679 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:34.679 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:34.679 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:34.679 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:48:34.679 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:48:34.679 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:48:34.679 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:48:34.679 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:48:34.679 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:34.679 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:34.679 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:48:34.679 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:48:34.679 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:48:34.679 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:48:34.680 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:34.680 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:48:34.680 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:48:34.680 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:34.680 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:34.680 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:34.680 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:48:34.680 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:48:34.680 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:34.680 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:34.680 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:34.680 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:34.680 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:48:34.681 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:48:34.681 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:48:34.681 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:48:34.681 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:48:34.681 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:34.681 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:34.681 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:34.681 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:48:34.681 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:48:34.681 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:34.681 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:48:34.681 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:34.681 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:48:34.682 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:34.682 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:34.682 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:48:34.682 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:34.682 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:48:34.682 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:34.682 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:48:34.682 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:34.682 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:34.682 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:34.682 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:48:34.682 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:48:34.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.673+0000 7f15d9600640 1 -- 172.21.15.8:0/1314978004 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f15b40676d0 msgr2=0x7f15b4069b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:34.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.673+0000 7f15d9600640 1 --2- 172.21.15.8:0/1314978004 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f15b40676d0 0x7f15b4069b90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f15c4007fd0 tx=0x7f15c4007940 comp rx=0 tx=0).stop 2024-03-23T23:48:34.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.673+0000 7f15d9600640 1 -- 172.21.15.8:0/1314978004 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15cc0ccfe0 msgr2=0x7f15cc1721f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:34.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.673+0000 7f15d9600640 1 --2- 172.21.15.8:0/1314978004 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15cc0ccfe0 0x7f15cc1721f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f15cc047960 tx=0x7f15c0011860 comp rx=0 tx=0).stop 2024-03-23T23:48:34.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.673+0000 7f15d3400640 1 -- 172.21.15.8:0/1314978004 reap_dead start 2024-03-23T23:48:34.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.673+0000 7f15d3400640 1 -- 172.21.15.8:0/1314978004 reap_dead start 2024-03-23T23:48:34.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.673+0000 7f15d9600640 1 -- 172.21.15.8:0/1314978004 shutdown_connections 2024-03-23T23:48:34.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.673+0000 7f15d9600640 1 -- 172.21.15.8:0/1314978004 >> 172.21.15.8:0/1314978004 conn(0x7f15cc048290 msgr2=0x7f15cc02b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:48:34.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.681+0000 7f15d9600640 1 -- 172.21.15.8:0/1314978004 shutdown_connections 2024-03-23T23:48:34.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:34.681+0000 7f15d9600640 1 -- 172.21.15.8:0/1314978004 wait complete. 2024-03-23T23:48:34.832 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:48:34.833 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-03-23T23:48:34.833 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-03-23T23:48:34.833 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-03-23T23:48:34.833 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-03-23T23:48:34.833 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-23T23:48:34.833 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:48:34.859 INFO:tasks.ceph.mon.c:Stopped 2024-03-23T23:48:34.859 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-03-23T23:48:34.859 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:48:35.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.237+0000 7ff4c3a00640 1 Processor -- start 2024-03-23T23:48:35.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.237+0000 7ff4c3a00640 1 -- start start 2024-03-23T23:48:35.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.237+0000 7ff4c3a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff4bc0710f0 0x7ff4bc15a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:35.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.237+0000 7ff4c3a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4bc0aa390 0x7ff4bc157010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:35.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.237+0000 7ff4c3a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4bc072f40 con 0x7ff4bc0c1d40 2024-03-23T23:48:35.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.237+0000 7ff4c3a00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4bc0ab420 con 0x7ff4bc0710f0 2024-03-23T23:48:35.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.237+0000 7ff4c3a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc0ab9c0 con 0x7ff4bc0aa390 2024-03-23T23:48:35.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.241+0000 7ff4c1a00640 1 -- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4bc0aa390 msgr2=0x7ff4bc157010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:48:35.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.241+0000 7ff4c1a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4bc0aa390 0x7ff4bc157010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:48:35.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.245+0000 7ff4bbe00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7ff4bc0c1d40 0x7ff4bc0abe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:50634/0 (socket says 172.21.15.8:50634) 2024-03-23T23:48:35.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.245+0000 7ff4bbe00640 1 -- 172.21.15.8:0/2778862014 learned_addr learned my addr 172.21.15.8:0/2778862014 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:48:35.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.261+0000 7ff4bb400640 1 -- 172.21.15.8:0/2778862014 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3316343184 0 0) 0x7ff4bc072f40 con 0x7ff4bc0c1d40 2024-03-23T23:48:35.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.261+0000 7ff4bb400640 1 -- 172.21.15.8:0/2778862014 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4a0003530 con 0x7ff4bc0c1d40 2024-03-23T23:48:35.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.261+0000 7ff4c1000640 1 --2- 172.21.15.8:0/2778862014 >> v2:172.21.15.8:3300/0 conn(0x7ff4bc0710f0 0x7ff4bc15a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:35.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.265+0000 7ff4c1000640 1 -- 172.21.15.8:0/2778862014 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4bc0aa390 msgr2=0x7ff4bc157010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:48:35.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.265+0000 7ff4c1000640 1 --2- 172.21.15.8:0/2778862014 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4bc0aa390 0x7ff4bc157010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:35.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.265+0000 7ff4c1000640 1 -- 172.21.15.8:0/2778862014 >> v1:172.21.15.196:6789/0 conn(0x7ff4bc0c1d40 legacy=0x7ff4bc0abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:35.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.265+0000 7ff4c1000640 1 -- 172.21.15.8:0/2778862014 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc0ab690 con 0x7ff4bc0710f0 2024-03-23T23:48:35.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.293+0000 7ff4c1000640 1 --2- 172.21.15.8:0/2778862014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4bc0710f0 0x7ff4bc15a7f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac0097c0 tx=0x7ff4ac01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c10e378016e5a5 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:35.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.293+0000 7ff4bb400640 1 -- 172.21.15.8:0/2778862014 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac0b0070 con 0x7ff4bc0710f0 2024-03-23T23:48:35.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.293+0000 7ff4bb400640 1 -- 172.21.15.8:0/2778862014 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac0ab600 con 0x7ff4bc0710f0 2024-03-23T23:48:35.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.293+0000 7ff4bb400640 1 -- 172.21.15.8:0/2778862014 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac0ab9d0 con 0x7ff4bc0710f0 2024-03-23T23:48:35.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.313+0000 7ff4c3a00640 1 -- 172.21.15.8:0/2778862014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4bc0710f0 msgr2=0x7ff4bc15a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:35.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.313+0000 7ff4c3a00640 1 --2- 172.21.15.8:0/2778862014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4bc0710f0 0x7ff4bc15a7f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac0097c0 tx=0x7ff4ac01c450 comp rx=0 tx=0).stop 2024-03-23T23:48:35.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.313+0000 7ff4c3a00640 1 -- 172.21.15.8:0/2778862014 shutdown_connections 2024-03-23T23:48:35.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.313+0000 7ff4c3a00640 1 --2- 172.21.15.8:0/2778862014 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4bc0aa390 0x7ff4bc157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:35.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.313+0000 7ff4c3a00640 1 --2- 172.21.15.8:0/2778862014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4bc0710f0 0x7ff4bc15a7f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:35.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.313+0000 7ff4c3a00640 1 -- 172.21.15.8:0/2778862014 >> 172.21.15.8:0/2778862014 conn(0x7ff4bc0c7170 msgr2=0x7ff4bc0c7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:48:35.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.313+0000 7ff4c3a00640 1 -- 172.21.15.8:0/2778862014 shutdown_connections 2024-03-23T23:48:35.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.313+0000 7ff4c3a00640 1 -- 172.21.15.8:0/2778862014 wait complete. 2024-03-23T23:48:35.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.321+0000 7ff4c3a00640 1 Processor -- start 2024-03-23T23:48:35.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.325+0000 7ff4c3a00640 1 -- start start 2024-03-23T23:48:35.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.325+0000 7ff4c3a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4bc0710f0 0x7ff4bc1588e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:35.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.333+0000 7ff4c1000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4bc0710f0 0x7ff4bc1588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:35.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.333+0000 7ff4c1000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4bc0710f0 0x7ff4bc1588e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54782/0 (socket says 172.21.15.8:54782) 2024-03-23T23:48:35.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.333+0000 7ff4c1000640 1 -- 172.21.15.8:0/4059553708 learned_addr learned my addr 172.21.15.8:0/4059553708 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:48:35.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.333+0000 7ff4c3a00640 1 --2- 172.21.15.8:0/4059553708 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4bc0aa390 0x7ff4bc15c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:35.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.333+0000 7ff4bbe00640 1 -- 172.21.15.8:0/4059553708 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4bc0aa390 msgr2=0x7ff4bc15c670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:48:35.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.333+0000 7ff4c3a00640 1 --2- 172.21.15.8:0/4059553708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4bc0c1d40 0x7ff4bc15cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:35.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.333+0000 7ff4bbe00640 1 --2- 172.21.15.8:0/4059553708 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4bc0aa390 0x7ff4bc15c670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:48:35.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.333+0000 7ff4c3a00640 1 -- 172.21.15.8:0/4059553708 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc0ac6e0 con 0x7ff4bc0710f0 2024-03-23T23:48:35.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.333+0000 7ff4c3a00640 1 -- 172.21.15.8:0/4059553708 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc0ac560 con 0x7ff4bc0c1d40 2024-03-23T23:48:35.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.333+0000 7ff4c3a00640 1 -- 172.21.15.8:0/4059553708 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc0714d0 con 0x7ff4bc0aa390 2024-03-23T23:48:35.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.333+0000 7ff4c1000640 1 -- 172.21.15.8:0/4059553708 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4bc0aa390 msgr2=0x7ff4bc15c670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:48:35.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.333+0000 7ff4c1000640 1 --2- 172.21.15.8:0/4059553708 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4bc0aa390 0x7ff4bc15c670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:35.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.333+0000 7ff4c1000640 1 -- 172.21.15.8:0/4059553708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4bc0c1d40 msgr2=0x7ff4bc15cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:35.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.333+0000 7ff4c1000640 1 --2- 172.21.15.8:0/4059553708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4bc0c1d40 0x7ff4bc15cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:35.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.333+0000 7ff4c1000640 1 -- 172.21.15.8:0/4059553708 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc15e6c0 con 0x7ff4bc0710f0 2024-03-23T23:48:35.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.333+0000 7ff4c1000640 1 --2- 172.21.15.8:0/4059553708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4bc0710f0 0x7ff4bc1588e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac01a080 tx=0x7ff4ac01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:35.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.337+0000 7ff4b8c00640 1 -- 172.21.15.8:0/4059553708 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac0b0050 con 0x7ff4bc0710f0 2024-03-23T23:48:35.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.337+0000 7ff4b8c00640 1 -- 172.21.15.8:0/4059553708 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac0bc070 con 0x7ff4bc0710f0 2024-03-23T23:48:35.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.337+0000 7ff4b8c00640 1 -- 172.21.15.8:0/4059553708 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac0b5810 con 0x7ff4bc0710f0 2024-03-23T23:48:35.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.345+0000 7ff4c3a00640 1 -- 172.21.15.8:0/4059553708 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4bc15e9a0 con 0x7ff4bc0710f0 2024-03-23T23:48:35.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.345+0000 7ff4c3a00640 1 -- 172.21.15.8:0/4059553708 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4bc15ef60 con 0x7ff4bc0710f0 2024-03-23T23:48:35.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.345+0000 7ff4c3a00640 1 -- 172.21.15.8:0/4059553708 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4bc15f160 con 0x7ff4bc0710f0 2024-03-23T23:48:35.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.357+0000 7ff4b8c00640 1 -- 172.21.15.8:0/4059553708 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff4ac0b59b0 con 0x7ff4bc0710f0 2024-03-23T23:48:35.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.365+0000 7ff4b8c00640 1 --2- 172.21.15.8:0/4059553708 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff49c067760 0x7ff49c069c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:35.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.365+0000 7ff4b8c00640 1 -- 172.21.15.8:0/4059553708 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7ff4ac120b20 con 0x7ff4bc0710f0 2024-03-23T23:48:35.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.369+0000 7ff4bbe00640 1 --2- 172.21.15.8:0/4059553708 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff49c067760 0x7ff49c069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:35.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.381+0000 7ff4bbe00640 1 --2- 172.21.15.8:0/4059553708 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff49c067760 0x7ff49c069c20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8000c10 tx=0x7ff4a8000f80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:35.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:35.417+0000 7ff4b8c00640 1 -- 172.21.15.8:0/4059553708 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7ff4ac0160d0 con 0x7ff4bc0710f0 2024-03-23T23:48:36.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:36.029+0000 7ff4c3a00640 1 -- 172.21.15.8:0/4059553708 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff4bc04f480 con 0x7ff4bc0710f0 2024-03-23T23:48:36.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:36.029+0000 7ff4b8c00640 1 -- 172.21.15.8:0/4059553708 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1561 (secure 0 0 0) 0x7ff4ac0f1570 con 0x7ff4bc0710f0 2024-03-23T23:48:36.032 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":42,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:48:36.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:36.049+0000 7ff4c3a00640 1 -- 172.21.15.8:0/4059553708 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff49c067760 msgr2=0x7ff49c069c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:36.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:36.049+0000 7ff4c3a00640 1 --2- 172.21.15.8:0/4059553708 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff49c067760 0x7ff49c069c20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8000c10 tx=0x7ff4a8000f80 comp rx=0 tx=0).stop 2024-03-23T23:48:36.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:36.049+0000 7ff4c3a00640 1 -- 172.21.15.8:0/4059553708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4bc0710f0 msgr2=0x7ff4bc1588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:36.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:36.049+0000 7ff4c3a00640 1 --2- 172.21.15.8:0/4059553708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4bc0710f0 0x7ff4bc1588e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac01a080 tx=0x7ff4ac01ac90 comp rx=0 tx=0).stop 2024-03-23T23:48:36.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:36.049+0000 7ff4c3a00640 1 -- 172.21.15.8:0/4059553708 shutdown_connections 2024-03-23T23:48:36.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:36.049+0000 7ff4c3a00640 1 --2- 172.21.15.8:0/4059553708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4bc0c1d40 0x7ff4bc15cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:36.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:36.049+0000 7ff4c3a00640 1 --2- 172.21.15.8:0/4059553708 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff49c067760 0x7ff49c069c20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:36.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:36.049+0000 7ff4c3a00640 1 --2- 172.21.15.8:0/4059553708 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4bc0aa390 0x7ff4bc15c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:36.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:36.049+0000 7ff4c3a00640 1 --2- 172.21.15.8:0/4059553708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4bc0710f0 0x7ff4bc1588e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:36.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:36.049+0000 7ff4c3a00640 1 -- 172.21.15.8:0/4059553708 >> 172.21.15.8:0/4059553708 conn(0x7ff4bc0c7170 msgr2=0x7ff4bc0c6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:48:36.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:36.053+0000 7ff4c3a00640 1 -- 172.21.15.8:0/4059553708 shutdown_connections 2024-03-23T23:48:36.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:36.053+0000 7ff4c3a00640 1 -- 172.21.15.8:0/4059553708 wait complete. 2024-03-23T23:48:39.089 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:48:39.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.441+0000 7fe2bbe00640 1 Processor -- start 2024-03-23T23:48:39.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.441+0000 7fe2bbe00640 1 -- start start 2024-03-23T23:48:39.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.441+0000 7fe2bbe00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe2b4071620 0x7fe2b40c1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:39.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.441+0000 7fe2bbe00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b4073500 con 0x7fe2b40c23c0 2024-03-23T23:48:39.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.441+0000 7fe2bbe00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b4152670 con 0x7fe2b40aba70 2024-03-23T23:48:39.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.441+0000 7fe2bbe00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b4152420 con 0x7fe2b4071620 2024-03-23T23:48:39.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.445+0000 7fe2b8a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe2b40c23c0 0x7fe2b414ebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:33116/0 (socket says 172.21.15.8:33116) 2024-03-23T23:48:39.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.445+0000 7fe2b8a00640 1 -- 172.21.15.8:0/1140155246 learned_addr learned my addr 172.21.15.8:0/1140155246 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:48:39.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.445+0000 7fe2b3e00640 1 -- 172.21.15.8:0/1140155246 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2418395153 0 0) 0x7fe2b4073500 con 0x7fe2b40c23c0 2024-03-23T23:48:39.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.445+0000 7fe2b3e00640 1 -- 172.21.15.8:0/1140155246 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe29c003530 con 0x7fe2b40c23c0 2024-03-23T23:48:39.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.445+0000 7fe2b3e00640 1 -- 172.21.15.8:0/1140155246 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3458911195 0 0) 0x7fe29c003530 con 0x7fe2b40c23c0 2024-03-23T23:48:39.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.445+0000 7fe2b3e00640 1 -- 172.21.15.8:0/1140155246 >> v2:172.21.15.196:3300/0 conn(0x7fe2b4071620 msgr2=0x7fe2b40c1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:48:39.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.445+0000 7fe2b3e00640 1 --2- 172.21.15.8:0/1140155246 >> v2:172.21.15.196:3300/0 conn(0x7fe2b4071620 0x7fe2b40c1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:39.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.445+0000 7fe2b3e00640 1 -- 172.21.15.8:0/1140155246 >> v1:172.21.15.196:6789/0 conn(0x7fe2b40aba70 legacy=0x7fe2b415c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:48:39.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.449+0000 7fe2b3e00640 1 -- 172.21.15.8:0/1140155246 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b4155040 con 0x7fe2b40c23c0 2024-03-23T23:48:39.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.449+0000 7fe2b3e00640 1 -- 172.21.15.8:0/1140155246 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7fe2ac001a00 con 0x7fe2b40c23c0 2024-03-23T23:48:39.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.449+0000 7fe2b3e00640 1 -- 172.21.15.8:0/1140155246 >> v1:172.21.15.8:6789/0 conn(0x7fe2b40c23c0 legacy=0x7fe2b414ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:39.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.449+0000 7fe2b3e00640 1 --2- 172.21.15.8:0/1140155246 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe29c003a80 0x7fe29c003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:39.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.449+0000 7fe2b3e00640 1 --2- 172.21.15.8:0/1140155246 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe29c004810 0x7fe29c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:39.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.449+0000 7fe2b9400640 1 -- 172.21.15.8:0/1140155246 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe29c003a80 msgr2=0x7fe29c003e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:48:39.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.449+0000 7fe2b9400640 1 --2- 172.21.15.8:0/1140155246 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe29c003a80 0x7fe29c003e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:48:39.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.449+0000 7fe2b3e00640 1 --2- 172.21.15.8:0/1140155246 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe29c00aad0 0x7fe29c00cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:39.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.449+0000 7fe2b3e00640 1 -- 172.21.15.8:0/1140155246 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b4152420 con 0x7fe29c004810 2024-03-23T23:48:39.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.449+0000 7fe2b3e00640 1 -- 172.21.15.8:0/1140155246 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c00d4e0 con 0x7fe29c00aad0 2024-03-23T23:48:39.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.449+0000 7fe2b3e00640 1 -- 172.21.15.8:0/1140155246 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c007a30 con 0x7fe29c003a80 2024-03-23T23:48:39.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.449+0000 7fe2b8a00640 1 --2- 172.21.15.8:0/1140155246 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe29c004810 0x7fe29c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:39.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.449+0000 7fe2b8a00640 1 -- 172.21.15.8:0/1140155246 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe29c003a80 msgr2=0x7fe29c003e80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:48:39.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.449+0000 7fe2b8a00640 1 --2- 172.21.15.8:0/1140155246 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe29c003a80 0x7fe29c003e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:39.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.449+0000 7fe2b8a00640 1 -- 172.21.15.8:0/1140155246 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe29c00aad0 msgr2=0x7fe29c00cec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:48:39.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.449+0000 7fe2b8a00640 1 --2- 172.21.15.8:0/1140155246 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe29c00aad0 0x7fe29c00cec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:39.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.449+0000 7fe2b8a00640 1 -- 172.21.15.8:0/1140155246 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29c003530 con 0x7fe29c004810 2024-03-23T23:48:39.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.449+0000 7fe2b9e00640 1 -- 172.21.15.8:0/1140155246 reap_dead start 2024-03-23T23:48:39.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.453+0000 7fe2b8a00640 1 --2- 172.21.15.8:0/1140155246 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe29c004810 0x7fe29c004c90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac005330 tx=0x7fe2ac01cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e50a77d490665ff server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:39.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.457+0000 7fe2b3e00640 1 -- 172.21.15.8:0/1140155246 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac004f50 con 0x7fe29c004810 2024-03-23T23:48:39.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.457+0000 7fe2b3e00640 1 -- 172.21.15.8:0/1140155246 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ac0a9020 con 0x7fe29c004810 2024-03-23T23:48:39.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.457+0000 7fe2b3e00640 1 -- 172.21.15.8:0/1140155246 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac004f50 con 0x7fe29c004810 2024-03-23T23:48:39.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.461+0000 7fe2bbe00640 1 -- 172.21.15.8:0/1140155246 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe29c004810 msgr2=0x7fe29c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:39.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.461+0000 7fe2bbe00640 1 --2- 172.21.15.8:0/1140155246 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe29c004810 0x7fe29c004c90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac005330 tx=0x7fe2ac01cf60 comp rx=0 tx=0).stop 2024-03-23T23:48:39.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.461+0000 7fe2bbe00640 1 -- 172.21.15.8:0/1140155246 shutdown_connections 2024-03-23T23:48:39.464 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.461+0000 7fe2bbe00640 1 --2- 172.21.15.8:0/1140155246 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe29c004810 0x7fe29c004c90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:39.464 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.461+0000 7fe2bbe00640 1 -- 172.21.15.8:0/1140155246 >> 172.21.15.8:0/1140155246 conn(0x7fe2b40c7170 msgr2=0x7fe2b40c7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:48:39.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.461+0000 7fe2bbe00640 1 -- 172.21.15.8:0/1140155246 shutdown_connections 2024-03-23T23:48:39.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.469+0000 7fe2bbe00640 1 -- 172.21.15.8:0/1140155246 wait complete. 2024-03-23T23:48:39.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.469+0000 7fe2bbe00640 1 Processor -- start 2024-03-23T23:48:39.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.477+0000 7fe2bbe00640 1 -- start start 2024-03-23T23:48:39.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.477+0000 7fe2bbe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe29c004810 0x7fe2b406dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:39.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.477+0000 7fe2bbe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2b40c5770 0x7fe2b4140720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:39.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.477+0000 7fe2bbe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe2b40c5bf0 0x7fe2b4140c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:39.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.477+0000 7fe2bbe00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b4071b80 con 0x7fe2b40c5770 2024-03-23T23:48:39.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.477+0000 7fe2bbe00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b4071a00 con 0x7fe29c004810 2024-03-23T23:48:39.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.477+0000 7fe2bbe00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b40ac380 con 0x7fe2b40c5bf0 2024-03-23T23:48:39.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.477+0000 7fe2b9e00640 1 -- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe2b40c5bf0 msgr2=0x7fe2b4140c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:48:39.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.477+0000 7fe2b9e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe2b40c5bf0 0x7fe2b4140c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:48:39.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.481+0000 7fe2b8a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2b40c5770 0x7fe2b4140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:39.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.481+0000 7fe2b8a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2b40c5770 0x7fe2b4140720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54798/0 (socket says 172.21.15.8:54798) 2024-03-23T23:48:39.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.481+0000 7fe2b8a00640 1 -- 172.21.15.8:0/1014805073 learned_addr learned my addr 172.21.15.8:0/1014805073 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:48:39.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.481+0000 7fe2b8a00640 1 -- 172.21.15.8:0/1014805073 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe2b40c5bf0 msgr2=0x7fe2b4140c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:48:39.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.481+0000 7fe2b8a00640 1 --2- 172.21.15.8:0/1014805073 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe2b40c5bf0 0x7fe2b4140c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:39.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.481+0000 7fe2b8a00640 1 -- 172.21.15.8:0/1014805073 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe29c004810 msgr2=0x7fe2b406dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:39.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.481+0000 7fe2b8a00640 1 --2- 172.21.15.8:0/1014805073 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe29c004810 0x7fe2b406dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:39.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.481+0000 7fe2b8a00640 1 -- 172.21.15.8:0/1014805073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b4145310 con 0x7fe2b40c5770 2024-03-23T23:48:39.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.489+0000 7fe2b8a00640 1 --2- 172.21.15.8:0/1014805073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2b40c5770 0x7fe2b4140720 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac01cd90 tx=0x7fe29c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:39.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.489+0000 7fe2b1600640 1 -- 172.21.15.8:0/1014805073 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac001900 con 0x7fe2b40c5770 2024-03-23T23:48:39.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.489+0000 7fe2b1600640 1 -- 172.21.15.8:0/1014805073 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ac0a5b10 con 0x7fe2b40c5770 2024-03-23T23:48:39.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.489+0000 7fe2b1600640 1 -- 172.21.15.8:0/1014805073 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac005490 con 0x7fe2b40c5770 2024-03-23T23:48:39.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.489+0000 7fe2bbe00640 1 -- 172.21.15.8:0/1014805073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b40c63b0 con 0x7fe2b40c5770 2024-03-23T23:48:39.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.489+0000 7fe2bbe00640 1 -- 172.21.15.8:0/1014805073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b40c6970 con 0x7fe2b40c5770 2024-03-23T23:48:39.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.493+0000 7fe2bbe00640 1 -- 172.21.15.8:0/1014805073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b404f480 con 0x7fe2b40c5770 2024-03-23T23:48:39.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.501+0000 7fe2b1600640 1 -- 172.21.15.8:0/1014805073 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fe2ac005630 con 0x7fe2b40c5770 2024-03-23T23:48:39.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.501+0000 7fe2b1600640 1 --2- 172.21.15.8:0/1014805073 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe294067690 0x7fe294069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:39.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.501+0000 7fe2b1600640 1 -- 172.21.15.8:0/1014805073 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fe2ac11f8c0 con 0x7fe2b40c5770 2024-03-23T23:48:39.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.505+0000 7fe2b9400640 1 --2- 172.21.15.8:0/1014805073 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe294067690 0x7fe294069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:39.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.509+0000 7fe2b9400640 1 --2- 172.21.15.8:0/1014805073 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe294067690 0x7fe294069b50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4073d90 tx=0x7fe2a8007b50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:39.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:39.517+0000 7fe2b1600640 1 -- 172.21.15.8:0/1014805073 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fe2ac016c70 con 0x7fe2b40c5770 2024-03-23T23:48:40.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:40.225+0000 7fe2bbe00640 1 -- 172.21.15.8:0/1014805073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe2b40aafc0 con 0x7fe2b40c5770 2024-03-23T23:48:40.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:40.225+0000 7fe2b1600640 1 -- 172.21.15.8:0/1014805073 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1561 (secure 0 0 0) 0x7fe2ac0f01f0 con 0x7fe2b40c5770 2024-03-23T23:48:40.229 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":42,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:48:40.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:40.237+0000 7fe2bbe00640 1 -- 172.21.15.8:0/1014805073 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe294067690 msgr2=0x7fe294069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:40.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:40.237+0000 7fe2bbe00640 1 --2- 172.21.15.8:0/1014805073 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe294067690 0x7fe294069b50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4073d90 tx=0x7fe2a8007b50 comp rx=0 tx=0).stop 2024-03-23T23:48:40.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:40.237+0000 7fe2bbe00640 1 -- 172.21.15.8:0/1014805073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2b40c5770 msgr2=0x7fe2b4140720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:40.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:40.237+0000 7fe2bbe00640 1 --2- 172.21.15.8:0/1014805073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2b40c5770 0x7fe2b4140720 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac01cd90 tx=0x7fe29c005840 comp rx=0 tx=0).stop 2024-03-23T23:48:40.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:40.237+0000 7fe2bbe00640 1 -- 172.21.15.8:0/1014805073 shutdown_connections 2024-03-23T23:48:40.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:40.237+0000 7fe2bbe00640 1 --2- 172.21.15.8:0/1014805073 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe294067690 0x7fe294069b50 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:40.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:40.237+0000 7fe2bbe00640 1 --2- 172.21.15.8:0/1014805073 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe2b40c5bf0 0x7fe2b4140c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:40.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:40.237+0000 7fe2bbe00640 1 --2- 172.21.15.8:0/1014805073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2b40c5770 0x7fe2b4140720 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:40.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:40.237+0000 7fe2bbe00640 1 --2- 172.21.15.8:0/1014805073 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe29c004810 0x7fe2b406dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:40.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:40.237+0000 7fe2bbe00640 1 -- 172.21.15.8:0/1014805073 >> 172.21.15.8:0/1014805073 conn(0x7fe2b40c7170 msgr2=0x7fe2b40c7550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:48:40.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:40.237+0000 7fe2bbe00640 1 -- 172.21.15.8:0/1014805073 shutdown_connections 2024-03-23T23:48:40.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:40.237+0000 7fe2bbe00640 1 -- 172.21.15.8:0/1014805073 wait complete. 2024-03-23T23:48:43.332 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:48:43.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.637+0000 7fb486e00640 1 Processor -- start 2024-03-23T23:48:43.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.641+0000 7fb486e00640 1 -- start start 2024-03-23T23:48:43.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.645+0000 7fb486e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb480152dc0 0x7fb480073220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:43.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.645+0000 7fb486e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4800c13e0 0x7fb4800c05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:43.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.645+0000 7fb486e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4800c3710 con 0x7fb48006efc0 2024-03-23T23:48:43.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.645+0000 7fb486e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb48006f5b0 con 0x7fb480152dc0 2024-03-23T23:48:43.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.645+0000 7fb486e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48006f850 con 0x7fb4800c13e0 2024-03-23T23:48:43.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.645+0000 7fb47fe00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb480152dc0 0x7fb480073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:43.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.645+0000 7fb47fe00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb480152dc0 0x7fb480073220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:49808/0 (socket says 172.21.15.8:49808) 2024-03-23T23:48:43.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.645+0000 7fb47fe00640 1 -- 172.21.15.8:0/4237097739 learned_addr learned my addr 172.21.15.8:0/4237097739 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:48:43.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.645+0000 7fb484e00640 1 -- 172.21.15.8:0/4237097739 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4800c13e0 msgr2=0x7fb4800c05a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:48:43.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.645+0000 7fb484e00640 1 --2- 172.21.15.8:0/4237097739 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4800c13e0 0x7fb4800c05a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:48:43.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.649+0000 7fb47fe00640 1 -- 172.21.15.8:0/4237097739 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4800c13e0 msgr2=0x7fb4800c05a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:48:43.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.649+0000 7fb47fe00640 1 --2- 172.21.15.8:0/4237097739 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4800c13e0 0x7fb4800c05a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:43.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.649+0000 7fb47fe00640 1 -- 172.21.15.8:0/4237097739 >> v1:172.21.15.8:6789/0 conn(0x7fb48006efc0 legacy=0x7fb480158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:43.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.649+0000 7fb47fe00640 1 -- 172.21.15.8:0/4237097739 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4800c30c0 con 0x7fb480152dc0 2024-03-23T23:48:43.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.653+0000 7fb47fe00640 1 --2- 172.21.15.8:0/4237097739 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb480152dc0 0x7fb480073220 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb470009870 tx=0x7fb47001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59c02599c4ca0f2d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:43.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.653+0000 7fb47ea00640 1 -- 172.21.15.8:0/4237097739 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4700ab600 con 0x7fb480152dc0 2024-03-23T23:48:43.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.657+0000 7fb47ea00640 1 -- 172.21.15.8:0/4237097739 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4700b0070 con 0x7fb480152dc0 2024-03-23T23:48:43.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.657+0000 7fb47ea00640 1 -- 172.21.15.8:0/4237097739 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4700ab9c0 con 0x7fb480152dc0 2024-03-23T23:48:43.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.657+0000 7fb486e00640 1 -- 172.21.15.8:0/4237097739 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb480152dc0 msgr2=0x7fb480073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:43.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.657+0000 7fb486e00640 1 --2- 172.21.15.8:0/4237097739 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb480152dc0 0x7fb480073220 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb470009870 tx=0x7fb47001c510 comp rx=0 tx=0).stop 2024-03-23T23:48:43.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.657+0000 7fb486e00640 1 -- 172.21.15.8:0/4237097739 shutdown_connections 2024-03-23T23:48:43.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.657+0000 7fb486e00640 1 --2- 172.21.15.8:0/4237097739 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4800c13e0 0x7fb4800c05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:43.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.657+0000 7fb486e00640 1 --2- 172.21.15.8:0/4237097739 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb480152dc0 0x7fb480073220 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:43.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.657+0000 7fb486e00640 1 -- 172.21.15.8:0/4237097739 >> 172.21.15.8:0/4237097739 conn(0x7fb4800c7170 msgr2=0x7fb4800c7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:48:43.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.661+0000 7fb486e00640 1 -- 172.21.15.8:0/4237097739 shutdown_connections 2024-03-23T23:48:43.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.665+0000 7fb486e00640 1 -- 172.21.15.8:0/4237097739 wait complete. 2024-03-23T23:48:43.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.669+0000 7fb486e00640 1 Processor -- start 2024-03-23T23:48:43.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.681+0000 7fb486e00640 1 -- start start 2024-03-23T23:48:43.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.681+0000 7fb486e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb48006efc0 0x7fb480149e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:43.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.681+0000 7fb486e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4800c13e0 0x7fb48014e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:43.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.681+0000 7fb486e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb480152dc0 0x7fb48014e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:43.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.681+0000 7fb486e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800726e0 con 0x7fb4800c13e0 2024-03-23T23:48:43.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.681+0000 7fb486e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb480072560 con 0x7fb480152dc0 2024-03-23T23:48:43.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.681+0000 7fb486e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb480162a00 con 0x7fb48006efc0 2024-03-23T23:48:43.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.681+0000 7fb47fe00640 1 -- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb48006efc0 msgr2=0x7fb480149e60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:48:43.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.681+0000 7fb47fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb48006efc0 0x7fb480149e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:48:43.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.685+0000 7fb47f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4800c13e0 0x7fb48014e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:43.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.685+0000 7fb47f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4800c13e0 0x7fb48014e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39418/0 (socket says 172.21.15.8:39418) 2024-03-23T23:48:43.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.685+0000 7fb47f400640 1 -- 172.21.15.8:0/2585783402 learned_addr learned my addr 172.21.15.8:0/2585783402 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:48:43.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.685+0000 7fb484e00640 1 --2- 172.21.15.8:0/2585783402 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb480152dc0 0x7fb48014e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:43.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.685+0000 7fb47f400640 1 -- 172.21.15.8:0/2585783402 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb48006efc0 msgr2=0x7fb480149e60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:48:43.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.685+0000 7fb47f400640 1 --2- 172.21.15.8:0/2585783402 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb48006efc0 0x7fb480149e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:43.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.685+0000 7fb47f400640 1 -- 172.21.15.8:0/2585783402 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb480152dc0 msgr2=0x7fb48014e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:43.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.685+0000 7fb47f400640 1 --2- 172.21.15.8:0/2585783402 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb480152dc0 0x7fb48014e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:43.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.685+0000 7fb47f400640 1 -- 172.21.15.8:0/2585783402 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4800be260 con 0x7fb4800c13e0 2024-03-23T23:48:43.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.685+0000 7fb47f400640 1 --2- 172.21.15.8:0/2585783402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4800c13e0 0x7fb48014e260 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb46c00c440 tx=0x7fb46c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:43.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.689+0000 7fb477e00640 1 -- 172.21.15.8:0/2585783402 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c017070 con 0x7fb4800c13e0 2024-03-23T23:48:43.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.689+0000 7fb486e00640 1 -- 172.21.15.8:0/2585783402 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4801fbde0 con 0x7fb4800c13e0 2024-03-23T23:48:43.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.689+0000 7fb486e00640 1 -- 172.21.15.8:0/2585783402 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb48014dc70 con 0x7fb4800c13e0 2024-03-23T23:48:43.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.689+0000 7fb477e00640 1 -- 172.21.15.8:0/2585783402 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46c0052d0 con 0x7fb4800c13e0 2024-03-23T23:48:43.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.693+0000 7fb477e00640 1 -- 172.21.15.8:0/2585783402 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c017070 con 0x7fb4800c13e0 2024-03-23T23:48:43.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.693+0000 7fb475600640 1 -- 172.21.15.8:0/2585783402 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb48004f480 con 0x7fb4800c13e0 2024-03-23T23:48:43.714 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:48:43.727 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:48:43.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.713+0000 7fb477e00640 1 -- 172.21.15.8:0/2585783402 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb46c01a070 con 0x7fb4800c13e0 2024-03-23T23:48:43.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.717+0000 7fb477e00640 1 --2- 172.21.15.8:0/2585783402 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb460067a10 0x7fb460069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:43.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.733+0000 7fb477e00640 1 -- 172.21.15.8:0/2585783402 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fb46c0050d0 con 0x7fb4800c13e0 2024-03-23T23:48:43.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.733+0000 7fb47fe00640 1 --2- 172.21.15.8:0/2585783402 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb460067a10 0x7fb460069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:43.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.753+0000 7fb47fe00640 1 --2- 172.21.15.8:0/2585783402 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb460067a10 0x7fb460069ed0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb4700af000 tx=0x7fb470008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:43.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:43.769+0000 7fb477e00640 1 -- 172.21.15.8:0/2585783402 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fb46c054aa0 con 0x7fb4800c13e0 2024-03-23T23:48:44.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:44.589+0000 7fb475600640 1 -- 172.21.15.8:0/2585783402 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb4800c0830 con 0x7fb4800c13e0 2024-03-23T23:48:44.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:44.593+0000 7fb477e00640 1 -- 172.21.15.8:0/2585783402 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1561 (secure 0 0 0) 0x7fb46c058b40 con 0x7fb4800c13e0 2024-03-23T23:48:44.594 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":42,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":26,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:48:44.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:44.597+0000 7fb486e00640 1 -- 172.21.15.8:0/2585783402 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb460067a10 msgr2=0x7fb460069ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:44.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:44.597+0000 7fb486e00640 1 --2- 172.21.15.8:0/2585783402 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb460067a10 0x7fb460069ed0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb4700af000 tx=0x7fb470008040 comp rx=0 tx=0).stop 2024-03-23T23:48:44.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:44.597+0000 7fb486e00640 1 -- 172.21.15.8:0/2585783402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4800c13e0 msgr2=0x7fb48014e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:44.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:44.597+0000 7fb486e00640 1 --2- 172.21.15.8:0/2585783402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4800c13e0 0x7fb48014e260 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb46c00c440 tx=0x7fb46c00c900 comp rx=0 tx=0).stop 2024-03-23T23:48:44.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:44.597+0000 7fb486e00640 1 -- 172.21.15.8:0/2585783402 shutdown_connections 2024-03-23T23:48:44.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:44.597+0000 7fb486e00640 1 --2- 172.21.15.8:0/2585783402 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb480152dc0 0x7fb48014e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:44.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:44.597+0000 7fb486e00640 1 --2- 172.21.15.8:0/2585783402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4800c13e0 0x7fb48014e260 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:44.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:44.597+0000 7fb486e00640 1 --2- 172.21.15.8:0/2585783402 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb460067a10 0x7fb460069ed0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:44.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:44.597+0000 7fb486e00640 1 --2- 172.21.15.8:0/2585783402 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb48006efc0 0x7fb480149e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:44.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:44.597+0000 7fb486e00640 1 -- 172.21.15.8:0/2585783402 >> 172.21.15.8:0/2585783402 conn(0x7fb4800c7170 msgr2=0x7fb4800c7550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:48:44.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:44.601+0000 7fb486e00640 1 -- 172.21.15.8:0/2585783402 shutdown_connections 2024-03-23T23:48:44.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:44.601+0000 7fb486e00640 1 -- 172.21.15.8:0/2585783402 wait complete. 2024-03-23T23:48:47.684 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:48:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:47.997+0000 7f28b3a00640 1 Processor -- start 2024-03-23T23:48:48.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:47.997+0000 7f28b3a00640 1 -- start start 2024-03-23T23:48:48.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:48.001+0000 7f28b3a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28ac152150 0x7f28ac1556b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:48.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:48.001+0000 7f28b3a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ac073100 con 0x7f28ac14ebe0 2024-03-23T23:48:48.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:48.001+0000 7f28b3a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ac0733e0 con 0x7f28ac072b20 2024-03-23T23:48:48.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:48.001+0000 7f28b3a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac154c60 con 0x7f28ac152150 2024-03-23T23:48:48.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:48.001+0000 7f28ab400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f28ac072b20 0x7f28ac0aa520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:50040/0 (socket says 172.21.15.8:50040) 2024-03-23T23:48:48.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:48.001+0000 7f28ab400640 1 -- 172.21.15.8:0/3225516516 learned_addr learned my addr 172.21.15.8:0/3225516516 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:48:48.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:48.001+0000 7f28b1000640 1 -- 172.21.15.8:0/3225516516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28ac152150 msgr2=0x7f28ac1556b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:48:48.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:48.001+0000 7f28b1000640 1 --2- 172.21.15.8:0/3225516516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28ac152150 0x7f28ac1556b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:48:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:48.205+0000 7f28b1000640 1 -- 172.21.15.8:0/3225516516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28ac152150 msgr2=0x7f28ac1556b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:48:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:48.205+0000 7f28b1000640 1 --2- 172.21.15.8:0/3225516516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28ac152150 0x7f28ac1556b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:48:48.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:48.613+0000 7f28b1000640 1 -- 172.21.15.8:0/3225516516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28ac152150 msgr2=0x7f28ac1556b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:48:48.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:48.613+0000 7f28b1000640 1 --2- 172.21.15.8:0/3225516516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28ac152150 0x7f28ac1556b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:48:49.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.417+0000 7f28b1000640 1 -- 172.21.15.8:0/3225516516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28ac152150 msgr2=0x7f28ac1556b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:48:49.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.417+0000 7f28b1000640 1 --2- 172.21.15.8:0/3225516516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28ac152150 0x7f28ac1556b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:48:49.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.833+0000 7f28b2400640 1 -- 172.21.15.8:0/3225516516 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1431640463 0 0) 0x7f28ac0733e0 con 0x7f28ac072b20 2024-03-23T23:48:49.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.833+0000 7f28b2400640 1 -- 172.21.15.8:0/3225516516 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2894003450 con 0x7f28ac072b20 2024-03-23T23:48:49.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.841+0000 7f28b2400640 1 -- 172.21.15.8:0/3225516516 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304894861 0 0) 0x7f28ac073100 con 0x7f28ac14ebe0 2024-03-23T23:48:49.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.841+0000 7f28b2400640 1 -- 172.21.15.8:0/3225516516 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2894003980 con 0x7f28ac14ebe0 2024-03-23T23:48:49.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.841+0000 7f28b2400640 1 -- 172.21.15.8:0/3225516516 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4086335870 0 0) 0x7f2894003450 con 0x7f28ac072b20 2024-03-23T23:48:49.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.841+0000 7f28b2400640 1 -- 172.21.15.8:0/3225516516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28ac152150 msgr2=0x7f28ac1556b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:48:49.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.841+0000 7f28b2400640 1 --2- 172.21.15.8:0/3225516516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28ac152150 0x7f28ac1556b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:49.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.841+0000 7f28b2400640 1 -- 172.21.15.8:0/3225516516 >> v1:172.21.15.8:6789/0 conn(0x7f28ac14ebe0 legacy=0x7f28ac0c1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:49.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.841+0000 7f28b2400640 1 -- 172.21.15.8:0/3225516516 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac154eb0 con 0x7f28ac072b20 2024-03-23T23:48:49.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.841+0000 7f28b2400640 1 -- 172.21.15.8:0/3225516516 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7f28980015a0 con 0x7f28ac072b20 2024-03-23T23:48:49.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.841+0000 7f28b2400640 1 -- 172.21.15.8:0/3225516516 >> v1:172.21.15.196:6789/0 conn(0x7f28ac072b20 legacy=0x7f28ac0aa520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:49.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.841+0000 7f28b2400640 1 --2- 172.21.15.8:0/3225516516 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2894003e30 0x7f2894006650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:49.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.841+0000 7f28b2400640 1 --2- 172.21.15.8:0/3225516516 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2894006b90 0x7f2894009020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:49.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.841+0000 7f28b2400640 1 --2- 172.21.15.8:0/3225516516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28940096b0 0x7f2894014480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:49.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.841+0000 7f28b2400640 1 -- 172.21.15.8:0/3225516516 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac154c60 con 0x7f2894003e30 2024-03-23T23:48:49.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.841+0000 7f28b2400640 1 -- 172.21.15.8:0/3225516516 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289400bc50 con 0x7f2894006b90 2024-03-23T23:48:49.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.841+0000 7f28b2400640 1 -- 172.21.15.8:0/3225516516 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289400be50 con 0x7f28940096b0 2024-03-23T23:48:49.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.845+0000 7f28b1000640 1 -- 172.21.15.8:0/3225516516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28940096b0 msgr2=0x7f2894014480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:48:49.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.845+0000 7f28b1000640 1 --2- 172.21.15.8:0/3225516516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28940096b0 0x7f2894014480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:48:49.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.849+0000 7f28ab400640 1 --2- 172.21.15.8:0/3225516516 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2894006b90 0x7f2894009020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:49.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.849+0000 7f28ab400640 1 -- 172.21.15.8:0/3225516516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28940096b0 msgr2=0x7f2894014480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:48:49.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.849+0000 7f28ab400640 1 --2- 172.21.15.8:0/3225516516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28940096b0 0x7f2894014480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:49.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.849+0000 7f28ab400640 1 -- 172.21.15.8:0/3225516516 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2894003e30 msgr2=0x7f2894006650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:48:49.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.849+0000 7f28ab400640 1 --2- 172.21.15.8:0/3225516516 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2894003e30 0x7f2894006650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:49.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.849+0000 7f28ab400640 1 -- 172.21.15.8:0/3225516516 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac154eb0 con 0x7f2894006b90 2024-03-23T23:48:49.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.853+0000 7f28ab400640 1 --2- 172.21.15.8:0/3225516516 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2894006b90 0x7f2894009020 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f289800c0e0 tx=0x7f289801cab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e737737e36249bba server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:49.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.861+0000 7f28b2400640 1 -- 172.21.15.8:0/3225516516 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2898007bd0 con 0x7f2894006b90 2024-03-23T23:48:49.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.861+0000 7f28b2400640 1 -- 172.21.15.8:0/3225516516 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28980a9020 con 0x7f2894006b90 2024-03-23T23:48:49.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.861+0000 7f28b2400640 1 -- 172.21.15.8:0/3225516516 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2898004ad0 con 0x7f2894006b90 2024-03-23T23:48:49.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.861+0000 7f28b3a00640 1 -- 172.21.15.8:0/3225516516 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2894006b90 msgr2=0x7f2894009020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:49.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.861+0000 7f28b3a00640 1 --2- 172.21.15.8:0/3225516516 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2894006b90 0x7f2894009020 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f289800c0e0 tx=0x7f289801cab0 comp rx=0 tx=0).stop 2024-03-23T23:48:49.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.861+0000 7f28b1000640 1 -- 172.21.15.8:0/3225516516 reap_dead start 2024-03-23T23:48:49.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.861+0000 7f28b3a00640 1 -- 172.21.15.8:0/3225516516 shutdown_connections 2024-03-23T23:48:49.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.861+0000 7f28b3a00640 1 -- 172.21.15.8:0/3225516516 >> 172.21.15.8:0/3225516516 conn(0x7f28ac0c3bd0 msgr2=0x7f28ac0c3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:48:49.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.861+0000 7f28b3a00640 1 -- 172.21.15.8:0/3225516516 shutdown_connections 2024-03-23T23:48:49.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.861+0000 7f28b3a00640 1 -- 172.21.15.8:0/3225516516 wait complete. 2024-03-23T23:48:49.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.865+0000 7f28b3a00640 1 Processor -- start 2024-03-23T23:48:49.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.865+0000 7f28b3a00640 1 -- start start 2024-03-23T23:48:49.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.869+0000 7f28b3a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28ac0c2cc0 0x7f28ac0c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:49.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.869+0000 7f28b3a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28ac0c6180 0x7f28ac147520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:49.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.869+0000 7f28b3a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28ac147a60 0x7f28ac147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:49.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.869+0000 7f28b3a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac0aadb0 con 0x7f28ac0c6180 2024-03-23T23:48:49.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.869+0000 7f28abe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28ac0c2cc0 0x7f28ac0c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:49.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.869+0000 7f28abe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28ac0c2cc0 0x7f28ac0c5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:49830/0 (socket says 172.21.15.8:49830) 2024-03-23T23:48:49.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.869+0000 7f28abe00640 1 -- 172.21.15.8:0/2256500839 learned_addr learned my addr 172.21.15.8:0/2256500839 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:48:49.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.869+0000 7f28b1000640 1 -- 172.21.15.8:0/2256500839 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28ac147a60 msgr2=0x7f28ac147ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:48:49.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.869+0000 7f28b1000640 1 --2- 172.21.15.8:0/2256500839 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28ac147a60 0x7f28ac147ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:48:49.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.869+0000 7f28ab400640 1 --2- 172.21.15.8:0/2256500839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28ac0c6180 0x7f28ac147520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:49.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.869+0000 7f28b3a00640 1 -- 172.21.15.8:0/2256500839 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac0aac30 con 0x7f28ac0c2cc0 2024-03-23T23:48:49.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.869+0000 7f28b3a00640 1 -- 172.21.15.8:0/2256500839 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac14efc0 con 0x7f28ac147a60 2024-03-23T23:48:49.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.869+0000 7f28ab400640 1 -- 172.21.15.8:0/2256500839 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28ac147a60 msgr2=0x7f28ac147ee0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:48:49.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.869+0000 7f28ab400640 1 --2- 172.21.15.8:0/2256500839 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28ac147a60 0x7f28ac147ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:49.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.869+0000 7f28ab400640 1 -- 172.21.15.8:0/2256500839 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28ac0c2cc0 msgr2=0x7f28ac0c5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:49.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.869+0000 7f28ab400640 1 --2- 172.21.15.8:0/2256500839 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28ac0c2cc0 0x7f28ac0c5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:49.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.869+0000 7f28ab400640 1 -- 172.21.15.8:0/2256500839 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac0c6600 con 0x7f28ac0c6180 2024-03-23T23:48:49.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.869+0000 7f28ab400640 1 --2- 172.21.15.8:0/2256500839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28ac0c6180 0x7f28ac147520 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f289400be20 tx=0x7f2894003740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:49.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.869+0000 7f28a8c00640 1 -- 172.21.15.8:0/2256500839 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2898007bd0 con 0x7f28ac0c6180 2024-03-23T23:48:49.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.869+0000 7f28b3a00640 1 -- 172.21.15.8:0/2256500839 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28ac06cdd0 con 0x7f28ac0c6180 2024-03-23T23:48:49.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.869+0000 7f28b3a00640 1 -- 172.21.15.8:0/2256500839 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ac06e510 con 0x7f28ac0c6180 2024-03-23T23:48:49.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.869+0000 7f28a8c00640 1 -- 172.21.15.8:0/2256500839 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28980048b0 con 0x7f28ac0c6180 2024-03-23T23:48:49.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.869+0000 7f28a8c00640 1 -- 172.21.15.8:0/2256500839 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28980015a0 con 0x7f28ac0c6180 2024-03-23T23:48:49.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.873+0000 7f289e000640 1 -- 172.21.15.8:0/2256500839 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28800052a0 con 0x7f28ac0c6180 2024-03-23T23:48:49.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.877+0000 7f28a8c00640 1 -- 172.21.15.8:0/2256500839 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f2898004c60 con 0x7f28ac0c6180 2024-03-23T23:48:49.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.877+0000 7f28a8c00640 1 --2- 172.21.15.8:0/2256500839 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f288c067610 0x7f288c069ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:49.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.881+0000 7f28abe00640 1 --2- 172.21.15.8:0/2256500839 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f288c067610 0x7f288c069ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:49.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.881+0000 7f28a8c00640 1 -- 172.21.15.8:0/2256500839 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f289811f510 con 0x7f28ac0c6180 2024-03-23T23:48:49.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.889+0000 7f28abe00640 1 --2- 172.21.15.8:0/2256500839 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f288c067610 0x7f288c069ad0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f28a0007fd0 tx=0x7f28a0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:49.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:49.893+0000 7f28a8c00640 1 -- 172.21.15.8:0/2256500839 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f28980167f0 con 0x7f28ac0c6180 2024-03-23T23:48:50.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:50.833+0000 7f289e000640 1 -- 172.21.15.8:0/2256500839 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f2880005590 con 0x7f28ac0c6180 2024-03-23T23:48:50.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:50.869+0000 7f28a8c00640 1 -- 172.21.15.8:0/2256500839 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1554 (secure 0 0 0) 0x7f28980ef760 con 0x7f28ac0c6180 2024-03-23T23:48:50.875 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":46,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:48:50.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:50.885+0000 7f289e000640 1 -- 172.21.15.8:0/2256500839 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f288c067610 msgr2=0x7f288c069ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:50.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:50.885+0000 7f289e000640 1 --2- 172.21.15.8:0/2256500839 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f288c067610 0x7f288c069ad0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f28a0007fd0 tx=0x7f28a0009040 comp rx=0 tx=0).stop 2024-03-23T23:48:50.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:50.885+0000 7f289e000640 1 -- 172.21.15.8:0/2256500839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28ac0c6180 msgr2=0x7f28ac147520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:50.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:50.885+0000 7f289e000640 1 --2- 172.21.15.8:0/2256500839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28ac0c6180 0x7f28ac147520 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f289400be20 tx=0x7f2894003740 comp rx=0 tx=0).stop 2024-03-23T23:48:50.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:50.885+0000 7f289e000640 1 -- 172.21.15.8:0/2256500839 shutdown_connections 2024-03-23T23:48:50.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:50.885+0000 7f289e000640 1 --2- 172.21.15.8:0/2256500839 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f288c067610 0x7f288c069ad0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:50.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:50.885+0000 7f289e000640 1 --2- 172.21.15.8:0/2256500839 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28ac147a60 0x7f28ac147ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:50.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:50.885+0000 7f289e000640 1 --2- 172.21.15.8:0/2256500839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28ac0c6180 0x7f28ac147520 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:50.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:50.885+0000 7f289e000640 1 --2- 172.21.15.8:0/2256500839 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28ac0c2cc0 0x7f28ac0c5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:50.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:50.885+0000 7f289e000640 1 -- 172.21.15.8:0/2256500839 >> 172.21.15.8:0/2256500839 conn(0x7f28ac0c3bd0 msgr2=0x7f28ac14be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:48:50.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:50.885+0000 7f289e000640 1 -- 172.21.15.8:0/2256500839 shutdown_connections 2024-03-23T23:48:50.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:50.885+0000 7f289e000640 1 -- 172.21.15.8:0/2256500839 wait complete. 2024-03-23T23:48:50.961 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-03-23T23:48:50.961 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-03-23T23:48:50.961 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:48:51.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.381+0000 7fdc01600640 1 Processor -- start 2024-03-23T23:48:51.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.381+0000 7fdc01600640 1 -- start start 2024-03-23T23:48:51.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.385+0000 7fdc01600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fdbf40dbf20 0x7fdbf40070d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:51.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.385+0000 7fdc01600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdbf4047f60 0x7fdbf40de9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:51.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.385+0000 7fdc01600640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbf40e1d00 con 0x7fdbf4007610 2024-03-23T23:48:51.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.385+0000 7fdc01600640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbf400b560 con 0x7fdbf40dbf20 2024-03-23T23:48:51.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.385+0000 7fdc01600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf40e1fe0 con 0x7fdbf4047f60 2024-03-23T23:48:51.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.385+0000 7fdbfaa00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fdbf40dbf20 0x7fdbf40070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:51.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.385+0000 7fdbfaa00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fdbf40dbf20 0x7fdbf40070d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39458/0 (socket says 172.21.15.8:39458) 2024-03-23T23:48:51.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.385+0000 7fdbfaa00640 1 -- 172.21.15.8:0/2274351346 learned_addr learned my addr 172.21.15.8:0/2274351346 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:48:51.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.389+0000 7fdbfa000640 1 -- 172.21.15.8:0/2274351346 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdbf4047f60 msgr2=0x7fdbf40de9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:48:51.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.389+0000 7fdbfa000640 1 --2- 172.21.15.8:0/2274351346 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdbf4047f60 0x7fdbf40de9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:48:51.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.389+0000 7fdbf9600640 1 -- 172.21.15.8:0/2274351346 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 131074750 0 0) 0x7fdbf40e1d00 con 0x7fdbf4007610 2024-03-23T23:48:51.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.389+0000 7fdbf9600640 1 -- 172.21.15.8:0/2274351346 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbe0003530 con 0x7fdbf4007610 2024-03-23T23:48:51.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.389+0000 7fdbf9600640 1 -- 172.21.15.8:0/2274351346 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3844765413 0 0) 0x7fdbe0003530 con 0x7fdbf4007610 2024-03-23T23:48:51.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.389+0000 7fdbf9600640 1 -- 172.21.15.8:0/2274351346 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdbf4047f60 msgr2=0x7fdbf40de9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:48:51.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.389+0000 7fdbf9600640 1 --2- 172.21.15.8:0/2274351346 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdbf4047f60 0x7fdbf40de9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:51.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.389+0000 7fdbf9600640 1 -- 172.21.15.8:0/2274351346 >> v2:172.21.15.8:3300/0 conn(0x7fdbf40dbf20 msgr2=0x7fdbf40070d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:48:51.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.389+0000 7fdbf9600640 1 --2- 172.21.15.8:0/2274351346 >> v2:172.21.15.8:3300/0 conn(0x7fdbf40dbf20 0x7fdbf40070d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:51.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.389+0000 7fdbf9600640 1 -- 172.21.15.8:0/2274351346 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf40e22c0 con 0x7fdbf4007610 2024-03-23T23:48:51.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.389+0000 7fdbfaa00640 1 --2- 172.21.15.8:0/2274351346 >> v2:172.21.15.8:3300/0 conn(0x7fdbf40dbf20 0x7fdbf40070d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:48:51.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.389+0000 7fdbf9600640 1 -- 172.21.15.8:0/2274351346 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7fdbfc075790 con 0x7fdbf4007610 2024-03-23T23:48:51.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.389+0000 7fdbf9600640 1 -- 172.21.15.8:0/2274351346 >> v1:172.21.15.8:6789/0 conn(0x7fdbf4007610 legacy=0x7fdbf40def00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:51.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.393+0000 7fdbf9600640 1 --2- 172.21.15.8:0/2274351346 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdbe0003a40 0x7fdbe0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:51.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.393+0000 7fdbf9600640 1 --2- 172.21.15.8:0/2274351346 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdbf4047f60 0x7fdbe0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:51.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.393+0000 7fdbf9600640 1 --2- 172.21.15.8:0/2274351346 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbe0004d50 0x7fdbe00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:51.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.393+0000 7fdbfa000640 1 -- 172.21.15.8:0/2274351346 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdbf4047f60 msgr2=0x7fdbe0004810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:48:51.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.393+0000 7fdbfa000640 1 --2- 172.21.15.8:0/2274351346 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdbf4047f60 0x7fdbe0004810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:48:51.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.393+0000 7fdbfbe00640 1 --2- 172.21.15.8:0/2274351346 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbe0004d50 0x7fdbe00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:51.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.393+0000 7fdbf9600640 1 -- 172.21.15.8:0/2274351346 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf400b560 con 0x7fdbe0004d50 2024-03-23T23:48:51.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.393+0000 7fdbf9600640 1 -- 172.21.15.8:0/2274351346 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf40e1fe0 con 0x7fdbe0003a40 2024-03-23T23:48:51.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.393+0000 7fdbf9600640 1 -- 172.21.15.8:0/2274351346 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe000bad0 con 0x7fdbf4047f60 2024-03-23T23:48:51.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.393+0000 7fdbfbe00640 1 -- 172.21.15.8:0/2274351346 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdbf4047f60 msgr2=0x7fdbe0004810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:48:51.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.393+0000 7fdbfbe00640 1 --2- 172.21.15.8:0/2274351346 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdbf4047f60 0x7fdbe0004810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:51.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.393+0000 7fdbfbe00640 1 -- 172.21.15.8:0/2274351346 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdbe0003a40 msgr2=0x7fdbe0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:48:51.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.393+0000 7fdbfbe00640 1 --2- 172.21.15.8:0/2274351346 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdbe0003a40 0x7fdbe0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:51.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.393+0000 7fdbfbe00640 1 -- 172.21.15.8:0/2274351346 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe0003530 con 0x7fdbe0004d50 2024-03-23T23:48:51.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.401+0000 7fdbfbe00640 1 --2- 172.21.15.8:0/2274351346 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbe0004d50 0x7fdbe00051d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc068920 tx=0x7fdbfc09b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df53b4f263cddb2a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:51.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.401+0000 7fdbf9600640 1 -- 172.21.15.8:0/2274351346 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc075400 con 0x7fdbe0004d50 2024-03-23T23:48:51.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.401+0000 7fdbf9600640 1 -- 172.21.15.8:0/2274351346 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbfc12a530 con 0x7fdbe0004d50 2024-03-23T23:48:51.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.401+0000 7fdbf9600640 1 -- 172.21.15.8:0/2274351346 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc12a9c0 con 0x7fdbe0004d50 2024-03-23T23:48:51.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.401+0000 7fdc01600640 1 -- 172.21.15.8:0/2274351346 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbe0004d50 msgr2=0x7fdbe00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:51.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.401+0000 7fdc01600640 1 --2- 172.21.15.8:0/2274351346 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbe0004d50 0x7fdbe00051d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc068920 tx=0x7fdbfc09b7d0 comp rx=0 tx=0).stop 2024-03-23T23:48:51.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.401+0000 7fdbfbe00640 1 -- 172.21.15.8:0/2274351346 reap_dead start 2024-03-23T23:48:51.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.401+0000 7fdc01600640 1 -- 172.21.15.8:0/2274351346 shutdown_connections 2024-03-23T23:48:51.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.401+0000 7fdc01600640 1 -- 172.21.15.8:0/2274351346 >> 172.21.15.8:0/2274351346 conn(0x7fdbf4048430 msgr2=0x7fdbf4048840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:48:51.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.401+0000 7fdc01600640 1 -- 172.21.15.8:0/2274351346 shutdown_connections 2024-03-23T23:48:51.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.401+0000 7fdc01600640 1 -- 172.21.15.8:0/2274351346 wait complete. 2024-03-23T23:48:51.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.409+0000 7fdc01600640 1 Processor -- start 2024-03-23T23:48:51.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.409+0000 7fdc01600640 1 -- start start 2024-03-23T23:48:51.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.409+0000 7fdc01600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdbe0004d50 0x7fdbf40d9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:51.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.409+0000 7fdc01600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdbf40da250 0x7fdbf40443e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:51.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.409+0000 7fdc01600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbf4044920 0x7fdbf40d8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:51.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.409+0000 7fdc01600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf40e2b60 con 0x7fdbf4044920 2024-03-23T23:48:51.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.409+0000 7fdbfaa00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdbe0004d50 0x7fdbf40d9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:51.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.409+0000 7fdbfaa00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdbe0004d50 0x7fdbf40d9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:49838/0 (socket says 172.21.15.8:49838) 2024-03-23T23:48:51.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.409+0000 7fdbfaa00640 1 -- 172.21.15.8:0/49358359 learned_addr learned my addr 172.21.15.8:0/49358359 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:48:51.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.409+0000 7fdc01600640 1 -- 172.21.15.8:0/49358359 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf40e2880 con 0x7fdbe0004d50 2024-03-23T23:48:51.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.409+0000 7fdc01600640 1 -- 172.21.15.8:0/49358359 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf40df610 con 0x7fdbf40da250 2024-03-23T23:48:51.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.409+0000 7fdbfa000640 1 -- 172.21.15.8:0/49358359 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdbf40da250 msgr2=0x7fdbf40443e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:48:51.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.409+0000 7fdbfa000640 1 --2- 172.21.15.8:0/49358359 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdbf40da250 0x7fdbf40443e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:48:51.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.413+0000 7fdbfbe00640 1 --2- 172.21.15.8:0/49358359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbf4044920 0x7fdbf40d8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:51.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.413+0000 7fdbfbe00640 1 -- 172.21.15.8:0/49358359 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdbf40da250 msgr2=0x7fdbf40443e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:48:51.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.413+0000 7fdbfbe00640 1 --2- 172.21.15.8:0/49358359 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdbf40da250 0x7fdbf40443e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:51.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.413+0000 7fdbfbe00640 1 -- 172.21.15.8:0/49358359 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdbe0004d50 msgr2=0x7fdbf40d9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:51.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.413+0000 7fdbfbe00640 1 --2- 172.21.15.8:0/49358359 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdbe0004d50 0x7fdbf40d9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:51.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.413+0000 7fdbfbe00640 1 -- 172.21.15.8:0/49358359 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf40da9c0 con 0x7fdbf4044920 2024-03-23T23:48:51.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.413+0000 7fdbfbe00640 1 --2- 172.21.15.8:0/49358359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbf4044920 0x7fdbf40d8840 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc000b70 tx=0x7fdbe0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:51.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.413+0000 7fdbf2a00640 1 -- 172.21.15.8:0/49358359 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc0503a0 con 0x7fdbf4044920 2024-03-23T23:48:51.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.413+0000 7fdbf2a00640 1 -- 172.21.15.8:0/49358359 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbfc04f980 con 0x7fdbf4044920 2024-03-23T23:48:51.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.417+0000 7fdbf2a00640 1 -- 172.21.15.8:0/49358359 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc068460 con 0x7fdbf4044920 2024-03-23T23:48:51.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.417+0000 7fdc01600640 1 -- 172.21.15.8:0/49358359 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf40db1f0 con 0x7fdbf4044920 2024-03-23T23:48:51.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.417+0000 7fdc01600640 1 -- 172.21.15.8:0/49358359 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf403fa10 con 0x7fdbf4044920 2024-03-23T23:48:51.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.421+0000 7fdbe7e00640 1 --2- 172.21.15.8:0/49358359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbf4005fe0 0x7fdbf40063c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:51.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.421+0000 7fdbe7e00640 1 -- 172.21.15.8:0/49358359 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf40054a0 con 0x7fdbf4005fe0 2024-03-23T23:48:51.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.421+0000 7fdbfaa00640 1 --2- 172.21.15.8:0/49358359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbf4005fe0 0x7fdbf40063c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:51.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.421+0000 7fdbf2a00640 1 -- 172.21.15.8:0/49358359 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fdbfc13c020 con 0x7fdbf4044920 2024-03-23T23:48:51.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.421+0000 7fdbfaa00640 1 -- 172.21.15.8:0/49358359 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdbf403fbe0 con 0x7fdbf4005fe0 2024-03-23T23:48:51.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.425+0000 7fdbfaa00640 1 --2- 172.21.15.8:0/49358359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbf4005fe0 0x7fdbf40063c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00f7b0 tx=0x7fdbec00fc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:51.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.425+0000 7fdbf2a00640 1 --2- 172.21.15.8:0/49358359 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdbdc067660 0x7fdbdc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:51.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.425+0000 7fdbf2a00640 1 -- 172.21.15.8:0/49358359 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fdbfc19e780 con 0x7fdbf4044920 2024-03-23T23:48:51.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.425+0000 7fdbf2a00640 1 -- 172.21.15.8:0/49358359 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec018070 con 0x7fdbf4005fe0 2024-03-23T23:48:51.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.425+0000 7fdbf2a00640 1 -- 172.21.15.8:0/49358359 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fdbec00d9b0 con 0x7fdbf4005fe0 2024-03-23T23:48:51.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.429+0000 7fdbf2a00640 1 -- 172.21.15.8:0/49358359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbf4005fe0 msgr2=0x7fdbf40063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:51.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.429+0000 7fdbf2a00640 1 --2- 172.21.15.8:0/49358359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbf4005fe0 0x7fdbf40063c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00f7b0 tx=0x7fdbec00fc70 comp rx=0 tx=0).stop 2024-03-23T23:48:51.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.429+0000 7fdbf2a00640 1 -- 172.21.15.8:0/49358359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbf4005fe0 msgr2=0x7fdbf40063c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:48:51.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.429+0000 7fdbf2a00640 1 --2- 172.21.15.8:0/49358359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbf4005fe0 0x7fdbf40063c0 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00f7b0 tx=0x7fdbec00fc70 comp rx=0 tx=0).stop 2024-03-23T23:48:51.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.429+0000 7fdbfa000640 1 --2- 172.21.15.8:0/49358359 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdbdc067660 0x7fdbdc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:51.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.433+0000 7fdbfa000640 1 --2- 172.21.15.8:0/49358359 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdbdc067660 0x7fdbdc069b20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdbf402c550 tx=0x7fdbe8006e10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:51.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.441+0000 7fdbe7e00640 1 --2- 172.21.15.8:0/49358359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbf40d8d80 0x7fdbf40d9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:51.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.441+0000 7fdbe7e00640 1 -- 172.21.15.8:0/49358359 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf40d96d0 con 0x7fdbf40d8d80 2024-03-23T23:48:51.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.445+0000 7fdbfaa00640 1 --2- 172.21.15.8:0/49358359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbf40d8d80 0x7fdbf40d9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:51.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.449+0000 7fdbfaa00640 1 -- 172.21.15.8:0/49358359 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fdbf400b1b0 con 0x7fdbf40d8d80 2024-03-23T23:48:51.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.449+0000 7fdbfaa00640 1 --2- 172.21.15.8:0/49358359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbf40d8d80 0x7fdbf40d9190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00f7b0 tx=0x7fdbec004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:51.464 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.461+0000 7fdbf2a00640 1 -- 172.21.15.8:0/49358359 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec02b020 con 0x7fdbf40d8d80 2024-03-23T23:48:51.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.465+0000 7fdbf2a00640 1 -- 172.21.15.8:0/49358359 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4860 (secure 0 0 0) 0x7fdbec0133e0 con 0x7fdbf40d8d80 2024-03-23T23:48:51.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.465+0000 7fdbf2a00640 1 -- 172.21.15.8:0/49358359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbf40d8d80 msgr2=0x7fdbf40d9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:51.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.465+0000 7fdbf2a00640 1 --2- 172.21.15.8:0/49358359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbf40d8d80 0x7fdbf40d9190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00f7b0 tx=0x7fdbec004740 comp rx=0 tx=0).stop 2024-03-23T23:48:51.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.465+0000 7fdbf2a00640 1 -- 172.21.15.8:0/49358359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbf40d8d80 msgr2=0x7fdbf40d9190 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:48:51.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.465+0000 7fdbf2a00640 1 --2- 172.21.15.8:0/49358359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbf40d8d80 0x7fdbf40d9190 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00f7b0 tx=0x7fdbec004740 comp rx=0 tx=0).stop 2024-03-23T23:48:51.467 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:48:51.467 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:48:51.467 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:48:51.467 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:48:51.467 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 46, 2024-03-23T23:48:51.467 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:48:51.467 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:48:51.468 INFO:teuthology.orchestra.run.smithi008.stdout: 1 2024-03-23T23:48:51.468 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:51.468 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 1, 2024-03-23T23:48:51.468 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:48:51.468 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:48:51.468 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:48:51.468 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:48:51.468 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:48:51.468 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:48:51.468 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:48:51.468 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:48:51.468 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:48:51.468 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:48:51.469 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:48:51.469 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:48:51.469 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:48:51.469 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:48:51.469 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:51.469 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:48:51.469 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:48:51.469 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:48:51.469 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:48:51.469 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:48:51.469 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:48:51.469 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:48:51.469 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:48:51.469 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:48:51.469 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:48:51.470 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:48:51.470 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:48:51.470 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:48:51.470 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:51.470 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:51.470 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:48:51.470 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:48:51.470 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:48:51.470 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:48:51.470 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:48:51.470 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:48:51.470 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:48:51.470 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:48:51.471 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:48:51.471 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:48:51.471 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:48:51.471 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:48:51.471 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:48:51.471 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:48:51.471 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:48:51.471 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:48:51.471 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:48:51.471 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:48:51.471 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:48:51.471 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:48:51.471 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:48:51.471 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:48:51.472 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:48:51.472 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:48:51.472 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:48:51.472 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:48:51.472 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:48:51.472 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:48:51.472 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:51.472 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:48:51.472 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:51.472 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:48:51.472 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:51.472 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:48:51.472 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:48:51.472 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:48:51.472 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:48:51.473 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:51.473 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:48:51.473 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:48:51.473 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:51.473 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:51.473 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:51.473 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:48:51.473 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:48:51.473 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:51.473 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:51.473 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:51.473 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:51.473 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:48:51.473 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:48:51.474 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:48:51.474 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:48:51.474 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:48:51.474 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:51.474 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:51.474 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:48:51.474 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:48:51.474 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:48:51.474 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:48:51.474 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:51.474 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:48:51.474 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:48:51.474 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:51.474 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:51.475 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:51.475 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:48:51.475 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:48:51.475 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:51.475 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:51.475 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:51.475 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:51.475 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:48:51.475 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:48:51.475 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:48:51.475 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:48:51.475 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:48:51.475 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:51.475 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:51.476 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:48:51.476 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:48:51.476 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:48:51.476 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:48:51.476 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:51.476 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:48:51.476 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:48:51.476 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:51.476 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:51.476 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:51.476 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:48:51.476 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:48:51.476 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:51.476 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:51.477 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:51.477 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:51.477 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:48:51.477 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:48:51.477 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:48:51.477 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:48:51.477 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:48:51.477 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:51.477 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:51.477 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:51.477 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:48:51.477 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:48:51.477 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:51.477 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:48:51.478 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:51.478 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:48:51.478 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:51.478 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:51.478 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:48:51.478 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:51.478 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:48:51.478 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:51.478 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:48:51.478 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:51.478 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:51.478 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:48:51.478 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:51.478 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:48:51.479 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:51.479 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:48:51.479 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:51.479 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:51.479 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:48:51.479 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:51.479 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:48:51.479 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:51.479 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:48:51.479 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:51.479 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:51.479 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:51.479 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:48:51.479 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:48:51.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.477+0000 7fdbe7e00640 1 -- 172.21.15.8:0/49358359 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdbdc067660 msgr2=0x7fdbdc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:51.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.477+0000 7fdbe7e00640 1 --2- 172.21.15.8:0/49358359 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdbdc067660 0x7fdbdc069b20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdbf402c550 tx=0x7fdbe8006e10 comp rx=0 tx=0).stop 2024-03-23T23:48:51.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.477+0000 7fdbe7e00640 1 -- 172.21.15.8:0/49358359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbf4044920 msgr2=0x7fdbf40d8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:51.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.477+0000 7fdbe7e00640 1 --2- 172.21.15.8:0/49358359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbf4044920 0x7fdbf40d8840 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc000b70 tx=0x7fdbe0005840 comp rx=0 tx=0).stop 2024-03-23T23:48:51.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.477+0000 7fdbfbe00640 1 -- 172.21.15.8:0/49358359 reap_dead start 2024-03-23T23:48:51.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.477+0000 7fdbfbe00640 1 -- 172.21.15.8:0/49358359 reap_dead start 2024-03-23T23:48:51.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.477+0000 7fdbe7e00640 1 -- 172.21.15.8:0/49358359 shutdown_connections 2024-03-23T23:48:51.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.477+0000 7fdbe7e00640 1 -- 172.21.15.8:0/49358359 >> 172.21.15.8:0/49358359 conn(0x7fdbf4048430 msgr2=0x7fdbf40e9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:48:51.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.481+0000 7fdbe7e00640 1 -- 172.21.15.8:0/49358359 shutdown_connections 2024-03-23T23:48:51.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:51.481+0000 7fdbe7e00640 1 -- 172.21.15.8:0/49358359 wait complete. 2024-03-23T23:48:51.526 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T23:48:51.526 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-03-23T23:48:51.527 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:48:52.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.005+0000 7f528f400640 1 Processor -- start 2024-03-23T23:48:52.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.005+0000 7f528f400640 1 -- start start 2024-03-23T23:48:52.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.009+0000 7f528f400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f528813a110 0x7f5288070c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:52.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.009+0000 7f528f400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f528806db80 0x7f52880c31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:52.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.013+0000 7f528ca00640 1 -- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f528813a110 msgr2=0x7f5288070c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:48:52.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.013+0000 7f528ca00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f528813a110 0x7f5288070c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:48:52.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.013+0000 7f5287e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f528806db80 0x7f52880c31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:52.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.013+0000 7f5287e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f528806db80 0x7f52880c31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39494/0 (socket says 172.21.15.8:39494) 2024-03-23T23:48:52.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.017+0000 7f5287e00640 1 -- 172.21.15.8:0/3592545586 learned_addr learned my addr 172.21.15.8:0/3592545586 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:48:52.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.017+0000 7f528f400640 1 -- 172.21.15.8:0/3592545586 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52880c1e40 con 0x7f5288154d10 2024-03-23T23:48:52.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.017+0000 7f528f400640 1 -- 172.21.15.8:0/3592545586 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f528806e320 con 0x7f528806db80 2024-03-23T23:48:52.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.017+0000 7f528f400640 1 -- 172.21.15.8:0/3592545586 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f528813a4f0 con 0x7f528813a110 2024-03-23T23:48:52.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.021+0000 7f5287e00640 1 -- 172.21.15.8:0/3592545586 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f528813a110 msgr2=0x7f5288070c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:48:52.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.021+0000 7f5287e00640 1 --2- 172.21.15.8:0/3592545586 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f528813a110 0x7f5288070c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:52.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.021+0000 7f5287e00640 1 -- 172.21.15.8:0/3592545586 >> v1:172.21.15.196:6789/0 conn(0x7f5288154d10 legacy=0x7f5288155160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:52.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.021+0000 7f5287e00640 1 -- 172.21.15.8:0/3592545586 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52880c2120 con 0x7f528806db80 2024-03-23T23:48:52.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.025+0000 7f5287e00640 1 --2- 172.21.15.8:0/3592545586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f528806db80 0x7f52880c31c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5274009870 tx=0x7f527401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23811577d14d02c2 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:52.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.025+0000 7f5287400640 1 -- 172.21.15.8:0/3592545586 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52740aa620 con 0x7f528806db80 2024-03-23T23:48:52.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.025+0000 7f5287400640 1 -- 172.21.15.8:0/3592545586 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52740af070 con 0x7f528806db80 2024-03-23T23:48:52.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.029+0000 7f528f400640 1 -- 172.21.15.8:0/3592545586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f528806db80 msgr2=0x7f52880c31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:52.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.029+0000 7f5287400640 1 -- 172.21.15.8:0/3592545586 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52740aa620 con 0x7f528806db80 2024-03-23T23:48:52.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.029+0000 7f528f400640 1 --2- 172.21.15.8:0/3592545586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f528806db80 0x7f52880c31c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5274009870 tx=0x7f527401c4c0 comp rx=0 tx=0).stop 2024-03-23T23:48:52.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.033+0000 7f528f400640 1 -- 172.21.15.8:0/3592545586 shutdown_connections 2024-03-23T23:48:52.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.033+0000 7f528f400640 1 --2- 172.21.15.8:0/3592545586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f528806db80 0x7f52880c31c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:52.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.033+0000 7f528f400640 1 --2- 172.21.15.8:0/3592545586 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f528813a110 0x7f5288070c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:52.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.033+0000 7f528f400640 1 -- 172.21.15.8:0/3592545586 >> 172.21.15.8:0/3592545586 conn(0x7f52880c6f60 msgr2=0x7f52880c7370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:48:52.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.037+0000 7f528f400640 1 -- 172.21.15.8:0/3592545586 shutdown_connections 2024-03-23T23:48:52.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.037+0000 7f528f400640 1 -- 172.21.15.8:0/3592545586 wait complete. 2024-03-23T23:48:52.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.037+0000 7f528f400640 1 Processor -- start 2024-03-23T23:48:52.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.045+0000 7f528f400640 1 -- start start 2024-03-23T23:48:52.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.057+0000 7f528f400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f528806db80 0x7f52880ab250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:52.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.057+0000 7f528f400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f528813a110 0x7f52881fb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:52.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.057+0000 7f528f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5288154d10 0x7f52880aa330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:52.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.057+0000 7f528ca00640 1 -- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f528806db80 msgr2=0x7f52880ab250 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:48:52.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.057+0000 7f528ca00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f528806db80 0x7f52880ab250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:48:52.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.057+0000 7f528f400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52880711b0 con 0x7f5288154d10 2024-03-23T23:48:52.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.057+0000 7f528f400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52880c2ca0 con 0x7f528813a110 2024-03-23T23:48:52.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.057+0000 7f528f400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52880c3700 con 0x7f528806db80 2024-03-23T23:48:52.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.057+0000 7f5287e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f528813a110 0x7f52881fb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:52.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.057+0000 7f5287e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f528813a110 0x7f52881fb280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:49854/0 (socket says 172.21.15.8:49854) 2024-03-23T23:48:52.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.057+0000 7f5287e00640 1 -- 172.21.15.8:0/1451257902 learned_addr learned my addr 172.21.15.8:0/1451257902 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:48:52.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.065+0000 7f5287e00640 1 -- 172.21.15.8:0/1451257902 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f528806db80 msgr2=0x7f52880ab250 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:48:52.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.065+0000 7f5287e00640 1 --2- 172.21.15.8:0/1451257902 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f528806db80 0x7f52880ab250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:52.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.065+0000 7f5287e00640 1 -- 172.21.15.8:0/1451257902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5288154d10 msgr2=0x7f52880aa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:52.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.065+0000 7f5287e00640 1 --2- 172.21.15.8:0/1451257902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5288154d10 0x7f52880aa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:48:52.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.065+0000 7f5287e00640 1 -- 172.21.15.8:0/1451257902 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5288152310 con 0x7f528813a110 2024-03-23T23:48:52.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.077+0000 7f5287e00640 1 --2- 172.21.15.8:0/1451257902 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f528813a110 0x7f52881fb280 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f52740ac040 tx=0x7f5274019260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:52.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.077+0000 7f5284c00640 1 -- 172.21.15.8:0/1451257902 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5274003ab0 con 0x7f528813a110 2024-03-23T23:48:52.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.077+0000 7f5284c00640 1 -- 172.21.15.8:0/1451257902 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5274003c50 con 0x7f528813a110 2024-03-23T23:48:52.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.077+0000 7f5284c00640 1 -- 172.21.15.8:0/1451257902 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52740aa420 con 0x7f528813a110 2024-03-23T23:48:52.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.081+0000 7f528f400640 1 -- 172.21.15.8:0/1451257902 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52880aacb0 con 0x7f528813a110 2024-03-23T23:48:52.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.081+0000 7f528f400640 1 -- 172.21.15.8:0/1451257902 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5288138560 con 0x7f528813a110 2024-03-23T23:48:52.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.085+0000 7f528f400640 1 --2- 172.21.15.8:0/1451257902 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5288138760 0x7f52881515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:52.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.085+0000 7f528f400640 1 -- 172.21.15.8:0/1451257902 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5288137a20 con 0x7f5288138760 2024-03-23T23:48:52.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.085+0000 7f528ca00640 1 --2- 172.21.15.8:0/1451257902 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5288138760 0x7f52881515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:52.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.089+0000 7f528ca00640 1 -- 172.21.15.8:0/1451257902 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f528804f410 con 0x7f5288138760 2024-03-23T23:48:52.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.093+0000 7f528ca00640 1 --2- 172.21.15.8:0/1451257902 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5288138760 0x7f52881515b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f527c0041d0 tx=0x7f527c00cd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:52.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.101+0000 7f5284c00640 1 -- 172.21.15.8:0/1451257902 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f52740aa5c0 con 0x7f528813a110 2024-03-23T23:48:52.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.101+0000 7f5284c00640 1 --2- 172.21.15.8:0/1451257902 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5268067660 0x7f5268069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:52.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.105+0000 7f528d400640 1 --2- 172.21.15.8:0/1451257902 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5268067660 0x7f5268069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:52.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.109+0000 7f5284c00640 1 -- 172.21.15.8:0/1451257902 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c007c90 con 0x7f5288138760 2024-03-23T23:48:52.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.109+0000 7f5284c00640 1 -- 172.21.15.8:0/1451257902 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f52741208e0 con 0x7f528813a110 2024-03-23T23:48:52.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.109+0000 7f5284c00640 1 -- 172.21.15.8:0/1451257902 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f527c007e30 con 0x7f5288138760 2024-03-23T23:48:52.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.109+0000 7f5284c00640 1 -- 172.21.15.8:0/1451257902 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5288138760 msgr2=0x7f52881515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:52.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.109+0000 7f5284c00640 1 --2- 172.21.15.8:0/1451257902 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5288138760 0x7f52881515b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f527c0041d0 tx=0x7f527c00cd70 comp rx=0 tx=0).stop 2024-03-23T23:48:52.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.109+0000 7f5284c00640 1 -- 172.21.15.8:0/1451257902 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5288138760 msgr2=0x7f52881515b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:48:52.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.109+0000 7f5284c00640 1 --2- 172.21.15.8:0/1451257902 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5288138760 0x7f52881515b0 secure :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f527c0041d0 tx=0x7f527c00cd70 comp rx=0 tx=0).stop 2024-03-23T23:48:52.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.113+0000 7f528d400640 1 --2- 172.21.15.8:0/1451257902 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5268067660 0x7f5268069b20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5280001320 tx=0x7f5280007d90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:52.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.137+0000 7f528f400640 1 --2- 172.21.15.8:0/1451257902 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f52880ace20 0x7f5288151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:48:52.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.137+0000 7f528f400640 1 -- 172.21.15.8:0/1451257902 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5288134d20 con 0x7f52880ace20 2024-03-23T23:48:52.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.149+0000 7f528ca00640 1 --2- 172.21.15.8:0/1451257902 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f52880ace20 0x7f5288151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:48:52.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.157+0000 7f528ca00640 1 -- 172.21.15.8:0/1451257902 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f528806e020 con 0x7f52880ace20 2024-03-23T23:48:52.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.165+0000 7f528ca00640 1 --2- 172.21.15.8:0/1451257902 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f52880ace20 0x7f5288151af0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f527c0041d0 tx=0x7f527c0039e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:48:52.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.169+0000 7f5284c00640 1 -- 172.21.15.8:0/1451257902 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c00ae80 con 0x7f52880ace20 2024-03-23T23:48:52.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.169+0000 7f5284c00640 1 -- 172.21.15.8:0/1451257902 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5171 (secure 0 0 0) 0x7f527c00e630 con 0x7f52880ace20 2024-03-23T23:48:52.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.169+0000 7f5284c00640 1 -- 172.21.15.8:0/1451257902 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f52880ace20 msgr2=0x7f5288151af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:52.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.169+0000 7f5284c00640 1 --2- 172.21.15.8:0/1451257902 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f52880ace20 0x7f5288151af0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f527c0041d0 tx=0x7f527c0039e0 comp rx=0 tx=0).stop 2024-03-23T23:48:52.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.169+0000 7f5284c00640 1 -- 172.21.15.8:0/1451257902 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f52880ace20 msgr2=0x7f5288151af0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:48:52.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.169+0000 7f5284c00640 1 --2- 172.21.15.8:0/1451257902 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f52880ace20 0x7f5288151af0 secure :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f527c0041d0 tx=0x7f527c0039e0 comp rx=0 tx=0).stop 2024-03-23T23:48:52.177 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:48:52.178 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:48:52.178 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:48:52.178 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:48:52.178 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 46, 2024-03-23T23:48:52.178 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:48:52.178 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:48:52.178 INFO:teuthology.orchestra.run.smithi008.stdout: 1 2024-03-23T23:48:52.178 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:52.178 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 2, 2024-03-23T23:48:52.178 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:48:52.178 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:48:52.178 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:48:52.179 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:48:52.179 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:48:52.179 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:48:52.179 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:48:52.179 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:48:52.179 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:48:52.179 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:48:52.179 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:48:52.179 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:48:52.179 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:48:52.179 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:48:52.179 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:52.179 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:48:52.179 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:48:52.180 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:48:52.180 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:48:52.180 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:48:52.180 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:48:52.180 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:48:52.180 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:48:52.180 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:48:52.180 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:48:52.180 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:48:52.180 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:48:52.180 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:48:52.180 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:52.180 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:52.180 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:48:52.181 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:48:52.181 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:48:52.181 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:48:52.181 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:48:52.181 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:48:52.181 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:48:52.181 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:48:52.181 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:48:52.181 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:48:52.181 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:48:52.181 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:48:52.181 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:48:52.181 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:48:52.182 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:48:52.182 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:48:52.182 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:48:52.182 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:48:52.182 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:48:52.182 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:48:52.182 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:48:52.182 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:48:52.182 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:48:52.182 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:48:52.182 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:48:52.182 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:48:52.182 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:48:52.183 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:48:52.183 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:52.183 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:48:52.183 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:52.183 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:48:52.183 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:52.183 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:48:52.183 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:48:52.183 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:48:52.183 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:48:52.183 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:52.183 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:48:52.183 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:48:52.184 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:52.184 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:52.184 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:52.184 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:48:52.184 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:48:52.184 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:52.184 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:52.184 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:52.184 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:52.184 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:48:52.184 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:48:52.184 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:48:52.184 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:48:52.184 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:48:52.184 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:52.185 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:52.185 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:48:52.185 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:48:52.185 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:48:52.185 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:48:52.185 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:52.185 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:48:52.185 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:48:52.185 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:52.185 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:52.185 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:52.185 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:48:52.185 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:48:52.186 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:52.186 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:52.186 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:52.186 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:52.186 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:48:52.186 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:48:52.186 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:48:52.186 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:48:52.186 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:48:52.186 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:52.186 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:52.186 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:48:52.187 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:48:52.187 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:48:52.187 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:48:52.187 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:52.187 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:48:52.187 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:48:52.187 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:52.187 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:52.187 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:52.187 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:48:52.187 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:48:52.187 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:48:52.187 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:52.187 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:52.188 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:52.188 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:48:52.188 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:48:52.188 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:48:52.188 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:48:52.188 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:48:52.188 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:52.188 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:52.188 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:52.188 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:48:52.188 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:48:52.188 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:52.188 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:48:52.189 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:52.189 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:48:52.189 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:52.189 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:52.189 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:48:52.189 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:52.189 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:48:52.189 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:52.189 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:48:52.189 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:52.189 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:52.189 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:48:52.189 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:52.189 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:48:52.190 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:52.190 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:48:52.190 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:52.190 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:52.190 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:48:52.190 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:52.190 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:48:52.190 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:52.190 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:48:52.190 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:52.190 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:52.190 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:48:52.190 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:52.191 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:48:52.191 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:52.191 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:48:52.191 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:48:52.191 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:48:52.191 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:48:52.191 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:48:52.191 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:48:52.191 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:48:52.191 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:48:52.191 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:48:52.191 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:48:52.191 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:48:52.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.177+0000 7f528f400640 1 -- 172.21.15.8:0/1451257902 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5268067660 msgr2=0x7f5268069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:52.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.177+0000 7f528f400640 1 --2- 172.21.15.8:0/1451257902 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5268067660 0x7f5268069b20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5280001320 tx=0x7f5280007d90 comp rx=0 tx=0).stop 2024-03-23T23:48:52.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.177+0000 7f528f400640 1 -- 172.21.15.8:0/1451257902 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f528813a110 msgr2=0x7f52881fb280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:48:52.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.177+0000 7f528f400640 1 --2- 172.21.15.8:0/1451257902 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f528813a110 0x7f52881fb280 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f52740ac040 tx=0x7f5274019260 comp rx=0 tx=0).stop 2024-03-23T23:48:52.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.177+0000 7f528d400640 1 -- 172.21.15.8:0/1451257902 reap_dead start 2024-03-23T23:48:52.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.177+0000 7f528d400640 1 -- 172.21.15.8:0/1451257902 reap_dead start 2024-03-23T23:48:52.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.177+0000 7f528f400640 1 -- 172.21.15.8:0/1451257902 shutdown_connections 2024-03-23T23:48:52.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.177+0000 7f528f400640 1 -- 172.21.15.8:0/1451257902 >> 172.21.15.8:0/1451257902 conn(0x7f52880c6f60 msgr2=0x7f52880c7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:48:52.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.177+0000 7f528f400640 1 -- 172.21.15.8:0/1451257902 shutdown_connections 2024-03-23T23:48:52.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:48:52.181+0000 7f528f400640 1 -- 172.21.15.8:0/1451257902 wait complete. 2024-03-23T23:48:52.245 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T23:48:52.246 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-03-23T23:49:12.247 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-03-23T23:49:12.247 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-03-23T23:49:12.248 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-23T23:49:12.248 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-23T23:49:12.254 INFO:tasks.ceph.mon.c:Started 2024-03-23T23:49:12.254 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T23:49:12.254 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:49:12.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.685+0000 7f7ba2400640 1 Processor -- start 2024-03-23T23:49:12.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.685+0000 7f7ba2400640 1 -- start start 2024-03-23T23:49:12.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.689+0000 7f7ba2400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7b9c0ac3b0 0x7f7b9c0c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:12.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.689+0000 7f7ba2400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7b9c070e90 0x7f7b9c15da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:12.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.689+0000 7f7ba2400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b9c0c3570 con 0x7f7b9c0aa390 2024-03-23T23:49:12.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.689+0000 7f7b9be00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7b9c070e90 0x7f7b9c15da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:12.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.689+0000 7f7b9be00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7b9c070e90 0x7f7b9c15da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55296/0 (socket says 172.21.15.8:55296) 2024-03-23T23:49:12.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.689+0000 7f7b9be00640 1 -- 172.21.15.8:0/2478053116 learned_addr learned my addr 172.21.15.8:0/2478053116 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:49:12.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.689+0000 7f7ba2400640 1 -- 172.21.15.8:0/2478053116 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b9c0ac790 con 0x7f7b9c070e90 2024-03-23T23:49:12.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.689+0000 7f7ba2400640 1 -- 172.21.15.8:0/2478053116 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c154170 con 0x7f7b9c0ac3b0 2024-03-23T23:49:12.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.689+0000 7f7b9be00640 1 -- 172.21.15.8:0/2478053116 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7b9c0ac3b0 msgr2=0x7f7b9c0c3bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-23T23:49:12.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.689+0000 7f7b9be00640 1 --2- 172.21.15.8:0/2478053116 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7b9c0ac3b0 0x7f7b9c0c3bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:12.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.689+0000 7f7b9be00640 1 -- 172.21.15.8:0/2478053116 >> v1:172.21.15.8:6789/0 conn(0x7f7b9c0aa390 legacy=0x7f7b9c15d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:12.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.689+0000 7f7b9be00640 1 -- 172.21.15.8:0/2478053116 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9c159e50 con 0x7f7b9c070e90 2024-03-23T23:49:12.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.697+0000 7f7b9be00640 1 --2- 172.21.15.8:0/2478053116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b9c070e90 0x7f7b9c15da60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7b94009e50 tx=0x7f7b9401c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c0d2e23faa49bf server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:12.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.697+0000 7f7b9a000640 1 -- 172.21.15.8:0/2478053116 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b940a5660 con 0x7f7b9c070e90 2024-03-23T23:49:12.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.697+0000 7f7b9a000640 1 -- 172.21.15.8:0/2478053116 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b940a5800 con 0x7f7b9c070e90 2024-03-23T23:49:12.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.697+0000 7f7b9a000640 1 -- 172.21.15.8:0/2478053116 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b940a5bd0 con 0x7f7b9c070e90 2024-03-23T23:49:12.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.697+0000 7f7ba2400640 1 -- 172.21.15.8:0/2478053116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b9c070e90 msgr2=0x7f7b9c15da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:12.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.697+0000 7f7ba2400640 1 --2- 172.21.15.8:0/2478053116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b9c070e90 0x7f7b9c15da60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7b94009e50 tx=0x7f7b9401c8f0 comp rx=0 tx=0).stop 2024-03-23T23:49:12.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.705+0000 7f7ba2400640 1 -- 172.21.15.8:0/2478053116 shutdown_connections 2024-03-23T23:49:12.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.705+0000 7f7ba2400640 1 --2- 172.21.15.8:0/2478053116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b9c070e90 0x7f7b9c15da60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:12.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.705+0000 7f7ba2400640 1 --2- 172.21.15.8:0/2478053116 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7b9c0ac3b0 0x7f7b9c0c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:12.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.705+0000 7f7ba2400640 1 -- 172.21.15.8:0/2478053116 >> 172.21.15.8:0/2478053116 conn(0x7f7b9c06b170 msgr2=0x7f7b9c06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:49:12.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.705+0000 7f7ba2400640 1 -- 172.21.15.8:0/2478053116 shutdown_connections 2024-03-23T23:49:12.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.709+0000 7f7ba2400640 1 -- 172.21.15.8:0/2478053116 wait complete. 2024-03-23T23:49:12.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.709+0000 7f7ba2400640 1 Processor -- start 2024-03-23T23:49:12.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.709+0000 7f7ba2400640 1 -- start start 2024-03-23T23:49:12.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.713+0000 7f7ba2400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b9c070e90 0x7f7b9c1f6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:12.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.713+0000 7f7ba2400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7b9c0aa390 0x7f7b9c14b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:12.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.713+0000 7f7ba2400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7b9c0ac3b0 0x7f7b9c14b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:12.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.713+0000 7f7ba2400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c15dfa0 con 0x7f7b9c070e90 2024-03-23T23:49:12.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.713+0000 7f7ba2400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c15a9d0 con 0x7f7b9c0aa390 2024-03-23T23:49:12.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.713+0000 7f7ba2400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c166e00 con 0x7f7b9c0ac3b0 2024-03-23T23:49:12.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.713+0000 7f7b9be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7b9c0ac3b0 0x7f7b9c14b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:12.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.713+0000 7f7b9be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7b9c0ac3b0 0x7f7b9c14b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:53756/0 (socket says 172.21.15.8:53756) 2024-03-23T23:49:12.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.713+0000 7f7b9be00640 1 -- 172.21.15.8:0/1516989406 learned_addr learned my addr 172.21.15.8:0/1516989406 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:49:12.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.713+0000 7f7b9b400640 1 --2- 172.21.15.8:0/1516989406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b9c070e90 0x7f7b9c1f6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:12.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.713+0000 7f7b9be00640 1 -- 172.21.15.8:0/1516989406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7b9c0ac3b0 msgr2=0x7f7b9c14b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-03-23T23:49:12.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.713+0000 7f7b9be00640 1 -- 172.21.15.8:0/1516989406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7b9c0ac3b0 msgr2=0x7f7b9c14b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T23:49:12.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.713+0000 7f7b9be00640 1 --2- 172.21.15.8:0/1516989406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7b9c0ac3b0 0x7f7b9c14b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:49:12.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.713+0000 7f7b9be00640 1 --2- 172.21.15.8:0/1516989406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7b9c0ac3b0 0x7f7b9c14b590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:49:12.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.713+0000 7f7b9b400640 1 -- 172.21.15.8:0/1516989406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7b9c0ac3b0 msgr2=0x7f7b9c14b590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:49:12.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.713+0000 7f7b9b400640 1 --2- 172.21.15.8:0/1516989406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7b9c0ac3b0 0x7f7b9c14b590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:12.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.713+0000 7f7b9b400640 1 -- 172.21.15.8:0/1516989406 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7b9c0aa390 msgr2=0x7f7b9c14b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:12.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.713+0000 7f7b9b400640 1 --2- 172.21.15.8:0/1516989406 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7b9c0aa390 0x7f7b9c14b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:12.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.713+0000 7f7b9b400640 1 -- 172.21.15.8:0/1516989406 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9c1f7170 con 0x7f7b9c070e90 2024-03-23T23:49:12.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.717+0000 7f7b9b400640 1 --2- 172.21.15.8:0/1516989406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b9c070e90 0x7f7b9c1f6480 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00b440 tx=0x7f7b8c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:12.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.717+0000 7f7b93400640 1 -- 172.21.15.8:0/1516989406 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c015020 con 0x7f7b9c070e90 2024-03-23T23:49:12.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.717+0000 7f7b93400640 1 -- 172.21.15.8:0/1516989406 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8c011830 con 0x7f7b9c070e90 2024-03-23T23:49:12.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.717+0000 7f7b93400640 1 -- 172.21.15.8:0/1516989406 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c011c20 con 0x7f7b9c070e90 2024-03-23T23:49:12.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.717+0000 7f7ba2400640 1 -- 172.21.15.8:0/1516989406 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b9c14edd0 con 0x7f7b9c070e90 2024-03-23T23:49:12.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.721+0000 7f7ba2400640 1 -- 172.21.15.8:0/1516989406 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b9c1f6e90 con 0x7f7b9c070e90 2024-03-23T23:49:12.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.721+0000 7f7ba2400640 1 -- 172.21.15.8:0/1516989406 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b9c04f480 con 0x7f7b9c070e90 2024-03-23T23:49:12.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.725+0000 7f7b93400640 1 -- 172.21.15.8:0/1516989406 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f7b8c018020 con 0x7f7b9c070e90 2024-03-23T23:49:12.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.725+0000 7f7b93400640 1 --2- 172.21.15.8:0/1516989406 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7b7c0676b0 0x7f7b7c069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:12.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.725+0000 7f7b93400640 1 -- 172.21.15.8:0/1516989406 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f7b8c054360 con 0x7f7b9c070e90 2024-03-23T23:49:12.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.725+0000 7f7b9aa00640 1 --2- 172.21.15.8:0/1516989406 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7b7c0676b0 0x7f7b7c069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:12.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.729+0000 7f7b93400640 1 -- 172.21.15.8:0/1516989406 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f7b8c01f020 con 0x7f7b9c070e90 2024-03-23T23:49:12.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:12.729+0000 7f7b9aa00640 1 --2- 172.21.15.8:0/1516989406 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7b7c0676b0 0x7f7b7c069b70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c15c7f0 tx=0x7f7b880079c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:13.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:13.365+0000 7f7ba2400640 1 -- 172.21.15.8:0/1516989406 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f7b9c15add0 con 0x7f7b9c070e90 2024-03-23T23:49:13.367 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":46,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:49:13.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:13.365+0000 7f7b93400640 1 -- 172.21.15.8:0/1516989406 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1555 (secure 0 0 0) 0x7f7b8c00f2e0 con 0x7f7b9c070e90 2024-03-23T23:49:13.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:13.369+0000 7f7ba2400640 1 -- 172.21.15.8:0/1516989406 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7b7c0676b0 msgr2=0x7f7b7c069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:13.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:13.369+0000 7f7ba2400640 1 --2- 172.21.15.8:0/1516989406 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7b7c0676b0 0x7f7b7c069b70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c15c7f0 tx=0x7f7b880079c0 comp rx=0 tx=0).stop 2024-03-23T23:49:13.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:13.369+0000 7f7ba2400640 1 -- 172.21.15.8:0/1516989406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b9c070e90 msgr2=0x7f7b9c1f6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:13.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:13.369+0000 7f7ba2400640 1 --2- 172.21.15.8:0/1516989406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b9c070e90 0x7f7b9c1f6480 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00b440 tx=0x7f7b8c00b900 comp rx=0 tx=0).stop 2024-03-23T23:49:13.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:13.369+0000 7f7ba2400640 1 -- 172.21.15.8:0/1516989406 shutdown_connections 2024-03-23T23:49:13.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:13.369+0000 7f7ba2400640 1 --2- 172.21.15.8:0/1516989406 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7b7c0676b0 0x7f7b7c069b70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:13.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:13.369+0000 7f7ba2400640 1 --2- 172.21.15.8:0/1516989406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7b9c0ac3b0 0x7f7b9c14b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:13.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:13.369+0000 7f7ba2400640 1 --2- 172.21.15.8:0/1516989406 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7b9c0aa390 0x7f7b9c14b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:13.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:13.369+0000 7f7ba2400640 1 --2- 172.21.15.8:0/1516989406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b9c070e90 0x7f7b9c1f6480 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:13.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:13.369+0000 7f7ba2400640 1 -- 172.21.15.8:0/1516989406 >> 172.21.15.8:0/1516989406 conn(0x7f7b9c06b170 msgr2=0x7f7b9c163cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:49:13.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:13.369+0000 7f7ba2400640 1 -- 172.21.15.8:0/1516989406 shutdown_connections 2024-03-23T23:49:13.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:13.369+0000 7f7ba2400640 1 -- 172.21.15.8:0/1516989406 wait complete. 2024-03-23T23:49:13.816 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:49:13.824 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:49:16.444 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:49:16.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.837+0000 7fb16e000640 1 Processor -- start 2024-03-23T23:49:16.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.837+0000 7fb16e000640 1 -- start start 2024-03-23T23:49:16.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.837+0000 7fb16e000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb1600d3cf0 0x7fb160006be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:16.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.837+0000 7fb16e000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb160007120 0x7fb1600498b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:16.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.837+0000 7fb16e000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb160046f80 con 0x7fb16000b250 2024-03-23T23:49:16.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.837+0000 7fb16e000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb160046330 con 0x7fb1600d3cf0 2024-03-23T23:49:16.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.837+0000 7fb16e000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb160046810 con 0x7fb160007120 2024-03-23T23:49:16.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.841+0000 7fb166a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb1600d3cf0 0x7fb160006be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:16.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.841+0000 7fb166a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb1600d3cf0 0x7fb160006be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43378/0 (socket says 172.21.15.8:43378) 2024-03-23T23:49:16.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.841+0000 7fb166a00640 1 -- 172.21.15.8:0/2529795525 learned_addr learned my addr 172.21.15.8:0/2529795525 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:49:16.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.841+0000 7fb166a00640 1 -- 172.21.15.8:0/2529795525 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb160007120 msgr2=0x7fb1600498b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:49:16.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.841+0000 7fb166a00640 1 --2- 172.21.15.8:0/2529795525 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb160007120 0x7fb1600498b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:16.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.841+0000 7fb166a00640 1 -- 172.21.15.8:0/2529795525 >> v1:172.21.15.8:6789/0 conn(0x7fb16000b250 legacy=0x7fb160049df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:49:16.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.841+0000 7fb166a00640 1 -- 172.21.15.8:0/2529795525 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1600d7050 con 0x7fb1600d3cf0 2024-03-23T23:49:16.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.865+0000 7fb166a00640 1 --2- 172.21.15.8:0/2529795525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1600d3cf0 0x7fb160006be0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb15c014a00 tx=0x7fb15c025410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ba91a86077bc8f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:16.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.869+0000 7fb166000640 1 -- 172.21.15.8:0/2529795525 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c0b9070 con 0x7fb1600d3cf0 2024-03-23T23:49:16.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.869+0000 7fb166000640 1 -- 172.21.15.8:0/2529795525 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15c0112d0 con 0x7fb1600d3cf0 2024-03-23T23:49:16.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.869+0000 7fb166000640 1 -- 172.21.15.8:0/2529795525 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c0b9070 con 0x7fb1600d3cf0 2024-03-23T23:49:16.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.877+0000 7fb16e000640 1 -- 172.21.15.8:0/2529795525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1600d3cf0 msgr2=0x7fb160006be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:16.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.877+0000 7fb16e000640 1 --2- 172.21.15.8:0/2529795525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1600d3cf0 0x7fb160006be0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb15c014a00 tx=0x7fb15c025410 comp rx=0 tx=0).stop 2024-03-23T23:49:16.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.877+0000 7fb16e000640 1 -- 172.21.15.8:0/2529795525 shutdown_connections 2024-03-23T23:49:16.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.877+0000 7fb16e000640 1 --2- 172.21.15.8:0/2529795525 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb160007120 0x7fb1600498b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:16.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.877+0000 7fb16e000640 1 --2- 172.21.15.8:0/2529795525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1600d3cf0 0x7fb160006be0 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb15c014a00 tx=0x7fb15c025410 comp rx=0 tx=0).stop 2024-03-23T23:49:16.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.877+0000 7fb16e000640 1 -- 172.21.15.8:0/2529795525 >> 172.21.15.8:0/2529795525 conn(0x7fb1600060c0 msgr2=0x7fb1600064d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:49:16.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.881+0000 7fb16e000640 1 -- 172.21.15.8:0/2529795525 shutdown_connections 2024-03-23T23:49:16.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.885+0000 7fb16e000640 1 -- 172.21.15.8:0/2529795525 wait complete. 2024-03-23T23:49:16.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.885+0000 7fb16e000640 1 Processor -- start 2024-03-23T23:49:16.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.893+0000 7fb16e000640 1 -- start start 2024-03-23T23:49:16.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.897+0000 7fb16e000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb160007120 0x7fb1600cea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:16.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.897+0000 7fb16e000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb16000b250 0x7fb160172170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:16.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.897+0000 7fb16e000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1601726b0 0x7fb1600cf730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:16.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.897+0000 7fb16ca00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb16000b250 0x7fb160172170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:16.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.897+0000 7fb16ca00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb16000b250 0x7fb160172170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43384/0 (socket says 172.21.15.8:43384) 2024-03-23T23:49:16.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.897+0000 7fb16e000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb160007990 con 0x7fb16000b250 2024-03-23T23:49:16.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.897+0000 7fb16e000640 1 -- 172.21.15.8:0/427617720 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb160007810 con 0x7fb1601726b0 2024-03-23T23:49:16.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.897+0000 7fb16ca00640 1 -- 172.21.15.8:0/427617720 learned_addr learned my addr 172.21.15.8:0/427617720 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:49:16.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.897+0000 7fb16e000640 1 -- 172.21.15.8:0/427617720 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb16000bb40 con 0x7fb160007120 2024-03-23T23:49:16.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.901+0000 7fb16ca00640 1 -- 172.21.15.8:0/427617720 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb160007120 msgr2=0x7fb1600cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:16.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.901+0000 7fb16ca00640 1 --2- 172.21.15.8:0/427617720 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb160007120 0x7fb1600cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:16.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.901+0000 7fb16ca00640 1 -- 172.21.15.8:0/427617720 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1601726b0 msgr2=0x7fb1600cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:16.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.901+0000 7fb16ca00640 1 --2- 172.21.15.8:0/427617720 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1601726b0 0x7fb1600cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:16.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.901+0000 7fb16ca00640 1 -- 172.21.15.8:0/427617720 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1600cefb0 con 0x7fb16000b250 2024-03-23T23:49:16.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.901+0000 7fb16ca00640 1 --2- 172.21.15.8:0/427617720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb16000b250 0x7fb160172170 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb168000b70 tx=0x7fb168073410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:16.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.909+0000 7fb15b400640 1 -- 172.21.15.8:0/427617720 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16806f410 con 0x7fb16000b250 2024-03-23T23:49:16.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.909+0000 7fb15b400640 1 -- 172.21.15.8:0/427617720 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16808f030 con 0x7fb16000b250 2024-03-23T23:49:16.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.909+0000 7fb15b400640 1 -- 172.21.15.8:0/427617720 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16806f690 con 0x7fb16000b250 2024-03-23T23:49:16.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.917+0000 7fb16e000640 1 -- 172.21.15.8:0/427617720 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb160172c00 con 0x7fb16000b250 2024-03-23T23:49:16.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.929+0000 7fb16e000640 1 -- 172.21.15.8:0/427617720 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb160042ee0 con 0x7fb16000b250 2024-03-23T23:49:16.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.933+0000 7fb15b400640 1 -- 172.21.15.8:0/427617720 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb16806f830 con 0x7fb16000b250 2024-03-23T23:49:16.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.937+0000 7fb16e000640 1 -- 172.21.15.8:0/427617720 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1600054a0 con 0x7fb16000b250 2024-03-23T23:49:16.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.937+0000 7fb15b400640 1 --2- 172.21.15.8:0/427617720 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb1480676b0 0x7fb148069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:16.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.949+0000 7fb166a00640 1 --2- 172.21.15.8:0/427617720 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb1480676b0 0x7fb148069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:16.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.953+0000 7fb15b400640 1 -- 172.21.15.8:0/427617720 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fb1680cc3c0 con 0x7fb16000b250 2024-03-23T23:49:16.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.965+0000 7fb166a00640 1 --2- 172.21.15.8:0/427617720 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb1480676b0 0x7fb148069b70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb15c0b6000 tx=0x7fb15c004ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:16.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:16.981+0000 7fb15b400640 1 -- 172.21.15.8:0/427617720 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fb1680d0d70 con 0x7fb16000b250 2024-03-23T23:49:17.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:17.737+0000 7fb16e000640 1 -- 172.21.15.8:0/427617720 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb1600075f0 con 0x7fb16000b250 2024-03-23T23:49:17.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:17.749+0000 7fb15b400640 1 -- 172.21.15.8:0/427617720 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1560 (secure 0 0 0) 0x7fb1680d0670 con 0x7fb16000b250 2024-03-23T23:49:17.756 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":48,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:49:17.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:17.769+0000 7fb16e000640 1 -- 172.21.15.8:0/427617720 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb1480676b0 msgr2=0x7fb148069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:17.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:17.769+0000 7fb16e000640 1 --2- 172.21.15.8:0/427617720 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb1480676b0 0x7fb148069b70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb15c0b6000 tx=0x7fb15c004ac0 comp rx=0 tx=0).stop 2024-03-23T23:49:17.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:17.769+0000 7fb16e000640 1 -- 172.21.15.8:0/427617720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb16000b250 msgr2=0x7fb160172170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:17.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:17.769+0000 7fb16e000640 1 --2- 172.21.15.8:0/427617720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb16000b250 0x7fb160172170 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb168000b70 tx=0x7fb168073410 comp rx=0 tx=0).stop 2024-03-23T23:49:17.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:17.769+0000 7fb16e000640 1 -- 172.21.15.8:0/427617720 shutdown_connections 2024-03-23T23:49:17.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:17.769+0000 7fb16e000640 1 --2- 172.21.15.8:0/427617720 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1601726b0 0x7fb1600cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:17.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:17.769+0000 7fb16e000640 1 --2- 172.21.15.8:0/427617720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb16000b250 0x7fb160172170 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:17.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:17.769+0000 7fb16e000640 1 --2- 172.21.15.8:0/427617720 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb1480676b0 0x7fb148069b70 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:17.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:17.769+0000 7fb16e000640 1 --2- 172.21.15.8:0/427617720 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb160007120 0x7fb1600cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:17.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:17.769+0000 7fb16e000640 1 -- 172.21.15.8:0/427617720 >> 172.21.15.8:0/427617720 conn(0x7fb1600060c0 msgr2=0x7fb1600d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:49:17.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:17.773+0000 7fb16e000640 1 -- 172.21.15.8:0/427617720 shutdown_connections 2024-03-23T23:49:17.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:17.773+0000 7fb16e000640 1 -- 172.21.15.8:0/427617720 wait complete. 2024-03-23T23:49:17.853 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T23:49:17.854 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T23:49:17.854 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:49:18.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.205+0000 7ff3d3200640 1 Processor -- start 2024-03-23T23:49:18.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.209+0000 7ff3d3200640 1 -- start start 2024-03-23T23:49:18.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.209+0000 7ff3d3200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff3cc0d3bd0 0x7ff3cc006be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:18.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.209+0000 7ff3d3200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff3cc0d80b0 0x7ff3cc0e0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:18.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.209+0000 7ff3d3200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3cc0d8500 con 0x7ff3cc007120 2024-03-23T23:49:18.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.209+0000 7ff3d3200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3cc0d7500 con 0x7ff3cc0d3bd0 2024-03-23T23:49:18.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.209+0000 7ff3d3200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc0d7070 con 0x7ff3cc0d80b0 2024-03-23T23:49:18.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.213+0000 7ff3d1e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff3cc0d3bd0 0x7ff3cc006be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:18.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.213+0000 7ff3d1e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff3cc0d3bd0 0x7ff3cc006be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:52090/0 (socket says 172.21.15.8:52090) 2024-03-23T23:49:18.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.213+0000 7ff3d1e00640 1 -- 172.21.15.8:0/3126935610 learned_addr learned my addr 172.21.15.8:0/3126935610 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:49:18.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.213+0000 7ff3d8c00640 1 --2- 172.21.15.8:0/3126935610 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff3cc0d80b0 0x7ff3cc0e0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:18.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.213+0000 7ff3d1e00640 1 -- 172.21.15.8:0/3126935610 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff3cc0d80b0 msgr2=0x7ff3cc0e0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:49:18.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.213+0000 7ff3d1e00640 1 --2- 172.21.15.8:0/3126935610 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff3cc0d80b0 0x7ff3cc0e0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:18.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.213+0000 7ff3d1e00640 1 -- 172.21.15.8:0/3126935610 >> v1:172.21.15.8:6789/0 conn(0x7ff3cc007120 legacy=0x7ff3cc0d79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:18.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.213+0000 7ff3d1e00640 1 -- 172.21.15.8:0/3126935610 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3cc0d3fb0 con 0x7ff3cc0d3bd0 2024-03-23T23:49:18.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.225+0000 7ff3d1e00640 1 --2- 172.21.15.8:0/3126935610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3cc0d3bd0 0x7ff3cc006be0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4008870 tx=0x7ff3c4021270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff683dee2bd6ca90 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:18.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.233+0000 7ff3d0a00640 1 -- 172.21.15.8:0/3126935610 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c40b8070 con 0x7ff3cc0d3bd0 2024-03-23T23:49:18.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.233+0000 7ff3d0a00640 1 -- 172.21.15.8:0/3126935610 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c40b3410 con 0x7ff3cc0d3bd0 2024-03-23T23:49:18.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.233+0000 7ff3d0a00640 1 -- 172.21.15.8:0/3126935610 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c40b37e0 con 0x7ff3cc0d3bd0 2024-03-23T23:49:18.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.237+0000 7ff3d3200640 1 -- 172.21.15.8:0/3126935610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3cc0d3bd0 msgr2=0x7ff3cc006be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:18.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.237+0000 7ff3d3200640 1 --2- 172.21.15.8:0/3126935610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3cc0d3bd0 0x7ff3cc006be0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4008870 tx=0x7ff3c4021270 comp rx=0 tx=0).stop 2024-03-23T23:49:18.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.237+0000 7ff3d3200640 1 -- 172.21.15.8:0/3126935610 shutdown_connections 2024-03-23T23:49:18.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.237+0000 7ff3d3200640 1 --2- 172.21.15.8:0/3126935610 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff3cc0d80b0 0x7ff3cc0e0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:18.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.237+0000 7ff3d3200640 1 --2- 172.21.15.8:0/3126935610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3cc0d3bd0 0x7ff3cc006be0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:18.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.237+0000 7ff3d3200640 1 -- 172.21.15.8:0/3126935610 >> 172.21.15.8:0/3126935610 conn(0x7ff3cc0060c0 msgr2=0x7ff3cc0064d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:49:18.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.237+0000 7ff3d3200640 1 -- 172.21.15.8:0/3126935610 shutdown_connections 2024-03-23T23:49:18.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.237+0000 7ff3d3200640 1 -- 172.21.15.8:0/3126935610 wait complete. 2024-03-23T23:49:18.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.245+0000 7ff3d3200640 1 Processor -- start 2024-03-23T23:49:18.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.249+0000 7ff3d3200640 1 -- start start 2024-03-23T23:49:18.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.249+0000 7ff3d3200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff3cc007120 0x7ff3cc0d43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:18.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.249+0000 7ff3d3200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3cc0d3bd0 0x7ff3cc04aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:18.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.249+0000 7ff3d3200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3cc0d80b0 0x7ff3cc16c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:18.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.249+0000 7ff3d3200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc0d6d00 con 0x7ff3cc0d80b0 2024-03-23T23:49:18.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.249+0000 7ff3d3200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc0d6a20 con 0x7ff3cc0d3bd0 2024-03-23T23:49:18.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.249+0000 7ff3d3200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc02e310 con 0x7ff3cc007120 2024-03-23T23:49:18.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.253+0000 7ff3d8c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3cc0d80b0 0x7ff3cc16c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:18.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.253+0000 7ff3d8c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3cc0d80b0 0x7ff3cc16c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43388/0 (socket says 172.21.15.8:43388) 2024-03-23T23:49:18.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.253+0000 7ff3d8c00640 1 -- 172.21.15.8:0/4268097152 learned_addr learned my addr 172.21.15.8:0/4268097152 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:49:18.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.253+0000 7ff3d8c00640 1 -- 172.21.15.8:0/4268097152 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff3cc007120 msgr2=0x7ff3cc0d43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:18.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.253+0000 7ff3d8c00640 1 --2- 172.21.15.8:0/4268097152 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff3cc007120 0x7ff3cc0d43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:18.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.253+0000 7ff3d8c00640 1 -- 172.21.15.8:0/4268097152 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3cc0d3bd0 msgr2=0x7ff3cc04aa60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:49:18.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.253+0000 7ff3d8c00640 1 --2- 172.21.15.8:0/4268097152 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3cc0d3bd0 0x7ff3cc04aa60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:18.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.253+0000 7ff3d8c00640 1 -- 172.21.15.8:0/4268097152 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3cc0d5cf0 con 0x7ff3cc0d80b0 2024-03-23T23:49:18.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.253+0000 7ff3d8c00640 1 --2- 172.21.15.8:0/4268097152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3cc0d80b0 0x7ff3cc16c1d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4069980 tx=0x7ff3d4068d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:18.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.257+0000 7ff3ca000640 1 -- 172.21.15.8:0/4268097152 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d40737a0 con 0x7ff3cc0d80b0 2024-03-23T23:49:18.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.257+0000 7ff3ca000640 1 -- 172.21.15.8:0/4268097152 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d4095850 con 0x7ff3cc0d80b0 2024-03-23T23:49:18.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.257+0000 7ff3ca000640 1 -- 172.21.15.8:0/4268097152 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4095c20 con 0x7ff3cc0d80b0 2024-03-23T23:49:18.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.265+0000 7ff3d3200640 1 -- 172.21.15.8:0/4268097152 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3cc0d5fd0 con 0x7ff3cc0d80b0 2024-03-23T23:49:18.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.265+0000 7ff3d3200640 1 -- 172.21.15.8:0/4268097152 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3cc16bcb0 con 0x7ff3cc0d80b0 2024-03-23T23:49:18.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.269+0000 7ff3ca000640 1 -- 172.21.15.8:0/4268097152 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff3d409e430 con 0x7ff3cc0d80b0 2024-03-23T23:49:18.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.273+0000 7ff3ca000640 1 --2- 172.21.15.8:0/4268097152 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff3b40676b0 0x7ff3b4069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:18.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.273+0000 7ff3ca000640 1 -- 172.21.15.8:0/4268097152 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7ff3d410a040 con 0x7ff3cc0d80b0 2024-03-23T23:49:18.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.273+0000 7ff3d1e00640 1 --2- 172.21.15.8:0/4268097152 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff3b40676b0 0x7ff3b4069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:18.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.277+0000 7ff3d3200640 1 --2- 172.21.15.8:0/4268097152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3ac002a80 0x7ff3ac004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:18.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.277+0000 7ff3d3200640 1 -- 172.21.15.8:0/4268097152 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac007ed0 con 0x7ff3ac002a80 2024-03-23T23:49:18.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.281+0000 7ff3d1400640 1 --2- 172.21.15.8:0/4268097152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3ac002a80 0x7ff3ac004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:18.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.281+0000 7ff3d1e00640 1 --2- 172.21.15.8:0/4268097152 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff3b40676b0 0x7ff3b4069b70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40b5000 tx=0x7ff3c4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:18.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.281+0000 7ff3d1400640 1 -- 172.21.15.8:0/4268097152 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff3ac0080d0 con 0x7ff3ac002a80 2024-03-23T23:49:18.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.285+0000 7ff3d1400640 1 --2- 172.21.15.8:0/4268097152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3ac002a80 0x7ff3ac004f40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc04b750 tx=0x7ff3c000c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:18.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.289+0000 7ff3ca000640 1 -- 172.21.15.8:0/4268097152 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c00052d0 con 0x7ff3ac002a80 2024-03-23T23:49:18.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.289+0000 7ff3ca000640 1 -- 172.21.15.8:0/4268097152 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7ff3c00052d0 con 0x7ff3ac002a80 2024-03-23T23:49:18.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.289+0000 7ff3ca000640 1 -- 172.21.15.8:0/4268097152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3ac002a80 msgr2=0x7ff3ac004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:18.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.289+0000 7ff3ca000640 1 --2- 172.21.15.8:0/4268097152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3ac002a80 0x7ff3ac004f40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc04b750 tx=0x7ff3c000c7a0 comp rx=0 tx=0).stop 2024-03-23T23:49:18.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.289+0000 7ff3ca000640 1 -- 172.21.15.8:0/4268097152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3ac002a80 msgr2=0x7ff3ac004f40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:49:18.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.289+0000 7ff3ca000640 1 --2- 172.21.15.8:0/4268097152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3ac002a80 0x7ff3ac004f40 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc04b750 tx=0x7ff3c000c7a0 comp rx=0 tx=0).stop 2024-03-23T23:49:18.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.313+0000 7ff3d3200640 1 --2- 172.21.15.8:0/4268097152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3ac006ec0 0x7ff3ac007350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:18.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.313+0000 7ff3d3200640 1 -- 172.21.15.8:0/4268097152 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac00a4b0 con 0x7ff3ac006ec0 2024-03-23T23:49:18.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.321+0000 7ff3d1400640 1 --2- 172.21.15.8:0/4268097152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3ac006ec0 0x7ff3ac007350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:18.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.325+0000 7ff3d1400640 1 -- 172.21.15.8:0/4268097152 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff3ac007890 con 0x7ff3ac006ec0 2024-03-23T23:49:18.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.329+0000 7ff3d1400640 1 --2- 172.21.15.8:0/4268097152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3ac006ec0 0x7ff3ac007350 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0000c10 tx=0x7ff3c0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:18.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.329+0000 7ff3ca000640 1 -- 172.21.15.8:0/4268097152 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c001ac90 con 0x7ff3ac006ec0 2024-03-23T23:49:18.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.329+0000 7ff3ca000640 1 -- 172.21.15.8:0/4268097152 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4871 (secure 0 0 0) 0x7ff3c0011650 con 0x7ff3ac006ec0 2024-03-23T23:49:18.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.329+0000 7ff3ca000640 1 -- 172.21.15.8:0/4268097152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3ac006ec0 msgr2=0x7ff3ac007350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:18.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.329+0000 7ff3ca000640 1 --2- 172.21.15.8:0/4268097152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3ac006ec0 0x7ff3ac007350 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0000c10 tx=0x7ff3c0000ee0 comp rx=0 tx=0).stop 2024-03-23T23:49:18.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.329+0000 7ff3ca000640 1 -- 172.21.15.8:0/4268097152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3ac006ec0 msgr2=0x7ff3ac007350 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:49:18.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.329+0000 7ff3ca000640 1 --2- 172.21.15.8:0/4268097152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3ac006ec0 0x7ff3ac007350 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0000c10 tx=0x7ff3c0000ee0 comp rx=0 tx=0).stop 2024-03-23T23:49:18.331 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:49:18.331 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:49:18.331 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:49:18.331 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:49:18.331 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 48, 2024-03-23T23:49:18.332 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:49:18.332 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:49:18.332 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:49:18.332 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:49:18.332 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:18.332 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 2, 2024-03-23T23:49:18.332 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:49:18.332 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:49:18.332 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:49:18.332 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:49:18.332 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:49:18.332 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:49:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:49:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:49:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:49:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:49:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:49:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:49:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:49:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:49:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:49:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:49:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:49:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:49:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:49:18.334 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:49:18.334 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:49:18.334 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:49:18.334 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:49:18.334 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:49:18.334 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:49:18.334 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:49:18.334 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:49:18.334 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:18.334 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:18.334 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:49:18.334 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:49:18.334 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:49:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:49:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:49:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:49:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:49:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:49:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:49:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:49:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:49:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:49:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:49:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:49:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:49:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:49:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:49:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:49:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:49:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:49:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:49:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:49:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:49:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:49:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:49:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:49:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:49:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:49:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:49:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:49:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:49:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:49:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:49:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:49:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:49:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:49:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:49:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:49:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:49:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:49:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:49:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:49:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:49:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:49:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:49:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:49:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:49:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:49:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:49:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:49:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:49:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:49:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:49:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:49:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:49:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:49:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:49:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:49:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:49:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:49:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:49:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:49:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:49:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:49:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:49:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:49:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:49:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:49:18.342 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:49:18.342 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:18.342 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:18.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:18.342 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:49:18.342 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:49:18.342 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:18.342 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:49:18.342 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:18.342 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:49:18.342 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:18.342 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:18.342 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:49:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:49:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:49:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:49:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:49:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:49:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:49:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:18.344 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:49:18.344 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:18.344 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:49:18.344 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:18.344 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:18.344 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:18.344 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:49:18.344 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:49:18.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.329+0000 7ff3d3200640 1 -- 172.21.15.8:0/4268097152 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff3b40676b0 msgr2=0x7ff3b4069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:18.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.329+0000 7ff3d3200640 1 --2- 172.21.15.8:0/4268097152 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff3b40676b0 0x7ff3b4069b70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40b5000 tx=0x7ff3c4008040 comp rx=0 tx=0).stop 2024-03-23T23:49:18.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.329+0000 7ff3d3200640 1 -- 172.21.15.8:0/4268097152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3cc0d80b0 msgr2=0x7ff3cc16c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:18.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.329+0000 7ff3d3200640 1 --2- 172.21.15.8:0/4268097152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3cc0d80b0 0x7ff3cc16c1d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4069980 tx=0x7ff3d4068d50 comp rx=0 tx=0).stop 2024-03-23T23:49:18.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.329+0000 7ff3d8c00640 1 -- 172.21.15.8:0/4268097152 reap_dead start 2024-03-23T23:49:18.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.329+0000 7ff3d8c00640 1 -- 172.21.15.8:0/4268097152 reap_dead start 2024-03-23T23:49:18.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.329+0000 7ff3d3200640 1 -- 172.21.15.8:0/4268097152 shutdown_connections 2024-03-23T23:49:18.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.329+0000 7ff3d3200640 1 -- 172.21.15.8:0/4268097152 >> 172.21.15.8:0/4268097152 conn(0x7ff3cc0060c0 msgr2=0x7ff3cc0cd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:49:18.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.329+0000 7ff3d3200640 1 -- 172.21.15.8:0/4268097152 shutdown_connections 2024-03-23T23:49:18.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.329+0000 7ff3d3200640 1 -- 172.21.15.8:0/4268097152 wait complete. 2024-03-23T23:49:18.379 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:49:18.379 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T23:49:18.380 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:49:18.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.681+0000 7f3ee3200640 1 Processor -- start 2024-03-23T23:49:18.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.681+0000 7f3ee3200640 1 -- start start 2024-03-23T23:49:18.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.685+0000 7f3ee3200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3edc0d7b00 0x7f3edc007230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:18.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.685+0000 7f3ee3200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3edc0432a0 0x7f3edc00e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:18.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.685+0000 7f3ee1e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3edc0d7b00 0x7f3edc007230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:18.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.685+0000 7f3ee1400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f3edc04db10 0x7f3edc00e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:44036/0 (socket says 172.21.15.8:44036) 2024-03-23T23:49:18.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.685+0000 7f3ee1e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3edc0d7b00 0x7f3edc007230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:52104/0 (socket says 172.21.15.8:52104) 2024-03-23T23:49:18.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.685+0000 7f3ee2800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3edc0432a0 0x7f3edc00e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:18.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.685+0000 7f3ee2800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3edc0432a0 0x7f3edc00e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43410/0 (socket says 172.21.15.8:43410) 2024-03-23T23:49:18.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.685+0000 7f3ee1400640 1 -- 172.21.15.8:0/1517839487 learned_addr learned my addr 172.21.15.8:0/1517839487 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:49:18.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.685+0000 7f3ee3200640 1 -- 172.21.15.8:0/1517839487 --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3edc0dae60 con 0x7f3edc04db10 2024-03-23T23:49:18.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.685+0000 7f3ee3200640 1 -- 172.21.15.8:0/1517839487 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3edc04abe0 con 0x7f3edc0432a0 2024-03-23T23:49:18.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.685+0000 7f3ee3200640 1 -- 172.21.15.8:0/1517839487 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3edc0db140 con 0x7f3edc0d7b00 2024-03-23T23:49:18.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.689+0000 7f3ee2800640 1 -- 172.21.15.8:0/1517839487 >> v2:172.21.15.196:3300/0 conn(0x7f3edc0d7b00 msgr2=0x7f3edc007230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:49:18.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.689+0000 7f3ee2800640 1 --2- 172.21.15.8:0/1517839487 >> v2:172.21.15.196:3300/0 conn(0x7f3edc0d7b00 0x7f3edc007230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:18.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.689+0000 7f3ee2800640 1 -- 172.21.15.8:0/1517839487 >> v1:172.21.15.8:6789/0 conn(0x7f3edc04db10 legacy=0x7f3edc00e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:18.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.689+0000 7f3ee2800640 1 -- 172.21.15.8:0/1517839487 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3edc04a590 con 0x7f3edc0432a0 2024-03-23T23:49:18.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.697+0000 7f3ee2800640 1 --2- 172.21.15.8:0/1517839487 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3edc0432a0 0x7f3edc00e8f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3ee402d610 tx=0x7f3ee40984a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64654666d884569 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:18.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.701+0000 7f3ee0a00640 1 -- 172.21.15.8:0/1517839487 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee412c070 con 0x7f3edc0432a0 2024-03-23T23:49:18.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.701+0000 7f3ee0a00640 1 -- 172.21.15.8:0/1517839487 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee4127600 con 0x7f3edc0432a0 2024-03-23T23:49:18.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.701+0000 7f3ee0a00640 1 -- 172.21.15.8:0/1517839487 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee412c070 con 0x7f3edc0432a0 2024-03-23T23:49:18.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.705+0000 7f3ee3200640 1 -- 172.21.15.8:0/1517839487 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3edc0432a0 msgr2=0x7f3edc00e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:18.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.705+0000 7f3ee3200640 1 --2- 172.21.15.8:0/1517839487 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3edc0432a0 0x7f3edc00e8f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3ee402d610 tx=0x7f3ee40984a0 comp rx=0 tx=0).stop 2024-03-23T23:49:18.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.709+0000 7f3ee3200640 1 -- 172.21.15.8:0/1517839487 shutdown_connections 2024-03-23T23:49:18.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.709+0000 7f3ee3200640 1 --2- 172.21.15.8:0/1517839487 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3edc0432a0 0x7f3edc00e8f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:18.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.709+0000 7f3ee3200640 1 --2- 172.21.15.8:0/1517839487 >> v2:172.21.15.196:3300/0 conn(0x7f3edc0d7b00 0x7f3edc007230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:18.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.709+0000 7f3ee3200640 1 -- 172.21.15.8:0/1517839487 >> 172.21.15.8:0/1517839487 conn(0x7f3edc04c690 msgr2=0x7f3edc04caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:49:18.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.709+0000 7f3ee3200640 1 -- 172.21.15.8:0/1517839487 shutdown_connections 2024-03-23T23:49:18.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.709+0000 7f3ee3200640 1 -- 172.21.15.8:0/1517839487 wait complete. 2024-03-23T23:49:18.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.713+0000 7f3ee3200640 1 Processor -- start 2024-03-23T23:49:18.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.713+0000 7f3ee3200640 1 -- start start 2024-03-23T23:49:18.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.717+0000 7f3ee3200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3edc0432a0 0x7f3edc0d4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:18.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.717+0000 7f3ee3200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3edc04db10 0x7f3edc17cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:18.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.717+0000 7f3ee3200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3edc0e4280 0x7f3edc17d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:18.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.717+0000 7f3ee3200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc0e75d0 con 0x7f3edc04db10 2024-03-23T23:49:18.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.717+0000 7f3ee3200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc0e7450 con 0x7f3edc0e4280 2024-03-23T23:49:18.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.717+0000 7f3ee3200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc0e7750 con 0x7f3edc0432a0 2024-03-23T23:49:18.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.717+0000 7f3ee1e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3edc0432a0 0x7f3edc0d4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:18.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.717+0000 7f3ee1400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3edc04db10 0x7f3edc17cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:18.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.717+0000 7f3ee1e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3edc0432a0 0x7f3edc0d4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:44402/0 (socket says 172.21.15.8:44402) 2024-03-23T23:49:18.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.717+0000 7f3ee1e00640 1 -- 172.21.15.8:0/2139799457 learned_addr learned my addr 172.21.15.8:0/2139799457 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:49:18.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.717+0000 7f3ee2800640 1 --2- 172.21.15.8:0/2139799457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3edc0e4280 0x7f3edc17d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:18.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.717+0000 7f3ee1400640 1 -- 172.21.15.8:0/2139799457 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3edc0432a0 msgr2=0x7f3edc0d4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:18.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.717+0000 7f3ee1400640 1 --2- 172.21.15.8:0/2139799457 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3edc0432a0 0x7f3edc0d4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:18.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.717+0000 7f3ee1400640 1 -- 172.21.15.8:0/2139799457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3edc0e4280 msgr2=0x7f3edc17d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:18.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.717+0000 7f3ee1400640 1 --2- 172.21.15.8:0/2139799457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3edc0e4280 0x7f3edc17d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:18.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.717+0000 7f3ee1400640 1 -- 172.21.15.8:0/2139799457 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3edc046680 con 0x7f3edc04db10 2024-03-23T23:49:18.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.721+0000 7f3ee1400640 1 --2- 172.21.15.8:0/2139799457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3edc04db10 0x7f3edc17cb30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3ed000c430 tx=0x7f3ed000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:18.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.721+0000 7f3eda000640 1 -- 172.21.15.8:0/2139799457 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0017070 con 0x7f3edc04db10 2024-03-23T23:49:18.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.721+0000 7f3eda000640 1 -- 172.21.15.8:0/2139799457 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed0005cf0 con 0x7f3edc04db10 2024-03-23T23:49:18.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.721+0000 7f3eda000640 1 -- 172.21.15.8:0/2139799457 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed00072d0 con 0x7f3edc04db10 2024-03-23T23:49:18.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.721+0000 7f3ee3200640 1 -- 172.21.15.8:0/2139799457 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3edc0e3fa0 con 0x7f3edc04db10 2024-03-23T23:49:18.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.721+0000 7f3ee3200640 1 -- 172.21.15.8:0/2139799457 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3edc0e4710 con 0x7f3edc04db10 2024-03-23T23:49:18.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.725+0000 7f3ecf400640 1 --2- 172.21.15.8:0/2139799457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3edc0d7b00 0x7f3edc0dd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:18.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.725+0000 7f3ecf400640 1 -- 172.21.15.8:0/2139799457 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc1807a0 con 0x7f3edc0d7b00 2024-03-23T23:49:18.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.729+0000 7f3eda000640 1 -- 172.21.15.8:0/2139799457 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3ed001a070 con 0x7f3edc04db10 2024-03-23T23:49:18.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.729+0000 7f3ee1e00640 1 --2- 172.21.15.8:0/2139799457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3edc0d7b00 0x7f3edc0dd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:18.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.729+0000 7f3ee1e00640 1 -- 172.21.15.8:0/2139799457 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3edc0dd6b0 con 0x7f3edc0d7b00 2024-03-23T23:49:18.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.733+0000 7f3eda000640 1 --2- 172.21.15.8:0/2139799457 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3ec4067660 0x7f3ec4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:18.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.733+0000 7f3eda000640 1 -- 172.21.15.8:0/2139799457 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f3ed0084df0 con 0x7f3edc04db10 2024-03-23T23:49:18.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.733+0000 7f3ee2800640 1 --2- 172.21.15.8:0/2139799457 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3ec4067660 0x7f3ec4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:18.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.737+0000 7f3ee1e00640 1 --2- 172.21.15.8:0/2139799457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3edc0d7b00 0x7f3edc0dd170 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3ed400f4d0 tx=0x7f3ed400f990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:18.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.737+0000 7f3ee2800640 1 --2- 172.21.15.8:0/2139799457 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3ec4067660 0x7f3ec4069b20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3edc050d10 tx=0x7f3ee4122000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:18.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.741+0000 7f3eda000640 1 -- 172.21.15.8:0/2139799457 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4019030 con 0x7f3edc0d7b00 2024-03-23T23:49:18.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.741+0000 7f3eda000640 1 -- 172.21.15.8:0/2139799457 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f3ed4004020 con 0x7f3edc0d7b00 2024-03-23T23:49:18.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.741+0000 7f3eda000640 1 -- 172.21.15.8:0/2139799457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3edc0d7b00 msgr2=0x7f3edc0dd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:18.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.741+0000 7f3eda000640 1 --2- 172.21.15.8:0/2139799457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3edc0d7b00 0x7f3edc0dd170 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3ed400f4d0 tx=0x7f3ed400f990 comp rx=0 tx=0).stop 2024-03-23T23:49:18.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.741+0000 7f3eda000640 1 -- 172.21.15.8:0/2139799457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3edc0d7b00 msgr2=0x7f3edc0dd170 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:49:18.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.741+0000 7f3eda000640 1 --2- 172.21.15.8:0/2139799457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3edc0d7b00 0x7f3edc0dd170 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:18.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.773+0000 7f3ecf400640 1 --2- 172.21.15.8:0/2139799457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3edc043680 0x7f3edc182df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:18.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.773+0000 7f3ecf400640 1 -- 172.21.15.8:0/2139799457 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc0052d0 con 0x7f3edc043680 2024-03-23T23:49:18.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.773+0000 7f3ee1e00640 1 --2- 172.21.15.8:0/2139799457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3edc043680 0x7f3edc182df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:18.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.777+0000 7f3ee1e00640 1 -- 172.21.15.8:0/2139799457 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3edc00fab0 con 0x7f3edc043680 2024-03-23T23:49:18.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.777+0000 7f3ee1e00640 1 --2- 172.21.15.8:0/2139799457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3edc043680 0x7f3edc182df0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3ed400f4d0 tx=0x7f3ed40046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:18.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.777+0000 7f3eda000640 1 -- 172.21.15.8:0/2139799457 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4014d80 con 0x7f3edc043680 2024-03-23T23:49:18.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.785+0000 7f3eda000640 1 -- 172.21.15.8:0/2139799457 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5182 (secure 0 0 0) 0x7f3ed4003620 con 0x7f3edc043680 2024-03-23T23:49:18.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.785+0000 7f3eda000640 1 -- 172.21.15.8:0/2139799457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3edc043680 msgr2=0x7f3edc182df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:18.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.785+0000 7f3eda000640 1 --2- 172.21.15.8:0/2139799457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3edc043680 0x7f3edc182df0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3ed400f4d0 tx=0x7f3ed40046d0 comp rx=0 tx=0).stop 2024-03-23T23:49:18.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.785+0000 7f3eda000640 1 -- 172.21.15.8:0/2139799457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3edc043680 msgr2=0x7f3edc182df0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:49:18.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.785+0000 7f3eda000640 1 --2- 172.21.15.8:0/2139799457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3edc043680 0x7f3edc182df0 secure :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3ed400f4d0 tx=0x7f3ed40046d0 comp rx=0 tx=0).stop 2024-03-23T23:49:18.793 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:49:18.793 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:49:18.793 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:49:18.793 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:49:18.793 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 48, 2024-03-23T23:49:18.793 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:49:18.793 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:49:18.793 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:49:18.793 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:49:18.793 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:18.793 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 2, 2024-03-23T23:49:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:49:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:49:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:49:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:49:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:49:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:49:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:49:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:49:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:49:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:49:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:49:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:49:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:49:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:49:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:49:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:49:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:49:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:49:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:49:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:49:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:49:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:49:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:49:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:49:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:49:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:49:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:49:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:49:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:49:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:49:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:49:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:49:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:49:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:49:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:49:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:49:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:49:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:49:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:49:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:49:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:49:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:49:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:49:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:49:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:49:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:49:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:49:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:49:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:49:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:49:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:49:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:49:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:49:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:49:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:49:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:49:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:49:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:49:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:49:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:49:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:49:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:49:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:49:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:49:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:49:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:49:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:49:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:49:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:49:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:49:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:49:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:49:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:49:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:49:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:49:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:49:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:49:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:49:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:49:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:49:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:49:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:49:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:49:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:18.802 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:49:18.802 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:49:18.802 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:49:18.802 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:49:18.802 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:18.802 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:49:18.802 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:49:18.802 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:18.802 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:18.802 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:18.802 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:49:18.802 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:49:18.802 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:49:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:49:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:49:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:49:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:49:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:49:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:49:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:49:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:49:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:49:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:49:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:49:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:49:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:49:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:49:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:49:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:49:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:49:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:49:18.806 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:18.806 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:49:18.806 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:18.806 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:18.806 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:49:18.806 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:18.806 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:49:18.806 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:18.806 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:49:18.806 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:18.806 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:18.806 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:18.806 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:49:18.806 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:49:18.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.793+0000 7f3ecf400640 1 -- 172.21.15.8:0/2139799457 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3ec4067660 msgr2=0x7f3ec4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:18.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.793+0000 7f3ecf400640 1 --2- 172.21.15.8:0/2139799457 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3ec4067660 0x7f3ec4069b20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3edc050d10 tx=0x7f3ee4122000 comp rx=0 tx=0).stop 2024-03-23T23:49:18.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.793+0000 7f3ecf400640 1 -- 172.21.15.8:0/2139799457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3edc04db10 msgr2=0x7f3edc17cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:18.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.793+0000 7f3ecf400640 1 --2- 172.21.15.8:0/2139799457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3edc04db10 0x7f3edc17cb30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3ed000c430 tx=0x7f3ed000c8f0 comp rx=0 tx=0).stop 2024-03-23T23:49:18.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.793+0000 7f3ee2800640 1 -- 172.21.15.8:0/2139799457 reap_dead start 2024-03-23T23:49:18.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.793+0000 7f3ee2800640 1 -- 172.21.15.8:0/2139799457 reap_dead start 2024-03-23T23:49:18.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.793+0000 7f3ecf400640 1 -- 172.21.15.8:0/2139799457 shutdown_connections 2024-03-23T23:49:18.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.793+0000 7f3ecf400640 1 -- 172.21.15.8:0/2139799457 >> 172.21.15.8:0/2139799457 conn(0x7f3edc04c690 msgr2=0x7f3edc04efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:49:18.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.797+0000 7f3ecf400640 1 -- 172.21.15.8:0/2139799457 shutdown_connections 2024-03-23T23:49:18.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:18.797+0000 7f3ecf400640 1 -- 172.21.15.8:0/2139799457 wait complete. 2024-03-23T23:49:18.861 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:49:18.861 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T23:49:18.862 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:49:19.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.285+0000 7fc1e0a00640 1 Processor -- start 2024-03-23T23:49:19.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.285+0000 7fc1e0a00640 1 -- start start 2024-03-23T23:49:19.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.285+0000 7fc1e0a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc1dc15f8c0 0x7fc1dc06e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:19.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.285+0000 7fc1e0a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1dc15fca0 con 0x7fc1dc06cdf0 2024-03-23T23:49:19.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.285+0000 7fc1e0a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1dc072c80 con 0x7fc1dc08b090 2024-03-23T23:49:19.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.285+0000 7fc1e0a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1dc06d2a0 con 0x7fc1dc15f8c0 2024-03-23T23:49:19.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.289+0000 7fc1d9e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fc1dc06cdf0 0x7fc1dc070e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:44038/0 (socket says 172.21.15.8:44038) 2024-03-23T23:49:19.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.289+0000 7fc1d9e00640 1 -- 172.21.15.8:0/3985507198 learned_addr learned my addr 172.21.15.8:0/3985507198 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:49:19.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.293+0000 7fc1da800640 1 --2- 172.21.15.8:0/3985507198 >> v2:172.21.15.196:3300/0 conn(0x7fc1dc15f8c0 0x7fc1dc06e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:19.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.293+0000 7fc1da800640 1 -- 172.21.15.8:0/3985507198 >> v1:172.21.15.196:6789/0 conn(0x7fc1dc08b090 legacy=0x7fc1dc08b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:49:19.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.293+0000 7fc1da800640 1 -- 172.21.15.8:0/3985507198 >> v1:172.21.15.8:6789/0 conn(0x7fc1dc06cdf0 legacy=0x7fc1dc070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:19.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.293+0000 7fc1da800640 1 -- 172.21.15.8:0/3985507198 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1dc071510 con 0x7fc1dc15f8c0 2024-03-23T23:49:19.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.305+0000 7fc1da800640 1 --2- 172.21.15.8:0/3985507198 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1dc15f8c0 0x7fc1dc06e650 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8008990 tx=0x7fc1c8020920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=650b25c2e98d219c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:19.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.309+0000 7fc1d9400640 1 -- 172.21.15.8:0/3985507198 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c80af070 con 0x7fc1dc15f8c0 2024-03-23T23:49:19.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.309+0000 7fc1d9400640 1 -- 172.21.15.8:0/3985507198 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c80a98c0 con 0x7fc1dc15f8c0 2024-03-23T23:49:19.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.309+0000 7fc1d9400640 1 -- 172.21.15.8:0/3985507198 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c80a9cb0 con 0x7fc1dc15f8c0 2024-03-23T23:49:19.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.321+0000 7fc1e0a00640 1 -- 172.21.15.8:0/3985507198 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1dc15f8c0 msgr2=0x7fc1dc06e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:19.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.321+0000 7fc1e0a00640 1 --2- 172.21.15.8:0/3985507198 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1dc15f8c0 0x7fc1dc06e650 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8008990 tx=0x7fc1c8020920 comp rx=0 tx=0).stop 2024-03-23T23:49:19.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.321+0000 7fc1e0a00640 1 -- 172.21.15.8:0/3985507198 shutdown_connections 2024-03-23T23:49:19.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.321+0000 7fc1e0a00640 1 --2- 172.21.15.8:0/3985507198 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1dc15f8c0 0x7fc1dc06e650 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:19.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.321+0000 7fc1e0a00640 1 -- 172.21.15.8:0/3985507198 >> 172.21.15.8:0/3985507198 conn(0x7fc1dc06b170 msgr2=0x7fc1dc06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:49:19.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.325+0000 7fc1e0a00640 1 -- 172.21.15.8:0/3985507198 shutdown_connections 2024-03-23T23:49:19.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.325+0000 7fc1e0a00640 1 -- 172.21.15.8:0/3985507198 wait complete. 2024-03-23T23:49:19.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.329+0000 7fc1e0a00640 1 Processor -- start 2024-03-23T23:49:19.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.329+0000 7fc1e0a00640 1 -- start start 2024-03-23T23:49:19.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.329+0000 7fc1e0a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1dc06cdf0 0x7fc1dc203d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:19.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.329+0000 7fc1e0a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1dc08b090 0x7fc1dc2070e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:19.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.329+0000 7fc1e0a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1dc15f8c0 0x7fc1dc157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:19.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.333+0000 7fc1d9e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1dc08b090 0x7fc1dc2070e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:19.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.333+0000 7fc1e0a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1dc08bd70 con 0x7fc1dc08b090 2024-03-23T23:49:19.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.333+0000 7fc1e0a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1dc08bbf0 con 0x7fc1dc15f8c0 2024-03-23T23:49:19.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.333+0000 7fc1e0a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1dc166080 con 0x7fc1dc06cdf0 2024-03-23T23:49:19.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.333+0000 7fc1d9e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1dc08b090 0x7fc1dc2070e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43422/0 (socket says 172.21.15.8:43422) 2024-03-23T23:49:19.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.333+0000 7fc1d9e00640 1 -- 172.21.15.8:0/2504345681 learned_addr learned my addr 172.21.15.8:0/2504345681 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:49:19.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.333+0000 7fc1d9e00640 1 -- 172.21.15.8:0/2504345681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1dc06cdf0 msgr2=0x7fc1dc203d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:19.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.333+0000 7fc1d9e00640 1 --2- 172.21.15.8:0/2504345681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1dc06cdf0 0x7fc1dc203d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:19.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.333+0000 7fc1d9e00640 1 -- 172.21.15.8:0/2504345681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1dc15f8c0 msgr2=0x7fc1dc157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:19.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.333+0000 7fc1d9e00640 1 --2- 172.21.15.8:0/2504345681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1dc15f8c0 0x7fc1dc157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:19.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.333+0000 7fc1d9e00640 1 -- 172.21.15.8:0/2504345681 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1dc156f20 con 0x7fc1dc08b090 2024-03-23T23:49:19.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.333+0000 7fc1d9e00640 1 --2- 172.21.15.8:0/2504345681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1dc08b090 0x7fc1dc2070e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc00c780 tx=0x7fc1cc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:19.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.337+0000 7fc1d2a00640 1 -- 172.21.15.8:0/2504345681 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc017070 con 0x7fc1dc08b090 2024-03-23T23:49:19.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.337+0000 7fc1d2a00640 1 -- 172.21.15.8:0/2504345681 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1cc005ae0 con 0x7fc1dc08b090 2024-03-23T23:49:19.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.337+0000 7fc1d2a00640 1 -- 172.21.15.8:0/2504345681 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc007070 con 0x7fc1dc08b090 2024-03-23T23:49:19.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.337+0000 7fc1e0a00640 1 -- 172.21.15.8:0/2504345681 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1dc203270 con 0x7fc1dc08b090 2024-03-23T23:49:19.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.337+0000 7fc1e0a00640 1 -- 172.21.15.8:0/2504345681 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1dc203830 con 0x7fc1dc08b090 2024-03-23T23:49:19.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.337+0000 7fc1e0a00640 1 --2- 172.21.15.8:0/2504345681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1dc0aa600 0x7fc1dc15ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:19.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.337+0000 7fc1e0a00640 1 -- 172.21.15.8:0/2504345681 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1dc207620 con 0x7fc1dc0aa600 2024-03-23T23:49:19.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.337+0000 7fc1da800640 1 --2- 172.21.15.8:0/2504345681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1dc0aa600 0x7fc1dc15ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:19.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.345+0000 7fc1d2a00640 1 -- 172.21.15.8:0/2504345681 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc1cc01a070 con 0x7fc1dc08b090 2024-03-23T23:49:19.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.345+0000 7fc1d2a00640 1 --2- 172.21.15.8:0/2504345681 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc1bc0676b0 0x7fc1bc069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:19.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.345+0000 7fc1d2a00640 1 -- 172.21.15.8:0/2504345681 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fc1cc0534d0 con 0x7fc1dc08b090 2024-03-23T23:49:19.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.357+0000 7fc1da800640 1 -- 172.21.15.8:0/2504345681 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc1dc203a30 con 0x7fc1dc0aa600 2024-03-23T23:49:19.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.357+0000 7fc1db200640 1 --2- 172.21.15.8:0/2504345681 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc1bc0676b0 0x7fc1bc069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:19.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.361+0000 7fc1db200640 1 --2- 172.21.15.8:0/2504345681 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc1bc0676b0 0x7fc1bc069b70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc165140 tx=0x7fc1d4007d40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:19.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.365+0000 7fc1da800640 1 --2- 172.21.15.8:0/2504345681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1dc0aa600 0x7fc1dc15ea90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc067fb0 tx=0x7fc1c8008700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:19.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.369+0000 7fc1d2a00640 1 -- 172.21.15.8:0/2504345681 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c80af040 con 0x7fc1dc0aa600 2024-03-23T23:49:19.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.369+0000 7fc1d2a00640 1 -- 172.21.15.8:0/2504345681 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fc1c80a98c0 con 0x7fc1dc0aa600 2024-03-23T23:49:19.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.369+0000 7fc1d2a00640 1 -- 172.21.15.8:0/2504345681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1dc0aa600 msgr2=0x7fc1dc15ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:19.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.369+0000 7fc1d2a00640 1 --2- 172.21.15.8:0/2504345681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1dc0aa600 0x7fc1dc15ea90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc067fb0 tx=0x7fc1c8008700 comp rx=0 tx=0).stop 2024-03-23T23:49:19.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.369+0000 7fc1d2a00640 1 -- 172.21.15.8:0/2504345681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1dc0aa600 msgr2=0x7fc1dc15ea90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:49:19.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.369+0000 7fc1d2a00640 1 --2- 172.21.15.8:0/2504345681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1dc0aa600 0x7fc1dc15ea90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:19.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.389+0000 7fc1e0a00640 1 --2- 172.21.15.8:0/2504345681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1dc0aa9e0 0x7fc1dc15efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:19.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.389+0000 7fc1e0a00640 1 -- 172.21.15.8:0/2504345681 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1dc04f410 con 0x7fc1dc0aa9e0 2024-03-23T23:49:19.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.389+0000 7fc1da800640 1 --2- 172.21.15.8:0/2504345681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1dc0aa9e0 0x7fc1dc15efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:19.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.393+0000 7fc1da800640 1 -- 172.21.15.8:0/2504345681 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc1dc0c37e0 con 0x7fc1dc0aa9e0 2024-03-23T23:49:19.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.397+0000 7fc1da800640 1 --2- 172.21.15.8:0/2504345681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1dc0aa9e0 0x7fc1dc15efd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8008990 tx=0x7fc1c80ab000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:19.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.405+0000 7fc1d2a00640 1 -- 172.21.15.8:0/2504345681 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c80af040 con 0x7fc1dc0aa9e0 2024-03-23T23:49:19.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.405+0000 7fc1d2a00640 1 -- 172.21.15.8:0/2504345681 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4529 (secure 0 0 0) 0x7fc1c80b3400 con 0x7fc1dc0aa9e0 2024-03-23T23:49:19.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.405+0000 7fc1d2a00640 1 -- 172.21.15.8:0/2504345681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1dc0aa9e0 msgr2=0x7fc1dc15efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:19.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.405+0000 7fc1d2a00640 1 --2- 172.21.15.8:0/2504345681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1dc0aa9e0 0x7fc1dc15efd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8008990 tx=0x7fc1c80ab000 comp rx=0 tx=0).stop 2024-03-23T23:49:19.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.405+0000 7fc1d2a00640 1 -- 172.21.15.8:0/2504345681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1dc0aa9e0 msgr2=0x7fc1dc15efd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:49:19.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.405+0000 7fc1d2a00640 1 --2- 172.21.15.8:0/2504345681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1dc0aa9e0 0x7fc1dc15efd0 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8008990 tx=0x7fc1c80ab000 comp rx=0 tx=0).stop 2024-03-23T23:49:19.407 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:49:19.408 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:49:19.408 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:49:19.408 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:49:19.408 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 48, 2024-03-23T23:49:19.408 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:49:19.408 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:49:19.408 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:49:19.408 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:49:19.408 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:19.408 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 3, 2024-03-23T23:49:19.408 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:49:19.408 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:49:19.408 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:49:19.409 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:49:19.409 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:49:19.409 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:49:19.409 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:49:19.409 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:49:19.409 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:49:19.409 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:49:19.409 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:49:19.409 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:49:19.409 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:49:19.409 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:49:19.409 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:19.409 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:49:19.410 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:49:19.410 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:49:19.410 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:49:19.410 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:49:19.410 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:49:19.410 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:49:19.410 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:49:19.410 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:49:19.410 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:49:19.410 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:49:19.410 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:49:19.410 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:49:19.410 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:19.411 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:19.411 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:49:19.411 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:49:19.411 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:49:19.411 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:49:19.411 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:49:19.411 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:49:19.411 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:49:19.411 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:49:19.411 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:49:19.411 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:49:19.411 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:49:19.411 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:49:19.412 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:49:19.412 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:49:19.412 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:49:19.412 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:49:19.412 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:49:19.412 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:49:19.412 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:49:19.412 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:49:19.412 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:49:19.412 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:49:19.412 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:49:19.412 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:49:19.412 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:49:19.413 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:49:19.413 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:49:19.413 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:49:19.413 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:19.413 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:49:19.413 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:19.413 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:49:19.413 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:19.413 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:49:19.413 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:49:19.413 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:49:19.413 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:49:19.413 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:19.413 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:49:19.414 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:49:19.414 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:19.414 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:19.414 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:19.414 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:49:19.414 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:49:19.414 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:19.414 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:19.414 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:19.414 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:19.414 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:49:19.414 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:49:19.414 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:49:19.415 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:49:19.415 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:49:19.415 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:19.415 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:19.415 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:49:19.415 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:49:19.415 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:49:19.415 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:49:19.415 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:19.415 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:49:19.415 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:49:19.415 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:19.415 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:19.416 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:19.416 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:49:19.416 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:49:19.416 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:19.416 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:19.416 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:19.416 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:19.416 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:49:19.416 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:49:19.416 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:49:19.416 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:49:19.416 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:49:19.416 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:19.417 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:19.417 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:49:19.417 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:49:19.417 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:49:19.417 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:49:19.417 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:19.417 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:49:19.417 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:49:19.417 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:19.417 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:19.417 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:19.417 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:49:19.417 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:49:19.417 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:19.418 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:19.418 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:19.418 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:19.418 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:49:19.418 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:49:19.418 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:49:19.418 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:49:19.418 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:49:19.418 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:19.418 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:19.418 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:19.418 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:49:19.419 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:49:19.419 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:19.419 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:49:19.419 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:19.419 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:49:19.419 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:19.419 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:19.419 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:49:19.419 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:19.419 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:49:19.419 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:19.419 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:49:19.419 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:19.419 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:19.420 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:19.420 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:49:19.420 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:49:19.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.405+0000 7fc1e0a00640 1 -- 172.21.15.8:0/2504345681 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc1bc0676b0 msgr2=0x7fc1bc069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:19.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.405+0000 7fc1e0a00640 1 --2- 172.21.15.8:0/2504345681 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc1bc0676b0 0x7fc1bc069b70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc165140 tx=0x7fc1d4007d40 comp rx=0 tx=0).stop 2024-03-23T23:49:19.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.405+0000 7fc1db200640 1 -- 172.21.15.8:0/2504345681 reap_dead start 2024-03-23T23:49:19.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.405+0000 7fc1e0a00640 1 -- 172.21.15.8:0/2504345681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1dc08b090 msgr2=0x7fc1dc2070e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:19.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.405+0000 7fc1e0a00640 1 --2- 172.21.15.8:0/2504345681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1dc08b090 0x7fc1dc2070e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc00c780 tx=0x7fc1cc00cc40 comp rx=0 tx=0).stop 2024-03-23T23:49:19.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.405+0000 7fc1e0a00640 1 -- 172.21.15.8:0/2504345681 shutdown_connections 2024-03-23T23:49:19.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.405+0000 7fc1e0a00640 1 --2- 172.21.15.8:0/2504345681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1dc08b090 0x7fc1dc2070e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:19.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.405+0000 7fc1e0a00640 1 -- 172.21.15.8:0/2504345681 >> 172.21.15.8:0/2504345681 conn(0x7fc1dc06b170 msgr2=0x7fc1dc163670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:49:19.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.409+0000 7fc1e0a00640 1 -- 172.21.15.8:0/2504345681 shutdown_connections 2024-03-23T23:49:19.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.409+0000 7fc1e0a00640 1 -- 172.21.15.8:0/2504345681 wait complete. 2024-03-23T23:49:19.452 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:49:19.452 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-03-23T23:49:19.452 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-03-23T23:49:19.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.805+0000 7f28c5200640 1 Processor -- start 2024-03-23T23:49:19.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.809+0000 7f28c5200640 1 -- start start 2024-03-23T23:49:19.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.813+0000 7f28c5200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28b80d3c70 0x7f28b8049710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:19.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.813+0000 7f28c5200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f28b804ae90 0x7f28b8006a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:19.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.813+0000 7f28c5200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28b80d7220 con 0x7f28b804b2f0 2024-03-23T23:49:19.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.813+0000 7f28c5200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b80d6fd0 con 0x7f28b804ae90 2024-03-23T23:49:19.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.813+0000 7f28c5200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b80d7500 con 0x7f28b80d3c70 2024-03-23T23:49:19.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.813+0000 7f28be800640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f28b804b2f0 0x7f28b80da350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:39178/0 (socket says 172.21.15.8:39178) 2024-03-23T23:49:19.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.813+0000 7f28be800640 1 -- 172.21.15.8:0/4156188409 learned_addr learned my addr 172.21.15.8:0/4156188409 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:49:19.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.813+0000 7f28bd400640 1 --2- 172.21.15.8:0/4156188409 >> v2:172.21.15.196:3300/0 conn(0x7f28b804ae90 0x7f28b8006a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:19.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.817+0000 7f28bde00640 1 --2- 172.21.15.8:0/4156188409 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28b80d3c70 0x7f28b8049710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:19.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.817+0000 7f28bca00640 1 -- 172.21.15.8:0/4156188409 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 786417784 0 0) 0x7f28b80d7220 con 0x7f28b804b2f0 2024-03-23T23:49:19.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.817+0000 7f28bca00640 1 -- 172.21.15.8:0/4156188409 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28a4003530 con 0x7f28b804b2f0 2024-03-23T23:49:19.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.817+0000 7f28bca00640 1 -- 172.21.15.8:0/4156188409 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2984175135 0 0) 0x7f28a4003530 con 0x7f28b804b2f0 2024-03-23T23:49:19.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.817+0000 7f28bca00640 1 -- 172.21.15.8:0/4156188409 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28b80d3c70 msgr2=0x7f28b8049710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:49:19.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.817+0000 7f28bca00640 1 --2- 172.21.15.8:0/4156188409 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28b80d3c70 0x7f28b8049710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:19.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.817+0000 7f28bca00640 1 -- 172.21.15.8:0/4156188409 >> v2:172.21.15.196:3300/0 conn(0x7f28b804ae90 msgr2=0x7f28b8006a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:49:19.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.817+0000 7f28bca00640 1 --2- 172.21.15.8:0/4156188409 >> v2:172.21.15.196:3300/0 conn(0x7f28b804ae90 0x7f28b8006a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:19.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.817+0000 7f28bca00640 1 -- 172.21.15.8:0/4156188409 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b80469a0 con 0x7f28b804b2f0 2024-03-23T23:49:19.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.817+0000 7f28bca00640 1 -- 172.21.15.8:0/4156188409 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7f28ac001680 con 0x7f28b804b2f0 2024-03-23T23:49:19.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.817+0000 7f28bca00640 1 -- 172.21.15.8:0/4156188409 >> v1:172.21.15.196:6789/0 conn(0x7f28b804b2f0 legacy=0x7f28b80da350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:19.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.817+0000 7f28bca00640 1 --2- 172.21.15.8:0/4156188409 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28a40039c0 0x7f28a4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:19.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.817+0000 7f28bca00640 1 --2- 172.21.15.8:0/4156188409 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28a4004810 0x7f28a4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:19.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.817+0000 7f28bca00640 1 --2- 172.21.15.8:0/4156188409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28a40051d0 0x7f28a400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:19.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.817+0000 7f28bca00640 1 -- 172.21.15.8:0/4156188409 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b80d6fd0 con 0x7f28a40051d0 2024-03-23T23:49:19.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.817+0000 7f28bca00640 1 -- 172.21.15.8:0/4156188409 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b80d7500 con 0x7f28a4004810 2024-03-23T23:49:19.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.817+0000 7f28bca00640 1 -- 172.21.15.8:0/4156188409 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a40149d0 con 0x7f28a40039c0 2024-03-23T23:49:19.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.817+0000 7f28be800640 1 --2- 172.21.15.8:0/4156188409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28a40051d0 0x7f28a400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:19.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.821+0000 7f28bd400640 1 --2- 172.21.15.8:0/4156188409 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28a4004810 0x7f28a4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:19.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.821+0000 7f28bde00640 1 --2- 172.21.15.8:0/4156188409 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28a40039c0 0x7f28a4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:19.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.821+0000 7f28be800640 1 -- 172.21.15.8:0/4156188409 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28a40039c0 msgr2=0x7f28a4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:49:19.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.821+0000 7f28be800640 1 --2- 172.21.15.8:0/4156188409 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28a40039c0 0x7f28a4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:19.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.821+0000 7f28be800640 1 -- 172.21.15.8:0/4156188409 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28a4004810 msgr2=0x7f28a4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:49:19.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.821+0000 7f28be800640 1 --2- 172.21.15.8:0/4156188409 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28a4004810 0x7f28a4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:19.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.821+0000 7f28be800640 1 -- 172.21.15.8:0/4156188409 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b80469a0 con 0x7f28a40051d0 2024-03-23T23:49:19.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.833+0000 7f28be800640 1 --2- 172.21.15.8:0/4156188409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28a40051d0 0x7f28a400b9d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f28b802b260 tx=0x7f28ac01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d563dabc47cf1b5d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:19.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.833+0000 7f28bca00640 1 -- 172.21.15.8:0/4156188409 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac007de0 con 0x7f28a40051d0 2024-03-23T23:49:19.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.833+0000 7f28bca00640 1 -- 172.21.15.8:0/4156188409 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ac0a9020 con 0x7f28a40051d0 2024-03-23T23:49:19.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.837+0000 7f28c5200640 1 -- 172.21.15.8:0/4156188409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28a40051d0 msgr2=0x7f28a400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:19.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.837+0000 7f28c5200640 1 --2- 172.21.15.8:0/4156188409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28a40051d0 0x7f28a400b9d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f28b802b260 tx=0x7f28ac01ccc0 comp rx=0 tx=0).stop 2024-03-23T23:49:19.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.837+0000 7f28be800640 1 -- 172.21.15.8:0/4156188409 reap_dead start 2024-03-23T23:49:19.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.837+0000 7f28c5200640 1 -- 172.21.15.8:0/4156188409 shutdown_connections 2024-03-23T23:49:19.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.837+0000 7f28c5200640 1 -- 172.21.15.8:0/4156188409 >> 172.21.15.8:0/4156188409 conn(0x7f28b8005f20 msgr2=0x7f28b8006330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:49:19.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.845+0000 7f28c5200640 1 -- 172.21.15.8:0/4156188409 shutdown_connections 2024-03-23T23:49:19.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.845+0000 7f28c5200640 1 -- 172.21.15.8:0/4156188409 wait complete. 2024-03-23T23:49:19.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.865+0000 7f28c5200640 1 Processor -- start 2024-03-23T23:49:19.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.865+0000 7f28c5200640 1 -- start start 2024-03-23T23:49:19.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.873+0000 7f28c5200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28a40051d0 0x7f28b816f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:19.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.873+0000 7f28c5200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28b8040420 0x7f28b804a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:19.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.873+0000 7f28c5200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28b8173180 0x7f28b80cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:19.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.873+0000 7f28c5200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b8046d10 con 0x7f28b8173180 2024-03-23T23:49:19.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.877+0000 7f28bd400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28b8040420 0x7f28b804a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:19.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.877+0000 7f28bd400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28b8040420 0x7f28b804a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:44464/0 (socket says 172.21.15.8:44464) 2024-03-23T23:49:19.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.877+0000 7f28bd400640 1 -- 172.21.15.8:0/1795082251 learned_addr learned my addr 172.21.15.8:0/1795082251 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:49:19.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.877+0000 7f28be800640 1 --2- 172.21.15.8:0/1795082251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28b8173180 0x7f28b80cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:19.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.885+0000 7f28c5200640 1 -- 172.21.15.8:0/1795082251 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b8007880 con 0x7f28a40051d0 2024-03-23T23:49:19.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.885+0000 7f28c5200640 1 -- 172.21.15.8:0/1795082251 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b8046320 con 0x7f28b8040420 2024-03-23T23:49:19.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.893+0000 7f28bde00640 1 --2- 172.21.15.8:0/1795082251 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28a40051d0 0x7f28b816f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:19.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.897+0000 7f28bde00640 1 -- 172.21.15.8:0/1795082251 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28b8040420 msgr2=0x7f28b804a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:19.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.897+0000 7f28bde00640 1 --2- 172.21.15.8:0/1795082251 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28b8040420 0x7f28b804a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:19.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.897+0000 7f28bde00640 1 -- 172.21.15.8:0/1795082251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28b8173180 msgr2=0x7f28b80cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:19.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.897+0000 7f28bde00640 1 --2- 172.21.15.8:0/1795082251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28b8173180 0x7f28b80cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:19.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.897+0000 7f28bde00640 1 -- 172.21.15.8:0/1795082251 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b800ae10 con 0x7f28a40051d0 2024-03-23T23:49:19.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.897+0000 7f28bd400640 1 --2- 172.21.15.8:0/1795082251 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28b8040420 0x7f28b804a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:49:19.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.897+0000 7f28bde00640 1 --2- 172.21.15.8:0/1795082251 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28a40051d0 0x7f28b816f300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f28b00116d0 tx=0x7f28b0011b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:19.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.897+0000 7f28be800640 1 --2- 172.21.15.8:0/1795082251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28b8173180 0x7f28b80cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:49:19.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.901+0000 7f28b6000640 1 -- 172.21.15.8:0/1795082251 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b000b040 con 0x7f28a40051d0 2024-03-23T23:49:19.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.901+0000 7f28c5200640 1 -- 172.21.15.8:0/1795082251 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b80425b0 con 0x7f28a40051d0 2024-03-23T23:49:19.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.901+0000 7f28c5200640 1 -- 172.21.15.8:0/1795082251 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b816f840 con 0x7f28a40051d0 2024-03-23T23:49:19.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.901+0000 7f28b6000640 1 -- 172.21.15.8:0/1795082251 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b000fad0 con 0x7f28a40051d0 2024-03-23T23:49:19.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.901+0000 7f28b6000640 1 -- 172.21.15.8:0/1795082251 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b000b040 con 0x7f28a40051d0 2024-03-23T23:49:19.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.901+0000 7f28c5200640 1 -- 172.21.15.8:0/1795082251 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28980052a0 con 0x7f28a40051d0 2024-03-23T23:49:19.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.905+0000 7f28b6000640 1 -- 172.21.15.8:0/1795082251 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f28b000fc80 con 0x7f28a40051d0 2024-03-23T23:49:19.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.905+0000 7f28b6000640 1 --2- 172.21.15.8:0/1795082251 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f28a0067890 0x7f28a0069d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:19.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.905+0000 7f28b6000640 1 -- 172.21.15.8:0/1795082251 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f28b00860e0 con 0x7f28a40051d0 2024-03-23T23:49:19.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.913+0000 7f28bd400640 1 --2- 172.21.15.8:0/1795082251 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f28a0067890 0x7f28a0069d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:19.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.913+0000 7f28bd400640 1 --2- 172.21.15.8:0/1795082251 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f28a0067890 0x7f28a0069d50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f28c006a690 tx=0x7f28c0066f70 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:19.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:19.921+0000 7f28b6000640 1 -- 172.21.15.8:0/1795082251 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f28b0056900 con 0x7f28a40051d0 2024-03-23T23:49:20.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:20.577+0000 7f28c5200640 1 -- 172.21.15.8:0/1795082251 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f2898005da0 con 0x7f28a40051d0 2024-03-23T23:49:20.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:20.589+0000 7f28b6000640 1 -- 172.21.15.8:0/1795082251 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f28b0056200 con 0x7f28a40051d0 2024-03-23T23:49:20.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:20.605+0000 7f28c5200640 1 -- 172.21.15.8:0/1795082251 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f28a0067890 msgr2=0x7f28a0069d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:20.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:20.605+0000 7f28c5200640 1 --2- 172.21.15.8:0/1795082251 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f28a0067890 0x7f28a0069d50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f28c006a690 tx=0x7f28c0066f70 comp rx=0 tx=0).stop 2024-03-23T23:49:20.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:20.605+0000 7f28c5200640 1 -- 172.21.15.8:0/1795082251 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28a40051d0 msgr2=0x7f28b816f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:20.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:20.605+0000 7f28c5200640 1 --2- 172.21.15.8:0/1795082251 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28a40051d0 0x7f28b816f300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f28b00116d0 tx=0x7f28b0011b90 comp rx=0 tx=0).stop 2024-03-23T23:49:20.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:20.605+0000 7f28c5200640 1 -- 172.21.15.8:0/1795082251 shutdown_connections 2024-03-23T23:49:20.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:20.605+0000 7f28c5200640 1 --2- 172.21.15.8:0/1795082251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28b8173180 0x7f28b80cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:20.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:20.605+0000 7f28c5200640 1 --2- 172.21.15.8:0/1795082251 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f28a0067890 0x7f28a0069d50 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:20.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:20.605+0000 7f28c5200640 1 --2- 172.21.15.8:0/1795082251 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28b8040420 0x7f28b804a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:20.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:20.605+0000 7f28c5200640 1 --2- 172.21.15.8:0/1795082251 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28a40051d0 0x7f28b816f300 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:20.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:20.605+0000 7f28c5200640 1 -- 172.21.15.8:0/1795082251 >> 172.21.15.8:0/1795082251 conn(0x7f28b8005f20 msgr2=0x7f28b80d6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:49:20.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:20.605+0000 7f28c5200640 1 -- 172.21.15.8:0/1795082251 shutdown_connections 2024-03-23T23:49:20.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:20.605+0000 7f28c5200640 1 -- 172.21.15.8:0/1795082251 wait complete. 2024-03-23T23:49:20.690 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-03-23T23:49:30.691 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T23:49:30.691 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:49:31.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.204+0000 7f99a2400640 1 Processor -- start 2024-03-23T23:49:31.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.204+0000 7f99a2400640 1 -- start start 2024-03-23T23:49:31.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.204+0000 7f99a2400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f999c0731a0 0x7f999c14f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:31.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.204+0000 7f99a2400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f999c06f070 0x7f999c0c1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:31.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.204+0000 7f99a2400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f999c0ac710 con 0x7f999c0ab730 2024-03-23T23:49:31.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.204+0000 7f99a2400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f999c0c4380 con 0x7f999c06f070 2024-03-23T23:49:31.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.204+0000 7f99a2400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f999c071c10 con 0x7f999c0731a0 2024-03-23T23:49:31.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.208+0000 7f999be00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f999c0ab730 0x7f999c0c3c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:55296/0 (socket says 172.21.15.8:55296) 2024-03-23T23:49:31.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.208+0000 7f999be00640 1 -- 172.21.15.8:0/316410584 learned_addr learned my addr 172.21.15.8:0/316410584 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:49:31.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.208+0000 7f999b400640 1 --2- 172.21.15.8:0/316410584 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f999c0731a0 0x7f999c14f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:31.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.208+0000 7f999b400640 1 -- 172.21.15.8:0/316410584 >> v2:172.21.15.8:3300/0 conn(0x7f999c06f070 msgr2=0x7f999c0c1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:49:31.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.208+0000 7f999b400640 1 --2- 172.21.15.8:0/316410584 >> v2:172.21.15.8:3300/0 conn(0x7f999c06f070 0x7f999c0c1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:31.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.208+0000 7f999b400640 1 -- 172.21.15.8:0/316410584 >> v1:172.21.15.8:6789/0 conn(0x7f999c0ab730 legacy=0x7f999c0c3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:31.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.208+0000 7f999b400640 1 -- 172.21.15.8:0/316410584 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f999c0ac430 con 0x7f999c0731a0 2024-03-23T23:49:31.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.216+0000 7f999b400640 1 --2- 172.21.15.8:0/316410584 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f999c0731a0 0x7f999c14f500 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f99840097c0 tx=0x7f998401c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4377c1d5c90739c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:31.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.216+0000 7f999a000640 1 -- 172.21.15.8:0/316410584 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99840b0070 con 0x7f999c0731a0 2024-03-23T23:49:31.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.216+0000 7f999a000640 1 -- 172.21.15.8:0/316410584 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99840ab600 con 0x7f999c0731a0 2024-03-23T23:49:31.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.216+0000 7f999a000640 1 -- 172.21.15.8:0/316410584 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99840ab9d0 con 0x7f999c0731a0 2024-03-23T23:49:31.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.220+0000 7f99a2400640 1 -- 172.21.15.8:0/316410584 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f999c0731a0 msgr2=0x7f999c14f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:31.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.220+0000 7f99a2400640 1 --2- 172.21.15.8:0/316410584 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f999c0731a0 0x7f999c14f500 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f99840097c0 tx=0x7f998401c3a0 comp rx=0 tx=0).stop 2024-03-23T23:49:31.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.224+0000 7f99a2400640 1 -- 172.21.15.8:0/316410584 shutdown_connections 2024-03-23T23:49:31.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.224+0000 7f99a2400640 1 --2- 172.21.15.8:0/316410584 >> v2:172.21.15.8:3300/0 conn(0x7f999c06f070 0x7f999c0c1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:31.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.224+0000 7f99a2400640 1 --2- 172.21.15.8:0/316410584 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f999c0731a0 0x7f999c14f500 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:31.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.224+0000 7f99a2400640 1 -- 172.21.15.8:0/316410584 >> 172.21.15.8:0/316410584 conn(0x7f999c06b170 msgr2=0x7f999c06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:49:31.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.228+0000 7f99a2400640 1 -- 172.21.15.8:0/316410584 shutdown_connections 2024-03-23T23:49:31.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.228+0000 7f99a2400640 1 -- 172.21.15.8:0/316410584 wait complete. 2024-03-23T23:49:31.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.232+0000 7f99a2400640 1 Processor -- start 2024-03-23T23:49:31.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.232+0000 7f99a2400640 1 -- start start 2024-03-23T23:49:31.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.236+0000 7f99a2400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f999c06f070 0x7f999c14d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:31.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.236+0000 7f99a2400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f999c0731a0 0x7f999c13b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:31.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.236+0000 7f99a2400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f999c0ab730 0x7f999c13b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:31.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.236+0000 7f99a2400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999c0abb40 con 0x7f999c0731a0 2024-03-23T23:49:31.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.236+0000 7f99a2400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999c15b7e0 con 0x7f999c0ab730 2024-03-23T23:49:31.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.236+0000 7f99a2400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f999c0abcc0 con 0x7f999c06f070 2024-03-23T23:49:31.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.240+0000 7f999aa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f999c0731a0 0x7f999c13b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:31.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.240+0000 7f999aa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f999c0731a0 0x7f999c13b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36790/0 (socket says 172.21.15.8:36790) 2024-03-23T23:49:31.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.240+0000 7f999aa00640 1 -- 172.21.15.8:0/958571072 learned_addr learned my addr 172.21.15.8:0/958571072 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:49:31.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.240+0000 7f999be00640 1 --2- 172.21.15.8:0/958571072 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f999c0ab730 0x7f999c13b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:31.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.240+0000 7f999b400640 1 --2- 172.21.15.8:0/958571072 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f999c06f070 0x7f999c14d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:31.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.244+0000 7f999be00640 1 -- 172.21.15.8:0/958571072 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f999c06f070 msgr2=0x7f999c14d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:31.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.244+0000 7f999be00640 1 --2- 172.21.15.8:0/958571072 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f999c06f070 0x7f999c14d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:31.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.244+0000 7f999be00640 1 -- 172.21.15.8:0/958571072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f999c0731a0 msgr2=0x7f999c13b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:31.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.244+0000 7f999be00640 1 --2- 172.21.15.8:0/958571072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f999c0731a0 0x7f999c13b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:31.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.244+0000 7f999be00640 1 -- 172.21.15.8:0/958571072 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f999c13bff0 con 0x7f999c0ab730 2024-03-23T23:49:31.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.244+0000 7f999aa00640 1 --2- 172.21.15.8:0/958571072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f999c0731a0 0x7f999c13b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:49:31.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.244+0000 7f999be00640 1 --2- 172.21.15.8:0/958571072 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f999c0ab730 0x7f999c13b7e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f999400c3c0 tx=0x7f999400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:31.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.244+0000 7f9993400640 1 -- 172.21.15.8:0/958571072 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9994017070 con 0x7f999c0ab730 2024-03-23T23:49:31.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.244+0000 7f9993400640 1 -- 172.21.15.8:0/958571072 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9994005cf0 con 0x7f999c0ab730 2024-03-23T23:49:31.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.244+0000 7f9993400640 1 -- 172.21.15.8:0/958571072 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99940072d0 con 0x7f999c0ab730 2024-03-23T23:49:31.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.248+0000 7f99a2400640 1 -- 172.21.15.8:0/958571072 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f999c1437c0 con 0x7f999c0ab730 2024-03-23T23:49:31.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.248+0000 7f99a2400640 1 -- 172.21.15.8:0/958571072 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f999c0c6c00 con 0x7f999c0ab730 2024-03-23T23:49:31.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.248+0000 7f99a2400640 1 -- 172.21.15.8:0/958571072 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f999c1435b0 con 0x7f999c0ab730 2024-03-23T23:49:31.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.256+0000 7f9993400640 1 -- 172.21.15.8:0/958571072 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f999401a070 con 0x7f999c0ab730 2024-03-23T23:49:31.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.260+0000 7f9993400640 1 --2- 172.21.15.8:0/958571072 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f99780676b0 0x7f9978069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:31.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.260+0000 7f9993400640 1 -- 172.21.15.8:0/958571072 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f9994085430 con 0x7f999c0ab730 2024-03-23T23:49:31.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.260+0000 7f999b400640 1 --2- 172.21.15.8:0/958571072 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f99780676b0 0x7f9978069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:31.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.264+0000 7f999b400640 1 --2- 172.21.15.8:0/958571072 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f99780676b0 0x7f9978069b70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f99840ad000 tx=0x7f99840a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:31.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.276+0000 7f9993400640 1 -- 172.21.15.8:0/958571072 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f9994055810 con 0x7f999c0ab730 2024-03-23T23:49:31.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.896+0000 7f99a2400640 1 -- 172.21.15.8:0/958571072 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f999c0aa820 con 0x7f999c0ab730 2024-03-23T23:49:31.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.900+0000 7f9993400640 1 -- 172.21.15.8:0/958571072 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1561 (secure 0 0 0) 0x7f99940598b0 con 0x7f999c0ab730 2024-03-23T23:49:31.906 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":48,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:49:31.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.912+0000 7f99a2400640 1 -- 172.21.15.8:0/958571072 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f99780676b0 msgr2=0x7f9978069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:31.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.912+0000 7f99a2400640 1 --2- 172.21.15.8:0/958571072 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f99780676b0 0x7f9978069b70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f99840ad000 tx=0x7f99840a6000 comp rx=0 tx=0).stop 2024-03-23T23:49:31.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.912+0000 7f99a2400640 1 -- 172.21.15.8:0/958571072 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f999c0ab730 msgr2=0x7f999c13b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:31.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.912+0000 7f99a2400640 1 --2- 172.21.15.8:0/958571072 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f999c0ab730 0x7f999c13b7e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f999400c3c0 tx=0x7f999400c880 comp rx=0 tx=0).stop 2024-03-23T23:49:31.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.912+0000 7f99a2400640 1 -- 172.21.15.8:0/958571072 shutdown_connections 2024-03-23T23:49:31.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.912+0000 7f99a2400640 1 --2- 172.21.15.8:0/958571072 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f999c0ab730 0x7f999c13b7e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:31.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.912+0000 7f99a2400640 1 --2- 172.21.15.8:0/958571072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f999c0731a0 0x7f999c13b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:31.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.912+0000 7f99a2400640 1 --2- 172.21.15.8:0/958571072 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f99780676b0 0x7f9978069b70 secure :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f99840ad000 tx=0x7f99840a6000 comp rx=0 tx=0).stop 2024-03-23T23:49:31.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.912+0000 7f99a2400640 1 --2- 172.21.15.8:0/958571072 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f999c06f070 0x7f999c14d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:31.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.912+0000 7f99a2400640 1 -- 172.21.15.8:0/958571072 >> 172.21.15.8:0/958571072 conn(0x7f999c06b170 msgr2=0x7f999c144c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:49:31.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.916+0000 7f99a2400640 1 -- 172.21.15.8:0/958571072 shutdown_connections 2024-03-23T23:49:31.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:31.916+0000 7f99a2400640 1 -- 172.21.15.8:0/958571072 wait complete. 2024-03-23T23:49:32.016 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T23:49:32.017 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-03-23T23:49:32.017 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T23:49:32.017 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:49:32.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.420+0000 7fc968e00640 1 Processor -- start 2024-03-23T23:49:32.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.420+0000 7fc968e00640 1 -- start start 2024-03-23T23:49:32.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.420+0000 7fc968e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc964157790 0x7fc9640c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:32.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.420+0000 7fc968e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc964073260 0x7fc96415d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:32.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.420+0000 7fc968e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc964073680 con 0x7fc9640c3f60 2024-03-23T23:49:32.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.420+0000 7fc968e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9640c2af0 con 0x7fc964157790 2024-03-23T23:49:32.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.420+0000 7fc968e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9640711c0 con 0x7fc964073260 2024-03-23T23:49:32.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.424+0000 7fc961400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc964157790 0x7fc9640c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:32.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.424+0000 7fc961e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fc9640c3f60 0x7fc964157080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:55302/0 (socket says 172.21.15.8:55302) 2024-03-23T23:49:32.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.424+0000 7fc961e00640 1 -- 172.21.15.8:0/3267464506 learned_addr learned my addr 172.21.15.8:0/3267464506 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:49:32.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.424+0000 7fc961400640 1 -- 172.21.15.8:0/3267464506 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc964073260 msgr2=0x7fc96415d400 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-23T23:49:32.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.424+0000 7fc961400640 1 --2- 172.21.15.8:0/3267464506 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc964073260 0x7fc96415d400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:32.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.424+0000 7fc961400640 1 -- 172.21.15.8:0/3267464506 >> v1:172.21.15.8:6789/0 conn(0x7fc9640c3f60 legacy=0x7fc964157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:32.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.424+0000 7fc961400640 1 -- 172.21.15.8:0/3267464506 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9640714a0 con 0x7fc964157790 2024-03-23T23:49:32.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.432+0000 7fc961400640 1 --2- 172.21.15.8:0/3267464506 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc964157790 0x7fc9640c34d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc9500097c0 tx=0x7fc95001bf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70827dafcc0b2087 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:32.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.440+0000 7fc960a00640 1 -- 172.21.15.8:0/3267464506 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9500ab070 con 0x7fc964157790 2024-03-23T23:49:32.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.440+0000 7fc960a00640 1 -- 172.21.15.8:0/3267464506 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9500a5610 con 0x7fc964157790 2024-03-23T23:49:32.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.440+0000 7fc960a00640 1 -- 172.21.15.8:0/3267464506 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9500a59e0 con 0x7fc964157790 2024-03-23T23:49:32.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.444+0000 7fc968e00640 1 -- 172.21.15.8:0/3267464506 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc964157790 msgr2=0x7fc9640c34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:32.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.444+0000 7fc968e00640 1 --2- 172.21.15.8:0/3267464506 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc964157790 0x7fc9640c34d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc9500097c0 tx=0x7fc95001bf70 comp rx=0 tx=0).stop 2024-03-23T23:49:32.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.444+0000 7fc968e00640 1 -- 172.21.15.8:0/3267464506 shutdown_connections 2024-03-23T23:49:32.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.444+0000 7fc968e00640 1 --2- 172.21.15.8:0/3267464506 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc964073260 0x7fc96415d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:32.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.444+0000 7fc968e00640 1 --2- 172.21.15.8:0/3267464506 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc964157790 0x7fc9640c34d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:32.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.444+0000 7fc968e00640 1 -- 172.21.15.8:0/3267464506 >> 172.21.15.8:0/3267464506 conn(0x7fc9640a9870 msgr2=0x7fc96406b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:49:32.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.448+0000 7fc968e00640 1 -- 172.21.15.8:0/3267464506 shutdown_connections 2024-03-23T23:49:32.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.448+0000 7fc968e00640 1 -- 172.21.15.8:0/3267464506 wait complete. 2024-03-23T23:49:32.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.452+0000 7fc968e00640 1 Processor -- start 2024-03-23T23:49:32.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.452+0000 7fc968e00640 1 -- start start 2024-03-23T23:49:32.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.456+0000 7fc968e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc964073260 0x7fc9640c6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:32.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.456+0000 7fc968e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9640c3f60 0x7fc96414ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:32.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.456+0000 7fc968e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc964157790 0x7fc96414e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:32.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.456+0000 7fc968e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc964122790 con 0x7fc964157790 2024-03-23T23:49:32.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.456+0000 7fc968e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc964122610 con 0x7fc9640c3f60 2024-03-23T23:49:32.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.456+0000 7fc968e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc964122910 con 0x7fc964073260 2024-03-23T23:49:32.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.456+0000 7fc961400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9640c3f60 0x7fc96414ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:32.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.456+0000 7fc961400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9640c3f60 0x7fc96414ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:40614/0 (socket says 172.21.15.8:40614) 2024-03-23T23:49:32.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.464+0000 7fc961400640 1 -- 172.21.15.8:0/1658120457 learned_addr learned my addr 172.21.15.8:0/1658120457 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:49:32.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.460+0000 7fc961e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc964073260 0x7fc9640c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:32.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.460+0000 7fc962800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc964157790 0x7fc96414e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:32.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.468+0000 7fc961400640 1 -- 172.21.15.8:0/1658120457 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc964073260 msgr2=0x7fc9640c6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:32.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.468+0000 7fc961400640 1 --2- 172.21.15.8:0/1658120457 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc964073260 0x7fc9640c6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:32.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.468+0000 7fc961400640 1 -- 172.21.15.8:0/1658120457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc964157790 msgr2=0x7fc96414e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:32.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.468+0000 7fc961400640 1 --2- 172.21.15.8:0/1658120457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc964157790 0x7fc96414e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:32.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.468+0000 7fc961400640 1 -- 172.21.15.8:0/1658120457 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc964150f90 con 0x7fc9640c3f60 2024-03-23T23:49:32.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.472+0000 7fc961400640 1 --2- 172.21.15.8:0/1658120457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9640c3f60 0x7fc96414ded0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc95001a620 tx=0x7fc950019060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:32.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.472+0000 7fc95a000640 1 -- 172.21.15.8:0/1658120457 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9500ab070 con 0x7fc9640c3f60 2024-03-23T23:49:32.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.472+0000 7fc95a000640 1 -- 172.21.15.8:0/1658120457 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9500b0670 con 0x7fc9640c3f60 2024-03-23T23:49:32.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.476+0000 7fc95a000640 1 -- 172.21.15.8:0/1658120457 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9500b0a60 con 0x7fc9640c3f60 2024-03-23T23:49:32.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.476+0000 7fc968e00640 1 -- 172.21.15.8:0/1658120457 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9640ac750 con 0x7fc9640c3f60 2024-03-23T23:49:32.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.476+0000 7fc968e00640 1 -- 172.21.15.8:0/1658120457 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9640ad230 con 0x7fc9640c3f60 2024-03-23T23:49:32.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.484+0000 7fc95a000640 1 -- 172.21.15.8:0/1658120457 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc9500ae070 con 0x7fc9640c3f60 2024-03-23T23:49:32.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.492+0000 7fc94f400640 1 --2- 172.21.15.8:0/1658120457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc964141b80 0x7fc9640aab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:32.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.492+0000 7fc94f400640 1 -- 172.21.15.8:0/1658120457 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96414e950 con 0x7fc964141b80 2024-03-23T23:49:32.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.504+0000 7fc961e00640 1 --2- 172.21.15.8:0/1658120457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc964141b80 0x7fc9640aab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:32.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.504+0000 7fc95a000640 1 --2- 172.21.15.8:0/1658120457 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc944067730 0x7fc944069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:32.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.504+0000 7fc95a000640 1 -- 172.21.15.8:0/1658120457 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fc95011ee40 con 0x7fc9640c3f60 2024-03-23T23:49:32.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.504+0000 7fc961e00640 1 -- 172.21.15.8:0/1658120457 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc9640ac540 con 0x7fc964141b80 2024-03-23T23:49:32.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.504+0000 7fc962800640 1 --2- 172.21.15.8:0/1658120457 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc944067730 0x7fc944069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:32.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.504+0000 7fc961e00640 1 --2- 172.21.15.8:0/1658120457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc964141b80 0x7fc9640aab50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc954000f70 tx=0x7fc954001d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:32.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.504+0000 7fc962800640 1 --2- 172.21.15.8:0/1658120457 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc944067730 0x7fc944069bf0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc95c009ee0 tx=0x7fc95c009450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:32.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.504+0000 7fc95a000640 1 -- 172.21.15.8:0/1658120457 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95400fa00 con 0x7fc964141b80 2024-03-23T23:49:32.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.508+0000 7fc95a000640 1 -- 172.21.15.8:0/1658120457 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fc954018070 con 0x7fc964141b80 2024-03-23T23:49:32.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.508+0000 7fc95a000640 1 -- 172.21.15.8:0/1658120457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc964141b80 msgr2=0x7fc9640aab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:32.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.508+0000 7fc95a000640 1 --2- 172.21.15.8:0/1658120457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc964141b80 0x7fc9640aab50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc954000f70 tx=0x7fc954001d00 comp rx=0 tx=0).stop 2024-03-23T23:49:32.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.508+0000 7fc95a000640 1 -- 172.21.15.8:0/1658120457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc964141b80 msgr2=0x7fc9640aab50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:49:32.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.508+0000 7fc95a000640 1 --2- 172.21.15.8:0/1658120457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc964141b80 0x7fc9640aab50 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc954000f70 tx=0x7fc954001d00 comp rx=0 tx=0).stop 2024-03-23T23:49:32.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.528+0000 7fc94f400640 1 --2- 172.21.15.8:0/1658120457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9640c12a0 0x7fc964151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:32.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.532+0000 7fc961e00640 1 --2- 172.21.15.8:0/1658120457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9640c12a0 0x7fc964151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:32.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.532+0000 7fc94f400640 1 -- 172.21.15.8:0/1658120457 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9640ad460 con 0x7fc9640c12a0 2024-03-23T23:49:32.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.532+0000 7fc961e00640 1 -- 172.21.15.8:0/1658120457 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc964068270 con 0x7fc9640c12a0 2024-03-23T23:49:32.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.532+0000 7fc961e00640 1 --2- 172.21.15.8:0/1658120457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9640c12a0 0x7fc964151590 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc954017000 tx=0x7fc954001490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:32.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.536+0000 7fc95a000640 1 -- 172.21.15.8:0/1658120457 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc954013500 con 0x7fc9640c12a0 2024-03-23T23:49:32.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.536+0000 7fc95a000640 1 -- 172.21.15.8:0/1658120457 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4872 (secure 0 0 0) 0x7fc9540136a0 con 0x7fc9640c12a0 2024-03-23T23:49:32.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.536+0000 7fc95a000640 1 -- 172.21.15.8:0/1658120457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9640c12a0 msgr2=0x7fc964151590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:32.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.540+0000 7fc95a000640 1 --2- 172.21.15.8:0/1658120457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9640c12a0 0x7fc964151590 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc954017000 tx=0x7fc954001490 comp rx=0 tx=0).stop 2024-03-23T23:49:32.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.540+0000 7fc95a000640 1 -- 172.21.15.8:0/1658120457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9640c12a0 msgr2=0x7fc964151590 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:49:32.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.540+0000 7fc95a000640 1 --2- 172.21.15.8:0/1658120457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9640c12a0 0x7fc964151590 secure :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc954017000 tx=0x7fc954001490 comp rx=0 tx=0).stop 2024-03-23T23:49:32.548 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:49:32.548 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:49:32.548 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:49:32.548 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:49:32.548 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 48, 2024-03-23T23:49:32.548 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:49:32.549 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:49:32.549 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:49:32.549 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:49:32.549 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:32.549 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 16, 2024-03-23T23:49:32.549 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:49:32.549 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:49:32.549 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:49:32.549 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:49:32.549 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:49:32.549 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:49:32.549 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:49:32.549 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:49:32.550 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:49:32.550 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:49:32.550 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:49:32.550 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:49:32.550 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:49:32.550 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:49:32.550 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:32.550 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:49:32.550 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:49:32.551 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:49:32.551 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:49:32.551 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:49:32.551 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:49:32.551 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:49:32.551 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:49:32.551 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:49:32.551 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:49:32.551 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:49:32.551 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:49:32.553 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:49:32.553 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:32.553 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:32.553 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:49:32.553 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:49:32.553 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:49:32.553 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:49:32.553 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:49:32.553 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:49:32.553 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:49:32.554 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:49:32.554 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:49:32.554 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:49:32.554 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:49:32.554 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:49:32.554 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:49:32.554 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:49:32.554 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:49:32.554 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:49:32.554 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:49:32.554 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:49:32.554 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:49:32.554 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:49:32.555 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:49:32.555 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:49:32.555 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:49:32.556 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:49:32.556 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:49:32.556 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:49:32.556 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:49:32.556 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:49:32.556 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:32.556 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:49:32.556 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:32.556 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:49:32.556 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:32.556 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:49:32.556 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:49:32.556 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:49:32.556 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:49:32.557 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:32.557 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:49:32.557 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:49:32.557 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:32.557 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:32.557 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:32.557 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:49:32.557 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:49:32.557 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:32.557 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:32.557 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:32.557 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:32.557 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:49:32.557 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:49:32.558 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:49:32.558 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:49:32.558 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:49:32.558 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:32.558 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:32.558 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:49:32.558 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:49:32.558 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:49:32.558 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:49:32.558 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:32.558 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:49:32.558 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:49:32.558 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:32.558 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:32.559 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:32.559 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:49:32.559 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:49:32.559 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:32.559 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:32.559 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:32.559 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:32.559 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:49:32.559 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:49:32.559 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:49:32.559 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:49:32.559 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:49:32.559 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:32.559 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:32.560 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:49:32.560 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:49:32.560 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:49:32.560 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:49:32.560 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:32.560 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:49:32.560 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:49:32.560 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:32.560 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:32.560 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:32.560 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:49:32.560 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:49:32.560 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:32.560 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:32.561 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:32.561 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:32.561 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:49:32.561 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:49:32.561 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:49:32.561 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:49:32.561 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:49:32.561 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:32.561 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:32.561 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:32.562 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:49:32.562 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:49:32.562 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:32.562 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:49:32.562 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:32.562 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:49:32.562 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:32.562 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:32.562 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:49:32.562 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:32.562 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:49:32.562 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:32.562 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:49:32.563 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:32.563 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:32.563 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:49:32.563 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:32.563 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:49:32.563 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:32.563 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:49:32.563 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:32.563 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:32.563 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:49:32.563 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:32.563 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:49:32.563 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:32.563 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:49:32.564 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:32.564 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:32.564 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:32.564 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:49:32.564 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:49:32.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.560+0000 7fc94f400640 1 -- 172.21.15.8:0/1658120457 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc944067730 msgr2=0x7fc944069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:32.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.560+0000 7fc94f400640 1 --2- 172.21.15.8:0/1658120457 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc944067730 0x7fc944069bf0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc95c009ee0 tx=0x7fc95c009450 comp rx=0 tx=0).stop 2024-03-23T23:49:32.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.560+0000 7fc94f400640 1 -- 172.21.15.8:0/1658120457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9640c3f60 msgr2=0x7fc96414ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:32.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.560+0000 7fc94f400640 1 --2- 172.21.15.8:0/1658120457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9640c3f60 0x7fc96414ded0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc95001a620 tx=0x7fc950019060 comp rx=0 tx=0).stop 2024-03-23T23:49:32.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.560+0000 7fc962800640 1 -- 172.21.15.8:0/1658120457 reap_dead start 2024-03-23T23:49:32.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.568+0000 7fc94f400640 1 -- 172.21.15.8:0/1658120457 shutdown_connections 2024-03-23T23:49:32.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.568+0000 7fc94f400640 1 --2- 172.21.15.8:0/1658120457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9640c3f60 0x7fc96414ded0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:32.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.568+0000 7fc94f400640 1 -- 172.21.15.8:0/1658120457 >> 172.21.15.8:0/1658120457 conn(0x7fc9640a9870 msgr2=0x7fc9641562f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:49:32.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.576+0000 7fc94f400640 1 -- 172.21.15.8:0/1658120457 shutdown_connections 2024-03-23T23:49:32.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:32.576+0000 7fc94f400640 1 -- 172.21.15.8:0/1658120457 wait complete. 2024-03-23T23:49:32.707 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:49:32.707 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T23:49:32.707 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:49:33.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.100+0000 7fb126400640 1 Processor -- start 2024-03-23T23:49:33.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.100+0000 7fb126400640 1 -- start start 2024-03-23T23:49:33.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.104+0000 7fb126400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb120152c20 0x7fb1200c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:33.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.104+0000 7fb126400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb1200be5c0 0x7fb1201557a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:33.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.104+0000 7fb126400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb12006d9d0 con 0x7fb1200c8e30 2024-03-23T23:49:33.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.104+0000 7fb126400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1200cbc50 con 0x7fb1200be5c0 2024-03-23T23:49:33.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.104+0000 7fb126400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb120153000 con 0x7fb120152c20 2024-03-23T23:49:33.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.104+0000 7fb125a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fb1200c8e30 0x7fb120155ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53406/0 (socket says 172.21.15.8:53406) 2024-03-23T23:49:33.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.104+0000 7fb125a00640 1 -- 172.21.15.8:0/3466877717 learned_addr learned my addr 172.21.15.8:0/3466877717 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:49:33.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.108+0000 7fb125000640 1 --2- 172.21.15.8:0/3466877717 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb120152c20 0x7fb1200c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:33.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.112+0000 7fb11fe00640 1 --2- 172.21.15.8:0/3466877717 >> v2:172.21.15.196:3300/0 conn(0x7fb1200be5c0 0x7fb1201557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:33.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.112+0000 7fb11f400640 1 -- 172.21.15.8:0/3466877717 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584661518 0 0) 0x7fb12006d9d0 con 0x7fb1200c8e30 2024-03-23T23:49:33.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.112+0000 7fb11f400640 1 -- 172.21.15.8:0/3466877717 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb104003530 con 0x7fb1200c8e30 2024-03-23T23:49:33.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.112+0000 7fb11fe00640 1 -- 172.21.15.8:0/3466877717 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb120152c20 msgr2=0x7fb1200c58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:49:33.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.112+0000 7fb11fe00640 1 --2- 172.21.15.8:0/3466877717 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb120152c20 0x7fb1200c58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:33.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.112+0000 7fb11fe00640 1 -- 172.21.15.8:0/3466877717 >> v1:172.21.15.8:6789/0 conn(0x7fb1200c8e30 legacy=0x7fb120155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:33.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.112+0000 7fb11fe00640 1 -- 172.21.15.8:0/3466877717 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb120159580 con 0x7fb1200be5c0 2024-03-23T23:49:33.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.124+0000 7fb11fe00640 1 --2- 172.21.15.8:0/3466877717 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1200be5c0 0x7fb1201557a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb1200cbdd0 tx=0x7fb10c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3dd3627d0ab3750 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:33.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.124+0000 7fb11f400640 1 -- 172.21.15.8:0/3466877717 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c0b0070 con 0x7fb1200be5c0 2024-03-23T23:49:33.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.124+0000 7fb11f400640 1 -- 172.21.15.8:0/3466877717 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10c0ab600 con 0x7fb1200be5c0 2024-03-23T23:49:33.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.124+0000 7fb11f400640 1 -- 172.21.15.8:0/3466877717 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c0ab9d0 con 0x7fb1200be5c0 2024-03-23T23:49:33.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.124+0000 7fb126400640 1 -- 172.21.15.8:0/3466877717 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1200be5c0 msgr2=0x7fb1201557a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:33.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.124+0000 7fb126400640 1 --2- 172.21.15.8:0/3466877717 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1200be5c0 0x7fb1201557a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb1200cbdd0 tx=0x7fb10c01c410 comp rx=0 tx=0).stop 2024-03-23T23:49:33.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.124+0000 7fb126400640 1 -- 172.21.15.8:0/3466877717 shutdown_connections 2024-03-23T23:49:33.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.124+0000 7fb126400640 1 --2- 172.21.15.8:0/3466877717 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1200be5c0 0x7fb1201557a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:33.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.124+0000 7fb126400640 1 --2- 172.21.15.8:0/3466877717 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb120152c20 0x7fb1200c58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:33.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.124+0000 7fb126400640 1 -- 172.21.15.8:0/3466877717 >> 172.21.15.8:0/3466877717 conn(0x7fb1200747f0 msgr2=0x7fb120074c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:49:33.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.128+0000 7fb126400640 1 -- 172.21.15.8:0/3466877717 shutdown_connections 2024-03-23T23:49:33.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.128+0000 7fb126400640 1 -- 172.21.15.8:0/3466877717 wait complete. 2024-03-23T23:49:33.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.136+0000 7fb126400640 1 Processor -- start 2024-03-23T23:49:33.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.136+0000 7fb126400640 1 -- start start 2024-03-23T23:49:33.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.136+0000 7fb126400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1200be5c0 0x7fb1201f2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:33.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.136+0000 7fb126400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1200c8e30 0x7fb12014c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:33.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.136+0000 7fb126400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb120152c20 0x7fb1201576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:33.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.136+0000 7fb126400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb120162720 con 0x7fb1200be5c0 2024-03-23T23:49:33.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.136+0000 7fb126400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1201563f0 con 0x7fb120152c20 2024-03-23T23:49:33.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.136+0000 7fb126400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1201628a0 con 0x7fb1200c8e30 2024-03-23T23:49:33.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.140+0000 7fb125a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb120152c20 0x7fb1201576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:33.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.140+0000 7fb125a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb120152c20 0x7fb1201576b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:53196/0 (socket says 172.21.15.8:53196) 2024-03-23T23:49:33.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.140+0000 7fb125a00640 1 -- 172.21.15.8:0/161767740 learned_addr learned my addr 172.21.15.8:0/161767740 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:49:33.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.140+0000 7fb11fe00640 1 --2- 172.21.15.8:0/161767740 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1200c8e30 0x7fb12014c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:33.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.140+0000 7fb125000640 1 --2- 172.21.15.8:0/161767740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1200be5c0 0x7fb1201f2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:33.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.140+0000 7fb11fe00640 1 -- 172.21.15.8:0/161767740 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb120152c20 msgr2=0x7fb1201576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:33.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.140+0000 7fb11fe00640 1 --2- 172.21.15.8:0/161767740 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb120152c20 0x7fb1201576b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:33.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.140+0000 7fb11fe00640 1 -- 172.21.15.8:0/161767740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1200be5c0 msgr2=0x7fb1201f2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:33.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.140+0000 7fb11fe00640 1 --2- 172.21.15.8:0/161767740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1200be5c0 0x7fb1201f2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:33.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.140+0000 7fb11fe00640 1 -- 172.21.15.8:0/161767740 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1201f6b10 con 0x7fb1200c8e30 2024-03-23T23:49:33.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.140+0000 7fb11fe00640 1 --2- 172.21.15.8:0/161767740 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1200c8e30 0x7fb12014c190 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb10c0ab000 tx=0x7fb10c0191b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:33.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.144+0000 7fb11cc00640 1 -- 172.21.15.8:0/161767740 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c0b8020 con 0x7fb1200c8e30 2024-03-23T23:49:33.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.144+0000 7fb126400640 1 -- 172.21.15.8:0/161767740 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1201f6df0 con 0x7fb1200c8e30 2024-03-23T23:49:33.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.144+0000 7fb126400640 1 -- 172.21.15.8:0/161767740 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1200c00c0 con 0x7fb1200c8e30 2024-03-23T23:49:33.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.144+0000 7fb11cc00640 1 -- 172.21.15.8:0/161767740 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10c0b4410 con 0x7fb1200c8e30 2024-03-23T23:49:33.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.144+0000 7fb11cc00640 1 -- 172.21.15.8:0/161767740 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c0b0040 con 0x7fb1200c8e30 2024-03-23T23:49:33.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.152+0000 7fb126400640 1 --2- 172.21.15.8:0/161767740 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0f8002a80 0x7fb0f8004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:33.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.152+0000 7fb126400640 1 -- 172.21.15.8:0/161767740 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f8007ed0 con 0x7fb0f8002a80 2024-03-23T23:49:33.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.152+0000 7fb11cc00640 1 -- 172.21.15.8:0/161767740 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb10c0bb020 con 0x7fb1200c8e30 2024-03-23T23:49:33.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.156+0000 7fb11cc00640 1 --2- 172.21.15.8:0/161767740 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb100067660 0x7fb100069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:33.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.156+0000 7fb11cc00640 1 -- 172.21.15.8:0/161767740 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fb10c11f260 con 0x7fb1200c8e30 2024-03-23T23:49:33.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.156+0000 7fb125000640 1 --2- 172.21.15.8:0/161767740 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0f8002a80 0x7fb0f8004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:33.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.156+0000 7fb125a00640 1 --2- 172.21.15.8:0/161767740 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb100067660 0x7fb100069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:33.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.160+0000 7fb125000640 1 -- 172.21.15.8:0/161767740 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb0f80080d0 con 0x7fb0f8002a80 2024-03-23T23:49:33.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.160+0000 7fb125000640 1 --2- 172.21.15.8:0/161767740 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0f8002a80 0x7fb0f8004f40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb118009f60 tx=0x7fb118009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:33.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.168+0000 7fb125a00640 1 --2- 172.21.15.8:0/161767740 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb100067660 0x7fb100069b20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb110007fd0 tx=0x7fb110009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:33.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.168+0000 7fb11cc00640 1 -- 172.21.15.8:0/161767740 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1180039a0 con 0x7fb0f8002a80 2024-03-23T23:49:33.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.168+0000 7fb11cc00640 1 -- 172.21.15.8:0/161767740 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fb118003b40 con 0x7fb0f8002a80 2024-03-23T23:49:33.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.168+0000 7fb11cc00640 1 -- 172.21.15.8:0/161767740 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0f8002a80 msgr2=0x7fb0f8004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:33.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.168+0000 7fb11cc00640 1 --2- 172.21.15.8:0/161767740 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0f8002a80 0x7fb0f8004f40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb118009f60 tx=0x7fb118009f90 comp rx=0 tx=0).stop 2024-03-23T23:49:33.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.168+0000 7fb11cc00640 1 -- 172.21.15.8:0/161767740 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0f8002a80 msgr2=0x7fb0f8004f40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:49:33.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.168+0000 7fb11cc00640 1 --2- 172.21.15.8:0/161767740 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0f8002a80 0x7fb0f8004f40 secure :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb118009f60 tx=0x7fb118009f90 comp rx=0 tx=0).stop 2024-03-23T23:49:33.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.192+0000 7fb126400640 1 --2- 172.21.15.8:0/161767740 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0f8006f10 0x7fb0f80073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:33.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.196+0000 7fb126400640 1 -- 172.21.15.8:0/161767740 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f800a4b0 con 0x7fb0f8006f10 2024-03-23T23:49:33.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.196+0000 7fb125000640 1 --2- 172.21.15.8:0/161767740 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0f8006f10 0x7fb0f80073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:33.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.196+0000 7fb125000640 1 -- 172.21.15.8:0/161767740 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb0f80078e0 con 0x7fb0f8006f10 2024-03-23T23:49:33.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.196+0000 7fb125000640 1 --2- 172.21.15.8:0/161767740 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0f8006f10 0x7fb0f80073a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb118009f60 tx=0x7fb118004a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:33.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.200+0000 7fb11cc00640 1 -- 172.21.15.8:0/161767740 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb118004600 con 0x7fb0f8006f10 2024-03-23T23:49:33.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.200+0000 7fb11cc00640 1 -- 172.21.15.8:0/161767740 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5183 (secure 0 0 0) 0x7fb1180045e0 con 0x7fb0f8006f10 2024-03-23T23:49:33.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.200+0000 7fb11cc00640 1 -- 172.21.15.8:0/161767740 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0f8006f10 msgr2=0x7fb0f80073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:33.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.200+0000 7fb11cc00640 1 --2- 172.21.15.8:0/161767740 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0f8006f10 0x7fb0f80073a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb118009f60 tx=0x7fb118004a50 comp rx=0 tx=0).stop 2024-03-23T23:49:33.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.200+0000 7fb11cc00640 1 -- 172.21.15.8:0/161767740 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0f8006f10 msgr2=0x7fb0f80073a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:49:33.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.200+0000 7fb11cc00640 1 --2- 172.21.15.8:0/161767740 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0f8006f10 0x7fb0f80073a0 secure :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb118009f60 tx=0x7fb118004a50 comp rx=0 tx=0).stop 2024-03-23T23:49:33.207 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:49:33.207 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:49:33.207 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:49:33.207 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:49:33.207 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 48, 2024-03-23T23:49:33.207 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:49:33.207 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:49:33.207 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:49:33.207 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:49:33.208 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:33.208 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 17, 2024-03-23T23:49:33.208 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:49:33.208 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:49:33.208 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:49:33.208 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:49:33.208 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:49:33.208 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:49:33.208 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:49:33.208 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:49:33.208 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:49:33.208 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:49:33.208 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:49:33.208 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:49:33.209 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:49:33.209 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:49:33.209 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:33.209 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:49:33.209 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:49:33.209 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:49:33.209 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:49:33.209 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:49:33.209 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:49:33.209 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:49:33.209 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:49:33.209 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:49:33.209 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:49:33.209 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:49:33.210 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:49:33.210 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:49:33.210 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:33.210 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:33.210 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:49:33.210 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:49:33.210 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:49:33.211 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:49:33.211 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:49:33.211 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:49:33.211 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:49:33.211 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:49:33.211 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:49:33.211 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:49:33.211 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:49:33.211 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:49:33.211 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:49:33.211 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:49:33.211 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:49:33.211 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:49:33.212 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:49:33.212 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:49:33.212 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:49:33.212 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:49:33.212 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:49:33.212 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:49:33.212 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:49:33.212 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:49:33.212 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:49:33.212 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:49:33.212 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:49:33.212 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:49:33.213 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:33.213 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:49:33.213 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:33.213 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:49:33.213 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:33.213 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:49:33.213 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:49:33.213 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:49:33.213 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:49:33.214 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:33.214 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:49:33.214 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:49:33.214 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:33.214 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:33.214 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:33.214 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:49:33.214 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:49:33.214 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:33.214 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:33.215 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:33.215 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:33.215 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:49:33.215 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:49:33.215 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:49:33.215 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:49:33.215 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:49:33.215 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:33.215 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:33.215 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:49:33.215 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:49:33.215 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:49:33.215 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:49:33.216 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:33.216 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:49:33.216 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:49:33.216 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:33.216 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:33.216 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:33.216 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:49:33.216 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:49:33.216 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:33.216 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:33.217 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:33.217 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:33.217 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:49:33.217 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:49:33.217 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:49:33.217 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:49:33.217 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:49:33.217 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:33.217 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:33.217 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:49:33.217 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:49:33.217 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:49:33.217 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:49:33.217 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:33.218 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:49:33.218 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:49:33.218 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:33.218 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:33.218 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:33.218 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:49:33.218 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:49:33.218 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:33.218 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:33.218 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:33.218 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:33.218 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:49:33.219 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:49:33.219 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:49:33.219 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:49:33.219 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:49:33.219 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:33.219 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:33.219 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:33.219 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:49:33.219 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:49:33.219 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:33.219 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:49:33.219 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:33.219 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:49:33.219 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:33.220 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:33.220 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:49:33.220 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:33.220 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:49:33.220 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:33.220 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:49:33.220 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:33.220 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:33.220 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:49:33.220 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:33.220 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:49:33.220 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:33.220 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:49:33.221 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:33.221 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:33.221 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:49:33.222 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:33.222 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:49:33.222 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:33.222 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:49:33.222 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:33.223 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:33.223 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:49:33.223 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:33.223 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:49:33.223 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:33.223 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:33.223 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:49:33.224 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:33.224 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:49:33.224 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:33.225 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:49:33.225 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:33.225 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:33.225 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:33.225 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:49:33.225 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:49:33.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.212+0000 7fb126400640 1 -- 172.21.15.8:0/161767740 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb100067660 msgr2=0x7fb100069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:33.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.212+0000 7fb126400640 1 --2- 172.21.15.8:0/161767740 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb100067660 0x7fb100069b20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb110007fd0 tx=0x7fb110009040 comp rx=0 tx=0).stop 2024-03-23T23:49:33.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.212+0000 7fb126400640 1 -- 172.21.15.8:0/161767740 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1200c8e30 msgr2=0x7fb12014c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:33.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.212+0000 7fb126400640 1 --2- 172.21.15.8:0/161767740 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1200c8e30 0x7fb12014c190 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb10c0ab000 tx=0x7fb10c0191b0 comp rx=0 tx=0).stop 2024-03-23T23:49:33.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.212+0000 7fb125a00640 1 -- 172.21.15.8:0/161767740 reap_dead start 2024-03-23T23:49:33.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.212+0000 7fb125a00640 1 -- 172.21.15.8:0/161767740 reap_dead start 2024-03-23T23:49:33.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.212+0000 7fb126400640 1 -- 172.21.15.8:0/161767740 shutdown_connections 2024-03-23T23:49:33.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.212+0000 7fb126400640 1 -- 172.21.15.8:0/161767740 >> 172.21.15.8:0/161767740 conn(0x7fb1200747f0 msgr2=0x7fb1201557a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:49:33.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.212+0000 7fb126400640 1 -- 172.21.15.8:0/161767740 shutdown_connections 2024-03-23T23:49:33.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.212+0000 7fb126400640 1 -- 172.21.15.8:0/161767740 wait complete. 2024-03-23T23:49:33.258 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:49:33.259 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T23:49:33.259 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:49:33.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.656+0000 7f3a29a00640 1 Processor -- start 2024-03-23T23:49:33.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.656+0000 7f3a29a00640 1 -- start start 2024-03-23T23:49:33.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.660+0000 7f3a29a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a1c00b080 0x7f3a1c00b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:33.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.660+0000 7f3a29a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a1c0f8f90 con 0x7f3a1c0f94b0 2024-03-23T23:49:33.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.660+0000 7f3a29a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a1c0f81d0 con 0x7f3a1c100930 2024-03-23T23:49:33.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.660+0000 7f3a29a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c0fa040 con 0x7f3a1c00b080 2024-03-23T23:49:33.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.664+0000 7f3a23e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a1c00b080 0x7f3a1c00b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:33.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.664+0000 7f3a23400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f3a1c0f94b0 0x7f3a1c0f9930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53410/0 (socket says 172.21.15.8:53410) 2024-03-23T23:49:33.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.664+0000 7f3a23400640 1 -- 172.21.15.8:0/2934676046 learned_addr learned my addr 172.21.15.8:0/2934676046 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:49:33.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.672+0000 7f3a22a00640 1 -- 172.21.15.8:0/2934676046 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 373149041 0 0) 0x7f3a1c0f8f90 con 0x7f3a1c0f94b0 2024-03-23T23:49:33.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.672+0000 7f3a22a00640 1 -- 172.21.15.8:0/2934676046 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a0c005740 con 0x7f3a1c0f94b0 2024-03-23T23:49:33.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.672+0000 7f3a23e00640 1 -- 172.21.15.8:0/2934676046 >> v1:172.21.15.196:6789/0 conn(0x7f3a1c100930 legacy=0x7f3a1c102d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:33.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.672+0000 7f3a23e00640 1 -- 172.21.15.8:0/2934676046 >> v1:172.21.15.8:6789/0 conn(0x7f3a1c0f94b0 legacy=0x7f3a1c0f9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:33.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.672+0000 7f3a23e00640 1 -- 172.21.15.8:0/2934676046 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1c0f84b0 con 0x7f3a1c00b080 2024-03-23T23:49:33.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.688+0000 7f3a23e00640 1 --2- 172.21.15.8:0/2934676046 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a1c00b080 0x7f3a1c00b460 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3a1800c210 tx=0x7f3a1801c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c5a5b658ee40ca2 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:33.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.692+0000 7f3a22a00640 1 -- 172.21.15.8:0/2934676046 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a180b0070 con 0x7f3a1c00b080 2024-03-23T23:49:33.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.692+0000 7f3a22a00640 1 -- 172.21.15.8:0/2934676046 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a18008be0 con 0x7f3a1c00b080 2024-03-23T23:49:33.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.692+0000 7f3a22a00640 1 -- 172.21.15.8:0/2934676046 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1800a0d0 con 0x7f3a1c00b080 2024-03-23T23:49:33.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.692+0000 7f3a29a00640 1 -- 172.21.15.8:0/2934676046 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a1c00b080 msgr2=0x7f3a1c00b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:33.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.692+0000 7f3a29a00640 1 --2- 172.21.15.8:0/2934676046 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a1c00b080 0x7f3a1c00b460 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3a1800c210 tx=0x7f3a1801c360 comp rx=0 tx=0).stop 2024-03-23T23:49:33.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.696+0000 7f3a29a00640 1 -- 172.21.15.8:0/2934676046 shutdown_connections 2024-03-23T23:49:33.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.696+0000 7f3a29a00640 1 --2- 172.21.15.8:0/2934676046 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a1c00b080 0x7f3a1c00b460 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:33.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.696+0000 7f3a29a00640 1 -- 172.21.15.8:0/2934676046 >> 172.21.15.8:0/2934676046 conn(0x7f3a1c005ef0 msgr2=0x7f3a1c006300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:49:33.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.700+0000 7f3a29a00640 1 -- 172.21.15.8:0/2934676046 shutdown_connections 2024-03-23T23:49:33.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.700+0000 7f3a29a00640 1 -- 172.21.15.8:0/2934676046 wait complete. 2024-03-23T23:49:33.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.704+0000 7f3a29a00640 1 Processor -- start 2024-03-23T23:49:33.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.712+0000 7f3a29a00640 1 -- start start 2024-03-23T23:49:33.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.712+0000 7f3a29a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3a1c00b080 0x7f3a1c02c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:33.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.712+0000 7f3a29a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a1c0f94b0 0x7f3a1c0eb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:33.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.712+0000 7f3a29a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a1c100930 0x7f3a1c0ebe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:33.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.716+0000 7f3a29a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c02e0d0 con 0x7f3a1c0f94b0 2024-03-23T23:49:33.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.716+0000 7f3a29a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c007640 con 0x7f3a1c00b080 2024-03-23T23:49:33.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.716+0000 7f3a29a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c02e250 con 0x7f3a1c100930 2024-03-23T23:49:33.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.716+0000 7f3a23e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3a1c00b080 0x7f3a1c02c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:33.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.716+0000 7f3a29000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a1c100930 0x7f3a1c0ebe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:33.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.716+0000 7f3a23e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3a1c00b080 0x7f3a1c02c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:53214/0 (socket says 172.21.15.8:53214) 2024-03-23T23:49:33.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.716+0000 7f3a23e00640 1 -- 172.21.15.8:0/4008596983 learned_addr learned my addr 172.21.15.8:0/4008596983 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:49:33.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.716+0000 7f3a29000640 1 -- 172.21.15.8:0/4008596983 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3a1c00b080 msgr2=0x7f3a1c02c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:33.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.716+0000 7f3a29000640 1 --2- 172.21.15.8:0/4008596983 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3a1c00b080 0x7f3a1c02c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:33.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.716+0000 7f3a29000640 1 -- 172.21.15.8:0/4008596983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a1c0f94b0 msgr2=0x7f3a1c0eb8e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:49:33.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.720+0000 7f3a23400640 1 --2- 172.21.15.8:0/4008596983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a1c0f94b0 0x7f3a1c0eb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:33.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.720+0000 7f3a29000640 1 --2- 172.21.15.8:0/4008596983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a1c0f94b0 0x7f3a1c0eb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:33.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.720+0000 7f3a29000640 1 -- 172.21.15.8:0/4008596983 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1c02ce10 con 0x7f3a1c100930 2024-03-23T23:49:33.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.720+0000 7f3a23400640 1 --2- 172.21.15.8:0/4008596983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a1c0f94b0 0x7f3a1c0eb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:49:33.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.720+0000 7f3a29000640 1 --2- 172.21.15.8:0/4008596983 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a1c100930 0x7f3a1c0ebe20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3a24073d90 tx=0x7f3a24073410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:33.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.724+0000 7f3a17e00640 1 -- 172.21.15.8:0/4008596983 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2404f980 con 0x7f3a1c100930 2024-03-23T23:49:33.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.724+0000 7f3a17e00640 1 -- 172.21.15.8:0/4008596983 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2407e020 con 0x7f3a1c100930 2024-03-23T23:49:33.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.724+0000 7f3a17e00640 1 -- 172.21.15.8:0/4008596983 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2406f630 con 0x7f3a1c100930 2024-03-23T23:49:33.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.724+0000 7f3a29a00640 1 -- 172.21.15.8:0/4008596983 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a1c19c830 con 0x7f3a1c100930 2024-03-23T23:49:33.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.724+0000 7f3a29a00640 1 -- 172.21.15.8:0/4008596983 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a1c19cdf0 con 0x7f3a1c100930 2024-03-23T23:49:33.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.732+0000 7f3a17e00640 1 -- 172.21.15.8:0/4008596983 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3a2406f890 con 0x7f3a1c100930 2024-03-23T23:49:33.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.732+0000 7f3a29a00640 1 --2- 172.21.15.8:0/4008596983 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a1c100250 0x7f3a1c0f1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:33.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.732+0000 7f3a29a00640 1 -- 172.21.15.8:0/4008596983 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c0052d0 con 0x7f3a1c100250 2024-03-23T23:49:33.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.732+0000 7f3a17e00640 1 --2- 172.21.15.8:0/4008596983 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3a04067730 0x7f3a04069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:33.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.732+0000 7f3a17e00640 1 -- 172.21.15.8:0/4008596983 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f3a240ef170 con 0x7f3a1c100930 2024-03-23T23:49:33.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.736+0000 7f3a23e00640 1 --2- 172.21.15.8:0/4008596983 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a1c100250 0x7f3a1c0f1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:33.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.736+0000 7f3a23e00640 1 -- 172.21.15.8:0/4008596983 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3a1c046d20 con 0x7f3a1c100250 2024-03-23T23:49:33.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.736+0000 7f3a23400640 1 --2- 172.21.15.8:0/4008596983 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3a04067730 0x7f3a04069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:33.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.740+0000 7f3a23400640 1 --2- 172.21.15.8:0/4008596983 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3a04067730 0x7f3a04069bf0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0f6b60 tx=0x7f3a10009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:33.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.740+0000 7f3a23e00640 1 --2- 172.21.15.8:0/4008596983 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a1c100250 0x7f3a1c0f1a70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3a18000c10 tx=0x7f3a18019100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:33.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.740+0000 7f3a17e00640 1 -- 172.21.15.8:0/4008596983 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a180bd070 con 0x7f3a1c100250 2024-03-23T23:49:33.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.740+0000 7f3a17e00640 1 -- 172.21.15.8:0/4008596983 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f3a1800a500 con 0x7f3a1c100250 2024-03-23T23:49:33.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.740+0000 7f3a17e00640 1 -- 172.21.15.8:0/4008596983 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a1c100250 msgr2=0x7f3a1c0f1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:33.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.744+0000 7f3a17e00640 1 --2- 172.21.15.8:0/4008596983 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a1c100250 0x7f3a1c0f1a70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3a18000c10 tx=0x7f3a18019100 comp rx=0 tx=0).stop 2024-03-23T23:49:33.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.744+0000 7f3a17e00640 1 -- 172.21.15.8:0/4008596983 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a1c100250 msgr2=0x7f3a1c0f1a70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:49:33.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.744+0000 7f3a17e00640 1 --2- 172.21.15.8:0/4008596983 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a1c100250 0x7f3a1c0f1a70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:33.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.768+0000 7f3a29a00640 1 --2- 172.21.15.8:0/4008596983 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a1c19cff0 0x7f3a1c199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:33.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.768+0000 7f3a29a00640 1 -- 172.21.15.8:0/4008596983 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c0ec360 con 0x7f3a1c19cff0 2024-03-23T23:49:33.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.772+0000 7f3a23e00640 1 --2- 172.21.15.8:0/4008596983 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a1c19cff0 0x7f3a1c199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:33.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.780+0000 7f3a23e00640 1 -- 172.21.15.8:0/4008596983 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3a1c02c970 con 0x7f3a1c19cff0 2024-03-23T23:49:33.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.788+0000 7f3a23e00640 1 --2- 172.21.15.8:0/4008596983 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a1c19cff0 0x7f3a1c199340 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c005450 tx=0x7f3a180a8000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:33.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.792+0000 7f3a17e00640 1 -- 172.21.15.8:0/4008596983 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a180b0040 con 0x7f3a1c19cff0 2024-03-23T23:49:33.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.792+0000 7f3a17e00640 1 -- 172.21.15.8:0/4008596983 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4530 (secure 0 0 0) 0x7f3a18000e50 con 0x7f3a1c19cff0 2024-03-23T23:49:33.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.792+0000 7f3a17e00640 1 -- 172.21.15.8:0/4008596983 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a1c19cff0 msgr2=0x7f3a1c199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:33.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.792+0000 7f3a17e00640 1 --2- 172.21.15.8:0/4008596983 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a1c19cff0 0x7f3a1c199340 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c005450 tx=0x7f3a180a8000 comp rx=0 tx=0).stop 2024-03-23T23:49:33.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.792+0000 7f3a17e00640 1 -- 172.21.15.8:0/4008596983 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a1c19cff0 msgr2=0x7f3a1c199340 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:49:33.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.792+0000 7f3a17e00640 1 --2- 172.21.15.8:0/4008596983 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a1c19cff0 0x7f3a1c199340 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c005450 tx=0x7f3a180a8000 comp rx=0 tx=0).stop 2024-03-23T23:49:33.798 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:49:33.798 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:49:33.798 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:49:33.798 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:49:33.798 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 48, 2024-03-23T23:49:33.798 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:49:33.798 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:49:33.798 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:49:33.798 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:49:33.799 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:33.799 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 18, 2024-03-23T23:49:33.799 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:49:33.799 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:49:33.799 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:49:33.799 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:49:33.799 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:49:33.799 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:49:33.799 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:49:33.799 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:49:33.799 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:49:33.799 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:49:33.800 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:49:33.800 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:49:33.800 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:49:33.800 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:49:33.800 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:33.800 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:49:33.800 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:49:33.800 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:49:33.800 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:49:33.800 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:49:33.800 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:49:33.800 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:49:33.800 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:49:33.801 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:49:33.801 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:49:33.801 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:49:33.801 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:49:33.801 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:49:33.801 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:33.801 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:33.801 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:49:33.801 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:49:33.801 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:49:33.801 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:49:33.801 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:49:33.801 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:49:33.802 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:49:33.802 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:49:33.802 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:49:33.802 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:49:33.802 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:49:33.802 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:49:33.802 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:49:33.802 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:49:33.802 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:49:33.802 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:49:33.802 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:49:33.802 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:49:33.802 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:49:33.803 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:49:33.803 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:49:33.803 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:49:33.803 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:49:33.803 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:49:33.803 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:49:33.803 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:49:33.803 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:49:33.803 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:49:33.803 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:33.803 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:49:33.803 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:33.803 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:49:33.803 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:33.804 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:49:33.804 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:49:33.804 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:49:33.804 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:49:33.804 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:33.804 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:49:33.804 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:49:33.804 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:33.804 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:33.805 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:33.805 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:49:33.805 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:49:33.805 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:33.805 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:33.805 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:33.805 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:33.805 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:49:33.805 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:49:33.805 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:49:33.805 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:49:33.806 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:49:33.806 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:33.806 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:33.806 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:49:33.806 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:49:33.807 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:49:33.807 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:49:33.807 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:33.807 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:49:33.807 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:49:33.807 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:33.807 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:33.807 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:33.807 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:49:33.807 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:49:33.807 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:33.807 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:33.807 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:33.807 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:33.808 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:49:33.808 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:49:33.808 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:49:33.808 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:49:33.808 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:49:33.808 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:33.808 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:33.808 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:49:33.808 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:49:33.808 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:49:33.808 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:49:33.808 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:33.808 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:49:33.808 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:49:33.808 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:33.809 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:33.809 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:33.809 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:49:33.809 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:49:33.809 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:33.809 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:33.809 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:33.809 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:33.809 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:49:33.809 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:49:33.809 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:49:33.809 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:49:33.809 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:49:33.809 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:33.810 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:33.810 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:33.810 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:49:33.810 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:49:33.810 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:33.810 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:49:33.810 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:33.810 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:49:33.810 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:33.810 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:33.810 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:49:33.810 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:33.810 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:49:33.810 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:33.811 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:49:33.811 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:33.811 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:33.811 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:33.811 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:49:33.811 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:49:33.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.804+0000 7f3a15600640 1 -- 172.21.15.8:0/4008596983 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3a04067730 msgr2=0x7f3a04069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:33.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.804+0000 7f3a15600640 1 --2- 172.21.15.8:0/4008596983 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3a04067730 0x7f3a04069bf0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0f6b60 tx=0x7f3a10009040 comp rx=0 tx=0).stop 2024-03-23T23:49:33.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.804+0000 7f3a15600640 1 -- 172.21.15.8:0/4008596983 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a1c100930 msgr2=0x7f3a1c0ebe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:33.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.804+0000 7f3a15600640 1 --2- 172.21.15.8:0/4008596983 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a1c100930 0x7f3a1c0ebe20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3a24073d90 tx=0x7f3a24073410 comp rx=0 tx=0).stop 2024-03-23T23:49:33.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.812+0000 7f3a29000640 1 -- 172.21.15.8:0/4008596983 reap_dead start 2024-03-23T23:49:33.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.812+0000 7f3a29000640 1 -- 172.21.15.8:0/4008596983 reap_dead start 2024-03-23T23:49:33.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.812+0000 7f3a15600640 1 -- 172.21.15.8:0/4008596983 shutdown_connections 2024-03-23T23:49:33.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.812+0000 7f3a15600640 1 -- 172.21.15.8:0/4008596983 >> 172.21.15.8:0/4008596983 conn(0x7f3a1c005ef0 msgr2=0x7f3a1c0eee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:49:33.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.812+0000 7f3a15600640 1 -- 172.21.15.8:0/4008596983 shutdown_connections 2024-03-23T23:49:33.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:33.812+0000 7f3a15600640 1 -- 172.21.15.8:0/4008596983 wait complete. 2024-03-23T23:49:33.852 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:49:33.852 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-03-23T23:49:33.852 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-03-23T23:49:33.853 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-03-23T23:49:33.853 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-03-23T23:49:33.853 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-23T23:49:33.853 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:49:33.894 INFO:tasks.ceph.mon.b:Stopped 2024-03-23T23:49:33.895 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-03-23T23:49:33.895 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:49:34.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.156+0000 7f5d19800640 1 Processor -- start 2024-03-23T23:49:34.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.160+0000 7f5d19800640 1 -- start start 2024-03-23T23:49:34.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.160+0000 7f5d19800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5d140a9790 0x7f5d141598b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:34.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.160+0000 7f5d19800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5d141562d0 0x7f5d14152c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:34.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.160+0000 7f5d19800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d14155b10 con 0x7f5d1406b3d0 2024-03-23T23:49:34.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.160+0000 7f5d19800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d140730e0 con 0x7f5d140a9790 2024-03-23T23:49:34.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.160+0000 7f5d19800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d1406c060 con 0x7f5d141562d0 2024-03-23T23:49:34.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.160+0000 7f5d12a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f5d1406b3d0 0x7f5d140c3a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53412/0 (socket says 172.21.15.8:53412) 2024-03-23T23:49:34.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.160+0000 7f5d12a00640 1 -- 172.21.15.8:0/3190291079 learned_addr learned my addr 172.21.15.8:0/3190291079 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:49:34.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.164+0000 7f5d13400640 1 -- 172.21.15.8:0/3190291079 >> v2:172.21.15.196:3300/0 conn(0x7f5d141562d0 msgr2=0x7f5d14152c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:49:34.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.164+0000 7f5d13400640 1 --2- 172.21.15.8:0/3190291079 >> v2:172.21.15.196:3300/0 conn(0x7f5d141562d0 0x7f5d14152c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:49:34.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.164+0000 7f5d12000640 1 --2- 172.21.15.8:0/3190291079 >> v2:172.21.15.8:3300/0 conn(0x7f5d140a9790 0x7f5d141598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:34.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.164+0000 7f5d11600640 1 -- 172.21.15.8:0/3190291079 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129884377 0 0) 0x7f5d14155b10 con 0x7f5d1406b3d0 2024-03-23T23:49:34.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.164+0000 7f5d11600640 1 -- 172.21.15.8:0/3190291079 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cf8003530 con 0x7f5d1406b3d0 2024-03-23T23:49:34.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.168+0000 7f5d12000640 1 -- 172.21.15.8:0/3190291079 >> v2:172.21.15.196:3300/0 conn(0x7f5d141562d0 msgr2=0x7f5d14152c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:49:34.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.168+0000 7f5d12000640 1 --2- 172.21.15.8:0/3190291079 >> v2:172.21.15.196:3300/0 conn(0x7f5d141562d0 0x7f5d14152c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:34.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.168+0000 7f5d12000640 1 -- 172.21.15.8:0/3190291079 >> v1:172.21.15.8:6789/0 conn(0x7f5d1406b3d0 legacy=0x7f5d140c3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:34.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.168+0000 7f5d12000640 1 -- 172.21.15.8:0/3190291079 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d14072b20 con 0x7f5d140a9790 2024-03-23T23:49:34.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.176+0000 7f5d12000640 1 --2- 172.21.15.8:0/3190291079 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d140a9790 0x7f5d141598b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5d14159fe0 tx=0x7f5d0001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108a6452995789f7 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:34.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.176+0000 7f5d11600640 1 -- 172.21.15.8:0/3190291079 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d000b0070 con 0x7f5d140a9790 2024-03-23T23:49:34.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.180+0000 7f5d11600640 1 -- 172.21.15.8:0/3190291079 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d000ab600 con 0x7f5d140a9790 2024-03-23T23:49:34.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.180+0000 7f5d11600640 1 -- 172.21.15.8:0/3190291079 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d000ab9b0 con 0x7f5d140a9790 2024-03-23T23:49:34.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.180+0000 7f5d19800640 1 -- 172.21.15.8:0/3190291079 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d140a9790 msgr2=0x7f5d141598b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:34.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.180+0000 7f5d19800640 1 --2- 172.21.15.8:0/3190291079 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d140a9790 0x7f5d141598b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5d14159fe0 tx=0x7f5d0001c380 comp rx=0 tx=0).stop 2024-03-23T23:49:34.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.180+0000 7f5d19800640 1 -- 172.21.15.8:0/3190291079 shutdown_connections 2024-03-23T23:49:34.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.180+0000 7f5d19800640 1 --2- 172.21.15.8:0/3190291079 >> v2:172.21.15.196:3300/0 conn(0x7f5d141562d0 0x7f5d14152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:34.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.180+0000 7f5d19800640 1 --2- 172.21.15.8:0/3190291079 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d140a9790 0x7f5d141598b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:34.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.180+0000 7f5d19800640 1 -- 172.21.15.8:0/3190291079 >> 172.21.15.8:0/3190291079 conn(0x7f5d140c8180 msgr2=0x7f5d140c8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:49:34.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.192+0000 7f5d19800640 1 -- 172.21.15.8:0/3190291079 shutdown_connections 2024-03-23T23:49:34.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.196+0000 7f5d19800640 1 -- 172.21.15.8:0/3190291079 wait complete. 2024-03-23T23:49:34.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.200+0000 7f5d19800640 1 Processor -- start 2024-03-23T23:49:34.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.212+0000 7f5d19800640 1 -- start start 2024-03-23T23:49:34.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.216+0000 7f5d19800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5d1406b3d0 0x7f5d14150090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:34.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.216+0000 7f5d19800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5d140a9790 0x7f5d141fb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:34.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.216+0000 7f5d19800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d141562d0 0x7f5d141f07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:34.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.216+0000 7f5d19800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1406b9c0 con 0x7f5d141562d0 2024-03-23T23:49:34.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.216+0000 7f5d19800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d14155e40 con 0x7f5d140a9790 2024-03-23T23:49:34.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.216+0000 7f5d19800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d14158f00 con 0x7f5d1406b3d0 2024-03-23T23:49:34.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.216+0000 7f5d12a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5d1406b3d0 0x7f5d14150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:34.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.216+0000 7f5d12a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5d1406b3d0 0x7f5d14150090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:60318/0 (socket says 172.21.15.8:60318) 2024-03-23T23:49:34.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.216+0000 7f5d12a00640 1 -- 172.21.15.8:0/3481745128 learned_addr learned my addr 172.21.15.8:0/3481745128 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:49:34.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.224+0000 7f5d13400640 1 --2- 172.21.15.8:0/3481745128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d141562d0 0x7f5d141f07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:34.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.224+0000 7f5d12000640 1 -- 172.21.15.8:0/3481745128 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5d140a9790 msgr2=0x7f5d141fb2e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:49:34.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.224+0000 7f5d12000640 1 --2- 172.21.15.8:0/3481745128 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5d140a9790 0x7f5d141fb2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:49:34.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.224+0000 7f5d12a00640 1 -- 172.21.15.8:0/3481745128 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5d140a9790 msgr2=0x7f5d141fb2e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:49:34.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.224+0000 7f5d12a00640 1 --2- 172.21.15.8:0/3481745128 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5d140a9790 0x7f5d141fb2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:34.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.224+0000 7f5d12a00640 1 -- 172.21.15.8:0/3481745128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d141562d0 msgr2=0x7f5d141f07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:34.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.224+0000 7f5d12a00640 1 --2- 172.21.15.8:0/3481745128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d141562d0 0x7f5d141f07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:34.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.228+0000 7f5d12a00640 1 -- 172.21.15.8:0/3481745128 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d14150820 con 0x7f5d1406b3d0 2024-03-23T23:49:34.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.228+0000 7f5d12a00640 1 --2- 172.21.15.8:0/3481745128 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5d1406b3d0 0x7f5d14150090 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c001590 tx=0x7f5d0c00bbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:34.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.236+0000 7f5d0aa00640 1 -- 172.21.15.8:0/3481745128 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c004d50 con 0x7f5d1406b3d0 2024-03-23T23:49:34.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.236+0000 7f5d0aa00640 1 -- 172.21.15.8:0/3481745128 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d0c009640 con 0x7f5d1406b3d0 2024-03-23T23:49:34.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.236+0000 7f5d0aa00640 1 -- 172.21.15.8:0/3481745128 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c009a10 con 0x7f5d1406b3d0 2024-03-23T23:49:34.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.248+0000 7f5d19800640 1 -- 172.21.15.8:0/3481745128 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d14150b00 con 0x7f5d1406b3d0 2024-03-23T23:49:34.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.248+0000 7f5d19800640 1 -- 172.21.15.8:0/3481745128 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d141510c0 con 0x7f5d1406b3d0 2024-03-23T23:49:34.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.256+0000 7f5d19800640 1 -- 172.21.15.8:0/3481745128 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d14151300 con 0x7f5d1406b3d0 2024-03-23T23:49:34.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.268+0000 7f5d0aa00640 1 -- 172.21.15.8:0/3481745128 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f5d0c009bb0 con 0x7f5d1406b3d0 2024-03-23T23:49:34.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.268+0000 7f5d0aa00640 1 --2- 172.21.15.8:0/3481745128 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5cf4067760 0x7f5cf4069c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:34.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.268+0000 7f5d0aa00640 1 -- 172.21.15.8:0/3481745128 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f5d0c085c30 con 0x7f5d1406b3d0 2024-03-23T23:49:34.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.272+0000 7f5d12000640 1 --2- 172.21.15.8:0/3481745128 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5cf4067760 0x7f5cf4069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:34.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.288+0000 7f5d12000640 1 --2- 172.21.15.8:0/3481745128 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5cf4067760 0x7f5cf4069c20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5d000ad000 tx=0x7f5d00008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:34.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.296+0000 7f5d0aa00640 1 -- 172.21.15.8:0/3481745128 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f5d0c025080 con 0x7f5d1406b3d0 2024-03-23T23:49:34.862 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":48,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:49:34.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.856+0000 7f5d19800640 1 -- 172.21.15.8:0/3481745128 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f5d140c43a0 con 0x7f5d1406b3d0 2024-03-23T23:49:34.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.856+0000 7f5d0aa00640 1 -- 172.21.15.8:0/3481745128 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1561 (secure 0 0 0) 0x7f5d0c012030 con 0x7f5d1406b3d0 2024-03-23T23:49:34.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.872+0000 7f5d19800640 1 -- 172.21.15.8:0/3481745128 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5cf4067760 msgr2=0x7f5cf4069c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:34.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.872+0000 7f5d19800640 1 --2- 172.21.15.8:0/3481745128 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5cf4067760 0x7f5cf4069c20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5d000ad000 tx=0x7f5d00008040 comp rx=0 tx=0).stop 2024-03-23T23:49:34.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.872+0000 7f5d19800640 1 -- 172.21.15.8:0/3481745128 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5d1406b3d0 msgr2=0x7f5d14150090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:34.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.872+0000 7f5d19800640 1 --2- 172.21.15.8:0/3481745128 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5d1406b3d0 0x7f5d14150090 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c001590 tx=0x7f5d0c00bbe0 comp rx=0 tx=0).stop 2024-03-23T23:49:34.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.876+0000 7f5d19800640 1 -- 172.21.15.8:0/3481745128 shutdown_connections 2024-03-23T23:49:34.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.876+0000 7f5d19800640 1 --2- 172.21.15.8:0/3481745128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d141562d0 0x7f5d141f07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:34.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.876+0000 7f5d19800640 1 --2- 172.21.15.8:0/3481745128 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5d140a9790 0x7f5d141fb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:34.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.876+0000 7f5d19800640 1 --2- 172.21.15.8:0/3481745128 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5cf4067760 0x7f5cf4069c20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:34.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.876+0000 7f5d19800640 1 --2- 172.21.15.8:0/3481745128 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5d1406b3d0 0x7f5d14150090 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:34.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.876+0000 7f5d19800640 1 -- 172.21.15.8:0/3481745128 >> 172.21.15.8:0/3481745128 conn(0x7f5d140c8180 msgr2=0x7f5d140c8560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:49:34.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.880+0000 7f5d19800640 1 -- 172.21.15.8:0/3481745128 shutdown_connections 2024-03-23T23:49:34.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:34.884+0000 7f5d19800640 1 -- 172.21.15.8:0/3481745128 wait complete. 2024-03-23T23:49:37.964 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:49:38.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.264+0000 7f6203200640 1 Processor -- start 2024-03-23T23:49:38.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.268+0000 7f6203200640 1 -- start start 2024-03-23T23:49:38.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.268+0000 7f6203200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6204071450 0x7f6204072b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:38.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.268+0000 7f6203200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6204071d50 con 0x7f620406c940 2024-03-23T23:49:38.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.268+0000 7f6203200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6204072030 con 0x7f6204156f80 2024-03-23T23:49:38.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.268+0000 7f6203200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6204072310 con 0x7f6204071450 2024-03-23T23:49:38.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.268+0000 7f6202800640 1 -- >> v2:172.21.15.196:3300/0 conn(0x7f6204071450 msgr2=0x7f6204072b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:49:38.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.268+0000 7f6201e00640 1 -- >> v1:172.21.15.196:6789/0 conn(0x7f6204156f80 legacy=0x7f62040c1810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-03-23T23:49:38.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.268+0000 7f6202800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6204071450 0x7f6204072b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:49:38.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.268+0000 7f6201400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f620406c940 0x7f620406d0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53426/0 (socket says 172.21.15.8:53426) 2024-03-23T23:49:38.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.268+0000 7f6201400640 1 -- 172.21.15.8:0/3535370705 learned_addr learned my addr 172.21.15.8:0/3535370705 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:49:38.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.272+0000 7f6200a00640 1 -- 172.21.15.8:0/3535370705 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3414340197 0 0) 0x7f6204071d50 con 0x7f620406c940 2024-03-23T23:49:38.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.272+0000 7f6200a00640 1 -- 172.21.15.8:0/3535370705 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61e8003530 con 0x7f620406c940 2024-03-23T23:49:38.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.272+0000 7f6200a00640 1 -- 172.21.15.8:0/3535370705 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3965847660 0 0) 0x7f61e8003530 con 0x7f620406c940 2024-03-23T23:49:38.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.272+0000 7f6200a00640 1 -- 172.21.15.8:0/3535370705 >> v2:172.21.15.196:3300/0 conn(0x7f6204071450 msgr2=0x7f6204072b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:49:38.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.272+0000 7f6200a00640 1 --2- 172.21.15.8:0/3535370705 >> v2:172.21.15.196:3300/0 conn(0x7f6204071450 0x7f6204072b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:38.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.272+0000 7f6200a00640 1 -- 172.21.15.8:0/3535370705 >> v1:172.21.15.196:6789/0 conn(0x7f6204156f80 legacy=0x7f62040c1810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:49:38.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.272+0000 7f6200a00640 1 -- 172.21.15.8:0/3535370705 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62040725f0 con 0x7f620406c940 2024-03-23T23:49:38.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.272+0000 7f6200a00640 1 -- 172.21.15.8:0/3535370705 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7f61f0001680 con 0x7f620406c940 2024-03-23T23:49:38.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.272+0000 7f6200a00640 1 -- 172.21.15.8:0/3535370705 >> v1:172.21.15.8:6789/0 conn(0x7f620406c940 legacy=0x7f620406d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:38.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.272+0000 7f6200a00640 1 --2- 172.21.15.8:0/3535370705 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61e80039c0 0x7f61e8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:38.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.272+0000 7f6200a00640 1 --2- 172.21.15.8:0/3535370705 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f61e8004810 0x7f61e8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:38.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.272+0000 7f6200a00640 1 --2- 172.21.15.8:0/3535370705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61e8005240 0x7f61e800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:38.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.272+0000 7f6200a00640 1 -- 172.21.15.8:0/3535370705 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6204072310 con 0x7f61e8005240 2024-03-23T23:49:38.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.272+0000 7f6200a00640 1 -- 172.21.15.8:0/3535370705 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e800c1a0 con 0x7f61e8004810 2024-03-23T23:49:38.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.272+0000 7f6200a00640 1 -- 172.21.15.8:0/3535370705 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e800c3a0 con 0x7f61e80039c0 2024-03-23T23:49:38.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.276+0000 7f6201400640 1 -- 172.21.15.8:0/3535370705 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f61e8004810 msgr2=0x7f61e8004c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:49:38.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.276+0000 7f6201400640 1 --2- 172.21.15.8:0/3535370705 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f61e8004810 0x7f61e8004c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:49:38.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.276+0000 7f6201e00640 1 --2- 172.21.15.8:0/3535370705 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61e80039c0 0x7f61e8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:38.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.276+0000 7f6202800640 1 --2- 172.21.15.8:0/3535370705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61e8005240 0x7f61e800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:38.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.276+0000 7f6202800640 1 -- 172.21.15.8:0/3535370705 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61e80039c0 msgr2=0x7f61e8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:49:38.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.276+0000 7f6202800640 1 --2- 172.21.15.8:0/3535370705 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61e80039c0 0x7f61e8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:38.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.276+0000 7f6202800640 1 -- 172.21.15.8:0/3535370705 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f61e8004810 msgr2=0x7f61e8004c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:49:38.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.276+0000 7f6202800640 1 --2- 172.21.15.8:0/3535370705 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f61e8004810 0x7f61e8004c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:38.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.276+0000 7f6202800640 1 -- 172.21.15.8:0/3535370705 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62040725f0 con 0x7f61e8005240 2024-03-23T23:49:38.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.280+0000 7f6202800640 1 --2- 172.21.15.8:0/3535370705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61e8005240 0x7f61e800b9d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f61fc009e30 tx=0x7f61fc01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3227d90363923c42 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:38.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.280+0000 7f6202800640 1 -- 172.21.15.8:0/3535370705 reap_dead start 2024-03-23T23:49:38.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.280+0000 7f6200a00640 1 -- 172.21.15.8:0/3535370705 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61fc009a30 con 0x7f61e8005240 2024-03-23T23:49:38.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.280+0000 7f6200a00640 1 -- 172.21.15.8:0/3535370705 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61fc0a9070 con 0x7f61e8005240 2024-03-23T23:49:38.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.280+0000 7f6200a00640 1 -- 172.21.15.8:0/3535370705 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61fc0a5bb0 con 0x7f61e8005240 2024-03-23T23:49:38.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.280+0000 7f6203200640 1 -- 172.21.15.8:0/3535370705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61e8005240 msgr2=0x7f61e800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:38.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.280+0000 7f6203200640 1 --2- 172.21.15.8:0/3535370705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61e8005240 0x7f61e800b9d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f61fc009e30 tx=0x7f61fc01c950 comp rx=0 tx=0).stop 2024-03-23T23:49:38.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.284+0000 7f6203200640 1 -- 172.21.15.8:0/3535370705 shutdown_connections 2024-03-23T23:49:38.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.284+0000 7f6203200640 1 --2- 172.21.15.8:0/3535370705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61e8005240 0x7f61e800b9d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:38.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.284+0000 7f6203200640 1 -- 172.21.15.8:0/3535370705 >> 172.21.15.8:0/3535370705 conn(0x7f62040c6e10 msgr2=0x7f62040c7220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:49:38.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.284+0000 7f6203200640 1 -- 172.21.15.8:0/3535370705 shutdown_connections 2024-03-23T23:49:38.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.284+0000 7f6203200640 1 -- 172.21.15.8:0/3535370705 wait complete. 2024-03-23T23:49:38.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.288+0000 7f6203200640 1 Processor -- start 2024-03-23T23:49:38.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.288+0000 7f6203200640 1 -- start start 2024-03-23T23:49:38.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.288+0000 7f6203200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61e8005240 0x7f62040c5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:38.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.288+0000 7f6201e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61e8005240 0x7f62040c5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:38.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.288+0000 7f6201e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61e8005240 0x7f62040c5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34794/0 (socket says 172.21.15.8:34794) 2024-03-23T23:49:38.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.288+0000 7f6201e00640 1 -- 172.21.15.8:0/636357258 learned_addr learned my addr 172.21.15.8:0/636357258 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:49:38.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.288+0000 7f6203200640 1 --2- 172.21.15.8:0/636357258 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62040abec0 0x7f620414b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:38.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.288+0000 7f6203200640 1 --2- 172.21.15.8:0/636357258 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6204152810 0x7f6204152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:38.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.288+0000 7f6201400640 1 -- 172.21.15.8:0/636357258 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62040abec0 msgr2=0x7f620414b140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:49:38.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.288+0000 7f6201400640 1 --2- 172.21.15.8:0/636357258 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62040abec0 0x7f620414b140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:49:38.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.288+0000 7f6203200640 1 -- 172.21.15.8:0/636357258 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620415d0d0 con 0x7f61e8005240 2024-03-23T23:49:38.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.288+0000 7f6203200640 1 -- 172.21.15.8:0/636357258 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620415cf50 con 0x7f62040abec0 2024-03-23T23:49:38.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.288+0000 7f6203200640 1 -- 172.21.15.8:0/636357258 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6204072b10 con 0x7f6204152810 2024-03-23T23:49:38.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.288+0000 7f6202800640 1 --2- 172.21.15.8:0/636357258 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6204152810 0x7f6204152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:38.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.288+0000 7f6201e00640 1 -- 172.21.15.8:0/636357258 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6204152810 msgr2=0x7f6204152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:38.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.288+0000 7f6201e00640 1 --2- 172.21.15.8:0/636357258 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6204152810 0x7f6204152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:38.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.288+0000 7f6201e00640 1 -- 172.21.15.8:0/636357258 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62040abec0 msgr2=0x7f620414b140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:49:38.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.288+0000 7f6201e00640 1 --2- 172.21.15.8:0/636357258 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62040abec0 0x7f620414b140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:38.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.288+0000 7f6201e00640 1 -- 172.21.15.8:0/636357258 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62040c6c00 con 0x7f61e8005240 2024-03-23T23:49:38.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.288+0000 7f6201e00640 1 --2- 172.21.15.8:0/636357258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61e8005240 0x7f62040c5980 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f61f40096e0 tx=0x7f61f4009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:38.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.292+0000 7f61fa000640 1 -- 172.21.15.8:0/636357258 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f4016070 con 0x7f61e8005240 2024-03-23T23:49:38.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.292+0000 7f6203200640 1 -- 172.21.15.8:0/636357258 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f620414bd20 con 0x7f61e8005240 2024-03-23T23:49:38.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.292+0000 7f61fa000640 1 -- 172.21.15.8:0/636357258 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f400e7b0 con 0x7f61e8005240 2024-03-23T23:49:38.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.292+0000 7f6203200640 1 -- 172.21.15.8:0/636357258 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62040c6360 con 0x7f61e8005240 2024-03-23T23:49:38.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.292+0000 7f61fa000640 1 -- 172.21.15.8:0/636357258 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f4016070 con 0x7f61e8005240 2024-03-23T23:49:38.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.292+0000 7f6203200640 1 -- 172.21.15.8:0/636357258 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f620404f410 con 0x7f61e8005240 2024-03-23T23:49:38.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.296+0000 7f61fa000640 1 -- 172.21.15.8:0/636357258 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f61f4019070 con 0x7f61e8005240 2024-03-23T23:49:38.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.296+0000 7f61fa000640 1 --2- 172.21.15.8:0/636357258 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f61e4067810 0x7f61e4069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:38.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.296+0000 7f61fa000640 1 -- 172.21.15.8:0/636357258 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f61f40852a0 con 0x7f61e8005240 2024-03-23T23:49:38.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.296+0000 7f6201400640 1 --2- 172.21.15.8:0/636357258 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f61e4067810 0x7f61e4069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:38.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.300+0000 7f6201400640 1 --2- 172.21.15.8:0/636357258 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f61e4067810 0x7f61e4069cd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f62041ecb60 tx=0x7f61f0001550 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:38.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.304+0000 7f61fa000640 1 -- 172.21.15.8:0/636357258 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f62040c6c00 con 0x7f61e8005240 2024-03-23T23:49:38.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.924+0000 7f6203200640 1 -- 172.21.15.8:0/636357258 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f6204071230 con 0x7f61e8005240 2024-03-23T23:49:38.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.928+0000 7f61fa000640 1 -- 172.21.15.8:0/636357258 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1561 (secure 0 0 0) 0x7f61f40553f0 con 0x7f61e8005240 2024-03-23T23:49:38.933 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":48,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:49:38.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.936+0000 7f6203200640 1 -- 172.21.15.8:0/636357258 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f61e4067810 msgr2=0x7f61e4069cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:38.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.936+0000 7f6203200640 1 --2- 172.21.15.8:0/636357258 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f61e4067810 0x7f61e4069cd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f62041ecb60 tx=0x7f61f0001550 comp rx=0 tx=0).stop 2024-03-23T23:49:38.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.936+0000 7f6203200640 1 -- 172.21.15.8:0/636357258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61e8005240 msgr2=0x7f62040c5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:38.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.936+0000 7f6203200640 1 --2- 172.21.15.8:0/636357258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61e8005240 0x7f62040c5980 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f61f40096e0 tx=0x7f61f4009ba0 comp rx=0 tx=0).stop 2024-03-23T23:49:38.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.940+0000 7f6203200640 1 -- 172.21.15.8:0/636357258 shutdown_connections 2024-03-23T23:49:38.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.940+0000 7f6203200640 1 --2- 172.21.15.8:0/636357258 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f61e4067810 0x7f61e4069cd0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:38.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.940+0000 7f6203200640 1 --2- 172.21.15.8:0/636357258 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6204152810 0x7f6204152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:38.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.940+0000 7f6203200640 1 --2- 172.21.15.8:0/636357258 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62040abec0 0x7f620414b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:38.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.940+0000 7f6203200640 1 --2- 172.21.15.8:0/636357258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61e8005240 0x7f62040c5980 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:38.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.940+0000 7f6203200640 1 -- 172.21.15.8:0/636357258 >> 172.21.15.8:0/636357258 conn(0x7f62040c6e10 msgr2=0x7f620406cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:49:38.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.940+0000 7f6203200640 1 -- 172.21.15.8:0/636357258 shutdown_connections 2024-03-23T23:49:38.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:38.944+0000 7f6203200640 1 -- 172.21.15.8:0/636357258 wait complete. 2024-03-23T23:49:42.017 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:49:42.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:42.352+0000 7f4421400640 1 Processor -- start 2024-03-23T23:49:42.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:42.352+0000 7f4421400640 1 -- start start 2024-03-23T23:49:42.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:42.352+0000 7f4421400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f441c0c8ee0 0x7f441c0c51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:42.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:42.352+0000 7f4421400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f441c0c93e0 con 0x7f441c0c6fa0 2024-03-23T23:49:42.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:42.352+0000 7f4421400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f441c0c96c0 con 0x7f441c0c7fd0 2024-03-23T23:49:42.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:42.352+0000 7f4421400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f441c0c5710 con 0x7f441c0c8ee0 2024-03-23T23:49:42.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:42.356+0000 7f441b200640 1 -- >> v2:172.21.15.196:3300/0 conn(0x7f441c0c8ee0 msgr2=0x7f441c0c51d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:49:42.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:42.356+0000 7f441a800640 1 -- >> v1:172.21.15.196:6789/0 conn(0x7f441c0c7fd0 legacy=0x7f441c15a4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-03-23T23:49:42.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:42.356+0000 7f441b200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f441c0c8ee0 0x7f441c0c51d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:49:42.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:42.356+0000 7f4419e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f441c0c6fa0 0x7f441c0c4ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53436/0 (socket says 172.21.15.8:53436) 2024-03-23T23:49:42.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:42.356+0000 7f4419e00640 1 -- 172.21.15.8:0/2882538064 learned_addr learned my addr 172.21.15.8:0/2882538064 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:49:42.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:42.564+0000 7f441b200640 1 -- 172.21.15.8:0/2882538064 >> v2:172.21.15.196:3300/0 conn(0x7f441c0c8ee0 msgr2=0x7f441c0c51d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:49:42.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:42.564+0000 7f441b200640 1 --2- 172.21.15.8:0/2882538064 >> v2:172.21.15.196:3300/0 conn(0x7f441c0c8ee0 0x7f441c0c51d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:49:42.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:42.580+0000 7f441a800640 1 -- 172.21.15.8:0/2882538064 >> v1:172.21.15.196:6789/0 conn(0x7f441c0c7fd0 legacy=0x7f441c15a4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-03-23T23:49:42.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:42.976+0000 7f441b200640 1 -- 172.21.15.8:0/2882538064 >> v2:172.21.15.196:3300/0 conn(0x7f441c0c8ee0 msgr2=0x7f441c0c51d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:49:42.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:42.976+0000 7f441b200640 1 --2- 172.21.15.8:0/2882538064 >> v2:172.21.15.196:3300/0 conn(0x7f441c0c8ee0 0x7f441c0c51d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:49:42.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:42.992+0000 7f441a800640 1 -- 172.21.15.8:0/2882538064 >> v1:172.21.15.196:6789/0 conn(0x7f441c0c7fd0 legacy=0x7f441c15a4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-03-23T23:49:43.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:43.780+0000 7f441b200640 1 -- 172.21.15.8:0/2882538064 >> v2:172.21.15.196:3300/0 conn(0x7f441c0c8ee0 msgr2=0x7f441c0c51d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:49:43.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:43.780+0000 7f441b200640 1 --2- 172.21.15.8:0/2882538064 >> v2:172.21.15.196:3300/0 conn(0x7f441c0c8ee0 0x7f441c0c51d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:49:43.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:43.816+0000 7f441a800640 1 -- 172.21.15.8:0/2882538064 >> v1:172.21.15.196:6789/0 conn(0x7f441c0c7fd0 legacy=0x7f441c15a4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-03-23T23:49:43.959 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:49:43.965 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:49:45.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.356+0000 7f4413e00640 1 -- 172.21.15.8:0/2882538064 >> v2:172.21.15.196:3300/0 conn(0x7f441c0c8ee0 msgr2=0x7f441c0c51d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:49:45.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.356+0000 7f4413e00640 1 --2- 172.21.15.8:0/2882538064 >> v2:172.21.15.196:3300/0 conn(0x7f441c0c8ee0 0x7f441c0c51d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:45.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.356+0000 7f4413e00640 1 -- 172.21.15.8:0/2882538064 >> v1:172.21.15.196:6789/0 conn(0x7f441c0c7fd0 legacy=0x7f441c15a4c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:49:45.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.356+0000 7f4413e00640 1 -- 172.21.15.8:0/2882538064 >> v1:172.21.15.8:6789/0 conn(0x7f441c0c6fa0 legacy=0x7f441c0c4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:45.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.356+0000 7f4413e00640 1 --2- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43fc0036d0 0x7f43fc005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:45.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.356+0000 7f4413e00640 1 --2- 172.21.15.8:0/2882538064 >> v2:172.21.15.8:3300/0 conn(0x7f43fc006240 0x7f43fc008700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:45.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.356+0000 7f4413e00640 1 -- 172.21.15.8:0/2882538064 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f441c0c5710 con 0x7f43fc006240 2024-03-23T23:49:45.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.356+0000 7f4413e00640 1 -- 172.21.15.8:0/2882538064 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc008db0 con 0x7f43fc0036d0 2024-03-23T23:49:45.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.360+0000 7f4419e00640 1 --2- 172.21.15.8:0/2882538064 >> v2:172.21.15.8:3300/0 conn(0x7f43fc006240 0x7f43fc008700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:45.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.360+0000 7f4419e00640 1 -- 172.21.15.8:0/2882538064 >> v2:172.21.15.8:3300/0 conn(0x7f43fc006240 msgr2=0x7f43fc008700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:49:45.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.360+0000 7f4419e00640 1 -- 172.21.15.8:0/2882538064 >> v2:172.21.15.8:3300/0 conn(0x7f43fc006240 msgr2=0x7f43fc008700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:49:45.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.360+0000 7f4419e00640 1 --2- 172.21.15.8:0/2882538064 >> v2:172.21.15.8:3300/0 conn(0x7f43fc006240 0x7f43fc008700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:49:45.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.360+0000 7f4419e00640 1 --2- 172.21.15.8:0/2882538064 >> v2:172.21.15.8:3300/0 conn(0x7f43fc006240 0x7f43fc008700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:49:45.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.364+0000 7f441a800640 1 --2- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43fc0036d0 0x7f43fc005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:45.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.368+0000 7f441a800640 1 -- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43fc0036d0 msgr2=0x7f43fc005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:49:45.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.368+0000 7f441a800640 1 -- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43fc0036d0 msgr2=0x7f43fc005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:49:45.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.368+0000 7f441a800640 1 --2- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43fc0036d0 0x7f43fc005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:49:45.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.368+0000 7f441a800640 1 --2- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43fc0036d0 0x7f43fc005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:49:45.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.564+0000 7f4419e00640 1 --2- 172.21.15.8:0/2882538064 >> v2:172.21.15.8:3300/0 conn(0x7f43fc006240 0x7f43fc008700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:45.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.564+0000 7f4419e00640 1 -- 172.21.15.8:0/2882538064 >> v2:172.21.15.8:3300/0 conn(0x7f43fc006240 msgr2=0x7f43fc008700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:49:45.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.564+0000 7f4419e00640 1 -- 172.21.15.8:0/2882538064 >> v2:172.21.15.8:3300/0 conn(0x7f43fc006240 msgr2=0x7f43fc008700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:49:45.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.564+0000 7f4419e00640 1 --2- 172.21.15.8:0/2882538064 >> v2:172.21.15.8:3300/0 conn(0x7f43fc006240 0x7f43fc008700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:49:45.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.564+0000 7f4419e00640 1 --2- 172.21.15.8:0/2882538064 >> v2:172.21.15.8:3300/0 conn(0x7f43fc006240 0x7f43fc008700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:49:45.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.572+0000 7f441a800640 1 --2- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43fc0036d0 0x7f43fc005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:45.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.572+0000 7f441a800640 1 -- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43fc0036d0 msgr2=0x7f43fc005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:49:45.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.572+0000 7f441a800640 1 -- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43fc0036d0 msgr2=0x7f43fc005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:49:45.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.572+0000 7f441a800640 1 --2- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43fc0036d0 0x7f43fc005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:49:45.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.572+0000 7f441a800640 1 --2- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43fc0036d0 0x7f43fc005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:49:45.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.968+0000 7f4419e00640 1 --2- 172.21.15.8:0/2882538064 >> v2:172.21.15.8:3300/0 conn(0x7f43fc006240 0x7f43fc008700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:45.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.968+0000 7f4419e00640 1 -- 172.21.15.8:0/2882538064 >> v2:172.21.15.8:3300/0 conn(0x7f43fc006240 msgr2=0x7f43fc008700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:49:45.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.968+0000 7f4419e00640 1 -- 172.21.15.8:0/2882538064 >> v2:172.21.15.8:3300/0 conn(0x7f43fc006240 msgr2=0x7f43fc008700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:49:45.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.972+0000 7f4419e00640 1 --2- 172.21.15.8:0/2882538064 >> v2:172.21.15.8:3300/0 conn(0x7f43fc006240 0x7f43fc008700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:49:45.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.972+0000 7f4419e00640 1 --2- 172.21.15.8:0/2882538064 >> v2:172.21.15.8:3300/0 conn(0x7f43fc006240 0x7f43fc008700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:49:45.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.992+0000 7f441a800640 1 --2- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43fc0036d0 0x7f43fc005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:45.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.996+0000 7f441a800640 1 -- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43fc0036d0 msgr2=0x7f43fc005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:49:45.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.996+0000 7f441a800640 1 -- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43fc0036d0 msgr2=0x7f43fc005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:49:45.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.996+0000 7f441a800640 1 --2- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43fc0036d0 0x7f43fc005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:49:45.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:45.996+0000 7f441a800640 1 --2- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43fc0036d0 0x7f43fc005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:49:46.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:46.776+0000 7f4419e00640 1 --2- 172.21.15.8:0/2882538064 >> v2:172.21.15.8:3300/0 conn(0x7f43fc006240 0x7f43fc008700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:46.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:46.776+0000 7f4419e00640 1 -- 172.21.15.8:0/2882538064 >> v2:172.21.15.8:3300/0 conn(0x7f43fc006240 msgr2=0x7f43fc008700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:49:46.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:46.776+0000 7f4419e00640 1 -- 172.21.15.8:0/2882538064 >> v2:172.21.15.8:3300/0 conn(0x7f43fc006240 msgr2=0x7f43fc008700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:49:46.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:46.776+0000 7f4419e00640 1 --2- 172.21.15.8:0/2882538064 >> v2:172.21.15.8:3300/0 conn(0x7f43fc006240 0x7f43fc008700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:49:46.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:46.776+0000 7f4419e00640 1 --2- 172.21.15.8:0/2882538064 >> v2:172.21.15.8:3300/0 conn(0x7f43fc006240 0x7f43fc008700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:49:46.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:46.800+0000 7f441a800640 1 --2- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43fc0036d0 0x7f43fc005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:46.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:46.804+0000 7f441a800640 1 -- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43fc0036d0 msgr2=0x7f43fc005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:49:46.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:46.804+0000 7f441a800640 1 -- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43fc0036d0 msgr2=0x7f43fc005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:49:46.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:46.804+0000 7f441a800640 1 --2- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43fc0036d0 0x7f43fc005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:49:46.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:46.804+0000 7f441a800640 1 --2- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43fc0036d0 0x7f43fc005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:49:48.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.356+0000 7f4413e00640 1 -- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43fc0036d0 msgr2=0x7f43fc005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:49:48.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.356+0000 7f4413e00640 1 --2- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43fc0036d0 0x7f43fc005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:48.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.356+0000 7f4413e00640 1 -- 172.21.15.8:0/2882538064 >> v2:172.21.15.8:3300/0 conn(0x7f43fc006240 msgr2=0x7f43fc008700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:49:48.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.356+0000 7f4413e00640 1 --2- 172.21.15.8:0/2882538064 >> v2:172.21.15.8:3300/0 conn(0x7f43fc006240 0x7f43fc008700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:48.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.356+0000 7f4413e00640 1 --2- 172.21.15.8:0/2882538064 >> v2:172.21.15.8:3300/0 conn(0x7f43fc010260 0x7f43fc0126f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:48.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.356+0000 7f4413e00640 1 -- 172.21.15.8:0/2882538064 --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f441c0c99a0 con 0x7f441c0c6fa0 2024-03-23T23:49:48.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.356+0000 7f4413e00640 1 -- 172.21.15.8:0/2882538064 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f441c0c96c0 con 0x7f441c0c7fd0 2024-03-23T23:49:48.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.356+0000 7f4413e00640 1 -- 172.21.15.8:0/2882538064 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f441c0c5710 con 0x7f43fc010260 2024-03-23T23:49:48.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.356+0000 7f441a800640 1 -- 172.21.15.8:0/2882538064 >> v1:172.21.15.196:6789/0 conn(0x7f441c0c7fd0 legacy=0x7f43fc00b2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-03-23T23:49:48.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.356+0000 7f441b200640 1 -- 172.21.15.8:0/2882538064 reap_dead start 2024-03-23T23:49:48.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.360+0000 7f441b200640 1 --2- 172.21.15.8:0/2882538064 >> v2:172.21.15.8:3300/0 conn(0x7f43fc010260 0x7f43fc0126f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:48.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.360+0000 7f441b200640 1 -- 172.21.15.8:0/2882538064 >> v2:172.21.15.8:3300/0 conn(0x7f43fc010260 msgr2=0x7f43fc0126f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:49:48.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.360+0000 7f441b200640 1 -- 172.21.15.8:0/2882538064 >> v2:172.21.15.8:3300/0 conn(0x7f43fc010260 msgr2=0x7f43fc0126f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:49:48.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.360+0000 7f441b200640 1 --2- 172.21.15.8:0/2882538064 >> v2:172.21.15.8:3300/0 conn(0x7f43fc010260 0x7f43fc0126f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:49:48.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.360+0000 7f441b200640 1 --2- 172.21.15.8:0/2882538064 >> v2:172.21.15.8:3300/0 conn(0x7f43fc010260 0x7f43fc0126f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:49:48.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.528+0000 7f4419400640 1 -- 172.21.15.8:0/2882538064 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406929685 0 0) 0x7f441c0c99a0 con 0x7f441c0c6fa0 2024-03-23T23:49:48.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.528+0000 7f4419400640 1 -- 172.21.15.8:0/2882538064 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4400003530 con 0x7f441c0c6fa0 2024-03-23T23:49:48.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.548+0000 7f4419400640 1 -- 172.21.15.8:0/2882538064 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1222946373 0 0) 0x7f4400003530 con 0x7f441c0c6fa0 2024-03-23T23:49:48.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.548+0000 7f4419400640 1 -- 172.21.15.8:0/2882538064 >> v2:172.21.15.8:3300/0 conn(0x7f43fc010260 msgr2=0x7f43fc0126f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:49:48.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.548+0000 7f4419400640 1 --2- 172.21.15.8:0/2882538064 >> v2:172.21.15.8:3300/0 conn(0x7f43fc010260 0x7f43fc0126f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:48.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.548+0000 7f4419400640 1 -- 172.21.15.8:0/2882538064 >> v1:172.21.15.196:6789/0 conn(0x7f441c0c7fd0 legacy=0x7f43fc00b2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:49:48.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.548+0000 7f4419400640 1 -- 172.21.15.8:0/2882538064 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43fc014da0 con 0x7f441c0c6fa0 2024-03-23T23:49:48.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.548+0000 7f4419400640 1 -- 172.21.15.8:0/2882538064 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7f44080015b0 con 0x7f441c0c6fa0 2024-03-23T23:49:48.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.548+0000 7f4419400640 1 -- 172.21.15.8:0/2882538064 >> v1:172.21.15.8:6789/0 conn(0x7f441c0c6fa0 legacy=0x7f43fc00ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:48.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.548+0000 7f4419400640 1 --2- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4400003a30 0x7f4400003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:48.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.548+0000 7f4419400640 1 --2- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4400004810 0x7f4400004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:48.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.548+0000 7f4419400640 1 --2- 172.21.15.8:0/2882538064 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44000052f0 0x7f440000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:48.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.548+0000 7f4419400640 1 -- 172.21.15.8:0/2882538064 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c0c5710 con 0x7f44000052f0 2024-03-23T23:49:48.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.548+0000 7f4419400640 1 -- 172.21.15.8:0/2882538064 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440000c1c0 con 0x7f4400004810 2024-03-23T23:49:48.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.548+0000 7f4419400640 1 -- 172.21.15.8:0/2882538064 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f440000c3c0 con 0x7f4400003a30 2024-03-23T23:49:48.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.548+0000 7f4419e00640 1 -- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4400004810 msgr2=0x7f4400004c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:49:48.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.548+0000 7f4419e00640 1 --2- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4400004810 0x7f4400004c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:49:48.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.556+0000 7f441a800640 1 --2- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4400003a30 0x7f4400003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:48.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.560+0000 7f441a800640 1 -- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4400004810 msgr2=0x7f4400004c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:49:48.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.560+0000 7f441a800640 1 --2- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4400004810 0x7f4400004c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:48.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.560+0000 7f441a800640 1 -- 172.21.15.8:0/2882538064 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44000052f0 msgr2=0x7f440000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:49:48.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.560+0000 7f441a800640 1 --2- 172.21.15.8:0/2882538064 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44000052f0 0x7f440000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:48.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.560+0000 7f441a800640 1 -- 172.21.15.8:0/2882538064 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43fc014da0 con 0x7f4400003a30 2024-03-23T23:49:48.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.560+0000 7f441b200640 1 -- 172.21.15.8:0/2882538064 reap_dead start 2024-03-23T23:49:48.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.580+0000 7f441a800640 1 --2- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4400003a30 0x7f4400003e70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f440c003940 tx=0x7f440c01dae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58f4dff705691b6 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:48.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.580+0000 7f4419400640 1 -- 172.21.15.8:0/2882538064 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c009af0 con 0x7f4400003a30 2024-03-23T23:49:48.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.584+0000 7f4419400640 1 -- 172.21.15.8:0/2882538064 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440c0a76c0 con 0x7f4400003a30 2024-03-23T23:49:48.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.584+0000 7f4421400640 1 -- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4400003a30 msgr2=0x7f4400003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:48.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.584+0000 7f4421400640 1 --2- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4400003a30 0x7f4400003e70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f440c003940 tx=0x7f440c01dae0 comp rx=0 tx=0).stop 2024-03-23T23:49:48.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.584+0000 7f4421400640 1 -- 172.21.15.8:0/2882538064 shutdown_connections 2024-03-23T23:49:48.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.584+0000 7f4421400640 1 --2- 172.21.15.8:0/2882538064 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4400003a30 0x7f4400003e70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:48.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.584+0000 7f4421400640 1 -- 172.21.15.8:0/2882538064 >> 172.21.15.8:0/2882538064 conn(0x7f441c0743f0 msgr2=0x7f441c074800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:49:48.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.584+0000 7f4421400640 1 -- 172.21.15.8:0/2882538064 shutdown_connections 2024-03-23T23:49:48.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.584+0000 7f4421400640 1 -- 172.21.15.8:0/2882538064 wait complete. 2024-03-23T23:49:48.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.592+0000 7f4421400640 1 Processor -- start 2024-03-23T23:49:48.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.592+0000 7f4421400640 1 -- start start 2024-03-23T23:49:48.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.592+0000 7f4421400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f441c0bfd70 0x7f441c152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:48.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.592+0000 7f4421400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f441c0c0150 0x7f441c153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:48.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.592+0000 7f441a800640 1 -- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f441c0bfd70 msgr2=0x7f441c152b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:49:48.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.592+0000 7f441a800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f441c0bfd70 0x7f441c152b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:49:48.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.596+0000 7f4419e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f441c0c0150 0x7f441c153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:48.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.596+0000 7f4419e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f441c0c0150 0x7f441c153070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40044/0 (socket says 172.21.15.8:40044) 2024-03-23T23:49:48.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.596+0000 7f4419e00640 1 -- 172.21.15.8:0/2837580402 learned_addr learned my addr 172.21.15.8:0/2837580402 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:49:48.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.596+0000 7f4421400640 1 --2- 172.21.15.8:0/2837580402 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f441c153ca0 0x7f441c1efa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:48.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.596+0000 7f4421400640 1 -- 172.21.15.8:0/2837580402 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c0c83b0 con 0x7f441c0c0150 2024-03-23T23:49:48.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.596+0000 7f4421400640 1 -- 172.21.15.8:0/2837580402 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c0c8530 con 0x7f441c0bfd70 2024-03-23T23:49:48.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.596+0000 7f4421400640 1 -- 172.21.15.8:0/2837580402 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441c0c73f0 con 0x7f441c153ca0 2024-03-23T23:49:48.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.596+0000 7f441b200640 1 --2- 172.21.15.8:0/2837580402 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f441c153ca0 0x7f441c1efa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:48.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.596+0000 7f441b200640 1 -- 172.21.15.8:0/2837580402 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f441c0bfd70 msgr2=0x7f441c152b30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:49:48.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.596+0000 7f441b200640 1 --2- 172.21.15.8:0/2837580402 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f441c0bfd70 0x7f441c152b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:48.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.596+0000 7f441b200640 1 -- 172.21.15.8:0/2837580402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f441c0c0150 msgr2=0x7f441c153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:48.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.596+0000 7f441b200640 1 --2- 172.21.15.8:0/2837580402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f441c0c0150 0x7f441c153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:48.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.596+0000 7f441b200640 1 -- 172.21.15.8:0/2837580402 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441c074d10 con 0x7f441c153ca0 2024-03-23T23:49:48.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.596+0000 7f441b200640 1 --2- 172.21.15.8:0/2837580402 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f441c153ca0 0x7f441c1efa50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f441c0c92c0 tx=0x7f441400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:48.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.600+0000 7f4412a00640 1 -- 172.21.15.8:0/2837580402 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441400cb50 con 0x7f441c153ca0 2024-03-23T23:49:48.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.600+0000 7f4412a00640 1 -- 172.21.15.8:0/2837580402 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4414018070 con 0x7f441c153ca0 2024-03-23T23:49:48.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.600+0000 7f4412a00640 1 -- 172.21.15.8:0/2837580402 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4414012430 con 0x7f441c153ca0 2024-03-23T23:49:48.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.600+0000 7f4421400640 1 -- 172.21.15.8:0/2837580402 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f441c06ca80 con 0x7f441c153ca0 2024-03-23T23:49:48.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.600+0000 7f4421400640 1 -- 172.21.15.8:0/2837580402 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f441c0a8860 con 0x7f441c153ca0 2024-03-23T23:49:48.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.604+0000 7f4421400640 1 -- 172.21.15.8:0/2837580402 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f441c159a30 con 0x7f441c153ca0 2024-03-23T23:49:48.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.604+0000 7f4412a00640 1 -- 172.21.15.8:0/2837580402 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f44140125d0 con 0x7f441c153ca0 2024-03-23T23:49:48.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.608+0000 7f4412a00640 1 --2- 172.21.15.8:0/2837580402 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f43fc06af00 0x7f43fc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:48.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.608+0000 7f441a800640 1 --2- 172.21.15.8:0/2837580402 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f43fc06af00 0x7f43fc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:48.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.612+0000 7f4412a00640 1 -- 172.21.15.8:0/2837580402 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f4414085ad0 con 0x7f441c153ca0 2024-03-23T23:49:48.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.620+0000 7f4412a00640 1 -- 172.21.15.8:0/2837580402 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f441c159a30 con 0x7f441c153ca0 2024-03-23T23:49:48.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:48.620+0000 7f441a800640 1 --2- 172.21.15.8:0/2837580402 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f43fc06af00 0x7f43fc06d3c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f440c0b0000 tx=0x7f440c00e040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:49.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.212+0000 7f4421400640 1 -- 172.21.15.8:0/2837580402 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f441c1ef830 con 0x7f441c153ca0 2024-03-23T23:49:49.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.216+0000 7f4412a00640 1 -- 172.21.15.8:0/2837580402 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1554 (secure 0 0 0) 0x7f4414056500 con 0x7f441c153ca0 2024-03-23T23:49:49.220 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":52,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:49:49.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.228+0000 7f4421400640 1 -- 172.21.15.8:0/2837580402 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f43fc06af00 msgr2=0x7f43fc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:49.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.228+0000 7f4421400640 1 --2- 172.21.15.8:0/2837580402 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f43fc06af00 0x7f43fc06d3c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f440c0b0000 tx=0x7f440c00e040 comp rx=0 tx=0).stop 2024-03-23T23:49:49.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.228+0000 7f4421400640 1 -- 172.21.15.8:0/2837580402 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f441c153ca0 msgr2=0x7f441c1efa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:49.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.228+0000 7f4421400640 1 --2- 172.21.15.8:0/2837580402 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f441c153ca0 0x7f441c1efa50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f441c0c92c0 tx=0x7f441400ecc0 comp rx=0 tx=0).stop 2024-03-23T23:49:49.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.228+0000 7f4421400640 1 -- 172.21.15.8:0/2837580402 shutdown_connections 2024-03-23T23:49:49.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.228+0000 7f4421400640 1 --2- 172.21.15.8:0/2837580402 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f43fc06af00 0x7f43fc06d3c0 secure :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f440c0b0000 tx=0x7f440c00e040 comp rx=0 tx=0).stop 2024-03-23T23:49:49.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.228+0000 7f4421400640 1 --2- 172.21.15.8:0/2837580402 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f441c153ca0 0x7f441c1efa50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:49.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.228+0000 7f4421400640 1 --2- 172.21.15.8:0/2837580402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f441c0c0150 0x7f441c153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:49.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.228+0000 7f4421400640 1 --2- 172.21.15.8:0/2837580402 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f441c0bfd70 0x7f441c152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:49.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.228+0000 7f4421400640 1 -- 172.21.15.8:0/2837580402 >> 172.21.15.8:0/2837580402 conn(0x7f441c0743f0 msgr2=0x7f441c0ac0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:49:49.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.232+0000 7f4421400640 1 -- 172.21.15.8:0/2837580402 shutdown_connections 2024-03-23T23:49:49.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.232+0000 7f4421400640 1 -- 172.21.15.8:0/2837580402 wait complete. 2024-03-23T23:49:49.354 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-03-23T23:49:49.354 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-03-23T23:49:49.354 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:49:49.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.672+0000 7eff56400640 1 Processor -- start 2024-03-23T23:49:49.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.672+0000 7eff56400640 1 -- start start 2024-03-23T23:49:49.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.676+0000 7eff56400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff500c4430 0x7eff50072b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:49.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.676+0000 7eff56400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7eff5014ede0 0x7eff500c2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:49.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.676+0000 7eff56400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff5006ccc0 con 0x7eff500c2d60 2024-03-23T23:49:49.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.676+0000 7eff56400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff500c3760 con 0x7eff5014ede0 2024-03-23T23:49:49.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.676+0000 7eff56400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff50151710 con 0x7eff500c4430 2024-03-23T23:49:49.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.676+0000 7eff55000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff500c4430 0x7eff50072b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:49.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.676+0000 7eff55000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff500c4430 0x7eff50072b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:60992/0 (socket says 172.21.15.8:60992) 2024-03-23T23:49:49.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.676+0000 7eff55000640 1 -- 172.21.15.8:0/3769687510 learned_addr learned my addr 172.21.15.8:0/3769687510 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:49:49.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.680+0000 7eff4fe00640 1 -- 172.21.15.8:0/3769687510 >> v2:172.21.15.196:3300/0 conn(0x7eff5014ede0 msgr2=0x7eff500c2820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:49:49.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.680+0000 7eff4fe00640 1 --2- 172.21.15.8:0/3769687510 >> v2:172.21.15.196:3300/0 conn(0x7eff5014ede0 0x7eff500c2820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:49:49.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.680+0000 7eff55000640 1 -- 172.21.15.8:0/3769687510 >> v2:172.21.15.196:3300/0 conn(0x7eff5014ede0 msgr2=0x7eff500c2820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:49:49.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.680+0000 7eff55000640 1 --2- 172.21.15.8:0/3769687510 >> v2:172.21.15.196:3300/0 conn(0x7eff5014ede0 0x7eff500c2820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:49.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.680+0000 7eff55000640 1 -- 172.21.15.8:0/3769687510 >> v1:172.21.15.8:6789/0 conn(0x7eff500c2d60 legacy=0x7eff50151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:49.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.680+0000 7eff55000640 1 -- 172.21.15.8:0/3769687510 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5006cfa0 con 0x7eff500c4430 2024-03-23T23:49:49.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.692+0000 7eff55000640 1 --2- 172.21.15.8:0/3769687510 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff500c4430 0x7eff50072b30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7eff44013150 tx=0x7eff44024cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e67e5fe14bb2eea server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:49.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.692+0000 7eff4f400640 1 -- 172.21.15.8:0/3769687510 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff440112d0 con 0x7eff500c4430 2024-03-23T23:49:49.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.692+0000 7eff4f400640 1 -- 172.21.15.8:0/3769687510 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff44011470 con 0x7eff500c4430 2024-03-23T23:49:49.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.692+0000 7eff4f400640 1 -- 172.21.15.8:0/3769687510 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff440112d0 con 0x7eff500c4430 2024-03-23T23:49:49.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.696+0000 7eff56400640 1 -- 172.21.15.8:0/3769687510 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff500c4430 msgr2=0x7eff50072b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:49.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.696+0000 7eff56400640 1 --2- 172.21.15.8:0/3769687510 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff500c4430 0x7eff50072b30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7eff44013150 tx=0x7eff44024cb0 comp rx=0 tx=0).stop 2024-03-23T23:49:49.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.696+0000 7eff56400640 1 -- 172.21.15.8:0/3769687510 shutdown_connections 2024-03-23T23:49:49.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.696+0000 7eff56400640 1 --2- 172.21.15.8:0/3769687510 >> v2:172.21.15.196:3300/0 conn(0x7eff5014ede0 0x7eff500c2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:49.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.696+0000 7eff56400640 1 --2- 172.21.15.8:0/3769687510 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff500c4430 0x7eff50072b30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:49.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.700+0000 7eff56400640 1 -- 172.21.15.8:0/3769687510 >> 172.21.15.8:0/3769687510 conn(0x7eff500c3910 msgr2=0x7eff500c3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:49:49.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.700+0000 7eff56400640 1 -- 172.21.15.8:0/3769687510 shutdown_connections 2024-03-23T23:49:49.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.700+0000 7eff56400640 1 -- 172.21.15.8:0/3769687510 wait complete. 2024-03-23T23:49:49.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.704+0000 7eff56400640 1 Processor -- start 2024-03-23T23:49:49.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.704+0000 7eff56400640 1 -- start start 2024-03-23T23:49:49.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.704+0000 7eff56400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff500c2d60 0x7eff501fbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:49.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.704+0000 7eff56400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff500c4430 0x7eff500ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:49.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.708+0000 7eff56400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff5014ede0 0x7eff5014a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:49.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.708+0000 7eff56400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5006c940 con 0x7eff500c2d60 2024-03-23T23:49:49.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.708+0000 7eff56400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff50070be0 con 0x7eff5014ede0 2024-03-23T23:49:49.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.708+0000 7eff56400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff50156750 con 0x7eff500c4430 2024-03-23T23:49:49.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.708+0000 7eff4fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff500c4430 0x7eff500ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:49.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.708+0000 7eff55a00640 1 -- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff5014ede0 msgr2=0x7eff5014a5f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:49:49.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.708+0000 7eff55a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff5014ede0 0x7eff5014a5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:49:49.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.708+0000 7eff4fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff500c4430 0x7eff500ab8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:32774/0 (socket says 172.21.15.8:32774) 2024-03-23T23:49:49.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.708+0000 7eff4fe00640 1 -- 172.21.15.8:0/1027479412 learned_addr learned my addr 172.21.15.8:0/1027479412 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:49:49.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.708+0000 7eff4fe00640 1 -- 172.21.15.8:0/1027479412 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff5014ede0 msgr2=0x7eff5014a5f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:49:49.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.708+0000 7eff4fe00640 1 --2- 172.21.15.8:0/1027479412 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff5014ede0 0x7eff5014a5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:49.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.708+0000 7eff4fe00640 1 -- 172.21.15.8:0/1027479412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff500c2d60 msgr2=0x7eff501fbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:49.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.708+0000 7eff4fe00640 1 --2- 172.21.15.8:0/1027479412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff500c2d60 0x7eff501fbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:49.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.708+0000 7eff4fe00640 1 -- 172.21.15.8:0/1027479412 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff501578e0 con 0x7eff500c4430 2024-03-23T23:49:49.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.712+0000 7eff4fe00640 1 --2- 172.21.15.8:0/1027479412 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff500c4430 0x7eff500ab8a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7eff3c00b550 tx=0x7eff3c00ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:49.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.716+0000 7eff4cc00640 1 -- 172.21.15.8:0/1027479412 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3c013020 con 0x7eff500c4430 2024-03-23T23:49:49.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.716+0000 7eff4cc00640 1 -- 172.21.15.8:0/1027479412 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3c003dc0 con 0x7eff500c4430 2024-03-23T23:49:49.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.716+0000 7eff4cc00640 1 -- 172.21.15.8:0/1027479412 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3c005290 con 0x7eff500c4430 2024-03-23T23:49:49.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.716+0000 7eff56400640 1 -- 172.21.15.8:0/1027479412 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff50157bc0 con 0x7eff500c4430 2024-03-23T23:49:49.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.716+0000 7eff56400640 1 -- 172.21.15.8:0/1027479412 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff50153ef0 con 0x7eff500c4430 2024-03-23T23:49:49.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.720+0000 7eff56400640 1 --2- 172.21.15.8:0/1027479412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff50157d90 0x7eff5014ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:49.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.720+0000 7eff56400640 1 -- 172.21.15.8:0/1027479412 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff501fc1e0 con 0x7eff50157d90 2024-03-23T23:49:49.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.720+0000 7eff55000640 1 --2- 172.21.15.8:0/1027479412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff50157d90 0x7eff5014ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:49.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.724+0000 7eff4cc00640 1 -- 172.21.15.8:0/1027479412 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7eff3c016020 con 0x7eff500c4430 2024-03-23T23:49:49.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.728+0000 7eff4cc00640 1 --2- 172.21.15.8:0/1027479412 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7eff30067660 0x7eff30069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:49.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.732+0000 7eff55000640 1 -- 172.21.15.8:0/1027479412 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7eff501540f0 con 0x7eff50157d90 2024-03-23T23:49:49.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.732+0000 7eff55a00640 1 --2- 172.21.15.8:0/1027479412 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7eff30067660 0x7eff30069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:49.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.736+0000 7eff55a00640 1 --2- 172.21.15.8:0/1027479412 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7eff30067660 0x7eff30069b20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7eff48000f90 tx=0x7eff48007d20 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:49.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.740+0000 7eff4cc00640 1 -- 172.21.15.8:0/1027479412 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7eff3c085850 con 0x7eff500c4430 2024-03-23T23:49:49.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.740+0000 7eff55000640 1 --2- 172.21.15.8:0/1027479412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff50157d90 0x7eff5014ab30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7eff50070750 tx=0x7eff440ad950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:49.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.752+0000 7eff4cc00640 1 -- 172.21.15.8:0/1027479412 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff440112d0 con 0x7eff50157d90 2024-03-23T23:49:49.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.756+0000 7eff4cc00640 1 -- 172.21.15.8:0/1027479412 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7eff440ada40 con 0x7eff50157d90 2024-03-23T23:49:49.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.756+0000 7eff4cc00640 1 -- 172.21.15.8:0/1027479412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff50157d90 msgr2=0x7eff5014ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:49.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.756+0000 7eff4cc00640 1 --2- 172.21.15.8:0/1027479412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff50157d90 0x7eff5014ab30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7eff50070750 tx=0x7eff440ad950 comp rx=0 tx=0).stop 2024-03-23T23:49:49.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.756+0000 7eff4cc00640 1 -- 172.21.15.8:0/1027479412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff50157d90 msgr2=0x7eff5014ab30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:49:49.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.756+0000 7eff4cc00640 1 --2- 172.21.15.8:0/1027479412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff50157d90 0x7eff5014ab30 secure :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7eff50070750 tx=0x7eff440ad950 comp rx=0 tx=0).stop 2024-03-23T23:49:49.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.816+0000 7eff56400640 1 --2- 172.21.15.8:0/1027479412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff5015bae0 0x7eff501526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:49.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.816+0000 7eff56400640 1 -- 172.21.15.8:0/1027479412 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5004f410 con 0x7eff5015bae0 2024-03-23T23:49:49.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.828+0000 7eff55000640 1 --2- 172.21.15.8:0/1027479412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff5015bae0 0x7eff501526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:49.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.836+0000 7eff55000640 1 -- 172.21.15.8:0/1027479412 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7eff50071d30 con 0x7eff5015bae0 2024-03-23T23:49:49.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.840+0000 7eff55000640 1 --2- 172.21.15.8:0/1027479412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff5015bae0 0x7eff501526c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7eff44013150 tx=0x7eff440af000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:49.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.840+0000 7eff4cc00640 1 -- 172.21.15.8:0/1027479412 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44003a60 con 0x7eff5015bae0 2024-03-23T23:49:49.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.840+0000 7eff4cc00640 1 -- 172.21.15.8:0/1027479412 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5173 (secure 0 0 0) 0x7eff44003c00 con 0x7eff5015bae0 2024-03-23T23:49:49.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.840+0000 7eff4cc00640 1 -- 172.21.15.8:0/1027479412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff5015bae0 msgr2=0x7eff501526c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:49.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.840+0000 7eff4cc00640 1 --2- 172.21.15.8:0/1027479412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff5015bae0 0x7eff501526c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7eff44013150 tx=0x7eff440af000 comp rx=0 tx=0).stop 2024-03-23T23:49:49.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.840+0000 7eff4cc00640 1 -- 172.21.15.8:0/1027479412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff5015bae0 msgr2=0x7eff501526c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:49:49.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.840+0000 7eff4cc00640 1 --2- 172.21.15.8:0/1027479412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff5015bae0 0x7eff501526c0 secure :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7eff44013150 tx=0x7eff440af000 comp rx=0 tx=0).stop 2024-03-23T23:49:49.846 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:49:49.846 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:49:49.846 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:49:49.846 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:49:49.846 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 52, 2024-03-23T23:49:49.846 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:49:49.847 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:49:49.847 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:49:49.847 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:49.847 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 1, 2024-03-23T23:49:49.847 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:49:49.847 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:49:49.847 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:49:49.847 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:49:49.847 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:49:49.847 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:49:49.847 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:49:49.847 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:49:49.848 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:49:49.848 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:49:49.848 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:49:49.848 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:49:49.848 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:49:49.848 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:49:49.848 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:49.848 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:49:49.848 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:49:49.848 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:49:49.848 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:49:49.848 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:49:49.848 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:49:49.849 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:49:49.849 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:49:49.849 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:49:49.849 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:49:49.849 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:49:49.849 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:49:49.849 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:49:49.849 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:49.849 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:49.849 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:49:49.849 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:49:49.849 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:49:49.850 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:49:49.850 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:49:49.850 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:49:49.850 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:49:49.850 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:49:49.850 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:49:49.850 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:49:49.850 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:49:49.850 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:49:49.850 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:49:49.850 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:49:49.851 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:49:49.851 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:49:49.851 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:49:49.851 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:49:49.851 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:49:49.851 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:49:49.851 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:49:49.851 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:49:49.851 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:49:49.851 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:49:49.852 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:49:49.852 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:49:49.852 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:49:49.852 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:49:49.852 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:49.852 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:49:49.852 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:49.852 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:49:49.852 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:49.852 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:49:49.852 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:49:49.853 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:49:49.853 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:49:49.853 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:49.853 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:49:49.853 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:49:49.853 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:49.853 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:49.853 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:49.853 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:49:49.853 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:49:49.853 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:49.853 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:49.853 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:49.854 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:49.854 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:49:49.854 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:49:49.854 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:49:49.854 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:49:49.854 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:49:49.854 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:49.854 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:49.854 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:49:49.854 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:49:49.854 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:49:49.855 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:49:49.855 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:49.855 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:49:49.855 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:49:49.855 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:49.855 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:49.855 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:49.855 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:49:49.855 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:49:49.855 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:49.855 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:49.855 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:49.855 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:49.856 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:49:49.856 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:49:49.856 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:49:49.856 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:49:49.856 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:49:49.856 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:49.856 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:49.856 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:49:49.856 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:49:49.856 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:49:49.856 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:49:49.856 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:49.856 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:49:49.856 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:49:49.857 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:49.857 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:49.857 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:49.857 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:49:49.857 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:49:49.857 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:49.857 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:49.857 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:49.857 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:49.857 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:49:49.857 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:49:49.857 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:49:49.857 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:49:49.857 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:49:49.858 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:49.858 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:49.858 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:49.858 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:49:49.858 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:49:49.858 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:49.858 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:49:49.858 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:49.858 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:49:49.858 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:49.858 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:49.858 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:49:49.858 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:49.859 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:49:49.859 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:49.859 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:49:49.859 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:49.859 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:49.859 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:49:49.859 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:49.859 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:49:49.859 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:49.859 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5 2024-03-23T23:49:49.859 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:49.859 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:49.859 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:49:49.859 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:49.860 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:49:49.860 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:49.860 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:49:49.860 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:49.860 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:49.860 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:49:49.860 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:49.860 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:49:49.860 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:49.860 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:49.860 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:49:49.860 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:49.860 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:49:49.861 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:49.861 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:49:49.861 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:49.861 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:49.861 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:49.861 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:49:49.861 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:49:49.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.860+0000 7eff56400640 1 -- 172.21.15.8:0/1027479412 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7eff30067660 msgr2=0x7eff30069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:49.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.860+0000 7eff56400640 1 --2- 172.21.15.8:0/1027479412 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7eff30067660 0x7eff30069b20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7eff48000f90 tx=0x7eff48007d20 comp rx=0 tx=0).stop 2024-03-23T23:49:49.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.860+0000 7eff56400640 1 -- 172.21.15.8:0/1027479412 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff500c4430 msgr2=0x7eff500ab8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:49.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.860+0000 7eff56400640 1 --2- 172.21.15.8:0/1027479412 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff500c4430 0x7eff500ab8a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7eff3c00b550 tx=0x7eff3c00ba10 comp rx=0 tx=0).stop 2024-03-23T23:49:49.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.860+0000 7eff55a00640 1 -- 172.21.15.8:0/1027479412 reap_dead start 2024-03-23T23:49:49.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.860+0000 7eff55a00640 1 -- 172.21.15.8:0/1027479412 reap_dead start 2024-03-23T23:49:49.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.860+0000 7eff56400640 1 -- 172.21.15.8:0/1027479412 shutdown_connections 2024-03-23T23:49:49.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.860+0000 7eff56400640 1 -- 172.21.15.8:0/1027479412 >> 172.21.15.8:0/1027479412 conn(0x7eff500c3910 msgr2=0x7eff5014d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:49:49.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.872+0000 7eff56400640 1 -- 172.21.15.8:0/1027479412 shutdown_connections 2024-03-23T23:49:49.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:49.872+0000 7eff56400640 1 -- 172.21.15.8:0/1027479412 wait complete. 2024-03-23T23:49:49.920 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T23:49:49.920 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-03-23T23:49:49.920 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:49:50.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.368+0000 7f7a6a800640 1 Processor -- start 2024-03-23T23:49:50.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.372+0000 7f7a6a800640 1 -- start start 2024-03-23T23:49:50.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.372+0000 7f7a6a800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7a5c0dbce0 0x7f7a5c0e2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:50.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.372+0000 7f7a6a800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7a5c0ded20 0x7f7a5c0df1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:50.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.372+0000 7f7a6a800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a5c0de870 con 0x7f7a5c00b0c0 2024-03-23T23:49:50.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.372+0000 7f7a6a800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a5c0e2c50 con 0x7f7a5c0dbce0 2024-03-23T23:49:50.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.372+0000 7f7a6a800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a5c0df710 con 0x7f7a5c0ded20 2024-03-23T23:49:50.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.376+0000 7f7a68a00640 1 -- >> v1:172.21.15.196:6789/0 conn(0x7f7a5c00b0c0 legacy=0x7f7a5c006f00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-03-23T23:49:50.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.376+0000 7f7a69e00640 1 -- >> v2:172.21.15.196:3300/0 conn(0x7f7a5c0ded20 msgr2=0x7f7a5c0df1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:49:50.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.376+0000 7f7a69e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7a5c0ded20 0x7f7a5c0df1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:49:50.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.376+0000 7f7a69400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7a5c0dbce0 0x7f7a5c0e2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:50.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.376+0000 7f7a69400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7a5c0dbce0 0x7f7a5c0e2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40090/0 (socket says 172.21.15.8:40090) 2024-03-23T23:49:50.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.380+0000 7f7a69400640 1 -- 172.21.15.8:0/2616121846 learned_addr learned my addr 172.21.15.8:0/2616121846 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:49:50.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.380+0000 7f7a69400640 1 -- 172.21.15.8:0/2616121846 >> v2:172.21.15.196:3300/0 conn(0x7f7a5c0ded20 msgr2=0x7f7a5c0df1d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:49:50.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.380+0000 7f7a69400640 1 --2- 172.21.15.8:0/2616121846 >> v2:172.21.15.196:3300/0 conn(0x7f7a5c0ded20 0x7f7a5c0df1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:50.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.380+0000 7f7a69400640 1 -- 172.21.15.8:0/2616121846 >> v1:172.21.15.196:6789/0 conn(0x7f7a5c00b0c0 legacy=0x7f7a5c006f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:49:50.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.380+0000 7f7a69400640 1 -- 172.21.15.8:0/2616121846 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5c047620 con 0x7f7a5c0dbce0 2024-03-23T23:49:50.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.384+0000 7f7a69400640 1 --2- 172.21.15.8:0/2616121846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a5c0dbce0 0x7f7a5c0e2710 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7a64075bc0 tx=0x7f7a640982a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6453ef59f3fa236 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:50.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.384+0000 7f7a63e00640 1 -- 172.21.15.8:0/2616121846 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6412c070 con 0x7f7a5c0dbce0 2024-03-23T23:49:50.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.388+0000 7f7a63e00640 1 -- 172.21.15.8:0/2616121846 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a64127640 con 0x7f7a5c0dbce0 2024-03-23T23:49:50.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.388+0000 7f7a63e00640 1 -- 172.21.15.8:0/2616121846 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6412c070 con 0x7f7a5c0dbce0 2024-03-23T23:49:50.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.392+0000 7f7a6a800640 1 -- 172.21.15.8:0/2616121846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a5c0dbce0 msgr2=0x7f7a5c0e2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:50.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.392+0000 7f7a6a800640 1 --2- 172.21.15.8:0/2616121846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a5c0dbce0 0x7f7a5c0e2710 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7a64075bc0 tx=0x7f7a640982a0 comp rx=0 tx=0).stop 2024-03-23T23:49:50.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.392+0000 7f7a6a800640 1 -- 172.21.15.8:0/2616121846 shutdown_connections 2024-03-23T23:49:50.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.392+0000 7f7a6a800640 1 --2- 172.21.15.8:0/2616121846 >> v2:172.21.15.196:3300/0 conn(0x7f7a5c0ded20 0x7f7a5c0df1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:50.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.392+0000 7f7a6a800640 1 --2- 172.21.15.8:0/2616121846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a5c0dbce0 0x7f7a5c0e2710 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:50.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.392+0000 7f7a6a800640 1 -- 172.21.15.8:0/2616121846 >> 172.21.15.8:0/2616121846 conn(0x7f7a5c048260 msgr2=0x7f7a5c048670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:49:50.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.392+0000 7f7a6a800640 1 -- 172.21.15.8:0/2616121846 shutdown_connections 2024-03-23T23:49:50.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.396+0000 7f7a6a800640 1 -- 172.21.15.8:0/2616121846 wait complete. 2024-03-23T23:49:50.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.396+0000 7f7a6a800640 1 Processor -- start 2024-03-23T23:49:50.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.396+0000 7f7a6a800640 1 -- start start 2024-03-23T23:49:50.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.400+0000 7f7a6a800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a5c00b0c0 0x7f7a5c0456d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:50.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.400+0000 7f7a6a800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a5c0dbce0 0x7f7a5c042f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:50.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.400+0000 7f7a6a800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a5c0ded20 0x7f7a5c0407a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:50.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.400+0000 7f7a6a800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c0dfc50 con 0x7f7a5c0dbce0 2024-03-23T23:49:50.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.400+0000 7f7a6a800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c047ec0 con 0x7f7a5c0ded20 2024-03-23T23:49:50.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.400+0000 7f7a6a800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c0dc0c0 con 0x7f7a5c00b0c0 2024-03-23T23:49:50.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.400+0000 7f7a69e00640 1 -- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a5c0ded20 msgr2=0x7f7a5c0407a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:49:50.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.400+0000 7f7a69e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a5c0ded20 0x7f7a5c0407a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:49:50.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.400+0000 7f7a69400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a5c00b0c0 0x7f7a5c0456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:50.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.400+0000 7f7a69400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a5c00b0c0 0x7f7a5c0456d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:32780/0 (socket says 172.21.15.8:32780) 2024-03-23T23:49:50.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.400+0000 7f7a69400640 1 -- 172.21.15.8:0/1653177126 learned_addr learned my addr 172.21.15.8:0/1653177126 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:49:50.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.400+0000 7f7a69400640 1 -- 172.21.15.8:0/1653177126 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a5c0ded20 msgr2=0x7f7a5c0407a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:49:50.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.400+0000 7f7a69400640 1 --2- 172.21.15.8:0/1653177126 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a5c0ded20 0x7f7a5c0407a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:50.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.400+0000 7f7a68a00640 1 --2- 172.21.15.8:0/1653177126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a5c0dbce0 0x7f7a5c042f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:50.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.400+0000 7f7a69400640 1 -- 172.21.15.8:0/1653177126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a5c0dbce0 msgr2=0x7f7a5c042f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:50.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.400+0000 7f7a69400640 1 --2- 172.21.15.8:0/1653177126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a5c0dbce0 0x7f7a5c042f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:49:50.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.400+0000 7f7a69400640 1 -- 172.21.15.8:0/1653177126 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5c044980 con 0x7f7a5c00b0c0 2024-03-23T23:49:50.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.400+0000 7f7a68a00640 1 --2- 172.21.15.8:0/1653177126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a5c0dbce0 0x7f7a5c042f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:49:50.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.404+0000 7f7a69400640 1 --2- 172.21.15.8:0/1653177126 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a5c00b0c0 0x7f7a5c0456d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7a64050720 tx=0x7f7a64095140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:50.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.404+0000 7f7a61600640 1 -- 172.21.15.8:0/1653177126 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a64136070 con 0x7f7a5c00b0c0 2024-03-23T23:49:50.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.404+0000 7f7a6a800640 1 -- 172.21.15.8:0/1653177126 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a5c045c10 con 0x7f7a5c00b0c0 2024-03-23T23:49:50.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.404+0000 7f7a6a800640 1 -- 172.21.15.8:0/1653177126 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a5c044ed0 con 0x7f7a5c00b0c0 2024-03-23T23:49:50.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.404+0000 7f7a61600640 1 -- 172.21.15.8:0/1653177126 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6406e780 con 0x7f7a5c00b0c0 2024-03-23T23:49:50.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.404+0000 7f7a61600640 1 -- 172.21.15.8:0/1653177126 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a64136070 con 0x7f7a5c00b0c0 2024-03-23T23:49:50.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.408+0000 7f7a6a800640 1 --2- 172.21.15.8:0/1653177126 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a40002a80 0x7f7a40004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:50.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.408+0000 7f7a6a800640 1 -- 172.21.15.8:0/1653177126 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a40007ed0 con 0x7f7a40002a80 2024-03-23T23:49:50.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.408+0000 7f7a61600640 1 -- 172.21.15.8:0/1653177126 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f7a64139070 con 0x7f7a5c00b0c0 2024-03-23T23:49:50.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.412+0000 7f7a68a00640 1 --2- 172.21.15.8:0/1653177126 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a40002a80 0x7f7a40004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:50.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.412+0000 7f7a61600640 1 --2- 172.21.15.8:0/1653177126 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7a44067a10 0x7f7a44069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:50.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.412+0000 7f7a68a00640 1 -- 172.21.15.8:0/1653177126 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7a400080d0 con 0x7f7a40002a80 2024-03-23T23:49:50.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.412+0000 7f7a61600640 1 -- 172.21.15.8:0/1653177126 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f7a64127400 con 0x7f7a5c00b0c0 2024-03-23T23:49:50.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.412+0000 7f7a69e00640 1 --2- 172.21.15.8:0/1653177126 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7a44067a10 0x7f7a44069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:50.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.412+0000 7f7a68a00640 1 --2- 172.21.15.8:0/1653177126 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a40002a80 0x7f7a40004f40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c030860 tx=0x7f7a5000cb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:50.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.416+0000 7f7a69e00640 1 --2- 172.21.15.8:0/1653177126 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7a44067a10 0x7f7a44069ed0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7a58003940 tx=0x7f7a58006c80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:50.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.416+0000 7f7a61600640 1 -- 172.21.15.8:0/1653177126 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a50003bc0 con 0x7f7a40002a80 2024-03-23T23:49:50.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.416+0000 7f7a61600640 1 -- 172.21.15.8:0/1653177126 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f7a50016070 con 0x7f7a40002a80 2024-03-23T23:49:50.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.416+0000 7f7a61600640 1 -- 172.21.15.8:0/1653177126 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a40002a80 msgr2=0x7f7a40004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:50.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.416+0000 7f7a61600640 1 --2- 172.21.15.8:0/1653177126 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a40002a80 0x7f7a40004f40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c030860 tx=0x7f7a5000cb80 comp rx=0 tx=0).stop 2024-03-23T23:49:50.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.416+0000 7f7a61600640 1 -- 172.21.15.8:0/1653177126 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a40002a80 msgr2=0x7f7a40004f40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:49:50.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.416+0000 7f7a61600640 1 --2- 172.21.15.8:0/1653177126 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a40002a80 0x7f7a40004f40 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c030860 tx=0x7f7a5000cb80 comp rx=0 tx=0).stop 2024-03-23T23:49:50.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.444+0000 7f7a6a800640 1 --2- 172.21.15.8:0/1653177126 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a40006f10 0x7f7a400073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:49:50.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.444+0000 7f7a6a800640 1 -- 172.21.15.8:0/1653177126 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4000a4b0 con 0x7f7a40006f10 2024-03-23T23:49:50.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.448+0000 7f7a68a00640 1 --2- 172.21.15.8:0/1653177126 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a40006f10 0x7f7a400073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:49:50.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.448+0000 7f7a68a00640 1 -- 172.21.15.8:0/1653177126 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7a400078e0 con 0x7f7a40006f10 2024-03-23T23:49:50.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.448+0000 7f7a68a00640 1 --2- 172.21.15.8:0/1653177126 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a40006f10 0x7f7a400073a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7a50015000 tx=0x7f7a500059e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:49:50.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.448+0000 7f7a61600640 1 -- 172.21.15.8:0/1653177126 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a500052e0 con 0x7f7a40006f10 2024-03-23T23:49:50.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.456+0000 7f7a61600640 1 -- 172.21.15.8:0/1653177126 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5028 (secure 0 0 0) 0x7f7a500052e0 con 0x7f7a40006f10 2024-03-23T23:49:50.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.456+0000 7f7a61600640 1 -- 172.21.15.8:0/1653177126 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a40006f10 msgr2=0x7f7a400073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:50.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.456+0000 7f7a61600640 1 --2- 172.21.15.8:0/1653177126 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a40006f10 0x7f7a400073a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7a50015000 tx=0x7f7a500059e0 comp rx=0 tx=0).stop 2024-03-23T23:49:50.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.456+0000 7f7a61600640 1 -- 172.21.15.8:0/1653177126 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a40006f10 msgr2=0x7f7a400073a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:49:50.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.456+0000 7f7a61600640 1 --2- 172.21.15.8:0/1653177126 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a40006f10 0x7f7a400073a0 secure :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7a50015000 tx=0x7f7a500059e0 comp rx=0 tx=0).stop 2024-03-23T23:49:50.458 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:49:50.458 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:49:50.458 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:49:50.458 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:49:50.458 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 52, 2024-03-23T23:49:50.458 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:49:50.458 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:49:50.458 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:49:50.458 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:50.458 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 1, 2024-03-23T23:49:50.458 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:49:50.458 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:49:50.459 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:49:50.459 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:49:50.459 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:49:50.459 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:49:50.459 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:49:50.459 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:49:50.459 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:49:50.459 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:49:50.459 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:49:50.459 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:49:50.459 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:49:50.459 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:49:50.459 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:50.459 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:49:50.459 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:49:50.460 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:49:50.460 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:49:50.460 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:49:50.460 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:49:50.460 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:49:50.460 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:49:50.460 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:49:50.460 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:49:50.460 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:49:50.460 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:49:50.460 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:49:50.460 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:50.460 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:50.461 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:49:50.461 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:49:50.461 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:49:50.461 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:49:50.461 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:49:50.461 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:49:50.461 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:49:50.461 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:49:50.461 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:49:50.461 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:49:50.461 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:49:50.461 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:49:50.461 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:49:50.461 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:49:50.462 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:49:50.462 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:49:50.462 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:49:50.462 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:49:50.462 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:49:50.462 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:49:50.462 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:49:50.462 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:49:50.462 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:49:50.462 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:49:50.462 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:49:50.462 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:49:50.462 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:49:50.463 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:49:50.463 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:50.463 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:49:50.463 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:50.463 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:49:50.463 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:50.463 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:49:50.463 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:49:50.463 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:49:50.463 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:49:50.463 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:50.463 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:49:50.463 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:49:50.463 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:50.463 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:50.464 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:50.464 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:49:50.464 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:49:50.464 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:50.464 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:50.464 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:50.464 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:50.464 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:49:50.464 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:49:50.464 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:49:50.464 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:49:50.464 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:49:50.464 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:50.464 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:50.465 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:49:50.465 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:49:50.465 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:49:50.465 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:49:50.465 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:50.465 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:49:50.465 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:49:50.465 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:50.465 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:50.465 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:50.465 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:49:50.465 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:49:50.465 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:50.465 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:50.466 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:50.466 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:50.466 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:49:50.466 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:49:50.466 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:49:50.466 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:49:50.466 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:49:50.466 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:50.466 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:50.466 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:49:50.466 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:49:50.466 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:49:50.466 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:49:50.467 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:50.467 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:49:50.467 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:49:50.467 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:50.467 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:50.467 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:50.467 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:49:50.467 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:49:50.467 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:49:50.467 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:50.467 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:50.467 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:50.467 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:49:50.467 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:49:50.468 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:49:50.468 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:49:50.468 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:49:50.468 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:50.468 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:50.468 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:50.468 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:49:50.468 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:49:50.468 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:50.468 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:49:50.468 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:50.468 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:49:50.468 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:50.468 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:50.469 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:49:50.469 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:50.469 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:49:50.469 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:50.469 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:49:50.469 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:50.469 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:50.469 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:49:50.469 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:50.469 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:49:50.469 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:50.469 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:49:50.469 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:50.469 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:50.470 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:49:50.470 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:50.470 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:49:50.470 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:50.470 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:49:50.470 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:50.470 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:49:50.470 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:49:50.470 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:49:50.470 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:49:50.470 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:49:50.470 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:49:50.470 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:49:50.470 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:49:50.471 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:49:50.471 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:49:50.471 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:49:50.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.456+0000 7f7a6a800640 1 -- 172.21.15.8:0/1653177126 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7a44067a10 msgr2=0x7f7a44069ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:50.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.456+0000 7f7a6a800640 1 --2- 172.21.15.8:0/1653177126 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7a44067a10 0x7f7a44069ed0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7a58003940 tx=0x7f7a58006c80 comp rx=0 tx=0).stop 2024-03-23T23:49:50.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.456+0000 7f7a69e00640 1 -- 172.21.15.8:0/1653177126 reap_dead start 2024-03-23T23:49:50.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.456+0000 7f7a6a800640 1 -- 172.21.15.8:0/1653177126 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a5c00b0c0 msgr2=0x7f7a5c0456d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:49:50.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.456+0000 7f7a6a800640 1 --2- 172.21.15.8:0/1653177126 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a5c00b0c0 0x7f7a5c0456d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7a64050720 tx=0x7f7a64095140 comp rx=0 tx=0).stop 2024-03-23T23:49:50.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.456+0000 7f7a6a800640 1 -- 172.21.15.8:0/1653177126 shutdown_connections 2024-03-23T23:49:50.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.456+0000 7f7a6a800640 1 --2- 172.21.15.8:0/1653177126 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a5c00b0c0 0x7f7a5c0456d0 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7a64050720 tx=0x7f7a64095140 comp rx=0 tx=0).stop 2024-03-23T23:49:50.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.456+0000 7f7a6a800640 1 -- 172.21.15.8:0/1653177126 >> 172.21.15.8:0/1653177126 conn(0x7f7a5c048260 msgr2=0x7f7a5c0dcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:49:50.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.464+0000 7f7a6a800640 1 -- 172.21.15.8:0/1653177126 shutdown_connections 2024-03-23T23:49:50.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:49:50.464+0000 7f7a6a800640 1 -- 172.21.15.8:0/1653177126 wait complete. 2024-03-23T23:49:50.645 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T23:49:50.645 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-03-23T23:50:10.646 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-03-23T23:50:10.646 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-03-23T23:50:10.647 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-23T23:50:10.647 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-23T23:50:10.655 INFO:tasks.ceph.mon.b:Started 2024-03-23T23:50:10.655 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T23:50:10.655 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:50:10.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:10.952+0000 7f72c6600640 1 Processor -- start 2024-03-23T23:50:10.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:10.952+0000 7f72c6600640 1 -- start start 2024-03-23T23:50:10.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:10.960+0000 7f72c6600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f72c014ef60 0x7f72c00c3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:10.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:10.960+0000 7f72c6600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72c0151730 0x7f72c0071990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:10.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:10.960+0000 7f72c6600640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c0071250 con 0x7f72c0071ed0 2024-03-23T23:50:10.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:10.960+0000 7f72c6600640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c006e710 con 0x7f72c014ef60 2024-03-23T23:50:10.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:10.960+0000 7f72c6600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c006e9f0 con 0x7f72c0151730 2024-03-23T23:50:10.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:10.960+0000 7f72bfe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72c0151730 0x7f72c0071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:10.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:10.960+0000 7f72c5c00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f72c0071ed0 0x7f72c0155350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:45462/0 (socket says 172.21.15.8:45462) 2024-03-23T23:50:10.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:10.960+0000 7f72c5c00640 1 -- 172.21.15.8:0/2101308748 learned_addr learned my addr 172.21.15.8:0/2101308748 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:50:10.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:10.964+0000 7f72c5200640 1 --2- 172.21.15.8:0/2101308748 >> v2:172.21.15.8:3300/0 conn(0x7f72c014ef60 0x7f72c00c3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:10.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:10.964+0000 7f72c5200640 1 -- 172.21.15.8:0/2101308748 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72c0151730 msgr2=0x7f72c0071990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:50:10.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:10.964+0000 7f72c5200640 1 --2- 172.21.15.8:0/2101308748 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72c0151730 0x7f72c0071990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:10.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:10.964+0000 7f72c5200640 1 -- 172.21.15.8:0/2101308748 >> v1:172.21.15.8:6789/0 conn(0x7f72c0071ed0 legacy=0x7f72c0155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:10.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:10.964+0000 7f72c5200640 1 -- 172.21.15.8:0/2101308748 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c0070f70 con 0x7f72c014ef60 2024-03-23T23:50:10.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:10.984+0000 7f72c5200640 1 --2- 172.21.15.8:0/2101308748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72c014ef60 0x7f72c00c3040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f72b00097c0 tx=0x7f72b001e4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a24761c16fbcabe server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:10.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:10.984+0000 7f72bf400640 1 -- 172.21.15.8:0/2101308748 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b00b3070 con 0x7f72c014ef60 2024-03-23T23:50:10.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:10.984+0000 7f72bf400640 1 -- 172.21.15.8:0/2101308748 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b00ae600 con 0x7f72c014ef60 2024-03-23T23:50:10.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:10.992+0000 7f72c6600640 1 -- 172.21.15.8:0/2101308748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72c014ef60 msgr2=0x7f72c00c3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:10.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:10.992+0000 7f72c6600640 1 --2- 172.21.15.8:0/2101308748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72c014ef60 0x7f72c00c3040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f72b00097c0 tx=0x7f72b001e4c0 comp rx=0 tx=0).stop 2024-03-23T23:50:10.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:10.992+0000 7f72c6600640 1 -- 172.21.15.8:0/2101308748 shutdown_connections 2024-03-23T23:50:10.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:10.992+0000 7f72c6600640 1 --2- 172.21.15.8:0/2101308748 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72c0151730 0x7f72c0071990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:10.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:10.992+0000 7f72c6600640 1 --2- 172.21.15.8:0/2101308748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72c014ef60 0x7f72c00c3040 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:10.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:10.992+0000 7f72c6600640 1 -- 172.21.15.8:0/2101308748 >> 172.21.15.8:0/2101308748 conn(0x7f72c00c3610 msgr2=0x7f72c00c3a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:50:11.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.000+0000 7f72c6600640 1 -- 172.21.15.8:0/2101308748 shutdown_connections 2024-03-23T23:50:11.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.000+0000 7f72c6600640 1 -- 172.21.15.8:0/2101308748 wait complete. 2024-03-23T23:50:11.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.004+0000 7f72c6600640 1 Processor -- start 2024-03-23T23:50:11.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.020+0000 7f72c6600640 1 -- start start 2024-03-23T23:50:11.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.020+0000 7f72c6600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72c0071ed0 0x7f72c0154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:11.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.020+0000 7f72c6600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72c014ef60 0x7f72c0152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:11.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.020+0000 7f72c6600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72c0151730 0x7f72c00ac550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:11.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.020+0000 7f72bfe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72c014ef60 0x7f72c0152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:11.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.024+0000 7f72bfe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72c014ef60 0x7f72c0152cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:33172/0 (socket says 172.21.15.8:33172) 2024-03-23T23:50:11.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.024+0000 7f72c5200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72c0071ed0 0x7f72c0154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:11.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.024+0000 7f72c5200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72c0071ed0 0x7f72c0154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:52764/0 (socket says 172.21.15.8:52764) 2024-03-23T23:50:11.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.028+0000 7f72bfe00640 1 -- 172.21.15.8:0/1915841253 learned_addr learned my addr 172.21.15.8:0/1915841253 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:50:11.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.028+0000 7f72c6600640 1 -- 172.21.15.8:0/1915841253 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c0155be0 con 0x7f72c0151730 2024-03-23T23:50:11.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.028+0000 7f72c6600640 1 -- 172.21.15.8:0/1915841253 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c0155a60 con 0x7f72c0071ed0 2024-03-23T23:50:11.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.028+0000 7f72c6600640 1 -- 172.21.15.8:0/1915841253 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c006ee20 con 0x7f72c014ef60 2024-03-23T23:50:11.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.028+0000 7f72c5c00640 1 --2- 172.21.15.8:0/1915841253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72c0151730 0x7f72c00ac550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:11.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.028+0000 7f72bfe00640 1 -- 172.21.15.8:0/1915841253 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72c0071ed0 msgr2=0x7f72c0154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:11.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.028+0000 7f72bfe00640 1 --2- 172.21.15.8:0/1915841253 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72c0071ed0 0x7f72c0154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:11.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.028+0000 7f72bfe00640 1 -- 172.21.15.8:0/1915841253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72c0151730 msgr2=0x7f72c00ac550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:11.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.028+0000 7f72bfe00640 1 --2- 172.21.15.8:0/1915841253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72c0151730 0x7f72c00ac550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:11.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.028+0000 7f72bfe00640 1 -- 172.21.15.8:0/1915841253 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c00aa020 con 0x7f72c014ef60 2024-03-23T23:50:11.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.040+0000 7f72bfe00640 1 --2- 172.21.15.8:0/1915841253 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72c014ef60 0x7f72c0152cb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f72ac00d5e0 tx=0x7f72ac00daa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:11.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.040+0000 7f72bcc00640 1 -- 172.21.15.8:0/1915841253 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac018020 con 0x7f72c014ef60 2024-03-23T23:50:11.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.040+0000 7f72bcc00640 1 -- 172.21.15.8:0/1915841253 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ac014620 con 0x7f72c014ef60 2024-03-23T23:50:11.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.040+0000 7f72bcc00640 1 -- 172.21.15.8:0/1915841253 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac0149d0 con 0x7f72c014ef60 2024-03-23T23:50:11.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.040+0000 7f72c6600640 1 -- 172.21.15.8:0/1915841253 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c00aa910 con 0x7f72c014ef60 2024-03-23T23:50:11.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.044+0000 7f72c6600640 1 -- 172.21.15.8:0/1915841253 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c0143660 con 0x7f72c014ef60 2024-03-23T23:50:11.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.052+0000 7f72b6000640 1 -- 172.21.15.8:0/1915841253 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72980052a0 con 0x7f72c014ef60 2024-03-23T23:50:11.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.052+0000 7f72bcc00640 1 -- 172.21.15.8:0/1915841253 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f72ac01b020 con 0x7f72c014ef60 2024-03-23T23:50:11.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.052+0000 7f72bcc00640 1 --2- 172.21.15.8:0/1915841253 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f72a0067760 0x7f72a0069c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:11.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.052+0000 7f72bcc00640 1 -- 172.21.15.8:0/1915841253 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f72ac085f60 con 0x7f72c014ef60 2024-03-23T23:50:11.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.056+0000 7f72c5200640 1 --2- 172.21.15.8:0/1915841253 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f72a0067760 0x7f72a0069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:11.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.068+0000 7f72c5200640 1 --2- 172.21.15.8:0/1915841253 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f72a0067760 0x7f72a0069c20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f72b00b0000 tx=0x7f72b0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:11.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:11.096+0000 7f72bcc00640 1 -- 172.21.15.8:0/1915841253 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f72ac0b26d0 con 0x7f72c014ef60 2024-03-23T23:50:12.065 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:12.064+0000 7f72b6000640 1 -- 172.21.15.8:0/1915841253 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f7298005590 con 0x7f72c014ef60 2024-03-23T23:50:12.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:12.064+0000 7f72bcc00640 1 -- 172.21.15.8:0/1915841253 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1555 (secure 0 0 0) 0x7f72ac022020 con 0x7f72c014ef60 2024-03-23T23:50:12.077 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":52,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:50:12.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:12.108+0000 7f72b6000640 1 -- 172.21.15.8:0/1915841253 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f72a0067760 msgr2=0x7f72a0069c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:12.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:12.108+0000 7f72b6000640 1 --2- 172.21.15.8:0/1915841253 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f72a0067760 0x7f72a0069c20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f72b00b0000 tx=0x7f72b0008040 comp rx=0 tx=0).stop 2024-03-23T23:50:12.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:12.108+0000 7f72b6000640 1 -- 172.21.15.8:0/1915841253 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72c014ef60 msgr2=0x7f72c0152cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:12.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:12.108+0000 7f72b6000640 1 --2- 172.21.15.8:0/1915841253 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72c014ef60 0x7f72c0152cb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f72ac00d5e0 tx=0x7f72ac00daa0 comp rx=0 tx=0).stop 2024-03-23T23:50:12.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:12.108+0000 7f72b6000640 1 -- 172.21.15.8:0/1915841253 shutdown_connections 2024-03-23T23:50:12.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:12.108+0000 7f72b6000640 1 --2- 172.21.15.8:0/1915841253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72c0151730 0x7f72c00ac550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:12.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:12.108+0000 7f72b6000640 1 --2- 172.21.15.8:0/1915841253 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f72a0067760 0x7f72a0069c20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:12.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:12.108+0000 7f72b6000640 1 --2- 172.21.15.8:0/1915841253 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72c014ef60 0x7f72c0152cb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:12.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:12.108+0000 7f72b6000640 1 --2- 172.21.15.8:0/1915841253 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72c0071ed0 0x7f72c0154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:12.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:12.108+0000 7f72b6000640 1 -- 172.21.15.8:0/1915841253 >> 172.21.15.8:0/1915841253 conn(0x7f72c00c3610 msgr2=0x7f72c006ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:50:12.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:12.112+0000 7f72b6000640 1 -- 172.21.15.8:0/1915841253 shutdown_connections 2024-03-23T23:50:12.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:12.112+0000 7f72b6000640 1 -- 172.21.15.8:0/1915841253 wait complete. 2024-03-23T23:50:14.037 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:50:14.045 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:50:15.219 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:50:15.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.708+0000 7ff5f0400640 1 Processor -- start 2024-03-23T23:50:15.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.708+0000 7ff5f0400640 1 -- start start 2024-03-23T23:50:15.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.712+0000 7ff5f0400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5e815af80 0x7ff5e815d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:15.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.712+0000 7ff5f0400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e814f240 con 0x7ff5e8151600 2024-03-23T23:50:15.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.712+0000 7ff5f0400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e8148480 con 0x7ff5e81480a0 2024-03-23T23:50:15.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.712+0000 7ff5f0400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e8072dc0 con 0x7ff5e815af80 2024-03-23T23:50:15.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.712+0000 7ff5ed000640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff5e8151600 0x7ff5e8151a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53324/0 (socket says 172.21.15.8:53324) 2024-03-23T23:50:15.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.712+0000 7ff5ed000640 1 -- 172.21.15.8:0/3940949765 learned_addr learned my addr 172.21.15.8:0/3940949765 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:50:15.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.712+0000 7ff5ee400640 1 --2- 172.21.15.8:0/3940949765 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5e815af80 0x7ff5e815d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:15.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.716+0000 7ff5e7e00640 1 -- 172.21.15.8:0/3940949765 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590301874 0 0) 0x7ff5d4001120 con 0x7ff5e8151600 2024-03-23T23:50:15.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.720+0000 7ff5e7e00640 1 -- 172.21.15.8:0/3940949765 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5d0003530 con 0x7ff5e8151600 2024-03-23T23:50:15.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.720+0000 7ff5e7e00640 1 -- 172.21.15.8:0/3940949765 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 913746542 0 0) 0x7ff5d0003530 con 0x7ff5e8151600 2024-03-23T23:50:15.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.720+0000 7ff5e7e00640 1 -- 172.21.15.8:0/3940949765 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5e815af80 msgr2=0x7ff5e815d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:50:15.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.720+0000 7ff5e7e00640 1 --2- 172.21.15.8:0/3940949765 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5e815af80 0x7ff5e815d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:15.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.720+0000 7ff5e7e00640 1 -- 172.21.15.8:0/3940949765 >> v1:172.21.15.196:6789/0 conn(0x7ff5e81480a0 legacy=0x7ff5e80c2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:15.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.720+0000 7ff5e7e00640 1 -- 172.21.15.8:0/3940949765 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e806d0d0 con 0x7ff5e8151600 2024-03-23T23:50:15.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.720+0000 7ff5e7e00640 1 -- 172.21.15.8:0/3940949765 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7ff5d4001850 con 0x7ff5e8151600 2024-03-23T23:50:15.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.720+0000 7ff5e7e00640 1 -- 172.21.15.8:0/3940949765 >> v1:172.21.15.8:6789/0 conn(0x7ff5e8151600 legacy=0x7ff5e8151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:15.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.720+0000 7ff5e7e00640 1 --2- 172.21.15.8:0/3940949765 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5d0003a40 0x7ff5d0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:15.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.720+0000 7ff5e7e00640 1 --2- 172.21.15.8:0/3940949765 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5d0004810 0x7ff5d0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:15.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.720+0000 7ff5e7e00640 1 --2- 172.21.15.8:0/3940949765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5d0005220 0x7ff5d00079b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:15.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.720+0000 7ff5e7e00640 1 -- 172.21.15.8:0/3940949765 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e8072dc0 con 0x7ff5d0005220 2024-03-23T23:50:15.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.720+0000 7ff5e7e00640 1 -- 172.21.15.8:0/3940949765 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d00080e0 con 0x7ff5d0003a40 2024-03-23T23:50:15.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.720+0000 7ff5e7e00640 1 -- 172.21.15.8:0/3940949765 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d00082e0 con 0x7ff5d0004810 2024-03-23T23:50:15.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.720+0000 7ff5ee400640 1 --2- 172.21.15.8:0/3940949765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5d0005220 0x7ff5d00079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:15.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.724+0000 7ff5ee400640 1 -- 172.21.15.8:0/3940949765 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5d0004810 msgr2=0x7ff5d0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:50:15.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.724+0000 7ff5eda00640 1 --2- 172.21.15.8:0/3940949765 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5d0003a40 0x7ff5d0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:15.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.724+0000 7ff5ee400640 1 --2- 172.21.15.8:0/3940949765 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5d0004810 0x7ff5d0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:15.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.724+0000 7ff5ee400640 1 -- 172.21.15.8:0/3940949765 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5d0003a40 msgr2=0x7ff5d0003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:50:15.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.728+0000 7ff5ee400640 1 --2- 172.21.15.8:0/3940949765 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5d0003a40 0x7ff5d0003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:15.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.728+0000 7ff5ee400640 1 -- 172.21.15.8:0/3940949765 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d0003530 con 0x7ff5d0005220 2024-03-23T23:50:15.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.732+0000 7ff5eda00640 1 --2- 172.21.15.8:0/3940949765 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5d0003a40 0x7ff5d0003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:50:15.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.740+0000 7ff5ee400640 1 --2- 172.21.15.8:0/3940949765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5d0005220 0x7ff5d00079b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8070b30 tx=0x7ff5e001cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca86c5bf82298816 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:15.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.756+0000 7ff5e7e00640 1 -- 172.21.15.8:0/3940949765 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e00b2070 con 0x7ff5d0005220 2024-03-23T23:50:15.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.756+0000 7ff5e7e00640 1 -- 172.21.15.8:0/3940949765 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e00a5b50 con 0x7ff5d0005220 2024-03-23T23:50:15.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.756+0000 7ff5e7e00640 1 -- 172.21.15.8:0/3940949765 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e0009bd0 con 0x7ff5d0005220 2024-03-23T23:50:15.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.756+0000 7ff5f0400640 1 -- 172.21.15.8:0/3940949765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5d0005220 msgr2=0x7ff5d00079b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:15.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.756+0000 7ff5f0400640 1 --2- 172.21.15.8:0/3940949765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5d0005220 0x7ff5d00079b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8070b30 tx=0x7ff5e001cb80 comp rx=0 tx=0).stop 2024-03-23T23:50:15.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.756+0000 7ff5ee400640 1 -- 172.21.15.8:0/3940949765 reap_dead start 2024-03-23T23:50:15.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.764+0000 7ff5f0400640 1 -- 172.21.15.8:0/3940949765 shutdown_connections 2024-03-23T23:50:15.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.764+0000 7ff5f0400640 1 -- 172.21.15.8:0/3940949765 >> 172.21.15.8:0/3940949765 conn(0x7ff5e80c3980 msgr2=0x7ff5e80c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:50:15.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.768+0000 7ff5f0400640 1 -- 172.21.15.8:0/3940949765 shutdown_connections 2024-03-23T23:50:15.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.768+0000 7ff5f0400640 1 -- 172.21.15.8:0/3940949765 wait complete. 2024-03-23T23:50:15.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.772+0000 7ff5f0400640 1 Processor -- start 2024-03-23T23:50:15.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.776+0000 7ff5f0400640 1 -- start start 2024-03-23T23:50:15.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.776+0000 7ff5f0400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5d0005220 0x7ff5e81455b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:15.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.776+0000 7ff5f0400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5e8140170 0x7ff5e80c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:15.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.776+0000 7ff5f0400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5e80abfa0 0x7ff5e80c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:15.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.776+0000 7ff5f0400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e8152170 con 0x7ff5e80abfa0 2024-03-23T23:50:15.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.776+0000 7ff5f0400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e806d690 con 0x7ff5d0005220 2024-03-23T23:50:15.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.776+0000 7ff5f0400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e80c2fa0 con 0x7ff5e8140170 2024-03-23T23:50:15.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.776+0000 7ff5eda00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5d0005220 0x7ff5e81455b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:15.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.776+0000 7ff5eda00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5d0005220 0x7ff5e81455b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:60874/0 (socket says 172.21.15.8:60874) 2024-03-23T23:50:15.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.776+0000 7ff5eda00640 1 -- 172.21.15.8:0/1916463594 learned_addr learned my addr 172.21.15.8:0/1916463594 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:50:15.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.780+0000 7ff5ee400640 1 --2- 172.21.15.8:0/1916463594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5e80abfa0 0x7ff5e80c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:15.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.780+0000 7ff5ee400640 1 -- 172.21.15.8:0/1916463594 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5e8140170 msgr2=0x7ff5e80c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:15.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.780+0000 7ff5ee400640 1 --2- 172.21.15.8:0/1916463594 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5e8140170 0x7ff5e80c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:15.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.780+0000 7ff5ee400640 1 -- 172.21.15.8:0/1916463594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5d0005220 msgr2=0x7ff5e81455b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:15.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.780+0000 7ff5ee400640 1 --2- 172.21.15.8:0/1916463594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5d0005220 0x7ff5e81455b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:15.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.780+0000 7ff5ee400640 1 -- 172.21.15.8:0/1916463594 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e80a9930 con 0x7ff5e80abfa0 2024-03-23T23:50:15.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.780+0000 7ff5eda00640 1 --2- 172.21.15.8:0/1916463594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5d0005220 0x7ff5e81455b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:50:15.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.780+0000 7ff5ee400640 1 --2- 172.21.15.8:0/1916463594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5e80abfa0 0x7ff5e80c6370 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff5e00ac000 tx=0x7ff5e0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:15.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.788+0000 7ff5e5600640 1 -- 172.21.15.8:0/1916463594 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e00b2040 con 0x7ff5e80abfa0 2024-03-23T23:50:15.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.788+0000 7ff5e5600640 1 -- 172.21.15.8:0/1916463594 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e00a5950 con 0x7ff5e80abfa0 2024-03-23T23:50:15.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.788+0000 7ff5e5600640 1 -- 172.21.15.8:0/1916463594 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e0009bd0 con 0x7ff5e80abfa0 2024-03-23T23:50:15.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.788+0000 7ff5f0400640 1 -- 172.21.15.8:0/1916463594 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e806e470 con 0x7ff5e80abfa0 2024-03-23T23:50:15.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.788+0000 7ff5f0400640 1 -- 172.21.15.8:0/1916463594 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e80a9bd0 con 0x7ff5e80abfa0 2024-03-23T23:50:15.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.788+0000 7ff5f0400640 1 -- 172.21.15.8:0/1916463594 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e804f410 con 0x7ff5e80abfa0 2024-03-23T23:50:15.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.812+0000 7ff5e5600640 1 -- 172.21.15.8:0/1916463594 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff5e00c0030 con 0x7ff5e80abfa0 2024-03-23T23:50:15.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.812+0000 7ff5e5600640 1 --2- 172.21.15.8:0/1916463594 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff5c8067730 0x7ff5c8069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:15.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.812+0000 7ff5e5600640 1 -- 172.21.15.8:0/1916463594 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7ff5e01206e0 con 0x7ff5e80abfa0 2024-03-23T23:50:15.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.816+0000 7ff5eda00640 1 --2- 172.21.15.8:0/1916463594 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff5c8067730 0x7ff5c8069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:15.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.820+0000 7ff5e5600640 1 -- 172.21.15.8:0/1916463594 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7ff5e00c7060 con 0x7ff5e80abfa0 2024-03-23T23:50:15.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:15.824+0000 7ff5eda00640 1 --2- 172.21.15.8:0/1916463594 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff5c8067730 0x7ff5c8069bf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8147aa0 tx=0x7ff5dc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:16.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:16.780+0000 7ff5f0400640 1 -- 172.21.15.8:0/1916463594 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff5e8071ce0 con 0x7ff5e80abfa0 2024-03-23T23:50:16.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:16.784+0000 7ff5e5600640 1 -- 172.21.15.8:0/1916463594 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1560 (secure 0 0 0) 0x7ff5e0016890 con 0x7ff5e80abfa0 2024-03-23T23:50:16.786 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":54,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:50:16.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:16.796+0000 7ff5f0400640 1 -- 172.21.15.8:0/1916463594 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff5c8067730 msgr2=0x7ff5c8069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:16.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:16.796+0000 7ff5f0400640 1 --2- 172.21.15.8:0/1916463594 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff5c8067730 0x7ff5c8069bf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8147aa0 tx=0x7ff5dc009040 comp rx=0 tx=0).stop 2024-03-23T23:50:16.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:16.796+0000 7ff5f0400640 1 -- 172.21.15.8:0/1916463594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5e80abfa0 msgr2=0x7ff5e80c6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:16.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:16.796+0000 7ff5f0400640 1 --2- 172.21.15.8:0/1916463594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5e80abfa0 0x7ff5e80c6370 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff5e00ac000 tx=0x7ff5e0009750 comp rx=0 tx=0).stop 2024-03-23T23:50:16.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:16.796+0000 7ff5f0400640 1 -- 172.21.15.8:0/1916463594 shutdown_connections 2024-03-23T23:50:16.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:16.796+0000 7ff5f0400640 1 --2- 172.21.15.8:0/1916463594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5e80abfa0 0x7ff5e80c6370 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:16.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:16.796+0000 7ff5f0400640 1 --2- 172.21.15.8:0/1916463594 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff5c8067730 0x7ff5c8069bf0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:16.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:16.796+0000 7ff5f0400640 1 --2- 172.21.15.8:0/1916463594 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5e8140170 0x7ff5e80c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:16.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:16.796+0000 7ff5f0400640 1 --2- 172.21.15.8:0/1916463594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5d0005220 0x7ff5e81455b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:16.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:16.796+0000 7ff5f0400640 1 -- 172.21.15.8:0/1916463594 >> 172.21.15.8:0/1916463594 conn(0x7ff5e80c3980 msgr2=0x7ff5e81ee9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:50:16.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:16.796+0000 7ff5f0400640 1 -- 172.21.15.8:0/1916463594 shutdown_connections 2024-03-23T23:50:16.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:16.796+0000 7ff5f0400640 1 -- 172.21.15.8:0/1916463594 wait complete. 2024-03-23T23:50:16.870 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T23:50:16.870 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T23:50:16.870 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:50:17.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.304+0000 7fa3a2200640 1 Processor -- start 2024-03-23T23:50:17.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.304+0000 7fa3a2200640 1 -- start start 2024-03-23T23:50:17.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.304+0000 7fa3a2200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa39400b4b0 0x7fa3940db830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:17.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.304+0000 7fa3a2200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa394006be0 0x7fa3940dbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:17.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.304+0000 7fa39b400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa394006be0 0x7fa3940dbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:17.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.304+0000 7fa39b400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa394006be0 0x7fa3940dbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:57628/0 (socket says 172.21.15.8:57628) 2024-03-23T23:50:17.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.308+0000 7fa3a0e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fa3940d2f30 0x7fa3940d33c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:52346/0 (socket says 172.21.15.8:52346) 2024-03-23T23:50:17.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.312+0000 7fa3a2200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3940469f0 con 0x7fa3940d2f30 2024-03-23T23:50:17.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.312+0000 7fa3a2200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa394007620 con 0x7fa39400b4b0 2024-03-23T23:50:17.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.312+0000 7fa3a2200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3940dc2b0 con 0x7fa394006be0 2024-03-23T23:50:17.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.312+0000 7fa39b400640 1 -- 172.21.15.8:0/2351104090 learned_addr learned my addr 172.21.15.8:0/2351104090 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:50:17.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.312+0000 7fa39b400640 1 -- 172.21.15.8:0/2351104090 >> v2:172.21.15.196:3300/0 conn(0x7fa39400b4b0 msgr2=0x7fa3940db830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-23T23:50:17.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.312+0000 7fa39b400640 1 --2- 172.21.15.8:0/2351104090 >> v2:172.21.15.196:3300/0 conn(0x7fa39400b4b0 0x7fa3940db830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:17.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.312+0000 7fa39b400640 1 -- 172.21.15.8:0/2351104090 >> v1:172.21.15.196:6789/0 conn(0x7fa3940d2f30 legacy=0x7fa3940d33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:50:17.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.312+0000 7fa39b400640 1 -- 172.21.15.8:0/2351104090 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa394007870 con 0x7fa394006be0 2024-03-23T23:50:17.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.316+0000 7fa3a0e00640 1 --1- 172.21.15.8:0/2351104090 >> v1:172.21.15.196:6789/0 conn(0x7fa3940d2f30 0x7fa3940d33c0 :-1 s=CLOSED pgs=0 cs=0 l=0).handle_server_banner_and_identify state changed while learned_addr, mark_down or replacing must be happened just now 2024-03-23T23:50:17.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.328+0000 7fa39b400640 1 --2- 172.21.15.8:0/2351104090 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa394006be0 0x7fa3940dbd70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa388009870 tx=0x7fa38801c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1a10d68a26d0cb0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:17.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.332+0000 7fa3a3800640 1 -- 172.21.15.8:0/2351104090 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3880aa430 con 0x7fa394006be0 2024-03-23T23:50:17.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.332+0000 7fa3a3800640 1 -- 172.21.15.8:0/2351104090 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3880af070 con 0x7fa394006be0 2024-03-23T23:50:17.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.332+0000 7fa3a3800640 1 -- 172.21.15.8:0/2351104090 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3880aa7f0 con 0x7fa394006be0 2024-03-23T23:50:17.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.332+0000 7fa3a2200640 1 -- 172.21.15.8:0/2351104090 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa394006be0 msgr2=0x7fa3940dbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:17.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.332+0000 7fa3a2200640 1 --2- 172.21.15.8:0/2351104090 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa394006be0 0x7fa3940dbd70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa388009870 tx=0x7fa38801c510 comp rx=0 tx=0).stop 2024-03-23T23:50:17.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.336+0000 7fa3a2200640 1 -- 172.21.15.8:0/2351104090 shutdown_connections 2024-03-23T23:50:17.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.336+0000 7fa3a2200640 1 --2- 172.21.15.8:0/2351104090 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa394006be0 0x7fa3940dbd70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:17.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.336+0000 7fa3a2200640 1 --2- 172.21.15.8:0/2351104090 >> v2:172.21.15.196:3300/0 conn(0x7fa39400b4b0 0x7fa3940db830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:17.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.336+0000 7fa3a2200640 1 -- 172.21.15.8:0/2351104090 >> 172.21.15.8:0/2351104090 conn(0x7fa3940060c0 msgr2=0x7fa3940064d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:50:17.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.352+0000 7fa3a2200640 1 -- 172.21.15.8:0/2351104090 shutdown_connections 2024-03-23T23:50:17.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.352+0000 7fa3a2200640 1 -- 172.21.15.8:0/2351104090 wait complete. 2024-03-23T23:50:17.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.352+0000 7fa3a2200640 1 Processor -- start 2024-03-23T23:50:17.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.356+0000 7fa3a2200640 1 -- start start 2024-03-23T23:50:17.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.356+0000 7fa3a2200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa394006be0 0x7fa3940d81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:17.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.356+0000 7fa3a2200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa39400b4b0 0x7fa3940d5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:17.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.360+0000 7fa3a2200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa3940d2f30 0x7fa39402cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:17.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.360+0000 7fa3a2200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39402e420 con 0x7fa394006be0 2024-03-23T23:50:17.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.360+0000 7fa3a2200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39402e2a0 con 0x7fa39400b4b0 2024-03-23T23:50:17.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.360+0000 7fa3a2200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa394047fd0 con 0x7fa3940d2f30 2024-03-23T23:50:17.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.360+0000 7fa39be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa394006be0 0x7fa3940d81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:17.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.360+0000 7fa39be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa394006be0 0x7fa3940d81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54106/0 (socket says 172.21.15.8:54106) 2024-03-23T23:50:17.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.360+0000 7fa39be00640 1 -- 172.21.15.8:0/1846913006 learned_addr learned my addr 172.21.15.8:0/1846913006 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:50:17.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.360+0000 7fa39b400640 1 --2- 172.21.15.8:0/1846913006 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa39400b4b0 0x7fa3940d5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:17.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.360+0000 7fa39be00640 1 -- 172.21.15.8:0/1846913006 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa3940d2f30 msgr2=0x7fa39402cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:17.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.360+0000 7fa39be00640 1 --2- 172.21.15.8:0/1846913006 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa3940d2f30 0x7fa39402cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:17.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.360+0000 7fa39be00640 1 -- 172.21.15.8:0/1846913006 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa39400b4b0 msgr2=0x7fa3940d5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:17.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.360+0000 7fa39be00640 1 --2- 172.21.15.8:0/1846913006 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa39400b4b0 0x7fa3940d5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:17.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.360+0000 7fa39be00640 1 -- 172.21.15.8:0/1846913006 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3940d5c10 con 0x7fa394006be0 2024-03-23T23:50:17.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.360+0000 7fa39be00640 1 --2- 172.21.15.8:0/1846913006 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa394006be0 0x7fa3940d81d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa39000b410 tx=0x7fa39000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:17.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.368+0000 7fa398c00640 1 -- 172.21.15.8:0/1846913006 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa390015020 con 0x7fa394006be0 2024-03-23T23:50:17.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.368+0000 7fa398c00640 1 -- 172.21.15.8:0/1846913006 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa390011830 con 0x7fa394006be0 2024-03-23T23:50:17.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.368+0000 7fa398c00640 1 -- 172.21.15.8:0/1846913006 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa390011c20 con 0x7fa394006be0 2024-03-23T23:50:17.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.368+0000 7fa3a2200640 1 -- 172.21.15.8:0/1846913006 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3940d2930 con 0x7fa394006be0 2024-03-23T23:50:17.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.368+0000 7fa3a2200640 1 -- 172.21.15.8:0/1846913006 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3940c5b50 con 0x7fa394006be0 2024-03-23T23:50:17.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.372+0000 7fa3a2200640 1 --2- 172.21.15.8:0/1846913006 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa394045540 0x7fa3940be6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:17.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.372+0000 7fa3a2200640 1 -- 172.21.15.8:0/1846913006 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3940d0ce0 con 0x7fa394045540 2024-03-23T23:50:17.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.372+0000 7fa39b400640 1 --2- 172.21.15.8:0/1846913006 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa394045540 0x7fa3940be6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:17.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.372+0000 7fa39b400640 1 -- 172.21.15.8:0/1846913006 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa3940c5660 con 0x7fa394045540 2024-03-23T23:50:17.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.380+0000 7fa39b400640 1 --2- 172.21.15.8:0/1846913006 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa394045540 0x7fa3940be6a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa39400cfe0 tx=0x7fa3880192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:17.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.380+0000 7fa398c00640 1 -- 172.21.15.8:0/1846913006 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fa390018020 con 0x7fa394006be0 2024-03-23T23:50:17.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.384+0000 7fa398c00640 1 --2- 172.21.15.8:0/1846913006 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa37c067690 0x7fa37c069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:17.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.384+0000 7fa3a0e00640 1 --2- 172.21.15.8:0/1846913006 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa37c067690 0x7fa37c069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:17.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.388+0000 7fa3a0e00640 1 --2- 172.21.15.8:0/1846913006 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa37c067690 0x7fa37c069b50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa39c000b70 tx=0x7fa39c0690a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:17.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.392+0000 7fa398c00640 1 -- 172.21.15.8:0/1846913006 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fa390085500 con 0x7fa394006be0 2024-03-23T23:50:17.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.392+0000 7fa398c00640 1 -- 172.21.15.8:0/1846913006 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3880aac30 con 0x7fa394045540 2024-03-23T23:50:17.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.392+0000 7fa398c00640 1 -- 172.21.15.8:0/1846913006 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fa3880af040 con 0x7fa394045540 2024-03-23T23:50:17.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.392+0000 7fa398c00640 1 -- 172.21.15.8:0/1846913006 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa394045540 msgr2=0x7fa3940be6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:17.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.392+0000 7fa398c00640 1 --2- 172.21.15.8:0/1846913006 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa394045540 0x7fa3940be6a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa39400cfe0 tx=0x7fa3880192b0 comp rx=0 tx=0).stop 2024-03-23T23:50:17.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.392+0000 7fa398c00640 1 -- 172.21.15.8:0/1846913006 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa394045540 msgr2=0x7fa3940be6a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:50:17.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.392+0000 7fa398c00640 1 --2- 172.21.15.8:0/1846913006 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa394045540 0x7fa3940be6a0 secure :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa39400cfe0 tx=0x7fa3880192b0 comp rx=0 tx=0).stop 2024-03-23T23:50:17.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.412+0000 7fa3a2200640 1 --2- 172.21.15.8:0/1846913006 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3940d1020 0x7fa3940bebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:17.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.412+0000 7fa39b400640 1 --2- 172.21.15.8:0/1846913006 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3940d1020 0x7fa3940bebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:17.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.412+0000 7fa3a2200640 1 -- 172.21.15.8:0/1846913006 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3940054a0 con 0x7fa3940d1020 2024-03-23T23:50:17.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.416+0000 7fa39b400640 1 -- 172.21.15.8:0/1846913006 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa3940d5ff0 con 0x7fa3940d1020 2024-03-23T23:50:17.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.416+0000 7fa39b400640 1 --2- 172.21.15.8:0/1846913006 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3940d1020 0x7fa3940bebe0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa38801abc0 tx=0x7fa388009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:17.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.416+0000 7fa398c00640 1 -- 172.21.15.8:0/1846913006 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa388003c60 con 0x7fa3940d1020 2024-03-23T23:50:17.420 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:50:17.421 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:50:17.421 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:50:17.421 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:50:17.421 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 54, 2024-03-23T23:50:17.421 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:50:17.421 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:50:17.421 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:50:17.421 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:50:17.421 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:17.421 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 2, 2024-03-23T23:50:17.421 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:50:17.421 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:50:17.421 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:50:17.422 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:50:17.422 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:50:17.422 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:50:17.422 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:50:17.422 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:50:17.422 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:50:17.422 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:50:17.422 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:50:17.422 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:50:17.423 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:50:17.423 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:50:17.423 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:17.423 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:50:17.423 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:50:17.423 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:50:17.424 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:50:17.424 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:50:17.424 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:50:17.424 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:50:17.424 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:50:17.424 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:50:17.424 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:50:17.424 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:50:17.424 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:50:17.424 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:50:17.424 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:17.424 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:17.425 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:50:17.425 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:50:17.425 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:50:17.425 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:50:17.425 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:50:17.425 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:50:17.425 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:50:17.425 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:50:17.425 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:50:17.425 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:50:17.425 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:50:17.425 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:50:17.425 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:50:17.426 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:50:17.426 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:50:17.426 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:50:17.426 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:50:17.426 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:50:17.426 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:50:17.426 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:50:17.426 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:50:17.426 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:50:17.426 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:50:17.426 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:50:17.426 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:50:17.427 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:50:17.427 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:50:17.427 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:50:17.427 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:17.427 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:50:17.427 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:17.427 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:50:17.427 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:17.427 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:50:17.427 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:50:17.427 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:50:17.427 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:50:17.427 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:17.428 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:50:17.428 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:50:17.428 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:17.428 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:17.428 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:17.428 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:50:17.428 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:50:17.428 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:17.428 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:17.429 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:17.429 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:17.429 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:50:17.429 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:50:17.429 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:50:17.429 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:50:17.429 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:50:17.429 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:17.429 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:17.429 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:50:17.429 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:50:17.429 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:50:17.429 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:50:17.429 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:17.430 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:50:17.430 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:50:17.430 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:17.430 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:17.430 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:17.430 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:50:17.430 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:50:17.430 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:17.430 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:17.430 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:17.430 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:17.430 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:50:17.430 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:50:17.431 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:50:17.431 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:50:17.431 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:50:17.431 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:17.431 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:17.431 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:50:17.431 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:50:17.431 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:50:17.431 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:50:17.431 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:17.431 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:50:17.431 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:50:17.431 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:17.432 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:17.432 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:17.432 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:50:17.432 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:50:17.432 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:17.432 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:17.432 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:17.432 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:17.432 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:50:17.432 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:50:17.432 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:50:17.432 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:50:17.432 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:50:17.433 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:17.433 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:17.433 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:17.433 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:50:17.433 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:50:17.433 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:17.433 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:17.433 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:17.433 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:50:17.433 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:17.434 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:17.434 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:50:17.434 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:17.434 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:17.434 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:17.434 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:50:17.434 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:17.434 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:17.434 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:50:17.434 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:17.435 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:17.435 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:17.435 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5 2024-03-23T23:50:17.435 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:17.435 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:17.435 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:50:17.435 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:17.435 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:50:17.435 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:17.435 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:50:17.435 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:17.435 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:17.435 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:17.435 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:17.436 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5 2024-03-23T23:50:17.436 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:17.436 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:17.436 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:50:17.436 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:17.436 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:17.436 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:17.436 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:50:17.436 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:17.436 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:17.436 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:17.436 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:50:17.436 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:50:17.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.416+0000 7fa398c00640 1 -- 172.21.15.8:0/1846913006 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5184 (secure 0 0 0) 0x7fa388003e00 con 0x7fa3940d1020 2024-03-23T23:50:17.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.416+0000 7fa398c00640 1 -- 172.21.15.8:0/1846913006 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3940d1020 msgr2=0x7fa3940bebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:17.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.416+0000 7fa398c00640 1 --2- 172.21.15.8:0/1846913006 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3940d1020 0x7fa3940bebe0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa38801abc0 tx=0x7fa388009240 comp rx=0 tx=0).stop 2024-03-23T23:50:17.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.420+0000 7fa398c00640 1 -- 172.21.15.8:0/1846913006 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3940d1020 msgr2=0x7fa3940bebe0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:50:17.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.420+0000 7fa398c00640 1 --2- 172.21.15.8:0/1846913006 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3940d1020 0x7fa3940bebe0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:17.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.420+0000 7fa3a2200640 1 -- 172.21.15.8:0/1846913006 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa37c067690 msgr2=0x7fa37c069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:17.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.420+0000 7fa3a2200640 1 --2- 172.21.15.8:0/1846913006 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa37c067690 0x7fa37c069b50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa39c000b70 tx=0x7fa39c0690a0 comp rx=0 tx=0).stop 2024-03-23T23:50:17.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.420+0000 7fa3a0e00640 1 -- 172.21.15.8:0/1846913006 reap_dead start 2024-03-23T23:50:17.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.420+0000 7fa3a2200640 1 -- 172.21.15.8:0/1846913006 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa394006be0 msgr2=0x7fa3940d81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:17.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.420+0000 7fa3a2200640 1 --2- 172.21.15.8:0/1846913006 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa394006be0 0x7fa3940d81d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa39000b410 tx=0x7fa39000b8d0 comp rx=0 tx=0).stop 2024-03-23T23:50:17.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.420+0000 7fa3a2200640 1 -- 172.21.15.8:0/1846913006 shutdown_connections 2024-03-23T23:50:17.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.420+0000 7fa3a2200640 1 --2- 172.21.15.8:0/1846913006 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa394006be0 0x7fa3940d81d0 secure :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa39000b410 tx=0x7fa39000b8d0 comp rx=0 tx=0).stop 2024-03-23T23:50:17.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.420+0000 7fa3a2200640 1 -- 172.21.15.8:0/1846913006 >> 172.21.15.8:0/1846913006 conn(0x7fa3940060c0 msgr2=0x7fa3940064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:50:17.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.424+0000 7fa3a2200640 1 -- 172.21.15.8:0/1846913006 shutdown_connections 2024-03-23T23:50:17.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.424+0000 7fa3a2200640 1 -- 172.21.15.8:0/1846913006 wait complete. 2024-03-23T23:50:17.467 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:50:17.467 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T23:50:17.467 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:50:17.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.936+0000 7f6d6ee00640 1 Processor -- start 2024-03-23T23:50:17.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.940+0000 7f6d6ee00640 1 -- start start 2024-03-23T23:50:17.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.952+0000 7f6d6ee00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6d680c4bf0 0x7f6d6815df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:17.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.952+0000 7f6d6ee00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6d680c3ff0 0x7f6d6815b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:17.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.956+0000 7f6d6ee00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d6806cf20 con 0x7f6d6815b970 2024-03-23T23:50:17.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.956+0000 7f6d6ee00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d6806db30 con 0x7f6d680c4bf0 2024-03-23T23:50:17.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.956+0000 7f6d6ee00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d6806d200 con 0x7f6d680c3ff0 2024-03-23T23:50:17.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.956+0000 7f6d67e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6d680c4bf0 0x7f6d6815df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:17.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.956+0000 7f6d67e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6d680c4bf0 0x7f6d6815df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54134/0 (socket says 172.21.15.8:54134) 2024-03-23T23:50:17.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.956+0000 7f6d67e00640 1 -- 172.21.15.8:0/1440121020 learned_addr learned my addr 172.21.15.8:0/1440121020 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:50:17.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.956+0000 7f6d67e00640 1 -- 172.21.15.8:0/1440121020 >> v2:172.21.15.196:3300/0 conn(0x7f6d680c3ff0 msgr2=0x7f6d6815b430 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-23T23:50:17.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.956+0000 7f6d67e00640 1 --2- 172.21.15.8:0/1440121020 >> v2:172.21.15.196:3300/0 conn(0x7f6d680c3ff0 0x7f6d6815b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:17.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.956+0000 7f6d67e00640 1 -- 172.21.15.8:0/1440121020 >> v1:172.21.15.8:6789/0 conn(0x7f6d6815b970 legacy=0x7f6d6815a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:17.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.956+0000 7f6d67e00640 1 -- 172.21.15.8:0/1440121020 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6806d4e0 con 0x7f6d680c4bf0 2024-03-23T23:50:17.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.964+0000 7f6d67e00640 1 --2- 172.21.15.8:0/1440121020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d680c4bf0 0x7f6d6815df40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6d680c7340 tx=0x7f6d5401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d05854e66cfde454 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:17.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.968+0000 7f6d66a00640 1 -- 172.21.15.8:0/1440121020 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d540b0070 con 0x7f6d680c4bf0 2024-03-23T23:50:17.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.968+0000 7f6d66a00640 1 -- 172.21.15.8:0/1440121020 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d540ab600 con 0x7f6d680c4bf0 2024-03-23T23:50:17.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.968+0000 7f6d66a00640 1 -- 172.21.15.8:0/1440121020 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d540b0070 con 0x7f6d680c4bf0 2024-03-23T23:50:17.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.968+0000 7f6d6ee00640 1 -- 172.21.15.8:0/1440121020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d680c4bf0 msgr2=0x7f6d6815df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:17.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.968+0000 7f6d6ee00640 1 --2- 172.21.15.8:0/1440121020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d680c4bf0 0x7f6d6815df40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6d680c7340 tx=0x7f6d5401c4b0 comp rx=0 tx=0).stop 2024-03-23T23:50:17.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.976+0000 7f6d6ee00640 1 -- 172.21.15.8:0/1440121020 shutdown_connections 2024-03-23T23:50:17.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.976+0000 7f6d6ee00640 1 --2- 172.21.15.8:0/1440121020 >> v2:172.21.15.196:3300/0 conn(0x7f6d680c3ff0 0x7f6d6815b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:17.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.976+0000 7f6d6ee00640 1 --2- 172.21.15.8:0/1440121020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d680c4bf0 0x7f6d6815df40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:17.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.976+0000 7f6d6ee00640 1 -- 172.21.15.8:0/1440121020 >> 172.21.15.8:0/1440121020 conn(0x7f6d680743f0 msgr2=0x7f6d68074800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:50:17.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.980+0000 7f6d6ee00640 1 -- 172.21.15.8:0/1440121020 shutdown_connections 2024-03-23T23:50:17.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.980+0000 7f6d6ee00640 1 -- 172.21.15.8:0/1440121020 wait complete. 2024-03-23T23:50:17.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.984+0000 7f6d6ee00640 1 Processor -- start 2024-03-23T23:50:17.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.984+0000 7f6d6ee00640 1 -- start start 2024-03-23T23:50:17.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.984+0000 7f6d6ee00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d680c3ff0 0x7f6d6815f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:17.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.984+0000 7f6d6ee00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d680c4bf0 0x7f6d680c1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:17.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.984+0000 7f6d67e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d680c3ff0 0x7f6d6815f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:17.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.984+0000 7f6d67e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d680c3ff0 0x7f6d6815f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:60928/0 (socket says 172.21.15.8:60928) 2024-03-23T23:50:17.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.984+0000 7f6d67400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d680c4bf0 0x7f6d680c1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:17.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.984+0000 7f6d67400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d680c4bf0 0x7f6d680c1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54146/0 (socket says 172.21.15.8:54146) 2024-03-23T23:50:17.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.984+0000 7f6d67e00640 1 -- 172.21.15.8:0/4258159550 learned_addr learned my addr 172.21.15.8:0/4258159550 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:50:17.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.984+0000 7f6d6ee00640 1 --2- 172.21.15.8:0/4258159550 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d6815b970 0x7f6d680c03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:17.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.988+0000 7f6d6ee00640 1 -- 172.21.15.8:0/4258159550 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d68166a80 con 0x7f6d680c4bf0 2024-03-23T23:50:17.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.988+0000 7f6d6ee00640 1 -- 172.21.15.8:0/4258159550 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d680c51e0 con 0x7f6d680c3ff0 2024-03-23T23:50:17.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.988+0000 7f6d6ce00640 1 --2- 172.21.15.8:0/4258159550 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d6815b970 0x7f6d680c03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:17.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.988+0000 7f6d6ee00640 1 -- 172.21.15.8:0/4258159550 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d68166c00 con 0x7f6d6815b970 2024-03-23T23:50:17.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.988+0000 7f6d67400640 1 -- 172.21.15.8:0/4258159550 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d6815b970 msgr2=0x7f6d680c03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:17.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.988+0000 7f6d67400640 1 --2- 172.21.15.8:0/4258159550 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d6815b970 0x7f6d680c03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:17.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.988+0000 7f6d67400640 1 -- 172.21.15.8:0/4258159550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d680c3ff0 msgr2=0x7f6d6815f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:17.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.988+0000 7f6d67400640 1 --2- 172.21.15.8:0/4258159550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d680c3ff0 0x7f6d6815f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:17.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.988+0000 7f6d67400640 1 -- 172.21.15.8:0/4258159550 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6815e6c0 con 0x7f6d680c4bf0 2024-03-23T23:50:17.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.988+0000 7f6d67400640 1 --2- 172.21.15.8:0/4258159550 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d680c4bf0 0x7f6d680c1f80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6d5800b410 tx=0x7f6d5800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:17.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.988+0000 7f6d5fe00640 1 -- 172.21.15.8:0/4258159550 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d58015020 con 0x7f6d680c4bf0 2024-03-23T23:50:17.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.988+0000 7f6d5fe00640 1 -- 172.21.15.8:0/4258159550 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d58011830 con 0x7f6d680c4bf0 2024-03-23T23:50:17.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.988+0000 7f6d5fe00640 1 -- 172.21.15.8:0/4258159550 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d58011c20 con 0x7f6d680c4bf0 2024-03-23T23:50:17.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.988+0000 7f6d6ee00640 1 -- 172.21.15.8:0/4258159550 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d680c08f0 con 0x7f6d680c4bf0 2024-03-23T23:50:17.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.988+0000 7f6d6ee00640 1 -- 172.21.15.8:0/4258159550 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d6815e960 con 0x7f6d680c4bf0 2024-03-23T23:50:17.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.992+0000 7f6d6ee00640 1 --2- 172.21.15.8:0/4258159550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d680c2f80 0x7f6d6815cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:17.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.992+0000 7f6d6ee00640 1 -- 172.21.15.8:0/4258159550 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d680c24c0 con 0x7f6d680c2f80 2024-03-23T23:50:17.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.992+0000 7f6d67e00640 1 --2- 172.21.15.8:0/4258159550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d680c2f80 0x7f6d6815cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:17.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.992+0000 7f6d67e00640 1 -- 172.21.15.8:0/4258159550 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6d68068270 con 0x7f6d680c2f80 2024-03-23T23:50:17.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.992+0000 7f6d5fe00640 1 -- 172.21.15.8:0/4258159550 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f6d58018020 con 0x7f6d680c4bf0 2024-03-23T23:50:17.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.996+0000 7f6d5fe00640 1 --2- 172.21.15.8:0/4258159550 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6d48067760 0x7f6d48069c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:17.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.996+0000 7f6d5fe00640 1 -- 172.21.15.8:0/4258159550 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f6d58085a00 con 0x7f6d680c4bf0 2024-03-23T23:50:17.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.996+0000 7f6d6ce00640 1 --2- 172.21.15.8:0/4258159550 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6d48067760 0x7f6d48069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:17.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:17.996+0000 7f6d67e00640 1 --2- 172.21.15.8:0/4258159550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d680c2f80 0x7f6d6815cbf0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6d540190c0 tx=0x7f6d5401acf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:18.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.000+0000 7f6d5fe00640 1 -- 172.21.15.8:0/4258159550 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d540bb020 con 0x7f6d680c2f80 2024-03-23T23:50:18.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.000+0000 7f6d5fe00640 1 -- 172.21.15.8:0/4258159550 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f6d54003920 con 0x7f6d680c2f80 2024-03-23T23:50:18.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.000+0000 7f6d5fe00640 1 -- 172.21.15.8:0/4258159550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d680c2f80 msgr2=0x7f6d6815cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:18.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.000+0000 7f6d5fe00640 1 --2- 172.21.15.8:0/4258159550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d680c2f80 0x7f6d6815cbf0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6d540190c0 tx=0x7f6d5401acf0 comp rx=0 tx=0).stop 2024-03-23T23:50:18.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.000+0000 7f6d5fe00640 1 -- 172.21.15.8:0/4258159550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d680c2f80 msgr2=0x7f6d6815cbf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:50:18.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.000+0000 7f6d5fe00640 1 --2- 172.21.15.8:0/4258159550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d680c2f80 0x7f6d6815cbf0 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6d540190c0 tx=0x7f6d5401acf0 comp rx=0 tx=0).stop 2024-03-23T23:50:18.007 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.004+0000 7f6d6ce00640 1 --2- 172.21.15.8:0/4258159550 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6d48067760 0x7f6d48069c20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6d68071180 tx=0x7f6d60009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:18.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.044+0000 7f6d6ee00640 1 --2- 172.21.15.8:0/4258159550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d681fe2d0 0x7f6d681fe6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:18.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.044+0000 7f6d6ee00640 1 -- 172.21.15.8:0/4258159550 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6815d710 con 0x7f6d681fe2d0 2024-03-23T23:50:18.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.048+0000 7f6d67e00640 1 --2- 172.21.15.8:0/4258159550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d681fe2d0 0x7f6d681fe6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:18.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.052+0000 7f6d67e00640 1 -- 172.21.15.8:0/4258159550 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6d6815ecd0 con 0x7f6d681fe2d0 2024-03-23T23:50:18.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.052+0000 7f6d67e00640 1 --2- 172.21.15.8:0/4258159550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d681fe2d0 0x7f6d681fe6e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6d68160ce0 tx=0x7f6d540a8000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:18.062 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:50:18.062 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:50:18.062 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:50:18.063 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:50:18.063 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 54, 2024-03-23T23:50:18.063 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:50:18.063 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:50:18.063 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:50:18.063 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:50:18.063 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:18.063 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 3, 2024-03-23T23:50:18.063 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:50:18.063 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:50:18.063 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:50:18.063 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:50:18.063 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:50:18.064 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:50:18.064 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:50:18.064 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:50:18.064 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:50:18.064 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:50:18.064 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:50:18.064 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:50:18.064 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:50:18.064 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:50:18.064 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:18.064 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:50:18.064 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:50:18.064 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:50:18.064 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:50:18.065 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:50:18.065 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:50:18.065 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:50:18.065 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:50:18.065 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:50:18.065 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:50:18.065 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:50:18.065 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:50:18.065 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:50:18.065 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:18.066 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:18.066 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:50:18.066 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:50:18.066 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:50:18.066 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:50:18.066 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:50:18.066 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:50:18.066 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:50:18.066 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:50:18.066 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:50:18.066 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:50:18.066 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:50:18.066 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:50:18.067 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:50:18.067 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:50:18.067 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:50:18.067 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:50:18.067 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:50:18.067 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:50:18.067 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:50:18.067 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:50:18.067 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:50:18.067 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:50:18.067 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:50:18.067 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:50:18.067 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:50:18.068 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:50:18.068 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:50:18.068 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:50:18.068 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:18.068 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:50:18.068 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:18.068 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:50:18.068 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:18.068 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:50:18.068 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:50:18.068 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:50:18.068 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:50:18.068 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:18.068 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:50:18.069 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:50:18.069 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:18.069 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:18.069 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:18.069 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:50:18.069 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:50:18.069 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:18.069 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:18.069 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:18.069 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:18.069 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:50:18.069 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:50:18.070 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:50:18.070 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:50:18.070 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:50:18.070 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:18.070 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:18.070 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:50:18.070 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:50:18.070 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:50:18.070 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:50:18.070 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:18.070 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:50:18.070 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:50:18.071 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:18.071 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:18.071 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:18.071 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:50:18.071 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:50:18.071 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:18.071 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:18.071 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:18.071 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:18.071 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:50:18.071 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:50:18.071 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:50:18.071 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:50:18.072 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:50:18.072 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:18.072 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:18.072 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:50:18.072 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:50:18.072 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:50:18.072 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:50:18.072 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:18.072 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:50:18.072 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:50:18.072 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:18.072 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:18.073 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:18.073 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:50:18.073 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:50:18.073 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:18.073 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:18.073 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:18.073 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:18.073 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:50:18.073 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:50:18.073 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:50:18.073 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:50:18.073 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:50:18.073 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:18.074 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:18.074 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:18.074 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:50:18.074 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:50:18.074 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:18.074 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:18.074 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:18.074 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:50:18.074 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:18.074 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:18.074 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:50:18.074 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:18.075 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:18.075 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:18.075 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:50:18.075 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:18.075 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:18.075 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:18.075 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:50:18.075 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:50:18.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.056+0000 7f6d5fe00640 1 -- 172.21.15.8:0/4258159550 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d540bb030 con 0x7f6d681fe2d0 2024-03-23T23:50:18.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.056+0000 7f6d5fe00640 1 -- 172.21.15.8:0/4258159550 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4529 (secure 0 0 0) 0x7f6d540c2c70 con 0x7f6d681fe2d0 2024-03-23T23:50:18.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.056+0000 7f6d5fe00640 1 -- 172.21.15.8:0/4258159550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d681fe2d0 msgr2=0x7f6d681fe6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:18.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.056+0000 7f6d5fe00640 1 --2- 172.21.15.8:0/4258159550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d681fe2d0 0x7f6d681fe6e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6d68160ce0 tx=0x7f6d540a8000 comp rx=0 tx=0).stop 2024-03-23T23:50:18.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.056+0000 7f6d5fe00640 1 -- 172.21.15.8:0/4258159550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d681fe2d0 msgr2=0x7f6d681fe6e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:50:18.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.056+0000 7f6d5fe00640 1 --2- 172.21.15.8:0/4258159550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d681fe2d0 0x7f6d681fe6e0 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6d68160ce0 tx=0x7f6d540a8000 comp rx=0 tx=0).stop 2024-03-23T23:50:18.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.064+0000 7f6d6ee00640 1 -- 172.21.15.8:0/4258159550 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6d48067760 msgr2=0x7f6d48069c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:18.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.064+0000 7f6d6ee00640 1 --2- 172.21.15.8:0/4258159550 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6d48067760 0x7f6d48069c20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6d68071180 tx=0x7f6d60009040 comp rx=0 tx=0).stop 2024-03-23T23:50:18.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.064+0000 7f6d6ee00640 1 -- 172.21.15.8:0/4258159550 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d680c4bf0 msgr2=0x7f6d680c1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:18.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.064+0000 7f6d6ee00640 1 --2- 172.21.15.8:0/4258159550 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d680c4bf0 0x7f6d680c1f80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6d5800b410 tx=0x7f6d5800b8d0 comp rx=0 tx=0).stop 2024-03-23T23:50:18.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.064+0000 7f6d6ce00640 1 -- 172.21.15.8:0/4258159550 reap_dead start 2024-03-23T23:50:18.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.064+0000 7f6d6ce00640 1 -- 172.21.15.8:0/4258159550 reap_dead start 2024-03-23T23:50:18.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.064+0000 7f6d6ee00640 1 -- 172.21.15.8:0/4258159550 shutdown_connections 2024-03-23T23:50:18.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.064+0000 7f6d6ee00640 1 -- 172.21.15.8:0/4258159550 >> 172.21.15.8:0/4258159550 conn(0x7f6d680743f0 msgr2=0x7f6d680c62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:50:18.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.072+0000 7f6d6ee00640 1 -- 172.21.15.8:0/4258159550 shutdown_connections 2024-03-23T23:50:18.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.072+0000 7f6d6ee00640 1 -- 172.21.15.8:0/4258159550 wait complete. 2024-03-23T23:50:18.133 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:50:18.134 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T23:50:18.134 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:50:18.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.568+0000 7f12b1200640 1 Processor -- start 2024-03-23T23:50:18.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.568+0000 7f12b1200640 1 -- start start 2024-03-23T23:50:18.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.572+0000 7f12b1200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f12ac0ca5d0 0x7f12ac15a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:18.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.572+0000 7f12b1200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f12ac0ca9b0 0x7f12ac0b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:18.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.572+0000 7f12b1200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12ac0c7510 con 0x7f12ac0b0a60 2024-03-23T23:50:18.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.572+0000 7f12b1200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12ac0c5960 con 0x7f12ac0ca9b0 2024-03-23T23:50:18.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.572+0000 7f12b1200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12ac0ae8f0 con 0x7f12ac0ca5d0 2024-03-23T23:50:18.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.572+0000 7f12ab400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f12ac0ca5d0 0x7f12ac15a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:18.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.572+0000 7f12ab400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f12ac0ca5d0 0x7f12ac15a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:60962/0 (socket says 172.21.15.8:60962) 2024-03-23T23:50:18.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.572+0000 7f12ab400640 1 -- 172.21.15.8:0/1096917915 learned_addr learned my addr 172.21.15.8:0/1096917915 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:50:18.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.576+0000 7f12ab400640 1 -- 172.21.15.8:0/1096917915 >> v2:172.21.15.8:3300/0 conn(0x7f12ac0ca9b0 msgr2=0x7f12ac0b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:50:18.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.576+0000 7f12ab400640 1 --2- 172.21.15.8:0/1096917915 >> v2:172.21.15.8:3300/0 conn(0x7f12ac0ca9b0 0x7f12ac0b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:18.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.576+0000 7f12ab400640 1 -- 172.21.15.8:0/1096917915 >> v1:172.21.15.196:6789/0 conn(0x7f12ac0b0a60 legacy=0x7f12ac0c5df0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-23T23:50:18.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.576+0000 7f12ab400640 1 -- 172.21.15.8:0/1096917915 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ac0aebd0 con 0x7f12ac0ca5d0 2024-03-23T23:50:18.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.592+0000 7f12ab400640 1 --2- 172.21.15.8:0/1096917915 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f12ac0ca5d0 0x7f12ac15a890 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f12ac08c510 tx=0x7f129c01c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e23b6efbcefc8164 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:18.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.596+0000 7f12aa000640 1 -- 172.21.15.8:0/1096917915 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c0b0070 con 0x7f12ac0ca5d0 2024-03-23T23:50:18.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.596+0000 7f12aa000640 1 -- 172.21.15.8:0/1096917915 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129c0ab600 con 0x7f12ac0ca5d0 2024-03-23T23:50:18.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.596+0000 7f12aa000640 1 -- 172.21.15.8:0/1096917915 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c0ab9d0 con 0x7f12ac0ca5d0 2024-03-23T23:50:18.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.596+0000 7f12b1200640 1 -- 172.21.15.8:0/1096917915 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f12ac0ca5d0 msgr2=0x7f12ac15a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:18.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.596+0000 7f12b1200640 1 --2- 172.21.15.8:0/1096917915 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f12ac0ca5d0 0x7f12ac15a890 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f12ac08c510 tx=0x7f129c01c500 comp rx=0 tx=0).stop 2024-03-23T23:50:18.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.604+0000 7f12b1200640 1 -- 172.21.15.8:0/1096917915 shutdown_connections 2024-03-23T23:50:18.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.604+0000 7f12b1200640 1 --2- 172.21.15.8:0/1096917915 >> v2:172.21.15.8:3300/0 conn(0x7f12ac0ca9b0 0x7f12ac0b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:18.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.604+0000 7f12b1200640 1 --2- 172.21.15.8:0/1096917915 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f12ac0ca5d0 0x7f12ac15a890 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:18.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.604+0000 7f12b1200640 1 -- 172.21.15.8:0/1096917915 >> 172.21.15.8:0/1096917915 conn(0x7f12ac0acee0 msgr2=0x7f12ac0ad2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:50:18.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.616+0000 7f12b1200640 1 -- 172.21.15.8:0/1096917915 shutdown_connections 2024-03-23T23:50:18.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.620+0000 7f12b1200640 1 -- 172.21.15.8:0/1096917915 wait complete. 2024-03-23T23:50:18.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.624+0000 7f12b1200640 1 Processor -- start 2024-03-23T23:50:18.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.628+0000 7f12b1200640 1 -- start start 2024-03-23T23:50:18.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.628+0000 7f12b1200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12ac0b0a60 0x7f12ac1f6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:18.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.628+0000 7f12b1200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f12ac0ca5d0 0x7f12ac0c2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:18.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.628+0000 7f12b1200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12ac0ca9b0 0x7f12ac0c2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:18.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.628+0000 7f12b1200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac0c6a90 con 0x7f12ac0b0a60 2024-03-23T23:50:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.628+0000 7f12b1200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac0c6910 con 0x7f12ac0ca5d0 2024-03-23T23:50:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.628+0000 7f12b1200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac166e40 con 0x7f12ac0ca9b0 2024-03-23T23:50:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.632+0000 7f12aaa00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f12ac0ca5d0 0x7f12ac0c2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.632+0000 7f12aaa00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f12ac0ca5d0 0x7f12ac0c2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:60968/0 (socket says 172.21.15.8:60968) 2024-03-23T23:50:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.632+0000 7f12aaa00640 1 -- 172.21.15.8:0/3880615619 learned_addr learned my addr 172.21.15.8:0/3880615619 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:50:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.632+0000 7f12abe00640 1 --2- 172.21.15.8:0/3880615619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12ac0ca9b0 0x7f12ac0c2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.632+0000 7f12ab400640 1 --2- 172.21.15.8:0/3880615619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12ac0b0a60 0x7f12ac1f6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.632+0000 7f12aaa00640 1 -- 172.21.15.8:0/3880615619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12ac0ca9b0 msgr2=0x7f12ac0c2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.632+0000 7f12aaa00640 1 --2- 172.21.15.8:0/3880615619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12ac0ca9b0 0x7f12ac0c2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.632+0000 7f12aaa00640 1 -- 172.21.15.8:0/3880615619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12ac0b0a60 msgr2=0x7f12ac1f6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.632+0000 7f12aaa00640 1 --2- 172.21.15.8:0/3880615619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12ac0b0a60 0x7f12ac1f6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.632+0000 7f12aaa00640 1 -- 172.21.15.8:0/3880615619 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ac151830 con 0x7f12ac0ca5d0 2024-03-23T23:50:18.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.640+0000 7f12aaa00640 1 --2- 172.21.15.8:0/3880615619 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f12ac0ca5d0 0x7f12ac0c2a30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f129800b420 tx=0x7f129800b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:18.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.644+0000 7f12a3400640 1 -- 172.21.15.8:0/3880615619 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1298011830 con 0x7f12ac0ca5d0 2024-03-23T23:50:18.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.644+0000 7f12a3400640 1 -- 172.21.15.8:0/3880615619 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1298016070 con 0x7f12ac0ca5d0 2024-03-23T23:50:18.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.644+0000 7f12a3400640 1 -- 172.21.15.8:0/3880615619 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1298011c10 con 0x7f12ac0ca5d0 2024-03-23T23:50:18.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.644+0000 7f12b1200640 1 -- 172.21.15.8:0/3880615619 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12ac151d10 con 0x7f12ac0ca5d0 2024-03-23T23:50:18.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.644+0000 7f12b1200640 1 -- 172.21.15.8:0/3880615619 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12ac1512e0 con 0x7f12ac0ca5d0 2024-03-23T23:50:18.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.648+0000 7f12b1200640 1 --2- 172.21.15.8:0/3880615619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12ac0c4030 0x7f12ac1f6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:18.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.648+0000 7f12b1200640 1 -- 172.21.15.8:0/3880615619 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac04f410 con 0x7f12ac0c4030 2024-03-23T23:50:18.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.652+0000 7f12ab400640 1 --2- 172.21.15.8:0/3880615619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12ac0c4030 0x7f12ac1f6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:18.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.656+0000 7f12ab400640 1 -- 172.21.15.8:0/3880615619 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f12ac0c5150 con 0x7f12ac0c4030 2024-03-23T23:50:18.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.664+0000 7f12ab400640 1 --2- 172.21.15.8:0/3880615619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12ac0c4030 0x7f12ac1f6680 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f12ac0ae3d0 tx=0x7f129c01ad40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:18.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.664+0000 7f12a3400640 1 -- 172.21.15.8:0/3880615619 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f129801b460 con 0x7f12ac0ca5d0 2024-03-23T23:50:18.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.668+0000 7f12a3400640 1 --2- 172.21.15.8:0/3880615619 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f128c0676b0 0x7f128c069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:18.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.668+0000 7f12a3400640 1 -- 172.21.15.8:0/3880615619 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f12980858b0 con 0x7f12ac0ca5d0 2024-03-23T23:50:18.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.668+0000 7f12a3400640 1 -- 172.21.15.8:0/3880615619 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c0bb020 con 0x7f12ac0c4030 2024-03-23T23:50:18.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.672+0000 7f12a3400640 1 -- 172.21.15.8:0/3880615619 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f129c0b1040 con 0x7f12ac0c4030 2024-03-23T23:50:18.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.672+0000 7f12a3400640 1 -- 172.21.15.8:0/3880615619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12ac0c4030 msgr2=0x7f12ac1f6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:18.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.672+0000 7f12a3400640 1 --2- 172.21.15.8:0/3880615619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12ac0c4030 0x7f12ac1f6680 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f12ac0ae3d0 tx=0x7f129c01ad40 comp rx=0 tx=0).stop 2024-03-23T23:50:18.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.672+0000 7f12a3400640 1 -- 172.21.15.8:0/3880615619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12ac0c4030 msgr2=0x7f12ac1f6680 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:50:18.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.672+0000 7f12a3400640 1 --2- 172.21.15.8:0/3880615619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12ac0c4030 0x7f12ac1f6680 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f12ac0ae3d0 tx=0x7f129c01ad40 comp rx=0 tx=0).stop 2024-03-23T23:50:18.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.676+0000 7f12abe00640 1 --2- 172.21.15.8:0/3880615619 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f128c0676b0 0x7f128c069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:18.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.680+0000 7f12abe00640 1 --2- 172.21.15.8:0/3880615619 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f128c0676b0 0x7f128c069b70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f12a4009ee0 tx=0x7f12a4009450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:18.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.724+0000 7f12b1200640 1 --2- 172.21.15.8:0/3880615619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12ac1f6bc0 0x7f12ac0aa920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:18.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.724+0000 7f12b1200640 1 -- 172.21.15.8:0/3880615619 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac0730b0 con 0x7f12ac1f6bc0 2024-03-23T23:50:18.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.728+0000 7f12ab400640 1 --2- 172.21.15.8:0/3880615619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12ac1f6bc0 0x7f12ac0aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:18.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.728+0000 7f12ab400640 1 -- 172.21.15.8:0/3880615619 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f12ac0c5e90 con 0x7f12ac1f6bc0 2024-03-23T23:50:18.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.732+0000 7f12ab400640 1 --2- 172.21.15.8:0/3880615619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12ac1f6bc0 0x7f12ac0aa920 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f129c000c10 tx=0x7f129c0192a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:18.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.732+0000 7f12a3400640 1 -- 172.21.15.8:0/3880615619 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c0bb040 con 0x7f12ac1f6bc0 2024-03-23T23:50:18.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.744+0000 7f12a3400640 1 -- 172.21.15.8:0/3880615619 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5039 (secure 0 0 0) 0x7f129c0c2220 con 0x7f12ac1f6bc0 2024-03-23T23:50:18.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.744+0000 7f12a3400640 1 -- 172.21.15.8:0/3880615619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12ac1f6bc0 msgr2=0x7f12ac0aa920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:18.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.744+0000 7f12a3400640 1 --2- 172.21.15.8:0/3880615619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12ac1f6bc0 0x7f12ac0aa920 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f129c000c10 tx=0x7f129c0192a0 comp rx=0 tx=0).stop 2024-03-23T23:50:18.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.744+0000 7f12a3400640 1 -- 172.21.15.8:0/3880615619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12ac1f6bc0 msgr2=0x7f12ac0aa920 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:50:18.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.744+0000 7f12a3400640 1 --2- 172.21.15.8:0/3880615619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12ac1f6bc0 0x7f12ac0aa920 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f129c000c10 tx=0x7f129c0192a0 comp rx=0 tx=0).stop 2024-03-23T23:50:18.757 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:50:18.758 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:50:18.758 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:50:18.758 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:50:18.758 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 54, 2024-03-23T23:50:18.758 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:50:18.758 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:50:18.758 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:50:18.758 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:50:18.758 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:18.758 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 3, 2024-03-23T23:50:18.758 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:50:18.759 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:50:18.759 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:50:18.759 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:50:18.759 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:50:18.759 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:50:18.759 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:50:18.759 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:50:18.759 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:50:18.759 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:50:18.759 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:50:18.760 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:50:18.760 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:50:18.760 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:50:18.760 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:18.760 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:50:18.760 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:50:18.760 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:50:18.760 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:50:18.760 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:50:18.760 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:50:18.760 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:50:18.760 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:50:18.761 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:50:18.761 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:50:18.761 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:50:18.761 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:50:18.761 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:50:18.761 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:18.761 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:18.761 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:50:18.761 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:50:18.761 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:50:18.761 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:50:18.761 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:50:18.761 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:50:18.762 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:50:18.762 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:50:18.762 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:50:18.762 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:50:18.762 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:50:18.762 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:50:18.762 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:50:18.762 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:50:18.762 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:50:18.762 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:50:18.762 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:50:18.762 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:50:18.762 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:50:18.763 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:50:18.763 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:50:18.763 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:50:18.763 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:50:18.763 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:50:18.763 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:50:18.763 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:50:18.763 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:50:18.763 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:50:18.763 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:50:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:50:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:50:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:50:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:50:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:50:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:50:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:50:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:50:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:50:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:50:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:50:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:50:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:50:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:50:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:18.766 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:50:18.766 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:50:18.766 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:50:18.766 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:50:18.766 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:18.766 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:50:18.766 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:50:18.766 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:18.766 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:18.766 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:18.766 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:50:18.766 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:50:18.766 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:50:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:50:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:50:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:50:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:50:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:50:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:50:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:50:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:50:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:50:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:50:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:50:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:50:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:50:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:50:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:50:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:50:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:50:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:50:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:50:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:50:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:50:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:50:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:50:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:50:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:50:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:50:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:50:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:50:18.772 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:18.772 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:18.772 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:18.772 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:50:18.772 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:50:18.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.760+0000 7f12b1200640 1 -- 172.21.15.8:0/3880615619 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f128c0676b0 msgr2=0x7f128c069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:18.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.760+0000 7f12b1200640 1 --2- 172.21.15.8:0/3880615619 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f128c0676b0 0x7f128c069b70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f12a4009ee0 tx=0x7f12a4009450 comp rx=0 tx=0).stop 2024-03-23T23:50:18.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.760+0000 7f12b1200640 1 -- 172.21.15.8:0/3880615619 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f12ac0ca5d0 msgr2=0x7f12ac0c2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:18.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.760+0000 7f12b1200640 1 --2- 172.21.15.8:0/3880615619 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f12ac0ca5d0 0x7f12ac0c2a30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f129800b420 tx=0x7f129800b8e0 comp rx=0 tx=0).stop 2024-03-23T23:50:18.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.760+0000 7f12abe00640 1 -- 172.21.15.8:0/3880615619 reap_dead start 2024-03-23T23:50:18.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.760+0000 7f12abe00640 1 -- 172.21.15.8:0/3880615619 reap_dead start 2024-03-23T23:50:18.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.764+0000 7f12b1200640 1 -- 172.21.15.8:0/3880615619 shutdown_connections 2024-03-23T23:50:18.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.764+0000 7f12b1200640 1 -- 172.21.15.8:0/3880615619 >> 172.21.15.8:0/3880615619 conn(0x7f12ac0acee0 msgr2=0x7f12ac0ac080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:50:18.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.792+0000 7f12b1200640 1 -- 172.21.15.8:0/3880615619 shutdown_connections 2024-03-23T23:50:18.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:18.796+0000 7f12b1200640 1 -- 172.21.15.8:0/3880615619 wait complete. 2024-03-23T23:50:18.907 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:50:18.908 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-03-23T23:50:18.908 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-03-23T23:50:19.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.452+0000 7f1198400640 1 Processor -- start 2024-03-23T23:50:19.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.452+0000 7f1198400640 1 -- start start 2024-03-23T23:50:19.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.456+0000 7f1198400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f11900c1f10 0x7f119006e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:19.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.456+0000 7f1198400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f11900c2a40 0x7f11900c2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:19.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.456+0000 7f1198400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11901523f0 con 0x7f11900c3440 2024-03-23T23:50:19.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.456+0000 7f1198400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1190152950 con 0x7f11900c2a40 2024-03-23T23:50:19.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.456+0000 7f1198400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1190152670 con 0x7f11900c1f10 2024-03-23T23:50:19.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.456+0000 7f1196400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f11900c3440 0x7f119014ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53344/0 (socket says 172.21.15.8:53344) 2024-03-23T23:50:19.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.456+0000 7f1196400640 1 -- 172.21.15.8:0/381516313 learned_addr learned my addr 172.21.15.8:0/381516313 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:50:19.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.464+0000 7f1195a00640 1 --2- 172.21.15.8:0/381516313 >> v2:172.21.15.196:3300/0 conn(0x7f11900c1f10 0x7f119006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:19.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.464+0000 7f1195000640 1 --2- 172.21.15.8:0/381516313 >> v2:172.21.15.8:3300/0 conn(0x7f11900c2a40 0x7f11900c2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:19.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.464+0000 7f1195000640 1 -- 172.21.15.8:0/381516313 >> v2:172.21.15.196:3300/0 conn(0x7f11900c1f10 msgr2=0x7f119006e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:50:19.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.464+0000 7f1195000640 1 --2- 172.21.15.8:0/381516313 >> v2:172.21.15.196:3300/0 conn(0x7f11900c1f10 0x7f119006e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:19.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.464+0000 7f1195000640 1 -- 172.21.15.8:0/381516313 >> v1:172.21.15.8:6789/0 conn(0x7f11900c3440 legacy=0x7f119014ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:19.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.464+0000 7f1195000640 1 -- 172.21.15.8:0/381516313 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119006de40 con 0x7f11900c2a40 2024-03-23T23:50:19.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.484+0000 7f1195000640 1 --2- 172.21.15.8:0/381516313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11900c2a40 0x7f11900c2f00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f119006ef20 tx=0x7f117c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cd0ce8cae0f4190 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:19.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.488+0000 7f118fe00640 1 -- 172.21.15.8:0/381516313 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c0a56f0 con 0x7f11900c2a40 2024-03-23T23:50:19.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.488+0000 7f118fe00640 1 -- 172.21.15.8:0/381516313 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117c0a5890 con 0x7f11900c2a40 2024-03-23T23:50:19.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.488+0000 7f118fe00640 1 -- 172.21.15.8:0/381516313 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c0a56f0 con 0x7f11900c2a40 2024-03-23T23:50:19.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.488+0000 7f1198400640 1 -- 172.21.15.8:0/381516313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11900c2a40 msgr2=0x7f11900c2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:19.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.488+0000 7f1198400640 1 --2- 172.21.15.8:0/381516313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11900c2a40 0x7f11900c2f00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f119006ef20 tx=0x7f117c01c980 comp rx=0 tx=0).stop 2024-03-23T23:50:19.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.500+0000 7f1198400640 1 -- 172.21.15.8:0/381516313 shutdown_connections 2024-03-23T23:50:19.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.500+0000 7f1198400640 1 --2- 172.21.15.8:0/381516313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11900c2a40 0x7f11900c2f00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:19.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.500+0000 7f1198400640 1 --2- 172.21.15.8:0/381516313 >> v2:172.21.15.196:3300/0 conn(0x7f11900c1f10 0x7f119006e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:19.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.500+0000 7f1198400640 1 -- 172.21.15.8:0/381516313 >> 172.21.15.8:0/381516313 conn(0x7f11900a9870 msgr2=0x7f119006b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:50:19.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.500+0000 7f1198400640 1 -- 172.21.15.8:0/381516313 shutdown_connections 2024-03-23T23:50:19.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.512+0000 7f1198400640 1 -- 172.21.15.8:0/381516313 wait complete. 2024-03-23T23:50:19.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.512+0000 7f1198400640 1 Processor -- start 2024-03-23T23:50:19.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.516+0000 7f1198400640 1 -- start start 2024-03-23T23:50:19.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.520+0000 7f1198400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11900c1f10 0x7f11901f91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:19.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.520+0000 7f1198400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11900c2a40 0x7f119014d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:19.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.520+0000 7f1195a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11900c1f10 0x7f11901f91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:19.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.520+0000 7f1195a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11900c1f10 0x7f11901f91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54186/0 (socket says 172.21.15.8:54186) 2024-03-23T23:50:19.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.524+0000 7f1195a00640 1 -- 172.21.15.8:0/3831447893 learned_addr learned my addr 172.21.15.8:0/3831447893 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:50:19.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.524+0000 7f1198400640 1 --2- 172.21.15.8:0/3831447893 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11900c3440 0x7f119014a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:19.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.524+0000 7f1198400640 1 -- 172.21.15.8:0/3831447893 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119015eed0 con 0x7f11900c1f10 2024-03-23T23:50:19.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.524+0000 7f1198400640 1 -- 172.21.15.8:0/3831447893 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119015ed50 con 0x7f11900c2a40 2024-03-23T23:50:19.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.524+0000 7f1198400640 1 -- 172.21.15.8:0/3831447893 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f119015f050 con 0x7f11900c3440 2024-03-23T23:50:19.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.524+0000 7f1195000640 1 --2- 172.21.15.8:0/3831447893 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11900c2a40 0x7f119014d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:19.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.524+0000 7f1195000640 1 -- 172.21.15.8:0/3831447893 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11900c3440 msgr2=0x7f119014a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:19.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.524+0000 7f1195000640 1 --2- 172.21.15.8:0/3831447893 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11900c3440 0x7f119014a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:19.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.524+0000 7f1195000640 1 -- 172.21.15.8:0/3831447893 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11900c1f10 msgr2=0x7f11901f91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:19.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.524+0000 7f1195000640 1 --2- 172.21.15.8:0/3831447893 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11900c1f10 0x7f11901f91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:19.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.524+0000 7f1195000640 1 -- 172.21.15.8:0/3831447893 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1190153550 con 0x7f11900c2a40 2024-03-23T23:50:19.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.524+0000 7f1195a00640 1 --2- 172.21.15.8:0/3831447893 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11900c1f10 0x7f11901f91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:50:19.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.528+0000 7f1195000640 1 --2- 172.21.15.8:0/3831447893 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11900c2a40 0x7f119014d540 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f117c0ab000 tx=0x7f117c01a760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:19.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.536+0000 7f118d600640 1 -- 172.21.15.8:0/3831447893 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c0bc020 con 0x7f11900c2a40 2024-03-23T23:50:19.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.536+0000 7f118d600640 1 -- 172.21.15.8:0/3831447893 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117c0ad800 con 0x7f11900c2a40 2024-03-23T23:50:19.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.536+0000 7f118d600640 1 -- 172.21.15.8:0/3831447893 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c0a56f0 con 0x7f11900c2a40 2024-03-23T23:50:19.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.536+0000 7f1198400640 1 -- 172.21.15.8:0/3831447893 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1190154390 con 0x7f11900c2a40 2024-03-23T23:50:19.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.536+0000 7f1198400640 1 -- 172.21.15.8:0/3831447893 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1190153270 con 0x7f11900c2a40 2024-03-23T23:50:19.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.552+0000 7f118d600640 1 -- 172.21.15.8:0/3831447893 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f117c0bf020 con 0x7f11900c2a40 2024-03-23T23:50:19.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.552+0000 7f118d600640 1 --2- 172.21.15.8:0/3831447893 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1170067730 0x7f1170069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:19.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.552+0000 7f118d600640 1 -- 172.21.15.8:0/3831447893 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f117c11f910 con 0x7f11900c2a40 2024-03-23T23:50:19.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.556+0000 7f1198400640 1 -- 172.21.15.8:0/3831447893 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1190068270 con 0x7f11900c2a40 2024-03-23T23:50:19.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.564+0000 7f1195a00640 1 --2- 172.21.15.8:0/3831447893 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1170067730 0x7f1170069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:19.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.568+0000 7f1195a00640 1 --2- 172.21.15.8:0/3831447893 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1170067730 0x7f1170069bf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f118400af80 tx=0x7f1184008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:19.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:19.576+0000 7f118d600640 1 -- 172.21.15.8:0/3831447893 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f117c0c6030 con 0x7f11900c2a40 2024-03-23T23:50:20.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:20.480+0000 7f1198400640 1 -- 172.21.15.8:0/3831447893 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f119015c100 con 0x7f11900c2a40 2024-03-23T23:50:20.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:20.492+0000 7f118d600640 1 -- 172.21.15.8:0/3831447893 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f1190153550 con 0x7f11900c2a40 2024-03-23T23:50:20.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:20.512+0000 7f1198400640 1 -- 172.21.15.8:0/3831447893 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1170067730 msgr2=0x7f1170069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:20.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:20.512+0000 7f1198400640 1 --2- 172.21.15.8:0/3831447893 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1170067730 0x7f1170069bf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f118400af80 tx=0x7f1184008040 comp rx=0 tx=0).stop 2024-03-23T23:50:20.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:20.512+0000 7f1198400640 1 -- 172.21.15.8:0/3831447893 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11900c2a40 msgr2=0x7f119014d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:20.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:20.512+0000 7f1198400640 1 --2- 172.21.15.8:0/3831447893 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11900c2a40 0x7f119014d540 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f117c0ab000 tx=0x7f117c01a760 comp rx=0 tx=0).stop 2024-03-23T23:50:20.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:20.520+0000 7f1198400640 1 -- 172.21.15.8:0/3831447893 shutdown_connections 2024-03-23T23:50:20.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:20.520+0000 7f1198400640 1 --2- 172.21.15.8:0/3831447893 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1170067730 0x7f1170069bf0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:20.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:20.520+0000 7f1198400640 1 --2- 172.21.15.8:0/3831447893 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11900c3440 0x7f119014a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:20.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:20.520+0000 7f1198400640 1 --2- 172.21.15.8:0/3831447893 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11900c2a40 0x7f119014d540 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:20.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:20.520+0000 7f1198400640 1 --2- 172.21.15.8:0/3831447893 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11900c1f10 0x7f11901f91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:20.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:20.520+0000 7f1198400640 1 -- 172.21.15.8:0/3831447893 >> 172.21.15.8:0/3831447893 conn(0x7f11900a9870 msgr2=0x7f1190150e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:50:20.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:20.520+0000 7f1198400640 1 -- 172.21.15.8:0/3831447893 shutdown_connections 2024-03-23T23:50:20.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:20.520+0000 7f1198400640 1 -- 172.21.15.8:0/3831447893 wait complete. 2024-03-23T23:50:20.612 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-03-23T23:50:30.613 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T23:50:30.613 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:50:30.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:30.984+0000 7ff20c400640 1 Processor -- start 2024-03-23T23:50:30.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:30.984+0000 7ff20c400640 1 -- start start 2024-03-23T23:50:30.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:30.992+0000 7ff20c400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1fc0d58d0 0x7ff1fc046ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:30.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:30.992+0000 7ff20c400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff1fc00b0b0 0x7ff1fc00b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:30.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:30.992+0000 7ff20c400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1fc0db810 con 0x7ff1fc006a40 2024-03-23T23:50:30.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:30.992+0000 7ff20c400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1fc0dc6e0 con 0x7ff1fc00b0b0 2024-03-23T23:50:30.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:30.992+0000 7ff20c400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc0d8dc0 con 0x7ff1fc0d58d0 2024-03-23T23:50:30.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:30.996+0000 7ff209a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1fc0d58d0 0x7ff1fc046ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:30.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:30.996+0000 7ff209a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1fc0d58d0 0x7ff1fc046ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:52844/0 (socket says 172.21.15.8:52844) 2024-03-23T23:50:30.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:30.996+0000 7ff209a00640 1 -- 172.21.15.8:0/2041100439 learned_addr learned my addr 172.21.15.8:0/2041100439 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:50:31.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:30.996+0000 7ff203e00640 1 -- 172.21.15.8:0/2041100439 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3455127313 0 0) 0x7ff1fc0db810 con 0x7ff1fc006a40 2024-03-23T23:50:31.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:30.996+0000 7ff203e00640 1 -- 172.21.15.8:0/2041100439 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1ec003530 con 0x7ff1fc006a40 2024-03-23T23:50:31.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:30.996+0000 7ff203e00640 1 -- 172.21.15.8:0/2041100439 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 300605661 0 0) 0x7ff1ec003530 con 0x7ff1fc006a40 2024-03-23T23:50:31.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:30.996+0000 7ff203e00640 1 -- 172.21.15.8:0/2041100439 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1fc0d58d0 msgr2=0x7ff1fc046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:50:31.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:30.996+0000 7ff203e00640 1 --2- 172.21.15.8:0/2041100439 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1fc0d58d0 0x7ff1fc046ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:31.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:30.996+0000 7ff203e00640 1 -- 172.21.15.8:0/2041100439 >> v2:172.21.15.196:3300/0 conn(0x7ff1fc00b0b0 msgr2=0x7ff1fc00b520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-23T23:50:31.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:30.996+0000 7ff203e00640 1 --2- 172.21.15.8:0/2041100439 >> v2:172.21.15.196:3300/0 conn(0x7ff1fc00b0b0 0x7ff1fc00b520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:31.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:30.996+0000 7ff203e00640 1 -- 172.21.15.8:0/2041100439 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1fc0dbab0 con 0x7ff1fc006a40 2024-03-23T23:50:31.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:30.996+0000 7ff203e00640 1 -- 172.21.15.8:0/2041100439 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7ff1f8001680 con 0x7ff1fc006a40 2024-03-23T23:50:31.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:30.996+0000 7ff203e00640 1 -- 172.21.15.8:0/2041100439 >> v1:172.21.15.8:6789/0 conn(0x7ff1fc006a40 legacy=0x7ff1fc0dbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:31.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:30.996+0000 7ff203e00640 1 --2- 172.21.15.8:0/2041100439 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1ec003a40 0x7ff1ec003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:31.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:30.996+0000 7ff203e00640 1 --2- 172.21.15.8:0/2041100439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1ec004810 0x7ff1ec004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:31.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:30.996+0000 7ff203e00640 1 --2- 172.21.15.8:0/2041100439 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1ec0051d0 0x7ff1ec00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:31.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:30.996+0000 7ff203e00640 1 -- 172.21.15.8:0/2041100439 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc0dc6e0 con 0x7ff1ec004810 2024-03-23T23:50:31.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:30.996+0000 7ff203e00640 1 -- 172.21.15.8:0/2041100439 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc0d8dc0 con 0x7ff1ec0051d0 2024-03-23T23:50:31.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:30.996+0000 7ff203e00640 1 -- 172.21.15.8:0/2041100439 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ec00c0a0 con 0x7ff1ec003a40 2024-03-23T23:50:31.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:30.996+0000 7ff20a400640 1 --2- 172.21.15.8:0/2041100439 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1ec0051d0 0x7ff1ec00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:31.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.000+0000 7ff209000640 1 --2- 172.21.15.8:0/2041100439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1ec004810 0x7ff1ec004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:31.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.000+0000 7ff20a400640 1 -- 172.21.15.8:0/2041100439 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1ec003a40 msgr2=0x7ff1ec003e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:50:31.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.000+0000 7ff20a400640 1 --2- 172.21.15.8:0/2041100439 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1ec003a40 0x7ff1ec003e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:31.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.000+0000 7ff20a400640 1 -- 172.21.15.8:0/2041100439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1ec004810 msgr2=0x7ff1ec004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:50:31.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.000+0000 7ff20a400640 1 --2- 172.21.15.8:0/2041100439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1ec004810 0x7ff1ec004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:31.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.000+0000 7ff20a400640 1 -- 172.21.15.8:0/2041100439 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ec003530 con 0x7ff1ec0051d0 2024-03-23T23:50:31.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.016+0000 7ff20a400640 1 --2- 172.21.15.8:0/2041100439 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1ec0051d0 0x7ff1ec00b9d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff20404f930 tx=0x7ff204087180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97c1ff48a3b88d50 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:31.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.016+0000 7ff203e00640 1 -- 172.21.15.8:0/2041100439 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20413d070 con 0x7ff1ec0051d0 2024-03-23T23:50:31.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.016+0000 7ff203e00640 1 -- 172.21.15.8:0/2041100439 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff204138600 con 0x7ff1ec0051d0 2024-03-23T23:50:31.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.032+0000 7ff20c400640 1 -- 172.21.15.8:0/2041100439 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1ec0051d0 msgr2=0x7ff1ec00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:31.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.032+0000 7ff20c400640 1 --2- 172.21.15.8:0/2041100439 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1ec0051d0 0x7ff1ec00b9d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff20404f930 tx=0x7ff204087180 comp rx=0 tx=0).stop 2024-03-23T23:50:31.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.040+0000 7ff203e00640 1 -- 172.21.15.8:0/2041100439 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff204062ba0 con 0x7ff1ec0051d0 2024-03-23T23:50:31.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.040+0000 7ff20a400640 1 -- 172.21.15.8:0/2041100439 reap_dead start 2024-03-23T23:50:31.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.040+0000 7ff20c400640 1 -- 172.21.15.8:0/2041100439 shutdown_connections 2024-03-23T23:50:31.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.040+0000 7ff20c400640 1 -- 172.21.15.8:0/2041100439 >> 172.21.15.8:0/2041100439 conn(0x7ff1fc005f20 msgr2=0x7ff1fc006330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:50:31.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.040+0000 7ff20c400640 1 -- 172.21.15.8:0/2041100439 shutdown_connections 2024-03-23T23:50:31.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.040+0000 7ff20c400640 1 -- 172.21.15.8:0/2041100439 wait complete. 2024-03-23T23:50:31.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.040+0000 7ff20c400640 1 Processor -- start 2024-03-23T23:50:31.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.040+0000 7ff20c400640 1 -- start start 2024-03-23T23:50:31.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.044+0000 7ff20c400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1fc042f00 0x7ff1fc0d7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:31.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.044+0000 7ff20c400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1fc0432e0 0x7ff1fc0e8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:31.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.044+0000 7ff20c400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1fc044450 0x7ff1fc0d0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:31.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.044+0000 7ff20c400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc007160 con 0x7ff1fc042f00 2024-03-23T23:50:31.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.044+0000 7ff20c400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc02e190 con 0x7ff1fc0432e0 2024-03-23T23:50:31.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.044+0000 7ff20c400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc0072e0 con 0x7ff1fc044450 2024-03-23T23:50:31.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.044+0000 7ff209a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1fc042f00 0x7ff1fc0d7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:31.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.044+0000 7ff209a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1fc042f00 0x7ff1fc0d7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51396/0 (socket says 172.21.15.8:51396) 2024-03-23T23:50:31.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.044+0000 7ff209a00640 1 -- 172.21.15.8:0/1092938041 learned_addr learned my addr 172.21.15.8:0/1092938041 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:50:31.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.048+0000 7ff20a400640 1 --2- 172.21.15.8:0/1092938041 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1fc044450 0x7ff1fc0d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:31.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.048+0000 7ff209a00640 1 -- 172.21.15.8:0/1092938041 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1fc044450 msgr2=0x7ff1fc0d0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:31.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.048+0000 7ff209a00640 1 --2- 172.21.15.8:0/1092938041 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1fc044450 0x7ff1fc0d0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:31.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.048+0000 7ff209000640 1 --2- 172.21.15.8:0/1092938041 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1fc0432e0 0x7ff1fc0e8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:31.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.048+0000 7ff209a00640 1 -- 172.21.15.8:0/1092938041 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1fc0432e0 msgr2=0x7ff1fc0e8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:31.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.048+0000 7ff209a00640 1 --2- 172.21.15.8:0/1092938041 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1fc0432e0 0x7ff1fc0e8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:31.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.048+0000 7ff209a00640 1 -- 172.21.15.8:0/1092938041 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1fc043a90 con 0x7ff1fc042f00 2024-03-23T23:50:31.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.048+0000 7ff209000640 1 --2- 172.21.15.8:0/1092938041 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1fc0432e0 0x7ff1fc0e8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:50:31.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.048+0000 7ff209a00640 1 --2- 172.21.15.8:0/1092938041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1fc042f00 0x7ff1fc0d7480 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000e920 tx=0x7ff1f000ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:31.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.048+0000 7ff201600640 1 -- 172.21.15.8:0/1092938041 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0017070 con 0x7ff1fc042f00 2024-03-23T23:50:31.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.048+0000 7ff201600640 1 -- 172.21.15.8:0/1092938041 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f000c710 con 0x7ff1fc042f00 2024-03-23T23:50:31.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.048+0000 7ff201600640 1 -- 172.21.15.8:0/1092938041 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f000cb00 con 0x7ff1fc042f00 2024-03-23T23:50:31.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.060+0000 7ff20c400640 1 -- 172.21.15.8:0/1092938041 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1fc045190 con 0x7ff1fc042f00 2024-03-23T23:50:31.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.060+0000 7ff20c400640 1 -- 172.21.15.8:0/1092938041 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1fc0ea2e0 con 0x7ff1fc042f00 2024-03-23T23:50:31.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.060+0000 7ff20c400640 1 -- 172.21.15.8:0/1092938041 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1fc005300 con 0x7ff1fc042f00 2024-03-23T23:50:31.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.092+0000 7ff201600640 1 -- 172.21.15.8:0/1092938041 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff1f001a070 con 0x7ff1fc042f00 2024-03-23T23:50:31.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.096+0000 7ff201600640 1 --2- 172.21.15.8:0/1092938041 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff1e40676e0 0x7ff1e4069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:31.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.100+0000 7ff201600640 1 -- 172.21.15.8:0/1092938041 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7ff1f0054480 con 0x7ff1fc042f00 2024-03-23T23:50:31.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.112+0000 7ff209000640 1 --2- 172.21.15.8:0/1092938041 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff1e40676e0 0x7ff1e4069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:31.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.116+0000 7ff201600640 1 -- 172.21.15.8:0/1092938041 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7ff1fc043a90 con 0x7ff1fc042f00 2024-03-23T23:50:31.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:31.116+0000 7ff209000640 1 --2- 172.21.15.8:0/1092938041 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff1e40676e0 0x7ff1e4069ba0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8003790 tx=0x7ff1f8000f60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:32.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.056+0000 7ff20c400640 1 -- 172.21.15.8:0/1092938041 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff1fc04b5f0 con 0x7ff1fc042f00 2024-03-23T23:50:32.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.064+0000 7ff201600640 1 -- 172.21.15.8:0/1092938041 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1561 (secure 0 0 0) 0x7ff1f0056ae0 con 0x7ff1fc042f00 2024-03-23T23:50:32.072 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":54,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:50:32.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.088+0000 7ff20c400640 1 -- 172.21.15.8:0/1092938041 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff1e40676e0 msgr2=0x7ff1e4069ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:32.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.088+0000 7ff20c400640 1 --2- 172.21.15.8:0/1092938041 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff1e40676e0 0x7ff1e4069ba0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8003790 tx=0x7ff1f8000f60 comp rx=0 tx=0).stop 2024-03-23T23:50:32.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.088+0000 7ff20c400640 1 -- 172.21.15.8:0/1092938041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1fc042f00 msgr2=0x7ff1fc0d7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:32.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.088+0000 7ff20c400640 1 --2- 172.21.15.8:0/1092938041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1fc042f00 0x7ff1fc0d7480 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000e920 tx=0x7ff1f000ede0 comp rx=0 tx=0).stop 2024-03-23T23:50:32.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.092+0000 7ff20c400640 1 -- 172.21.15.8:0/1092938041 shutdown_connections 2024-03-23T23:50:32.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.092+0000 7ff20c400640 1 --2- 172.21.15.8:0/1092938041 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff1e40676e0 0x7ff1e4069ba0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:32.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.092+0000 7ff20c400640 1 --2- 172.21.15.8:0/1092938041 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1fc044450 0x7ff1fc0d0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:32.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.092+0000 7ff20c400640 1 --2- 172.21.15.8:0/1092938041 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1fc0432e0 0x7ff1fc0e8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:32.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.092+0000 7ff20c400640 1 --2- 172.21.15.8:0/1092938041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1fc042f00 0x7ff1fc0d7480 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:32.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.092+0000 7ff20c400640 1 -- 172.21.15.8:0/1092938041 >> 172.21.15.8:0/1092938041 conn(0x7ff1fc005f20 msgr2=0x7ff1fc0edaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:50:32.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.096+0000 7ff20c400640 1 -- 172.21.15.8:0/1092938041 shutdown_connections 2024-03-23T23:50:32.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.096+0000 7ff20c400640 1 -- 172.21.15.8:0/1092938041 wait complete. 2024-03-23T23:50:32.173 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T23:50:32.174 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-03-23T23:50:32.174 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T23:50:32.174 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:50:32.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.456+0000 7f77a9a00640 1 Processor -- start 2024-03-23T23:50:32.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.460+0000 7f77a9a00640 1 -- start start 2024-03-23T23:50:32.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.472+0000 7f77a9a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f779c008790 0x7f779c008bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:32.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.472+0000 7f77a9a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f779c0d4da0 con 0x7f779c0d49c0 2024-03-23T23:50:32.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.472+0000 7f77a9a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f779c0da720 con 0x7f779c0d8580 2024-03-23T23:50:32.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.472+0000 7f77a9a00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f779c0479d0 con 0x7f779c008790 2024-03-23T23:50:32.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.472+0000 7f77a9000640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f779c0d8580 0x7f779c0d8a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:42968/0 (socket says 172.21.15.8:42968) 2024-03-23T23:50:32.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.472+0000 7f77a9000640 1 -- 172.21.15.8:0/651811744 learned_addr learned my addr 172.21.15.8:0/651811744 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:50:32.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.476+0000 7f77a3400640 1 --2- 172.21.15.8:0/651811744 >> v2:172.21.15.8:3300/0 conn(0x7f779c008790 0x7f779c008bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:32.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.476+0000 7f77a3400640 1 -- 172.21.15.8:0/651811744 >> v1:172.21.15.196:6789/0 conn(0x7f779c0d8580 legacy=0x7f779c0d8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:50:32.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.476+0000 7f77a3400640 1 -- 172.21.15.8:0/651811744 >> v1:172.21.15.8:6789/0 conn(0x7f779c0d49c0 legacy=0x7f779c0472c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:50:32.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.476+0000 7f77a3400640 1 -- 172.21.15.8:0/651811744 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779c0da9c0 con 0x7f779c008790 2024-03-23T23:50:32.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.484+0000 7f77a3400640 1 --2- 172.21.15.8:0/651811744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f779c008790 0x7f779c008bf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f77900097c0 tx=0x7f779001c1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ff179eced4a135 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:32.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.488+0000 7f77a2a00640 1 -- 172.21.15.8:0/651811744 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77900b0070 con 0x7f779c008790 2024-03-23T23:50:32.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.488+0000 7f77a2a00640 1 -- 172.21.15.8:0/651811744 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77900ab600 con 0x7f779c008790 2024-03-23T23:50:32.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.488+0000 7f77a2a00640 1 -- 172.21.15.8:0/651811744 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77900ab9d0 con 0x7f779c008790 2024-03-23T23:50:32.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.492+0000 7f77a9a00640 1 -- 172.21.15.8:0/651811744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f779c008790 msgr2=0x7f779c008bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:32.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.492+0000 7f77a9a00640 1 --2- 172.21.15.8:0/651811744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f779c008790 0x7f779c008bf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f77900097c0 tx=0x7f779001c1b0 comp rx=0 tx=0).stop 2024-03-23T23:50:32.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.492+0000 7f77a9a00640 1 -- 172.21.15.8:0/651811744 shutdown_connections 2024-03-23T23:50:32.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.492+0000 7f77a9a00640 1 --2- 172.21.15.8:0/651811744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f779c008790 0x7f779c008bf0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:32.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.492+0000 7f77a9a00640 1 -- 172.21.15.8:0/651811744 >> 172.21.15.8:0/651811744 conn(0x7f779c007c70 msgr2=0x7f779c008080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:50:32.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.492+0000 7f77a9a00640 1 -- 172.21.15.8:0/651811744 shutdown_connections 2024-03-23T23:50:32.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.492+0000 7f77a9a00640 1 -- 172.21.15.8:0/651811744 wait complete. 2024-03-23T23:50:32.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.504+0000 7f77a9a00640 1 Processor -- start 2024-03-23T23:50:32.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.512+0000 7f77a9a00640 1 -- start start 2024-03-23T23:50:32.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.516+0000 7f77a9a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f779c008790 0x7f779c0d7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:32.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.516+0000 7f77a9a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f779c0d49c0 0x7f779c0d0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:32.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.516+0000 7f77a9a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f779c0d8580 0x7f779c179030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:32.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.516+0000 7f77a9a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c047db0 con 0x7f779c008790 2024-03-23T23:50:32.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.516+0000 7f77a9a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c047c30 con 0x7f779c0d49c0 2024-03-23T23:50:32.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.516+0000 7f77a9a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f779c02f230 con 0x7f779c0d8580 2024-03-23T23:50:32.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.520+0000 7f77a9000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f779c0d8580 0x7f779c179030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:32.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.524+0000 7f77a3400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f779c0d49c0 0x7f779c0d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:32.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.524+0000 7f77a3400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f779c0d49c0 0x7f779c0d0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:36678/0 (socket says 172.21.15.8:36678) 2024-03-23T23:50:32.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.524+0000 7f77a3400640 1 -- 172.21.15.8:0/2747862727 learned_addr learned my addr 172.21.15.8:0/2747862727 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:50:32.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.524+0000 7f77a3400640 1 -- 172.21.15.8:0/2747862727 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f779c0d8580 msgr2=0x7f779c179030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:32.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.524+0000 7f77a3400640 1 --2- 172.21.15.8:0/2747862727 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f779c0d8580 0x7f779c179030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:32.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.524+0000 7f77a3400640 1 -- 172.21.15.8:0/2747862727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f779c008790 msgr2=0x7f779c0d7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:32.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.524+0000 7f77a3400640 1 --2- 172.21.15.8:0/2747862727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f779c008790 0x7f779c0d7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:32.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.524+0000 7f77a3400640 1 -- 172.21.15.8:0/2747862727 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779c0d7960 con 0x7f779c0d49c0 2024-03-23T23:50:32.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.524+0000 7f77a3400640 1 --2- 172.21.15.8:0/2747862727 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f779c0d49c0 0x7f779c0d0020 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f77900ae040 tx=0x7f779001a9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:32.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.532+0000 7f7797e00640 1 -- 172.21.15.8:0/2747862727 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77900b0050 con 0x7f779c0d49c0 2024-03-23T23:50:32.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.532+0000 7f7797e00640 1 -- 172.21.15.8:0/2747862727 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77900bc070 con 0x7f779c0d49c0 2024-03-23T23:50:32.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.532+0000 7f7797e00640 1 -- 172.21.15.8:0/2747862727 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77900b5a70 con 0x7f779c0d49c0 2024-03-23T23:50:32.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.532+0000 7f77a9a00640 1 -- 172.21.15.8:0/2747862727 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f779c0d5f40 con 0x7f779c0d49c0 2024-03-23T23:50:32.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.532+0000 7f77a9a00640 1 -- 172.21.15.8:0/2747862727 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f779c0d6500 con 0x7f779c0d49c0 2024-03-23T23:50:32.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.536+0000 7f77a9a00640 1 --2- 172.21.15.8:0/2747862727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f779c179570 0x7f779c003170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:32.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.536+0000 7f77a9a00640 1 -- 172.21.15.8:0/2747862727 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c0d4f80 con 0x7f779c179570 2024-03-23T23:50:32.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.536+0000 7f77a3e00640 1 --2- 172.21.15.8:0/2747862727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f779c179570 0x7f779c003170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:32.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.536+0000 7f77a3e00640 1 -- 172.21.15.8:0/2747862727 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f779c0056f0 con 0x7f779c179570 2024-03-23T23:50:32.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.536+0000 7f77a3e00640 1 --2- 172.21.15.8:0/2747862727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f779c179570 0x7f779c003170 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f779800c340 tx=0x7f779800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:32.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.540+0000 7f7797e00640 1 -- 172.21.15.8:0/2747862727 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7798007020 con 0x7f779c179570 2024-03-23T23:50:32.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.540+0000 7f7797e00640 1 -- 172.21.15.8:0/2747862727 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f77900ab4c0 con 0x7f779c0d49c0 2024-03-23T23:50:32.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.544+0000 7f7797e00640 1 --2- 172.21.15.8:0/2747862727 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f77840675b0 0x7f7784069a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:32.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.552+0000 7f7797e00640 1 -- 172.21.15.8:0/2747862727 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f77901203d0 con 0x7f779c0d49c0 2024-03-23T23:50:32.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.556+0000 7f77a9000640 1 --2- 172.21.15.8:0/2747862727 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f77840675b0 0x7f7784069a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:32.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.564+0000 7f77a9000640 1 --2- 172.21.15.8:0/2747862727 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f77840675b0 0x7f7784069a70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f77a406a4e0 tx=0x7f77a406b0e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:32.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.564+0000 7f7797e00640 1 -- 172.21.15.8:0/2747862727 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f77980071c0 con 0x7f779c179570 2024-03-23T23:50:32.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.564+0000 7f7797e00640 1 -- 172.21.15.8:0/2747862727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f779c179570 msgr2=0x7f779c003170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:32.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.564+0000 7f7797e00640 1 --2- 172.21.15.8:0/2747862727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f779c179570 0x7f779c003170 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f779800c340 tx=0x7f779800c800 comp rx=0 tx=0).stop 2024-03-23T23:50:32.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.564+0000 7f7797e00640 1 -- 172.21.15.8:0/2747862727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f779c179570 msgr2=0x7f779c003170 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:50:32.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.564+0000 7f7797e00640 1 --2- 172.21.15.8:0/2747862727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f779c179570 0x7f779c003170 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:32.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.588+0000 7f77a9a00640 1 --2- 172.21.15.8:0/2747862727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f779c180b70 0x7f779c180f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:32.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.588+0000 7f77a9a00640 1 -- 172.21.15.8:0/2747862727 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c0092d0 con 0x7f779c180b70 2024-03-23T23:50:32.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.604+0000 7f77a3e00640 1 --2- 172.21.15.8:0/2747862727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f779c180b70 0x7f779c180f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:32.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.604+0000 7f77a3e00640 1 -- 172.21.15.8:0/2747862727 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f779c00be60 con 0x7f779c180b70 2024-03-23T23:50:32.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.608+0000 7f77a3e00640 1 --2- 172.21.15.8:0/2747862727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f779c180b70 0x7f779c180f80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7798013000 tx=0x7f7798001030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:32.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.616+0000 7f7797e00640 1 -- 172.21.15.8:0/2747862727 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7798019880 con 0x7f779c180b70 2024-03-23T23:50:32.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.616+0000 7f7797e00640 1 -- 172.21.15.8:0/2747862727 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5185 (secure 0 0 0) 0x7f7798019a20 con 0x7f779c180b70 2024-03-23T23:50:32.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.616+0000 7f7797e00640 1 -- 172.21.15.8:0/2747862727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f779c180b70 msgr2=0x7f779c180f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:32.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.616+0000 7f7797e00640 1 --2- 172.21.15.8:0/2747862727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f779c180b70 0x7f779c180f80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7798013000 tx=0x7f7798001030 comp rx=0 tx=0).stop 2024-03-23T23:50:32.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.616+0000 7f7797e00640 1 -- 172.21.15.8:0/2747862727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f779c180b70 msgr2=0x7f779c180f80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:50:32.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.616+0000 7f7797e00640 1 --2- 172.21.15.8:0/2747862727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f779c180b70 0x7f779c180f80 secure :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7798013000 tx=0x7f7798001030 comp rx=0 tx=0).stop 2024-03-23T23:50:32.634 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:50:32.634 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:50:32.634 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:50:32.635 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:50:32.635 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 54, 2024-03-23T23:50:32.635 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:50:32.635 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:50:32.635 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:50:32.635 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:50:32.636 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:32.636 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 17, 2024-03-23T23:50:32.636 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:50:32.636 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:50:32.636 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:50:32.636 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:50:32.636 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:50:32.637 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:50:32.637 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:50:32.637 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:50:32.637 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:50:32.637 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:50:32.638 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:50:32.638 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:50:32.638 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:50:32.638 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:50:32.638 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:32.638 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:50:32.638 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:50:32.638 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:50:32.639 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:50:32.639 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:50:32.639 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:50:32.639 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:50:32.639 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:50:32.639 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:50:32.639 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:50:32.640 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:50:32.640 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:50:32.640 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:50:32.640 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:32.640 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:32.640 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:50:32.641 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:50:32.641 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:50:32.641 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:50:32.641 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:50:32.641 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:50:32.641 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:50:32.642 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:50:32.642 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:50:32.642 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:50:32.642 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:50:32.642 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:50:32.642 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:50:32.642 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:50:32.642 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:50:32.642 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:50:32.643 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:50:32.643 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:50:32.643 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:50:32.643 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:50:32.643 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:50:32.643 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:50:32.643 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:50:32.643 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:50:32.643 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:50:32.643 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:50:32.643 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:50:32.643 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:50:32.643 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:32.643 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:50:32.643 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:32.644 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:50:32.644 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:32.644 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:50:32.644 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:50:32.644 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:50:32.644 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:50:32.644 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:32.644 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:50:32.644 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:50:32.644 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:32.645 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:32.645 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:32.645 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:50:32.645 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:50:32.645 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:32.645 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:32.645 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:32.645 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:32.645 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:50:32.645 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:50:32.645 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:50:32.645 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:50:32.645 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:50:32.645 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:32.645 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:32.646 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:50:32.646 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:50:32.646 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:50:32.646 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:50:32.646 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:32.646 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:50:32.646 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:50:32.646 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:32.646 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:32.646 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:32.646 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:50:32.646 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:50:32.646 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:32.647 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:32.647 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:32.647 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:32.647 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:50:32.647 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:50:32.647 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:50:32.647 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:50:32.647 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:50:32.647 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:32.647 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:32.647 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:50:32.647 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:50:32.647 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:50:32.647 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:50:32.648 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:32.648 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:50:32.648 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:50:32.648 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:32.648 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:32.648 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:32.648 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:50:32.648 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:50:32.649 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:32.649 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:32.649 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:32.649 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:32.649 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:50:32.649 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:50:32.649 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:50:32.649 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:50:32.649 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:50:32.649 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:32.649 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:32.650 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:32.650 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:50:32.650 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:50:32.650 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:32.650 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:32.650 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:32.650 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:50:32.650 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:32.650 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:32.651 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:50:32.651 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:32.651 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:32.651 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:32.651 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:50:32.651 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:32.651 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:32.651 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:50:32.651 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:32.652 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:32.652 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:32.652 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5 2024-03-23T23:50:32.652 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:32.652 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:32.652 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:50:32.652 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:32.652 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:50:32.652 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:32.652 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:50:32.652 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:32.652 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:32.653 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:32.653 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:32.653 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:50:32.653 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:32.653 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:32.653 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:50:32.653 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:32.653 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:32.653 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:32.653 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:50:32.653 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:32.653 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:32.653 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:32.653 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:50:32.654 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:50:32.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.636+0000 7f77a9a00640 1 -- 172.21.15.8:0/2747862727 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f77840675b0 msgr2=0x7f7784069a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:32.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.636+0000 7f77a9a00640 1 --2- 172.21.15.8:0/2747862727 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f77840675b0 0x7f7784069a70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f77a406a4e0 tx=0x7f77a406b0e0 comp rx=0 tx=0).stop 2024-03-23T23:50:32.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.636+0000 7f77a9000640 1 -- 172.21.15.8:0/2747862727 reap_dead start 2024-03-23T23:50:32.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.640+0000 7f77a9a00640 1 -- 172.21.15.8:0/2747862727 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f779c0d49c0 msgr2=0x7f779c0d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:32.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.640+0000 7f77a9a00640 1 --2- 172.21.15.8:0/2747862727 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f779c0d49c0 0x7f779c0d0020 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f77900ae040 tx=0x7f779001a9f0 comp rx=0 tx=0).stop 2024-03-23T23:50:32.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.640+0000 7f77a9a00640 1 -- 172.21.15.8:0/2747862727 shutdown_connections 2024-03-23T23:50:32.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.640+0000 7f77a9a00640 1 --2- 172.21.15.8:0/2747862727 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f779c0d49c0 0x7f779c0d0020 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f77900ae040 tx=0x7f779001a9f0 comp rx=0 tx=0).stop 2024-03-23T23:50:32.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.640+0000 7f77a9a00640 1 -- 172.21.15.8:0/2747862727 >> 172.21.15.8:0/2747862727 conn(0x7f779c007c70 msgr2=0x7f779c0d2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:50:32.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.656+0000 7f77a9a00640 1 -- 172.21.15.8:0/2747862727 shutdown_connections 2024-03-23T23:50:32.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:32.660+0000 7f77a9a00640 1 -- 172.21.15.8:0/2747862727 wait complete. 2024-03-23T23:50:32.770 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:50:32.770 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T23:50:32.770 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:50:33.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.124+0000 7fd248800640 1 Processor -- start 2024-03-23T23:50:33.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.124+0000 7fd248800640 1 -- start start 2024-03-23T23:50:33.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.124+0000 7fd248800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd240154df0 0x7fd240151800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:33.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.124+0000 7fd248800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd24006e260 0x7fd24006e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:33.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.124+0000 7fd248800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd240155360 con 0x7fd24014edf0 2024-03-23T23:50:33.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.124+0000 7fd248800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd24006ddd0 con 0x7fd240154df0 2024-03-23T23:50:33.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.124+0000 7fd248800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd240155640 con 0x7fd24006e260 2024-03-23T23:50:33.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.124+0000 7fd245400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd240154df0 0x7fd240151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:33.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.124+0000 7fd245400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd240154df0 0x7fd240151800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:46788/0 (socket says 172.21.15.8:46788) 2024-03-23T23:50:33.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.124+0000 7fd245400640 1 -- 172.21.15.8:0/4078233380 learned_addr learned my addr 172.21.15.8:0/4078233380 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:50:33.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.128+0000 7fd246800640 1 --2- 172.21.15.8:0/4078233380 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd24006e260 0x7fd24006e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:33.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.128+0000 7fd246800640 1 -- 172.21.15.8:0/4078233380 >> v2:172.21.15.196:3300/0 conn(0x7fd240154df0 msgr2=0x7fd240151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:50:33.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.128+0000 7fd246800640 1 --2- 172.21.15.8:0/4078233380 >> v2:172.21.15.196:3300/0 conn(0x7fd240154df0 0x7fd240151800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:33.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.128+0000 7fd246800640 1 -- 172.21.15.8:0/4078233380 >> v1:172.21.15.8:6789/0 conn(0x7fd24014edf0 legacy=0x7fd2400c3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:33.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.128+0000 7fd246800640 1 -- 172.21.15.8:0/4078233380 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd240155920 con 0x7fd24006e260 2024-03-23T23:50:33.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.136+0000 7fd246800640 1 --2- 172.21.15.8:0/4078233380 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd24006e260 0x7fd24006e6f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd23c009d90 tx=0x7fd23c01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55cba7db83c5368d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:33.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.136+0000 7fd244a00640 1 -- 172.21.15.8:0/4078233380 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c0b2070 con 0x7fd24006e260 2024-03-23T23:50:33.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.136+0000 7fd244a00640 1 -- 172.21.15.8:0/4078233380 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23c0a58e0 con 0x7fd24006e260 2024-03-23T23:50:33.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.136+0000 7fd244a00640 1 -- 172.21.15.8:0/4078233380 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c0b2070 con 0x7fd24006e260 2024-03-23T23:50:33.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.136+0000 7fd248800640 1 -- 172.21.15.8:0/4078233380 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd24006e260 msgr2=0x7fd24006e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:33.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.136+0000 7fd248800640 1 --2- 172.21.15.8:0/4078233380 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd24006e260 0x7fd24006e6f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd23c009d90 tx=0x7fd23c01c970 comp rx=0 tx=0).stop 2024-03-23T23:50:33.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.140+0000 7fd248800640 1 -- 172.21.15.8:0/4078233380 shutdown_connections 2024-03-23T23:50:33.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.140+0000 7fd248800640 1 --2- 172.21.15.8:0/4078233380 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd24006e260 0x7fd24006e6f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:33.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.140+0000 7fd248800640 1 --2- 172.21.15.8:0/4078233380 >> v2:172.21.15.196:3300/0 conn(0x7fd240154df0 0x7fd240151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:33.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.140+0000 7fd248800640 1 -- 172.21.15.8:0/4078233380 >> 172.21.15.8:0/4078233380 conn(0x7fd24006b170 msgr2=0x7fd24006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:50:33.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.140+0000 7fd248800640 1 -- 172.21.15.8:0/4078233380 shutdown_connections 2024-03-23T23:50:33.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.140+0000 7fd248800640 1 -- 172.21.15.8:0/4078233380 wait complete. 2024-03-23T23:50:33.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.144+0000 7fd248800640 1 Processor -- start 2024-03-23T23:50:33.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.144+0000 7fd248800640 1 -- start start 2024-03-23T23:50:33.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.148+0000 7fd248800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd24006e260 0x7fd24014ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:33.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.148+0000 7fd248800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd24014edf0 0x7fd2400aa370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:33.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.148+0000 7fd248800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd240154df0 0x7fd2400aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:33.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.148+0000 7fd248800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2400c45d0 con 0x7fd240154df0 2024-03-23T23:50:33.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.148+0000 7fd248800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd240155c00 con 0x7fd24014edf0 2024-03-23T23:50:33.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.148+0000 7fd248800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2400c4750 con 0x7fd24006e260 2024-03-23T23:50:33.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.148+0000 7fd246800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd240154df0 0x7fd2400aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:33.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.148+0000 7fd246800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd240154df0 0x7fd2400aa8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45066/0 (socket says 172.21.15.8:45066) 2024-03-23T23:50:33.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.148+0000 7fd246800640 1 -- 172.21.15.8:0/2274224033 learned_addr learned my addr 172.21.15.8:0/2274224033 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:50:33.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.148+0000 7fd245400640 1 --2- 172.21.15.8:0/2274224033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd24014edf0 0x7fd2400aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:33.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.148+0000 7fd245e00640 1 --2- 172.21.15.8:0/2274224033 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd24006e260 0x7fd24014ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:33.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.148+0000 7fd246800640 1 -- 172.21.15.8:0/2274224033 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd24006e260 msgr2=0x7fd24014ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:33.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.148+0000 7fd246800640 1 --2- 172.21.15.8:0/2274224033 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd24006e260 0x7fd24014ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:33.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.148+0000 7fd246800640 1 -- 172.21.15.8:0/2274224033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd24014edf0 msgr2=0x7fd2400aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:33.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.152+0000 7fd246800640 1 --2- 172.21.15.8:0/2274224033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd24014edf0 0x7fd2400aa370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:33.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.152+0000 7fd246800640 1 -- 172.21.15.8:0/2274224033 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd240150470 con 0x7fd240154df0 2024-03-23T23:50:33.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.152+0000 7fd245e00640 1 --2- 172.21.15.8:0/2274224033 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd24006e260 0x7fd24014ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:50:33.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.152+0000 7fd246800640 1 --2- 172.21.15.8:0/2274224033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd240154df0 0x7fd2400aa8b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd23c01b020 tx=0x7fd23c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:33.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.152+0000 7fd245400640 1 --2- 172.21.15.8:0/2274224033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd24014edf0 0x7fd2400aa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:50:33.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.152+0000 7fd23a000640 1 -- 172.21.15.8:0/2274224033 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c0b2050 con 0x7fd240154df0 2024-03-23T23:50:33.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.152+0000 7fd23a000640 1 -- 172.21.15.8:0/2274224033 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23c0be070 con 0x7fd240154df0 2024-03-23T23:50:33.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.152+0000 7fd23a000640 1 -- 172.21.15.8:0/2274224033 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c004040 con 0x7fd240154df0 2024-03-23T23:50:33.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.156+0000 7fd248800640 1 -- 172.21.15.8:0/2274224033 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2401508d0 con 0x7fd240154df0 2024-03-23T23:50:33.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.156+0000 7fd248800640 1 -- 172.21.15.8:0/2274224033 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2400c2490 con 0x7fd240154df0 2024-03-23T23:50:33.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.164+0000 7fd23a000640 1 -- 172.21.15.8:0/2274224033 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd23c0041e0 con 0x7fd240154df0 2024-03-23T23:50:33.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.164+0000 7fd248800640 1 --2- 172.21.15.8:0/2274224033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2400c2060 0x7fd2400c2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:33.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.164+0000 7fd248800640 1 -- 172.21.15.8:0/2274224033 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd240068270 con 0x7fd2400c2060 2024-03-23T23:50:33.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.168+0000 7fd23a000640 1 --2- 172.21.15.8:0/2274224033 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd2200676b0 0x7fd220069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:33.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.168+0000 7fd245400640 1 --2- 172.21.15.8:0/2274224033 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd2200676b0 0x7fd220069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:33.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.172+0000 7fd245e00640 1 --2- 172.21.15.8:0/2274224033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2400c2060 0x7fd2400c2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:33.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.172+0000 7fd245e00640 1 -- 172.21.15.8:0/2274224033 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd24015bf60 con 0x7fd2400c2060 2024-03-23T23:50:33.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.172+0000 7fd245e00640 1 --2- 172.21.15.8:0/2274224033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2400c2060 0x7fd2400c2690 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd23400e4e0 tx=0x7fd23400e9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:33.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.172+0000 7fd23a000640 1 -- 172.21.15.8:0/2274224033 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2340052e0 con 0x7fd2400c2060 2024-03-23T23:50:33.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.172+0000 7fd23a000640 1 -- 172.21.15.8:0/2274224033 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fd2340052e0 con 0x7fd2400c2060 2024-03-23T23:50:33.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.172+0000 7fd23a000640 1 -- 172.21.15.8:0/2274224033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2400c2060 msgr2=0x7fd2400c2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:33.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.172+0000 7fd23a000640 1 --2- 172.21.15.8:0/2274224033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2400c2060 0x7fd2400c2690 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd23400e4e0 tx=0x7fd23400e9a0 comp rx=0 tx=0).stop 2024-03-23T23:50:33.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.172+0000 7fd23a000640 1 -- 172.21.15.8:0/2274224033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2400c2060 msgr2=0x7fd2400c2690 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:50:33.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.172+0000 7fd23a000640 1 --2- 172.21.15.8:0/2274224033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2400c2060 0x7fd2400c2690 secure :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd23400e4e0 tx=0x7fd23400e9a0 comp rx=0 tx=0).stop 2024-03-23T23:50:33.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.172+0000 7fd23a000640 1 -- 172.21.15.8:0/2274224033 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fd23c0ee9d0 con 0x7fd240154df0 2024-03-23T23:50:33.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.176+0000 7fd245400640 1 --2- 172.21.15.8:0/2274224033 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd2200676b0 0x7fd220069b70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd2401ea220 tx=0x7fd22c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:33.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.224+0000 7fd248800640 1 --2- 172.21.15.8:0/2274224033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd240151d30 0x7fd240152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:33.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.224+0000 7fd248800640 1 -- 172.21.15.8:0/2274224033 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd240152680 con 0x7fd240151d30 2024-03-23T23:50:33.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.224+0000 7fd245e00640 1 --2- 172.21.15.8:0/2274224033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd240151d30 0x7fd240152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:33.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.232+0000 7fd245e00640 1 -- 172.21.15.8:0/2274224033 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd24014d360 con 0x7fd240151d30 2024-03-23T23:50:33.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.236+0000 7fd245e00640 1 --2- 172.21.15.8:0/2274224033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd240151d30 0x7fd240152140 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd23400e4e0 tx=0x7fd234000ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:33.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.236+0000 7fd23a000640 1 -- 172.21.15.8:0/2274224033 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd234007230 con 0x7fd240151d30 2024-03-23T23:50:33.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.236+0000 7fd23a000640 1 -- 172.21.15.8:0/2274224033 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4530 (secure 0 0 0) 0x7fd2340073d0 con 0x7fd240151d30 2024-03-23T23:50:33.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.236+0000 7fd23a000640 1 -- 172.21.15.8:0/2274224033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd240151d30 msgr2=0x7fd240152140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:33.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.236+0000 7fd23a000640 1 --2- 172.21.15.8:0/2274224033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd240151d30 0x7fd240152140 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd23400e4e0 tx=0x7fd234000ee0 comp rx=0 tx=0).stop 2024-03-23T23:50:33.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.236+0000 7fd23a000640 1 -- 172.21.15.8:0/2274224033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd240151d30 msgr2=0x7fd240152140 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:50:33.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.236+0000 7fd23a000640 1 --2- 172.21.15.8:0/2274224033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd240151d30 0x7fd240152140 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd23400e4e0 tx=0x7fd234000ee0 comp rx=0 tx=0).stop 2024-03-23T23:50:33.241 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:50:33.242 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:50:33.242 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:50:33.242 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:50:33.242 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 54, 2024-03-23T23:50:33.242 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:50:33.242 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:50:33.242 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:50:33.242 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:50:33.242 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:33.242 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 18, 2024-03-23T23:50:33.242 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:50:33.243 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:50:33.243 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:50:33.243 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:50:33.243 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:50:33.243 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:50:33.243 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:50:33.243 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:50:33.243 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:50:33.243 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:50:33.243 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:50:33.244 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:50:33.244 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:50:33.244 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:50:33.244 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:33.244 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:50:33.244 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:50:33.244 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:50:33.244 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:50:33.244 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:50:33.244 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:50:33.244 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:50:33.244 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:50:33.244 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:50:33.244 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:50:33.245 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:50:33.245 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:50:33.245 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:50:33.245 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:33.245 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:33.245 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:50:33.245 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:50:33.245 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:50:33.245 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:50:33.245 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:50:33.245 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:50:33.245 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:50:33.245 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:50:33.246 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:50:33.246 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:50:33.246 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:50:33.246 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:50:33.246 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:50:33.246 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:50:33.246 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:50:33.246 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:50:33.246 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:50:33.246 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:50:33.246 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:50:33.246 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:50:33.246 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:50:33.247 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:50:33.247 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:50:33.247 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:50:33.247 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:50:33.247 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:50:33.247 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:50:33.247 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:50:33.247 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:33.247 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:50:33.247 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:33.247 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:50:33.247 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:33.247 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:50:33.247 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:50:33.248 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:50:33.248 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:50:33.248 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:33.248 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:50:33.248 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:50:33.248 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:33.248 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:33.248 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:33.248 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:50:33.248 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:50:33.248 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:33.248 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:33.248 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:33.248 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:33.249 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:50:33.249 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:50:33.249 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:50:33.249 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:50:33.249 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:50:33.249 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:33.249 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:33.249 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:50:33.249 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:50:33.249 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:50:33.249 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:50:33.249 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:33.249 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:50:33.250 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:50:33.250 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:33.250 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:33.250 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:33.250 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:50:33.250 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:50:33.250 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:33.250 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:33.250 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:33.250 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:33.250 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:50:33.250 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:50:33.251 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:50:33.251 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:50:33.251 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:50:33.251 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:33.251 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:33.251 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:50:33.251 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:50:33.251 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:50:33.251 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:50:33.251 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:33.251 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:50:33.251 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:50:33.251 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:33.251 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:33.252 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:33.252 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:50:33.252 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:50:33.252 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:33.252 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:33.252 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:33.252 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:33.252 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:50:33.252 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:50:33.253 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:50:33.253 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:50:33.253 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:50:33.253 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:33.253 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:33.253 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:33.253 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:50:33.253 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:50:33.253 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:33.253 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:33.253 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:33.253 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:50:33.253 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:33.254 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:33.254 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:50:33.254 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:33.254 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:33.254 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:33.254 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:50:33.254 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:33.254 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:33.254 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:33.254 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:50:33.254 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:50:33.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.240+0000 7fd248800640 1 -- 172.21.15.8:0/2274224033 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd2200676b0 msgr2=0x7fd220069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:33.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.240+0000 7fd248800640 1 --2- 172.21.15.8:0/2274224033 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd2200676b0 0x7fd220069b70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd2401ea220 tx=0x7fd22c008040 comp rx=0 tx=0).stop 2024-03-23T23:50:33.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.240+0000 7fd246800640 1 -- 172.21.15.8:0/2274224033 reap_dead start 2024-03-23T23:50:33.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.240+0000 7fd248800640 1 -- 172.21.15.8:0/2274224033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd240154df0 msgr2=0x7fd2400aa8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:33.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.240+0000 7fd248800640 1 --2- 172.21.15.8:0/2274224033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd240154df0 0x7fd2400aa8b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd23c01b020 tx=0x7fd23c019710 comp rx=0 tx=0).stop 2024-03-23T23:50:33.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.240+0000 7fd248800640 1 -- 172.21.15.8:0/2274224033 shutdown_connections 2024-03-23T23:50:33.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.244+0000 7fd248800640 1 --2- 172.21.15.8:0/2274224033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd240154df0 0x7fd2400aa8b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:33.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.244+0000 7fd248800640 1 -- 172.21.15.8:0/2274224033 >> 172.21.15.8:0/2274224033 conn(0x7fd24006b170 msgr2=0x7fd24014db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:50:33.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.244+0000 7fd248800640 1 -- 172.21.15.8:0/2274224033 shutdown_connections 2024-03-23T23:50:33.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.252+0000 7fd248800640 1 -- 172.21.15.8:0/2274224033 wait complete. 2024-03-23T23:50:33.293 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:50:33.293 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T23:50:33.293 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:50:33.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.640+0000 7f1ad6c00640 1 Processor -- start 2024-03-23T23:50:33.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.640+0000 7f1ad6c00640 1 -- start start 2024-03-23T23:50:33.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.644+0000 7f1ad6c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1ad00c2820 0x7f1ad00c2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:33.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.644+0000 7f1ad6c00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad006ccc0 con 0x7f1ad0151ba0 2024-03-23T23:50:33.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.644+0000 7f1ad6c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad006cfa0 con 0x7f1ad014ede0 2024-03-23T23:50:33.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.644+0000 7f1ad6c00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad00c3760 con 0x7f1ad00c2820 2024-03-23T23:50:33.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.644+0000 7f1ad6200640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f1ad0151ba0 0x7f1ad0151fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42768/0 (socket says 172.21.15.8:42768) 2024-03-23T23:50:33.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.644+0000 7f1ad6200640 1 -- 172.21.15.8:0/1067007835 learned_addr learned my addr 172.21.15.8:0/1067007835 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:50:33.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.652+0000 7f1acfe00640 1 -- 172.21.15.8:0/1067007835 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1286783242 0 0) 0x7f1ad006ccc0 con 0x7f1ad0151ba0 2024-03-23T23:50:33.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.652+0000 7f1acfe00640 1 -- 172.21.15.8:0/1067007835 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ab8003530 con 0x7f1ad0151ba0 2024-03-23T23:50:33.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.656+0000 7f1acfe00640 1 -- 172.21.15.8:0/1067007835 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 338606005 0 0) 0x7f1ab8003530 con 0x7f1ad0151ba0 2024-03-23T23:50:33.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.656+0000 7f1acfe00640 1 -- 172.21.15.8:0/1067007835 >> v2:172.21.15.8:3300/0 conn(0x7f1ad00c2820 msgr2=0x7f1ad00c2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:50:33.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.656+0000 7f1acfe00640 1 --2- 172.21.15.8:0/1067007835 >> v2:172.21.15.8:3300/0 conn(0x7f1ad00c2820 0x7f1ad00c2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:33.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.656+0000 7f1acfe00640 1 -- 172.21.15.8:0/1067007835 >> v1:172.21.15.196:6789/0 conn(0x7f1ad014ede0 legacy=0x7f1ad0072b30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-23T23:50:33.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.656+0000 7f1acfe00640 1 -- 172.21.15.8:0/1067007835 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad006d280 con 0x7f1ad0151ba0 2024-03-23T23:50:33.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.656+0000 7f1acfe00640 1 -- 172.21.15.8:0/1067007835 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7f1ac8001a00 con 0x7f1ad0151ba0 2024-03-23T23:50:33.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.656+0000 7f1acfe00640 1 -- 172.21.15.8:0/1067007835 >> v1:172.21.15.8:6789/0 conn(0x7f1ad0151ba0 legacy=0x7f1ad0151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:33.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.656+0000 7f1acfe00640 1 --2- 172.21.15.8:0/1067007835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ab80039c0 0x7f1ab8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:33.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.656+0000 7f1acfe00640 1 --2- 172.21.15.8:0/1067007835 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ab8004810 0x7f1ab8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:33.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.656+0000 7f1acfe00640 1 --2- 172.21.15.8:0/1067007835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ab80052f0 0x7f1ab800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:33.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.656+0000 7f1acfe00640 1 -- 172.21.15.8:0/1067007835 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad00c3760 con 0x7f1ab80052f0 2024-03-23T23:50:33.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.656+0000 7f1acfe00640 1 -- 172.21.15.8:0/1067007835 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab800c2b0 con 0x7f1ab80039c0 2024-03-23T23:50:33.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.656+0000 7f1acfe00640 1 -- 172.21.15.8:0/1067007835 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab800c4b0 con 0x7f1ab8004810 2024-03-23T23:50:33.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.656+0000 7f1ad6200640 1 --2- 172.21.15.8:0/1067007835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ab80052f0 0x7f1ab800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:33.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.656+0000 7f1ad5800640 1 --2- 172.21.15.8:0/1067007835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ab80039c0 0x7f1ab8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:33.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.660+0000 7f1ad6200640 1 -- 172.21.15.8:0/1067007835 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ab8004810 msgr2=0x7f1ab8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:50:33.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.660+0000 7f1ad6200640 1 --2- 172.21.15.8:0/1067007835 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ab8004810 0x7f1ab8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:33.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.660+0000 7f1ad6200640 1 -- 172.21.15.8:0/1067007835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ab80039c0 msgr2=0x7f1ab8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:50:33.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.660+0000 7f1ad6200640 1 --2- 172.21.15.8:0/1067007835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ab80039c0 0x7f1ab8003dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:33.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.660+0000 7f1ad6200640 1 -- 172.21.15.8:0/1067007835 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad006d280 con 0x7f1ab80052f0 2024-03-23T23:50:33.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.672+0000 7f1ad6200640 1 --2- 172.21.15.8:0/1067007835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ab80052f0 0x7f1ab800b9d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8008510 tx=0x7f1ac801d0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31bd0177186307b7 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:33.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.672+0000 7f1ad6200640 1 -- 172.21.15.8:0/1067007835 reap_dead start 2024-03-23T23:50:33.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.672+0000 7f1acfe00640 1 -- 172.21.15.8:0/1067007835 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac8005060 con 0x7f1ab80052f0 2024-03-23T23:50:33.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.672+0000 7f1acfe00640 1 -- 172.21.15.8:0/1067007835 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac8008270 con 0x7f1ab80052f0 2024-03-23T23:50:33.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.676+0000 7f1ad6c00640 1 -- 172.21.15.8:0/1067007835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ab80052f0 msgr2=0x7f1ab800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:33.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.676+0000 7f1acfe00640 1 -- 172.21.15.8:0/1067007835 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac8005060 con 0x7f1ab80052f0 2024-03-23T23:50:33.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.676+0000 7f1ad6c00640 1 --2- 172.21.15.8:0/1067007835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ab80052f0 0x7f1ab800b9d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8008510 tx=0x7f1ac801d0c0 comp rx=0 tx=0).stop 2024-03-23T23:50:33.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.676+0000 7f1ad6c00640 1 -- 172.21.15.8:0/1067007835 shutdown_connections 2024-03-23T23:50:33.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.676+0000 7f1ad6c00640 1 --2- 172.21.15.8:0/1067007835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ab80052f0 0x7f1ab800b9d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:33.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.676+0000 7f1ad6c00640 1 -- 172.21.15.8:0/1067007835 >> 172.21.15.8:0/1067007835 conn(0x7f1ad00c3910 msgr2=0x7f1ad00c3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:50:33.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.676+0000 7f1ad6c00640 1 -- 172.21.15.8:0/1067007835 shutdown_connections 2024-03-23T23:50:33.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.676+0000 7f1ad6c00640 1 -- 172.21.15.8:0/1067007835 wait complete. 2024-03-23T23:50:33.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.680+0000 7f1ad6c00640 1 Processor -- start 2024-03-23T23:50:33.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.680+0000 7f1ad6c00640 1 -- start start 2024-03-23T23:50:33.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.684+0000 7f1ad6c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ab80052f0 0x7f1ad01e7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:33.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.684+0000 7f1ad6c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ad0148560 0x7f1ad014d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:33.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.684+0000 7f1ad6c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ad014d5f0 0x7f1ad01e3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:33.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.684+0000 7f1ad5800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ab80052f0 0x7f1ad01e7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:33.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.684+0000 7f1ad5800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ab80052f0 0x7f1ad01e7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:46832/0 (socket says 172.21.15.8:46832) 2024-03-23T23:50:33.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.684+0000 7f1ad5800640 1 -- 172.21.15.8:0/477637539 learned_addr learned my addr 172.21.15.8:0/477637539 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:50:33.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.684+0000 7f1ad4e00640 1 --2- 172.21.15.8:0/477637539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ad0148560 0x7f1ad014d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:33.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.684+0000 7f1ad6c00640 1 -- 172.21.15.8:0/477637539 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad0070be0 con 0x7f1ad014d5f0 2024-03-23T23:50:33.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.684+0000 7f1ad6c00640 1 -- 172.21.15.8:0/477637539 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad0151710 con 0x7f1ab80052f0 2024-03-23T23:50:33.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.688+0000 7f1ad6c00640 1 -- 172.21.15.8:0/477637539 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad006c940 con 0x7f1ad0148560 2024-03-23T23:50:33.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.688+0000 7f1ad6200640 1 --2- 172.21.15.8:0/477637539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ad014d5f0 0x7f1ad01e3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:33.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.688+0000 7f1ad4e00640 1 -- 172.21.15.8:0/477637539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ab80052f0 msgr2=0x7f1ad01e7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:33.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.688+0000 7f1ad4e00640 1 --2- 172.21.15.8:0/477637539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ab80052f0 0x7f1ad01e7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:33.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.688+0000 7f1ad4e00640 1 -- 172.21.15.8:0/477637539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ad014d5f0 msgr2=0x7f1ad01e3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:33.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.688+0000 7f1ad4e00640 1 --2- 172.21.15.8:0/477637539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ad014d5f0 0x7f1ad01e3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:33.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.688+0000 7f1ad4e00640 1 -- 172.21.15.8:0/477637539 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad01505a0 con 0x7f1ad0148560 2024-03-23T23:50:33.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.688+0000 7f1ad6200640 1 --2- 172.21.15.8:0/477637539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ad014d5f0 0x7f1ad01e3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:50:33.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.696+0000 7f1ad4e00640 1 --2- 172.21.15.8:0/477637539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ad0148560 0x7f1ad014d0b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1abc00b3e0 tx=0x7f1abc009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:33.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.704+0000 7f1acd600640 1 -- 172.21.15.8:0/477637539 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc015020 con 0x7f1ad0148560 2024-03-23T23:50:33.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.704+0000 7f1acd600640 1 -- 172.21.15.8:0/477637539 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1abc011830 con 0x7f1ad0148560 2024-03-23T23:50:33.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.704+0000 7f1acd600640 1 -- 172.21.15.8:0/477637539 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc011c00 con 0x7f1ad0148560 2024-03-23T23:50:33.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.704+0000 7f1ad6c00640 1 -- 172.21.15.8:0/477637539 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad0150880 con 0x7f1ad0148560 2024-03-23T23:50:33.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.704+0000 7f1ad6c00640 1 -- 172.21.15.8:0/477637539 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad0150e40 con 0x7f1ad0148560 2024-03-23T23:50:33.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.712+0000 7f1ad6c00640 1 --2- 172.21.15.8:0/477637539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1aac002a80 0x7f1aac004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:33.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.712+0000 7f1ad6c00640 1 -- 172.21.15.8:0/477637539 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac007ed0 con 0x7f1aac002a80 2024-03-23T23:50:33.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.716+0000 7f1ad5800640 1 --2- 172.21.15.8:0/477637539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1aac002a80 0x7f1aac004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:33.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.716+0000 7f1ad5800640 1 -- 172.21.15.8:0/477637539 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1aac0080d0 con 0x7f1aac002a80 2024-03-23T23:50:33.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.720+0000 7f1acd600640 1 -- 172.21.15.8:0/477637539 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f1abc018020 con 0x7f1ad0148560 2024-03-23T23:50:33.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.720+0000 7f1acd600640 1 --2- 172.21.15.8:0/477637539 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1ab0067730 0x7f1ab0069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:33.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.720+0000 7f1acd600640 1 -- 172.21.15.8:0/477637539 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f1abc085b50 con 0x7f1ad0148560 2024-03-23T23:50:33.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.732+0000 7f1ad6200640 1 --2- 172.21.15.8:0/477637539 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1ab0067730 0x7f1ab0069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:33.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.732+0000 7f1ad5800640 1 --2- 172.21.15.8:0/477637539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1aac002a80 0x7f1aac004f40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400e7a0 tx=0x7f1ac400ec60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:33.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.732+0000 7f1ad6200640 1 --2- 172.21.15.8:0/477637539 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1ab0067730 0x7f1ab0069bf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0151f80 tx=0x7f1ac8007040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:33.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.748+0000 7f1acd600640 1 -- 172.21.15.8:0/477637539 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac4019020 con 0x7f1aac002a80 2024-03-23T23:50:33.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.748+0000 7f1acd600640 1 -- 172.21.15.8:0/477637539 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f1ac400ee50 con 0x7f1aac002a80 2024-03-23T23:50:33.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.748+0000 7f1acd600640 1 -- 172.21.15.8:0/477637539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1aac002a80 msgr2=0x7f1aac004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:33.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.748+0000 7f1acd600640 1 --2- 172.21.15.8:0/477637539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1aac002a80 0x7f1aac004f40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400e7a0 tx=0x7f1ac400ec60 comp rx=0 tx=0).stop 2024-03-23T23:50:33.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.748+0000 7f1acd600640 1 -- 172.21.15.8:0/477637539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1aac002a80 msgr2=0x7f1aac004f40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:50:33.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.748+0000 7f1acd600640 1 --2- 172.21.15.8:0/477637539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1aac002a80 0x7f1aac004f40 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400e7a0 tx=0x7f1ac400ec60 comp rx=0 tx=0).stop 2024-03-23T23:50:33.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.780+0000 7f1ad6c00640 1 --2- 172.21.15.8:0/477637539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1aac006f10 0x7f1aac0073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:33.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.780+0000 7f1ad6c00640 1 -- 172.21.15.8:0/477637539 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac00a4b0 con 0x7f1aac006f10 2024-03-23T23:50:33.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.780+0000 7f1ad5800640 1 --2- 172.21.15.8:0/477637539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1aac006f10 0x7f1aac0073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:33.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.784+0000 7f1ad5800640 1 -- 172.21.15.8:0/477637539 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1aac0078e0 con 0x7f1aac006f10 2024-03-23T23:50:33.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.800+0000 7f1ad5800640 1 --2- 172.21.15.8:0/477637539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1aac006f10 0x7f1aac0073a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400e7a0 tx=0x7f1ac4004710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:33.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.800+0000 7f1acd600640 1 -- 172.21.15.8:0/477637539 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac4019040 con 0x7f1aac006f10 2024-03-23T23:50:33.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.808+0000 7f1acd600640 1 -- 172.21.15.8:0/477637539 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5040 (secure 0 0 0) 0x7f1ac4015d50 con 0x7f1aac006f10 2024-03-23T23:50:33.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.808+0000 7f1acd600640 1 -- 172.21.15.8:0/477637539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1aac006f10 msgr2=0x7f1aac0073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:33.813 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:50:33.813 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:50:33.813 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:50:33.813 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:50:33.813 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 54, 2024-03-23T23:50:33.813 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:50:33.813 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:50:33.813 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:50:33.813 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:50:33.814 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:33.814 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 18, 2024-03-23T23:50:33.814 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:50:33.814 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:50:33.814 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:50:33.814 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:50:33.814 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:50:33.814 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:50:33.814 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:50:33.814 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:50:33.814 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:50:33.814 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:50:33.814 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:50:33.814 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:50:33.815 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:50:33.815 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:50:33.815 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:33.815 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:50:33.815 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:50:33.815 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:50:33.815 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:50:33.815 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:50:33.815 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:50:33.815 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:50:33.815 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:50:33.815 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:50:33.815 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:50:33.815 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:50:33.816 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:50:33.816 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:50:33.816 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:33.816 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:33.816 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:50:33.816 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:50:33.816 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:50:33.816 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:50:33.816 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:50:33.816 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:50:33.816 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:50:33.816 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:50:33.816 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:50:33.816 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:50:33.817 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:50:33.817 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:50:33.817 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:50:33.817 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:50:33.817 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:50:33.817 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:50:33.817 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:50:33.817 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:50:33.817 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:50:33.817 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:50:33.817 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:50:33.817 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:50:33.817 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:50:33.817 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:50:33.818 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:50:33.818 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:50:33.818 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:50:33.818 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:50:33.818 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:33.818 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:50:33.818 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:33.818 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:50:33.818 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:33.818 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:50:33.818 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:50:33.818 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:50:33.818 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:50:33.818 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:33.819 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:50:33.819 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:50:33.819 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:33.819 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:33.819 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:33.819 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:50:33.819 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:50:33.819 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:33.819 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:33.819 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:33.819 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:33.819 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:50:33.819 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:50:33.819 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:50:33.820 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:50:33.820 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:50:33.820 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:33.820 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:33.820 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:50:33.820 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:50:33.820 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:50:33.820 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:50:33.820 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:33.820 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:50:33.820 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:50:33.820 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:33.820 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:33.820 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:33.821 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:50:33.821 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:50:33.821 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:33.821 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:33.821 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:33.821 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:33.821 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:50:33.821 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:50:33.821 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:50:33.821 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:50:33.821 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:50:33.821 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:33.821 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:33.821 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:50:33.822 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:50:33.822 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:50:33.822 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:50:33.822 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:33.822 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:50:33.822 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:50:33.822 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:33.822 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:33.822 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:33.822 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:50:33.822 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:50:33.822 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:33.822 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:33.822 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:33.823 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:33.823 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:50:33.823 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:50:33.823 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:50:33.823 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:50:33.823 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:50:33.823 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:33.823 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:33.823 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:33.823 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:50:33.823 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:50:33.823 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:33.823 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:33.823 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:33.824 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:50:33.824 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:33.824 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:33.824 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:50:33.824 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:33.824 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:33.824 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:33.824 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:50:33.824 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:33.824 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:33.824 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:50:33.824 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:33.824 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:33.824 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:33.824 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:50:33.825 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:33.825 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:33.825 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:50:33.825 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:33.825 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:33.825 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:33.825 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:50:33.825 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:33.825 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:33.825 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:50:33.825 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:33.825 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:33.825 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:33.825 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:50:33.826 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:33.826 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:33.826 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:33.826 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:50:33.826 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:50:33.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.812+0000 7f1acd600640 1 --2- 172.21.15.8:0/477637539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1aac006f10 0x7f1aac0073a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400e7a0 tx=0x7f1ac4004710 comp rx=0 tx=0).stop 2024-03-23T23:50:33.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.812+0000 7f1acd600640 1 -- 172.21.15.8:0/477637539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1aac006f10 msgr2=0x7f1aac0073a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:50:33.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.812+0000 7f1acd600640 1 --2- 172.21.15.8:0/477637539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1aac006f10 0x7f1aac0073a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:33.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.812+0000 7f1ad6c00640 1 -- 172.21.15.8:0/477637539 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1ab0067730 msgr2=0x7f1ab0069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:33.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.812+0000 7f1ad6c00640 1 --2- 172.21.15.8:0/477637539 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1ab0067730 0x7f1ab0069bf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0151f80 tx=0x7f1ac8007040 comp rx=0 tx=0).stop 2024-03-23T23:50:33.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.812+0000 7f1ad6c00640 1 -- 172.21.15.8:0/477637539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ad0148560 msgr2=0x7f1ad014d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:33.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.812+0000 7f1ad6c00640 1 --2- 172.21.15.8:0/477637539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ad0148560 0x7f1ad014d0b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1abc00b3e0 tx=0x7f1abc009f90 comp rx=0 tx=0).stop 2024-03-23T23:50:33.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.812+0000 7f1ad6200640 1 -- 172.21.15.8:0/477637539 reap_dead start 2024-03-23T23:50:33.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.812+0000 7f1ad6200640 1 -- 172.21.15.8:0/477637539 reap_dead start 2024-03-23T23:50:33.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.812+0000 7f1ad6c00640 1 -- 172.21.15.8:0/477637539 shutdown_connections 2024-03-23T23:50:33.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.812+0000 7f1ad6c00640 1 -- 172.21.15.8:0/477637539 >> 172.21.15.8:0/477637539 conn(0x7f1ad00c3910 msgr2=0x7f1ad0145d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:50:33.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.816+0000 7f1ad6c00640 1 -- 172.21.15.8:0/477637539 shutdown_connections 2024-03-23T23:50:33.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:33.816+0000 7f1ad6c00640 1 -- 172.21.15.8:0/477637539 wait complete. 2024-03-23T23:50:33.899 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:50:33.899 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-03-23T23:50:33.899 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a'] 2024-03-23T23:50:33.900 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-03-23T23:50:33.900 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-03-23T23:50:33.900 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-23T23:50:33.900 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:50:33.955 INFO:tasks.ceph.mon.b:Stopped 2024-03-23T23:50:33.955 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-03-23T23:50:33.956 INFO:tasks.ceph.mon.a:Sent signal 19 2024-03-23T23:50:33.956 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-03-23T23:50:44.166 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:50:44.171 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:50:48.957 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-03-23T23:50:48.957 INFO:tasks.ceph.mon.a:Sent signal 18 2024-03-23T23:50:48.958 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-03-23T23:50:48.958 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:50:49.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:49.332+0000 7f6c5aa00640 1 Processor -- start 2024-03-23T23:50:49.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:49.332+0000 7f6c5aa00640 1 -- start start 2024-03-23T23:50:49.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:49.332+0000 7f6c5aa00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6c540710f0 0x7f6c5415a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:49.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:49.332+0000 7f6c5aa00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c54072f40 con 0x7f6c540c1d40 2024-03-23T23:50:49.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:49.332+0000 7f6c5aa00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c540ab690 con 0x7f6c540aa390 2024-03-23T23:50:49.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:49.332+0000 7f6c5aa00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c540ab420 con 0x7f6c540710f0 2024-03-23T23:50:49.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:49.332+0000 7f6c53400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f6c540c1d40 0x7f6c540abe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:56120/0 (socket says 172.21.15.8:56120) 2024-03-23T23:50:49.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:49.336+0000 7f6c53400640 1 -- 172.21.15.8:0/1345802696 learned_addr learned my addr 172.21.15.8:0/1345802696 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:50:49.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:49.336+0000 7f6c58a00640 1 -- 172.21.15.8:0/1345802696 >> v1:172.21.15.196:6789/0 conn(0x7f6c540aa390 legacy=0x7f6c54157010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-03-23T23:50:49.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:49.344+0000 7f6c53e00640 1 -- 172.21.15.8:0/1345802696 >> v2:172.21.15.196:3300/0 conn(0x7f6c540710f0 msgr2=0x7f6c5415a7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:50:49.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:49.344+0000 7f6c53e00640 1 --2- 172.21.15.8:0/1345802696 >> v2:172.21.15.196:3300/0 conn(0x7f6c540710f0 0x7f6c5415a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:50:49.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:49.540+0000 7f6c58a00640 1 -- 172.21.15.8:0/1345802696 >> v1:172.21.15.196:6789/0 conn(0x7f6c540aa390 legacy=0x7f6c54157010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-03-23T23:50:49.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:49.548+0000 7f6c53e00640 1 -- 172.21.15.8:0/1345802696 >> v2:172.21.15.196:3300/0 conn(0x7f6c540710f0 msgr2=0x7f6c5415a7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:50:49.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:49.548+0000 7f6c53e00640 1 --2- 172.21.15.8:0/1345802696 >> v2:172.21.15.196:3300/0 conn(0x7f6c540710f0 0x7f6c5415a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:50:49.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:49.952+0000 7f6c53e00640 1 -- 172.21.15.8:0/1345802696 >> v2:172.21.15.196:3300/0 conn(0x7f6c540710f0 msgr2=0x7f6c5415a7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:50:49.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:49.952+0000 7f6c53e00640 1 --2- 172.21.15.8:0/1345802696 >> v2:172.21.15.196:3300/0 conn(0x7f6c540710f0 0x7f6c5415a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:50:49.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:49.952+0000 7f6c58a00640 1 -- 172.21.15.8:0/1345802696 >> v1:172.21.15.196:6789/0 conn(0x7f6c540aa390 legacy=0x7f6c54157010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-03-23T23:50:50.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:50.760+0000 7f6c53e00640 1 -- 172.21.15.8:0/1345802696 >> v2:172.21.15.196:3300/0 conn(0x7f6c540710f0 msgr2=0x7f6c5415a7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:50:50.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:50.760+0000 7f6c53e00640 1 --2- 172.21.15.8:0/1345802696 >> v2:172.21.15.196:3300/0 conn(0x7f6c540710f0 0x7f6c5415a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:50:50.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:50.760+0000 7f6c58a00640 1 -- 172.21.15.8:0/1345802696 >> v1:172.21.15.196:6789/0 conn(0x7f6c540aa390 legacy=0x7f6c54157010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-03-23T23:50:52.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.332+0000 7f6c51600640 1 -- 172.21.15.8:0/1345802696 >> v2:172.21.15.196:3300/0 conn(0x7f6c540710f0 msgr2=0x7f6c5415a7f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:50:52.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.332+0000 7f6c51600640 1 --2- 172.21.15.8:0/1345802696 >> v2:172.21.15.196:3300/0 conn(0x7f6c540710f0 0x7f6c5415a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:52.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.332+0000 7f6c51600640 1 -- 172.21.15.8:0/1345802696 >> v1:172.21.15.196:6789/0 conn(0x7f6c540aa390 legacy=0x7f6c54157010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:50:52.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.332+0000 7f6c51600640 1 -- 172.21.15.8:0/1345802696 >> v1:172.21.15.8:6789/0 conn(0x7f6c540c1d40 legacy=0x7f6c540abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:52.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.336+0000 7f6c51600640 1 --2- 172.21.15.8:0/1345802696 >> v2:172.21.15.8:3300/0 conn(0x7f6c340036b0 0x7f6c34005b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:52.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.336+0000 7f6c53e00640 1 --2- 172.21.15.8:0/1345802696 >> v2:172.21.15.8:3300/0 conn(0x7f6c340036b0 0x7f6c34005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:52.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.336+0000 7f6c51600640 1 --2- 172.21.15.8:0/1345802696 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c34006120 0x7f6c340085e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:52.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.336+0000 7f6c51600640 1 -- 172.21.15.8:0/1345802696 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c540ab420 con 0x7f6c340036b0 2024-03-23T23:50:52.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.336+0000 7f6c51600640 1 -- 172.21.15.8:0/1345802696 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c34008ce0 con 0x7f6c34006120 2024-03-23T23:50:52.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.336+0000 7f6c53e00640 1 -- 172.21.15.8:0/1345802696 >> v2:172.21.15.8:3300/0 conn(0x7f6c340036b0 msgr2=0x7f6c34005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:50:52.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.336+0000 7f6c53e00640 1 -- 172.21.15.8:0/1345802696 >> v2:172.21.15.8:3300/0 conn(0x7f6c340036b0 msgr2=0x7f6c34005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:50:52.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.336+0000 7f6c53e00640 1 --2- 172.21.15.8:0/1345802696 >> v2:172.21.15.8:3300/0 conn(0x7f6c340036b0 0x7f6c34005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:50:52.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.336+0000 7f6c53e00640 1 --2- 172.21.15.8:0/1345802696 >> v2:172.21.15.8:3300/0 conn(0x7f6c340036b0 0x7f6c34005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:50:52.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.340+0000 7f6c53400640 1 --2- 172.21.15.8:0/1345802696 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c34006120 0x7f6c340085e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:52.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.340+0000 7f6c53400640 1 -- 172.21.15.8:0/1345802696 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c34006120 msgr2=0x7f6c340085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:50:52.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.340+0000 7f6c53400640 1 -- 172.21.15.8:0/1345802696 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c34006120 msgr2=0x7f6c340085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:50:52.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.340+0000 7f6c53400640 1 --2- 172.21.15.8:0/1345802696 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c34006120 0x7f6c340085e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:50:52.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.340+0000 7f6c53400640 1 --2- 172.21.15.8:0/1345802696 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c34006120 0x7f6c340085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:50:52.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.544+0000 7f6c53e00640 1 --2- 172.21.15.8:0/1345802696 >> v2:172.21.15.8:3300/0 conn(0x7f6c340036b0 0x7f6c34005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:52.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.544+0000 7f6c53400640 1 --2- 172.21.15.8:0/1345802696 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c34006120 0x7f6c340085e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:52.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.544+0000 7f6c53400640 1 -- 172.21.15.8:0/1345802696 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c34006120 msgr2=0x7f6c340085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:50:52.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.544+0000 7f6c53400640 1 -- 172.21.15.8:0/1345802696 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c34006120 msgr2=0x7f6c340085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:50:52.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.544+0000 7f6c53400640 1 --2- 172.21.15.8:0/1345802696 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c34006120 0x7f6c340085e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:50:52.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.544+0000 7f6c53400640 1 --2- 172.21.15.8:0/1345802696 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c34006120 0x7f6c340085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:50:52.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.544+0000 7f6c53e00640 1 -- 172.21.15.8:0/1345802696 >> v2:172.21.15.8:3300/0 conn(0x7f6c340036b0 msgr2=0x7f6c34005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:50:52.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.544+0000 7f6c53e00640 1 -- 172.21.15.8:0/1345802696 >> v2:172.21.15.8:3300/0 conn(0x7f6c340036b0 msgr2=0x7f6c34005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:50:52.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.544+0000 7f6c53e00640 1 --2- 172.21.15.8:0/1345802696 >> v2:172.21.15.8:3300/0 conn(0x7f6c340036b0 0x7f6c34005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:50:52.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.544+0000 7f6c53e00640 1 --2- 172.21.15.8:0/1345802696 >> v2:172.21.15.8:3300/0 conn(0x7f6c340036b0 0x7f6c34005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:50:52.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.948+0000 7f6c53400640 1 --2- 172.21.15.8:0/1345802696 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c34006120 0x7f6c340085e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:52.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.948+0000 7f6c53400640 1 -- 172.21.15.8:0/1345802696 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c34006120 msgr2=0x7f6c340085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:50:52.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.948+0000 7f6c53400640 1 -- 172.21.15.8:0/1345802696 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c34006120 msgr2=0x7f6c340085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:50:52.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.948+0000 7f6c53400640 1 --2- 172.21.15.8:0/1345802696 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c34006120 0x7f6c340085e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:50:52.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.948+0000 7f6c53400640 1 --2- 172.21.15.8:0/1345802696 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c34006120 0x7f6c340085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:50:52.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.952+0000 7f6c53e00640 1 --2- 172.21.15.8:0/1345802696 >> v2:172.21.15.8:3300/0 conn(0x7f6c340036b0 0x7f6c34005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:52.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.952+0000 7f6c53e00640 1 -- 172.21.15.8:0/1345802696 >> v2:172.21.15.8:3300/0 conn(0x7f6c340036b0 msgr2=0x7f6c34005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:50:52.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.952+0000 7f6c53e00640 1 -- 172.21.15.8:0/1345802696 >> v2:172.21.15.8:3300/0 conn(0x7f6c340036b0 msgr2=0x7f6c34005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:50:52.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.952+0000 7f6c53e00640 1 --2- 172.21.15.8:0/1345802696 >> v2:172.21.15.8:3300/0 conn(0x7f6c340036b0 0x7f6c34005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:50:52.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:52.952+0000 7f6c53e00640 1 --2- 172.21.15.8:0/1345802696 >> v2:172.21.15.8:3300/0 conn(0x7f6c340036b0 0x7f6c34005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:50:53.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:53.751+0000 7f6c53400640 1 --2- 172.21.15.8:0/1345802696 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c34006120 0x7f6c340085e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:53.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:53.751+0000 7f6c53400640 1 -- 172.21.15.8:0/1345802696 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c34006120 msgr2=0x7f6c340085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:50:53.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:53.751+0000 7f6c53400640 1 -- 172.21.15.8:0/1345802696 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c34006120 msgr2=0x7f6c340085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:50:53.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:53.751+0000 7f6c53400640 1 --2- 172.21.15.8:0/1345802696 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c34006120 0x7f6c340085e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:50:53.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:53.751+0000 7f6c53400640 1 --2- 172.21.15.8:0/1345802696 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c34006120 0x7f6c340085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:50:53.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:53.767+0000 7f6c53e00640 1 --2- 172.21.15.8:0/1345802696 >> v2:172.21.15.8:3300/0 conn(0x7f6c340036b0 0x7f6c34005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:53.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:53.767+0000 7f6c53e00640 1 -- 172.21.15.8:0/1345802696 >> v2:172.21.15.8:3300/0 conn(0x7f6c340036b0 msgr2=0x7f6c34005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:50:53.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:53.767+0000 7f6c53e00640 1 -- 172.21.15.8:0/1345802696 >> v2:172.21.15.8:3300/0 conn(0x7f6c340036b0 msgr2=0x7f6c34005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:50:53.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:53.767+0000 7f6c53e00640 1 --2- 172.21.15.8:0/1345802696 >> v2:172.21.15.8:3300/0 conn(0x7f6c340036b0 0x7f6c34005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:50:53.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:53.767+0000 7f6c53e00640 1 --2- 172.21.15.8:0/1345802696 >> v2:172.21.15.8:3300/0 conn(0x7f6c340036b0 0x7f6c34005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:50:55.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.343+0000 7f6c51600640 1 -- 172.21.15.8:0/1345802696 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c34006120 msgr2=0x7f6c340085e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:50:55.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.343+0000 7f6c51600640 1 --2- 172.21.15.8:0/1345802696 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c34006120 0x7f6c340085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:55.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.343+0000 7f6c51600640 1 -- 172.21.15.8:0/1345802696 >> v2:172.21.15.8:3300/0 conn(0x7f6c340036b0 msgr2=0x7f6c34005b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:50:55.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.343+0000 7f6c51600640 1 --2- 172.21.15.8:0/1345802696 >> v2:172.21.15.8:3300/0 conn(0x7f6c340036b0 0x7f6c34005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:55.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.343+0000 7f6c51600640 1 --2- 172.21.15.8:0/1345802696 >> v2:172.21.15.8:3300/0 conn(0x7f6c340100c0 0x7f6c34012550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:55.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.343+0000 7f6c51600640 1 -- 172.21.15.8:0/1345802696 --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c5415ad30 con 0x7f6c540c1d40 2024-03-23T23:50:55.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.343+0000 7f6c51600640 1 -- 172.21.15.8:0/1345802696 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c540ab690 con 0x7f6c540aa390 2024-03-23T23:50:55.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.343+0000 7f6c51600640 1 -- 172.21.15.8:0/1345802696 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c540ab420 con 0x7f6c340100c0 2024-03-23T23:50:55.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.343+0000 7f6c58a00640 1 -- 172.21.15.8:0/1345802696 reap_dead start 2024-03-23T23:50:55.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.343+0000 7f6c53400640 1 -- 172.21.15.8:0/1345802696 >> v1:172.21.15.196:6789/0 conn(0x7f6c540aa390 legacy=0x7f6c3400e920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-03-23T23:50:55.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.363+0000 7f6c58a00640 1 --2- 172.21.15.8:0/1345802696 >> v2:172.21.15.8:3300/0 conn(0x7f6c340100c0 0x7f6c34012550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:55.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.363+0000 7f6c58a00640 1 -- 172.21.15.8:0/1345802696 >> v1:172.21.15.196:6789/0 conn(0x7f6c540aa390 legacy=0x7f6c3400e920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:50:55.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.363+0000 7f6c58a00640 1 -- 172.21.15.8:0/1345802696 >> v1:172.21.15.8:6789/0 conn(0x7f6c540c1d40 legacy=0x7f6c3400b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:55.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.363+0000 7f6c58a00640 1 -- 172.21.15.8:0/1345802696 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c34014ca0 con 0x7f6c340100c0 2024-03-23T23:50:55.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.379+0000 7f6c58a00640 1 --2- 172.21.15.8:0/1345802696 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c340100c0 0x7f6c34012550 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6c540ab860 tx=0x7f6c4c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34100a46c1e6063a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:55.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.379+0000 7f6c52a00640 1 -- 172.21.15.8:0/1345802696 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c0a5860 con 0x7f6c340100c0 2024-03-23T23:50:55.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.379+0000 7f6c52a00640 1 -- 172.21.15.8:0/1345802696 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c0a9070 con 0x7f6c340100c0 2024-03-23T23:50:55.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.379+0000 7f6c52a00640 1 -- 172.21.15.8:0/1345802696 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c0a5c60 con 0x7f6c340100c0 2024-03-23T23:50:55.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.379+0000 7f6c5aa00640 1 -- 172.21.15.8:0/1345802696 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c340100c0 msgr2=0x7f6c34012550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:55.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.379+0000 7f6c5aa00640 1 --2- 172.21.15.8:0/1345802696 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c340100c0 0x7f6c34012550 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6c540ab860 tx=0x7f6c4c01c9a0 comp rx=0 tx=0).stop 2024-03-23T23:50:55.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.379+0000 7f6c5aa00640 1 -- 172.21.15.8:0/1345802696 shutdown_connections 2024-03-23T23:50:55.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.379+0000 7f6c5aa00640 1 --2- 172.21.15.8:0/1345802696 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c340100c0 0x7f6c34012550 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:55.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.379+0000 7f6c5aa00640 1 -- 172.21.15.8:0/1345802696 >> 172.21.15.8:0/1345802696 conn(0x7f6c540c7170 msgr2=0x7f6c540c7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:50:55.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.379+0000 7f6c5aa00640 1 -- 172.21.15.8:0/1345802696 shutdown_connections 2024-03-23T23:50:55.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.379+0000 7f6c5aa00640 1 -- 172.21.15.8:0/1345802696 wait complete. 2024-03-23T23:50:55.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.383+0000 7f6c5aa00640 1 Processor -- start 2024-03-23T23:50:55.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.383+0000 7f6c5aa00640 1 -- start start 2024-03-23T23:50:55.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.387+0000 7f6c5aa00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c340100c0 0x7f6c541f3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:55.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.387+0000 7f6c5aa00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c540aa390 0x7f6c540c2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:55.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.387+0000 7f6c5aa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c540c1d40 0x7f6c5414dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:55.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.387+0000 7f6c5aa00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c54157010 con 0x7f6c540c1d40 2024-03-23T23:50:55.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.387+0000 7f6c5aa00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540716e0 con 0x7f6c340100c0 2024-03-23T23:50:55.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.387+0000 7f6c5aa00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c54157190 con 0x7f6c540aa390 2024-03-23T23:50:55.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.387+0000 7f6c53e00640 1 -- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c340100c0 msgr2=0x7f6c541f3360 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:50:55.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.387+0000 7f6c53400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c540aa390 0x7f6c540c2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:55.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.387+0000 7f6c53400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c540aa390 0x7f6c540c2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:44484/0 (socket says 172.21.15.8:44484) 2024-03-23T23:50:55.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.387+0000 7f6c53400640 1 -- 172.21.15.8:0/3028737518 learned_addr learned my addr 172.21.15.8:0/3028737518 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:50:55.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.387+0000 7f6c58a00640 1 --2- 172.21.15.8:0/3028737518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c540c1d40 0x7f6c5414dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:55.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.387+0000 7f6c53400640 1 -- 172.21.15.8:0/3028737518 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c340100c0 msgr2=0x7f6c541f3360 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-23T23:50:55.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.387+0000 7f6c53e00640 1 --2- 172.21.15.8:0/3028737518 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c340100c0 0x7f6c541f3360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:50:55.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.387+0000 7f6c53400640 1 --2- 172.21.15.8:0/3028737518 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c340100c0 0x7f6c541f3360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:55.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.387+0000 7f6c53400640 1 -- 172.21.15.8:0/3028737518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c540c1d40 msgr2=0x7f6c5414dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:55.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.387+0000 7f6c53400640 1 --2- 172.21.15.8:0/3028737518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c540c1d40 0x7f6c5414dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:55.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.387+0000 7f6c53400640 1 -- 172.21.15.8:0/3028737518 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c541f6930 con 0x7f6c540aa390 2024-03-23T23:50:55.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.387+0000 7f6c58a00640 1 --2- 172.21.15.8:0/3028737518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c540c1d40 0x7f6c5414dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:50:55.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.387+0000 7f6c53400640 1 --2- 172.21.15.8:0/3028737518 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c540aa390 0x7f6c540c2f70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6c400076d0 tx=0x7f6c40001640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:55.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.395+0000 7f6c4be00640 1 -- 172.21.15.8:0/3028737518 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4001b020 con 0x7f6c540aa390 2024-03-23T23:50:55.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.395+0000 7f6c4be00640 1 -- 172.21.15.8:0/3028737518 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c40017670 con 0x7f6c540aa390 2024-03-23T23:50:55.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.395+0000 7f6c4be00640 1 -- 172.21.15.8:0/3028737518 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c40001d50 con 0x7f6c540aa390 2024-03-23T23:50:55.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.395+0000 7f6c5aa00640 1 -- 172.21.15.8:0/3028737518 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c541f2880 con 0x7f6c540aa390 2024-03-23T23:50:55.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.395+0000 7f6c5aa00640 1 -- 172.21.15.8:0/3028737518 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c540c3980 con 0x7f6c540aa390 2024-03-23T23:50:55.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.399+0000 7f6c5aa00640 1 -- 172.21.15.8:0/3028737518 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c5404f480 con 0x7f6c540aa390 2024-03-23T23:50:55.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.403+0000 7f6c4be00640 1 -- 172.21.15.8:0/3028737518 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f6c4001e020 con 0x7f6c540aa390 2024-03-23T23:50:55.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.403+0000 7f6c4be00640 1 --2- 172.21.15.8:0/3028737518 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6c34068b10 0x7f6c3406afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:55.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.403+0000 7f6c53e00640 1 --2- 172.21.15.8:0/3028737518 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6c34068b10 0x7f6c3406afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:55.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.407+0000 7f6c4be00640 1 -- 172.21.15.8:0/3028737518 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f6c40054860 con 0x7f6c540aa390 2024-03-23T23:50:55.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.411+0000 7f6c53e00640 1 --2- 172.21.15.8:0/3028737518 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6c34068b10 0x7f6c3406afd0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6c34006090 tx=0x7f6c44009550 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:55.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.431+0000 7f6c4be00640 1 -- 172.21.15.8:0/3028737518 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f6c40025020 con 0x7f6c540aa390 2024-03-23T23:50:55.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.959+0000 7f6c5aa00640 1 -- 172.21.15.8:0/3028737518 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f6c540aad70 con 0x7f6c540aa390 2024-03-23T23:50:55.964 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":58,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:50:55.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.959+0000 7f6c4be00640 1 -- 172.21.15.8:0/3028737518 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1554 (secure 0 0 0) 0x7f6c40056ec0 con 0x7f6c540aa390 2024-03-23T23:50:55.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.963+0000 7f6c5aa00640 1 -- 172.21.15.8:0/3028737518 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6c34068b10 msgr2=0x7f6c3406afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:55.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.963+0000 7f6c5aa00640 1 --2- 172.21.15.8:0/3028737518 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6c34068b10 0x7f6c3406afd0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6c34006090 tx=0x7f6c44009550 comp rx=0 tx=0).stop 2024-03-23T23:50:55.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.963+0000 7f6c5aa00640 1 -- 172.21.15.8:0/3028737518 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c540aa390 msgr2=0x7f6c540c2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:55.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.963+0000 7f6c5aa00640 1 --2- 172.21.15.8:0/3028737518 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c540aa390 0x7f6c540c2f70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6c400076d0 tx=0x7f6c40001640 comp rx=0 tx=0).stop 2024-03-23T23:50:55.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.963+0000 7f6c5aa00640 1 -- 172.21.15.8:0/3028737518 shutdown_connections 2024-03-23T23:50:55.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.963+0000 7f6c5aa00640 1 --2- 172.21.15.8:0/3028737518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c540c1d40 0x7f6c5414dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:55.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.963+0000 7f6c5aa00640 1 --2- 172.21.15.8:0/3028737518 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6c34068b10 0x7f6c3406afd0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:55.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.963+0000 7f6c5aa00640 1 --2- 172.21.15.8:0/3028737518 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c540aa390 0x7f6c540c2f70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:55.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.963+0000 7f6c5aa00640 1 --2- 172.21.15.8:0/3028737518 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c340100c0 0x7f6c541f3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:55.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.963+0000 7f6c5aa00640 1 -- 172.21.15.8:0/3028737518 >> 172.21.15.8:0/3028737518 conn(0x7f6c540c7170 msgr2=0x7f6c5406eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:50:55.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.967+0000 7f6c5aa00640 1 -- 172.21.15.8:0/3028737518 shutdown_connections 2024-03-23T23:50:55.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:55.967+0000 7f6c5aa00640 1 -- 172.21.15.8:0/3028737518 wait complete. 2024-03-23T23:50:56.017 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-03-23T23:50:56.017 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-03-23T23:50:56.017 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:50:56.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.355+0000 7feffaa00640 1 Processor -- start 2024-03-23T23:50:56.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.355+0000 7feffaa00640 1 -- start start 2024-03-23T23:50:56.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.359+0000 7feffaa00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7feff415a670 0x7feff40c2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:56.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.359+0000 7feff9600640 1 -- >> v1:172.21.15.196:6789/0 conn(0x7feff4157180 legacy=0x7feff4070be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-03-23T23:50:56.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.359+0000 7feff8c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7feff415a670 0x7feff40c2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:56.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.359+0000 7feff8c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7feff415a670 0x7feff40c2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33590/0 (socket says 172.21.15.8:33590) 2024-03-23T23:50:56.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.363+0000 7feffaa00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7feff40c2d60 0x7feff4164380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:56.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.363+0000 7feffa000640 1 -- >> v2:172.21.15.196:3300/0 conn(0x7feff40c2d60 msgr2=0x7feff4164380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:50:56.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.363+0000 7feffa000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7feff40c2d60 0x7feff4164380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:50:56.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.363+0000 7feffaa00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff40712f0 con 0x7feff4157180 2024-03-23T23:50:56.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.367+0000 7feffaa00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feff4157560 con 0x7feff415a670 2024-03-23T23:50:56.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.367+0000 7feffaa00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feff406ccf0 con 0x7feff40c2d60 2024-03-23T23:50:56.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.367+0000 7feff8c00640 1 -- 172.21.15.8:0/427681567 learned_addr learned my addr 172.21.15.8:0/427681567 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:50:56.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.367+0000 7feff8c00640 1 -- 172.21.15.8:0/427681567 >> v2:172.21.15.196:3300/0 conn(0x7feff40c2d60 msgr2=0x7feff4164380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:50:56.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.367+0000 7feff8c00640 1 --2- 172.21.15.8:0/427681567 >> v2:172.21.15.196:3300/0 conn(0x7feff40c2d60 0x7feff4164380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:56.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.367+0000 7feff8c00640 1 -- 172.21.15.8:0/427681567 >> v1:172.21.15.196:6789/0 conn(0x7feff4157180 legacy=0x7feff4070be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:50:56.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.367+0000 7feff8c00640 1 -- 172.21.15.8:0/427681567 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff4159b90 con 0x7feff415a670 2024-03-23T23:50:56.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.387+0000 7feff8c00640 1 --2- 172.21.15.8:0/427681567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff415a670 0x7feff40c2820 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7feff4070750 tx=0x7fefe801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895fe9374a12e75a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:56.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.391+0000 7feff3e00640 1 -- 172.21.15.8:0/427681567 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe80b0070 con 0x7feff415a670 2024-03-23T23:50:56.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.391+0000 7feff3e00640 1 -- 172.21.15.8:0/427681567 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe80ab600 con 0x7feff415a670 2024-03-23T23:50:56.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.391+0000 7feff3e00640 1 -- 172.21.15.8:0/427681567 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe80ab9d0 con 0x7feff415a670 2024-03-23T23:50:56.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.391+0000 7feffaa00640 1 -- 172.21.15.8:0/427681567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff415a670 msgr2=0x7feff40c2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:56.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.391+0000 7feffaa00640 1 --2- 172.21.15.8:0/427681567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff415a670 0x7feff40c2820 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7feff4070750 tx=0x7fefe801c500 comp rx=0 tx=0).stop 2024-03-23T23:50:56.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.391+0000 7feffaa00640 1 -- 172.21.15.8:0/427681567 shutdown_connections 2024-03-23T23:50:56.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.391+0000 7feffaa00640 1 --2- 172.21.15.8:0/427681567 >> v2:172.21.15.196:3300/0 conn(0x7feff40c2d60 0x7feff4164380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:56.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.391+0000 7feffaa00640 1 --2- 172.21.15.8:0/427681567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff415a670 0x7feff40c2820 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:56.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.391+0000 7feffaa00640 1 -- 172.21.15.8:0/427681567 >> 172.21.15.8:0/427681567 conn(0x7feff40c3910 msgr2=0x7feff40c3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:50:56.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.391+0000 7feffaa00640 1 -- 172.21.15.8:0/427681567 shutdown_connections 2024-03-23T23:50:56.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.391+0000 7feffaa00640 1 -- 172.21.15.8:0/427681567 wait complete. 2024-03-23T23:50:56.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.399+0000 7feffaa00640 1 Processor -- start 2024-03-23T23:50:56.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.399+0000 7feffaa00640 1 -- start start 2024-03-23T23:50:56.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.399+0000 7feffaa00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feff40c2d60 0x7feff41529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:56.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.399+0000 7feffaa00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feff4157180 0x7feff40ab580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:56.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.399+0000 7feffaa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff415a670 0x7feff40abac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:56.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.403+0000 7feffaa00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff406f440 con 0x7feff415a670 2024-03-23T23:50:56.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.403+0000 7feffaa00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff415a1e0 con 0x7feff40c2d60 2024-03-23T23:50:56.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.403+0000 7feffaa00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff406f5c0 con 0x7feff4157180 2024-03-23T23:50:56.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.403+0000 7feffa000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff415a670 0x7feff40abac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:56.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.403+0000 7feffa000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff415a670 0x7feff40abac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33592/0 (socket says 172.21.15.8:33592) 2024-03-23T23:50:56.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.403+0000 7feffa000640 1 -- 172.21.15.8:0/3117899476 learned_addr learned my addr 172.21.15.8:0/3117899476 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:50:56.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.403+0000 7feff9600640 1 -- 172.21.15.8:0/3117899476 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feff40c2d60 msgr2=0x7feff41529b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:50:56.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.403+0000 7feff9600640 1 --2- 172.21.15.8:0/3117899476 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feff40c2d60 0x7feff41529b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:50:56.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.403+0000 7feff8c00640 1 --2- 172.21.15.8:0/3117899476 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feff4157180 0x7feff40ab580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:56.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.407+0000 7feffa000640 1 -- 172.21.15.8:0/3117899476 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feff4157180 msgr2=0x7feff40ab580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:56.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.407+0000 7feffa000640 1 --2- 172.21.15.8:0/3117899476 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feff4157180 0x7feff40ab580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:56.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.407+0000 7feffa000640 1 -- 172.21.15.8:0/3117899476 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feff40c2d60 msgr2=0x7feff41529b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:50:56.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.407+0000 7feffa000640 1 --2- 172.21.15.8:0/3117899476 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feff40c2d60 0x7feff41529b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:56.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.411+0000 7feffa000640 1 -- 172.21.15.8:0/3117899476 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff4150db0 con 0x7feff415a670 2024-03-23T23:50:56.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.415+0000 7feffa000640 1 --2- 172.21.15.8:0/3117899476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff415a670 0x7feff40abac0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fefe000b410 tx=0x7fefe0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:56.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.415+0000 7feff1600640 1 -- 172.21.15.8:0/3117899476 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe0017070 con 0x7feff415a670 2024-03-23T23:50:56.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.415+0000 7feff1600640 1 -- 172.21.15.8:0/3117899476 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe0003dc0 con 0x7feff415a670 2024-03-23T23:50:56.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.415+0000 7feff1600640 1 -- 172.21.15.8:0/3117899476 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe0006310 con 0x7feff415a670 2024-03-23T23:50:56.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.415+0000 7feffaa00640 1 -- 172.21.15.8:0/3117899476 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff41f2c10 con 0x7feff415a670 2024-03-23T23:50:56.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.415+0000 7feffaa00640 1 -- 172.21.15.8:0/3117899476 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff41f31d0 con 0x7feff415a670 2024-03-23T23:50:56.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.419+0000 7feffaa00640 1 --2- 172.21.15.8:0/3117899476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff40ac000 0x7feff40a9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:56.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.419+0000 7feff9600640 1 --2- 172.21.15.8:0/3117899476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff40ac000 0x7feff40a9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:56.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.419+0000 7feffaa00640 1 -- 172.21.15.8:0/3117899476 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff40c1580 con 0x7feff40ac000 2024-03-23T23:50:56.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.423+0000 7feff9600640 1 -- 172.21.15.8:0/3117899476 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feff40ab1b0 con 0x7feff40ac000 2024-03-23T23:50:56.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.423+0000 7feff9600640 1 --2- 172.21.15.8:0/3117899476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff40ac000 0x7feff40a9470 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fefec00bcc0 tx=0x7fefec009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:56.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.427+0000 7feff1600640 1 -- 172.21.15.8:0/3117899476 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fefe001a070 con 0x7feff415a670 2024-03-23T23:50:56.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.427+0000 7feff1600640 1 --2- 172.21.15.8:0/3117899476 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fefd4067690 0x7fefd4069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:56.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.427+0000 7feff1600640 1 -- 172.21.15.8:0/3117899476 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec014630 con 0x7feff40ac000 2024-03-23T23:50:56.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.427+0000 7feff1600640 1 -- 172.21.15.8:0/3117899476 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fefe0084da0 con 0x7feff415a670 2024-03-23T23:50:56.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.427+0000 7feff1600640 1 -- 172.21.15.8:0/3117899476 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fefec0147d0 con 0x7feff40ac000 2024-03-23T23:50:56.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.427+0000 7feff1600640 1 -- 172.21.15.8:0/3117899476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff40ac000 msgr2=0x7feff40a9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:56.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.427+0000 7feff1600640 1 --2- 172.21.15.8:0/3117899476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff40ac000 0x7feff40a9470 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fefec00bcc0 tx=0x7fefec009f30 comp rx=0 tx=0).stop 2024-03-23T23:50:56.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.431+0000 7feff8c00640 1 --2- 172.21.15.8:0/3117899476 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fefd4067690 0x7fefd4069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:56.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.435+0000 7feff1600640 1 -- 172.21.15.8:0/3117899476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff40ac000 msgr2=0x7feff40a9470 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:50:56.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.435+0000 7feff1600640 1 --2- 172.21.15.8:0/3117899476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff40ac000 0x7feff40a9470 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:56.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.447+0000 7feff8c00640 1 --2- 172.21.15.8:0/3117899476 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fefd4067690 0x7fefd4069b50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fefe80ad000 tx=0x7fefe80a4f90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:56.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.503+0000 7feffaa00640 1 --2- 172.21.15.8:0/3117899476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff41f2710 0x7feff40a99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:56.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.503+0000 7feffaa00640 1 -- 172.21.15.8:0/3117899476 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff404f410 con 0x7feff41f2710 2024-03-23T23:50:56.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.507+0000 7feff9600640 1 --2- 172.21.15.8:0/3117899476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff41f2710 0x7feff40a99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:56.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.507+0000 7feff9600640 1 -- 172.21.15.8:0/3117899476 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7feff40c3370 con 0x7feff41f2710 2024-03-23T23:50:56.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.507+0000 7feff9600640 1 --2- 172.21.15.8:0/3117899476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff41f2710 0x7feff40a99b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fefec009fd0 tx=0x7fefec005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:56.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.511+0000 7feff1600640 1 -- 172.21.15.8:0/3117899476 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec019040 con 0x7feff41f2710 2024-03-23T23:50:56.515 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:50:56.515 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:50:56.515 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:50:56.515 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:50:56.515 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 58, 2024-03-23T23:50:56.515 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:50:56.515 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:50:56.516 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:50:56.516 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:56.516 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 2, 2024-03-23T23:50:56.516 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:50:56.516 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:50:56.516 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:50:56.516 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:50:56.516 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:50:56.516 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:50:56.516 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:50:56.516 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:50:56.516 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:50:56.516 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:50:56.516 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:50:56.517 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:50:56.517 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:50:56.517 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:50:56.517 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:56.517 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:50:56.517 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:50:56.517 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:50:56.517 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:50:56.517 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:50:56.517 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:50:56.517 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:50:56.517 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:50:56.517 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:50:56.517 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:50:56.518 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:50:56.518 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:50:56.518 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:50:56.518 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:56.518 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:56.518 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:50:56.518 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:50:56.518 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:50:56.518 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:50:56.518 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:50:56.518 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:50:56.518 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:50:56.518 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:50:56.518 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:50:56.519 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:50:56.519 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:50:56.519 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:50:56.519 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:50:56.519 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:50:56.519 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:50:56.519 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:50:56.519 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:50:56.519 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:50:56.519 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:50:56.519 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:50:56.519 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:50:56.519 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:50:56.519 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:50:56.520 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:50:56.520 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:50:56.520 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:50:56.520 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:50:56.520 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:50:56.520 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:56.520 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:50:56.520 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:56.520 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:50:56.520 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:56.520 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:50:56.520 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:50:56.520 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:50:56.520 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:50:56.521 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:56.521 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:50:56.521 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:50:56.521 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:56.521 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:56.521 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:56.521 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:50:56.521 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:50:56.521 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:56.521 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:56.521 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:56.521 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:56.521 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:50:56.521 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:50:56.522 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:50:56.522 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:50:56.522 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:50:56.522 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:56.522 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:56.522 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:50:56.522 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:50:56.522 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:50:56.522 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:50:56.522 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:56.522 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:50:56.522 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:50:56.522 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:56.522 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:56.523 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:56.523 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:50:56.523 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:50:56.523 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:56.523 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:56.523 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:56.523 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:56.523 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:50:56.523 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:50:56.523 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:50:56.523 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:50:56.523 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:50:56.523 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:56.524 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:56.524 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:50:56.524 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:50:56.524 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:50:56.524 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:50:56.524 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:56.524 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:50:56.524 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:50:56.524 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:56.524 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:56.524 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:56.524 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:50:56.524 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:50:56.525 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:56.525 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:56.525 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:56.525 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:56.525 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:50:56.525 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:50:56.525 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:50:56.525 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:50:56.525 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:50:56.525 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:56.525 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:56.525 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:56.525 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:50:56.525 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:50:56.526 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:56.526 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:56.526 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:56.526 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:50:56.526 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:56.526 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:56.526 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:50:56.526 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:56.526 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:56.526 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:56.526 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:50:56.526 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:56.526 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:56.527 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:50:56.527 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:56.527 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:56.527 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:56.527 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5 2024-03-23T23:50:56.527 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:56.527 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:56.527 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:50:56.527 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:56.527 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:50:56.527 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:56.527 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:50:56.527 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:56.527 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:56.528 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:56.528 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:56.528 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5 2024-03-23T23:50:56.528 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:56.528 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:56.528 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:50:56.528 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:56.528 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:56.528 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:56.528 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:50:56.528 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:56.528 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:56.528 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:56.528 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:50:56.529 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:50:56.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.511+0000 7feff1600640 1 -- 172.21.15.8:0/3117899476 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5173 (secure 0 0 0) 0x7fefec01b8a0 con 0x7feff41f2710 2024-03-23T23:50:56.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.511+0000 7feff1600640 1 -- 172.21.15.8:0/3117899476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff41f2710 msgr2=0x7feff40a99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:56.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.511+0000 7feff1600640 1 --2- 172.21.15.8:0/3117899476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff41f2710 0x7feff40a99b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fefec009fd0 tx=0x7fefec005db0 comp rx=0 tx=0).stop 2024-03-23T23:50:56.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.511+0000 7feff1600640 1 -- 172.21.15.8:0/3117899476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff41f2710 msgr2=0x7feff40a99b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:50:56.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.511+0000 7feff1600640 1 --2- 172.21.15.8:0/3117899476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff41f2710 0x7feff40a99b0 secure :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fefec009fd0 tx=0x7fefec005db0 comp rx=0 tx=0).stop 2024-03-23T23:50:56.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.515+0000 7feffaa00640 1 -- 172.21.15.8:0/3117899476 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fefd4067690 msgr2=0x7fefd4069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:56.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.515+0000 7feffaa00640 1 --2- 172.21.15.8:0/3117899476 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fefd4067690 0x7fefd4069b50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fefe80ad000 tx=0x7fefe80a4f90 comp rx=0 tx=0).stop 2024-03-23T23:50:56.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.515+0000 7feffaa00640 1 -- 172.21.15.8:0/3117899476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff415a670 msgr2=0x7feff40abac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:56.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.515+0000 7feffaa00640 1 --2- 172.21.15.8:0/3117899476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff415a670 0x7feff40abac0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fefe000b410 tx=0x7fefe0009f90 comp rx=0 tx=0).stop 2024-03-23T23:50:56.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.515+0000 7feffa000640 1 -- 172.21.15.8:0/3117899476 reap_dead start 2024-03-23T23:50:56.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.515+0000 7feffa000640 1 -- 172.21.15.8:0/3117899476 reap_dead start 2024-03-23T23:50:56.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.515+0000 7feffaa00640 1 -- 172.21.15.8:0/3117899476 shutdown_connections 2024-03-23T23:50:56.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.515+0000 7feffaa00640 1 -- 172.21.15.8:0/3117899476 >> 172.21.15.8:0/3117899476 conn(0x7feff40c3910 msgr2=0x7feff4155b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:50:56.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.515+0000 7feffaa00640 1 -- 172.21.15.8:0/3117899476 shutdown_connections 2024-03-23T23:50:56.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.515+0000 7feffaa00640 1 -- 172.21.15.8:0/3117899476 wait complete. 2024-03-23T23:50:56.582 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T23:50:56.582 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-03-23T23:50:56.582 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:50:56.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.895+0000 7fe237e00640 1 Processor -- start 2024-03-23T23:50:56.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.895+0000 7fe237e00640 1 -- start start 2024-03-23T23:50:56.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.899+0000 7fe237e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe2300d7a80 0x7fe23004a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:56.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.899+0000 7fe237e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe23000e8d0 0x7fe230007650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:56.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.899+0000 7fe237e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2300db200 con 0x7fe230007210 2024-03-23T23:50:56.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.899+0000 7fe237e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe23000fcd0 con 0x7fe23000e8d0 2024-03-23T23:50:56.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.899+0000 7fe237e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe23004ad40 con 0x7fe2300d7a80 2024-03-23T23:50:56.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.899+0000 7fe236a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe2300d7a80 0x7fe23004a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:56.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.899+0000 7fe237400640 1 -- >> v2:172.21.15.196:3300/0 conn(0x7fe23000e8d0 msgr2=0x7fe230007650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:50:56.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.899+0000 7fe237400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe23000e8d0 0x7fe230007650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:50:56.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.899+0000 7fe236a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe2300d7a80 0x7fe23004a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:44500/0 (socket says 172.21.15.8:44500) 2024-03-23T23:50:56.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.899+0000 7fe236000640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe230007210 0x7fe23000e1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:33634/0 (socket says 172.21.15.8:33634) 2024-03-23T23:50:56.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.899+0000 7fe236000640 1 -- 172.21.15.8:0/2933382539 learned_addr learned my addr 172.21.15.8:0/2933382539 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:50:56.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.903+0000 7fe236a00640 1 -- 172.21.15.8:0/2933382539 >> v2:172.21.15.196:3300/0 conn(0x7fe23000e8d0 msgr2=0x7fe230007650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:50:56.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.903+0000 7fe236a00640 1 --2- 172.21.15.8:0/2933382539 >> v2:172.21.15.196:3300/0 conn(0x7fe23000e8d0 0x7fe230007650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:56.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.903+0000 7fe236a00640 1 -- 172.21.15.8:0/2933382539 >> v1:172.21.15.8:6789/0 conn(0x7fe230007210 legacy=0x7fe23000e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:56.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.903+0000 7fe236a00640 1 -- 172.21.15.8:0/2933382539 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2300da440 con 0x7fe2300d7a80 2024-03-23T23:50:56.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.907+0000 7fe236a00640 1 --2- 172.21.15.8:0/2933382539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe2300d7a80 0x7fe23004a4f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe2380695d0 tx=0x7fe238098340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6191ea8d5f35a015 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:56.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.907+0000 7fe235600640 1 -- 172.21.15.8:0/2933382539 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23812c070 con 0x7fe2300d7a80 2024-03-23T23:50:56.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.907+0000 7fe235600640 1 -- 172.21.15.8:0/2933382539 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe238127600 con 0x7fe2300d7a80 2024-03-23T23:50:56.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.907+0000 7fe235600640 1 -- 172.21.15.8:0/2933382539 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23812c070 con 0x7fe2300d7a80 2024-03-23T23:50:56.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.911+0000 7fe237e00640 1 -- 172.21.15.8:0/2933382539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe2300d7a80 msgr2=0x7fe23004a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:56.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.911+0000 7fe237e00640 1 --2- 172.21.15.8:0/2933382539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe2300d7a80 0x7fe23004a4f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe2380695d0 tx=0x7fe238098340 comp rx=0 tx=0).stop 2024-03-23T23:50:56.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.911+0000 7fe237e00640 1 -- 172.21.15.8:0/2933382539 shutdown_connections 2024-03-23T23:50:56.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.911+0000 7fe237e00640 1 --2- 172.21.15.8:0/2933382539 >> v2:172.21.15.196:3300/0 conn(0x7fe23000e8d0 0x7fe230007650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:56.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.911+0000 7fe237e00640 1 --2- 172.21.15.8:0/2933382539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe2300d7a80 0x7fe23004a4f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:56.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.911+0000 7fe237e00640 1 -- 172.21.15.8:0/2933382539 >> 172.21.15.8:0/2933382539 conn(0x7fe23004c5f0 msgr2=0x7fe23004ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:50:56.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.915+0000 7fe237e00640 1 -- 172.21.15.8:0/2933382539 shutdown_connections 2024-03-23T23:50:56.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.915+0000 7fe237e00640 1 -- 172.21.15.8:0/2933382539 wait complete. 2024-03-23T23:50:56.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.915+0000 7fe237e00640 1 Processor -- start 2024-03-23T23:50:56.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.919+0000 7fe237e00640 1 -- start start 2024-03-23T23:50:56.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.919+0000 7fe237e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe230007210 0x7fe230032750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:56.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.919+0000 7fe237e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe23000e8d0 0x7fe2300d9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:56.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.923+0000 7fe237e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe2300d7a80 0x7fe2300dd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:56.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.923+0000 7fe237e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23004aa30 con 0x7fe23000e8d0 2024-03-23T23:50:56.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.923+0000 7fe237e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23004e480 con 0x7fe2300d7a80 2024-03-23T23:50:56.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.923+0000 7fe237e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2300e74d0 con 0x7fe230007210 2024-03-23T23:50:56.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.923+0000 7fe236a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe230007210 0x7fe230032750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:56.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.923+0000 7fe236a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe230007210 0x7fe230032750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:44504/0 (socket says 172.21.15.8:44504) 2024-03-23T23:50:56.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.923+0000 7fe236a00640 1 -- 172.21.15.8:0/955750028 learned_addr learned my addr 172.21.15.8:0/955750028 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:50:56.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.923+0000 7fe236000640 1 --2- 172.21.15.8:0/955750028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe23000e8d0 0x7fe2300d9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:56.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.923+0000 7fe236a00640 1 -- 172.21.15.8:0/955750028 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe2300d7a80 msgr2=0x7fe2300dd7a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-23T23:50:56.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.923+0000 7fe236a00640 1 --2- 172.21.15.8:0/955750028 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe2300d7a80 0x7fe2300dd7a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:56.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.923+0000 7fe236a00640 1 -- 172.21.15.8:0/955750028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe23000e8d0 msgr2=0x7fe2300d9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:56.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.923+0000 7fe236a00640 1 --2- 172.21.15.8:0/955750028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe23000e8d0 0x7fe2300d9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:56.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.923+0000 7fe236a00640 1 -- 172.21.15.8:0/955750028 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe230049c40 con 0x7fe230007210 2024-03-23T23:50:56.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.923+0000 7fe236000640 1 --2- 172.21.15.8:0/955750028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe23000e8d0 0x7fe2300d9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:50:56.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.923+0000 7fe236a00640 1 --2- 172.21.15.8:0/955750028 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe230007210 0x7fe230032750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe23804f930 tx=0x7fe2380951e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:56.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.923+0000 7fe22ea00640 1 -- 172.21.15.8:0/955750028 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe238135070 con 0x7fe230007210 2024-03-23T23:50:56.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.923+0000 7fe22ea00640 1 -- 172.21.15.8:0/955750028 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe238131890 con 0x7fe230007210 2024-03-23T23:50:56.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.923+0000 7fe22ea00640 1 -- 172.21.15.8:0/955750028 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23812c040 con 0x7fe230007210 2024-03-23T23:50:56.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.923+0000 7fe237e00640 1 -- 172.21.15.8:0/955750028 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2300de3b0 con 0x7fe230007210 2024-03-23T23:50:56.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.923+0000 7fe237e00640 1 -- 172.21.15.8:0/955750028 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2300d9eb0 con 0x7fe230007210 2024-03-23T23:50:56.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.927+0000 7fe237e00640 1 --2- 172.21.15.8:0/955750028 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe230042d00 0x7fe2300ddce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:56.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.927+0000 7fe237e00640 1 -- 172.21.15.8:0/955750028 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2300dce20 con 0x7fe230042d00 2024-03-23T23:50:56.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.927+0000 7fe236000640 1 --2- 172.21.15.8:0/955750028 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe230042d00 0x7fe2300ddce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:56.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.927+0000 7fe22ea00640 1 -- 172.21.15.8:0/955750028 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fe238138070 con 0x7fe230007210 2024-03-23T23:50:56.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.931+0000 7fe22ea00640 1 --2- 172.21.15.8:0/955750028 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe218067660 0x7fe218069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:56.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.931+0000 7fe236000640 1 -- 172.21.15.8:0/955750028 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe2300de580 con 0x7fe230042d00 2024-03-23T23:50:56.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.931+0000 7fe237400640 1 --2- 172.21.15.8:0/955750028 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe218067660 0x7fe218069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:56.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.931+0000 7fe236000640 1 --2- 172.21.15.8:0/955750028 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe230042d00 0x7fe2300ddce0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe224000f70 tx=0x7fe22400d8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:56.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.931+0000 7fe22ea00640 1 -- 172.21.15.8:0/955750028 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fe23819c200 con 0x7fe230007210 2024-03-23T23:50:56.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.931+0000 7fe22ea00640 1 -- 172.21.15.8:0/955750028 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe224018070 con 0x7fe230042d00 2024-03-23T23:50:56.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.931+0000 7fe237400640 1 --2- 172.21.15.8:0/955750028 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe218067660 0x7fe218069b20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe228006fd0 tx=0x7fe228006c40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:56.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.935+0000 7fe22ea00640 1 -- 172.21.15.8:0/955750028 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fe224005cf0 con 0x7fe230042d00 2024-03-23T23:50:56.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.935+0000 7fe22ea00640 1 -- 172.21.15.8:0/955750028 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe230042d00 msgr2=0x7fe2300ddce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:56.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.935+0000 7fe22ea00640 1 --2- 172.21.15.8:0/955750028 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe230042d00 0x7fe2300ddce0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe224000f70 tx=0x7fe22400d8e0 comp rx=0 tx=0).stop 2024-03-23T23:50:56.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.935+0000 7fe22ea00640 1 -- 172.21.15.8:0/955750028 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe230042d00 msgr2=0x7fe2300ddce0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:50:56.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.935+0000 7fe22ea00640 1 --2- 172.21.15.8:0/955750028 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe230042d00 0x7fe2300ddce0 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe224000f70 tx=0x7fe22400d8e0 comp rx=0 tx=0).stop 2024-03-23T23:50:56.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.947+0000 7fe237e00640 1 --2- 172.21.15.8:0/955750028 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe2300db700 0x7fe2300dbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:50:56.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.947+0000 7fe237e00640 1 -- 172.21.15.8:0/955750028 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2300068a0 con 0x7fe2300db700 2024-03-23T23:50:56.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.947+0000 7fe236000640 1 --2- 172.21.15.8:0/955750028 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe2300db700 0x7fe2300dbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:50:56.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.951+0000 7fe236000640 1 -- 172.21.15.8:0/955750028 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe230035780 con 0x7fe2300db700 2024-03-23T23:50:56.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.951+0000 7fe236000640 1 --2- 172.21.15.8:0/955750028 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe2300db700 0x7fe2300dbb10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe224000f70 tx=0x7fe224005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:50:56.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.951+0000 7fe22ea00640 1 -- 172.21.15.8:0/955750028 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe224018040 con 0x7fe2300db700 2024-03-23T23:50:56.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.951+0000 7fe22ea00640 1 -- 172.21.15.8:0/955750028 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5028 (secure 0 0 0) 0x7fe22401cbd0 con 0x7fe2300db700 2024-03-23T23:50:56.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.951+0000 7fe22ea00640 1 -- 172.21.15.8:0/955750028 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe2300db700 msgr2=0x7fe2300dbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:56.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.951+0000 7fe22ea00640 1 --2- 172.21.15.8:0/955750028 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe2300db700 0x7fe2300dbb10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe224000f70 tx=0x7fe224005800 comp rx=0 tx=0).stop 2024-03-23T23:50:56.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.951+0000 7fe22ea00640 1 -- 172.21.15.8:0/955750028 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe2300db700 msgr2=0x7fe2300dbb10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:50:56.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.951+0000 7fe22ea00640 1 --2- 172.21.15.8:0/955750028 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe2300db700 0x7fe2300dbb10 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe224000f70 tx=0x7fe224005800 comp rx=0 tx=0).stop 2024-03-23T23:50:56.958 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:50:56.959 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:50:56.959 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:50:56.959 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:50:56.959 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 58, 2024-03-23T23:50:56.959 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:50:56.959 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:50:56.959 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:50:56.959 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:56.959 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 2, 2024-03-23T23:50:56.959 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:50:56.959 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:50:56.959 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:50:56.959 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:50:56.960 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:50:56.960 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:50:56.960 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:50:56.960 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:50:56.960 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:50:56.960 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:50:56.960 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:50:56.960 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:50:56.960 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:50:56.960 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:50:56.960 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:56.960 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:50:56.960 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:50:56.960 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:50:56.961 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:50:56.961 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:50:56.961 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:50:56.961 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:50:56.961 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:50:56.961 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:50:56.961 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:50:56.961 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:50:56.961 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:50:56.961 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:50:56.961 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:56.961 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:56.961 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:50:56.961 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:50:56.962 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:50:56.962 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:50:56.962 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:50:56.963 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:50:56.963 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:50:56.963 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:50:56.963 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:50:56.963 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:50:56.963 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:50:56.963 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:50:56.963 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:50:56.963 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:50:56.963 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:50:56.963 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:50:56.963 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:50:56.963 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:50:56.964 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:50:56.964 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:50:56.964 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:50:56.964 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:50:56.964 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:50:56.964 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:50:56.964 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:50:56.964 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:50:56.964 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:50:56.964 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:50:56.964 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:56.964 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:50:56.964 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:56.964 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:50:56.965 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:56.965 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:50:56.965 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:50:56.965 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:50:56.965 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:50:56.965 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:56.965 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:50:56.965 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:50:56.965 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:56.965 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:56.966 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:56.966 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:50:56.966 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:50:56.966 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:56.966 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:56.966 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:56.967 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:56.967 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:50:56.967 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:50:56.967 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:50:56.967 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:50:56.967 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:50:56.967 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:56.967 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:56.967 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:50:56.967 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:50:56.967 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:50:56.967 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:50:56.967 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:56.967 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:50:56.968 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:50:56.968 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:56.968 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:56.968 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:56.968 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:50:56.968 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:50:56.968 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:56.968 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:56.968 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:56.968 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:56.968 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:50:56.968 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:50:56.968 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:50:56.968 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:50:56.969 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:50:56.969 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:56.969 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:56.969 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:50:56.969 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:50:56.969 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:50:56.969 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:50:56.969 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:56.969 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:50:56.969 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:50:56.969 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:56.969 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:56.969 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:56.970 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:50:56.970 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:50:56.970 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:50:56.970 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:56.970 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:56.970 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:56.970 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:50:56.970 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:50:56.970 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:50:56.970 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:50:56.970 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:50:56.970 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:56.970 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:56.970 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:56.971 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:50:56.971 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:50:56.971 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:56.971 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:56.971 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:56.971 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:50:56.971 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:56.971 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:56.971 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:50:56.971 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:56.971 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:56.971 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:56.971 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:50:56.971 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:56.972 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:56.972 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:50:56.972 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:56.972 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:56.972 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:56.972 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:50:56.972 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:56.972 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:56.972 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:50:56.972 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:56.972 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:56.972 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:56.972 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:50:56.972 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:56.973 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:50:56.973 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:50:56.973 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:50:56.973 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:50:56.973 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:50:56.973 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:50:56.973 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:50:56.973 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:50:56.973 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:50:56.973 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:50:56.973 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:50:56.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.955+0000 7fe237e00640 1 -- 172.21.15.8:0/955750028 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe218067660 msgr2=0x7fe218069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:56.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.955+0000 7fe237e00640 1 --2- 172.21.15.8:0/955750028 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe218067660 0x7fe218069b20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe228006fd0 tx=0x7fe228006c40 comp rx=0 tx=0).stop 2024-03-23T23:50:56.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.955+0000 7fe237400640 1 -- 172.21.15.8:0/955750028 reap_dead start 2024-03-23T23:50:56.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.955+0000 7fe237e00640 1 -- 172.21.15.8:0/955750028 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe230007210 msgr2=0x7fe230032750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:50:56.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.955+0000 7fe237e00640 1 --2- 172.21.15.8:0/955750028 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe230007210 0x7fe230032750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe23804f930 tx=0x7fe2380951e0 comp rx=0 tx=0).stop 2024-03-23T23:50:56.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.955+0000 7fe237e00640 1 -- 172.21.15.8:0/955750028 shutdown_connections 2024-03-23T23:50:56.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.955+0000 7fe237e00640 1 --2- 172.21.15.8:0/955750028 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe230007210 0x7fe230032750 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:50:56.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.955+0000 7fe237e00640 1 -- 172.21.15.8:0/955750028 >> 172.21.15.8:0/955750028 conn(0x7fe23004c5f0 msgr2=0x7fe2300d6be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:50:56.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.959+0000 7fe237e00640 1 -- 172.21.15.8:0/955750028 shutdown_connections 2024-03-23T23:50:56.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:50:56.959+0000 7fe237e00640 1 -- 172.21.15.8:0/955750028 wait complete. 2024-03-23T23:50:57.013 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T23:50:57.013 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-03-23T23:51:14.388 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:51:14.393 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:51:17.013 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-03-23T23:51:17.014 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-03-23T23:51:17.014 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-23T23:51:17.014 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-23T23:51:17.025 INFO:tasks.ceph.mon.b:Started 2024-03-23T23:51:17.025 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-03-23T23:51:17.026 INFO:tasks.ceph.mon.a:Sent signal 19 2024-03-23T23:51:17.026 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-03-23T23:51:32.027 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-03-23T23:51:32.028 INFO:tasks.ceph.mon.a:Sent signal 18 2024-03-23T23:51:32.028 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T23:51:32.028 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:51:32.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.511+0000 7f0f1cc00640 1 Processor -- start 2024-03-23T23:51:32.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.511+0000 7f0f1cc00640 1 -- start start 2024-03-23T23:51:32.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.515+0000 7f0f1cc00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0f18153950 0x7f0f1815a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:32.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.519+0000 7f0f1cc00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0f180c1cd0 0x7f0f180c2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:32.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.519+0000 7f0f16a00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f0f1806ccf0 0x7f0f18071670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:54206/0 (socket says 172.21.15.8:54206) 2024-03-23T23:51:32.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.519+0000 7f0f16a00640 1 -- 172.21.15.8:0/3626024571 learned_addr learned my addr 172.21.15.8:0/3626024571 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:51:32.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.519+0000 7f0f17e00640 1 --2- 172.21.15.8:0/3626024571 >> v2:172.21.15.196:3300/0 conn(0x7f0f180c1cd0 0x7f0f180c2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:32.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.519+0000 7f0f1cc00640 1 -- 172.21.15.8:0/3626024571 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f180c2d10 con 0x7f0f1806ccf0 2024-03-23T23:51:32.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.519+0000 7f0f1cc00640 1 -- 172.21.15.8:0/3626024571 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f180c2ff0 con 0x7f0f18153950 2024-03-23T23:51:32.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.519+0000 7f0f1cc00640 1 -- 172.21.15.8:0/3626024571 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f18070e70 con 0x7f0f180c1cd0 2024-03-23T23:51:32.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.523+0000 7f0f17400640 1 --2- 172.21.15.8:0/3626024571 >> v2:172.21.15.8:3300/0 conn(0x7f0f18153950 0x7f0f1815a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:32.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.523+0000 7f0f17400640 1 -- 172.21.15.8:0/3626024571 >> v2:172.21.15.196:3300/0 conn(0x7f0f180c1cd0 msgr2=0x7f0f180c2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:51:32.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.523+0000 7f0f17400640 1 --2- 172.21.15.8:0/3626024571 >> v2:172.21.15.196:3300/0 conn(0x7f0f180c1cd0 0x7f0f180c2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:32.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.523+0000 7f0f17400640 1 -- 172.21.15.8:0/3626024571 >> v1:172.21.15.196:6789/0 conn(0x7f0f1806ccf0 legacy=0x7f0f18071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:51:32.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.523+0000 7f0f17400640 1 -- 172.21.15.8:0/3626024571 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f18071150 con 0x7f0f18153950 2024-03-23T23:51:32.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.535+0000 7f0f17400640 1 --2- 172.21.15.8:0/3626024571 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f18153950 0x7f0f1815a440 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0f180a9930 tx=0x7f0f0801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f9057df5ce87ad server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:32.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.535+0000 7f0f16000640 1 -- 172.21.15.8:0/3626024571 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f080b0070 con 0x7f0f18153950 2024-03-23T23:51:32.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.543+0000 7f0f16000640 1 -- 172.21.15.8:0/3626024571 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f080ab600 con 0x7f0f18153950 2024-03-23T23:51:32.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.543+0000 7f0f16000640 1 -- 172.21.15.8:0/3626024571 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f080b0070 con 0x7f0f18153950 2024-03-23T23:51:32.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.547+0000 7f0f1cc00640 1 -- 172.21.15.8:0/3626024571 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f18153950 msgr2=0x7f0f1815a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:32.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.547+0000 7f0f1cc00640 1 --2- 172.21.15.8:0/3626024571 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f18153950 0x7f0f1815a440 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0f180a9930 tx=0x7f0f0801c3b0 comp rx=0 tx=0).stop 2024-03-23T23:51:32.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.547+0000 7f0f1cc00640 1 -- 172.21.15.8:0/3626024571 shutdown_connections 2024-03-23T23:51:32.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.547+0000 7f0f1cc00640 1 --2- 172.21.15.8:0/3626024571 >> v2:172.21.15.196:3300/0 conn(0x7f0f180c1cd0 0x7f0f180c2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:32.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.547+0000 7f0f1cc00640 1 --2- 172.21.15.8:0/3626024571 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f18153950 0x7f0f1815a440 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:32.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.547+0000 7f0f1cc00640 1 -- 172.21.15.8:0/3626024571 >> 172.21.15.8:0/3626024571 conn(0x7f0f180c6b70 msgr2=0x7f0f180c6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:51:32.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.547+0000 7f0f1cc00640 1 -- 172.21.15.8:0/3626024571 shutdown_connections 2024-03-23T23:51:32.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.547+0000 7f0f1cc00640 1 -- 172.21.15.8:0/3626024571 wait complete. 2024-03-23T23:51:32.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.555+0000 7f0f1cc00640 1 Processor -- start 2024-03-23T23:51:32.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.555+0000 7f0f1cc00640 1 -- start start 2024-03-23T23:51:32.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.559+0000 7f0f1cc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f1806ccf0 0x7f0f1806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:32.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.563+0000 7f0f17400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f1806ccf0 0x7f0f1806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:32.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.563+0000 7f0f17400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f1806ccf0 0x7f0f1806d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40102/0 (socket says 172.21.15.8:40102) 2024-03-23T23:51:32.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.563+0000 7f0f17400640 1 -- 172.21.15.8:0/1718993482 learned_addr learned my addr 172.21.15.8:0/1718993482 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:51:32.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.563+0000 7f0f1cc00640 1 --2- 172.21.15.8:0/1718993482 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f180c1cd0 0x7f0f181f32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:32.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.563+0000 7f0f1cc00640 1 --2- 172.21.15.8:0/1718993482 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f18153950 0x7f0f181f37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:32.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.563+0000 7f0f1cc00640 1 -- 172.21.15.8:0/1718993482 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f18166d70 con 0x7f0f1806ccf0 2024-03-23T23:51:32.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.563+0000 7f0f1cc00640 1 -- 172.21.15.8:0/1718993482 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f180c2a50 con 0x7f0f180c1cd0 2024-03-23T23:51:32.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.563+0000 7f0f1cc00640 1 -- 172.21.15.8:0/1718993482 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f18166ef0 con 0x7f0f18153950 2024-03-23T23:51:32.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.563+0000 7f0f17e00640 1 --2- 172.21.15.8:0/1718993482 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f18153950 0x7f0f181f37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:32.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.563+0000 7f0f16a00640 1 --2- 172.21.15.8:0/1718993482 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f180c1cd0 0x7f0f181f32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:32.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.563+0000 7f0f17e00640 1 -- 172.21.15.8:0/1718993482 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f180c1cd0 msgr2=0x7f0f181f32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:32.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.563+0000 7f0f17e00640 1 --2- 172.21.15.8:0/1718993482 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f180c1cd0 0x7f0f181f32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:32.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.563+0000 7f0f17e00640 1 -- 172.21.15.8:0/1718993482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f1806ccf0 msgr2=0x7f0f1806d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:32.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.563+0000 7f0f17e00640 1 --2- 172.21.15.8:0/1718993482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f1806ccf0 0x7f0f1806d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:32.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.563+0000 7f0f17e00640 1 -- 172.21.15.8:0/1718993482 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f181f71d0 con 0x7f0f18153950 2024-03-23T23:51:32.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.567+0000 7f0f17e00640 1 --2- 172.21.15.8:0/1718993482 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f18153950 0x7f0f181f37f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0f1000cce0 tx=0x7f0f1000a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:32.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.571+0000 7f0f0f400640 1 -- 172.21.15.8:0/1718993482 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f10003ba0 con 0x7f0f18153950 2024-03-23T23:51:32.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.571+0000 7f0f0f400640 1 -- 172.21.15.8:0/1718993482 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f10003d40 con 0x7f0f18153950 2024-03-23T23:51:32.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.571+0000 7f0f0f400640 1 -- 172.21.15.8:0/1718993482 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f10004240 con 0x7f0f18153950 2024-03-23T23:51:32.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.571+0000 7f0f1cc00640 1 -- 172.21.15.8:0/1718993482 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f18147370 con 0x7f0f18153950 2024-03-23T23:51:32.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.571+0000 7f0f1cc00640 1 -- 172.21.15.8:0/1718993482 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f1806d870 con 0x7f0f18153950 2024-03-23T23:51:32.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.571+0000 7f0f1cc00640 1 -- 172.21.15.8:0/1718993482 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f1815a960 con 0x7f0f18153950 2024-03-23T23:51:32.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.579+0000 7f0f0f400640 1 -- 172.21.15.8:0/1718993482 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f0f100043e0 con 0x7f0f18153950 2024-03-23T23:51:32.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.579+0000 7f0f0f400640 1 --2- 172.21.15.8:0/1718993482 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0ef8067730 0x7f0ef8069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:32.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.579+0000 7f0f0f400640 1 -- 172.21.15.8:0/1718993482 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f0f10086750 con 0x7f0f18153950 2024-03-23T23:51:32.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.583+0000 7f0f17400640 1 --2- 172.21.15.8:0/1718993482 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0ef8067730 0x7f0ef8069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:32.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.587+0000 7f0f17400640 1 --2- 172.21.15.8:0/1718993482 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0ef8067730 0x7f0ef8069bf0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0f18070b80 tx=0x7f0f080a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:32.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:32.627+0000 7f0f0f400640 1 -- 172.21.15.8:0/1718993482 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f0f10057080 con 0x7f0f18153950 2024-03-23T23:51:33.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.327+0000 7f0f1cc00640 1 -- 172.21.15.8:0/1718993482 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f0f18075800 con 0x7f0f18153950 2024-03-23T23:51:33.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.339+0000 7f0f0f400640 1 -- 172.21.15.8:0/1718993482 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1560 (secure 0 0 0) 0x7f0f10057080 con 0x7f0f18153950 2024-03-23T23:51:33.344 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":66,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:51:33.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.347+0000 7f0f1cc00640 1 -- 172.21.15.8:0/1718993482 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0ef8067730 msgr2=0x7f0ef8069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:33.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.347+0000 7f0f1cc00640 1 --2- 172.21.15.8:0/1718993482 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0ef8067730 0x7f0ef8069bf0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0f18070b80 tx=0x7f0f080a6000 comp rx=0 tx=0).stop 2024-03-23T23:51:33.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.347+0000 7f0f1cc00640 1 -- 172.21.15.8:0/1718993482 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f18153950 msgr2=0x7f0f181f37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:33.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.347+0000 7f0f1cc00640 1 --2- 172.21.15.8:0/1718993482 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f18153950 0x7f0f181f37f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0f1000cce0 tx=0x7f0f1000a660 comp rx=0 tx=0).stop 2024-03-23T23:51:33.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.351+0000 7f0f1cc00640 1 -- 172.21.15.8:0/1718993482 shutdown_connections 2024-03-23T23:51:33.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.351+0000 7f0f1cc00640 1 --2- 172.21.15.8:0/1718993482 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0ef8067730 0x7f0ef8069bf0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:33.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.351+0000 7f0f1cc00640 1 --2- 172.21.15.8:0/1718993482 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f18153950 0x7f0f181f37f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:33.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.351+0000 7f0f1cc00640 1 --2- 172.21.15.8:0/1718993482 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f180c1cd0 0x7f0f181f32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:33.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.351+0000 7f0f1cc00640 1 --2- 172.21.15.8:0/1718993482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f1806ccf0 0x7f0f1806d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:33.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.351+0000 7f0f1cc00640 1 -- 172.21.15.8:0/1718993482 >> 172.21.15.8:0/1718993482 conn(0x7f0f180c6b70 msgr2=0x7f0f18163ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:51:33.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.355+0000 7f0f1cc00640 1 -- 172.21.15.8:0/1718993482 shutdown_connections 2024-03-23T23:51:33.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.355+0000 7f0f1cc00640 1 -- 172.21.15.8:0/1718993482 wait complete. 2024-03-23T23:51:33.421 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T23:51:33.421 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T23:51:33.421 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:51:33.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.771+0000 7f0a69c00640 1 Processor -- start 2024-03-23T23:51:33.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.771+0000 7f0a69c00640 1 -- start start 2024-03-23T23:51:33.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.779+0000 7f0a69c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0a5c0d3ab0 0x7f0a5c00a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:33.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.779+0000 7f0a69c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0a5c007360 0x7f0a5c0da330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:33.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.779+0000 7f0a69c00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a5c04b300 con 0x7f0a5c006f00 2024-03-23T23:51:33.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.779+0000 7f0a69c00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a5c00aed0 con 0x7f0a5c007360 2024-03-23T23:51:33.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.779+0000 7f0a69c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a5c0da870 con 0x7f0a5c0d3ab0 2024-03-23T23:51:33.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.783+0000 7f0a63e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0a5c0d3ab0 0x7f0a5c00a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:33.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.783+0000 7f0a63e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0a5c0d3ab0 0x7f0a5c00a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:41866/0 (socket says 172.21.15.8:41866) 2024-03-23T23:51:33.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.783+0000 7f0a63e00640 1 -- 172.21.15.8:0/1246019483 learned_addr learned my addr 172.21.15.8:0/1246019483 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:51:33.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.783+0000 7f0a69200640 1 --2- 172.21.15.8:0/1246019483 >> v2:172.21.15.8:3300/0 conn(0x7f0a5c007360 0x7f0a5c0da330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:33.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.783+0000 7f0a69200640 1 -- 172.21.15.8:0/1246019483 >> v2:172.21.15.196:3300/0 conn(0x7f0a5c0d3ab0 msgr2=0x7f0a5c00a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:51:33.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.783+0000 7f0a69200640 1 --2- 172.21.15.8:0/1246019483 >> v2:172.21.15.196:3300/0 conn(0x7f0a5c0d3ab0 0x7f0a5c00a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:33.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.783+0000 7f0a69200640 1 -- 172.21.15.8:0/1246019483 >> v1:172.21.15.8:6789/0 conn(0x7f0a5c006f00 legacy=0x7f0a5c0d9c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:51:33.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.787+0000 7f0a69200640 1 -- 172.21.15.8:0/1246019483 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5c046300 con 0x7f0a5c007360 2024-03-23T23:51:33.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.791+0000 7f0a63e00640 1 --2- 172.21.15.8:0/1246019483 >> v2:172.21.15.196:3300/0 conn(0x7f0a5c0d3ab0 0x7f0a5c00a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:51:33.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.795+0000 7f0a69200640 1 --2- 172.21.15.8:0/1246019483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a5c007360 0x7f0a5c0da330 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0a640695d0 tx=0x7f0a640990d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d48f804f60273001 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:33.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.799+0000 7f0a62a00640 1 -- 172.21.15.8:0/1246019483 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a641209e0 con 0x7f0a5c007360 2024-03-23T23:51:33.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.799+0000 7f0a62a00640 1 -- 172.21.15.8:0/1246019483 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a64120b80 con 0x7f0a5c007360 2024-03-23T23:51:33.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.799+0000 7f0a62a00640 1 -- 172.21.15.8:0/1246019483 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6406f480 con 0x7f0a5c007360 2024-03-23T23:51:33.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.799+0000 7f0a69c00640 1 -- 172.21.15.8:0/1246019483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a5c007360 msgr2=0x7f0a5c0da330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:33.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.799+0000 7f0a69c00640 1 --2- 172.21.15.8:0/1246019483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a5c007360 0x7f0a5c0da330 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0a640695d0 tx=0x7f0a640990d0 comp rx=0 tx=0).stop 2024-03-23T23:51:33.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.799+0000 7f0a69c00640 1 -- 172.21.15.8:0/1246019483 shutdown_connections 2024-03-23T23:51:33.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.799+0000 7f0a69c00640 1 --2- 172.21.15.8:0/1246019483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a5c007360 0x7f0a5c0da330 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:33.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.799+0000 7f0a69c00640 1 --2- 172.21.15.8:0/1246019483 >> v2:172.21.15.196:3300/0 conn(0x7f0a5c0d3ab0 0x7f0a5c00a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:33.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.799+0000 7f0a69c00640 1 -- 172.21.15.8:0/1246019483 >> 172.21.15.8:0/1246019483 conn(0x7f0a5c048260 msgr2=0x7f0a5c048670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:51:33.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.803+0000 7f0a69c00640 1 -- 172.21.15.8:0/1246019483 shutdown_connections 2024-03-23T23:51:33.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.811+0000 7f0a69c00640 1 -- 172.21.15.8:0/1246019483 wait complete. 2024-03-23T23:51:33.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.811+0000 7f0a69c00640 1 Processor -- start 2024-03-23T23:51:33.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.819+0000 7f0a69c00640 1 -- start start 2024-03-23T23:51:33.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.819+0000 7f0a69c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a5c006f00 0x7f0a5c0d6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:33.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.819+0000 7f0a69c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a5c007360 0x7f0a5c0ce250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:33.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.823+0000 7f0a69c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a5c0d3ab0 0x7f0a5c0caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:33.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.823+0000 7f0a69c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c0d3e90 con 0x7f0a5c0d3ab0 2024-03-23T23:51:33.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.823+0000 7f0a69c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c046950 con 0x7f0a5c007360 2024-03-23T23:51:33.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.823+0000 7f0a69c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c0d4010 con 0x7f0a5c006f00 2024-03-23T23:51:33.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.823+0000 7f0a63400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a5c007360 0x7f0a5c0ce250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:33.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.823+0000 7f0a63400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a5c007360 0x7f0a5c0ce250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:41882/0 (socket says 172.21.15.8:41882) 2024-03-23T23:51:33.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.823+0000 7f0a63400640 1 -- 172.21.15.8:0/2963252126 learned_addr learned my addr 172.21.15.8:0/2963252126 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:51:33.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.823+0000 7f0a63e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a5c006f00 0x7f0a5c0d6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:33.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.823+0000 7f0a69200640 1 --2- 172.21.15.8:0/2963252126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a5c0d3ab0 0x7f0a5c0caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:33.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.827+0000 7f0a63400640 1 -- 172.21.15.8:0/2963252126 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a5c006f00 msgr2=0x7f0a5c0d6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:33.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.827+0000 7f0a63400640 1 --2- 172.21.15.8:0/2963252126 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a5c006f00 0x7f0a5c0d6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:33.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.831+0000 7f0a63400640 1 -- 172.21.15.8:0/2963252126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a5c0d3ab0 msgr2=0x7f0a5c0caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:33.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.831+0000 7f0a63400640 1 --2- 172.21.15.8:0/2963252126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a5c0d3ab0 0x7f0a5c0caa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:33.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.831+0000 7f0a63400640 1 -- 172.21.15.8:0/2963252126 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5c0ce790 con 0x7f0a5c007360 2024-03-23T23:51:33.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.831+0000 7f0a63400640 1 --2- 172.21.15.8:0/2963252126 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a5c007360 0x7f0a5c0ce250 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0a5000b420 tx=0x7f0a5000b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:33.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.835+0000 7f0a57e00640 1 -- 172.21.15.8:0/2963252126 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a50011830 con 0x7f0a5c007360 2024-03-23T23:51:33.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.835+0000 7f0a57e00640 1 -- 172.21.15.8:0/2963252126 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a50016070 con 0x7f0a5c007360 2024-03-23T23:51:33.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.835+0000 7f0a57e00640 1 -- 172.21.15.8:0/2963252126 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a50011c30 con 0x7f0a5c007360 2024-03-23T23:51:33.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.835+0000 7f0a69c00640 1 -- 172.21.15.8:0/2963252126 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a5c045c10 con 0x7f0a5c007360 2024-03-23T23:51:33.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.835+0000 7f0a69c00640 1 -- 172.21.15.8:0/2963252126 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a5c0d5570 con 0x7f0a5c007360 2024-03-23T23:51:33.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.843+0000 7f0a69c00640 1 --2- 172.21.15.8:0/2963252126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a40002a80 0x7f0a40004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:33.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.843+0000 7f0a69c00640 1 -- 172.21.15.8:0/2963252126 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a40007ed0 con 0x7f0a40002a80 2024-03-23T23:51:33.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.843+0000 7f0a63e00640 1 --2- 172.21.15.8:0/2963252126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a40002a80 0x7f0a40004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:33.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.843+0000 7f0a63e00640 1 -- 172.21.15.8:0/2963252126 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0a400080d0 con 0x7f0a40002a80 2024-03-23T23:51:33.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.843+0000 7f0a63e00640 1 --2- 172.21.15.8:0/2963252126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a40002a80 0x7f0a40004f40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0a58011600 tx=0x7f0a58011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:33.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.843+0000 7f0a57e00640 1 -- 172.21.15.8:0/2963252126 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f0a5001b460 con 0x7f0a5c007360 2024-03-23T23:51:33.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.847+0000 7f0a57e00640 1 --2- 172.21.15.8:0/2963252126 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0a440676b0 0x7f0a44069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:33.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.851+0000 7f0a57e00640 1 -- 172.21.15.8:0/2963252126 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f0a50085720 con 0x7f0a5c007360 2024-03-23T23:51:33.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.851+0000 7f0a57e00640 1 -- 172.21.15.8:0/2963252126 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a58019020 con 0x7f0a40002a80 2024-03-23T23:51:33.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.851+0000 7f0a57e00640 1 -- 172.21.15.8:0/2963252126 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f0a58004440 con 0x7f0a40002a80 2024-03-23T23:51:33.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.851+0000 7f0a57e00640 1 -- 172.21.15.8:0/2963252126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a40002a80 msgr2=0x7f0a40004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:33.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.851+0000 7f0a57e00640 1 --2- 172.21.15.8:0/2963252126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a40002a80 0x7f0a40004f40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0a58011600 tx=0x7f0a58011ac0 comp rx=0 tx=0).stop 2024-03-23T23:51:33.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.851+0000 7f0a57e00640 1 -- 172.21.15.8:0/2963252126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a40002a80 msgr2=0x7f0a40004f40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:51:33.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.851+0000 7f0a57e00640 1 --2- 172.21.15.8:0/2963252126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a40002a80 0x7f0a40004f40 secure :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0a58011600 tx=0x7f0a58011ac0 comp rx=0 tx=0).stop 2024-03-23T23:51:33.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.859+0000 7f0a69200640 1 --2- 172.21.15.8:0/2963252126 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0a440676b0 0x7f0a44069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:33.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.871+0000 7f0a69200640 1 --2- 172.21.15.8:0/2963252126 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0a440676b0 0x7f0a44069b70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c048ee0 tx=0x7f0a64122070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:33.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.871+0000 7f0a69c00640 1 --2- 172.21.15.8:0/2963252126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a40006ec0 0x7f0a40007350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:33.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.871+0000 7f0a69c00640 1 -- 172.21.15.8:0/2963252126 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4000a4b0 con 0x7f0a40006ec0 2024-03-23T23:51:33.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.875+0000 7f0a63e00640 1 --2- 172.21.15.8:0/2963252126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a40006ec0 0x7f0a40007350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:33.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.875+0000 7f0a63e00640 1 -- 172.21.15.8:0/2963252126 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0a40007890 con 0x7f0a40006ec0 2024-03-23T23:51:33.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.875+0000 7f0a63e00640 1 --2- 172.21.15.8:0/2963252126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a40006ec0 0x7f0a40007350 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0a58011600 tx=0x7f0a58004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:33.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.875+0000 7f0a57e00640 1 -- 172.21.15.8:0/2963252126 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a58019070 con 0x7f0a40006ec0 2024-03-23T23:51:33.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.879+0000 7f0a57e00640 1 -- 172.21.15.8:0/2963252126 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5184 (secure 0 0 0) 0x7f0a580202d0 con 0x7f0a40006ec0 2024-03-23T23:51:33.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.879+0000 7f0a57e00640 1 -- 172.21.15.8:0/2963252126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a40006ec0 msgr2=0x7f0a40007350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:33.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.879+0000 7f0a57e00640 1 --2- 172.21.15.8:0/2963252126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a40006ec0 0x7f0a40007350 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0a58011600 tx=0x7f0a58004740 comp rx=0 tx=0).stop 2024-03-23T23:51:33.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.879+0000 7f0a57e00640 1 -- 172.21.15.8:0/2963252126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a40006ec0 msgr2=0x7f0a40007350 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:51:33.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.879+0000 7f0a57e00640 1 --2- 172.21.15.8:0/2963252126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a40006ec0 0x7f0a40007350 secure :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0a58011600 tx=0x7f0a58004740 comp rx=0 tx=0).stop 2024-03-23T23:51:33.885 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:51:33.885 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:51:33.885 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:51:33.885 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:51:33.885 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 66, 2024-03-23T23:51:33.885 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:51:33.885 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:51:33.885 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:51:33.885 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:51:33.885 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:33.885 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 1, 2024-03-23T23:51:33.886 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:51:33.886 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:51:33.886 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:51:33.886 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:51:33.886 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:51:33.886 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:51:33.886 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:51:33.886 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:51:33.886 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:51:33.886 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:51:33.886 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:51:33.886 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:51:33.886 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:51:33.886 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:51:33.887 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:33.887 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:51:33.887 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:51:33.887 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:51:33.887 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:51:33.887 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:51:33.887 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:51:33.887 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:51:33.887 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:51:33.887 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:51:33.887 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:51:33.887 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:51:33.887 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:51:33.888 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:51:33.888 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:33.888 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:33.888 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:51:33.888 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:51:33.888 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:51:33.888 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:51:33.888 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:51:33.888 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:51:33.888 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:51:33.888 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:51:33.888 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:51:33.888 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:51:33.888 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:51:33.889 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:51:33.889 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:51:33.889 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:51:33.889 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:51:33.889 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:51:33.889 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:51:33.889 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:51:33.889 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:51:33.889 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:51:33.889 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:51:33.889 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:51:33.889 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:51:33.889 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:51:33.889 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:51:33.889 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:51:33.890 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:51:33.890 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:51:33.890 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:33.890 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:51:33.890 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:33.890 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:51:33.890 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:33.890 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:51:33.890 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:51:33.890 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:51:33.890 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:51:33.890 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:33.890 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:51:33.891 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:51:33.891 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:33.891 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:33.891 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:33.891 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:51:33.891 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:51:33.891 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:33.891 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:33.891 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:33.891 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:33.891 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:51:33.891 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:51:33.891 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:51:33.891 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:51:33.891 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:51:33.892 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:33.892 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:33.892 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:51:33.892 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:51:33.892 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:51:33.892 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:51:33.892 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:33.892 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:51:33.892 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:51:33.892 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:33.892 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:33.892 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:33.892 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:51:33.892 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:51:33.893 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:33.893 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:33.893 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:33.893 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:33.893 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:51:33.893 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:51:33.893 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:51:33.893 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:51:33.893 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:51:33.893 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:33.893 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:33.893 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:51:33.893 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:51:33.893 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:51:33.894 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:51:33.894 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:33.894 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:51:33.894 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:51:33.894 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:33.894 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:33.894 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:33.894 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:51:33.895 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:51:33.895 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:33.895 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:33.895 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:33.895 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:33.895 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:51:33.895 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:51:33.895 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:51:33.895 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:51:33.895 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:51:33.898 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:33.898 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:33.898 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:33.898 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:51:33.898 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:51:33.898 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:33.898 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:51:33.898 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:51:33.898 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:51:33.898 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:33.899 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:33.899 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:51:33.899 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:33.899 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:51:33.899 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:51:33.899 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:51:33.899 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:33.899 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:33.899 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:51:33.900 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:33.900 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:51:33.900 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:51:33.900 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5 2024-03-23T23:51:33.900 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:33.900 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:33.900 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:51:33.900 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:33.900 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:51:33.900 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:51:33.900 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:51:33.900 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:33.901 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:33.901 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:51:33.901 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:51:33.901 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:51:33.901 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:33.901 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:33.901 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:51:33.901 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:33.901 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:51:33.901 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:51:33.901 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:51:33.902 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:33.902 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:33.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:33.902 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:51:33.902 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:51:33.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.879+0000 7f0a69c00640 1 -- 172.21.15.8:0/2963252126 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0a440676b0 msgr2=0x7f0a44069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:33.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.879+0000 7f0a69c00640 1 --2- 172.21.15.8:0/2963252126 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0a440676b0 0x7f0a44069b70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c048ee0 tx=0x7f0a64122070 comp rx=0 tx=0).stop 2024-03-23T23:51:33.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.879+0000 7f0a69200640 1 -- 172.21.15.8:0/2963252126 reap_dead start 2024-03-23T23:51:33.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.879+0000 7f0a69c00640 1 -- 172.21.15.8:0/2963252126 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a5c007360 msgr2=0x7f0a5c0ce250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:33.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.879+0000 7f0a69c00640 1 --2- 172.21.15.8:0/2963252126 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a5c007360 0x7f0a5c0ce250 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0a5000b420 tx=0x7f0a5000b8e0 comp rx=0 tx=0).stop 2024-03-23T23:51:33.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.879+0000 7f0a69c00640 1 -- 172.21.15.8:0/2963252126 shutdown_connections 2024-03-23T23:51:33.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.879+0000 7f0a69c00640 1 --2- 172.21.15.8:0/2963252126 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a5c007360 0x7f0a5c0ce250 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:33.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.879+0000 7f0a69c00640 1 -- 172.21.15.8:0/2963252126 >> 172.21.15.8:0/2963252126 conn(0x7f0a5c048260 msgr2=0x7f0a5c02ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:51:33.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.879+0000 7f0a69c00640 1 -- 172.21.15.8:0/2963252126 shutdown_connections 2024-03-23T23:51:33.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:33.879+0000 7f0a69c00640 1 -- 172.21.15.8:0/2963252126 wait complete. 2024-03-23T23:51:33.941 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:51:33.941 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T23:51:33.942 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:51:34.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.279+0000 7f3c7ec00640 1 Processor -- start 2024-03-23T23:51:34.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.279+0000 7f3c7ec00640 1 -- start start 2024-03-23T23:51:34.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.283+0000 7f3c7ec00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c7806ea50 0x7f3c7814eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:34.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.283+0000 7f3c7ec00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c78071b60 con 0x7f3c78151bb0 2024-03-23T23:51:34.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.283+0000 7f3c7ec00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c78071e40 con 0x7f3c78151f90 2024-03-23T23:51:34.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.283+0000 7f3c7ec00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c78072120 con 0x7f3c7806ea50 2024-03-23T23:51:34.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.283+0000 7f3c77e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f3c78151bb0 0x7f3c780c1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:44008/0 (socket says 172.21.15.8:44008) 2024-03-23T23:51:34.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.283+0000 7f3c77e00640 1 -- 172.21.15.8:0/3505595067 learned_addr learned my addr 172.21.15.8:0/3505595067 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:51:34.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.287+0000 7f3c76a00640 1 -- 172.21.15.8:0/3505595067 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3201402895 0 0) 0x7f3c78071b60 con 0x7f3c78151bb0 2024-03-23T23:51:34.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.287+0000 7f3c76a00640 1 -- 172.21.15.8:0/3505595067 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c5c003530 con 0x7f3c78151bb0 2024-03-23T23:51:34.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.287+0000 7f3c76a00640 1 -- 172.21.15.8:0/3505595067 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1688580425 0 0) 0x7f3c78071e40 con 0x7f3c78151f90 2024-03-23T23:51:34.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.287+0000 7f3c76a00640 1 -- 172.21.15.8:0/3505595067 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c78071b60 con 0x7f3c78151f90 2024-03-23T23:51:34.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.287+0000 7f3c76a00640 1 -- 172.21.15.8:0/3505595067 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2518541533 0 0) 0x7f3c78071b60 con 0x7f3c78151f90 2024-03-23T23:51:34.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.287+0000 7f3c76a00640 1 -- 172.21.15.8:0/3505595067 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c7806ea50 msgr2=0x7f3c7814eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:51:34.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.287+0000 7f3c76a00640 1 --2- 172.21.15.8:0/3505595067 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c7806ea50 0x7f3c7814eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:34.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.287+0000 7f3c76a00640 1 -- 172.21.15.8:0/3505595067 >> v1:172.21.15.8:6789/0 conn(0x7f3c78151bb0 legacy=0x7f3c780c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:34.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.287+0000 7f3c76a00640 1 -- 172.21.15.8:0/3505595067 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c780c3590 con 0x7f3c78151f90 2024-03-23T23:51:34.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.287+0000 7f3c76a00640 1 -- 172.21.15.8:0/3505595067 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7f3c70001980 con 0x7f3c78151f90 2024-03-23T23:51:34.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.287+0000 7f3c76a00640 1 -- 172.21.15.8:0/3505595067 >> v1:172.21.15.196:6789/0 conn(0x7f3c78151f90 legacy=0x7f3c7806e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:34.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.287+0000 7f3c76a00640 1 --2- 172.21.15.8:0/3505595067 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c7806ea50 0x7f3c5c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:34.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.287+0000 7f3c76a00640 1 --2- 172.21.15.8:0/3505595067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c5c006c00 0x7f3c5c003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:34.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.287+0000 7f3c77e00640 1 --2- 172.21.15.8:0/3505595067 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c7806ea50 0x7f3c5c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:34.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.287+0000 7f3c76a00640 1 --2- 172.21.15.8:0/3505595067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c5c00d4d0 0x7f3c5c00f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:34.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.287+0000 7f3c76a00640 1 -- 172.21.15.8:0/3505595067 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c78072120 con 0x7f3c5c006c00 2024-03-23T23:51:34.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.287+0000 7f3c76a00640 1 -- 172.21.15.8:0/3505595067 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c010220 con 0x7f3c5c00d4d0 2024-03-23T23:51:34.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.287+0000 7f3c76a00640 1 -- 172.21.15.8:0/3505595067 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c010420 con 0x7f3c7806ea50 2024-03-23T23:51:34.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.291+0000 7f3c7cc00640 1 --2- 172.21.15.8:0/3505595067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c5c00d4d0 0x7f3c5c00f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:34.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.291+0000 7f3c77400640 1 --2- 172.21.15.8:0/3505595067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c5c006c00 0x7f3c5c003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:34.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.291+0000 7f3c77e00640 1 -- 172.21.15.8:0/3505595067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c5c00d4d0 msgr2=0x7f3c5c00f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:51:34.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.291+0000 7f3c77e00640 1 --2- 172.21.15.8:0/3505595067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c5c00d4d0 0x7f3c5c00f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:34.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.291+0000 7f3c77e00640 1 -- 172.21.15.8:0/3505595067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c5c006c00 msgr2=0x7f3c5c003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:51:34.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.291+0000 7f3c77e00640 1 --2- 172.21.15.8:0/3505595067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c5c006c00 0x7f3c5c003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:34.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.291+0000 7f3c77e00640 1 -- 172.21.15.8:0/3505595067 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c78071b60 con 0x7f3c7806ea50 2024-03-23T23:51:34.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.303+0000 7f3c77e00640 1 --2- 172.21.15.8:0/3505595067 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c7806ea50 0x7f3c5c0039f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3c64007fa0 tx=0x7f3c6401ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27740096c3d5dac5 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:34.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.311+0000 7f3c76a00640 1 -- 172.21.15.8:0/3505595067 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c64007b70 con 0x7f3c7806ea50 2024-03-23T23:51:34.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.315+0000 7f3c76a00640 1 -- 172.21.15.8:0/3505595067 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c640a9020 con 0x7f3c7806ea50 2024-03-23T23:51:34.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.315+0000 7f3c76a00640 1 -- 172.21.15.8:0/3505595067 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c64004b70 con 0x7f3c7806ea50 2024-03-23T23:51:34.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.319+0000 7f3c7ec00640 1 -- 172.21.15.8:0/3505595067 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c7806ea50 msgr2=0x7f3c5c0039f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:34.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.319+0000 7f3c7ec00640 1 --2- 172.21.15.8:0/3505595067 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c7806ea50 0x7f3c5c0039f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3c64007fa0 tx=0x7f3c6401ca90 comp rx=0 tx=0).stop 2024-03-23T23:51:34.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.319+0000 7f3c7cc00640 1 -- 172.21.15.8:0/3505595067 reap_dead start 2024-03-23T23:51:34.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.319+0000 7f3c7ec00640 1 -- 172.21.15.8:0/3505595067 shutdown_connections 2024-03-23T23:51:34.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.319+0000 7f3c7ec00640 1 -- 172.21.15.8:0/3505595067 >> 172.21.15.8:0/3505595067 conn(0x7f3c780a9870 msgr2=0x7f3c7806b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:51:34.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.323+0000 7f3c7ec00640 1 -- 172.21.15.8:0/3505595067 shutdown_connections 2024-03-23T23:51:34.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.323+0000 7f3c7ec00640 1 -- 172.21.15.8:0/3505595067 wait complete. 2024-03-23T23:51:34.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.331+0000 7f3c7ec00640 1 Processor -- start 2024-03-23T23:51:34.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.335+0000 7f3c7ec00640 1 -- start start 2024-03-23T23:51:34.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.343+0000 7f3c7ec00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c7806ea50 0x7f3c78150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:34.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.343+0000 7f3c7ec00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c781558e0 0x7f3c78141ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:34.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.343+0000 7f3c77e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c7806ea50 0x7f3c78150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:34.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.343+0000 7f3c77e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c7806ea50 0x7f3c78150e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:35398/0 (socket says 172.21.15.8:35398) 2024-03-23T23:51:34.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.347+0000 7f3c77e00640 1 -- 172.21.15.8:0/3906354640 learned_addr learned my addr 172.21.15.8:0/3906354640 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:51:34.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.347+0000 7f3c7ec00640 1 --2- 172.21.15.8:0/3906354640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c78154c70 0x7f3c78155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:34.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.347+0000 7f3c7ec00640 1 -- 172.21.15.8:0/3906354640 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7815d210 con 0x7f3c781558e0 2024-03-23T23:51:34.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.347+0000 7f3c7ec00640 1 -- 172.21.15.8:0/3906354640 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7814f590 con 0x7f3c78154c70 2024-03-23T23:51:34.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.347+0000 7f3c7ec00640 1 -- 172.21.15.8:0/3906354640 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7815d390 con 0x7f3c7806ea50 2024-03-23T23:51:34.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.347+0000 7f3c77400640 1 --2- 172.21.15.8:0/3906354640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c781558e0 0x7f3c78141ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:34.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.347+0000 7f3c7cc00640 1 --2- 172.21.15.8:0/3906354640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c78154c70 0x7f3c78155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:34.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.351+0000 7f3c7cc00640 1 -- 172.21.15.8:0/3906354640 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c7806ea50 msgr2=0x7f3c78150e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:34.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.351+0000 7f3c7cc00640 1 --2- 172.21.15.8:0/3906354640 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c7806ea50 0x7f3c78150e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:34.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.351+0000 7f3c7cc00640 1 -- 172.21.15.8:0/3906354640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c781558e0 msgr2=0x7f3c78141ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:34.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.351+0000 7f3c7cc00640 1 --2- 172.21.15.8:0/3906354640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c781558e0 0x7f3c78141ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:34.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.351+0000 7f3c7cc00640 1 -- 172.21.15.8:0/3906354640 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c781fe030 con 0x7f3c78154c70 2024-03-23T23:51:34.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.351+0000 7f3c7cc00640 1 --2- 172.21.15.8:0/3906354640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c78154c70 0x7f3c78155120 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3c78071640 tx=0x7f3c6800c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:34.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.351+0000 7f3c6fe00640 1 -- 172.21.15.8:0/3906354640 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c68011800 con 0x7f3c78154c70 2024-03-23T23:51:34.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.351+0000 7f3c6fe00640 1 -- 172.21.15.8:0/3906354640 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c68015030 con 0x7f3c78154c70 2024-03-23T23:51:34.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.351+0000 7f3c6fe00640 1 -- 172.21.15.8:0/3906354640 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c68011be0 con 0x7f3c78154c70 2024-03-23T23:51:34.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.355+0000 7f3c7ec00640 1 -- 172.21.15.8:0/3906354640 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c781fe2d0 con 0x7f3c78154c70 2024-03-23T23:51:34.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.355+0000 7f3c7ec00640 1 -- 172.21.15.8:0/3906354640 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c781fe890 con 0x7f3c78154c70 2024-03-23T23:51:34.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.359+0000 7f3c7ec00640 1 --2- 172.21.15.8:0/3906354640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c50002a80 0x7f3c50004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:34.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.359+0000 7f3c7ec00640 1 -- 172.21.15.8:0/3906354640 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c50007ed0 con 0x7f3c50002a80 2024-03-23T23:51:34.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.363+0000 7f3c6fe00640 1 -- 172.21.15.8:0/3906354640 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3c680193d0 con 0x7f3c78154c70 2024-03-23T23:51:34.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.363+0000 7f3c77e00640 1 --2- 172.21.15.8:0/3906354640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c50002a80 0x7f3c50004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:34.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.363+0000 7f3c6fe00640 1 --2- 172.21.15.8:0/3906354640 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3c58067760 0x7f3c58069c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:34.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.363+0000 7f3c6fe00640 1 -- 172.21.15.8:0/3906354640 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f3c680858b0 con 0x7f3c78154c70 2024-03-23T23:51:34.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.367+0000 7f3c77400640 1 --2- 172.21.15.8:0/3906354640 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3c58067760 0x7f3c58069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:34.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.367+0000 7f3c77e00640 1 -- 172.21.15.8:0/3906354640 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3c500080d0 con 0x7f3c50002a80 2024-03-23T23:51:34.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.367+0000 7f3c77400640 1 --2- 172.21.15.8:0/3906354640 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3c58067760 0x7f3c58069c20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3c7815b1d0 tx=0x7f3c70009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:34.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.375+0000 7f3c77e00640 1 --2- 172.21.15.8:0/3906354640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c50002a80 0x7f3c50004f40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3c6401c8c0 tx=0x7f3c64019830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:34.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.379+0000 7f3c6fe00640 1 -- 172.21.15.8:0/3906354640 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c64004970 con 0x7f3c50002a80 2024-03-23T23:51:34.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.379+0000 7f3c6fe00640 1 -- 172.21.15.8:0/3906354640 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f3c64004b10 con 0x7f3c50002a80 2024-03-23T23:51:34.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.379+0000 7f3c6fe00640 1 -- 172.21.15.8:0/3906354640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c50002a80 msgr2=0x7f3c50004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:34.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.379+0000 7f3c6fe00640 1 --2- 172.21.15.8:0/3906354640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c50002a80 0x7f3c50004f40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3c6401c8c0 tx=0x7f3c64019830 comp rx=0 tx=0).stop 2024-03-23T23:51:34.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.379+0000 7f3c6fe00640 1 -- 172.21.15.8:0/3906354640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c50002a80 msgr2=0x7f3c50004f40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:51:34.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.379+0000 7f3c6fe00640 1 --2- 172.21.15.8:0/3906354640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c50002a80 0x7f3c50004f40 secure :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3c6401c8c0 tx=0x7f3c64019830 comp rx=0 tx=0).stop 2024-03-23T23:51:34.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.399+0000 7f3c7ec00640 1 --2- 172.21.15.8:0/3906354640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c50006f40 0x7f3c500073d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:34.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.399+0000 7f3c7ec00640 1 -- 172.21.15.8:0/3906354640 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5000a4b0 con 0x7f3c50006f40 2024-03-23T23:51:34.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.399+0000 7f3c77e00640 1 --2- 172.21.15.8:0/3906354640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c50006f40 0x7f3c500073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:34.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.399+0000 7f3c77e00640 1 -- 172.21.15.8:0/3906354640 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3c50007910 con 0x7f3c50006f40 2024-03-23T23:51:34.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.411+0000 7f3c77e00640 1 --2- 172.21.15.8:0/3906354640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c50006f40 0x7f3c500073d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3c780c7190 tx=0x7f3c5c004830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:34.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.411+0000 7f3c6fe00640 1 -- 172.21.15.8:0/3906354640 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c64007520 con 0x7f3c50006f40 2024-03-23T23:51:34.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.411+0000 7f3c6fe00640 1 -- 172.21.15.8:0/3906354640 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4529 (secure 0 0 0) 0x7f3c640bf040 con 0x7f3c50006f40 2024-03-23T23:51:34.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.411+0000 7f3c6fe00640 1 -- 172.21.15.8:0/3906354640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c50006f40 msgr2=0x7f3c500073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:34.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.411+0000 7f3c6fe00640 1 --2- 172.21.15.8:0/3906354640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c50006f40 0x7f3c500073d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3c780c7190 tx=0x7f3c5c004830 comp rx=0 tx=0).stop 2024-03-23T23:51:34.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.411+0000 7f3c6fe00640 1 -- 172.21.15.8:0/3906354640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c50006f40 msgr2=0x7f3c500073d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:51:34.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.411+0000 7f3c6fe00640 1 --2- 172.21.15.8:0/3906354640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c50006f40 0x7f3c500073d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:34.418 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:51:34.418 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:51:34.418 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:51:34.419 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:51:34.419 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 66, 2024-03-23T23:51:34.419 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:51:34.419 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:51:34.419 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:51:34.419 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:51:34.419 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:34.419 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 2, 2024-03-23T23:51:34.419 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:51:34.419 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:51:34.419 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:51:34.419 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:51:34.419 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:51:34.419 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:51:34.420 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:51:34.420 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:51:34.420 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:51:34.420 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:51:34.420 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:51:34.420 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:51:34.420 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:51:34.420 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:51:34.420 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:34.420 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:51:34.420 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:51:34.420 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:51:34.420 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:51:34.420 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:51:34.421 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:51:34.421 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:51:34.421 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:51:34.421 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:51:34.421 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:51:34.421 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:51:34.421 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:51:34.421 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:51:34.421 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:34.421 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:34.421 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:51:34.421 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:51:34.421 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:51:34.421 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:51:34.422 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:51:34.422 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:51:34.422 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:51:34.422 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:51:34.422 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:51:34.422 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:51:34.422 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:51:34.422 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:51:34.422 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:51:34.422 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:51:34.422 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:51:34.423 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:51:34.423 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:51:34.423 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:51:34.423 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:51:34.423 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:51:34.423 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:51:34.423 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:51:34.423 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:51:34.423 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:51:34.423 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:51:34.423 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:51:34.424 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:51:34.424 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:51:34.424 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:34.424 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:51:34.424 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:34.424 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:51:34.424 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:34.424 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:51:34.424 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:51:34.424 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:51:34.424 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:51:34.424 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:34.424 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:51:34.424 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:51:34.425 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:34.425 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:34.425 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:34.425 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:51:34.425 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:51:34.425 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:34.425 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:34.425 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:34.425 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:34.425 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:51:34.425 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:51:34.425 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:51:34.426 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:51:34.426 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:51:34.426 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:34.426 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:34.426 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:51:34.426 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:51:34.426 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:51:34.426 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:51:34.426 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:34.426 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:51:34.426 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:51:34.426 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:34.426 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:34.427 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:34.427 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:51:34.427 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:51:34.427 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:34.427 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:34.427 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:34.427 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:34.427 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:51:34.427 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:51:34.427 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:51:34.427 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:51:34.427 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:51:34.427 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:34.427 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:34.428 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:51:34.428 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:51:34.428 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:51:34.428 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:51:34.428 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:34.428 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:51:34.428 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:51:34.428 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:34.428 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:34.428 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:34.428 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:51:34.428 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:51:34.428 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:34.428 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:34.429 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:34.429 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:34.429 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:51:34.429 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:51:34.429 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:51:34.429 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:51:34.429 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:51:34.429 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:34.429 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:34.429 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:34.429 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:51:34.429 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:51:34.429 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:34.429 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:51:34.430 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:51:34.430 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:51:34.430 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:34.430 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:34.430 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:51:34.430 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:34.430 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:51:34.430 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:51:34.430 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:51:34.430 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:34.431 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:34.431 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:34.431 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:51:34.431 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:51:34.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.419+0000 7f3c7ec00640 1 -- 172.21.15.8:0/3906354640 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3c58067760 msgr2=0x7f3c58069c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:34.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.419+0000 7f3c7ec00640 1 --2- 172.21.15.8:0/3906354640 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3c58067760 0x7f3c58069c20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3c7815b1d0 tx=0x7f3c70009040 comp rx=0 tx=0).stop 2024-03-23T23:51:34.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.419+0000 7f3c7ec00640 1 -- 172.21.15.8:0/3906354640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c78154c70 msgr2=0x7f3c78155120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:34.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.419+0000 7f3c7ec00640 1 --2- 172.21.15.8:0/3906354640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c78154c70 0x7f3c78155120 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3c78071640 tx=0x7f3c6800c890 comp rx=0 tx=0).stop 2024-03-23T23:51:34.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.419+0000 7f3c7cc00640 1 -- 172.21.15.8:0/3906354640 reap_dead start 2024-03-23T23:51:34.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.419+0000 7f3c7cc00640 1 -- 172.21.15.8:0/3906354640 reap_dead start 2024-03-23T23:51:34.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.427+0000 7f3c7ec00640 1 -- 172.21.15.8:0/3906354640 shutdown_connections 2024-03-23T23:51:34.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.427+0000 7f3c7ec00640 1 -- 172.21.15.8:0/3906354640 >> 172.21.15.8:0/3906354640 conn(0x7f3c780a9870 msgr2=0x7f3c78143350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:51:34.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.427+0000 7f3c7ec00640 1 -- 172.21.15.8:0/3906354640 shutdown_connections 2024-03-23T23:51:34.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.427+0000 7f3c7ec00640 1 -- 172.21.15.8:0/3906354640 wait complete. 2024-03-23T23:51:34.496 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:51:34.496 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T23:51:34.496 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:51:34.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.827+0000 7f0b63a00640 1 Processor -- start 2024-03-23T23:51:34.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.827+0000 7f0b63a00640 1 -- start start 2024-03-23T23:51:34.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.831+0000 7f0b63a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0b5c0c3f60 0x7f0b5c0c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:34.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.831+0000 7f0b63a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0b5c073260 0x7f0b5c157080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:34.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.831+0000 7f0b63a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b5c1575c0 0x7f0b5c15d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:34.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.831+0000 7f0b63a00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b5c0c2af0 con 0x7f0b5c073260 2024-03-23T23:51:34.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.831+0000 7f0b63a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b5c1579d0 con 0x7f0b5c0c3f60 2024-03-23T23:51:34.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.831+0000 7f0b63a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c0711c0 con 0x7f0b5c1575c0 2024-03-23T23:51:34.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.831+0000 7f0b5be00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0b5c073260 0x7f0b5c157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:34.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.831+0000 7f0b5be00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0b5c073260 0x7f0b5c157080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52142/0 (socket says 172.21.15.8:52142) 2024-03-23T23:51:34.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.831+0000 7f0b5be00640 1 -- 172.21.15.8:0/2941824105 learned_addr learned my addr 172.21.15.8:0/2941824105 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:51:34.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.835+0000 7f0b61000640 1 --2- 172.21.15.8:0/2941824105 >> v2:172.21.15.196:3300/0 conn(0x7f0b5c0c3f60 0x7f0b5c0c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:34.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.835+0000 7f0b61a00640 1 --2- 172.21.15.8:0/2941824105 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b5c1575c0 0x7f0b5c15d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:34.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.835+0000 7f0b61a00640 1 -- 172.21.15.8:0/2941824105 >> v2:172.21.15.196:3300/0 conn(0x7f0b5c0c3f60 msgr2=0x7f0b5c0c34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:51:34.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.835+0000 7f0b61a00640 1 --2- 172.21.15.8:0/2941824105 >> v2:172.21.15.196:3300/0 conn(0x7f0b5c0c3f60 0x7f0b5c0c34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:34.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.835+0000 7f0b61a00640 1 -- 172.21.15.8:0/2941824105 >> v2:172.21.15.8:3300/0 conn(0x7f0b5c073260 msgr2=0x7f0b5c157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:51:34.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.835+0000 7f0b61a00640 1 --2- 172.21.15.8:0/2941824105 >> v2:172.21.15.8:3300/0 conn(0x7f0b5c073260 0x7f0b5c157080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:34.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.835+0000 7f0b61a00640 1 -- 172.21.15.8:0/2941824105 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5c0714a0 con 0x7f0b5c1575c0 2024-03-23T23:51:34.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.843+0000 7f0b61a00640 1 --2- 172.21.15.8:0/2941824105 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b5c1575c0 0x7f0b5c15d400 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0a9cc0 tx=0x7f0b5401c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b513a20fe39dcf8e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:34.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.843+0000 7f0b5b400640 1 -- 172.21.15.8:0/2941824105 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b540ac070 con 0x7f0b5c1575c0 2024-03-23T23:51:34.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.843+0000 7f0b5b400640 1 -- 172.21.15.8:0/2941824105 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b540a66a0 con 0x7f0b5c1575c0 2024-03-23T23:51:34.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.843+0000 7f0b5b400640 1 -- 172.21.15.8:0/2941824105 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b540ac070 con 0x7f0b5c1575c0 2024-03-23T23:51:34.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.847+0000 7f0b63a00640 1 -- 172.21.15.8:0/2941824105 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b5c1575c0 msgr2=0x7f0b5c15d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:34.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.847+0000 7f0b63a00640 1 --2- 172.21.15.8:0/2941824105 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b5c1575c0 0x7f0b5c15d400 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0a9cc0 tx=0x7f0b5401c850 comp rx=0 tx=0).stop 2024-03-23T23:51:34.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.847+0000 7f0b63a00640 1 -- 172.21.15.8:0/2941824105 shutdown_connections 2024-03-23T23:51:34.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.847+0000 7f0b63a00640 1 --2- 172.21.15.8:0/2941824105 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b5c1575c0 0x7f0b5c15d400 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:34.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.847+0000 7f0b63a00640 1 --2- 172.21.15.8:0/2941824105 >> v2:172.21.15.8:3300/0 conn(0x7f0b5c073260 0x7f0b5c157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:34.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.847+0000 7f0b63a00640 1 --2- 172.21.15.8:0/2941824105 >> v2:172.21.15.196:3300/0 conn(0x7f0b5c0c3f60 0x7f0b5c0c34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:34.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.847+0000 7f0b63a00640 1 -- 172.21.15.8:0/2941824105 >> 172.21.15.8:0/2941824105 conn(0x7f0b5c0a9870 msgr2=0x7f0b5c06b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:51:34.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.851+0000 7f0b63a00640 1 -- 172.21.15.8:0/2941824105 shutdown_connections 2024-03-23T23:51:34.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.851+0000 7f0b63a00640 1 -- 172.21.15.8:0/2941824105 wait complete. 2024-03-23T23:51:34.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.855+0000 7f0b63a00640 1 Processor -- start 2024-03-23T23:51:34.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.855+0000 7f0b63a00640 1 -- start start 2024-03-23T23:51:34.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.855+0000 7f0b63a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b5c073260 0x7f0b5c1443d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:34.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.855+0000 7f0b63a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b5c0c3f60 0x7f0b5c0c51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:34.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.855+0000 7f0b63a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b5c1575c0 0x7f0b5c151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:34.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.855+0000 7f0b63a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c159d70 con 0x7f0b5c0c3f60 2024-03-23T23:51:34.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.855+0000 7f0b63a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c0c4550 con 0x7f0b5c1575c0 2024-03-23T23:51:34.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.855+0000 7f0b63a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c159ef0 con 0x7f0b5c073260 2024-03-23T23:51:34.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.859+0000 7f0b61a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b5c1575c0 0x7f0b5c151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:34.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.859+0000 7f0b61a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b5c1575c0 0x7f0b5c151f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:41938/0 (socket says 172.21.15.8:41938) 2024-03-23T23:51:34.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.859+0000 7f0b61a00640 1 -- 172.21.15.8:0/3249008813 learned_addr learned my addr 172.21.15.8:0/3249008813 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:51:34.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.859+0000 7f0b61000640 1 --2- 172.21.15.8:0/3249008813 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b5c073260 0x7f0b5c1443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:34.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.859+0000 7f0b61a00640 1 -- 172.21.15.8:0/3249008813 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b5c073260 msgr2=0x7f0b5c1443d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:34.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.859+0000 7f0b61a00640 1 --2- 172.21.15.8:0/3249008813 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b5c073260 0x7f0b5c1443d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:34.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.859+0000 7f0b61a00640 1 -- 172.21.15.8:0/3249008813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b5c0c3f60 msgr2=0x7f0b5c0c51d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:51:34.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.859+0000 7f0b61a00640 1 --2- 172.21.15.8:0/3249008813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b5c0c3f60 0x7f0b5c0c51d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:34.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.859+0000 7f0b61a00640 1 -- 172.21.15.8:0/3249008813 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5c0c6ca0 con 0x7f0b5c1575c0 2024-03-23T23:51:34.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.859+0000 7f0b61a00640 1 --2- 172.21.15.8:0/3249008813 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b5c1575c0 0x7f0b5c151f90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0b5401d0f0 tx=0x7f0b540195f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:34.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.863+0000 7f0b58c00640 1 -- 172.21.15.8:0/3249008813 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b540ac070 con 0x7f0b5c1575c0 2024-03-23T23:51:34.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.863+0000 7f0b58c00640 1 -- 172.21.15.8:0/3249008813 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b540a7690 con 0x7f0b5c1575c0 2024-03-23T23:51:34.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.863+0000 7f0b58c00640 1 -- 172.21.15.8:0/3249008813 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b54009450 con 0x7f0b5c1575c0 2024-03-23T23:51:34.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.875+0000 7f0b63a00640 1 -- 172.21.15.8:0/3249008813 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b5c144910 con 0x7f0b5c1575c0 2024-03-23T23:51:34.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.875+0000 7f0b63a00640 1 -- 172.21.15.8:0/3249008813 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5c135ca0 con 0x7f0b5c1575c0 2024-03-23T23:51:34.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.879+0000 7f0b63a00640 1 --2- 172.21.15.8:0/3249008813 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b5c0c5710 0x7f0b5c0c4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:34.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.879+0000 7f0b63a00640 1 -- 172.21.15.8:0/3249008813 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c135ee0 con 0x7f0b5c0c5710 2024-03-23T23:51:34.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.879+0000 7f0b61000640 1 --2- 172.21.15.8:0/3249008813 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b5c0c5710 0x7f0b5c0c4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:34.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.879+0000 7f0b61000640 1 -- 172.21.15.8:0/3249008813 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0b5c068270 con 0x7f0b5c0c5710 2024-03-23T23:51:34.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.879+0000 7f0b58c00640 1 -- 172.21.15.8:0/3249008813 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f0b540c2060 con 0x7f0b5c1575c0 2024-03-23T23:51:34.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.883+0000 7f0b61000640 1 --2- 172.21.15.8:0/3249008813 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b5c0c5710 0x7f0b5c0c4960 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c011600 tx=0x7f0b4c011ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:34.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.883+0000 7f0b58c00640 1 --2- 172.21.15.8:0/3249008813 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0b3c067730 0x7f0b3c069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:34.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.883+0000 7f0b58c00640 1 -- 172.21.15.8:0/3249008813 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f0b5411f910 con 0x7f0b5c1575c0 2024-03-23T23:51:34.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.887+0000 7f0b58c00640 1 -- 172.21.15.8:0/3249008813 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c004230 con 0x7f0b5c0c5710 2024-03-23T23:51:34.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.887+0000 7f0b58c00640 1 -- 172.21.15.8:0/3249008813 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f0b4c004230 con 0x7f0b5c0c5710 2024-03-23T23:51:34.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.887+0000 7f0b58c00640 1 -- 172.21.15.8:0/3249008813 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b5c0c5710 msgr2=0x7f0b5c0c4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:34.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.887+0000 7f0b58c00640 1 --2- 172.21.15.8:0/3249008813 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b5c0c5710 0x7f0b5c0c4960 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c011600 tx=0x7f0b4c011ac0 comp rx=0 tx=0).stop 2024-03-23T23:51:34.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.887+0000 7f0b58c00640 1 -- 172.21.15.8:0/3249008813 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b5c0c5710 msgr2=0x7f0b5c0c4960 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:51:34.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.887+0000 7f0b58c00640 1 --2- 172.21.15.8:0/3249008813 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b5c0c5710 0x7f0b5c0c4960 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c011600 tx=0x7f0b4c011ac0 comp rx=0 tx=0).stop 2024-03-23T23:51:34.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.895+0000 7f0b5be00640 1 --2- 172.21.15.8:0/3249008813 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0b3c067730 0x7f0b3c069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:34.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.903+0000 7f0b5be00640 1 --2- 172.21.15.8:0/3249008813 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0b3c067730 0x7f0b3c069bf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c06ecb0 tx=0x7f0b48009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:34.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.927+0000 7f0b63a00640 1 --2- 172.21.15.8:0/3249008813 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b5c15be00 0x7f0b5c1524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:34.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.927+0000 7f0b63a00640 1 -- 172.21.15.8:0/3249008813 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c154030 con 0x7f0b5c15be00 2024-03-23T23:51:34.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.939+0000 7f0b61000640 1 --2- 172.21.15.8:0/3249008813 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b5c15be00 0x7f0b5c1524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:34.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.939+0000 7f0b61000640 1 -- 172.21.15.8:0/3249008813 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0b5c0c21d0 con 0x7f0b5c15be00 2024-03-23T23:51:34.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.943+0000 7f0b61000640 1 --2- 172.21.15.8:0/3249008813 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b5c15be00 0x7f0b5c1524d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c011600 tx=0x7f0b4c0046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.947+0000 7f0b58c00640 1 -- 172.21.15.8:0/3249008813 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c003620 con 0x7f0b5c15be00 2024-03-23T23:51:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.947+0000 7f0b58c00640 1 -- 172.21.15.8:0/3249008813 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5039 (secure 0 0 0) 0x7f0b4c003620 con 0x7f0b5c15be00 2024-03-23T23:51:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.947+0000 7f0b58c00640 1 -- 172.21.15.8:0/3249008813 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b5c15be00 msgr2=0x7f0b5c1524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.947+0000 7f0b58c00640 1 --2- 172.21.15.8:0/3249008813 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b5c15be00 0x7f0b5c1524d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c011600 tx=0x7f0b4c0046d0 comp rx=0 tx=0).stop 2024-03-23T23:51:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.947+0000 7f0b58c00640 1 -- 172.21.15.8:0/3249008813 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b5c15be00 msgr2=0x7f0b5c1524d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:51:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.947+0000 7f0b58c00640 1 --2- 172.21.15.8:0/3249008813 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b5c15be00 0x7f0b5c1524d0 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c011600 tx=0x7f0b4c0046d0 comp rx=0 tx=0).stop 2024-03-23T23:51:34.955 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:51:34.955 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:51:34.955 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:51:34.955 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:51:34.956 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 66, 2024-03-23T23:51:34.956 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:51:34.956 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:51:34.956 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:51:34.956 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:51:34.956 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:34.956 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 2, 2024-03-23T23:51:34.956 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:51:34.956 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:51:34.956 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:51:34.956 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:51:34.956 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:51:34.956 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:51:34.956 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:51:34.957 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:51:34.957 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:51:34.957 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:51:34.957 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:51:34.957 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:51:34.957 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:51:34.957 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:51:34.957 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:34.957 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:51:34.957 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:51:34.957 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:51:34.957 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:51:34.957 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:51:34.958 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:51:34.958 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:51:34.958 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:51:34.958 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:51:34.958 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:51:34.958 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:51:34.958 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:51:34.958 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:51:34.958 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:34.958 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:34.958 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:51:34.958 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:51:34.958 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:51:34.959 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:51:34.959 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:51:34.959 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:51:34.959 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:51:34.959 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:51:34.959 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:51:34.959 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:51:34.959 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:51:34.959 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:51:34.959 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:51:34.959 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:51:34.959 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:51:34.959 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:51:34.959 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:51:34.959 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:51:34.960 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:51:34.960 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:51:34.960 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:51:34.960 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:51:34.960 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:51:34.960 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:51:34.960 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:51:34.960 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:51:34.960 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:51:34.960 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:51:34.960 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:34.960 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:51:34.960 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:34.961 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:51:34.961 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:34.961 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:51:34.961 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:51:34.961 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:51:34.961 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:51:34.961 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:34.961 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:51:34.961 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:51:34.961 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:34.961 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:34.961 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:34.961 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:51:34.961 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:51:34.962 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:34.962 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:34.962 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:34.962 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:34.962 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:51:34.962 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:51:34.962 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:51:34.962 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:51:34.962 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:51:34.962 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:34.962 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:34.962 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:51:34.962 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:51:34.963 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:51:34.963 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:51:34.963 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:34.963 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:51:34.963 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:51:34.963 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:34.963 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:34.963 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:34.963 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:51:34.963 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:51:34.963 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:34.963 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:34.963 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:34.964 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:34.964 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:51:34.964 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:51:34.964 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:51:34.964 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:51:34.964 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:51:34.964 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:34.964 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:34.964 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:51:34.964 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:51:34.964 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:51:34.964 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:51:34.964 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:34.964 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:51:34.965 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:51:34.965 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:34.965 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:34.965 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:34.965 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:51:34.965 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:51:34.965 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:34.965 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:34.965 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:34.965 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:34.965 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:51:34.965 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:51:34.965 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:51:34.965 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:51:34.966 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:51:34.966 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:34.966 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:34.966 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:34.966 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:51:34.966 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:51:34.966 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:34.966 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:51:34.966 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:51:34.966 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:51:34.966 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:34.966 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:34.966 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:51:34.967 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:34.967 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:51:34.967 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:51:34.967 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:51:34.967 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:34.967 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:34.967 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:51:34.967 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:34.967 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:51:34.967 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:51:34.967 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:51:34.967 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:34.967 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:34.967 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:51:34.968 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:34.968 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:51:34.968 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:51:34.968 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:51:34.968 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:34.968 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:34.968 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:51:34.968 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:34.968 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:51:34.968 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:51:34.968 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:51:34.968 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:34.968 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:34.968 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:34.969 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:51:34.969 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:51:34.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.955+0000 7f0b63a00640 1 -- 172.21.15.8:0/3249008813 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0b3c067730 msgr2=0x7f0b3c069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:34.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.955+0000 7f0b63a00640 1 --2- 172.21.15.8:0/3249008813 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0b3c067730 0x7f0b3c069bf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c06ecb0 tx=0x7f0b48009240 comp rx=0 tx=0).stop 2024-03-23T23:51:34.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.955+0000 7f0b63a00640 1 -- 172.21.15.8:0/3249008813 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b5c1575c0 msgr2=0x7f0b5c151f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:34.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.955+0000 7f0b63a00640 1 --2- 172.21.15.8:0/3249008813 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b5c1575c0 0x7f0b5c151f90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0b5401d0f0 tx=0x7f0b540195f0 comp rx=0 tx=0).stop 2024-03-23T23:51:34.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.955+0000 7f0b61a00640 1 -- 172.21.15.8:0/3249008813 reap_dead start 2024-03-23T23:51:34.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.955+0000 7f0b61a00640 1 -- 172.21.15.8:0/3249008813 reap_dead start 2024-03-23T23:51:34.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.955+0000 7f0b63a00640 1 -- 172.21.15.8:0/3249008813 shutdown_connections 2024-03-23T23:51:34.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.955+0000 7f0b63a00640 1 -- 172.21.15.8:0/3249008813 >> 172.21.15.8:0/3249008813 conn(0x7f0b5c0a9870 msgr2=0x7f0b5c158aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:51:34.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.955+0000 7f0b63a00640 1 -- 172.21.15.8:0/3249008813 shutdown_connections 2024-03-23T23:51:34.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:34.955+0000 7f0b63a00640 1 -- 172.21.15.8:0/3249008813 wait complete. 2024-03-23T23:51:35.027 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:51:35.027 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-03-23T23:51:35.028 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-03-23T23:51:35.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.343+0000 7f5ce9600640 1 Processor -- start 2024-03-23T23:51:35.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.343+0000 7f5ce9600640 1 -- start start 2024-03-23T23:51:35.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.343+0000 7f5ce9600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5cdc0dbce0 0x7f5cdc0e2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:35.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.343+0000 7f5ce9600640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cdc0de870 con 0x7f5cdc00b0c0 2024-03-23T23:51:35.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.343+0000 7f5ce9600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cdc047620 con 0x7f5cdc0ded20 2024-03-23T23:51:35.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.343+0000 7f5ce9600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc0e2c50 con 0x7f5cdc0dbce0 2024-03-23T23:51:35.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.347+0000 7f5ce3400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f5cdc00b0c0 0x7f5cdc006f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:44016/0 (socket says 172.21.15.8:44016) 2024-03-23T23:51:35.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.347+0000 7f5ce3400640 1 -- 172.21.15.8:0/3152108886 learned_addr learned my addr 172.21.15.8:0/3152108886 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:51:35.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.347+0000 7f5ce2a00640 1 -- 172.21.15.8:0/3152108886 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2833329952 0 0) 0x7f5cdc0de870 con 0x7f5cdc00b0c0 2024-03-23T23:51:35.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.347+0000 7f5ce2a00640 1 -- 172.21.15.8:0/3152108886 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ccc003530 con 0x7f5cdc00b0c0 2024-03-23T23:51:35.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.351+0000 7f5ce3e00640 1 --2- 172.21.15.8:0/3152108886 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5cdc0dbce0 0x7f5cdc0e2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:35.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.355+0000 7f5ce2a00640 1 -- 172.21.15.8:0/3152108886 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3498630182 0 0) 0x7f5ccc003530 con 0x7f5cdc00b0c0 2024-03-23T23:51:35.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.355+0000 7f5ce2a00640 1 -- 172.21.15.8:0/3152108886 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5cdc0dbce0 msgr2=0x7f5cdc0e2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:51:35.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.355+0000 7f5ce2a00640 1 --2- 172.21.15.8:0/3152108886 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5cdc0dbce0 0x7f5cdc0e2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:35.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.355+0000 7f5ce2a00640 1 -- 172.21.15.8:0/3152108886 >> v1:172.21.15.196:6789/0 conn(0x7f5cdc0ded20 legacy=0x7f5cdc0df1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:51:35.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.355+0000 7f5ce2a00640 1 -- 172.21.15.8:0/3152108886 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc047900 con 0x7f5cdc00b0c0 2024-03-23T23:51:35.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.355+0000 7f5ce2a00640 1 -- 172.21.15.8:0/3152108886 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7f5cd0001680 con 0x7f5cdc00b0c0 2024-03-23T23:51:35.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.355+0000 7f5ce2a00640 1 -- 172.21.15.8:0/3152108886 >> v1:172.21.15.8:6789/0 conn(0x7f5cdc00b0c0 legacy=0x7f5cdc006f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:35.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.355+0000 7f5ce2a00640 1 --2- 172.21.15.8:0/3152108886 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5ccc0039f0 0x7f5ccc003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:35.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.355+0000 7f5ce2a00640 1 --2- 172.21.15.8:0/3152108886 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ccc0043c0 0x7f5ccc004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:35.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.355+0000 7f5ce2a00640 1 --2- 172.21.15.8:0/3152108886 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5ccc005130 0x7f5ccc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:35.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.355+0000 7f5ce2a00640 1 -- 172.21.15.8:0/3152108886 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc0e2c50 con 0x7f5ccc0043c0 2024-03-23T23:51:35.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.355+0000 7f5ce2a00640 1 -- 172.21.15.8:0/3152108886 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc00c040 con 0x7f5ccc005130 2024-03-23T23:51:35.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.355+0000 7f5ce2a00640 1 -- 172.21.15.8:0/3152108886 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc00c240 con 0x7f5ccc0039f0 2024-03-23T23:51:35.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.355+0000 7f5ce3400640 1 --2- 172.21.15.8:0/3152108886 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ccc0043c0 0x7f5ccc004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:35.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.355+0000 7f5ce3400640 1 -- 172.21.15.8:0/3152108886 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5ccc0039f0 msgr2=0x7f5ccc003df0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:51:35.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.355+0000 7f5ce3400640 1 --2- 172.21.15.8:0/3152108886 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5ccc0039f0 0x7f5ccc003df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:35.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.355+0000 7f5ce3400640 1 -- 172.21.15.8:0/3152108886 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5ccc005130 msgr2=0x7f5ccc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:51:35.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.355+0000 7f5ce3400640 1 --2- 172.21.15.8:0/3152108886 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5ccc005130 0x7f5ccc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:35.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.355+0000 7f5ce3400640 1 -- 172.21.15.8:0/3152108886 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc047900 con 0x7f5ccc0043c0 2024-03-23T23:51:35.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.367+0000 7f5ce3400640 1 --2- 172.21.15.8:0/3152108886 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ccc0043c0 0x7f5ccc004890 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5cd000c290 tx=0x7f5cd001ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53bf1a77ffca6b30 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:35.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.367+0000 7f5ce2a00640 1 -- 172.21.15.8:0/3152108886 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0007d80 con 0x7f5ccc0043c0 2024-03-23T23:51:35.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.367+0000 7f5ce2a00640 1 -- 172.21.15.8:0/3152108886 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd00a9070 con 0x7f5ccc0043c0 2024-03-23T23:51:35.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.367+0000 7f5ce2a00640 1 -- 172.21.15.8:0/3152108886 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd00a5db0 con 0x7f5ccc0043c0 2024-03-23T23:51:35.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.371+0000 7f5ce9600640 1 -- 172.21.15.8:0/3152108886 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ccc0043c0 msgr2=0x7f5ccc004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:35.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.371+0000 7f5ce9600640 1 --2- 172.21.15.8:0/3152108886 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ccc0043c0 0x7f5ccc004890 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5cd000c290 tx=0x7f5cd001ccd0 comp rx=0 tx=0).stop 2024-03-23T23:51:35.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.375+0000 7f5ce8c00640 1 -- 172.21.15.8:0/3152108886 reap_dead start 2024-03-23T23:51:35.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.375+0000 7f5ce9600640 1 -- 172.21.15.8:0/3152108886 shutdown_connections 2024-03-23T23:51:35.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.375+0000 7f5ce9600640 1 -- 172.21.15.8:0/3152108886 >> 172.21.15.8:0/3152108886 conn(0x7f5cdc048260 msgr2=0x7f5cdc048670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:51:35.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.375+0000 7f5ce9600640 1 -- 172.21.15.8:0/3152108886 shutdown_connections 2024-03-23T23:51:35.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.375+0000 7f5ce9600640 1 -- 172.21.15.8:0/3152108886 wait complete. 2024-03-23T23:51:35.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.379+0000 7f5ce9600640 1 Processor -- start 2024-03-23T23:51:35.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.379+0000 7f5ce9600640 1 -- start start 2024-03-23T23:51:35.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.391+0000 7f5ce9600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5ccc0043c0 0x7f5cdc177d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:35.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.391+0000 7f5ce9600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5cdc0d9220 0x7f5cdc0dfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:35.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.391+0000 7f5ce9600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5cdc0e0310 0x7f5cdc0d8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:35.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.391+0000 7f5ce9600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc0dc0c0 con 0x7f5cdc0d9220 2024-03-23T23:51:35.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.391+0000 7f5ce9600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc0dfc50 con 0x7f5cdc0e0310 2024-03-23T23:51:35.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.391+0000 7f5ce9600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc007610 con 0x7f5ccc0043c0 2024-03-23T23:51:35.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.391+0000 7f5ce3e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5ccc0043c0 0x7f5cdc177d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:35.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.391+0000 7f5ce3e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5ccc0043c0 0x7f5cdc177d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:35454/0 (socket says 172.21.15.8:35454) 2024-03-23T23:51:35.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.391+0000 7f5ce3e00640 1 -- 172.21.15.8:0/2385038306 learned_addr learned my addr 172.21.15.8:0/2385038306 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:51:35.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.391+0000 7f5ce8c00640 1 --2- 172.21.15.8:0/2385038306 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5cdc0e0310 0x7f5cdc0d8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:35.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.391+0000 7f5ce3400640 1 --2- 172.21.15.8:0/2385038306 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5cdc0d9220 0x7f5cdc0dfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:35.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.395+0000 7f5ce3400640 1 -- 172.21.15.8:0/2385038306 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5ccc0043c0 msgr2=0x7f5cdc177d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:35.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.395+0000 7f5ce3400640 1 --2- 172.21.15.8:0/2385038306 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5ccc0043c0 0x7f5cdc177d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:35.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.395+0000 7f5ce3400640 1 -- 172.21.15.8:0/2385038306 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5cdc0e0310 msgr2=0x7f5cdc0d8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:35.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.395+0000 7f5ce3400640 1 --2- 172.21.15.8:0/2385038306 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5cdc0e0310 0x7f5cdc0d8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:35.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.395+0000 7f5ce3400640 1 -- 172.21.15.8:0/2385038306 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc03fad0 con 0x7f5cdc0d9220 2024-03-23T23:51:35.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.395+0000 7f5ce3400640 1 --2- 172.21.15.8:0/2385038306 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5cdc0d9220 0x7f5cdc0dfdd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0009000 tx=0x7f5ccc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:35.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.395+0000 7f5cd7e00640 1 -- 172.21.15.8:0/2385038306 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd00a6aa0 con 0x7f5cdc0d9220 2024-03-23T23:51:35.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.395+0000 7f5cd7e00640 1 -- 172.21.15.8:0/2385038306 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd00a6c40 con 0x7f5cdc0d9220 2024-03-23T23:51:35.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.399+0000 7f5cd7e00640 1 -- 172.21.15.8:0/2385038306 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd00047f0 con 0x7f5cdc0d9220 2024-03-23T23:51:35.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.399+0000 7f5ce9600640 1 -- 172.21.15.8:0/2385038306 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cdc030bf0 con 0x7f5cdc0d9220 2024-03-23T23:51:35.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.399+0000 7f5ce9600640 1 -- 172.21.15.8:0/2385038306 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cdc0311b0 con 0x7f5cdc0d9220 2024-03-23T23:51:35.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.403+0000 7f5ce9600640 1 -- 172.21.15.8:0/2385038306 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cdc0052d0 con 0x7f5cdc0d9220 2024-03-23T23:51:35.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.403+0000 7f5cd7e00640 1 -- 172.21.15.8:0/2385038306 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f5cd0004990 con 0x7f5cdc0d9220 2024-03-23T23:51:35.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.407+0000 7f5cd7e00640 1 --2- 172.21.15.8:0/2385038306 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5cc40676e0 0x7f5cc4069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:35.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.407+0000 7f5cd7e00640 1 -- 172.21.15.8:0/2385038306 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f5cd011f950 con 0x7f5cdc0d9220 2024-03-23T23:51:35.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.407+0000 7f5ce3e00640 1 --2- 172.21.15.8:0/2385038306 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5cc40676e0 0x7f5cc4069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:35.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.415+0000 7f5cd7e00640 1 -- 172.21.15.8:0/2385038306 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f5cd00be060 con 0x7f5cdc0d9220 2024-03-23T23:51:35.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:35.427+0000 7f5ce3e00640 1 --2- 172.21.15.8:0/2385038306 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5cc40676e0 0x7f5cc4069ba0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8004660 tx=0x7f5cd8009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:36.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:36.039+0000 7f5ce9600640 1 -- 172.21.15.8:0/2385038306 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f5cdc03ef90 con 0x7f5cdc0d9220 2024-03-23T23:51:36.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:36.043+0000 7f5cd7e00640 1 -- 172.21.15.8:0/2385038306 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f5cd0016a10 con 0x7f5cdc0d9220 2024-03-23T23:51:36.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:36.047+0000 7f5ce9600640 1 -- 172.21.15.8:0/2385038306 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5cc40676e0 msgr2=0x7f5cc4069ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:36.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:36.047+0000 7f5ce9600640 1 --2- 172.21.15.8:0/2385038306 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5cc40676e0 0x7f5cc4069ba0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8004660 tx=0x7f5cd8009190 comp rx=0 tx=0).stop 2024-03-23T23:51:36.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:36.047+0000 7f5ce9600640 1 -- 172.21.15.8:0/2385038306 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5cdc0d9220 msgr2=0x7f5cdc0dfdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:36.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:36.047+0000 7f5ce9600640 1 --2- 172.21.15.8:0/2385038306 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5cdc0d9220 0x7f5cdc0dfdd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0009000 tx=0x7f5ccc005840 comp rx=0 tx=0).stop 2024-03-23T23:51:36.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:36.047+0000 7f5ce9600640 1 -- 172.21.15.8:0/2385038306 shutdown_connections 2024-03-23T23:51:36.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:36.047+0000 7f5ce9600640 1 --2- 172.21.15.8:0/2385038306 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5cdc0e0310 0x7f5cdc0d8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:36.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:36.047+0000 7f5ce9600640 1 --2- 172.21.15.8:0/2385038306 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5cdc0d9220 0x7f5cdc0dfdd0 secure :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0009000 tx=0x7f5ccc005840 comp rx=0 tx=0).stop 2024-03-23T23:51:36.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:36.047+0000 7f5ce9600640 1 --2- 172.21.15.8:0/2385038306 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5cc40676e0 0x7f5cc4069ba0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:36.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:36.047+0000 7f5ce9600640 1 --2- 172.21.15.8:0/2385038306 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5ccc0043c0 0x7f5cdc177d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:36.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:36.047+0000 7f5ce9600640 1 -- 172.21.15.8:0/2385038306 >> 172.21.15.8:0/2385038306 conn(0x7f5cdc048260 msgr2=0x7f5cdc02b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:51:36.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:36.047+0000 7f5ce9600640 1 -- 172.21.15.8:0/2385038306 shutdown_connections 2024-03-23T23:51:36.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:36.047+0000 7f5ce9600640 1 -- 172.21.15.8:0/2385038306 wait complete. 2024-03-23T23:51:36.101 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-03-23T23:51:44.577 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:51:44.581 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:51:46.102 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T23:51:46.103 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:51:46.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.323+0000 7f41a1200640 1 Processor -- start 2024-03-23T23:51:46.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.323+0000 7f41a1200640 1 -- start start 2024-03-23T23:51:46.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.323+0000 7f41a1200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f419c14a180 0x7f419c154220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:46.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.327+0000 7f41a1200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f419c06e350 0x7f419c06e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:46.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.327+0000 7f41a1200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f419c14a560 con 0x7f419c0c1b70 2024-03-23T23:51:46.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.327+0000 7f41a1200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f419c0c2070 con 0x7f419c06e350 2024-03-23T23:51:46.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.327+0000 7f41a1200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419c0c2350 con 0x7f419c14a180 2024-03-23T23:51:46.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.327+0000 7f4199400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f419c0c1b70 0x7f419c0c3620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48686/0 (socket says 172.21.15.8:48686) 2024-03-23T23:51:46.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.327+0000 7f4199400640 1 -- 172.21.15.8:0/1529702180 learned_addr learned my addr 172.21.15.8:0/1529702180 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:51:46.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.327+0000 7f4199e00640 1 --2- 172.21.15.8:0/1529702180 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f419c14a180 0x7f419c154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:46.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.327+0000 7f419a800640 1 --2- 172.21.15.8:0/1529702180 >> v2:172.21.15.196:3300/0 conn(0x7f419c06e350 0x7f419c06e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:46.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.327+0000 7f4198a00640 1 -- 172.21.15.8:0/1529702180 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3746726199 0 0) 0x7f419c14a560 con 0x7f419c0c1b70 2024-03-23T23:51:46.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.327+0000 7f4198a00640 1 -- 172.21.15.8:0/1529702180 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4180003530 con 0x7f419c0c1b70 2024-03-23T23:51:46.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.327+0000 7f4198a00640 1 -- 172.21.15.8:0/1529702180 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 284605343 0 0) 0x7f4180003530 con 0x7f419c0c1b70 2024-03-23T23:51:46.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.327+0000 7f4198a00640 1 -- 172.21.15.8:0/1529702180 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f419c14a180 msgr2=0x7f419c154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:51:46.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.327+0000 7f4198a00640 1 --2- 172.21.15.8:0/1529702180 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f419c14a180 0x7f419c154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:46.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.327+0000 7f4198a00640 1 -- 172.21.15.8:0/1529702180 >> v2:172.21.15.196:3300/0 conn(0x7f419c06e350 msgr2=0x7f419c06e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:51:46.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.327+0000 7f4198a00640 1 --2- 172.21.15.8:0/1529702180 >> v2:172.21.15.196:3300/0 conn(0x7f419c06e350 0x7f419c06e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:46.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.327+0000 7f4198a00640 1 -- 172.21.15.8:0/1529702180 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419c0c2630 con 0x7f419c0c1b70 2024-03-23T23:51:46.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.327+0000 7f4198a00640 1 -- 172.21.15.8:0/1529702180 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7f4188001680 con 0x7f419c0c1b70 2024-03-23T23:51:46.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.327+0000 7f4198a00640 1 -- 172.21.15.8:0/1529702180 >> v1:172.21.15.8:6789/0 conn(0x7f419c0c1b70 legacy=0x7f419c0c3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:46.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.327+0000 7f4198a00640 1 --2- 172.21.15.8:0/1529702180 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4180003a30 0x7f4180003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:46.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.327+0000 7f4198a00640 1 --2- 172.21.15.8:0/1529702180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4180004810 0x7f4180004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:46.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.327+0000 7f4198a00640 1 --2- 172.21.15.8:0/1529702180 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f419c14a180 0x7f41800051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:46.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.327+0000 7f4198a00640 1 -- 172.21.15.8:0/1529702180 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419c0c2070 con 0x7f4180004810 2024-03-23T23:51:46.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.327+0000 7f4198a00640 1 -- 172.21.15.8:0/1529702180 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419c0c2350 con 0x7f4180003a30 2024-03-23T23:51:46.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.327+0000 7f4198a00640 1 -- 172.21.15.8:0/1529702180 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418000bab0 con 0x7f419c14a180 2024-03-23T23:51:46.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.327+0000 7f4199400640 1 --2- 172.21.15.8:0/1529702180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4180004810 0x7f4180004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:46.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.327+0000 7f4199e00640 1 --2- 172.21.15.8:0/1529702180 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4180003a30 0x7f4180003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:46.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.327+0000 7f4199400640 1 -- 172.21.15.8:0/1529702180 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f419c14a180 msgr2=0x7f41800051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:51:46.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.327+0000 7f4199400640 1 --2- 172.21.15.8:0/1529702180 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f419c14a180 0x7f41800051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:46.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.327+0000 7f4199400640 1 -- 172.21.15.8:0/1529702180 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4180003a30 msgr2=0x7f4180003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:51:46.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.331+0000 7f4199400640 1 --2- 172.21.15.8:0/1529702180 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4180003a30 0x7f4180003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:46.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.331+0000 7f4199400640 1 -- 172.21.15.8:0/1529702180 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419c0c2630 con 0x7f4180004810 2024-03-23T23:51:46.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.335+0000 7f4199400640 1 --2- 172.21.15.8:0/1529702180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4180004810 0x7f4180004c90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4188001060 tx=0x7f418801cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ba3b76e845df0c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:46.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.335+0000 7f4198a00640 1 -- 172.21.15.8:0/1529702180 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4188007e60 con 0x7f4180004810 2024-03-23T23:51:46.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.335+0000 7f4198a00640 1 -- 172.21.15.8:0/1529702180 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41880a9020 con 0x7f4180004810 2024-03-23T23:51:46.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.335+0000 7f4198a00640 1 -- 172.21.15.8:0/1529702180 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41880a5c80 con 0x7f4180004810 2024-03-23T23:51:46.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.335+0000 7f41a1200640 1 -- 172.21.15.8:0/1529702180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4180004810 msgr2=0x7f4180004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:46.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.335+0000 7f41a1200640 1 --2- 172.21.15.8:0/1529702180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4180004810 0x7f4180004c90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4188001060 tx=0x7f418801cd80 comp rx=0 tx=0).stop 2024-03-23T23:51:46.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.335+0000 7f419a800640 1 -- 172.21.15.8:0/1529702180 reap_dead start 2024-03-23T23:51:46.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.335+0000 7f41a1200640 1 -- 172.21.15.8:0/1529702180 shutdown_connections 2024-03-23T23:51:46.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.335+0000 7f41a1200640 1 -- 172.21.15.8:0/1529702180 >> 172.21.15.8:0/1529702180 conn(0x7f419c06b170 msgr2=0x7f419c06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:51:46.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.339+0000 7f41a1200640 1 -- 172.21.15.8:0/1529702180 shutdown_connections 2024-03-23T23:51:46.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.339+0000 7f41a1200640 1 -- 172.21.15.8:0/1529702180 wait complete. 2024-03-23T23:51:46.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.339+0000 7f41a1200640 1 Processor -- start 2024-03-23T23:51:46.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.339+0000 7f41a1200640 1 -- start start 2024-03-23T23:51:46.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.343+0000 7f41a1200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f419c153630 0x7f419c15da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:46.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.343+0000 7f41a1200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f419c1573e0 0x7f419c1fbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:46.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.343+0000 7f41a1200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f419c1fc0f0 0x7f419c1f1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:46.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.343+0000 7f41a1200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419c15e7a0 con 0x7f419c153630 2024-03-23T23:51:46.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.343+0000 7f41a1200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419c154630 con 0x7f419c1573e0 2024-03-23T23:51:46.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.343+0000 7f41a1200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419c15e920 con 0x7f419c1fc0f0 2024-03-23T23:51:46.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.343+0000 7f4199e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f419c153630 0x7f419c15da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:46.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.343+0000 7f4199e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f419c153630 0x7f419c15da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59584/0 (socket says 172.21.15.8:59584) 2024-03-23T23:51:46.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.343+0000 7f4199e00640 1 -- 172.21.15.8:0/2249946072 learned_addr learned my addr 172.21.15.8:0/2249946072 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:51:46.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.343+0000 7f4199400640 1 --2- 172.21.15.8:0/2249946072 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f419c1573e0 0x7f419c1fbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:46.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.343+0000 7f4199e00640 1 -- 172.21.15.8:0/2249946072 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f419c1fc0f0 msgr2=0x7f419c1f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:46.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.343+0000 7f4199e00640 1 --2- 172.21.15.8:0/2249946072 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f419c1fc0f0 0x7f419c1f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:46.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.343+0000 7f4199e00640 1 -- 172.21.15.8:0/2249946072 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f419c1573e0 msgr2=0x7f419c1fbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:46.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.343+0000 7f4199e00640 1 --2- 172.21.15.8:0/2249946072 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f419c1573e0 0x7f419c1fbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:46.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.343+0000 7f4199e00640 1 -- 172.21.15.8:0/2249946072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419c156880 con 0x7f419c153630 2024-03-23T23:51:46.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.343+0000 7f4199e00640 1 --2- 172.21.15.8:0/2249946072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f419c153630 0x7f419c15da30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f418c011640 tx=0x7f418c011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:46.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.343+0000 7f4192000640 1 -- 172.21.15.8:0/2249946072 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c00f8c0 con 0x7f419c153630 2024-03-23T23:51:46.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.347+0000 7f4192000640 1 -- 172.21.15.8:0/2249946072 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418c00fa60 con 0x7f419c153630 2024-03-23T23:51:46.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.347+0000 7f4192000640 1 -- 172.21.15.8:0/2249946072 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c00fe10 con 0x7f419c153630 2024-03-23T23:51:46.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.347+0000 7f41a1200640 1 -- 172.21.15.8:0/2249946072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f419c156b60 con 0x7f419c153630 2024-03-23T23:51:46.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.347+0000 7f41a1200640 1 -- 172.21.15.8:0/2249946072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f419c157840 con 0x7f419c153630 2024-03-23T23:51:46.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.347+0000 7f41a1200640 1 -- 172.21.15.8:0/2249946072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f419c04f480 con 0x7f419c153630 2024-03-23T23:51:46.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.347+0000 7f4192000640 1 -- 172.21.15.8:0/2249946072 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f418c015460 con 0x7f419c153630 2024-03-23T23:51:46.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.351+0000 7f4192000640 1 --2- 172.21.15.8:0/2249946072 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f417c0676b0 0x7f417c069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:46.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.351+0000 7f4192000640 1 -- 172.21.15.8:0/2249946072 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f418c0864d0 con 0x7f419c153630 2024-03-23T23:51:46.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.351+0000 7f4199400640 1 --2- 172.21.15.8:0/2249946072 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f417c0676b0 0x7f417c069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:46.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.351+0000 7f4199400640 1 --2- 172.21.15.8:0/2249946072 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f417c0676b0 0x7f417c069b70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f41880aa000 tx=0x7f4188001a50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:46.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.359+0000 7f4192000640 1 -- 172.21.15.8:0/2249946072 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f418c019030 con 0x7f419c153630 2024-03-23T23:51:46.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.795+0000 7f41a1200640 1 -- 172.21.15.8:0/2249946072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f419c0c3400 con 0x7f419c153630 2024-03-23T23:51:46.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.795+0000 7f4192000640 1 -- 172.21.15.8:0/2249946072 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1561 (secure 0 0 0) 0x7f418c019030 con 0x7f419c153630 2024-03-23T23:51:46.802 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":66,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:51:46.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.799+0000 7f41a1200640 1 -- 172.21.15.8:0/2249946072 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f417c0676b0 msgr2=0x7f417c069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:46.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.799+0000 7f41a1200640 1 --2- 172.21.15.8:0/2249946072 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f417c0676b0 0x7f417c069b70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f41880aa000 tx=0x7f4188001a50 comp rx=0 tx=0).stop 2024-03-23T23:51:46.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.799+0000 7f41a1200640 1 -- 172.21.15.8:0/2249946072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f419c153630 msgr2=0x7f419c15da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:46.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.799+0000 7f41a1200640 1 --2- 172.21.15.8:0/2249946072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f419c153630 0x7f419c15da30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f418c011640 tx=0x7f418c011b00 comp rx=0 tx=0).stop 2024-03-23T23:51:46.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.799+0000 7f41a1200640 1 -- 172.21.15.8:0/2249946072 shutdown_connections 2024-03-23T23:51:46.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.799+0000 7f41a1200640 1 --2- 172.21.15.8:0/2249946072 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f417c0676b0 0x7f417c069b70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:46.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.799+0000 7f41a1200640 1 --2- 172.21.15.8:0/2249946072 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f419c1fc0f0 0x7f419c1f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:46.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.799+0000 7f41a1200640 1 --2- 172.21.15.8:0/2249946072 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f419c1573e0 0x7f419c1fbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:46.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.799+0000 7f41a1200640 1 --2- 172.21.15.8:0/2249946072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f419c153630 0x7f419c15da30 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:46.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.799+0000 7f41a1200640 1 -- 172.21.15.8:0/2249946072 >> 172.21.15.8:0/2249946072 conn(0x7f419c06b170 msgr2=0x7f419c148940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:51:46.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.799+0000 7f41a1200640 1 -- 172.21.15.8:0/2249946072 shutdown_connections 2024-03-23T23:51:46.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:46.799+0000 7f41a1200640 1 -- 172.21.15.8:0/2249946072 wait complete. 2024-03-23T23:51:46.838 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T23:51:46.838 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-03-23T23:51:46.838 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T23:51:46.838 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:51:47.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.091+0000 7f604fe00640 1 Processor -- start 2024-03-23T23:51:47.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.091+0000 7f604fe00640 1 -- start start 2024-03-23T23:51:47.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.091+0000 7f604fe00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f60500c2fa0 0x7f6050155940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:47.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.091+0000 7f604fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f605006de70 0x7f6050155e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:47.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.091+0000 7f604fe00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6050070220 con 0x7f605014f910 2024-03-23T23:51:47.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.091+0000 7f604fe00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f605006f5c0 con 0x7f60500c2fa0 2024-03-23T23:51:47.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.091+0000 7f604fe00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6050070500 con 0x7f605006de70 2024-03-23T23:51:47.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.095+0000 7f604ea00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f605014f910 0x7f60500c2890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:52394/0 (socket says 172.21.15.8:52394) 2024-03-23T23:51:47.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.095+0000 7f604ea00640 1 -- 172.21.15.8:0/3402127213 learned_addr learned my addr 172.21.15.8:0/3402127213 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:51:47.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.095+0000 7f604e000640 1 --2- 172.21.15.8:0/3402127213 >> v2:172.21.15.196:3300/0 conn(0x7f60500c2fa0 0x7f6050155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:47.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.095+0000 7f604f400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f605006de70 0x7f6050155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:47.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.095+0000 7f604f400640 1 -- 172.21.15.8:0/3402127213 >> v2:172.21.15.196:3300/0 conn(0x7f60500c2fa0 msgr2=0x7f6050155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:51:47.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.095+0000 7f604f400640 1 --2- 172.21.15.8:0/3402127213 >> v2:172.21.15.196:3300/0 conn(0x7f60500c2fa0 0x7f6050155940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:47.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.095+0000 7f604f400640 1 -- 172.21.15.8:0/3402127213 >> v1:172.21.15.196:6789/0 conn(0x7f605014f910 legacy=0x7f60500c2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:51:47.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.095+0000 7f604f400640 1 -- 172.21.15.8:0/3402127213 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605006f810 con 0x7f605006de70 2024-03-23T23:51:47.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.099+0000 7f604f400640 1 --2- 172.21.15.8:0/3402127213 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f605006de70 0x7f6050155e80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f60480097c0 tx=0x7f604801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b19a25b737f24fe server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:47.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.103+0000 7f604d600640 1 -- 172.21.15.8:0/3402127213 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60480b0070 con 0x7f605006de70 2024-03-23T23:51:47.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.103+0000 7f604d600640 1 -- 172.21.15.8:0/3402127213 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60480ab600 con 0x7f605006de70 2024-03-23T23:51:47.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.103+0000 7f604d600640 1 -- 172.21.15.8:0/3402127213 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60480ab9d0 con 0x7f605006de70 2024-03-23T23:51:47.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.103+0000 7f604fe00640 1 -- 172.21.15.8:0/3402127213 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f605006de70 msgr2=0x7f6050155e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:47.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.107+0000 7f604fe00640 1 --2- 172.21.15.8:0/3402127213 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f605006de70 0x7f6050155e80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f60480097c0 tx=0x7f604801c3f0 comp rx=0 tx=0).stop 2024-03-23T23:51:47.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.111+0000 7f604fe00640 1 -- 172.21.15.8:0/3402127213 shutdown_connections 2024-03-23T23:51:47.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.111+0000 7f604fe00640 1 --2- 172.21.15.8:0/3402127213 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f605006de70 0x7f6050155e80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:47.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.111+0000 7f604fe00640 1 --2- 172.21.15.8:0/3402127213 >> v2:172.21.15.196:3300/0 conn(0x7f60500c2fa0 0x7f6050155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:47.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.111+0000 7f604fe00640 1 -- 172.21.15.8:0/3402127213 >> 172.21.15.8:0/3402127213 conn(0x7f60500c4990 msgr2=0x7f60500c4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:51:47.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.111+0000 7f604fe00640 1 -- 172.21.15.8:0/3402127213 shutdown_connections 2024-03-23T23:51:47.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.111+0000 7f604fe00640 1 -- 172.21.15.8:0/3402127213 wait complete. 2024-03-23T23:51:47.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.115+0000 7f604fe00640 1 Processor -- start 2024-03-23T23:51:47.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.115+0000 7f604fe00640 1 -- start start 2024-03-23T23:51:47.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.115+0000 7f604fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f605006de70 0x7f60500aaf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:47.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.115+0000 7f604fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60500c2fa0 0x7f6050145860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:47.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.119+0000 7f604ea00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f605006de70 0x7f60500aaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:47.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.119+0000 7f604ea00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f605006de70 0x7f60500aaf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:49994/0 (socket says 172.21.15.8:49994) 2024-03-23T23:51:47.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.119+0000 7f604e000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60500c2fa0 0x7f6050145860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:47.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.119+0000 7f604e000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60500c2fa0 0x7f6050145860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59586/0 (socket says 172.21.15.8:59586) 2024-03-23T23:51:47.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.119+0000 7f604ea00640 1 -- 172.21.15.8:0/1274049660 learned_addr learned my addr 172.21.15.8:0/1274049660 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:51:47.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.119+0000 7f604fe00640 1 --2- 172.21.15.8:0/1274049660 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f605014f910 0x7f60501fb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:47.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.119+0000 7f604fe00640 1 -- 172.21.15.8:0/1274049660 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605015d660 con 0x7f60500c2fa0 2024-03-23T23:51:47.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.119+0000 7f604fe00640 1 -- 172.21.15.8:0/1274049660 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605015d4e0 con 0x7f605014f910 2024-03-23T23:51:47.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.119+0000 7f604fe00640 1 -- 172.21.15.8:0/1274049660 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605015d7e0 con 0x7f605006de70 2024-03-23T23:51:47.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.119+0000 7f604f400640 1 --2- 172.21.15.8:0/1274049660 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f605014f910 0x7f60501fb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:47.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.119+0000 7f604e000640 1 -- 172.21.15.8:0/1274049660 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f605006de70 msgr2=0x7f60500aaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:47.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.119+0000 7f604e000640 1 --2- 172.21.15.8:0/1274049660 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f605006de70 0x7f60500aaf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:47.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.119+0000 7f604e000640 1 -- 172.21.15.8:0/1274049660 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f605014f910 msgr2=0x7f60501fb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:47.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.119+0000 7f604e000640 1 --2- 172.21.15.8:0/1274049660 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f605014f910 0x7f60501fb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:47.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.119+0000 7f604e000640 1 -- 172.21.15.8:0/1274049660 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60501ff8a0 con 0x7f60500c2fa0 2024-03-23T23:51:47.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.119+0000 7f604e000640 1 --2- 172.21.15.8:0/1274049660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60500c2fa0 0x7f6050145860 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f603800d5f0 tx=0x7f603800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:47.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.119+0000 7f6046a00640 1 -- 172.21.15.8:0/1274049660 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60380125f0 con 0x7f60500c2fa0 2024-03-23T23:51:47.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.119+0000 7f6046a00640 1 -- 172.21.15.8:0/1274049660 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6038019070 con 0x7f60500c2fa0 2024-03-23T23:51:47.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.119+0000 7f604fe00640 1 -- 172.21.15.8:0/1274049660 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60501fed20 con 0x7f60500c2fa0 2024-03-23T23:51:47.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.119+0000 7f604fe00640 1 -- 172.21.15.8:0/1274049660 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60501ff2e0 con 0x7f60500c2fa0 2024-03-23T23:51:47.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.123+0000 7f6046a00640 1 -- 172.21.15.8:0/1274049660 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60380129d0 con 0x7f60500c2fa0 2024-03-23T23:51:47.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.123+0000 7f604fe00640 1 --2- 172.21.15.8:0/1274049660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605014a7a0 0x7f60501fbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:47.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.123+0000 7f604fe00640 1 -- 172.21.15.8:0/1274049660 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60501fb370 con 0x7f605014a7a0 2024-03-23T23:51:47.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.123+0000 7f604ea00640 1 --2- 172.21.15.8:0/1274049660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605014a7a0 0x7f60501fbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:47.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.123+0000 7f604ea00640 1 -- 172.21.15.8:0/1274049660 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f605004f410 con 0x7f605014a7a0 2024-03-23T23:51:47.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.127+0000 7f6046a00640 1 -- 172.21.15.8:0/1274049660 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f6038012b70 con 0x7f60500c2fa0 2024-03-23T23:51:47.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.127+0000 7f604ea00640 1 --2- 172.21.15.8:0/1274049660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605014a7a0 0x7f60501fbc30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6040009ce0 tx=0x7f604000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:47.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.127+0000 7f6046a00640 1 --2- 172.21.15.8:0/1274049660 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f602c067730 0x7f602c069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:47.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.127+0000 7f6046a00640 1 -- 172.21.15.8:0/1274049660 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f6038085fe0 con 0x7f60500c2fa0 2024-03-23T23:51:47.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.127+0000 7f6046a00640 1 -- 172.21.15.8:0/1274049660 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6040018020 con 0x7f605014a7a0 2024-03-23T23:51:47.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.127+0000 7f6046a00640 1 -- 172.21.15.8:0/1274049660 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f6040014480 con 0x7f605014a7a0 2024-03-23T23:51:47.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.127+0000 7f6046a00640 1 -- 172.21.15.8:0/1274049660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605014a7a0 msgr2=0x7f60501fbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:47.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.127+0000 7f6046a00640 1 --2- 172.21.15.8:0/1274049660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605014a7a0 0x7f60501fbc30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6040009ce0 tx=0x7f604000c490 comp rx=0 tx=0).stop 2024-03-23T23:51:47.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.127+0000 7f6046a00640 1 -- 172.21.15.8:0/1274049660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605014a7a0 msgr2=0x7f60501fbc30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:51:47.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.127+0000 7f6046a00640 1 --2- 172.21.15.8:0/1274049660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605014a7a0 0x7f60501fbc30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:47.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.131+0000 7f604f400640 1 --2- 172.21.15.8:0/1274049660 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f602c067730 0x7f602c069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:47.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.139+0000 7f604f400640 1 --2- 172.21.15.8:0/1274049660 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f602c067730 0x7f602c069bf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f60480ad000 tx=0x7f60480a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:47.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.143+0000 7f604fe00640 1 --2- 172.21.15.8:0/1274049660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6050145da0 0x7f60500acb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:47.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.143+0000 7f604fe00640 1 -- 172.21.15.8:0/1274049660 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605006dc50 con 0x7f6050145da0 2024-03-23T23:51:47.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.143+0000 7f604ea00640 1 --2- 172.21.15.8:0/1274049660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6050145da0 0x7f60500acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:47.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.143+0000 7f604ea00640 1 -- 172.21.15.8:0/1274049660 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f605006b170 con 0x7f6050145da0 2024-03-23T23:51:47.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.147+0000 7f604ea00640 1 --2- 172.21.15.8:0/1274049660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6050145da0 0x7f60500acb80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6040009ce0 tx=0x7f6040005c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:47.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.151+0000 7f6046a00640 1 -- 172.21.15.8:0/1274049660 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6040018040 con 0x7f6050145da0 2024-03-23T23:51:47.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.151+0000 7f6046a00640 1 -- 172.21.15.8:0/1274049660 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5185 (secure 0 0 0) 0x7f6040014e40 con 0x7f6050145da0 2024-03-23T23:51:47.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.151+0000 7f6046a00640 1 -- 172.21.15.8:0/1274049660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6050145da0 msgr2=0x7f60500acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:47.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.151+0000 7f6046a00640 1 --2- 172.21.15.8:0/1274049660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6050145da0 0x7f60500acb80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6040009ce0 tx=0x7f6040005c60 comp rx=0 tx=0).stop 2024-03-23T23:51:47.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.151+0000 7f6046a00640 1 -- 172.21.15.8:0/1274049660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6050145da0 msgr2=0x7f60500acb80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:51:47.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.151+0000 7f6046a00640 1 --2- 172.21.15.8:0/1274049660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6050145da0 0x7f60500acb80 secure :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6040009ce0 tx=0x7f6040005c60 comp rx=0 tx=0).stop 2024-03-23T23:51:47.156 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:51:47.156 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:51:47.156 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:51:47.157 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:51:47.157 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 66, 2024-03-23T23:51:47.157 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:51:47.157 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:51:47.157 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:51:47.157 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:51:47.158 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:47.158 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 15, 2024-03-23T23:51:47.158 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:51:47.158 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:51:47.158 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:51:47.159 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:51:47.159 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:51:47.159 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:51:47.159 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:51:47.159 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:51:47.160 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:51:47.160 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:51:47.160 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:51:47.160 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:51:47.160 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:51:47.161 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:51:47.161 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:47.161 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:51:47.161 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:51:47.161 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:51:47.161 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:51:47.162 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:51:47.162 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:51:47.162 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:51:47.162 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:51:47.163 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:51:47.164 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:51:47.164 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:51:47.164 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:51:47.164 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:51:47.164 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:47.164 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.164 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:51:47.164 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:51:47.164 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:51:47.164 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:51:47.164 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:51:47.164 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:51:47.164 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:51:47.165 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:51:47.165 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:51:47.165 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:51:47.165 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:51:47.165 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:51:47.165 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:51:47.165 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:51:47.165 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:51:47.165 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:51:47.165 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:51:47.165 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:51:47.165 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:51:47.165 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:51:47.166 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:51:47.166 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:51:47.166 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:51:47.166 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:51:47.166 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:51:47.166 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:51:47.166 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:51:47.166 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:51:47.166 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:47.166 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:51:47.166 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.166 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:51:47.166 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.167 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:51:47.167 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:51:47.167 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:51:47.167 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:51:47.167 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.167 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:51:47.167 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:51:47.167 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:47.167 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.167 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.167 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:51:47.167 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:51:47.167 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:47.167 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:47.168 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:47.168 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.168 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:51:47.168 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:51:47.168 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:51:47.168 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:51:47.168 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:51:47.168 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.168 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.168 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:51:47.168 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:51:47.168 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:51:47.168 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:51:47.169 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.169 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:51:47.169 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:51:47.169 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:47.169 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.169 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.169 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:51:47.169 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:51:47.169 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:47.169 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:47.169 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:47.169 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.169 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:51:47.170 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:51:47.170 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:51:47.170 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:51:47.170 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:51:47.170 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.170 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.170 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:51:47.170 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:51:47.170 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:51:47.170 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:51:47.170 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.170 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:51:47.170 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:51:47.171 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:47.171 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.171 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.171 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:51:47.171 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:51:47.171 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:47.171 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:47.171 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:47.171 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.171 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:51:47.171 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:51:47.171 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:51:47.171 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:51:47.171 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:51:47.172 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:47.172 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:47.172 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.172 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:51:47.172 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:51:47.172 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.172 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:51:47.172 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:51:47.172 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:51:47.172 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:47.172 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:47.172 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:51:47.172 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.172 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:51:47.173 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:51:47.173 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:51:47.173 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:47.173 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:47.173 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:51:47.173 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.173 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:51:47.173 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:51:47.174 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5 2024-03-23T23:51:47.174 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:47.174 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:47.174 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:51:47.174 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.174 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:51:47.174 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:51:47.174 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:51:47.174 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.174 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.174 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:51:47.174 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:51:47.174 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5 2024-03-23T23:51:47.175 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:47.175 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:47.175 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:51:47.175 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.175 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:51:47.175 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:51:47.175 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:51:47.175 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:47.175 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:47.175 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.175 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:51:47.175 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:51:47.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.151+0000 7f604fe00640 1 -- 172.21.15.8:0/1274049660 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f602c067730 msgr2=0x7f602c069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:47.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.151+0000 7f604fe00640 1 --2- 172.21.15.8:0/1274049660 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f602c067730 0x7f602c069bf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f60480ad000 tx=0x7f60480a6000 comp rx=0 tx=0).stop 2024-03-23T23:51:47.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.151+0000 7f604fe00640 1 -- 172.21.15.8:0/1274049660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60500c2fa0 msgr2=0x7f6050145860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:47.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.151+0000 7f604fe00640 1 --2- 172.21.15.8:0/1274049660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60500c2fa0 0x7f6050145860 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f603800d5f0 tx=0x7f603800dab0 comp rx=0 tx=0).stop 2024-03-23T23:51:47.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.151+0000 7f604f400640 1 -- 172.21.15.8:0/1274049660 reap_dead start 2024-03-23T23:51:47.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.155+0000 7f604fe00640 1 -- 172.21.15.8:0/1274049660 shutdown_connections 2024-03-23T23:51:47.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.155+0000 7f604fe00640 1 --2- 172.21.15.8:0/1274049660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60500c2fa0 0x7f6050145860 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:47.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.155+0000 7f604fe00640 1 -- 172.21.15.8:0/1274049660 >> 172.21.15.8:0/1274049660 conn(0x7f60500c4990 msgr2=0x7f60500c1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:51:47.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.155+0000 7f604fe00640 1 -- 172.21.15.8:0/1274049660 shutdown_connections 2024-03-23T23:51:47.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.155+0000 7f604fe00640 1 -- 172.21.15.8:0/1274049660 wait complete. 2024-03-23T23:51:47.191 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:51:47.191 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T23:51:47.192 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:51:47.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.447+0000 7f2ef2000640 1 Processor -- start 2024-03-23T23:51:47.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.451+0000 7f2ef2000640 1 -- start start 2024-03-23T23:51:47.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.451+0000 7f2ef2000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2ee4049940 0x7f2ee40d73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:47.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.451+0000 7f2ef2000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2ee4009fd0 0x7f2ee4046a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:47.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.451+0000 7f2ef2000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee4049ec0 con 0x7f2ee40d6240 2024-03-23T23:51:47.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.451+0000 7f2ef2000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee404a200 con 0x7f2ee4049940 2024-03-23T23:51:47.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.451+0000 7f2ef2000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee404a4e0 con 0x7f2ee4009fd0 2024-03-23T23:51:47.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.455+0000 7f2ef0c00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f2ee40d6240 0x7f2ee404afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48700/0 (socket says 172.21.15.8:48700) 2024-03-23T23:51:47.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.455+0000 7f2ef0c00640 1 -- 172.21.15.8:0/53822364 learned_addr learned my addr 172.21.15.8:0/53822364 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:51:47.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.455+0000 7f2eebe00640 1 --2- 172.21.15.8:0/53822364 >> v2:172.21.15.8:3300/0 conn(0x7f2ee4049940 0x7f2ee40d73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:47.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.455+0000 7f2ef1600640 1 --2- 172.21.15.8:0/53822364 >> v2:172.21.15.196:3300/0 conn(0x7f2ee4009fd0 0x7f2ee4046a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:47.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.455+0000 7f2eebe00640 1 -- 172.21.15.8:0/53822364 >> v2:172.21.15.196:3300/0 conn(0x7f2ee4009fd0 msgr2=0x7f2ee4046a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:51:47.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.455+0000 7f2eebe00640 1 --2- 172.21.15.8:0/53822364 >> v2:172.21.15.196:3300/0 conn(0x7f2ee4009fd0 0x7f2ee4046a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:47.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.455+0000 7f2eebe00640 1 -- 172.21.15.8:0/53822364 >> v1:172.21.15.8:6789/0 conn(0x7f2ee40d6240 legacy=0x7f2ee404afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:47.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.455+0000 7f2eebe00640 1 -- 172.21.15.8:0/53822364 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee404a7c0 con 0x7f2ee4049940 2024-03-23T23:51:47.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.463+0000 7f2eebe00640 1 --2- 172.21.15.8:0/53822364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ee4049940 0x7f2ee40d73e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2ee400d3b0 tx=0x7f2ee001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1fe5ca31cf1fa7a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:47.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.463+0000 7f2eeb400640 1 -- 172.21.15.8:0/53822364 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee00b0070 con 0x7f2ee4049940 2024-03-23T23:51:47.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.463+0000 7f2eeb400640 1 -- 172.21.15.8:0/53822364 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee00ab600 con 0x7f2ee4049940 2024-03-23T23:51:47.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.463+0000 7f2eeb400640 1 -- 172.21.15.8:0/53822364 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee00ab9d0 con 0x7f2ee4049940 2024-03-23T23:51:47.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.463+0000 7f2ef2000640 1 -- 172.21.15.8:0/53822364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ee4049940 msgr2=0x7f2ee40d73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:47.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.463+0000 7f2ef2000640 1 --2- 172.21.15.8:0/53822364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ee4049940 0x7f2ee40d73e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2ee400d3b0 tx=0x7f2ee001c410 comp rx=0 tx=0).stop 2024-03-23T23:51:47.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.467+0000 7f2ef2000640 1 -- 172.21.15.8:0/53822364 shutdown_connections 2024-03-23T23:51:47.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.467+0000 7f2ef2000640 1 --2- 172.21.15.8:0/53822364 >> v2:172.21.15.196:3300/0 conn(0x7f2ee4009fd0 0x7f2ee4046a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:47.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.467+0000 7f2ef2000640 1 --2- 172.21.15.8:0/53822364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ee4049940 0x7f2ee40d73e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:47.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.467+0000 7f2ef2000640 1 -- 172.21.15.8:0/53822364 >> 172.21.15.8:0/53822364 conn(0x7f2ee4048260 msgr2=0x7f2ee4048670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:51:47.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.467+0000 7f2ef2000640 1 -- 172.21.15.8:0/53822364 shutdown_connections 2024-03-23T23:51:47.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.467+0000 7f2ef2000640 1 -- 172.21.15.8:0/53822364 wait complete. 2024-03-23T23:51:47.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.467+0000 7f2ef2000640 1 Processor -- start 2024-03-23T23:51:47.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.471+0000 7f2ef2000640 1 -- start start 2024-03-23T23:51:47.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.471+0000 7f2ef2000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ee4009fd0 0x7f2ee40306e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:47.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.471+0000 7f2ef2000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ee4049940 0x7f2ee402f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:47.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.471+0000 7f2ef2000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ee40d6240 0x7f2ee402fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:47.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.475+0000 7f2ef0c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ee4009fd0 0x7f2ee40306e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:47.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.475+0000 7f2ef0c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ee4009fd0 0x7f2ee40306e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:49998/0 (socket says 172.21.15.8:49998) 2024-03-23T23:51:47.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.475+0000 7f2ef0c00640 1 -- 172.21.15.8:0/1865409891 learned_addr learned my addr 172.21.15.8:0/1865409891 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:51:47.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.475+0000 7f2ef2000640 1 -- 172.21.15.8:0/1865409891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee400a560 con 0x7f2ee40d6240 2024-03-23T23:51:47.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.475+0000 7f2ef1600640 1 --2- 172.21.15.8:0/1865409891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ee40d6240 0x7f2ee402fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:47.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.475+0000 7f2ef2000640 1 -- 172.21.15.8:0/1865409891 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee400a3e0 con 0x7f2ee4049940 2024-03-23T23:51:47.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.475+0000 7f2ef2000640 1 -- 172.21.15.8:0/1865409891 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee4006f00 con 0x7f2ee4009fd0 2024-03-23T23:51:47.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.475+0000 7f2ef1600640 1 -- 172.21.15.8:0/1865409891 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ee4009fd0 msgr2=0x7f2ee40306e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:47.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.475+0000 7f2ef1600640 1 --2- 172.21.15.8:0/1865409891 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ee4009fd0 0x7f2ee40306e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:47.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.475+0000 7f2ef1600640 1 -- 172.21.15.8:0/1865409891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ee4049940 msgr2=0x7f2ee402f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:47.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.475+0000 7f2ef1600640 1 --2- 172.21.15.8:0/1865409891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ee4049940 0x7f2ee402f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:47.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.475+0000 7f2ef1600640 1 -- 172.21.15.8:0/1865409891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee402c940 con 0x7f2ee40d6240 2024-03-23T23:51:47.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.475+0000 7f2ef1600640 1 --2- 172.21.15.8:0/1865409891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ee40d6240 0x7f2ee402fc90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2eec0694b0 tx=0x7f2eec068d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:47.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.487+0000 7f2ee8c00640 1 -- 172.21.15.8:0/1865409891 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec099070 con 0x7f2ee40d6240 2024-03-23T23:51:47.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.487+0000 7f2ee8c00640 1 -- 172.21.15.8:0/1865409891 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eec071400 con 0x7f2ee40d6240 2024-03-23T23:51:47.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.487+0000 7f2ee8c00640 1 -- 172.21.15.8:0/1865409891 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec0737e0 con 0x7f2ee40d6240 2024-03-23T23:51:47.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.487+0000 7f2ef2000640 1 -- 172.21.15.8:0/1865409891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee402b620 con 0x7f2ee40d6240 2024-03-23T23:51:47.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.487+0000 7f2ef2000640 1 -- 172.21.15.8:0/1865409891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee40caf20 con 0x7f2ee40d6240 2024-03-23T23:51:47.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.491+0000 7f2eda000640 1 --2- 172.21.15.8:0/1865409891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ec4002a80 0x7f2ec4004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:47.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.491+0000 7f2eda000640 1 -- 172.21.15.8:0/1865409891 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec4007ed0 con 0x7f2ec4002a80 2024-03-23T23:51:47.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.491+0000 7f2ef0c00640 1 --2- 172.21.15.8:0/1865409891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ec4002a80 0x7f2ec4004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:47.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.495+0000 7f2ef0c00640 1 -- 172.21.15.8:0/1865409891 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2ec40080d0 con 0x7f2ec4002a80 2024-03-23T23:51:47.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.495+0000 7f2ef0c00640 1 --2- 172.21.15.8:0/1865409891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ec4002a80 0x7f2ec4004f40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2edc000f70 tx=0x7f2edc00fc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:47.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.499+0000 7f2ee8c00640 1 -- 172.21.15.8:0/1865409891 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f2eec09c070 con 0x7f2ee40d6240 2024-03-23T23:51:47.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.499+0000 7f2ee8c00640 1 --2- 172.21.15.8:0/1865409891 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2ed00676b0 0x7f2ed0069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:47.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.499+0000 7f2ee8c00640 1 -- 172.21.15.8:0/1865409891 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f2eec101260 con 0x7f2ee40d6240 2024-03-23T23:51:47.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.499+0000 7f2eebe00640 1 --2- 172.21.15.8:0/1865409891 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2ed00676b0 0x7f2ed0069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:47.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.503+0000 7f2ee8c00640 1 -- 172.21.15.8:0/1865409891 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2edc0058c0 con 0x7f2ec4002a80 2024-03-23T23:51:47.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.503+0000 7f2ee8c00640 1 -- 172.21.15.8:0/1865409891 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f2edc018070 con 0x7f2ec4002a80 2024-03-23T23:51:47.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.503+0000 7f2ee8c00640 1 -- 172.21.15.8:0/1865409891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ec4002a80 msgr2=0x7f2ec4004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:47.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.503+0000 7f2ee8c00640 1 --2- 172.21.15.8:0/1865409891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ec4002a80 0x7f2ec4004f40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2edc000f70 tx=0x7f2edc00fc00 comp rx=0 tx=0).stop 2024-03-23T23:51:47.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.503+0000 7f2ee8c00640 1 -- 172.21.15.8:0/1865409891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ec4002a80 msgr2=0x7f2ec4004f40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:51:47.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.507+0000 7f2ee8c00640 1 --2- 172.21.15.8:0/1865409891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ec4002a80 0x7f2ec4004f40 secure :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2edc000f70 tx=0x7f2edc00fc00 comp rx=0 tx=0).stop 2024-03-23T23:51:47.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.511+0000 7f2eebe00640 1 --2- 172.21.15.8:0/1865409891 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2ed00676b0 0x7f2ed0069b70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2ee00ad000 tx=0x7f2ee0004740 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:47.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.527+0000 7f2eda000640 1 --2- 172.21.15.8:0/1865409891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ec4006f10 0x7f2ec40073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:47.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.527+0000 7f2eda000640 1 -- 172.21.15.8:0/1865409891 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec400a4b0 con 0x7f2ec4006f10 2024-03-23T23:51:47.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.535+0000 7f2ef0c00640 1 --2- 172.21.15.8:0/1865409891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ec4006f10 0x7f2ec40073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:47.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.543+0000 7f2ef0c00640 1 -- 172.21.15.8:0/1865409891 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2ec40078e0 con 0x7f2ec4006f10 2024-03-23T23:51:47.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.547+0000 7f2ef0c00640 1 --2- 172.21.15.8:0/1865409891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ec4006f10 0x7f2ec40073a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2edc000f70 tx=0x7f2edc005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:47.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.547+0000 7f2ee8c00640 1 -- 172.21.15.8:0/1865409891 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2edc0070d0 con 0x7f2ec4006f10 2024-03-23T23:51:47.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.551+0000 7f2ee8c00640 1 -- 172.21.15.8:0/1865409891 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4530 (secure 0 0 0) 0x7f2edc0070d0 con 0x7f2ec4006f10 2024-03-23T23:51:47.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.551+0000 7f2ee8c00640 1 -- 172.21.15.8:0/1865409891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ec4006f10 msgr2=0x7f2ec40073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:47.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.551+0000 7f2ee8c00640 1 --2- 172.21.15.8:0/1865409891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ec4006f10 0x7f2ec40073a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2edc000f70 tx=0x7f2edc005800 comp rx=0 tx=0).stop 2024-03-23T23:51:47.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.551+0000 7f2ee8c00640 1 -- 172.21.15.8:0/1865409891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ec4006f10 msgr2=0x7f2ec40073a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:51:47.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.551+0000 7f2ee8c00640 1 --2- 172.21.15.8:0/1865409891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ec4006f10 0x7f2ec40073a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:47.558 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:51:47.558 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:51:47.558 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:51:47.558 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:51:47.559 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 66, 2024-03-23T23:51:47.559 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:51:47.559 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:51:47.559 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:51:47.559 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:51:47.559 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:47.559 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 15, 2024-03-23T23:51:47.559 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:51:47.559 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:51:47.559 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:51:47.559 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:51:47.559 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:51:47.559 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:51:47.559 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:51:47.560 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:51:47.560 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:51:47.560 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:51:47.560 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:51:47.560 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:51:47.560 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:51:47.560 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:51:47.560 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:47.560 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:51:47.560 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:51:47.560 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:51:47.560 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:51:47.560 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:51:47.560 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:51:47.561 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:51:47.561 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:51:47.561 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:51:47.561 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:51:47.561 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:51:47.561 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:51:47.561 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:51:47.561 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:47.561 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.561 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:51:47.561 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:51:47.561 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:51:47.561 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:51:47.561 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:51:47.562 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:51:47.562 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:51:47.562 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:51:47.562 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:51:47.562 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:51:47.562 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:51:47.562 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:51:47.562 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:51:47.562 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:51:47.562 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:51:47.562 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:51:47.562 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:51:47.562 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:51:47.562 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:51:47.563 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:51:47.563 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:51:47.563 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:51:47.563 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:51:47.563 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:51:47.563 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:51:47.563 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:51:47.563 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:51:47.563 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:51:47.563 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:47.563 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:51:47.563 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.563 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:51:47.563 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.564 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:51:47.564 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:51:47.564 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:51:47.564 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:51:47.564 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.564 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:51:47.564 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:51:47.564 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:47.564 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.564 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.564 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:51:47.564 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:51:47.564 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:47.564 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:47.565 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:47.565 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.565 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:51:47.565 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:51:47.565 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:51:47.565 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:51:47.565 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:51:47.565 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.565 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.565 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:51:47.565 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:51:47.565 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:51:47.565 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:51:47.566 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.566 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:51:47.566 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:51:47.566 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:47.566 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.566 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.566 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:51:47.566 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:51:47.566 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:47.566 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:47.566 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:47.566 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.566 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:51:47.567 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:51:47.567 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:51:47.567 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:51:47.567 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:51:47.567 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.567 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.567 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:51:47.567 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:51:47.567 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:51:47.567 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:51:47.567 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.567 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:51:47.567 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:51:47.568 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:47.568 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.568 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.568 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:51:47.568 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:51:47.568 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:47.568 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:47.568 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:47.568 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.568 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:51:47.568 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:51:47.568 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:51:47.568 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:51:47.569 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:51:47.569 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:47.569 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:47.569 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.569 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:51:47.569 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:51:47.569 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.569 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:51:47.569 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:51:47.569 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:51:47.569 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:47.569 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:47.569 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:51:47.569 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.570 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:51:47.570 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:51:47.570 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:51:47.570 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:47.570 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:47.570 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.570 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:51:47.570 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:51:47.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.555+0000 7f2eda000640 1 -- 172.21.15.8:0/1865409891 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2ed00676b0 msgr2=0x7f2ed0069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:47.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.555+0000 7f2eda000640 1 --2- 172.21.15.8:0/1865409891 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2ed00676b0 0x7f2ed0069b70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2ee00ad000 tx=0x7f2ee0004740 comp rx=0 tx=0).stop 2024-03-23T23:51:47.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.555+0000 7f2eda000640 1 -- 172.21.15.8:0/1865409891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ee40d6240 msgr2=0x7f2ee402fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:47.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.555+0000 7f2eda000640 1 --2- 172.21.15.8:0/1865409891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ee40d6240 0x7f2ee402fc90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2eec0694b0 tx=0x7f2eec068d50 comp rx=0 tx=0).stop 2024-03-23T23:51:47.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.555+0000 7f2ef1600640 1 -- 172.21.15.8:0/1865409891 reap_dead start 2024-03-23T23:51:47.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.555+0000 7f2ef1600640 1 -- 172.21.15.8:0/1865409891 reap_dead start 2024-03-23T23:51:47.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.555+0000 7f2eda000640 1 -- 172.21.15.8:0/1865409891 shutdown_connections 2024-03-23T23:51:47.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.555+0000 7f2eda000640 1 -- 172.21.15.8:0/1865409891 >> 172.21.15.8:0/1865409891 conn(0x7f2ee4048260 msgr2=0x7f2ee4004910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:51:47.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.555+0000 7f2eda000640 1 -- 172.21.15.8:0/1865409891 shutdown_connections 2024-03-23T23:51:47.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.555+0000 7f2eda000640 1 -- 172.21.15.8:0/1865409891 wait complete. 2024-03-23T23:51:47.598 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:51:47.598 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T23:51:47.598 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:51:47.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.839+0000 7f01b3400640 1 Processor -- start 2024-03-23T23:51:47.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.839+0000 7f01b3400640 1 -- start start 2024-03-23T23:51:47.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.839+0000 7f01b3400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f01ac0a9c80 0x7f01ac0c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:47.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.839+0000 7f01b3400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f01ac06e340 0x7f01ac06e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:47.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.839+0000 7f01b3400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ac0c21f0 con 0x7f01ac14eb70 2024-03-23T23:51:47.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.839+0000 7f01b3400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01ac06ecf0 con 0x7f01ac06e340 2024-03-23T23:51:47.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.839+0000 7f01b3400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01ac071b60 con 0x7f01ac0a9c80 2024-03-23T23:51:47.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.839+0000 7f01b0a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f01ac0a9c80 0x7f01ac0c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:47.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.839+0000 7f01b0a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f01ac0a9c80 0x7f01ac0c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:58068/0 (socket says 172.21.15.8:58068) 2024-03-23T23:51:47.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.839+0000 7f01b0a00640 1 -- 172.21.15.8:0/2100491180 learned_addr learned my addr 172.21.15.8:0/2100491180 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:51:47.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.843+0000 7f01abe00640 1 --2- 172.21.15.8:0/2100491180 >> v2:172.21.15.8:3300/0 conn(0x7f01ac06e340 0x7f01ac06e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:47.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.843+0000 7f01abe00640 1 -- 172.21.15.8:0/2100491180 >> v2:172.21.15.196:3300/0 conn(0x7f01ac0a9c80 msgr2=0x7f01ac0c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:51:47.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.843+0000 7f01abe00640 1 --2- 172.21.15.8:0/2100491180 >> v2:172.21.15.196:3300/0 conn(0x7f01ac0a9c80 0x7f01ac0c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:47.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.843+0000 7f01abe00640 1 -- 172.21.15.8:0/2100491180 >> v1:172.21.15.196:6789/0 conn(0x7f01ac14eb70 legacy=0x7f01ac14ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:51:47.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.843+0000 7f01abe00640 1 -- 172.21.15.8:0/2100491180 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ac071e40 con 0x7f01ac06e340 2024-03-23T23:51:47.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.847+0000 7f01abe00640 1 --2- 172.21.15.8:0/2100491180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01ac06e340 0x7f01ac06e7b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f01ac0c4a30 tx=0x7f01a401c5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ecf5c3ca424524d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:47.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.847+0000 7f01ab400640 1 -- 172.21.15.8:0/2100491180 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a40aa660 con 0x7f01ac06e340 2024-03-23T23:51:47.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.847+0000 7f01ab400640 1 -- 172.21.15.8:0/2100491180 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a40af070 con 0x7f01ac06e340 2024-03-23T23:51:47.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.847+0000 7f01ab400640 1 -- 172.21.15.8:0/2100491180 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a40aaa20 con 0x7f01ac06e340 2024-03-23T23:51:47.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.851+0000 7f01b3400640 1 -- 172.21.15.8:0/2100491180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01ac06e340 msgr2=0x7f01ac06e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:47.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.851+0000 7f01b3400640 1 --2- 172.21.15.8:0/2100491180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01ac06e340 0x7f01ac06e7b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f01ac0c4a30 tx=0x7f01a401c5f0 comp rx=0 tx=0).stop 2024-03-23T23:51:47.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.851+0000 7f01b3400640 1 -- 172.21.15.8:0/2100491180 shutdown_connections 2024-03-23T23:51:47.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.851+0000 7f01b3400640 1 --2- 172.21.15.8:0/2100491180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01ac06e340 0x7f01ac06e7b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:47.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.851+0000 7f01b3400640 1 --2- 172.21.15.8:0/2100491180 >> v2:172.21.15.196:3300/0 conn(0x7f01ac0a9c80 0x7f01ac0c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:47.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.851+0000 7f01b3400640 1 -- 172.21.15.8:0/2100491180 >> 172.21.15.8:0/2100491180 conn(0x7f01ac0a9870 msgr2=0x7f01ac06b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:51:47.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.851+0000 7f01b3400640 1 -- 172.21.15.8:0/2100491180 shutdown_connections 2024-03-23T23:51:47.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.851+0000 7f01b3400640 1 -- 172.21.15.8:0/2100491180 wait complete. 2024-03-23T23:51:47.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.851+0000 7f01b3400640 1 Processor -- start 2024-03-23T23:51:47.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.855+0000 7f01b3400640 1 -- start start 2024-03-23T23:51:47.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.855+0000 7f01b3400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01ac06e340 0x7f01ac1440f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:47.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.855+0000 7f01b3400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01ac0a9c80 0x7f01ac0ab500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:47.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.855+0000 7f01b3400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f01ac14eb70 0x7f01ac0aba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:47.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.855+0000 7f01b3400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac1561d0 con 0x7f01ac0a9c80 2024-03-23T23:51:47.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.855+0000 7f01b3400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac152610 con 0x7f01ac14eb70 2024-03-23T23:51:47.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.855+0000 7f01b3400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac156350 con 0x7f01ac06e340 2024-03-23T23:51:47.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.855+0000 7f01b1400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f01ac14eb70 0x7f01ac0aba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:47.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.855+0000 7f01abe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01ac0a9c80 0x7f01ac0ab500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:47.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.855+0000 7f01b1400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f01ac14eb70 0x7f01ac0aba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:58080/0 (socket says 172.21.15.8:58080) 2024-03-23T23:51:47.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.855+0000 7f01b1400640 1 -- 172.21.15.8:0/3312468368 learned_addr learned my addr 172.21.15.8:0/3312468368 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:51:47.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.855+0000 7f01b0a00640 1 --2- 172.21.15.8:0/3312468368 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01ac06e340 0x7f01ac1440f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:47.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.855+0000 7f01b1400640 1 -- 172.21.15.8:0/3312468368 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01ac06e340 msgr2=0x7f01ac1440f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:47.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.855+0000 7f01b1400640 1 --2- 172.21.15.8:0/3312468368 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01ac06e340 0x7f01ac1440f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:47.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.855+0000 7f01b1400640 1 -- 172.21.15.8:0/3312468368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01ac0a9c80 msgr2=0x7f01ac0ab500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:47.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.855+0000 7f01b1400640 1 --2- 172.21.15.8:0/3312468368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01ac0a9c80 0x7f01ac0ab500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:47.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.855+0000 7f01b1400640 1 -- 172.21.15.8:0/3312468368 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ac143cb0 con 0x7f01ac14eb70 2024-03-23T23:51:47.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.855+0000 7f01abe00640 1 --2- 172.21.15.8:0/3312468368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01ac0a9c80 0x7f01ac0ab500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:51:47.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.859+0000 7f01b1400640 1 --2- 172.21.15.8:0/3312468368 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f01ac14eb70 0x7f01ac0aba40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f019c00b410 tx=0x7f019c00b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:47.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.859+0000 7f01a8c00640 1 -- 172.21.15.8:0/3312468368 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c015020 con 0x7f01ac14eb70 2024-03-23T23:51:47.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.859+0000 7f01a8c00640 1 -- 172.21.15.8:0/3312468368 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019c011870 con 0x7f01ac14eb70 2024-03-23T23:51:47.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.859+0000 7f01a8c00640 1 -- 172.21.15.8:0/3312468368 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c011c60 con 0x7f01ac14eb70 2024-03-23T23:51:47.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.859+0000 7f01b3400640 1 -- 172.21.15.8:0/3312468368 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ac1410f0 con 0x7f01ac14eb70 2024-03-23T23:51:47.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.859+0000 7f01b3400640 1 -- 172.21.15.8:0/3312468368 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ac1416b0 con 0x7f01ac14eb70 2024-03-23T23:51:47.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.863+0000 7f01b3400640 1 --2- 172.21.15.8:0/3312468368 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01ac0ac520 0x7f01ac13b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:47.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.863+0000 7f01b3400640 1 -- 172.21.15.8:0/3312468368 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac068270 con 0x7f01ac0ac520 2024-03-23T23:51:47.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.863+0000 7f01a8c00640 1 -- 172.21.15.8:0/3312468368 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f019c018020 con 0x7f01ac14eb70 2024-03-23T23:51:47.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.867+0000 7f01a8c00640 1 --2- 172.21.15.8:0/3312468368 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f018c0676b0 0x7f018c069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:47.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.867+0000 7f01b0a00640 1 --2- 172.21.15.8:0/3312468368 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01ac0ac520 0x7f01ac13b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:47.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.867+0000 7f01abe00640 1 --2- 172.21.15.8:0/3312468368 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f018c0676b0 0x7f018c069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:47.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.867+0000 7f01b0a00640 1 -- 172.21.15.8:0/3312468368 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f01ac0c1950 con 0x7f01ac0ac520 2024-03-23T23:51:47.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.867+0000 7f01abe00640 1 --2- 172.21.15.8:0/3312468368 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f018c0676b0 0x7f018c069b70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f01a40ae000 tx=0x7f01a40a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:47.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.867+0000 7f01a8c00640 1 -- 172.21.15.8:0/3312468368 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f019c011e00 con 0x7f01ac14eb70 2024-03-23T23:51:47.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.867+0000 7f01b0a00640 1 --2- 172.21.15.8:0/3312468368 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01ac0ac520 0x7f01ac13b710 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f01ac1510c0 tx=0x7f019800ab70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:47.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.871+0000 7f01a8c00640 1 -- 172.21.15.8:0/3312468368 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019801b070 con 0x7f01ac0ac520 2024-03-23T23:51:47.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.871+0000 7f01a8c00640 1 -- 172.21.15.8:0/3312468368 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f0198004230 con 0x7f01ac0ac520 2024-03-23T23:51:47.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.871+0000 7f01a8c00640 1 -- 172.21.15.8:0/3312468368 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01ac0ac520 msgr2=0x7f01ac13b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:47.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.871+0000 7f01a8c00640 1 --2- 172.21.15.8:0/3312468368 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01ac0ac520 0x7f01ac13b710 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f01ac1510c0 tx=0x7f019800ab70 comp rx=0 tx=0).stop 2024-03-23T23:51:47.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.871+0000 7f01a8c00640 1 -- 172.21.15.8:0/3312468368 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01ac0ac520 msgr2=0x7f01ac13b710 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:51:47.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.871+0000 7f01a8c00640 1 --2- 172.21.15.8:0/3312468368 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01ac0ac520 0x7f01ac13b710 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f01ac1510c0 tx=0x7f019800ab70 comp rx=0 tx=0).stop 2024-03-23T23:51:47.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.883+0000 7f01b3400640 1 --2- 172.21.15.8:0/3312468368 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01ac13bc50 0x7f01ac13c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:47.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.883+0000 7f01b3400640 1 -- 172.21.15.8:0/3312468368 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac13c5a0 con 0x7f01ac13bc50 2024-03-23T23:51:47.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.883+0000 7f01b0a00640 1 --2- 172.21.15.8:0/3312468368 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01ac13bc50 0x7f01ac13c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:47.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.883+0000 7f01b0a00640 1 -- 172.21.15.8:0/3312468368 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f01ac14d0a0 con 0x7f01ac13bc50 2024-03-23T23:51:47.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.883+0000 7f01b0a00640 1 --2- 172.21.15.8:0/3312468368 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01ac13bc50 0x7f01ac13c060 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0198007010 tx=0x7f01980046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:47.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.887+0000 7f01a8c00640 1 -- 172.21.15.8:0/3312468368 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019801b050 con 0x7f01ac13bc50 2024-03-23T23:51:47.891 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:51:47.891 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:51:47.892 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:51:47.892 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:51:47.892 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 66, 2024-03-23T23:51:47.892 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:51:47.892 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:51:47.892 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:51:47.892 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:51:47.892 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:47.892 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 15, 2024-03-23T23:51:47.892 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:51:47.892 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:51:47.892 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:51:47.892 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:51:47.893 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:51:47.893 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:51:47.893 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:51:47.893 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:51:47.893 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:51:47.893 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:51:47.893 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:51:47.893 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:51:47.893 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:51:47.893 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:51:47.893 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:47.893 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:51:47.893 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:51:47.893 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:51:47.894 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:51:47.894 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:51:47.894 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:51:47.894 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:51:47.894 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:51:47.894 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:51:47.894 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:51:47.894 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:51:47.894 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:51:47.894 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:51:47.894 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:47.894 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.894 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:51:47.895 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:51:47.895 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:51:47.895 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:51:47.895 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:51:47.895 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:51:47.895 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:51:47.895 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:51:47.895 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:51:47.895 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:51:47.895 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:51:47.895 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:51:47.895 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:51:47.895 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:51:47.896 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:51:47.896 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:51:47.896 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:51:47.896 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:51:47.896 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:51:47.896 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:51:47.896 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:51:47.896 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:51:47.896 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:51:47.896 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:51:47.896 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:51:47.896 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:51:47.896 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:51:47.896 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:51:47.897 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:47.897 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:51:47.897 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.897 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:51:47.897 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.897 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:51:47.897 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:51:47.897 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:51:47.897 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:51:47.897 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.897 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:51:47.897 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:51:47.897 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:47.898 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.898 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.898 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:51:47.898 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:51:47.898 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:47.898 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:47.898 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:47.898 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.898 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:51:47.898 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:51:47.898 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:51:47.898 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:51:47.898 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:51:47.899 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.899 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.899 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:51:47.899 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:51:47.899 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:51:47.899 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:51:47.899 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.899 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:51:47.899 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:51:47.899 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:47.899 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.899 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.899 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:51:47.899 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:51:47.900 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:47.900 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:47.900 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:47.900 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.900 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:51:47.900 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:51:47.900 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:51:47.900 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:51:47.900 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:51:47.900 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.900 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.901 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:51:47.901 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:51:47.901 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:51:47.901 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:51:47.901 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.901 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:51:47.901 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:51:47.901 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:47.901 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.901 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.902 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:51:47.902 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:51:47.902 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:51:47.902 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:47.902 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:47.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.902 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:51:47.902 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:51:47.902 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:51:47.902 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:51:47.902 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:51:47.902 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:47.902 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:47.903 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.903 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:51:47.903 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:51:47.903 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.903 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:51:47.903 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:51:47.903 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:51:47.903 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:47.903 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:47.903 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:51:47.903 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.903 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:51:47.903 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:51:47.903 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:51:47.903 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:47.904 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:47.904 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:51:47.904 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.904 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:51:47.904 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:51:47.904 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:51:47.904 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:47.904 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:47.904 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:51:47.904 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.904 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:51:47.904 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:51:47.904 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:51:47.905 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:47.905 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:51:47.905 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:51:47.905 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:51:47.905 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:51:47.905 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:51:47.905 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:51:47.905 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:51:47.905 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:51:47.905 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:51:47.905 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:51:47.905 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:51:47.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.887+0000 7f01a8c00640 1 -- 172.21.15.8:0/3312468368 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5040 (secure 0 0 0) 0x7f019801c040 con 0x7f01ac13bc50 2024-03-23T23:51:47.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.887+0000 7f01a8c00640 1 -- 172.21.15.8:0/3312468368 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01ac13bc50 msgr2=0x7f01ac13c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:47.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.887+0000 7f01a8c00640 1 --2- 172.21.15.8:0/3312468368 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01ac13bc50 0x7f01ac13c060 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0198007010 tx=0x7f01980046d0 comp rx=0 tx=0).stop 2024-03-23T23:51:47.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.887+0000 7f01a8c00640 1 -- 172.21.15.8:0/3312468368 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01ac13bc50 msgr2=0x7f01ac13c060 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:51:47.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.887+0000 7f01a8c00640 1 --2- 172.21.15.8:0/3312468368 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01ac13bc50 0x7f01ac13c060 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0198007010 tx=0x7f01980046d0 comp rx=0 tx=0).stop 2024-03-23T23:51:47.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.891+0000 7f01b3400640 1 -- 172.21.15.8:0/3312468368 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f018c0676b0 msgr2=0x7f018c069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:47.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.891+0000 7f01b3400640 1 --2- 172.21.15.8:0/3312468368 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f018c0676b0 0x7f018c069b70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f01a40ae000 tx=0x7f01a40a7000 comp rx=0 tx=0).stop 2024-03-23T23:51:47.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.891+0000 7f01b3400640 1 -- 172.21.15.8:0/3312468368 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f01ac14eb70 msgr2=0x7f01ac0aba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:47.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.891+0000 7f01b3400640 1 --2- 172.21.15.8:0/3312468368 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f01ac14eb70 0x7f01ac0aba40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f019c00b410 tx=0x7f019c00b8d0 comp rx=0 tx=0).stop 2024-03-23T23:51:47.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.891+0000 7f01b1400640 1 -- 172.21.15.8:0/3312468368 reap_dead start 2024-03-23T23:51:47.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.891+0000 7f01b1400640 1 -- 172.21.15.8:0/3312468368 reap_dead start 2024-03-23T23:51:47.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.891+0000 7f01b3400640 1 -- 172.21.15.8:0/3312468368 shutdown_connections 2024-03-23T23:51:47.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.891+0000 7f01b3400640 1 -- 172.21.15.8:0/3312468368 >> 172.21.15.8:0/3312468368 conn(0x7f01ac0a9870 msgr2=0x7f01ac06b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:51:47.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.891+0000 7f01b3400640 1 -- 172.21.15.8:0/3312468368 shutdown_connections 2024-03-23T23:51:47.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:47.891+0000 7f01b3400640 1 -- 172.21.15.8:0/3312468368 wait complete. 2024-03-23T23:51:47.934 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:51:47.935 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-03-23T23:51:47.935 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-03-23T23:51:47.935 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-03-23T23:51:47.935 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-03-23T23:51:47.935 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-23T23:51:47.935 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:51:47.962 INFO:tasks.ceph.mon.a:Stopped 2024-03-23T23:51:47.962 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-03-23T23:51:47.962 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:51:48.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.247+0000 7f8519e00640 1 Processor -- start 2024-03-23T23:51:48.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.247+0000 7f8519e00640 1 -- start start 2024-03-23T23:51:48.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.251+0000 7f8519e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f85140c2ee0 0x7f8514152630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:48.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.251+0000 7f8519e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8514070e90 0x7f85141562c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:48.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.251+0000 7f8519e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f85140ac250 0x7f851414c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:48.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.251+0000 7f8513400640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f85140ac250 msgr2=0x7f851414c270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:51:48.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.251+0000 7f8513400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f85140ac250 0x7f851414c270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:51:48.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.251+0000 7f8512000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8514070e90 0x7f85141562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:48.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.251+0000 7f8519e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8514155e30 con 0x7f85140ac250 2024-03-23T23:51:48.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.251+0000 7f8519e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8514152b70 con 0x7f8514070e90 2024-03-23T23:51:48.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.251+0000 7f8519e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8514152e10 con 0x7f85140c2ee0 2024-03-23T23:51:48.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.251+0000 7f8512000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8514070e90 0x7f85141562c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:58150/0 (socket says 172.21.15.8:58150) 2024-03-23T23:51:48.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.251+0000 7f8512000640 1 -- 172.21.15.8:0/808483898 learned_addr learned my addr 172.21.15.8:0/808483898 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:51:48.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.251+0000 7f8512a00640 1 --2- 172.21.15.8:0/808483898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f85140c2ee0 0x7f8514152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:48.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.251+0000 7f8512000640 1 -- 172.21.15.8:0/808483898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f85140c2ee0 msgr2=0x7f8514152630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:51:48.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.251+0000 7f8512000640 1 --2- 172.21.15.8:0/808483898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f85140c2ee0 0x7f8514152630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:48.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.251+0000 7f8512000640 1 -- 172.21.15.8:0/808483898 >> v2:172.21.15.8:3300/0 conn(0x7f85140ac250 msgr2=0x7f851414c270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:51:48.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.251+0000 7f8512000640 1 --2- 172.21.15.8:0/808483898 >> v2:172.21.15.8:3300/0 conn(0x7f85140ac250 0x7f851414c270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:48.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.251+0000 7f8512000640 1 -- 172.21.15.8:0/808483898 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85141530f0 con 0x7f8514070e90 2024-03-23T23:51:48.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.255+0000 7f8512000640 1 --2- 172.21.15.8:0/808483898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8514070e90 0x7f85141562c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f85140ac8f0 tx=0x7f84fc01c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=502691b467b6d47d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:48.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.255+0000 7f8511600640 1 -- 172.21.15.8:0/808483898 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc0b2070 con 0x7f8514070e90 2024-03-23T23:51:48.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.255+0000 7f8511600640 1 -- 172.21.15.8:0/808483898 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84fc0ad680 con 0x7f8514070e90 2024-03-23T23:51:48.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.255+0000 7f8511600640 1 -- 172.21.15.8:0/808483898 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc0ada50 con 0x7f8514070e90 2024-03-23T23:51:48.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.259+0000 7f8519e00640 1 -- 172.21.15.8:0/808483898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8514070e90 msgr2=0x7f85141562c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:48.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.259+0000 7f8519e00640 1 --2- 172.21.15.8:0/808483898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8514070e90 0x7f85141562c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f85140ac8f0 tx=0x7f84fc01c4b0 comp rx=0 tx=0).stop 2024-03-23T23:51:48.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.259+0000 7f8519e00640 1 -- 172.21.15.8:0/808483898 shutdown_connections 2024-03-23T23:51:48.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.259+0000 7f8519e00640 1 --2- 172.21.15.8:0/808483898 >> v2:172.21.15.8:3300/0 conn(0x7f85140ac250 0x7f851414c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:48.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.259+0000 7f8519e00640 1 --2- 172.21.15.8:0/808483898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8514070e90 0x7f85141562c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:48.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.259+0000 7f8519e00640 1 --2- 172.21.15.8:0/808483898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f85140c2ee0 0x7f8514152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:48.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.259+0000 7f8519e00640 1 -- 172.21.15.8:0/808483898 >> 172.21.15.8:0/808483898 conn(0x7f851406b170 msgr2=0x7f851406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:51:48.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.259+0000 7f8519e00640 1 -- 172.21.15.8:0/808483898 shutdown_connections 2024-03-23T23:51:48.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.259+0000 7f8519e00640 1 -- 172.21.15.8:0/808483898 wait complete. 2024-03-23T23:51:48.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.259+0000 7f8519e00640 1 Processor -- start 2024-03-23T23:51:48.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.259+0000 7f8519e00640 1 -- start start 2024-03-23T23:51:48.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.263+0000 7f8519e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8514070e90 0x7f851414b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:48.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.263+0000 7f8519e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85140ac250 0x7f85141521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:48.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.263+0000 7f8519e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f85140c2ee0 0x7f851413eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:48.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.263+0000 7f8519e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85140c47a0 con 0x7f85140ac250 2024-03-23T23:51:48.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.263+0000 7f8519e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85140c4620 con 0x7f85140c2ee0 2024-03-23T23:51:48.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.263+0000 7f8519e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85140c4920 con 0x7f8514070e90 2024-03-23T23:51:48.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.263+0000 7f8512000640 1 -- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85140ac250 msgr2=0x7f85141521e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:51:48.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.263+0000 7f8512000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85140ac250 0x7f85141521e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:51:48.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.263+0000 7f8513400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f85140c2ee0 0x7f851413eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:48.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.263+0000 7f8513400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f85140c2ee0 0x7f851413eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:58160/0 (socket says 172.21.15.8:58160) 2024-03-23T23:51:48.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.263+0000 7f8513400640 1 -- 172.21.15.8:0/4088178681 learned_addr learned my addr 172.21.15.8:0/4088178681 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:51:48.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.263+0000 7f8513400640 1 -- 172.21.15.8:0/4088178681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8514070e90 msgr2=0x7f851414b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:48.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.263+0000 7f8513400640 1 --2- 172.21.15.8:0/4088178681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8514070e90 0x7f851414b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:48.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.263+0000 7f8513400640 1 -- 172.21.15.8:0/4088178681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85140ac250 msgr2=0x7f85141521e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:51:48.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.263+0000 7f8513400640 1 --2- 172.21.15.8:0/4088178681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85140ac250 0x7f85141521e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:48.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.263+0000 7f8513400640 1 -- 172.21.15.8:0/4088178681 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8514151b50 con 0x7f85140c2ee0 2024-03-23T23:51:48.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.267+0000 7f8513400640 1 --2- 172.21.15.8:0/4088178681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f85140c2ee0 0x7f851413eb00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f850c00be60 tx=0x7f850c00bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:48.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.267+0000 7f850b400640 1 -- 172.21.15.8:0/4088178681 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c00ce40 con 0x7f85140c2ee0 2024-03-23T23:51:48.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.267+0000 7f850b400640 1 -- 172.21.15.8:0/4088178681 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850c010030 con 0x7f85140c2ee0 2024-03-23T23:51:48.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.267+0000 7f850b400640 1 -- 172.21.15.8:0/4088178681 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c016650 con 0x7f85140c2ee0 2024-03-23T23:51:48.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.267+0000 7f8519e00640 1 -- 172.21.15.8:0/4088178681 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85140c6db0 con 0x7f85140c2ee0 2024-03-23T23:51:48.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.271+0000 7f8519e00640 1 -- 172.21.15.8:0/4088178681 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85140c5c70 con 0x7f85140c2ee0 2024-03-23T23:51:48.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.271+0000 7f8519e00640 1 -- 172.21.15.8:0/4088178681 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f851404f480 con 0x7f85140c2ee0 2024-03-23T23:51:48.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.275+0000 7f850b400640 1 -- 172.21.15.8:0/4088178681 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f850c0153e0 con 0x7f85140c2ee0 2024-03-23T23:51:48.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.275+0000 7f850b400640 1 --2- 172.21.15.8:0/4088178681 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f84f0067690 0x7f84f0069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:48.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.275+0000 7f850b400640 1 -- 172.21.15.8:0/4088178681 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f850c085f40 con 0x7f85140c2ee0 2024-03-23T23:51:48.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.279+0000 7f8512a00640 1 --2- 172.21.15.8:0/4088178681 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f84f0067690 0x7f84f0069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:48.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.283+0000 7f8512a00640 1 --2- 172.21.15.8:0/4088178681 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f84f0067690 0x7f84f0069b50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f85040098f0 tx=0x7f8504008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:48.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.291+0000 7f850b400640 1 -- 172.21.15.8:0/4088178681 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f850c0568e0 con 0x7f85140c2ee0 2024-03-23T23:51:48.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.763+0000 7f8519e00640 1 -- 172.21.15.8:0/4088178681 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f85140713e0 con 0x7f85140c2ee0 2024-03-23T23:51:48.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.767+0000 7f850b400640 1 -- 172.21.15.8:0/4088178681 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1561 (secure 0 0 0) 0x7f850c0561e0 con 0x7f85140c2ee0 2024-03-23T23:51:48.777 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":66,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:51:48.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.775+0000 7f8519e00640 1 -- 172.21.15.8:0/4088178681 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f84f0067690 msgr2=0x7f84f0069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:48.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.775+0000 7f8519e00640 1 --2- 172.21.15.8:0/4088178681 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f84f0067690 0x7f84f0069b50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f85040098f0 tx=0x7f8504008040 comp rx=0 tx=0).stop 2024-03-23T23:51:48.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.775+0000 7f8519e00640 1 -- 172.21.15.8:0/4088178681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f85140c2ee0 msgr2=0x7f851413eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:48.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.775+0000 7f8519e00640 1 --2- 172.21.15.8:0/4088178681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f85140c2ee0 0x7f851413eb00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f850c00be60 tx=0x7f850c00bf50 comp rx=0 tx=0).stop 2024-03-23T23:51:48.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.775+0000 7f8519e00640 1 -- 172.21.15.8:0/4088178681 shutdown_connections 2024-03-23T23:51:48.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.775+0000 7f8519e00640 1 --2- 172.21.15.8:0/4088178681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f85140c2ee0 0x7f851413eb00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:48.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.775+0000 7f8519e00640 1 --2- 172.21.15.8:0/4088178681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85140ac250 0x7f85141521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:48.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.775+0000 7f8519e00640 1 --2- 172.21.15.8:0/4088178681 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f84f0067690 0x7f84f0069b50 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:48.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.775+0000 7f8519e00640 1 --2- 172.21.15.8:0/4088178681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8514070e90 0x7f851414b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:48.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.775+0000 7f8519e00640 1 -- 172.21.15.8:0/4088178681 >> 172.21.15.8:0/4088178681 conn(0x7f851406b170 msgr2=0x7f851406b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:51:48.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.775+0000 7f8519e00640 1 -- 172.21.15.8:0/4088178681 shutdown_connections 2024-03-23T23:51:48.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:48.775+0000 7f8519e00640 1 -- 172.21.15.8:0/4088178681 wait complete. 2024-03-23T23:51:51.831 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:51:51.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.983+0000 7f6960c00640 1 Processor -- start 2024-03-23T23:51:51.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.983+0000 7f6960c00640 1 -- start start 2024-03-23T23:51:51.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.983+0000 7f6960c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f695c0aad50 0x7f695c153800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:51.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.983+0000 7f6960c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f695c0c3590 0x7f695c153d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:51.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.983+0000 7f6960c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f695c0a9cc0 con 0x7f695c150e40 2024-03-23T23:51:51.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.983+0000 7f6960c00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f695c0c3000 con 0x7f695c0aad50 2024-03-23T23:51:51.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.983+0000 7f6960c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695c0a9a20 con 0x7f695c0c3590 2024-03-23T23:51:51.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.983+0000 7f6959400640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f695c0aad50 msgr2=0x7f695c153800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:51:51.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.983+0000 7f6959400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f695c0aad50 0x7f695c153800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:51:51.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.983+0000 7f6959e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f695c150e40 0x7f695c06b170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:52408/0 (socket says 172.21.15.8:52408) 2024-03-23T23:51:51.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.983+0000 7f6959e00640 1 -- 172.21.15.8:0/2808498358 learned_addr learned my addr 172.21.15.8:0/2808498358 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:51:51.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.983+0000 7f695a800640 1 --2- 172.21.15.8:0/2808498358 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f695c0c3590 0x7f695c153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:51.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.983+0000 7f6958a00640 1 -- 172.21.15.8:0/2808498358 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685055085 0 0) 0x7f695c0a9cc0 con 0x7f695c150e40 2024-03-23T23:51:51.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.983+0000 7f6958a00640 1 -- 172.21.15.8:0/2808498358 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6940003530 con 0x7f695c150e40 2024-03-23T23:51:51.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.987+0000 7f6958a00640 1 -- 172.21.15.8:0/2808498358 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2351253299 0 0) 0x7f6940003530 con 0x7f695c150e40 2024-03-23T23:51:51.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.987+0000 7f6958a00640 1 -- 172.21.15.8:0/2808498358 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f695c0c3590 msgr2=0x7f695c153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:51:51.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.987+0000 7f6958a00640 1 --2- 172.21.15.8:0/2808498358 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f695c0c3590 0x7f695c153d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:51.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.987+0000 7f6958a00640 1 -- 172.21.15.8:0/2808498358 >> v2:172.21.15.8:3300/0 conn(0x7f695c0aad50 msgr2=0x7f695c153800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:51:51.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.987+0000 7f6958a00640 1 --2- 172.21.15.8:0/2808498358 >> v2:172.21.15.8:3300/0 conn(0x7f695c0aad50 0x7f695c153800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:51.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.987+0000 7f6958a00640 1 -- 172.21.15.8:0/2808498358 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695c151220 con 0x7f695c150e40 2024-03-23T23:51:51.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.987+0000 7f6958a00640 1 -- 172.21.15.8:0/2808498358 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7f694c0016a0 con 0x7f695c150e40 2024-03-23T23:51:51.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.987+0000 7f6958a00640 1 -- 172.21.15.8:0/2808498358 >> v1:172.21.15.196:6789/0 conn(0x7f695c150e40 legacy=0x7f695c06b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:51.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.987+0000 7f6958a00640 1 --2- 172.21.15.8:0/2808498358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6940003a30 0x7f6940003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:51.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.987+0000 7f6958a00640 1 --2- 172.21.15.8:0/2808498358 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f695c0c3590 0x7f6940004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:51.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.987+0000 7f6958a00640 1 --2- 172.21.15.8:0/2808498358 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6940004d50 0x7f69400051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:51.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.987+0000 7f6958a00640 1 -- 172.21.15.8:0/2808498358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695c0c3000 con 0x7f6940003a30 2024-03-23T23:51:51.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.987+0000 7f6958a00640 1 -- 172.21.15.8:0/2808498358 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695c0a9a20 con 0x7f6940004d50 2024-03-23T23:51:51.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.987+0000 7f6958a00640 1 -- 172.21.15.8:0/2808498358 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f694000bbe0 con 0x7f695c0c3590 2024-03-23T23:51:51.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.987+0000 7f6959e00640 1 -- 172.21.15.8:0/2808498358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6940003a30 msgr2=0x7f6940003e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:51:51.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.987+0000 7f6959e00640 1 --2- 172.21.15.8:0/2808498358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6940003a30 0x7f6940003e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:51:51.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.987+0000 7f695a800640 1 --2- 172.21.15.8:0/2808498358 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6940004d50 0x7f69400051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:51.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.987+0000 7f695a800640 1 -- 172.21.15.8:0/2808498358 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f695c0c3590 msgr2=0x7f6940004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:51:51.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.987+0000 7f695a800640 1 --2- 172.21.15.8:0/2808498358 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f695c0c3590 0x7f6940004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:51.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.987+0000 7f695a800640 1 -- 172.21.15.8:0/2808498358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6940003a30 msgr2=0x7f6940003e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:51:51.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.987+0000 7f695a800640 1 --2- 172.21.15.8:0/2808498358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6940003a30 0x7f6940003e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:51.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.987+0000 7f695a800640 1 -- 172.21.15.8:0/2808498358 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6940003530 con 0x7f6940004d50 2024-03-23T23:51:51.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.991+0000 7f695a800640 1 --2- 172.21.15.8:0/2808498358 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6940004d50 0x7f69400051d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6954009f90 tx=0x7f695401d6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f48cda78c492ec7 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:51.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.991+0000 7f6958a00640 1 -- 172.21.15.8:0/2808498358 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6954009c10 con 0x7f6940004d50 2024-03-23T23:51:51.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.995+0000 7f6958a00640 1 -- 172.21.15.8:0/2808498358 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69540a5aa0 con 0x7f6940004d50 2024-03-23T23:51:51.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.995+0000 7f6958a00640 1 -- 172.21.15.8:0/2808498358 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69540ad3f0 con 0x7f6940004d50 2024-03-23T23:51:51.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.995+0000 7f6960c00640 1 -- 172.21.15.8:0/2808498358 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6940004d50 msgr2=0x7f69400051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:51.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.995+0000 7f6960c00640 1 --2- 172.21.15.8:0/2808498358 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6940004d50 0x7f69400051d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6954009f90 tx=0x7f695401d6e0 comp rx=0 tx=0).stop 2024-03-23T23:51:51.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.995+0000 7f695a800640 1 -- 172.21.15.8:0/2808498358 reap_dead start 2024-03-23T23:51:51.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.995+0000 7f6960c00640 1 -- 172.21.15.8:0/2808498358 shutdown_connections 2024-03-23T23:51:51.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.995+0000 7f6960c00640 1 -- 172.21.15.8:0/2808498358 >> 172.21.15.8:0/2808498358 conn(0x7f695c0c8180 msgr2=0x7f695c0c8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:51:51.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.995+0000 7f6960c00640 1 -- 172.21.15.8:0/2808498358 shutdown_connections 2024-03-23T23:51:51.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.995+0000 7f6960c00640 1 -- 172.21.15.8:0/2808498358 wait complete. 2024-03-23T23:51:52.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.995+0000 7f6960c00640 1 Processor -- start 2024-03-23T23:51:52.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.995+0000 7f6960c00640 1 -- start start 2024-03-23T23:51:52.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.999+0000 7f6960c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6940004d50 0x7f695c1f17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:52.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.999+0000 7f6960c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f695c0c5c80 0x7f695c145e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:52.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.999+0000 7f6960c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f695c0c6100 0x7f695c1463b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:52.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.999+0000 7f6960c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695c06c020 con 0x7f6940004d50 2024-03-23T23:51:52.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.999+0000 7f6960c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695c06bea0 con 0x7f695c0c6100 2024-03-23T23:51:52.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.999+0000 7f6960c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695c15e0a0 con 0x7f695c0c5c80 2024-03-23T23:51:52.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.999+0000 7f6959e00640 1 -- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6940004d50 msgr2=0x7f695c1f17b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:51:52.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.999+0000 7f6959e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6940004d50 0x7f695c1f17b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:51:52.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.999+0000 7f695a800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f695c0c6100 0x7f695c1463b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:52.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.999+0000 7f6959400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f695c0c5c80 0x7f695c145e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:52.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.999+0000 7f695a800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f695c0c6100 0x7f695c1463b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:58178/0 (socket says 172.21.15.8:58178) 2024-03-23T23:51:52.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:51.999+0000 7f695a800640 1 -- 172.21.15.8:0/316066316 learned_addr learned my addr 172.21.15.8:0/316066316 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:51:52.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:52.003+0000 7f6959400640 1 -- 172.21.15.8:0/316066316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f695c0c6100 msgr2=0x7f695c1463b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:52.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:52.003+0000 7f6959400640 1 --2- 172.21.15.8:0/316066316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f695c0c6100 0x7f695c1463b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:52.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:52.003+0000 7f6959400640 1 -- 172.21.15.8:0/316066316 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6940004d50 msgr2=0x7f695c1f17b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:51:52.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:52.003+0000 7f6959400640 1 --2- 172.21.15.8:0/316066316 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6940004d50 0x7f695c1f17b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:52.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:52.003+0000 7f6959400640 1 -- 172.21.15.8:0/316066316 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695c154e30 con 0x7f695c0c5c80 2024-03-23T23:51:52.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:52.003+0000 7f6959400640 1 --2- 172.21.15.8:0/316066316 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f695c0c5c80 0x7f695c145e70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f694800b360 tx=0x7f694800b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:52.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:52.003+0000 7f6952000640 1 -- 172.21.15.8:0/316066316 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6948016070 con 0x7f695c0c5c80 2024-03-23T23:51:52.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:52.003+0000 7f6952000640 1 -- 172.21.15.8:0/316066316 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6948003dc0 con 0x7f695c0c5c80 2024-03-23T23:51:52.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:52.003+0000 7f6952000640 1 -- 172.21.15.8:0/316066316 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69480052b0 con 0x7f695c0c5c80 2024-03-23T23:51:52.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:52.003+0000 7f6960c00640 1 -- 172.21.15.8:0/316066316 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f695c1f2000 con 0x7f695c0c5c80 2024-03-23T23:51:52.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:52.003+0000 7f6960c00640 1 -- 172.21.15.8:0/316066316 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f695c0c6bc0 con 0x7f695c0c5c80 2024-03-23T23:51:52.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:52.003+0000 7f6960c00640 1 -- 172.21.15.8:0/316066316 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f695c04f480 con 0x7f695c0c5c80 2024-03-23T23:51:52.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:52.007+0000 7f6952000640 1 -- 172.21.15.8:0/316066316 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f6948019070 con 0x7f695c0c5c80 2024-03-23T23:51:52.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:52.007+0000 7f6952000640 1 --2- 172.21.15.8:0/316066316 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f693c067690 0x7f693c069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:52.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:52.007+0000 7f6952000640 1 -- 172.21.15.8:0/316066316 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f69480851c0 con 0x7f695c0c5c80 2024-03-23T23:51:52.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:52.011+0000 7f6959e00640 1 --2- 172.21.15.8:0/316066316 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f693c067690 0x7f693c069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:52.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:52.011+0000 7f6959e00640 1 --2- 172.21.15.8:0/316066316 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f693c067690 0x7f693c069b50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f694c001ec0 tx=0x7f694c0015d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:52.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:52.015+0000 7f6952000640 1 -- 172.21.15.8:0/316066316 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f6948020020 con 0x7f695c0c5c80 2024-03-23T23:51:52.184 INFO:tasks.workunit.client.1.smithi196.stdout:fs setup took 380 secs 2024-03-23T23:51:52.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:52.315+0000 7f6960c00640 1 -- 172.21.15.8:0/316066316 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f695c06bc80 con 0x7f695c0c5c80 2024-03-23T23:51:52.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:52.327+0000 7f6952000640 1 -- 172.21.15.8:0/316066316 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1561 (secure 0 0 0) 0x7f69480554a0 con 0x7f695c0c5c80 2024-03-23T23:51:52.331 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":66,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:51:52.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:52.331+0000 7f6960c00640 1 -- 172.21.15.8:0/316066316 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f693c067690 msgr2=0x7f693c069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:52.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:52.331+0000 7f6960c00640 1 --2- 172.21.15.8:0/316066316 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f693c067690 0x7f693c069b50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f694c001ec0 tx=0x7f694c0015d0 comp rx=0 tx=0).stop 2024-03-23T23:51:52.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:52.331+0000 7f6960c00640 1 -- 172.21.15.8:0/316066316 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f695c0c5c80 msgr2=0x7f695c145e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:52.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:52.331+0000 7f6960c00640 1 --2- 172.21.15.8:0/316066316 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f695c0c5c80 0x7f695c145e70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f694800b360 tx=0x7f694800b820 comp rx=0 tx=0).stop 2024-03-23T23:51:52.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:52.331+0000 7f6960c00640 1 -- 172.21.15.8:0/316066316 shutdown_connections 2024-03-23T23:51:52.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:52.331+0000 7f6960c00640 1 --2- 172.21.15.8:0/316066316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f695c0c6100 0x7f695c1463b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:52.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:52.331+0000 7f6960c00640 1 --2- 172.21.15.8:0/316066316 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f693c067690 0x7f693c069b50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:52.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:52.331+0000 7f6960c00640 1 --2- 172.21.15.8:0/316066316 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f695c0c5c80 0x7f695c145e70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:52.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:52.331+0000 7f6960c00640 1 --2- 172.21.15.8:0/316066316 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6940004d50 0x7f695c1f17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:52.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:52.331+0000 7f6960c00640 1 -- 172.21.15.8:0/316066316 >> 172.21.15.8:0/316066316 conn(0x7f695c0c8180 msgr2=0x7f695c071ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:51:52.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:52.331+0000 7f6960c00640 1 -- 172.21.15.8:0/316066316 shutdown_connections 2024-03-23T23:51:52.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:52.331+0000 7f6960c00640 1 -- 172.21.15.8:0/316066316 wait complete. 2024-03-23T23:51:54.807 INFO:tasks.workunit.client.1.smithi196.stdout:Syncing()...2 sec 2024-03-23T23:51:54.809 INFO:tasks.workunit.client.1.smithi196.stdout:Starting Actual Benchmark At: Sat Mar 23 23:51:54 2024 2024-03-23T23:51:54.809 INFO:tasks.workunit.client.1.smithi196.stdout: 2024-03-23T23:51:55.362 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:51:55.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.523+0000 7efd23a00640 1 Processor -- start 2024-03-23T23:51:55.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.523+0000 7efd23a00640 1 -- start start 2024-03-23T23:51:55.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.527+0000 7efd23a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7efd1c06c3e0 0x7efd1c06f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:55.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.527+0000 7efd23a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7efd1c0c6310 0x7efd1c155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:55.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.527+0000 7efd23a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd1c159dd0 con 0x7efd1c159940 2024-03-23T23:51:55.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.527+0000 7efd23a00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd1c0c5e80 con 0x7efd1c0c6310 2024-03-23T23:51:55.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.527+0000 7efd23a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd1c0a6d80 con 0x7efd1c06c3e0 2024-03-23T23:51:55.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.527+0000 7efd13e00640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7efd1c159940 legacy=0x7efd1c0c0d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:51:55.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.527+0000 7efd21a00640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7efd1c0c6310 msgr2=0x7efd1c155ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:51:55.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.527+0000 7efd21a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7efd1c0c6310 0x7efd1c155ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:51:55.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.535+0000 7efd21000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7efd1c06c3e0 0x7efd1c06f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:55.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.535+0000 7efd21000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7efd1c06c3e0 0x7efd1c06f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:42454/0 (socket says 172.21.15.8:42454) 2024-03-23T23:51:55.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.535+0000 7efd21000640 1 -- 172.21.15.8:0/2732373730 learned_addr learned my addr 172.21.15.8:0/2732373730 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:51:55.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.543+0000 7efd21000640 1 -- 172.21.15.8:0/2732373730 >> v2:172.21.15.8:3300/0 conn(0x7efd1c0c6310 msgr2=0x7efd1c155ee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:51:55.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.543+0000 7efd21000640 1 --2- 172.21.15.8:0/2732373730 >> v2:172.21.15.8:3300/0 conn(0x7efd1c0c6310 0x7efd1c155ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:55.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.543+0000 7efd21000640 1 -- 172.21.15.8:0/2732373730 >> v1:172.21.15.8:6789/0 conn(0x7efd1c159940 legacy=0x7efd1c0c0d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:51:55.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.543+0000 7efd21000640 1 -- 172.21.15.8:0/2732373730 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd1c0a7060 con 0x7efd1c06c3e0 2024-03-23T23:51:55.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.543+0000 7efd21000640 1 --2- 172.21.15.8:0/2732373730 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd1c06c3e0 0x7efd1c06f3f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efd1c0aa730 tx=0x7efd0c01c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d44bc130a1c513c5 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:55.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.551+0000 7efd1be00640 1 -- 172.21.15.8:0/2732373730 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c0b0070 con 0x7efd1c06c3e0 2024-03-23T23:51:55.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.551+0000 7efd1be00640 1 -- 172.21.15.8:0/2732373730 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0c0ab600 con 0x7efd1c06c3e0 2024-03-23T23:51:55.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.551+0000 7efd1be00640 1 -- 172.21.15.8:0/2732373730 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c0ab9d0 con 0x7efd1c06c3e0 2024-03-23T23:51:55.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.551+0000 7efd23a00640 1 -- 172.21.15.8:0/2732373730 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd1c06c3e0 msgr2=0x7efd1c06f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:55.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.551+0000 7efd23a00640 1 --2- 172.21.15.8:0/2732373730 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd1c06c3e0 0x7efd1c06f3f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efd1c0aa730 tx=0x7efd0c01c440 comp rx=0 tx=0).stop 2024-03-23T23:51:55.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.551+0000 7efd23a00640 1 -- 172.21.15.8:0/2732373730 shutdown_connections 2024-03-23T23:51:55.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.551+0000 7efd23a00640 1 --2- 172.21.15.8:0/2732373730 >> v2:172.21.15.8:3300/0 conn(0x7efd1c0c6310 0x7efd1c155ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:55.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.551+0000 7efd23a00640 1 --2- 172.21.15.8:0/2732373730 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd1c06c3e0 0x7efd1c06f3f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:55.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.551+0000 7efd23a00640 1 -- 172.21.15.8:0/2732373730 >> 172.21.15.8:0/2732373730 conn(0x7efd1c0c4400 msgr2=0x7efd1c0c4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:51:55.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.551+0000 7efd23a00640 1 -- 172.21.15.8:0/2732373730 shutdown_connections 2024-03-23T23:51:55.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.551+0000 7efd23a00640 1 -- 172.21.15.8:0/2732373730 wait complete. 2024-03-23T23:51:55.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.551+0000 7efd23a00640 1 Processor -- start 2024-03-23T23:51:55.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.551+0000 7efd23a00640 1 -- start start 2024-03-23T23:51:55.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.551+0000 7efd23a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd1c06c3e0 0x7efd1c151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:55.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.551+0000 7efd23a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efd1c0c6310 0x7efd1c0c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:55.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.551+0000 7efd23a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd1c144730 0x7efd1c072970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:55.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.551+0000 7efd23a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1c162270 con 0x7efd1c144730 2024-03-23T23:51:55.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.551+0000 7efd23a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1c06ca10 con 0x7efd1c06c3e0 2024-03-23T23:51:55.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.551+0000 7efd23a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd1c1623f0 con 0x7efd1c0c6310 2024-03-23T23:51:55.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.551+0000 7efd21a00640 1 -- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd1c144730 msgr2=0x7efd1c072970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:51:55.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.551+0000 7efd21a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd1c144730 0x7efd1c072970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:51:55.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.551+0000 7efd21000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd1c06c3e0 0x7efd1c151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:55.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.551+0000 7efd21000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd1c06c3e0 0x7efd1c151a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:42458/0 (socket says 172.21.15.8:42458) 2024-03-23T23:51:55.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.551+0000 7efd21000640 1 -- 172.21.15.8:0/25657658 learned_addr learned my addr 172.21.15.8:0/25657658 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:51:55.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.563+0000 7efd21000640 1 -- 172.21.15.8:0/25657658 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efd1c0c6310 msgr2=0x7efd1c0c28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:55.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.563+0000 7efd21000640 1 --2- 172.21.15.8:0/25657658 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efd1c0c6310 0x7efd1c0c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:55.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.563+0000 7efd21000640 1 -- 172.21.15.8:0/25657658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd1c144730 msgr2=0x7efd1c072970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:51:55.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.563+0000 7efd21000640 1 --2- 172.21.15.8:0/25657658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd1c144730 0x7efd1c072970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:55.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.563+0000 7efd21000640 1 -- 172.21.15.8:0/25657658 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd1c143b80 con 0x7efd1c06c3e0 2024-03-23T23:51:55.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.563+0000 7efd21000640 1 --2- 172.21.15.8:0/25657658 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd1c06c3e0 0x7efd1c151a90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efd0c0ae040 tx=0x7efd0c01ac80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:55.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.563+0000 7efd19600640 1 -- 172.21.15.8:0/25657658 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c0ba020 con 0x7efd1c06c3e0 2024-03-23T23:51:55.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.563+0000 7efd19600640 1 -- 172.21.15.8:0/25657658 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0c0b6640 con 0x7efd1c06c3e0 2024-03-23T23:51:55.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.563+0000 7efd19600640 1 -- 172.21.15.8:0/25657658 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c0b0040 con 0x7efd1c06c3e0 2024-03-23T23:51:55.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.563+0000 7efd23a00640 1 -- 172.21.15.8:0/25657658 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd1c150fb0 con 0x7efd1c06c3e0 2024-03-23T23:51:55.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.563+0000 7efd23a00640 1 -- 172.21.15.8:0/25657658 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd1c151570 con 0x7efd1c06c3e0 2024-03-23T23:51:55.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.567+0000 7efd23a00640 1 -- 172.21.15.8:0/25657658 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd1c04f480 con 0x7efd1c06c3e0 2024-03-23T23:51:55.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.571+0000 7efd19600640 1 -- 172.21.15.8:0/25657658 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7efd0c0bd020 con 0x7efd1c06c3e0 2024-03-23T23:51:55.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.571+0000 7efd19600640 1 --2- 172.21.15.8:0/25657658 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7efcf8067610 0x7efcf8069ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:55.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.575+0000 7efd19600640 1 -- 172.21.15.8:0/25657658 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7efd0c1202c0 con 0x7efd1c06c3e0 2024-03-23T23:51:55.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.575+0000 7efd13e00640 1 --2- 172.21.15.8:0/25657658 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7efcf8067610 0x7efcf8069ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:55.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.587+0000 7efd13e00640 1 --2- 172.21.15.8:0/25657658 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7efcf8067610 0x7efcf8069ad0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efd1c144130 tx=0x7efd04006ca0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:51:55.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.611+0000 7efd19600640 1 -- 172.21.15.8:0/25657658 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7efd0c0c4030 con 0x7efd1c06c3e0 2024-03-23T23:51:55.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.883+0000 7efd23a00640 1 -- 172.21.15.8:0/25657658 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7efd1c151740 con 0x7efd1c06c3e0 2024-03-23T23:51:55.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.883+0000 7efd19600640 1 -- 172.21.15.8:0/25657658 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1561 (secure 0 0 0) 0x7efd0c0160f0 con 0x7efd1c06c3e0 2024-03-23T23:51:55.888 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":66,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:51:55.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.887+0000 7efd23a00640 1 -- 172.21.15.8:0/25657658 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7efcf8067610 msgr2=0x7efcf8069ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:55.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.887+0000 7efd23a00640 1 --2- 172.21.15.8:0/25657658 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7efcf8067610 0x7efcf8069ad0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efd1c144130 tx=0x7efd04006ca0 comp rx=0 tx=0).stop 2024-03-23T23:51:55.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.887+0000 7efd23a00640 1 -- 172.21.15.8:0/25657658 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd1c06c3e0 msgr2=0x7efd1c151a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:51:55.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.887+0000 7efd23a00640 1 --2- 172.21.15.8:0/25657658 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd1c06c3e0 0x7efd1c151a90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efd0c0ae040 tx=0x7efd0c01ac80 comp rx=0 tx=0).stop 2024-03-23T23:51:55.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.887+0000 7efd23a00640 1 -- 172.21.15.8:0/25657658 shutdown_connections 2024-03-23T23:51:55.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.887+0000 7efd23a00640 1 --2- 172.21.15.8:0/25657658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd1c144730 0x7efd1c072970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:55.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.887+0000 7efd23a00640 1 --2- 172.21.15.8:0/25657658 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7efcf8067610 0x7efcf8069ad0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:55.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.887+0000 7efd23a00640 1 --2- 172.21.15.8:0/25657658 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efd1c0c6310 0x7efd1c0c28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:55.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.887+0000 7efd23a00640 1 --2- 172.21.15.8:0/25657658 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd1c06c3e0 0x7efd1c151a90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:51:55.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.887+0000 7efd23a00640 1 -- 172.21.15.8:0/25657658 >> 172.21.15.8:0/25657658 conn(0x7efd1c0c4400 msgr2=0x7efd1c0c51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:51:55.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.887+0000 7efd23a00640 1 -- 172.21.15.8:0/25657658 shutdown_connections 2024-03-23T23:51:55.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:55.887+0000 7efd23a00640 1 -- 172.21.15.8:0/25657658 wait complete. 2024-03-23T23:51:58.920 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:51:59.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:59.275+0000 7f6516400640 1 Processor -- start 2024-03-23T23:51:59.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:59.275+0000 7f6516400640 1 -- start start 2024-03-23T23:51:59.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:59.275+0000 7f6516400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6510072f00 0x7f651006ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:51:59.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:59.275+0000 7f6516400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f651006f400 con 0x7f6510072b20 2024-03-23T23:51:59.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:59.275+0000 7f6516400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f651006f6e0 con 0x7f6510152490 2024-03-23T23:51:59.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:59.275+0000 7f6516400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6510073370 con 0x7f6510072f00 2024-03-23T23:51:59.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:59.275+0000 7f650f400640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f6510072b20 legacy=0x7f65100a9990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:51:59.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:59.279+0000 7f650fe00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6510072f00 0x7f651006ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:59.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:59.279+0000 7f650fe00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6510072f00 0x7f651006ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:42470/0 (socket says 172.21.15.8:42470) 2024-03-23T23:51:59.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:59.279+0000 7f650fe00640 1 -- 172.21.15.8:0/3790872659 learned_addr learned my addr 172.21.15.8:0/3790872659 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:51:59.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:59.279+0000 7f650ea00640 1 --1- 172.21.15.8:0/3790872659 >> v1:172.21.15.196:6789/0 conn(0x7f6510152490 0x7f65100aa0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:39282/0 (socket says 172.21.15.8:39282) 2024-03-23T23:51:59.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:59.279+0000 7f650fe00640 1 -- 172.21.15.8:0/3790872659 >> v2:172.21.15.196:3300/0 conn(0x7f6510072f00 msgr2=0x7f651006ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T23:51:59.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:59.279+0000 7f650fe00640 1 -- 172.21.15.8:0/3790872659 >> v2:172.21.15.196:3300/0 conn(0x7f6510072f00 msgr2=0x7f651006ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:51:59.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:59.279+0000 7f650fe00640 1 --2- 172.21.15.8:0/3790872659 >> v2:172.21.15.196:3300/0 conn(0x7f6510072f00 0x7f651006ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:51:59.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:59.279+0000 7f650fe00640 1 --2- 172.21.15.8:0/3790872659 >> v2:172.21.15.196:3300/0 conn(0x7f6510072f00 0x7f651006ecb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:51:59.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:59.483+0000 7f650f400640 1 -- 172.21.15.8:0/3790872659 >> v1:172.21.15.8:6789/0 conn(0x7f6510072b20 legacy=0x7f65100a9990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:51:59.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:59.483+0000 7f650fe00640 1 --2- 172.21.15.8:0/3790872659 >> v2:172.21.15.196:3300/0 conn(0x7f6510072f00 0x7f651006ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:59.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:59.487+0000 7f650fe00640 1 -- 172.21.15.8:0/3790872659 >> v2:172.21.15.196:3300/0 conn(0x7f6510072f00 msgr2=0x7f651006ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:51:59.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:59.487+0000 7f650fe00640 1 -- 172.21.15.8:0/3790872659 >> v2:172.21.15.196:3300/0 conn(0x7f6510072f00 msgr2=0x7f651006ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:51:59.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:59.487+0000 7f650fe00640 1 --2- 172.21.15.8:0/3790872659 >> v2:172.21.15.196:3300/0 conn(0x7f6510072f00 0x7f651006ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:51:59.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:59.487+0000 7f650fe00640 1 --2- 172.21.15.8:0/3790872659 >> v2:172.21.15.196:3300/0 conn(0x7f6510072f00 0x7f651006ecb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:51:59.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:59.887+0000 7f650f400640 1 -- 172.21.15.8:0/3790872659 >> v1:172.21.15.8:6789/0 conn(0x7f6510072b20 legacy=0x7f65100a9990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:51:59.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:59.891+0000 7f650fe00640 1 --2- 172.21.15.8:0/3790872659 >> v2:172.21.15.196:3300/0 conn(0x7f6510072f00 0x7f651006ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:51:59.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:59.899+0000 7f650fe00640 1 -- 172.21.15.8:0/3790872659 >> v2:172.21.15.196:3300/0 conn(0x7f6510072f00 msgr2=0x7f651006ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:51:59.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:59.899+0000 7f650fe00640 1 -- 172.21.15.8:0/3790872659 >> v2:172.21.15.196:3300/0 conn(0x7f6510072f00 msgr2=0x7f651006ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:51:59.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:59.899+0000 7f650fe00640 1 --2- 172.21.15.8:0/3790872659 >> v2:172.21.15.196:3300/0 conn(0x7f6510072f00 0x7f651006ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:51:59.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:51:59.899+0000 7f650fe00640 1 --2- 172.21.15.8:0/3790872659 >> v2:172.21.15.196:3300/0 conn(0x7f6510072f00 0x7f651006ecb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:52:00.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:00.691+0000 7f650f400640 1 -- 172.21.15.8:0/3790872659 >> v1:172.21.15.8:6789/0 conn(0x7f6510072b20 legacy=0x7f65100a9990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:52:00.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:00.703+0000 7f650fe00640 1 --2- 172.21.15.8:0/3790872659 >> v2:172.21.15.196:3300/0 conn(0x7f6510072f00 0x7f651006ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:00.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:00.703+0000 7f650fe00640 1 -- 172.21.15.8:0/3790872659 >> v2:172.21.15.196:3300/0 conn(0x7f6510072f00 msgr2=0x7f651006ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:52:00.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:00.703+0000 7f650fe00640 1 -- 172.21.15.8:0/3790872659 >> v2:172.21.15.196:3300/0 conn(0x7f6510072f00 msgr2=0x7f651006ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:52:00.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:00.703+0000 7f650fe00640 1 --2- 172.21.15.8:0/3790872659 >> v2:172.21.15.196:3300/0 conn(0x7f6510072f00 0x7f651006ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:52:00.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:00.703+0000 7f650fe00640 1 --2- 172.21.15.8:0/3790872659 >> v2:172.21.15.196:3300/0 conn(0x7f6510072f00 0x7f651006ecb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:52:02.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.275+0000 7f650cc00640 1 -- 172.21.15.8:0/3790872659 >> v2:172.21.15.196:3300/0 conn(0x7f6510072f00 msgr2=0x7f651006ecb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:52:02.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.275+0000 7f650cc00640 1 --2- 172.21.15.8:0/3790872659 >> v2:172.21.15.196:3300/0 conn(0x7f6510072f00 0x7f651006ecb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:02.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.275+0000 7f650cc00640 1 -- 172.21.15.8:0/3790872659 >> v1:172.21.15.196:6789/0 conn(0x7f6510152490 legacy=0x7f65100aa0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:02.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.275+0000 7f650cc00640 1 -- 172.21.15.8:0/3790872659 >> v1:172.21.15.8:6789/0 conn(0x7f6510072b20 legacy=0x7f65100a9990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:52:02.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.279+0000 7f650cc00640 1 --2- 172.21.15.8:0/3790872659 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f64f0007ae0 0x7f64f0009f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:02.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.279+0000 7f650cc00640 1 --2- 172.21.15.8:0/3790872659 >> v2:172.21.15.8:3300/0 conn(0x7f64f000a660 0x7f64f000cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:02.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.279+0000 7f650cc00640 1 -- 172.21.15.8:0/3790872659 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6510073370 con 0x7f64f000a660 2024-03-23T23:52:02.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.279+0000 7f650cc00640 1 -- 172.21.15.8:0/3790872659 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f000d1c0 con 0x7f64f0007ae0 2024-03-23T23:52:02.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.279+0000 7f650ea00640 1 -- 172.21.15.8:0/3790872659 >> v2:172.21.15.8:3300/0 conn(0x7f64f000a660 msgr2=0x7f64f000cb20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:52:02.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.279+0000 7f650ea00640 1 --2- 172.21.15.8:0/3790872659 >> v2:172.21.15.8:3300/0 conn(0x7f64f000a660 0x7f64f000cb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:52:02.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.279+0000 7f650f400640 1 --2- 172.21.15.8:0/3790872659 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f64f0007ae0 0x7f64f0009f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:02.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.279+0000 7f650f400640 1 -- 172.21.15.8:0/3790872659 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f64f0007ae0 msgr2=0x7f64f0009f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:52:02.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.279+0000 7f650f400640 1 -- 172.21.15.8:0/3790872659 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f64f0007ae0 msgr2=0x7f64f0009f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:52:02.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.279+0000 7f650f400640 1 --2- 172.21.15.8:0/3790872659 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f64f0007ae0 0x7f64f0009f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:52:02.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.279+0000 7f650f400640 1 --2- 172.21.15.8:0/3790872659 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f64f0007ae0 0x7f64f0009f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:52:02.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.483+0000 7f650ea00640 1 -- 172.21.15.8:0/3790872659 >> v2:172.21.15.8:3300/0 conn(0x7f64f000a660 msgr2=0x7f64f000cb20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:52:02.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.483+0000 7f650ea00640 1 --2- 172.21.15.8:0/3790872659 >> v2:172.21.15.8:3300/0 conn(0x7f64f000a660 0x7f64f000cb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:52:02.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.483+0000 7f650f400640 1 --2- 172.21.15.8:0/3790872659 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f64f0007ae0 0x7f64f0009f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:02.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.483+0000 7f650f400640 1 -- 172.21.15.8:0/3790872659 >> v2:172.21.15.8:3300/0 conn(0x7f64f000a660 msgr2=0x7f64f000cb20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:52:02.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.483+0000 7f650f400640 1 --2- 172.21.15.8:0/3790872659 >> v2:172.21.15.8:3300/0 conn(0x7f64f000a660 0x7f64f000cb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:02.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.483+0000 7f650f400640 1 -- 172.21.15.8:0/3790872659 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f651006f9c0 con 0x7f64f0007ae0 2024-03-23T23:52:02.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.491+0000 7f650f400640 1 --2- 172.21.15.8:0/3790872659 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f64f0007ae0 0x7f64f0009f30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6500003990 tx=0x7f650001cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edd7ab9b1d2bb1e8 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:02.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.515+0000 7f650e000640 1 -- 172.21.15.8:0/3790872659 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65000b2070 con 0x7f64f0007ae0 2024-03-23T23:52:02.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.515+0000 7f650e000640 1 -- 172.21.15.8:0/3790872659 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65000a5cd0 con 0x7f64f0007ae0 2024-03-23T23:52:02.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.515+0000 7f650e000640 1 -- 172.21.15.8:0/3790872659 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65000ad680 con 0x7f64f0007ae0 2024-03-23T23:52:02.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.519+0000 7f6516400640 1 -- 172.21.15.8:0/3790872659 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f64f0007ae0 msgr2=0x7f64f0009f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:02.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.519+0000 7f6516400640 1 --2- 172.21.15.8:0/3790872659 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f64f0007ae0 0x7f64f0009f30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6500003990 tx=0x7f650001cf60 comp rx=0 tx=0).stop 2024-03-23T23:52:02.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.519+0000 7f650fe00640 1 -- 172.21.15.8:0/3790872659 reap_dead start 2024-03-23T23:52:02.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.519+0000 7f6516400640 1 -- 172.21.15.8:0/3790872659 shutdown_connections 2024-03-23T23:52:02.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.519+0000 7f6516400640 1 -- 172.21.15.8:0/3790872659 >> 172.21.15.8:0/3790872659 conn(0x7f651006c280 msgr2=0x7f651006c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:02.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.519+0000 7f6516400640 1 -- 172.21.15.8:0/3790872659 shutdown_connections 2024-03-23T23:52:02.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.519+0000 7f6516400640 1 -- 172.21.15.8:0/3790872659 wait complete. 2024-03-23T23:52:02.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.519+0000 7f6516400640 1 Processor -- start 2024-03-23T23:52:02.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.519+0000 7f6516400640 1 -- start start 2024-03-23T23:52:02.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.523+0000 7f6516400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65100ac9d0 0x7f65100abba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:02.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.523+0000 7f6516400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65101469a0 0x7f6510146e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:02.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.523+0000 7f6516400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65101ebcb0 0x7f65101ec130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:02.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.523+0000 7f6516400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651006bd50 con 0x7f65101ebcb0 2024-03-23T23:52:02.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.523+0000 7f6516400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651006bbd0 con 0x7f65100ac9d0 2024-03-23T23:52:02.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.523+0000 7f6516400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f651006bed0 con 0x7f65101469a0 2024-03-23T23:52:02.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.523+0000 7f650fe00640 1 -- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65101ebcb0 msgr2=0x7f65101ec130 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:52:02.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.523+0000 7f650fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65101ebcb0 0x7f65101ec130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:52:02.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.523+0000 7f650ea00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65101469a0 0x7f6510146e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:02.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.523+0000 7f650ea00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65101469a0 0x7f6510146e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:52228/0 (socket says 172.21.15.8:52228) 2024-03-23T23:52:02.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.523+0000 7f650ea00640 1 -- 172.21.15.8:0/3371458058 learned_addr learned my addr 172.21.15.8:0/3371458058 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:52:02.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.527+0000 7f650ea00640 1 -- 172.21.15.8:0/3371458058 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65100ac9d0 msgr2=0x7f65100abba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:02.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.527+0000 7f650ea00640 1 --2- 172.21.15.8:0/3371458058 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65100ac9d0 0x7f65100abba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:02.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.527+0000 7f650ea00640 1 -- 172.21.15.8:0/3371458058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65101ebcb0 msgr2=0x7f65101ec130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:52:02.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.527+0000 7f650ea00640 1 --2- 172.21.15.8:0/3371458058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65101ebcb0 0x7f65101ec130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:02.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.527+0000 7f650ea00640 1 -- 172.21.15.8:0/3371458058 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65100ac0e0 con 0x7f65101469a0 2024-03-23T23:52:02.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.583+0000 7f650ea00640 1 --2- 172.21.15.8:0/3371458058 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65101469a0 0x7f6510146e00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f64fc00c580 tx=0x7f64fc00ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:02.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.595+0000 7f6507400640 1 -- 172.21.15.8:0/3371458058 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc017070 con 0x7f65101469a0 2024-03-23T23:52:02.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.595+0000 7f6507400640 1 -- 172.21.15.8:0/3371458058 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64fc006500 con 0x7f65101469a0 2024-03-23T23:52:02.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.595+0000 7f6507400640 1 -- 172.21.15.8:0/3371458058 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc0049d0 con 0x7f65101469a0 2024-03-23T23:52:02.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.595+0000 7f6516400640 1 -- 172.21.15.8:0/3371458058 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6510148dc0 con 0x7f65101469a0 2024-03-23T23:52:02.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.599+0000 7f6516400640 1 -- 172.21.15.8:0/3371458058 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6510149380 con 0x7f65101469a0 2024-03-23T23:52:02.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.599+0000 7f6516400640 1 -- 172.21.15.8:0/3371458058 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f651004f480 con 0x7f65101469a0 2024-03-23T23:52:02.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.627+0000 7f6507400640 1 -- 172.21.15.8:0/3371458058 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f64fc01a070 con 0x7f65101469a0 2024-03-23T23:52:02.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.631+0000 7f6507400640 1 --2- 172.21.15.8:0/3371458058 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f64f0070ca0 0x7f64f0073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:02.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.631+0000 7f6507400640 1 -- 172.21.15.8:0/3371458058 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f64fc0854e0 con 0x7f65101469a0 2024-03-23T23:52:02.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.643+0000 7f650f400640 1 --2- 172.21.15.8:0/3371458058 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f64f0070ca0 0x7f64f0073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:02.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.643+0000 7f650f400640 1 --2- 172.21.15.8:0/3371458058 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f64f0070ca0 0x7f64f0073160 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f65000af000 tx=0x7f6500005d50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:02.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:02.671+0000 7f6507400640 1 -- 172.21.15.8:0/3371458058 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f64fc0557c0 con 0x7f65101469a0 2024-03-23T23:52:03.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.219+0000 7f6516400640 1 -- 172.21.15.8:0/3371458058 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f6510073760 con 0x7f65101469a0 2024-03-23T23:52:03.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.223+0000 7f6507400640 1 -- 172.21.15.8:0/3371458058 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1554 (secure 0 0 0) 0x7f64fc059860 con 0x7f65101469a0 2024-03-23T23:52:03.222 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":70,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:52:03.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.227+0000 7f6516400640 1 -- 172.21.15.8:0/3371458058 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f64f0070ca0 msgr2=0x7f64f0073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:03.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.227+0000 7f6516400640 1 --2- 172.21.15.8:0/3371458058 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f64f0070ca0 0x7f64f0073160 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f65000af000 tx=0x7f6500005d50 comp rx=0 tx=0).stop 2024-03-23T23:52:03.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.227+0000 7f6516400640 1 -- 172.21.15.8:0/3371458058 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65101469a0 msgr2=0x7f6510146e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:03.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.227+0000 7f6516400640 1 --2- 172.21.15.8:0/3371458058 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65101469a0 0x7f6510146e00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f64fc00c580 tx=0x7f64fc00ca40 comp rx=0 tx=0).stop 2024-03-23T23:52:03.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.227+0000 7f6516400640 1 -- 172.21.15.8:0/3371458058 shutdown_connections 2024-03-23T23:52:03.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.227+0000 7f6516400640 1 --2- 172.21.15.8:0/3371458058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65101ebcb0 0x7f65101ec130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:03.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.227+0000 7f6516400640 1 --2- 172.21.15.8:0/3371458058 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f64f0070ca0 0x7f64f0073160 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:03.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.227+0000 7f6516400640 1 --2- 172.21.15.8:0/3371458058 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65101469a0 0x7f6510146e00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:03.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.227+0000 7f6516400640 1 --2- 172.21.15.8:0/3371458058 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65100ac9d0 0x7f65100abba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:03.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.227+0000 7f6516400640 1 -- 172.21.15.8:0/3371458058 >> 172.21.15.8:0/3371458058 conn(0x7f651006c280 msgr2=0x7f651015d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:03.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.231+0000 7f6516400640 1 -- 172.21.15.8:0/3371458058 shutdown_connections 2024-03-23T23:52:03.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.231+0000 7f6516400640 1 -- 172.21.15.8:0/3371458058 wait complete. 2024-03-23T23:52:03.262 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-03-23T23:52:03.262 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-03-23T23:52:03.263 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:52:03.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.487+0000 7f3d8ec00640 1 Processor -- start 2024-03-23T23:52:03.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.491+0000 7f3d8ec00640 1 -- start start 2024-03-23T23:52:03.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.491+0000 7f3d8ec00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d880c3600 0x7f3d880c2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:03.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.491+0000 7f3d8ec00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d8815acc0 con 0x7f3d880c3f60 2024-03-23T23:52:03.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.491+0000 7f3d8ec00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d88159f00 con 0x7f3d88071a30 2024-03-23T23:52:03.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.491+0000 7f3d8ec00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8815a830 con 0x7f3d880c3600 2024-03-23T23:52:03.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.495+0000 7f3d87e00640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f3d880c3f60 legacy=0x7f3d880c1c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:52:03.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.495+0000 7f3d8cc00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f3d88071a30 0x7f3d88156c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:46838/0 (socket says 172.21.15.8:46838) 2024-03-23T23:52:03.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.495+0000 7f3d8cc00640 1 -- 172.21.15.8:0/1037173806 learned_addr learned my addr 172.21.15.8:0/1037173806 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:52:03.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.507+0000 7f3d7f400640 1 --2- 172.21.15.8:0/1037173806 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d880c3600 0x7f3d880c2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:03.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.507+0000 7f3d87400640 1 -- 172.21.15.8:0/1037173806 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1342362111 0 0) 0x7f3d88159f00 con 0x7f3d88071a30 2024-03-23T23:52:03.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.507+0000 7f3d87400640 1 -- 172.21.15.8:0/1037173806 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d6c003530 con 0x7f3d88071a30 2024-03-23T23:52:03.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.507+0000 7f3d7f400640 1 -- 172.21.15.8:0/1037173806 >> v1:172.21.15.196:6789/0 conn(0x7f3d88071a30 legacy=0x7f3d88156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:03.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.507+0000 7f3d7f400640 1 -- 172.21.15.8:0/1037173806 >> v1:172.21.15.8:6789/0 conn(0x7f3d880c3f60 legacy=0x7f3d880c1c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:52:03.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.507+0000 7f3d7f400640 1 -- 172.21.15.8:0/1037173806 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8815a1e0 con 0x7f3d880c3600 2024-03-23T23:52:03.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.515+0000 7f3d7f400640 1 --2- 172.21.15.8:0/1037173806 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d880c3600 0x7f3d880c2380 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3d78009dc0 tx=0x7f3d7801c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a3480f0712ac0bd server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:03.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.539+0000 7f3d87400640 1 -- 172.21.15.8:0/1037173806 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d780b2070 con 0x7f3d880c3600 2024-03-23T23:52:03.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.539+0000 7f3d87400640 1 -- 172.21.15.8:0/1037173806 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d780a5780 con 0x7f3d880c3600 2024-03-23T23:52:03.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.539+0000 7f3d87400640 1 -- 172.21.15.8:0/1037173806 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d780a5b50 con 0x7f3d880c3600 2024-03-23T23:52:03.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.539+0000 7f3d8ec00640 1 -- 172.21.15.8:0/1037173806 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d880c3600 msgr2=0x7f3d880c2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:03.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.539+0000 7f3d8ec00640 1 --2- 172.21.15.8:0/1037173806 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d880c3600 0x7f3d880c2380 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3d78009dc0 tx=0x7f3d7801c8c0 comp rx=0 tx=0).stop 2024-03-23T23:52:03.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.543+0000 7f3d8ec00640 1 -- 172.21.15.8:0/1037173806 shutdown_connections 2024-03-23T23:52:03.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.543+0000 7f3d8ec00640 1 --2- 172.21.15.8:0/1037173806 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d880c3600 0x7f3d880c2380 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:03.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.543+0000 7f3d8ec00640 1 -- 172.21.15.8:0/1037173806 >> 172.21.15.8:0/1037173806 conn(0x7f3d8806b170 msgr2=0x7f3d8806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:03.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.543+0000 7f3d8ec00640 1 -- 172.21.15.8:0/1037173806 shutdown_connections 2024-03-23T23:52:03.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.543+0000 7f3d8ec00640 1 -- 172.21.15.8:0/1037173806 wait complete. 2024-03-23T23:52:03.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.547+0000 7f3d8ec00640 1 Processor -- start 2024-03-23T23:52:03.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.547+0000 7f3d8ec00640 1 -- start start 2024-03-23T23:52:03.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.551+0000 7f3d8ec00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d88071a30 0x7f3d8814c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:03.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.551+0000 7f3d8ec00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d880c3600 0x7f3d88149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:03.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.551+0000 7f3d8ec00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d880c3f60 0x7f3d8814a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:03.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.551+0000 7f3d8ec00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d880c4340 con 0x7f3d880c3f60 2024-03-23T23:52:03.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.551+0000 7f3d8ec00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d88157750 con 0x7f3d880c3600 2024-03-23T23:52:03.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.551+0000 7f3d8ec00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d880c44c0 con 0x7f3d88071a30 2024-03-23T23:52:03.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.551+0000 7f3d8cc00640 1 -- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d880c3f60 msgr2=0x7f3d8814a330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:52:03.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.551+0000 7f3d8cc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d880c3f60 0x7f3d8814a330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:52:03.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.551+0000 7f3d87e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d88071a30 0x7f3d8814c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:03.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.551+0000 7f3d87e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d88071a30 0x7f3d8814c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:45986/0 (socket says 172.21.15.8:45986) 2024-03-23T23:52:03.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.551+0000 7f3d87e00640 1 -- 172.21.15.8:0/213188370 learned_addr learned my addr 172.21.15.8:0/213188370 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:52:03.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.555+0000 7f3d87e00640 1 -- 172.21.15.8:0/213188370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d880c3600 msgr2=0x7f3d88149df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:03.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.555+0000 7f3d87e00640 1 --2- 172.21.15.8:0/213188370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d880c3600 0x7f3d88149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:03.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.555+0000 7f3d87e00640 1 -- 172.21.15.8:0/213188370 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d880c3f60 msgr2=0x7f3d8814a330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:52:03.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.555+0000 7f3d87e00640 1 --2- 172.21.15.8:0/213188370 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d880c3f60 0x7f3d8814a330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:03.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.555+0000 7f3d87e00640 1 -- 172.21.15.8:0/213188370 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d881530e0 con 0x7f3d88071a30 2024-03-23T23:52:03.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.559+0000 7f3d87e00640 1 --2- 172.21.15.8:0/213188370 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d88071a30 0x7f3d8814c5d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000b550 tx=0x7f3d7000ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:03.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.559+0000 7f3d84c00640 1 -- 172.21.15.8:0/213188370 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d70003dd0 con 0x7f3d88071a30 2024-03-23T23:52:03.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.559+0000 7f3d8ec00640 1 -- 172.21.15.8:0/213188370 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d880c5000 con 0x7f3d88071a30 2024-03-23T23:52:03.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.559+0000 7f3d84c00640 1 -- 172.21.15.8:0/213188370 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d70015070 con 0x7f3d88071a30 2024-03-23T23:52:03.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.559+0000 7f3d8ec00640 1 -- 172.21.15.8:0/213188370 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d880c55c0 con 0x7f3d88071a30 2024-03-23T23:52:03.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.559+0000 7f3d84c00640 1 -- 172.21.15.8:0/213188370 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d70005330 con 0x7f3d88071a30 2024-03-23T23:52:03.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.563+0000 7f3d8ec00640 1 --2- 172.21.15.8:0/213188370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d8814a870 0x7f3d881fe8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:03.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.563+0000 7f3d8ec00640 1 -- 172.21.15.8:0/213188370 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d88068270 con 0x7f3d8814a870 2024-03-23T23:52:03.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.571+0000 7f3d7f400640 1 --2- 172.21.15.8:0/213188370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d8814a870 0x7f3d881fe8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:03.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.571+0000 7f3d7f400640 1 -- 172.21.15.8:0/213188370 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3d8806b760 con 0x7f3d8814a870 2024-03-23T23:52:03.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.575+0000 7f3d7f400640 1 --2- 172.21.15.8:0/213188370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d8814a870 0x7f3d881fe8f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3d880c8280 tx=0x7f3d780a5b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:03.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.575+0000 7f3d84c00640 1 -- 172.21.15.8:0/213188370 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d780bd030 con 0x7f3d8814a870 2024-03-23T23:52:03.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.579+0000 7f3d84c00640 1 -- 172.21.15.8:0/213188370 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3d700054d0 con 0x7f3d88071a30 2024-03-23T23:52:03.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.583+0000 7f3d84c00640 1 --2- 172.21.15.8:0/213188370 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3d64067560 0x7f3d64069a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:03.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.583+0000 7f3d84c00640 1 -- 172.21.15.8:0/213188370 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f3d70085aa0 con 0x7f3d88071a30 2024-03-23T23:52:03.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.587+0000 7f3d84c00640 1 -- 172.21.15.8:0/213188370 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f3d780b3040 con 0x7f3d8814a870 2024-03-23T23:52:03.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.587+0000 7f3d84c00640 1 -- 172.21.15.8:0/213188370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d8814a870 msgr2=0x7f3d881fe8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:03.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.587+0000 7f3d84c00640 1 --2- 172.21.15.8:0/213188370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d8814a870 0x7f3d881fe8f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3d880c8280 tx=0x7f3d780a5b90 comp rx=0 tx=0).stop 2024-03-23T23:52:03.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.587+0000 7f3d84c00640 1 -- 172.21.15.8:0/213188370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d8814a870 msgr2=0x7f3d881fe8f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:52:03.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.587+0000 7f3d84c00640 1 --2- 172.21.15.8:0/213188370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d8814a870 0x7f3d881fe8f0 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3d880c8280 tx=0x7f3d780a5b90 comp rx=0 tx=0).stop 2024-03-23T23:52:03.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.587+0000 7f3d8cc00640 1 --2- 172.21.15.8:0/213188370 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3d64067560 0x7f3d64069a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:03.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.595+0000 7f3d8cc00640 1 --2- 172.21.15.8:0/213188370 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3d64067560 0x7f3d64069a20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3d80007fd0 tx=0x7f3d800079a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:03.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.599+0000 7f3d8ec00640 1 --2- 172.21.15.8:0/213188370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d881fee30 0x7f3d881ff210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:03.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.599+0000 7f3d8ec00640 1 -- 172.21.15.8:0/213188370 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d881ff750 con 0x7f3d881fee30 2024-03-23T23:52:03.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.603+0000 7f3d7f400640 1 --2- 172.21.15.8:0/213188370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d881fee30 0x7f3d881ff210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:03.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.611+0000 7f3d7f400640 1 -- 172.21.15.8:0/213188370 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3d880c2a90 con 0x7f3d881fee30 2024-03-23T23:52:03.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.619+0000 7f3d7f400640 1 --2- 172.21.15.8:0/213188370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d881fee30 0x7f3d881ff210 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3d78000f90 tx=0x7f3d780a7000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:03.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.627+0000 7f3d84c00640 1 -- 172.21.15.8:0/213188370 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d780b2070 con 0x7f3d881fee30 2024-03-23T23:52:03.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.647+0000 7f3d84c00640 1 -- 172.21.15.8:0/213188370 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5003 (secure 0 0 0) 0x7f3d78003fb0 con 0x7f3d881fee30 2024-03-23T23:52:03.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.647+0000 7f3d84c00640 1 -- 172.21.15.8:0/213188370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d881fee30 msgr2=0x7f3d881ff210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:03.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.647+0000 7f3d84c00640 1 --2- 172.21.15.8:0/213188370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d881fee30 0x7f3d881ff210 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3d78000f90 tx=0x7f3d780a7000 comp rx=0 tx=0).stop 2024-03-23T23:52:03.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.647+0000 7f3d84c00640 1 -- 172.21.15.8:0/213188370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d881fee30 msgr2=0x7f3d881ff210 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:52:03.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.647+0000 7f3d84c00640 1 --2- 172.21.15.8:0/213188370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d881fee30 0x7f3d881ff210 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3d78000f90 tx=0x7f3d780a7000 comp rx=0 tx=0).stop 2024-03-23T23:52:03.647 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:52:03.647 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:52:03.647 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:52:03.647 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:52:03.647 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 70, 2024-03-23T23:52:03.647 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:52:03.647 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:52:03.647 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:52:03.647 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:03.647 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 1, 2024-03-23T23:52:03.647 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:52:03.647 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:52:03.648 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:52:03.648 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:52:03.648 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:52:03.648 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:52:03.648 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:52:03.648 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:52:03.648 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:52:03.648 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:52:03.648 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:52:03.648 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:52:03.648 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:52:03.648 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:52:03.648 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:03.648 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:52:03.649 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:52:03.649 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:52:03.649 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:52:03.649 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:52:03.649 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:52:03.649 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:52:03.649 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:52:03.649 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:52:03.649 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:52:03.649 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:52:03.649 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:52:03.650 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:52:03.650 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:03.650 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:03.650 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:52:03.650 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:52:03.650 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:52:03.650 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:52:03.650 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:52:03.650 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:52:03.650 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:52:03.650 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:52:03.650 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:52:03.650 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:52:03.651 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:52:03.651 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:52:03.651 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:52:03.651 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:52:03.651 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:52:03.651 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:52:03.651 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:52:03.651 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:52:03.651 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:52:03.651 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:52:03.651 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:52:03.652 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:52:03.652 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:52:03.652 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:52:03.652 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:52:03.652 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:52:03.652 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:52:03.652 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:52:03.652 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:03.652 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:52:03.652 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:03.652 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:52:03.652 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:03.652 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:52:03.653 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:52:03.653 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:52:03.653 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:52:03.653 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:03.653 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:52:03.653 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:52:03.653 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:03.653 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:03.653 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:03.653 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:52:03.653 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:52:03.653 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:03.653 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:03.653 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:03.654 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:03.654 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:52:03.654 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:52:03.654 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:52:03.654 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:52:03.654 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:52:03.654 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:03.654 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:03.654 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:52:03.654 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:52:03.654 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:52:03.654 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:52:03.654 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:03.655 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:52:03.655 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:52:03.655 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:03.655 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:03.655 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:03.655 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:52:03.655 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:52:03.655 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:03.655 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:03.655 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:03.655 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:03.655 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:52:03.655 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:52:03.655 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:52:03.656 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:52:03.656 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:52:03.656 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:03.656 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:03.656 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:52:03.656 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:52:03.656 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:52:03.656 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:52:03.656 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:03.656 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:52:03.656 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:52:03.656 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:03.656 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:03.657 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:03.657 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:52:03.657 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:52:03.657 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:03.657 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:03.657 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:03.657 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:03.657 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:52:03.657 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:52:03.657 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:52:03.657 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:52:03.657 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:52:03.657 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:03.657 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:03.658 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:03.658 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:52:03.658 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:52:03.658 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:03.658 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:52:03.658 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:03.658 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:52:03.658 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:03.658 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:03.658 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:52:03.658 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:03.658 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:52:03.658 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:03.659 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:52:03.659 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:03.659 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:03.659 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:52:03.659 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:03.659 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:52:03.659 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:03.659 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:52:03.659 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:03.659 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:03.659 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:52:03.659 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:03.659 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:52:03.659 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:03.660 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:52:03.660 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:03.660 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:03.660 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:52:03.660 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:03.660 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:52:03.660 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:03.660 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:03.660 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:03.660 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:52:03.660 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:52:03.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.651+0000 7f3d8ec00640 1 -- 172.21.15.8:0/213188370 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3d64067560 msgr2=0x7f3d64069a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:03.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.651+0000 7f3d8ec00640 1 --2- 172.21.15.8:0/213188370 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3d64067560 0x7f3d64069a20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3d80007fd0 tx=0x7f3d800079a0 comp rx=0 tx=0).stop 2024-03-23T23:52:03.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.651+0000 7f3d8ec00640 1 -- 172.21.15.8:0/213188370 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d88071a30 msgr2=0x7f3d8814c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:03.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.651+0000 7f3d8ec00640 1 --2- 172.21.15.8:0/213188370 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d88071a30 0x7f3d8814c5d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000b550 tx=0x7f3d7000ba10 comp rx=0 tx=0).stop 2024-03-23T23:52:03.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.651+0000 7f3d8cc00640 1 -- 172.21.15.8:0/213188370 reap_dead start 2024-03-23T23:52:03.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.651+0000 7f3d8cc00640 1 -- 172.21.15.8:0/213188370 reap_dead start 2024-03-23T23:52:03.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.651+0000 7f3d8ec00640 1 -- 172.21.15.8:0/213188370 shutdown_connections 2024-03-23T23:52:03.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.651+0000 7f3d8ec00640 1 -- 172.21.15.8:0/213188370 >> 172.21.15.8:0/213188370 conn(0x7f3d8806b170 msgr2=0x7f3d88153b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:03.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.655+0000 7f3d8ec00640 1 -- 172.21.15.8:0/213188370 shutdown_connections 2024-03-23T23:52:03.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:03.655+0000 7f3d8ec00640 1 -- 172.21.15.8:0/213188370 wait complete. 2024-03-23T23:52:03.712 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T23:52:03.712 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-03-23T23:52:03.712 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:52:04.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.079+0000 7f73a6e00640 1 Processor -- start 2024-03-23T23:52:04.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.079+0000 7f73a6e00640 1 -- start start 2024-03-23T23:52:04.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.083+0000 7f73a6e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f73a006d2b0 0x7f73a00714f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:04.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.083+0000 7f73a6e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f73a0071a30 0x7f73a01515d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:04.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.083+0000 7f73a6e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73a0070c80 con 0x7f73a014ece0 2024-03-23T23:52:04.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.083+0000 7f73a5a00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f73a014ece0 0x7f73a006e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:46846/0 (socket says 172.21.15.8:46846) 2024-03-23T23:52:04.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.083+0000 7f73a5a00640 1 -- 172.21.15.8:0/3260845550 learned_addr learned my addr 172.21.15.8:0/3260845550 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:52:04.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.083+0000 7f73a5000640 1 --2- 172.21.15.8:0/3260845550 >> v2:172.21.15.196:3300/0 conn(0x7f73a006d2b0 0x7f73a00714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:04.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.083+0000 7f73a6e00640 1 -- 172.21.15.8:0/3260845550 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a0070f60 con 0x7f73a0071a30 2024-03-23T23:52:04.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.083+0000 7f73a6e00640 1 -- 172.21.15.8:0/3260845550 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a006e2b0 con 0x7f73a006d2b0 2024-03-23T23:52:04.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.083+0000 7f73a6400640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f73a0071a30 msgr2=0x7f73a01515d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:52:04.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.083+0000 7f73a6400640 1 --2- 172.21.15.8:0/3260845550 >> v2:172.21.15.8:3300/0 conn(0x7f73a0071a30 0x7f73a01515d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:52:04.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.083+0000 7f73a5000640 1 -- 172.21.15.8:0/3260845550 >> v2:172.21.15.8:3300/0 conn(0x7f73a0071a30 msgr2=0x7f73a01515d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:52:04.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.083+0000 7f73a5000640 1 --2- 172.21.15.8:0/3260845550 >> v2:172.21.15.8:3300/0 conn(0x7f73a0071a30 0x7f73a01515d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:04.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.083+0000 7f73a5000640 1 -- 172.21.15.8:0/3260845550 >> v1:172.21.15.196:6789/0 conn(0x7f73a014ece0 legacy=0x7f73a006e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:52:04.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.083+0000 7f73a5000640 1 -- 172.21.15.8:0/3260845550 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a0152180 con 0x7f73a006d2b0 2024-03-23T23:52:04.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.091+0000 7f73a5000640 1 --2- 172.21.15.8:0/3260845550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73a006d2b0 0x7f73a00714f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f73a0072b70 tx=0x7f738c01e5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fdc7c5de9626c48 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:04.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.091+0000 7f739fe00640 1 -- 172.21.15.8:0/3260845550 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c0b3070 con 0x7f73a006d2b0 2024-03-23T23:52:04.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.091+0000 7f739fe00640 1 -- 172.21.15.8:0/3260845550 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738c0ae410 con 0x7f73a006d2b0 2024-03-23T23:52:04.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.091+0000 7f739fe00640 1 -- 172.21.15.8:0/3260845550 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c0ae7e0 con 0x7f73a006d2b0 2024-03-23T23:52:04.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.095+0000 7f73a6e00640 1 -- 172.21.15.8:0/3260845550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73a006d2b0 msgr2=0x7f73a00714f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:04.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.095+0000 7f73a6e00640 1 --2- 172.21.15.8:0/3260845550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73a006d2b0 0x7f73a00714f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f73a0072b70 tx=0x7f738c01e5a0 comp rx=0 tx=0).stop 2024-03-23T23:52:04.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.095+0000 7f73a6e00640 1 -- 172.21.15.8:0/3260845550 shutdown_connections 2024-03-23T23:52:04.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.095+0000 7f73a6e00640 1 --2- 172.21.15.8:0/3260845550 >> v2:172.21.15.8:3300/0 conn(0x7f73a0071a30 0x7f73a01515d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:04.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.095+0000 7f73a6e00640 1 --2- 172.21.15.8:0/3260845550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73a006d2b0 0x7f73a00714f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:04.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.095+0000 7f73a6e00640 1 -- 172.21.15.8:0/3260845550 >> 172.21.15.8:0/3260845550 conn(0x7f73a00c6e10 msgr2=0x7f73a00c7220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:04.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.095+0000 7f73a6e00640 1 -- 172.21.15.8:0/3260845550 shutdown_connections 2024-03-23T23:52:04.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.095+0000 7f73a6e00640 1 -- 172.21.15.8:0/3260845550 wait complete. 2024-03-23T23:52:04.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.099+0000 7f73a6e00640 1 Processor -- start 2024-03-23T23:52:04.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.103+0000 7f73a6e00640 1 -- start start 2024-03-23T23:52:04.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.103+0000 7f73a6e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73a006d2b0 0x7f73a01438e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:04.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.103+0000 7f73a6e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73a0071a30 0x7f73a01eeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:04.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.103+0000 7f73a6e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73a014ece0 0x7f73a0145ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:04.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.103+0000 7f73a6400640 1 -- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73a014ece0 msgr2=0x7f73a0145ba0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:52:04.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.103+0000 7f73a6400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73a014ece0 0x7f73a0145ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:52:04.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.103+0000 7f73a6e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a0151f20 con 0x7f73a014ece0 2024-03-23T23:52:04.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.103+0000 7f73a6e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a015e750 con 0x7f73a006d2b0 2024-03-23T23:52:04.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.103+0000 7f73a6e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a015e8d0 con 0x7f73a0071a30 2024-03-23T23:52:04.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.107+0000 7f73a5000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73a0071a30 0x7f73a01eeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:04.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.107+0000 7f73a5000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73a0071a30 0x7f73a01eeac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:46000/0 (socket says 172.21.15.8:46000) 2024-03-23T23:52:04.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.107+0000 7f73a5000640 1 -- 172.21.15.8:0/839983413 learned_addr learned my addr 172.21.15.8:0/839983413 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:52:04.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.107+0000 7f73a5a00640 1 --2- 172.21.15.8:0/839983413 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73a006d2b0 0x7f73a01438e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:04.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.111+0000 7f73a5a00640 1 -- 172.21.15.8:0/839983413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73a0071a30 msgr2=0x7f73a01eeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:04.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.111+0000 7f73a5a00640 1 --2- 172.21.15.8:0/839983413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73a0071a30 0x7f73a01eeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:04.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.111+0000 7f73a5a00640 1 -- 172.21.15.8:0/839983413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73a014ece0 msgr2=0x7f73a0145ba0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:52:04.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.111+0000 7f73a5a00640 1 --2- 172.21.15.8:0/839983413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73a014ece0 0x7f73a0145ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:04.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.111+0000 7f73a5a00640 1 -- 172.21.15.8:0/839983413 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a014d9e0 con 0x7f73a006d2b0 2024-03-23T23:52:04.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.115+0000 7f73a5a00640 1 --2- 172.21.15.8:0/839983413 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73a006d2b0 0x7f73a01438e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f739400c390 tx=0x7f739400c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:04.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.119+0000 7f739d600640 1 -- 172.21.15.8:0/839983413 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7394017070 con 0x7f73a006d2b0 2024-03-23T23:52:04.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.119+0000 7f739d600640 1 -- 172.21.15.8:0/839983413 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7394005cf0 con 0x7f73a006d2b0 2024-03-23T23:52:04.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.119+0000 7f739d600640 1 -- 172.21.15.8:0/839983413 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73940072f0 con 0x7f73a006d2b0 2024-03-23T23:52:04.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.119+0000 7f73a6e00640 1 -- 172.21.15.8:0/839983413 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a014d140 con 0x7f73a006d2b0 2024-03-23T23:52:04.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.119+0000 7f73a6e00640 1 -- 172.21.15.8:0/839983413 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a014d700 con 0x7f73a006d2b0 2024-03-23T23:52:04.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.123+0000 7f73a6e00640 1 --2- 172.21.15.8:0/839983413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73a00abfe0 0x7f73a00a9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:04.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.123+0000 7f73a6e00640 1 -- 172.21.15.8:0/839983413 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a00c2430 con 0x7f73a00abfe0 2024-03-23T23:52:04.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.127+0000 7f73a5000640 1 --2- 172.21.15.8:0/839983413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73a00abfe0 0x7f73a00a9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:04.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.127+0000 7f739d600640 1 -- 172.21.15.8:0/839983413 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f739401a070 con 0x7f73a006d2b0 2024-03-23T23:52:04.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.131+0000 7f739d600640 1 --2- 172.21.15.8:0/839983413 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7380067610 0x7f7380069ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:04.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.131+0000 7f739d600640 1 -- 172.21.15.8:0/839983413 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f7394084e80 con 0x7f73a006d2b0 2024-03-23T23:52:04.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.131+0000 7f73a6400640 1 --2- 172.21.15.8:0/839983413 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7380067610 0x7f7380069ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:04.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.135+0000 7f73a6400640 1 --2- 172.21.15.8:0/839983413 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7380067610 0x7f7380069ad0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7398003cc0 tx=0x7f73980091f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:04.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.135+0000 7f73a5000640 1 -- 172.21.15.8:0/839983413 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f73a006d780 con 0x7f73a00abfe0 2024-03-23T23:52:04.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.143+0000 7f73a5000640 1 --2- 172.21.15.8:0/839983413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73a00abfe0 0x7f73a00a9950 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f738c01e5e0 tx=0x7f738c01b340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:04.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.143+0000 7f739d600640 1 -- 172.21.15.8:0/839983413 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c0bd020 con 0x7f73a00abfe0 2024-03-23T23:52:04.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.151+0000 7f739d600640 1 -- 172.21.15.8:0/839983413 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f738c0aeb00 con 0x7f73a00abfe0 2024-03-23T23:52:04.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.151+0000 7f739d600640 1 -- 172.21.15.8:0/839983413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73a00abfe0 msgr2=0x7f73a00a9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:04.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.151+0000 7f739d600640 1 --2- 172.21.15.8:0/839983413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73a00abfe0 0x7f73a00a9950 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f738c01e5e0 tx=0x7f738c01b340 comp rx=0 tx=0).stop 2024-03-23T23:52:04.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.151+0000 7f739d600640 1 -- 172.21.15.8:0/839983413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73a00abfe0 msgr2=0x7f73a00a9950 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:52:04.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.151+0000 7f739d600640 1 --2- 172.21.15.8:0/839983413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73a00abfe0 0x7f73a00a9950 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f738c01e5e0 tx=0x7f738c01b340 comp rx=0 tx=0).stop 2024-03-23T23:52:04.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.183+0000 7f73a6e00640 1 --2- 172.21.15.8:0/839983413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73a01460e0 0x7f73a01eb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:04.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.183+0000 7f73a6e00640 1 -- 172.21.15.8:0/839983413 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a0068790 con 0x7f73a01460e0 2024-03-23T23:52:04.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.183+0000 7f73a5000640 1 --2- 172.21.15.8:0/839983413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73a01460e0 0x7f73a01eb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:04.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.191+0000 7f73a5000640 1 -- 172.21.15.8:0/839983413 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f73a004f410 con 0x7f73a01460e0 2024-03-23T23:52:04.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.195+0000 7f73a5000640 1 --2- 172.21.15.8:0/839983413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73a01460e0 0x7f73a01eb1f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f73a0155990 tx=0x7f738c0a9000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:04.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.195+0000 7f739d600640 1 -- 172.21.15.8:0/839983413 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c0bd030 con 0x7f73a01460e0 2024-03-23T23:52:04.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.207+0000 7f739d600640 1 -- 172.21.15.8:0/839983413 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5171 (secure 0 0 0) 0x7f738c000e50 con 0x7f73a01460e0 2024-03-23T23:52:04.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.207+0000 7f739d600640 1 -- 172.21.15.8:0/839983413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73a01460e0 msgr2=0x7f73a01eb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:04.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.207+0000 7f739d600640 1 --2- 172.21.15.8:0/839983413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73a01460e0 0x7f73a01eb1f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f73a0155990 tx=0x7f738c0a9000 comp rx=0 tx=0).stop 2024-03-23T23:52:04.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.207+0000 7f739d600640 1 -- 172.21.15.8:0/839983413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73a01460e0 msgr2=0x7f73a01eb1f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:52:04.207 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:52:04.207 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:52:04.207 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:52:04.207 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:52:04.207 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 70, 2024-03-23T23:52:04.207 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:52:04.207 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:52:04.208 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:52:04.208 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:04.208 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 1, 2024-03-23T23:52:04.208 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:52:04.208 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:52:04.208 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:52:04.209 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:52:04.209 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:52:04.209 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:52:04.209 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:52:04.209 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:52:04.209 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:52:04.209 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:52:04.209 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:52:04.209 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:52:04.210 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:52:04.210 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:52:04.210 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:04.210 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:52:04.210 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:52:04.210 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:52:04.210 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:52:04.210 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:52:04.210 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:52:04.210 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:52:04.210 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:52:04.210 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:52:04.210 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:52:04.211 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:52:04.211 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:52:04.211 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:52:04.211 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:04.211 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:04.211 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:52:04.211 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:52:04.211 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:52:04.211 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:52:04.211 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:52:04.211 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:52:04.211 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:52:04.211 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:52:04.211 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:52:04.212 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:52:04.212 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:52:04.212 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:52:04.212 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:52:04.212 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:52:04.212 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:52:04.212 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:52:04.212 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:52:04.212 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:52:04.212 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:52:04.212 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:52:04.212 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:52:04.213 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:52:04.213 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:52:04.213 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:52:04.213 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:52:04.213 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:52:04.213 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:52:04.213 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:52:04.213 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:04.213 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:52:04.213 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:04.213 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:52:04.213 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:04.213 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:52:04.213 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:52:04.214 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:52:04.214 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:52:04.214 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:04.214 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:52:04.214 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:52:04.214 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:04.214 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:04.214 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:04.214 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:52:04.214 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:52:04.214 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:04.214 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:04.214 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:04.215 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:04.215 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:52:04.215 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:52:04.215 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:52:04.215 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:52:04.215 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:52:04.215 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:04.215 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:04.215 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:52:04.215 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:52:04.215 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:52:04.215 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:52:04.215 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:04.215 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:52:04.216 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:52:04.216 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:04.216 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:04.216 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:04.216 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:52:04.216 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:52:04.216 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:04.216 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:04.216 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:04.216 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:04.216 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:52:04.216 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:52:04.216 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:52:04.216 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:52:04.217 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:52:04.217 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:04.217 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:04.217 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:52:04.217 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:52:04.217 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:52:04.217 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:52:04.217 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:04.217 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:52:04.217 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:52:04.217 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:04.217 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:04.217 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:04.217 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:52:04.218 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:52:04.218 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:04.218 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:04.218 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:04.218 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:04.218 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:52:04.218 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:52:04.218 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:52:04.218 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:52:04.218 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:52:04.218 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:04.218 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:04.218 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:04.218 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:52:04.219 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:52:04.219 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:04.219 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:52:04.219 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:04.219 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:52:04.219 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:04.219 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:04.219 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:52:04.219 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:04.219 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:52:04.219 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:04.219 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:52:04.219 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:04.219 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:04.220 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:52:04.220 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:04.220 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:52:04.220 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:04.220 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5 2024-03-23T23:52:04.220 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:04.220 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:04.220 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:52:04.220 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:04.220 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:52:04.220 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:04.220 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:52:04.220 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:04.221 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:04.221 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:52:04.221 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:04.221 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:52:04.221 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:04.221 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:04.221 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:52:04.221 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:04.221 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:52:04.221 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:04.221 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:52:04.221 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:04.221 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:04.221 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:04.221 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:52:04.222 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:52:04.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.207+0000 7f739d600640 1 --2- 172.21.15.8:0/839983413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73a01460e0 0x7f73a01eb1f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:04.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.211+0000 7f73a6e00640 1 -- 172.21.15.8:0/839983413 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7380067610 msgr2=0x7f7380069ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:04.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.211+0000 7f73a6e00640 1 --2- 172.21.15.8:0/839983413 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7380067610 0x7f7380069ad0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7398003cc0 tx=0x7f73980091f0 comp rx=0 tx=0).stop 2024-03-23T23:52:04.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.211+0000 7f73a6e00640 1 -- 172.21.15.8:0/839983413 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73a006d2b0 msgr2=0x7f73a01438e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:04.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.211+0000 7f73a6e00640 1 --2- 172.21.15.8:0/839983413 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73a006d2b0 0x7f73a01438e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f739400c390 tx=0x7f739400c850 comp rx=0 tx=0).stop 2024-03-23T23:52:04.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.211+0000 7f73a6400640 1 -- 172.21.15.8:0/839983413 reap_dead start 2024-03-23T23:52:04.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.211+0000 7f73a6400640 1 -- 172.21.15.8:0/839983413 reap_dead start 2024-03-23T23:52:04.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.211+0000 7f73a6e00640 1 -- 172.21.15.8:0/839983413 shutdown_connections 2024-03-23T23:52:04.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.211+0000 7f73a6e00640 1 -- 172.21.15.8:0/839983413 >> 172.21.15.8:0/839983413 conn(0x7f73a00c6e10 msgr2=0x7f73a0149f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:04.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.211+0000 7f73a6e00640 1 -- 172.21.15.8:0/839983413 shutdown_connections 2024-03-23T23:52:04.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:04.211+0000 7f73a6e00640 1 -- 172.21.15.8:0/839983413 wait complete. 2024-03-23T23:52:04.249 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T23:52:04.249 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-03-23T23:52:05.210 INFO:tasks.workunit.client.0.smithi008.stdout:Syncing()...51 sec 2024-03-23T23:52:05.210 INFO:tasks.workunit.client.0.smithi008.stdout:FFSB benchmark finished at: Sat Mar 23 23:52:05 2024 2024-03-23T23:52:05.210 INFO:tasks.workunit.client.0.smithi008.stdout: 2024-03-23T23:52:05.211 INFO:tasks.workunit.client.0.smithi008.stdout:Results: 2024-03-23T23:52:05.211 INFO:tasks.workunit.client.0.smithi008.stdout:Benchmark took 356.45 sec 2024-03-23T23:52:05.211 INFO:tasks.workunit.client.0.smithi008.stdout: 2024-03-23T23:52:05.211 INFO:tasks.workunit.client.0.smithi008.stdout:Total Results 2024-03-23T23:52:05.211 INFO:tasks.workunit.client.0.smithi008.stdout:=============== 2024-03-23T23:52:05.211 INFO:tasks.workunit.client.0.smithi008.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-03-23T23:52:05.211 INFO:tasks.workunit.client.0.smithi008.stdout: ======= ============ ========= ======= =========== ========== 2024-03-23T23:52:05.211 INFO:tasks.workunit.client.0.smithi008.stdout: write : 18551040 52044.32 100.000% 100.000% 203MB/sec 2024-03-23T23:52:05.211 INFO:tasks.workunit.client.0.smithi008.stdout:- 2024-03-23T23:52:05.211 INFO:tasks.workunit.client.0.smithi008.stdout:52044.32 Transactions per Second 2024-03-23T23:52:05.211 INFO:tasks.workunit.client.0.smithi008.stdout: 2024-03-23T23:52:05.211 INFO:tasks.workunit.client.0.smithi008.stdout:Throughput Results 2024-03-23T23:52:05.211 INFO:tasks.workunit.client.0.smithi008.stdout:=================== 2024-03-23T23:52:05.211 INFO:tasks.workunit.client.0.smithi008.stdout:Write Throughput: 203MB/sec 2024-03-23T23:52:05.528 INFO:tasks.workunit.client.0.smithi008.stdout: 2024-03-23T23:52:05.528 INFO:tasks.workunit.client.0.smithi008.stdout:System Call Latency statistics in millisecs 2024-03-23T23:52:05.529 INFO:tasks.workunit.client.0.smithi008.stdout:===== 2024-03-23T23:52:05.529 INFO:tasks.workunit.client.0.smithi008.stdout: Min Avg Max Total Calls 2024-03-23T23:52:05.529 INFO:tasks.workunit.client.0.smithi008.stdout: ======== ======== ======== ============ 2024-03-23T23:52:05.529 INFO:tasks.workunit.client.0.smithi008.stdout:[ open] 0.019000 0.227876 64.017998 14493 2024-03-23T23:52:05.529 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-03-23T23:52:05.529 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-03-23T23:52:05.529 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-03-23T23:52:05.529 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-03-23T23:52:05.529 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-03-23T23:52:05.529 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-03-23T23:52:05.529 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[6] 50.000000 - 100.000000 : 2 2024-03-23T23:52:05.529 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[7] 20.000000 - 50.000000 : 41 2024-03-23T23:52:05.529 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[8] 10.000000 - 20.000000 : 42 2024-03-23T23:52:05.530 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[9] 5.000000 - 10.000000 : 68 2024-03-23T23:52:05.530 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[10] 2.000000 - 5.000000 : 76 2024-03-23T23:52:05.530 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[11] 1.000000 - 2.000000 : 39 2024-03-23T23:52:05.530 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[12] 0.500000 - 1.000000 : 32 2024-03-23T23:52:05.530 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[13] 0.200000 - 0.500000 : 57 2024-03-23T23:52:05.530 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[14] 0.100000 - 0.200000 : 241 2024-03-23T23:52:05.530 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[15] 0.050000 - 0.100000 : 1048 2024-03-23T23:52:05.530 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[16] 0.020000 - 0.050000 : 12845 2024-03-23T23:52:05.530 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[17] 0.010000 - 0.020000 : 2 2024-03-23T23:52:05.530 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-03-23T23:52:05.530 INFO:tasks.workunit.client.0.smithi008.stdout: 2024-03-23T23:52:05.530 INFO:tasks.workunit.client.0.smithi008.stdout:[ write] 0.003000 0.518592 11601.258789 18551040 2024-03-23T23:52:05.530 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[0] 5000.000000 - 10000.000000 : 430 2024-03-23T23:52:05.531 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[1] 2000.000000 - 5000.000000 : 1228 2024-03-23T23:52:05.531 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[2] 1000.000000 - 2000.000000 : 658 2024-03-23T23:52:05.531 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[3] 500.000000 - 1000.000000 : 517 2024-03-23T23:52:05.531 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[4] 200.000000 - 500.000000 : 882 2024-03-23T23:52:05.531 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[5] 100.000000 - 200.000000 : 1381 2024-03-23T23:52:05.531 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[6] 50.000000 - 100.000000 : 4014 2024-03-23T23:52:05.531 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[7] 20.000000 - 50.000000 : 12232 2024-03-23T23:52:05.531 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[8] 10.000000 - 20.000000 : 6582 2024-03-23T23:52:05.531 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[9] 5.000000 - 10.000000 : 7619 2024-03-23T23:52:05.531 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[10] 2.000000 - 5.000000 : 11688 2024-03-23T23:52:05.531 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[11] 1.000000 - 2.000000 : 6773 2024-03-23T23:52:05.531 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[12] 0.500000 - 1.000000 : 7052 2024-03-23T23:52:05.531 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[13] 0.200000 - 0.500000 : 15878 2024-03-23T23:52:05.531 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[14] 0.100000 - 0.200000 : 20809 2024-03-23T23:52:05.532 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[15] 0.050000 - 0.100000 : 48021 2024-03-23T23:52:05.532 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[16] 0.020000 - 0.050000 : 323442 2024-03-23T23:52:05.532 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[17] 0.010000 - 0.020000 : 7122153 2024-03-23T23:52:05.532 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[18] 0.000000 - 0.010000 : 10959679 2024-03-23T23:52:05.532 INFO:tasks.workunit.client.0.smithi008.stdout: 2024-03-23T23:52:05.532 INFO:tasks.workunit.client.0.smithi008.stdout:[ lseek] 0.000000 0.002423 80.016998 18551040 2024-03-23T23:52:05.532 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-03-23T23:52:05.532 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-03-23T23:52:05.532 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-03-23T23:52:05.532 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-03-23T23:52:05.532 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-03-23T23:52:05.532 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-03-23T23:52:05.532 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[6] 50.000000 - 100.000000 : 15 2024-03-23T23:52:05.533 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[7] 20.000000 - 50.000000 : 270 2024-03-23T23:52:05.533 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[8] 10.000000 - 20.000000 : 446 2024-03-23T23:52:05.533 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[9] 5.000000 - 10.000000 : 602 2024-03-23T23:52:05.533 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[10] 2.000000 - 5.000000 : 1058 2024-03-23T23:52:05.533 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[11] 1.000000 - 2.000000 : 566 2024-03-23T23:52:05.533 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[12] 0.500000 - 1.000000 : 682 2024-03-23T23:52:05.533 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[13] 0.200000 - 0.500000 : 1337 2024-03-23T23:52:05.533 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[14] 0.100000 - 0.200000 : 1291 2024-03-23T23:52:05.533 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[15] 0.050000 - 0.100000 : 2706 2024-03-23T23:52:05.533 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[16] 0.020000 - 0.050000 : 9840 2024-03-23T23:52:05.533 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[17] 0.010000 - 0.020000 : 11939 2024-03-23T23:52:05.534 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[18] 0.000000 - 0.010000 : 18520288 2024-03-23T23:52:05.534 INFO:tasks.workunit.client.0.smithi008.stdout: 2024-03-23T23:52:05.534 INFO:tasks.workunit.client.0.smithi008.stdout:[ close] 0.004000 0.025033 46.682999 14493 2024-03-23T23:52:05.534 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-03-23T23:52:05.534 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-03-23T23:52:05.534 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-03-23T23:52:05.534 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-03-23T23:52:05.535 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-03-23T23:52:05.535 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-03-23T23:52:05.535 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-03-23T23:52:05.535 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[7] 20.000000 - 50.000000 : 2 2024-03-23T23:52:05.535 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[8] 10.000000 - 20.000000 : 6 2024-03-23T23:52:05.535 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[9] 5.000000 - 10.000000 : 3 2024-03-23T23:52:05.535 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[10] 2.000000 - 5.000000 : 6 2024-03-23T23:52:05.535 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[11] 1.000000 - 2.000000 : 4 2024-03-23T23:52:05.535 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[12] 0.500000 - 1.000000 : 2 2024-03-23T23:52:05.535 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[13] 0.200000 - 0.500000 : 11 2024-03-23T23:52:05.535 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[14] 0.100000 - 0.200000 : 11 2024-03-23T23:52:05.535 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[15] 0.050000 - 0.100000 : 20 2024-03-23T23:52:05.536 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[16] 0.020000 - 0.050000 : 104 2024-03-23T23:52:05.536 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[17] 0.010000 - 0.020000 : 8992 2024-03-23T23:52:05.536 INFO:tasks.workunit.client.0.smithi008.stdout: msec_range[18] 0.000000 - 0.010000 : 5332 2024-03-23T23:52:05.536 INFO:tasks.workunit.client.0.smithi008.stdout: 2024-03-23T23:52:05.536 INFO:tasks.workunit.client.0.smithi008.stdout: 2024-03-23T23:52:05.536 INFO:tasks.workunit.client.0.smithi008.stdout: 2024-03-23T23:52:05.536 INFO:tasks.workunit.client.0.smithi008.stdout: 2024-03-23T23:52:05.536 INFO:tasks.workunit.client.0.smithi008.stdout:5.9% User Time 2024-03-23T23:52:05.536 INFO:tasks.workunit.client.0.smithi008.stdout:54.1% System Time 2024-03-23T23:52:05.536 INFO:tasks.workunit.client.0.smithi008.stdout:60.0% CPU Utilization 2024-03-23T23:52:05.585 INFO:tasks.workunit.client.0.smithi008.stderr:+ cd .. 2024-03-23T23:52:05.594 INFO:tasks.workunit.client.0.smithi008.stderr:+ rm -r tmp ffsb 2024-03-23T23:52:14.655 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:52:14.661 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:52:24.250 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-03-23T23:52:24.250 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-03-23T23:52:24.251 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-23T23:52:24.251 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-23T23:52:24.256 INFO:tasks.ceph.mon.a:Started 2024-03-23T23:52:24.256 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T23:52:24.257 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:52:24.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.543+0000 7fbb19200640 1 Processor -- start 2024-03-23T23:52:24.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.547+0000 7fbb19200640 1 -- start start 2024-03-23T23:52:24.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.547+0000 7fbb19200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb140722f0 0x7fbb141564a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:24.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.547+0000 7fbb19200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb14155a00 con 0x7fbb14073180 2024-03-23T23:52:24.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.547+0000 7fbb19200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb140c3710 con 0x7fbb1414f840 2024-03-23T23:52:24.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.547+0000 7fbb19200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb14156010 con 0x7fbb140722f0 2024-03-23T23:52:24.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.547+0000 7fbb11e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fbb1414f840 0x7fbb140c1e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:51620/0 (socket says 172.21.15.8:51620) 2024-03-23T23:52:24.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.547+0000 7fbb11e00640 1 -- 172.21.15.8:0/4060713640 learned_addr learned my addr 172.21.15.8:0/4060713640 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:52:24.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.547+0000 7fbb11400640 1 --2- 172.21.15.8:0/4060713640 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb140722f0 0x7fbb141564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:24.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.551+0000 7fbb10a00640 1 -- 172.21.15.8:0/4060713640 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2680104713 0 0) 0x7fbb140c3710 con 0x7fbb1414f840 2024-03-23T23:52:24.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.551+0000 7fbb10a00640 1 -- 172.21.15.8:0/4060713640 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaf8003530 con 0x7fbb1414f840 2024-03-23T23:52:24.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.551+0000 7fbb10a00640 1 -- 172.21.15.8:0/4060713640 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 194630532 0 0) 0x7fbaf8003530 con 0x7fbb1414f840 2024-03-23T23:52:24.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.551+0000 7fbb10a00640 1 -- 172.21.15.8:0/4060713640 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb140722f0 msgr2=0x7fbb141564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:52:24.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.551+0000 7fbb10a00640 1 --2- 172.21.15.8:0/4060713640 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb140722f0 0x7fbb141564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:24.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.551+0000 7fbb10a00640 1 -- 172.21.15.8:0/4060713640 >> v1:172.21.15.8:6789/0 conn(0x7fbb14073180 legacy=0x7fbb140c05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:52:24.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.551+0000 7fbb10a00640 1 -- 172.21.15.8:0/4060713640 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb14155ca0 con 0x7fbb1414f840 2024-03-23T23:52:24.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.551+0000 7fbb10a00640 1 -- 172.21.15.8:0/4060713640 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7fbb04001680 con 0x7fbb1414f840 2024-03-23T23:52:24.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.551+0000 7fbb10a00640 1 -- 172.21.15.8:0/4060713640 >> v1:172.21.15.196:6789/0 conn(0x7fbb1414f840 legacy=0x7fbb140c1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:24.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.551+0000 7fbb10a00640 1 --2- 172.21.15.8:0/4060713640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbaf8003a30 0x7fbaf8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:24.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.551+0000 7fbb10a00640 1 --2- 172.21.15.8:0/4060713640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbaf8004810 0x7fbaf8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:24.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.551+0000 7fbb10a00640 1 --2- 172.21.15.8:0/4060713640 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbaf80051d0 0x7fbaf80141e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:24.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.551+0000 7fbb10a00640 1 -- 172.21.15.8:0/4060713640 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb14156010 con 0x7fbaf8003a30 2024-03-23T23:52:24.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.551+0000 7fbb10a00640 1 -- 172.21.15.8:0/4060713640 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf8014910 con 0x7fbaf8004810 2024-03-23T23:52:24.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.551+0000 7fbb10a00640 1 -- 172.21.15.8:0/4060713640 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf8014b10 con 0x7fbaf80051d0 2024-03-23T23:52:24.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.551+0000 7fbb11e00640 1 --2- 172.21.15.8:0/4060713640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbaf8003a30 0x7fbaf8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:24.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.555+0000 7fbb11400640 1 --2- 172.21.15.8:0/4060713640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbaf8004810 0x7fbaf8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:24.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.555+0000 7fbb12800640 1 --2- 172.21.15.8:0/4060713640 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbaf80051d0 0x7fbaf80141e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:24.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.555+0000 7fbb11e00640 1 -- 172.21.15.8:0/4060713640 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbaf80051d0 msgr2=0x7fbaf80141e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:52:24.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.555+0000 7fbb11e00640 1 --2- 172.21.15.8:0/4060713640 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbaf80051d0 0x7fbaf80141e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:24.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.555+0000 7fbb11e00640 1 -- 172.21.15.8:0/4060713640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbaf8004810 msgr2=0x7fbaf8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:52:24.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.555+0000 7fbb11e00640 1 --2- 172.21.15.8:0/4060713640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbaf8004810 0x7fbaf8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:24.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.555+0000 7fbb11e00640 1 -- 172.21.15.8:0/4060713640 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb14155ca0 con 0x7fbaf8003a30 2024-03-23T23:52:24.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.555+0000 7fbb11400640 1 --2- 172.21.15.8:0/4060713640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbaf8004810 0x7fbaf8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:52:24.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.555+0000 7fbb12800640 1 --2- 172.21.15.8:0/4060713640 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbaf80051d0 0x7fbaf80141e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:52:24.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.559+0000 7fbb11e00640 1 --2- 172.21.15.8:0/4060713640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbaf8003a30 0x7fbaf8003e30 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fbb0401d290 tx=0x7fbb0402dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffddc9dd746c8b1e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:24.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.575+0000 7fbb10a00640 1 -- 172.21.15.8:0/4060713640 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb040c3070 con 0x7fbaf8003a30 2024-03-23T23:52:24.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.575+0000 7fbb10a00640 1 -- 172.21.15.8:0/4060713640 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb040b6a20 con 0x7fbaf8003a30 2024-03-23T23:52:24.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.575+0000 7fbb10a00640 1 -- 172.21.15.8:0/4060713640 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb04018d70 con 0x7fbaf8003a30 2024-03-23T23:52:24.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.575+0000 7fbb19200640 1 -- 172.21.15.8:0/4060713640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbaf8003a30 msgr2=0x7fbaf8003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:24.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.575+0000 7fbb19200640 1 --2- 172.21.15.8:0/4060713640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbaf8003a30 0x7fbaf8003e30 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fbb0401d290 tx=0x7fbb0402dd40 comp rx=0 tx=0).stop 2024-03-23T23:52:24.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.575+0000 7fbb12800640 1 -- 172.21.15.8:0/4060713640 reap_dead start 2024-03-23T23:52:24.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.583+0000 7fbb19200640 1 -- 172.21.15.8:0/4060713640 shutdown_connections 2024-03-23T23:52:24.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.583+0000 7fbb19200640 1 -- 172.21.15.8:0/4060713640 >> 172.21.15.8:0/4060713640 conn(0x7fbb140c7170 msgr2=0x7fbb140c7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:24.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.583+0000 7fbb19200640 1 -- 172.21.15.8:0/4060713640 shutdown_connections 2024-03-23T23:52:24.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.583+0000 7fbb19200640 1 -- 172.21.15.8:0/4060713640 wait complete. 2024-03-23T23:52:24.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.591+0000 7fbb19200640 1 Processor -- start 2024-03-23T23:52:24.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.591+0000 7fbb19200640 1 -- start start 2024-03-23T23:52:24.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.595+0000 7fbb19200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbaf8003a30 0x7fbb14150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:24.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.595+0000 7fbb19200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb141ee430 0x7fbb1414ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:24.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.599+0000 7fbb19200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb1406db10 0x7fbb141eadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:24.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.599+0000 7fbb12800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb1406db10 0x7fbb141eadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:24.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.599+0000 7fbb12800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb1406db10 0x7fbb141eadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42832/0 (socket says 172.21.15.8:42832) 2024-03-23T23:52:24.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.599+0000 7fbb12800640 1 -- 172.21.15.8:0/1961093443 learned_addr learned my addr 172.21.15.8:0/1961093443 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:52:24.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.599+0000 7fbb19200640 1 -- 172.21.15.8:0/1961093443 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1414fc20 con 0x7fbb1406db10 2024-03-23T23:52:24.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.599+0000 7fbb19200640 1 -- 172.21.15.8:0/1961093443 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb141568b0 con 0x7fbb141ee430 2024-03-23T23:52:24.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.599+0000 7fbb19200640 1 -- 172.21.15.8:0/1961093443 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1414fda0 con 0x7fbaf8003a30 2024-03-23T23:52:24.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.599+0000 7fbb12800640 1 -- 172.21.15.8:0/1961093443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb1406db10 msgr2=0x7fbb141eadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-03-23T23:52:24.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.599+0000 7fbb12800640 1 -- 172.21.15.8:0/1961093443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb1406db10 msgr2=0x7fbb141eadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T23:52:24.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.599+0000 7fbb12800640 1 --2- 172.21.15.8:0/1961093443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb1406db10 0x7fbb141eadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:52:24.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.599+0000 7fbb12800640 1 --2- 172.21.15.8:0/1961093443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb1406db10 0x7fbb141eadc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:52:24.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.603+0000 7fbb11e00640 1 --2- 172.21.15.8:0/1961093443 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbaf8003a30 0x7fbb14150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:24.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.603+0000 7fbb11400640 1 --2- 172.21.15.8:0/1961093443 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb141ee430 0x7fbb1414ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:24.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.603+0000 7fbb11400640 1 -- 172.21.15.8:0/1961093443 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbaf8003a30 msgr2=0x7fbb14150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:24.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.603+0000 7fbb11400640 1 --2- 172.21.15.8:0/1961093443 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbaf8003a30 0x7fbb14150f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:24.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.603+0000 7fbb11400640 1 -- 172.21.15.8:0/1961093443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb1406db10 msgr2=0x7fbb141eadc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:52:24.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.603+0000 7fbb11400640 1 --2- 172.21.15.8:0/1961093443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb1406db10 0x7fbb141eadc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:24.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.603+0000 7fbb11400640 1 -- 172.21.15.8:0/1961093443 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb14150150 con 0x7fbb141ee430 2024-03-23T23:52:24.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.607+0000 7fbb11400640 1 --2- 172.21.15.8:0/1961093443 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb141ee430 0x7fbb1414ebe0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbb14072730 tx=0x7fbb00011ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:24.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.607+0000 7fbb0a000640 1 -- 172.21.15.8:0/1961093443 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb00004220 con 0x7fbb141ee430 2024-03-23T23:52:24.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.607+0000 7fbb19200640 1 -- 172.21.15.8:0/1961093443 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb14150430 con 0x7fbb141ee430 2024-03-23T23:52:24.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.607+0000 7fbb19200640 1 -- 172.21.15.8:0/1961093443 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb141ea8a0 con 0x7fbb141ee430 2024-03-23T23:52:24.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.611+0000 7fbb0a000640 1 -- 172.21.15.8:0/1961093443 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb000043c0 con 0x7fbb141ee430 2024-03-23T23:52:24.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.611+0000 7fbb0a000640 1 -- 172.21.15.8:0/1961093443 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb00015870 con 0x7fbb141ee430 2024-03-23T23:52:24.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.611+0000 7fbaff400640 1 -- 172.21.15.8:0/1961093443 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb141eaaa0 con 0x7fbb141ee430 2024-03-23T23:52:24.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.619+0000 7fbb0a000640 1 -- 172.21.15.8:0/1961093443 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fbb00015a10 con 0x7fbb141ee430 2024-03-23T23:52:24.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.619+0000 7fbb0a000640 1 --2- 172.21.15.8:0/1961093443 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbaf4067690 0x7fbaf4069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:24.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.619+0000 7fbb0a000640 1 -- 172.21.15.8:0/1961093443 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fbb00086300 con 0x7fbb141ee430 2024-03-23T23:52:24.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.623+0000 7fbb11e00640 1 --2- 172.21.15.8:0/1961093443 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbaf4067690 0x7fbaf4069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:24.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.623+0000 7fbb11e00640 1 --2- 172.21.15.8:0/1961093443 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbaf4067690 0x7fbaf4069b50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbb040c0000 tx=0x7fbb040b8070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:24.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:24.647+0000 7fbb0a000640 1 -- 172.21.15.8:0/1961093443 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fbb141eaaa0 con 0x7fbb141ee430 2024-03-23T23:52:25.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:25.059+0000 7fbaff400640 1 -- 172.21.15.8:0/1961093443 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fbb1404f480 con 0x7fbb141ee430 2024-03-23T23:52:25.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:25.063+0000 7fbb0a000640 1 -- 172.21.15.8:0/1961093443 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1555 (secure 0 0 0) 0x7fbb00019030 con 0x7fbb141ee430 2024-03-23T23:52:25.063 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":70,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":22,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:52:25.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:25.063+0000 7fbaff400640 1 -- 172.21.15.8:0/1961093443 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbaf4067690 msgr2=0x7fbaf4069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:25.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:25.063+0000 7fbaff400640 1 --2- 172.21.15.8:0/1961093443 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbaf4067690 0x7fbaf4069b50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbb040c0000 tx=0x7fbb040b8070 comp rx=0 tx=0).stop 2024-03-23T23:52:25.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:25.063+0000 7fbaff400640 1 -- 172.21.15.8:0/1961093443 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb141ee430 msgr2=0x7fbb1414ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:25.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:25.063+0000 7fbaff400640 1 --2- 172.21.15.8:0/1961093443 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb141ee430 0x7fbb1414ebe0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbb14072730 tx=0x7fbb00011ae0 comp rx=0 tx=0).stop 2024-03-23T23:52:25.065 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:25.063+0000 7fbaff400640 1 -- 172.21.15.8:0/1961093443 shutdown_connections 2024-03-23T23:52:25.065 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:25.063+0000 7fbaff400640 1 --2- 172.21.15.8:0/1961093443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb1406db10 0x7fbb141eadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:25.065 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:25.063+0000 7fbaff400640 1 --2- 172.21.15.8:0/1961093443 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb141ee430 0x7fbb1414ebe0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:25.065 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:25.063+0000 7fbaff400640 1 --2- 172.21.15.8:0/1961093443 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbaf4067690 0x7fbaf4069b50 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:25.065 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:25.063+0000 7fbaff400640 1 --2- 172.21.15.8:0/1961093443 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbaf8003a30 0x7fbb14150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:25.065 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:25.063+0000 7fbaff400640 1 -- 172.21.15.8:0/1961093443 >> 172.21.15.8:0/1961093443 conn(0x7fbb140c7170 msgr2=0x7fbb140718e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:25.065 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:25.063+0000 7fbaff400640 1 -- 172.21.15.8:0/1961093443 shutdown_connections 2024-03-23T23:52:25.065 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:25.063+0000 7fbaff400640 1 -- 172.21.15.8:0/1961093443 wait complete. 2024-03-23T23:52:28.087 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:52:28.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.339+0000 7ff0bfe00640 1 Processor -- start 2024-03-23T23:52:28.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.339+0000 7ff0bfe00640 1 -- start start 2024-03-23T23:52:28.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.343+0000 7ff0bfe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff0b814a180 0x7ff0b8154220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:28.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.343+0000 7ff0bfe00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff0b80c1b70 0x7ff0b80c3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:28.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.343+0000 7ff0bfe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0b80c3b60 0x7ff0b806e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:28.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.343+0000 7ff0bfe00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0b814a560 con 0x7ff0b814a180 2024-03-23T23:52:28.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.343+0000 7ff0bfe00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0b80ac3a0 con 0x7ff0b80c1b70 2024-03-23T23:52:28.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.343+0000 7ff0bfe00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b80c2070 con 0x7ff0b80c3b60 2024-03-23T23:52:28.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.343+0000 7ff0bca00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff0b80c1b70 0x7ff0b80c3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:28.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.343+0000 7ff0bca00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff0b80c1b70 0x7ff0b80c3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:35560/0 (socket says 172.21.15.8:35560) 2024-03-23T23:52:28.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.343+0000 7ff0bca00640 1 -- 172.21.15.8:0/622308553 learned_addr learned my addr 172.21.15.8:0/622308553 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:52:28.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.343+0000 7ff0bd400640 1 --2- 172.21.15.8:0/622308553 >> v2:172.21.15.8:3300/0 conn(0x7ff0b814a180 0x7ff0b8154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:28.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.343+0000 7ff0bd400640 1 -- 172.21.15.8:0/622308553 >> v2:172.21.15.8:3300/0 conn(0x7ff0b814a180 msgr2=0x7ff0b8154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:52:28.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.343+0000 7ff0bd400640 1 -- 172.21.15.8:0/622308553 >> v2:172.21.15.8:3300/0 conn(0x7ff0b814a180 msgr2=0x7ff0b8154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:52:28.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.343+0000 7ff0bd400640 1 --2- 172.21.15.8:0/622308553 >> v2:172.21.15.8:3300/0 conn(0x7ff0b814a180 0x7ff0b8154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:52:28.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.343+0000 7ff0bd400640 1 --2- 172.21.15.8:0/622308553 >> v2:172.21.15.8:3300/0 conn(0x7ff0b814a180 0x7ff0b8154220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:52:28.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.347+0000 7ff0bde00640 1 --2- 172.21.15.8:0/622308553 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0b80c3b60 0x7ff0b806e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:28.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.347+0000 7ff0bca00640 1 -- 172.21.15.8:0/622308553 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0b80c3b60 msgr2=0x7ff0b806e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:52:28.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.347+0000 7ff0bca00640 1 --2- 172.21.15.8:0/622308553 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0b80c3b60 0x7ff0b806e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:28.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.347+0000 7ff0bca00640 1 -- 172.21.15.8:0/622308553 >> v2:172.21.15.8:3300/0 conn(0x7ff0b814a180 msgr2=0x7ff0b8154220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:52:28.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.347+0000 7ff0bca00640 1 --2- 172.21.15.8:0/622308553 >> v2:172.21.15.8:3300/0 conn(0x7ff0b814a180 0x7ff0b8154220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:28.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.347+0000 7ff0bca00640 1 -- 172.21.15.8:0/622308553 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b80c2350 con 0x7ff0b80c1b70 2024-03-23T23:52:28.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.347+0000 7ff0bde00640 1 --2- 172.21.15.8:0/622308553 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0b80c3b60 0x7ff0b806e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:52:28.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.351+0000 7ff0bca00640 1 --2- 172.21.15.8:0/622308553 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0b80c1b70 0x7ff0b80c3620 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80ac6e0 tx=0x7ff0a401c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38976806560022ba server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:28.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.355+0000 7ff0b7e00640 1 -- 172.21.15.8:0/622308553 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a40ab650 con 0x7ff0b80c1b70 2024-03-23T23:52:28.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.355+0000 7ff0b7e00640 1 -- 172.21.15.8:0/622308553 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a40b0070 con 0x7ff0b80c1b70 2024-03-23T23:52:28.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.355+0000 7ff0b7e00640 1 -- 172.21.15.8:0/622308553 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a40aba10 con 0x7ff0b80c1b70 2024-03-23T23:52:28.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.355+0000 7ff0bfe00640 1 -- 172.21.15.8:0/622308553 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0b80c1b70 msgr2=0x7ff0b80c3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:28.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.355+0000 7ff0bfe00640 1 --2- 172.21.15.8:0/622308553 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0b80c1b70 0x7ff0b80c3620 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80ac6e0 tx=0x7ff0a401c490 comp rx=0 tx=0).stop 2024-03-23T23:52:28.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.359+0000 7ff0bfe00640 1 -- 172.21.15.8:0/622308553 shutdown_connections 2024-03-23T23:52:28.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.359+0000 7ff0bfe00640 1 --2- 172.21.15.8:0/622308553 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0b80c3b60 0x7ff0b806e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:28.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.359+0000 7ff0bfe00640 1 --2- 172.21.15.8:0/622308553 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0b80c1b70 0x7ff0b80c3620 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:28.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.359+0000 7ff0bfe00640 1 --2- 172.21.15.8:0/622308553 >> v2:172.21.15.8:3300/0 conn(0x7ff0b814a180 0x7ff0b8154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:28.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.359+0000 7ff0bfe00640 1 -- 172.21.15.8:0/622308553 >> 172.21.15.8:0/622308553 conn(0x7ff0b806b170 msgr2=0x7ff0b806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:28.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.359+0000 7ff0bfe00640 1 -- 172.21.15.8:0/622308553 shutdown_connections 2024-03-23T23:52:28.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.359+0000 7ff0bfe00640 1 -- 172.21.15.8:0/622308553 wait complete. 2024-03-23T23:52:28.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.359+0000 7ff0bfe00640 1 Processor -- start 2024-03-23T23:52:28.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.359+0000 7ff0bfe00640 1 -- start start 2024-03-23T23:52:28.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.363+0000 7ff0bfe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0b80c1b70 0x7ff0b80ab230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:28.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.367+0000 7ff0bfe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0b80c3b60 0x7ff0b8158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:28.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.367+0000 7ff0bfe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0b814a180 0x7ff0b81589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:28.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.367+0000 7ff0bfe00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b8156d80 con 0x7ff0b80c3b60 2024-03-23T23:52:28.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.367+0000 7ff0bfe00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b8156c00 con 0x7ff0b814a180 2024-03-23T23:52:28.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.367+0000 7ff0bfe00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b8156f00 con 0x7ff0b80c1b70 2024-03-23T23:52:28.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.371+0000 7ff0bca00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0b80c3b60 0x7ff0b8158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:28.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.371+0000 7ff0bca00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0b80c3b60 0x7ff0b8158490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42850/0 (socket says 172.21.15.8:42850) 2024-03-23T23:52:28.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.371+0000 7ff0bca00640 1 -- 172.21.15.8:0/1919511109 learned_addr learned my addr 172.21.15.8:0/1919511109 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:52:28.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.371+0000 7ff0bca00640 1 -- 172.21.15.8:0/1919511109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0b80c3b60 msgr2=0x7ff0b8158490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-03-23T23:52:28.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.371+0000 7ff0bca00640 1 -- 172.21.15.8:0/1919511109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0b80c3b60 msgr2=0x7ff0b8158490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T23:52:28.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.371+0000 7ff0bca00640 1 --2- 172.21.15.8:0/1919511109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0b80c3b60 0x7ff0b8158490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:52:28.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.371+0000 7ff0bca00640 1 --2- 172.21.15.8:0/1919511109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0b80c3b60 0x7ff0b8158490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:52:28.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.371+0000 7ff0bde00640 1 --2- 172.21.15.8:0/1919511109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0b814a180 0x7ff0b81589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:28.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.371+0000 7ff0bd400640 1 --2- 172.21.15.8:0/1919511109 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0b80c1b70 0x7ff0b80ab230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:28.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.375+0000 7ff0bd400640 1 -- 172.21.15.8:0/1919511109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0b814a180 msgr2=0x7ff0b81589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:28.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.375+0000 7ff0bd400640 1 --2- 172.21.15.8:0/1919511109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0b814a180 0x7ff0b81589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:28.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.375+0000 7ff0bd400640 1 -- 172.21.15.8:0/1919511109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0b80c3b60 msgr2=0x7ff0b8158490 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:52:28.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.375+0000 7ff0bd400640 1 --2- 172.21.15.8:0/1919511109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0b80c3b60 0x7ff0b8158490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:28.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.375+0000 7ff0bd400640 1 -- 172.21.15.8:0/1919511109 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b8158f10 con 0x7ff0b80c1b70 2024-03-23T23:52:28.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.379+0000 7ff0bd400640 1 --2- 172.21.15.8:0/1919511109 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0b80c1b70 0x7ff0b80ab230 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac00e810 tx=0x7ff0ac00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:28.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.387+0000 7ff0b5600640 1 -- 172.21.15.8:0/1919511109 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac017030 con 0x7ff0b80c1b70 2024-03-23T23:52:28.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.387+0000 7ff0bfe00640 1 -- 172.21.15.8:0/1919511109 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b80721a0 con 0x7ff0b80c1b70 2024-03-23T23:52:28.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.387+0000 7ff0bfe00640 1 -- 172.21.15.8:0/1919511109 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b80716c0 con 0x7ff0b80c1b70 2024-03-23T23:52:28.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.391+0000 7ff0bfe00640 1 -- 172.21.15.8:0/1919511109 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0b804f480 con 0x7ff0b80c1b70 2024-03-23T23:52:28.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.391+0000 7ff0b5600640 1 -- 172.21.15.8:0/1919511109 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ac00ee00 con 0x7ff0b80c1b70 2024-03-23T23:52:28.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.391+0000 7ff0b5600640 1 -- 172.21.15.8:0/1919511109 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac017030 con 0x7ff0b80c1b70 2024-03-23T23:52:28.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.395+0000 7ff0b5600640 1 -- 172.21.15.8:0/1919511109 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff0ac01a070 con 0x7ff0b80c1b70 2024-03-23T23:52:28.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.399+0000 7ff0b5600640 1 --2- 172.21.15.8:0/1919511109 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff098067890 0x7ff098069d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:28.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.399+0000 7ff0b5600640 1 -- 172.21.15.8:0/1919511109 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7ff0ac0850c0 con 0x7ff0b80c1b70 2024-03-23T23:52:28.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.415+0000 7ff0bca00640 1 --2- 172.21.15.8:0/1919511109 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff098067890 0x7ff098069d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:28.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.427+0000 7ff0bca00640 1 --2- 172.21.15.8:0/1919511109 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff098067890 0x7ff098069d50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4000c10 tx=0x7ff0a40a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:28.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.439+0000 7ff0b5600640 1 -- 172.21.15.8:0/1919511109 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7ff0ac055970 con 0x7ff0b80c1b70 2024-03-23T23:52:28.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.847+0000 7ff0bfe00640 1 -- 172.21.15.8:0/1919511109 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff0b80c3400 con 0x7ff0b80c1b70 2024-03-23T23:52:28.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.847+0000 7ff0b5600640 1 -- 172.21.15.8:0/1919511109 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1555 (secure 0 0 0) 0x7ff0ac055270 con 0x7ff0b80c1b70 2024-03-23T23:52:28.848 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":70,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":26,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:52:28.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.851+0000 7ff0bfe00640 1 -- 172.21.15.8:0/1919511109 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff098067890 msgr2=0x7ff098069d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:28.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.851+0000 7ff0bfe00640 1 --2- 172.21.15.8:0/1919511109 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff098067890 0x7ff098069d50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4000c10 tx=0x7ff0a40a7000 comp rx=0 tx=0).stop 2024-03-23T23:52:28.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.851+0000 7ff0bfe00640 1 -- 172.21.15.8:0/1919511109 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0b80c1b70 msgr2=0x7ff0b80ab230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:28.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.851+0000 7ff0bfe00640 1 --2- 172.21.15.8:0/1919511109 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0b80c1b70 0x7ff0b80ab230 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac00e810 tx=0x7ff0ac00ecd0 comp rx=0 tx=0).stop 2024-03-23T23:52:28.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.851+0000 7ff0bfe00640 1 -- 172.21.15.8:0/1919511109 shutdown_connections 2024-03-23T23:52:28.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.851+0000 7ff0bfe00640 1 --2- 172.21.15.8:0/1919511109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0b814a180 0x7ff0b81589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:28.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.851+0000 7ff0bfe00640 1 --2- 172.21.15.8:0/1919511109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0b80c3b60 0x7ff0b8158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:28.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.851+0000 7ff0bfe00640 1 --2- 172.21.15.8:0/1919511109 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff098067890 0x7ff098069d50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:28.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.851+0000 7ff0bfe00640 1 --2- 172.21.15.8:0/1919511109 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0b80c1b70 0x7ff0b80ab230 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:28.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.851+0000 7ff0bfe00640 1 -- 172.21.15.8:0/1919511109 >> 172.21.15.8:0/1919511109 conn(0x7ff0b806b170 msgr2=0x7ff0b815b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:28.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.851+0000 7ff0bfe00640 1 -- 172.21.15.8:0/1919511109 shutdown_connections 2024-03-23T23:52:28.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:28.851+0000 7ff0bfe00640 1 -- 172.21.15.8:0/1919511109 wait complete. 2024-03-23T23:52:31.879 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:52:32.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.146+0000 7f8677e00640 1 Processor -- start 2024-03-23T23:52:32.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.146+0000 7f8677e00640 1 -- start start 2024-03-23T23:52:32.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.146+0000 7f8677e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f86700c8d90 0x7f86701578d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:32.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.146+0000 7f8677e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f86700c7280 0x7f86700c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:32.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.146+0000 7f8677e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86700c9260 con 0x7f8670150d70 2024-03-23T23:52:32.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.146+0000 7f8677e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86700c9540 con 0x7f86700c7280 2024-03-23T23:52:32.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.146+0000 7f8677e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86700c9820 con 0x7f86700c8d90 2024-03-23T23:52:32.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.146+0000 7f8675400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f8670150d70 0x7f8670070460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:51636/0 (socket says 172.21.15.8:51636) 2024-03-23T23:52:32.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.146+0000 7f8675400640 1 -- 172.21.15.8:0/387317896 learned_addr learned my addr 172.21.15.8:0/387317896 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:52:32.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.146+0000 7f8675e00640 1 --2- 172.21.15.8:0/387317896 >> v2:172.21.15.196:3300/0 conn(0x7f86700c7280 0x7f86700c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:32.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.150+0000 7f8675e00640 1 -- 172.21.15.8:0/387317896 >> v2:172.21.15.196:3300/0 conn(0x7f86700c7280 msgr2=0x7f86700c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T23:52:32.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.150+0000 7f8675e00640 1 -- 172.21.15.8:0/387317896 >> v2:172.21.15.196:3300/0 conn(0x7f86700c7280 msgr2=0x7f86700c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:52:32.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.150+0000 7f8675e00640 1 --2- 172.21.15.8:0/387317896 >> v2:172.21.15.196:3300/0 conn(0x7f86700c7280 0x7f86700c76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:52:32.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.150+0000 7f8675e00640 1 --2- 172.21.15.8:0/387317896 >> v2:172.21.15.196:3300/0 conn(0x7f86700c7280 0x7f86700c76f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:52:32.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.150+0000 7f8674a00640 1 --2- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f86700c8d90 0x7f86701578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:32.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.150+0000 7f8674a00640 1 -- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f86700c8d90 msgr2=0x7f86701578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:52:32.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.150+0000 7f8674a00640 1 -- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f86700c8d90 msgr2=0x7f86701578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:52:32.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.150+0000 7f8674a00640 1 --2- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f86700c8d90 0x7f86701578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:52:32.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.150+0000 7f8674a00640 1 --2- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f86700c8d90 0x7f86701578d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:52:32.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.354+0000 7f8674a00640 1 --2- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f86700c8d90 0x7f86701578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:32.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.354+0000 7f8674a00640 1 -- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f86700c8d90 msgr2=0x7f86701578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:52:32.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.354+0000 7f8674a00640 1 -- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f86700c8d90 msgr2=0x7f86701578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:52:32.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.354+0000 7f8674a00640 1 --2- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f86700c8d90 0x7f86701578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:52:32.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.354+0000 7f8674a00640 1 --2- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f86700c8d90 0x7f86701578d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:52:32.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.358+0000 7f8675e00640 1 --2- 172.21.15.8:0/387317896 >> v2:172.21.15.196:3300/0 conn(0x7f86700c7280 0x7f86700c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:32.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.366+0000 7f8675e00640 1 -- 172.21.15.8:0/387317896 >> v2:172.21.15.196:3300/0 conn(0x7f86700c7280 msgr2=0x7f86700c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T23:52:32.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.366+0000 7f8675e00640 1 -- 172.21.15.8:0/387317896 >> v2:172.21.15.196:3300/0 conn(0x7f86700c7280 msgr2=0x7f86700c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:52:32.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.366+0000 7f8675e00640 1 --2- 172.21.15.8:0/387317896 >> v2:172.21.15.196:3300/0 conn(0x7f86700c7280 0x7f86700c76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:52:32.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.366+0000 7f8675e00640 1 --2- 172.21.15.8:0/387317896 >> v2:172.21.15.196:3300/0 conn(0x7f86700c7280 0x7f86700c76f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:52:32.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.758+0000 7f8674a00640 1 --2- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f86700c8d90 0x7f86701578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:32.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.758+0000 7f8674a00640 1 -- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f86700c8d90 msgr2=0x7f86701578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:52:32.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.758+0000 7f8674a00640 1 -- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f86700c8d90 msgr2=0x7f86701578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:52:32.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.758+0000 7f8674a00640 1 --2- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f86700c8d90 0x7f86701578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:52:32.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.758+0000 7f8674a00640 1 --2- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f86700c8d90 0x7f86701578d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:52:32.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.774+0000 7f8675e00640 1 --2- 172.21.15.8:0/387317896 >> v2:172.21.15.196:3300/0 conn(0x7f86700c7280 0x7f86700c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:32.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.774+0000 7f8675e00640 1 -- 172.21.15.8:0/387317896 >> v2:172.21.15.196:3300/0 conn(0x7f86700c7280 msgr2=0x7f86700c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:52:32.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.774+0000 7f8675e00640 1 -- 172.21.15.8:0/387317896 >> v2:172.21.15.196:3300/0 conn(0x7f86700c7280 msgr2=0x7f86700c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:52:32.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.774+0000 7f8675e00640 1 --2- 172.21.15.8:0/387317896 >> v2:172.21.15.196:3300/0 conn(0x7f86700c7280 0x7f86700c76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:52:32.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:32.774+0000 7f8675e00640 1 --2- 172.21.15.8:0/387317896 >> v2:172.21.15.196:3300/0 conn(0x7f86700c7280 0x7f86700c76f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:52:33.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:33.566+0000 7f8674a00640 1 --2- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f86700c8d90 0x7f86701578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:33.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:33.566+0000 7f8674a00640 1 -- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f86700c8d90 msgr2=0x7f86701578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:52:33.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:33.566+0000 7f8674a00640 1 -- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f86700c8d90 msgr2=0x7f86701578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:52:33.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:33.566+0000 7f8674a00640 1 --2- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f86700c8d90 0x7f86701578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:52:33.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:33.566+0000 7f8674a00640 1 --2- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f86700c8d90 0x7f86701578d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:52:33.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:33.590+0000 7f8675e00640 1 --2- 172.21.15.8:0/387317896 >> v2:172.21.15.196:3300/0 conn(0x7f86700c7280 0x7f86700c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:33.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:33.598+0000 7f8675e00640 1 -- 172.21.15.8:0/387317896 >> v2:172.21.15.196:3300/0 conn(0x7f86700c7280 msgr2=0x7f86700c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:52:33.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:33.598+0000 7f8675e00640 1 -- 172.21.15.8:0/387317896 >> v2:172.21.15.196:3300/0 conn(0x7f86700c7280 msgr2=0x7f86700c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:52:33.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:33.598+0000 7f8675e00640 1 --2- 172.21.15.8:0/387317896 >> v2:172.21.15.196:3300/0 conn(0x7f86700c7280 0x7f86700c76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:52:33.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:33.598+0000 7f8675e00640 1 --2- 172.21.15.8:0/387317896 >> v2:172.21.15.196:3300/0 conn(0x7f86700c7280 0x7f86700c76f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:52:35.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.146+0000 7f866ea00640 1 -- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f86700c8d90 msgr2=0x7f86701578d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:52:35.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.146+0000 7f866ea00640 1 --2- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f86700c8d90 0x7f86701578d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:35.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.146+0000 7f866ea00640 1 -- 172.21.15.8:0/387317896 >> v2:172.21.15.196:3300/0 conn(0x7f86700c7280 msgr2=0x7f86700c76f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:52:35.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.146+0000 7f866ea00640 1 --2- 172.21.15.8:0/387317896 >> v2:172.21.15.196:3300/0 conn(0x7f86700c7280 0x7f86700c76f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:35.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.146+0000 7f866ea00640 1 -- 172.21.15.8:0/387317896 >> v1:172.21.15.196:6789/0 conn(0x7f8670150d70 legacy=0x7f8670070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:35.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.146+0000 7f866ea00640 1 --2- 172.21.15.8:0/387317896 >> v2:172.21.15.8:3300/0 conn(0x7f8650007380 0x7f8650009840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:35.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.146+0000 7f866ea00640 1 -- 172.21.15.8:0/387317896 --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86700c9b00 con 0x7f86500036d0 2024-03-23T23:52:35.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.146+0000 7f866ea00640 1 -- 172.21.15.8:0/387317896 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86700c9540 con 0x7f8650007380 2024-03-23T23:52:35.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.150+0000 7f8674a00640 1 --2- 172.21.15.8:0/387317896 >> v2:172.21.15.8:3300/0 conn(0x7f8650007380 0x7f8650009840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:35.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.150+0000 7f8674a00640 1 -- 172.21.15.8:0/387317896 >> v2:172.21.15.8:3300/0 conn(0x7f8650007380 msgr2=0x7f8650009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:52:35.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.150+0000 7f8674a00640 1 -- 172.21.15.8:0/387317896 >> v2:172.21.15.8:3300/0 conn(0x7f8650007380 msgr2=0x7f8650009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:52:35.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.150+0000 7f8674a00640 1 --2- 172.21.15.8:0/387317896 >> v2:172.21.15.8:3300/0 conn(0x7f8650007380 0x7f8650009840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:52:35.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.150+0000 7f8674a00640 1 --2- 172.21.15.8:0/387317896 >> v2:172.21.15.8:3300/0 conn(0x7f8650007380 0x7f8650009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:52:35.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.354+0000 7f8674a00640 1 --2- 172.21.15.8:0/387317896 >> v2:172.21.15.8:3300/0 conn(0x7f8650007380 0x7f8650009840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:35.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.354+0000 7f8674a00640 1 -- 172.21.15.8:0/387317896 >> v2:172.21.15.8:3300/0 conn(0x7f8650007380 msgr2=0x7f8650009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:52:35.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.354+0000 7f8674a00640 1 -- 172.21.15.8:0/387317896 >> v2:172.21.15.8:3300/0 conn(0x7f8650007380 msgr2=0x7f8650009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:52:35.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.354+0000 7f8674a00640 1 --2- 172.21.15.8:0/387317896 >> v2:172.21.15.8:3300/0 conn(0x7f8650007380 0x7f8650009840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:52:35.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.354+0000 7f8674a00640 1 --2- 172.21.15.8:0/387317896 >> v2:172.21.15.8:3300/0 conn(0x7f8650007380 0x7f8650009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:52:35.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.758+0000 7f8674a00640 1 --2- 172.21.15.8:0/387317896 >> v2:172.21.15.8:3300/0 conn(0x7f8650007380 0x7f8650009840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:35.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.758+0000 7f8674a00640 1 -- 172.21.15.8:0/387317896 >> v2:172.21.15.8:3300/0 conn(0x7f8650007380 msgr2=0x7f8650009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:52:35.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.758+0000 7f8674a00640 1 -- 172.21.15.8:0/387317896 >> v2:172.21.15.8:3300/0 conn(0x7f8650007380 msgr2=0x7f8650009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:52:35.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.758+0000 7f8674a00640 1 --2- 172.21.15.8:0/387317896 >> v2:172.21.15.8:3300/0 conn(0x7f8650007380 0x7f8650009840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:52:35.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.758+0000 7f8674a00640 1 --2- 172.21.15.8:0/387317896 >> v2:172.21.15.8:3300/0 conn(0x7f8650007380 0x7f8650009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:52:35.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.826+0000 7f866fe00640 1 -- 172.21.15.8:0/387317896 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3953277133 0 0) 0x7f86700c9b00 con 0x7f86500036d0 2024-03-23T23:52:35.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.826+0000 7f866fe00640 1 -- 172.21.15.8:0/387317896 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8658003530 con 0x7f86500036d0 2024-03-23T23:52:35.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.830+0000 7f866fe00640 1 -- 172.21.15.8:0/387317896 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2947224378 0 0) 0x7f8658003530 con 0x7f86500036d0 2024-03-23T23:52:35.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.830+0000 7f866fe00640 1 -- 172.21.15.8:0/387317896 >> v2:172.21.15.8:3300/0 conn(0x7f8650007380 msgr2=0x7f8650009840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:52:35.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.830+0000 7f866fe00640 1 --2- 172.21.15.8:0/387317896 >> v2:172.21.15.8:3300/0 conn(0x7f8650007380 0x7f8650009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:35.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.830+0000 7f866fe00640 1 -- 172.21.15.8:0/387317896 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865000afb0 con 0x7f86500036d0 2024-03-23T23:52:35.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.830+0000 7f866fe00640 1 -- 172.21.15.8:0/387317896 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7f8664001700 con 0x7f86500036d0 2024-03-23T23:52:35.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.830+0000 7f866fe00640 1 -- 172.21.15.8:0/387317896 >> v1:172.21.15.8:6789/0 conn(0x7f86500036d0 legacy=0x7f8650005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:35.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.830+0000 7f866fe00640 1 --2- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f86700c8d90 0x7f8658003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:35.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.830+0000 7f866fe00640 1 --2- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8658004090 0x7f8658004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:35.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.830+0000 7f866fe00640 1 --2- 172.21.15.8:0/387317896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8658004d50 0x7f86580051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:35.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.830+0000 7f866fe00640 1 -- 172.21.15.8:0/387317896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86700c9540 con 0x7f8658004d50 2024-03-23T23:52:35.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.830+0000 7f866fe00640 1 -- 172.21.15.8:0/387317896 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86580145d0 con 0x7f8658004090 2024-03-23T23:52:35.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.830+0000 7f866fe00640 1 -- 172.21.15.8:0/387317896 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8658014750 con 0x7f86700c8d90 2024-03-23T23:52:35.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.830+0000 7f8675400640 1 --2- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f86700c8d90 0x7f8658003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:35.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.830+0000 7f8674a00640 1 --2- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8658004090 0x7f8658004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:35.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.830+0000 7f8675e00640 1 -- 172.21.15.8:0/387317896 reap_dead start 2024-03-23T23:52:35.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.830+0000 7f8674a00640 1 -- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f86700c8d90 msgr2=0x7f8658003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:52:35.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.830+0000 7f8674a00640 1 --2- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f86700c8d90 0x7f8658003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:35.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.830+0000 7f8674a00640 1 -- 172.21.15.8:0/387317896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8658004d50 msgr2=0x7f86580051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:52:35.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.830+0000 7f8674a00640 1 --2- 172.21.15.8:0/387317896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8658004d50 0x7f86580051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:35.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.830+0000 7f8674a00640 1 -- 172.21.15.8:0/387317896 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865000afb0 con 0x7f8658004090 2024-03-23T23:52:35.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.834+0000 7f8674a00640 1 --2- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8658004090 0x7f8658004810 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f865c000ee0 tx=0x7f865c01da50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bca35dce20603d1 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:35.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.846+0000 7f866fe00640 1 -- 172.21.15.8:0/387317896 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c0ac070 con 0x7f8658004090 2024-03-23T23:52:35.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.846+0000 7f866fe00640 1 -- 172.21.15.8:0/387317896 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865c0a6990 con 0x7f8658004090 2024-03-23T23:52:35.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.846+0000 7f866fe00640 1 -- 172.21.15.8:0/387317896 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c00f040 con 0x7f8658004090 2024-03-23T23:52:35.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.846+0000 7f8677e00640 1 -- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8658004090 msgr2=0x7f8658004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:35.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.846+0000 7f8677e00640 1 --2- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8658004090 0x7f8658004810 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f865c000ee0 tx=0x7f865c01da50 comp rx=0 tx=0).stop 2024-03-23T23:52:35.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.846+0000 7f8677e00640 1 -- 172.21.15.8:0/387317896 shutdown_connections 2024-03-23T23:52:35.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.846+0000 7f8677e00640 1 --2- 172.21.15.8:0/387317896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8658004d50 0x7f86580051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:35.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.846+0000 7f8677e00640 1 --2- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8658004090 0x7f8658004810 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:35.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.846+0000 7f8677e00640 1 --2- 172.21.15.8:0/387317896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f86700c8d90 0x7f8658003a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:35.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.846+0000 7f8677e00640 1 -- 172.21.15.8:0/387317896 >> 172.21.15.8:0/387317896 conn(0x7f86700743f0 msgr2=0x7f8670074800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:35.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.850+0000 7f8677e00640 1 -- 172.21.15.8:0/387317896 shutdown_connections 2024-03-23T23:52:35.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.850+0000 7f8677e00640 1 -- 172.21.15.8:0/387317896 wait complete. 2024-03-23T23:52:35.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.854+0000 7f8677e00640 1 Processor -- start 2024-03-23T23:52:35.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.854+0000 7f8677e00640 1 -- start start 2024-03-23T23:52:35.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.858+0000 7f8677e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8658004090 0x7f86701e7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:35.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.858+0000 7f8677e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8658004d50 0x7f86700ad300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:35.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.862+0000 7f8677e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86700c8d90 0x7f8670155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:35.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.862+0000 7f8677e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86700711b0 con 0x7f86700c8d90 2024-03-23T23:52:35.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.862+0000 7f8677e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8670071030 con 0x7f8658004d50 2024-03-23T23:52:35.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.862+0000 7f8677e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8670151150 con 0x7f8658004090 2024-03-23T23:52:35.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.862+0000 7f8675e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86700c8d90 0x7f8670155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:35.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.862+0000 7f8675e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86700c8d90 0x7f8670155310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40136/0 (socket says 172.21.15.8:40136) 2024-03-23T23:52:35.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.862+0000 7f8675e00640 1 -- 172.21.15.8:0/188488349 learned_addr learned my addr 172.21.15.8:0/188488349 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:52:35.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.862+0000 7f8675e00640 1 -- 172.21.15.8:0/188488349 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8658004090 msgr2=0x7f86701e7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:35.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.862+0000 7f8675e00640 1 --2- 172.21.15.8:0/188488349 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8658004090 0x7f86701e7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:35.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.862+0000 7f8675e00640 1 -- 172.21.15.8:0/188488349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8658004d50 msgr2=0x7f86700ad300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:35.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.862+0000 7f8675e00640 1 --2- 172.21.15.8:0/188488349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8658004d50 0x7f86700ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:35.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.862+0000 7f8675e00640 1 -- 172.21.15.8:0/188488349 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8670154710 con 0x7f86700c8d90 2024-03-23T23:52:35.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.862+0000 7f8675e00640 1 --2- 172.21.15.8:0/188488349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86700c8d90 0x7f8670155310 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8650009ea0 tx=0x7f8668012610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:35.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.862+0000 7f866d600640 1 -- 172.21.15.8:0/188488349 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866801a070 con 0x7f86700c8d90 2024-03-23T23:52:35.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.862+0000 7f866d600640 1 -- 172.21.15.8:0/188488349 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8668016420 con 0x7f86700c8d90 2024-03-23T23:52:35.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.866+0000 7f8677e00640 1 -- 172.21.15.8:0/188488349 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8670154b50 con 0x7f86700c8d90 2024-03-23T23:52:35.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.866+0000 7f866d600640 1 -- 172.21.15.8:0/188488349 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8668016810 con 0x7f86700c8d90 2024-03-23T23:52:35.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.866+0000 7f8677e00640 1 -- 172.21.15.8:0/188488349 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8670156060 con 0x7f86700c8d90 2024-03-23T23:52:35.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.866+0000 7f8677e00640 1 -- 172.21.15.8:0/188488349 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867004f480 con 0x7f86700c8d90 2024-03-23T23:52:35.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.874+0000 7f866d600640 1 -- 172.21.15.8:0/188488349 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f866801d070 con 0x7f86700c8d90 2024-03-23T23:52:35.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.874+0000 7f866d600640 1 --2- 172.21.15.8:0/188488349 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f86500682c0 0x7f865006a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:35.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.878+0000 7f866d600640 1 -- 172.21.15.8:0/188488349 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f8668086fb0 con 0x7f86700c8d90 2024-03-23T23:52:35.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.878+0000 7f8675400640 1 --2- 172.21.15.8:0/188488349 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f86500682c0 0x7f865006a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:35.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.882+0000 7f8675400640 1 --2- 172.21.15.8:0/188488349 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f86500682c0 0x7f865006a780 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8664001b70 tx=0x7f8664001ae0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:35.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:35.886+0000 7f866d600640 1 -- 172.21.15.8:0/188488349 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f8668010050 con 0x7f86700c8d90 2024-03-23T23:52:36.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:36.390+0000 7f8677e00640 1 -- 172.21.15.8:0/188488349 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f8670156e00 con 0x7f86700c8d90 2024-03-23T23:52:36.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:36.394+0000 7f866d600640 1 -- 172.21.15.8:0/188488349 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1554 (secure 0 0 0) 0x7f86680578e0 con 0x7f86700c8d90 2024-03-23T23:52:36.397 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":74,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:52:36.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:36.414+0000 7f8677e00640 1 -- 172.21.15.8:0/188488349 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f86500682c0 msgr2=0x7f865006a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:36.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:36.414+0000 7f8677e00640 1 --2- 172.21.15.8:0/188488349 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f86500682c0 0x7f865006a780 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8664001b70 tx=0x7f8664001ae0 comp rx=0 tx=0).stop 2024-03-23T23:52:36.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:36.414+0000 7f8677e00640 1 -- 172.21.15.8:0/188488349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86700c8d90 msgr2=0x7f8670155310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:36.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:36.414+0000 7f8677e00640 1 --2- 172.21.15.8:0/188488349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86700c8d90 0x7f8670155310 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8650009ea0 tx=0x7f8668012610 comp rx=0 tx=0).stop 2024-03-23T23:52:36.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:36.414+0000 7f8677e00640 1 -- 172.21.15.8:0/188488349 shutdown_connections 2024-03-23T23:52:36.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:36.414+0000 7f8677e00640 1 --2- 172.21.15.8:0/188488349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86700c8d90 0x7f8670155310 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:36.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:36.414+0000 7f8677e00640 1 --2- 172.21.15.8:0/188488349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8658004d50 0x7f86700ad300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:36.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:36.414+0000 7f8677e00640 1 --2- 172.21.15.8:0/188488349 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f86500682c0 0x7f865006a780 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:36.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:36.414+0000 7f8677e00640 1 --2- 172.21.15.8:0/188488349 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8658004090 0x7f86701e7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:36.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:36.414+0000 7f8677e00640 1 -- 172.21.15.8:0/188488349 >> 172.21.15.8:0/188488349 conn(0x7f86700743f0 msgr2=0x7f86700747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:36.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:36.414+0000 7f8677e00640 1 -- 172.21.15.8:0/188488349 shutdown_connections 2024-03-23T23:52:36.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:36.414+0000 7f8677e00640 1 -- 172.21.15.8:0/188488349 wait complete. 2024-03-23T23:52:39.493 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:52:39.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.770+0000 7f0cc3800640 1 Processor -- start 2024-03-23T23:52:39.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.770+0000 7f0cc3800640 1 -- start start 2024-03-23T23:52:39.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.778+0000 7f0cc3800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0cbc0c1b70 0x7f0cbc154220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:39.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.778+0000 7f0cc3800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0cbc06e350 0x7f0cbc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:39.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.778+0000 7f0cc0e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f0cbc14a180 0x7f0cbc0c3620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:44262/0 (socket says 172.21.15.8:44262) 2024-03-23T23:52:39.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.778+0000 7f0cc0e00640 1 -- 172.21.15.8:0/637573336 learned_addr learned my addr 172.21.15.8:0/637573336 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:52:39.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.778+0000 7f0cbbe00640 1 --2- 172.21.15.8:0/637573336 >> v2:172.21.15.8:3300/0 conn(0x7f0cbc0c1b70 0x7f0cbc154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:39.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.778+0000 7f0cc1800640 1 --2- 172.21.15.8:0/637573336 >> v2:172.21.15.196:3300/0 conn(0x7f0cbc06e350 0x7f0cbc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:39.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.778+0000 7f0cc3800640 1 -- 172.21.15.8:0/637573336 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cbc14a560 con 0x7f0cbc14a180 2024-03-23T23:52:39.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.778+0000 7f0cc3800640 1 -- 172.21.15.8:0/637573336 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cbc0c2070 con 0x7f0cbc0c1b70 2024-03-23T23:52:39.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.778+0000 7f0cc3800640 1 -- 172.21.15.8:0/637573336 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cbc0c2350 con 0x7f0cbc06e350 2024-03-23T23:52:39.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.786+0000 7f0cbbe00640 1 -- 172.21.15.8:0/637573336 >> v2:172.21.15.196:3300/0 conn(0x7f0cbc06e350 msgr2=0x7f0cbc06e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:52:39.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.786+0000 7f0cbbe00640 1 --2- 172.21.15.8:0/637573336 >> v2:172.21.15.196:3300/0 conn(0x7f0cbc06e350 0x7f0cbc06e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:39.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.786+0000 7f0cbbe00640 1 -- 172.21.15.8:0/637573336 >> v1:172.21.15.196:6789/0 conn(0x7f0cbc14a180 legacy=0x7f0cbc0c3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:39.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.786+0000 7f0cbbe00640 1 -- 172.21.15.8:0/637573336 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cbc0c2630 con 0x7f0cbc0c1b70 2024-03-23T23:52:39.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.790+0000 7f0cbbe00640 1 --2- 172.21.15.8:0/637573336 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0cbc0c1b70 0x7f0cbc154220 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc06c210 tx=0x7f0cac0206b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df333f19be44784 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:39.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.794+0000 7f0cbb400640 1 -- 172.21.15.8:0/637573336 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac0ad3f0 con 0x7f0cbc0c1b70 2024-03-23T23:52:39.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.794+0000 7f0cbb400640 1 -- 172.21.15.8:0/637573336 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cac0ad590 con 0x7f0cbc0c1b70 2024-03-23T23:52:39.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.794+0000 7f0cbb400640 1 -- 172.21.15.8:0/637573336 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac0ad960 con 0x7f0cbc0c1b70 2024-03-23T23:52:39.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.794+0000 7f0cc3800640 1 -- 172.21.15.8:0/637573336 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0cbc0c1b70 msgr2=0x7f0cbc154220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:39.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.794+0000 7f0cc3800640 1 --2- 172.21.15.8:0/637573336 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0cbc0c1b70 0x7f0cbc154220 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc06c210 tx=0x7f0cac0206b0 comp rx=0 tx=0).stop 2024-03-23T23:52:39.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.798+0000 7f0cc3800640 1 -- 172.21.15.8:0/637573336 shutdown_connections 2024-03-23T23:52:39.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.798+0000 7f0cc3800640 1 --2- 172.21.15.8:0/637573336 >> v2:172.21.15.196:3300/0 conn(0x7f0cbc06e350 0x7f0cbc06e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:39.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.798+0000 7f0cc3800640 1 --2- 172.21.15.8:0/637573336 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0cbc0c1b70 0x7f0cbc154220 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:39.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.798+0000 7f0cc3800640 1 -- 172.21.15.8:0/637573336 >> 172.21.15.8:0/637573336 conn(0x7f0cbc06b170 msgr2=0x7f0cbc06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:39.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.798+0000 7f0cc3800640 1 -- 172.21.15.8:0/637573336 shutdown_connections 2024-03-23T23:52:39.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.802+0000 7f0cc3800640 1 -- 172.21.15.8:0/637573336 wait complete. 2024-03-23T23:52:39.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.806+0000 7f0cc3800640 1 Processor -- start 2024-03-23T23:52:39.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.806+0000 7f0cc3800640 1 -- start start 2024-03-23T23:52:39.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.806+0000 7f0cc3800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0cbc06e350 0x7f0cbc1547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:39.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.806+0000 7f0cc3800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0cbc0c1b70 0x7f0cbc14fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:39.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.806+0000 7f0cc3800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0cbc14a180 0x7f0cbc14ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:39.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.806+0000 7f0cc3800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cbc15e920 con 0x7f0cbc0c1b70 2024-03-23T23:52:39.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.806+0000 7f0cc3800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cbc15e7a0 con 0x7f0cbc06e350 2024-03-23T23:52:39.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.806+0000 7f0cc3800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cbc15eaa0 con 0x7f0cbc14a180 2024-03-23T23:52:39.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.810+0000 7f0cc0e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0cbc06e350 0x7f0cbc1547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:39.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.810+0000 7f0cc0e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0cbc06e350 0x7f0cbc1547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:44958/0 (socket says 172.21.15.8:44958) 2024-03-23T23:52:39.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.810+0000 7f0cc0e00640 1 -- 172.21.15.8:0/939760853 learned_addr learned my addr 172.21.15.8:0/939760853 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:52:39.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.810+0000 7f0cbbe00640 1 --2- 172.21.15.8:0/939760853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0cbc0c1b70 0x7f0cbc14fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:39.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.810+0000 7f0cc1800640 1 --2- 172.21.15.8:0/939760853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0cbc14a180 0x7f0cbc14ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:39.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.810+0000 7f0cbbe00640 1 -- 172.21.15.8:0/939760853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0cbc14a180 msgr2=0x7f0cbc14ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:39.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.810+0000 7f0cbbe00640 1 --2- 172.21.15.8:0/939760853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0cbc14a180 0x7f0cbc14ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:39.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.810+0000 7f0cbbe00640 1 -- 172.21.15.8:0/939760853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0cbc06e350 msgr2=0x7f0cbc1547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:39.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.810+0000 7f0cbbe00640 1 --2- 172.21.15.8:0/939760853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0cbc06e350 0x7f0cbc1547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:39.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.810+0000 7f0cbbe00640 1 -- 172.21.15.8:0/939760853 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cbc156190 con 0x7f0cbc0c1b70 2024-03-23T23:52:39.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.810+0000 7f0cc1800640 1 --2- 172.21.15.8:0/939760853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0cbc14a180 0x7f0cbc14ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:52:39.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.814+0000 7f0cbbe00640 1 --2- 172.21.15.8:0/939760853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0cbc0c1b70 0x7f0cbc14fcd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc0ac8f0 tx=0x7f0cac01eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:39.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.818+0000 7f0cb8c00640 1 -- 172.21.15.8:0/939760853 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac0bb070 con 0x7f0cbc0c1b70 2024-03-23T23:52:39.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.818+0000 7f0cb8c00640 1 -- 172.21.15.8:0/939760853 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cac0b53f0 con 0x7f0cbc0c1b70 2024-03-23T23:52:39.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.818+0000 7f0cb8c00640 1 -- 172.21.15.8:0/939760853 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac0b57c0 con 0x7f0cbc0c1b70 2024-03-23T23:52:39.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.822+0000 7f0cc3800640 1 -- 172.21.15.8:0/939760853 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cbc1fe9d0 con 0x7f0cbc0c1b70 2024-03-23T23:52:39.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.822+0000 7f0cc3800640 1 -- 172.21.15.8:0/939760853 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cbc1fef90 con 0x7f0cbc0c1b70 2024-03-23T23:52:39.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.830+0000 7f0cc3800640 1 -- 172.21.15.8:0/939760853 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cbc04f480 con 0x7f0cbc0c1b70 2024-03-23T23:52:39.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.830+0000 7f0cb8c00640 1 -- 172.21.15.8:0/939760853 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f0cac0be070 con 0x7f0cbc0c1b70 2024-03-23T23:52:39.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.834+0000 7f0cb8c00640 1 --2- 172.21.15.8:0/939760853 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0c9c067730 0x7f0c9c069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:39.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.842+0000 7f0cc0e00640 1 --2- 172.21.15.8:0/939760853 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0c9c067730 0x7f0c9c069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:39.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.842+0000 7f0cb8c00640 1 -- 172.21.15.8:0/939760853 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f0cac11fba0 con 0x7f0cbc0c1b70 2024-03-23T23:52:39.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.846+0000 7f0cc0e00640 1 --2- 172.21.15.8:0/939760853 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0c9c067730 0x7f0c9c069bf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8000fc0 tx=0x7f0ca8007cf0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:39.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:39.854+0000 7f0cb8c00640 1 -- 172.21.15.8:0/939760853 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f0cac0b1020 con 0x7f0cbc0c1b70 2024-03-23T23:52:40.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.354+0000 7f0cc3800640 1 -- 172.21.15.8:0/939760853 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f0cbc06b6f0 con 0x7f0cbc0c1b70 2024-03-23T23:52:40.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.358+0000 7f0cb8c00640 1 -- 172.21.15.8:0/939760853 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1560 (secure 0 0 0) 0x7f0cac01a3c0 con 0x7f0cbc0c1b70 2024-03-23T23:52:40.358 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":78,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:52:40.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.366+0000 7f0cc3800640 1 -- 172.21.15.8:0/939760853 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0c9c067730 msgr2=0x7f0c9c069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:40.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.366+0000 7f0cc3800640 1 --2- 172.21.15.8:0/939760853 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0c9c067730 0x7f0c9c069bf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8000fc0 tx=0x7f0ca8007cf0 comp rx=0 tx=0).stop 2024-03-23T23:52:40.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.366+0000 7f0cc3800640 1 -- 172.21.15.8:0/939760853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0cbc0c1b70 msgr2=0x7f0cbc14fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:40.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.366+0000 7f0cc3800640 1 --2- 172.21.15.8:0/939760853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0cbc0c1b70 0x7f0cbc14fcd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc0ac8f0 tx=0x7f0cac01eef0 comp rx=0 tx=0).stop 2024-03-23T23:52:40.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.366+0000 7f0cc3800640 1 -- 172.21.15.8:0/939760853 shutdown_connections 2024-03-23T23:52:40.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.366+0000 7f0cc3800640 1 --2- 172.21.15.8:0/939760853 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0c9c067730 0x7f0c9c069bf0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:40.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.366+0000 7f0cc3800640 1 --2- 172.21.15.8:0/939760853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0cbc14a180 0x7f0cbc14ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:40.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.366+0000 7f0cc3800640 1 --2- 172.21.15.8:0/939760853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0cbc0c1b70 0x7f0cbc14fcd0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:40.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.366+0000 7f0cc3800640 1 --2- 172.21.15.8:0/939760853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0cbc06e350 0x7f0cbc1547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:40.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.366+0000 7f0cc3800640 1 -- 172.21.15.8:0/939760853 >> 172.21.15.8:0/939760853 conn(0x7f0cbc06b170 msgr2=0x7f0cbc152ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:40.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.366+0000 7f0cc3800640 1 -- 172.21.15.8:0/939760853 shutdown_connections 2024-03-23T23:52:40.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.366+0000 7f0cc3800640 1 -- 172.21.15.8:0/939760853 wait complete. 2024-03-23T23:52:40.424 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T23:52:40.424 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T23:52:40.424 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:52:40.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.710+0000 7f183ce00640 1 Processor -- start 2024-03-23T23:52:40.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.710+0000 7f183ce00640 1 -- start start 2024-03-23T23:52:40.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.714+0000 7f183ce00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f183814fc70 0x7f18380c3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:40.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.714+0000 7f183ce00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f18380c4160 0x7f1838152f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:40.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.714+0000 7f183ce00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18380c2f70 con 0x7f18380c3d00 2024-03-23T23:52:40.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.714+0000 7f183ce00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18380c36a0 con 0x7f18380c4160 2024-03-23T23:52:40.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.714+0000 7f183ce00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1838155e70 con 0x7f183814fc70 2024-03-23T23:52:40.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.714+0000 7f182d400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f18380c3d00 0x7f1838152850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:56892/0 (socket says 172.21.15.8:56892) 2024-03-23T23:52:40.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.714+0000 7f182d400640 1 -- 172.21.15.8:0/716066231 learned_addr learned my addr 172.21.15.8:0/716066231 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:52:40.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.714+0000 7f1835e00640 1 --2- 172.21.15.8:0/716066231 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f183814fc70 0x7f18380c3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:40.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.718+0000 7f1835400640 1 -- 172.21.15.8:0/716066231 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2382373228 0 0) 0x7f18380c2f70 con 0x7f18380c3d00 2024-03-23T23:52:40.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.718+0000 7f1835400640 1 -- 172.21.15.8:0/716066231 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f181c003530 con 0x7f18380c3d00 2024-03-23T23:52:40.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.718+0000 7f1836800640 1 --2- 172.21.15.8:0/716066231 >> v2:172.21.15.8:3300/0 conn(0x7f18380c4160 0x7f1838152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:40.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.722+0000 7f1836800640 1 -- 172.21.15.8:0/716066231 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f183814fc70 msgr2=0x7f18380c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:52:40.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.722+0000 7f1836800640 1 --2- 172.21.15.8:0/716066231 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f183814fc70 0x7f18380c3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:40.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.722+0000 7f1836800640 1 -- 172.21.15.8:0/716066231 >> v1:172.21.15.8:6789/0 conn(0x7f18380c3d00 legacy=0x7f1838152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:40.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.722+0000 7f1836800640 1 -- 172.21.15.8:0/716066231 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1838156150 con 0x7f18380c4160 2024-03-23T23:52:40.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.726+0000 7f1836800640 1 --2- 172.21.15.8:0/716066231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18380c4160 0x7f1838152f60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1830009d90 tx=0x7f183001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a653e21d023672 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:40.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.726+0000 7f1835400640 1 -- 172.21.15.8:0/716066231 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18300b2070 con 0x7f18380c4160 2024-03-23T23:52:40.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.730+0000 7f1835400640 1 -- 172.21.15.8:0/716066231 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18300a58b0 con 0x7f18380c4160 2024-03-23T23:52:40.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.730+0000 7f1835400640 1 -- 172.21.15.8:0/716066231 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18300a5c80 con 0x7f18380c4160 2024-03-23T23:52:40.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.730+0000 7f183ce00640 1 -- 172.21.15.8:0/716066231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18380c4160 msgr2=0x7f1838152f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:40.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.730+0000 7f183ce00640 1 --2- 172.21.15.8:0/716066231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18380c4160 0x7f1838152f60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1830009d90 tx=0x7f183001c8e0 comp rx=0 tx=0).stop 2024-03-23T23:52:40.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.738+0000 7f183ce00640 1 -- 172.21.15.8:0/716066231 shutdown_connections 2024-03-23T23:52:40.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.738+0000 7f183ce00640 1 --2- 172.21.15.8:0/716066231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18380c4160 0x7f1838152f60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:40.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.738+0000 7f183ce00640 1 --2- 172.21.15.8:0/716066231 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f183814fc70 0x7f18380c3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:40.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.738+0000 7f183ce00640 1 -- 172.21.15.8:0/716066231 >> 172.21.15.8:0/716066231 conn(0x7f183806b170 msgr2=0x7f183806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:40.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.738+0000 7f183ce00640 1 -- 172.21.15.8:0/716066231 shutdown_connections 2024-03-23T23:52:40.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.738+0000 7f183ce00640 1 -- 172.21.15.8:0/716066231 wait complete. 2024-03-23T23:52:40.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.738+0000 7f183ce00640 1 Processor -- start 2024-03-23T23:52:40.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.742+0000 7f183ce00640 1 -- start start 2024-03-23T23:52:40.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.742+0000 7f183ce00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f18380c3d00 0x7f183814a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:40.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.742+0000 7f183ce00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18380c4160 0x7f183814ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:40.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.742+0000 7f183ce00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f183814fc70 0x7f1838143d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:40.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.742+0000 7f183ce00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18380c18d0 con 0x7f18380c4160 2024-03-23T23:52:40.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.742+0000 7f183ce00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18381534a0 con 0x7f18380c3d00 2024-03-23T23:52:40.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.742+0000 7f183ce00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1838150050 con 0x7f183814fc70 2024-03-23T23:52:40.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.742+0000 7f182d400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18380c4160 0x7f183814ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:40.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.742+0000 7f1835e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f18380c3d00 0x7f183814a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:40.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.742+0000 7f1835e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f18380c3d00 0x7f183814a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:44970/0 (socket says 172.21.15.8:44970) 2024-03-23T23:52:40.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.742+0000 7f1835e00640 1 -- 172.21.15.8:0/3980700809 learned_addr learned my addr 172.21.15.8:0/3980700809 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:52:40.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.742+0000 7f1836800640 1 --2- 172.21.15.8:0/3980700809 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f183814fc70 0x7f1838143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:40.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.746+0000 7f182d400640 1 -- 172.21.15.8:0/3980700809 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f183814fc70 msgr2=0x7f1838143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:40.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.746+0000 7f182d400640 1 --2- 172.21.15.8:0/3980700809 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f183814fc70 0x7f1838143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:40.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.746+0000 7f182d400640 1 -- 172.21.15.8:0/3980700809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f18380c3d00 msgr2=0x7f183814a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:40.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.746+0000 7f182d400640 1 --2- 172.21.15.8:0/3980700809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f18380c3d00 0x7f183814a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:40.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.746+0000 7f182d400640 1 -- 172.21.15.8:0/3980700809 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f183814aa60 con 0x7f18380c4160 2024-03-23T23:52:40.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.746+0000 7f1835e00640 1 --2- 172.21.15.8:0/3980700809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f18380c3d00 0x7f183814a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:52:40.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.746+0000 7f1836800640 1 --2- 172.21.15.8:0/3980700809 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f183814fc70 0x7f1838143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:52:40.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.746+0000 7f182d400640 1 --2- 172.21.15.8:0/3980700809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18380c4160 0x7f183814ee20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f182000c430 tx=0x7f182000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:40.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.746+0000 7f182ea00640 1 -- 172.21.15.8:0/3980700809 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1820017070 con 0x7f18380c4160 2024-03-23T23:52:40.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.746+0000 7f182ea00640 1 -- 172.21.15.8:0/3980700809 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1820005cf0 con 0x7f18380c4160 2024-03-23T23:52:40.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.746+0000 7f182ea00640 1 -- 172.21.15.8:0/3980700809 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18200072d0 con 0x7f18380c4160 2024-03-23T23:52:40.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.746+0000 7f183ce00640 1 -- 172.21.15.8:0/3980700809 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f183814c160 con 0x7f18380c4160 2024-03-23T23:52:40.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.746+0000 7f183ce00640 1 -- 172.21.15.8:0/3980700809 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f183814c720 con 0x7f18380c4160 2024-03-23T23:52:40.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.750+0000 7f183ce00640 1 --2- 172.21.15.8:0/3980700809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f183814c920 0x7f1838144270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:40.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.750+0000 7f183ce00640 1 -- 172.21.15.8:0/3980700809 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183814cf20 con 0x7f183814c920 2024-03-23T23:52:40.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.750+0000 7f1835e00640 1 --2- 172.21.15.8:0/3980700809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f183814c920 0x7f1838144270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:40.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.750+0000 7f1835e00640 1 -- 172.21.15.8:0/3980700809 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1838068270 con 0x7f183814c920 2024-03-23T23:52:40.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.750+0000 7f1835e00640 1 --2- 172.21.15.8:0/3980700809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f183814c920 0x7f1838144270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f182800f580 tx=0x7f182800fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:40.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.750+0000 7f182ea00640 1 -- 172.21.15.8:0/3980700809 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f182001a070 con 0x7f18380c4160 2024-03-23T23:52:40.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.754+0000 7f182ea00640 1 --2- 172.21.15.8:0/3980700809 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f181406fef0 0x7f18140723b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:40.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.754+0000 7f182ea00640 1 -- 172.21.15.8:0/3980700809 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1828018070 con 0x7f183814c920 2024-03-23T23:52:40.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.754+0000 7f182ea00640 1 -- 172.21.15.8:0/3980700809 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f1820084f40 con 0x7f18380c4160 2024-03-23T23:52:40.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.754+0000 7f182ea00640 1 -- 172.21.15.8:0/3980700809 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f1828004220 con 0x7f183814c920 2024-03-23T23:52:40.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.754+0000 7f182ea00640 1 -- 172.21.15.8:0/3980700809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f183814c920 msgr2=0x7f1838144270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:40.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.754+0000 7f182ea00640 1 --2- 172.21.15.8:0/3980700809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f183814c920 0x7f1838144270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f182800f580 tx=0x7f182800fa40 comp rx=0 tx=0).stop 2024-03-23T23:52:40.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.754+0000 7f182ea00640 1 -- 172.21.15.8:0/3980700809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f183814c920 msgr2=0x7f1838144270 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:52:40.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.754+0000 7f182ea00640 1 --2- 172.21.15.8:0/3980700809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f183814c920 0x7f1838144270 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f182800f580 tx=0x7f182800fa40 comp rx=0 tx=0).stop 2024-03-23T23:52:40.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.754+0000 7f1836800640 1 --2- 172.21.15.8:0/3980700809 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f181406fef0 0x7f18140723b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:40.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.766+0000 7f1836800640 1 --2- 172.21.15.8:0/3980700809 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f181406fef0 0x7f18140723b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f18300af000 tx=0x7f18300a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:40.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.770+0000 7f183ce00640 1 --2- 172.21.15.8:0/3980700809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1838145e00 0x7f18381ee080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:40.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.770+0000 7f183ce00640 1 -- 172.21.15.8:0/3980700809 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18380c2ce0 con 0x7f1838145e00 2024-03-23T23:52:40.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.770+0000 7f1835e00640 1 --2- 172.21.15.8:0/3980700809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1838145e00 0x7f18381ee080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:40.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.770+0000 7f1835e00640 1 -- 172.21.15.8:0/3980700809 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f183806ea10 con 0x7f1838145e00 2024-03-23T23:52:40.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.770+0000 7f1835e00640 1 --2- 172.21.15.8:0/3980700809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1838145e00 0x7f18381ee080 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f182800f580 tx=0x7f1828004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:40.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.770+0000 7f182ea00640 1 -- 172.21.15.8:0/3980700809 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1828003d30 con 0x7f1838145e00 2024-03-23T23:52:40.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.774+0000 7f182ea00640 1 -- 172.21.15.8:0/3980700809 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4531 (secure 0 0 0) 0x7f18280133e0 con 0x7f1838145e00 2024-03-23T23:52:40.773 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:52:40.773 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:52:40.773 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:52:40.774 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:52:40.774 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 78, 2024-03-23T23:52:40.774 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:52:40.774 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:52:40.774 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:52:40.774 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:52:40.774 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:40.774 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 3, 2024-03-23T23:52:40.774 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:52:40.774 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:52:40.774 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:52:40.774 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:52:40.775 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:52:40.775 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:52:40.775 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:52:40.775 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:52:40.775 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:52:40.775 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:52:40.775 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:52:40.775 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:52:40.775 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:52:40.775 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:52:40.775 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:40.775 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:52:40.775 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:52:40.776 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:52:40.776 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:52:40.776 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:52:40.776 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:52:40.776 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:52:40.776 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:52:40.776 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:52:40.776 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:52:40.776 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:52:40.776 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:52:40.776 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:52:40.776 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:40.776 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:40.777 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:52:40.777 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:52:40.777 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:52:40.777 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:52:40.777 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:52:40.777 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:52:40.777 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:52:40.777 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:52:40.777 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:52:40.777 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:52:40.777 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:52:40.777 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:52:40.777 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:52:40.778 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:52:40.778 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:52:40.778 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:52:40.778 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:52:40.778 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:52:40.778 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:52:40.778 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:52:40.778 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:52:40.778 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:52:40.778 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:52:40.778 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:52:40.778 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:52:40.778 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:52:40.779 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:52:40.779 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:52:40.779 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:40.779 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:52:40.779 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:40.779 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:52:40.779 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:40.779 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:52:40.779 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:52:40.779 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:52:40.779 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:52:40.779 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:40.779 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:52:40.779 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:52:40.780 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:40.780 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:40.780 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:40.780 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:52:40.780 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:52:40.780 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:40.780 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:40.780 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:40.780 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:40.780 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:52:40.780 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:52:40.780 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:52:40.780 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:52:40.780 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:52:40.781 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:40.781 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:40.781 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:52:40.781 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:52:40.781 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:52:40.781 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:52:40.781 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:40.781 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:52:40.781 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:52:40.781 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:40.781 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:40.781 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:40.781 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:52:40.781 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:52:40.782 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:40.782 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:40.782 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:40.782 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:40.782 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:52:40.782 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:52:40.782 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:52:40.782 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:52:40.782 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:52:40.782 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:40.782 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:40.782 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:52:40.782 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:52:40.783 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:52:40.783 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:52:40.783 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:40.783 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:52:40.783 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:52:40.783 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:40.783 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:40.783 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:40.783 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:52:40.783 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:52:40.783 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:40.783 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:40.783 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:40.784 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:40.784 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:52:40.784 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:52:40.784 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:52:40.784 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:52:40.784 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:52:40.784 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:40.784 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:40.784 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:40.784 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:52:40.784 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:52:40.784 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:40.784 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:52:40.784 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:40.785 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:52:40.785 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:40.785 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:40.785 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:52:40.785 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:40.785 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:52:40.785 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:40.785 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:52:40.785 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:40.785 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:40.785 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:40.785 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:52:40.785 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:52:40.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.774+0000 7f182ea00640 1 -- 172.21.15.8:0/3980700809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1838145e00 msgr2=0x7f18381ee080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:40.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.774+0000 7f182ea00640 1 --2- 172.21.15.8:0/3980700809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1838145e00 0x7f18381ee080 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f182800f580 tx=0x7f1828004740 comp rx=0 tx=0).stop 2024-03-23T23:52:40.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.774+0000 7f182ea00640 1 -- 172.21.15.8:0/3980700809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1838145e00 msgr2=0x7f18381ee080 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:52:40.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.774+0000 7f182ea00640 1 --2- 172.21.15.8:0/3980700809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1838145e00 0x7f18381ee080 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f182800f580 tx=0x7f1828004740 comp rx=0 tx=0).stop 2024-03-23T23:52:40.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.774+0000 7f183ce00640 1 -- 172.21.15.8:0/3980700809 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f181406fef0 msgr2=0x7f18140723b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:40.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.774+0000 7f183ce00640 1 --2- 172.21.15.8:0/3980700809 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f181406fef0 0x7f18140723b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f18300af000 tx=0x7f18300a7070 comp rx=0 tx=0).stop 2024-03-23T23:52:40.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.774+0000 7f1836800640 1 -- 172.21.15.8:0/3980700809 reap_dead start 2024-03-23T23:52:40.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.774+0000 7f183ce00640 1 -- 172.21.15.8:0/3980700809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18380c4160 msgr2=0x7f183814ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:40.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.774+0000 7f183ce00640 1 --2- 172.21.15.8:0/3980700809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18380c4160 0x7f183814ee20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f182000c430 tx=0x7f182000c8f0 comp rx=0 tx=0).stop 2024-03-23T23:52:40.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.774+0000 7f183ce00640 1 -- 172.21.15.8:0/3980700809 shutdown_connections 2024-03-23T23:52:40.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.774+0000 7f183ce00640 1 --2- 172.21.15.8:0/3980700809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18380c4160 0x7f183814ee20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:40.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.774+0000 7f183ce00640 1 -- 172.21.15.8:0/3980700809 >> 172.21.15.8:0/3980700809 conn(0x7f183806b170 msgr2=0x7f183815c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:40.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.774+0000 7f183ce00640 1 -- 172.21.15.8:0/3980700809 shutdown_connections 2024-03-23T23:52:40.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:40.774+0000 7f183ce00640 1 -- 172.21.15.8:0/3980700809 wait complete. 2024-03-23T23:52:40.819 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:52:40.819 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T23:52:40.819 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:52:41.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.122+0000 7f783ce00640 1 Processor -- start 2024-03-23T23:52:41.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.122+0000 7f783ce00640 1 -- start start 2024-03-23T23:52:41.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.122+0000 7f783ce00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7838157790 0x7f78380c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:41.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.122+0000 7f783ce00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7838073260 0x7f783815d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.122+0000 7f783ce00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7838073680 con 0x7f78380c3f60 2024-03-23T23:52:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.122+0000 7f783ce00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78380c2af0 con 0x7f7838157790 2024-03-23T23:52:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.122+0000 7f783ce00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78380711c0 con 0x7f7838073260 2024-03-23T23:52:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.126+0000 7f7835400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7838157790 0x7f78380c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:41.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.126+0000 7f7835400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7838157790 0x7f78380c34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40218/0 (socket says 172.21.15.8:40218) 2024-03-23T23:52:41.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.126+0000 7f7835400640 1 -- 172.21.15.8:0/2604966961 learned_addr learned my addr 172.21.15.8:0/2604966961 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:52:41.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.130+0000 7f7835400640 1 -- 172.21.15.8:0/2604966961 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7838073260 msgr2=0x7f783815d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:52:41.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.130+0000 7f7835400640 1 --2- 172.21.15.8:0/2604966961 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7838073260 0x7f783815d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:41.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.130+0000 7f7835400640 1 -- 172.21.15.8:0/2604966961 >> v1:172.21.15.196:6789/0 conn(0x7f78380c3f60 legacy=0x7f7838157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:52:41.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.130+0000 7f7835400640 1 -- 172.21.15.8:0/2604966961 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78380714a0 con 0x7f7838157790 2024-03-23T23:52:41.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.142+0000 7f7835400640 1 --2- 172.21.15.8:0/2604966961 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7838157790 0x7f78380c34d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7824009870 tx=0x7f782401c220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=713f49529ed225c1 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:41.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.142+0000 7f7834a00640 1 -- 172.21.15.8:0/2604966961 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78240b0070 con 0x7f7838157790 2024-03-23T23:52:41.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.142+0000 7f7834a00640 1 -- 172.21.15.8:0/2604966961 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78240ab600 con 0x7f7838157790 2024-03-23T23:52:41.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.142+0000 7f7834a00640 1 -- 172.21.15.8:0/2604966961 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78240ab9d0 con 0x7f7838157790 2024-03-23T23:52:41.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.142+0000 7f783ce00640 1 -- 172.21.15.8:0/2604966961 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7838157790 msgr2=0x7f78380c34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:41.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.142+0000 7f783ce00640 1 --2- 172.21.15.8:0/2604966961 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7838157790 0x7f78380c34d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7824009870 tx=0x7f782401c220 comp rx=0 tx=0).stop 2024-03-23T23:52:41.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.142+0000 7f783ce00640 1 -- 172.21.15.8:0/2604966961 shutdown_connections 2024-03-23T23:52:41.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.142+0000 7f783ce00640 1 --2- 172.21.15.8:0/2604966961 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7838073260 0x7f783815d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:41.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.142+0000 7f783ce00640 1 --2- 172.21.15.8:0/2604966961 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7838157790 0x7f78380c34d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:41.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.142+0000 7f783ce00640 1 -- 172.21.15.8:0/2604966961 >> 172.21.15.8:0/2604966961 conn(0x7f78380a9870 msgr2=0x7f783806b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:41.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.142+0000 7f783ce00640 1 -- 172.21.15.8:0/2604966961 shutdown_connections 2024-03-23T23:52:41.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.142+0000 7f783ce00640 1 -- 172.21.15.8:0/2604966961 wait complete. 2024-03-23T23:52:41.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.146+0000 7f783ce00640 1 Processor -- start 2024-03-23T23:52:41.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.146+0000 7f783ce00640 1 -- start start 2024-03-23T23:52:41.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.146+0000 7f783ce00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7838073260 0x7f783814af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:41.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.146+0000 7f783ce00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78380c3f60 0x7f78381463a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:41.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.146+0000 7f783ce00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78380ad090 0x7f78381468e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:41.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.146+0000 7f783ce00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78381666a0 con 0x7f78380c3f60 2024-03-23T23:52:41.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.146+0000 7f783ce00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78380c4550 con 0x7f78380ad090 2024-03-23T23:52:41.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.146+0000 7f783ce00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7838166820 con 0x7f7838073260 2024-03-23T23:52:41.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.150+0000 7f7835e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7838073260 0x7f783814af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:41.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.150+0000 7f7835e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7838073260 0x7f783814af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:35884/0 (socket says 172.21.15.8:35884) 2024-03-23T23:52:41.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.150+0000 7f7835e00640 1 -- 172.21.15.8:0/1828368163 learned_addr learned my addr 172.21.15.8:0/1828368163 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:52:41.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.150+0000 7f7836800640 1 --2- 172.21.15.8:0/1828368163 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78380ad090 0x7f78381468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:41.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.154+0000 7f7835e00640 1 -- 172.21.15.8:0/1828368163 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78380ad090 msgr2=0x7f78381468e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:41.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.154+0000 7f7835e00640 1 --2- 172.21.15.8:0/1828368163 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78380ad090 0x7f78381468e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:41.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.154+0000 7f7835e00640 1 -- 172.21.15.8:0/1828368163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78380c3f60 msgr2=0x7f78381463a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:41.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.154+0000 7f7835e00640 1 --2- 172.21.15.8:0/1828368163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78380c3f60 0x7f78381463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:41.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.154+0000 7f7835e00640 1 -- 172.21.15.8:0/1828368163 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78381f5930 con 0x7f7838073260 2024-03-23T23:52:41.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.158+0000 7f7835e00640 1 --2- 172.21.15.8:0/1828368163 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7838073260 0x7f783814af50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f782800b410 tx=0x7f782800b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:41.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.158+0000 7f782e000640 1 -- 172.21.15.8:0/1828368163 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7828015020 con 0x7f7838073260 2024-03-23T23:52:41.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.162+0000 7f782e000640 1 -- 172.21.15.8:0/1828368163 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7828011830 con 0x7f7838073260 2024-03-23T23:52:41.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.162+0000 7f782e000640 1 -- 172.21.15.8:0/1828368163 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7828011c20 con 0x7f7838073260 2024-03-23T23:52:41.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.162+0000 7f783ce00640 1 -- 172.21.15.8:0/1828368163 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78381f5c10 con 0x7f7838073260 2024-03-23T23:52:41.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.162+0000 7f783ce00640 1 -- 172.21.15.8:0/1828368163 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78381f61d0 con 0x7f7838073260 2024-03-23T23:52:41.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.162+0000 7f783ce00640 1 --2- 172.21.15.8:0/1828368163 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7838150660 0x7f78381486c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:41.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.162+0000 7f783ce00640 1 -- 172.21.15.8:0/1828368163 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78381f6820 con 0x7f7838150660 2024-03-23T23:52:41.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.170+0000 7f7835400640 1 --2- 172.21.15.8:0/1828368163 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7838150660 0x7f78381486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:41.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.174+0000 7f782e000640 1 -- 172.21.15.8:0/1828368163 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f7828018020 con 0x7f7838073260 2024-03-23T23:52:41.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.174+0000 7f782e000640 1 --2- 172.21.15.8:0/1828368163 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7818067760 0x7f7818069c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:41.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.174+0000 7f782e000640 1 -- 172.21.15.8:0/1828368163 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f7828085b20 con 0x7f7838073260 2024-03-23T23:52:41.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.178+0000 7f7836800640 1 --2- 172.21.15.8:0/1828368163 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7818067760 0x7f7818069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:41.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.178+0000 7f7835400640 1 -- 172.21.15.8:0/1828368163 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7838068270 con 0x7f7838150660 2024-03-23T23:52:41.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.182+0000 7f7835400640 1 --2- 172.21.15.8:0/1828368163 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7838150660 0x7f78381486c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f78380a9cc0 tx=0x7f78240abaa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:41.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.182+0000 7f7836800640 1 --2- 172.21.15.8:0/1828368163 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7818067760 0x7f7818069c20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7838146e20 tx=0x7f7830009410 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:41.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.190+0000 7f782e000640 1 -- 172.21.15.8:0/1828368163 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78240b9020 con 0x7f7838150660 2024-03-23T23:52:41.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.190+0000 7f782e000640 1 -- 172.21.15.8:0/1828368163 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f78240b1040 con 0x7f7838150660 2024-03-23T23:52:41.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.190+0000 7f782e000640 1 -- 172.21.15.8:0/1828368163 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7838150660 msgr2=0x7f78381486c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:41.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.190+0000 7f782e000640 1 --2- 172.21.15.8:0/1828368163 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7838150660 0x7f78381486c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f78380a9cc0 tx=0x7f78240abaa0 comp rx=0 tx=0).stop 2024-03-23T23:52:41.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.190+0000 7f782e000640 1 -- 172.21.15.8:0/1828368163 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7838150660 msgr2=0x7f78381486c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:52:41.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.190+0000 7f782e000640 1 --2- 172.21.15.8:0/1828368163 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7838150660 0x7f78381486c0 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f78380a9cc0 tx=0x7f78240abaa0 comp rx=0 tx=0).stop 2024-03-23T23:52:41.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.202+0000 7f783ce00640 1 --2- 172.21.15.8:0/1828368163 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78381f63a0 0x7f7838148c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:41.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.202+0000 7f783ce00640 1 -- 172.21.15.8:0/1828368163 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7838151120 con 0x7f78381f63a0 2024-03-23T23:52:41.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.206+0000 7f7835400640 1 --2- 172.21.15.8:0/1828368163 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78381f63a0 0x7f7838148c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:41.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.210+0000 7f7835400640 1 -- 172.21.15.8:0/1828368163 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f783814b490 con 0x7f78381f63a0 2024-03-23T23:52:41.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.210+0000 7f7835400640 1 --2- 172.21.15.8:0/1828368163 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78381f63a0 0x7f7838148c00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7824009870 tx=0x7f78240a8000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:41.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.210+0000 7f782e000640 1 -- 172.21.15.8:0/1828368163 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78240b9040 con 0x7f78381f63a0 2024-03-23T23:52:41.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.218+0000 7f782e000640 1 -- 172.21.15.8:0/1828368163 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5012 (secure 0 0 0) 0x7f7824009490 con 0x7f78381f63a0 2024-03-23T23:52:41.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.218+0000 7f782e000640 1 -- 172.21.15.8:0/1828368163 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78381f63a0 msgr2=0x7f7838148c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:41.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.218+0000 7f782e000640 1 --2- 172.21.15.8:0/1828368163 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78381f63a0 0x7f7838148c00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7824009870 tx=0x7f78240a8000 comp rx=0 tx=0).stop 2024-03-23T23:52:41.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.218+0000 7f782e000640 1 -- 172.21.15.8:0/1828368163 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78381f63a0 msgr2=0x7f7838148c00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:52:41.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.218+0000 7f782e000640 1 --2- 172.21.15.8:0/1828368163 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78381f63a0 0x7f7838148c00 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7824009870 tx=0x7f78240a8000 comp rx=0 tx=0).stop 2024-03-23T23:52:41.219 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:52:41.220 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:52:41.220 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:52:41.220 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:52:41.220 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 78, 2024-03-23T23:52:41.220 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:52:41.220 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:52:41.220 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:52:41.220 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:52:41.220 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:41.220 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 4, 2024-03-23T23:52:41.220 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:52:41.220 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:52:41.221 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:52:41.221 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:52:41.221 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:52:41.221 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:52:41.221 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:52:41.221 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:52:41.221 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:52:41.221 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:52:41.221 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:52:41.221 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:52:41.221 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:52:41.221 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:52:41.222 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:41.222 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:52:41.222 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:52:41.222 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:52:41.222 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:52:41.222 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:52:41.222 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:52:41.222 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:52:41.222 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:52:41.222 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:52:41.222 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:52:41.222 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:52:41.222 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:52:41.223 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:52:41.223 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:41.223 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:41.223 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:52:41.223 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:52:41.223 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:52:41.223 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:52:41.223 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:52:41.223 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:52:41.223 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:52:41.223 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:52:41.223 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:52:41.223 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:52:41.224 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:52:41.224 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:52:41.224 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:52:41.224 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:52:41.224 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:52:41.224 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:52:41.224 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:52:41.224 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:52:41.224 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:52:41.224 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:52:41.224 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:52:41.224 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:52:41.224 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:52:41.225 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:52:41.225 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:52:41.225 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:52:41.225 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:52:41.225 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:52:41.225 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:41.225 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:52:41.225 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:41.225 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:52:41.225 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:41.225 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:52:41.225 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:52:41.225 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:52:41.225 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:52:41.226 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:41.226 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:52:41.226 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:52:41.226 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:41.226 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:41.226 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:41.226 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:52:41.226 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:52:41.226 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:41.226 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:41.226 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:41.226 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:41.226 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:52:41.227 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:52:41.227 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:52:41.227 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:52:41.227 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:52:41.227 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:41.227 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:41.227 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:52:41.227 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:52:41.227 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:52:41.227 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:52:41.227 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:41.227 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:52:41.227 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:52:41.227 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:41.228 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:41.228 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:41.228 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:52:41.228 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:52:41.228 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:41.228 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:41.228 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:41.228 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:41.228 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:52:41.228 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:52:41.228 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:52:41.228 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:52:41.228 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:52:41.229 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:41.229 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:41.229 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:52:41.229 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:52:41.229 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:52:41.229 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:52:41.229 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:41.229 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:52:41.229 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:52:41.229 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:41.229 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:41.229 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:41.229 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:52:41.229 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:52:41.230 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:41.230 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:41.230 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:41.230 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:41.230 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:52:41.230 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:52:41.230 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:52:41.230 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:52:41.230 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:52:41.230 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:41.230 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:41.230 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:41.230 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:52:41.231 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:52:41.231 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:41.231 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:52:41.231 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:41.231 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:52:41.231 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:41.231 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:41.231 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:52:41.231 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:41.231 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:52:41.231 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:41.231 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:52:41.233 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:41.233 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:41.233 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:52:41.233 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:41.233 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:52:41.233 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:41.233 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:52:41.233 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:41.233 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:41.234 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:52:41.234 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:41.234 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:52:41.234 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:41.234 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:52:41.234 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:41.234 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:41.234 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:52:41.234 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:41.234 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:52:41.234 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:41.234 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:41.234 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:41.235 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:52:41.235 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:52:41.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.222+0000 7f783ce00640 1 -- 172.21.15.8:0/1828368163 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7818067760 msgr2=0x7f7818069c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:41.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.222+0000 7f783ce00640 1 --2- 172.21.15.8:0/1828368163 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7818067760 0x7f7818069c20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7838146e20 tx=0x7f7830009410 comp rx=0 tx=0).stop 2024-03-23T23:52:41.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.222+0000 7f783ce00640 1 -- 172.21.15.8:0/1828368163 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7838073260 msgr2=0x7f783814af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:41.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.222+0000 7f783ce00640 1 --2- 172.21.15.8:0/1828368163 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7838073260 0x7f783814af50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f782800b410 tx=0x7f782800b8d0 comp rx=0 tx=0).stop 2024-03-23T23:52:41.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.222+0000 7f7836800640 1 -- 172.21.15.8:0/1828368163 reap_dead start 2024-03-23T23:52:41.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.222+0000 7f7836800640 1 -- 172.21.15.8:0/1828368163 reap_dead start 2024-03-23T23:52:41.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.222+0000 7f783ce00640 1 -- 172.21.15.8:0/1828368163 shutdown_connections 2024-03-23T23:52:41.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.222+0000 7f783ce00640 1 -- 172.21.15.8:0/1828368163 >> 172.21.15.8:0/1828368163 conn(0x7f78380a9870 msgr2=0x7f7838147a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:41.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.230+0000 7f783ce00640 1 -- 172.21.15.8:0/1828368163 shutdown_connections 2024-03-23T23:52:41.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.230+0000 7f783ce00640 1 -- 172.21.15.8:0/1828368163 wait complete. 2024-03-23T23:52:41.302 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:52:41.302 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T23:52:41.302 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:52:41.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.542+0000 7fba19400640 1 Processor -- start 2024-03-23T23:52:41.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.542+0000 7fba19400640 1 -- start start 2024-03-23T23:52:41.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.542+0000 7fba19400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba14156ee0 0x7fba14073230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:41.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.542+0000 7fba19400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fba14149bd0 0x7fba1414a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:41.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.542+0000 7fba19400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba14073770 con 0x7fba140ac270 2024-03-23T23:52:41.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.542+0000 7fba19400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba140aa390 con 0x7fba14149bd0 2024-03-23T23:52:41.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.542+0000 7fba19400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1406e720 con 0x7fba14156ee0 2024-03-23T23:52:41.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.542+0000 7fba11e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fba14149bd0 0x7fba1414a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:41.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.542+0000 7fba12800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba14156ee0 0x7fba14073230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:41.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.542+0000 7fba11e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fba14149bd0 0x7fba1414a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40238/0 (socket says 172.21.15.8:40238) 2024-03-23T23:52:41.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.542+0000 7fba11e00640 1 -- 172.21.15.8:0/48675644 learned_addr learned my addr 172.21.15.8:0/48675644 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:52:41.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.546+0000 7fba11e00640 1 -- 172.21.15.8:0/48675644 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba14156ee0 msgr2=0x7fba14073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:52:41.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.546+0000 7fba11e00640 1 --2- 172.21.15.8:0/48675644 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba14156ee0 0x7fba14073230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:41.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.546+0000 7fba11e00640 1 -- 172.21.15.8:0/48675644 >> v1:172.21.15.196:6789/0 conn(0x7fba140ac270 legacy=0x7fba140ac6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:52:41.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.546+0000 7fba11e00640 1 -- 172.21.15.8:0/48675644 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1406ea00 con 0x7fba14149bd0 2024-03-23T23:52:41.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.546+0000 7fba11e00640 1 --2- 172.21.15.8:0/48675644 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba14149bd0 0x7fba1414a030 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fba00009870 tx=0x7fba0001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ead5abf738c8a90 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:41.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.546+0000 7fba11400640 1 -- 172.21.15.8:0/48675644 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba000ab620 con 0x7fba14149bd0 2024-03-23T23:52:41.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.550+0000 7fba11400640 1 -- 172.21.15.8:0/48675644 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba000b0070 con 0x7fba14149bd0 2024-03-23T23:52:41.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.550+0000 7fba11400640 1 -- 172.21.15.8:0/48675644 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba000ab9e0 con 0x7fba14149bd0 2024-03-23T23:52:41.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.550+0000 7fba19400640 1 -- 172.21.15.8:0/48675644 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba14149bd0 msgr2=0x7fba1414a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:41.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.550+0000 7fba19400640 1 --2- 172.21.15.8:0/48675644 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba14149bd0 0x7fba1414a030 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fba00009870 tx=0x7fba0001c460 comp rx=0 tx=0).stop 2024-03-23T23:52:41.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.550+0000 7fba19400640 1 -- 172.21.15.8:0/48675644 shutdown_connections 2024-03-23T23:52:41.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.550+0000 7fba19400640 1 --2- 172.21.15.8:0/48675644 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba14149bd0 0x7fba1414a030 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:41.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.550+0000 7fba19400640 1 --2- 172.21.15.8:0/48675644 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba14156ee0 0x7fba14073230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:41.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.550+0000 7fba19400640 1 -- 172.21.15.8:0/48675644 >> 172.21.15.8:0/48675644 conn(0x7fba1406b170 msgr2=0x7fba1406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:41.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.550+0000 7fba19400640 1 -- 172.21.15.8:0/48675644 shutdown_connections 2024-03-23T23:52:41.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.550+0000 7fba19400640 1 -- 172.21.15.8:0/48675644 wait complete. 2024-03-23T23:52:41.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.550+0000 7fba19400640 1 Processor -- start 2024-03-23T23:52:41.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.550+0000 7fba19400640 1 -- start start 2024-03-23T23:52:41.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.554+0000 7fba19400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba140ac270 0x7fba14146b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:41.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.554+0000 7fba19400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba14149bd0 0x7fba14150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:41.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.554+0000 7fba19400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba14156ee0 0x7fba14150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:41.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.554+0000 7fba19400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba14157870 con 0x7fba140ac270 2024-03-23T23:52:41.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.554+0000 7fba19400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1414a570 con 0x7fba14149bd0 2024-03-23T23:52:41.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.554+0000 7fba19400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba141579f0 con 0x7fba14156ee0 2024-03-23T23:52:41.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.554+0000 7fba12800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba140ac270 0x7fba14146b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:41.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.554+0000 7fba12800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba140ac270 0x7fba14146b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40250/0 (socket says 172.21.15.8:40250) 2024-03-23T23:52:41.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.554+0000 7fba12800640 1 -- 172.21.15.8:0/1958645567 learned_addr learned my addr 172.21.15.8:0/1958645567 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:52:41.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.554+0000 7fba13200640 1 --2- 172.21.15.8:0/1958645567 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba14156ee0 0x7fba14150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:41.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.554+0000 7fba11e00640 1 --2- 172.21.15.8:0/1958645567 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba14149bd0 0x7fba14150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:41.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.554+0000 7fba12800640 1 -- 172.21.15.8:0/1958645567 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba14156ee0 msgr2=0x7fba14150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:41.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.554+0000 7fba12800640 1 --2- 172.21.15.8:0/1958645567 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba14156ee0 0x7fba14150890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:41.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.554+0000 7fba12800640 1 -- 172.21.15.8:0/1958645567 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba14149bd0 msgr2=0x7fba14150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:41.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.554+0000 7fba12800640 1 --2- 172.21.15.8:0/1958645567 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba14149bd0 0x7fba14150350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:41.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.554+0000 7fba12800640 1 -- 172.21.15.8:0/1958645567 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba14153940 con 0x7fba140ac270 2024-03-23T23:52:41.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.554+0000 7fba13200640 1 --2- 172.21.15.8:0/1958645567 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba14156ee0 0x7fba14150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:52:41.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.554+0000 7fba12800640 1 --2- 172.21.15.8:0/1958645567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba140ac270 0x7fba14146b50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fba0400d800 tx=0x7fba0400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:41.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.554+0000 7fba0aa00640 1 -- 172.21.15.8:0/1958645567 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0400b6c0 con 0x7fba140ac270 2024-03-23T23:52:41.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.554+0000 7fba0aa00640 1 -- 172.21.15.8:0/1958645567 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba04019070 con 0x7fba140ac270 2024-03-23T23:52:41.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.554+0000 7fba0aa00640 1 -- 172.21.15.8:0/1958645567 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0400ba60 con 0x7fba140ac270 2024-03-23T23:52:41.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.554+0000 7fba19400640 1 -- 172.21.15.8:0/1958645567 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba14153c20 con 0x7fba140ac270 2024-03-23T23:52:41.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.554+0000 7fba19400640 1 -- 172.21.15.8:0/1958645567 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba141541e0 con 0x7fba140ac270 2024-03-23T23:52:41.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.558+0000 7fba19400640 1 --2- 172.21.15.8:0/1958645567 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba14142960 0x7fba14142d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:41.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.558+0000 7fba19400640 1 -- 172.21.15.8:0/1958645567 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba14068270 con 0x7fba14142960 2024-03-23T23:52:41.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.558+0000 7fba11e00640 1 --2- 172.21.15.8:0/1958645567 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba14142960 0x7fba14142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:41.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.558+0000 7fba0aa00640 1 -- 172.21.15.8:0/1958645567 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fba0400bc00 con 0x7fba140ac270 2024-03-23T23:52:41.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.558+0000 7fba0aa00640 1 --2- 172.21.15.8:0/1958645567 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb9f4067660 0x7fb9f4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:41.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.558+0000 7fba0aa00640 1 -- 172.21.15.8:0/1958645567 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fba04086170 con 0x7fba140ac270 2024-03-23T23:52:41.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.562+0000 7fba13200640 1 --2- 172.21.15.8:0/1958645567 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb9f4067660 0x7fb9f4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:41.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.562+0000 7fba11e00640 1 -- 172.21.15.8:0/1958645567 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fba14154860 con 0x7fba14142960 2024-03-23T23:52:41.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.562+0000 7fba13200640 1 --2- 172.21.15.8:0/1958645567 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb9f4067660 0x7fb9f4069b20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fba0c009f40 tx=0x7fba0c0094d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:41.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.566+0000 7fba11e00640 1 --2- 172.21.15.8:0/1958645567 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba14142960 0x7fba14142d40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fba1406f680 tx=0x7fba00019200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:41.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.574+0000 7fba0aa00640 1 -- 172.21.15.8:0/1958645567 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba000ba070 con 0x7fba14142960 2024-03-23T23:52:41.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.578+0000 7fba0aa00640 1 -- 172.21.15.8:0/1958645567 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fba000b0040 con 0x7fba14142960 2024-03-23T23:52:41.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.578+0000 7fba0aa00640 1 -- 172.21.15.8:0/1958645567 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba14142960 msgr2=0x7fba14142d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:41.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.578+0000 7fba0aa00640 1 --2- 172.21.15.8:0/1958645567 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba14142960 0x7fba14142d40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fba1406f680 tx=0x7fba00019200 comp rx=0 tx=0).stop 2024-03-23T23:52:41.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.578+0000 7fba0aa00640 1 -- 172.21.15.8:0/1958645567 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba14142960 msgr2=0x7fba14142d40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:52:41.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.578+0000 7fba0aa00640 1 --2- 172.21.15.8:0/1958645567 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba14142960 0x7fba14142d40 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fba1406f680 tx=0x7fba00019200 comp rx=0 tx=0).stop 2024-03-23T23:52:41.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.586+0000 7fba19400640 1 --2- 172.21.15.8:0/1958645567 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba141f1800 0x7fba141f1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:41.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.586+0000 7fba19400640 1 -- 172.21.15.8:0/1958645567 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba140c1b70 con 0x7fba141f1800 2024-03-23T23:52:41.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.594+0000 7fba11e00640 1 --2- 172.21.15.8:0/1958645567 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba141f1800 0x7fba141f1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:41.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.602+0000 7fba11e00640 1 -- 172.21.15.8:0/1958645567 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fba14067090 con 0x7fba141f1800 2024-03-23T23:52:41.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.606+0000 7fba11e00640 1 --2- 172.21.15.8:0/1958645567 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba141f1800 0x7fba141f1be0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fba0001c4a0 tx=0x7fba00009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:41.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.606+0000 7fba0aa00640 1 -- 172.21.15.8:0/1958645567 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba000c9070 con 0x7fba141f1800 2024-03-23T23:52:41.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.610+0000 7fba0aa00640 1 -- 172.21.15.8:0/1958645567 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5182 (secure 0 0 0) 0x7fba000c5670 con 0x7fba141f1800 2024-03-23T23:52:41.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.610+0000 7fba0aa00640 1 -- 172.21.15.8:0/1958645567 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba141f1800 msgr2=0x7fba141f1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:41.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.610+0000 7fba0aa00640 1 --2- 172.21.15.8:0/1958645567 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba141f1800 0x7fba141f1be0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fba0001c4a0 tx=0x7fba00009240 comp rx=0 tx=0).stop 2024-03-23T23:52:41.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.610+0000 7fba0aa00640 1 -- 172.21.15.8:0/1958645567 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba141f1800 msgr2=0x7fba141f1be0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:52:41.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.610+0000 7fba0aa00640 1 --2- 172.21.15.8:0/1958645567 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba141f1800 0x7fba141f1be0 secure :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fba0001c4a0 tx=0x7fba00009240 comp rx=0 tx=0).stop 2024-03-23T23:52:41.610 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:52:41.610 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:52:41.610 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:52:41.610 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:52:41.610 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 78, 2024-03-23T23:52:41.610 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:52:41.610 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:52:41.610 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:52:41.610 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:52:41.610 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:41.611 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 4, 2024-03-23T23:52:41.611 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:52:41.611 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:52:41.611 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:52:41.611 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:52:41.611 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:52:41.611 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:52:41.611 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:52:41.611 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:52:41.611 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:52:41.611 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:52:41.611 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:52:41.612 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:52:41.612 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:52:41.612 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:52:41.612 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:41.612 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:52:41.612 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:52:41.612 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:52:41.612 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:52:41.612 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:52:41.612 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:52:41.613 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:52:41.613 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:52:41.613 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:52:41.613 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:52:41.613 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:52:41.613 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:52:41.613 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:52:41.613 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:41.613 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:41.613 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:52:41.613 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:52:41.613 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:52:41.613 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:52:41.613 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:52:41.614 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:52:41.614 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:52:41.614 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:52:41.614 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:52:41.614 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:52:41.614 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:52:41.614 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:52:41.614 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:52:41.614 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:52:41.614 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:52:41.614 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:52:41.614 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:52:41.614 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:52:41.615 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:52:41.615 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:52:41.615 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:52:41.615 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:52:41.615 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:52:41.615 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:52:41.615 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:52:41.615 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:52:41.615 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:52:41.615 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:52:41.615 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:41.615 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:52:41.615 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:41.616 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:52:41.616 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:41.616 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:52:41.616 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:52:41.616 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:52:41.616 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:52:41.616 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:41.616 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:52:41.616 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:52:41.616 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:41.616 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:41.616 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:41.616 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:52:41.616 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:52:41.617 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:41.617 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:41.617 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:41.617 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:41.617 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:52:41.617 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:52:41.617 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:52:41.617 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:52:41.617 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:52:41.617 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:41.617 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:41.617 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:52:41.617 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:52:41.618 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:52:41.618 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:52:41.618 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:41.618 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:52:41.618 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:52:41.618 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:41.618 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:41.618 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:41.618 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:52:41.618 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:52:41.618 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:41.618 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:41.618 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:41.619 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:41.619 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:52:41.619 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:52:41.619 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:52:41.619 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:52:41.619 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:52:41.619 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:41.619 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:41.619 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:52:41.619 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:52:41.619 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:52:41.619 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:52:41.619 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:41.619 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:52:41.620 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:52:41.620 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:41.620 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:41.620 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:41.620 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:52:41.620 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:52:41.620 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:41.620 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:41.620 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:41.620 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:41.620 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:52:41.621 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:52:41.621 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:52:41.621 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:52:41.621 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:52:41.621 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:41.621 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:41.621 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:41.621 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:52:41.621 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:52:41.621 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:41.621 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:52:41.621 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:41.622 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:52:41.622 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:41.622 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:41.622 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:52:41.622 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:41.622 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:52:41.622 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:41.622 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:52:41.622 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:41.622 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:41.622 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:52:41.622 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:41.623 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:52:41.623 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:41.623 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5 2024-03-23T23:52:41.623 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:41.623 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:41.623 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:52:41.623 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:41.623 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:52:41.623 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:41.623 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:52:41.623 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:41.623 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:41.623 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:52:41.624 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:41.624 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:52:41.624 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:41.624 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:41.624 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:52:41.624 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:41.624 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:52:41.624 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:41.624 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:52:41.624 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:41.624 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:41.624 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:41.625 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:52:41.625 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:52:41.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.610+0000 7fba19400640 1 -- 172.21.15.8:0/1958645567 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb9f4067660 msgr2=0x7fb9f4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:41.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.610+0000 7fba19400640 1 --2- 172.21.15.8:0/1958645567 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb9f4067660 0x7fb9f4069b20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fba0c009f40 tx=0x7fba0c0094d0 comp rx=0 tx=0).stop 2024-03-23T23:52:41.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.610+0000 7fba19400640 1 -- 172.21.15.8:0/1958645567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba140ac270 msgr2=0x7fba14146b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:41.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.610+0000 7fba19400640 1 --2- 172.21.15.8:0/1958645567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba140ac270 0x7fba14146b50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fba0400d800 tx=0x7fba0400dcc0 comp rx=0 tx=0).stop 2024-03-23T23:52:41.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.610+0000 7fba13200640 1 -- 172.21.15.8:0/1958645567 reap_dead start 2024-03-23T23:52:41.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.610+0000 7fba13200640 1 -- 172.21.15.8:0/1958645567 reap_dead start 2024-03-23T23:52:41.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.610+0000 7fba19400640 1 -- 172.21.15.8:0/1958645567 shutdown_connections 2024-03-23T23:52:41.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.610+0000 7fba19400640 1 -- 172.21.15.8:0/1958645567 >> 172.21.15.8:0/1958645567 conn(0x7fba1406b170 msgr2=0x7fba14156000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:41.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.610+0000 7fba19400640 1 -- 172.21.15.8:0/1958645567 shutdown_connections 2024-03-23T23:52:41.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.610+0000 7fba19400640 1 -- 172.21.15.8:0/1958645567 wait complete. 2024-03-23T23:52:41.639 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:52:41.639 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-03-23T23:52:41.639 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-03-23T23:52:41.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.914+0000 7fd7f7e00640 1 Processor -- start 2024-03-23T23:52:41.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.914+0000 7fd7f7e00640 1 -- start start 2024-03-23T23:52:41.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.918+0000 7fd7f7e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd7f00dbc50 0x7fd7f00dc030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:41.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.918+0000 7fd7f7e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd7f000b290 0x7fd7f00e28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:41.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.918+0000 7fd7f7e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f00dea40 con 0x7fd7f00070d0 2024-03-23T23:52:41.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.918+0000 7fd7f7e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7f00e2e20 con 0x7fd7f000b290 2024-03-23T23:52:41.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.918+0000 7fd7f7e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7f00477f0 con 0x7fd7f00dbc50 2024-03-23T23:52:41.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.922+0000 7fd7f6a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd7f00070d0 0x7fd7f00deef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:56900/0 (socket says 172.21.15.8:56900) 2024-03-23T23:52:41.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.922+0000 7fd7f5600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd7f000b290 0x7fd7f00e28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:41.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.922+0000 7fd7f5600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd7f000b290 0x7fd7f00e28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40252/0 (socket says 172.21.15.8:40252) 2024-03-23T23:52:41.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.922+0000 7fd7f5600640 1 -- 172.21.15.8:0/185487865 learned_addr learned my addr 172.21.15.8:0/185487865 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:52:41.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.922+0000 7fd7f6000640 1 --2- 172.21.15.8:0/185487865 >> v2:172.21.15.196:3300/0 conn(0x7fd7f00dbc50 0x7fd7f00dc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:41.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.922+0000 7fd7f4c00640 1 -- 172.21.15.8:0/185487865 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1106665014 0 0) 0x7fd7f00dea40 con 0x7fd7f00070d0 2024-03-23T23:52:41.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.922+0000 7fd7f4c00640 1 -- 172.21.15.8:0/185487865 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7f80503a0 con 0x7fd7f00070d0 2024-03-23T23:52:41.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.926+0000 7fd7f6000640 1 -- 172.21.15.8:0/185487865 >> v2:172.21.15.8:3300/0 conn(0x7fd7f000b290 msgr2=0x7fd7f00e28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:52:41.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.926+0000 7fd7f6000640 1 --2- 172.21.15.8:0/185487865 >> v2:172.21.15.8:3300/0 conn(0x7fd7f000b290 0x7fd7f00e28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:41.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.926+0000 7fd7f6000640 1 -- 172.21.15.8:0/185487865 >> v1:172.21.15.8:6789/0 conn(0x7fd7f00070d0 legacy=0x7fd7f00deef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:41.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.926+0000 7fd7f6000640 1 -- 172.21.15.8:0/185487865 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f0047ad0 con 0x7fd7f00dbc50 2024-03-23T23:52:41.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.930+0000 7fd7f6000640 1 --2- 172.21.15.8:0/185487865 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7f00dbc50 0x7fd7f00dc030 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd7e40097c0 tx=0x7fd7e401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0eebd5c6fec26fb server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:41.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.934+0000 7fd7f4c00640 1 -- 172.21.15.8:0/185487865 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e40b0070 con 0x7fd7f00dbc50 2024-03-23T23:52:41.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.934+0000 7fd7f4c00640 1 -- 172.21.15.8:0/185487865 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e40ab600 con 0x7fd7f00dbc50 2024-03-23T23:52:41.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.934+0000 7fd7f4c00640 1 -- 172.21.15.8:0/185487865 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e40ab9d0 con 0x7fd7f00dbc50 2024-03-23T23:52:41.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.934+0000 7fd7f7e00640 1 -- 172.21.15.8:0/185487865 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7f00dbc50 msgr2=0x7fd7f00dc030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:41.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.934+0000 7fd7f7e00640 1 --2- 172.21.15.8:0/185487865 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7f00dbc50 0x7fd7f00dc030 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd7e40097c0 tx=0x7fd7e401c3c0 comp rx=0 tx=0).stop 2024-03-23T23:52:41.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.934+0000 7fd7f7e00640 1 -- 172.21.15.8:0/185487865 shutdown_connections 2024-03-23T23:52:41.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.934+0000 7fd7f7e00640 1 --2- 172.21.15.8:0/185487865 >> v2:172.21.15.8:3300/0 conn(0x7fd7f000b290 0x7fd7f00e28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:41.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.934+0000 7fd7f7e00640 1 --2- 172.21.15.8:0/185487865 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7f00dbc50 0x7fd7f00dc030 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:41.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.934+0000 7fd7f7e00640 1 -- 172.21.15.8:0/185487865 >> 172.21.15.8:0/185487865 conn(0x7fd7f0048430 msgr2=0x7fd7f0048840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:41.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.938+0000 7fd7f7e00640 1 -- 172.21.15.8:0/185487865 shutdown_connections 2024-03-23T23:52:41.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.938+0000 7fd7f7e00640 1 -- 172.21.15.8:0/185487865 wait complete. 2024-03-23T23:52:41.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.942+0000 7fd7f7e00640 1 Processor -- start 2024-03-23T23:52:41.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.942+0000 7fd7f7e00640 1 -- start start 2024-03-23T23:52:41.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.942+0000 7fd7f7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7f00070d0 0x7fd7f0040d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:41.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.942+0000 7fd7f7e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7f000b290 0x7fd7f00451f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:41.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.942+0000 7fd7f7e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7f00dbc50 0x7fd7f00dacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:41.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.942+0000 7fd7f7e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f00dfe20 con 0x7fd7f00070d0 2024-03-23T23:52:41.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.942+0000 7fd7f7e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f0007910 con 0x7fd7f000b290 2024-03-23T23:52:41.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.942+0000 7fd7f7e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f00ebad0 con 0x7fd7f00dbc50 2024-03-23T23:52:41.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.942+0000 7fd7f6000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7f00070d0 0x7fd7f0040d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:41.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.942+0000 7fd7f6000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7f00070d0 0x7fd7f0040d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40264/0 (socket says 172.21.15.8:40264) 2024-03-23T23:52:41.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.942+0000 7fd7f6000640 1 -- 172.21.15.8:0/373070833 learned_addr learned my addr 172.21.15.8:0/373070833 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:52:41.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.946+0000 7fd7f6000640 1 -- 172.21.15.8:0/373070833 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7f00dbc50 msgr2=0x7fd7f00dacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:41.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.946+0000 7fd7f6000640 1 --2- 172.21.15.8:0/373070833 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7f00dbc50 0x7fd7f00dacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:41.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.946+0000 7fd7f6000640 1 -- 172.21.15.8:0/373070833 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7f000b290 msgr2=0x7fd7f00451f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:41.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.946+0000 7fd7f6000640 1 --2- 172.21.15.8:0/373070833 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7f000b290 0x7fd7f00451f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:41.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.946+0000 7fd7f6000640 1 -- 172.21.15.8:0/373070833 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f00dda80 con 0x7fd7f00070d0 2024-03-23T23:52:41.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.946+0000 7fd7f6000640 1 --2- 172.21.15.8:0/373070833 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7f00070d0 0x7fd7f0040d30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4018fd0 tx=0x7fd7e4019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:41.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.946+0000 7fd7eea00640 1 -- 172.21.15.8:0/373070833 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e40b9070 con 0x7fd7f00070d0 2024-03-23T23:52:41.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.946+0000 7fd7eea00640 1 -- 172.21.15.8:0/373070833 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e40b5480 con 0x7fd7f00070d0 2024-03-23T23:52:41.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.946+0000 7fd7eea00640 1 -- 172.21.15.8:0/373070833 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e40b0040 con 0x7fd7f00070d0 2024-03-23T23:52:41.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.946+0000 7fd7f7e00640 1 -- 172.21.15.8:0/373070833 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f002ecd0 con 0x7fd7f00070d0 2024-03-23T23:52:41.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.950+0000 7fd7f7e00640 1 -- 172.21.15.8:0/373070833 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f002ef70 con 0x7fd7f00070d0 2024-03-23T23:52:41.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.950+0000 7fd7e3e00640 1 -- 172.21.15.8:0/373070833 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7cc0052a0 con 0x7fd7f00070d0 2024-03-23T23:52:41.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.954+0000 7fd7eea00640 1 -- 172.21.15.8:0/373070833 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd7e40bc070 con 0x7fd7f00070d0 2024-03-23T23:52:41.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.958+0000 7fd7eea00640 1 --2- 172.21.15.8:0/373070833 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd7d8067660 0x7fd7d8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:41.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.958+0000 7fd7eea00640 1 -- 172.21.15.8:0/373070833 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fd7e4120180 con 0x7fd7f00070d0 2024-03-23T23:52:41.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.958+0000 7fd7f5600640 1 --2- 172.21.15.8:0/373070833 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd7d8067660 0x7fd7d8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:41.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.966+0000 7fd7f5600640 1 --2- 172.21.15.8:0/373070833 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd7d8067660 0x7fd7d8069b20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc0094a0 tx=0x7fd7dc0093f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:41.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:41.966+0000 7fd7eea00640 1 -- 172.21.15.8:0/373070833 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fd7e40c3030 con 0x7fd7f00070d0 2024-03-23T23:52:42.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:42.526+0000 7fd7e3e00640 1 -- 172.21.15.8:0/373070833 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fd7cc005860 con 0x7fd7f00070d0 2024-03-23T23:52:42.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:42.538+0000 7fd7eea00640 1 -- 172.21.15.8:0/373070833 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fd7e4016090 con 0x7fd7f00070d0 2024-03-23T23:52:42.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:42.546+0000 7fd7e3e00640 1 -- 172.21.15.8:0/373070833 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd7d8067660 msgr2=0x7fd7d8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:42.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:42.546+0000 7fd7e3e00640 1 --2- 172.21.15.8:0/373070833 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd7d8067660 0x7fd7d8069b20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc0094a0 tx=0x7fd7dc0093f0 comp rx=0 tx=0).stop 2024-03-23T23:52:42.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:42.546+0000 7fd7e3e00640 1 -- 172.21.15.8:0/373070833 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7f00070d0 msgr2=0x7fd7f0040d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:42.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:42.546+0000 7fd7e3e00640 1 --2- 172.21.15.8:0/373070833 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7f00070d0 0x7fd7f0040d30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4018fd0 tx=0x7fd7e4019160 comp rx=0 tx=0).stop 2024-03-23T23:52:42.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:42.546+0000 7fd7e3e00640 1 -- 172.21.15.8:0/373070833 shutdown_connections 2024-03-23T23:52:42.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:42.546+0000 7fd7e3e00640 1 --2- 172.21.15.8:0/373070833 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd7d8067660 0x7fd7d8069b20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:42.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:42.546+0000 7fd7e3e00640 1 --2- 172.21.15.8:0/373070833 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7f00dbc50 0x7fd7f00dacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:42.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:42.546+0000 7fd7e3e00640 1 --2- 172.21.15.8:0/373070833 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7f000b290 0x7fd7f00451f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:42.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:42.546+0000 7fd7e3e00640 1 --2- 172.21.15.8:0/373070833 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7f00070d0 0x7fd7f0040d30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:42.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:42.546+0000 7fd7e3e00640 1 -- 172.21.15.8:0/373070833 >> 172.21.15.8:0/373070833 conn(0x7fd7f0048430 msgr2=0x7fd7f00e8690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:42.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:42.546+0000 7fd7e3e00640 1 -- 172.21.15.8:0/373070833 shutdown_connections 2024-03-23T23:52:42.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:42.546+0000 7fd7e3e00640 1 -- 172.21.15.8:0/373070833 wait complete. 2024-03-23T23:52:42.623 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-03-23T23:52:44.900 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:52:44.904 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:52:52.624 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T23:52:52.624 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:52:52.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.922+0000 7fd70d400640 1 Processor -- start 2024-03-23T23:52:52.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.922+0000 7fd70d400640 1 -- start start 2024-03-23T23:52:52.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.926+0000 7fd70d400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd7000e3d60 0x7fd7000e6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:52.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.926+0000 7fd70d400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd70000bb00 con 0x7fd7000db8d0 2024-03-23T23:52:52.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.926+0000 7fd70d400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd700007410 con 0x7fd7000d7b60 2024-03-23T23:52:52.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.926+0000 7fd70d400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd700007130 con 0x7fd7000e3d60 2024-03-23T23:52:52.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.926+0000 7fd707e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fd7000d7b60 0x7fd700046160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:36578/0 (socket says 172.21.15.8:36578) 2024-03-23T23:52:52.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.926+0000 7fd707e00640 1 -- 172.21.15.8:0/1852062987 learned_addr learned my addr 172.21.15.8:0/1852062987 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:52:52.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.926+0000 7fd70ca00640 1 --2- 172.21.15.8:0/1852062987 >> v2:172.21.15.8:3300/0 conn(0x7fd7000e3d60 0x7fd7000e6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:52.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.930+0000 7fd706a00640 1 -- 172.21.15.8:0/1852062987 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2735168862 0 0) 0x7fd700007410 con 0x7fd7000d7b60 2024-03-23T23:52:52.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.930+0000 7fd706a00640 1 -- 172.21.15.8:0/1852062987 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6f0003530 con 0x7fd7000d7b60 2024-03-23T23:52:52.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.930+0000 7fd70ca00640 1 -- 172.21.15.8:0/1852062987 >> v1:172.21.15.196:6789/0 conn(0x7fd7000d7b60 legacy=0x7fd700046160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:52.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.930+0000 7fd70ca00640 1 -- 172.21.15.8:0/1852062987 >> v1:172.21.15.8:6789/0 conn(0x7fd7000db8d0 legacy=0x7fd7000dbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:52:52.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.930+0000 7fd70ca00640 1 -- 172.21.15.8:0/1852062987 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7000da4f0 con 0x7fd7000e3d60 2024-03-23T23:52:52.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.934+0000 7fd70ca00640 1 --2- 172.21.15.8:0/1852062987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7000e3d60 0x7fd7000e6150 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd7080695d0 tx=0x7fd7080982d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6782c871d89b290 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:52.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.938+0000 7fd706a00640 1 -- 172.21.15.8:0/1852062987 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70812c070 con 0x7fd7000e3d60 2024-03-23T23:52:52.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.938+0000 7fd706a00640 1 -- 172.21.15.8:0/1852062987 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd708127600 con 0x7fd7000e3d60 2024-03-23T23:52:52.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.938+0000 7fd706a00640 1 -- 172.21.15.8:0/1852062987 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd708127a70 con 0x7fd7000e3d60 2024-03-23T23:52:52.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.938+0000 7fd70d400640 1 -- 172.21.15.8:0/1852062987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7000e3d60 msgr2=0x7fd7000e6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:52.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.938+0000 7fd70d400640 1 --2- 172.21.15.8:0/1852062987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7000e3d60 0x7fd7000e6150 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd7080695d0 tx=0x7fd7080982d0 comp rx=0 tx=0).stop 2024-03-23T23:52:52.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.942+0000 7fd70d400640 1 -- 172.21.15.8:0/1852062987 shutdown_connections 2024-03-23T23:52:52.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.942+0000 7fd70d400640 1 --2- 172.21.15.8:0/1852062987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7000e3d60 0x7fd7000e6150 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:52.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.942+0000 7fd70d400640 1 -- 172.21.15.8:0/1852062987 >> 172.21.15.8:0/1852062987 conn(0x7fd700005ef0 msgr2=0x7fd700006300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:52.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.946+0000 7fd70d400640 1 -- 172.21.15.8:0/1852062987 shutdown_connections 2024-03-23T23:52:52.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.946+0000 7fd70d400640 1 -- 172.21.15.8:0/1852062987 wait complete. 2024-03-23T23:52:52.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.950+0000 7fd70d400640 1 Processor -- start 2024-03-23T23:52:52.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.950+0000 7fd70d400640 1 -- start start 2024-03-23T23:52:52.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.954+0000 7fd70d400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7000d7b60 0x7fd7000433a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:52.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.954+0000 7fd70d400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7000db8d0 0x7fd700031630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:52.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.954+0000 7fd70d400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7000e3d60 0x7fd7000d36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:52.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.954+0000 7fd70d400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd700045af0 con 0x7fd7000e3d60 2024-03-23T23:52:52.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.954+0000 7fd70d400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd700006c30 con 0x7fd7000d7b60 2024-03-23T23:52:52.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.954+0000 7fd70d400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7000db2b0 con 0x7fd7000db8d0 2024-03-23T23:52:52.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.954+0000 7fd707400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7000db8d0 0x7fd700031630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:52.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.954+0000 7fd70ca00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7000e3d60 0x7fd7000d36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:52.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.954+0000 7fd707400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7000db8d0 0x7fd700031630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:38858/0 (socket says 172.21.15.8:38858) 2024-03-23T23:52:52.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.954+0000 7fd707400640 1 -- 172.21.15.8:0/1087528652 learned_addr learned my addr 172.21.15.8:0/1087528652 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:52:52.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.954+0000 7fd70ca00640 1 -- 172.21.15.8:0/1087528652 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7000db8d0 msgr2=0x7fd700031630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:52.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.954+0000 7fd70ca00640 1 --2- 172.21.15.8:0/1087528652 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7000db8d0 0x7fd700031630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:52.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.954+0000 7fd70ca00640 1 -- 172.21.15.8:0/1087528652 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7000d7b60 msgr2=0x7fd7000433a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-23T23:52:52.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.954+0000 7fd70ca00640 1 --2- 172.21.15.8:0/1087528652 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7000d7b60 0x7fd7000433a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:52.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.954+0000 7fd70ca00640 1 -- 172.21.15.8:0/1087528652 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd700175e30 con 0x7fd7000e3d60 2024-03-23T23:52:52.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.954+0000 7fd70ca00640 1 --2- 172.21.15.8:0/1087528652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7000e3d60 0x7fd7000d36d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd708050260 tx=0x7fd708095120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:52.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.958+0000 7fd6fbe00640 1 -- 172.21.15.8:0/1087528652 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70812c040 con 0x7fd7000e3d60 2024-03-23T23:52:52.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.958+0000 7fd6fbe00640 1 -- 172.21.15.8:0/1087528652 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd708127e20 con 0x7fd7000e3d60 2024-03-23T23:52:52.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.958+0000 7fd6fbe00640 1 -- 172.21.15.8:0/1087528652 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd708149600 con 0x7fd7000e3d60 2024-03-23T23:52:52.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.958+0000 7fd70d400640 1 -- 172.21.15.8:0/1087528652 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7001760b0 con 0x7fd7000e3d60 2024-03-23T23:52:52.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.962+0000 7fd70d400640 1 -- 172.21.15.8:0/1087528652 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd700176670 con 0x7fd7000e3d60 2024-03-23T23:52:52.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.962+0000 7fd70d400640 1 -- 172.21.15.8:0/1087528652 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7000052d0 con 0x7fd7000e3d60 2024-03-23T23:52:52.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.966+0000 7fd6fbe00640 1 -- 172.21.15.8:0/1087528652 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd7081497a0 con 0x7fd7000e3d60 2024-03-23T23:52:52.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.966+0000 7fd6fbe00640 1 --2- 172.21.15.8:0/1087528652 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd6e80676b0 0x7fd6e8069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:52.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.970+0000 7fd707e00640 1 --2- 172.21.15.8:0/1087528652 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd6e80676b0 0x7fd6e8069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:52.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.970+0000 7fd707e00640 1 --2- 172.21.15.8:0/1087528652 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd6e80676b0 0x7fd6e8069b70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc007fd0 tx=0x7fd6fc007900 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:52.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.974+0000 7fd6fbe00640 1 -- 172.21.15.8:0/1087528652 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fd708142e60 con 0x7fd7000e3d60 2024-03-23T23:52:52.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:52.998+0000 7fd6fbe00640 1 -- 172.21.15.8:0/1087528652 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fd700175e30 con 0x7fd7000e3d60 2024-03-23T23:52:53.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.602+0000 7fd70d400640 1 -- 172.21.15.8:0/1087528652 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd7000d1720 con 0x7fd7000e3d60 2024-03-23T23:52:53.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.606+0000 7fd6fbe00640 1 -- 172.21.15.8:0/1087528652 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1561 (secure 0 0 0) 0x7fd708145030 con 0x7fd7000e3d60 2024-03-23T23:52:53.608 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":78,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:52:53.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.610+0000 7fd70d400640 1 -- 172.21.15.8:0/1087528652 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd6e80676b0 msgr2=0x7fd6e8069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:53.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.610+0000 7fd70d400640 1 --2- 172.21.15.8:0/1087528652 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd6e80676b0 0x7fd6e8069b70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc007fd0 tx=0x7fd6fc007900 comp rx=0 tx=0).stop 2024-03-23T23:52:53.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.610+0000 7fd70d400640 1 -- 172.21.15.8:0/1087528652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7000e3d60 msgr2=0x7fd7000d36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:53.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.610+0000 7fd70d400640 1 --2- 172.21.15.8:0/1087528652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7000e3d60 0x7fd7000d36d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd708050260 tx=0x7fd708095120 comp rx=0 tx=0).stop 2024-03-23T23:52:53.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.610+0000 7fd70d400640 1 -- 172.21.15.8:0/1087528652 shutdown_connections 2024-03-23T23:52:53.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.610+0000 7fd70d400640 1 --2- 172.21.15.8:0/1087528652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7000e3d60 0x7fd7000d36d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:53.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.610+0000 7fd70d400640 1 --2- 172.21.15.8:0/1087528652 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd6e80676b0 0x7fd6e8069b70 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:53.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.610+0000 7fd70d400640 1 --2- 172.21.15.8:0/1087528652 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7000db8d0 0x7fd700031630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:53.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.610+0000 7fd70d400640 1 --2- 172.21.15.8:0/1087528652 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7000d7b60 0x7fd7000433a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:53.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.610+0000 7fd70d400640 1 -- 172.21.15.8:0/1087528652 >> 172.21.15.8:0/1087528652 conn(0x7fd700005ef0 msgr2=0x7fd7000dbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:53.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.614+0000 7fd70d400640 1 -- 172.21.15.8:0/1087528652 shutdown_connections 2024-03-23T23:52:53.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.614+0000 7fd70d400640 1 -- 172.21.15.8:0/1087528652 wait complete. 2024-03-23T23:52:53.662 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T23:52:53.662 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-03-23T23:52:53.662 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T23:52:53.662 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:52:53.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.942+0000 7f61fe400640 1 Processor -- start 2024-03-23T23:52:53.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.942+0000 7f61fe400640 1 -- start start 2024-03-23T23:52:53.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.946+0000 7f61fe400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f61f8151ba0 0x7f61f8151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:53.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.946+0000 7f61fe400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f806cfa0 con 0x7f61f80c4430 2024-03-23T23:52:53.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.946+0000 7f61fe400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f806d280 con 0x7f61f814eb80 2024-03-23T23:52:53.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.946+0000 7f61fe400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f80c3760 con 0x7f61f8151ba0 2024-03-23T23:52:53.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.946+0000 7f61f7e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f61f814eb80 0x7f61f80c2820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:36594/0 (socket says 172.21.15.8:36594) 2024-03-23T23:52:53.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.946+0000 7f61f7e00640 1 -- 172.21.15.8:0/1075964189 learned_addr learned my addr 172.21.15.8:0/1075964189 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:52:53.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.946+0000 7f61fda00640 1 --2- 172.21.15.8:0/1075964189 >> v2:172.21.15.196:3300/0 conn(0x7f61f8151ba0 0x7f61f8151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:53.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.946+0000 7f61f7400640 1 -- 172.21.15.8:0/1075964189 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1339723681 0 0) 0x7f61f806d280 con 0x7f61f814eb80 2024-03-23T23:52:53.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.946+0000 7f61f7400640 1 -- 172.21.15.8:0/1075964189 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61dc003530 con 0x7f61f814eb80 2024-03-23T23:52:53.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.950+0000 7f61f7400640 1 -- 172.21.15.8:0/1075964189 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1844007047 0 0) 0x7f61f806cfa0 con 0x7f61f80c4430 2024-03-23T23:52:53.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.950+0000 7f61f7400640 1 -- 172.21.15.8:0/1075964189 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61f806d280 con 0x7f61f80c4430 2024-03-23T23:52:53.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.950+0000 7f61f7400640 1 -- 172.21.15.8:0/1075964189 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3331985826 0 0) 0x7f61f806d280 con 0x7f61f80c4430 2024-03-23T23:52:53.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.950+0000 7f61f7400640 1 -- 172.21.15.8:0/1075964189 >> v2:172.21.15.196:3300/0 conn(0x7f61f8151ba0 msgr2=0x7f61f8151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:52:53.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.950+0000 7f61f7400640 1 --2- 172.21.15.8:0/1075964189 >> v2:172.21.15.196:3300/0 conn(0x7f61f8151ba0 0x7f61f8151fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:53.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.950+0000 7f61f7400640 1 -- 172.21.15.8:0/1075964189 >> v1:172.21.15.196:6789/0 conn(0x7f61f814eb80 legacy=0x7f61f80c2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:53.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.950+0000 7f61f7400640 1 -- 172.21.15.8:0/1075964189 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f806d560 con 0x7f61f80c4430 2024-03-23T23:52:53.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.950+0000 7f61f7400640 1 -- 172.21.15.8:0/1075964189 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7f61e8001660 con 0x7f61f80c4430 2024-03-23T23:52:53.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.950+0000 7f61f7400640 1 -- 172.21.15.8:0/1075964189 >> v1:172.21.15.8:6789/0 conn(0x7f61f80c4430 legacy=0x7f61f8072b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:53.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.950+0000 7f61f7400640 1 --2- 172.21.15.8:0/1075964189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61dc003b50 0x7f61dc003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:53.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.950+0000 7f61f7400640 1 --2- 172.21.15.8:0/1075964189 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f61dc004810 0x7f61dc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:53.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.950+0000 7f61f7400640 1 --2- 172.21.15.8:0/1075964189 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61dc0051d0 0x7f61dc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:53.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.950+0000 7f61f7400640 1 -- 172.21.15.8:0/1075964189 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f80c3760 con 0x7f61dc003b50 2024-03-23T23:52:53.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.950+0000 7f61f7400640 1 -- 172.21.15.8:0/1075964189 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc00bfd0 con 0x7f61dc004810 2024-03-23T23:52:53.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.950+0000 7f61f7400640 1 -- 172.21.15.8:0/1075964189 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc00c1d0 con 0x7f61dc0051d0 2024-03-23T23:52:53.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.950+0000 7f61f7e00640 1 --2- 172.21.15.8:0/1075964189 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f61dc004810 0x7f61dc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:53.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.950+0000 7f61fda00640 1 --2- 172.21.15.8:0/1075964189 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61dc0051d0 0x7f61dc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:53.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.950+0000 7f61fd000640 1 --2- 172.21.15.8:0/1075964189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61dc003b50 0x7f61dc003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:53.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.950+0000 7f61f7e00640 1 -- 172.21.15.8:0/1075964189 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61dc0051d0 msgr2=0x7f61dc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:52:53.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.950+0000 7f61f7e00640 1 --2- 172.21.15.8:0/1075964189 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61dc0051d0 0x7f61dc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:53.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.950+0000 7f61f7e00640 1 -- 172.21.15.8:0/1075964189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61dc003b50 msgr2=0x7f61dc003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:52:53.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.950+0000 7f61f7e00640 1 --2- 172.21.15.8:0/1075964189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61dc003b50 0x7f61dc003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:53.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.950+0000 7f61f7e00640 1 -- 172.21.15.8:0/1075964189 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61dc00c490 con 0x7f61dc004810 2024-03-23T23:52:53.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.954+0000 7f61fd000640 1 --2- 172.21.15.8:0/1075964189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61dc003b50 0x7f61dc003f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:52:53.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.954+0000 7f61fda00640 1 -- 172.21.15.8:0/1075964189 reap_dead start 2024-03-23T23:52:53.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.962+0000 7f61f7e00640 1 --2- 172.21.15.8:0/1075964189 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f61dc004810 0x7f61dc004c90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f61e4015600 tx=0x7f61e40279b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e728acdd223ace21 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:53.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.966+0000 7f61f7400640 1 -- 172.21.15.8:0/1075964189 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e4015220 con 0x7f61dc004810 2024-03-23T23:52:53.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.966+0000 7f61f7400640 1 -- 172.21.15.8:0/1075964189 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e4012030 con 0x7f61dc004810 2024-03-23T23:52:53.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.970+0000 7f61f7400640 1 -- 172.21.15.8:0/1075964189 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e4015220 con 0x7f61dc004810 2024-03-23T23:52:53.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.970+0000 7f61fe400640 1 -- 172.21.15.8:0/1075964189 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f61dc004810 msgr2=0x7f61dc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:53.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.970+0000 7f61fe400640 1 --2- 172.21.15.8:0/1075964189 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f61dc004810 0x7f61dc004c90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f61e4015600 tx=0x7f61e40279b0 comp rx=0 tx=0).stop 2024-03-23T23:52:53.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.970+0000 7f61fe400640 1 -- 172.21.15.8:0/1075964189 shutdown_connections 2024-03-23T23:52:53.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.970+0000 7f61fe400640 1 --2- 172.21.15.8:0/1075964189 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f61dc004810 0x7f61dc004c90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:53.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.970+0000 7f61fe400640 1 -- 172.21.15.8:0/1075964189 >> 172.21.15.8:0/1075964189 conn(0x7f61f80c3910 msgr2=0x7f61f80c3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:53.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.970+0000 7f61fe400640 1 -- 172.21.15.8:0/1075964189 shutdown_connections 2024-03-23T23:52:53.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.970+0000 7f61fe400640 1 -- 172.21.15.8:0/1075964189 wait complete. 2024-03-23T23:52:53.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.974+0000 7f61fe400640 1 Processor -- start 2024-03-23T23:52:53.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.974+0000 7f61fe400640 1 -- start start 2024-03-23T23:52:53.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.978+0000 7f61fe400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61dc004810 0x7f61f81415f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:53.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.978+0000 7f61fe400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f61f80c2480 0x7f61f8140650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:53.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.978+0000 7f61fe400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61f8140b90 0x7f61f81e68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:53.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.978+0000 7f61fd000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61dc004810 0x7f61f81415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:53.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.978+0000 7f61fd000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61dc004810 0x7f61f81415f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:38876/0 (socket says 172.21.15.8:38876) 2024-03-23T23:52:53.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.978+0000 7f61fda00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61f8140b90 0x7f61f81e68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:53.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.978+0000 7f61fda00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61f8140b90 0x7f61f81e68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35618/0 (socket says 172.21.15.8:35618) 2024-03-23T23:52:53.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.978+0000 7f61fd000640 1 -- 172.21.15.8:0/2355387424 learned_addr learned my addr 172.21.15.8:0/2355387424 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:52:53.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.978+0000 7f61fe400640 1 -- 172.21.15.8:0/2355387424 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f8070be0 con 0x7f61f8140b90 2024-03-23T23:52:53.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.978+0000 7f61fe400640 1 -- 172.21.15.8:0/2355387424 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f8151710 con 0x7f61f80c2480 2024-03-23T23:52:53.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.978+0000 7f61fe400640 1 -- 172.21.15.8:0/2355387424 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f806c940 con 0x7f61dc004810 2024-03-23T23:52:53.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.982+0000 7f61f7e00640 1 --2- 172.21.15.8:0/2355387424 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f61f80c2480 0x7f61f8140650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:53.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.982+0000 7f61fda00640 1 -- 172.21.15.8:0/2355387424 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61dc004810 msgr2=0x7f61f81415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:53.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.982+0000 7f61fda00640 1 --2- 172.21.15.8:0/2355387424 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61dc004810 0x7f61f81415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:53.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.982+0000 7f61fda00640 1 -- 172.21.15.8:0/2355387424 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f61f80c2480 msgr2=0x7f61f8140650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:53.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.982+0000 7f61fda00640 1 --2- 172.21.15.8:0/2355387424 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f61f80c2480 0x7f61f8140650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:53.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.982+0000 7f61fda00640 1 -- 172.21.15.8:0/2355387424 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f8141bd0 con 0x7f61f8140b90 2024-03-23T23:52:53.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.982+0000 7f61fda00640 1 --2- 172.21.15.8:0/2355387424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61f8140b90 0x7f61f81e68b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f61f8151f80 tx=0x7f61f00115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:53.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.982+0000 7f61f4c00640 1 -- 172.21.15.8:0/2355387424 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f0011e10 con 0x7f61f8140b90 2024-03-23T23:52:53.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.986+0000 7f61fe400640 1 -- 172.21.15.8:0/2355387424 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f814d0a0 con 0x7f61f8140b90 2024-03-23T23:52:53.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.986+0000 7f61fe400640 1 -- 172.21.15.8:0/2355387424 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f814d660 con 0x7f61f8140b90 2024-03-23T23:52:53.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.986+0000 7f61fe400640 1 --2- 172.21.15.8:0/2355387424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61f81e6df0 0x7f61f81e71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:53.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.986+0000 7f61fe400640 1 -- 172.21.15.8:0/2355387424 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f8143180 con 0x7f61f81e6df0 2024-03-23T23:52:53.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.990+0000 7f61fd000640 1 --2- 172.21.15.8:0/2355387424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61f81e6df0 0x7f61f81e71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:53.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.994+0000 7f61f4c00640 1 -- 172.21.15.8:0/2355387424 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f001b070 con 0x7f61f8140b90 2024-03-23T23:52:53.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.994+0000 7f61f4c00640 1 -- 172.21.15.8:0/2355387424 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f00039a0 con 0x7f61f8140b90 2024-03-23T23:52:53.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.994+0000 7f61f4c00640 1 -- 172.21.15.8:0/2355387424 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f61f0003bc0 con 0x7f61f8140b90 2024-03-23T23:52:53.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:53.998+0000 7f61fd000640 1 -- 172.21.15.8:0/2355387424 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f61f804f410 con 0x7f61f81e6df0 2024-03-23T23:52:54.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.002+0000 7f61fd000640 1 --2- 172.21.15.8:0/2355387424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61f81e6df0 0x7f61f81e71d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f61e8005e20 tx=0x7f61e80062e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:54.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.002+0000 7f61f4c00640 1 --2- 172.21.15.8:0/2355387424 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f61d8067660 0x7f61d8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:54.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.002+0000 7f61f4c00640 1 -- 172.21.15.8:0/2355387424 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f61f0086280 con 0x7f61f8140b90 2024-03-23T23:52:54.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.002+0000 7f61f7e00640 1 --2- 172.21.15.8:0/2355387424 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f61d8067660 0x7f61d8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:54.007 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.006+0000 7f61f4c00640 1 -- 172.21.15.8:0/2355387424 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e80050d0 con 0x7f61f81e6df0 2024-03-23T23:52:54.007 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.006+0000 7f61f4c00640 1 -- 172.21.15.8:0/2355387424 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f61e8019070 con 0x7f61f81e6df0 2024-03-23T23:52:54.007 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.006+0000 7f61f4c00640 1 -- 172.21.15.8:0/2355387424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61f81e6df0 msgr2=0x7f61f81e71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:54.007 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.006+0000 7f61f4c00640 1 --2- 172.21.15.8:0/2355387424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61f81e6df0 0x7f61f81e71d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f61e8005e20 tx=0x7f61e80062e0 comp rx=0 tx=0).stop 2024-03-23T23:52:54.007 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.006+0000 7f61f4c00640 1 -- 172.21.15.8:0/2355387424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61f81e6df0 msgr2=0x7f61f81e71d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:52:54.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.006+0000 7f61f4c00640 1 --2- 172.21.15.8:0/2355387424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61f81e6df0 0x7f61f81e71d0 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f61e8005e20 tx=0x7f61e80062e0 comp rx=0 tx=0).stop 2024-03-23T23:52:54.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.014+0000 7f61f7e00640 1 --2- 172.21.15.8:0/2355387424 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f61d8067660 0x7f61d8069b20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f61e40ba000 tx=0x7f61e4001350 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:54.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.030+0000 7f61fe400640 1 --2- 172.21.15.8:0/2355387424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61f81501e0 0x7f61f81505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:54.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.030+0000 7f61fe400640 1 -- 172.21.15.8:0/2355387424 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f8071d30 con 0x7f61f81501e0 2024-03-23T23:52:54.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.030+0000 7f61fd000640 1 --2- 172.21.15.8:0/2355387424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61f81501e0 0x7f61f81505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:54.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.034+0000 7f61fd000640 1 -- 172.21.15.8:0/2355387424 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f61f814a070 con 0x7f61f81501e0 2024-03-23T23:52:54.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.034+0000 7f61fd000640 1 --2- 172.21.15.8:0/2355387424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61f81501e0 0x7f61f81505c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f61e8001a80 tx=0x7f61e8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:54.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.034+0000 7f61f4c00640 1 -- 172.21.15.8:0/2355387424 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e8010a30 con 0x7f61f81501e0 2024-03-23T23:52:54.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.038+0000 7f61f4c00640 1 -- 172.21.15.8:0/2355387424 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4532 (secure 0 0 0) 0x7f61e8010bd0 con 0x7f61f81501e0 2024-03-23T23:52:54.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.038+0000 7f61f4c00640 1 -- 172.21.15.8:0/2355387424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61f81501e0 msgr2=0x7f61f81505c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:54.040 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:52:54.041 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:52:54.041 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:52:54.041 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:52:54.041 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 78, 2024-03-23T23:52:54.041 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:52:54.041 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:52:54.041 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:52:54.041 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:52:54.041 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:54.041 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 16, 2024-03-23T23:52:54.041 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:52:54.041 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:52:54.042 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:52:54.042 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:52:54.042 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:52:54.042 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:52:54.042 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:52:54.042 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:52:54.042 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:52:54.042 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:52:54.042 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:52:54.042 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:52:54.042 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:52:54.042 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:52:54.042 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:54.043 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:52:54.043 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:52:54.043 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:52:54.043 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:52:54.043 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:52:54.043 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:52:54.043 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:52:54.043 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:52:54.043 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:52:54.043 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:52:54.043 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:52:54.043 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:52:54.043 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:52:54.044 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:54.044 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:54.044 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:52:54.044 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:52:54.044 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:52:54.044 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:52:54.044 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:52:54.044 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:52:54.044 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:52:54.044 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:52:54.044 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:52:54.044 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:52:54.044 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:52:54.044 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:52:54.045 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:52:54.045 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:52:54.045 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:52:54.045 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:52:54.045 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:52:54.045 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:52:54.045 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:52:54.045 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:52:54.045 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:52:54.045 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:52:54.045 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:52:54.045 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:52:54.045 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:52:54.046 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:52:54.046 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:52:54.046 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:52:54.046 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:54.046 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:52:54.046 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:54.046 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:52:54.046 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:54.046 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:52:54.046 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:52:54.046 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:52:54.046 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:52:54.046 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:54.047 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:52:54.047 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:52:54.047 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:54.047 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:54.047 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:54.047 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:52:54.047 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:52:54.047 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:54.047 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:54.047 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:54.047 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:54.047 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:52:54.047 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:52:54.047 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:52:54.048 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:52:54.048 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:52:54.048 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:54.048 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:54.048 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:52:54.048 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:52:54.048 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:52:54.048 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:52:54.048 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:54.048 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:52:54.048 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:52:54.048 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:54.048 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:54.049 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:54.049 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:52:54.049 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:52:54.049 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:54.049 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:54.049 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:54.049 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:54.049 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:52:54.049 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:52:54.049 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:52:54.049 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:52:54.049 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:52:54.049 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:54.049 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:54.050 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:52:54.050 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:52:54.050 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:52:54.050 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:52:54.050 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:54.050 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:52:54.050 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:52:54.050 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:54.050 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:54.050 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:54.050 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:52:54.050 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:52:54.050 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:54.051 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:54.051 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:54.051 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:54.051 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:52:54.051 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:52:54.051 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:52:54.051 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:52:54.051 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:52:54.051 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:54.051 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:54.051 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:54.051 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:52:54.051 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:52:54.051 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:54.052 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:52:54.052 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:54.052 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:52:54.052 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:54.052 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:54.052 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:52:54.052 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:54.052 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:52:54.052 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:54.052 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:52:54.052 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:54.052 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:54.052 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:54.053 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:52:54.053 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:52:54.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.038+0000 7f61f4c00640 1 --2- 172.21.15.8:0/2355387424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61f81501e0 0x7f61f81505c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f61e8001a80 tx=0x7f61e8000ee0 comp rx=0 tx=0).stop 2024-03-23T23:52:54.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.038+0000 7f61f4c00640 1 -- 172.21.15.8:0/2355387424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61f81501e0 msgr2=0x7f61f81505c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:52:54.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.038+0000 7f61f4c00640 1 --2- 172.21.15.8:0/2355387424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61f81501e0 0x7f61f81505c0 secure :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f61e8001a80 tx=0x7f61e8000ee0 comp rx=0 tx=0).stop 2024-03-23T23:52:54.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.046+0000 7f61fe400640 1 -- 172.21.15.8:0/2355387424 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f61d8067660 msgr2=0x7f61d8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:54.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.046+0000 7f61fe400640 1 --2- 172.21.15.8:0/2355387424 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f61d8067660 0x7f61d8069b20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f61e40ba000 tx=0x7f61e4001350 comp rx=0 tx=0).stop 2024-03-23T23:52:54.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.046+0000 7f61fe400640 1 -- 172.21.15.8:0/2355387424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61f8140b90 msgr2=0x7f61f81e68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:54.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.046+0000 7f61fe400640 1 --2- 172.21.15.8:0/2355387424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61f8140b90 0x7f61f81e68b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f61f8151f80 tx=0x7f61f00115a0 comp rx=0 tx=0).stop 2024-03-23T23:52:54.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.050+0000 7f61fda00640 1 -- 172.21.15.8:0/2355387424 reap_dead start 2024-03-23T23:52:54.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.050+0000 7f61fda00640 1 -- 172.21.15.8:0/2355387424 reap_dead start 2024-03-23T23:52:54.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.054+0000 7f61fe400640 1 -- 172.21.15.8:0/2355387424 shutdown_connections 2024-03-23T23:52:54.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.054+0000 7f61fe400640 1 -- 172.21.15.8:0/2355387424 >> 172.21.15.8:0/2355387424 conn(0x7f61f80c3910 msgr2=0x7f61f8148b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:54.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.058+0000 7f61fe400640 1 -- 172.21.15.8:0/2355387424 shutdown_connections 2024-03-23T23:52:54.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.058+0000 7f61fe400640 1 -- 172.21.15.8:0/2355387424 wait complete. 2024-03-23T23:52:54.148 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:52:54.148 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T23:52:54.148 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:52:54.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.530+0000 7f95d7200640 1 Processor -- start 2024-03-23T23:52:54.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.530+0000 7f95d7200640 1 -- start start 2024-03-23T23:52:54.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.530+0000 7f95d7200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95d014ede0 0x7f95d0072b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:54.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.530+0000 7f95d7200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f95d00c2820 0x7f95d00c2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:54.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.530+0000 7f95d7200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95d006ccc0 con 0x7f95d00c4430 2024-03-23T23:52:54.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.530+0000 7f95d7200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95d00c3760 con 0x7f95d00c2820 2024-03-23T23:52:54.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.530+0000 7f95d7200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d0151710 con 0x7f95d014ede0 2024-03-23T23:52:54.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.534+0000 7f95d6800640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f95d00c4430 0x7f95d0151ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:57316/0 (socket says 172.21.15.8:57316) 2024-03-23T23:52:54.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.534+0000 7f95d6800640 1 -- 172.21.15.8:0/405305154 learned_addr learned my addr 172.21.15.8:0/405305154 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:52:54.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.534+0000 7f95d5e00640 1 --2- 172.21.15.8:0/405305154 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95d014ede0 0x7f95d0072b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:54.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.534+0000 7f95d4a00640 1 -- 172.21.15.8:0/405305154 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 691530490 0 0) 0x7f95d006ccc0 con 0x7f95d00c4430 2024-03-23T23:52:54.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.534+0000 7f95d4a00640 1 -- 172.21.15.8:0/405305154 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95b8003530 con 0x7f95d00c4430 2024-03-23T23:52:54.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.534+0000 7f95d4a00640 1 -- 172.21.15.8:0/405305154 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1202285766 0 0) 0x7f95b8003530 con 0x7f95d00c4430 2024-03-23T23:52:54.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.534+0000 7f95d4a00640 1 -- 172.21.15.8:0/405305154 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95d014ede0 msgr2=0x7f95d0072b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:52:54.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.534+0000 7f95d4a00640 1 --2- 172.21.15.8:0/405305154 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95d014ede0 0x7f95d0072b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:54.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.534+0000 7f95d4a00640 1 -- 172.21.15.8:0/405305154 >> v2:172.21.15.196:3300/0 conn(0x7f95d00c2820 msgr2=0x7f95d00c2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:52:54.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.534+0000 7f95d4a00640 1 --2- 172.21.15.8:0/405305154 >> v2:172.21.15.196:3300/0 conn(0x7f95d00c2820 0x7f95d00c2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:54.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.534+0000 7f95d4a00640 1 -- 172.21.15.8:0/405305154 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d006cfa0 con 0x7f95d00c4430 2024-03-23T23:52:54.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.534+0000 7f95d4a00640 1 -- 172.21.15.8:0/405305154 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7f95c4001660 con 0x7f95d00c4430 2024-03-23T23:52:54.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.534+0000 7f95d4a00640 1 -- 172.21.15.8:0/405305154 >> v1:172.21.15.8:6789/0 conn(0x7f95d00c4430 legacy=0x7f95d0151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:54.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.534+0000 7f95d4a00640 1 --2- 172.21.15.8:0/405305154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95b80039c0 0x7f95b8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:54.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.534+0000 7f95d4a00640 1 --2- 172.21.15.8:0/405305154 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95b8004810 0x7f95b8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:54.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.534+0000 7f95d4a00640 1 --2- 172.21.15.8:0/405305154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95b80051d0 0x7f95b800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:54.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.534+0000 7f95d4a00640 1 -- 172.21.15.8:0/405305154 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d00c3760 con 0x7f95b80051d0 2024-03-23T23:52:54.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.534+0000 7f95d4a00640 1 -- 172.21.15.8:0/405305154 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d0151710 con 0x7f95b80039c0 2024-03-23T23:52:54.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.534+0000 7f95d4a00640 1 -- 172.21.15.8:0/405305154 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b800c100 con 0x7f95b8004810 2024-03-23T23:52:54.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.538+0000 7f95d6800640 1 --2- 172.21.15.8:0/405305154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95b80051d0 0x7f95b800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:54.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.538+0000 7f95d5e00640 1 --2- 172.21.15.8:0/405305154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95b80039c0 0x7f95b8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:54.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.538+0000 7f95d6800640 1 -- 172.21.15.8:0/405305154 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95b8004810 msgr2=0x7f95b8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:52:54.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.538+0000 7f95d6800640 1 --2- 172.21.15.8:0/405305154 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95b8004810 0x7f95b8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:54.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.538+0000 7f95d6800640 1 -- 172.21.15.8:0/405305154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95b80039c0 msgr2=0x7f95b8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:52:54.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.538+0000 7f95d6800640 1 --2- 172.21.15.8:0/405305154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95b80039c0 0x7f95b8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:54.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.538+0000 7f95d6800640 1 -- 172.21.15.8:0/405305154 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d006cfa0 con 0x7f95b80051d0 2024-03-23T23:52:54.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.542+0000 7f95d6800640 1 --2- 172.21.15.8:0/405305154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95b80051d0 0x7f95b800b9d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f95c400c210 tx=0x7f95c401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae720808c7497ac server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:54.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.542+0000 7f95d4a00640 1 -- 172.21.15.8:0/405305154 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c4007d00 con 0x7f95b80051d0 2024-03-23T23:52:54.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.542+0000 7f95d4a00640 1 -- 172.21.15.8:0/405305154 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c40a5b60 con 0x7f95b80051d0 2024-03-23T23:52:54.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.546+0000 7f95d7200640 1 -- 172.21.15.8:0/405305154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95b80051d0 msgr2=0x7f95b800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:54.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.546+0000 7f95d4a00640 1 -- 172.21.15.8:0/405305154 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c4007d00 con 0x7f95b80051d0 2024-03-23T23:52:54.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.546+0000 7f95d7200640 1 --2- 172.21.15.8:0/405305154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95b80051d0 0x7f95b800b9d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f95c400c210 tx=0x7f95c401cc60 comp rx=0 tx=0).stop 2024-03-23T23:52:54.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.546+0000 7f95d6800640 1 -- 172.21.15.8:0/405305154 reap_dead start 2024-03-23T23:52:54.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.546+0000 7f95d7200640 1 -- 172.21.15.8:0/405305154 shutdown_connections 2024-03-23T23:52:54.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.546+0000 7f95d7200640 1 -- 172.21.15.8:0/405305154 >> 172.21.15.8:0/405305154 conn(0x7f95d00c3910 msgr2=0x7f95d00c3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:54.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.546+0000 7f95d7200640 1 -- 172.21.15.8:0/405305154 shutdown_connections 2024-03-23T23:52:54.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.546+0000 7f95d7200640 1 -- 172.21.15.8:0/405305154 wait complete. 2024-03-23T23:52:54.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.550+0000 7f95d7200640 1 Processor -- start 2024-03-23T23:52:54.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.550+0000 7f95d7200640 1 -- start start 2024-03-23T23:52:54.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.554+0000 7f95d7200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95d00c5da0 0x7f95d01eeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:54.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.554+0000 7f95d7200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95d0155740 0x7f95d01ef3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:54.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.554+0000 7f95d7200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95d013db40 0x7f95d013dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:54.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.554+0000 7f95d7200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d0070be0 con 0x7f95d013db40 2024-03-23T23:52:54.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.554+0000 7f95d7200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d006d560 con 0x7f95d00c5da0 2024-03-23T23:52:54.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.554+0000 7f95d7200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d006c940 con 0x7f95d0155740 2024-03-23T23:52:54.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.554+0000 7f95d6800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95d013db40 0x7f95d013dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:54.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.554+0000 7f95d6800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95d013db40 0x7f95d013dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35650/0 (socket says 172.21.15.8:35650) 2024-03-23T23:52:54.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.554+0000 7f95d6800640 1 -- 172.21.15.8:0/1444669311 learned_addr learned my addr 172.21.15.8:0/1444669311 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:52:54.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.558+0000 7f95d5e00640 1 --2- 172.21.15.8:0/1444669311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95d00c5da0 0x7f95d01eeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:54.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.558+0000 7f95d6800640 1 -- 172.21.15.8:0/1444669311 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95d0155740 msgr2=0x7f95d01ef3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:54.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.558+0000 7f95d6800640 1 --2- 172.21.15.8:0/1444669311 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95d0155740 0x7f95d01ef3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:54.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.558+0000 7f95d6800640 1 -- 172.21.15.8:0/1444669311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95d00c5da0 msgr2=0x7f95d01eeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:54.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.558+0000 7f95d6800640 1 --2- 172.21.15.8:0/1444669311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95d00c5da0 0x7f95d01eeea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:54.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.558+0000 7f95d6800640 1 -- 172.21.15.8:0/1444669311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d01530c0 con 0x7f95d013db40 2024-03-23T23:52:54.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.562+0000 7f95d6800640 1 --2- 172.21.15.8:0/1444669311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95d013db40 0x7f95d013dfd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f95c401c6d0 tx=0x7f95b8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:54.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.562+0000 7f95ca000640 1 -- 172.21.15.8:0/1444669311 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c4007d00 con 0x7f95d013db40 2024-03-23T23:52:54.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.562+0000 7f95ca000640 1 -- 172.21.15.8:0/1444669311 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c40b5030 con 0x7f95d013db40 2024-03-23T23:52:54.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.562+0000 7f95ca000640 1 -- 172.21.15.8:0/1444669311 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c4001c40 con 0x7f95d013db40 2024-03-23T23:52:54.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.562+0000 7f95d7200640 1 -- 172.21.15.8:0/1444669311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95d01533a0 con 0x7f95d013db40 2024-03-23T23:52:54.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.566+0000 7f95d7200640 1 -- 172.21.15.8:0/1444669311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95d0151440 con 0x7f95d013db40 2024-03-23T23:52:54.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.570+0000 7f95ca000640 1 -- 172.21.15.8:0/1444669311 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f95c40075e0 con 0x7f95d013db40 2024-03-23T23:52:54.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.570+0000 7f95d7200640 1 --2- 172.21.15.8:0/1444669311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95d0153570 0x7f95d013e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:54.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.570+0000 7f95d7200640 1 -- 172.21.15.8:0/1444669311 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d01eebc0 con 0x7f95d0153570 2024-03-23T23:52:54.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.574+0000 7f95ca000640 1 --2- 172.21.15.8:0/1444669311 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f95b40676b0 0x7f95b4069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:54.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.574+0000 7f95d5400640 1 --2- 172.21.15.8:0/1444669311 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f95b40676b0 0x7f95b4069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:54.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.578+0000 7f95ca000640 1 -- 172.21.15.8:0/1444669311 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f95c40eda90 con 0x7f95d013db40 2024-03-23T23:52:54.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.578+0000 7f95d5e00640 1 --2- 172.21.15.8:0/1444669311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95d0153570 0x7f95d013e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:54.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.582+0000 7f95d5e00640 1 -- 172.21.15.8:0/1444669311 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f95d0150bb0 con 0x7f95d0153570 2024-03-23T23:52:54.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.582+0000 7f95d5e00640 1 --2- 172.21.15.8:0/1444669311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95d0153570 0x7f95d013e510 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f95d00733b0 tx=0x7f95cc007700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:54.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.586+0000 7f95ca000640 1 -- 172.21.15.8:0/1444669311 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc01b020 con 0x7f95d0153570 2024-03-23T23:52:54.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.586+0000 7f95ca000640 1 -- 172.21.15.8:0/1444669311 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f95cc017470 con 0x7f95d0153570 2024-03-23T23:52:54.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.586+0000 7f95ca000640 1 -- 172.21.15.8:0/1444669311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95d0153570 msgr2=0x7f95d013e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:54.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.586+0000 7f95ca000640 1 --2- 172.21.15.8:0/1444669311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95d0153570 0x7f95d013e510 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f95d00733b0 tx=0x7f95cc007700 comp rx=0 tx=0).stop 2024-03-23T23:52:54.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.586+0000 7f95ca000640 1 -- 172.21.15.8:0/1444669311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95d0153570 msgr2=0x7f95d013e510 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:52:54.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.586+0000 7f95ca000640 1 --2- 172.21.15.8:0/1444669311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95d0153570 0x7f95d013e510 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f95d00733b0 tx=0x7f95cc007700 comp rx=0 tx=0).stop 2024-03-23T23:52:54.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.590+0000 7f95d5400640 1 --2- 172.21.15.8:0/1444669311 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f95b40676b0 0x7f95b4069b70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f95d01424a0 tx=0x7f95c0006ca0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:54.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.642+0000 7f95d7200640 1 --2- 172.21.15.8:0/1444669311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95d0134740 0x7f95d0134b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:54.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.642+0000 7f95d7200640 1 -- 172.21.15.8:0/1444669311 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d004f410 con 0x7f95d0134740 2024-03-23T23:52:54.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.646+0000 7f95d5e00640 1 --2- 172.21.15.8:0/1444669311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95d0134740 0x7f95d0134b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:54.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.650+0000 7f95d5e00640 1 -- 172.21.15.8:0/1444669311 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f95d0071d30 con 0x7f95d0134740 2024-03-23T23:52:54.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.654+0000 7f95d5e00640 1 --2- 172.21.15.8:0/1444669311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95d0134740 0x7f95d0134b50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f95cc01c000 tx=0x7f95cc004ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:54.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.658+0000 7f95ca000640 1 -- 172.21.15.8:0/1444669311 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc01b030 con 0x7f95d0134740 2024-03-23T23:52:54.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.658+0000 7f95ca000640 1 -- 172.21.15.8:0/1444669311 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5013 (secure 0 0 0) 0x7f95cc020450 con 0x7f95d0134740 2024-03-23T23:52:54.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.666+0000 7f95ca000640 1 -- 172.21.15.8:0/1444669311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95d0134740 msgr2=0x7f95d0134b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:54.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.666+0000 7f95ca000640 1 --2- 172.21.15.8:0/1444669311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95d0134740 0x7f95d0134b50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f95cc01c000 tx=0x7f95cc004ac0 comp rx=0 tx=0).stop 2024-03-23T23:52:54.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.666+0000 7f95ca000640 1 -- 172.21.15.8:0/1444669311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95d0134740 msgr2=0x7f95d0134b50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:52:54.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.666+0000 7f95ca000640 1 --2- 172.21.15.8:0/1444669311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95d0134740 0x7f95d0134b50 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f95cc01c000 tx=0x7f95cc004ac0 comp rx=0 tx=0).stop 2024-03-23T23:52:54.729 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:52:54.729 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:52:54.730 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:52:54.730 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:52:54.730 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 78, 2024-03-23T23:52:54.730 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:52:54.730 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:52:54.730 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:52:54.730 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:52:54.730 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:54.730 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 17, 2024-03-23T23:52:54.730 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:52:54.731 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:52:54.731 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:52:54.731 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:52:54.731 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:52:54.731 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:52:54.731 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:52:54.731 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:52:54.731 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:52:54.731 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:52:54.731 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:52:54.731 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:52:54.731 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:52:54.731 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:52:54.731 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:54.732 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:52:54.732 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:52:54.732 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:52:54.732 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:52:54.732 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:52:54.732 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:52:54.732 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:52:54.732 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:52:54.732 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:52:54.732 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:52:54.733 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:52:54.733 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:52:54.733 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:52:54.733 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:54.733 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:54.733 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:52:54.733 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:52:54.733 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:52:54.733 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:52:54.733 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:52:54.733 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:52:54.733 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:52:54.733 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:52:54.734 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:52:54.734 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:52:54.734 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:52:54.734 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:52:54.734 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:52:54.734 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:52:54.734 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:52:54.734 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:52:54.734 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:52:54.734 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:52:54.734 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:52:54.734 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:52:54.734 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:52:54.735 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:52:54.735 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:52:54.735 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:52:54.735 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:52:54.735 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:52:54.735 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:52:54.735 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:52:54.735 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:54.735 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:52:54.735 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:54.735 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:52:54.735 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:54.735 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:52:54.735 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:52:54.736 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:52:54.736 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:52:54.736 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:54.736 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:52:54.736 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:52:54.736 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:54.736 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:54.736 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:54.736 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:52:54.736 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:52:54.736 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:54.736 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:54.736 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:54.736 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:54.737 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:52:54.737 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:52:54.737 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:52:54.737 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:52:54.737 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:52:54.737 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:54.737 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:54.737 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:52:54.737 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:52:54.737 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:52:54.737 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:52:54.737 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:54.737 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:52:54.737 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:52:54.738 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:54.738 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:54.738 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:54.738 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:52:54.738 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:52:54.738 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:54.738 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:54.738 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:54.738 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:54.738 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:52:54.738 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:52:54.738 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:52:54.738 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:52:54.739 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:52:54.739 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:54.739 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:54.739 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:52:54.739 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:52:54.739 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:52:54.739 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:52:54.739 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:54.739 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:52:54.739 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:52:54.739 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:54.739 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:54.739 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:54.740 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:52:54.740 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:52:54.740 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:54.740 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:54.740 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:54.740 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:54.740 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:52:54.740 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:52:54.740 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:52:54.740 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:52:54.740 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:52:54.740 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:54.740 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:54.741 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:54.741 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:52:54.741 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:52:54.741 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:54.741 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:52:54.741 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:54.741 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:52:54.741 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:54.741 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:54.741 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:52:54.741 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:54.741 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:52:54.741 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:54.741 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:52:54.742 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:54.742 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:54.742 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:52:54.742 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:54.742 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:52:54.742 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:54.742 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:52:54.742 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:54.742 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:54.742 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:52:54.742 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:54.742 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:52:54.742 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:54.743 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:52:54.743 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:54.743 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:54.743 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:52:54.743 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:54.743 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:52:54.743 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:54.743 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:54.743 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:54.743 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:52:54.743 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:52:54.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.674+0000 7f95d7200640 1 -- 172.21.15.8:0/1444669311 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f95b40676b0 msgr2=0x7f95b4069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:54.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.674+0000 7f95d7200640 1 --2- 172.21.15.8:0/1444669311 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f95b40676b0 0x7f95b4069b70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f95d01424a0 tx=0x7f95c0006ca0 comp rx=0 tx=0).stop 2024-03-23T23:52:54.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.674+0000 7f95d6800640 1 -- 172.21.15.8:0/1444669311 reap_dead start 2024-03-23T23:52:54.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.674+0000 7f95d7200640 1 -- 172.21.15.8:0/1444669311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95d013db40 msgr2=0x7f95d013dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:54.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.674+0000 7f95d7200640 1 --2- 172.21.15.8:0/1444669311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95d013db40 0x7f95d013dfd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f95c401c6d0 tx=0x7f95b8005840 comp rx=0 tx=0).stop 2024-03-23T23:52:54.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.674+0000 7f95d7200640 1 -- 172.21.15.8:0/1444669311 shutdown_connections 2024-03-23T23:52:54.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.674+0000 7f95d7200640 1 --2- 172.21.15.8:0/1444669311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95d013db40 0x7f95d013dfd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:54.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.674+0000 7f95d7200640 1 -- 172.21.15.8:0/1444669311 >> 172.21.15.8:0/1444669311 conn(0x7f95d00c3910 msgr2=0x7f95d0070d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:54.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.674+0000 7f95d7200640 1 -- 172.21.15.8:0/1444669311 shutdown_connections 2024-03-23T23:52:54.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:54.674+0000 7f95d7200640 1 -- 172.21.15.8:0/1444669311 wait complete. 2024-03-23T23:52:54.745 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:52:54.746 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T23:52:54.746 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:52:55.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.146+0000 7f2a51800640 1 Processor -- start 2024-03-23T23:52:55.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.150+0000 7f2a51800640 1 -- start start 2024-03-23T23:52:55.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.150+0000 7f2a51800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2a4c151bb0 0x7f2a4c0c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:55.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.150+0000 7f2a51800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2a4c151f90 0x7f2a4c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:55.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.150+0000 7f2a51800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a4c152400 0x7f2a4c06e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:55.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.150+0000 7f2a51800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a4c0c21f0 con 0x7f2a4c151bb0 2024-03-23T23:52:55.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.150+0000 7f2a51800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a4c071b60 con 0x7f2a4c151f90 2024-03-23T23:52:55.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.150+0000 7f2a51800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c071e40 con 0x7f2a4c152400 2024-03-23T23:52:55.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.154+0000 7f2a4a000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2a4c151f90 0x7f2a4c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:55.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.154+0000 7f2a4a000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2a4c151f90 0x7f2a4c06e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:43624/0 (socket says 172.21.15.8:43624) 2024-03-23T23:52:55.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.154+0000 7f2a4a000640 1 -- 172.21.15.8:0/2734183950 learned_addr learned my addr 172.21.15.8:0/2734183950 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:52:55.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.154+0000 7f2a4b400640 1 --2- 172.21.15.8:0/2734183950 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a4c152400 0x7f2a4c06e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:55.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.154+0000 7f2a4aa00640 1 --2- 172.21.15.8:0/2734183950 >> v2:172.21.15.8:3300/0 conn(0x7f2a4c151bb0 0x7f2a4c0c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:55.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.158+0000 7f2a4b400640 1 -- 172.21.15.8:0/2734183950 >> v2:172.21.15.196:3300/0 conn(0x7f2a4c151f90 msgr2=0x7f2a4c06e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:52:55.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.158+0000 7f2a4b400640 1 --2- 172.21.15.8:0/2734183950 >> v2:172.21.15.196:3300/0 conn(0x7f2a4c151f90 0x7f2a4c06e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:55.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.158+0000 7f2a4b400640 1 -- 172.21.15.8:0/2734183950 >> v2:172.21.15.8:3300/0 conn(0x7f2a4c151bb0 msgr2=0x7f2a4c0c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:52:55.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.158+0000 7f2a4b400640 1 --2- 172.21.15.8:0/2734183950 >> v2:172.21.15.8:3300/0 conn(0x7f2a4c151bb0 0x7f2a4c0c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:55.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.158+0000 7f2a4b400640 1 -- 172.21.15.8:0/2734183950 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4c072120 con 0x7f2a4c152400 2024-03-23T23:52:55.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.174+0000 7f2a4b400640 1 --2- 172.21.15.8:0/2734183950 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a4c152400 0x7f2a4c06e880 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c0c3330 tx=0x7f2a4401c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e67c18f520a85460 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:55.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.178+0000 7f2a49600640 1 -- 172.21.15.8:0/2734183950 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a440b1070 con 0x7f2a4c152400 2024-03-23T23:52:55.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.178+0000 7f2a49600640 1 -- 172.21.15.8:0/2734183950 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a440ac640 con 0x7f2a4c152400 2024-03-23T23:52:55.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.178+0000 7f2a49600640 1 -- 172.21.15.8:0/2734183950 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a440aca10 con 0x7f2a4c152400 2024-03-23T23:52:55.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.186+0000 7f2a51800640 1 -- 172.21.15.8:0/2734183950 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a4c152400 msgr2=0x7f2a4c06e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:55.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.186+0000 7f2a51800640 1 --2- 172.21.15.8:0/2734183950 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a4c152400 0x7f2a4c06e880 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c0c3330 tx=0x7f2a4401c850 comp rx=0 tx=0).stop 2024-03-23T23:52:55.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.190+0000 7f2a51800640 1 -- 172.21.15.8:0/2734183950 shutdown_connections 2024-03-23T23:52:55.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.190+0000 7f2a51800640 1 --2- 172.21.15.8:0/2734183950 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a4c152400 0x7f2a4c06e880 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:55.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.190+0000 7f2a51800640 1 --2- 172.21.15.8:0/2734183950 >> v2:172.21.15.196:3300/0 conn(0x7f2a4c151f90 0x7f2a4c06e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:55.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.190+0000 7f2a51800640 1 --2- 172.21.15.8:0/2734183950 >> v2:172.21.15.8:3300/0 conn(0x7f2a4c151bb0 0x7f2a4c0c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:55.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.190+0000 7f2a51800640 1 -- 172.21.15.8:0/2734183950 >> 172.21.15.8:0/2734183950 conn(0x7f2a4c0a9870 msgr2=0x7f2a4c06b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:55.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.190+0000 7f2a51800640 1 -- 172.21.15.8:0/2734183950 shutdown_connections 2024-03-23T23:52:55.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.190+0000 7f2a51800640 1 -- 172.21.15.8:0/2734183950 wait complete. 2024-03-23T23:52:55.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.202+0000 7f2a51800640 1 Processor -- start 2024-03-23T23:52:55.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.206+0000 7f2a51800640 1 -- start start 2024-03-23T23:52:55.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.210+0000 7f2a51800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a4c151bb0 0x7f2a4c0ac530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:55.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.210+0000 7f2a51800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2a4c151f90 0x7f2a4c1f5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:55.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.210+0000 7f2a51800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a4c152400 0x7f2a4c1f62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:55.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.210+0000 7f2a4a000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2a4c151f90 0x7f2a4c1f5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:55.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.210+0000 7f2a4a000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2a4c151f90 0x7f2a4c1f5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:43628/0 (socket says 172.21.15.8:43628) 2024-03-23T23:52:55.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.210+0000 7f2a4aa00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a4c151bb0 0x7f2a4c0ac530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:55.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.210+0000 7f2a4aa00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a4c151bb0 0x7f2a4c0ac530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:38912/0 (socket says 172.21.15.8:38912) 2024-03-23T23:52:55.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.210+0000 7f2a4a000640 1 -- 172.21.15.8:0/3493277414 learned_addr learned my addr 172.21.15.8:0/3493277414 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:52:55.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.210+0000 7f2a51800640 1 -- 172.21.15.8:0/3493277414 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c155200 con 0x7f2a4c152400 2024-03-23T23:52:55.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.214+0000 7f2a51800640 1 -- 172.21.15.8:0/3493277414 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c155080 con 0x7f2a4c151f90 2024-03-23T23:52:55.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.214+0000 7f2a51800640 1 -- 172.21.15.8:0/3493277414 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c155380 con 0x7f2a4c151bb0 2024-03-23T23:52:55.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.214+0000 7f2a4b400640 1 --2- 172.21.15.8:0/3493277414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a4c152400 0x7f2a4c1f62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:55.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.218+0000 7f2a4aa00640 1 -- 172.21.15.8:0/3493277414 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2a4c151f90 msgr2=0x7f2a4c1f5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:55.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.218+0000 7f2a4aa00640 1 --2- 172.21.15.8:0/3493277414 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2a4c151f90 0x7f2a4c1f5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:55.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.218+0000 7f2a4aa00640 1 -- 172.21.15.8:0/3493277414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a4c152400 msgr2=0x7f2a4c1f62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:55.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.218+0000 7f2a4aa00640 1 --2- 172.21.15.8:0/3493277414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a4c152400 0x7f2a4c1f62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:55.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.218+0000 7f2a4aa00640 1 -- 172.21.15.8:0/3493277414 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4c14add0 con 0x7f2a4c151bb0 2024-03-23T23:52:55.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.218+0000 7f2a4aa00640 1 --2- 172.21.15.8:0/3493277414 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a4c151bb0 0x7f2a4c0ac530 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c00d620 tx=0x7f2a3c00dae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:55.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.218+0000 7f2a42a00640 1 -- 172.21.15.8:0/3493277414 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c018020 con 0x7f2a4c151bb0 2024-03-23T23:52:55.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.218+0000 7f2a42a00640 1 -- 172.21.15.8:0/3493277414 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3c014620 con 0x7f2a4c151bb0 2024-03-23T23:52:55.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.218+0000 7f2a51800640 1 -- 172.21.15.8:0/3493277414 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a4c1f69c0 con 0x7f2a4c151bb0 2024-03-23T23:52:55.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.218+0000 7f2a42a00640 1 -- 172.21.15.8:0/3493277414 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c014a10 con 0x7f2a4c151bb0 2024-03-23T23:52:55.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.218+0000 7f2a51800640 1 -- 172.21.15.8:0/3493277414 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a4c14bd50 con 0x7f2a4c151bb0 2024-03-23T23:52:55.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.222+0000 7f2a51800640 1 --2- 172.21.15.8:0/3493277414 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a4c0aa390 0x7f2a4c149e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:55.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.222+0000 7f2a51800640 1 -- 172.21.15.8:0/3493277414 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c0aaeb0 con 0x7f2a4c0aa390 2024-03-23T23:52:55.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.226+0000 7f2a4a000640 1 --2- 172.21.15.8:0/3493277414 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a4c0aa390 0x7f2a4c149e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:55.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.226+0000 7f2a42a00640 1 -- 172.21.15.8:0/3493277414 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f2a3c01b020 con 0x7f2a4c151bb0 2024-03-23T23:52:55.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.230+0000 7f2a42a00640 1 --2- 172.21.15.8:0/3493277414 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2a2c067660 0x7f2a2c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:55.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.230+0000 7f2a4a000640 1 -- 172.21.15.8:0/3493277414 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2a4c1f6ca0 con 0x7f2a4c0aa390 2024-03-23T23:52:55.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.230+0000 7f2a4b400640 1 --2- 172.21.15.8:0/3493277414 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2a2c067660 0x7f2a2c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:55.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.234+0000 7f2a4b400640 1 --2- 172.21.15.8:0/3493277414 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2a2c067660 0x7f2a2c069b20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2a440ae000 tx=0x7f2a440a6070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:55.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.234+0000 7f2a4a000640 1 --2- 172.21.15.8:0/3493277414 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a4c0aa390 0x7f2a4c149e50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c14b490 tx=0x7f2a38003e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:55.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.234+0000 7f2a42a00640 1 -- 172.21.15.8:0/3493277414 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3800b040 con 0x7f2a4c0aa390 2024-03-23T23:52:55.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.234+0000 7f2a42a00640 1 -- 172.21.15.8:0/3493277414 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f2a3801a070 con 0x7f2a4c0aa390 2024-03-23T23:52:55.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.234+0000 7f2a42a00640 1 -- 172.21.15.8:0/3493277414 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a4c0aa390 msgr2=0x7f2a4c149e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:55.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.234+0000 7f2a42a00640 1 --2- 172.21.15.8:0/3493277414 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a4c0aa390 0x7f2a4c149e50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c14b490 tx=0x7f2a38003e00 comp rx=0 tx=0).stop 2024-03-23T23:52:55.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.234+0000 7f2a42a00640 1 -- 172.21.15.8:0/3493277414 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a4c0aa390 msgr2=0x7f2a4c149e50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:52:55.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.234+0000 7f2a42a00640 1 --2- 172.21.15.8:0/3493277414 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a4c0aa390 0x7f2a4c149e50 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c14b490 tx=0x7f2a38003e00 comp rx=0 tx=0).stop 2024-03-23T23:52:55.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.238+0000 7f2a42a00640 1 -- 172.21.15.8:0/3493277414 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f2a3c054540 con 0x7f2a4c151bb0 2024-03-23T23:52:55.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.254+0000 7f2a51800640 1 --2- 172.21.15.8:0/3493277414 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a4c15bc20 0x7f2a4c14a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:55.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.254+0000 7f2a51800640 1 -- 172.21.15.8:0/3493277414 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c14c0c0 con 0x7f2a4c15bc20 2024-03-23T23:52:55.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.254+0000 7f2a4a000640 1 --2- 172.21.15.8:0/3493277414 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a4c15bc20 0x7f2a4c14a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:55.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.258+0000 7f2a4a000640 1 -- 172.21.15.8:0/3493277414 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2a4c068270 con 0x7f2a4c15bc20 2024-03-23T23:52:55.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.258+0000 7f2a4a000640 1 --2- 172.21.15.8:0/3493277414 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a4c15bc20 0x7f2a4c14a390 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2a38019000 tx=0x7f2a380046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:55.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.258+0000 7f2a42a00640 1 -- 172.21.15.8:0/3493277414 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a38015a70 con 0x7f2a4c15bc20 2024-03-23T23:52:55.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.262+0000 7f2a42a00640 1 -- 172.21.15.8:0/3493277414 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5183 (secure 0 0 0) 0x7f2a38015a70 con 0x7f2a4c15bc20 2024-03-23T23:52:55.267 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:52:55.267 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:52:55.267 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:52:55.267 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:52:55.267 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 78, 2024-03-23T23:52:55.267 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:52:55.267 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:52:55.267 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:52:55.267 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:52:55.267 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:55.267 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 18, 2024-03-23T23:52:55.268 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:52:55.268 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:52:55.268 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:52:55.268 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:52:55.268 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:52:55.268 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:52:55.268 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:52:55.268 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:52:55.268 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:52:55.268 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:52:55.268 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:52:55.268 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:52:55.268 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:52:55.268 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:52:55.269 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:55.269 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:52:55.269 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:52:55.269 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:52:55.269 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:52:55.269 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:52:55.269 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:52:55.269 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:52:55.269 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:52:55.269 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:52:55.269 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:52:55.269 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:52:55.269 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:52:55.269 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:52:55.270 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:55.270 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:55.270 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:52:55.270 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:52:55.270 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:52:55.270 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:52:55.270 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:52:55.270 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:52:55.270 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:52:55.270 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:52:55.270 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:52:55.270 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:52:55.270 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:52:55.271 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:52:55.271 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:52:55.271 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:52:55.271 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:52:55.271 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:52:55.271 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:52:55.271 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:52:55.271 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:52:55.271 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:52:55.271 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:52:55.271 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:52:55.271 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:52:55.271 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:52:55.271 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:52:55.272 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:52:55.272 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:52:55.272 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:52:55.272 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:55.272 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:52:55.272 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:55.272 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:52:55.272 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:55.272 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:52:55.272 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:52:55.272 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:52:55.272 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:52:55.272 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:55.272 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:52:55.273 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:52:55.273 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:55.273 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:55.273 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:55.273 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:52:55.273 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:52:55.273 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:55.273 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:55.273 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:55.273 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:55.273 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:52:55.273 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:52:55.273 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:52:55.273 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:52:55.274 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:52:55.274 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:55.274 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:55.274 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:52:55.274 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:52:55.274 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:52:55.274 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:52:55.274 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:55.274 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:52:55.274 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:52:55.274 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:55.274 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:55.274 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:55.275 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:52:55.275 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:52:55.275 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:55.275 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:55.275 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:55.275 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:55.275 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:52:55.275 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:52:55.275 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:52:55.275 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:52:55.275 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:52:55.275 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:55.275 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:55.275 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:52:55.276 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:52:55.276 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:52:55.276 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:52:55.276 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:55.276 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:52:55.276 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:52:55.276 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:55.276 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:55.276 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:55.276 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:52:55.276 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:52:55.276 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:52:55.276 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:55.276 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:55.277 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:55.277 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:52:55.277 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:52:55.277 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:52:55.277 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:52:55.277 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:52:55.277 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:55.277 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:55.277 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:55.277 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:52:55.277 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:52:55.277 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:55.277 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:52:55.277 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:55.278 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:52:55.278 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:55.278 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:55.278 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:52:55.278 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:55.278 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:52:55.278 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:55.278 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:52:55.278 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:55.278 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:55.278 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:52:55.278 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:55.278 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:52:55.279 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:55.279 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5 2024-03-23T23:52:55.279 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:55.279 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:55.279 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:52:55.279 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:55.279 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:52:55.279 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:55.279 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:52:55.279 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:55.279 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:55.279 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:52:55.279 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:55.279 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:52:55.280 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:55.280 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:52:55.280 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:52:55.280 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:52:55.280 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:52:55.280 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:52:55.280 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:52:55.280 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:52:55.280 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:52:55.280 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:52:55.280 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:52:55.280 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:52:55.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.262+0000 7f2a42a00640 1 -- 172.21.15.8:0/3493277414 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a4c15bc20 msgr2=0x7f2a4c14a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:55.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.262+0000 7f2a42a00640 1 --2- 172.21.15.8:0/3493277414 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a4c15bc20 0x7f2a4c14a390 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2a38019000 tx=0x7f2a380046d0 comp rx=0 tx=0).stop 2024-03-23T23:52:55.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.262+0000 7f2a42a00640 1 -- 172.21.15.8:0/3493277414 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a4c15bc20 msgr2=0x7f2a4c14a390 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:52:55.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.270+0000 7f2a42a00640 1 --2- 172.21.15.8:0/3493277414 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a4c15bc20 0x7f2a4c14a390 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:55.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.270+0000 7f2a51800640 1 -- 172.21.15.8:0/3493277414 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2a2c067660 msgr2=0x7f2a2c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:55.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.270+0000 7f2a51800640 1 --2- 172.21.15.8:0/3493277414 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2a2c067660 0x7f2a2c069b20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2a440ae000 tx=0x7f2a440a6070 comp rx=0 tx=0).stop 2024-03-23T23:52:55.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.270+0000 7f2a51800640 1 -- 172.21.15.8:0/3493277414 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a4c151bb0 msgr2=0x7f2a4c0ac530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:55.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.270+0000 7f2a51800640 1 --2- 172.21.15.8:0/3493277414 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a4c151bb0 0x7f2a4c0ac530 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c00d620 tx=0x7f2a3c00dae0 comp rx=0 tx=0).stop 2024-03-23T23:52:55.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.270+0000 7f2a4b400640 1 -- 172.21.15.8:0/3493277414 reap_dead start 2024-03-23T23:52:55.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.270+0000 7f2a4b400640 1 -- 172.21.15.8:0/3493277414 reap_dead start 2024-03-23T23:52:55.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.270+0000 7f2a51800640 1 -- 172.21.15.8:0/3493277414 shutdown_connections 2024-03-23T23:52:55.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.270+0000 7f2a51800640 1 -- 172.21.15.8:0/3493277414 >> 172.21.15.8:0/3493277414 conn(0x7f2a4c0a9870 msgr2=0x7f2a4c06b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:55.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.270+0000 7f2a51800640 1 -- 172.21.15.8:0/3493277414 shutdown_connections 2024-03-23T23:52:55.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.270+0000 7f2a51800640 1 -- 172.21.15.8:0/3493277414 wait complete. 2024-03-23T23:52:55.329 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:52:55.329 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-03-23T23:52:55.329 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-03-23T23:52:55.329 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-03-23T23:52:55.330 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-03-23T23:52:55.330 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-23T23:52:55.330 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:52:55.367 INFO:tasks.ceph.mon.b:Stopped 2024-03-23T23:52:55.367 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-03-23T23:52:55.367 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:52:55.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.670+0000 7f034ce00640 1 Processor -- start 2024-03-23T23:52:55.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.670+0000 7f034ce00640 1 -- start start 2024-03-23T23:52:55.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.670+0000 7f034ce00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f034806f140 0x7f034806caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:55.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.670+0000 7f034ce00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f034814b5a0 0x7f034814ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:55.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.670+0000 7f034ce00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0348155e70 con 0x7f03480aa390 2024-03-23T23:52:55.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.670+0000 7f034ce00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03481550b0 con 0x7f034814b5a0 2024-03-23T23:52:55.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.670+0000 7f034ce00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0348155390 con 0x7f034806f140 2024-03-23T23:52:55.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.670+0000 7f0345e00640 1 -- >> v1:172.21.15.196:6789/0 conn(0x7f03480aa390 legacy=0x7f03480c3e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-03-23T23:52:55.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.670+0000 7f0346800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f034814b5a0 0x7f034814ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:55.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.674+0000 7f0346800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f034814b5a0 0x7f034814ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35716/0 (socket says 172.21.15.8:35716) 2024-03-23T23:52:55.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.674+0000 7f0346800640 1 -- 172.21.15.8:0/1281544972 learned_addr learned my addr 172.21.15.8:0/1281544972 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:52:55.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.674+0000 7f0346800640 1 -- 172.21.15.8:0/1281544972 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f034806f140 msgr2=0x7f034806caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:52:55.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.674+0000 7f0346800640 1 --2- 172.21.15.8:0/1281544972 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f034806f140 0x7f034806caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:55.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.674+0000 7f0346800640 1 -- 172.21.15.8:0/1281544972 >> v1:172.21.15.196:6789/0 conn(0x7f03480aa390 legacy=0x7f03480c3e60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:52:55.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.674+0000 7f0346800640 1 -- 172.21.15.8:0/1281544972 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0348155670 con 0x7f034814b5a0 2024-03-23T23:52:55.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.686+0000 7f0346800640 1 --2- 172.21.15.8:0/1281544972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f034814b5a0 0x7f034814ba10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0340009e50 tx=0x7f034001eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7edf68ccff36fca4 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:55.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.690+0000 7f0344a00640 1 -- 172.21.15.8:0/1281544972 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03400a79c0 con 0x7f034814b5a0 2024-03-23T23:52:55.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.690+0000 7f0344a00640 1 -- 172.21.15.8:0/1281544972 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03400a7b60 con 0x7f034814b5a0 2024-03-23T23:52:55.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.690+0000 7f0344a00640 1 -- 172.21.15.8:0/1281544972 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03400af3f0 con 0x7f034814b5a0 2024-03-23T23:52:55.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.690+0000 7f034ce00640 1 -- 172.21.15.8:0/1281544972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f034814b5a0 msgr2=0x7f034814ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:55.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.690+0000 7f034ce00640 1 --2- 172.21.15.8:0/1281544972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f034814b5a0 0x7f034814ba10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0340009e50 tx=0x7f034001eb70 comp rx=0 tx=0).stop 2024-03-23T23:52:55.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.690+0000 7f034ce00640 1 -- 172.21.15.8:0/1281544972 shutdown_connections 2024-03-23T23:52:55.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.690+0000 7f034ce00640 1 --2- 172.21.15.8:0/1281544972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f034814b5a0 0x7f034814ba10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:55.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.690+0000 7f034ce00640 1 --2- 172.21.15.8:0/1281544972 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f034806f140 0x7f034806caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:55.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.690+0000 7f034ce00640 1 -- 172.21.15.8:0/1281544972 >> 172.21.15.8:0/1281544972 conn(0x7f034806b170 msgr2=0x7f034806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:55.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.690+0000 7f034ce00640 1 -- 172.21.15.8:0/1281544972 shutdown_connections 2024-03-23T23:52:55.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.694+0000 7f034ce00640 1 -- 172.21.15.8:0/1281544972 wait complete. 2024-03-23T23:52:55.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.694+0000 7f034ce00640 1 Processor -- start 2024-03-23T23:52:55.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.702+0000 7f034ce00640 1 -- start start 2024-03-23T23:52:55.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.702+0000 7f034ce00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f034806f140 0x7f03481fe340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:55.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.702+0000 7f034ce00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03480aa390 0x7f0348150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:55.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.702+0000 7f034ce00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f034814b5a0 0x7f034814dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:55.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.702+0000 7f034ce00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0348152340 con 0x7f034806f140 2024-03-23T23:52:55.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.702+0000 7f034ce00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03481521c0 con 0x7f034814b5a0 2024-03-23T23:52:55.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.702+0000 7f034ce00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03481524c0 con 0x7f03480aa390 2024-03-23T23:52:55.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.702+0000 7f0346800640 1 -- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f034814b5a0 msgr2=0x7f034814dbc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:52:55.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.702+0000 7f0346800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f034814b5a0 0x7f034814dbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:52:55.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.702+0000 7f0345e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f034806f140 0x7f03481fe340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:55.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.702+0000 7f0345e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f034806f140 0x7f03481fe340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35720/0 (socket says 172.21.15.8:35720) 2024-03-23T23:52:55.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.702+0000 7f0345e00640 1 -- 172.21.15.8:0/1974464357 learned_addr learned my addr 172.21.15.8:0/1974464357 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:52:55.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.702+0000 7f0345400640 1 --2- 172.21.15.8:0/1974464357 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03480aa390 0x7f0348150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:55.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.706+0000 7f0345e00640 1 -- 172.21.15.8:0/1974464357 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03480aa390 msgr2=0x7f0348150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:55.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.706+0000 7f0345e00640 1 --2- 172.21.15.8:0/1974464357 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03480aa390 0x7f0348150840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:55.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.706+0000 7f0345e00640 1 -- 172.21.15.8:0/1974464357 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f034814b5a0 msgr2=0x7f034814dbc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:52:55.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.706+0000 7f0345e00640 1 --2- 172.21.15.8:0/1974464357 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f034814b5a0 0x7f034814dbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:55.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.706+0000 7f0345e00640 1 -- 172.21.15.8:0/1974464357 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03480aab70 con 0x7f034806f140 2024-03-23T23:52:55.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.706+0000 7f0345e00640 1 --2- 172.21.15.8:0/1974464357 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f034806f140 0x7f03481fe340 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f033800b4e0 tx=0x7f033800b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:55.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.710+0000 7f033e000640 1 -- 172.21.15.8:0/1974464357 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0338003d80 con 0x7f034806f140 2024-03-23T23:52:55.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.710+0000 7f033e000640 1 -- 172.21.15.8:0/1974464357 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0338015070 con 0x7f034806f140 2024-03-23T23:52:55.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.710+0000 7f033e000640 1 -- 172.21.15.8:0/1974464357 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03380052b0 con 0x7f034806f140 2024-03-23T23:52:55.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.710+0000 7f034ce00640 1 -- 172.21.15.8:0/1974464357 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f034806cc50 con 0x7f034806f140 2024-03-23T23:52:55.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.710+0000 7f034ce00640 1 -- 172.21.15.8:0/1974464357 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03480c5b80 con 0x7f034806f140 2024-03-23T23:52:55.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.714+0000 7f034ce00640 1 -- 172.21.15.8:0/1974464357 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f034804f480 con 0x7f034806f140 2024-03-23T23:52:55.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.714+0000 7f033e000640 1 -- 172.21.15.8:0/1974464357 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f0338005450 con 0x7f034806f140 2024-03-23T23:52:55.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.718+0000 7f033e000640 1 --2- 172.21.15.8:0/1974464357 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0328067610 0x7f0328069ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:55.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.718+0000 7f033e000640 1 -- 172.21.15.8:0/1974464357 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f0338086450 con 0x7f034806f140 2024-03-23T23:52:55.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.718+0000 7f0345400640 1 --2- 172.21.15.8:0/1974464357 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0328067610 0x7f0328069ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:55.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.726+0000 7f0345400640 1 --2- 172.21.15.8:0/1974464357 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0328067610 0x7f0328069ad0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0334006fd0 tx=0x7f0334008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:55.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:55.730+0000 7f033e000640 1 -- 172.21.15.8:0/1974464357 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f034806cc50 con 0x7f034806f140 2024-03-23T23:52:56.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:56.298+0000 7f034ce00640 1 -- 172.21.15.8:0/1974464357 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f03480c37b0 con 0x7f034806f140 2024-03-23T23:52:56.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:56.302+0000 7f033e000640 1 -- 172.21.15.8:0/1974464357 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1561 (secure 0 0 0) 0x7f034806cc50 con 0x7f034806f140 2024-03-23T23:52:56.302 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":78,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:52:56.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:56.302+0000 7f034ce00640 1 -- 172.21.15.8:0/1974464357 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0328067610 msgr2=0x7f0328069ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:56.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:56.302+0000 7f034ce00640 1 --2- 172.21.15.8:0/1974464357 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0328067610 0x7f0328069ad0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0334006fd0 tx=0x7f0334008040 comp rx=0 tx=0).stop 2024-03-23T23:52:56.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:56.302+0000 7f034ce00640 1 -- 172.21.15.8:0/1974464357 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f034806f140 msgr2=0x7f03481fe340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:56.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:56.302+0000 7f034ce00640 1 --2- 172.21.15.8:0/1974464357 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f034806f140 0x7f03481fe340 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f033800b4e0 tx=0x7f033800b9a0 comp rx=0 tx=0).stop 2024-03-23T23:52:56.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:56.302+0000 7f034ce00640 1 -- 172.21.15.8:0/1974464357 shutdown_connections 2024-03-23T23:52:56.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:56.302+0000 7f034ce00640 1 --2- 172.21.15.8:0/1974464357 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f034814b5a0 0x7f034814dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:56.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:56.302+0000 7f034ce00640 1 --2- 172.21.15.8:0/1974464357 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0328067610 0x7f0328069ad0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:56.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:56.302+0000 7f034ce00640 1 --2- 172.21.15.8:0/1974464357 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f03480aa390 0x7f0348150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:56.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:56.302+0000 7f034ce00640 1 --2- 172.21.15.8:0/1974464357 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f034806f140 0x7f03481fe340 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:56.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:56.302+0000 7f034ce00640 1 -- 172.21.15.8:0/1974464357 >> 172.21.15.8:0/1974464357 conn(0x7f034806b170 msgr2=0x7f03481488a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:56.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:56.306+0000 7f034ce00640 1 -- 172.21.15.8:0/1974464357 shutdown_connections 2024-03-23T23:52:56.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:56.306+0000 7f034ce00640 1 -- 172.21.15.8:0/1974464357 wait complete. 2024-03-23T23:52:59.337 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:52:59.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.642+0000 7f6a13200640 1 Processor -- start 2024-03-23T23:52:59.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.642+0000 7f6a13200640 1 -- start start 2024-03-23T23:52:59.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.642+0000 7f6a13200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6a0c0aee20 0x7f6a0c0ae7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:59.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.642+0000 7f6a13200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a0c0c6fe0 0x7f6a0c0c7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:59.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.642+0000 7f6a13200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a0c1537c0 con 0x7f6a0c150c70 2024-03-23T23:52:59.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.642+0000 7f6a13200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a0c1543d0 con 0x7f6a0c0aee20 2024-03-23T23:52:59.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.642+0000 7f6a13200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c151050 con 0x7f6a0c0c6fe0 2024-03-23T23:52:59.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.642+0000 7f6a03e00640 1 -- >> v2:172.21.15.196:3300/0 conn(0x7f6a0c0aee20 msgr2=0x7f6a0c0ae7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:52:59.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.642+0000 7f6a03e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6a0c0aee20 0x7f6a0c0ae7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:52:59.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.642+0000 7f6a0be00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f6a0c150c70 0x7f6a0c0710c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:57322/0 (socket says 172.21.15.8:57322) 2024-03-23T23:52:59.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.642+0000 7f6a0be00640 1 -- 172.21.15.8:0/223793713 learned_addr learned my addr 172.21.15.8:0/223793713 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:52:59.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.642+0000 7f6a11200640 1 --2- 172.21.15.8:0/223793713 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a0c0c6fe0 0x7f6a0c0c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:59.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.646+0000 7f6a0b400640 1 -- 172.21.15.8:0/223793713 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 874451536 0 0) 0x7f6a0c1537c0 con 0x7f6a0c150c70 2024-03-23T23:52:59.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.646+0000 7f6a0b400640 1 -- 172.21.15.8:0/223793713 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69f0003530 con 0x7f6a0c150c70 2024-03-23T23:52:59.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.646+0000 7f6a0b400640 1 -- 172.21.15.8:0/223793713 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3525362013 0 0) 0x7f69f0003530 con 0x7f6a0c150c70 2024-03-23T23:52:59.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.646+0000 7f6a0b400640 1 -- 172.21.15.8:0/223793713 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a0c0c6fe0 msgr2=0x7f6a0c0c7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:52:59.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.646+0000 7f6a0b400640 1 --2- 172.21.15.8:0/223793713 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a0c0c6fe0 0x7f6a0c0c7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:59.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.646+0000 7f6a0b400640 1 -- 172.21.15.8:0/223793713 >> v2:172.21.15.196:3300/0 conn(0x7f6a0c0aee20 msgr2=0x7f6a0c0ae7d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:52:59.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.646+0000 7f6a0b400640 1 --2- 172.21.15.8:0/223793713 >> v2:172.21.15.196:3300/0 conn(0x7f6a0c0aee20 0x7f6a0c0ae7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:59.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.646+0000 7f6a0b400640 1 -- 172.21.15.8:0/223793713 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0c153aa0 con 0x7f6a0c150c70 2024-03-23T23:52:59.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.646+0000 7f6a0b400640 1 -- 172.21.15.8:0/223793713 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7f69fc001680 con 0x7f6a0c150c70 2024-03-23T23:52:59.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.646+0000 7f6a0b400640 1 -- 172.21.15.8:0/223793713 >> v1:172.21.15.8:6789/0 conn(0x7f6a0c150c70 legacy=0x7f6a0c0710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:59.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.646+0000 7f6a0b400640 1 --2- 172.21.15.8:0/223793713 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69f0003a30 0x7f69f0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:59.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.646+0000 7f6a0b400640 1 --2- 172.21.15.8:0/223793713 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a0c0c6fe0 0x7f69f0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:59.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.646+0000 7f6a0b400640 1 --2- 172.21.15.8:0/223793713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69f0004d50 0x7f69f00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:59.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.646+0000 7f6a0b400640 1 -- 172.21.15.8:0/223793713 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c1543d0 con 0x7f69f0004d50 2024-03-23T23:52:59.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.646+0000 7f6a0b400640 1 -- 172.21.15.8:0/223793713 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c151050 con 0x7f69f0003a30 2024-03-23T23:52:59.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.646+0000 7f6a0b400640 1 -- 172.21.15.8:0/223793713 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f000ff10 con 0x7f6a0c0c6fe0 2024-03-23T23:52:59.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.646+0000 7f6a0be00640 1 -- 172.21.15.8:0/223793713 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69f0003a30 msgr2=0x7f69f0003e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:52:59.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.646+0000 7f6a0be00640 1 --2- 172.21.15.8:0/223793713 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69f0003a30 0x7f69f0003e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:52:59.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.646+0000 7f6a11200640 1 --2- 172.21.15.8:0/223793713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69f0004d50 0x7f69f00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:59.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.646+0000 7f6a03e00640 1 --2- 172.21.15.8:0/223793713 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a0c0c6fe0 0x7f69f0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:59.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.646+0000 7f6a11200640 1 -- 172.21.15.8:0/223793713 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a0c0c6fe0 msgr2=0x7f69f0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:52:59.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.646+0000 7f6a11200640 1 --2- 172.21.15.8:0/223793713 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a0c0c6fe0 0x7f69f0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:59.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.646+0000 7f6a11200640 1 -- 172.21.15.8:0/223793713 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69f0003a30 msgr2=0x7f69f0003e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:52:59.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.646+0000 7f6a11200640 1 --2- 172.21.15.8:0/223793713 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69f0003a30 0x7f69f0003e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:59.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.646+0000 7f6a11200640 1 -- 172.21.15.8:0/223793713 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f0003530 con 0x7f69f0004d50 2024-03-23T23:52:59.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.654+0000 7f6a11200640 1 --2- 172.21.15.8:0/223793713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69f0004d50 0x7f69f00051d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6a04009fc0 tx=0x7f6a0401cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa98b063126978cd server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:59.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.654+0000 7f6a0b400640 1 -- 172.21.15.8:0/223793713 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a040b2070 con 0x7f69f0004d50 2024-03-23T23:52:59.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.654+0000 7f6a0b400640 1 -- 172.21.15.8:0/223793713 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a040a5c90 con 0x7f69f0004d50 2024-03-23T23:52:59.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.654+0000 7f6a0b400640 1 -- 172.21.15.8:0/223793713 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a04009c10 con 0x7f69f0004d50 2024-03-23T23:52:59.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.654+0000 7f6a13200640 1 -- 172.21.15.8:0/223793713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69f0004d50 msgr2=0x7f69f00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:52:59.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.654+0000 7f6a13200640 1 --2- 172.21.15.8:0/223793713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69f0004d50 0x7f69f00051d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6a04009fc0 tx=0x7f6a0401cce0 comp rx=0 tx=0).stop 2024-03-23T23:52:59.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.654+0000 7f6a11200640 1 -- 172.21.15.8:0/223793713 reap_dead start 2024-03-23T23:52:59.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.654+0000 7f6a13200640 1 -- 172.21.15.8:0/223793713 shutdown_connections 2024-03-23T23:52:59.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.654+0000 7f6a13200640 1 -- 172.21.15.8:0/223793713 >> 172.21.15.8:0/223793713 conn(0x7f6a0c0c8fe0 msgr2=0x7f6a0c0c93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:52:59.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.654+0000 7f6a13200640 1 -- 172.21.15.8:0/223793713 shutdown_connections 2024-03-23T23:52:59.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.654+0000 7f6a13200640 1 -- 172.21.15.8:0/223793713 wait complete. 2024-03-23T23:52:59.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.658+0000 7f6a13200640 1 Processor -- start 2024-03-23T23:52:59.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.658+0000 7f6a13200640 1 -- start start 2024-03-23T23:52:59.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.658+0000 7f6a13200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69f0004d50 0x7f6a0c0ad550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:59.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.658+0000 7f6a13200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a0c1453f0 0x7f6a0c0ada90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:59.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.658+0000 7f6a13200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a0c138e90 0x7f6a0c139310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:59.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.658+0000 7f6a13200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c0717d0 con 0x7f6a0c138e90 2024-03-23T23:52:59.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.658+0000 7f6a13200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c154060 con 0x7f69f0004d50 2024-03-23T23:52:59.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.658+0000 7f6a13200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c071950 con 0x7f6a0c1453f0 2024-03-23T23:52:59.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.658+0000 7f6a11200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a0c138e90 0x7f6a0c139310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:59.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.658+0000 7f6a11200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a0c138e90 0x7f6a0c139310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35728/0 (socket says 172.21.15.8:35728) 2024-03-23T23:52:59.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.658+0000 7f6a11200640 1 -- 172.21.15.8:0/1752647082 learned_addr learned my addr 172.21.15.8:0/1752647082 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:52:59.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.658+0000 7f6a0be00640 1 -- 172.21.15.8:0/1752647082 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69f0004d50 msgr2=0x7f6a0c0ad550 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:52:59.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.658+0000 7f6a0be00640 1 --2- 172.21.15.8:0/1752647082 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69f0004d50 0x7f6a0c0ad550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:52:59.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.658+0000 7f6a11200640 1 -- 172.21.15.8:0/1752647082 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a0c1453f0 msgr2=0x7f6a0c0ada90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-23T23:52:59.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.658+0000 7f6a11200640 1 --2- 172.21.15.8:0/1752647082 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a0c1453f0 0x7f6a0c0ada90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:59.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.658+0000 7f6a11200640 1 -- 172.21.15.8:0/1752647082 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69f0004d50 msgr2=0x7f6a0c0ad550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:52:59.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.658+0000 7f6a11200640 1 --2- 172.21.15.8:0/1752647082 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69f0004d50 0x7f6a0c0ad550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:52:59.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.658+0000 7f6a11200640 1 -- 172.21.15.8:0/1752647082 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0c151b00 con 0x7f6a0c138e90 2024-03-23T23:52:59.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.658+0000 7f6a11200640 1 --2- 172.21.15.8:0/1752647082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a0c138e90 0x7f6a0c139310 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6a04002240 tx=0x7f6a04009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:52:59.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.658+0000 7f6a08c00640 1 -- 172.21.15.8:0/1752647082 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a040b2040 con 0x7f6a0c138e90 2024-03-23T23:52:59.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.662+0000 7f6a08c00640 1 -- 172.21.15.8:0/1752647082 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a040a5a90 con 0x7f6a0c138e90 2024-03-23T23:52:59.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.662+0000 7f6a08c00640 1 -- 172.21.15.8:0/1752647082 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a04009c10 con 0x7f6a0c138e90 2024-03-23T23:52:59.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.662+0000 7f6a13200640 1 -- 172.21.15.8:0/1752647082 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a0c145b90 con 0x7f6a0c138e90 2024-03-23T23:52:59.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.662+0000 7f6a13200640 1 -- 172.21.15.8:0/1752647082 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a0c1e7db0 con 0x7f6a0c138e90 2024-03-23T23:52:59.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.662+0000 7f6a13200640 1 -- 172.21.15.8:0/1752647082 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a0c04f480 con 0x7f6a0c138e90 2024-03-23T23:52:59.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.666+0000 7f6a08c00640 1 -- 172.21.15.8:0/1752647082 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f6a040be020 con 0x7f6a0c138e90 2024-03-23T23:52:59.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.666+0000 7f6a08c00640 1 --2- 172.21.15.8:0/1752647082 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f69e8067610 0x7f69e8069ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:52:59.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.666+0000 7f6a08c00640 1 -- 172.21.15.8:0/1752647082 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f6a04120ae0 con 0x7f6a0c138e90 2024-03-23T23:52:59.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.666+0000 7f6a0be00640 1 --2- 172.21.15.8:0/1752647082 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f69e8067610 0x7f69e8069ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:52:59.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.670+0000 7f6a08c00640 1 -- 172.21.15.8:0/1752647082 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f6a040169f0 con 0x7f6a0c138e90 2024-03-23T23:52:59.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:52:59.674+0000 7f6a0be00640 1 --2- 172.21.15.8:0/1752647082 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f69e8067610 0x7f69e8069ad0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f69fc001ec0 tx=0x7f69fc0015d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:00.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:00.002+0000 7f6a13200640 1 -- 172.21.15.8:0/1752647082 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f6a0c14fbb0 con 0x7f6a0c138e90 2024-03-23T23:53:00.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:00.006+0000 7f6a08c00640 1 -- 172.21.15.8:0/1752647082 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1561 (secure 0 0 0) 0x7f6a040f14a0 con 0x7f6a0c138e90 2024-03-23T23:53:00.006 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":78,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:53:00.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:00.010+0000 7f6a13200640 1 -- 172.21.15.8:0/1752647082 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f69e8067610 msgr2=0x7f69e8069ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:00.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:00.010+0000 7f6a13200640 1 --2- 172.21.15.8:0/1752647082 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f69e8067610 0x7f69e8069ad0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f69fc001ec0 tx=0x7f69fc0015d0 comp rx=0 tx=0).stop 2024-03-23T23:53:00.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:00.010+0000 7f6a13200640 1 -- 172.21.15.8:0/1752647082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a0c138e90 msgr2=0x7f6a0c139310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:00.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:00.010+0000 7f6a13200640 1 --2- 172.21.15.8:0/1752647082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a0c138e90 0x7f6a0c139310 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6a04002240 tx=0x7f6a04009750 comp rx=0 tx=0).stop 2024-03-23T23:53:00.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:00.010+0000 7f6a13200640 1 -- 172.21.15.8:0/1752647082 shutdown_connections 2024-03-23T23:53:00.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:00.010+0000 7f6a13200640 1 --2- 172.21.15.8:0/1752647082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a0c138e90 0x7f6a0c139310 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:00.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:00.010+0000 7f6a13200640 1 --2- 172.21.15.8:0/1752647082 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f69e8067610 0x7f69e8069ad0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:00.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:00.010+0000 7f6a13200640 1 --2- 172.21.15.8:0/1752647082 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a0c1453f0 0x7f6a0c0ada90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:00.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:00.010+0000 7f6a13200640 1 --2- 172.21.15.8:0/1752647082 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69f0004d50 0x7f6a0c0ad550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:00.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:00.010+0000 7f6a13200640 1 -- 172.21.15.8:0/1752647082 >> 172.21.15.8:0/1752647082 conn(0x7f6a0c0c8fe0 msgr2=0x7f6a0c0c31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:53:00.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:00.010+0000 7f6a13200640 1 -- 172.21.15.8:0/1752647082 shutdown_connections 2024-03-23T23:53:00.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:00.010+0000 7f6a13200640 1 -- 172.21.15.8:0/1752647082 wait complete. 2024-03-23T23:53:03.054 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:53:03.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.466+0000 7f7452800640 1 Processor -- start 2024-03-23T23:53:03.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.466+0000 7f7452800640 1 -- start start 2024-03-23T23:53:03.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.466+0000 7f7452800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f74440d7b00 0x7f7444007230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:03.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.466+0000 7f7452800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f74440432a0 0x7f744400e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:03.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.466+0000 7f7452800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74440dae60 con 0x7f744404db10 2024-03-23T23:53:03.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.466+0000 7f7452800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f744404abe0 con 0x7f74440d7b00 2024-03-23T23:53:03.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.466+0000 7f7452800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74440db140 con 0x7f74440432a0 2024-03-23T23:53:03.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.466+0000 7f7451400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f74440d7b00 0x7f7444007230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:03.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.466+0000 7f7451400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f74440d7b00 0x7f7444007230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49420/0 (socket says 172.21.15.8:49420) 2024-03-23T23:53:03.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.466+0000 7f7451400640 1 -- 172.21.15.8:0/988484582 learned_addr learned my addr 172.21.15.8:0/988484582 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:53:03.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.470+0000 7f7451e00640 1 --2- 172.21.15.8:0/988484582 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f74440432a0 0x7f744400e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:03.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.470+0000 7f7451400640 1 -- 172.21.15.8:0/988484582 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f74440432a0 msgr2=0x7f744400e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:53:03.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.470+0000 7f7451400640 1 --2- 172.21.15.8:0/988484582 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f74440432a0 0x7f744400e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:03.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.470+0000 7f7451400640 1 -- 172.21.15.8:0/988484582 >> v1:172.21.15.8:6789/0 conn(0x7f744404db10 legacy=0x7f744400e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:03.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.470+0000 7f7451400640 1 -- 172.21.15.8:0/988484582 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744404a590 con 0x7f74440d7b00 2024-03-23T23:53:03.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.470+0000 7f7451e00640 1 --2- 172.21.15.8:0/988484582 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f74440432a0 0x7f744400e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:53:03.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.482+0000 7f7451400640 1 --2- 172.21.15.8:0/988484582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74440d7b00 0x7f7444007230 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7440009870 tx=0x7f744001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5caa9f9298fbbf25 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:03.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.482+0000 7f744be00640 1 -- 172.21.15.8:0/988484582 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74400b2070 con 0x7f74440d7b00 2024-03-23T23:53:03.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.482+0000 7f744be00640 1 -- 172.21.15.8:0/988484582 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74400ad640 con 0x7f74440d7b00 2024-03-23T23:53:03.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.482+0000 7f744be00640 1 -- 172.21.15.8:0/988484582 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74400ada10 con 0x7f74440d7b00 2024-03-23T23:53:03.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.486+0000 7f7452800640 1 -- 172.21.15.8:0/988484582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74440d7b00 msgr2=0x7f7444007230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:03.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.486+0000 7f7452800640 1 --2- 172.21.15.8:0/988484582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74440d7b00 0x7f7444007230 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7440009870 tx=0x7f744001c560 comp rx=0 tx=0).stop 2024-03-23T23:53:03.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.486+0000 7f7452800640 1 -- 172.21.15.8:0/988484582 shutdown_connections 2024-03-23T23:53:03.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.486+0000 7f7452800640 1 --2- 172.21.15.8:0/988484582 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f74440432a0 0x7f744400e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:03.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.486+0000 7f7452800640 1 --2- 172.21.15.8:0/988484582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74440d7b00 0x7f7444007230 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:03.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.486+0000 7f7452800640 1 -- 172.21.15.8:0/988484582 >> 172.21.15.8:0/988484582 conn(0x7f744404c690 msgr2=0x7f744404caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:53:03.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.486+0000 7f7452800640 1 -- 172.21.15.8:0/988484582 shutdown_connections 2024-03-23T23:53:03.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.486+0000 7f7452800640 1 -- 172.21.15.8:0/988484582 wait complete. 2024-03-23T23:53:03.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.490+0000 7f7452800640 1 Processor -- start 2024-03-23T23:53:03.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.490+0000 7f7452800640 1 -- start start 2024-03-23T23:53:03.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.490+0000 7f7452800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74440432a0 0x7f7444047f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:03.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.490+0000 7f7452800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f744404db10 0x7f7444048b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:03.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.490+0000 7f7452800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7444049070 0x7f74440dc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:03.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.490+0000 7f7452800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74440e75d0 con 0x7f744404db10 2024-03-23T23:53:03.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.490+0000 7f7452800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74440e7450 con 0x7f74440432a0 2024-03-23T23:53:03.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.490+0000 7f7452800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74440e7750 con 0x7f7444049070 2024-03-23T23:53:03.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.494+0000 7f7451400640 1 -- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74440432a0 msgr2=0x7f7444047f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:53:03.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.494+0000 7f7451400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74440432a0 0x7f7444047f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:53:03.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.494+0000 7f7450a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f744404db10 0x7f7444048b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:03.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.494+0000 7f7450a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f744404db10 0x7f7444048b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49426/0 (socket says 172.21.15.8:49426) 2024-03-23T23:53:03.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.494+0000 7f7450a00640 1 -- 172.21.15.8:0/1145254771 learned_addr learned my addr 172.21.15.8:0/1145254771 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:53:03.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.494+0000 7f7451e00640 1 --2- 172.21.15.8:0/1145254771 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7444049070 0x7f74440dc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:03.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.494+0000 7f7450a00640 1 -- 172.21.15.8:0/1145254771 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7444049070 msgr2=0x7f74440dc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:03.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.494+0000 7f7450a00640 1 --2- 172.21.15.8:0/1145254771 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7444049070 0x7f74440dc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:03.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.494+0000 7f7450a00640 1 -- 172.21.15.8:0/1145254771 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74440432a0 msgr2=0x7f7444047f80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:53:03.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.494+0000 7f7450a00640 1 --2- 172.21.15.8:0/1145254771 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74440432a0 0x7f7444047f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:03.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.494+0000 7f7450a00640 1 -- 172.21.15.8:0/1145254771 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74440d6ed0 con 0x7f744404db10 2024-03-23T23:53:03.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.498+0000 7f7450a00640 1 --2- 172.21.15.8:0/1145254771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f744404db10 0x7f7444048b30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f743800c430 tx=0x7f743800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:03.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.498+0000 7f7449600640 1 -- 172.21.15.8:0/1145254771 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74380052d0 con 0x7f744404db10 2024-03-23T23:53:03.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.502+0000 7f7449600640 1 -- 172.21.15.8:0/1145254771 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7438005470 con 0x7f744404db10 2024-03-23T23:53:03.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.502+0000 7f7449600640 1 -- 172.21.15.8:0/1145254771 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7438007260 con 0x7f744404db10 2024-03-23T23:53:03.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.502+0000 7f7452800640 1 -- 172.21.15.8:0/1145254771 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7444042c60 con 0x7f744404db10 2024-03-23T23:53:03.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.502+0000 7f7452800640 1 -- 172.21.15.8:0/1145254771 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7444047210 con 0x7f744404db10 2024-03-23T23:53:03.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.506+0000 7f7452800640 1 -- 172.21.15.8:0/1145254771 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74440052d0 con 0x7f744404db10 2024-03-23T23:53:03.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.506+0000 7f7449600640 1 -- 172.21.15.8:0/1145254771 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f7438007400 con 0x7f744404db10 2024-03-23T23:53:03.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.510+0000 7f7449600640 1 --2- 172.21.15.8:0/1145254771 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f742c067690 0x7f742c069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:03.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.518+0000 7f7451400640 1 --2- 172.21.15.8:0/1145254771 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f742c067690 0x7f742c069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:03.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.518+0000 7f7449600640 1 -- 172.21.15.8:0/1145254771 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f74380531f0 con 0x7f744404db10 2024-03-23T23:53:03.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.522+0000 7f7451400640 1 --2- 172.21.15.8:0/1145254771 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f742c067690 0x7f742c069b50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f74400af000 tx=0x7f7440008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:03.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:03.522+0000 7f7449600640 1 -- 172.21.15.8:0/1145254771 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f7438055850 con 0x7f744404db10 2024-03-23T23:53:04.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:04.050+0000 7f7452800640 1 -- 172.21.15.8:0/1145254771 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f74440d6960 con 0x7f744404db10 2024-03-23T23:53:04.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:04.050+0000 7f7449600640 1 -- 172.21.15.8:0/1145254771 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1561 (secure 0 0 0) 0x7f7438055850 con 0x7f744404db10 2024-03-23T23:53:04.052 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":78,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":26,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:53:04.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:04.058+0000 7f7452800640 1 -- 172.21.15.8:0/1145254771 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f742c067690 msgr2=0x7f742c069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:04.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:04.058+0000 7f7452800640 1 --2- 172.21.15.8:0/1145254771 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f742c067690 0x7f742c069b50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f74400af000 tx=0x7f7440008040 comp rx=0 tx=0).stop 2024-03-23T23:53:04.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:04.058+0000 7f7452800640 1 -- 172.21.15.8:0/1145254771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f744404db10 msgr2=0x7f7444048b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:04.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:04.058+0000 7f7452800640 1 --2- 172.21.15.8:0/1145254771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f744404db10 0x7f7444048b30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f743800c430 tx=0x7f743800c8f0 comp rx=0 tx=0).stop 2024-03-23T23:53:04.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:04.058+0000 7f7452800640 1 -- 172.21.15.8:0/1145254771 shutdown_connections 2024-03-23T23:53:04.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:04.062+0000 7f7452800640 1 --2- 172.21.15.8:0/1145254771 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f742c067690 0x7f742c069b50 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:04.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:04.062+0000 7f7452800640 1 --2- 172.21.15.8:0/1145254771 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7444049070 0x7f74440dc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:04.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:04.062+0000 7f7452800640 1 --2- 172.21.15.8:0/1145254771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f744404db10 0x7f7444048b30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:04.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:04.062+0000 7f7452800640 1 --2- 172.21.15.8:0/1145254771 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74440432a0 0x7f7444047f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:04.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:04.062+0000 7f7452800640 1 -- 172.21.15.8:0/1145254771 >> 172.21.15.8:0/1145254771 conn(0x7f744404c690 msgr2=0x7f74440d3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:53:04.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:04.062+0000 7f7452800640 1 -- 172.21.15.8:0/1145254771 shutdown_connections 2024-03-23T23:53:04.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:04.062+0000 7f7452800640 1 -- 172.21.15.8:0/1145254771 wait complete. 2024-03-23T23:53:07.096 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:53:07.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:07.506+0000 7f39cda00640 1 Processor -- start 2024-03-23T23:53:07.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:07.506+0000 7f39cda00640 1 -- start start 2024-03-23T23:53:07.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:07.510+0000 7f39cda00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f39c80aba70 0x7f39c814ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:07.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:07.510+0000 7f39c6000640 1 -- >> v2:172.21.15.196:3300/0 conn(0x7f39c80aba70 msgr2=0x7f39c814ebe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:53:07.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:07.510+0000 7f39c6000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f39c80aba70 0x7f39c814ebe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:53:07.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:07.510+0000 7f39cda00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39c8073500 con 0x7f39c814f120 2024-03-23T23:53:07.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:07.510+0000 7f39cda00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39c8152670 con 0x7f39c8071620 2024-03-23T23:53:07.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:07.510+0000 7f39cda00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c8152420 con 0x7f39c80aba70 2024-03-23T23:53:07.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:07.510+0000 7f39c7400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f39c814f120 0x7f39c815c280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:37404/0 (socket says 172.21.15.8:37404) 2024-03-23T23:53:07.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:07.510+0000 7f39c7400640 1 -- 172.21.15.8:0/2965701373 learned_addr learned my addr 172.21.15.8:0/2965701373 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:53:07.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:07.510+0000 7f39c6a00640 1 -- 172.21.15.8:0/2965701373 >> v1:172.21.15.196:6789/0 conn(0x7f39c8071620 legacy=0x7f39c80c1e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-03-23T23:53:07.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:07.714+0000 7f39c6000640 1 -- 172.21.15.8:0/2965701373 >> v2:172.21.15.196:3300/0 conn(0x7f39c80aba70 msgr2=0x7f39c814ebe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:53:07.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:07.714+0000 7f39c6000640 1 --2- 172.21.15.8:0/2965701373 >> v2:172.21.15.196:3300/0 conn(0x7f39c80aba70 0x7f39c814ebe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:53:07.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:07.718+0000 7f39c6a00640 1 -- 172.21.15.8:0/2965701373 >> v1:172.21.15.196:6789/0 conn(0x7f39c8071620 legacy=0x7f39c80c1e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-03-23T23:53:08.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:08.118+0000 7f39c6000640 1 -- 172.21.15.8:0/2965701373 >> v2:172.21.15.196:3300/0 conn(0x7f39c80aba70 msgr2=0x7f39c814ebe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:53:08.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:08.118+0000 7f39c6000640 1 --2- 172.21.15.8:0/2965701373 >> v2:172.21.15.196:3300/0 conn(0x7f39c80aba70 0x7f39c814ebe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:53:08.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:08.122+0000 7f39c6a00640 1 -- 172.21.15.8:0/2965701373 >> v1:172.21.15.196:6789/0 conn(0x7f39c8071620 legacy=0x7f39c80c1e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-03-23T23:53:08.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:08.922+0000 7f39c6000640 1 -- 172.21.15.8:0/2965701373 >> v2:172.21.15.196:3300/0 conn(0x7f39c80aba70 msgr2=0x7f39c814ebe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:53:08.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:08.922+0000 7f39c6000640 1 --2- 172.21.15.8:0/2965701373 >> v2:172.21.15.196:3300/0 conn(0x7f39c80aba70 0x7f39c814ebe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:53:08.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:08.926+0000 7f39c6a00640 1 -- 172.21.15.8:0/2965701373 >> v1:172.21.15.196:6789/0 conn(0x7f39c8071620 legacy=0x7f39c80c1e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-03-23T23:53:10.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.290+0000 7f39c5600640 1 -- 172.21.15.8:0/2965701373 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 721031534 0 0) 0x7f39c8073500 con 0x7f39c814f120 2024-03-23T23:53:10.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.290+0000 7f39c5600640 1 -- 172.21.15.8:0/2965701373 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39ac003530 con 0x7f39c814f120 2024-03-23T23:53:10.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.290+0000 7f39c5600640 1 -- 172.21.15.8:0/2965701373 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2562488301 0 0) 0x7f39ac003530 con 0x7f39c814f120 2024-03-23T23:53:10.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.290+0000 7f39c5600640 1 -- 172.21.15.8:0/2965701373 >> v2:172.21.15.196:3300/0 conn(0x7f39c80aba70 msgr2=0x7f39c814ebe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:53:10.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.290+0000 7f39c5600640 1 --2- 172.21.15.8:0/2965701373 >> v2:172.21.15.196:3300/0 conn(0x7f39c80aba70 0x7f39c814ebe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:10.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.290+0000 7f39c5600640 1 -- 172.21.15.8:0/2965701373 >> v1:172.21.15.196:6789/0 conn(0x7f39c8071620 legacy=0x7f39c80c1e80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:53:10.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.290+0000 7f39c5600640 1 -- 172.21.15.8:0/2965701373 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c8155040 con 0x7f39c814f120 2024-03-23T23:53:10.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.294+0000 7f39c5600640 1 -- 172.21.15.8:0/2965701373 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7f39b8001900 con 0x7f39c814f120 2024-03-23T23:53:10.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.294+0000 7f39c5600640 1 -- 172.21.15.8:0/2965701373 >> v1:172.21.15.8:6789/0 conn(0x7f39c814f120 legacy=0x7f39c815c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:10.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.294+0000 7f39c5600640 1 --2- 172.21.15.8:0/2965701373 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39ac003a30 0x7f39ac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:10.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.294+0000 7f39c5600640 1 --2- 172.21.15.8:0/2965701373 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39ac004810 0x7f39ac004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:10.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.294+0000 7f39c5600640 1 --2- 172.21.15.8:0/2965701373 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39ac0053d0 0x7f39ac0079b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:10.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.294+0000 7f39c5600640 1 -- 172.21.15.8:0/2965701373 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c8152420 con 0x7f39ac0053d0 2024-03-23T23:53:10.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.294+0000 7f39c5600640 1 -- 172.21.15.8:0/2965701373 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac008260 con 0x7f39ac004810 2024-03-23T23:53:10.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.294+0000 7f39c5600640 1 -- 172.21.15.8:0/2965701373 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac008460 con 0x7f39ac003a30 2024-03-23T23:53:10.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.294+0000 7f39c7400640 1 --2- 172.21.15.8:0/2965701373 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39ac0053d0 0x7f39ac0079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:10.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.294+0000 7f39c6000640 1 -- 172.21.15.8:0/2965701373 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39ac004810 msgr2=0x7f39ac004c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:53:10.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.294+0000 7f39c6000640 1 --2- 172.21.15.8:0/2965701373 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39ac004810 0x7f39ac004c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:53:10.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.294+0000 7f39c6a00640 1 --2- 172.21.15.8:0/2965701373 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39ac003a30 0x7f39ac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:10.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.298+0000 7f39c7400640 1 -- 172.21.15.8:0/2965701373 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39ac003a30 msgr2=0x7f39ac003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:53:10.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.298+0000 7f39c7400640 1 --2- 172.21.15.8:0/2965701373 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39ac003a30 0x7f39ac003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:10.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.298+0000 7f39c7400640 1 -- 172.21.15.8:0/2965701373 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39ac004810 msgr2=0x7f39ac004c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:53:10.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.298+0000 7f39c7400640 1 --2- 172.21.15.8:0/2965701373 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39ac004810 0x7f39ac004c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:10.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.298+0000 7f39c7400640 1 -- 172.21.15.8:0/2965701373 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c8155040 con 0x7f39ac0053d0 2024-03-23T23:53:10.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.302+0000 7f39c7400640 1 -- 172.21.15.8:0/2965701373 reap_dead start 2024-03-23T23:53:10.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.306+0000 7f39c7400640 1 --2- 172.21.15.8:0/2965701373 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39ac0053d0 0x7f39ac0079b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f39b800a860 tx=0x7f39b801d2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab46fd5c562e4f1e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:10.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.306+0000 7f39c5600640 1 -- 172.21.15.8:0/2965701373 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b800a460 con 0x7f39ac0053d0 2024-03-23T23:53:10.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.306+0000 7f39c5600640 1 -- 172.21.15.8:0/2965701373 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b80ab530 con 0x7f39ac0053d0 2024-03-23T23:53:10.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.306+0000 7f39cda00640 1 -- 172.21.15.8:0/2965701373 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39ac0053d0 msgr2=0x7f39ac0079b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:10.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.306+0000 7f39cda00640 1 --2- 172.21.15.8:0/2965701373 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39ac0053d0 0x7f39ac0079b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f39b800a860 tx=0x7f39b801d2a0 comp rx=0 tx=0).stop 2024-03-23T23:53:10.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.306+0000 7f39cda00640 1 -- 172.21.15.8:0/2965701373 shutdown_connections 2024-03-23T23:53:10.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.306+0000 7f39cda00640 1 --2- 172.21.15.8:0/2965701373 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39ac0053d0 0x7f39ac0079b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:10.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.306+0000 7f39cda00640 1 -- 172.21.15.8:0/2965701373 >> 172.21.15.8:0/2965701373 conn(0x7f39c80c7170 msgr2=0x7f39c80c7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:53:10.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.310+0000 7f39cda00640 1 -- 172.21.15.8:0/2965701373 shutdown_connections 2024-03-23T23:53:10.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.310+0000 7f39cda00640 1 -- 172.21.15.8:0/2965701373 wait complete. 2024-03-23T23:53:10.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.314+0000 7f39cda00640 1 Processor -- start 2024-03-23T23:53:10.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.318+0000 7f39cda00640 1 -- start start 2024-03-23T23:53:10.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.322+0000 7f39cda00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39ac0053d0 0x7f39c80bd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:10.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.322+0000 7f39cda00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39c814dff0 0x7f39c81eb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:10.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.322+0000 7f39cda00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39c8150bf0 0x7f39c814b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:10.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.322+0000 7f39cda00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c80ac380 con 0x7f39c814dff0 2024-03-23T23:53:10.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.322+0000 7f39cda00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c8071c10 con 0x7f39c8150bf0 2024-03-23T23:53:10.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.322+0000 7f39cda00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c80ac500 con 0x7f39ac0053d0 2024-03-23T23:53:10.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.326+0000 7f39c7400640 1 -- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39c8150bf0 msgr2=0x7f39c814b940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:53:10.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.326+0000 7f39c7400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39c8150bf0 0x7f39c814b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:53:10.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.326+0000 7f39c6000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39c814dff0 0x7f39c81eb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:10.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.326+0000 7f39c6000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39c814dff0 0x7f39c81eb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49442/0 (socket says 172.21.15.8:49442) 2024-03-23T23:53:10.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.326+0000 7f39c6000640 1 -- 172.21.15.8:0/614360296 learned_addr learned my addr 172.21.15.8:0/614360296 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:53:10.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.326+0000 7f39c6a00640 1 --2- 172.21.15.8:0/614360296 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39ac0053d0 0x7f39c80bd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:10.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.326+0000 7f39c6000640 1 -- 172.21.15.8:0/614360296 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39ac0053d0 msgr2=0x7f39c80bd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:10.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.326+0000 7f39c6000640 1 --2- 172.21.15.8:0/614360296 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39ac0053d0 0x7f39c80bd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:10.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.326+0000 7f39c6000640 1 -- 172.21.15.8:0/614360296 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39c8150bf0 msgr2=0x7f39c814b940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:53:10.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.326+0000 7f39c6000640 1 --2- 172.21.15.8:0/614360296 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39c8150bf0 0x7f39c814b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:10.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.326+0000 7f39c6000640 1 -- 172.21.15.8:0/614360296 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c80c12a0 con 0x7f39c814dff0 2024-03-23T23:53:10.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.330+0000 7f39c6000640 1 --2- 172.21.15.8:0/614360296 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39c814dff0 0x7f39c81eb040 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f39b000c760 tx=0x7f39b000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:10.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.330+0000 7f39bea00640 1 -- 172.21.15.8:0/614360296 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0018070 con 0x7f39c814dff0 2024-03-23T23:53:10.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.330+0000 7f39bea00640 1 -- 172.21.15.8:0/614360296 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b00072f0 con 0x7f39c814dff0 2024-03-23T23:53:10.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.330+0000 7f39bea00640 1 -- 172.21.15.8:0/614360296 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b000a820 con 0x7f39c814dff0 2024-03-23T23:53:10.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.330+0000 7f39cda00640 1 -- 172.21.15.8:0/614360296 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c80c1580 con 0x7f39c814dff0 2024-03-23T23:53:10.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.330+0000 7f39cda00640 1 -- 172.21.15.8:0/614360296 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c81eab20 con 0x7f39c814dff0 2024-03-23T23:53:10.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.334+0000 7f39cda00640 1 -- 172.21.15.8:0/614360296 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39c804f480 con 0x7f39c814dff0 2024-03-23T23:53:10.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.334+0000 7f39bea00640 1 -- 172.21.15.8:0/614360296 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f39b000a9c0 con 0x7f39c814dff0 2024-03-23T23:53:10.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.338+0000 7f39bea00640 1 --2- 172.21.15.8:0/614360296 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f39a4067640 0x7f39a4069b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:10.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.338+0000 7f39bea00640 1 -- 172.21.15.8:0/614360296 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f39b0084f30 con 0x7f39c814dff0 2024-03-23T23:53:10.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.338+0000 7f39c6a00640 1 --2- 172.21.15.8:0/614360296 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f39a4067640 0x7f39a4069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:10.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.350+0000 7f39bea00640 1 -- 172.21.15.8:0/614360296 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f39b00557e0 con 0x7f39c814dff0 2024-03-23T23:53:10.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.354+0000 7f39c6a00640 1 --2- 172.21.15.8:0/614360296 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f39a4067640 0x7f39a4069b00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f39c0003910 tx=0x7f39c00037c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:10.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.894+0000 7f39cda00640 1 -- 172.21.15.8:0/614360296 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f39c80aa5b0 con 0x7f39c814dff0 2024-03-23T23:53:10.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.914+0000 7f39bea00640 1 -- 172.21.15.8:0/614360296 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1554 (secure 0 0 0) 0x7f39b00550e0 con 0x7f39c814dff0 2024-03-23T23:53:10.920 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":82,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:53:10.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.942+0000 7f39cda00640 1 -- 172.21.15.8:0/614360296 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f39a4067640 msgr2=0x7f39a4069b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:10.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.942+0000 7f39cda00640 1 --2- 172.21.15.8:0/614360296 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f39a4067640 0x7f39a4069b00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f39c0003910 tx=0x7f39c00037c0 comp rx=0 tx=0).stop 2024-03-23T23:53:10.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.942+0000 7f39cda00640 1 -- 172.21.15.8:0/614360296 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39c814dff0 msgr2=0x7f39c81eb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:10.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.942+0000 7f39cda00640 1 --2- 172.21.15.8:0/614360296 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39c814dff0 0x7f39c81eb040 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f39b000c760 tx=0x7f39b000cc20 comp rx=0 tx=0).stop 2024-03-23T23:53:10.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.946+0000 7f39cda00640 1 -- 172.21.15.8:0/614360296 shutdown_connections 2024-03-23T23:53:10.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.946+0000 7f39cda00640 1 --2- 172.21.15.8:0/614360296 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39c8150bf0 0x7f39c814b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:10.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.946+0000 7f39cda00640 1 --2- 172.21.15.8:0/614360296 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39c814dff0 0x7f39c81eb040 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:10.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.946+0000 7f39cda00640 1 --2- 172.21.15.8:0/614360296 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f39a4067640 0x7f39a4069b00 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:10.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.946+0000 7f39cda00640 1 --2- 172.21.15.8:0/614360296 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39ac0053d0 0x7f39c80bd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:10.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.946+0000 7f39cda00640 1 -- 172.21.15.8:0/614360296 >> 172.21.15.8:0/614360296 conn(0x7f39c80c7170 msgr2=0x7f39c80c7550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:53:10.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.954+0000 7f39cda00640 1 -- 172.21.15.8:0/614360296 shutdown_connections 2024-03-23T23:53:10.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:10.954+0000 7f39cda00640 1 -- 172.21.15.8:0/614360296 wait complete. 2024-03-23T23:53:11.022 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-03-23T23:53:11.022 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-03-23T23:53:11.022 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:53:11.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.286+0000 7fbb51e00640 1 Processor -- start 2024-03-23T23:53:11.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.286+0000 7fbb51e00640 1 -- start start 2024-03-23T23:53:11.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.286+0000 7fbb51e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb440dbce0 0x7fbb440e2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:11.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.286+0000 7fbb51e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbb4400b0c0 0x7fbb44006f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:11.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.286+0000 7fbb51e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb440de870 con 0x7fbb44007440 2024-03-23T23:53:11.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.286+0000 7fbb51e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb440e2c50 con 0x7fbb4400b0c0 2024-03-23T23:53:11.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.286+0000 7fbb51e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb44047620 con 0x7fbb440dbce0 2024-03-23T23:53:11.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.290+0000 7fbb4be00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbb4400b0c0 0x7fbb44006f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:11.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.290+0000 7fbb4be00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbb4400b0c0 0x7fbb44006f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49444/0 (socket says 172.21.15.8:49444) 2024-03-23T23:53:11.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.290+0000 7fbb4be00640 1 -- 172.21.15.8:0/250024737 learned_addr learned my addr 172.21.15.8:0/250024737 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:53:11.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.290+0000 7fbb4be00640 1 -- 172.21.15.8:0/250024737 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb440dbce0 msgr2=0x7fbb440e2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:53:11.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.290+0000 7fbb4be00640 1 --2- 172.21.15.8:0/250024737 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb440dbce0 0x7fbb440e2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:11.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.290+0000 7fbb4be00640 1 -- 172.21.15.8:0/250024737 >> v1:172.21.15.8:6789/0 conn(0x7fbb44007440 legacy=0x7fbb440ded20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:53:11.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.290+0000 7fbb4be00640 1 -- 172.21.15.8:0/250024737 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb44047900 con 0x7fbb4400b0c0 2024-03-23T23:53:11.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.294+0000 7fbb4be00640 1 --2- 172.21.15.8:0/250024737 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb4400b0c0 0x7fbb44006f00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbb38009870 tx=0x7fbb3801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c53460f94ec6cdbf server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:11.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.294+0000 7fbb4b400640 1 -- 172.21.15.8:0/250024737 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb380b1070 con 0x7fbb4400b0c0 2024-03-23T23:53:11.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.294+0000 7fbb4b400640 1 -- 172.21.15.8:0/250024737 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb380ac620 con 0x7fbb4400b0c0 2024-03-23T23:53:11.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.294+0000 7fbb4b400640 1 -- 172.21.15.8:0/250024737 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb380ac9f0 con 0x7fbb4400b0c0 2024-03-23T23:53:11.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.294+0000 7fbb51e00640 1 -- 172.21.15.8:0/250024737 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb4400b0c0 msgr2=0x7fbb44006f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:11.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.294+0000 7fbb51e00640 1 --2- 172.21.15.8:0/250024737 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb4400b0c0 0x7fbb44006f00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbb38009870 tx=0x7fbb3801c460 comp rx=0 tx=0).stop 2024-03-23T23:53:11.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.294+0000 7fbb51e00640 1 -- 172.21.15.8:0/250024737 shutdown_connections 2024-03-23T23:53:11.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.294+0000 7fbb51e00640 1 --2- 172.21.15.8:0/250024737 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb4400b0c0 0x7fbb44006f00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:11.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.294+0000 7fbb51e00640 1 --2- 172.21.15.8:0/250024737 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb440dbce0 0x7fbb440e2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:11.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.294+0000 7fbb51e00640 1 -- 172.21.15.8:0/250024737 >> 172.21.15.8:0/250024737 conn(0x7fbb44048260 msgr2=0x7fbb44048670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:53:11.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.294+0000 7fbb51e00640 1 -- 172.21.15.8:0/250024737 shutdown_connections 2024-03-23T23:53:11.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.294+0000 7fbb51e00640 1 -- 172.21.15.8:0/250024737 wait complete. 2024-03-23T23:53:11.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.298+0000 7fbb51e00640 1 Processor -- start 2024-03-23T23:53:11.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.298+0000 7fbb51e00640 1 -- start start 2024-03-23T23:53:11.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.298+0000 7fbb51e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44007440 0x7fbb4402c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:11.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.298+0000 7fbb51e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb4400b0c0 0x7fbb4417b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:11.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.298+0000 7fbb51e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb440dbce0 0x7fbb440493b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:11.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.298+0000 7fbb51e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb440dc0c0 con 0x7fbb4400b0c0 2024-03-23T23:53:11.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.298+0000 7fbb51e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb440dfc50 con 0x7fbb440dbce0 2024-03-23T23:53:11.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.298+0000 7fbb51e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb440eb900 con 0x7fbb44007440 2024-03-23T23:53:11.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.298+0000 7fbb50a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44007440 0x7fbb4402c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:11.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.298+0000 7fbb51400640 1 -- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb440dbce0 msgr2=0x7fbb440493b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:53:11.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.298+0000 7fbb51400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb440dbce0 0x7fbb440493b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:53:11.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.298+0000 7fbb50a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44007440 0x7fbb4402c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:42454/0 (socket says 172.21.15.8:42454) 2024-03-23T23:53:11.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.298+0000 7fbb50a00640 1 -- 172.21.15.8:0/3481691690 learned_addr learned my addr 172.21.15.8:0/3481691690 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:53:11.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.298+0000 7fbb4be00640 1 --2- 172.21.15.8:0/3481691690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb4400b0c0 0x7fbb4417b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:11.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.302+0000 7fbb4be00640 1 -- 172.21.15.8:0/3481691690 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44007440 msgr2=0x7fbb4402c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:11.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.302+0000 7fbb4be00640 1 --2- 172.21.15.8:0/3481691690 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44007440 0x7fbb4402c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:11.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.302+0000 7fbb4be00640 1 -- 172.21.15.8:0/3481691690 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb440dbce0 msgr2=0x7fbb440493b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:53:11.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.302+0000 7fbb4be00640 1 --2- 172.21.15.8:0/3481691690 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb440dbce0 0x7fbb440493b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:11.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.302+0000 7fbb4be00640 1 -- 172.21.15.8:0/3481691690 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb4417bb00 con 0x7fbb4400b0c0 2024-03-23T23:53:11.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.302+0000 7fbb4be00640 1 --2- 172.21.15.8:0/3481691690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb4400b0c0 0x7fbb4417b5c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbb380ac000 tx=0x7fbb3801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:11.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.302+0000 7fbb48c00640 1 -- 172.21.15.8:0/3481691690 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb380bb020 con 0x7fbb4400b0c0 2024-03-23T23:53:11.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.302+0000 7fbb48c00640 1 -- 172.21.15.8:0/3481691690 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb380b7720 con 0x7fbb4400b0c0 2024-03-23T23:53:11.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.302+0000 7fbb48c00640 1 -- 172.21.15.8:0/3481691690 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb380b1040 con 0x7fbb4400b0c0 2024-03-23T23:53:11.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.302+0000 7fbb51e00640 1 -- 172.21.15.8:0/3481691690 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb440498f0 con 0x7fbb4400b0c0 2024-03-23T23:53:11.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.302+0000 7fbb51e00640 1 -- 172.21.15.8:0/3481691690 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb4402ca70 con 0x7fbb4400b0c0 2024-03-23T23:53:11.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.306+0000 7fbb51e00640 1 --2- 172.21.15.8:0/3481691690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb4402cd50 0x7fbb440d61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:11.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.306+0000 7fbb51e00640 1 -- 172.21.15.8:0/3481691690 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb44035e10 con 0x7fbb4402cd50 2024-03-23T23:53:11.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.306+0000 7fbb50a00640 1 --2- 172.21.15.8:0/3481691690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb4402cd50 0x7fbb440d61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:11.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.306+0000 7fbb50a00640 1 -- 172.21.15.8:0/3481691690 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbb440052d0 con 0x7fbb4402cd50 2024-03-23T23:53:11.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.306+0000 7fbb48c00640 1 -- 172.21.15.8:0/3481691690 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fbb380be020 con 0x7fbb4400b0c0 2024-03-23T23:53:11.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.306+0000 7fbb50a00640 1 --2- 172.21.15.8:0/3481691690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb4402cd50 0x7fbb440d61e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbb4000e7a0 tx=0x7fbb4000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:11.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.310+0000 7fbb48c00640 1 --2- 172.21.15.8:0/3481691690 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbb2c0675c0 0x7fbb2c069a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:11.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.310+0000 7fbb48c00640 1 -- 172.21.15.8:0/3481691690 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fbb381200e0 con 0x7fbb4400b0c0 2024-03-23T23:53:11.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.310+0000 7fbb48c00640 1 -- 172.21.15.8:0/3481691690 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb40017070 con 0x7fbb4402cd50 2024-03-23T23:53:11.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.310+0000 7fbb51400640 1 --2- 172.21.15.8:0/3481691690 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbb2c0675c0 0x7fbb2c069a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:11.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.310+0000 7fbb48c00640 1 -- 172.21.15.8:0/3481691690 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fbb4000c7a0 con 0x7fbb4402cd50 2024-03-23T23:53:11.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.310+0000 7fbb48c00640 1 -- 172.21.15.8:0/3481691690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb4402cd50 msgr2=0x7fbb440d61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:11.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.310+0000 7fbb48c00640 1 --2- 172.21.15.8:0/3481691690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb4402cd50 0x7fbb440d61e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbb4000e7a0 tx=0x7fbb4000ec60 comp rx=0 tx=0).stop 2024-03-23T23:53:11.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.310+0000 7fbb48c00640 1 -- 172.21.15.8:0/3481691690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb4402cd50 msgr2=0x7fbb440d61e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:53:11.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.310+0000 7fbb48c00640 1 --2- 172.21.15.8:0/3481691690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb4402cd50 0x7fbb440d61e0 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbb4000e7a0 tx=0x7fbb4000ec60 comp rx=0 tx=0).stop 2024-03-23T23:53:11.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.318+0000 7fbb51400640 1 --2- 172.21.15.8:0/3481691690 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbb2c0675c0 0x7fbb2c069a80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c06a3c0 tx=0x7fbb4c0690a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:11.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.322+0000 7fbb51e00640 1 --2- 172.21.15.8:0/3481691690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb440d8ad0 0x7fbb4417ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:11.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.322+0000 7fbb51e00640 1 -- 172.21.15.8:0/3481691690 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4403ef90 con 0x7fbb440d8ad0 2024-03-23T23:53:11.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.326+0000 7fbb50a00640 1 --2- 172.21.15.8:0/3481691690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb440d8ad0 0x7fbb4417ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:11.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.330+0000 7fbb50a00640 1 -- 172.21.15.8:0/3481691690 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fbb4400b6f0 con 0x7fbb440d8ad0 2024-03-23T23:53:11.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.334+0000 7fbb50a00640 1 --2- 172.21.15.8:0/3481691690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb440d8ad0 0x7fbb4417ac20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbb4000e7a0 tx=0x7fbb40004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:11.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.334+0000 7fbb48c00640 1 -- 172.21.15.8:0/3481691690 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb40017070 con 0x7fbb440d8ad0 2024-03-23T23:53:11.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.334+0000 7fbb48c00640 1 -- 172.21.15.8:0/3481691690 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5003 (secure 0 0 0) 0x7fbb40006350 con 0x7fbb440d8ad0 2024-03-23T23:53:11.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.334+0000 7fbb48c00640 1 -- 172.21.15.8:0/3481691690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb440d8ad0 msgr2=0x7fbb4417ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:11.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.338+0000 7fbb48c00640 1 --2- 172.21.15.8:0/3481691690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb440d8ad0 0x7fbb4417ac20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbb4000e7a0 tx=0x7fbb40004740 comp rx=0 tx=0).stop 2024-03-23T23:53:11.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.338+0000 7fbb48c00640 1 -- 172.21.15.8:0/3481691690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb440d8ad0 msgr2=0x7fbb4417ac20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:53:11.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.338+0000 7fbb48c00640 1 --2- 172.21.15.8:0/3481691690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb440d8ad0 0x7fbb4417ac20 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbb4000e7a0 tx=0x7fbb40004740 comp rx=0 tx=0).stop 2024-03-23T23:53:11.343 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:53:11.343 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:53:11.344 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:53:11.344 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:53:11.344 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 82, 2024-03-23T23:53:11.344 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:53:11.344 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:53:11.344 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:53:11.344 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:11.344 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 1, 2024-03-23T23:53:11.344 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:53:11.344 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:53:11.344 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:53:11.344 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:53:11.345 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:53:11.345 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:53:11.345 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:53:11.345 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:53:11.345 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:53:11.345 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:53:11.345 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:53:11.345 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:53:11.345 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:53:11.345 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:53:11.345 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:11.345 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:53:11.346 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:53:11.346 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:53:11.346 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:53:11.346 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:53:11.346 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:53:11.347 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:53:11.347 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:53:11.347 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:53:11.347 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:53:11.347 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:53:11.347 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:53:11.347 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:53:11.347 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:11.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:11.347 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:53:11.347 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:53:11.347 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:53:11.347 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:53:11.348 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:53:11.348 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:53:11.348 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:53:11.348 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:53:11.348 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:53:11.348 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:53:11.348 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:53:11.348 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:53:11.348 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:53:11.348 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:53:11.348 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:53:11.349 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:53:11.349 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:53:11.349 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:53:11.349 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:53:11.349 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:53:11.349 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:53:11.349 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:53:11.349 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:53:11.349 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:53:11.350 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:53:11.350 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:53:11.350 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:53:11.350 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:53:11.350 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:11.350 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:53:11.350 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:11.350 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:53:11.350 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:11.350 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:53:11.350 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:53:11.350 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:53:11.350 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:53:11.351 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:11.351 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:53:11.351 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:53:11.351 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:11.351 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:11.351 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:11.351 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:53:11.351 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:53:11.351 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:11.351 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:11.351 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:11.351 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:11.352 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:53:11.352 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:53:11.352 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:53:11.352 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:53:11.352 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:53:11.352 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:11.352 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:11.352 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:53:11.352 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:53:11.352 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:53:11.352 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:53:11.352 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:11.353 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:53:11.353 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:53:11.353 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:11.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:11.353 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:11.353 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:53:11.353 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:53:11.353 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:11.353 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:11.353 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:11.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:11.353 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:53:11.353 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:53:11.354 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:53:11.354 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:53:11.354 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:53:11.354 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:11.354 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:11.354 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:53:11.354 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:53:11.354 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:53:11.354 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:53:11.354 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:11.354 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:53:11.354 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:53:11.355 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:11.355 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:11.355 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:11.355 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:53:11.355 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:53:11.355 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:11.355 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:11.355 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:11.355 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:11.355 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:53:11.355 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:53:11.355 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:53:11.355 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:53:11.356 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:53:11.356 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:11.356 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:11.356 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:11.356 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:53:11.356 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:53:11.356 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:11.356 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:53:11.356 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:11.356 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:53:11.356 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:11.356 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:11.357 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:53:11.357 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:11.357 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:53:11.357 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:11.357 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:53:11.357 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:11.357 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:11.357 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:53:11.357 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:11.357 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:53:11.357 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:11.357 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:53:11.358 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:11.358 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:11.358 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:53:11.358 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:11.358 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:53:11.358 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:11.358 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:53:11.358 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:11.358 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:11.358 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:53:11.358 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:11.358 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5 2024-03-23T23:53:11.359 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:11.359 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:11.359 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:11.359 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:53:11.359 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:53:11.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.342+0000 7fbb51e00640 1 -- 172.21.15.8:0/3481691690 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbb2c0675c0 msgr2=0x7fbb2c069a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:11.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.342+0000 7fbb51e00640 1 --2- 172.21.15.8:0/3481691690 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbb2c0675c0 0x7fbb2c069a80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c06a3c0 tx=0x7fbb4c0690a0 comp rx=0 tx=0).stop 2024-03-23T23:53:11.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.342+0000 7fbb51e00640 1 -- 172.21.15.8:0/3481691690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb4400b0c0 msgr2=0x7fbb4417b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:11.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.342+0000 7fbb51e00640 1 --2- 172.21.15.8:0/3481691690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb4400b0c0 0x7fbb4417b5c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbb380ac000 tx=0x7fbb3801aca0 comp rx=0 tx=0).stop 2024-03-23T23:53:11.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.342+0000 7fbb51400640 1 -- 172.21.15.8:0/3481691690 reap_dead start 2024-03-23T23:53:11.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.342+0000 7fbb51400640 1 -- 172.21.15.8:0/3481691690 reap_dead start 2024-03-23T23:53:11.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.342+0000 7fbb51e00640 1 -- 172.21.15.8:0/3481691690 shutdown_connections 2024-03-23T23:53:11.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.342+0000 7fbb51e00640 1 -- 172.21.15.8:0/3481691690 >> 172.21.15.8:0/3481691690 conn(0x7fbb44048260 msgr2=0x7fbb440e84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:53:11.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.346+0000 7fbb51e00640 1 -- 172.21.15.8:0/3481691690 shutdown_connections 2024-03-23T23:53:11.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.346+0000 7fbb51e00640 1 -- 172.21.15.8:0/3481691690 wait complete. 2024-03-23T23:53:11.382 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T23:53:11.383 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-03-23T23:53:11.383 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:53:11.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.670+0000 7fb3c6a00640 1 Processor -- start 2024-03-23T23:53:11.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.670+0000 7fb3c6a00640 1 -- start start 2024-03-23T23:53:11.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.670+0000 7fb3c6a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb3c00c1ed0 0x7fb3c0152700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:11.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.670+0000 7fb3c6a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb3c00c22b0 0x7fb3c014ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:11.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.670+0000 7fb3c6a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb3c00c2710 0x7fb3c006e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:11.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.670+0000 7fb3c6a00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c006e080 con 0x7fb3c00c1ed0 2024-03-23T23:53:11.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.670+0000 7fb3c6a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c0152c40 con 0x7fb3c00c2710 2024-03-23T23:53:11.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.670+0000 7fb3c6a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c00c34d0 con 0x7fb3c00c22b0 2024-03-23T23:53:11.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.674+0000 7fb3c4a00640 1 -- >> v2:172.21.15.196:3300/0 conn(0x7fb3c00c2710 msgr2=0x7fb3c006e510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:53:11.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.674+0000 7fb3c4a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb3c00c2710 0x7fb3c006e510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:53:11.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.674+0000 7fb3bfe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb3c00c1ed0 0x7fb3c0152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:11.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.674+0000 7fb3bfe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb3c00c1ed0 0x7fb3c0152700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49472/0 (socket says 172.21.15.8:49472) 2024-03-23T23:53:11.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.674+0000 7fb3bfe00640 1 -- 172.21.15.8:0/1039573191 learned_addr learned my addr 172.21.15.8:0/1039573191 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:53:11.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.674+0000 7fb3bf400640 1 --2- 172.21.15.8:0/1039573191 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb3c00c22b0 0x7fb3c014ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:11.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.678+0000 7fb3bfe00640 1 -- 172.21.15.8:0/1039573191 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb3c00c22b0 msgr2=0x7fb3c014ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:53:11.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.678+0000 7fb3bfe00640 1 --2- 172.21.15.8:0/1039573191 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb3c00c22b0 0x7fb3c014ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:11.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.678+0000 7fb3bfe00640 1 -- 172.21.15.8:0/1039573191 >> v2:172.21.15.196:3300/0 conn(0x7fb3c00c2710 msgr2=0x7fb3c006e510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:53:11.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.678+0000 7fb3bfe00640 1 --2- 172.21.15.8:0/1039573191 >> v2:172.21.15.196:3300/0 conn(0x7fb3c00c2710 0x7fb3c006e510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:11.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.678+0000 7fb3bfe00640 1 -- 172.21.15.8:0/1039573191 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c00c37b0 con 0x7fb3c00c1ed0 2024-03-23T23:53:11.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.686+0000 7fb3bfe00640 1 --2- 172.21.15.8:0/1039573191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3c00c1ed0 0x7fb3c0152700 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb3c00c4740 tx=0x7fb3b0020b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=846d018e8f50b212 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:11.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.686+0000 7fb3bea00640 1 -- 172.21.15.8:0/1039573191 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b00af070 con 0x7fb3c00c1ed0 2024-03-23T23:53:11.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.686+0000 7fb3bea00640 1 -- 172.21.15.8:0/1039573191 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b0004230 con 0x7fb3c00c1ed0 2024-03-23T23:53:11.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.686+0000 7fb3bea00640 1 -- 172.21.15.8:0/1039573191 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b00a9990 con 0x7fb3c00c1ed0 2024-03-23T23:53:11.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.690+0000 7fb3c6a00640 1 -- 172.21.15.8:0/1039573191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3c00c1ed0 msgr2=0x7fb3c0152700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:11.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.690+0000 7fb3c6a00640 1 --2- 172.21.15.8:0/1039573191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3c00c1ed0 0x7fb3c0152700 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb3c00c4740 tx=0x7fb3b0020b40 comp rx=0 tx=0).stop 2024-03-23T23:53:11.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.690+0000 7fb3c6a00640 1 -- 172.21.15.8:0/1039573191 shutdown_connections 2024-03-23T23:53:11.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.690+0000 7fb3c6a00640 1 --2- 172.21.15.8:0/1039573191 >> v2:172.21.15.196:3300/0 conn(0x7fb3c00c2710 0x7fb3c006e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:11.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.690+0000 7fb3c6a00640 1 --2- 172.21.15.8:0/1039573191 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb3c00c22b0 0x7fb3c014ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:11.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.690+0000 7fb3c6a00640 1 --2- 172.21.15.8:0/1039573191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3c00c1ed0 0x7fb3c0152700 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:11.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.690+0000 7fb3c6a00640 1 -- 172.21.15.8:0/1039573191 >> 172.21.15.8:0/1039573191 conn(0x7fb3c006b170 msgr2=0x7fb3c006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:53:11.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.694+0000 7fb3c6a00640 1 -- 172.21.15.8:0/1039573191 shutdown_connections 2024-03-23T23:53:11.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.694+0000 7fb3c6a00640 1 -- 172.21.15.8:0/1039573191 wait complete. 2024-03-23T23:53:11.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.698+0000 7fb3c6a00640 1 Processor -- start 2024-03-23T23:53:11.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.702+0000 7fb3c6a00640 1 -- start start 2024-03-23T23:53:11.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.706+0000 7fb3c6a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb3c00c1ed0 0x7fb3c00ac5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:11.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.706+0000 7fb3c6a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb3c00c22b0 0x7fb3c014a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:11.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.706+0000 7fb3c6a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3c00c2710 0x7fb3c014a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:11.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.706+0000 7fb3c6a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c00c4100 con 0x7fb3c00c2710 2024-03-23T23:53:11.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.706+0000 7fb3c6a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c00c3f80 con 0x7fb3c00c1ed0 2024-03-23T23:53:11.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.706+0000 7fb3c6a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c00c4280 con 0x7fb3c00c22b0 2024-03-23T23:53:11.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.706+0000 7fb3bf400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb3c00c22b0 0x7fb3c014a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:11.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.706+0000 7fb3bf400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb3c00c22b0 0x7fb3c014a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:42460/0 (socket says 172.21.15.8:42460) 2024-03-23T23:53:11.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.706+0000 7fb3bf400640 1 -- 172.21.15.8:0/756771760 learned_addr learned my addr 172.21.15.8:0/756771760 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:53:11.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.706+0000 7fb3c4a00640 1 --2- 172.21.15.8:0/756771760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3c00c2710 0x7fb3c014a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:11.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.710+0000 7fb3bfe00640 1 -- 172.21.15.8:0/756771760 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb3c00c1ed0 msgr2=0x7fb3c00ac5a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:53:11.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.710+0000 7fb3bfe00640 1 --2- 172.21.15.8:0/756771760 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb3c00c1ed0 0x7fb3c00ac5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:53:11.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.710+0000 7fb3bf400640 1 -- 172.21.15.8:0/756771760 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb3c00c1ed0 msgr2=0x7fb3c00ac5a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:53:11.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.710+0000 7fb3bf400640 1 --2- 172.21.15.8:0/756771760 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb3c00c1ed0 0x7fb3c00ac5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:11.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.710+0000 7fb3bf400640 1 -- 172.21.15.8:0/756771760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3c00c2710 msgr2=0x7fb3c014a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:11.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.710+0000 7fb3bf400640 1 --2- 172.21.15.8:0/756771760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3c00c2710 0x7fb3c014a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:11.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.710+0000 7fb3bf400640 1 -- 172.21.15.8:0/756771760 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c014c0e0 con 0x7fb3c00c22b0 2024-03-23T23:53:11.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.718+0000 7fb3bf400640 1 --2- 172.21.15.8:0/756771760 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb3c00c22b0 0x7fb3c014a130 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac01e630 tx=0x7fb3ac01eaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:11.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.722+0000 7fb3b7e00640 1 -- 172.21.15.8:0/756771760 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac01f040 con 0x7fb3c00c22b0 2024-03-23T23:53:11.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.722+0000 7fb3b7e00640 1 -- 172.21.15.8:0/756771760 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ac02a070 con 0x7fb3c00c22b0 2024-03-23T23:53:11.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.722+0000 7fb3b7e00640 1 -- 172.21.15.8:0/756771760 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac025840 con 0x7fb3c00c22b0 2024-03-23T23:53:11.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.722+0000 7fb3c6a00640 1 -- 172.21.15.8:0/756771760 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c00aabe0 con 0x7fb3c00c22b0 2024-03-23T23:53:11.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.722+0000 7fb3c6a00640 1 -- 172.21.15.8:0/756771760 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c014e360 con 0x7fb3c00c22b0 2024-03-23T23:53:11.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.730+0000 7fb3b7e00640 1 -- 172.21.15.8:0/756771760 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb3ac0259e0 con 0x7fb3c00c22b0 2024-03-23T23:53:11.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.734+0000 7fb3b7e00640 1 --2- 172.21.15.8:0/756771760 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb3a0067690 0x7fb3a0069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:11.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.734+0000 7fb3b7e00640 1 -- 172.21.15.8:0/756771760 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fb3ac096e30 con 0x7fb3c00c22b0 2024-03-23T23:53:11.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.734+0000 7fb3c6a00640 1 --2- 172.21.15.8:0/756771760 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb398002a80 0x7fb398004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:11.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.734+0000 7fb3c6a00640 1 -- 172.21.15.8:0/756771760 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb398007ed0 con 0x7fb398002a80 2024-03-23T23:53:11.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.738+0000 7fb3c4a00640 1 --2- 172.21.15.8:0/756771760 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb398002a80 0x7fb398004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:11.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.742+0000 7fb3c4a00640 1 -- 172.21.15.8:0/756771760 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb3980080d0 con 0x7fb398002a80 2024-03-23T23:53:11.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.742+0000 7fb3bfe00640 1 --2- 172.21.15.8:0/756771760 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb3a0067690 0x7fb3a0069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:11.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.742+0000 7fb3c4a00640 1 --2- 172.21.15.8:0/756771760 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb398002a80 0x7fb398004f40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8003cc0 tx=0x7fb3b800b780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:11.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.746+0000 7fb3b7e00640 1 -- 172.21.15.8:0/756771760 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b801a070 con 0x7fb398002a80 2024-03-23T23:53:11.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.746+0000 7fb3b7e00640 1 -- 172.21.15.8:0/756771760 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fb3b80064d0 con 0x7fb398002a80 2024-03-23T23:53:11.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.746+0000 7fb3b7e00640 1 -- 172.21.15.8:0/756771760 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb398002a80 msgr2=0x7fb398004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:11.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.746+0000 7fb3b7e00640 1 --2- 172.21.15.8:0/756771760 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb398002a80 0x7fb398004f40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8003cc0 tx=0x7fb3b800b780 comp rx=0 tx=0).stop 2024-03-23T23:53:11.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.746+0000 7fb3b7e00640 1 -- 172.21.15.8:0/756771760 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb398002a80 msgr2=0x7fb398004f40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:53:11.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.746+0000 7fb3b7e00640 1 --2- 172.21.15.8:0/756771760 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb398002a80 0x7fb398004f40 secure :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8003cc0 tx=0x7fb3b800b780 comp rx=0 tx=0).stop 2024-03-23T23:53:11.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.754+0000 7fb3bfe00640 1 --2- 172.21.15.8:0/756771760 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb3a0067690 0x7fb3a0069b50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb3b00b3000 tx=0x7fb3b000f040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:11.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.766+0000 7fb3c6a00640 1 --2- 172.21.15.8:0/756771760 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb398006f10 0x7fb3980073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:11.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.766+0000 7fb3c6a00640 1 -- 172.21.15.8:0/756771760 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb39800a4b0 con 0x7fb398006f10 2024-03-23T23:53:11.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.766+0000 7fb3c4a00640 1 --2- 172.21.15.8:0/756771760 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb398006f10 0x7fb3980073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:11.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.770+0000 7fb3c4a00640 1 -- 172.21.15.8:0/756771760 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb3980078e0 con 0x7fb398006f10 2024-03-23T23:53:11.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.770+0000 7fb3c4a00640 1 --2- 172.21.15.8:0/756771760 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb398006f10 0x7fb3980073a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8003cc0 tx=0x7fb3b8003bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:11.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.774+0000 7fb3b7e00640 1 -- 172.21.15.8:0/756771760 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b801a050 con 0x7fb398006f10 2024-03-23T23:53:11.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.774+0000 7fb3b7e00640 1 -- 172.21.15.8:0/756771760 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5171 (secure 0 0 0) 0x7fb3b801b040 con 0x7fb398006f10 2024-03-23T23:53:11.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.774+0000 7fb3b7e00640 1 -- 172.21.15.8:0/756771760 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb398006f10 msgr2=0x7fb3980073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:11.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.774+0000 7fb3b7e00640 1 --2- 172.21.15.8:0/756771760 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb398006f10 0x7fb3980073a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8003cc0 tx=0x7fb3b8003bf0 comp rx=0 tx=0).stop 2024-03-23T23:53:11.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.774+0000 7fb3b7e00640 1 -- 172.21.15.8:0/756771760 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb398006f10 msgr2=0x7fb3980073a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:53:11.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.774+0000 7fb3b7e00640 1 --2- 172.21.15.8:0/756771760 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb398006f10 0x7fb3980073a0 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8003cc0 tx=0x7fb3b8003bf0 comp rx=0 tx=0).stop 2024-03-23T23:53:11.774 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:53:11.775 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:53:11.775 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:53:11.775 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:53:11.775 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 82, 2024-03-23T23:53:11.775 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:53:11.775 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:53:11.775 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:53:11.775 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:11.775 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 1, 2024-03-23T23:53:11.775 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:53:11.775 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:53:11.775 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:53:11.775 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:53:11.776 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:53:11.776 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:53:11.776 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:53:11.776 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:53:11.776 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:53:11.776 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:53:11.776 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:53:11.776 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:53:11.776 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:53:11.776 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:53:11.776 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:11.777 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:53:11.777 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:53:11.777 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:53:11.777 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:53:11.777 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:53:11.777 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:53:11.777 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:53:11.777 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:53:11.777 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:53:11.777 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:53:11.778 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:53:11.778 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:53:11.778 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:53:11.778 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:11.778 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:11.778 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:53:11.778 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:53:11.778 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:53:11.778 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:53:11.778 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:53:11.779 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:53:11.779 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:53:11.779 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:53:11.779 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:53:11.779 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:53:11.779 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:53:11.779 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:53:11.779 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:53:11.779 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:53:11.779 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:53:11.779 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:53:11.780 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:53:11.780 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:53:11.780 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:53:11.780 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:53:11.780 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:53:11.780 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:53:11.780 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:53:11.780 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:53:11.780 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:53:11.780 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:53:11.780 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:53:11.781 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:53:11.781 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:11.781 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:53:11.781 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:11.781 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:53:11.781 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:11.781 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:53:11.781 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:53:11.781 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:53:11.781 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:53:11.782 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:11.782 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:53:11.782 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:53:11.782 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:11.782 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:11.782 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:11.782 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:53:11.782 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:53:11.782 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:11.782 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:11.783 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:11.783 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:11.783 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:53:11.783 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:53:11.783 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:53:11.783 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:53:11.783 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:53:11.783 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:11.783 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:11.783 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:53:11.783 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:53:11.783 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:53:11.784 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:53:11.784 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:11.784 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:53:11.784 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:53:11.784 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:11.784 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:11.784 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:11.784 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:53:11.784 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:53:11.784 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:11.784 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:53:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:53:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:53:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:53:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:53:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:53:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:53:11.786 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:53:11.786 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:53:11.786 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:11.786 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:53:11.786 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:53:11.786 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:11.786 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:11.786 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:11.786 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:53:11.787 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:53:11.787 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:11.787 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:11.787 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:11.787 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:11.787 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:53:11.787 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:53:11.787 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:53:11.787 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:53:11.787 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:53:11.787 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:11.788 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:11.788 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:11.788 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:53:11.788 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:53:11.788 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:11.788 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:53:11.788 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:11.788 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:53:11.788 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:11.789 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:11.789 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:53:11.789 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:11.789 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:53:11.789 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:11.789 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:53:11.789 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:11.789 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:11.789 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:53:11.789 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:11.790 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:53:11.790 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:11.790 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 7 2024-03-23T23:53:11.790 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:11.790 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:11.790 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:53:11.790 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:11.790 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:53:11.790 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:11.791 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:53:11.791 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:11.791 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:11.791 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:53:11.791 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:11.791 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:53:11.791 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:11.791 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:11.791 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:53:11.792 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:11.792 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:53:11.792 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:11.792 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:53:11.792 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:11.792 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:11.792 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:11.792 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:53:11.792 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:53:11.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.782+0000 7fb3c6a00640 1 -- 172.21.15.8:0/756771760 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb3a0067690 msgr2=0x7fb3a0069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:11.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.782+0000 7fb3c6a00640 1 --2- 172.21.15.8:0/756771760 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb3a0067690 0x7fb3a0069b50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb3b00b3000 tx=0x7fb3b000f040 comp rx=0 tx=0).stop 2024-03-23T23:53:11.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.782+0000 7fb3c4a00640 1 -- 172.21.15.8:0/756771760 reap_dead start 2024-03-23T23:53:11.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.782+0000 7fb3c6a00640 1 -- 172.21.15.8:0/756771760 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb3c00c22b0 msgr2=0x7fb3c014a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:11.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.782+0000 7fb3c6a00640 1 --2- 172.21.15.8:0/756771760 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb3c00c22b0 0x7fb3c014a130 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac01e630 tx=0x7fb3ac01eaf0 comp rx=0 tx=0).stop 2024-03-23T23:53:11.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.790+0000 7fb3c6a00640 1 -- 172.21.15.8:0/756771760 shutdown_connections 2024-03-23T23:53:11.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.790+0000 7fb3c6a00640 1 --2- 172.21.15.8:0/756771760 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb3c00c22b0 0x7fb3c014a130 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac01e630 tx=0x7fb3ac01eaf0 comp rx=0 tx=0).stop 2024-03-23T23:53:11.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.790+0000 7fb3c6a00640 1 -- 172.21.15.8:0/756771760 >> 172.21.15.8:0/756771760 conn(0x7fb3c006b170 msgr2=0x7fb3c0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:53:11.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.790+0000 7fb3c6a00640 1 -- 172.21.15.8:0/756771760 shutdown_connections 2024-03-23T23:53:11.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:11.790+0000 7fb3c6a00640 1 -- 172.21.15.8:0/756771760 wait complete. 2024-03-23T23:53:11.843 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T23:53:11.843 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-03-23T23:53:15.214 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:53:15.221 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:53:31.843 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-03-23T23:53:31.843 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-03-23T23:53:31.844 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-23T23:53:31.844 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-23T23:53:31.854 INFO:tasks.ceph.mon.b:Started 2024-03-23T23:53:31.854 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T23:53:31.854 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:53:32.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.214+0000 7f1177e00640 1 Processor -- start 2024-03-23T23:53:32.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.214+0000 7f1177e00640 1 -- start start 2024-03-23T23:53:32.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.218+0000 7f1177e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f117014f500 0x7f117006f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:32.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.218+0000 7f1177e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f11700c1b70 0x7f1170151de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:32.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.218+0000 7f1177e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11700ac710 con 0x7f11700731a0 2024-03-23T23:53:32.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.218+0000 7f1177e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1170071c10 con 0x7f11700c1b70 2024-03-23T23:53:32.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.218+0000 7f1177e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11700ac430 con 0x7f117014f500 2024-03-23T23:53:32.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.218+0000 7f1175e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f11700c1b70 0x7f1170151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:32.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.218+0000 7f1175e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f11700c1b70 0x7f1170151de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41178/0 (socket says 172.21.15.8:41178) 2024-03-23T23:53:32.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.218+0000 7f1175e00640 1 -- 172.21.15.8:0/1329128871 learned_addr learned my addr 172.21.15.8:0/1329128871 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:53:32.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.218+0000 7f1175e00640 1 -- 172.21.15.8:0/1329128871 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f117014f500 msgr2=0x7f117006f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:53:32.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.218+0000 7f1175e00640 1 --2- 172.21.15.8:0/1329128871 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f117014f500 0x7f117006f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:32.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.218+0000 7f1175e00640 1 -- 172.21.15.8:0/1329128871 >> v1:172.21.15.8:6789/0 conn(0x7f11700731a0 legacy=0x7f11700ab730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:53:32.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.218+0000 7f1175e00640 1 -- 172.21.15.8:0/1329128871 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1170152990 con 0x7f11700c1b70 2024-03-23T23:53:32.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.222+0000 7f1175e00640 1 --2- 172.21.15.8:0/1329128871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11700c1b70 0x7f1170151de0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1168009e50 tx=0x7f116801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1893eedacdffc61 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:32.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.222+0000 7f116fe00640 1 -- 172.21.15.8:0/1329128871 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11680a5560 con 0x7f11700c1b70 2024-03-23T23:53:32.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.222+0000 7f116fe00640 1 -- 172.21.15.8:0/1329128871 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11680a5700 con 0x7f11700c1b70 2024-03-23T23:53:32.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.222+0000 7f116fe00640 1 -- 172.21.15.8:0/1329128871 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11680a5ad0 con 0x7f11700c1b70 2024-03-23T23:53:32.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.222+0000 7f1177e00640 1 -- 172.21.15.8:0/1329128871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11700c1b70 msgr2=0x7f1170151de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:32.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.222+0000 7f1177e00640 1 --2- 172.21.15.8:0/1329128871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11700c1b70 0x7f1170151de0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1168009e50 tx=0x7f116801c960 comp rx=0 tx=0).stop 2024-03-23T23:53:32.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.226+0000 7f1177e00640 1 -- 172.21.15.8:0/1329128871 shutdown_connections 2024-03-23T23:53:32.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.226+0000 7f1177e00640 1 --2- 172.21.15.8:0/1329128871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11700c1b70 0x7f1170151de0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:32.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.226+0000 7f1177e00640 1 --2- 172.21.15.8:0/1329128871 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f117014f500 0x7f117006f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:32.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.226+0000 7f1177e00640 1 -- 172.21.15.8:0/1329128871 >> 172.21.15.8:0/1329128871 conn(0x7f117006b170 msgr2=0x7f117006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:53:32.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.226+0000 7f1177e00640 1 -- 172.21.15.8:0/1329128871 shutdown_connections 2024-03-23T23:53:32.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.226+0000 7f1177e00640 1 -- 172.21.15.8:0/1329128871 wait complete. 2024-03-23T23:53:32.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.226+0000 7f1177e00640 1 Processor -- start 2024-03-23T23:53:32.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.226+0000 7f1177e00640 1 -- start start 2024-03-23T23:53:32.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.230+0000 7f1177e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11700731a0 0x7f11701518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:32.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.230+0000 7f1177e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11700c1b70 0x7f11701546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:32.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.230+0000 7f1177e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f117014f500 0x7f11701539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:32.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.230+0000 7f1177e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117015ea80 con 0x7f117014f500 2024-03-23T23:53:32.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.230+0000 7f1177e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117015e900 con 0x7f11700731a0 2024-03-23T23:53:32.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.230+0000 7f1177e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f117015ec00 con 0x7f11700c1b70 2024-03-23T23:53:32.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.230+0000 7f1175400640 1 -- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11700731a0 msgr2=0x7f11701518d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:53:32.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.230+0000 7f1175400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11700731a0 0x7f11701518d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:53:32.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.230+0000 7f1175e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f117014f500 0x7f11701539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:32.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.230+0000 7f1175e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f117014f500 0x7f11701539b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41190/0 (socket says 172.21.15.8:41190) 2024-03-23T23:53:32.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.230+0000 7f1175e00640 1 -- 172.21.15.8:0/3170965608 learned_addr learned my addr 172.21.15.8:0/3170965608 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:53:32.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.230+0000 7f1175e00640 1 -- 172.21.15.8:0/3170965608 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11700c1b70 msgr2=0x7f11701546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:32.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.230+0000 7f1175e00640 1 --2- 172.21.15.8:0/3170965608 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11700c1b70 0x7f11701546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:32.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.230+0000 7f1175e00640 1 -- 172.21.15.8:0/3170965608 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11700731a0 msgr2=0x7f11701518d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:53:32.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.230+0000 7f1175e00640 1 --2- 172.21.15.8:0/3170965608 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11700731a0 0x7f11701518d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:32.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.230+0000 7f1175e00640 1 -- 172.21.15.8:0/3170965608 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11701531f0 con 0x7f117014f500 2024-03-23T23:53:32.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.230+0000 7f1175e00640 1 --2- 172.21.15.8:0/3170965608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f117014f500 0x7f11701539b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f11680af040 tx=0x7f1168019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:32.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.230+0000 7f116d600640 1 -- 172.21.15.8:0/3170965608 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11680bc020 con 0x7f117014f500 2024-03-23T23:53:32.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.230+0000 7f116d600640 1 -- 172.21.15.8:0/3170965608 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11680b8690 con 0x7f117014f500 2024-03-23T23:53:32.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.230+0000 7f116d600640 1 -- 172.21.15.8:0/3170965608 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1168009510 con 0x7f117014f500 2024-03-23T23:53:32.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.230+0000 7f1177e00640 1 -- 172.21.15.8:0/3170965608 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1170151160 con 0x7f117014f500 2024-03-23T23:53:32.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.230+0000 7f1177e00640 1 -- 172.21.15.8:0/3170965608 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1170154bf0 con 0x7f117014f500 2024-03-23T23:53:32.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.230+0000 7f1177e00640 1 -- 172.21.15.8:0/3170965608 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f117004f480 con 0x7f117014f500 2024-03-23T23:53:32.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.234+0000 7f116d600640 1 -- 172.21.15.8:0/3170965608 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f11680bf020 con 0x7f117014f500 2024-03-23T23:53:32.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.234+0000 7f116d600640 1 --2- 172.21.15.8:0/3170965608 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1150067690 0x7f1150069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:32.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.234+0000 7f116d600640 1 -- 172.21.15.8:0/3170965608 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f1168120b90 con 0x7f117014f500 2024-03-23T23:53:32.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.238+0000 7f1175400640 1 --2- 172.21.15.8:0/3170965608 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1150067690 0x7f1150069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:32.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.238+0000 7f116d600640 1 -- 172.21.15.8:0/3170965608 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f11680c6030 con 0x7f117014f500 2024-03-23T23:53:32.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.242+0000 7f1175400640 1 --2- 172.21.15.8:0/3170965608 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1150067690 0x7f1150069b50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1164007fd0 tx=0x7f1164007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:32.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.586+0000 7f1177e00640 1 -- 172.21.15.8:0/3170965608 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f1170153660 con 0x7f117014f500 2024-03-23T23:53:32.590 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":82,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:53:32.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.586+0000 7f116d600640 1 -- 172.21.15.8:0/3170965608 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1555 (secure 0 0 0) 0x7f11680165e0 con 0x7f117014f500 2024-03-23T23:53:32.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.590+0000 7f1177e00640 1 -- 172.21.15.8:0/3170965608 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1150067690 msgr2=0x7f1150069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:32.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.590+0000 7f1177e00640 1 --2- 172.21.15.8:0/3170965608 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1150067690 0x7f1150069b50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1164007fd0 tx=0x7f1164007ac0 comp rx=0 tx=0).stop 2024-03-23T23:53:32.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.590+0000 7f1177e00640 1 -- 172.21.15.8:0/3170965608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f117014f500 msgr2=0x7f11701539b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:32.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.590+0000 7f1177e00640 1 --2- 172.21.15.8:0/3170965608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f117014f500 0x7f11701539b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f11680af040 tx=0x7f1168019700 comp rx=0 tx=0).stop 2024-03-23T23:53:32.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.594+0000 7f1177e00640 1 -- 172.21.15.8:0/3170965608 shutdown_connections 2024-03-23T23:53:32.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.594+0000 7f1177e00640 1 --2- 172.21.15.8:0/3170965608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f117014f500 0x7f11701539b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:32.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.594+0000 7f1177e00640 1 --2- 172.21.15.8:0/3170965608 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1150067690 0x7f1150069b50 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:32.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.594+0000 7f1177e00640 1 --2- 172.21.15.8:0/3170965608 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11700c1b70 0x7f11701546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:32.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.594+0000 7f1177e00640 1 --2- 172.21.15.8:0/3170965608 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11700731a0 0x7f11701518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:32.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.594+0000 7f1177e00640 1 -- 172.21.15.8:0/3170965608 >> 172.21.15.8:0/3170965608 conn(0x7f117006b170 msgr2=0x7f11700aaa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:53:32.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.602+0000 7f1177e00640 1 -- 172.21.15.8:0/3170965608 shutdown_connections 2024-03-23T23:53:32.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:32.602+0000 7f1177e00640 1 -- 172.21.15.8:0/3170965608 wait complete. 2024-03-23T23:53:35.670 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:53:36.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.046+0000 7f2e8f000640 1 Processor -- start 2024-03-23T23:53:36.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.046+0000 7f2e8f000640 1 -- start start 2024-03-23T23:53:36.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.046+0000 7f2e8f000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2e8814d7f0 0x7f2e880c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:36.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.046+0000 7f2e8f000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e88154320 0x7f2e88070090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:36.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.046+0000 7f2e8f000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2e880705d0 0x7f2e880c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:36.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.046+0000 7f2e8f000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e880c5850 con 0x7f2e8814d7f0 2024-03-23T23:53:36.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.046+0000 7f2e8f000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e880c52b0 con 0x7f2e880705d0 2024-03-23T23:53:36.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.046+0000 7f2e8f000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e880c5570 con 0x7f2e88154320 2024-03-23T23:53:36.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.046+0000 7f2e8d000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2e880705d0 0x7f2e880c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:36.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.046+0000 7f2e8d000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2e880705d0 0x7f2e880c5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:57978/0 (socket says 172.21.15.8:57978) 2024-03-23T23:53:36.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.046+0000 7f2e8d000640 1 -- 172.21.15.8:0/2257294012 learned_addr learned my addr 172.21.15.8:0/2257294012 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:53:36.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.046+0000 7f2e8d000640 1 -- 172.21.15.8:0/2257294012 >> v2:172.21.15.196:3300/0 conn(0x7f2e880705d0 msgr2=0x7f2e880c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:53:36.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.046+0000 7f2e8d000640 1 -- 172.21.15.8:0/2257294012 >> v2:172.21.15.196:3300/0 conn(0x7f2e880705d0 msgr2=0x7f2e880c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:53:36.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.046+0000 7f2e8d000640 1 --2- 172.21.15.8:0/2257294012 >> v2:172.21.15.196:3300/0 conn(0x7f2e880705d0 0x7f2e880c5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:53:36.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.050+0000 7f2e8d000640 1 --2- 172.21.15.8:0/2257294012 >> v2:172.21.15.196:3300/0 conn(0x7f2e880705d0 0x7f2e880c5a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:53:36.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.050+0000 7f2e87e00640 1 --2- 172.21.15.8:0/2257294012 >> v2:172.21.15.8:3300/0 conn(0x7f2e8814d7f0 0x7f2e880c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:36.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.050+0000 7f2e87e00640 1 -- 172.21.15.8:0/2257294012 >> v2:172.21.15.8:3300/0 conn(0x7f2e8814d7f0 msgr2=0x7f2e880c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:53:36.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.050+0000 7f2e87e00640 1 -- 172.21.15.8:0/2257294012 >> v2:172.21.15.8:3300/0 conn(0x7f2e8814d7f0 msgr2=0x7f2e880c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:53:36.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.050+0000 7f2e87e00640 1 --2- 172.21.15.8:0/2257294012 >> v2:172.21.15.8:3300/0 conn(0x7f2e8814d7f0 0x7f2e880c4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:53:36.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.050+0000 7f2e87e00640 1 --2- 172.21.15.8:0/2257294012 >> v2:172.21.15.8:3300/0 conn(0x7f2e8814d7f0 0x7f2e880c4d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:53:36.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.050+0000 7f2e87400640 1 --2- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e88154320 0x7f2e88070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:36.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.050+0000 7f2e87400640 1 -- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e88154320 msgr2=0x7f2e88070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T23:53:36.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.050+0000 7f2e87400640 1 -- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e88154320 msgr2=0x7f2e88070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:53:36.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.050+0000 7f2e87400640 1 --2- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e88154320 0x7f2e88070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:53:36.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.050+0000 7f2e87400640 1 --2- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e88154320 0x7f2e88070090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:53:36.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.254+0000 7f2e87e00640 1 --2- 172.21.15.8:0/2257294012 >> v2:172.21.15.8:3300/0 conn(0x7f2e8814d7f0 0x7f2e880c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:36.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.254+0000 7f2e87400640 1 --2- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e88154320 0x7f2e88070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:36.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.254+0000 7f2e8d000640 1 --2- 172.21.15.8:0/2257294012 >> v2:172.21.15.196:3300/0 conn(0x7f2e880705d0 0x7f2e880c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:36.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.254+0000 7f2e87e00640 1 -- 172.21.15.8:0/2257294012 >> v2:172.21.15.8:3300/0 conn(0x7f2e8814d7f0 msgr2=0x7f2e880c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:53:36.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.254+0000 7f2e87e00640 1 -- 172.21.15.8:0/2257294012 >> v2:172.21.15.8:3300/0 conn(0x7f2e8814d7f0 msgr2=0x7f2e880c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:53:36.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.254+0000 7f2e87e00640 1 --2- 172.21.15.8:0/2257294012 >> v2:172.21.15.8:3300/0 conn(0x7f2e8814d7f0 0x7f2e880c4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:53:36.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.254+0000 7f2e87e00640 1 --2- 172.21.15.8:0/2257294012 >> v2:172.21.15.8:3300/0 conn(0x7f2e8814d7f0 0x7f2e880c4d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:53:36.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.254+0000 7f2e8d000640 1 -- 172.21.15.8:0/2257294012 >> v2:172.21.15.196:3300/0 conn(0x7f2e880705d0 msgr2=0x7f2e880c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T23:53:36.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.254+0000 7f2e8d000640 1 -- 172.21.15.8:0/2257294012 >> v2:172.21.15.196:3300/0 conn(0x7f2e880705d0 msgr2=0x7f2e880c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:53:36.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.254+0000 7f2e8d000640 1 --2- 172.21.15.8:0/2257294012 >> v2:172.21.15.196:3300/0 conn(0x7f2e880705d0 0x7f2e880c5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:53:36.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.254+0000 7f2e8d000640 1 --2- 172.21.15.8:0/2257294012 >> v2:172.21.15.196:3300/0 conn(0x7f2e880705d0 0x7f2e880c5a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:53:36.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.254+0000 7f2e87400640 1 -- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e88154320 msgr2=0x7f2e88070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:53:36.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.254+0000 7f2e87400640 1 -- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e88154320 msgr2=0x7f2e88070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:53:36.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.254+0000 7f2e87400640 1 --2- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e88154320 0x7f2e88070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:53:36.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.254+0000 7f2e87400640 1 --2- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e88154320 0x7f2e88070090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:53:36.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.658+0000 7f2e87e00640 1 --2- 172.21.15.8:0/2257294012 >> v2:172.21.15.8:3300/0 conn(0x7f2e8814d7f0 0x7f2e880c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:36.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.658+0000 7f2e87e00640 1 -- 172.21.15.8:0/2257294012 >> v2:172.21.15.8:3300/0 conn(0x7f2e8814d7f0 msgr2=0x7f2e880c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:53:36.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.658+0000 7f2e87e00640 1 -- 172.21.15.8:0/2257294012 >> v2:172.21.15.8:3300/0 conn(0x7f2e8814d7f0 msgr2=0x7f2e880c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:53:36.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.658+0000 7f2e87e00640 1 --2- 172.21.15.8:0/2257294012 >> v2:172.21.15.8:3300/0 conn(0x7f2e8814d7f0 0x7f2e880c4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:53:36.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.658+0000 7f2e87e00640 1 --2- 172.21.15.8:0/2257294012 >> v2:172.21.15.8:3300/0 conn(0x7f2e8814d7f0 0x7f2e880c4d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:53:36.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.662+0000 7f2e8d000640 1 --2- 172.21.15.8:0/2257294012 >> v2:172.21.15.196:3300/0 conn(0x7f2e880705d0 0x7f2e880c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:36.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.666+0000 7f2e8d000640 1 -- 172.21.15.8:0/2257294012 >> v2:172.21.15.196:3300/0 conn(0x7f2e880705d0 msgr2=0x7f2e880c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:53:36.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.666+0000 7f2e8d000640 1 -- 172.21.15.8:0/2257294012 >> v2:172.21.15.196:3300/0 conn(0x7f2e880705d0 msgr2=0x7f2e880c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:53:36.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.666+0000 7f2e8d000640 1 --2- 172.21.15.8:0/2257294012 >> v2:172.21.15.196:3300/0 conn(0x7f2e880705d0 0x7f2e880c5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:53:36.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.666+0000 7f2e8d000640 1 --2- 172.21.15.8:0/2257294012 >> v2:172.21.15.196:3300/0 conn(0x7f2e880705d0 0x7f2e880c5a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:53:36.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.666+0000 7f2e87400640 1 --2- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e88154320 0x7f2e88070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:36.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.666+0000 7f2e87400640 1 -- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e88154320 msgr2=0x7f2e88070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:53:36.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.666+0000 7f2e87400640 1 -- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e88154320 msgr2=0x7f2e88070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:53:36.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.666+0000 7f2e87400640 1 --2- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e88154320 0x7f2e88070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:53:36.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:36.666+0000 7f2e87400640 1 --2- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e88154320 0x7f2e88070090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:53:37.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:37.466+0000 7f2e87e00640 1 --2- 172.21.15.8:0/2257294012 >> v2:172.21.15.8:3300/0 conn(0x7f2e8814d7f0 0x7f2e880c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:37.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:37.466+0000 7f2e87e00640 1 -- 172.21.15.8:0/2257294012 >> v2:172.21.15.8:3300/0 conn(0x7f2e8814d7f0 msgr2=0x7f2e880c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:53:37.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:37.466+0000 7f2e87e00640 1 -- 172.21.15.8:0/2257294012 >> v2:172.21.15.8:3300/0 conn(0x7f2e8814d7f0 msgr2=0x7f2e880c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:53:37.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:37.466+0000 7f2e87e00640 1 --2- 172.21.15.8:0/2257294012 >> v2:172.21.15.8:3300/0 conn(0x7f2e8814d7f0 0x7f2e880c4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:53:37.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:37.466+0000 7f2e87e00640 1 --2- 172.21.15.8:0/2257294012 >> v2:172.21.15.8:3300/0 conn(0x7f2e8814d7f0 0x7f2e880c4d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:53:37.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:37.470+0000 7f2e8d000640 1 --2- 172.21.15.8:0/2257294012 >> v2:172.21.15.196:3300/0 conn(0x7f2e880705d0 0x7f2e880c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:37.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:37.470+0000 7f2e8d000640 1 -- 172.21.15.8:0/2257294012 >> v2:172.21.15.196:3300/0 conn(0x7f2e880705d0 msgr2=0x7f2e880c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:53:37.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:37.470+0000 7f2e8d000640 1 -- 172.21.15.8:0/2257294012 >> v2:172.21.15.196:3300/0 conn(0x7f2e880705d0 msgr2=0x7f2e880c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:53:37.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:37.470+0000 7f2e8d000640 1 --2- 172.21.15.8:0/2257294012 >> v2:172.21.15.196:3300/0 conn(0x7f2e880705d0 0x7f2e880c5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:53:37.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:37.470+0000 7f2e8d000640 1 --2- 172.21.15.8:0/2257294012 >> v2:172.21.15.196:3300/0 conn(0x7f2e880705d0 0x7f2e880c5a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:53:37.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:37.470+0000 7f2e87400640 1 --2- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e88154320 0x7f2e88070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:37.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:37.470+0000 7f2e87400640 1 -- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e88154320 msgr2=0x7f2e88070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:53:37.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:37.470+0000 7f2e87400640 1 -- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e88154320 msgr2=0x7f2e88070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:53:37.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:37.470+0000 7f2e87400640 1 --2- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e88154320 0x7f2e88070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:53:37.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:37.470+0000 7f2e87400640 1 --2- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e88154320 0x7f2e88070090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:53:39.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.050+0000 7f2e85600640 1 -- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e88154320 msgr2=0x7f2e88070090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:53:39.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.050+0000 7f2e85600640 1 --2- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e88154320 0x7f2e88070090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:39.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.050+0000 7f2e85600640 1 -- 172.21.15.8:0/2257294012 >> v2:172.21.15.196:3300/0 conn(0x7f2e880705d0 msgr2=0x7f2e880c5a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:53:39.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.050+0000 7f2e85600640 1 --2- 172.21.15.8:0/2257294012 >> v2:172.21.15.196:3300/0 conn(0x7f2e880705d0 0x7f2e880c5a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:39.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.050+0000 7f2e85600640 1 -- 172.21.15.8:0/2257294012 >> v2:172.21.15.8:3300/0 conn(0x7f2e8814d7f0 msgr2=0x7f2e880c4d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:53:39.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.050+0000 7f2e85600640 1 --2- 172.21.15.8:0/2257294012 >> v2:172.21.15.8:3300/0 conn(0x7f2e8814d7f0 0x7f2e880c4d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:39.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.054+0000 7f2e85600640 1 -- 172.21.15.8:0/2257294012 --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e88153840 con 0x7f2e6c0036c0 2024-03-23T23:53:39.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.054+0000 7f2e85600640 1 -- 172.21.15.8:0/2257294012 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e6c00c0f0 con 0x7f2e6c007370 2024-03-23T23:53:39.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.058+0000 7f2e86a00640 1 -- 172.21.15.8:0/2257294012 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1019326728 0 0) 0x7f2e88153840 con 0x7f2e6c0036c0 2024-03-23T23:53:39.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.058+0000 7f2e86a00640 1 -- 172.21.15.8:0/2257294012 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e64003530 con 0x7f2e6c0036c0 2024-03-23T23:53:39.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.058+0000 7f2e86a00640 1 -- 172.21.15.8:0/2257294012 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3979479554 0 0) 0x7f2e64003530 con 0x7f2e6c0036c0 2024-03-23T23:53:39.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.058+0000 7f2e86a00640 1 -- 172.21.15.8:0/2257294012 >> v1:172.21.15.196:6789/0 conn(0x7f2e6c007370 legacy=0x7f2e6c009830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:53:39.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.058+0000 7f2e86a00640 1 -- 172.21.15.8:0/2257294012 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6c00d3f0 con 0x7f2e6c0036c0 2024-03-23T23:53:39.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.058+0000 7f2e86a00640 1 -- 172.21.15.8:0/2257294012 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7f2e78009a00 con 0x7f2e6c0036c0 2024-03-23T23:53:39.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.058+0000 7f2e86a00640 1 -- 172.21.15.8:0/2257294012 >> v1:172.21.15.8:6789/0 conn(0x7f2e6c0036c0 legacy=0x7f2e6c005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:39.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.058+0000 7f2e8d000640 1 -- 172.21.15.8:0/2257294012 reap_dead start 2024-03-23T23:53:39.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.058+0000 7f2e86a00640 1 --2- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e64003ab0 0x7f2e64003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:39.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.058+0000 7f2e86a00640 1 --2- 172.21.15.8:0/2257294012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e64004810 0x7f2e64004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:39.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.058+0000 7f2e86a00640 1 --2- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e640099c0 0x7f2e6400bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:39.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.058+0000 7f2e86a00640 1 -- 172.21.15.8:0/2257294012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6400c3a0 con 0x7f2e64004810 2024-03-23T23:53:39.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.058+0000 7f2e86a00640 1 -- 172.21.15.8:0/2257294012 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6400c550 con 0x7f2e640099c0 2024-03-23T23:53:39.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.058+0000 7f2e86a00640 1 -- 172.21.15.8:0/2257294012 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6400c750 con 0x7f2e64003ab0 2024-03-23T23:53:39.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.062+0000 7f2e8d000640 1 --2- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e640099c0 0x7f2e6400bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:39.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.062+0000 7f2e87400640 1 --2- 172.21.15.8:0/2257294012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e64004810 0x7f2e64004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:39.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.062+0000 7f2e87e00640 1 --2- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e64003ab0 0x7f2e64003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:39.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.062+0000 7f2e8d000640 1 -- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e64003ab0 msgr2=0x7f2e64003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:53:39.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.062+0000 7f2e8d000640 1 --2- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e64003ab0 0x7f2e64003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:39.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.062+0000 7f2e8d000640 1 -- 172.21.15.8:0/2257294012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e64004810 msgr2=0x7f2e64004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:53:39.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.062+0000 7f2e8d000640 1 --2- 172.21.15.8:0/2257294012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e64004810 0x7f2e64004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:39.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.062+0000 7f2e8d000640 1 -- 172.21.15.8:0/2257294012 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e64003530 con 0x7f2e640099c0 2024-03-23T23:53:39.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.078+0000 7f2e8d000640 1 --2- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e640099c0 0x7f2e6400bdb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2e880c9c20 tx=0x7f2e8001cfa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=397eb53ef5605f7c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:39.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.090+0000 7f2e86a00640 1 -- 172.21.15.8:0/2257294012 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e800ab070 con 0x7f2e640099c0 2024-03-23T23:53:39.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.090+0000 7f2e86a00640 1 -- 172.21.15.8:0/2257294012 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e800a5d60 con 0x7f2e640099c0 2024-03-23T23:53:39.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.090+0000 7f2e86a00640 1 -- 172.21.15.8:0/2257294012 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8000f040 con 0x7f2e640099c0 2024-03-23T23:53:39.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.094+0000 7f2e8f000640 1 -- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e640099c0 msgr2=0x7f2e6400bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:39.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.094+0000 7f2e8f000640 1 --2- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e640099c0 0x7f2e6400bdb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2e880c9c20 tx=0x7f2e8001cfa0 comp rx=0 tx=0).stop 2024-03-23T23:53:39.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.094+0000 7f2e8f000640 1 -- 172.21.15.8:0/2257294012 shutdown_connections 2024-03-23T23:53:39.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.094+0000 7f2e8f000640 1 --2- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e640099c0 0x7f2e6400bdb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:39.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.094+0000 7f2e8f000640 1 --2- 172.21.15.8:0/2257294012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e64004810 0x7f2e64004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:39.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.094+0000 7f2e8f000640 1 --2- 172.21.15.8:0/2257294012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e64003ab0 0x7f2e64003e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:39.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.094+0000 7f2e8f000640 1 -- 172.21.15.8:0/2257294012 >> 172.21.15.8:0/2257294012 conn(0x7f2e880c8fe0 msgr2=0x7f2e880c93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:53:39.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.094+0000 7f2e8f000640 1 -- 172.21.15.8:0/2257294012 shutdown_connections 2024-03-23T23:53:39.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.094+0000 7f2e8f000640 1 -- 172.21.15.8:0/2257294012 wait complete. 2024-03-23T23:53:39.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.098+0000 7f2e8f000640 1 Processor -- start 2024-03-23T23:53:39.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.106+0000 7f2e8f000640 1 -- start start 2024-03-23T23:53:39.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.110+0000 7f2e8f000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e64003ab0 0x7f2e880ac7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:39.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.110+0000 7f2e8f000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e64004810 0x7f2e880ae360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:39.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.110+0000 7f2e8f000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e640099c0 0x7f2e880ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:39.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.110+0000 7f2e8f000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e880af120 con 0x7f2e64004810 2024-03-23T23:53:39.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.110+0000 7f2e8f000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e880c6280 con 0x7f2e640099c0 2024-03-23T23:53:39.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.110+0000 7f2e8f000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e880c6ee0 con 0x7f2e64003ab0 2024-03-23T23:53:39.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.110+0000 7f2e87400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e64004810 0x7f2e880ae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:39.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.110+0000 7f2e87400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e64004810 0x7f2e880ae360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48512/0 (socket says 172.21.15.8:48512) 2024-03-23T23:53:39.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.110+0000 7f2e87400640 1 -- 172.21.15.8:0/4159551167 learned_addr learned my addr 172.21.15.8:0/4159551167 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:53:39.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.114+0000 7f2e8d000640 1 --2- 172.21.15.8:0/4159551167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e640099c0 0x7f2e880ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:39.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.114+0000 7f2e87e00640 1 --2- 172.21.15.8:0/4159551167 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e64003ab0 0x7f2e880ac7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:39.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.114+0000 7f2e8d000640 1 -- 172.21.15.8:0/4159551167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e640099c0 msgr2=0x7f2e880ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-03-23T23:53:39.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.114+0000 7f2e8d000640 1 -- 172.21.15.8:0/4159551167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e640099c0 msgr2=0x7f2e880ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T23:53:39.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.114+0000 7f2e8d000640 1 --2- 172.21.15.8:0/4159551167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e640099c0 0x7f2e880ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:53:39.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.114+0000 7f2e8d000640 1 --2- 172.21.15.8:0/4159551167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e640099c0 0x7f2e880ae8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:53:39.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.114+0000 7f2e87400640 1 -- 172.21.15.8:0/4159551167 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e64003ab0 msgr2=0x7f2e880ac7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:39.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.114+0000 7f2e87400640 1 --2- 172.21.15.8:0/4159551167 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e64003ab0 0x7f2e880ac7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:39.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.114+0000 7f2e87400640 1 -- 172.21.15.8:0/4159551167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e640099c0 msgr2=0x7f2e880ae8a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:53:39.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.114+0000 7f2e87400640 1 --2- 172.21.15.8:0/4159551167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e640099c0 0x7f2e880ae8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:39.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.114+0000 7f2e87400640 1 -- 172.21.15.8:0/4159551167 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e880adf40 con 0x7f2e64004810 2024-03-23T23:53:39.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.118+0000 7f2e87400640 1 --2- 172.21.15.8:0/4159551167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e64004810 0x7f2e880ae360 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2e70015670 tx=0x7f2e70015b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:39.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.122+0000 7f2e7fe00640 1 -- 172.21.15.8:0/4159551167 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e700118a0 con 0x7f2e64004810 2024-03-23T23:53:39.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.122+0000 7f2e7fe00640 1 -- 172.21.15.8:0/4159551167 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e70011a40 con 0x7f2e64004810 2024-03-23T23:53:39.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.122+0000 7f2e7fe00640 1 -- 172.21.15.8:0/4159551167 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e70011df0 con 0x7f2e64004810 2024-03-23T23:53:39.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.126+0000 7f2e8f000640 1 -- 172.21.15.8:0/4159551167 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e880abae0 con 0x7f2e64004810 2024-03-23T23:53:39.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.126+0000 7f2e8f000640 1 -- 172.21.15.8:0/4159551167 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e880ab000 con 0x7f2e64004810 2024-03-23T23:53:39.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.130+0000 7f2e8f000640 1 -- 172.21.15.8:0/4159551167 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e88067a40 con 0x7f2e64004810 2024-03-23T23:53:39.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.134+0000 7f2e7fe00640 1 -- 172.21.15.8:0/4159551167 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f2e7001f020 con 0x7f2e64004810 2024-03-23T23:53:39.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.138+0000 7f2e7fe00640 1 --2- 172.21.15.8:0/4159551167 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2e6c067ec0 0x7f2e6c06a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:39.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.138+0000 7f2e7fe00640 1 -- 172.21.15.8:0/4159551167 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f2e700866b0 con 0x7f2e64004810 2024-03-23T23:53:39.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.142+0000 7f2e87e00640 1 --2- 172.21.15.8:0/4159551167 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2e6c067ec0 0x7f2e6c06a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:39.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.154+0000 7f2e87e00640 1 --2- 172.21.15.8:0/4159551167 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2e6c067ec0 0x7f2e6c06a380 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2e78007080 tx=0x7f2e78003ad0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:39.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.186+0000 7f2e7fe00640 1 -- 172.21.15.8:0/4159551167 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f2e70026060 con 0x7f2e64004810 2024-03-23T23:53:39.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.714+0000 7f2e8f000640 1 -- 172.21.15.8:0/4159551167 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f2e880c6870 con 0x7f2e64004810 2024-03-23T23:53:39.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.714+0000 7f2e7fe00640 1 -- 172.21.15.8:0/4159551167 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1560 (secure 0 0 0) 0x7f2e70056fe0 con 0x7f2e64004810 2024-03-23T23:53:39.715 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":90,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:53:39.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.722+0000 7f2e8f000640 1 -- 172.21.15.8:0/4159551167 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2e6c067ec0 msgr2=0x7f2e6c06a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:39.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.722+0000 7f2e8f000640 1 --2- 172.21.15.8:0/4159551167 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2e6c067ec0 0x7f2e6c06a380 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2e78007080 tx=0x7f2e78003ad0 comp rx=0 tx=0).stop 2024-03-23T23:53:39.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.722+0000 7f2e8f000640 1 -- 172.21.15.8:0/4159551167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e64004810 msgr2=0x7f2e880ae360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:39.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.722+0000 7f2e8f000640 1 --2- 172.21.15.8:0/4159551167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e64004810 0x7f2e880ae360 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2e70015670 tx=0x7f2e70015b30 comp rx=0 tx=0).stop 2024-03-23T23:53:39.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.722+0000 7f2e8f000640 1 -- 172.21.15.8:0/4159551167 shutdown_connections 2024-03-23T23:53:39.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.722+0000 7f2e8f000640 1 --2- 172.21.15.8:0/4159551167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e640099c0 0x7f2e880ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:39.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.722+0000 7f2e8f000640 1 --2- 172.21.15.8:0/4159551167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e64004810 0x7f2e880ae360 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2e70015670 tx=0x7f2e70015b30 comp rx=0 tx=0).stop 2024-03-23T23:53:39.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.722+0000 7f2e8f000640 1 --2- 172.21.15.8:0/4159551167 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2e6c067ec0 0x7f2e6c06a380 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:39.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.722+0000 7f2e8f000640 1 --2- 172.21.15.8:0/4159551167 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e64003ab0 0x7f2e880ac7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:39.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.722+0000 7f2e8f000640 1 -- 172.21.15.8:0/4159551167 >> 172.21.15.8:0/4159551167 conn(0x7f2e880c8fe0 msgr2=0x7f2e8814a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:53:39.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.722+0000 7f2e8f000640 1 -- 172.21.15.8:0/4159551167 shutdown_connections 2024-03-23T23:53:39.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:39.722+0000 7f2e8f000640 1 -- 172.21.15.8:0/4159551167 wait complete. 2024-03-23T23:53:39.805 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T23:53:39.805 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T23:53:39.806 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:53:40.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.258+0000 7f822ce00640 1 Processor -- start 2024-03-23T23:53:40.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.258+0000 7f822ce00640 1 -- start start 2024-03-23T23:53:40.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.262+0000 7f822ce00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82200d4320 0x7f82200dadf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:40.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.262+0000 7f822ce00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f82200496e0 0x7f8220006f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:40.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.262+0000 7f822ce00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8220049db0 con 0x7f8220007440 2024-03-23T23:53:40.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.262+0000 7f822ce00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82200dd960 con 0x7f82200496e0 2024-03-23T23:53:40.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.262+0000 7f822ce00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8220046300 con 0x7f82200d4320 2024-03-23T23:53:40.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.262+0000 7f8226800640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f8220007440 0x7f82200dddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:56138/0 (socket says 172.21.15.8:56138) 2024-03-23T23:53:40.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.262+0000 7f8226800640 1 -- 172.21.15.8:0/3692780962 learned_addr learned my addr 172.21.15.8:0/3692780962 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:53:40.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.262+0000 7f8225e00640 1 --2- 172.21.15.8:0/3692780962 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82200d4320 0x7f82200dadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:40.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.266+0000 7f8225e00640 1 -- 172.21.15.8:0/3692780962 >> v2:172.21.15.8:3300/0 conn(0x7f82200496e0 msgr2=0x7f8220006f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:53:40.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.266+0000 7f8225e00640 1 --2- 172.21.15.8:0/3692780962 >> v2:172.21.15.8:3300/0 conn(0x7f82200496e0 0x7f8220006f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:40.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.266+0000 7f8225e00640 1 -- 172.21.15.8:0/3692780962 >> v1:172.21.15.196:6789/0 conn(0x7f8220007440 legacy=0x7f82200dddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:53:40.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.266+0000 7f8225e00640 1 -- 172.21.15.8:0/3692780962 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82200465e0 con 0x7f82200d4320 2024-03-23T23:53:40.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.270+0000 7f8225e00640 1 --2- 172.21.15.8:0/3692780962 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82200d4320 0x7f82200dadf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f822000d380 tx=0x7f821801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e07b9a7c23e1a06 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:40.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.270+0000 7f8224a00640 1 -- 172.21.15.8:0/3692780962 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82180b0070 con 0x7f82200d4320 2024-03-23T23:53:40.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.270+0000 7f8224a00640 1 -- 172.21.15.8:0/3692780962 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82180ab600 con 0x7f82200d4320 2024-03-23T23:53:40.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.270+0000 7f8224a00640 1 -- 172.21.15.8:0/3692780962 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82180ab9d0 con 0x7f82200d4320 2024-03-23T23:53:40.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.274+0000 7f822ce00640 1 -- 172.21.15.8:0/3692780962 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82200d4320 msgr2=0x7f82200dadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:40.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.274+0000 7f822ce00640 1 --2- 172.21.15.8:0/3692780962 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82200d4320 0x7f82200dadf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f822000d380 tx=0x7f821801c3f0 comp rx=0 tx=0).stop 2024-03-23T23:53:40.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.278+0000 7f822ce00640 1 -- 172.21.15.8:0/3692780962 shutdown_connections 2024-03-23T23:53:40.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.278+0000 7f822ce00640 1 --2- 172.21.15.8:0/3692780962 >> v2:172.21.15.8:3300/0 conn(0x7f82200496e0 0x7f8220006f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:40.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.278+0000 7f822ce00640 1 --2- 172.21.15.8:0/3692780962 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82200d4320 0x7f82200dadf0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:40.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.278+0000 7f822ce00640 1 -- 172.21.15.8:0/3692780962 >> 172.21.15.8:0/3692780962 conn(0x7f8220048260 msgr2=0x7f8220048670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:53:40.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.278+0000 7f822ce00640 1 -- 172.21.15.8:0/3692780962 shutdown_connections 2024-03-23T23:53:40.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.278+0000 7f822ce00640 1 -- 172.21.15.8:0/3692780962 wait complete. 2024-03-23T23:53:40.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.282+0000 7f822ce00640 1 Processor -- start 2024-03-23T23:53:40.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.282+0000 7f822ce00640 1 -- start start 2024-03-23T23:53:40.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.282+0000 7f822ce00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8220007440 0x7f82200d0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:40.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.282+0000 7f822ce00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82200496e0 0x7f82200c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:40.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.282+0000 7f822ce00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f82200d4320 0x7f82200ce970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:40.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.282+0000 7f822ce00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82200e7690 con 0x7f82200496e0 2024-03-23T23:53:40.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.282+0000 7f822ce00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82200e7510 con 0x7f82200d4320 2024-03-23T23:53:40.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.282+0000 7f8225400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82200496e0 0x7f82200c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:40.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.282+0000 7f822ce00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82200e7810 con 0x7f8220007440 2024-03-23T23:53:40.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.282+0000 7f8225400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82200496e0 0x7f82200c8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48534/0 (socket says 172.21.15.8:48534) 2024-03-23T23:53:40.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.282+0000 7f8225400640 1 -- 172.21.15.8:0/1213915526 learned_addr learned my addr 172.21.15.8:0/1213915526 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:53:40.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.286+0000 7f8225400640 1 -- 172.21.15.8:0/1213915526 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8220007440 msgr2=0x7f82200d0f10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-23T23:53:40.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.286+0000 7f8225400640 1 --2- 172.21.15.8:0/1213915526 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8220007440 0x7f82200d0f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:40.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.286+0000 7f8225400640 1 -- 172.21.15.8:0/1213915526 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f82200d4320 msgr2=0x7f82200ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:40.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.286+0000 7f8225400640 1 --2- 172.21.15.8:0/1213915526 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f82200d4320 0x7f82200ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:40.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.286+0000 7f8225400640 1 -- 172.21.15.8:0/1213915526 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82200dc790 con 0x7f82200496e0 2024-03-23T23:53:40.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.286+0000 7f8225400640 1 --2- 172.21.15.8:0/1213915526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82200496e0 0x7f82200c8dc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f821400b410 tx=0x7f821400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:40.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.286+0000 7f821e000640 1 -- 172.21.15.8:0/1213915526 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8214015020 con 0x7f82200496e0 2024-03-23T23:53:40.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.286+0000 7f821e000640 1 -- 172.21.15.8:0/1213915526 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8214011830 con 0x7f82200496e0 2024-03-23T23:53:40.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.286+0000 7f821e000640 1 -- 172.21.15.8:0/1213915526 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8214011c20 con 0x7f82200496e0 2024-03-23T23:53:40.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.286+0000 7f822ce00640 1 -- 172.21.15.8:0/1213915526 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82201774d0 con 0x7f82200496e0 2024-03-23T23:53:40.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.286+0000 7f822ce00640 1 -- 172.21.15.8:0/1213915526 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82200dbaf0 con 0x7f82200496e0 2024-03-23T23:53:40.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.290+0000 7f821e000640 1 -- 172.21.15.8:0/1213915526 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f8214018020 con 0x7f82200496e0 2024-03-23T23:53:40.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.290+0000 7f821e000640 1 --2- 172.21.15.8:0/1213915526 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f82080676b0 0x7f8208069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:40.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.290+0000 7f822ce00640 1 --2- 172.21.15.8:0/1213915526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82200c76f0 0x7f82200ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:40.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.290+0000 7f822ce00640 1 -- 172.21.15.8:0/1213915526 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82200052d0 con 0x7f82200c76f0 2024-03-23T23:53:40.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.294+0000 7f8226800640 1 --2- 172.21.15.8:0/1213915526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82200c76f0 0x7f82200ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:40.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.294+0000 7f8226800640 1 -- 172.21.15.8:0/1213915526 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f82200dce50 con 0x7f82200c76f0 2024-03-23T23:53:40.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.294+0000 7f8226800640 1 --2- 172.21.15.8:0/1213915526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82200c76f0 0x7f82200ceeb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f82200dbe10 tx=0x7f8228068640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:40.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.294+0000 7f821e000640 1 -- 172.21.15.8:0/1213915526 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f8214053dc0 con 0x7f82200496e0 2024-03-23T23:53:40.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.294+0000 7f821e000640 1 -- 172.21.15.8:0/1213915526 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822806c070 con 0x7f82200c76f0 2024-03-23T23:53:40.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.294+0000 7f821e000640 1 -- 172.21.15.8:0/1213915526 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f8228068770 con 0x7f82200c76f0 2024-03-23T23:53:40.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.294+0000 7f821e000640 1 -- 172.21.15.8:0/1213915526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82200c76f0 msgr2=0x7f82200ceeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:40.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.294+0000 7f821e000640 1 --2- 172.21.15.8:0/1213915526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82200c76f0 0x7f82200ceeb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f82200dbe10 tx=0x7f8228068640 comp rx=0 tx=0).stop 2024-03-23T23:53:40.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.294+0000 7f821e000640 1 -- 172.21.15.8:0/1213915526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82200c76f0 msgr2=0x7f82200ceeb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:53:40.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.294+0000 7f821e000640 1 --2- 172.21.15.8:0/1213915526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82200c76f0 0x7f82200ceeb0 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f82200dbe10 tx=0x7f8228068640 comp rx=0 tx=0).stop 2024-03-23T23:53:40.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.298+0000 7f8225e00640 1 --2- 172.21.15.8:0/1213915526 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f82080676b0 0x7f8208069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:40.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.302+0000 7f8225e00640 1 --2- 172.21.15.8:0/1213915526 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f82080676b0 0x7f8208069b70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f82180ad000 tx=0x7f82180a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:40.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.310+0000 7f822ce00640 1 --2- 172.21.15.8:0/1213915526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82200cf940 0x7f82200cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:40.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.310+0000 7f822ce00640 1 -- 172.21.15.8:0/1213915526 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82200315c0 con 0x7f82200cf940 2024-03-23T23:53:40.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.310+0000 7f8226800640 1 --2- 172.21.15.8:0/1213915526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82200cf940 0x7f82200cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:40.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.314+0000 7f8226800640 1 -- 172.21.15.8:0/1213915526 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f82200de200 con 0x7f82200cf940 2024-03-23T23:53:40.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.314+0000 7f8226800640 1 --2- 172.21.15.8:0/1213915526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82200cf940 0x7f82200cfd50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f822802d610 tx=0x7f8228075570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:40.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.314+0000 7f821e000640 1 -- 172.21.15.8:0/1213915526 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82280a2460 con 0x7f82200cf940 2024-03-23T23:53:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.314+0000 7f821e000640 1 -- 172.21.15.8:0/1213915526 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5014 (secure 0 0 0) 0x7f82280a2460 con 0x7f82200cf940 2024-03-23T23:53:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.314+0000 7f821e000640 1 -- 172.21.15.8:0/1213915526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82200cf940 msgr2=0x7f82200cfd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.314+0000 7f821e000640 1 --2- 172.21.15.8:0/1213915526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82200cf940 0x7f82200cfd50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f822802d610 tx=0x7f8228075570 comp rx=0 tx=0).stop 2024-03-23T23:53:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.314+0000 7f821e000640 1 -- 172.21.15.8:0/1213915526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82200cf940 msgr2=0x7f82200cfd50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:53:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.314+0000 7f821e000640 1 --2- 172.21.15.8:0/1213915526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82200cf940 0x7f82200cfd50 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f822802d610 tx=0x7f8228075570 comp rx=0 tx=0).stop 2024-03-23T23:53:40.320 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:53:40.320 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:53:40.320 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:53:40.320 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:53:40.320 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 90, 2024-03-23T23:53:40.320 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:53:40.320 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:53:40.320 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:53:40.320 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:53:40.321 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:40.321 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 2, 2024-03-23T23:53:40.321 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:53:40.321 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:53:40.321 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:53:40.321 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:53:40.321 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:53:40.321 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:53:40.321 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:53:40.322 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:53:40.322 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:53:40.322 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:53:40.322 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:53:40.322 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:53:40.322 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:53:40.322 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:53:40.322 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:40.322 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:53:40.322 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:53:40.322 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:53:40.322 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:53:40.323 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:53:40.323 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:53:40.323 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:53:40.323 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:53:40.323 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:53:40.323 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:53:40.323 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:53:40.323 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:53:40.323 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:53:40.323 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:40.323 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:40.323 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:53:40.323 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:53:40.324 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:53:40.324 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:53:40.324 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:53:40.324 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:53:40.324 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:53:40.324 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:53:40.324 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:53:40.324 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:53:40.324 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:53:40.324 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:53:40.324 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:53:40.324 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:53:40.324 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:53:40.324 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:53:40.325 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:53:40.325 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:53:40.325 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:53:40.325 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:53:40.325 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:53:40.325 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:53:40.325 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:53:40.325 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:53:40.325 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:53:40.325 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:53:40.325 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:53:40.325 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:53:40.325 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:40.325 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:53:40.326 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:40.326 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:53:40.326 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:40.326 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:53:40.326 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:53:40.326 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:53:40.326 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:53:40.326 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:40.326 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:53:40.326 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:53:40.326 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:40.326 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:40.326 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:40.327 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:53:40.327 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:53:40.327 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:40.327 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:40.327 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:40.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:40.327 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:53:40.327 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:53:40.327 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:53:40.327 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:53:40.327 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:53:40.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:40.327 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:40.327 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:53:40.328 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:53:40.328 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:53:40.328 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:53:40.328 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:40.328 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:53:40.328 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:53:40.328 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:40.328 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:40.328 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:40.328 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:53:40.328 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:53:40.328 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:40.328 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:40.329 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:40.329 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:40.329 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:53:40.329 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:53:40.329 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:53:40.329 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:53:40.329 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:53:40.329 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:40.329 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:40.329 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:53:40.329 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:53:40.329 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:53:40.329 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:53:40.329 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:40.330 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:53:40.330 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:53:40.330 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:40.330 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:40.330 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:40.330 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:53:40.330 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:53:40.330 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:40.330 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:40.330 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:40.330 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:40.330 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:53:40.330 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:53:40.331 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:53:40.331 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:53:40.331 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:53:40.331 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:40.331 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:40.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:40.331 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:53:40.331 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:53:40.331 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:40.331 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:53:40.331 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:40.331 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:53:40.331 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:40.331 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:40.332 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:53:40.332 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:40.332 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:53:40.332 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:40.332 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:53:40.332 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:40.332 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:40.332 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:53:40.332 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:40.332 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:53:40.332 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:40.332 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:53:40.332 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:40.332 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:40.333 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:53:40.333 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:40.333 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:53:40.333 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:40.333 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:53:40.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:40.333 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:40.333 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:53:40.333 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:40.333 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5 2024-03-23T23:53:40.333 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:40.333 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:40.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:40.333 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:53:40.334 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:53:40.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.326+0000 7f822ce00640 1 -- 172.21.15.8:0/1213915526 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f82080676b0 msgr2=0x7f8208069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:40.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.326+0000 7f822ce00640 1 --2- 172.21.15.8:0/1213915526 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f82080676b0 0x7f8208069b70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f82180ad000 tx=0x7f82180a6000 comp rx=0 tx=0).stop 2024-03-23T23:53:40.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.326+0000 7f822ce00640 1 -- 172.21.15.8:0/1213915526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82200496e0 msgr2=0x7f82200c8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:40.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.326+0000 7f822ce00640 1 --2- 172.21.15.8:0/1213915526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82200496e0 0x7f82200c8dc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f821400b410 tx=0x7f821400b8d0 comp rx=0 tx=0).stop 2024-03-23T23:53:40.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.326+0000 7f8226800640 1 -- 172.21.15.8:0/1213915526 reap_dead start 2024-03-23T23:53:40.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.326+0000 7f822ce00640 1 -- 172.21.15.8:0/1213915526 shutdown_connections 2024-03-23T23:53:40.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.326+0000 7f822ce00640 1 -- 172.21.15.8:0/1213915526 >> 172.21.15.8:0/1213915526 conn(0x7f8220048260 msgr2=0x7f822002bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:53:40.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.326+0000 7f822ce00640 1 -- 172.21.15.8:0/1213915526 shutdown_connections 2024-03-23T23:53:40.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.326+0000 7f822ce00640 1 -- 172.21.15.8:0/1213915526 wait complete. 2024-03-23T23:53:40.384 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:53:40.384 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T23:53:40.384 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:53:40.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.642+0000 7ff4d5e00640 1 Processor -- start 2024-03-23T23:53:40.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.642+0000 7ff4d5e00640 1 -- start start 2024-03-23T23:53:40.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.642+0000 7ff4d5e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4d00c3f60 0x7ff4d0071a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:40.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.642+0000 7ff4d5e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff4d00c3600 0x7ff4d00c1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:40.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.646+0000 7ff4d5e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff4d00c21b0 0x7ff4d0156c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:40.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.646+0000 7ff4d5e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d015a830 con 0x7ff4d00c21b0 2024-03-23T23:53:40.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.646+0000 7ff4d5e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d015acc0 con 0x7ff4d00c3600 2024-03-23T23:53:40.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.650+0000 7ff4cf400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff4d00c21b0 0x7ff4d0156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:40.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.650+0000 7ff4cf400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff4d00c21b0 0x7ff4d0156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48560/0 (socket says 172.21.15.8:48560) 2024-03-23T23:53:40.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.650+0000 7ff4cf400640 1 -- 172.21.15.8:0/1255169179 learned_addr learned my addr 172.21.15.8:0/1255169179 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:53:40.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.650+0000 7ff4d5e00640 1 -- 172.21.15.8:0/1255169179 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d0159f00 con 0x7ff4d00c3f60 2024-03-23T23:53:40.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.650+0000 7ff4cf400640 1 -- 172.21.15.8:0/1255169179 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4d00c3f60 msgr2=0x7ff4d0071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:53:40.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.650+0000 7ff4cf400640 1 --2- 172.21.15.8:0/1255169179 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4d00c3f60 0x7ff4d0071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:40.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.650+0000 7ff4cf400640 1 -- 172.21.15.8:0/1255169179 >> v2:172.21.15.196:3300/0 conn(0x7ff4d00c3600 msgr2=0x7ff4d00c1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:53:40.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.650+0000 7ff4cf400640 1 --2- 172.21.15.8:0/1255169179 >> v2:172.21.15.196:3300/0 conn(0x7ff4d00c3600 0x7ff4d00c1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:40.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.650+0000 7ff4cf400640 1 -- 172.21.15.8:0/1255169179 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d015a1e0 con 0x7ff4d00c21b0 2024-03-23T23:53:40.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.658+0000 7ff4cf400640 1 --2- 172.21.15.8:0/1255169179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4d00c21b0 0x7ff4d0156c30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff4d006c1c0 tx=0x7ff4c801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=935ab62583703a08 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:40.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.658+0000 7ff4cd600640 1 -- 172.21.15.8:0/1255169179 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c80b0070 con 0x7ff4d00c21b0 2024-03-23T23:53:40.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.658+0000 7ff4cd600640 1 -- 172.21.15.8:0/1255169179 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c80ab600 con 0x7ff4d00c21b0 2024-03-23T23:53:40.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.658+0000 7ff4d5e00640 1 -- 172.21.15.8:0/1255169179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4d00c21b0 msgr2=0x7ff4d0156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:40.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.658+0000 7ff4d5e00640 1 --2- 172.21.15.8:0/1255169179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4d00c21b0 0x7ff4d0156c30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff4d006c1c0 tx=0x7ff4c801c490 comp rx=0 tx=0).stop 2024-03-23T23:53:40.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.662+0000 7ff4d5e00640 1 -- 172.21.15.8:0/1255169179 shutdown_connections 2024-03-23T23:53:40.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.662+0000 7ff4d5e00640 1 --2- 172.21.15.8:0/1255169179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4d00c21b0 0x7ff4d0156c30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:40.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.662+0000 7ff4d5e00640 1 --2- 172.21.15.8:0/1255169179 >> v2:172.21.15.196:3300/0 conn(0x7ff4d00c3600 0x7ff4d00c1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:40.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.662+0000 7ff4d5e00640 1 --2- 172.21.15.8:0/1255169179 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4d00c3f60 0x7ff4d0071a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:40.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.662+0000 7ff4d5e00640 1 -- 172.21.15.8:0/1255169179 >> 172.21.15.8:0/1255169179 conn(0x7ff4d006b170 msgr2=0x7ff4d006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:53:40.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.662+0000 7ff4d5e00640 1 -- 172.21.15.8:0/1255169179 shutdown_connections 2024-03-23T23:53:40.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.662+0000 7ff4d5e00640 1 -- 172.21.15.8:0/1255169179 wait complete. 2024-03-23T23:53:40.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.662+0000 7ff4d5e00640 1 Processor -- start 2024-03-23T23:53:40.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.662+0000 7ff4d5e00640 1 -- start start 2024-03-23T23:53:40.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.670+0000 7ff4d5e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4d00c21b0 0x7ff4d0158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:40.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.670+0000 7ff4d5e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4d00c3600 0x7ff4d00c6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:40.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.670+0000 7ff4d5e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d00c3f60 0x7ff4d00c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:40.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.670+0000 7ff4cea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4d00c21b0 0x7ff4d0158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:40.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.670+0000 7ff4d5e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d0157700 con 0x7ff4d00c21b0 2024-03-23T23:53:40.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.670+0000 7ff4d5e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d0157580 con 0x7ff4d00c3f60 2024-03-23T23:53:40.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.670+0000 7ff4cea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4d00c21b0 0x7ff4d0158f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48572/0 (socket says 172.21.15.8:48572) 2024-03-23T23:53:40.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.670+0000 7ff4cea00640 1 -- 172.21.15.8:0/2902360906 learned_addr learned my addr 172.21.15.8:0/2902360906 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:53:40.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.670+0000 7ff4d5e00640 1 -- 172.21.15.8:0/2902360906 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d00c4340 con 0x7ff4d00c3600 2024-03-23T23:53:40.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.670+0000 7ff4ce000640 1 --2- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4d00c3600 0x7ff4d00c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:40.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.670+0000 7ff4cf400640 1 --2- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d00c3f60 0x7ff4d00c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:40.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.674+0000 7ff4cea00640 1 -- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4d00c3600 msgr2=0x7ff4d00c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:40.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.674+0000 7ff4cea00640 1 --2- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4d00c3600 0x7ff4d00c6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:40.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.674+0000 7ff4cea00640 1 -- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d00c3f60 msgr2=0x7ff4d00c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:40.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.674+0000 7ff4cea00640 1 --2- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d00c3f60 0x7ff4d00c68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:40.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.674+0000 7ff4cea00640 1 -- 172.21.15.8:0/2902360906 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d00bcd90 con 0x7ff4d00c21b0 2024-03-23T23:53:40.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.674+0000 7ff4cea00640 1 --2- 172.21.15.8:0/2902360906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4d00c21b0 0x7ff4d0158f60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc00b550 tx=0x7ff4bc00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:40.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.678+0000 7ff4c7400640 1 -- 172.21.15.8:0/2902360906 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc014070 con 0x7ff4d00c21b0 2024-03-23T23:53:40.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.678+0000 7ff4c7400640 1 -- 172.21.15.8:0/2902360906 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4bc010890 con 0x7ff4d00c21b0 2024-03-23T23:53:40.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.678+0000 7ff4c7400640 1 -- 172.21.15.8:0/2902360906 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc010c80 con 0x7ff4d00c21b0 2024-03-23T23:53:40.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.678+0000 7ff4d5e00640 1 -- 172.21.15.8:0/2902360906 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d00bc3c0 con 0x7ff4d00c21b0 2024-03-23T23:53:40.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.678+0000 7ff4d5e00640 1 -- 172.21.15.8:0/2902360906 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d01594a0 con 0x7ff4d00c21b0 2024-03-23T23:53:40.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.678+0000 7ff4d5e00640 1 --2- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d00c6e10 0x7ff4d00c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:40.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.678+0000 7ff4d5e00640 1 -- 172.21.15.8:0/2902360906 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d01476d0 con 0x7ff4d00c6e10 2024-03-23T23:53:40.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.682+0000 7ff4ce000640 1 --2- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d00c6e10 0x7ff4d00c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:40.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.682+0000 7ff4ce000640 1 -- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d00c6e10 msgr2=0x7ff4d00c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-03-23T23:53:40.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.682+0000 7ff4ce000640 1 -- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d00c6e10 msgr2=0x7ff4d00c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T23:53:40.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.682+0000 7ff4ce000640 1 --2- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d00c6e10 0x7ff4d00c4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:53:40.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.682+0000 7ff4ce000640 1 --2- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d00c6e10 0x7ff4d00c4e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:53:40.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.686+0000 7ff4c7400640 1 -- 172.21.15.8:0/2902360906 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff4bc017070 con 0x7ff4d00c21b0 2024-03-23T23:53:40.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.686+0000 7ff4c7400640 1 --2- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff4b00676b0 0x7ff4b0069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:40.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.686+0000 7ff4c7400640 1 -- 172.21.15.8:0/2902360906 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7ff4bc085970 con 0x7ff4d00c21b0 2024-03-23T23:53:40.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.690+0000 7ff4cf400640 1 --2- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff4b00676b0 0x7ff4b0069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:40.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.698+0000 7ff4cf400640 1 --2- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff4b00676b0 0x7ff4b0069b70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff4c80ad000 tx=0x7ff4c80a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:40.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.886+0000 7ff4ce000640 1 --2- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d00c6e10 0x7ff4d00c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:40.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.890+0000 7ff4ce000640 1 -- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d00c6e10 msgr2=0x7ff4d00c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-03-23T23:53:40.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.890+0000 7ff4ce000640 1 -- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d00c6e10 msgr2=0x7ff4d00c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T23:53:40.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.890+0000 7ff4ce000640 1 --2- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d00c6e10 0x7ff4d00c4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:53:40.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:40.890+0000 7ff4ce000640 1 --2- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d00c6e10 0x7ff4d00c4e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:53:41.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:41.302+0000 7ff4ce000640 1 --2- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d00c6e10 0x7ff4d00c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:41.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:41.302+0000 7ff4ce000640 1 -- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d00c6e10 msgr2=0x7ff4d00c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-03-23T23:53:41.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:41.302+0000 7ff4ce000640 1 -- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d00c6e10 msgr2=0x7ff4d00c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T23:53:41.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:41.302+0000 7ff4ce000640 1 --2- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d00c6e10 0x7ff4d00c4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:53:41.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:41.302+0000 7ff4ce000640 1 --2- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d00c6e10 0x7ff4d00c4e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:53:42.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:42.106+0000 7ff4ce000640 1 --2- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d00c6e10 0x7ff4d00c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:42.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:42.106+0000 7ff4ce000640 1 -- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d00c6e10 msgr2=0x7ff4d00c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-03-23T23:53:42.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:42.106+0000 7ff4ce000640 1 -- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d00c6e10 msgr2=0x7ff4d00c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T23:53:42.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:42.106+0000 7ff4ce000640 1 --2- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d00c6e10 0x7ff4d00c4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:53:42.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:42.106+0000 7ff4ce000640 1 --2- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d00c6e10 0x7ff4d00c4e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:53:43.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:43.710+0000 7ff4ce000640 1 --2- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d00c6e10 0x7ff4d00c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:43.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:43.726+0000 7ff4ce000640 1 -- 172.21.15.8:0/2902360906 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff4d00bd070 con 0x7ff4d00c6e10 2024-03-23T23:53:43.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:43.730+0000 7ff4ce000640 1 --2- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d00c6e10 0x7ff4d00c4e60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff4d015cd70 tx=0x7ff4c0007680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:43.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:43.734+0000 7ff4c7400640 1 -- 172.21.15.8:0/2902360906 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0016800 con 0x7ff4d00c6e10 2024-03-23T23:53:43.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:43.750+0000 7ff4c7400640 1 -- 172.21.15.8:0/2902360906 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7ff4c0016800 con 0x7ff4d00c6e10 2024-03-23T23:53:43.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:43.750+0000 7ff4c7400640 1 -- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d00c6e10 msgr2=0x7ff4d00c4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:43.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:43.750+0000 7ff4c7400640 1 --2- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d00c6e10 0x7ff4d00c4e60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff4d015cd70 tx=0x7ff4c0007680 comp rx=0 tx=0).stop 2024-03-23T23:53:43.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:43.750+0000 7ff4c7400640 1 -- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d00c6e10 msgr2=0x7ff4d00c4e60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:53:43.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:43.750+0000 7ff4c7400640 1 --2- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d00c6e10 0x7ff4d00c4e60 secure :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff4d015cd70 tx=0x7ff4c0007680 comp rx=0 tx=0).stop 2024-03-23T23:53:43.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:43.790+0000 7ff4d5e00640 1 --2- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d0148270 0x7ff4d00c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:43.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:43.790+0000 7ff4d5e00640 1 -- 172.21.15.8:0/2902360906 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d0068270 con 0x7ff4d0148270 2024-03-23T23:53:43.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:43.790+0000 7ff4ce000640 1 --2- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d0148270 0x7ff4d00c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:43.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:43.794+0000 7ff4ce000640 1 -- 172.21.15.8:0/2902360906 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff4d0068af0 con 0x7ff4d0148270 2024-03-23T23:53:43.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:43.794+0000 7ff4ce000640 1 --2- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d0148270 0x7ff4d00c53a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff4d015cd70 tx=0x7ff4c0004ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:43.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:43.798+0000 7ff4c7400640 1 -- 172.21.15.8:0/2902360906 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c001ec50 con 0x7ff4d0148270 2024-03-23T23:53:43.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:43.798+0000 7ff4c7400640 1 -- 172.21.15.8:0/2902360906 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4529 (secure 0 0 0) 0x7ff4c001edf0 con 0x7ff4d0148270 2024-03-23T23:53:43.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:43.798+0000 7ff4c7400640 1 -- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d0148270 msgr2=0x7ff4d00c53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:43.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:43.798+0000 7ff4c7400640 1 --2- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d0148270 0x7ff4d00c53a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff4d015cd70 tx=0x7ff4c0004ac0 comp rx=0 tx=0).stop 2024-03-23T23:53:43.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:43.798+0000 7ff4c7400640 1 -- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d0148270 msgr2=0x7ff4d00c53a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:53:43.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:43.798+0000 7ff4c7400640 1 --2- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d0148270 0x7ff4d00c53a0 secure :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff4d015cd70 tx=0x7ff4c0004ac0 comp rx=0 tx=0).stop 2024-03-23T23:53:43.803 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:53:43.803 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:53:43.803 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:53:43.804 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:53:43.804 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 90, 2024-03-23T23:53:43.804 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:53:43.804 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:53:43.804 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:53:43.804 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:53:43.804 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:43.804 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 5, 2024-03-23T23:53:43.804 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:53:43.804 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:53:43.804 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:53:43.804 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:53:43.805 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:53:43.805 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:53:43.805 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:53:43.805 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:53:43.805 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:53:43.805 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:53:43.805 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:53:43.805 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:53:43.805 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:53:43.806 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:53:43.806 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:43.806 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:53:43.806 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:53:43.806 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:53:43.806 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:53:43.806 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:53:43.807 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:53:43.807 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:53:43.807 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:53:43.807 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:53:43.807 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:53:43.807 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:53:43.807 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:53:43.807 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:53:43.808 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:43.808 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:43.808 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:53:43.808 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:53:43.809 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:53:43.809 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:53:43.809 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:53:43.809 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:53:43.809 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:53:43.809 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:53:43.809 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:53:43.809 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:53:43.809 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:53:43.809 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:53:43.809 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:53:43.810 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:53:43.810 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:53:43.810 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:53:43.810 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:53:43.810 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:53:43.810 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:53:43.810 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:53:43.810 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:53:43.810 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:53:43.810 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:53:43.810 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:53:43.810 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:53:43.811 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:53:43.811 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:53:43.811 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:53:43.811 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:43.811 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:53:43.811 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:43.811 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:53:43.811 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:43.811 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:53:43.811 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:53:43.811 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:53:43.811 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:53:43.811 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:43.812 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:53:43.812 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:53:43.812 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:43.812 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:43.812 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:43.813 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:53:43.813 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:53:43.813 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:43.813 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:43.813 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:43.813 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:43.813 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:53:43.813 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:53:43.813 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:53:43.813 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:53:43.813 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:53:43.813 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:43.813 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:43.814 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:53:43.814 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:53:43.814 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:53:43.814 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:53:43.814 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:43.814 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:53:43.814 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:53:43.814 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:43.814 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:43.814 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:43.814 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:53:43.814 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:53:43.815 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:43.815 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:43.815 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:43.815 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:43.815 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:53:43.815 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:53:43.815 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:53:43.815 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:53:43.815 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:53:43.815 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:43.815 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:43.815 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:53:43.815 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:53:43.816 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:53:43.816 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:53:43.816 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:43.816 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:53:43.816 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:53:43.816 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:43.816 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:43.816 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:43.816 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:53:43.816 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:53:43.816 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:43.816 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:43.816 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:43.817 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:43.817 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:53:43.817 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:53:43.817 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:53:43.817 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:53:43.817 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:53:43.817 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:43.817 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:43.818 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:43.818 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:53:43.818 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:53:43.818 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:43.818 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:53:43.818 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:43.818 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:53:43.818 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:43.818 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:43.818 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:53:43.818 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:43.818 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:53:43.818 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:43.819 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:53:43.819 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:43.819 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:43.819 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:43.819 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:53:43.819 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:53:43.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:43.806+0000 7ff4d5e00640 1 -- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff4b00676b0 msgr2=0x7ff4b0069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:43.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:43.806+0000 7ff4d5e00640 1 --2- 172.21.15.8:0/2902360906 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff4b00676b0 0x7ff4b0069b70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff4c80ad000 tx=0x7ff4c80a6000 comp rx=0 tx=0).stop 2024-03-23T23:53:43.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:43.806+0000 7ff4d5e00640 1 -- 172.21.15.8:0/2902360906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4d00c21b0 msgr2=0x7ff4d0158f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:43.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:43.806+0000 7ff4d5e00640 1 --2- 172.21.15.8:0/2902360906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4d00c21b0 0x7ff4d0158f60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc00b550 tx=0x7ff4bc00ba10 comp rx=0 tx=0).stop 2024-03-23T23:53:43.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:43.810+0000 7ff4cf400640 1 -- 172.21.15.8:0/2902360906 reap_dead start 2024-03-23T23:53:43.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:43.810+0000 7ff4cf400640 1 -- 172.21.15.8:0/2902360906 reap_dead start 2024-03-23T23:53:43.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:43.810+0000 7ff4d5e00640 1 -- 172.21.15.8:0/2902360906 shutdown_connections 2024-03-23T23:53:43.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:43.810+0000 7ff4d5e00640 1 -- 172.21.15.8:0/2902360906 >> 172.21.15.8:0/2902360906 conn(0x7ff4d006b170 msgr2=0x7ff4d0070f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:53:43.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:43.810+0000 7ff4d5e00640 1 -- 172.21.15.8:0/2902360906 shutdown_connections 2024-03-23T23:53:43.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:43.810+0000 7ff4d5e00640 1 -- 172.21.15.8:0/2902360906 wait complete. 2024-03-23T23:53:43.913 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:53:43.914 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T23:53:43.914 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:53:44.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.198+0000 7fb579800640 1 Processor -- start 2024-03-23T23:53:44.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.202+0000 7fb579800640 1 -- start start 2024-03-23T23:53:44.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.202+0000 7fb579800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb56c0e3d60 0x7fb56c0e6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:44.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.202+0000 7fb579800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb56c00bb00 con 0x7fb56c0d7b60 2024-03-23T23:53:44.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.202+0000 7fb579800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb56c007410 con 0x7fb56c0db8d0 2024-03-23T23:53:44.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.202+0000 7fb579800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb56c007130 con 0x7fb56c0e3d60 2024-03-23T23:53:44.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.206+0000 7fb573400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fb56c0db8d0 0x7fb56c0dbd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:38912/0 (socket says 172.21.15.8:38912) 2024-03-23T23:53:44.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.206+0000 7fb573400640 1 -- 172.21.15.8:0/4183376838 learned_addr learned my addr 172.21.15.8:0/4183376838 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:53:44.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.206+0000 7fb578e00640 1 --2- 172.21.15.8:0/4183376838 >> v2:172.21.15.8:3300/0 conn(0x7fb56c0e3d60 0x7fb56c0e6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:44.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.206+0000 7fb578e00640 1 -- 172.21.15.8:0/4183376838 >> v1:172.21.15.196:6789/0 conn(0x7fb56c0db8d0 legacy=0x7fb56c0dbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:44.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.206+0000 7fb578e00640 1 -- 172.21.15.8:0/4183376838 >> v1:172.21.15.8:6789/0 conn(0x7fb56c0d7b60 legacy=0x7fb56c046160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:53:44.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.206+0000 7fb578e00640 1 -- 172.21.15.8:0/4183376838 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb56c0da4f0 con 0x7fb56c0e3d60 2024-03-23T23:53:44.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.218+0000 7fb578e00640 1 --2- 172.21.15.8:0/4183376838 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb56c0e3d60 0x7fb56c0e6150 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb5680097c0 tx=0x7fb56801c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9fc1af1c4ac6beb server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:44.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.218+0000 7fb572a00640 1 -- 172.21.15.8:0/4183376838 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5680b0070 con 0x7fb56c0e3d60 2024-03-23T23:53:44.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.218+0000 7fb572a00640 1 -- 172.21.15.8:0/4183376838 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5680ab600 con 0x7fb56c0e3d60 2024-03-23T23:53:44.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.218+0000 7fb572a00640 1 -- 172.21.15.8:0/4183376838 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5680ab9d0 con 0x7fb56c0e3d60 2024-03-23T23:53:44.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.222+0000 7fb579800640 1 -- 172.21.15.8:0/4183376838 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb56c0e3d60 msgr2=0x7fb56c0e6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:44.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.222+0000 7fb579800640 1 --2- 172.21.15.8:0/4183376838 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb56c0e3d60 0x7fb56c0e6150 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb5680097c0 tx=0x7fb56801c340 comp rx=0 tx=0).stop 2024-03-23T23:53:44.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.222+0000 7fb579800640 1 -- 172.21.15.8:0/4183376838 shutdown_connections 2024-03-23T23:53:44.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.222+0000 7fb579800640 1 --2- 172.21.15.8:0/4183376838 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb56c0e3d60 0x7fb56c0e6150 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:44.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.222+0000 7fb579800640 1 -- 172.21.15.8:0/4183376838 >> 172.21.15.8:0/4183376838 conn(0x7fb56c005ef0 msgr2=0x7fb56c006300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:53:44.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.234+0000 7fb579800640 1 -- 172.21.15.8:0/4183376838 shutdown_connections 2024-03-23T23:53:44.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.242+0000 7fb579800640 1 -- 172.21.15.8:0/4183376838 wait complete. 2024-03-23T23:53:44.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.242+0000 7fb579800640 1 Processor -- start 2024-03-23T23:53:44.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.246+0000 7fb579800640 1 -- start start 2024-03-23T23:53:44.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.254+0000 7fb579800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb56c0d7b60 0x7fb56c0e4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:44.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.254+0000 7fb579800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb56c0db8d0 0x7fb56c0d0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:44.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.254+0000 7fb579800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb56c0e3d60 0x7fb56c0d3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:44.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.254+0000 7fb579800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56c045af0 con 0x7fb56c0d7b60 2024-03-23T23:53:44.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.254+0000 7fb579800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56c006c30 con 0x7fb56c0db8d0 2024-03-23T23:53:44.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.254+0000 7fb579800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb56c0db2b0 con 0x7fb56c0e3d60 2024-03-23T23:53:44.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.254+0000 7fb573e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb56c0d7b60 0x7fb56c0e4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:44.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.254+0000 7fb573e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb56c0d7b60 0x7fb56c0e4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47038/0 (socket says 172.21.15.8:47038) 2024-03-23T23:53:44.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.254+0000 7fb573e00640 1 -- 172.21.15.8:0/2590186305 learned_addr learned my addr 172.21.15.8:0/2590186305 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:53:44.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.254+0000 7fb578e00640 1 --2- 172.21.15.8:0/2590186305 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb56c0e3d60 0x7fb56c0d3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:44.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.258+0000 7fb573400640 1 --2- 172.21.15.8:0/2590186305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb56c0db8d0 0x7fb56c0d0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:44.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.258+0000 7fb578e00640 1 -- 172.21.15.8:0/2590186305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb56c0db8d0 msgr2=0x7fb56c0d0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:44.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.258+0000 7fb578e00640 1 --2- 172.21.15.8:0/2590186305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb56c0db8d0 0x7fb56c0d0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:44.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.258+0000 7fb578e00640 1 -- 172.21.15.8:0/2590186305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb56c0d7b60 msgr2=0x7fb56c0e4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:44.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.258+0000 7fb578e00640 1 --2- 172.21.15.8:0/2590186305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb56c0d7b60 0x7fb56c0e4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:44.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.258+0000 7fb578e00640 1 -- 172.21.15.8:0/2590186305 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb56c0d8a40 con 0x7fb56c0e3d60 2024-03-23T23:53:44.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.266+0000 7fb578e00640 1 --2- 172.21.15.8:0/2590186305 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb56c0e3d60 0x7fb56c0d3090 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb5680ab000 tx=0x7fb56801ab80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:44.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.266+0000 7fb567e00640 1 -- 172.21.15.8:0/2590186305 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5680b0050 con 0x7fb56c0e3d60 2024-03-23T23:53:44.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.266+0000 7fb579800640 1 -- 172.21.15.8:0/2590186305 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb56c0d8ce0 con 0x7fb56c0e3d60 2024-03-23T23:53:44.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.266+0000 7fb579800640 1 -- 172.21.15.8:0/2590186305 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb56c0d92a0 con 0x7fb56c0e3d60 2024-03-23T23:53:44.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.266+0000 7fb567e00640 1 -- 172.21.15.8:0/2590186305 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5680bc070 con 0x7fb56c0e3d60 2024-03-23T23:53:44.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.266+0000 7fb567e00640 1 -- 172.21.15.8:0/2590186305 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5680b0050 con 0x7fb56c0e3d60 2024-03-23T23:53:44.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.270+0000 7fb579800640 1 --2- 172.21.15.8:0/2590186305 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb550002a80 0x7fb550004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:44.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.270+0000 7fb579800640 1 -- 172.21.15.8:0/2590186305 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb550007ed0 con 0x7fb550002a80 2024-03-23T23:53:44.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.274+0000 7fb573e00640 1 --2- 172.21.15.8:0/2590186305 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb550002a80 0x7fb550004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:44.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.274+0000 7fb567e00640 1 -- 172.21.15.8:0/2590186305 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb5680b5610 con 0x7fb56c0e3d60 2024-03-23T23:53:44.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.274+0000 7fb567e00640 1 --2- 172.21.15.8:0/2590186305 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb554067860 0x7fb554069d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:44.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.278+0000 7fb567e00640 1 -- 172.21.15.8:0/2590186305 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fb568120030 con 0x7fb56c0e3d60 2024-03-23T23:53:44.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.278+0000 7fb573400640 1 --2- 172.21.15.8:0/2590186305 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb554067860 0x7fb554069d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:44.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.278+0000 7fb573400640 1 --2- 172.21.15.8:0/2590186305 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb554067860 0x7fb554069d20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb56c180570 tx=0x7fb560009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:44.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.278+0000 7fb573e00640 1 -- 172.21.15.8:0/2590186305 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb5500080d0 con 0x7fb550002a80 2024-03-23T23:53:44.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.278+0000 7fb573e00640 1 --2- 172.21.15.8:0/2590186305 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb550002a80 0x7fb550004f40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb57402d610 tx=0x7fb574068870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:44.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.286+0000 7fb567e00640 1 -- 172.21.15.8:0/2590186305 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb574073760 con 0x7fb550002a80 2024-03-23T23:53:44.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.290+0000 7fb567e00640 1 -- 172.21.15.8:0/2590186305 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fb574073760 con 0x7fb550002a80 2024-03-23T23:53:44.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.290+0000 7fb567e00640 1 -- 172.21.15.8:0/2590186305 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb550002a80 msgr2=0x7fb550004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:44.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.290+0000 7fb567e00640 1 --2- 172.21.15.8:0/2590186305 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb550002a80 0x7fb550004f40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb57402d610 tx=0x7fb574068870 comp rx=0 tx=0).stop 2024-03-23T23:53:44.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.290+0000 7fb567e00640 1 -- 172.21.15.8:0/2590186305 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb550002a80 msgr2=0x7fb550004f40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:53:44.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.290+0000 7fb567e00640 1 --2- 172.21.15.8:0/2590186305 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb550002a80 0x7fb550004f40 secure :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb57402d610 tx=0x7fb574068870 comp rx=0 tx=0).stop 2024-03-23T23:53:44.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.326+0000 7fb579800640 1 --2- 172.21.15.8:0/2590186305 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb550006f80 0x7fb550007410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:44.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.326+0000 7fb579800640 1 -- 172.21.15.8:0/2590186305 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55000a460 con 0x7fb550006f80 2024-03-23T23:53:44.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.326+0000 7fb573e00640 1 --2- 172.21.15.8:0/2590186305 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb550006f80 0x7fb550007410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:44.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.330+0000 7fb573e00640 1 -- 172.21.15.8:0/2590186305 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb550007950 con 0x7fb550006f80 2024-03-23T23:53:44.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.330+0000 7fb573e00640 1 --2- 172.21.15.8:0/2590186305 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb550006f80 0x7fb550007410 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb574069bd0 tx=0x7fb57406b0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:44.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.334+0000 7fb567e00640 1 -- 172.21.15.8:0/2590186305 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb574070760 con 0x7fb550006f80 2024-03-23T23:53:44.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.334+0000 7fb567e00640 1 -- 172.21.15.8:0/2590186305 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5182 (secure 0 0 0) 0x7fb574070900 con 0x7fb550006f80 2024-03-23T23:53:44.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.334+0000 7fb567e00640 1 -- 172.21.15.8:0/2590186305 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb550006f80 msgr2=0x7fb550007410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:44.336 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:53:44.336 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:53:44.336 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:53:44.336 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:53:44.336 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 90, 2024-03-23T23:53:44.336 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:53:44.336 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:53:44.337 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:53:44.337 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:53:44.337 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:44.337 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 6, 2024-03-23T23:53:44.337 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:53:44.337 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:53:44.337 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:53:44.337 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:53:44.337 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:53:44.338 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:53:44.338 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:53:44.338 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:53:44.338 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:53:44.338 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:53:44.338 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:53:44.338 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:53:44.338 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:53:44.338 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:53:44.338 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:44.338 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:53:44.338 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:53:44.339 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:53:44.339 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:53:44.339 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:53:44.339 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:53:44.340 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:53:44.340 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:53:44.340 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:53:44.340 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:53:44.340 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:53:44.340 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:53:44.341 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:53:44.341 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:44.341 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:44.341 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:53:44.342 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:53:44.342 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:53:44.342 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:53:44.342 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:53:44.342 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:53:44.342 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:53:44.343 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:53:44.343 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:53:44.343 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:53:44.343 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:53:44.343 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:53:44.343 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:53:44.343 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:53:44.343 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:53:44.343 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:53:44.344 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:53:44.344 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:53:44.344 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:53:44.344 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:53:44.344 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:53:44.344 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:53:44.344 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:53:44.344 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:53:44.345 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:53:44.345 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:53:44.345 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:53:44.345 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:53:44.345 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:44.345 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:53:44.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:44.345 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:53:44.346 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:44.346 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:53:44.346 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:53:44.346 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:53:44.346 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:53:44.346 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:44.346 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:53:44.346 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:53:44.346 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:44.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:44.347 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:44.347 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:53:44.347 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:53:44.347 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:44.347 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:44.347 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:44.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:44.347 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:53:44.347 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:53:44.348 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:53:44.348 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:53:44.348 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:53:44.348 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:44.348 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:44.348 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:53:44.348 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:53:44.348 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:53:44.349 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:53:44.349 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:44.349 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:53:44.349 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:53:44.349 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:44.349 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:44.349 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:44.349 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:53:44.349 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:53:44.350 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:44.350 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:44.350 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:44.350 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:44.350 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:53:44.350 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:53:44.351 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:53:44.351 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:53:44.351 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:53:44.351 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:44.351 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:44.351 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:53:44.351 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:53:44.351 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:53:44.351 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:53:44.351 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:44.351 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:53:44.351 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:53:44.351 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:44.352 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:44.352 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:44.352 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:53:44.352 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:53:44.352 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:44.352 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:44.352 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:44.352 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:44.352 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:53:44.352 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:53:44.352 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:53:44.352 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:53:44.352 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:53:44.352 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:44.353 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:44.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:44.353 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:53:44.353 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:53:44.353 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:44.353 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:53:44.353 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:44.353 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:53:44.353 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:44.353 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:44.353 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:53:44.353 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:44.353 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:53:44.353 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:44.354 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:53:44.354 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:44.354 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:44.354 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:53:44.354 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:44.354 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:53:44.354 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:44.354 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 7 2024-03-23T23:53:44.354 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:44.354 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:44.354 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:53:44.354 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:44.354 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:53:44.355 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:44.355 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:53:44.355 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:44.355 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:44.355 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:53:44.355 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:44.355 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:53:44.355 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:44.355 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:44.355 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:53:44.355 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:44.355 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:53:44.355 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:44.355 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:53:44.356 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:44.356 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:44.356 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:44.356 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:53:44.356 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:53:44.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.334+0000 7fb567e00640 1 --2- 172.21.15.8:0/2590186305 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb550006f80 0x7fb550007410 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb574069bd0 tx=0x7fb57406b0e0 comp rx=0 tx=0).stop 2024-03-23T23:53:44.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.334+0000 7fb567e00640 1 -- 172.21.15.8:0/2590186305 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb550006f80 msgr2=0x7fb550007410 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:53:44.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.334+0000 7fb567e00640 1 --2- 172.21.15.8:0/2590186305 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb550006f80 0x7fb550007410 secure :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb574069bd0 tx=0x7fb57406b0e0 comp rx=0 tx=0).stop 2024-03-23T23:53:44.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.338+0000 7fb579800640 1 -- 172.21.15.8:0/2590186305 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb554067860 msgr2=0x7fb554069d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:44.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.338+0000 7fb579800640 1 --2- 172.21.15.8:0/2590186305 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb554067860 0x7fb554069d20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb56c180570 tx=0x7fb560009040 comp rx=0 tx=0).stop 2024-03-23T23:53:44.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.338+0000 7fb579800640 1 -- 172.21.15.8:0/2590186305 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb56c0e3d60 msgr2=0x7fb56c0d3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:44.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.338+0000 7fb579800640 1 --2- 172.21.15.8:0/2590186305 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb56c0e3d60 0x7fb56c0d3090 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb5680ab000 tx=0x7fb56801ab80 comp rx=0 tx=0).stop 2024-03-23T23:53:44.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.338+0000 7fb578e00640 1 -- 172.21.15.8:0/2590186305 reap_dead start 2024-03-23T23:53:44.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.338+0000 7fb578e00640 1 -- 172.21.15.8:0/2590186305 reap_dead start 2024-03-23T23:53:44.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.338+0000 7fb579800640 1 -- 172.21.15.8:0/2590186305 shutdown_connections 2024-03-23T23:53:44.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.338+0000 7fb579800640 1 -- 172.21.15.8:0/2590186305 >> 172.21.15.8:0/2590186305 conn(0x7fb56c005ef0 msgr2=0x7fb56c009d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:53:44.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.338+0000 7fb579800640 1 -- 172.21.15.8:0/2590186305 shutdown_connections 2024-03-23T23:53:44.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.342+0000 7fb579800640 1 -- 172.21.15.8:0/2590186305 wait complete. 2024-03-23T23:53:44.411 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:53:44.411 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-03-23T23:53:44.411 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-03-23T23:53:44.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.722+0000 7f2388200640 1 Processor -- start 2024-03-23T23:53:44.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.722+0000 7f2388200640 1 -- start start 2024-03-23T23:53:44.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.722+0000 7f2388200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f23800c3f60 0x7f2380071a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:44.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.722+0000 7f2388200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f23800c2380 0x7f2380156c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:44.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.722+0000 7f2388200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f238015acc0 con 0x7f23800c3600 2024-03-23T23:53:44.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.722+0000 7f2388200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f238015a830 con 0x7f23800c3f60 2024-03-23T23:53:44.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.722+0000 7f2388200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2380159f00 con 0x7f23800c2380 2024-03-23T23:53:44.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.722+0000 7f2384e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f23800c3600 0x7f23800c1c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:52646/0 (socket says 172.21.15.8:52646) 2024-03-23T23:53:44.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.722+0000 7f2384e00640 1 -- 172.21.15.8:0/1817802084 learned_addr learned my addr 172.21.15.8:0/1817802084 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:53:44.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.726+0000 7f237fe00640 1 -- 172.21.15.8:0/1817802084 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743772779 0 0) 0x7f238015acc0 con 0x7f23800c3600 2024-03-23T23:53:44.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.726+0000 7f237fe00640 1 -- 172.21.15.8:0/1817802084 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2368003530 con 0x7f23800c3600 2024-03-23T23:53:44.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.730+0000 7f2385800640 1 --2- 172.21.15.8:0/1817802084 >> v2:172.21.15.196:3300/0 conn(0x7f23800c3f60 0x7f2380071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:44.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.730+0000 7f237fe00640 1 -- 172.21.15.8:0/1817802084 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 54200324 0 0) 0x7f2368003530 con 0x7f23800c3600 2024-03-23T23:53:44.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.730+0000 7f237fe00640 1 -- 172.21.15.8:0/1817802084 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f23800c2380 msgr2=0x7f2380156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:53:44.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.730+0000 7f237fe00640 1 --2- 172.21.15.8:0/1817802084 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f23800c2380 0x7f2380156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:44.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.730+0000 7f237fe00640 1 -- 172.21.15.8:0/1817802084 >> v2:172.21.15.196:3300/0 conn(0x7f23800c3f60 msgr2=0x7f2380071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:53:44.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.730+0000 7f237fe00640 1 --2- 172.21.15.8:0/1817802084 >> v2:172.21.15.196:3300/0 conn(0x7f23800c3f60 0x7f2380071a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:44.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.730+0000 7f237fe00640 1 -- 172.21.15.8:0/1817802084 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238015a1e0 con 0x7f23800c3600 2024-03-23T23:53:44.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.730+0000 7f237fe00640 1 -- 172.21.15.8:0/1817802084 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7f2374001680 con 0x7f23800c3600 2024-03-23T23:53:44.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.730+0000 7f237fe00640 1 -- 172.21.15.8:0/1817802084 >> v1:172.21.15.8:6789/0 conn(0x7f23800c3600 legacy=0x7f23800c1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:44.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.730+0000 7f237fe00640 1 --2- 172.21.15.8:0/1817802084 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23680039c0 0x7f2368003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:44.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.730+0000 7f237fe00640 1 --2- 172.21.15.8:0/1817802084 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2368004810 0x7f2368004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:44.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.730+0000 7f237fe00640 1 --2- 172.21.15.8:0/1817802084 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2368005240 0x7f236800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:44.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.730+0000 7f237fe00640 1 -- 172.21.15.8:0/1817802084 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238015a830 con 0x7f23680039c0 2024-03-23T23:53:44.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.730+0000 7f237fe00640 1 -- 172.21.15.8:0/1817802084 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2380159f00 con 0x7f2368004810 2024-03-23T23:53:44.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.730+0000 7f237fe00640 1 -- 172.21.15.8:0/1817802084 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236800c180 con 0x7f2368005240 2024-03-23T23:53:44.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.730+0000 7f2385800640 1 --2- 172.21.15.8:0/1817802084 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23680039c0 0x7f2368003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:44.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.730+0000 7f2384e00640 1 --2- 172.21.15.8:0/1817802084 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2368004810 0x7f2368004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:44.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.730+0000 7f2384e00640 1 -- 172.21.15.8:0/1817802084 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2368005240 msgr2=0x7f236800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:53:44.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.730+0000 7f2384e00640 1 --2- 172.21.15.8:0/1817802084 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2368005240 0x7f236800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:44.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.730+0000 7f2384e00640 1 -- 172.21.15.8:0/1817802084 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23680039c0 msgr2=0x7f2368003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:53:44.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.730+0000 7f2384e00640 1 --2- 172.21.15.8:0/1817802084 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23680039c0 0x7f2368003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:44.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.730+0000 7f2384e00640 1 -- 172.21.15.8:0/1817802084 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2368003530 con 0x7f2368004810 2024-03-23T23:53:44.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.730+0000 7f2385800640 1 --2- 172.21.15.8:0/1817802084 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23680039c0 0x7f2368003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:53:44.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.742+0000 7f2384e00640 1 --2- 172.21.15.8:0/1817802084 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2368004810 0x7f2368004c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f237400c240 tx=0x7f237401ccc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33006b79f51f36e1 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:44.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.742+0000 7f237fe00640 1 -- 172.21.15.8:0/1817802084 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2374007d40 con 0x7f2368004810 2024-03-23T23:53:44.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.742+0000 7f237fe00640 1 -- 172.21.15.8:0/1817802084 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23740a9020 con 0x7f2368004810 2024-03-23T23:53:44.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.742+0000 7f237fe00640 1 -- 172.21.15.8:0/1817802084 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2374005ae0 con 0x7f2368004810 2024-03-23T23:53:44.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.746+0000 7f2388200640 1 -- 172.21.15.8:0/1817802084 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2368004810 msgr2=0x7f2368004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:44.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.746+0000 7f2388200640 1 --2- 172.21.15.8:0/1817802084 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2368004810 0x7f2368004c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f237400c240 tx=0x7f237401ccc0 comp rx=0 tx=0).stop 2024-03-23T23:53:44.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.746+0000 7f2386200640 1 -- 172.21.15.8:0/1817802084 reap_dead start 2024-03-23T23:53:44.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.746+0000 7f2388200640 1 -- 172.21.15.8:0/1817802084 shutdown_connections 2024-03-23T23:53:44.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.746+0000 7f2388200640 1 -- 172.21.15.8:0/1817802084 >> 172.21.15.8:0/1817802084 conn(0x7f238006b170 msgr2=0x7f238006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:53:44.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.750+0000 7f2388200640 1 -- 172.21.15.8:0/1817802084 shutdown_connections 2024-03-23T23:53:44.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.750+0000 7f2388200640 1 -- 172.21.15.8:0/1817802084 wait complete. 2024-03-23T23:53:44.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.750+0000 7f2388200640 1 Processor -- start 2024-03-23T23:53:44.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.750+0000 7f2388200640 1 -- start start 2024-03-23T23:53:44.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.750+0000 7f2388200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2368004810 0x7f2380155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:44.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.750+0000 7f2388200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2380152310 0x7f23801f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:44.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.750+0000 7f2388200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f23801493c0 0x7f23801f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:44.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.750+0000 7f2388200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2380157440 con 0x7f2368004810 2024-03-23T23:53:44.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.750+0000 7f2388200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23800c4550 con 0x7f2380152310 2024-03-23T23:53:44.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.750+0000 7f2388200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23801575c0 con 0x7f23801493c0 2024-03-23T23:53:44.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.754+0000 7f2385800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2368004810 0x7f2380155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:44.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.754+0000 7f2385800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2368004810 0x7f2380155950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47070/0 (socket says 172.21.15.8:47070) 2024-03-23T23:53:44.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.754+0000 7f2385800640 1 -- 172.21.15.8:0/3890316170 learned_addr learned my addr 172.21.15.8:0/3890316170 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:53:44.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.754+0000 7f2385800640 1 -- 172.21.15.8:0/3890316170 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f23801493c0 msgr2=0x7f23801f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:44.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.754+0000 7f2385800640 1 --2- 172.21.15.8:0/3890316170 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f23801493c0 0x7f23801f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:44.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.754+0000 7f2385800640 1 -- 172.21.15.8:0/3890316170 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2380152310 msgr2=0x7f23801f5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:44.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.754+0000 7f2385800640 1 --2- 172.21.15.8:0/3890316170 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2380152310 0x7f23801f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:44.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.754+0000 7f2385800640 1 -- 172.21.15.8:0/3890316170 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23801f69e0 con 0x7f2368004810 2024-03-23T23:53:44.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.754+0000 7f2385800640 1 --2- 172.21.15.8:0/3890316170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2368004810 0x7f2380155950 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f23780049d0 tx=0x7f2378007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:44.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.754+0000 7f237d600640 1 -- 172.21.15.8:0/3890316170 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2378014590 con 0x7f2368004810 2024-03-23T23:53:44.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.754+0000 7f237d600640 1 -- 172.21.15.8:0/3890316170 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237801a070 con 0x7f2368004810 2024-03-23T23:53:44.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.754+0000 7f237d600640 1 -- 172.21.15.8:0/3890316170 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2378014950 con 0x7f2368004810 2024-03-23T23:53:44.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.754+0000 7f2388200640 1 -- 172.21.15.8:0/3890316170 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23801490e0 con 0x7f2368004810 2024-03-23T23:53:44.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.754+0000 7f2388200640 1 -- 172.21.15.8:0/3890316170 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23800c6be0 con 0x7f2368004810 2024-03-23T23:53:44.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.758+0000 7f2388200640 1 -- 172.21.15.8:0/3890316170 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2380068270 con 0x7f2368004810 2024-03-23T23:53:44.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.766+0000 7f237d600640 1 -- 172.21.15.8:0/3890316170 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f2378014af0 con 0x7f2368004810 2024-03-23T23:53:44.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.770+0000 7f237d600640 1 --2- 172.21.15.8:0/3890316170 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f23600676e0 0x7f2360069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:44.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.770+0000 7f237d600640 1 -- 172.21.15.8:0/3890316170 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f2378087230 con 0x7f2368004810 2024-03-23T23:53:44.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.774+0000 7f2384e00640 1 --2- 172.21.15.8:0/3890316170 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f23600676e0 0x7f2360069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:44.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.774+0000 7f237d600640 1 -- 172.21.15.8:0/3890316170 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f23801f69e0 con 0x7f2368004810 2024-03-23T23:53:44.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:44.778+0000 7f2384e00640 1 --2- 172.21.15.8:0/3890316170 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f23600676e0 0x7f2360069ba0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f23740aa000 tx=0x7f238015a7a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:45.329 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:53:45.343 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:53:45.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:45.354+0000 7f2388200640 1 -- 172.21.15.8:0/3890316170 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f23800c20d0 con 0x7f2368004810 2024-03-23T23:53:45.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:45.362+0000 7f237d600640 1 -- 172.21.15.8:0/3890316170 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f2378057bd0 con 0x7f2368004810 2024-03-23T23:53:45.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:45.370+0000 7f2388200640 1 -- 172.21.15.8:0/3890316170 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f23600676e0 msgr2=0x7f2360069ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:45.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:45.370+0000 7f2388200640 1 --2- 172.21.15.8:0/3890316170 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f23600676e0 0x7f2360069ba0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f23740aa000 tx=0x7f238015a7a0 comp rx=0 tx=0).stop 2024-03-23T23:53:45.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:45.370+0000 7f2388200640 1 -- 172.21.15.8:0/3890316170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2368004810 msgr2=0x7f2380155950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:45.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:45.370+0000 7f2388200640 1 --2- 172.21.15.8:0/3890316170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2368004810 0x7f2380155950 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f23780049d0 tx=0x7f2378007700 comp rx=0 tx=0).stop 2024-03-23T23:53:45.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:45.370+0000 7f2388200640 1 -- 172.21.15.8:0/3890316170 shutdown_connections 2024-03-23T23:53:45.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:45.370+0000 7f2388200640 1 --2- 172.21.15.8:0/3890316170 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f23600676e0 0x7f2360069ba0 secure :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f23740aa000 tx=0x7f238015a7a0 comp rx=0 tx=0).stop 2024-03-23T23:53:45.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:45.370+0000 7f2388200640 1 --2- 172.21.15.8:0/3890316170 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f23801493c0 0x7f23801f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:45.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:45.370+0000 7f2388200640 1 --2- 172.21.15.8:0/3890316170 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2380152310 0x7f23801f5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:45.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:45.370+0000 7f2388200640 1 --2- 172.21.15.8:0/3890316170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2368004810 0x7f2380155950 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:45.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:45.370+0000 7f2388200640 1 -- 172.21.15.8:0/3890316170 >> 172.21.15.8:0/3890316170 conn(0x7f238006b170 msgr2=0x7f23801594f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:53:45.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:45.374+0000 7f2388200640 1 -- 172.21.15.8:0/3890316170 shutdown_connections 2024-03-23T23:53:45.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:45.382+0000 7f2388200640 1 -- 172.21.15.8:0/3890316170 wait complete. 2024-03-23T23:53:45.438 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-03-23T23:53:55.439 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T23:53:55.439 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:53:55.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.822+0000 7fc516000640 1 Processor -- start 2024-03-23T23:53:55.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.822+0000 7fc516000640 1 -- start start 2024-03-23T23:53:55.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.826+0000 7fc516000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc5100ae850 0x7fc5100aec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:55.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.826+0000 7fc516000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc5100c61e0 0x7fc5100c6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:55.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.826+0000 7fc516000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5100c9db0 con 0x7fc5100ca550 2024-03-23T23:53:55.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.826+0000 7fc516000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5100ca0c0 con 0x7fc5100ae850 2024-03-23T23:53:55.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.826+0000 7fc516000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5100b0b00 con 0x7fc5100c61e0 2024-03-23T23:53:55.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.830+0000 7fc50fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc5100c61e0 0x7fc5100c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:55.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.830+0000 7fc50fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc5100c61e0 0x7fc5100c6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:59336/0 (socket says 172.21.15.8:59336) 2024-03-23T23:53:55.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.830+0000 7fc50fe00640 1 -- 172.21.15.8:0/3670548808 learned_addr learned my addr 172.21.15.8:0/3670548808 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:53:55.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.834+0000 7fc50fe00640 1 -- 172.21.15.8:0/3670548808 >> v2:172.21.15.196:3300/0 conn(0x7fc5100ae850 msgr2=0x7fc5100aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:53:55.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.834+0000 7fc50fe00640 1 --2- 172.21.15.8:0/3670548808 >> v2:172.21.15.196:3300/0 conn(0x7fc5100ae850 0x7fc5100aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:55.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.838+0000 7fc50fe00640 1 -- 172.21.15.8:0/3670548808 >> v1:172.21.15.196:6789/0 conn(0x7fc5100ca550 legacy=0x7fc5100caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:53:55.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.838+0000 7fc50fe00640 1 -- 172.21.15.8:0/3670548808 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5100b0da0 con 0x7fc5100c61e0 2024-03-23T23:53:55.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.858+0000 7fc50fe00640 1 --2- 172.21.15.8:0/3670548808 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc5100c61e0 0x7fc5100c6630 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc009870 tx=0x7fc4fc01c2b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dfe92f7f0cdd14b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:55.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.862+0000 7fc50e000640 1 -- 172.21.15.8:0/3670548808 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc0b0070 con 0x7fc5100c61e0 2024-03-23T23:53:55.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.862+0000 7fc50e000640 1 -- 172.21.15.8:0/3670548808 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4fc0ab600 con 0x7fc5100c61e0 2024-03-23T23:53:55.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.862+0000 7fc50e000640 1 -- 172.21.15.8:0/3670548808 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc0ab9d0 con 0x7fc5100c61e0 2024-03-23T23:53:55.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.866+0000 7fc516000640 1 -- 172.21.15.8:0/3670548808 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc5100c61e0 msgr2=0x7fc5100c6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:55.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.866+0000 7fc516000640 1 --2- 172.21.15.8:0/3670548808 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc5100c61e0 0x7fc5100c6630 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc009870 tx=0x7fc4fc01c2b0 comp rx=0 tx=0).stop 2024-03-23T23:53:55.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.866+0000 7fc516000640 1 -- 172.21.15.8:0/3670548808 shutdown_connections 2024-03-23T23:53:55.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.866+0000 7fc516000640 1 --2- 172.21.15.8:0/3670548808 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc5100c61e0 0x7fc5100c6630 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:55.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.866+0000 7fc516000640 1 --2- 172.21.15.8:0/3670548808 >> v2:172.21.15.196:3300/0 conn(0x7fc5100ae850 0x7fc5100aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:55.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.866+0000 7fc516000640 1 -- 172.21.15.8:0/3670548808 >> 172.21.15.8:0/3670548808 conn(0x7fc5100cb630 msgr2=0x7fc5100cba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:53:55.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.866+0000 7fc516000640 1 -- 172.21.15.8:0/3670548808 shutdown_connections 2024-03-23T23:53:55.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.870+0000 7fc516000640 1 -- 172.21.15.8:0/3670548808 wait complete. 2024-03-23T23:53:55.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.882+0000 7fc516000640 1 Processor -- start 2024-03-23T23:53:55.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.886+0000 7fc516000640 1 -- start start 2024-03-23T23:53:55.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.886+0000 7fc516000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc5100ae850 0x7fc5101645b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:55.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.886+0000 7fc516000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc5100c61e0 0x7fc5100c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:55.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.886+0000 7fc516000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5100ca550 0x7fc5101f4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:55.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.886+0000 7fc516000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5100af2f0 con 0x7fc5100ca550 2024-03-23T23:53:55.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.886+0000 7fc50fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5100ca550 0x7fc5101f4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:55.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.886+0000 7fc50fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5100ca550 0x7fc5101f4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53422/0 (socket says 172.21.15.8:53422) 2024-03-23T23:53:55.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.886+0000 7fc50fe00640 1 -- 172.21.15.8:0/3557505475 learned_addr learned my addr 172.21.15.8:0/3557505475 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:53:55.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.890+0000 7fc516000640 1 -- 172.21.15.8:0/3557505475 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5100af170 con 0x7fc5100c61e0 2024-03-23T23:53:55.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.890+0000 7fc516000640 1 -- 172.21.15.8:0/3557505475 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc510166de0 con 0x7fc5100ae850 2024-03-23T23:53:55.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.890+0000 7fc50fe00640 1 -- 172.21.15.8:0/3557505475 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc5100ae850 msgr2=0x7fc5101645b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:55.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.890+0000 7fc50fe00640 1 --2- 172.21.15.8:0/3557505475 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc5100ae850 0x7fc5101645b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:55.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.890+0000 7fc50fe00640 1 -- 172.21.15.8:0/3557505475 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc5100c61e0 msgr2=0x7fc5100c41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:55.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.890+0000 7fc50fe00640 1 --2- 172.21.15.8:0/3557505475 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc5100c61e0 0x7fc5100c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:55.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.890+0000 7fc50fe00640 1 -- 172.21.15.8:0/3557505475 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5100c4b50 con 0x7fc5100ca550 2024-03-23T23:53:55.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.890+0000 7fc50fe00640 1 --2- 172.21.15.8:0/3557505475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5100ca550 0x7fc5101f4100 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc01a960 tx=0x7fc4fc019050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:55.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.894+0000 7fc507400640 1 -- 172.21.15.8:0/3557505475 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc0b9020 con 0x7fc5100ca550 2024-03-23T23:53:55.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.894+0000 7fc507400640 1 -- 172.21.15.8:0/3557505475 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4fc0b1040 con 0x7fc5100ca550 2024-03-23T23:53:55.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.894+0000 7fc507400640 1 -- 172.21.15.8:0/3557505475 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc0b0050 con 0x7fc5100ca550 2024-03-23T23:53:55.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.894+0000 7fc516000640 1 -- 172.21.15.8:0/3557505475 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5101f63a0 con 0x7fc5100ca550 2024-03-23T23:53:55.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.894+0000 7fc516000640 1 -- 172.21.15.8:0/3557505475 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5101f6960 con 0x7fc5100ca550 2024-03-23T23:53:55.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.898+0000 7fc516000640 1 -- 172.21.15.8:0/3557505475 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc51004f480 con 0x7fc5100ca550 2024-03-23T23:53:55.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.910+0000 7fc507400640 1 -- 172.21.15.8:0/3557505475 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc4fc0bc020 con 0x7fc5100ca550 2024-03-23T23:53:55.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.914+0000 7fc507400640 1 --2- 172.21.15.8:0/3557505475 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc4f0067730 0x7fc4f0069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:55.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.914+0000 7fc507400640 1 -- 172.21.15.8:0/3557505475 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fc4fc11f930 con 0x7fc5100ca550 2024-03-23T23:53:55.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.918+0000 7fc50f400640 1 --2- 172.21.15.8:0/3557505475 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc4f0067730 0x7fc4f0069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:55.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.918+0000 7fc50f400640 1 --2- 172.21.15.8:0/3557505475 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc4f0067730 0x7fc4f0069bf0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc50800ab90 tx=0x7fc508009250 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:55.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:55.946+0000 7fc507400640 1 -- 172.21.15.8:0/3557505475 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fc4fc0c3030 con 0x7fc5100ca550 2024-03-23T23:53:56.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.462+0000 7fc516000640 1 -- 172.21.15.8:0/3557505475 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc5100beb00 con 0x7fc5100ca550 2024-03-23T23:53:56.464 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.462+0000 7fc507400640 1 -- 172.21.15.8:0/3557505475 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1561 (secure 0 0 0) 0x7fc5100c9db0 con 0x7fc5100ca550 2024-03-23T23:53:56.464 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":90,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:53:56.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.466+0000 7fc516000640 1 -- 172.21.15.8:0/3557505475 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc4f0067730 msgr2=0x7fc4f0069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:56.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.466+0000 7fc516000640 1 --2- 172.21.15.8:0/3557505475 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc4f0067730 0x7fc4f0069bf0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc50800ab90 tx=0x7fc508009250 comp rx=0 tx=0).stop 2024-03-23T23:53:56.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.466+0000 7fc516000640 1 -- 172.21.15.8:0/3557505475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5100ca550 msgr2=0x7fc5101f4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:56.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.466+0000 7fc516000640 1 --2- 172.21.15.8:0/3557505475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5100ca550 0x7fc5101f4100 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc01a960 tx=0x7fc4fc019050 comp rx=0 tx=0).stop 2024-03-23T23:53:56.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.466+0000 7fc516000640 1 -- 172.21.15.8:0/3557505475 shutdown_connections 2024-03-23T23:53:56.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.466+0000 7fc516000640 1 --2- 172.21.15.8:0/3557505475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5100ca550 0x7fc5101f4100 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:56.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.466+0000 7fc516000640 1 --2- 172.21.15.8:0/3557505475 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc5100c61e0 0x7fc5100c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:56.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.466+0000 7fc516000640 1 --2- 172.21.15.8:0/3557505475 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc4f0067730 0x7fc4f0069bf0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:56.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.466+0000 7fc516000640 1 --2- 172.21.15.8:0/3557505475 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc5100ae850 0x7fc5101645b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:56.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.466+0000 7fc516000640 1 -- 172.21.15.8:0/3557505475 >> 172.21.15.8:0/3557505475 conn(0x7fc5100cb630 msgr2=0x7fc510157d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:53:56.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.466+0000 7fc516000640 1 -- 172.21.15.8:0/3557505475 shutdown_connections 2024-03-23T23:53:56.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.466+0000 7fc516000640 1 -- 172.21.15.8:0/3557505475 wait complete. 2024-03-23T23:53:56.490 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T23:53:56.490 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-03-23T23:53:56.490 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T23:53:56.490 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:53:56.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.730+0000 7f76fd000640 1 Processor -- start 2024-03-23T23:53:56.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.734+0000 7f76fd000640 1 -- start start 2024-03-23T23:53:56.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.734+0000 7f76fd000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f76f806c4e0 0x7f76f815a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:56.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.734+0000 7f76fd000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f76f80c8140 0x7f76f80c8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:56.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.734+0000 7f76fd000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f806e320 con 0x7f76f80a8970 2024-03-23T23:53:56.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.734+0000 7f76fd000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f80c4700 con 0x7f76f806c4e0 2024-03-23T23:53:56.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.734+0000 7f76fd000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f815ade0 con 0x7f76f80c8140 2024-03-23T23:53:56.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.738+0000 7f76f5400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f76f80a8970 0x7f76f8157070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:40518/0 (socket says 172.21.15.8:40518) 2024-03-23T23:53:56.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.738+0000 7f76f5e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f76f806c4e0 0x7f76f815a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:56.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.738+0000 7f76f5e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f76f806c4e0 0x7f76f815a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53432/0 (socket says 172.21.15.8:53432) 2024-03-23T23:53:56.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.738+0000 7f76f5e00640 1 -- 172.21.15.8:0/3348954100 learned_addr learned my addr 172.21.15.8:0/3348954100 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:53:56.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.738+0000 7f76f5e00640 1 -- 172.21.15.8:0/3348954100 >> v2:172.21.15.196:3300/0 conn(0x7f76f80c8140 msgr2=0x7f76f80c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:53:56.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.738+0000 7f76f5e00640 1 --2- 172.21.15.8:0/3348954100 >> v2:172.21.15.196:3300/0 conn(0x7f76f80c8140 0x7f76f80c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:56.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.738+0000 7f76f5e00640 1 -- 172.21.15.8:0/3348954100 >> v1:172.21.15.8:6789/0 conn(0x7f76f80a8970 legacy=0x7f76f8157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:56.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.738+0000 7f76f5e00640 1 -- 172.21.15.8:0/3348954100 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f8070b50 con 0x7f76f806c4e0 2024-03-23T23:53:56.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.746+0000 7f76f5e00640 1 --2- 172.21.15.8:0/3348954100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f806c4e0 0x7f76f815a8a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f76f80ac020 tx=0x7f76e801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=718a65f6a4305976 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:56.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.746+0000 7f76f4a00640 1 -- 172.21.15.8:0/3348954100 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e80b0070 con 0x7f76f806c4e0 2024-03-23T23:53:56.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.746+0000 7f76f4a00640 1 -- 172.21.15.8:0/3348954100 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e80ab600 con 0x7f76f806c4e0 2024-03-23T23:53:56.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.746+0000 7f76f4a00640 1 -- 172.21.15.8:0/3348954100 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e80b0070 con 0x7f76f806c4e0 2024-03-23T23:53:56.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.746+0000 7f76fd000640 1 -- 172.21.15.8:0/3348954100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f806c4e0 msgr2=0x7f76f815a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:56.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.746+0000 7f76fd000640 1 --2- 172.21.15.8:0/3348954100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f806c4e0 0x7f76f815a8a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f76f80ac020 tx=0x7f76e801c4b0 comp rx=0 tx=0).stop 2024-03-23T23:53:56.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.750+0000 7f76fd000640 1 -- 172.21.15.8:0/3348954100 shutdown_connections 2024-03-23T23:53:56.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.750+0000 7f76fd000640 1 --2- 172.21.15.8:0/3348954100 >> v2:172.21.15.196:3300/0 conn(0x7f76f80c8140 0x7f76f80c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:56.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.750+0000 7f76fd000640 1 --2- 172.21.15.8:0/3348954100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f806c4e0 0x7f76f815a8a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:56.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.750+0000 7f76fd000640 1 -- 172.21.15.8:0/3348954100 >> 172.21.15.8:0/3348954100 conn(0x7f76f80aafe0 msgr2=0x7f76f80ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:53:56.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.750+0000 7f76fd000640 1 -- 172.21.15.8:0/3348954100 shutdown_connections 2024-03-23T23:53:56.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.750+0000 7f76fd000640 1 -- 172.21.15.8:0/3348954100 wait complete. 2024-03-23T23:53:56.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.750+0000 7f76fd000640 1 Processor -- start 2024-03-23T23:53:56.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.754+0000 7f76fd000640 1 -- start start 2024-03-23T23:53:56.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.754+0000 7f76fd000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f806c4e0 0x7f76f80ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:56.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.754+0000 7f76fd000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f76f80a8970 0x7f76f8158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:56.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.754+0000 7f76fd000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f76f80c8140 0x7f76f8158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:56.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.754+0000 7f76fd000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f8157900 con 0x7f76f806c4e0 2024-03-23T23:53:56.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.754+0000 7f76fd000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f8157780 con 0x7f76f80c8140 2024-03-23T23:53:56.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.754+0000 7f76fd000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f80c8a90 con 0x7f76f80a8970 2024-03-23T23:53:56.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.754+0000 7f76f5e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f806c4e0 0x7f76f80ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:56.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.758+0000 7f76f5e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f806c4e0 0x7f76f80ace00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53448/0 (socket says 172.21.15.8:53448) 2024-03-23T23:53:56.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.758+0000 7f76f5e00640 1 -- 172.21.15.8:0/1411309880 learned_addr learned my addr 172.21.15.8:0/1411309880 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:53:56.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.758+0000 7f76f5400640 1 --2- 172.21.15.8:0/1411309880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f76f80a8970 0x7f76f8158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:56.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.758+0000 7f76f5e00640 1 -- 172.21.15.8:0/1411309880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f76f80a8970 msgr2=0x7f76f8158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:56.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.758+0000 7f76f5e00640 1 --2- 172.21.15.8:0/1411309880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f76f80a8970 0x7f76f8158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:56.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.758+0000 7f76f5e00640 1 -- 172.21.15.8:0/1411309880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f76f80c8140 msgr2=0x7f76f8158fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:56.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.758+0000 7f76f5e00640 1 --2- 172.21.15.8:0/1411309880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f76f80c8140 0x7f76f8158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:56.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.758+0000 7f76f5e00640 1 -- 172.21.15.8:0/1411309880 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f80aec00 con 0x7f76f806c4e0 2024-03-23T23:53:56.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.758+0000 7f76f5e00640 1 --2- 172.21.15.8:0/1411309880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f806c4e0 0x7f76f80ace00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f76e80190c0 tx=0x7f76e8019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:56.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.758+0000 7f76ee000640 1 -- 172.21.15.8:0/1411309880 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e80b0040 con 0x7f76f806c4e0 2024-03-23T23:53:56.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.758+0000 7f76ee000640 1 -- 172.21.15.8:0/1411309880 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e80bb070 con 0x7f76f806c4e0 2024-03-23T23:53:56.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.758+0000 7f76ee000640 1 -- 172.21.15.8:0/1411309880 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e80abe00 con 0x7f76f806c4e0 2024-03-23T23:53:56.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.758+0000 7f76fd000640 1 -- 172.21.15.8:0/1411309880 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f80ad340 con 0x7f76f806c4e0 2024-03-23T23:53:56.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.762+0000 7f76fd000640 1 -- 172.21.15.8:0/1411309880 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f815b360 con 0x7f76f806c4e0 2024-03-23T23:53:56.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.762+0000 7f76ee000640 1 -- 172.21.15.8:0/1411309880 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f76e8003620 con 0x7f76f806c4e0 2024-03-23T23:53:56.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.766+0000 7f76fd000640 1 --2- 172.21.15.8:0/1411309880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f80ad870 0x7f76f80adc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:56.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.766+0000 7f76fd000640 1 -- 172.21.15.8:0/1411309880 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f8068270 con 0x7f76f80ad870 2024-03-23T23:53:56.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.766+0000 7f76ee000640 1 --2- 172.21.15.8:0/1411309880 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f76d8067730 0x7f76d8069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:56.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.766+0000 7f76ee000640 1 -- 172.21.15.8:0/1411309880 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f76e81203d0 con 0x7f76f806c4e0 2024-03-23T23:53:56.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.766+0000 7f76f6800640 1 --2- 172.21.15.8:0/1411309880 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f76d8067730 0x7f76d8069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:56.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.766+0000 7f76f6800640 1 --2- 172.21.15.8:0/1411309880 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f76d8067730 0x7f76d8069bf0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f76f000ab10 tx=0x7f76f0009250 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:56.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.766+0000 7f76f5400640 1 --2- 172.21.15.8:0/1411309880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f80ad870 0x7f76f80adc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:56.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.766+0000 7f76f5400640 1 -- 172.21.15.8:0/1411309880 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f76f80c8d90 con 0x7f76f80ad870 2024-03-23T23:53:56.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.770+0000 7f76f5400640 1 --2- 172.21.15.8:0/1411309880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f80ad870 0x7f76f80adc50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f76e4000f70 tx=0x7f76e40017f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:56.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.770+0000 7f76ee000640 1 -- 172.21.15.8:0/1411309880 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e4019070 con 0x7f76f80ad870 2024-03-23T23:53:56.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.770+0000 7f76ee000640 1 -- 172.21.15.8:0/1411309880 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f76e4010510 con 0x7f76f80ad870 2024-03-23T23:53:56.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.770+0000 7f76ee000640 1 -- 172.21.15.8:0/1411309880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f80ad870 msgr2=0x7f76f80adc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:56.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.770+0000 7f76ee000640 1 --2- 172.21.15.8:0/1411309880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f80ad870 0x7f76f80adc50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f76e4000f70 tx=0x7f76e40017f0 comp rx=0 tx=0).stop 2024-03-23T23:53:56.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.770+0000 7f76ee000640 1 -- 172.21.15.8:0/1411309880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f80ad870 msgr2=0x7f76f80adc50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:53:56.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.770+0000 7f76ee000640 1 --2- 172.21.15.8:0/1411309880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f80ad870 0x7f76f80adc50 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f76e4000f70 tx=0x7f76e40017f0 comp rx=0 tx=0).stop 2024-03-23T23:53:56.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.786+0000 7f76fd000640 1 --2- 172.21.15.8:0/1411309880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f80ae190 0x7f76f81474c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:56.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.786+0000 7f76fd000640 1 -- 172.21.15.8:0/1411309880 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f80ae5a0 con 0x7f76f80ae190 2024-03-23T23:53:56.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.790+0000 7f76f5400640 1 --2- 172.21.15.8:0/1411309880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f80ae190 0x7f76f81474c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:56.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.790+0000 7f76f5400640 1 -- 172.21.15.8:0/1411309880 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f76f80c3c30 con 0x7f76f80ae190 2024-03-23T23:53:56.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.790+0000 7f76f5400640 1 --2- 172.21.15.8:0/1411309880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f80ae190 0x7f76f81474c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f76e4000fc0 tx=0x7f76e4000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:56.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.794+0000 7f76ee000640 1 -- 172.21.15.8:0/1411309880 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e4019030 con 0x7f76f80ae190 2024-03-23T23:53:56.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.794+0000 7f76ee000640 1 -- 172.21.15.8:0/1411309880 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5015 (secure 0 0 0) 0x7f76e401a040 con 0x7f76f80ae190 2024-03-23T23:53:56.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.794+0000 7f76ee000640 1 -- 172.21.15.8:0/1411309880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f80ae190 msgr2=0x7f76f81474c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:56.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.794+0000 7f76ee000640 1 --2- 172.21.15.8:0/1411309880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f80ae190 0x7f76f81474c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f76e4000fc0 tx=0x7f76e4000ee0 comp rx=0 tx=0).stop 2024-03-23T23:53:56.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.794+0000 7f76ee000640 1 -- 172.21.15.8:0/1411309880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f80ae190 msgr2=0x7f76f81474c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:53:56.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.794+0000 7f76ee000640 1 --2- 172.21.15.8:0/1411309880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f80ae190 0x7f76f81474c0 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f76e4000fc0 tx=0x7f76e4000ee0 comp rx=0 tx=0).stop 2024-03-23T23:53:56.802 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:53:56.802 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:53:56.802 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:53:56.802 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:53:56.802 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 90, 2024-03-23T23:53:56.802 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:53:56.802 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:53:56.802 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:53:56.802 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:53:56.802 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:56.802 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 18, 2024-03-23T23:53:56.803 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:53:56.803 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:53:56.803 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:53:56.803 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:53:56.803 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:53:56.803 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:53:56.803 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:53:56.803 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:53:56.803 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:53:56.803 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:53:56.803 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:53:56.803 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:53:56.803 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:53:56.803 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:53:56.804 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:56.804 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:53:56.804 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:53:56.804 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:53:56.804 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:53:56.804 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:53:56.804 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:53:56.804 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:53:56.804 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:53:56.804 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:53:56.804 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:53:56.804 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:53:56.804 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:53:56.804 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:53:56.805 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:56.805 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:56.805 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:53:56.805 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:53:56.805 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:53:56.805 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:53:56.805 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:53:56.805 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:53:56.805 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:53:56.805 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:53:56.805 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:53:56.805 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:53:56.805 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:53:56.806 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:53:56.806 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:53:56.806 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:53:56.806 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:53:56.806 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:53:56.806 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:53:56.806 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:53:56.806 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:53:56.806 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:53:56.806 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:53:56.806 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:53:56.806 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:53:56.806 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:53:56.806 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:53:56.807 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:53:56.807 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:53:56.807 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:53:56.807 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:56.807 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:53:56.807 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:56.807 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:53:56.807 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:56.807 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:53:56.807 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:53:56.807 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:53:56.807 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:53:56.807 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:56.807 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:53:56.808 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:53:56.808 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:56.808 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:56.808 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:56.808 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:53:56.808 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:53:56.808 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:56.808 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:56.808 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:56.808 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:56.808 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:53:56.808 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:53:56.808 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:53:56.808 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:53:56.809 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:53:56.809 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:56.809 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:56.809 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:53:56.809 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:53:56.809 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:53:56.809 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:53:56.809 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:56.809 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:53:56.809 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:53:56.809 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:56.809 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:56.809 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:56.809 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:53:56.810 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:53:56.810 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:56.810 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:56.810 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:56.810 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:56.810 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:53:56.810 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:53:56.810 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:53:56.810 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:53:56.810 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:53:56.810 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:56.810 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:56.810 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:53:56.811 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:53:56.811 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:53:56.811 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:53:56.811 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:56.811 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:53:56.811 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:53:56.811 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:56.811 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:56.811 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:56.811 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:53:56.811 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:53:56.811 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:56.811 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:56.811 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:56.811 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:56.812 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:53:56.812 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:53:56.812 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:53:56.812 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:53:56.812 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:53:56.812 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:56.812 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:56.812 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:56.812 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:53:56.812 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:53:56.812 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:56.812 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:53:56.812 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:56.812 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:53:56.813 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:56.813 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:56.813 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:53:56.813 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:56.813 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:53:56.813 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:56.813 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:53:56.813 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:56.813 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:56.813 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:53:56.813 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:56.813 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:53:56.813 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:56.813 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:53:56.814 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:56.814 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:56.814 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:53:56.814 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:56.814 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:53:56.814 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:56.814 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:53:56.814 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:56.814 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:56.814 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:53:56.814 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:56.814 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5 2024-03-23T23:53:56.814 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:56.814 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:56.815 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:56.815 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:53:56.815 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:53:56.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.802+0000 7f76fd000640 1 -- 172.21.15.8:0/1411309880 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f76d8067730 msgr2=0x7f76d8069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:56.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.802+0000 7f76fd000640 1 --2- 172.21.15.8:0/1411309880 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f76d8067730 0x7f76d8069bf0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f76f000ab10 tx=0x7f76f0009250 comp rx=0 tx=0).stop 2024-03-23T23:53:56.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.802+0000 7f76fd000640 1 -- 172.21.15.8:0/1411309880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f806c4e0 msgr2=0x7f76f80ace00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:56.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.802+0000 7f76fd000640 1 --2- 172.21.15.8:0/1411309880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f806c4e0 0x7f76f80ace00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f76e80190c0 tx=0x7f76e8019250 comp rx=0 tx=0).stop 2024-03-23T23:53:56.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.802+0000 7f76f6800640 1 -- 172.21.15.8:0/1411309880 reap_dead start 2024-03-23T23:53:56.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.802+0000 7f76f6800640 1 -- 172.21.15.8:0/1411309880 reap_dead start 2024-03-23T23:53:56.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.802+0000 7f76fd000640 1 -- 172.21.15.8:0/1411309880 shutdown_connections 2024-03-23T23:53:56.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.802+0000 7f76fd000640 1 -- 172.21.15.8:0/1411309880 >> 172.21.15.8:0/1411309880 conn(0x7f76f80aafe0 msgr2=0x7f76f8165fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:53:56.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.806+0000 7f76fd000640 1 -- 172.21.15.8:0/1411309880 shutdown_connections 2024-03-23T23:53:56.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:56.806+0000 7f76fd000640 1 -- 172.21.15.8:0/1411309880 wait complete. 2024-03-23T23:53:56.856 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:53:56.856 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T23:53:56.856 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:53:57.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.070+0000 7f8e46200640 1 Processor -- start 2024-03-23T23:53:57.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.070+0000 7f8e46200640 1 -- start start 2024-03-23T23:53:57.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.074+0000 7f8e46200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8e4014fae0 0x7f8e400c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:57.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.074+0000 7f8e46200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8e401532b0 0x7f8e40072d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:57.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.074+0000 7f8e46200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e40152810 con 0x7f8e400732c0 2024-03-23T23:53:57.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.074+0000 7f8e46200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e400c57d0 con 0x7f8e401532b0 2024-03-23T23:53:57.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.074+0000 7f8e46200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e400c54f0 con 0x7f8e4014fae0 2024-03-23T23:53:57.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.074+0000 7f8e3ea00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8e401532b0 0x7f8e40072d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:57.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.074+0000 7f8e3ea00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8e401532b0 0x7f8e40072d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53472/0 (socket says 172.21.15.8:53472) 2024-03-23T23:53:57.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.074+0000 7f8e3ea00640 1 -- 172.21.15.8:0/639224227 learned_addr learned my addr 172.21.15.8:0/639224227 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:53:57.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.074+0000 7f8e3ea00640 1 -- 172.21.15.8:0/639224227 >> v2:172.21.15.196:3300/0 conn(0x7f8e4014fae0 msgr2=0x7f8e400c4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:53:57.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.074+0000 7f8e3ea00640 1 --2- 172.21.15.8:0/639224227 >> v2:172.21.15.196:3300/0 conn(0x7f8e4014fae0 0x7f8e400c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:57.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.074+0000 7f8e3ea00640 1 -- 172.21.15.8:0/639224227 >> v1:172.21.15.196:6789/0 conn(0x7f8e400732c0 legacy=0x7f8e4006ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:53:57.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.074+0000 7f8e3ea00640 1 -- 172.21.15.8:0/639224227 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e40152ab0 con 0x7f8e401532b0 2024-03-23T23:53:57.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.078+0000 7f8e3ea00640 1 --2- 172.21.15.8:0/639224227 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e401532b0 0x7f8e40072d80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8e400c27d0 tx=0x7f8e2c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc961c41d3fedb0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:57.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.078+0000 7f8e3e000640 1 -- 172.21.15.8:0/639224227 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c0b0070 con 0x7f8e401532b0 2024-03-23T23:53:57.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.078+0000 7f8e3e000640 1 -- 172.21.15.8:0/639224227 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2c0ab600 con 0x7f8e401532b0 2024-03-23T23:53:57.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.078+0000 7f8e3e000640 1 -- 172.21.15.8:0/639224227 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c0ab9d0 con 0x7f8e401532b0 2024-03-23T23:53:57.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.078+0000 7f8e46200640 1 -- 172.21.15.8:0/639224227 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e401532b0 msgr2=0x7f8e40072d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:57.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.078+0000 7f8e46200640 1 --2- 172.21.15.8:0/639224227 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e401532b0 0x7f8e40072d80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8e400c27d0 tx=0x7f8e2c01c450 comp rx=0 tx=0).stop 2024-03-23T23:53:57.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.078+0000 7f8e46200640 1 -- 172.21.15.8:0/639224227 shutdown_connections 2024-03-23T23:53:57.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.078+0000 7f8e46200640 1 --2- 172.21.15.8:0/639224227 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e401532b0 0x7f8e40072d80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:57.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.078+0000 7f8e46200640 1 --2- 172.21.15.8:0/639224227 >> v2:172.21.15.196:3300/0 conn(0x7f8e4014fae0 0x7f8e400c4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:57.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.078+0000 7f8e46200640 1 -- 172.21.15.8:0/639224227 >> 172.21.15.8:0/639224227 conn(0x7f8e4006c280 msgr2=0x7f8e4006c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:53:57.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.078+0000 7f8e46200640 1 -- 172.21.15.8:0/639224227 shutdown_connections 2024-03-23T23:53:57.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.078+0000 7f8e46200640 1 -- 172.21.15.8:0/639224227 wait complete. 2024-03-23T23:53:57.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.082+0000 7f8e46200640 1 Processor -- start 2024-03-23T23:53:57.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.082+0000 7f8e46200640 1 -- start start 2024-03-23T23:53:57.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.082+0000 7f8e46200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e400732c0 0x7f8e401eca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:57.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.082+0000 7f8e46200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e4014fae0 0x7f8e40141590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:57.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.082+0000 7f8e46200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e401532b0 0x7f8e400ab810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:57.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.082+0000 7f8e46200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e40150040 con 0x7f8e401532b0 2024-03-23T23:53:57.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.082+0000 7f8e46200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4014fec0 con 0x7f8e400732c0 2024-03-23T23:53:57.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.082+0000 7f8e46200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4015d790 con 0x7f8e4014fae0 2024-03-23T23:53:57.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.082+0000 7f8e3fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e401532b0 0x7f8e400ab810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:57.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.082+0000 7f8e3fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e401532b0 0x7f8e400ab810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53488/0 (socket says 172.21.15.8:53488) 2024-03-23T23:53:57.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.082+0000 7f8e3fe00640 1 -- 172.21.15.8:0/2521869230 learned_addr learned my addr 172.21.15.8:0/2521869230 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:53:57.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.082+0000 7f8e3fe00640 1 -- 172.21.15.8:0/2521869230 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e4014fae0 msgr2=0x7f8e40141590 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-23T23:53:57.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.082+0000 7f8e3fe00640 1 --2- 172.21.15.8:0/2521869230 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e4014fae0 0x7f8e40141590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:57.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.082+0000 7f8e3fe00640 1 -- 172.21.15.8:0/2521869230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e400732c0 msgr2=0x7f8e401eca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:57.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.082+0000 7f8e3fe00640 1 --2- 172.21.15.8:0/2521869230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e400732c0 0x7f8e401eca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:57.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.082+0000 7f8e3fe00640 1 -- 172.21.15.8:0/2521869230 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e400ab310 con 0x7f8e401532b0 2024-03-23T23:53:57.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.086+0000 7f8e3fe00640 1 --2- 172.21.15.8:0/2521869230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e401532b0 0x7f8e400ab810 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8e38002210 tx=0x7f8e3800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:57.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.086+0000 7f8e37400640 1 -- 172.21.15.8:0/2521869230 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3800ce60 con 0x7f8e401532b0 2024-03-23T23:53:57.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.086+0000 7f8e37400640 1 -- 172.21.15.8:0/2521869230 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e38015070 con 0x7f8e401532b0 2024-03-23T23:53:57.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.086+0000 7f8e37400640 1 -- 172.21.15.8:0/2521869230 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e38005070 con 0x7f8e401532b0 2024-03-23T23:53:57.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.086+0000 7f8e46200640 1 -- 172.21.15.8:0/2521869230 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e400c7910 con 0x7f8e401532b0 2024-03-23T23:53:57.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.086+0000 7f8e46200640 1 -- 172.21.15.8:0/2521869230 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e40141ad0 con 0x7f8e401532b0 2024-03-23T23:53:57.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.086+0000 7f8e46200640 1 --2- 172.21.15.8:0/2521869230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e400ad550 0x7f8e400abd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:57.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.086+0000 7f8e46200640 1 -- 172.21.15.8:0/2521869230 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4014abb0 con 0x7f8e400ad550 2024-03-23T23:53:57.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.086+0000 7f8e3f400640 1 --2- 172.21.15.8:0/2521869230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e400ad550 0x7f8e400abd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:57.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.086+0000 7f8e37400640 1 -- 172.21.15.8:0/2521869230 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f8e38005230 con 0x7f8e401532b0 2024-03-23T23:53:57.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.090+0000 7f8e37400640 1 --2- 172.21.15.8:0/2521869230 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8e20067660 0x7f8e20069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:57.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.090+0000 7f8e37400640 1 -- 172.21.15.8:0/2521869230 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f8e38089a70 con 0x7f8e401532b0 2024-03-23T23:53:57.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.090+0000 7f8e3ea00640 1 --2- 172.21.15.8:0/2521869230 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8e20067660 0x7f8e20069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:57.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.090+0000 7f8e3f400640 1 -- 172.21.15.8:0/2521869230 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8e400ab110 con 0x7f8e400ad550 2024-03-23T23:53:57.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.090+0000 7f8e3ea00640 1 --2- 172.21.15.8:0/2521869230 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8e20067660 0x7f8e20069b20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c0ad000 tx=0x7f8e2c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:57.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.094+0000 7f8e3f400640 1 --2- 172.21.15.8:0/2521869230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e400ad550 0x7f8e400abd50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000b320 tx=0x7f8e3000b7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:57.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.098+0000 7f8e37400640 1 -- 172.21.15.8:0/2521869230 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e30015020 con 0x7f8e400ad550 2024-03-23T23:53:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.102+0000 7f8e37400640 1 -- 172.21.15.8:0/2521869230 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f8e30011830 con 0x7f8e400ad550 2024-03-23T23:53:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.102+0000 7f8e37400640 1 -- 172.21.15.8:0/2521869230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e400ad550 msgr2=0x7f8e400abd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.102+0000 7f8e37400640 1 --2- 172.21.15.8:0/2521869230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e400ad550 0x7f8e400abd50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000b320 tx=0x7f8e3000b7e0 comp rx=0 tx=0).stop 2024-03-23T23:53:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.102+0000 7f8e37400640 1 -- 172.21.15.8:0/2521869230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e400ad550 msgr2=0x7f8e400abd50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:53:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.102+0000 7f8e37400640 1 --2- 172.21.15.8:0/2521869230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e400ad550 0x7f8e400abd50 secure :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000b320 tx=0x7f8e3000b7e0 comp rx=0 tx=0).stop 2024-03-23T23:53:57.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.114+0000 7f8e46200640 1 --2- 172.21.15.8:0/2521869230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e400ac290 0x7f8e400c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:57.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.114+0000 7f8e46200640 1 -- 172.21.15.8:0/2521869230 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4015ffa0 con 0x7f8e400ac290 2024-03-23T23:53:57.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.118+0000 7f8e3f400640 1 --2- 172.21.15.8:0/2521869230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e400ac290 0x7f8e400c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:57.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.122+0000 7f8e3f400640 1 -- 172.21.15.8:0/2521869230 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8e40068270 con 0x7f8e400ac290 2024-03-23T23:53:57.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.126+0000 7f8e3f400640 1 --2- 172.21.15.8:0/2521869230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e400ac290 0x7f8e400c6870 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000b320 tx=0x7f8e300047e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:57.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.130+0000 7f8e37400640 1 -- 172.21.15.8:0/2521869230 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e30015040 con 0x7f8e400ac290 2024-03-23T23:53:57.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.134+0000 7f8e37400640 1 -- 172.21.15.8:0/2521869230 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4530 (secure 0 0 0) 0x7f8e3001a630 con 0x7f8e400ac290 2024-03-23T23:53:57.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.134+0000 7f8e37400640 1 -- 172.21.15.8:0/2521869230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e400ac290 msgr2=0x7f8e400c6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:57.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.134+0000 7f8e37400640 1 --2- 172.21.15.8:0/2521869230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e400ac290 0x7f8e400c6870 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000b320 tx=0x7f8e300047e0 comp rx=0 tx=0).stop 2024-03-23T23:53:57.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.134+0000 7f8e37400640 1 -- 172.21.15.8:0/2521869230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e400ac290 msgr2=0x7f8e400c6870 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:53:57.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.134+0000 7f8e37400640 1 --2- 172.21.15.8:0/2521869230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e400ac290 0x7f8e400c6870 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:57.135 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:53:57.135 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:53:57.135 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:53:57.135 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:53:57.135 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 90, 2024-03-23T23:53:57.135 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:53:57.135 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:53:57.136 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:53:57.136 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:53:57.136 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:57.136 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 19, 2024-03-23T23:53:57.136 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:53:57.136 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:53:57.136 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:53:57.136 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:53:57.137 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:53:57.137 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:53:57.137 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:53:57.137 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:53:57.137 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:53:57.137 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:53:57.137 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:53:57.137 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:53:57.137 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:53:57.138 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:53:57.138 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:57.138 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:53:57.138 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:53:57.138 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:53:57.138 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:53:57.138 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:53:57.138 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:53:57.138 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:53:57.139 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:53:57.139 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:53:57.139 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:53:57.139 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:53:57.139 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:53:57.139 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:53:57.139 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:57.139 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:57.139 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:53:57.139 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:53:57.139 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:53:57.139 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:53:57.139 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:53:57.140 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:53:57.140 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:53:57.140 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:53:57.140 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:53:57.140 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:53:57.140 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:53:57.140 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:53:57.140 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:53:57.140 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:53:57.140 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:53:57.140 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:53:57.140 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:53:57.141 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:53:57.141 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:53:57.141 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:53:57.141 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:53:57.141 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:53:57.141 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:53:57.141 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:53:57.141 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:53:57.141 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:53:57.141 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:53:57.141 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:53:57.142 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:57.142 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:53:57.142 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:57.142 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:53:57.142 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:57.142 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:53:57.142 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:53:57.146 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:53:57.146 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:53:57.146 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:57.147 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:53:57.147 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:53:57.147 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:57.147 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:57.147 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:57.148 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:53:57.148 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:53:57.148 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:57.148 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:57.148 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:57.148 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:57.149 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:53:57.149 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:53:57.149 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:53:57.149 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:53:57.149 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:53:57.149 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:57.150 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:57.150 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:53:57.150 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:53:57.150 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:53:57.150 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:53:57.151 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:57.151 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:53:57.151 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:53:57.151 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:57.151 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:57.151 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:57.152 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:53:57.152 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:53:57.152 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:57.152 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:57.152 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:57.152 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:57.153 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:53:57.153 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:53:57.153 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:53:57.153 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:53:57.153 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:53:57.153 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:57.154 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:57.154 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:53:57.154 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:53:57.154 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:53:57.154 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:53:57.155 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:57.155 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:53:57.155 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:53:57.155 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:57.155 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:57.155 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:57.156 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:53:57.156 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:53:57.156 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:57.156 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:57.156 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:57.156 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:57.157 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:53:57.157 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:53:57.157 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:53:57.157 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:53:57.157 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:53:57.157 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:57.158 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:57.158 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:57.158 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:53:57.158 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:53:57.158 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:57.159 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:53:57.159 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:57.159 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:53:57.159 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:57.159 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:57.159 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:53:57.160 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:57.160 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:53:57.160 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:57.160 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:53:57.160 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:57.160 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:57.161 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:57.161 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:53:57.161 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:53:57.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.134+0000 7f8e34c00640 1 -- 172.21.15.8:0/2521869230 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8e20067660 msgr2=0x7f8e20069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:57.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.134+0000 7f8e34c00640 1 --2- 172.21.15.8:0/2521869230 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8e20067660 0x7f8e20069b20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c0ad000 tx=0x7f8e2c008040 comp rx=0 tx=0).stop 2024-03-23T23:53:57.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.134+0000 7f8e34c00640 1 -- 172.21.15.8:0/2521869230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e401532b0 msgr2=0x7f8e400ab810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:57.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.134+0000 7f8e34c00640 1 --2- 172.21.15.8:0/2521869230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e401532b0 0x7f8e400ab810 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8e38002210 tx=0x7f8e3800cc10 comp rx=0 tx=0).stop 2024-03-23T23:53:57.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.134+0000 7f8e3fe00640 1 -- 172.21.15.8:0/2521869230 reap_dead start 2024-03-23T23:53:57.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.134+0000 7f8e3fe00640 1 -- 172.21.15.8:0/2521869230 reap_dead start 2024-03-23T23:53:57.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.134+0000 7f8e34c00640 1 -- 172.21.15.8:0/2521869230 shutdown_connections 2024-03-23T23:53:57.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.134+0000 7f8e34c00640 1 -- 172.21.15.8:0/2521869230 >> 172.21.15.8:0/2521869230 conn(0x7f8e4006c280 msgr2=0x7f8e4006ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:53:57.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.134+0000 7f8e34c00640 1 -- 172.21.15.8:0/2521869230 shutdown_connections 2024-03-23T23:53:57.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.138+0000 7f8e34c00640 1 -- 172.21.15.8:0/2521869230 wait complete. 2024-03-23T23:53:57.172 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:53:57.172 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T23:53:57.172 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:53:57.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.582+0000 7f0e12e00640 1 Processor -- start 2024-03-23T23:53:57.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.582+0000 7f0e12e00640 1 -- start start 2024-03-23T23:53:57.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.586+0000 7f0e12e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0e0c0aadf0 0x7f0e0c1557b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:57.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.586+0000 7f0e12e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e0c06f510 0x7f0e0c0c10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:57.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.586+0000 7f0e12e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e0c0ac630 con 0x7f0e0c0ab1d0 2024-03-23T23:53:57.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.586+0000 7f0e12e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e0c156790 con 0x7f0e0c0aadf0 2024-03-23T23:53:57.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.586+0000 7f0e12e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c155cf0 con 0x7f0e0c06f510 2024-03-23T23:53:57.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.586+0000 7f0e0aa00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e0c06f510 0x7f0e0c0c10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:57.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.590+0000 7f0e0be00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f0e0c0ab1d0 0x7f0e0c0c0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:49688/0 (socket says 172.21.15.8:49688) 2024-03-23T23:53:57.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.590+0000 7f0e0be00640 1 -- 172.21.15.8:0/2196320096 learned_addr learned my addr 172.21.15.8:0/2196320096 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:53:57.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.590+0000 7f0e0b400640 1 --2- 172.21.15.8:0/2196320096 >> v2:172.21.15.196:3300/0 conn(0x7f0e0c0aadf0 0x7f0e0c1557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:57.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.594+0000 7f0e0b400640 1 -- 172.21.15.8:0/2196320096 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e0c06f510 msgr2=0x7f0e0c0c10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:53:57.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.594+0000 7f0e0b400640 1 --2- 172.21.15.8:0/2196320096 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e0c06f510 0x7f0e0c0c10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:57.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.594+0000 7f0e0b400640 1 -- 172.21.15.8:0/2196320096 >> v1:172.21.15.196:6789/0 conn(0x7f0e0c0ab1d0 legacy=0x7f0e0c0c0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:57.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.594+0000 7f0e0b400640 1 -- 172.21.15.8:0/2196320096 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0c1597d0 con 0x7f0e0c0aadf0 2024-03-23T23:53:57.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.598+0000 7f0e0b400640 1 --2- 172.21.15.8:0/2196320096 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e0c0aadf0 0x7f0e0c1557b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0df80097c0 tx=0x7f0df801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c094944c32d917ff server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:57.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.602+0000 7f0e11800640 1 -- 172.21.15.8:0/2196320096 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df80b0070 con 0x7f0e0c0aadf0 2024-03-23T23:53:57.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.602+0000 7f0e11800640 1 -- 172.21.15.8:0/2196320096 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df80ab600 con 0x7f0e0c0aadf0 2024-03-23T23:53:57.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.602+0000 7f0e11800640 1 -- 172.21.15.8:0/2196320096 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df80b0070 con 0x7f0e0c0aadf0 2024-03-23T23:53:57.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.606+0000 7f0e12e00640 1 -- 172.21.15.8:0/2196320096 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e0c0aadf0 msgr2=0x7f0e0c1557b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:57.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.606+0000 7f0e12e00640 1 --2- 172.21.15.8:0/2196320096 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e0c0aadf0 0x7f0e0c1557b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0df80097c0 tx=0x7f0df801c410 comp rx=0 tx=0).stop 2024-03-23T23:53:57.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.610+0000 7f0e12e00640 1 -- 172.21.15.8:0/2196320096 shutdown_connections 2024-03-23T23:53:57.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.610+0000 7f0e12e00640 1 --2- 172.21.15.8:0/2196320096 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e0c06f510 0x7f0e0c0c10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:57.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.610+0000 7f0e12e00640 1 --2- 172.21.15.8:0/2196320096 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e0c0aadf0 0x7f0e0c1557b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:57.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.610+0000 7f0e12e00640 1 -- 172.21.15.8:0/2196320096 >> 172.21.15.8:0/2196320096 conn(0x7f0e0c0c3bd0 msgr2=0x7f0e0c0c3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:53:57.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.610+0000 7f0e12e00640 1 -- 172.21.15.8:0/2196320096 shutdown_connections 2024-03-23T23:53:57.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.610+0000 7f0e12e00640 1 -- 172.21.15.8:0/2196320096 wait complete. 2024-03-23T23:53:57.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.614+0000 7f0e12e00640 1 Processor -- start 2024-03-23T23:53:57.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.618+0000 7f0e12e00640 1 -- start start 2024-03-23T23:53:57.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.618+0000 7f0e12e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e0c06f510 0x7f0e0c0bdac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:57.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.618+0000 7f0e12e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e0c0aadf0 0x7f0e0c14cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:57.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.618+0000 7f0e12e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e0c0ab1d0 0x7f0e0c1fe890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:57.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.618+0000 7f0e12e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c0c15e0 con 0x7f0e0c0aadf0 2024-03-23T23:53:57.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.618+0000 7f0e12e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c0c0e80 con 0x7f0e0c0ab1d0 2024-03-23T23:53:57.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.618+0000 7f0e12e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c0bf5f0 con 0x7f0e0c06f510 2024-03-23T23:53:57.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.622+0000 7f0e0aa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e0c0aadf0 0x7f0e0c14cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:57.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.622+0000 7f0e0aa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e0c0aadf0 0x7f0e0c14cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53490/0 (socket says 172.21.15.8:53490) 2024-03-23T23:53:57.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.622+0000 7f0e0aa00640 1 -- 172.21.15.8:0/1057139751 learned_addr learned my addr 172.21.15.8:0/1057139751 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:53:57.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.622+0000 7f0e0b400640 1 --2- 172.21.15.8:0/1057139751 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e0c06f510 0x7f0e0c0bdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:57.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.622+0000 7f0e0aa00640 1 -- 172.21.15.8:0/1057139751 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e0c06f510 msgr2=0x7f0e0c0bdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:57.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.622+0000 7f0e0aa00640 1 --2- 172.21.15.8:0/1057139751 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e0c06f510 0x7f0e0c0bdac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:57.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.622+0000 7f0e0aa00640 1 -- 172.21.15.8:0/1057139751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e0c0ab1d0 msgr2=0x7f0e0c1fe890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:57.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.622+0000 7f0e0aa00640 1 --2- 172.21.15.8:0/1057139751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e0c0ab1d0 0x7f0e0c1fe890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:53:57.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.622+0000 7f0e0aa00640 1 -- 172.21.15.8:0/1057139751 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0c0bf8d0 con 0x7f0e0c0aadf0 2024-03-23T23:53:57.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.622+0000 7f0e0aa00640 1 --2- 172.21.15.8:0/1057139751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e0c0aadf0 0x7f0e0c14cd80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0e0400ec70 tx=0x7f0e0400c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:57.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.626+0000 7f0dffe00640 1 -- 172.21.15.8:0/1057139751 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e04018020 con 0x7f0e0c0aadf0 2024-03-23T23:53:57.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.626+0000 7f0dffe00640 1 -- 172.21.15.8:0/1057139751 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0400a050 con 0x7f0e0c0aadf0 2024-03-23T23:53:57.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.626+0000 7f0dffe00640 1 -- 172.21.15.8:0/1057139751 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e040146a0 con 0x7f0e0c0aadf0 2024-03-23T23:53:57.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.626+0000 7f0e12e00640 1 -- 172.21.15.8:0/1057139751 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e0c0bd2c0 con 0x7f0e0c0aadf0 2024-03-23T23:53:57.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.626+0000 7f0e12e00640 1 -- 172.21.15.8:0/1057139751 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e0c14d2c0 con 0x7f0e0c0aadf0 2024-03-23T23:53:57.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.626+0000 7f0e12e00640 1 --2- 172.21.15.8:0/1057139751 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e0c0bf160 0x7f0e0c142850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:57.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.630+0000 7f0e12e00640 1 -- 172.21.15.8:0/1057139751 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c0bd140 con 0x7f0e0c0bf160 2024-03-23T23:53:57.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.630+0000 7f0e0b400640 1 --2- 172.21.15.8:0/1057139751 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e0c0bf160 0x7f0e0c142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:57.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.630+0000 7f0dffe00640 1 -- 172.21.15.8:0/1057139751 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f0e0401b020 con 0x7f0e0c0aadf0 2024-03-23T23:53:57.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.634+0000 7f0dffe00640 1 --2- 172.21.15.8:0/1057139751 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0dec067660 0x7f0dec069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:57.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.634+0000 7f0dffe00640 1 -- 172.21.15.8:0/1057139751 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f0e04086800 con 0x7f0e0c0aadf0 2024-03-23T23:53:57.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.634+0000 7f0e0be00640 1 --2- 172.21.15.8:0/1057139751 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0dec067660 0x7f0dec069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:57.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.642+0000 7f0e0b400640 1 -- 172.21.15.8:0/1057139751 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0e0c068270 con 0x7f0e0c0bf160 2024-03-23T23:53:57.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.642+0000 7f0e0be00640 1 --2- 172.21.15.8:0/1057139751 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0dec067660 0x7f0dec069b20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0e00000f70 tx=0x7f0e00007a90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:57.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.646+0000 7f0e0b400640 1 --2- 172.21.15.8:0/1057139751 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e0c0bf160 0x7f0e0c142850 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c06c180 tx=0x7f0df80191b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:57.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.650+0000 7f0dffe00640 1 -- 172.21.15.8:0/1057139751 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df80b9070 con 0x7f0e0c0bf160 2024-03-23T23:53:57.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.650+0000 7f0dffe00640 1 -- 172.21.15.8:0/1057139751 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f0df8003820 con 0x7f0e0c0bf160 2024-03-23T23:53:57.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.650+0000 7f0dffe00640 1 -- 172.21.15.8:0/1057139751 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e0c0bf160 msgr2=0x7f0e0c142850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:57.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.650+0000 7f0dffe00640 1 --2- 172.21.15.8:0/1057139751 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e0c0bf160 0x7f0e0c142850 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c06c180 tx=0x7f0df80191b0 comp rx=0 tx=0).stop 2024-03-23T23:53:57.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.650+0000 7f0dffe00640 1 -- 172.21.15.8:0/1057139751 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e0c0bf160 msgr2=0x7f0e0c142850 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:53:57.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.650+0000 7f0dffe00640 1 --2- 172.21.15.8:0/1057139751 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e0c0bf160 0x7f0e0c142850 secure :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c06c180 tx=0x7f0df80191b0 comp rx=0 tx=0).stop 2024-03-23T23:53:57.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.670+0000 7f0e12e00640 1 --2- 172.21.15.8:0/1057139751 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e0c0c28c0 0x7f0e0c142d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:53:57.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.670+0000 7f0e12e00640 1 -- 172.21.15.8:0/1057139751 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c0c1760 con 0x7f0e0c0c28c0 2024-03-23T23:53:57.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.670+0000 7f0e0b400640 1 --2- 172.21.15.8:0/1057139751 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e0c0c28c0 0x7f0e0c142d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:53:57.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.674+0000 7f0e0b400640 1 -- 172.21.15.8:0/1057139751 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0e0c0bfaa0 con 0x7f0e0c0c28c0 2024-03-23T23:53:57.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.678+0000 7f0e0b400640 1 --2- 172.21.15.8:0/1057139751 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e0c0c28c0 0x7f0e0c142d90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0df80097c0 tx=0x7f0df80a8000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:53:57.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.682+0000 7f0dffe00640 1 -- 172.21.15.8:0/1057139751 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df80b9040 con 0x7f0e0c0c28c0 2024-03-23T23:53:57.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.682+0000 7f0dffe00640 1 -- 172.21.15.8:0/1057139751 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5183 (secure 0 0 0) 0x7f0df80b5d50 con 0x7f0e0c0c28c0 2024-03-23T23:53:57.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.682+0000 7f0dffe00640 1 -- 172.21.15.8:0/1057139751 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e0c0c28c0 msgr2=0x7f0e0c142d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:57.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.682+0000 7f0dffe00640 1 --2- 172.21.15.8:0/1057139751 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e0c0c28c0 0x7f0e0c142d90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0df80097c0 tx=0x7f0df80a8000 comp rx=0 tx=0).stop 2024-03-23T23:53:57.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.682+0000 7f0dffe00640 1 -- 172.21.15.8:0/1057139751 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e0c0c28c0 msgr2=0x7f0e0c142d90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:53:57.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.682+0000 7f0dffe00640 1 --2- 172.21.15.8:0/1057139751 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e0c0c28c0 0x7f0e0c142d90 secure :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0df80097c0 tx=0x7f0df80a8000 comp rx=0 tx=0).stop 2024-03-23T23:53:57.684 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:53:57.684 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:53:57.684 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:53:57.685 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:53:57.685 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 90, 2024-03-23T23:53:57.685 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:53:57.685 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:53:57.685 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:53:57.685 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:53:57.685 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:57.685 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 19, 2024-03-23T23:53:57.685 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:53:57.685 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:53:57.685 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:53:57.685 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:53:57.685 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:53:57.686 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:53:57.686 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:53:57.686 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:53:57.686 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:53:57.686 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:53:57.686 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:53:57.686 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:53:57.686 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:53:57.686 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:53:57.686 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:57.686 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:53:57.686 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:53:57.686 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:53:57.687 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:53:57.687 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:53:57.687 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:53:57.687 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:53:57.687 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:53:57.687 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:53:57.687 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:53:57.687 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:53:57.687 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:53:57.687 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:53:57.687 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:57.687 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:57.687 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:53:57.688 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:53:57.688 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:53:57.688 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:53:57.688 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:53:57.688 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:53:57.688 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:53:57.688 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:53:57.688 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:53:57.688 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:53:57.688 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:53:57.688 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:53:57.688 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:53:57.688 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:53:57.689 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:53:57.689 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:53:57.689 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:53:57.689 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:53:57.689 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:53:57.689 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:53:57.689 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:53:57.689 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:53:57.689 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:53:57.689 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:53:57.689 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:53:57.689 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:53:57.689 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:53:57.690 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:53:57.690 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:57.690 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:53:57.690 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:57.690 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:53:57.690 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:57.690 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:53:57.690 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:53:57.690 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:53:57.690 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:53:57.690 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:57.690 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:53:57.690 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:53:57.691 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:57.691 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:57.691 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:57.691 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:53:57.691 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:53:57.691 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:57.691 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:57.691 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:57.691 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:57.691 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:53:57.691 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:53:57.691 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:53:57.691 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:53:57.692 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:53:57.692 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:57.692 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:57.692 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:53:57.692 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:53:57.692 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:53:57.692 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:53:57.692 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:57.692 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:53:57.692 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:53:57.692 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:57.692 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:57.693 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:57.693 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:53:57.693 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:53:57.693 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:57.693 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:57.693 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:57.693 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:57.693 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:53:57.693 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:53:57.693 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:53:57.693 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:53:57.693 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:53:57.693 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:57.694 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:57.694 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:53:57.694 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:53:57.694 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:53:57.694 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:53:57.694 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:57.694 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:53:57.694 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:53:57.694 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:57.694 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:57.694 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:57.694 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:53:57.694 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:53:57.694 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:53:57.695 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:57.695 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:57.695 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:57.695 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:53:57.695 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:53:57.695 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:53:57.695 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:53:57.695 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:53:57.695 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:57.695 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:57.695 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:57.695 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:53:57.695 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:53:57.696 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:57.696 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:53:57.696 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:57.696 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:53:57.696 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:57.696 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:57.696 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:53:57.696 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:57.696 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:53:57.696 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:57.696 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:53:57.697 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:57.697 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:57.697 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:53:57.697 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:57.697 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:53:57.697 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:57.697 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 7 2024-03-23T23:53:57.697 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:57.697 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:57.697 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:53:57.697 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:57.697 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:53:57.697 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:57.698 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:53:57.698 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:57.698 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:57.698 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:53:57.698 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:57.698 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:53:57.698 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:57.698 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:53:57.698 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:53:57.698 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:53:57.699 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:53:57.699 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:53:57.699 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:53:57.699 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:53:57.699 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:53:57.699 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:53:57.699 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:53:57.699 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:53:57.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.686+0000 7f0e12e00640 1 -- 172.21.15.8:0/1057139751 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0dec067660 msgr2=0x7f0dec069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:57.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.686+0000 7f0e12e00640 1 --2- 172.21.15.8:0/1057139751 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0dec067660 0x7f0dec069b20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0e00000f70 tx=0x7f0e00007a90 comp rx=0 tx=0).stop 2024-03-23T23:53:57.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.686+0000 7f0e12e00640 1 -- 172.21.15.8:0/1057139751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e0c0aadf0 msgr2=0x7f0e0c14cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:53:57.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.686+0000 7f0e12e00640 1 --2- 172.21.15.8:0/1057139751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e0c0aadf0 0x7f0e0c14cd80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0e0400ec70 tx=0x7f0e0400c580 comp rx=0 tx=0).stop 2024-03-23T23:53:57.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.686+0000 7f0e0be00640 1 -- 172.21.15.8:0/1057139751 reap_dead start 2024-03-23T23:53:57.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.686+0000 7f0e0be00640 1 -- 172.21.15.8:0/1057139751 reap_dead start 2024-03-23T23:53:57.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.686+0000 7f0e12e00640 1 -- 172.21.15.8:0/1057139751 shutdown_connections 2024-03-23T23:53:57.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.686+0000 7f0e12e00640 1 -- 172.21.15.8:0/1057139751 >> 172.21.15.8:0/1057139751 conn(0x7f0e0c0c3bd0 msgr2=0x7f0e0c0c5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:53:57.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.686+0000 7f0e12e00640 1 -- 172.21.15.8:0/1057139751 shutdown_connections 2024-03-23T23:53:57.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:53:57.686+0000 7f0e12e00640 1 -- 172.21.15.8:0/1057139751 wait complete. 2024-03-23T23:53:57.759 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:53:57.759 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-03-23T23:53:57.759 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-03-23T23:53:57.760 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-03-23T23:53:57.760 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-03-23T23:53:57.760 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-23T23:53:57.760 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:54:03.208 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-03-23T23:54:03.862 INFO:tasks.ceph.mon.c:Stopped 2024-03-23T23:54:03.862 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-03-23T23:54:03.862 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:54:04.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.102+0000 7f2727400640 1 Processor -- start 2024-03-23T23:54:04.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.102+0000 7f2727400640 1 -- start start 2024-03-23T23:54:04.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.106+0000 7f2727400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f272014a180 0x7f2720154220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:04.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.106+0000 7f2727400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f27200c1b70 0x7f27200c3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:04.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.106+0000 7f2727400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f272014a560 con 0x7f27200c3b60 2024-03-23T23:54:04.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.106+0000 7f2727400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27200c2070 con 0x7f27200c1b70 2024-03-23T23:54:04.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.106+0000 7f2727400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27200c2350 con 0x7f272014a180 2024-03-23T23:54:04.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.106+0000 7f271fe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f27200c1b70 0x7f27200c3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:04.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.106+0000 7f271fe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f27200c1b70 0x7f27200c3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38454/0 (socket says 172.21.15.8:38454) 2024-03-23T23:54:04.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.106+0000 7f271fe00640 1 -- 172.21.15.8:0/2341284664 learned_addr learned my addr 172.21.15.8:0/2341284664 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:54:04.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.106+0000 7f271fe00640 1 -- 172.21.15.8:0/2341284664 >> v2:172.21.15.196:3300/0 conn(0x7f272014a180 msgr2=0x7f2720154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:54:04.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.106+0000 7f271fe00640 1 --2- 172.21.15.8:0/2341284664 >> v2:172.21.15.196:3300/0 conn(0x7f272014a180 0x7f2720154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:04.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.106+0000 7f271fe00640 1 -- 172.21.15.8:0/2341284664 >> v1:172.21.15.196:6789/0 conn(0x7f27200c3b60 legacy=0x7f272006e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:54:04.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.106+0000 7f271fe00640 1 -- 172.21.15.8:0/2341284664 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27200c2630 con 0x7f27200c1b70 2024-03-23T23:54:04.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.110+0000 7f271fe00640 1 --2- 172.21.15.8:0/2341284664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27200c1b70 0x7f27200c3620 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f272006c150 tx=0x7f270c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aa4a7623540896d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:04.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.110+0000 7f271f400640 1 -- 172.21.15.8:0/2341284664 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c0a7070 con 0x7f27200c1b70 2024-03-23T23:54:04.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.110+0000 7f271f400640 1 -- 172.21.15.8:0/2341284664 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270c0b0070 con 0x7f27200c1b70 2024-03-23T23:54:04.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.110+0000 7f271f400640 1 -- 172.21.15.8:0/2341284664 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c0ab890 con 0x7f27200c1b70 2024-03-23T23:54:04.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.110+0000 7f2727400640 1 -- 172.21.15.8:0/2341284664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27200c1b70 msgr2=0x7f27200c3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:04.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.110+0000 7f2727400640 1 --2- 172.21.15.8:0/2341284664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27200c1b70 0x7f27200c3620 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f272006c150 tx=0x7f270c01c450 comp rx=0 tx=0).stop 2024-03-23T23:54:04.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.110+0000 7f2727400640 1 -- 172.21.15.8:0/2341284664 shutdown_connections 2024-03-23T23:54:04.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.110+0000 7f2727400640 1 --2- 172.21.15.8:0/2341284664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27200c1b70 0x7f27200c3620 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:04.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.110+0000 7f2727400640 1 --2- 172.21.15.8:0/2341284664 >> v2:172.21.15.196:3300/0 conn(0x7f272014a180 0x7f2720154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:04.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.110+0000 7f2727400640 1 -- 172.21.15.8:0/2341284664 >> 172.21.15.8:0/2341284664 conn(0x7f272006b170 msgr2=0x7f272006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:54:04.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.110+0000 7f2727400640 1 -- 172.21.15.8:0/2341284664 shutdown_connections 2024-03-23T23:54:04.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.110+0000 7f2727400640 1 -- 172.21.15.8:0/2341284664 wait complete. 2024-03-23T23:54:04.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.110+0000 7f2727400640 1 Processor -- start 2024-03-23T23:54:04.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.110+0000 7f2727400640 1 -- start start 2024-03-23T23:54:04.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.110+0000 7f2727400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27200c1b70 0x7f2720156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:04.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.110+0000 7f2727400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27200c3b60 0x7f272014a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:04.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.110+0000 7f2727400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f272014a180 0x7f272014ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:04.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.110+0000 7f2727400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2720160930 con 0x7f27200c1b70 2024-03-23T23:54:04.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.110+0000 7f2727400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27201607b0 con 0x7f27200c3b60 2024-03-23T23:54:04.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.110+0000 7f2727400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2720160ab0 con 0x7f272014a180 2024-03-23T23:54:04.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.114+0000 7f2725400640 1 -- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f272014a180 msgr2=0x7f272014ac70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:54:04.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.114+0000 7f2725400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f272014a180 0x7f272014ac70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:54:04.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.114+0000 7f2724a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27200c1b70 0x7f2720156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:04.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.114+0000 7f2724a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27200c1b70 0x7f2720156e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38462/0 (socket says 172.21.15.8:38462) 2024-03-23T23:54:04.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.114+0000 7f2724a00640 1 -- 172.21.15.8:0/2917094931 learned_addr learned my addr 172.21.15.8:0/2917094931 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:54:04.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.114+0000 7f2724a00640 1 -- 172.21.15.8:0/2917094931 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f272014a180 msgr2=0x7f272014ac70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:54:04.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.114+0000 7f2724a00640 1 --2- 172.21.15.8:0/2917094931 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f272014a180 0x7f272014ac70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:04.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.114+0000 7f2724a00640 1 -- 172.21.15.8:0/2917094931 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27200c3b60 msgr2=0x7f272014a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:04.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.114+0000 7f2724a00640 1 --2- 172.21.15.8:0/2917094931 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27200c3b60 0x7f272014a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:04.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.114+0000 7f2724a00640 1 -- 172.21.15.8:0/2917094931 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2720148830 con 0x7f27200c1b70 2024-03-23T23:54:04.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.114+0000 7f2724a00640 1 --2- 172.21.15.8:0/2917094931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27200c1b70 0x7f2720156e30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f271400b550 tx=0x7f271400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:04.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.114+0000 7f271cc00640 1 -- 172.21.15.8:0/2917094931 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2714014070 con 0x7f27200c1b70 2024-03-23T23:54:04.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.114+0000 7f271cc00640 1 -- 172.21.15.8:0/2917094931 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2714010890 con 0x7f27200c1b70 2024-03-23T23:54:04.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.114+0000 7f2727400640 1 -- 172.21.15.8:0/2917094931 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2720148b10 con 0x7f27200c1b70 2024-03-23T23:54:04.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.114+0000 7f271cc00640 1 -- 172.21.15.8:0/2917094931 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2714010c80 con 0x7f27200c1b70 2024-03-23T23:54:04.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.114+0000 7f2727400640 1 -- 172.21.15.8:0/2917094931 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272014d110 con 0x7f27200c1b70 2024-03-23T23:54:04.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.114+0000 7f2727400640 1 -- 172.21.15.8:0/2917094931 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f272004f480 con 0x7f27200c1b70 2024-03-23T23:54:04.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.118+0000 7f271cc00640 1 -- 172.21.15.8:0/2917094931 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f2714017070 con 0x7f27200c1b70 2024-03-23T23:54:04.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.118+0000 7f271cc00640 1 --2- 172.21.15.8:0/2917094931 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2700067610 0x7f2700069ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:04.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.118+0000 7f271cc00640 1 -- 172.21.15.8:0/2917094931 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f2714085a70 con 0x7f27200c1b70 2024-03-23T23:54:04.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.118+0000 7f271fe00640 1 --2- 172.21.15.8:0/2917094931 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2700067610 0x7f2700069ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:04.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.122+0000 7f271fe00640 1 --2- 172.21.15.8:0/2917094931 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2700067610 0x7f2700069ad0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f270c0af000 tx=0x7f270c004740 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:04.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.126+0000 7f271cc00640 1 -- 172.21.15.8:0/2917094931 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f2714056320 con 0x7f27200c1b70 2024-03-23T23:54:04.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.634+0000 7f2727400640 1 -- 172.21.15.8:0/2917094931 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f27200c3400 con 0x7f27200c1b70 2024-03-23T23:54:04.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.638+0000 7f271cc00640 1 -- 172.21.15.8:0/2917094931 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1561 (secure 0 0 0) 0x7f2714010e20 con 0x7f27200c1b70 2024-03-23T23:54:04.637 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":90,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":26,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:54:04.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.638+0000 7f2727400640 1 -- 172.21.15.8:0/2917094931 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2700067610 msgr2=0x7f2700069ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:04.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.638+0000 7f2727400640 1 --2- 172.21.15.8:0/2917094931 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2700067610 0x7f2700069ad0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f270c0af000 tx=0x7f270c004740 comp rx=0 tx=0).stop 2024-03-23T23:54:04.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.638+0000 7f2727400640 1 -- 172.21.15.8:0/2917094931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27200c1b70 msgr2=0x7f2720156e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:04.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.638+0000 7f2727400640 1 --2- 172.21.15.8:0/2917094931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27200c1b70 0x7f2720156e30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f271400b550 tx=0x7f271400ba10 comp rx=0 tx=0).stop 2024-03-23T23:54:04.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.638+0000 7f2727400640 1 -- 172.21.15.8:0/2917094931 shutdown_connections 2024-03-23T23:54:04.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.638+0000 7f2727400640 1 --2- 172.21.15.8:0/2917094931 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2700067610 0x7f2700069ad0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:04.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.638+0000 7f2727400640 1 --2- 172.21.15.8:0/2917094931 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f272014a180 0x7f272014ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:04.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.638+0000 7f2727400640 1 --2- 172.21.15.8:0/2917094931 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27200c3b60 0x7f272014a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:04.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.638+0000 7f2727400640 1 --2- 172.21.15.8:0/2917094931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27200c1b70 0x7f2720156e30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:04.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.638+0000 7f2727400640 1 -- 172.21.15.8:0/2917094931 >> 172.21.15.8:0/2917094931 conn(0x7f272006b170 msgr2=0x7f272006b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:54:04.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.642+0000 7f2727400640 1 -- 172.21.15.8:0/2917094931 shutdown_connections 2024-03-23T23:54:04.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:04.642+0000 7f2727400640 1 -- 172.21.15.8:0/2917094931 wait complete. 2024-03-23T23:54:07.672 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:54:08.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:08.298+0000 7ff754400640 1 Processor -- start 2024-03-23T23:54:08.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:08.298+0000 7ff754400640 1 -- start start 2024-03-23T23:54:08.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:08.302+0000 7ff754400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff74c0c3e60 0x7ff74c06caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:08.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:08.302+0000 7ff754400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff74c152240 0x7ff74c15c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:08.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:08.302+0000 7ff752400640 1 -- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff74c152240 msgr2=0x7ff74c15c330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:54:08.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:08.302+0000 7ff752400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff74c152240 0x7ff74c15c330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:54:08.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:08.302+0000 7ff754400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff74c155e70 con 0x7ff74c0aa390 2024-03-23T23:54:08.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:08.302+0000 7ff754400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff74c1550b0 con 0x7ff74c0c3e60 2024-03-23T23:54:08.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:08.302+0000 7ff754400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c155390 con 0x7ff74c152240 2024-03-23T23:54:08.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:08.302+0000 7ff751a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff74c0c3e60 0x7ff74c06caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:08.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:08.302+0000 7ff751a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff74c0c3e60 0x7ff74c06caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38468/0 (socket says 172.21.15.8:38468) 2024-03-23T23:54:08.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:08.302+0000 7ff751a00640 1 -- 172.21.15.8:0/1383274666 learned_addr learned my addr 172.21.15.8:0/1383274666 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:54:08.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:08.302+0000 7ff751a00640 1 -- 172.21.15.8:0/1383274666 >> v2:172.21.15.8:3300/0 conn(0x7ff74c0c3e60 msgr2=0x7ff74c06caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T23:54:08.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:08.302+0000 7ff751a00640 1 -- 172.21.15.8:0/1383274666 >> v2:172.21.15.8:3300/0 conn(0x7ff74c0c3e60 msgr2=0x7ff74c06caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:54:08.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:08.302+0000 7ff751a00640 1 --2- 172.21.15.8:0/1383274666 >> v2:172.21.15.8:3300/0 conn(0x7ff74c0c3e60 0x7ff74c06caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:54:08.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:08.302+0000 7ff751a00640 1 --2- 172.21.15.8:0/1383274666 >> v2:172.21.15.8:3300/0 conn(0x7ff74c0c3e60 0x7ff74c06caf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:54:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:08.506+0000 7ff752400640 1 -- 172.21.15.8:0/1383274666 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff74c152240 msgr2=0x7ff74c15c330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:54:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:08.506+0000 7ff752400640 1 --2- 172.21.15.8:0/1383274666 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff74c152240 0x7ff74c15c330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:54:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:08.506+0000 7ff751a00640 1 --2- 172.21.15.8:0/1383274666 >> v2:172.21.15.8:3300/0 conn(0x7ff74c0c3e60 0x7ff74c06caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:08.510+0000 7ff751a00640 1 -- 172.21.15.8:0/1383274666 >> v2:172.21.15.8:3300/0 conn(0x7ff74c0c3e60 msgr2=0x7ff74c06caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:54:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:08.510+0000 7ff751a00640 1 -- 172.21.15.8:0/1383274666 >> v2:172.21.15.8:3300/0 conn(0x7ff74c0c3e60 msgr2=0x7ff74c06caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:54:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:08.510+0000 7ff751a00640 1 --2- 172.21.15.8:0/1383274666 >> v2:172.21.15.8:3300/0 conn(0x7ff74c0c3e60 0x7ff74c06caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:54:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:08.510+0000 7ff751a00640 1 --2- 172.21.15.8:0/1383274666 >> v2:172.21.15.8:3300/0 conn(0x7ff74c0c3e60 0x7ff74c06caf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:54:08.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:08.910+0000 7ff752400640 1 -- 172.21.15.8:0/1383274666 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff74c152240 msgr2=0x7ff74c15c330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:54:08.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:08.910+0000 7ff752400640 1 --2- 172.21.15.8:0/1383274666 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff74c152240 0x7ff74c15c330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:54:08.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:08.914+0000 7ff751a00640 1 --2- 172.21.15.8:0/1383274666 >> v2:172.21.15.8:3300/0 conn(0x7ff74c0c3e60 0x7ff74c06caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:08.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:08.918+0000 7ff751a00640 1 -- 172.21.15.8:0/1383274666 >> v2:172.21.15.8:3300/0 conn(0x7ff74c0c3e60 msgr2=0x7ff74c06caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:54:08.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:08.918+0000 7ff751a00640 1 -- 172.21.15.8:0/1383274666 >> v2:172.21.15.8:3300/0 conn(0x7ff74c0c3e60 msgr2=0x7ff74c06caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:54:08.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:08.918+0000 7ff751a00640 1 --2- 172.21.15.8:0/1383274666 >> v2:172.21.15.8:3300/0 conn(0x7ff74c0c3e60 0x7ff74c06caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:54:08.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:08.918+0000 7ff751a00640 1 --2- 172.21.15.8:0/1383274666 >> v2:172.21.15.8:3300/0 conn(0x7ff74c0c3e60 0x7ff74c06caf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:54:09.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:09.713+0000 7ff752400640 1 -- 172.21.15.8:0/1383274666 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff74c152240 msgr2=0x7ff74c15c330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:54:09.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:09.713+0000 7ff752400640 1 --2- 172.21.15.8:0/1383274666 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff74c152240 0x7ff74c15c330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:54:09.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:09.721+0000 7ff751a00640 1 --2- 172.21.15.8:0/1383274666 >> v2:172.21.15.8:3300/0 conn(0x7ff74c0c3e60 0x7ff74c06caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:09.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:09.721+0000 7ff751a00640 1 -- 172.21.15.8:0/1383274666 >> v2:172.21.15.8:3300/0 conn(0x7ff74c0c3e60 msgr2=0x7ff74c06caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:54:09.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:09.721+0000 7ff751a00640 1 -- 172.21.15.8:0/1383274666 >> v2:172.21.15.8:3300/0 conn(0x7ff74c0c3e60 msgr2=0x7ff74c06caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:54:09.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:09.721+0000 7ff751a00640 1 --2- 172.21.15.8:0/1383274666 >> v2:172.21.15.8:3300/0 conn(0x7ff74c0c3e60 0x7ff74c06caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:54:09.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:09.721+0000 7ff751a00640 1 --2- 172.21.15.8:0/1383274666 >> v2:172.21.15.8:3300/0 conn(0x7ff74c0c3e60 0x7ff74c06caf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:54:09.820 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-03-23T23:54:11.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:11.301+0000 7ff74aa00640 1 -- 172.21.15.8:0/1383274666 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff74c152240 msgr2=0x7ff74c15c330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:54:11.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:11.301+0000 7ff74aa00640 1 --2- 172.21.15.8:0/1383274666 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff74c152240 0x7ff74c15c330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:11.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:11.301+0000 7ff74aa00640 1 -- 172.21.15.8:0/1383274666 >> v2:172.21.15.8:3300/0 conn(0x7ff74c0c3e60 msgr2=0x7ff74c06caf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:54:11.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:11.301+0000 7ff74aa00640 1 --2- 172.21.15.8:0/1383274666 >> v2:172.21.15.8:3300/0 conn(0x7ff74c0c3e60 0x7ff74c06caf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:11.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:11.301+0000 7ff74aa00640 1 -- 172.21.15.8:0/1383274666 >> v1:172.21.15.196:6789/0 conn(0x7ff74c0aa390 legacy=0x7ff74c14b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:11.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:11.301+0000 7ff74aa00640 1 --2- 172.21.15.8:0/1383274666 >> v2:172.21.15.196:3300/0 conn(0x7ff72c009570 0x7ff72c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:11.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:11.301+0000 7ff74aa00640 1 -- 172.21.15.8:0/1383274666 --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff74c155670 con 0x7ff72c0058c0 2024-03-23T23:54:11.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:11.301+0000 7ff74aa00640 1 -- 172.21.15.8:0/1383274666 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff74c1550b0 con 0x7ff72c009570 2024-03-23T23:54:11.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:11.301+0000 7ff751000640 1 --2- 172.21.15.8:0/1383274666 >> v2:172.21.15.196:3300/0 conn(0x7ff72c009570 0x7ff72c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:11.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:11.305+0000 7ff751000640 1 -- 172.21.15.8:0/1383274666 >> v2:172.21.15.196:3300/0 conn(0x7ff72c009570 msgr2=0x7ff72c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:54:11.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:11.305+0000 7ff751000640 1 -- 172.21.15.8:0/1383274666 >> v2:172.21.15.196:3300/0 conn(0x7ff72c009570 msgr2=0x7ff72c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:54:11.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:11.305+0000 7ff751000640 1 --2- 172.21.15.8:0/1383274666 >> v2:172.21.15.196:3300/0 conn(0x7ff72c009570 0x7ff72c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:54:11.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:11.305+0000 7ff751000640 1 --2- 172.21.15.8:0/1383274666 >> v2:172.21.15.196:3300/0 conn(0x7ff72c009570 0x7ff72c00ba30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:54:11.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:11.509+0000 7ff751000640 1 --2- 172.21.15.8:0/1383274666 >> v2:172.21.15.196:3300/0 conn(0x7ff72c009570 0x7ff72c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:11.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:11.509+0000 7ff751000640 1 -- 172.21.15.8:0/1383274666 >> v2:172.21.15.196:3300/0 conn(0x7ff72c009570 msgr2=0x7ff72c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:54:11.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:11.509+0000 7ff751000640 1 -- 172.21.15.8:0/1383274666 >> v2:172.21.15.196:3300/0 conn(0x7ff72c009570 msgr2=0x7ff72c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:54:11.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:11.509+0000 7ff751000640 1 --2- 172.21.15.8:0/1383274666 >> v2:172.21.15.196:3300/0 conn(0x7ff72c009570 0x7ff72c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:54:11.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:11.509+0000 7ff751000640 1 --2- 172.21.15.8:0/1383274666 >> v2:172.21.15.196:3300/0 conn(0x7ff72c009570 0x7ff72c00ba30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:54:11.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:11.913+0000 7ff751000640 1 --2- 172.21.15.8:0/1383274666 >> v2:172.21.15.196:3300/0 conn(0x7ff72c009570 0x7ff72c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:11.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:11.913+0000 7ff751000640 1 -- 172.21.15.8:0/1383274666 >> v2:172.21.15.196:3300/0 conn(0x7ff72c009570 msgr2=0x7ff72c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:54:11.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:11.913+0000 7ff751000640 1 -- 172.21.15.8:0/1383274666 >> v2:172.21.15.196:3300/0 conn(0x7ff72c009570 msgr2=0x7ff72c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:54:11.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:11.913+0000 7ff751000640 1 --2- 172.21.15.8:0/1383274666 >> v2:172.21.15.196:3300/0 conn(0x7ff72c009570 0x7ff72c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:54:11.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:11.913+0000 7ff751000640 1 --2- 172.21.15.8:0/1383274666 >> v2:172.21.15.196:3300/0 conn(0x7ff72c009570 0x7ff72c00ba30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:54:12.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.265+0000 7ff74be00640 1 -- 172.21.15.8:0/1383274666 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1625659811 0 0) 0x7ff74c155670 con 0x7ff72c0058c0 2024-03-23T23:54:12.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.265+0000 7ff74be00640 1 -- 172.21.15.8:0/1383274666 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff734003530 con 0x7ff72c0058c0 2024-03-23T23:54:12.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.265+0000 7ff74be00640 1 -- 172.21.15.8:0/1383274666 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 561813759 0 0) 0x7ff734003530 con 0x7ff72c0058c0 2024-03-23T23:54:12.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.265+0000 7ff74be00640 1 -- 172.21.15.8:0/1383274666 >> v2:172.21.15.196:3300/0 conn(0x7ff72c009570 msgr2=0x7ff72c00ba30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:54:12.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.265+0000 7ff74be00640 1 --2- 172.21.15.8:0/1383274666 >> v2:172.21.15.196:3300/0 conn(0x7ff72c009570 0x7ff72c00ba30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:12.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.265+0000 7ff74be00640 1 -- 172.21.15.8:0/1383274666 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72c00d200 con 0x7ff72c0058c0 2024-03-23T23:54:12.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.265+0000 7ff74be00640 1 -- 172.21.15.8:0/1383274666 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7ff744009700 con 0x7ff72c0058c0 2024-03-23T23:54:12.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.265+0000 7ff74be00640 1 -- 172.21.15.8:0/1383274666 >> v1:172.21.15.8:6789/0 conn(0x7ff72c0058c0 legacy=0x7ff72c007d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:12.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.265+0000 7ff74be00640 1 --2- 172.21.15.8:0/1383274666 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff74c152240 0x7ff734003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:12.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.265+0000 7ff74be00640 1 --2- 172.21.15.8:0/1383274666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff734004060 0x7ff734004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:12.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.265+0000 7ff74be00640 1 --2- 172.21.15.8:0/1383274666 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff734004d50 0x7ff7340051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:12.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.265+0000 7ff74be00640 1 -- 172.21.15.8:0/1383274666 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c1550b0 con 0x7ff734004060 2024-03-23T23:54:12.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.265+0000 7ff74be00640 1 -- 172.21.15.8:0/1383274666 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73400bc10 con 0x7ff734004d50 2024-03-23T23:54:12.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.265+0000 7ff74be00640 1 -- 172.21.15.8:0/1383274666 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73400be10 con 0x7ff74c152240 2024-03-23T23:54:12.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.265+0000 7ff752400640 1 -- 172.21.15.8:0/1383274666 reap_dead start 2024-03-23T23:54:12.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.269+0000 7ff752400640 1 --2- 172.21.15.8:0/1383274666 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff734004d50 0x7ff7340051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:12.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.273+0000 7ff751a00640 1 -- 172.21.15.8:0/1383274666 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff74c152240 msgr2=0x7ff734003a30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:54:12.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.273+0000 7ff751a00640 1 --2- 172.21.15.8:0/1383274666 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff74c152240 0x7ff734003a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:54:12.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.273+0000 7ff751000640 1 --2- 172.21.15.8:0/1383274666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff734004060 0x7ff734004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:12.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.281+0000 7ff751000640 1 -- 172.21.15.8:0/1383274666 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff74c152240 msgr2=0x7ff734003a30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:54:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.281+0000 7ff751000640 1 --2- 172.21.15.8:0/1383274666 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff74c152240 0x7ff734003a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.281+0000 7ff751000640 1 -- 172.21.15.8:0/1383274666 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff734004d50 msgr2=0x7ff7340051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:54:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.281+0000 7ff751000640 1 --2- 172.21.15.8:0/1383274666 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff734004d50 0x7ff7340051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.281+0000 7ff751000640 1 -- 172.21.15.8:0/1383274666 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72c00d200 con 0x7ff734004060 2024-03-23T23:54:12.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.285+0000 7ff751000640 1 --2- 172.21.15.8:0/1383274666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff734004060 0x7ff734004810 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff72c00c030 tx=0x7ff740020df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a07ba185a78adb6 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:12.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.285+0000 7ff74be00640 1 -- 172.21.15.8:0/1383274666 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7400013c0 con 0x7ff734004060 2024-03-23T23:54:12.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.285+0000 7ff74be00640 1 -- 172.21.15.8:0/1383274666 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7400050d0 con 0x7ff734004060 2024-03-23T23:54:12.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.289+0000 7ff754400640 1 -- 172.21.15.8:0/1383274666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff734004060 msgr2=0x7ff734004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:12.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.289+0000 7ff754400640 1 --2- 172.21.15.8:0/1383274666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff734004060 0x7ff734004810 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff72c00c030 tx=0x7ff740020df0 comp rx=0 tx=0).stop 2024-03-23T23:54:12.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.289+0000 7ff754400640 1 -- 172.21.15.8:0/1383274666 shutdown_connections 2024-03-23T23:54:12.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.289+0000 7ff754400640 1 --2- 172.21.15.8:0/1383274666 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff734004d50 0x7ff7340051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:12.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.289+0000 7ff754400640 1 --2- 172.21.15.8:0/1383274666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff734004060 0x7ff734004810 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:12.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.289+0000 7ff754400640 1 --2- 172.21.15.8:0/1383274666 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff74c152240 0x7ff734003a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:12.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.289+0000 7ff754400640 1 -- 172.21.15.8:0/1383274666 >> 172.21.15.8:0/1383274666 conn(0x7ff74c06b170 msgr2=0x7ff74c06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:54:12.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.289+0000 7ff754400640 1 -- 172.21.15.8:0/1383274666 shutdown_connections 2024-03-23T23:54:12.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.289+0000 7ff754400640 1 -- 172.21.15.8:0/1383274666 wait complete. 2024-03-23T23:54:12.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.289+0000 7ff754400640 1 Processor -- start 2024-03-23T23:54:12.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.293+0000 7ff754400640 1 -- start start 2024-03-23T23:54:12.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.293+0000 7ff754400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff734004060 0x7ff74c1504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:12.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.293+0000 7ff751a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff734004060 0x7ff74c1504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:12.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.293+0000 7ff751a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff734004060 0x7ff74c1504e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38528/0 (socket says 172.21.15.8:38528) 2024-03-23T23:54:12.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.293+0000 7ff751a00640 1 -- 172.21.15.8:0/4051676896 learned_addr learned my addr 172.21.15.8:0/4051676896 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:54:12.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.293+0000 7ff754400640 1 --2- 172.21.15.8:0/4051676896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff734004d50 0x7ff74c146050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:12.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.293+0000 7ff754400640 1 --2- 172.21.15.8:0/4051676896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff74c152240 0x7ff74c146590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:12.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.293+0000 7ff751000640 1 -- 172.21.15.8:0/4051676896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff734004d50 msgr2=0x7ff74c146050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:54:12.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.293+0000 7ff751000640 1 --2- 172.21.15.8:0/4051676896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff734004d50 0x7ff74c146050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:54:12.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.293+0000 7ff754400640 1 -- 172.21.15.8:0/4051676896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c0c43c0 con 0x7ff734004060 2024-03-23T23:54:12.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.293+0000 7ff754400640 1 -- 172.21.15.8:0/4051676896 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c0c4240 con 0x7ff74c152240 2024-03-23T23:54:12.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.293+0000 7ff754400640 1 -- 172.21.15.8:0/4051676896 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c14b5a0 con 0x7ff734004d50 2024-03-23T23:54:12.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.293+0000 7ff752400640 1 --2- 172.21.15.8:0/4051676896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff74c152240 0x7ff74c146590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:12.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.293+0000 7ff751a00640 1 -- 172.21.15.8:0/4051676896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff734004d50 msgr2=0x7ff74c146050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:54:12.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.293+0000 7ff751a00640 1 --2- 172.21.15.8:0/4051676896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff734004d50 0x7ff74c146050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:12.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.293+0000 7ff751a00640 1 -- 172.21.15.8:0/4051676896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff74c152240 msgr2=0x7ff74c146590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:12.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.293+0000 7ff751a00640 1 --2- 172.21.15.8:0/4051676896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff74c152240 0x7ff74c146590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:12.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.293+0000 7ff751a00640 1 -- 172.21.15.8:0/4051676896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff74c14e1a0 con 0x7ff734004060 2024-03-23T23:54:12.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.293+0000 7ff752400640 1 --2- 172.21.15.8:0/4051676896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff74c152240 0x7ff74c146590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:54:12.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.297+0000 7ff751a00640 1 --2- 172.21.15.8:0/4051676896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff734004060 0x7ff74c1504e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff744012cf0 tx=0x7ff7440075c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:12.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.297+0000 7ff749600640 1 -- 172.21.15.8:0/4051676896 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff744003ba0 con 0x7ff734004060 2024-03-23T23:54:12.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.297+0000 7ff749600640 1 -- 172.21.15.8:0/4051676896 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff744003d40 con 0x7ff734004060 2024-03-23T23:54:12.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.297+0000 7ff754400640 1 -- 172.21.15.8:0/4051676896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff74c14bea0 con 0x7ff734004060 2024-03-23T23:54:12.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.297+0000 7ff754400640 1 -- 172.21.15.8:0/4051676896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff74c0c7ec0 con 0x7ff734004060 2024-03-23T23:54:12.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.301+0000 7ff749600640 1 -- 172.21.15.8:0/4051676896 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff744009b60 con 0x7ff734004060 2024-03-23T23:54:12.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.305+0000 7ff749600640 1 -- 172.21.15.8:0/4051676896 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff744009d00 con 0x7ff734004060 2024-03-23T23:54:12.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.305+0000 7ff749600640 1 --2- 172.21.15.8:0/4051676896 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff72c0682a0 0x7ff72c06a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:12.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.305+0000 7ff749600640 1 -- 172.21.15.8:0/4051676896 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7ff744086930 con 0x7ff734004060 2024-03-23T23:54:12.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.305+0000 7ff751000640 1 --2- 172.21.15.8:0/4051676896 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff72c0682a0 0x7ff72c06a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:12.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.305+0000 7ff751000640 1 --2- 172.21.15.8:0/4051676896 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff72c0682a0 0x7ff72c06a760 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff7400b2000 tx=0x7ff740001130 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:12.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.309+0000 7ff754400640 1 -- 172.21.15.8:0/4051676896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff74c04f480 con 0x7ff734004060 2024-03-23T23:54:12.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.321+0000 7ff749600640 1 -- 172.21.15.8:0/4051676896 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7ff74401a020 con 0x7ff734004060 2024-03-23T23:54:12.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.833+0000 7ff754400640 1 -- 172.21.15.8:0/4051676896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff74c0c37b0 con 0x7ff734004060 2024-03-23T23:54:12.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.833+0000 7ff749600640 1 -- 172.21.15.8:0/4051676896 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1554 (secure 0 0 0) 0x7ff744084e20 con 0x7ff734004060 2024-03-23T23:54:12.839 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":94,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:54:12.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.837+0000 7ff754400640 1 -- 172.21.15.8:0/4051676896 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff72c0682a0 msgr2=0x7ff72c06a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:12.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.841+0000 7ff754400640 1 --2- 172.21.15.8:0/4051676896 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff72c0682a0 0x7ff72c06a760 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff7400b2000 tx=0x7ff740001130 comp rx=0 tx=0).stop 2024-03-23T23:54:12.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.841+0000 7ff754400640 1 -- 172.21.15.8:0/4051676896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff734004060 msgr2=0x7ff74c1504e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:12.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.841+0000 7ff754400640 1 --2- 172.21.15.8:0/4051676896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff734004060 0x7ff74c1504e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff744012cf0 tx=0x7ff7440075c0 comp rx=0 tx=0).stop 2024-03-23T23:54:12.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.841+0000 7ff754400640 1 -- 172.21.15.8:0/4051676896 shutdown_connections 2024-03-23T23:54:12.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.841+0000 7ff754400640 1 --2- 172.21.15.8:0/4051676896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff74c152240 0x7ff74c146590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:12.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.841+0000 7ff754400640 1 --2- 172.21.15.8:0/4051676896 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff72c0682a0 0x7ff72c06a760 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:12.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.841+0000 7ff754400640 1 --2- 172.21.15.8:0/4051676896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff734004d50 0x7ff74c146050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:12.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.841+0000 7ff754400640 1 --2- 172.21.15.8:0/4051676896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff734004060 0x7ff74c1504e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:12.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.841+0000 7ff754400640 1 -- 172.21.15.8:0/4051676896 >> 172.21.15.8:0/4051676896 conn(0x7ff74c06b170 msgr2=0x7ff74c0c22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:54:12.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.849+0000 7ff754400640 1 -- 172.21.15.8:0/4051676896 shutdown_connections 2024-03-23T23:54:12.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:12.849+0000 7ff754400640 1 -- 172.21.15.8:0/4051676896 wait complete. 2024-03-23T23:54:12.958 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-03-23T23:54:12.958 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-03-23T23:54:12.959 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:54:13.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.285+0000 7f6cce000640 1 Processor -- start 2024-03-23T23:54:13.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.285+0000 7f6cce000640 1 -- start start 2024-03-23T23:54:13.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.289+0000 7f6cce000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6cc80c4060 0x7f6cc8156de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:13.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.289+0000 7f6cce000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6cc8159df0 0x7f6cc815a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:13.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.289+0000 7f6cc7400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6cc80c4060 0x7f6cc8156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:13.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.289+0000 7f6cc7400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6cc80c4060 0x7f6cc8156de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33936/0 (socket says 172.21.15.8:33936) 2024-03-23T23:54:13.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.289+0000 7f6cc6a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f6cc8071680 0x7f6cc8157320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:58554/0 (socket says 172.21.15.8:58554) 2024-03-23T23:54:13.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.297+0000 7f6cc7e00640 1 -- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6cc8159df0 msgr2=0x7f6cc815a280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:54:13.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.297+0000 7f6cc7e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6cc8159df0 0x7f6cc815a280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:54:13.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.297+0000 7f6cce000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cc8073040 con 0x7f6cc8071680 2024-03-23T23:54:13.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.297+0000 7f6cce000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cc80c1b00 con 0x7f6cc80c4060 2024-03-23T23:54:13.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.297+0000 7f6cce000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc80c1de0 con 0x7f6cc8159df0 2024-03-23T23:54:13.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.301+0000 7f6cc7400640 1 -- 172.21.15.8:0/908932333 learned_addr learned my addr 172.21.15.8:0/908932333 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:54:13.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.301+0000 7f6cc7400640 1 -- 172.21.15.8:0/908932333 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6cc8159df0 msgr2=0x7f6cc815a280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:54:13.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.301+0000 7f6cc7400640 1 --2- 172.21.15.8:0/908932333 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6cc8159df0 0x7f6cc815a280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:13.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.301+0000 7f6cc7400640 1 -- 172.21.15.8:0/908932333 >> v1:172.21.15.8:6789/0 conn(0x7f6cc8071680 legacy=0x7f6cc8157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:54:13.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.301+0000 7f6cc7400640 1 -- 172.21.15.8:0/908932333 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc80c20c0 con 0x7f6cc80c4060 2024-03-23T23:54:13.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.313+0000 7f6cc7400640 1 --2- 172.21.15.8:0/908932333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc80c4060 0x7f6cc8156de0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0009e50 tx=0x7f6cc001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca90fe92c031ee1e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:13.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.313+0000 7f6cc6000640 1 -- 172.21.15.8:0/908932333 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc00a5620 con 0x7f6cc80c4060 2024-03-23T23:54:13.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.313+0000 7f6cc6000640 1 -- 172.21.15.8:0/908932333 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc00a57c0 con 0x7f6cc80c4060 2024-03-23T23:54:13.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.313+0000 7f6cc6000640 1 -- 172.21.15.8:0/908932333 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc00a5b90 con 0x7f6cc80c4060 2024-03-23T23:54:13.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.317+0000 7f6cce000640 1 -- 172.21.15.8:0/908932333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc80c4060 msgr2=0x7f6cc8156de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:13.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.317+0000 7f6cce000640 1 --2- 172.21.15.8:0/908932333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc80c4060 0x7f6cc8156de0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0009e50 tx=0x7f6cc001c980 comp rx=0 tx=0).stop 2024-03-23T23:54:13.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.317+0000 7f6cce000640 1 -- 172.21.15.8:0/908932333 shutdown_connections 2024-03-23T23:54:13.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.317+0000 7f6cce000640 1 --2- 172.21.15.8:0/908932333 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6cc8159df0 0x7f6cc815a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:13.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.317+0000 7f6cce000640 1 --2- 172.21.15.8:0/908932333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc80c4060 0x7f6cc8156de0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:13.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.317+0000 7f6cce000640 1 -- 172.21.15.8:0/908932333 >> 172.21.15.8:0/908932333 conn(0x7f6cc806b170 msgr2=0x7f6cc806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:54:13.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.317+0000 7f6cce000640 1 -- 172.21.15.8:0/908932333 shutdown_connections 2024-03-23T23:54:13.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.317+0000 7f6cce000640 1 -- 172.21.15.8:0/908932333 wait complete. 2024-03-23T23:54:13.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.329+0000 7f6cce000640 1 Processor -- start 2024-03-23T23:54:13.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.333+0000 7f6cce000640 1 -- start start 2024-03-23T23:54:13.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.333+0000 7f6cce000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6cc8071680 0x7f6cc81ff040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:13.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.333+0000 7f6cce000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6cc80c4060 0x7f6cc814f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:13.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.333+0000 7f6cce000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc8159df0 0x7f6cc81fb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:13.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.333+0000 7f6cc7400640 1 -- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6cc8071680 msgr2=0x7f6cc81ff040 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:54:13.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.333+0000 7f6cc7400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6cc8071680 0x7f6cc81ff040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:54:13.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.333+0000 7f6cc6a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6cc80c4060 0x7f6cc814f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:13.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.333+0000 7f6cc6a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6cc80c4060 0x7f6cc814f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:53314/0 (socket says 172.21.15.8:53314) 2024-03-23T23:54:13.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.337+0000 7f6cc6a00640 1 -- 172.21.15.8:0/1661926894 learned_addr learned my addr 172.21.15.8:0/1661926894 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:54:13.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.337+0000 7f6cc7e00640 1 --2- 172.21.15.8:0/1661926894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc8159df0 0x7f6cc81fb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:13.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.337+0000 7f6cce000640 1 -- 172.21.15.8:0/1661926894 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc80c45c0 con 0x7f6cc8159df0 2024-03-23T23:54:13.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.337+0000 7f6cce000640 1 -- 172.21.15.8:0/1661926894 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc80c4440 con 0x7f6cc80c4060 2024-03-23T23:54:13.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.337+0000 7f6cce000640 1 -- 172.21.15.8:0/1661926894 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc8166d50 con 0x7f6cc8071680 2024-03-23T23:54:13.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.337+0000 7f6cc7e00640 1 -- 172.21.15.8:0/1661926894 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6cc8071680 msgr2=0x7f6cc81ff040 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:54:13.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.337+0000 7f6cc7e00640 1 --2- 172.21.15.8:0/1661926894 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6cc8071680 0x7f6cc81ff040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:13.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.337+0000 7f6cc7e00640 1 -- 172.21.15.8:0/1661926894 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6cc80c4060 msgr2=0x7f6cc814f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:13.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.337+0000 7f6cc7e00640 1 --2- 172.21.15.8:0/1661926894 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6cc80c4060 0x7f6cc814f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:13.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.337+0000 7f6cc7e00640 1 -- 172.21.15.8:0/1661926894 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc81ff580 con 0x7f6cc8159df0 2024-03-23T23:54:13.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.337+0000 7f6cc7e00640 1 --2- 172.21.15.8:0/1661926894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc8159df0 0x7f6cc81fb7b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6cb800b410 tx=0x7f6cb800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:13.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.341+0000 7f6cbf400640 1 -- 172.21.15.8:0/1661926894 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8017070 con 0x7f6cc8159df0 2024-03-23T23:54:13.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.341+0000 7f6cce000640 1 -- 172.21.15.8:0/1661926894 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cc8159230 con 0x7f6cc8159df0 2024-03-23T23:54:13.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.341+0000 7f6cbf400640 1 -- 172.21.15.8:0/1661926894 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb8003d80 con 0x7f6cc8159df0 2024-03-23T23:54:13.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.341+0000 7f6cbf400640 1 -- 172.21.15.8:0/1661926894 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8006310 con 0x7f6cc8159df0 2024-03-23T23:54:13.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.341+0000 7f6cce000640 1 -- 172.21.15.8:0/1661926894 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc81597f0 con 0x7f6cc8159df0 2024-03-23T23:54:13.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.349+0000 7f6cce000640 1 --2- 172.21.15.8:0/1661926894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca0002a80 0x7f6ca0004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:13.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.349+0000 7f6cce000640 1 -- 172.21.15.8:0/1661926894 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca0007ed0 con 0x7f6ca0002a80 2024-03-23T23:54:13.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.349+0000 7f6cc7400640 1 --2- 172.21.15.8:0/1661926894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca0002a80 0x7f6ca0004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:13.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.349+0000 7f6cbf400640 1 -- 172.21.15.8:0/1661926894 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f6cb80064b0 con 0x7f6cc8159df0 2024-03-23T23:54:13.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.349+0000 7f6cbf400640 1 --2- 172.21.15.8:0/1661926894 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6ca8067610 0x7f6ca8069ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:13.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.349+0000 7f6cbf400640 1 -- 172.21.15.8:0/1661926894 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f6cb8084ce0 con 0x7f6cc8159df0 2024-03-23T23:54:13.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.353+0000 7f6cc7400640 1 -- 172.21.15.8:0/1661926894 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6ca00080d0 con 0x7f6ca0002a80 2024-03-23T23:54:13.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.353+0000 7f6cc6a00640 1 --2- 172.21.15.8:0/1661926894 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6ca8067610 0x7f6ca8069ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:13.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.357+0000 7f6cc6a00640 1 --2- 172.21.15.8:0/1661926894 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6ca8067610 0x7f6ca8069ad0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4007fd0 tx=0x7f6cb4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:13.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.357+0000 7f6cc7400640 1 --2- 172.21.15.8:0/1661926894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca0002a80 0x7f6ca0004f40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8070c20 tx=0x7f6cc0019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:13.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.357+0000 7f6cbf400640 1 -- 172.21.15.8:0/1661926894 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc00039a0 con 0x7f6ca0002a80 2024-03-23T23:54:13.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.357+0000 7f6cbf400640 1 -- 172.21.15.8:0/1661926894 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f6cc0003b40 con 0x7f6ca0002a80 2024-03-23T23:54:13.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.357+0000 7f6cbf400640 1 -- 172.21.15.8:0/1661926894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca0002a80 msgr2=0x7f6ca0004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:13.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.357+0000 7f6cbf400640 1 --2- 172.21.15.8:0/1661926894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca0002a80 0x7f6ca0004f40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8070c20 tx=0x7f6cc0019720 comp rx=0 tx=0).stop 2024-03-23T23:54:13.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.357+0000 7f6cbf400640 1 -- 172.21.15.8:0/1661926894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca0002a80 msgr2=0x7f6ca0004f40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:54:13.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.357+0000 7f6cbf400640 1 --2- 172.21.15.8:0/1661926894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca0002a80 0x7f6ca0004f40 secure :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8070c20 tx=0x7f6cc0019720 comp rx=0 tx=0).stop 2024-03-23T23:54:13.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.397+0000 7f6cce000640 1 --2- 172.21.15.8:0/1661926894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca0006f10 0x7f6ca00073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:13.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.397+0000 7f6cce000640 1 -- 172.21.15.8:0/1661926894 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca000a4b0 con 0x7f6ca0006f10 2024-03-23T23:54:13.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.401+0000 7f6cc7400640 1 --2- 172.21.15.8:0/1661926894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca0006f10 0x7f6ca00073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:13.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.401+0000 7f6cc7400640 1 -- 172.21.15.8:0/1661926894 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6ca00078e0 con 0x7f6ca0006f10 2024-03-23T23:54:13.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.401+0000 7f6cc7400640 1 --2- 172.21.15.8:0/1661926894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca0006f10 0x7f6ca00073a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6cc001d220 tx=0x7f6cc0009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:13.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.401+0000 7f6cbf400640 1 -- 172.21.15.8:0/1661926894 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc00039a0 con 0x7f6ca0006f10 2024-03-23T23:54:13.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.405+0000 7f6cbf400640 1 -- 172.21.15.8:0/1661926894 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5173 (secure 0 0 0) 0x7f6cc00b9470 con 0x7f6ca0006f10 2024-03-23T23:54:13.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.405+0000 7f6cbf400640 1 -- 172.21.15.8:0/1661926894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca0006f10 msgr2=0x7f6ca00073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:13.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.405+0000 7f6cbf400640 1 --2- 172.21.15.8:0/1661926894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca0006f10 0x7f6ca00073a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6cc001d220 tx=0x7f6cc0009810 comp rx=0 tx=0).stop 2024-03-23T23:54:13.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.405+0000 7f6cbf400640 1 -- 172.21.15.8:0/1661926894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca0006f10 msgr2=0x7f6ca00073a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:54:13.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.405+0000 7f6cbf400640 1 --2- 172.21.15.8:0/1661926894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca0006f10 0x7f6ca00073a0 secure :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6cc001d220 tx=0x7f6cc0009810 comp rx=0 tx=0).stop 2024-03-23T23:54:13.406 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:54:13.406 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:54:13.407 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:54:13.407 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:54:13.407 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 94, 2024-03-23T23:54:13.407 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:54:13.407 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:54:13.407 INFO:teuthology.orchestra.run.smithi008.stdout: 1 2024-03-23T23:54:13.407 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:54:13.407 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 1, 2024-03-23T23:54:13.407 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:54:13.407 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:54:13.407 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:54:13.407 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:54:13.407 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:54:13.408 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:54:13.408 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:54:13.408 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:54:13.408 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:54:13.408 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:54:13.408 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:54:13.408 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:54:13.408 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:54:13.408 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:54:13.408 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:54:13.408 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:54:13.408 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:54:13.408 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:54:13.409 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:54:13.409 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:54:13.409 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:54:13.409 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:54:13.409 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:54:13.409 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:54:13.409 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:54:13.409 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:54:13.409 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:54:13.409 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:54:13.410 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:54:13.410 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:13.410 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:54:13.410 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:54:13.410 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:54:13.410 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:54:13.410 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:54:13.411 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:54:13.411 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:54:13.411 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:54:13.411 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:54:13.411 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:54:13.411 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:54:13.411 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:54:13.412 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:54:13.412 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:54:13.412 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:54:13.412 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:54:13.413 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:54:13.413 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:54:13.413 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:54:13.413 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:54:13.414 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:54:13.414 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:54:13.414 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:54:13.414 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:54:13.414 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:54:13.414 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:54:13.414 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:54:13.415 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:54:13.415 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:54:13.415 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:54:13.415 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:13.415 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:54:13.415 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:13.415 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:54:13.415 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:54:13.415 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:54:13.416 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:54:13.416 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:13.416 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:54:13.416 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:54:13.416 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:54:13.416 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:13.416 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:13.416 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:54:13.416 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:54:13.416 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:54:13.417 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:13.417 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:54:13.417 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:13.417 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:54:13.417 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:54:13.417 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:54:13.417 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:54:13.417 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:54:13.417 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:13.418 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:13.418 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:54:13.418 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:54:13.418 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:54:13.418 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:54:13.418 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:13.418 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:54:13.418 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:54:13.418 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:54:13.418 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:13.418 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:13.418 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:54:13.419 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:54:13.419 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:54:13.419 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:13.419 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:54:13.419 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:13.419 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:54:13.419 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:54:13.419 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:54:13.419 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:54:13.419 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:54:13.419 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:13.419 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:13.419 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:54:13.420 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:54:13.420 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:54:13.420 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:54:13.420 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:13.420 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:54:13.420 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:54:13.420 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:54:13.421 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:13.421 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:13.421 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:54:13.421 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:54:13.421 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:54:13.421 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:13.421 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:54:13.421 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:13.421 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:54:13.421 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:54:13.421 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:54:13.422 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:54:13.422 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:54:13.422 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:13.422 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:54:13.422 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:13.422 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:54:13.422 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:54:13.422 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:13.422 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:54:13.422 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:54:13.422 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:54:13.423 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:13.423 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:54:13.423 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:54:13.423 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:13.423 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:54:13.423 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:54:13.423 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:54:13.424 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:13.424 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:54:13.424 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:54:13.424 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:13.424 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:54:13.424 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:54:13.424 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 8 2024-03-23T23:54:13.424 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:13.424 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:54:13.424 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:54:13.424 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:13.424 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:54:13.424 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:54:13.424 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:54:13.425 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:13.425 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:13.425 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:54:13.425 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:54:13.425 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 6 2024-03-23T23:54:13.425 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:13.425 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:54:13.425 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:54:13.425 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:13.425 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:54:13.425 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:54:13.425 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:54:13.425 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:13.426 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:54:13.426 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:13.426 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:54:13.426 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:54:13.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.405+0000 7f6cce000640 1 -- 172.21.15.8:0/1661926894 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6ca8067610 msgr2=0x7f6ca8069ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:13.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.405+0000 7f6cce000640 1 --2- 172.21.15.8:0/1661926894 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6ca8067610 0x7f6ca8069ad0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4007fd0 tx=0x7f6cb4009040 comp rx=0 tx=0).stop 2024-03-23T23:54:13.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.405+0000 7f6cce000640 1 -- 172.21.15.8:0/1661926894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc8159df0 msgr2=0x7f6cc81fb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:13.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.405+0000 7f6cce000640 1 --2- 172.21.15.8:0/1661926894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc8159df0 0x7f6cc81fb7b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6cb800b410 tx=0x7f6cb800b8d0 comp rx=0 tx=0).stop 2024-03-23T23:54:13.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.409+0000 7f6cc7e00640 1 -- 172.21.15.8:0/1661926894 reap_dead start 2024-03-23T23:54:13.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.409+0000 7f6cc7e00640 1 -- 172.21.15.8:0/1661926894 reap_dead start 2024-03-23T23:54:13.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.409+0000 7f6cce000640 1 -- 172.21.15.8:0/1661926894 shutdown_connections 2024-03-23T23:54:13.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.413+0000 7f6cce000640 1 -- 172.21.15.8:0/1661926894 >> 172.21.15.8:0/1661926894 conn(0x7f6cc806b170 msgr2=0x7f6cc806e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:54:13.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.417+0000 7f6cce000640 1 -- 172.21.15.8:0/1661926894 shutdown_connections 2024-03-23T23:54:13.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.417+0000 7f6cce000640 1 -- 172.21.15.8:0/1661926894 wait complete. 2024-03-23T23:54:13.454 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T23:54:13.454 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-03-23T23:54:13.454 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:54:13.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.689+0000 7f3e3f000640 1 Processor -- start 2024-03-23T23:54:13.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.693+0000 7f3e3f000640 1 -- start start 2024-03-23T23:54:13.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.693+0000 7f3e3f000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3e3806dcd0 0x7f3e3806e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:13.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.693+0000 7f3e3f000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3e380c3760 0x7f3e38072030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:13.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.693+0000 7f3e3f000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e380c0fa0 con 0x7f3e38073050 2024-03-23T23:54:13.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.693+0000 7f3e3f000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e380c2da0 con 0x7f3e3806dcd0 2024-03-23T23:54:13.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.693+0000 7f3e3f000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3806cf20 con 0x7f3e380c3760 2024-03-23T23:54:13.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.693+0000 7f3e3dc00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3e3806dcd0 0x7f3e3806e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:13.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.693+0000 7f3e3dc00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3e3806dcd0 0x7f3e3806e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33964/0 (socket says 172.21.15.8:33964) 2024-03-23T23:54:13.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.693+0000 7f3e3dc00640 1 -- 172.21.15.8:0/1686101932 learned_addr learned my addr 172.21.15.8:0/1686101932 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:54:13.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.693+0000 7f3e3dc00640 1 -- 172.21.15.8:0/1686101932 >> v2:172.21.15.196:3300/0 conn(0x7f3e380c3760 msgr2=0x7f3e38072030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:54:13.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.693+0000 7f3e3dc00640 1 --2- 172.21.15.8:0/1686101932 >> v2:172.21.15.196:3300/0 conn(0x7f3e380c3760 0x7f3e38072030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:13.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.693+0000 7f3e3dc00640 1 -- 172.21.15.8:0/1686101932 >> v1:172.21.15.196:6789/0 conn(0x7f3e38073050 legacy=0x7f3e38071920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:54:13.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.693+0000 7f3e3dc00640 1 -- 172.21.15.8:0/1686101932 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3806d200 con 0x7f3e3806dcd0 2024-03-23T23:54:13.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.697+0000 7f3e3dc00640 1 --2- 172.21.15.8:0/1686101932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e3806dcd0 0x7f3e3806e0b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3e3806f4c0 tx=0x7f3e2c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7233ee1795da96ae server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:13.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.697+0000 7f3e37e00640 1 -- 172.21.15.8:0/1686101932 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c0b0070 con 0x7f3e3806dcd0 2024-03-23T23:54:13.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.697+0000 7f3e37e00640 1 -- 172.21.15.8:0/1686101932 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2c0ab600 con 0x7f3e3806dcd0 2024-03-23T23:54:13.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.697+0000 7f3e37e00640 1 -- 172.21.15.8:0/1686101932 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c0ab9d0 con 0x7f3e3806dcd0 2024-03-23T23:54:13.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.701+0000 7f3e3f000640 1 -- 172.21.15.8:0/1686101932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e3806dcd0 msgr2=0x7f3e3806e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:13.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.701+0000 7f3e3f000640 1 --2- 172.21.15.8:0/1686101932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e3806dcd0 0x7f3e3806e0b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3e3806f4c0 tx=0x7f3e2c01c450 comp rx=0 tx=0).stop 2024-03-23T23:54:13.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.701+0000 7f3e3f000640 1 -- 172.21.15.8:0/1686101932 shutdown_connections 2024-03-23T23:54:13.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.701+0000 7f3e3f000640 1 --2- 172.21.15.8:0/1686101932 >> v2:172.21.15.196:3300/0 conn(0x7f3e380c3760 0x7f3e38072030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:13.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.701+0000 7f3e3f000640 1 --2- 172.21.15.8:0/1686101932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e3806dcd0 0x7f3e3806e0b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:13.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.701+0000 7f3e3f000640 1 -- 172.21.15.8:0/1686101932 >> 172.21.15.8:0/1686101932 conn(0x7f3e3806b170 msgr2=0x7f3e3806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:54:13.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.701+0000 7f3e3f000640 1 -- 172.21.15.8:0/1686101932 shutdown_connections 2024-03-23T23:54:13.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.701+0000 7f3e3f000640 1 -- 172.21.15.8:0/1686101932 wait complete. 2024-03-23T23:54:13.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.701+0000 7f3e3f000640 1 Processor -- start 2024-03-23T23:54:13.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.701+0000 7f3e3f000640 1 -- start start 2024-03-23T23:54:13.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.705+0000 7f3e3f000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e3806dcd0 0x7f3e380ac060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:13.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.705+0000 7f3e3f000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e38073050 0x7f3e380ac5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:13.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.705+0000 7f3e3f000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e380c3760 0x7f3e38156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:13.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.705+0000 7f3e3f000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e380c1580 con 0x7f3e380c3760 2024-03-23T23:54:13.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.705+0000 7f3e3f000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e380c1400 con 0x7f3e3806dcd0 2024-03-23T23:54:13.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.705+0000 7f3e3f000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e38162780 con 0x7f3e38073050 2024-03-23T23:54:13.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.705+0000 7f3e3d200640 1 -- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e38073050 msgr2=0x7f3e380ac5a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:54:13.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.705+0000 7f3e3e600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e380c3760 0x7f3e38156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:13.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.705+0000 7f3e3d200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e38073050 0x7f3e380ac5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:54:13.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.705+0000 7f3e3e600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e380c3760 0x7f3e38156d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33968/0 (socket says 172.21.15.8:33968) 2024-03-23T23:54:13.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.705+0000 7f3e3e600640 1 -- 172.21.15.8:0/1821538331 learned_addr learned my addr 172.21.15.8:0/1821538331 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:54:13.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.705+0000 7f3e3e600640 1 -- 172.21.15.8:0/1821538331 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e38073050 msgr2=0x7f3e380ac5a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:54:13.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.705+0000 7f3e3e600640 1 --2- 172.21.15.8:0/1821538331 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e38073050 0x7f3e380ac5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:13.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.705+0000 7f3e3e600640 1 -- 172.21.15.8:0/1821538331 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e3806dcd0 msgr2=0x7f3e380ac060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:13.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.705+0000 7f3e3e600640 1 --2- 172.21.15.8:0/1821538331 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e3806dcd0 0x7f3e380ac060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:13.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.705+0000 7f3e3e600640 1 -- 172.21.15.8:0/1821538331 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e380acfa0 con 0x7f3e380c3760 2024-03-23T23:54:13.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.705+0000 7f3e3e600640 1 --2- 172.21.15.8:0/1821538331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e380c3760 0x7f3e38156d60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3e3000b9e0 tx=0x7f3e3000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:13.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.705+0000 7f3e35600640 1 -- 172.21.15.8:0/1821538331 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e30019070 con 0x7f3e380c3760 2024-03-23T23:54:13.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.705+0000 7f3e35600640 1 -- 172.21.15.8:0/1821538331 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3000cb20 con 0x7f3e380c3760 2024-03-23T23:54:13.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.705+0000 7f3e35600640 1 -- 172.21.15.8:0/1821538331 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e30014440 con 0x7f3e380c3760 2024-03-23T23:54:13.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.705+0000 7f3e3f000640 1 -- 172.21.15.8:0/1821538331 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e3815f930 con 0x7f3e380c3760 2024-03-23T23:54:13.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.705+0000 7f3e3f000640 1 -- 172.21.15.8:0/1821538331 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e380accc0 con 0x7f3e380c3760 2024-03-23T23:54:13.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.709+0000 7f3e3f000640 1 --2- 172.21.15.8:0/1821538331 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e38158780 0x7f3e381572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:13.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.709+0000 7f3e3f000640 1 -- 172.21.15.8:0/1821538331 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e38156a80 con 0x7f3e38158780 2024-03-23T23:54:13.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.709+0000 7f3e35600640 1 -- 172.21.15.8:0/1821538331 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3e3001c070 con 0x7f3e380c3760 2024-03-23T23:54:13.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.709+0000 7f3e3dc00640 1 --2- 172.21.15.8:0/1821538331 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e38158780 0x7f3e381572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:13.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.709+0000 7f3e35600640 1 --2- 172.21.15.8:0/1821538331 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3e18067660 0x7f3e18069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:13.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.709+0000 7f3e35600640 1 -- 172.21.15.8:0/1821538331 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f3e300858f0 con 0x7f3e380c3760 2024-03-23T23:54:13.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.709+0000 7f3e3dc00640 1 -- 172.21.15.8:0/1821538331 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3e3804f410 con 0x7f3e38158780 2024-03-23T23:54:13.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.709+0000 7f3e3d200640 1 --2- 172.21.15.8:0/1821538331 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3e18067660 0x7f3e18069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:13.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.709+0000 7f3e3dc00640 1 --2- 172.21.15.8:0/1821538331 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e38158780 0x7f3e381572a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3e380c8130 tx=0x7f3e2c0abac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:13.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.713+0000 7f3e3d200640 1 --2- 172.21.15.8:0/1821538331 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3e18067660 0x7f3e18069b20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3e38151e50 tx=0x7f3e24007a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:13.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.713+0000 7f3e35600640 1 -- 172.21.15.8:0/1821538331 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c0b9020 con 0x7f3e38158780 2024-03-23T23:54:13.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.713+0000 7f3e35600640 1 -- 172.21.15.8:0/1821538331 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f3e2c0b1040 con 0x7f3e38158780 2024-03-23T23:54:13.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.713+0000 7f3e35600640 1 -- 172.21.15.8:0/1821538331 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e38158780 msgr2=0x7f3e381572a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:13.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.713+0000 7f3e35600640 1 --2- 172.21.15.8:0/1821538331 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e38158780 0x7f3e381572a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3e380c8130 tx=0x7f3e2c0abac0 comp rx=0 tx=0).stop 2024-03-23T23:54:13.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.713+0000 7f3e35600640 1 -- 172.21.15.8:0/1821538331 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e38158780 msgr2=0x7f3e381572a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:54:13.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.713+0000 7f3e35600640 1 --2- 172.21.15.8:0/1821538331 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e38158780 0x7f3e381572a0 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3e380c8130 tx=0x7f3e2c0abac0 comp rx=0 tx=0).stop 2024-03-23T23:54:13.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.725+0000 7f3e3f000640 1 --2- 172.21.15.8:0/1821538331 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e381577e0 0x7f3e380aa180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:13.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.725+0000 7f3e3f000640 1 -- 172.21.15.8:0/1821538331 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e380c11e0 con 0x7f3e381577e0 2024-03-23T23:54:13.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.725+0000 7f3e3dc00640 1 --2- 172.21.15.8:0/1821538331 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e381577e0 0x7f3e380aa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:13.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.729+0000 7f3e3dc00640 1 -- 172.21.15.8:0/1821538331 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3e380c2ae0 con 0x7f3e381577e0 2024-03-23T23:54:13.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.729+0000 7f3e3dc00640 1 --2- 172.21.15.8:0/1821538331 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e381577e0 0x7f3e380aa180 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c000c10 tx=0x7f3e2c0a8000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:13.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.729+0000 7f3e35600640 1 -- 172.21.15.8:0/1821538331 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c0b9070 con 0x7f3e381577e0 2024-03-23T23:54:13.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.729+0000 7f3e35600640 1 -- 172.21.15.8:0/1821538331 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4518 (secure 0 0 0) 0x7f3e2c000e50 con 0x7f3e381577e0 2024-03-23T23:54:13.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.729+0000 7f3e35600640 1 -- 172.21.15.8:0/1821538331 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e381577e0 msgr2=0x7f3e380aa180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:13.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.729+0000 7f3e35600640 1 --2- 172.21.15.8:0/1821538331 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e381577e0 0x7f3e380aa180 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c000c10 tx=0x7f3e2c0a8000 comp rx=0 tx=0).stop 2024-03-23T23:54:13.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.729+0000 7f3e35600640 1 -- 172.21.15.8:0/1821538331 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e381577e0 msgr2=0x7f3e380aa180 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:54:13.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.729+0000 7f3e35600640 1 --2- 172.21.15.8:0/1821538331 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e381577e0 0x7f3e380aa180 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c000c10 tx=0x7f3e2c0a8000 comp rx=0 tx=0).stop 2024-03-23T23:54:13.731 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:54:13.731 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:54:13.732 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:54:13.732 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:54:13.732 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 94, 2024-03-23T23:54:13.732 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:54:13.732 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:54:13.732 INFO:teuthology.orchestra.run.smithi008.stdout: 1 2024-03-23T23:54:13.732 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:54:13.732 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 1, 2024-03-23T23:54:13.732 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:54:13.733 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:54:13.733 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:54:13.733 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:54:13.733 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:54:13.733 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:54:13.733 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:54:13.733 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:54:13.733 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:54:13.733 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:54:13.733 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:54:13.733 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:54:13.733 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:54:13.734 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:54:13.734 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:54:13.734 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:54:13.734 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:54:13.734 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:54:13.734 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:54:13.734 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:54:13.734 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:54:13.734 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:54:13.734 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:54:13.734 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:54:13.734 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:54:13.734 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:54:13.734 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:54:13.735 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:54:13.735 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:54:13.735 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:13.735 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:54:13.735 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:54:13.735 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:54:13.735 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:54:13.735 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:54:13.735 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:54:13.735 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:54:13.735 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:54:13.735 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:54:13.735 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:54:13.735 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:54:13.736 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:54:13.736 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:54:13.736 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:54:13.736 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:54:13.736 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:54:13.736 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:54:13.736 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:54:13.736 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:54:13.736 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:54:13.736 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:54:13.736 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:54:13.736 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:54:13.736 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:54:13.737 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:54:13.737 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:54:13.737 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:54:13.737 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:54:13.737 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:54:13.737 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:54:13.737 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:13.737 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:54:13.737 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:13.737 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:54:13.737 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:54:13.737 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:54:13.737 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:54:13.737 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:13.738 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:54:13.738 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:54:13.738 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:54:13.738 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:13.738 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:13.738 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:54:13.738 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:54:13.738 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:54:13.738 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:13.738 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:54:13.738 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:13.738 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:54:13.738 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:54:13.739 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:54:13.739 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:54:13.739 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:54:13.739 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:13.739 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:13.739 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:54:13.739 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:54:13.739 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:54:13.739 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:54:13.739 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:13.739 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:54:13.739 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:54:13.739 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:54:13.739 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:13.740 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:13.740 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:54:13.740 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:54:13.740 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:54:13.740 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:13.740 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:54:13.740 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:13.740 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:54:13.740 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:54:13.740 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:54:13.740 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:54:13.740 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:54:13.740 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:13.741 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:13.741 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:54:13.741 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:54:13.741 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:54:13.741 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:54:13.741 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:13.741 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:54:13.741 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:54:13.741 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:54:13.741 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:13.741 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:13.741 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:54:13.741 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:54:13.741 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:54:13.742 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:13.742 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:54:13.742 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:13.742 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:54:13.742 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:54:13.742 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:54:13.742 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:54:13.742 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:54:13.742 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:13.742 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:54:13.742 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:13.742 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:54:13.742 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:54:13.743 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:13.743 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:54:13.743 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:54:13.743 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:54:13.743 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:13.743 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:54:13.743 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:54:13.743 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:13.743 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:54:13.743 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:54:13.743 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:54:13.743 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:13.743 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:54:13.743 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:13.744 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:54:13.744 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:54:13.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.729+0000 7f3e3f000640 1 -- 172.21.15.8:0/1821538331 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3e18067660 msgr2=0x7f3e18069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:13.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.729+0000 7f3e3f000640 1 --2- 172.21.15.8:0/1821538331 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3e18067660 0x7f3e18069b20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3e38151e50 tx=0x7f3e24007a00 comp rx=0 tx=0).stop 2024-03-23T23:54:13.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.729+0000 7f3e3f000640 1 -- 172.21.15.8:0/1821538331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e380c3760 msgr2=0x7f3e38156d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:13.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.729+0000 7f3e3f000640 1 --2- 172.21.15.8:0/1821538331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e380c3760 0x7f3e38156d60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3e3000b9e0 tx=0x7f3e3000bea0 comp rx=0 tx=0).stop 2024-03-23T23:54:13.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.729+0000 7f3e3e600640 1 -- 172.21.15.8:0/1821538331 reap_dead start 2024-03-23T23:54:13.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.729+0000 7f3e3e600640 1 -- 172.21.15.8:0/1821538331 reap_dead start 2024-03-23T23:54:13.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.729+0000 7f3e3f000640 1 -- 172.21.15.8:0/1821538331 shutdown_connections 2024-03-23T23:54:13.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.729+0000 7f3e3f000640 1 -- 172.21.15.8:0/1821538331 >> 172.21.15.8:0/1821538331 conn(0x7f3e3806b170 msgr2=0x7f3e380c3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:54:13.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.729+0000 7f3e3f000640 1 -- 172.21.15.8:0/1821538331 shutdown_connections 2024-03-23T23:54:13.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:13.729+0000 7f3e3f000640 1 -- 172.21.15.8:0/1821538331 wait complete. 2024-03-23T23:54:13.762 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T23:54:13.762 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-03-23T23:54:16.099 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:54:16.109 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:54:33.763 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-03-23T23:54:33.764 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-03-23T23:54:33.764 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-23T23:54:33.764 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-23T23:54:33.769 INFO:tasks.ceph.mon.c:Started 2024-03-23T23:54:33.770 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T23:54:33.770 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:54:34.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.097+0000 7f11ff200640 1 Processor -- start 2024-03-23T23:54:34.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.097+0000 7f11ff200640 1 -- start start 2024-03-23T23:54:34.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.101+0000 7f11ff200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f11f814ef60 0x7f11f80c3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:34.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.101+0000 7f11ff200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11f8151730 0x7f11f8071990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:34.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.101+0000 7f11ff200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f11f8071ed0 0x7f11f8155350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:34.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.101+0000 7f11fd400640 1 -- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11f8151730 msgr2=0x7f11f8071990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:54:34.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.101+0000 7f11fd400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11f8151730 0x7f11f8071990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:54:34.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.101+0000 7f11ff200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11f8071250 con 0x7f11f8071ed0 2024-03-23T23:54:34.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.101+0000 7f11ff200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11f806e710 con 0x7f11f814ef60 2024-03-23T23:54:34.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.101+0000 7f11ff200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f806e9f0 con 0x7f11f8151730 2024-03-23T23:54:34.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.105+0000 7f11fde00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f11f814ef60 0x7f11f80c3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:34.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.105+0000 7f11fde00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f11f814ef60 0x7f11f80c3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:40528/0 (socket says 172.21.15.8:40528) 2024-03-23T23:54:34.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.105+0000 7f11fde00640 1 -- 172.21.15.8:0/4201420965 learned_addr learned my addr 172.21.15.8:0/4201420965 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:54:34.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.105+0000 7f11fde00640 1 -- 172.21.15.8:0/4201420965 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11f8151730 msgr2=0x7f11f8071990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:54:34.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.105+0000 7f11fde00640 1 --2- 172.21.15.8:0/4201420965 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11f8151730 0x7f11f8071990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:34.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.105+0000 7f11fde00640 1 -- 172.21.15.8:0/4201420965 >> v2:172.21.15.8:3300/0 conn(0x7f11f8071ed0 msgr2=0x7f11f8155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:54:34.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.105+0000 7f11fde00640 1 --2- 172.21.15.8:0/4201420965 >> v2:172.21.15.8:3300/0 conn(0x7f11f8071ed0 0x7f11f8155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:34.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.105+0000 7f11fde00640 1 -- 172.21.15.8:0/4201420965 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f8070f70 con 0x7f11f814ef60 2024-03-23T23:54:34.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.121+0000 7f11fde00640 1 --2- 172.21.15.8:0/4201420965 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11f814ef60 0x7f11f80c3040 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f11f806ff10 tx=0x7f11f4025370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34133f78670bbb0c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:34.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.129+0000 7f11fca00640 1 -- 172.21.15.8:0/4201420965 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f40bb070 con 0x7f11f814ef60 2024-03-23T23:54:34.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.129+0000 7f11fca00640 1 -- 172.21.15.8:0/4201420965 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f40b6410 con 0x7f11f814ef60 2024-03-23T23:54:34.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.129+0000 7f11fca00640 1 -- 172.21.15.8:0/4201420965 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f40bb070 con 0x7f11f814ef60 2024-03-23T23:54:34.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.133+0000 7f11ff200640 1 -- 172.21.15.8:0/4201420965 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11f814ef60 msgr2=0x7f11f80c3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:34.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.133+0000 7f11ff200640 1 --2- 172.21.15.8:0/4201420965 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11f814ef60 0x7f11f80c3040 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f11f806ff10 tx=0x7f11f4025370 comp rx=0 tx=0).stop 2024-03-23T23:54:34.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.137+0000 7f11ff200640 1 -- 172.21.15.8:0/4201420965 shutdown_connections 2024-03-23T23:54:34.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.137+0000 7f11ff200640 1 --2- 172.21.15.8:0/4201420965 >> v2:172.21.15.8:3300/0 conn(0x7f11f8071ed0 0x7f11f8155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:34.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.137+0000 7f11ff200640 1 --2- 172.21.15.8:0/4201420965 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11f8151730 0x7f11f8071990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:34.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.137+0000 7f11ff200640 1 --2- 172.21.15.8:0/4201420965 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11f814ef60 0x7f11f80c3040 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:34.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.137+0000 7f11ff200640 1 -- 172.21.15.8:0/4201420965 >> 172.21.15.8:0/4201420965 conn(0x7f11f80c3610 msgr2=0x7f11f80c3a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:54:34.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.137+0000 7f11ff200640 1 -- 172.21.15.8:0/4201420965 shutdown_connections 2024-03-23T23:54:34.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.137+0000 7f11ff200640 1 -- 172.21.15.8:0/4201420965 wait complete. 2024-03-23T23:54:34.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.145+0000 7f11ff200640 1 Processor -- start 2024-03-23T23:54:34.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.149+0000 7f11ff200640 1 -- start start 2024-03-23T23:54:34.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.157+0000 7f11ff200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11f8071ed0 0x7f11f8148040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:34.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.157+0000 7f11ff200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11f814ef60 0x7f11f8143360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:34.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.157+0000 7f11ff200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11f8151730 0x7f11f81438a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:34.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.157+0000 7f11ff200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f80c1f10 con 0x7f11f8071ed0 2024-03-23T23:54:34.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.157+0000 7f11ff200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f8155ca0 con 0x7f11f8151730 2024-03-23T23:54:34.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.157+0000 7f11ff200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f80c2090 con 0x7f11f814ef60 2024-03-23T23:54:34.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.157+0000 7f11fd400640 1 -- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11f814ef60 msgr2=0x7f11f8143360 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:54:34.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.157+0000 7f11fd400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11f814ef60 0x7f11f8143360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:54:34.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.157+0000 7f11fde00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11f8071ed0 0x7f11f8148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:34.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.157+0000 7f11fde00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11f8071ed0 0x7f11f8148040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57188/0 (socket says 172.21.15.8:57188) 2024-03-23T23:54:34.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.157+0000 7f11fde00640 1 -- 172.21.15.8:0/1913300230 learned_addr learned my addr 172.21.15.8:0/1913300230 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:54:34.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.157+0000 7f11fe800640 1 --2- 172.21.15.8:0/1913300230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11f8151730 0x7f11f81438a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:34.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.161+0000 7f11fde00640 1 -- 172.21.15.8:0/1913300230 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11f814ef60 msgr2=0x7f11f8143360 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:54:34.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.161+0000 7f11fde00640 1 --2- 172.21.15.8:0/1913300230 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11f814ef60 0x7f11f8143360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:34.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.161+0000 7f11fde00640 1 -- 172.21.15.8:0/1913300230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11f8151730 msgr2=0x7f11f81438a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:34.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.161+0000 7f11fde00640 1 --2- 172.21.15.8:0/1913300230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11f8151730 0x7f11f81438a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:34.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.161+0000 7f11fde00640 1 -- 172.21.15.8:0/1913300230 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f80ac930 con 0x7f11f8071ed0 2024-03-23T23:54:34.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.161+0000 7f11fde00640 1 --2- 172.21.15.8:0/1913300230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11f8071ed0 0x7f11f8148040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f11f40b9040 tx=0x7f11f4022110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:34.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.161+0000 7f11f2000640 1 -- 172.21.15.8:0/1913300230 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f40bb040 con 0x7f11f8071ed0 2024-03-23T23:54:34.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.161+0000 7f11f2000640 1 -- 172.21.15.8:0/1913300230 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f4004040 con 0x7f11f8071ed0 2024-03-23T23:54:34.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.161+0000 7f11f2000640 1 -- 172.21.15.8:0/1913300230 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f40bb040 con 0x7f11f8071ed0 2024-03-23T23:54:34.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.161+0000 7f11ff200640 1 -- 172.21.15.8:0/1913300230 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f81ee6b0 con 0x7f11f8071ed0 2024-03-23T23:54:34.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.161+0000 7f11ff200640 1 -- 172.21.15.8:0/1913300230 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f80c50c0 con 0x7f11f8071ed0 2024-03-23T23:54:34.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.165+0000 7f11e7400640 1 -- 172.21.15.8:0/1913300230 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d00052a0 con 0x7f11f8071ed0 2024-03-23T23:54:34.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.173+0000 7f11f2000640 1 -- 172.21.15.8:0/1913300230 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f11f40041f0 con 0x7f11f8071ed0 2024-03-23T23:54:34.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.173+0000 7f11f2000640 1 --2- 172.21.15.8:0/1913300230 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f11dc067a10 0x7f11dc069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:34.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.173+0000 7f11f2000640 1 -- 172.21.15.8:0/1913300230 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f11f4003c90 con 0x7f11f8071ed0 2024-03-23T23:54:34.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.181+0000 7f11fd400640 1 --2- 172.21.15.8:0/1913300230 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f11dc067a10 0x7f11dc069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:34.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.189+0000 7f11f2000640 1 -- 172.21.15.8:0/1913300230 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f11f401eff0 con 0x7f11f8071ed0 2024-03-23T23:54:34.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:34.189+0000 7f11fd400640 1 --2- 172.21.15.8:0/1913300230 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f11dc067a10 0x7f11dc069ed0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f11f815b2e0 tx=0x7f11ec006d90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:34.953 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-23T23:54:34.953 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-23T23:54:35.059 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2024-03-23T23:54:35.059 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-23T23:54:35.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:35.065+0000 7f11e7400640 1 -- 172.21.15.8:0/1913300230 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f11d0005860 con 0x7f11f8071ed0 2024-03-23T23:54:35.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:35.069+0000 7f11f2000640 1 -- 172.21.15.8:0/1913300230 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1555 (secure 0 0 0) 0x7f11f40f9190 con 0x7f11f8071ed0 2024-03-23T23:54:35.073 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":94,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:54:35.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:35.073+0000 7f11e7400640 1 -- 172.21.15.8:0/1913300230 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f11dc067a10 msgr2=0x7f11dc069ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:35.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:35.073+0000 7f11e7400640 1 --2- 172.21.15.8:0/1913300230 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f11dc067a10 0x7f11dc069ed0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f11f815b2e0 tx=0x7f11ec006d90 comp rx=0 tx=0).stop 2024-03-23T23:54:35.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:35.073+0000 7f11e7400640 1 -- 172.21.15.8:0/1913300230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11f8071ed0 msgr2=0x7f11f8148040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:35.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:35.073+0000 7f11e7400640 1 --2- 172.21.15.8:0/1913300230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11f8071ed0 0x7f11f8148040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f11f40b9040 tx=0x7f11f4022110 comp rx=0 tx=0).stop 2024-03-23T23:54:35.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:35.077+0000 7f11e7400640 1 -- 172.21.15.8:0/1913300230 shutdown_connections 2024-03-23T23:54:35.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:35.077+0000 7f11e7400640 1 --2- 172.21.15.8:0/1913300230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11f8151730 0x7f11f81438a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:35.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:35.077+0000 7f11e7400640 1 --2- 172.21.15.8:0/1913300230 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f11dc067a10 0x7f11dc069ed0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:35.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:35.077+0000 7f11e7400640 1 --2- 172.21.15.8:0/1913300230 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f11f814ef60 0x7f11f8143360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:35.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:35.077+0000 7f11e7400640 1 --2- 172.21.15.8:0/1913300230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11f8071ed0 0x7f11f8148040 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:35.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:35.077+0000 7f11e7400640 1 -- 172.21.15.8:0/1913300230 >> 172.21.15.8:0/1913300230 conn(0x7f11f80c3610 msgr2=0x7f11f814f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:54:35.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:35.077+0000 7f11e7400640 1 -- 172.21.15.8:0/1913300230 shutdown_connections 2024-03-23T23:54:35.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:35.077+0000 7f11e7400640 1 -- 172.21.15.8:0/1913300230 wait complete. 2024-03-23T23:54:38.015 DEBUG:teuthology.parallel:result is None 2024-03-23T23:54:38.138 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:54:38.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:38.545+0000 7f93c5000640 1 Processor -- start 2024-03-23T23:54:38.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:38.545+0000 7f93c5000640 1 -- start start 2024-03-23T23:54:38.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:38.545+0000 7f93c5000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f93c0152e60 0x7f93c00c3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:38.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:38.545+0000 7f93c5000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c00c3320 con 0x7f93c00c4140 2024-03-23T23:54:38.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:38.545+0000 7f93c5000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c00c36f0 con 0x7f93c00aa5b0 2024-03-23T23:54:38.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:38.545+0000 7f93c5000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c00c39d0 con 0x7f93c0152e60 2024-03-23T23:54:38.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:38.545+0000 7f93be800640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f93c00aa5b0 0x7f93c01602b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:36032/0 (socket says 172.21.15.8:36032) 2024-03-23T23:54:38.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:38.545+0000 7f93be800640 1 -- 172.21.15.8:0/812587195 learned_addr learned my addr 172.21.15.8:0/812587195 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:54:38.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:38.549+0000 7f93bde00640 1 --2- 172.21.15.8:0/812587195 >> v2:172.21.15.196:3300/0 conn(0x7f93c0152e60 0x7f93c00c3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:38.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:38.549+0000 7f93bde00640 1 -- 172.21.15.8:0/812587195 >> v2:172.21.15.196:3300/0 conn(0x7f93c0152e60 msgr2=0x7f93c00c3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T23:54:38.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:38.549+0000 7f93bde00640 1 -- 172.21.15.8:0/812587195 >> v2:172.21.15.196:3300/0 conn(0x7f93c0152e60 msgr2=0x7f93c00c3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:54:38.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:38.549+0000 7f93bde00640 1 --2- 172.21.15.8:0/812587195 >> v2:172.21.15.196:3300/0 conn(0x7f93c0152e60 0x7f93c00c3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:54:38.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:38.549+0000 7f93bde00640 1 --2- 172.21.15.8:0/812587195 >> v2:172.21.15.196:3300/0 conn(0x7f93c0152e60 0x7f93c00c3c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:54:38.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:38.765+0000 7f93bde00640 1 --2- 172.21.15.8:0/812587195 >> v2:172.21.15.196:3300/0 conn(0x7f93c0152e60 0x7f93c00c3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:38.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:38.765+0000 7f93bde00640 1 -- 172.21.15.8:0/812587195 >> v2:172.21.15.196:3300/0 conn(0x7f93c0152e60 msgr2=0x7f93c00c3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T23:54:38.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:38.765+0000 7f93bde00640 1 -- 172.21.15.8:0/812587195 >> v2:172.21.15.196:3300/0 conn(0x7f93c0152e60 msgr2=0x7f93c00c3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:54:38.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:38.765+0000 7f93bde00640 1 --2- 172.21.15.8:0/812587195 >> v2:172.21.15.196:3300/0 conn(0x7f93c0152e60 0x7f93c00c3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:54:38.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:38.765+0000 7f93bde00640 1 --2- 172.21.15.8:0/812587195 >> v2:172.21.15.196:3300/0 conn(0x7f93c0152e60 0x7f93c00c3c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:54:39.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:39.169+0000 7f93bde00640 1 --2- 172.21.15.8:0/812587195 >> v2:172.21.15.196:3300/0 conn(0x7f93c0152e60 0x7f93c00c3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:39.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:39.177+0000 7f93bde00640 1 -- 172.21.15.8:0/812587195 >> v2:172.21.15.196:3300/0 conn(0x7f93c0152e60 msgr2=0x7f93c00c3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T23:54:39.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:39.177+0000 7f93bde00640 1 -- 172.21.15.8:0/812587195 >> v2:172.21.15.196:3300/0 conn(0x7f93c0152e60 msgr2=0x7f93c00c3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:54:39.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:39.177+0000 7f93bde00640 1 --2- 172.21.15.8:0/812587195 >> v2:172.21.15.196:3300/0 conn(0x7f93c0152e60 0x7f93c00c3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:54:39.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:39.177+0000 7f93bde00640 1 --2- 172.21.15.8:0/812587195 >> v2:172.21.15.196:3300/0 conn(0x7f93c0152e60 0x7f93c00c3c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:54:39.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:39.985+0000 7f93bde00640 1 --2- 172.21.15.8:0/812587195 >> v2:172.21.15.196:3300/0 conn(0x7f93c0152e60 0x7f93c00c3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:39.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:39.989+0000 7f93bde00640 1 -- 172.21.15.8:0/812587195 >> v2:172.21.15.196:3300/0 conn(0x7f93c0152e60 msgr2=0x7f93c00c3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T23:54:39.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:39.989+0000 7f93bde00640 1 -- 172.21.15.8:0/812587195 >> v2:172.21.15.196:3300/0 conn(0x7f93c0152e60 msgr2=0x7f93c00c3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:54:39.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:39.989+0000 7f93bde00640 1 --2- 172.21.15.8:0/812587195 >> v2:172.21.15.196:3300/0 conn(0x7f93c0152e60 0x7f93c00c3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:54:39.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:39.989+0000 7f93bde00640 1 --2- 172.21.15.8:0/812587195 >> v2:172.21.15.196:3300/0 conn(0x7f93c0152e60 0x7f93c00c3c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:54:41.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:41.545+0000 7f93b7400640 1 -- 172.21.15.8:0/812587195 >> v2:172.21.15.196:3300/0 conn(0x7f93c0152e60 msgr2=0x7f93c00c3c00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:54:41.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:41.545+0000 7f93b7400640 1 --2- 172.21.15.8:0/812587195 >> v2:172.21.15.196:3300/0 conn(0x7f93c0152e60 0x7f93c00c3c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:41.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:41.549+0000 7f93b7400640 1 -- 172.21.15.8:0/812587195 >> v1:172.21.15.196:6789/0 conn(0x7f93c00aa5b0 legacy=0x7f93c01602b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:41.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:41.549+0000 7f93b7400640 1 -- 172.21.15.8:0/812587195 >> v1:172.21.15.8:6789/0 conn(0x7f93c00c4140 legacy=0x7f93c0159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:41.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:41.549+0000 7f93b7400640 1 --2- 172.21.15.8:0/812587195 >> v2:172.21.15.8:3300/0 conn(0x7f93a00036d0 0x7f93a0005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:41.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:41.549+0000 7f93b7400640 1 --2- 172.21.15.8:0/812587195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a0006230 0x7f93a00086f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:41.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:41.549+0000 7f93b7400640 1 -- 172.21.15.8:0/812587195 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c00c39d0 con 0x7f93a00036d0 2024-03-23T23:54:41.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:41.549+0000 7f93b7400640 1 -- 172.21.15.8:0/812587195 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a0008e20 con 0x7f93a0006230 2024-03-23T23:54:41.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:41.549+0000 7f93bde00640 1 --2- 172.21.15.8:0/812587195 >> v2:172.21.15.8:3300/0 conn(0x7f93a00036d0 0x7f93a0005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:41.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:41.549+0000 7f93bde00640 1 -- 172.21.15.8:0/812587195 >> v2:172.21.15.8:3300/0 conn(0x7f93a00036d0 msgr2=0x7f93a0005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T23:54:41.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:41.549+0000 7f93bde00640 1 -- 172.21.15.8:0/812587195 >> v2:172.21.15.8:3300/0 conn(0x7f93a00036d0 msgr2=0x7f93a0005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:54:41.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:41.549+0000 7f93bde00640 1 --2- 172.21.15.8:0/812587195 >> v2:172.21.15.8:3300/0 conn(0x7f93a00036d0 0x7f93a0005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:54:41.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:41.549+0000 7f93bde00640 1 --2- 172.21.15.8:0/812587195 >> v2:172.21.15.8:3300/0 conn(0x7f93a00036d0 0x7f93a0005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:54:41.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:41.553+0000 7f93bd400640 1 --2- 172.21.15.8:0/812587195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a0006230 0x7f93a00086f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:41.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:41.553+0000 7f93bd400640 1 -- 172.21.15.8:0/812587195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a0006230 msgr2=0x7f93a00086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:54:41.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:41.553+0000 7f93bd400640 1 -- 172.21.15.8:0/812587195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a0006230 msgr2=0x7f93a00086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:54:41.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:41.553+0000 7f93bd400640 1 --2- 172.21.15.8:0/812587195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a0006230 0x7f93a00086f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:54:41.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:41.553+0000 7f93bd400640 1 --2- 172.21.15.8:0/812587195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a0006230 0x7f93a00086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:54:41.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:41.753+0000 7f93bde00640 1 --2- 172.21.15.8:0/812587195 >> v2:172.21.15.8:3300/0 conn(0x7f93a00036d0 0x7f93a0005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:41.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:41.753+0000 7f93bde00640 1 -- 172.21.15.8:0/812587195 >> v2:172.21.15.8:3300/0 conn(0x7f93a00036d0 msgr2=0x7f93a0005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:54:41.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:41.753+0000 7f93bde00640 1 -- 172.21.15.8:0/812587195 >> v2:172.21.15.8:3300/0 conn(0x7f93a00036d0 msgr2=0x7f93a0005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:54:41.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:41.753+0000 7f93bde00640 1 --2- 172.21.15.8:0/812587195 >> v2:172.21.15.8:3300/0 conn(0x7f93a00036d0 0x7f93a0005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:54:41.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:41.753+0000 7f93bde00640 1 --2- 172.21.15.8:0/812587195 >> v2:172.21.15.8:3300/0 conn(0x7f93a00036d0 0x7f93a0005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:54:41.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:41.757+0000 7f93bd400640 1 --2- 172.21.15.8:0/812587195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a0006230 0x7f93a00086f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:41.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:41.757+0000 7f93bd400640 1 -- 172.21.15.8:0/812587195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a0006230 msgr2=0x7f93a00086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:54:41.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:41.757+0000 7f93bd400640 1 -- 172.21.15.8:0/812587195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a0006230 msgr2=0x7f93a00086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:54:41.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:41.757+0000 7f93bd400640 1 --2- 172.21.15.8:0/812587195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a0006230 0x7f93a00086f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:54:41.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:41.757+0000 7f93bd400640 1 --2- 172.21.15.8:0/812587195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a0006230 0x7f93a00086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:54:42.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:42.157+0000 7f93bde00640 1 --2- 172.21.15.8:0/812587195 >> v2:172.21.15.8:3300/0 conn(0x7f93a00036d0 0x7f93a0005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:42.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:42.157+0000 7f93bde00640 1 -- 172.21.15.8:0/812587195 >> v2:172.21.15.8:3300/0 conn(0x7f93a00036d0 msgr2=0x7f93a0005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:54:42.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:42.157+0000 7f93bde00640 1 -- 172.21.15.8:0/812587195 >> v2:172.21.15.8:3300/0 conn(0x7f93a00036d0 msgr2=0x7f93a0005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:54:42.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:42.157+0000 7f93bde00640 1 --2- 172.21.15.8:0/812587195 >> v2:172.21.15.8:3300/0 conn(0x7f93a00036d0 0x7f93a0005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:54:42.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:42.157+0000 7f93bde00640 1 --2- 172.21.15.8:0/812587195 >> v2:172.21.15.8:3300/0 conn(0x7f93a00036d0 0x7f93a0005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:54:42.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:42.161+0000 7f93bd400640 1 --2- 172.21.15.8:0/812587195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a0006230 0x7f93a00086f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:42.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:42.161+0000 7f93bd400640 1 -- 172.21.15.8:0/812587195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a0006230 msgr2=0x7f93a00086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:54:42.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:42.161+0000 7f93bd400640 1 -- 172.21.15.8:0/812587195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a0006230 msgr2=0x7f93a00086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:54:42.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:42.161+0000 7f93bd400640 1 --2- 172.21.15.8:0/812587195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a0006230 0x7f93a00086f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:54:42.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:42.161+0000 7f93bd400640 1 --2- 172.21.15.8:0/812587195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a0006230 0x7f93a00086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:54:42.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:42.961+0000 7f93bde00640 1 --2- 172.21.15.8:0/812587195 >> v2:172.21.15.8:3300/0 conn(0x7f93a00036d0 0x7f93a0005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:42.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:42.961+0000 7f93bde00640 1 -- 172.21.15.8:0/812587195 >> v2:172.21.15.8:3300/0 conn(0x7f93a00036d0 msgr2=0x7f93a0005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:54:42.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:42.961+0000 7f93bde00640 1 -- 172.21.15.8:0/812587195 >> v2:172.21.15.8:3300/0 conn(0x7f93a00036d0 msgr2=0x7f93a0005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:54:42.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:42.961+0000 7f93bde00640 1 --2- 172.21.15.8:0/812587195 >> v2:172.21.15.8:3300/0 conn(0x7f93a00036d0 0x7f93a0005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:54:42.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:42.961+0000 7f93bde00640 1 --2- 172.21.15.8:0/812587195 >> v2:172.21.15.8:3300/0 conn(0x7f93a00036d0 0x7f93a0005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:54:42.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:42.965+0000 7f93bd400640 1 --2- 172.21.15.8:0/812587195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a0006230 0x7f93a00086f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:42.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:42.969+0000 7f93bd400640 1 -- 172.21.15.8:0/812587195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a0006230 msgr2=0x7f93a00086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:54:42.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:42.969+0000 7f93bd400640 1 -- 172.21.15.8:0/812587195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a0006230 msgr2=0x7f93a00086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:54:42.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:42.969+0000 7f93bd400640 1 --2- 172.21.15.8:0/812587195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a0006230 0x7f93a00086f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:54:42.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:42.969+0000 7f93bd400640 1 --2- 172.21.15.8:0/812587195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a0006230 0x7f93a00086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:54:44.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.549+0000 7f93b7400640 1 -- 172.21.15.8:0/812587195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a0006230 msgr2=0x7f93a00086f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:54:44.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.549+0000 7f93b7400640 1 --2- 172.21.15.8:0/812587195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a0006230 0x7f93a00086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:44.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.549+0000 7f93b7400640 1 -- 172.21.15.8:0/812587195 >> v2:172.21.15.8:3300/0 conn(0x7f93a00036d0 msgr2=0x7f93a0005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:54:44.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.549+0000 7f93b7400640 1 --2- 172.21.15.8:0/812587195 >> v2:172.21.15.8:3300/0 conn(0x7f93a00036d0 0x7f93a0005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:44.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.549+0000 7f93be800640 1 -- 172.21.15.8:0/812587195 reap_dead start 2024-03-23T23:54:44.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.549+0000 7f93b7400640 1 --2- 172.21.15.8:0/812587195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a00092c0 0x7f93a000b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:44.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.549+0000 7f93b7400640 1 --2- 172.21.15.8:0/812587195 >> v2:172.21.15.8:3300/0 conn(0x7f93a000bd20 0x7f93a000e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:44.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.553+0000 7f93b7400640 1 -- 172.21.15.8:0/812587195 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c00ab640 con 0x7f93a000e8a0 2024-03-23T23:54:44.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.553+0000 7f93b7400640 1 -- 172.21.15.8:0/812587195 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c00c39d0 con 0x7f93a000bd20 2024-03-23T23:54:44.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.553+0000 7f93b7400640 1 -- 172.21.15.8:0/812587195 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a0008e20 con 0x7f93a00092c0 2024-03-23T23:54:44.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.553+0000 7f93bd400640 1 --2- 172.21.15.8:0/812587195 >> v2:172.21.15.8:3300/0 conn(0x7f93a000bd20 0x7f93a000e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:44.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.553+0000 7f93bd400640 1 -- 172.21.15.8:0/812587195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a00092c0 msgr2=0x7f93a000b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:54:44.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.553+0000 7f93bd400640 1 --2- 172.21.15.8:0/812587195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a00092c0 0x7f93a000b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:44.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.553+0000 7f93bd400640 1 -- 172.21.15.8:0/812587195 >> v1:172.21.15.196:6789/0 conn(0x7f93a000e8a0 legacy=0x7f93a0010d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:54:44.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.553+0000 7f93bd400640 1 -- 172.21.15.8:0/812587195 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a0004c90 con 0x7f93a000bd20 2024-03-23T23:54:44.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.573+0000 7f93bd400640 1 --2- 172.21.15.8:0/812587195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93a000bd20 0x7f93a000e1b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f93b0007fd0 tx=0x7f93b001cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef1a87793101db5f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:44.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.577+0000 7f93bca00640 1 -- 172.21.15.8:0/812587195 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b00ab070 con 0x7f93a000bd20 2024-03-23T23:54:44.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.577+0000 7f93bca00640 1 -- 172.21.15.8:0/812587195 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b00a57e0 con 0x7f93a000bd20 2024-03-23T23:54:44.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.577+0000 7f93bca00640 1 -- 172.21.15.8:0/812587195 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b00a5bd0 con 0x7f93a000bd20 2024-03-23T23:54:44.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.581+0000 7f93c5000640 1 -- 172.21.15.8:0/812587195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93a000bd20 msgr2=0x7f93a000e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:44.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.581+0000 7f93c5000640 1 --2- 172.21.15.8:0/812587195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93a000bd20 0x7f93a000e1b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f93b0007fd0 tx=0x7f93b001cb90 comp rx=0 tx=0).stop 2024-03-23T23:54:44.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.585+0000 7f93c5000640 1 -- 172.21.15.8:0/812587195 shutdown_connections 2024-03-23T23:54:44.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.585+0000 7f93c5000640 1 --2- 172.21.15.8:0/812587195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93a000bd20 0x7f93a000e1b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:44.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.585+0000 7f93c5000640 1 --2- 172.21.15.8:0/812587195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a00092c0 0x7f93a000b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:44.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.585+0000 7f93c5000640 1 -- 172.21.15.8:0/812587195 >> 172.21.15.8:0/812587195 conn(0x7f93c006b170 msgr2=0x7f93c006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:54:44.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.593+0000 7f93c5000640 1 -- 172.21.15.8:0/812587195 shutdown_connections 2024-03-23T23:54:44.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.597+0000 7f93c5000640 1 -- 172.21.15.8:0/812587195 wait complete. 2024-03-23T23:54:44.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.605+0000 7f93c5000640 1 Processor -- start 2024-03-23T23:54:44.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.605+0000 7f93c5000640 1 -- start start 2024-03-23T23:54:44.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.609+0000 7f93c5000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93a00092c0 0x7f93c0147790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:44.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.609+0000 7f93c5000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a000bd20 0x7f93c014fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:44.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.609+0000 7f93c5000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93a000e8a0 0x7f93c0150310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:44.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.609+0000 7f93bd400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a000bd20 0x7f93c014fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:44.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.609+0000 7f93bd400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a000bd20 0x7f93c014fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:43538/0 (socket says 172.21.15.8:43538) 2024-03-23T23:54:44.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.609+0000 7f93be800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93a000e8a0 0x7f93c0150310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:44.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.609+0000 7f93be800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93a000e8a0 0x7f93c0150310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45684/0 (socket says 172.21.15.8:45684) 2024-03-23T23:54:44.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.609+0000 7f93c5000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c0159c30 con 0x7f93a000e8a0 2024-03-23T23:54:44.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.609+0000 7f93c5000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c0158f90 con 0x7f93a00092c0 2024-03-23T23:54:44.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.609+0000 7f93c5000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c0159db0 con 0x7f93a000bd20 2024-03-23T23:54:44.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.609+0000 7f93bd400640 1 -- 172.21.15.8:0/1526987110 learned_addr learned my addr 172.21.15.8:0/1526987110 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:54:44.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.613+0000 7f93bd400640 1 -- 172.21.15.8:0/1526987110 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a000bd20 msgr2=0x7f93c014fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-03-23T23:54:44.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.613+0000 7f93bd400640 1 -- 172.21.15.8:0/1526987110 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a000bd20 msgr2=0x7f93c014fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T23:54:44.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.613+0000 7f93bd400640 1 --2- 172.21.15.8:0/1526987110 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a000bd20 0x7f93c014fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:54:44.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.613+0000 7f93bd400640 1 --2- 172.21.15.8:0/1526987110 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a000bd20 0x7f93c014fdd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:54:44.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.613+0000 7f93bde00640 1 --2- 172.21.15.8:0/1526987110 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93a00092c0 0x7f93c0147790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:44.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.613+0000 7f93be800640 1 -- 172.21.15.8:0/1526987110 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a000bd20 msgr2=0x7f93c014fdd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:54:44.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.613+0000 7f93be800640 1 --2- 172.21.15.8:0/1526987110 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a000bd20 0x7f93c014fdd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:44.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.613+0000 7f93be800640 1 -- 172.21.15.8:0/1526987110 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93a00092c0 msgr2=0x7f93c0147790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:44.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.613+0000 7f93be800640 1 --2- 172.21.15.8:0/1526987110 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93a00092c0 0x7f93c0147790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:44.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.613+0000 7f93be800640 1 -- 172.21.15.8:0/1526987110 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c0157d40 con 0x7f93a000e8a0 2024-03-23T23:54:44.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.613+0000 7f93be800640 1 --2- 172.21.15.8:0/1526987110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93a000e8a0 0x7f93c0150310 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f93c00c17e0 tx=0x7f93ac00c570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:44.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.621+0000 7f93b6000640 1 -- 172.21.15.8:0/1526987110 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ac005ac0 con 0x7f93a000e8a0 2024-03-23T23:54:44.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.621+0000 7f93b6000640 1 -- 172.21.15.8:0/1526987110 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93ac005c60 con 0x7f93a000e8a0 2024-03-23T23:54:44.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.621+0000 7f93b6000640 1 -- 172.21.15.8:0/1526987110 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ac007330 con 0x7f93a000e8a0 2024-03-23T23:54:44.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.621+0000 7f93c5000640 1 -- 172.21.15.8:0/1526987110 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c006ed60 con 0x7f93a000e8a0 2024-03-23T23:54:44.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.621+0000 7f93c5000640 1 -- 172.21.15.8:0/1526987110 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c0158240 con 0x7f93a000e8a0 2024-03-23T23:54:44.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.625+0000 7f93c5000640 1 -- 172.21.15.8:0/1526987110 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c004f480 con 0x7f93a000e8a0 2024-03-23T23:54:44.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.629+0000 7f93b6000640 1 -- 172.21.15.8:0/1526987110 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f93ac011070 con 0x7f93a000e8a0 2024-03-23T23:54:44.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.629+0000 7f93b6000640 1 --2- 172.21.15.8:0/1526987110 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f93a00697d0 0x7f93a006bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:44.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.629+0000 7f93b6000640 1 -- 172.21.15.8:0/1526987110 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f93ac084ef0 con 0x7f93a000e8a0 2024-03-23T23:54:44.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.633+0000 7f93bde00640 1 --2- 172.21.15.8:0/1526987110 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f93a00697d0 0x7f93a006bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:44.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.633+0000 7f93bde00640 1 --2- 172.21.15.8:0/1526987110 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f93a00697d0 0x7f93a006bc90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f93c0151880 tx=0x7f93b8003aa0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:44.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:44.645+0000 7f93b6000640 1 -- 172.21.15.8:0/1526987110 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f93ac055920 con 0x7f93a000e8a0 2024-03-23T23:54:45.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.225+0000 7f93c5000640 1 -- 172.21.15.8:0/1526987110 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f93c00c2350 con 0x7f93a000e8a0 2024-03-23T23:54:45.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.225+0000 7f93b6000640 1 -- 172.21.15.8:0/1526987110 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1561 (secure 0 0 0) 0x7f93ac055920 con 0x7f93a000e8a0 2024-03-23T23:54:45.229 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":100,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:54:45.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.229+0000 7f93c5000640 1 -- 172.21.15.8:0/1526987110 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f93a00697d0 msgr2=0x7f93a006bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:45.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.229+0000 7f93c5000640 1 --2- 172.21.15.8:0/1526987110 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f93a00697d0 0x7f93a006bc90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f93c0151880 tx=0x7f93b8003aa0 comp rx=0 tx=0).stop 2024-03-23T23:54:45.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.229+0000 7f93c5000640 1 -- 172.21.15.8:0/1526987110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93a000e8a0 msgr2=0x7f93c0150310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:45.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.229+0000 7f93c5000640 1 --2- 172.21.15.8:0/1526987110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93a000e8a0 0x7f93c0150310 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f93c00c17e0 tx=0x7f93ac00c570 comp rx=0 tx=0).stop 2024-03-23T23:54:45.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.233+0000 7f93c5000640 1 -- 172.21.15.8:0/1526987110 shutdown_connections 2024-03-23T23:54:45.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.233+0000 7f93c5000640 1 --2- 172.21.15.8:0/1526987110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93a000e8a0 0x7f93c0150310 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:45.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.233+0000 7f93c5000640 1 --2- 172.21.15.8:0/1526987110 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f93a00697d0 0x7f93a006bc90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:45.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.233+0000 7f93c5000640 1 --2- 172.21.15.8:0/1526987110 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a000bd20 0x7f93c014fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:45.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.233+0000 7f93c5000640 1 --2- 172.21.15.8:0/1526987110 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93a00092c0 0x7f93c0147790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:45.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.233+0000 7f93c5000640 1 -- 172.21.15.8:0/1526987110 >> 172.21.15.8:0/1526987110 conn(0x7f93c006b170 msgr2=0x7f93c0153e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:54:45.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.233+0000 7f93c5000640 1 -- 172.21.15.8:0/1526987110 shutdown_connections 2024-03-23T23:54:45.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.233+0000 7f93c5000640 1 -- 172.21.15.8:0/1526987110 wait complete. 2024-03-23T23:54:45.295 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T23:54:45.295 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T23:54:45.295 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:54:45.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.541+0000 7f89d3c00640 1 Processor -- start 2024-03-23T23:54:45.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.541+0000 7f89d3c00640 1 -- start start 2024-03-23T23:54:45.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.541+0000 7f89d3c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89cc1549b0 0x7f89cc153540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:45.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.541+0000 7f89d3c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f89cc0ad4a0 0x7f89cc157130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:45.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.545+0000 7f89d3c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89cc156c50 con 0x7f89cc0c6150 2024-03-23T23:54:45.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.545+0000 7f89d3c00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89cc151020 con 0x7f89cc0ad4a0 2024-03-23T23:54:45.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.545+0000 7f89d3c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc0ae4b0 con 0x7f89cc1549b0 2024-03-23T23:54:45.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.545+0000 7f89cbe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89cc1549b0 0x7f89cc153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:45.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.545+0000 7f89cbe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89cc1549b0 0x7f89cc153540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:43540/0 (socket says 172.21.15.8:43540) 2024-03-23T23:54:45.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.545+0000 7f89cbe00640 1 -- 172.21.15.8:0/1571746622 learned_addr learned my addr 172.21.15.8:0/1571746622 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:54:45.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.545+0000 7f89cbe00640 1 -- 172.21.15.8:0/1571746622 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89cc1549b0 msgr2=0x7f89cc153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T23:54:45.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.545+0000 7f89cbe00640 1 -- 172.21.15.8:0/1571746622 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89cc1549b0 msgr2=0x7f89cc153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:54:45.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.545+0000 7f89cbe00640 1 --2- 172.21.15.8:0/1571746622 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89cc1549b0 0x7f89cc153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:54:45.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.545+0000 7f89cbe00640 1 --2- 172.21.15.8:0/1571746622 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89cc1549b0 0x7f89cc153540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:54:45.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.549+0000 7f89d1c00640 1 --2- 172.21.15.8:0/1571746622 >> v2:172.21.15.8:3300/0 conn(0x7f89cc0ad4a0 0x7f89cc157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:45.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.553+0000 7f89d1c00640 1 -- 172.21.15.8:0/1571746622 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89cc1549b0 msgr2=0x7f89cc153540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:54:45.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.553+0000 7f89d1c00640 1 --2- 172.21.15.8:0/1571746622 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89cc1549b0 0x7f89cc153540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:45.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.553+0000 7f89d1c00640 1 -- 172.21.15.8:0/1571746622 >> v1:172.21.15.196:6789/0 conn(0x7f89cc0c6150 legacy=0x7f89cc0c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:45.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.553+0000 7f89d1c00640 1 -- 172.21.15.8:0/1571746622 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89cc0ad950 con 0x7f89cc0ad4a0 2024-03-23T23:54:45.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.557+0000 7f89d1c00640 1 --2- 172.21.15.8:0/1571746622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89cc0ad4a0 0x7f89cc157130 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f89c4009d90 tx=0x7f89c401c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ac5f1cd080afc2 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:45.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.561+0000 7f89cb400640 1 -- 172.21.15.8:0/1571746622 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c40b2070 con 0x7f89cc0ad4a0 2024-03-23T23:54:45.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.561+0000 7f89cb400640 1 -- 172.21.15.8:0/1571746622 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c40a5830 con 0x7f89cc0ad4a0 2024-03-23T23:54:45.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.561+0000 7f89cb400640 1 -- 172.21.15.8:0/1571746622 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c40a5c00 con 0x7f89cc0ad4a0 2024-03-23T23:54:45.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.561+0000 7f89d3c00640 1 -- 172.21.15.8:0/1571746622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89cc0ad4a0 msgr2=0x7f89cc157130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:45.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.561+0000 7f89d3c00640 1 --2- 172.21.15.8:0/1571746622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89cc0ad4a0 0x7f89cc157130 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f89c4009d90 tx=0x7f89c401c990 comp rx=0 tx=0).stop 2024-03-23T23:54:45.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.561+0000 7f89d3c00640 1 -- 172.21.15.8:0/1571746622 shutdown_connections 2024-03-23T23:54:45.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.561+0000 7f89d3c00640 1 --2- 172.21.15.8:0/1571746622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89cc0ad4a0 0x7f89cc157130 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:45.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.561+0000 7f89d3c00640 1 --2- 172.21.15.8:0/1571746622 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89cc1549b0 0x7f89cc153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:45.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.561+0000 7f89d3c00640 1 -- 172.21.15.8:0/1571746622 >> 172.21.15.8:0/1571746622 conn(0x7f89cc0c8e80 msgr2=0x7f89cc0c9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:54:45.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.561+0000 7f89d3c00640 1 -- 172.21.15.8:0/1571746622 shutdown_connections 2024-03-23T23:54:45.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.561+0000 7f89d3c00640 1 -- 172.21.15.8:0/1571746622 wait complete. 2024-03-23T23:54:45.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.565+0000 7f89d3c00640 1 Processor -- start 2024-03-23T23:54:45.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.565+0000 7f89d3c00640 1 -- start start 2024-03-23T23:54:45.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.565+0000 7f89d3c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f89cc0ad4a0 0x7f89cc0a9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:45.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.569+0000 7f89d3c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89cc0c6150 0x7f89cc0a9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:45.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.569+0000 7f89d3c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89cc1549b0 0x7f89cc152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:45.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.569+0000 7f89d3c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc0acdc0 con 0x7f89cc0c6150 2024-03-23T23:54:45.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.569+0000 7f89d3c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc0c6530 con 0x7f89cc0ad4a0 2024-03-23T23:54:45.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.569+0000 7f89d3c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc0c8790 con 0x7f89cc1549b0 2024-03-23T23:54:45.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.569+0000 7f89cbe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89cc0c6150 0x7f89cc0a9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:45.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.569+0000 7f89cbe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89cc0c6150 0x7f89cc0a9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45702/0 (socket says 172.21.15.8:45702) 2024-03-23T23:54:45.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.569+0000 7f89cbe00640 1 -- 172.21.15.8:0/840063978 learned_addr learned my addr 172.21.15.8:0/840063978 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:54:45.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.569+0000 7f89cbe00640 1 -- 172.21.15.8:0/840063978 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89cc1549b0 msgr2=0x7f89cc152660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:45.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.569+0000 7f89cbe00640 1 --2- 172.21.15.8:0/840063978 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89cc1549b0 0x7f89cc152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:45.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.569+0000 7f89d1200640 1 --2- 172.21.15.8:0/840063978 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f89cc0ad4a0 0x7f89cc0a9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:45.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.569+0000 7f89cbe00640 1 -- 172.21.15.8:0/840063978 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f89cc0ad4a0 msgr2=0x7f89cc0a9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:45.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.569+0000 7f89cbe00640 1 --2- 172.21.15.8:0/840063978 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f89cc0ad4a0 0x7f89cc0a9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:45.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.569+0000 7f89cbe00640 1 -- 172.21.15.8:0/840063978 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89cc0abbc0 con 0x7f89cc0c6150 2024-03-23T23:54:45.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.569+0000 7f89d1200640 1 --2- 172.21.15.8:0/840063978 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f89cc0ad4a0 0x7f89cc0a9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:54:45.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.569+0000 7f89cbe00640 1 --2- 172.21.15.8:0/840063978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89cc0c6150 0x7f89cc0a9420 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f89c000e790 tx=0x7f89c000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:45.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.569+0000 7f89c8c00640 1 -- 172.21.15.8:0/840063978 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c0017070 con 0x7f89cc0c6150 2024-03-23T23:54:45.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.573+0000 7f89c8c00640 1 -- 172.21.15.8:0/840063978 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c0004020 con 0x7f89cc0c6150 2024-03-23T23:54:45.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.573+0000 7f89c8c00640 1 -- 172.21.15.8:0/840063978 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c000f040 con 0x7f89cc0c6150 2024-03-23T23:54:45.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.573+0000 7f89d3c00640 1 -- 172.21.15.8:0/840063978 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89cc0a8c20 con 0x7f89cc0c6150 2024-03-23T23:54:45.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.573+0000 7f89d3c00640 1 -- 172.21.15.8:0/840063978 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89cc1e5d80 con 0x7f89cc0c6150 2024-03-23T23:54:45.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.573+0000 7f89d3c00640 1 --2- 172.21.15.8:0/840063978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89cc1e6df0 0x7f89cc14f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:45.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.573+0000 7f89d3c00640 1 -- 172.21.15.8:0/840063978 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc04f410 con 0x7f89cc1e6df0 2024-03-23T23:54:45.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.577+0000 7f89d1200640 1 --2- 172.21.15.8:0/840063978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89cc1e6df0 0x7f89cc14f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:45.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.577+0000 7f89c8c00640 1 -- 172.21.15.8:0/840063978 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f89c000c6d0 con 0x7f89cc0c6150 2024-03-23T23:54:45.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.577+0000 7f89c8c00640 1 --2- 172.21.15.8:0/840063978 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f89ac0676e0 0x7f89ac069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:45.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.581+0000 7f89c8c00640 1 -- 172.21.15.8:0/840063978 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f89c0085640 con 0x7f89cc0c6150 2024-03-23T23:54:45.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.581+0000 7f89d1200640 1 -- 172.21.15.8:0/840063978 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f89cc0c32b0 con 0x7f89cc1e6df0 2024-03-23T23:54:45.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.581+0000 7f89d1200640 1 --2- 172.21.15.8:0/840063978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89cc1e6df0 0x7f89cc14f5e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f89b800d450 tx=0x7f89b800d910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:45.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.585+0000 7f89c8c00640 1 -- 172.21.15.8:0/840063978 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b8016070 con 0x7f89cc1e6df0 2024-03-23T23:54:45.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.585+0000 7f89c8c00640 1 -- 172.21.15.8:0/840063978 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f89b8007220 con 0x7f89cc1e6df0 2024-03-23T23:54:45.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.585+0000 7f89c8c00640 1 -- 172.21.15.8:0/840063978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89cc1e6df0 msgr2=0x7f89cc14f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:45.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.585+0000 7f89c8c00640 1 --2- 172.21.15.8:0/840063978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89cc1e6df0 0x7f89cc14f5e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f89b800d450 tx=0x7f89b800d910 comp rx=0 tx=0).stop 2024-03-23T23:54:45.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.585+0000 7f89c8c00640 1 -- 172.21.15.8:0/840063978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89cc1e6df0 msgr2=0x7f89cc14f5e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:54:45.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.585+0000 7f89c8c00640 1 --2- 172.21.15.8:0/840063978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89cc1e6df0 0x7f89cc14f5e0 secure :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f89b800d450 tx=0x7f89b800d910 comp rx=0 tx=0).stop 2024-03-23T23:54:45.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.593+0000 7f89d1c00640 1 --2- 172.21.15.8:0/840063978 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f89ac0676e0 0x7f89ac069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:45.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.613+0000 7f89d1c00640 1 --2- 172.21.15.8:0/840063978 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f89ac0676e0 0x7f89ac069ba0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f89c40af000 tx=0x7f89c4004af0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:45.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.613+0000 7f89d3c00640 1 --2- 172.21.15.8:0/840063978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89cc152ba0 0x7f89cc14fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:45.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.617+0000 7f89d1200640 1 --2- 172.21.15.8:0/840063978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89cc152ba0 0x7f89cc14fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:45.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.617+0000 7f89d3c00640 1 -- 172.21.15.8:0/840063978 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc0c7e60 con 0x7f89cc152ba0 2024-03-23T23:54:45.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.621+0000 7f89d1200640 1 -- 172.21.15.8:0/840063978 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f89cc06ec80 con 0x7f89cc152ba0 2024-03-23T23:54:45.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.621+0000 7f89d1200640 1 --2- 172.21.15.8:0/840063978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89cc152ba0 0x7f89cc14fb20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f89b800d450 tx=0x7f89b8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:45.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.621+0000 7f89c8c00640 1 -- 172.21.15.8:0/840063978 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b8028020 con 0x7f89cc152ba0 2024-03-23T23:54:45.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.625+0000 7f89c8c00640 1 -- 172.21.15.8:0/840063978 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5185 (secure 0 0 0) 0x7f89b8012bb0 con 0x7f89cc152ba0 2024-03-23T23:54:45.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.625+0000 7f89c8c00640 1 -- 172.21.15.8:0/840063978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89cc152ba0 msgr2=0x7f89cc14fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:45.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.625+0000 7f89c8c00640 1 --2- 172.21.15.8:0/840063978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89cc152ba0 0x7f89cc14fb20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f89b800d450 tx=0x7f89b8000ee0 comp rx=0 tx=0).stop 2024-03-23T23:54:45.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.625+0000 7f89c8c00640 1 -- 172.21.15.8:0/840063978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89cc152ba0 msgr2=0x7f89cc14fb20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:54:45.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.625+0000 7f89c8c00640 1 --2- 172.21.15.8:0/840063978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89cc152ba0 0x7f89cc14fb20 secure :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f89b800d450 tx=0x7f89b8000ee0 comp rx=0 tx=0).stop 2024-03-23T23:54:45.629 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:54:45.629 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:54:45.629 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:54:45.629 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:54:45.629 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 100, 2024-03-23T23:54:45.629 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:54:45.629 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:54:45.629 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:54:45.629 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:54:45.629 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:54:45.629 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 1, 2024-03-23T23:54:45.630 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:54:45.630 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:54:45.630 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:54:45.630 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:54:45.630 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:54:45.630 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:54:45.630 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:54:45.630 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:54:45.630 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:54:45.630 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:54:45.630 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:54:45.630 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:54:45.630 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:54:45.631 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:54:45.631 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:54:45.631 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:54:45.631 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:54:45.631 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:54:45.631 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:54:45.631 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:54:45.631 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:54:45.631 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:54:45.631 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:54:45.631 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:54:45.631 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:54:45.631 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:54:45.631 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:54:45.632 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:54:45.632 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:54:45.632 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:45.632 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:54:45.632 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:54:45.632 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:54:45.632 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:54:45.632 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:54:45.632 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:54:45.632 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:54:45.632 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:54:45.632 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:54:45.632 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:54:45.633 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:54:45.633 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:54:45.633 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:54:45.633 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:54:45.633 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:54:45.633 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:54:45.633 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:54:45.633 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:54:45.634 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:54:45.634 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:54:45.634 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:54:45.634 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:54:45.634 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:54:45.634 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:54:45.634 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:54:45.634 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:54:45.634 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:54:45.634 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:54:45.634 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:54:45.634 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:54:45.634 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:45.634 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:54:45.635 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:45.635 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:54:45.635 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:54:45.635 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:54:45.635 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:54:45.635 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:45.635 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:54:45.635 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:54:45.635 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:54:45.635 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:45.635 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:45.635 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:54:45.635 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:54:45.635 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:54:45.636 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:45.636 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:54:45.636 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:45.636 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:54:45.636 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:54:45.636 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:54:45.636 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:54:45.636 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:54:45.636 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:45.636 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:45.636 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:54:45.636 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:54:45.636 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:54:45.637 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:54:45.637 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:45.637 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:54:45.637 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:54:45.637 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:54:45.637 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:45.637 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:45.637 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:54:45.637 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:54:45.637 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:54:45.637 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:45.637 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:54:45.637 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:45.638 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:54:45.638 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:54:45.638 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:54:45.638 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:54:45.638 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:54:45.638 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:45.638 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:45.638 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:54:45.638 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:54:45.638 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:54:45.638 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:54:45.638 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:45.638 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:54:45.638 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:54:45.639 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:54:45.639 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:45.639 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:45.639 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:54:45.639 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:54:45.639 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:54:45.639 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:45.639 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:54:45.639 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:45.639 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:54:45.639 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:54:45.639 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:54:45.639 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:54:45.640 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:54:45.640 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:45.640 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:54:45.640 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:45.640 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:54:45.640 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:54:45.640 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:45.640 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:54:45.640 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:54:45.640 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:54:45.640 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:45.640 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:54:45.640 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:54:45.640 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:45.641 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:54:45.641 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:54:45.641 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:54:45.641 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:45.641 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:54:45.641 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:54:45.641 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:45.641 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:54:45.641 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:54:45.641 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 8 2024-03-23T23:54:45.641 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:45.641 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:54:45.641 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:54:45.641 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:45.642 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:54:45.642 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:54:45.642 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:54:45.642 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:45.642 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:45.642 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:54:45.642 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:54:45.642 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 6 2024-03-23T23:54:45.642 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:45.642 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:54:45.642 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:54:45.642 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:45.642 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:54:45.643 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:54:45.643 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:54:45.643 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:45.644 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:54:45.644 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:45.644 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:54:45.644 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:54:45.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.629+0000 7f89d3c00640 1 -- 172.21.15.8:0/840063978 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f89ac0676e0 msgr2=0x7f89ac069ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:45.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.629+0000 7f89d3c00640 1 --2- 172.21.15.8:0/840063978 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f89ac0676e0 0x7f89ac069ba0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f89c40af000 tx=0x7f89c4004af0 comp rx=0 tx=0).stop 2024-03-23T23:54:45.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.629+0000 7f89d1c00640 1 -- 172.21.15.8:0/840063978 reap_dead start 2024-03-23T23:54:45.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.629+0000 7f89d3c00640 1 -- 172.21.15.8:0/840063978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89cc0c6150 msgr2=0x7f89cc0a9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:45.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.629+0000 7f89d3c00640 1 --2- 172.21.15.8:0/840063978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89cc0c6150 0x7f89cc0a9420 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f89c000e790 tx=0x7f89c000ec50 comp rx=0 tx=0).stop 2024-03-23T23:54:45.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.629+0000 7f89d3c00640 1 -- 172.21.15.8:0/840063978 shutdown_connections 2024-03-23T23:54:45.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.629+0000 7f89d3c00640 1 --2- 172.21.15.8:0/840063978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89cc0c6150 0x7f89cc0a9420 secure :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f89c000e790 tx=0x7f89c000ec50 comp rx=0 tx=0).stop 2024-03-23T23:54:45.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.629+0000 7f89d3c00640 1 -- 172.21.15.8:0/840063978 >> 172.21.15.8:0/840063978 conn(0x7f89cc0c8e80 msgr2=0x7f89cc0c9260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:54:45.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.629+0000 7f89d3c00640 1 -- 172.21.15.8:0/840063978 shutdown_connections 2024-03-23T23:54:45.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:45.629+0000 7f89d3c00640 1 -- 172.21.15.8:0/840063978 wait complete. 2024-03-23T23:54:45.684 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:54:45.684 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T23:54:45.684 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:54:46.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.049+0000 7fd80f400640 1 Processor -- start 2024-03-23T23:54:46.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.049+0000 7fd80f400640 1 -- start start 2024-03-23T23:54:46.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.049+0000 7fd80f400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd808151bb0 0x7fd8080c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:46.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.053+0000 7fd80ca00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd808151bb0 0x7fd8080c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:46.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.053+0000 7fd80ca00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd808151bb0 0x7fd8080c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45734/0 (socket says 172.21.15.8:45734) 2024-03-23T23:54:46.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.057+0000 7fd80ca00640 1 -- 172.21.15.8:0/3886209489 learned_addr learned my addr 172.21.15.8:0/3886209489 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:54:46.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.057+0000 7fd80f400640 1 --2- 172.21.15.8:0/3886209489 >> v2:172.21.15.196:3300/0 conn(0x7fd80806ea50 0x7fd80814eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:46.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.057+0000 7fd80f400640 1 -- 172.21.15.8:0/3886209489 --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8080c21f0 con 0x7fd808151f90 2024-03-23T23:54:46.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.061+0000 7fd80f400640 1 -- 172.21.15.8:0/3886209489 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd808071b60 con 0x7fd808151bb0 2024-03-23T23:54:46.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.061+0000 7fd80f400640 1 -- 172.21.15.8:0/3886209489 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd808071e40 con 0x7fd80806ea50 2024-03-23T23:54:46.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.061+0000 7fd807400640 1 -- 172.21.15.8:0/3886209489 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2719274125 0 0) 0x7fd7f4001120 con 0x7fd808151f90 2024-03-23T23:54:46.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.061+0000 7fd807400640 1 -- 172.21.15.8:0/3886209489 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7ec003430 con 0x7fd808151f90 2024-03-23T23:54:46.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.061+0000 7fd807400640 1 -- 172.21.15.8:0/3886209489 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2543646458 0 0) 0x7fd7ec003430 con 0x7fd808151f90 2024-03-23T23:54:46.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.061+0000 7fd80ca00640 1 -- 172.21.15.8:0/3886209489 >> v2:172.21.15.196:3300/0 conn(0x7fd80806ea50 msgr2=0x7fd80814eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:54:46.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.061+0000 7fd80ca00640 1 --2- 172.21.15.8:0/3886209489 >> v2:172.21.15.196:3300/0 conn(0x7fd80806ea50 0x7fd80814eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:46.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.065+0000 7fd80ca00640 1 -- 172.21.15.8:0/3886209489 >> v1:172.21.15.8:6789/0 conn(0x7fd808151f90 legacy=0x7fd80806e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:46.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.065+0000 7fd80ca00640 1 -- 172.21.15.8:0/3886209489 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd808072120 con 0x7fd808151bb0 2024-03-23T23:54:46.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.077+0000 7fd80ca00640 1 --2- 172.21.15.8:0/3886209489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd808151bb0 0x7fd8080c1cb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd808072ae0 tx=0x7fd7f801c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb3d3a231496eb2 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:46.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.077+0000 7fd807400640 1 -- 172.21.15.8:0/3886209489 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f80b0070 con 0x7fd808151bb0 2024-03-23T23:54:46.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.077+0000 7fd807400640 1 -- 172.21.15.8:0/3886209489 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f80089e0 con 0x7fd808151bb0 2024-03-23T23:54:46.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.077+0000 7fd80f400640 1 -- 172.21.15.8:0/3886209489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd808151bb0 msgr2=0x7fd8080c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:46.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.081+0000 7fd807400640 1 -- 172.21.15.8:0/3886209489 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f80b0070 con 0x7fd808151bb0 2024-03-23T23:54:46.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.081+0000 7fd80f400640 1 --2- 172.21.15.8:0/3886209489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd808151bb0 0x7fd8080c1cb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd808072ae0 tx=0x7fd7f801c280 comp rx=0 tx=0).stop 2024-03-23T23:54:46.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.085+0000 7fd80f400640 1 -- 172.21.15.8:0/3886209489 shutdown_connections 2024-03-23T23:54:46.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.085+0000 7fd80f400640 1 --2- 172.21.15.8:0/3886209489 >> v2:172.21.15.196:3300/0 conn(0x7fd80806ea50 0x7fd80814eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:46.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.085+0000 7fd80f400640 1 --2- 172.21.15.8:0/3886209489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd808151bb0 0x7fd8080c1cb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:46.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.085+0000 7fd80f400640 1 -- 172.21.15.8:0/3886209489 >> 172.21.15.8:0/3886209489 conn(0x7fd8080a9870 msgr2=0x7fd80806b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:54:46.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.089+0000 7fd80f400640 1 -- 172.21.15.8:0/3886209489 shutdown_connections 2024-03-23T23:54:46.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.089+0000 7fd80f400640 1 -- 172.21.15.8:0/3886209489 wait complete. 2024-03-23T23:54:46.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.097+0000 7fd80f400640 1 Processor -- start 2024-03-23T23:54:46.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.097+0000 7fd80f400640 1 -- start start 2024-03-23T23:54:46.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.101+0000 7fd80f400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd80806ea50 0x7fd8080c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:46.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.101+0000 7fd80f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd808151bb0 0x7fd8081e7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:46.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.101+0000 7fd80ca00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd80806ea50 0x7fd8080c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:46.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.105+0000 7fd80ca00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd80806ea50 0x7fd8080c6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:43508/0 (socket says 172.21.15.8:43508) 2024-03-23T23:54:46.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.105+0000 7fd80f400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd808151f90 0x7fd808140250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:46.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.105+0000 7fd80f400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80814f440 con 0x7fd808151bb0 2024-03-23T23:54:46.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.105+0000 7fd80f400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80814f2c0 con 0x7fd80806ea50 2024-03-23T23:54:46.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.105+0000 7fd80f400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8081f32c0 con 0x7fd808151f90 2024-03-23T23:54:46.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.105+0000 7fd80ca00640 1 -- 172.21.15.8:0/1640684347 learned_addr learned my addr 172.21.15.8:0/1640684347 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:54:46.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.105+0000 7fd80d400640 1 --2- 172.21.15.8:0/1640684347 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd808151f90 0x7fd808140250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:46.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.105+0000 7fd80d400640 1 -- 172.21.15.8:0/1640684347 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd808151f90 msgr2=0x7fd808140250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-03-23T23:54:46.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.105+0000 7fd80d400640 1 -- 172.21.15.8:0/1640684347 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd808151f90 msgr2=0x7fd808140250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T23:54:46.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.105+0000 7fd80d400640 1 --2- 172.21.15.8:0/1640684347 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd808151f90 0x7fd808140250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:54:46.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.105+0000 7fd80d400640 1 --2- 172.21.15.8:0/1640684347 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd808151f90 0x7fd808140250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:54:46.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.109+0000 7fd80ca00640 1 -- 172.21.15.8:0/1640684347 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd808151f90 msgr2=0x7fd808140250 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:54:46.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.109+0000 7fd80ca00640 1 --2- 172.21.15.8:0/1640684347 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd808151f90 0x7fd808140250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:46.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.109+0000 7fd80ca00640 1 -- 172.21.15.8:0/1640684347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd808151bb0 msgr2=0x7fd8081e7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:46.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.109+0000 7fd80ca00640 1 --2- 172.21.15.8:0/1640684347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd808151bb0 0x7fd8081e7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:46.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.109+0000 7fd80ca00640 1 -- 172.21.15.8:0/1640684347 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8080c6600 con 0x7fd80806ea50 2024-03-23T23:54:46.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.113+0000 7fd80ca00640 1 --2- 172.21.15.8:0/1640684347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd80806ea50 0x7fd8080c6c50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8000c10 tx=0x7fd7f800abe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:46.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.113+0000 7fd804c00640 1 -- 172.21.15.8:0/1640684347 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f80bb020 con 0x7fd80806ea50 2024-03-23T23:54:46.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.113+0000 7fd804c00640 1 -- 172.21.15.8:0/1640684347 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f800a2d0 con 0x7fd80806ea50 2024-03-23T23:54:46.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.113+0000 7fd804c00640 1 -- 172.21.15.8:0/1640684347 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f80b0040 con 0x7fd80806ea50 2024-03-23T23:54:46.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.117+0000 7fd80f400640 1 -- 172.21.15.8:0/1640684347 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8080c1820 con 0x7fd80806ea50 2024-03-23T23:54:46.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.117+0000 7fd80f400640 1 -- 172.21.15.8:0/1640684347 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8081f2fe0 con 0x7fd80806ea50 2024-03-23T23:54:46.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.121+0000 7fd80f400640 1 --2- 172.21.15.8:0/1640684347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd80814c690 0x7fd808140790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:46.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.121+0000 7fd80f400640 1 -- 172.21.15.8:0/1640684347 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd808150740 con 0x7fd80814c690 2024-03-23T23:54:46.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.125+0000 7fd804c00640 1 -- 172.21.15.8:0/1640684347 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd7f80be020 con 0x7fd80806ea50 2024-03-23T23:54:46.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.129+0000 7fd804c00640 1 --2- 172.21.15.8:0/1640684347 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd7e8067730 0x7fd7e8069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:46.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.129+0000 7fd804c00640 1 -- 172.21.15.8:0/1640684347 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fd7f8120020 con 0x7fd80806ea50 2024-03-23T23:54:46.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.129+0000 7fd80d400640 1 --2- 172.21.15.8:0/1640684347 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd7e8067730 0x7fd7e8069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:46.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.133+0000 7fd807e00640 1 --2- 172.21.15.8:0/1640684347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd80814c690 0x7fd808140790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:46.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.137+0000 7fd807e00640 1 -- 172.21.15.8:0/1640684347 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd808140cd0 con 0x7fd80814c690 2024-03-23T23:54:46.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.137+0000 7fd807e00640 1 --2- 172.21.15.8:0/1640684347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd80814c690 0x7fd808140790 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd8080c1e50 tx=0x7fd7f400c7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:46.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.141+0000 7fd804c00640 1 -- 172.21.15.8:0/1640684347 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f4011850 con 0x7fd80814c690 2024-03-23T23:54:46.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.141+0000 7fd80d400640 1 --2- 172.21.15.8:0/1640684347 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd7e8067730 0x7fd7e8069bf0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd800009470 tx=0x7fd8000094a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:46.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.149+0000 7fd804c00640 1 -- 172.21.15.8:0/1640684347 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fd7f4017070 con 0x7fd80814c690 2024-03-23T23:54:46.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.149+0000 7fd804c00640 1 -- 172.21.15.8:0/1640684347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd80814c690 msgr2=0x7fd808140790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:46.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.149+0000 7fd804c00640 1 --2- 172.21.15.8:0/1640684347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd80814c690 0x7fd808140790 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd8080c1e50 tx=0x7fd7f400c7a0 comp rx=0 tx=0).stop 2024-03-23T23:54:46.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.149+0000 7fd804c00640 1 -- 172.21.15.8:0/1640684347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd80814c690 msgr2=0x7fd808140790 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:54:46.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.149+0000 7fd804c00640 1 --2- 172.21.15.8:0/1640684347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd80814c690 0x7fd808140790 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd8080c1e50 tx=0x7fd7f400c7a0 comp rx=0 tx=0).stop 2024-03-23T23:54:46.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.197+0000 7fd80f400640 1 --2- 172.21.15.8:0/1640684347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8080c5190 0x7fd8080c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:46.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.197+0000 7fd80f400640 1 -- 172.21.15.8:0/1640684347 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8080c19f0 con 0x7fd8080c5190 2024-03-23T23:54:46.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.197+0000 7fd807e00640 1 --2- 172.21.15.8:0/1640684347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8080c5190 0x7fd8080c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:46.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.205+0000 7fd807e00640 1 -- 172.21.15.8:0/1640684347 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd8081f2dd0 con 0x7fd8080c5190 2024-03-23T23:54:46.215 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:54:46.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.213+0000 7fd807e00640 1 --2- 172.21.15.8:0/1640684347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8080c5190 0x7fd8080c55a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd808144ab0 tx=0x7fd7f4001410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:46.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.213+0000 7fd804c00640 1 -- 172.21.15.8:0/1640684347 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f401c230 con 0x7fd8080c5190 2024-03-23T23:54:46.219 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:54:46.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.221+0000 7fd804c00640 1 -- 172.21.15.8:0/1640684347 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4530 (secure 0 0 0) 0x7fd7f401c230 con 0x7fd8080c5190 2024-03-23T23:54:46.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.221+0000 7fd804c00640 1 -- 172.21.15.8:0/1640684347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8080c5190 msgr2=0x7fd8080c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:46.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.221+0000 7fd804c00640 1 --2- 172.21.15.8:0/1640684347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8080c5190 0x7fd8080c55a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd808144ab0 tx=0x7fd7f4001410 comp rx=0 tx=0).stop 2024-03-23T23:54:46.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.221+0000 7fd804c00640 1 -- 172.21.15.8:0/1640684347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8080c5190 msgr2=0x7fd8080c55a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:54:46.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.221+0000 7fd804c00640 1 --2- 172.21.15.8:0/1640684347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8080c5190 0x7fd8080c55a0 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd808144ab0 tx=0x7fd7f4001410 comp rx=0 tx=0).stop 2024-03-23T23:54:46.227 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:54:46.227 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:54:46.227 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:54:46.227 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:54:46.227 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 100, 2024-03-23T23:54:46.227 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:54:46.227 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:54:46.227 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:54:46.227 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:54:46.228 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:54:46.228 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 1, 2024-03-23T23:54:46.228 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:54:46.228 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:54:46.228 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:54:46.228 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:54:46.228 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:54:46.228 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:54:46.228 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:54:46.228 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:54:46.228 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:54:46.228 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:54:46.228 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:54:46.228 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:54:46.229 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:54:46.229 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:54:46.229 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:54:46.229 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:54:46.229 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:54:46.229 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:54:46.229 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:54:46.229 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:54:46.229 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:54:46.229 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:54:46.229 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:54:46.229 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:54:46.229 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:54:46.229 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:54:46.230 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:54:46.230 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:54:46.230 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:54:46.230 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:46.230 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:54:46.230 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:54:46.230 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:54:46.230 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:54:46.230 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:54:46.230 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:54:46.230 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:54:46.230 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:54:46.230 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:54:46.230 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:54:46.231 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:54:46.231 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:54:46.231 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:54:46.231 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:54:46.231 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:54:46.231 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:54:46.231 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:54:46.231 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:54:46.231 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:54:46.231 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:54:46.231 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:54:46.231 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:54:46.231 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:54:46.232 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:54:46.232 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:54:46.232 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:54:46.232 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:54:46.232 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:54:46.232 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:54:46.232 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:54:46.232 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:46.232 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:54:46.232 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:46.232 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:54:46.232 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:54:46.232 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:54:46.232 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:54:46.233 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:46.233 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:54:46.233 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:54:46.233 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:54:46.233 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:46.233 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:46.233 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:54:46.233 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:54:46.233 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:54:46.233 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:46.233 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:54:46.233 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:46.233 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:54:46.233 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:54:46.234 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:54:46.234 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:54:46.234 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:54:46.234 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:46.234 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:46.234 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:54:46.234 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:54:46.234 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:54:46.234 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:54:46.234 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:46.234 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:54:46.234 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:54:46.234 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:54:46.234 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:46.235 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:46.235 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:54:46.235 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:54:46.235 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:54:46.235 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:46.235 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:54:46.235 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:46.235 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:54:46.235 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:54:46.235 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:54:46.235 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:54:46.235 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:54:46.235 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:46.235 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:46.236 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:54:46.236 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:54:46.236 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:54:46.236 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:54:46.236 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:46.236 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:54:46.236 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:54:46.236 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:54:46.236 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:46.236 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:46.236 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:54:46.236 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:54:46.236 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:54:46.236 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:46.237 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:54:46.237 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:46.237 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:54:46.237 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:54:46.237 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:54:46.237 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:54:46.237 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:54:46.237 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:46.237 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:54:46.237 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:46.238 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:54:46.238 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:54:46.238 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:46.238 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:54:46.238 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:54:46.238 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:54:46.238 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:46.238 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:54:46.238 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:54:46.238 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:46.238 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:54:46.238 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:54:46.239 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:54:46.239 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:46.239 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:54:46.239 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:46.239 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:54:46.239 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:54:46.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.229+0000 7fd80f400640 1 -- 172.21.15.8:0/1640684347 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd7e8067730 msgr2=0x7fd7e8069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:46.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.229+0000 7fd80f400640 1 --2- 172.21.15.8:0/1640684347 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd7e8067730 0x7fd7e8069bf0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd800009470 tx=0x7fd8000094a0 comp rx=0 tx=0).stop 2024-03-23T23:54:46.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.229+0000 7fd80f400640 1 -- 172.21.15.8:0/1640684347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd80806ea50 msgr2=0x7fd8080c6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:46.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.229+0000 7fd80f400640 1 --2- 172.21.15.8:0/1640684347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd80806ea50 0x7fd8080c6c50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8000c10 tx=0x7fd7f800abe0 comp rx=0 tx=0).stop 2024-03-23T23:54:46.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.229+0000 7fd80d400640 1 -- 172.21.15.8:0/1640684347 reap_dead start 2024-03-23T23:54:46.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.229+0000 7fd80d400640 1 -- 172.21.15.8:0/1640684347 reap_dead start 2024-03-23T23:54:46.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.233+0000 7fd80f400640 1 -- 172.21.15.8:0/1640684347 shutdown_connections 2024-03-23T23:54:46.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.233+0000 7fd80f400640 1 -- 172.21.15.8:0/1640684347 >> 172.21.15.8:0/1640684347 conn(0x7fd8080a9870 msgr2=0x7fd80814df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:54:46.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.245+0000 7fd80f400640 1 -- 172.21.15.8:0/1640684347 shutdown_connections 2024-03-23T23:54:46.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.245+0000 7fd80f400640 1 -- 172.21.15.8:0/1640684347 wait complete. 2024-03-23T23:54:46.317 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:54:46.317 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T23:54:46.318 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:54:46.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.693+0000 7f6153400640 1 Processor -- start 2024-03-23T23:54:46.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.693+0000 7f6153400640 1 -- start start 2024-03-23T23:54:46.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.697+0000 7f6153400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f614c0b09b0 0x7f614c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:46.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.697+0000 7f6153400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c0c9160 0x7f614c1591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:46.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.697+0000 7f6153400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f614c0c63f0 con 0x7f614c0cbeb0 2024-03-23T23:54:46.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.697+0000 7f6153400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f614c0c9880 con 0x7f614c0b09b0 2024-03-23T23:54:46.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.697+0000 7f6153400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614c0c5be0 con 0x7f614c0c9160 2024-03-23T23:54:46.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.697+0000 7f6151400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f614c0cbeb0 0x7f614c159710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:40496/0 (socket says 172.21.15.8:40496) 2024-03-23T23:54:46.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.697+0000 7f6151400640 1 -- 172.21.15.8:0/651096382 learned_addr learned my addr 172.21.15.8:0/651096382 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:54:46.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.697+0000 7f614be00640 1 --2- 172.21.15.8:0/651096382 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c0c9160 0x7f614c1591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:46.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.701+0000 7f6150a00640 1 --2- 172.21.15.8:0/651096382 >> v2:172.21.15.8:3300/0 conn(0x7f614c0b09b0 0x7f614c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:46.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.701+0000 7f614b400640 1 -- 172.21.15.8:0/651096382 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 366407323 0 0) 0x7f613c001120 con 0x7f614c0cbeb0 2024-03-23T23:54:46.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.701+0000 7f614b400640 1 -- 172.21.15.8:0/651096382 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6130003530 con 0x7f614c0cbeb0 2024-03-23T23:54:46.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.701+0000 7f6150a00640 1 -- 172.21.15.8:0/651096382 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c0c9160 msgr2=0x7f614c1591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:54:46.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.701+0000 7f6150a00640 1 --2- 172.21.15.8:0/651096382 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c0c9160 0x7f614c1591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:46.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.701+0000 7f6150a00640 1 -- 172.21.15.8:0/651096382 >> v1:172.21.15.196:6789/0 conn(0x7f614c0cbeb0 legacy=0x7f614c159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:46.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.701+0000 7f6150a00640 1 -- 172.21.15.8:0/651096382 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c156640 con 0x7f614c0b09b0 2024-03-23T23:54:46.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.705+0000 7f6150a00640 1 --2- 172.21.15.8:0/651096382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f614c0b09b0 0x7f614c0cb970 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6144009d90 tx=0x7f614401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b17060c7cc051503 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:46.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.709+0000 7f614b400640 1 -- 172.21.15.8:0/651096382 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61440b2070 con 0x7f614c0b09b0 2024-03-23T23:54:46.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.709+0000 7f614b400640 1 -- 172.21.15.8:0/651096382 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61440a5890 con 0x7f614c0b09b0 2024-03-23T23:54:46.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.709+0000 7f614b400640 1 -- 172.21.15.8:0/651096382 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61440a5c40 con 0x7f614c0b09b0 2024-03-23T23:54:46.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.713+0000 7f6153400640 1 -- 172.21.15.8:0/651096382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f614c0b09b0 msgr2=0x7f614c0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:46.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.713+0000 7f6153400640 1 --2- 172.21.15.8:0/651096382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f614c0b09b0 0x7f614c0cb970 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6144009d90 tx=0x7f614401c8e0 comp rx=0 tx=0).stop 2024-03-23T23:54:46.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.713+0000 7f6153400640 1 -- 172.21.15.8:0/651096382 shutdown_connections 2024-03-23T23:54:46.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.713+0000 7f6153400640 1 --2- 172.21.15.8:0/651096382 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c0c9160 0x7f614c1591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:46.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.713+0000 7f6153400640 1 --2- 172.21.15.8:0/651096382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f614c0b09b0 0x7f614c0cb970 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:46.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.713+0000 7f6153400640 1 -- 172.21.15.8:0/651096382 >> 172.21.15.8:0/651096382 conn(0x7f614c0ad450 msgr2=0x7f614c0cb260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:54:46.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.713+0000 7f6153400640 1 -- 172.21.15.8:0/651096382 shutdown_connections 2024-03-23T23:54:46.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.713+0000 7f6153400640 1 -- 172.21.15.8:0/651096382 wait complete. 2024-03-23T23:54:46.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.717+0000 7f6153400640 1 Processor -- start 2024-03-23T23:54:46.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.721+0000 7f6153400640 1 -- start start 2024-03-23T23:54:46.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.721+0000 7f6153400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f614c0b09b0 0x7f614c14fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:46.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.721+0000 7f6153400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c0c9160 0x7f614c14ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:46.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.721+0000 7f6153400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f614c0cbeb0 0x7f614c14f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:46.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.721+0000 7f6153400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c162b20 con 0x7f614c0cbeb0 2024-03-23T23:54:46.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.721+0000 7f6153400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c1629a0 con 0x7f614c0b09b0 2024-03-23T23:54:46.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.721+0000 7f6153400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614c162ca0 con 0x7f614c0c9160 2024-03-23T23:54:46.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.721+0000 7f614be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c0c9160 0x7f614c14ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:46.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.721+0000 7f614be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c0c9160 0x7f614c14ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:43564/0 (socket says 172.21.15.8:43564) 2024-03-23T23:54:46.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.721+0000 7f614be00640 1 -- 172.21.15.8:0/4225170856 learned_addr learned my addr 172.21.15.8:0/4225170856 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:54:46.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.721+0000 7f6151400640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f614c0cbeb0 0x7f614c14f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:46.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.721+0000 7f6150a00640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f614c0b09b0 0x7f614c14fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:46.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.721+0000 7f614be00640 1 -- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c0c9160 msgr2=0x7f614c14ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-03-23T23:54:46.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.721+0000 7f614be00640 1 -- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c0c9160 msgr2=0x7f614c14ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T23:54:46.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.721+0000 7f614be00640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c0c9160 0x7f614c14ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:54:46.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.721+0000 7f614be00640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c0c9160 0x7f614c14ec70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:54:46.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.721+0000 7f6151400640 1 -- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c0c9160 msgr2=0x7f614c14ec70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:54:46.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.721+0000 7f6151400640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c0c9160 0x7f614c14ec70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:46.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.721+0000 7f6151400640 1 -- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f614c0b09b0 msgr2=0x7f614c14fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:46.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.721+0000 7f6151400640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f614c0b09b0 0x7f614c14fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:46.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.721+0000 7f6151400640 1 -- 172.21.15.8:0/4225170856 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c157d90 con 0x7f614c0cbeb0 2024-03-23T23:54:46.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.725+0000 7f6151400640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f614c0cbeb0 0x7f614c14f1b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f613c007f50 tx=0x7f613c00c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:46.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.725+0000 7f6148c00640 1 -- 172.21.15.8:0/4225170856 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c039070 con 0x7f614c0cbeb0 2024-03-23T23:54:46.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.725+0000 7f6148c00640 1 -- 172.21.15.8:0/4225170856 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613c005af0 con 0x7f614c0cbeb0 2024-03-23T23:54:46.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.725+0000 7f6153400640 1 -- 172.21.15.8:0/4225170856 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f614c152070 con 0x7f614c0cbeb0 2024-03-23T23:54:46.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.725+0000 7f6148c00640 1 -- 172.21.15.8:0/4225170856 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c0070d0 con 0x7f614c0cbeb0 2024-03-23T23:54:46.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.725+0000 7f6153400640 1 -- 172.21.15.8:0/4225170856 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f614c152630 con 0x7f614c0cbeb0 2024-03-23T23:54:46.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.725+0000 7f6153400640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c1553b0 0x7f614c14f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:46.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.725+0000 7f6153400640 1 -- 172.21.15.8:0/4225170856 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614c068270 con 0x7f614c1553b0 2024-03-23T23:54:46.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.725+0000 7f6150a00640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c1553b0 0x7f614c14f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:46.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.725+0000 7f6150a00640 1 -- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c1553b0 msgr2=0x7f614c14f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-03-23T23:54:46.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.725+0000 7f6150a00640 1 -- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c1553b0 msgr2=0x7f614c14f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T23:54:46.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.725+0000 7f6150a00640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c1553b0 0x7f614c14f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:54:46.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.725+0000 7f6150a00640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c1553b0 0x7f614c14f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:54:46.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.733+0000 7f6148c00640 1 -- 172.21.15.8:0/4225170856 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f613c03c070 con 0x7f614c0cbeb0 2024-03-23T23:54:46.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.733+0000 7f6148c00640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f612c0676b0 0x7f612c069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:46.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.733+0000 7f6148c00640 1 -- 172.21.15.8:0/4225170856 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f613c0a6df0 con 0x7f614c0cbeb0 2024-03-23T23:54:46.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.737+0000 7f614be00640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f612c0676b0 0x7f612c069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:46.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.745+0000 7f614be00640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f612c0676b0 0x7f612c069b70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f614c0c2080 tx=0x7f6138008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:46.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.929+0000 7f6150a00640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c1553b0 0x7f614c14f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:46.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.929+0000 7f6150a00640 1 -- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c1553b0 msgr2=0x7f614c14f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-03-23T23:54:46.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.929+0000 7f6150a00640 1 -- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c1553b0 msgr2=0x7f614c14f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T23:54:46.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.929+0000 7f6150a00640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c1553b0 0x7f614c14f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:54:46.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:46.929+0000 7f6150a00640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c1553b0 0x7f614c14f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:54:47.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:47.341+0000 7f6150a00640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c1553b0 0x7f614c14f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:47.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:47.341+0000 7f6150a00640 1 -- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c1553b0 msgr2=0x7f614c14f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-03-23T23:54:47.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:47.345+0000 7f6150a00640 1 -- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c1553b0 msgr2=0x7f614c14f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T23:54:47.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:47.345+0000 7f6150a00640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c1553b0 0x7f614c14f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:54:47.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:47.345+0000 7f6150a00640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c1553b0 0x7f614c14f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:54:48.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:48.153+0000 7f6150a00640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c1553b0 0x7f614c14f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:48.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:48.153+0000 7f6150a00640 1 -- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c1553b0 msgr2=0x7f614c14f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-03-23T23:54:48.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:48.153+0000 7f6150a00640 1 -- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c1553b0 msgr2=0x7f614c14f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T23:54:48.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:48.153+0000 7f6150a00640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c1553b0 0x7f614c14f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:54:48.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:48.153+0000 7f6150a00640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c1553b0 0x7f614c14f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:54:49.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:49.757+0000 7f6150a00640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c1553b0 0x7f614c14f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:49.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:49.757+0000 7f6150a00640 1 -- 172.21.15.8:0/4225170856 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f614c15ff60 con 0x7f614c1553b0 2024-03-23T23:54:49.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:49.757+0000 7f6150a00640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c1553b0 0x7f614c14f6f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f614c0680e0 tx=0x7f6144019680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:49.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:49.761+0000 7f6148c00640 1 -- 172.21.15.8:0/4225170856 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61440b2040 con 0x7f614c1553b0 2024-03-23T23:54:49.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:49.765+0000 7f6148c00640 1 -- 172.21.15.8:0/4225170856 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f61440c2470 con 0x7f614c1553b0 2024-03-23T23:54:49.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:49.765+0000 7f6148c00640 1 -- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c1553b0 msgr2=0x7f614c14f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:49.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:49.765+0000 7f6148c00640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c1553b0 0x7f614c14f6f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f614c0680e0 tx=0x7f6144019680 comp rx=0 tx=0).stop 2024-03-23T23:54:49.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:49.765+0000 7f6148c00640 1 -- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c1553b0 msgr2=0x7f614c14f6f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:54:49.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:49.765+0000 7f6148c00640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c1553b0 0x7f614c14f6f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:49.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:49.773+0000 7f6153400640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c157810 0x7f614c153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:49.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:49.773+0000 7f6153400640 1 -- 172.21.15.8:0/4225170856 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614c06dd70 con 0x7f614c157810 2024-03-23T23:54:49.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:49.773+0000 7f6150a00640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c157810 0x7f614c153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:49.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:49.777+0000 7f6150a00640 1 -- 172.21.15.8:0/4225170856 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f614c159960 con 0x7f614c157810 2024-03-23T23:54:49.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:49.777+0000 7f6150a00640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c157810 0x7f614c153e70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f614401c920 tx=0x7f6144009750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:49.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:49.777+0000 7f6148c00640 1 -- 172.21.15.8:0/4225170856 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61440b2050 con 0x7f614c157810 2024-03-23T23:54:49.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:49.777+0000 7f6148c00640 1 -- 172.21.15.8:0/4225170856 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4530 (secure 0 0 0) 0x7f6144009a30 con 0x7f614c157810 2024-03-23T23:54:49.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:49.777+0000 7f6148c00640 1 -- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c157810 msgr2=0x7f614c153e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:49.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:49.777+0000 7f6148c00640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c157810 0x7f614c153e70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f614401c920 tx=0x7f6144009750 comp rx=0 tx=0).stop 2024-03-23T23:54:49.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:49.777+0000 7f6148c00640 1 -- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c157810 msgr2=0x7f614c153e70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:54:49.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:49.777+0000 7f6148c00640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f614c157810 0x7f614c153e70 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f614401c920 tx=0x7f6144009750 comp rx=0 tx=0).stop 2024-03-23T23:54:49.780 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:54:49.781 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:54:49.781 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:54:49.781 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:54:49.781 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 100, 2024-03-23T23:54:49.781 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:54:49.782 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:54:49.782 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:54:49.782 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:54:49.782 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:54:49.782 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 5, 2024-03-23T23:54:49.782 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:54:49.782 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:54:49.783 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:54:49.783 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:54:49.783 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:54:49.783 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:54:49.783 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:54:49.783 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:54:49.783 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:54:49.784 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:54:49.784 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:54:49.784 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:54:49.784 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:54:49.784 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:54:49.784 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:54:49.785 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:54:49.785 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:54:49.785 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:54:49.785 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:54:49.785 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:54:49.785 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:54:49.786 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:54:49.786 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:54:49.786 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:54:49.786 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:54:49.786 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:54:49.786 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:54:49.787 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:54:49.787 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:54:49.787 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:49.787 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:54:49.787 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:54:49.788 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:54:49.788 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:54:49.788 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:54:49.788 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:54:49.788 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:54:49.789 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:54:49.789 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:54:49.789 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:54:49.790 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:54:49.790 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:54:49.790 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:54:49.790 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:54:49.790 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:54:49.791 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:54:49.791 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:54:49.791 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:54:49.791 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:54:49.791 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:54:49.791 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:54:49.791 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:54:49.792 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:54:49.792 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:54:49.792 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:54:49.792 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:54:49.793 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:54:49.793 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:54:49.793 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:54:49.793 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:54:49.793 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:49.793 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:54:49.794 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:49.794 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:54:49.794 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:54:49.794 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:54:49.794 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:54:49.794 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:49.794 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:54:49.795 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:54:49.795 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:54:49.795 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:49.795 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:49.795 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:54:49.795 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:54:49.796 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:54:49.796 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:49.796 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:54:49.796 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:49.796 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:54:49.796 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:54:49.796 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:54:49.796 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:54:49.797 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:54:49.797 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:49.797 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:49.797 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:54:49.797 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:54:49.797 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:54:49.797 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:54:49.797 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:49.797 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:54:49.797 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:54:49.797 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:54:49.797 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:49.797 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:49.798 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:54:49.798 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:54:49.798 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:54:49.798 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:49.798 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:54:49.798 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:49.798 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:54:49.798 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:54:49.798 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:54:49.798 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:54:49.798 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:54:49.798 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:49.799 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:49.799 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:54:49.799 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:54:49.799 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:54:49.799 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:54:49.799 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:49.799 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:54:49.799 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:54:49.799 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:54:49.799 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:49.799 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:49.800 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:54:49.800 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:54:49.800 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:54:49.800 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:49.800 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:54:49.800 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:49.800 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:54:49.800 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:54:49.800 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:54:49.800 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:54:49.800 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:54:49.801 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:49.801 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:54:49.801 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:49.801 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:54:49.801 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:54:49.801 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:49.801 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:54:49.801 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:54:49.802 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:54:49.802 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:49.802 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:54:49.802 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:54:49.802 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:54:49.802 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:54:49.803 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:54:49.803 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:54:49.803 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:54:49.803 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:54:49.803 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:54:49.803 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:54:49.804 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:54:49.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:49.777+0000 7f6153400640 1 -- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f612c0676b0 msgr2=0x7f612c069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:49.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:49.777+0000 7f6153400640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f612c0676b0 0x7f612c069b70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f614c0c2080 tx=0x7f6138008040 comp rx=0 tx=0).stop 2024-03-23T23:54:49.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:49.777+0000 7f6153400640 1 -- 172.21.15.8:0/4225170856 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f614c0cbeb0 msgr2=0x7f614c14f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:49.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:49.777+0000 7f6153400640 1 --2- 172.21.15.8:0/4225170856 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f614c0cbeb0 0x7f614c14f1b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f613c007f50 tx=0x7f613c00c7a0 comp rx=0 tx=0).stop 2024-03-23T23:54:49.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:49.777+0000 7f6151400640 1 -- 172.21.15.8:0/4225170856 reap_dead start 2024-03-23T23:54:49.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:49.777+0000 7f6151400640 1 -- 172.21.15.8:0/4225170856 reap_dead start 2024-03-23T23:54:49.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:49.777+0000 7f6153400640 1 -- 172.21.15.8:0/4225170856 shutdown_connections 2024-03-23T23:54:49.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:49.777+0000 7f6153400640 1 -- 172.21.15.8:0/4225170856 >> 172.21.15.8:0/4225170856 conn(0x7f614c0ad450 msgr2=0x7f614c0ac660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:54:49.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:49.777+0000 7f6153400640 1 -- 172.21.15.8:0/4225170856 shutdown_connections 2024-03-23T23:54:49.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:49.777+0000 7f6153400640 1 -- 172.21.15.8:0/4225170856 wait complete. 2024-03-23T23:54:49.807 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:54:49.808 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-03-23T23:54:49.808 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-03-23T23:54:50.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.117+0000 7fa0cea00640 1 Processor -- start 2024-03-23T23:54:50.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.117+0000 7fa0cea00640 1 -- start start 2024-03-23T23:54:50.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.121+0000 7fa0cea00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa0c00496e0 0x7fa0c004ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:50.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.121+0000 7fa0cea00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0c0006a10 0x7fa0c0006e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:50.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.121+0000 7fa0cea00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c0046970 con 0x7fa0c000b080 2024-03-23T23:54:50.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.121+0000 7fa0cea00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c00d6fa0 con 0x7fa0c00496e0 2024-03-23T23:54:50.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.121+0000 7fa0cea00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c00d74d0 con 0x7fa0c0006a10 2024-03-23T23:54:50.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.125+0000 7fa0cd600640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fa0c000b080 0x7fa0c00d39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39476/0 (socket says 172.21.15.8:39476) 2024-03-23T23:54:50.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.125+0000 7fa0cd600640 1 -- 172.21.15.8:0/3532841843 learned_addr learned my addr 172.21.15.8:0/3532841843 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:54:50.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.125+0000 7fa0c7e00640 1 -- 172.21.15.8:0/3532841843 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3693086112 0 0) 0x7fa0c0046970 con 0x7fa0c000b080 2024-03-23T23:54:50.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.125+0000 7fa0c7e00640 1 -- 172.21.15.8:0/3532841843 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0b0003530 con 0x7fa0c000b080 2024-03-23T23:54:50.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.129+0000 7fa0ccc00640 1 --2- 172.21.15.8:0/3532841843 >> v2:172.21.15.196:3300/0 conn(0x7fa0c00496e0 0x7fa0c004ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:50.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.129+0000 7fa0c7e00640 1 -- 172.21.15.8:0/3532841843 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 346463136 0 0) 0x7fa0b0003530 con 0x7fa0c000b080 2024-03-23T23:54:50.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.129+0000 7fa0c7e00640 1 -- 172.21.15.8:0/3532841843 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0c0006a10 msgr2=0x7fa0c0006e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:54:50.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.129+0000 7fa0c7e00640 1 --2- 172.21.15.8:0/3532841843 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0c0006a10 0x7fa0c0006e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:50.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.129+0000 7fa0c7e00640 1 -- 172.21.15.8:0/3532841843 >> v2:172.21.15.196:3300/0 conn(0x7fa0c00496e0 msgr2=0x7fa0c004ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:54:50.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.129+0000 7fa0c7e00640 1 --2- 172.21.15.8:0/3532841843 >> v2:172.21.15.196:3300/0 conn(0x7fa0c00496e0 0x7fa0c004ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:50.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.129+0000 7fa0c7e00640 1 -- 172.21.15.8:0/3532841843 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c002e0d0 con 0x7fa0c000b080 2024-03-23T23:54:50.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.129+0000 7fa0c7e00640 1 -- 172.21.15.8:0/3532841843 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7fa0bc001680 con 0x7fa0c000b080 2024-03-23T23:54:50.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.129+0000 7fa0c7e00640 1 -- 172.21.15.8:0/3532841843 >> v1:172.21.15.8:6789/0 conn(0x7fa0c000b080 legacy=0x7fa0c00d39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:50.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.133+0000 7fa0c7e00640 1 --2- 172.21.15.8:0/3532841843 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0b00039c0 0x7fa0b0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:50.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.133+0000 7fa0c7e00640 1 --2- 172.21.15.8:0/3532841843 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0c0006a10 0x7fa0b0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:50.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.133+0000 7fa0c7e00640 1 --2- 172.21.15.8:0/3532841843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0b0004da0 0x7fa0b0005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:50.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.133+0000 7fa0c7e00640 1 -- 172.21.15.8:0/3532841843 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c00d6fa0 con 0x7fa0b0004da0 2024-03-23T23:54:50.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.133+0000 7fa0ccc00640 1 --2- 172.21.15.8:0/3532841843 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0c0006a10 0x7fa0b0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:50.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.133+0000 7fa0c7e00640 1 -- 172.21.15.8:0/3532841843 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c00d74d0 con 0x7fa0b00039c0 2024-03-23T23:54:50.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.133+0000 7fa0c7e00640 1 -- 172.21.15.8:0/3532841843 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b000bc80 con 0x7fa0c0006a10 2024-03-23T23:54:50.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.133+0000 7fa0ce000640 1 --2- 172.21.15.8:0/3532841843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0b0004da0 0x7fa0b0005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:50.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.133+0000 7fa0ccc00640 1 -- 172.21.15.8:0/3532841843 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0b00039c0 msgr2=0x7fa0b0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:54:50.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.133+0000 7fa0ccc00640 1 --2- 172.21.15.8:0/3532841843 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0b00039c0 0x7fa0b0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:50.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.133+0000 7fa0ccc00640 1 -- 172.21.15.8:0/3532841843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0b0004da0 msgr2=0x7fa0b0005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:54:50.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.133+0000 7fa0ccc00640 1 --2- 172.21.15.8:0/3532841843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0b0004da0 0x7fa0b0005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:50.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.133+0000 7fa0ccc00640 1 -- 172.21.15.8:0/3532841843 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b0003530 con 0x7fa0c0006a10 2024-03-23T23:54:50.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.141+0000 7fa0ccc00640 1 --2- 172.21.15.8:0/3532841843 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0c0006a10 0x7fa0b0004810 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400ba30 tx=0x7fa0b401c700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb1cd732b878cf66 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:50.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.145+0000 7fa0c7e00640 1 -- 172.21.15.8:0/3532841843 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b40b2070 con 0x7fa0c0006a10 2024-03-23T23:54:50.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.145+0000 7fa0c7e00640 1 -- 172.21.15.8:0/3532841843 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b40ad3f0 con 0x7fa0c0006a10 2024-03-23T23:54:50.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.145+0000 7fa0c7e00640 1 -- 172.21.15.8:0/3532841843 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b400b600 con 0x7fa0c0006a10 2024-03-23T23:54:50.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.145+0000 7fa0cea00640 1 -- 172.21.15.8:0/3532841843 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0c0006a10 msgr2=0x7fa0b0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:50.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.145+0000 7fa0cea00640 1 --2- 172.21.15.8:0/3532841843 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0c0006a10 0x7fa0b0004810 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400ba30 tx=0x7fa0b401c700 comp rx=0 tx=0).stop 2024-03-23T23:54:50.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.145+0000 7fa0ce000640 1 -- 172.21.15.8:0/3532841843 reap_dead start 2024-03-23T23:54:50.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.149+0000 7fa0cea00640 1 -- 172.21.15.8:0/3532841843 shutdown_connections 2024-03-23T23:54:50.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.149+0000 7fa0cea00640 1 -- 172.21.15.8:0/3532841843 >> 172.21.15.8:0/3532841843 conn(0x7fa0c0005ef0 msgr2=0x7fa0c0006300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:54:50.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.149+0000 7fa0cea00640 1 -- 172.21.15.8:0/3532841843 shutdown_connections 2024-03-23T23:54:50.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.153+0000 7fa0cea00640 1 -- 172.21.15.8:0/3532841843 wait complete. 2024-03-23T23:54:50.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.157+0000 7fa0cea00640 1 Processor -- start 2024-03-23T23:54:50.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.161+0000 7fa0cea00640 1 -- start start 2024-03-23T23:54:50.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.161+0000 7fa0cea00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0c0006a10 0x7fa0c002bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:50.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.161+0000 7fa0cea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0c0045030 0x7fa0c00d8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:50.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.161+0000 7fa0cea00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0c00d8ac0 0x7fa0c002fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:50.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.161+0000 7fa0cea00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c0049af0 con 0x7fa0c0045030 2024-03-23T23:54:50.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.161+0000 7fa0cea00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c0046ce0 con 0x7fa0c00d8ac0 2024-03-23T23:54:50.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.161+0000 7fa0cea00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c00462f0 con 0x7fa0c0006a10 2024-03-23T23:54:50.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.161+0000 7fa0cd600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0c0006a10 0x7fa0c002bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:50.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.161+0000 7fa0cd600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0c0006a10 0x7fa0c002bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:43650/0 (socket says 172.21.15.8:43650) 2024-03-23T23:54:50.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.161+0000 7fa0cd600640 1 -- 172.21.15.8:0/3720411164 learned_addr learned my addr 172.21.15.8:0/3720411164 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:54:50.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.165+0000 7fa0cd600640 1 -- 172.21.15.8:0/3720411164 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0c00d8ac0 msgr2=0x7fa0c002fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:50.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.165+0000 7fa0cd600640 1 --2- 172.21.15.8:0/3720411164 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0c00d8ac0 0x7fa0c002fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:50.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.165+0000 7fa0cd600640 1 -- 172.21.15.8:0/3720411164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0c0045030 msgr2=0x7fa0c00d8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:50.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.165+0000 7fa0cd600640 1 --2- 172.21.15.8:0/3720411164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0c0045030 0x7fa0c00d8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:50.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.165+0000 7fa0cd600640 1 -- 172.21.15.8:0/3720411164 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c00454c0 con 0x7fa0c0006a10 2024-03-23T23:54:50.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.173+0000 7fa0cd600640 1 --2- 172.21.15.8:0/3720411164 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0c0006a10 0x7fa0c002bb60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc00c810 tx=0x7fa0bc00ccd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:50.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.177+0000 7fa0c5600640 1 -- 172.21.15.8:0/3720411164 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc018070 con 0x7fa0c0006a10 2024-03-23T23:54:50.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.177+0000 7fa0cea00640 1 -- 172.21.15.8:0/3720411164 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c0042950 con 0x7fa0c0006a10 2024-03-23T23:54:50.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.177+0000 7fa0cea00640 1 -- 172.21.15.8:0/3720411164 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c0042f10 con 0x7fa0c0006a10 2024-03-23T23:54:50.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.177+0000 7fa0c5600640 1 -- 172.21.15.8:0/3720411164 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0bc00a5e0 con 0x7fa0c0006a10 2024-03-23T23:54:50.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.177+0000 7fa0c5600640 1 -- 172.21.15.8:0/3720411164 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc00a9d0 con 0x7fa0c0006a10 2024-03-23T23:54:50.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.181+0000 7fa0baa00640 1 -- 172.21.15.8:0/3720411164 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa09c0052a0 con 0x7fa0c0006a10 2024-03-23T23:54:50.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.181+0000 7fa0c5600640 1 -- 172.21.15.8:0/3720411164 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fa0bc01b070 con 0x7fa0c0006a10 2024-03-23T23:54:50.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.185+0000 7fa0c5600640 1 --2- 172.21.15.8:0/3720411164 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa0a80676b0 0x7fa0a8069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:54:50.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.185+0000 7fa0c5600640 1 -- 172.21.15.8:0/3720411164 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fa0bc085380 con 0x7fa0c0006a10 2024-03-23T23:54:50.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.185+0000 7fa0ccc00640 1 --2- 172.21.15.8:0/3720411164 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa0a80676b0 0x7fa0a8069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:54:50.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.201+0000 7fa0ccc00640 1 --2- 172.21.15.8:0/3720411164 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa0a80676b0 0x7fa0a8069b70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa0b40af000 tx=0x7fa0b4004740 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:54:50.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.217+0000 7fa0c5600640 1 -- 172.21.15.8:0/3720411164 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fa0bc055c20 con 0x7fa0c0006a10 2024-03-23T23:54:50.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.853+0000 7fa0baa00640 1 -- 172.21.15.8:0/3720411164 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fa09c005da0 con 0x7fa0c0006a10 2024-03-23T23:54:50.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.877+0000 7fa0c5600640 1 -- 172.21.15.8:0/3720411164 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fa0bc055520 con 0x7fa0c0006a10 2024-03-23T23:54:50.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.881+0000 7fa0baa00640 1 -- 172.21.15.8:0/3720411164 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa0a80676b0 msgr2=0x7fa0a8069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:50.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.881+0000 7fa0baa00640 1 --2- 172.21.15.8:0/3720411164 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa0a80676b0 0x7fa0a8069b70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa0b40af000 tx=0x7fa0b4004740 comp rx=0 tx=0).stop 2024-03-23T23:54:50.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.885+0000 7fa0baa00640 1 -- 172.21.15.8:0/3720411164 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0c0006a10 msgr2=0x7fa0c002bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:54:50.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.885+0000 7fa0baa00640 1 --2- 172.21.15.8:0/3720411164 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0c0006a10 0x7fa0c002bb60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc00c810 tx=0x7fa0bc00ccd0 comp rx=0 tx=0).stop 2024-03-23T23:54:50.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.885+0000 7fa0baa00640 1 -- 172.21.15.8:0/3720411164 shutdown_connections 2024-03-23T23:54:50.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.885+0000 7fa0baa00640 1 --2- 172.21.15.8:0/3720411164 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0c00d8ac0 0x7fa0c002fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:50.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.885+0000 7fa0baa00640 1 --2- 172.21.15.8:0/3720411164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0c0045030 0x7fa0c00d8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:50.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.885+0000 7fa0baa00640 1 --2- 172.21.15.8:0/3720411164 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa0a80676b0 0x7fa0a8069b70 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:50.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.885+0000 7fa0baa00640 1 --2- 172.21.15.8:0/3720411164 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0c0006a10 0x7fa0c002bb60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:54:50.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.885+0000 7fa0baa00640 1 -- 172.21.15.8:0/3720411164 >> 172.21.15.8:0/3720411164 conn(0x7fa0c0005ef0 msgr2=0x7fa0c0004910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:54:50.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.885+0000 7fa0baa00640 1 -- 172.21.15.8:0/3720411164 shutdown_connections 2024-03-23T23:54:50.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:54:50.885+0000 7fa0baa00640 1 -- 172.21.15.8:0/3720411164 wait complete. 2024-03-23T23:54:50.996 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-03-23T23:55:00.997 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T23:55:00.998 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:55:01.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.249+0000 7f3e0da00640 1 Processor -- start 2024-03-23T23:55:01.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.249+0000 7f3e0da00640 1 -- start start 2024-03-23T23:55:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.257+0000 7f3e0da00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e080c3e60 0x7f3e0806caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.257+0000 7f3e0da00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3e081519b0 0x7f3e08151e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.257+0000 7f3e0da00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e08155e70 con 0x7f3e080aa390 2024-03-23T23:55:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.257+0000 7f3e06a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e080c3e60 0x7f3e0806caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.257+0000 7f3e06a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e080c3e60 0x7f3e0806caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:54506/0 (socket says 172.21.15.8:54506) 2024-03-23T23:55:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.257+0000 7f3e06a00640 1 -- 172.21.15.8:0/2640380069 learned_addr learned my addr 172.21.15.8:0/2640380069 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:55:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.257+0000 7f3e07400640 1 --2- 172.21.15.8:0/2640380069 >> v2:172.21.15.8:3300/0 conn(0x7f3e081519b0 0x7f3e08151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:01.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.257+0000 7f3e0da00640 1 -- 172.21.15.8:0/2640380069 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e081550b0 con 0x7f3e081519b0 2024-03-23T23:55:01.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.257+0000 7f3e0da00640 1 -- 172.21.15.8:0/2640380069 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e08155390 con 0x7f3e080c3e60 2024-03-23T23:55:01.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.257+0000 7f3e07400640 1 -- 172.21.15.8:0/2640380069 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e080c3e60 msgr2=0x7f3e0806caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:55:01.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.257+0000 7f3e07400640 1 --2- 172.21.15.8:0/2640380069 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e080c3e60 0x7f3e0806caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:01.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.257+0000 7f3e07400640 1 -- 172.21.15.8:0/2640380069 >> v1:172.21.15.196:6789/0 conn(0x7f3e080aa390 legacy=0x7f3e0814b5a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:55:01.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.257+0000 7f3e07400640 1 -- 172.21.15.8:0/2640380069 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e08155670 con 0x7f3e081519b0 2024-03-23T23:55:01.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.265+0000 7f3e07400640 1 --2- 172.21.15.8:0/2640380069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e081519b0 0x7f3e08151e20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009d90 tx=0x7f3e0001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef0f5a0e75893b0b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:55:01.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.265+0000 7f3e05600640 1 -- 172.21.15.8:0/2640380069 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e000b2070 con 0x7f3e081519b0 2024-03-23T23:55:01.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.265+0000 7f3e05600640 1 -- 172.21.15.8:0/2640380069 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e000a58b0 con 0x7f3e081519b0 2024-03-23T23:55:01.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.269+0000 7f3e0da00640 1 -- 172.21.15.8:0/2640380069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e081519b0 msgr2=0x7f3e08151e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:01.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.269+0000 7f3e0da00640 1 --2- 172.21.15.8:0/2640380069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e081519b0 0x7f3e08151e20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009d90 tx=0x7f3e0001c890 comp rx=0 tx=0).stop 2024-03-23T23:55:01.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.269+0000 7f3e0da00640 1 -- 172.21.15.8:0/2640380069 shutdown_connections 2024-03-23T23:55:01.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.269+0000 7f3e0da00640 1 --2- 172.21.15.8:0/2640380069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e081519b0 0x7f3e08151e20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:01.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.269+0000 7f3e0da00640 1 --2- 172.21.15.8:0/2640380069 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e080c3e60 0x7f3e0806caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:01.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.269+0000 7f3e0da00640 1 -- 172.21.15.8:0/2640380069 >> 172.21.15.8:0/2640380069 conn(0x7f3e0806b170 msgr2=0x7f3e0806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:55:01.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.277+0000 7f3e0da00640 1 -- 172.21.15.8:0/2640380069 shutdown_connections 2024-03-23T23:55:01.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.281+0000 7f3e0da00640 1 -- 172.21.15.8:0/2640380069 wait complete. 2024-03-23T23:55:01.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.289+0000 7f3e0da00640 1 Processor -- start 2024-03-23T23:55:01.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.289+0000 7f3e0da00640 1 -- start start 2024-03-23T23:55:01.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.289+0000 7f3e0da00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e080aa390 0x7f3e0815ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:01.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.289+0000 7f3e0da00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e080c3e60 0x7f3e08144430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:01.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.289+0000 7f3e0da00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e081519b0 0x7f3e081f6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:01.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.289+0000 7f3e0da00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e081524e0 con 0x7f3e081519b0 2024-03-23T23:55:01.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.289+0000 7f3e0da00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e08152360 con 0x7f3e080aa390 2024-03-23T23:55:01.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.289+0000 7f3e0da00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0814bcb0 con 0x7f3e080c3e60 2024-03-23T23:55:01.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.293+0000 7f3e07400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e081519b0 0x7f3e081f6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:01.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.293+0000 7f3e07400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e081519b0 0x7f3e081f6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42290/0 (socket says 172.21.15.8:42290) 2024-03-23T23:55:01.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.293+0000 7f3e07400640 1 -- 172.21.15.8:0/1426796543 learned_addr learned my addr 172.21.15.8:0/1426796543 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:55:01.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.293+0000 7f3e07400640 1 -- 172.21.15.8:0/1426796543 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e080c3e60 msgr2=0x7f3e08144430 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-23T23:55:01.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.293+0000 7f3e07400640 1 --2- 172.21.15.8:0/1426796543 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e080c3e60 0x7f3e08144430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:01.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.293+0000 7f3e07400640 1 -- 172.21.15.8:0/1426796543 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e080aa390 msgr2=0x7f3e0815ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:01.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.293+0000 7f3e07400640 1 --2- 172.21.15.8:0/1426796543 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e080aa390 0x7f3e0815ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:01.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.293+0000 7f3e07400640 1 -- 172.21.15.8:0/1426796543 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e081f6020 con 0x7f3e081519b0 2024-03-23T23:55:01.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.293+0000 7f3e07400640 1 --2- 172.21.15.8:0/1426796543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e081519b0 0x7f3e081f6520 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3e000b0040 tx=0x7f3e00019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:55:01.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.293+0000 7f3dfea00640 1 -- 172.21.15.8:0/1426796543 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e000b2050 con 0x7f3e081519b0 2024-03-23T23:55:01.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.293+0000 7f3dfea00640 1 -- 172.21.15.8:0/1426796543 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e000be070 con 0x7f3e081519b0 2024-03-23T23:55:01.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.293+0000 7f3dfea00640 1 -- 172.21.15.8:0/1426796543 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e00004040 con 0x7f3e081519b0 2024-03-23T23:55:01.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.305+0000 7f3e0da00640 1 -- 172.21.15.8:0/1426796543 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e0815fbd0 con 0x7f3e081519b0 2024-03-23T23:55:01.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.305+0000 7f3e0da00640 1 -- 172.21.15.8:0/1426796543 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e08160190 con 0x7f3e081519b0 2024-03-23T23:55:01.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.309+0000 7f3df3e00640 1 -- 172.21.15.8:0/1426796543 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e0804f480 con 0x7f3e081519b0 2024-03-23T23:55:01.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.313+0000 7f3dfea00640 1 -- 172.21.15.8:0/1426796543 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3e000041e0 con 0x7f3e081519b0 2024-03-23T23:55:01.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.313+0000 7f3dfea00640 1 --2- 172.21.15.8:0/1426796543 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3de8067690 0x7f3de8069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:01.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.313+0000 7f3dfea00640 1 -- 172.21.15.8:0/1426796543 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f3e00120e30 con 0x7f3e081519b0 2024-03-23T23:55:01.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.329+0000 7f3e06a00640 1 --2- 172.21.15.8:0/1426796543 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3de8067690 0x7f3de8069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:01.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.345+0000 7f3e06a00640 1 --2- 172.21.15.8:0/1426796543 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3de8067690 0x7f3de8069b50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009770 tx=0x7f3df4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:55:01.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.349+0000 7f3dfea00640 1 -- 172.21.15.8:0/1426796543 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f3e00016540 con 0x7f3e081519b0 2024-03-23T23:55:01.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.829+0000 7f3df3e00640 1 -- 172.21.15.8:0/1426796543 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f3e080c37b0 con 0x7f3e081519b0 2024-03-23T23:55:01.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.829+0000 7f3dfea00640 1 -- 172.21.15.8:0/1426796543 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1562 (secure 0 0 0) 0x7f3e000f16f0 con 0x7f3e081519b0 2024-03-23T23:55:01.833 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":100,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:55:01.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.833+0000 7f3df3e00640 1 -- 172.21.15.8:0/1426796543 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3de8067690 msgr2=0x7f3de8069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:01.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.833+0000 7f3df3e00640 1 --2- 172.21.15.8:0/1426796543 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3de8067690 0x7f3de8069b50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009770 tx=0x7f3df4008040 comp rx=0 tx=0).stop 2024-03-23T23:55:01.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.833+0000 7f3df3e00640 1 -- 172.21.15.8:0/1426796543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e081519b0 msgr2=0x7f3e081f6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:01.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.833+0000 7f3df3e00640 1 --2- 172.21.15.8:0/1426796543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e081519b0 0x7f3e081f6520 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3e000b0040 tx=0x7f3e00019630 comp rx=0 tx=0).stop 2024-03-23T23:55:01.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.833+0000 7f3df3e00640 1 -- 172.21.15.8:0/1426796543 shutdown_connections 2024-03-23T23:55:01.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.833+0000 7f3df3e00640 1 --2- 172.21.15.8:0/1426796543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e081519b0 0x7f3e081f6520 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:01.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.833+0000 7f3df3e00640 1 --2- 172.21.15.8:0/1426796543 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3de8067690 0x7f3de8069b50 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:01.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.833+0000 7f3df3e00640 1 --2- 172.21.15.8:0/1426796543 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e080c3e60 0x7f3e08144430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:01.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.833+0000 7f3df3e00640 1 --2- 172.21.15.8:0/1426796543 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e080aa390 0x7f3e0815ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:01.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.833+0000 7f3df3e00640 1 -- 172.21.15.8:0/1426796543 >> 172.21.15.8:0/1426796543 conn(0x7f3e0806b170 msgr2=0x7f3e08154670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:55:01.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.837+0000 7f3df3e00640 1 -- 172.21.15.8:0/1426796543 shutdown_connections 2024-03-23T23:55:01.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:01.837+0000 7f3df3e00640 1 -- 172.21.15.8:0/1426796543 wait complete. 2024-03-23T23:55:01.876 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T23:55:01.876 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-03-23T23:55:01.876 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T23:55:01.876 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:55:02.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.273+0000 7f9775000640 1 Processor -- start 2024-03-23T23:55:02.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.273+0000 7f9775000640 1 -- start start 2024-03-23T23:55:02.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.277+0000 7f9775000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97700c3f60 0x7f9770071a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:02.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.277+0000 7f9775000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f97700c3600 0x7f97700c1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:02.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.277+0000 7f9775000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f977015acc0 con 0x7f97700c21b0 2024-03-23T23:55:02.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.277+0000 7f9775000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977015a830 con 0x7f97700c3600 2024-03-23T23:55:02.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.277+0000 7f9775000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9770159f00 con 0x7f97700c3f60 2024-03-23T23:55:02.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.277+0000 7f976e800640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f97700c21b0 0x7f9770156c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53198/0 (socket says 172.21.15.8:53198) 2024-03-23T23:55:02.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.277+0000 7f976e800640 1 -- 172.21.15.8:0/1171892979 learned_addr learned my addr 172.21.15.8:0/1171892979 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:55:02.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.277+0000 7f976de00640 1 --2- 172.21.15.8:0/1171892979 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97700c3f60 0x7f9770071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:02.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.277+0000 7f976d400640 1 --2- 172.21.15.8:0/1171892979 >> v2:172.21.15.196:3300/0 conn(0x7f97700c3600 0x7f97700c1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:02.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.277+0000 7f976ca00640 1 -- 172.21.15.8:0/1171892979 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3147047212 0 0) 0x7f977015acc0 con 0x7f97700c21b0 2024-03-23T23:55:02.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.277+0000 7f976ca00640 1 -- 172.21.15.8:0/1171892979 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9754003530 con 0x7f97700c21b0 2024-03-23T23:55:02.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.281+0000 7f976d400640 1 -- 172.21.15.8:0/1171892979 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97700c3f60 msgr2=0x7f9770071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:55:02.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.281+0000 7f976d400640 1 --2- 172.21.15.8:0/1171892979 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97700c3f60 0x7f9770071a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:02.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.281+0000 7f976d400640 1 -- 172.21.15.8:0/1171892979 >> v1:172.21.15.8:6789/0 conn(0x7f97700c21b0 legacy=0x7f9770156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:02.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.281+0000 7f976d400640 1 -- 172.21.15.8:0/1171892979 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977015a1e0 con 0x7f97700c3600 2024-03-23T23:55:02.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.289+0000 7f976d400640 1 --2- 172.21.15.8:0/1171892979 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97700c3600 0x7f97700c1c70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f975c0097c0 tx=0x7f975c01c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd2086d3d0684478 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:55:02.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.293+0000 7f976ca00640 1 -- 172.21.15.8:0/1171892979 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c0b0070 con 0x7f97700c3600 2024-03-23T23:55:02.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.293+0000 7f976ca00640 1 -- 172.21.15.8:0/1171892979 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975c0ab600 con 0x7f97700c3600 2024-03-23T23:55:02.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.293+0000 7f976ca00640 1 -- 172.21.15.8:0/1171892979 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c0ab9d0 con 0x7f97700c3600 2024-03-23T23:55:02.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.293+0000 7f9775000640 1 -- 172.21.15.8:0/1171892979 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97700c3600 msgr2=0x7f97700c1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:02.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.293+0000 7f9775000640 1 --2- 172.21.15.8:0/1171892979 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97700c3600 0x7f97700c1c70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f975c0097c0 tx=0x7f975c01c430 comp rx=0 tx=0).stop 2024-03-23T23:55:02.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.297+0000 7f9775000640 1 -- 172.21.15.8:0/1171892979 shutdown_connections 2024-03-23T23:55:02.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.297+0000 7f9775000640 1 --2- 172.21.15.8:0/1171892979 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97700c3600 0x7f97700c1c70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:02.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.297+0000 7f9775000640 1 --2- 172.21.15.8:0/1171892979 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97700c3f60 0x7f9770071a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:02.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.297+0000 7f9775000640 1 -- 172.21.15.8:0/1171892979 >> 172.21.15.8:0/1171892979 conn(0x7f977006b170 msgr2=0x7f977006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:55:02.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.297+0000 7f9775000640 1 -- 172.21.15.8:0/1171892979 shutdown_connections 2024-03-23T23:55:02.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.297+0000 7f9775000640 1 -- 172.21.15.8:0/1171892979 wait complete. 2024-03-23T23:55:02.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.301+0000 7f9775000640 1 Processor -- start 2024-03-23T23:55:02.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.301+0000 7f9775000640 1 -- start start 2024-03-23T23:55:02.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.301+0000 7f9775000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97700c21b0 0x7f97701f25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:02.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.301+0000 7f9775000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97700c3600 0x7f97701522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:02.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.305+0000 7f9775000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97700c3f60 0x7f977014af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:02.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.305+0000 7f9775000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97700c4340 con 0x7f97700c3600 2024-03-23T23:55:02.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.305+0000 7f9775000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9770157750 con 0x7f97700c3f60 2024-03-23T23:55:02.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.305+0000 7f9775000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97700c44c0 con 0x7f97700c21b0 2024-03-23T23:55:02.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.305+0000 7f976e800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97700c3f60 0x7f977014af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:02.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.305+0000 7f976e800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97700c3f60 0x7f977014af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:58720/0 (socket says 172.21.15.8:58720) 2024-03-23T23:55:02.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.305+0000 7f976e800640 1 -- 172.21.15.8:0/3620990417 learned_addr learned my addr 172.21.15.8:0/3620990417 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:55:02.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.305+0000 7f976d400640 1 --2- 172.21.15.8:0/3620990417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97700c3600 0x7f97701522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:02.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.305+0000 7f976e800640 1 -- 172.21.15.8:0/3620990417 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97700c21b0 msgr2=0x7f97701f25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:02.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.305+0000 7f976e800640 1 --2- 172.21.15.8:0/3620990417 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97700c21b0 0x7f97701f25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:02.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.305+0000 7f976e800640 1 -- 172.21.15.8:0/3620990417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97700c3600 msgr2=0x7f97701522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:02.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.305+0000 7f976e800640 1 --2- 172.21.15.8:0/3620990417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97700c3600 0x7f97701522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:02.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.305+0000 7f976e800640 1 -- 172.21.15.8:0/3620990417 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977014cba0 con 0x7f97700c3f60 2024-03-23T23:55:02.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.305+0000 7f976e800640 1 --2- 172.21.15.8:0/3620990417 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97700c3f60 0x7f977014af90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f976800cb40 tx=0x7f976800a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:55:02.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.309+0000 7f9766000640 1 -- 172.21.15.8:0/3620990417 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9768017070 con 0x7f97700c3f60 2024-03-23T23:55:02.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.309+0000 7f9775000640 1 -- 172.21.15.8:0/3620990417 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977014ce80 con 0x7f97700c3f60 2024-03-23T23:55:02.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.309+0000 7f9775000640 1 -- 172.21.15.8:0/3620990417 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9770147380 con 0x7f97700c3f60 2024-03-23T23:55:02.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.309+0000 7f9766000640 1 -- 172.21.15.8:0/3620990417 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976800aca0 con 0x7f97700c3f60 2024-03-23T23:55:02.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.309+0000 7f9766000640 1 -- 172.21.15.8:0/3620990417 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9768012620 con 0x7f97700c3f60 2024-03-23T23:55:02.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.313+0000 7f975b400640 1 --2- 172.21.15.8:0/3620990417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97700acea0 0x7f97701f5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:02.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.317+0000 7f975b400640 1 -- 172.21.15.8:0/3620990417 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977014c950 con 0x7f97700acea0 2024-03-23T23:55:02.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.317+0000 7f9766000640 1 -- 172.21.15.8:0/3620990417 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f976801a070 con 0x7f97700c3f60 2024-03-23T23:55:02.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.317+0000 7f976de00640 1 --2- 172.21.15.8:0/3620990417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97700acea0 0x7f97701f5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:02.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.321+0000 7f976de00640 1 -- 172.21.15.8:0/3620990417 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f977014bc90 con 0x7f97700acea0 2024-03-23T23:55:02.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.325+0000 7f9766000640 1 --2- 172.21.15.8:0/3620990417 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9750067660 0x7f9750069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:02.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.325+0000 7f976de00640 1 --2- 172.21.15.8:0/3620990417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97700acea0 0x7f97701f5b30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f976000e7a0 tx=0x7f976000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:55:02.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.325+0000 7f9766000640 1 -- 172.21.15.8:0/3620990417 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f9768085970 con 0x7f97700c3f60 2024-03-23T23:55:02.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.325+0000 7f976d400640 1 --2- 172.21.15.8:0/3620990417 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9750067660 0x7f9750069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:02.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.325+0000 7f9766000640 1 -- 172.21.15.8:0/3620990417 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9760017070 con 0x7f97700acea0 2024-03-23T23:55:02.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.325+0000 7f9766000640 1 -- 172.21.15.8:0/3620990417 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f976000ee50 con 0x7f97700acea0 2024-03-23T23:55:02.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.325+0000 7f9766000640 1 -- 172.21.15.8:0/3620990417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97700acea0 msgr2=0x7f97701f5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:02.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.325+0000 7f9766000640 1 --2- 172.21.15.8:0/3620990417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97700acea0 0x7f97701f5b30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f976000e7a0 tx=0x7f976000ec60 comp rx=0 tx=0).stop 2024-03-23T23:55:02.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.329+0000 7f976d400640 1 --2- 172.21.15.8:0/3620990417 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9750067660 0x7f9750069b20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f975c0ad000 tx=0x7f975c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:55:02.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.329+0000 7f9766000640 1 -- 172.21.15.8:0/3620990417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97700acea0 msgr2=0x7f97701f5b30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:55:02.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.329+0000 7f9766000640 1 --2- 172.21.15.8:0/3620990417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97700acea0 0x7f97701f5b30 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:02.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.345+0000 7f975b400640 1 --2- 172.21.15.8:0/3620990417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97701f6070 0x7f97701f6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:02.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.345+0000 7f975b400640 1 -- 172.21.15.8:0/3620990417 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97701f69c0 con 0x7f97701f6070 2024-03-23T23:55:02.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.345+0000 7f976de00640 1 --2- 172.21.15.8:0/3620990417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97701f6070 0x7f97701f6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:02.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.345+0000 7f976de00640 1 -- 172.21.15.8:0/3620990417 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f977014d870 con 0x7f97701f6070 2024-03-23T23:55:02.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.345+0000 7f976de00640 1 --2- 172.21.15.8:0/3620990417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97701f6070 0x7f97701f6480 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9760018000 tx=0x7f97600046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:55:02.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.349+0000 7f9766000640 1 -- 172.21.15.8:0/3620990417 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9760017070 con 0x7f97701f6070 2024-03-23T23:55:02.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.349+0000 7f9766000640 1 -- 172.21.15.8:0/3620990417 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5186 (secure 0 0 0) 0x7f9760006670 con 0x7f97701f6070 2024-03-23T23:55:02.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.349+0000 7f9766000640 1 -- 172.21.15.8:0/3620990417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97701f6070 msgr2=0x7f97701f6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:02.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.349+0000 7f9766000640 1 --2- 172.21.15.8:0/3620990417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97701f6070 0x7f97701f6480 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9760018000 tx=0x7f97600046d0 comp rx=0 tx=0).stop 2024-03-23T23:55:02.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.349+0000 7f9766000640 1 -- 172.21.15.8:0/3620990417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97701f6070 msgr2=0x7f97701f6480 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:55:02.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.349+0000 7f9766000640 1 --2- 172.21.15.8:0/3620990417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97701f6070 0x7f97701f6480 secure :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9760018000 tx=0x7f97600046d0 comp rx=0 tx=0).stop 2024-03-23T23:55:02.352 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:55:02.352 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:55:02.352 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:55:02.352 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:55:02.352 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 100, 2024-03-23T23:55:02.352 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:55:02.352 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:55:02.352 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:55:02.353 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:55:02.353 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:55:02.353 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 17, 2024-03-23T23:55:02.353 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:55:02.353 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:55:02.353 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:55:02.353 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:55:02.353 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:55:02.353 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:55:02.353 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:55:02.354 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:55:02.354 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:55:02.354 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:55:02.354 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:55:02.354 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:55:02.354 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:55:02.354 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:55:02.355 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:55:02.355 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:55:02.355 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:55:02.355 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:55:02.355 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:55:02.355 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:55:02.355 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:55:02.355 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:55:02.355 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:55:02.356 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:55:02.356 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:55:02.356 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:55:02.356 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:55:02.356 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:55:02.356 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:55:02.356 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:02.356 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:55:02.356 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:55:02.356 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:55:02.356 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:55:02.356 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:55:02.357 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:55:02.357 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:55:02.357 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:55:02.357 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:55:02.357 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:55:02.357 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:55:02.357 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:55:02.357 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:55:02.357 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:55:02.358 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:55:02.358 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:55:02.358 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:55:02.358 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:55:02.358 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:55:02.358 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:55:02.358 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:55:02.358 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:55:02.359 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:55:02.359 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:55:02.359 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:55:02.359 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:55:02.359 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:55:02.359 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:55:02.359 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:55:02.360 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:55:02.360 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:02.360 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:55:02.360 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:02.360 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:55:02.360 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:55:02.361 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:55:02.361 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:55:02.361 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:02.361 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:55:02.361 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:55:02.361 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:55:02.361 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:02.361 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:02.361 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:55:02.361 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:55:02.361 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:55:02.362 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:02.362 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:55:02.362 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:02.362 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:55:02.362 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:55:02.362 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:55:02.362 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:55:02.363 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:55:02.363 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:02.363 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:02.363 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:55:02.363 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:55:02.363 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:55:02.363 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:55:02.363 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:02.363 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:55:02.363 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:55:02.363 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:55:02.364 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:02.364 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:02.364 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:55:02.364 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:55:02.364 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:55:02.364 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:02.364 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:55:02.364 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:02.364 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:55:02.365 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:55:02.365 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:55:02.365 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:55:02.365 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:55:02.365 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:02.365 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:02.365 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:55:02.365 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:55:02.365 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:55:02.365 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:55:02.366 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:02.366 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:55:02.366 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:55:02.366 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:55:02.366 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:02.366 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:02.366 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:55:02.366 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:55:02.366 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:55:02.367 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:02.367 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:55:02.367 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:02.367 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:55:02.367 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:55:02.367 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:55:02.367 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:55:02.367 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:55:02.368 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:02.368 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:55:02.368 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:02.368 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:55:02.368 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:55:02.368 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:02.368 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:55:02.368 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:55:02.369 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:55:02.369 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:02.369 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:55:02.369 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:55:02.369 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:02.370 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:55:02.370 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:55:02.370 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:55:02.370 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:02.370 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:55:02.370 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:55:02.370 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:02.370 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:55:02.371 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:55:02.371 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 8 2024-03-23T23:55:02.371 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:02.371 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:55:02.371 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:55:02.371 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:02.371 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:55:02.371 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:55:02.371 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:55:02.372 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:02.372 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:02.372 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:55:02.372 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:55:02.372 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5 2024-03-23T23:55:02.372 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:02.372 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:55:02.372 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:55:02.373 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:02.373 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:55:02.373 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:55:02.373 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:55:02.373 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:02.373 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:55:02.374 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:02.374 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:55:02.374 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:55:02.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.349+0000 7f975b400640 1 -- 172.21.15.8:0/3620990417 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9750067660 msgr2=0x7f9750069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:02.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.349+0000 7f975b400640 1 --2- 172.21.15.8:0/3620990417 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9750067660 0x7f9750069b20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f975c0ad000 tx=0x7f975c008040 comp rx=0 tx=0).stop 2024-03-23T23:55:02.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.349+0000 7f975b400640 1 -- 172.21.15.8:0/3620990417 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97700c3f60 msgr2=0x7f977014af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:02.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.349+0000 7f975b400640 1 --2- 172.21.15.8:0/3620990417 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97700c3f60 0x7f977014af90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f976800cb40 tx=0x7f976800a060 comp rx=0 tx=0).stop 2024-03-23T23:55:02.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.349+0000 7f976e800640 1 -- 172.21.15.8:0/3620990417 reap_dead start 2024-03-23T23:55:02.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.349+0000 7f976e800640 1 -- 172.21.15.8:0/3620990417 reap_dead start 2024-03-23T23:55:02.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.349+0000 7f975b400640 1 -- 172.21.15.8:0/3620990417 shutdown_connections 2024-03-23T23:55:02.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.349+0000 7f975b400640 1 -- 172.21.15.8:0/3620990417 >> 172.21.15.8:0/3620990417 conn(0x7f977006b170 msgr2=0x7f977006b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:55:02.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.353+0000 7f975b400640 1 -- 172.21.15.8:0/3620990417 shutdown_connections 2024-03-23T23:55:02.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.353+0000 7f975b400640 1 -- 172.21.15.8:0/3620990417 wait complete. 2024-03-23T23:55:02.390 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:55:02.391 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T23:55:02.391 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:55:02.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.673+0000 7f791b200640 1 Processor -- start 2024-03-23T23:55:02.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.673+0000 7f791b200640 1 -- start start 2024-03-23T23:55:02.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.677+0000 7f791b200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f791c1522b0 0x7f791c0c2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:02.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.677+0000 7f791b200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f791c06ccc0 con 0x7f791c14ede0 2024-03-23T23:55:02.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.677+0000 7f791b200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f791c06cfa0 con 0x7f791c0c2820 2024-03-23T23:55:02.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.677+0000 7f791b200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f791c0c3760 con 0x7f791c1522b0 2024-03-23T23:55:02.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.677+0000 7f7919400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f791c0c2820 0x7f791c151ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:48128/0 (socket says 172.21.15.8:48128) 2024-03-23T23:55:02.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.677+0000 7f7919400640 1 -- 172.21.15.8:0/1964044195 learned_addr learned my addr 172.21.15.8:0/1964044195 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:55:02.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.681+0000 7f791a800640 1 --2- 172.21.15.8:0/1964044195 >> v2:172.21.15.8:3300/0 conn(0x7f791c1522b0 0x7f791c0c2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:02.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.685+0000 7f791a800640 1 -- 172.21.15.8:0/1964044195 >> v1:172.21.15.196:6789/0 conn(0x7f791c0c2820 legacy=0x7f791c151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:02.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.685+0000 7f791a800640 1 -- 172.21.15.8:0/1964044195 >> v1:172.21.15.8:6789/0 conn(0x7f791c14ede0 legacy=0x7f791c072b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:02.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.685+0000 7f7918a00640 1 -- 172.21.15.8:0/1964044195 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2790145494 0 0) 0x7f791c06ccc0 con 0x7f791c14ede0 2024-03-23T23:55:02.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.685+0000 7f791a800640 1 -- 172.21.15.8:0/1964044195 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791c06d280 con 0x7f791c1522b0 2024-03-23T23:55:02.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.701+0000 7f791a800640 1 --2- 172.21.15.8:0/1964044195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f791c1522b0 0x7f791c0c2c70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f790c0097c0 tx=0x7f790c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9767afdfd2fadd99 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:55:02.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.701+0000 7f7918a00640 1 -- 172.21.15.8:0/1964044195 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790c0b0070 con 0x7f791c1522b0 2024-03-23T23:55:02.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.701+0000 7f7918a00640 1 -- 172.21.15.8:0/1964044195 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790c0ab600 con 0x7f791c1522b0 2024-03-23T23:55:02.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.701+0000 7f7918a00640 1 -- 172.21.15.8:0/1964044195 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790c0ab9d0 con 0x7f791c1522b0 2024-03-23T23:55:02.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.705+0000 7f791b200640 1 -- 172.21.15.8:0/1964044195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f791c1522b0 msgr2=0x7f791c0c2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:02.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.705+0000 7f791b200640 1 --2- 172.21.15.8:0/1964044195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f791c1522b0 0x7f791c0c2c70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f790c0097c0 tx=0x7f790c01c4a0 comp rx=0 tx=0).stop 2024-03-23T23:55:02.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.717+0000 7f791b200640 1 -- 172.21.15.8:0/1964044195 shutdown_connections 2024-03-23T23:55:02.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.717+0000 7f791b200640 1 --2- 172.21.15.8:0/1964044195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f791c1522b0 0x7f791c0c2c70 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:02.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.717+0000 7f791b200640 1 -- 172.21.15.8:0/1964044195 >> 172.21.15.8:0/1964044195 conn(0x7f791c0c3910 msgr2=0x7f791c0c3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:55:02.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.717+0000 7f791b200640 1 -- 172.21.15.8:0/1964044195 shutdown_connections 2024-03-23T23:55:02.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.717+0000 7f791b200640 1 -- 172.21.15.8:0/1964044195 wait complete. 2024-03-23T23:55:02.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.721+0000 7f791b200640 1 Processor -- start 2024-03-23T23:55:02.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.725+0000 7f791b200640 1 -- start start 2024-03-23T23:55:02.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.725+0000 7f791b200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f791c0c2820 0x7f791c1443e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:02.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.729+0000 7f791b200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f791c14ede0 0x7f791c143bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:02.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.729+0000 7f7919e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f791c0c2820 0x7f791c1443e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:02.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.729+0000 7f7919e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f791c0c2820 0x7f791c1443e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53942/0 (socket says 172.21.15.8:53942) 2024-03-23T23:55:02.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.729+0000 7f791b200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f791c1522b0 0x7f791c0c5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:02.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.729+0000 7f791b200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791c15f7a0 con 0x7f791c0c2820 2024-03-23T23:55:02.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.729+0000 7f791b200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791c151710 con 0x7f791c14ede0 2024-03-23T23:55:02.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.729+0000 7f791b200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f791c15f920 con 0x7f791c1522b0 2024-03-23T23:55:02.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.729+0000 7f7919e00640 1 -- 172.21.15.8:0/3224325802 learned_addr learned my addr 172.21.15.8:0/3224325802 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:55:02.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.733+0000 7f791a800640 1 --2- 172.21.15.8:0/3224325802 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f791c1522b0 0x7f791c0c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:02.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.737+0000 7f7919e00640 1 -- 172.21.15.8:0/3224325802 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f791c1522b0 msgr2=0x7f791c0c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:02.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.737+0000 7f7919e00640 1 --2- 172.21.15.8:0/3224325802 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f791c1522b0 0x7f791c0c5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:02.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.737+0000 7f7919e00640 1 -- 172.21.15.8:0/3224325802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f791c14ede0 msgr2=0x7f791c143bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:02.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.737+0000 7f7919e00640 1 --2- 172.21.15.8:0/3224325802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f791c14ede0 0x7f791c143bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:02.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.737+0000 7f7919e00640 1 -- 172.21.15.8:0/3224325802 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791c144920 con 0x7f791c0c2820 2024-03-23T23:55:02.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.737+0000 7f7919e00640 1 --2- 172.21.15.8:0/3224325802 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f791c0c2820 0x7f791c1443e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f791400c810 tx=0x7f791400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:55:02.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.745+0000 7f7912000640 1 -- 172.21.15.8:0/3224325802 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7914003db0 con 0x7f791c0c2820 2024-03-23T23:55:02.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.745+0000 7f7912000640 1 -- 172.21.15.8:0/3224325802 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7914005070 con 0x7f791c0c2820 2024-03-23T23:55:02.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.745+0000 7f7912000640 1 -- 172.21.15.8:0/3224325802 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7914005440 con 0x7f791c0c2820 2024-03-23T23:55:02.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.745+0000 7f791b200640 1 -- 172.21.15.8:0/3224325802 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f791c1440f0 con 0x7f791c0c2820 2024-03-23T23:55:02.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.745+0000 7f791b200640 1 -- 172.21.15.8:0/3224325802 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f791c0a9ad0 con 0x7f791c0c2820 2024-03-23T23:55:02.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.749+0000 7f7912000640 1 -- 172.21.15.8:0/3224325802 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f79140055e0 con 0x7f791c0c2820 2024-03-23T23:55:02.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.749+0000 7f7912000640 1 --2- 172.21.15.8:0/3224325802 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f78fc067730 0x7f78fc069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:02.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.749+0000 7f7912000640 1 -- 172.21.15.8:0/3224325802 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f7914085bd0 con 0x7f791c0c2820 2024-03-23T23:55:02.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.753+0000 7f791b200640 1 --2- 172.21.15.8:0/3224325802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f791c0aa980 0x7f791c0a9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:02.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.753+0000 7f791b200640 1 -- 172.21.15.8:0/3224325802 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791c14e630 con 0x7f791c0aa980 2024-03-23T23:55:02.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.753+0000 7f7919400640 1 --2- 172.21.15.8:0/3224325802 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f78fc067730 0x7f78fc069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:02.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.753+0000 7f791a800640 1 --2- 172.21.15.8:0/3224325802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f791c0aa980 0x7f791c0a9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:02.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.757+0000 7f791a800640 1 -- 172.21.15.8:0/3224325802 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f791c14c590 con 0x7f791c0aa980 2024-03-23T23:55:02.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.761+0000 7f791a800640 1 --2- 172.21.15.8:0/3224325802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f791c0aa980 0x7f791c0a9cd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f791c073380 tx=0x7f790c019240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:55:02.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.761+0000 7f7919400640 1 --2- 172.21.15.8:0/3224325802 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f78fc067730 0x7f78fc069bf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f791c145dd0 tx=0x7f7908005a70 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:55:02.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.773+0000 7f7912000640 1 -- 172.21.15.8:0/3224325802 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790c0bb030 con 0x7f791c0aa980 2024-03-23T23:55:02.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.777+0000 7f7912000640 1 -- 172.21.15.8:0/3224325802 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f790c0b1040 con 0x7f791c0aa980 2024-03-23T23:55:02.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.777+0000 7f7912000640 1 -- 172.21.15.8:0/3224325802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f791c0aa980 msgr2=0x7f791c0a9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:02.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.777+0000 7f7912000640 1 --2- 172.21.15.8:0/3224325802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f791c0aa980 0x7f791c0a9cd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f791c073380 tx=0x7f790c019240 comp rx=0 tx=0).stop 2024-03-23T23:55:02.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.777+0000 7f7912000640 1 -- 172.21.15.8:0/3224325802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f791c0aa980 msgr2=0x7f791c0a9cd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:55:02.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.777+0000 7f7912000640 1 --2- 172.21.15.8:0/3224325802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f791c0aa980 0x7f791c0a9cd0 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f791c073380 tx=0x7f790c019240 comp rx=0 tx=0).stop 2024-03-23T23:55:02.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.813+0000 7f791b200640 1 --2- 172.21.15.8:0/3224325802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f791c1f5830 0x7f791c1f5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:02.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.813+0000 7f791b200640 1 -- 172.21.15.8:0/3224325802 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791c0c5490 con 0x7f791c1f5830 2024-03-23T23:55:02.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.817+0000 7f791a800640 1 --2- 172.21.15.8:0/3224325802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f791c1f5830 0x7f791c1f5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:02.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.817+0000 7f791a800640 1 -- 172.21.15.8:0/3224325802 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f791c04f410 con 0x7f791c1f5830 2024-03-23T23:55:02.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.821+0000 7f791a800640 1 --2- 172.21.15.8:0/3224325802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f791c1f5830 0x7f791c1f5c10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f790c01a0d0 tx=0x7f790c009190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:55:02.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.821+0000 7f7912000640 1 -- 172.21.15.8:0/3224325802 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790c0bb070 con 0x7f791c1f5830 2024-03-23T23:55:02.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.825+0000 7f7912000640 1 -- 172.21.15.8:0/3224325802 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4531 (secure 0 0 0) 0x7f790c0b75d0 con 0x7f791c1f5830 2024-03-23T23:55:02.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.825+0000 7f7912000640 1 -- 172.21.15.8:0/3224325802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f791c1f5830 msgr2=0x7f791c1f5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:02.833 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:55:02.833 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:55:02.833 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:55:02.833 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:55:02.833 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 100, 2024-03-23T23:55:02.833 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:55:02.834 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:55:02.834 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:55:02.834 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:55:02.834 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:55:02.834 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 18, 2024-03-23T23:55:02.834 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:55:02.834 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:55:02.834 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:55:02.834 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:55:02.835 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:55:02.835 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:55:02.835 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:55:02.835 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:55:02.835 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:55:02.835 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:55:02.835 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:55:02.835 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:55:02.835 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:55:02.836 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:55:02.836 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:55:02.836 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:55:02.836 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:55:02.836 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:55:02.836 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:55:02.836 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:55:02.836 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:55:02.837 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:55:02.837 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:55:02.837 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:55:02.837 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:55:02.837 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:55:02.837 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:55:02.837 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:55:02.837 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:55:02.837 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:02.837 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:55:02.837 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:55:02.838 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:55:02.838 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:55:02.838 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:55:02.838 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:55:02.838 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:55:02.838 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:55:02.838 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:55:02.838 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:55:02.838 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:55:02.838 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:55:02.839 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:55:02.839 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:55:02.839 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:55:02.839 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:55:02.839 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:55:02.839 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:55:02.839 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:55:02.839 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:55:02.840 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:55:02.840 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:55:02.840 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:55:02.840 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:55:02.840 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:55:02.840 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:55:02.840 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:55:02.840 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:55:02.841 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:55:02.841 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:55:02.841 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:02.841 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:55:02.841 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:02.841 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:55:02.841 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:55:02.841 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:55:02.842 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:55:02.842 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:02.842 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:55:02.842 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:55:02.842 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:55:02.843 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:02.843 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:02.843 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:55:02.843 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:55:02.843 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:55:02.843 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:02.843 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:55:02.843 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:02.844 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:55:02.844 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:55:02.844 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:55:02.844 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:55:02.844 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:55:02.844 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:02.844 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:02.844 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:55:02.845 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:55:02.845 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:55:02.845 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:55:02.845 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:02.845 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:55:02.845 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:55:02.846 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:55:02.846 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:02.846 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:02.846 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:55:02.846 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:55:02.846 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:55:02.846 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:02.846 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:55:02.846 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:02.846 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:55:02.847 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:55:02.847 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:55:02.847 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:55:02.847 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:55:02.847 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:02.847 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:02.847 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:55:02.847 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:55:02.847 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:55:02.847 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:55:02.847 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:02.847 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:55:02.848 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:55:02.848 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:55:02.848 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:02.848 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:02.848 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:55:02.848 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:55:02.848 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:55:02.848 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:02.848 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:55:02.848 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:02.848 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:55:02.848 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:55:02.849 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:55:02.849 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:55:02.849 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:55:02.849 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:02.849 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:55:02.849 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:02.849 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:55:02.849 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:55:02.849 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:02.849 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:55:02.849 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:55:02.849 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:55:02.850 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:02.850 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:55:02.850 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:55:02.850 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:02.850 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:55:02.850 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:55:02.850 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:55:02.850 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:02.850 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:55:02.850 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:02.850 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:55:02.851 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:55:02.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.825+0000 7f7912000640 1 --2- 172.21.15.8:0/3224325802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f791c1f5830 0x7f791c1f5c10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f790c01a0d0 tx=0x7f790c009190 comp rx=0 tx=0).stop 2024-03-23T23:55:02.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.825+0000 7f7912000640 1 -- 172.21.15.8:0/3224325802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f791c1f5830 msgr2=0x7f791c1f5c10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:55:02.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.825+0000 7f7912000640 1 --2- 172.21.15.8:0/3224325802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f791c1f5830 0x7f791c1f5c10 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f790c01a0d0 tx=0x7f790c009190 comp rx=0 tx=0).stop 2024-03-23T23:55:02.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.825+0000 7f791b200640 1 -- 172.21.15.8:0/3224325802 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f78fc067730 msgr2=0x7f78fc069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:02.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.825+0000 7f791b200640 1 --2- 172.21.15.8:0/3224325802 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f78fc067730 0x7f78fc069bf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f791c145dd0 tx=0x7f7908005a70 comp rx=0 tx=0).stop 2024-03-23T23:55:02.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.825+0000 7f791b200640 1 -- 172.21.15.8:0/3224325802 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f791c0c2820 msgr2=0x7f791c1443e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:02.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.825+0000 7f791b200640 1 --2- 172.21.15.8:0/3224325802 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f791c0c2820 0x7f791c1443e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f791400c810 tx=0x7f791400ccd0 comp rx=0 tx=0).stop 2024-03-23T23:55:02.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.829+0000 7f791a800640 1 -- 172.21.15.8:0/3224325802 reap_dead start 2024-03-23T23:55:02.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.829+0000 7f791b200640 1 -- 172.21.15.8:0/3224325802 shutdown_connections 2024-03-23T23:55:02.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.829+0000 7f791b200640 1 -- 172.21.15.8:0/3224325802 >> 172.21.15.8:0/3224325802 conn(0x7f791c0c3910 msgr2=0x7f791c0c3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:55:02.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.833+0000 7f791b200640 1 -- 172.21.15.8:0/3224325802 shutdown_connections 2024-03-23T23:55:02.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:02.833+0000 7f791b200640 1 -- 172.21.15.8:0/3224325802 wait complete. 2024-03-23T23:55:02.913 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:55:02.913 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T23:55:02.914 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:55:03.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.373+0000 7fdcc7200640 1 Processor -- start 2024-03-23T23:55:03.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.373+0000 7fdcc7200640 1 -- start start 2024-03-23T23:55:03.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.373+0000 7fdcc7200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fdcc8156f80 0x7fdcc8072b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:03.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.373+0000 7fdcc7200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdcc806c940 0x7fdcc80c1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:03.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.373+0000 7fdcc7200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc8071d50 con 0x7fdcc8071450 2024-03-23T23:55:03.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.373+0000 7fdcc7200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc8072030 con 0x7fdcc8156f80 2024-03-23T23:55:03.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.373+0000 7fdcc7200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc8072310 con 0x7fdcc806c940 2024-03-23T23:55:03.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.373+0000 7fdcc5400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdcc806c940 0x7fdcc80c1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:03.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.373+0000 7fdcc5400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdcc806c940 0x7fdcc80c1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:51866/0 (socket says 172.21.15.8:51866) 2024-03-23T23:55:03.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.373+0000 7fdcc5400640 1 -- 172.21.15.8:0/1502059747 learned_addr learned my addr 172.21.15.8:0/1502059747 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:55:03.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.377+0000 7fdcc5e00640 1 --2- 172.21.15.8:0/1502059747 >> v2:172.21.15.8:3300/0 conn(0x7fdcc8156f80 0x7fdcc8072b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:03.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.377+0000 7fdcc5400640 1 -- 172.21.15.8:0/1502059747 >> v2:172.21.15.8:3300/0 conn(0x7fdcc8156f80 msgr2=0x7fdcc8072b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:55:03.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.377+0000 7fdcc5400640 1 --2- 172.21.15.8:0/1502059747 >> v2:172.21.15.8:3300/0 conn(0x7fdcc8156f80 0x7fdcc8072b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:03.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.377+0000 7fdcc5400640 1 -- 172.21.15.8:0/1502059747 >> v1:172.21.15.196:6789/0 conn(0x7fdcc8071450 legacy=0x7fdcc806d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:55:03.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.377+0000 7fdcc5400640 1 -- 172.21.15.8:0/1502059747 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc80725f0 con 0x7fdcc806c940 2024-03-23T23:55:03.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.377+0000 7fdcc5e00640 1 --2- 172.21.15.8:0/1502059747 >> v2:172.21.15.8:3300/0 conn(0x7fdcc8156f80 0x7fdcc8072b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:55:03.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.381+0000 7fdcc5400640 1 --2- 172.21.15.8:0/1502059747 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdcc806c940 0x7fdcc80c1810 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0009870 tx=0x7fdcc001c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=755b6aaeb4062436 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:55:03.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.385+0000 7fdcc4a00640 1 -- 172.21.15.8:0/1502059747 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc00b0070 con 0x7fdcc806c940 2024-03-23T23:55:03.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.385+0000 7fdcc4a00640 1 -- 172.21.15.8:0/1502059747 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc00ab600 con 0x7fdcc806c940 2024-03-23T23:55:03.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.385+0000 7fdcc4a00640 1 -- 172.21.15.8:0/1502059747 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc00ab9d0 con 0x7fdcc806c940 2024-03-23T23:55:03.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.385+0000 7fdcc7200640 1 -- 172.21.15.8:0/1502059747 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdcc806c940 msgr2=0x7fdcc80c1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:03.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.385+0000 7fdcc7200640 1 --2- 172.21.15.8:0/1502059747 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdcc806c940 0x7fdcc80c1810 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0009870 tx=0x7fdcc001c520 comp rx=0 tx=0).stop 2024-03-23T23:55:03.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.389+0000 7fdcc7200640 1 -- 172.21.15.8:0/1502059747 shutdown_connections 2024-03-23T23:55:03.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.389+0000 7fdcc7200640 1 --2- 172.21.15.8:0/1502059747 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdcc806c940 0x7fdcc80c1810 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:03.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.389+0000 7fdcc7200640 1 --2- 172.21.15.8:0/1502059747 >> v2:172.21.15.8:3300/0 conn(0x7fdcc8156f80 0x7fdcc8072b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:03.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.389+0000 7fdcc7200640 1 -- 172.21.15.8:0/1502059747 >> 172.21.15.8:0/1502059747 conn(0x7fdcc80c6e10 msgr2=0x7fdcc80c7220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:55:03.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.389+0000 7fdcc7200640 1 -- 172.21.15.8:0/1502059747 shutdown_connections 2024-03-23T23:55:03.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.389+0000 7fdcc7200640 1 -- 172.21.15.8:0/1502059747 wait complete. 2024-03-23T23:55:03.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.393+0000 7fdcc7200640 1 Processor -- start 2024-03-23T23:55:03.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.393+0000 7fdcc7200640 1 -- start start 2024-03-23T23:55:03.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.393+0000 7fdcc7200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdcc806c940 0x7fdcc80a9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:03.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.397+0000 7fdcc7200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdcc8071450 0x7fdcc80c2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:03.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.397+0000 7fdcc7200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdcc8156f80 0x7fdcc813f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:03.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.397+0000 7fdcc7200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc80c1ed0 con 0x7fdcc806c940 2024-03-23T23:55:03.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.397+0000 7fdcc7200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc80c1d50 con 0x7fdcc8156f80 2024-03-23T23:55:03.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.397+0000 7fdcc7200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc8164af0 con 0x7fdcc8071450 2024-03-23T23:55:03.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.397+0000 7fdcc5e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdcc806c940 0x7fdcc80a9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:03.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.397+0000 7fdcc5e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdcc806c940 0x7fdcc80a9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53946/0 (socket says 172.21.15.8:53946) 2024-03-23T23:55:03.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.397+0000 7fdcc5e00640 1 -- 172.21.15.8:0/1094466295 learned_addr learned my addr 172.21.15.8:0/1094466295 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:55:03.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.397+0000 7fdcc5e00640 1 -- 172.21.15.8:0/1094466295 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdcc8071450 msgr2=0x7fdcc80c2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:03.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.397+0000 7fdcc5e00640 1 --2- 172.21.15.8:0/1094466295 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdcc8071450 0x7fdcc80c2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:03.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.397+0000 7fdcc5e00640 1 -- 172.21.15.8:0/1094466295 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdcc8156f80 msgr2=0x7fdcc813f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:03.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.397+0000 7fdcc5e00640 1 --2- 172.21.15.8:0/1094466295 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdcc8156f80 0x7fdcc813f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:03.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.397+0000 7fdcc5e00640 1 -- 172.21.15.8:0/1094466295 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc815bf20 con 0x7fdcc806c940 2024-03-23T23:55:03.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.401+0000 7fdcc5e00640 1 --2- 172.21.15.8:0/1094466295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdcc806c940 0x7fdcc80a9bd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdcb400e9b0 tx=0x7fdcb400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:55:03.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.401+0000 7fdcbe000640 1 -- 172.21.15.8:0/1094466295 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4017070 con 0x7fdcc806c940 2024-03-23T23:55:03.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.401+0000 7fdcbe000640 1 -- 172.21.15.8:0/1094466295 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb400ca00 con 0x7fdcc806c940 2024-03-23T23:55:03.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.401+0000 7fdcbe000640 1 -- 172.21.15.8:0/1094466295 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb400cdd0 con 0x7fdcc806c940 2024-03-23T23:55:03.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.401+0000 7fdcc7200640 1 -- 172.21.15.8:0/1094466295 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc815c200 con 0x7fdcc806c940 2024-03-23T23:55:03.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.401+0000 7fdcc7200640 1 -- 172.21.15.8:0/1094466295 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc815c7c0 con 0x7fdcc806c940 2024-03-23T23:55:03.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.405+0000 7fdcc7200640 1 --2- 172.21.15.8:0/1094466295 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdcc80c2b60 0x7fdcc813f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:03.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.405+0000 7fdcc7200640 1 -- 172.21.15.8:0/1094466295 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc80aa110 con 0x7fdcc80c2b60 2024-03-23T23:55:03.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.409+0000 7fdcc5400640 1 --2- 172.21.15.8:0/1094466295 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdcc80c2b60 0x7fdcc813f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:03.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.409+0000 7fdcbe000640 1 -- 172.21.15.8:0/1094466295 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fdcb401a070 con 0x7fdcc806c940 2024-03-23T23:55:03.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.409+0000 7fdcbe000640 1 --2- 172.21.15.8:0/1094466295 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdca80676b0 0x7fdca8069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:03.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.409+0000 7fdcbe000640 1 -- 172.21.15.8:0/1094466295 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fdcb4085ed0 con 0x7fdcc806c940 2024-03-23T23:55:03.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.409+0000 7fdcc6800640 1 --2- 172.21.15.8:0/1094466295 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdca80676b0 0x7fdca8069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:03.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.409+0000 7fdcc5400640 1 -- 172.21.15.8:0/1094466295 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdcc804f410 con 0x7fdcc80c2b60 2024-03-23T23:55:03.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.413+0000 7fdcc6800640 1 --2- 172.21.15.8:0/1094466295 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdca80676b0 0x7fdca8069b70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8004370 tx=0x7fdcb8007d40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:55:03.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.413+0000 7fdcc5400640 1 --2- 172.21.15.8:0/1094466295 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdcc80c2b60 0x7fdcc813f6b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdcc806c770 tx=0x7fdcc00ab9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:55:03.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.417+0000 7fdcbe000640 1 -- 172.21.15.8:0/1094466295 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc00b8020 con 0x7fdcc80c2b60 2024-03-23T23:55:03.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.417+0000 7fdcbe000640 1 -- 172.21.15.8:0/1094466295 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fdcc00abc60 con 0x7fdcc80c2b60 2024-03-23T23:55:03.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.417+0000 7fdcbe000640 1 -- 172.21.15.8:0/1094466295 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdcc80c2b60 msgr2=0x7fdcc813f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:03.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.417+0000 7fdcbe000640 1 --2- 172.21.15.8:0/1094466295 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdcc80c2b60 0x7fdcc813f6b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdcc806c770 tx=0x7fdcc00ab9f0 comp rx=0 tx=0).stop 2024-03-23T23:55:03.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.417+0000 7fdcbe000640 1 -- 172.21.15.8:0/1094466295 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdcc80c2b60 msgr2=0x7fdcc813f6b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:55:03.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.417+0000 7fdcbe000640 1 --2- 172.21.15.8:0/1094466295 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdcc80c2b60 0x7fdcc813f6b0 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdcc806c770 tx=0x7fdcc00ab9f0 comp rx=0 tx=0).stop 2024-03-23T23:55:03.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.433+0000 7fdcc7200640 1 --2- 172.21.15.8:0/1094466295 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdcc81fe330 0x7fdcc81fe710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:03.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.433+0000 7fdcc7200640 1 -- 172.21.15.8:0/1094466295 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc8071230 con 0x7fdcc81fe330 2024-03-23T23:55:03.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.433+0000 7fdcc5400640 1 --2- 172.21.15.8:0/1094466295 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdcc81fe330 0x7fdcc81fe710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:03.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.433+0000 7fdcc5400640 1 -- 172.21.15.8:0/1094466295 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fdcc8155c90 con 0x7fdcc81fe330 2024-03-23T23:55:03.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.441+0000 7fdcc5400640 1 --2- 172.21.15.8:0/1094466295 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdcc81fe330 0x7fdcc81fe710 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0009870 tx=0x7fdcc00a6000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:55:03.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.449+0000 7fdcbe000640 1 -- 172.21.15.8:0/1094466295 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc00b8030 con 0x7fdcc81fe330 2024-03-23T23:55:03.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.453+0000 7fdcbe000640 1 -- 172.21.15.8:0/1094466295 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4531 (secure 0 0 0) 0x7fdcc0003ce0 con 0x7fdcc81fe330 2024-03-23T23:55:03.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.453+0000 7fdcbe000640 1 -- 172.21.15.8:0/1094466295 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdcc81fe330 msgr2=0x7fdcc81fe710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:03.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.453+0000 7fdcbe000640 1 --2- 172.21.15.8:0/1094466295 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdcc81fe330 0x7fdcc81fe710 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0009870 tx=0x7fdcc00a6000 comp rx=0 tx=0).stop 2024-03-23T23:55:03.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.453+0000 7fdcbe000640 1 -- 172.21.15.8:0/1094466295 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdcc81fe330 msgr2=0x7fdcc81fe710 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:55:03.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.453+0000 7fdcbe000640 1 --2- 172.21.15.8:0/1094466295 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdcc81fe330 0x7fdcc81fe710 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0009870 tx=0x7fdcc00a6000 comp rx=0 tx=0).stop 2024-03-23T23:55:03.456 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:55:03.456 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:55:03.456 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:55:03.456 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:55:03.456 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 100, 2024-03-23T23:55:03.456 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:55:03.456 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:55:03.457 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:55:03.457 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:55:03.457 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:55:03.457 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 19, 2024-03-23T23:55:03.457 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:55:03.457 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:55:03.457 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:55:03.457 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:55:03.457 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:55:03.458 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:55:03.458 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:55:03.458 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:55:03.458 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:55:03.458 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:55:03.458 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:55:03.458 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:55:03.458 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:55:03.459 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:55:03.459 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:55:03.459 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:55:03.459 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:55:03.459 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:55:03.459 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:55:03.459 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:55:03.459 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:55:03.460 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:55:03.460 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:55:03.460 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:55:03.460 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:55:03.460 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:55:03.460 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:55:03.460 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:55:03.460 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:55:03.460 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:03.461 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:55:03.461 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:55:03.461 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:55:03.461 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:55:03.461 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:55:03.461 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:55:03.461 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:55:03.461 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:55:03.462 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:55:03.462 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:55:03.462 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:55:03.462 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:55:03.462 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:55:03.462 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:55:03.462 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:55:03.462 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:55:03.462 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:55:03.463 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:55:03.463 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:55:03.463 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:55:03.463 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:55:03.463 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:55:03.463 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:55:03.463 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:55:03.463 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:55:03.463 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:55:03.464 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:55:03.464 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:55:03.464 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:55:03.464 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:55:03.464 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:03.464 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:55:03.464 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:03.464 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:55:03.464 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:55:03.464 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:55:03.465 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:55:03.465 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:03.465 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:55:03.465 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:55:03.465 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:55:03.465 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:03.465 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:03.465 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:55:03.465 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:55:03.466 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:55:03.466 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:03.466 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:55:03.466 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:03.466 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:55:03.466 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:55:03.466 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:55:03.466 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:55:03.466 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:55:03.467 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:03.467 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:03.467 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:55:03.467 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:55:03.467 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:55:03.467 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:55:03.467 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:03.467 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:55:03.467 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:55:03.468 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:55:03.468 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:03.468 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:03.468 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:55:03.468 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:55:03.468 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:55:03.468 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:03.469 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:55:03.469 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:03.469 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:55:03.469 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:55:03.469 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:55:03.469 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:55:03.469 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:55:03.469 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:03.469 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:03.469 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:55:03.470 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:55:03.470 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:55:03.470 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:55:03.470 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:03.470 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:55:03.470 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:55:03.470 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:55:03.470 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:03.470 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:03.471 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:55:03.471 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:55:03.471 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:55:03.471 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:03.471 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:55:03.471 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:03.471 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:55:03.471 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:55:03.472 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:55:03.472 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:55:03.472 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:55:03.472 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:03.472 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:55:03.472 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:03.472 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:55:03.472 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:55:03.472 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:03.473 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:55:03.473 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:55:03.473 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:55:03.473 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:03.473 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:55:03.473 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:55:03.473 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:03.473 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:55:03.473 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:55:03.474 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:55:03.474 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:03.474 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:55:03.474 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:03.474 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:55:03.474 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:55:03.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.457+0000 7fdcc7200640 1 -- 172.21.15.8:0/1094466295 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdca80676b0 msgr2=0x7fdca8069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:03.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.457+0000 7fdcc7200640 1 --2- 172.21.15.8:0/1094466295 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fdca80676b0 0x7fdca8069b70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8004370 tx=0x7fdcb8007d40 comp rx=0 tx=0).stop 2024-03-23T23:55:03.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.457+0000 7fdcc7200640 1 -- 172.21.15.8:0/1094466295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdcc806c940 msgr2=0x7fdcc80a9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:03.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.457+0000 7fdcc7200640 1 --2- 172.21.15.8:0/1094466295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdcc806c940 0x7fdcc80a9bd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdcb400e9b0 tx=0x7fdcb400ee70 comp rx=0 tx=0).stop 2024-03-23T23:55:03.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.457+0000 7fdcc6800640 1 -- 172.21.15.8:0/1094466295 reap_dead start 2024-03-23T23:55:03.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.457+0000 7fdcc6800640 1 -- 172.21.15.8:0/1094466295 reap_dead start 2024-03-23T23:55:03.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.461+0000 7fdcc7200640 1 -- 172.21.15.8:0/1094466295 shutdown_connections 2024-03-23T23:55:03.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.461+0000 7fdcc7200640 1 -- 172.21.15.8:0/1094466295 >> 172.21.15.8:0/1094466295 conn(0x7fdcc80c6e10 msgr2=0x7fdcc81561b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:55:03.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.461+0000 7fdcc7200640 1 -- 172.21.15.8:0/1094466295 shutdown_connections 2024-03-23T23:55:03.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:03.461+0000 7fdcc7200640 1 -- 172.21.15.8:0/1094466295 wait complete. 2024-03-23T23:55:03.526 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:55:03.526 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-03-23T23:55:03.527 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['c'] 2024-03-23T23:55:03.527 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-03-23T23:55:03.527 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-03-23T23:55:03.527 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-23T23:55:03.527 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:55:09.593 INFO:tasks.ceph.mon.a:Stopped 2024-03-23T23:55:09.594 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-03-23T23:55:09.594 INFO:tasks.ceph.mon.c:Sent signal 19 2024-03-23T23:55:09.594 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-03-23T23:55:09.870 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-03-23T23:55:16.467 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:55:16.472 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:55:16.483 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-03-23T23:55:24.595 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-03-23T23:55:24.596 INFO:tasks.ceph.mon.c:Sent signal 18 2024-03-23T23:55:24.596 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-03-23T23:55:24.596 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:55:24.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:24.973+0000 7fbb68e00640 1 Processor -- start 2024-03-23T23:55:24.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:24.977+0000 7fbb68e00640 1 -- start start 2024-03-23T23:55:24.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:24.977+0000 7fbb68e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbb641598b0 0x7fbb64152c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:24.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:24.977+0000 7fbb68e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb64155b10 con 0x7fbb640a9790 2024-03-23T23:55:24.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:24.977+0000 7fbb68e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb64072b20 con 0x7fbb6406b3d0 2024-03-23T23:55:24.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:24.977+0000 7fbb68e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb640730e0 con 0x7fbb641598b0 2024-03-23T23:55:24.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:24.977+0000 7fbb61400640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7fbb640a9790 legacy=0x7fbb641562d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:55:24.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:24.981+0000 7fbb62800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbb641598b0 0x7fbb64152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:24.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:24.981+0000 7fbb62800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbb641598b0 0x7fbb64152c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:53720/0 (socket says 172.21.15.8:53720) 2024-03-23T23:55:24.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:24.981+0000 7fbb62800640 1 -- 172.21.15.8:0/3906865855 learned_addr learned my addr 172.21.15.8:0/3906865855 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:55:24.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:24.981+0000 7fbb62800640 1 -- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb641598b0 msgr2=0x7fbb64152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T23:55:24.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:24.981+0000 7fbb62800640 1 -- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb641598b0 msgr2=0x7fbb64152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:55:24.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:24.981+0000 7fbb62800640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb641598b0 0x7fbb64152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:55:24.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:24.981+0000 7fbb62800640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb641598b0 0x7fbb64152c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:55:25.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:25.181+0000 7fbb61400640 1 -- 172.21.15.8:0/3906865855 >> v1:172.21.15.8:6789/0 conn(0x7fbb640a9790 legacy=0x7fbb641562d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:55:25.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:25.185+0000 7fbb62800640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb641598b0 0x7fbb64152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:25.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:25.185+0000 7fbb62800640 1 -- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb641598b0 msgr2=0x7fbb64152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:55:25.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:25.185+0000 7fbb62800640 1 -- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb641598b0 msgr2=0x7fbb64152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:55:25.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:25.185+0000 7fbb62800640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb641598b0 0x7fbb64152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:55:25.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:25.185+0000 7fbb62800640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb641598b0 0x7fbb64152c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:55:25.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:25.589+0000 7fbb61400640 1 -- 172.21.15.8:0/3906865855 >> v1:172.21.15.8:6789/0 conn(0x7fbb640a9790 legacy=0x7fbb641562d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:55:25.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:25.589+0000 7fbb62800640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb641598b0 0x7fbb64152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:25.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:25.593+0000 7fbb62800640 1 -- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb641598b0 msgr2=0x7fbb64152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:55:25.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:25.593+0000 7fbb62800640 1 -- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb641598b0 msgr2=0x7fbb64152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:55:25.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:25.593+0000 7fbb62800640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb641598b0 0x7fbb64152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:55:25.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:25.593+0000 7fbb62800640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb641598b0 0x7fbb64152c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:55:26.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:26.393+0000 7fbb61400640 1 -- 172.21.15.8:0/3906865855 >> v1:172.21.15.8:6789/0 conn(0x7fbb640a9790 legacy=0x7fbb641562d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:55:26.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:26.397+0000 7fbb62800640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb641598b0 0x7fbb64152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:26.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:26.401+0000 7fbb62800640 1 -- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb641598b0 msgr2=0x7fbb64152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:55:26.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:26.401+0000 7fbb62800640 1 -- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb641598b0 msgr2=0x7fbb64152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:55:26.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:26.401+0000 7fbb62800640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb641598b0 0x7fbb64152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:55:26.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:26.401+0000 7fbb62800640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb641598b0 0x7fbb64152c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:55:27.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:27.853+0000 7fbb61e00640 1 -- 172.21.15.8:0/3906865855 >> v1:172.21.15.196:6789/0 conn(0x7fbb6406b3d0 legacy=0x7fbb640c3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-03-23T23:55:27.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:27.853+0000 7fbb61e00640 1 -- 172.21.15.8:0/3906865855 >> v1:172.21.15.196:6789/0 conn(0x7fbb6406b3d0 legacy=0x7fbb640c3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T23:55:27.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:27.853+0000 7fbb61e00640 1 --1- 172.21.15.8:0/3906865855 >> v1:172.21.15.196:6789/0 conn(0x7fbb6406b3d0 0x7fbb640c3a30 :-1 s=OPENED pgs=65 cs=1 l=1).handle_message read tag failed 2024-03-23T23:55:27.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:27.853+0000 7fbb61e00640 1 --1- 172.21.15.8:0/3906865855 >> v1:172.21.15.196:6789/0 conn(0x7fbb6406b3d0 0x7fbb640c3a30 :-1 s=OPENED pgs=65 cs=1 l=1).fault on lossy channel, failing 2024-03-23T23:55:27.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:27.977+0000 7fbb5b400640 1 -- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb641598b0 msgr2=0x7fbb64152c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:55:27.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:27.977+0000 7fbb5b400640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb641598b0 0x7fbb64152c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:27.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:27.977+0000 7fbb5b400640 1 -- 172.21.15.8:0/3906865855 >> v1:172.21.15.196:6789/0 conn(0x7fbb6406b3d0 legacy=0x7fbb640c3a30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:55:27.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:27.977+0000 7fbb5b400640 1 -- 172.21.15.8:0/3906865855 >> v1:172.21.15.8:6789/0 conn(0x7fbb640a9790 legacy=0x7fbb641562d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:55:27.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:27.977+0000 7fbb5b400640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.8:3300/0 conn(0x7fbb44003620 0x7fbb44005a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:27.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:27.977+0000 7fbb5b400640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb440085c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:27.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:27.977+0000 7fbb5b400640 1 -- 172.21.15.8:0/3906865855 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb640730e0 con 0x7fbb44003620 2024-03-23T23:55:27.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:27.977+0000 7fbb5b400640 1 -- 172.21.15.8:0/3906865855 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb44008cf0 con 0x7fbb44006100 2024-03-23T23:55:27.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:27.977+0000 7fbb61e00640 1 -- 172.21.15.8:0/3906865855 >> v2:172.21.15.8:3300/0 conn(0x7fbb44003620 msgr2=0x7fbb44005a70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:55:27.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:27.977+0000 7fbb61e00640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.8:3300/0 conn(0x7fbb44003620 0x7fbb44005a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:55:27.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:27.977+0000 7fbb61400640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb440085c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:27.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:27.977+0000 7fbb61400640 1 -- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 msgr2=0x7fbb440085c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:55:27.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:27.977+0000 7fbb61400640 1 -- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 msgr2=0x7fbb440085c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:55:27.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:27.977+0000 7fbb61400640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb440085c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:55:27.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:27.977+0000 7fbb61400640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb440085c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:55:28.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:28.181+0000 7fbb61400640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb440085c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:28.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:28.181+0000 7fbb61e00640 1 -- 172.21.15.8:0/3906865855 >> v2:172.21.15.8:3300/0 conn(0x7fbb44003620 msgr2=0x7fbb44005a70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:55:28.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:28.181+0000 7fbb61e00640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.8:3300/0 conn(0x7fbb44003620 0x7fbb44005a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:55:28.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:28.185+0000 7fbb61400640 1 -- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 msgr2=0x7fbb440085c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:55:28.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:28.185+0000 7fbb61400640 1 -- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 msgr2=0x7fbb440085c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:55:28.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:28.185+0000 7fbb61400640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb440085c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:55:28.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:28.185+0000 7fbb61400640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb440085c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:55:28.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:28.585+0000 7fbb61e00640 1 -- 172.21.15.8:0/3906865855 >> v2:172.21.15.8:3300/0 conn(0x7fbb44003620 msgr2=0x7fbb44005a70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:55:28.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:28.585+0000 7fbb61e00640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.8:3300/0 conn(0x7fbb44003620 0x7fbb44005a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:55:28.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:28.589+0000 7fbb61400640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb440085c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:28.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:28.589+0000 7fbb61400640 1 -- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 msgr2=0x7fbb440085c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:55:28.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:28.589+0000 7fbb61400640 1 -- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 msgr2=0x7fbb440085c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:55:28.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:28.589+0000 7fbb61400640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb440085c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:55:28.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:28.589+0000 7fbb61400640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb440085c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:55:29.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:29.389+0000 7fbb61e00640 1 -- 172.21.15.8:0/3906865855 >> v2:172.21.15.8:3300/0 conn(0x7fbb44003620 msgr2=0x7fbb44005a70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:55:29.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:29.389+0000 7fbb61e00640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.8:3300/0 conn(0x7fbb44003620 0x7fbb44005a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:55:29.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:29.405+0000 7fbb61400640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb440085c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:29.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:29.405+0000 7fbb61400640 1 -- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 msgr2=0x7fbb440085c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:55:29.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:29.405+0000 7fbb61400640 1 -- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 msgr2=0x7fbb440085c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:55:29.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:29.405+0000 7fbb61400640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb440085c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:55:29.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:29.405+0000 7fbb61400640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb440085c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:55:30.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:30.977+0000 7fbb5b400640 1 -- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 msgr2=0x7fbb440085c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:55:30.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:30.977+0000 7fbb5b400640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb440085c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:30.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:30.977+0000 7fbb5b400640 1 -- 172.21.15.8:0/3906865855 >> v2:172.21.15.8:3300/0 conn(0x7fbb44003620 msgr2=0x7fbb44005a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:55:30.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:30.977+0000 7fbb5b400640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.8:3300/0 conn(0x7fbb44003620 0x7fbb44005a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:30.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:30.977+0000 7fbb5b400640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.8:3300/0 conn(0x7fbb44011900 0x7fbb44013cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:30.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:30.977+0000 7fbb5b400640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb44017ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:30.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:30.977+0000 7fbb5b400640 1 -- 172.21.15.8:0/3906865855 --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb64072e00 con 0x7fbb640a9790 2024-03-23T23:55:30.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:30.977+0000 7fbb5b400640 1 -- 172.21.15.8:0/3906865855 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb640730e0 con 0x7fbb44011900 2024-03-23T23:55:30.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:30.977+0000 7fbb5b400640 1 -- 172.21.15.8:0/3906865855 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb44008cf0 con 0x7fbb44006100 2024-03-23T23:55:30.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:30.977+0000 7fbb61400640 1 -- 172.21.15.8:0/3906865855 >> v1:172.21.15.8:6789/0 conn(0x7fbb640a9790 legacy=0x7fbb44016390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:55:30.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:30.981+0000 7fbb61e00640 1 -- 172.21.15.8:0/3906865855 >> v2:172.21.15.8:3300/0 conn(0x7fbb44011900 msgr2=0x7fbb44013cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:55:30.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:30.981+0000 7fbb61e00640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.8:3300/0 conn(0x7fbb44011900 0x7fbb44013cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:55:30.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:30.985+0000 7fbb62800640 1 -- 172.21.15.8:0/3906865855 reap_dead start 2024-03-23T23:55:30.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:30.989+0000 7fbb62800640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb44017ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:30.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:30.989+0000 7fbb62800640 1 -- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 msgr2=0x7fbb44017ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:55:30.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:30.989+0000 7fbb62800640 1 -- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 msgr2=0x7fbb44017ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:55:30.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:30.989+0000 7fbb62800640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb44017ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:55:30.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:30.989+0000 7fbb62800640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb44017ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:55:31.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:31.181+0000 7fbb61400640 1 -- 172.21.15.8:0/3906865855 >> v1:172.21.15.8:6789/0 conn(0x7fbb640a9790 legacy=0x7fbb44016390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:55:31.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:31.189+0000 7fbb61e00640 1 -- 172.21.15.8:0/3906865855 >> v2:172.21.15.8:3300/0 conn(0x7fbb44011900 msgr2=0x7fbb44013cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:55:31.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:31.189+0000 7fbb61e00640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.8:3300/0 conn(0x7fbb44011900 0x7fbb44013cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:55:31.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:31.193+0000 7fbb62800640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb44017ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:31.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:31.197+0000 7fbb62800640 1 -- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 msgr2=0x7fbb44017ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:55:31.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:31.197+0000 7fbb62800640 1 -- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 msgr2=0x7fbb44017ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:55:31.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:31.197+0000 7fbb62800640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb44017ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:55:31.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:31.197+0000 7fbb62800640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb44017ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:55:31.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:31.593+0000 7fbb61400640 1 -- 172.21.15.8:0/3906865855 >> v1:172.21.15.8:6789/0 conn(0x7fbb640a9790 legacy=0x7fbb44016390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:55:31.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:31.593+0000 7fbb61e00640 1 -- 172.21.15.8:0/3906865855 >> v2:172.21.15.8:3300/0 conn(0x7fbb44011900 msgr2=0x7fbb44013cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:55:31.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:31.593+0000 7fbb61e00640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.8:3300/0 conn(0x7fbb44011900 0x7fbb44013cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:55:31.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:31.613+0000 7fbb62800640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb44017ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:31.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:31.613+0000 7fbb62800640 1 -- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 msgr2=0x7fbb44017ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:55:31.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:31.613+0000 7fbb62800640 1 -- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 msgr2=0x7fbb44017ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:55:31.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:31.613+0000 7fbb62800640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb44017ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:55:31.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:31.613+0000 7fbb62800640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb44017ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:55:32.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:32.397+0000 7fbb61400640 1 -- 172.21.15.8:0/3906865855 >> v1:172.21.15.8:6789/0 conn(0x7fbb640a9790 legacy=0x7fbb44016390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:55:32.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:32.397+0000 7fbb61e00640 1 -- 172.21.15.8:0/3906865855 >> v2:172.21.15.8:3300/0 conn(0x7fbb44011900 msgr2=0x7fbb44013cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:55:32.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:32.397+0000 7fbb61e00640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.8:3300/0 conn(0x7fbb44011900 0x7fbb44013cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:55:32.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:32.421+0000 7fbb62800640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb44017ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:32.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:32.421+0000 7fbb62800640 1 -- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 msgr2=0x7fbb44017ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:55:32.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:32.421+0000 7fbb62800640 1 -- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 msgr2=0x7fbb44017ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:55:32.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:32.421+0000 7fbb62800640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb44017ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:55:32.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:32.421+0000 7fbb62800640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb44017ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:55:33.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:33.977+0000 7fbb5b400640 1 -- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 msgr2=0x7fbb44017ad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:55:33.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:33.977+0000 7fbb5b400640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb44017ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:33.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:33.977+0000 7fbb5b400640 1 -- 172.21.15.8:0/3906865855 >> v2:172.21.15.8:3300/0 conn(0x7fbb44011900 msgr2=0x7fbb44013cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:55:33.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:33.977+0000 7fbb5b400640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.8:3300/0 conn(0x7fbb44011900 0x7fbb44013cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:33.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:33.977+0000 7fbb5b400640 1 -- 172.21.15.8:0/3906865855 >> v1:172.21.15.8:6789/0 conn(0x7fbb640a9790 legacy=0x7fbb44016390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:55:33.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:33.977+0000 7fbb5b400640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb44019730 0x7fbb4401bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:33.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:33.977+0000 7fbb5b400640 1 -- 172.21.15.8:0/3906865855 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb64155b10 con 0x7fbb44003a60 2024-03-23T23:55:33.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:33.977+0000 7fbb5b400640 1 -- 172.21.15.8:0/3906865855 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb640730e0 con 0x7fbb44019730 2024-03-23T23:55:33.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:33.981+0000 7fbb61400640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb44019730 0x7fbb4401bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:33.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:33.981+0000 7fbb61400640 1 -- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb44019730 msgr2=0x7fbb4401bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:55:33.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:33.981+0000 7fbb61400640 1 -- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb44019730 msgr2=0x7fbb4401bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:55:33.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:33.981+0000 7fbb61400640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb44019730 0x7fbb4401bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:55:33.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:33.981+0000 7fbb61400640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb44019730 0x7fbb4401bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:55:34.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.185+0000 7fbb61400640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb44019730 0x7fbb4401bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:34.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.185+0000 7fbb61400640 1 -- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb44019730 msgr2=0x7fbb4401bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:55:34.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.185+0000 7fbb61400640 1 -- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb44019730 msgr2=0x7fbb4401bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:55:34.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.185+0000 7fbb61400640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb44019730 0x7fbb4401bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:55:34.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.185+0000 7fbb61400640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb44019730 0x7fbb4401bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:55:34.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.589+0000 7fbb61400640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb44019730 0x7fbb4401bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:34.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.589+0000 7fbb61400640 1 -- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb44019730 msgr2=0x7fbb4401bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:55:34.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.589+0000 7fbb61400640 1 -- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb44019730 msgr2=0x7fbb4401bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:55:34.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.589+0000 7fbb61400640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb44019730 0x7fbb4401bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:55:34.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.589+0000 7fbb61400640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb44019730 0x7fbb4401bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:55:34.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.685+0000 7fbb60a00640 1 -- 172.21.15.8:0/3906865855 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1527102543 0 0) 0x7fbb64155b10 con 0x7fbb44003a60 2024-03-23T23:55:34.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.685+0000 7fbb60a00640 1 -- 172.21.15.8:0/3906865855 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb48003530 con 0x7fbb44003a60 2024-03-23T23:55:34.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.721+0000 7fbb60a00640 1 -- 172.21.15.8:0/3906865855 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1457055163 0 0) 0x7fbb48003530 con 0x7fbb44003a60 2024-03-23T23:55:34.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.721+0000 7fbb60a00640 1 -- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb44019730 msgr2=0x7fbb4401bb20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:55:34.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.721+0000 7fbb60a00640 1 --2- 172.21.15.8:0/3906865855 >> v2:172.21.15.196:3300/0 conn(0x7fbb44019730 0x7fbb4401bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:34.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.721+0000 7fbb60a00640 1 -- 172.21.15.8:0/3906865855 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb64072e00 con 0x7fbb44003a60 2024-03-23T23:55:34.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.721+0000 7fbb60a00640 1 -- 172.21.15.8:0/3906865855 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7fbb540018a0 con 0x7fbb44003a60 2024-03-23T23:55:34.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.721+0000 7fbb60a00640 1 -- 172.21.15.8:0/3906865855 >> v1:172.21.15.196:6789/0 conn(0x7fbb44003a60 legacy=0x7fbb44018010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:34.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.721+0000 7fbb62800640 1 -- 172.21.15.8:0/3906865855 reap_dead start 2024-03-23T23:55:34.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.721+0000 7fbb60a00640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb48003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:34.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.721+0000 7fbb60a00640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb48004040 0x7fbb48004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:34.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.721+0000 7fbb60a00640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb48004d50 0x7fbb480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:34.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.721+0000 7fbb60a00640 1 -- 172.21.15.8:0/3906865855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb640730e0 con 0x7fbb48004d50 2024-03-23T23:55:34.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.721+0000 7fbb60a00640 1 -- 172.21.15.8:0/3906865855 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4800bbe0 con 0x7fbb48004040 2024-03-23T23:55:34.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.721+0000 7fbb60a00640 1 -- 172.21.15.8:0/3906865855 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4800bde0 con 0x7fbb44006100 2024-03-23T23:55:34.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.721+0000 7fbb62800640 1 -- 172.21.15.8:0/3906865855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb48004d50 msgr2=0x7fbb480051d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:55:34.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.721+0000 7fbb62800640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb48004d50 0x7fbb480051d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:55:34.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.729+0000 7fbb61e00640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb48003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:34.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.733+0000 7fbb61e00640 1 -- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb48004040 msgr2=0x7fbb48004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:55:34.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.733+0000 7fbb61e00640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb48004040 0x7fbb48004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:34.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.733+0000 7fbb61e00640 1 -- 172.21.15.8:0/3906865855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb48004d50 msgr2=0x7fbb480051d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:55:34.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.733+0000 7fbb61e00640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb48004d50 0x7fbb480051d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:34.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.733+0000 7fbb61e00640 1 -- 172.21.15.8:0/3906865855 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb64072e00 con 0x7fbb44006100 2024-03-23T23:55:34.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.753+0000 7fbb61e00640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb48003a30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbb54001160 tx=0x7fbb5401f2f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6825168695410973 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:55:34.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.769+0000 7fbb60a00640 1 -- 172.21.15.8:0/3906865855 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb54007c70 con 0x7fbb44006100 2024-03-23T23:55:34.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.769+0000 7fbb60a00640 1 -- 172.21.15.8:0/3906865855 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb540ac070 con 0x7fbb44006100 2024-03-23T23:55:34.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.769+0000 7fbb60a00640 1 -- 172.21.15.8:0/3906865855 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb540072b0 con 0x7fbb44006100 2024-03-23T23:55:34.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.769+0000 7fbb68e00640 1 -- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 msgr2=0x7fbb48003a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:34.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.769+0000 7fbb68e00640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb48003a30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbb54001160 tx=0x7fbb5401f2f0 comp rx=0 tx=0).stop 2024-03-23T23:55:34.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.773+0000 7fbb68e00640 1 -- 172.21.15.8:0/3906865855 shutdown_connections 2024-03-23T23:55:34.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.773+0000 7fbb68e00640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb48004d50 0x7fbb480051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:34.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.773+0000 7fbb68e00640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb48004040 0x7fbb48004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:34.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.773+0000 7fbb68e00640 1 --2- 172.21.15.8:0/3906865855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb44006100 0x7fbb48003a30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:34.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.773+0000 7fbb68e00640 1 -- 172.21.15.8:0/3906865855 >> 172.21.15.8:0/3906865855 conn(0x7fbb640c8180 msgr2=0x7fbb640c8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:55:34.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.781+0000 7fbb68e00640 1 -- 172.21.15.8:0/3906865855 shutdown_connections 2024-03-23T23:55:34.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.781+0000 7fbb68e00640 1 -- 172.21.15.8:0/3906865855 wait complete. 2024-03-23T23:55:34.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.793+0000 7fbb68e00640 1 Processor -- start 2024-03-23T23:55:34.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.797+0000 7fbb68e00640 1 -- start start 2024-03-23T23:55:34.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.801+0000 7fbb68e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb44006100 0x7fbb64156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:34.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.801+0000 7fbb68e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb48004040 0x7fbb641f7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:34.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.801+0000 7fbb68e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb48004d50 0x7fbb641f8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:34.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.801+0000 7fbb61e00640 1 -- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb44006100 msgr2=0x7fbb64156f50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:55:34.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.801+0000 7fbb61e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb44006100 0x7fbb64156f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:55:34.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.805+0000 7fbb62800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb48004d50 0x7fbb641f8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:34.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.805+0000 7fbb62800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb48004d50 0x7fbb641f8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:55596/0 (socket says 172.21.15.8:55596) 2024-03-23T23:55:34.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.805+0000 7fbb62800640 1 -- 172.21.15.8:0/252603523 learned_addr learned my addr 172.21.15.8:0/252603523 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:55:34.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.805+0000 7fbb61400640 1 --2- 172.21.15.8:0/252603523 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb48004040 0x7fbb641f7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:34.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.809+0000 7fbb68e00640 1 -- 172.21.15.8:0/252603523 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb64155e40 con 0x7fbb44006100 2024-03-23T23:55:34.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.809+0000 7fbb68e00640 1 -- 172.21.15.8:0/252603523 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6406b7b0 con 0x7fbb48004040 2024-03-23T23:55:34.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.809+0000 7fbb68e00640 1 -- 172.21.15.8:0/252603523 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6406b930 con 0x7fbb48004d50 2024-03-23T23:55:34.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.817+0000 7fbb62800640 1 -- 172.21.15.8:0/252603523 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb48004040 msgr2=0x7fbb641f7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:34.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.817+0000 7fbb62800640 1 --2- 172.21.15.8:0/252603523 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb48004040 0x7fbb641f7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:34.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.817+0000 7fbb62800640 1 -- 172.21.15.8:0/252603523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb44006100 msgr2=0x7fbb64156f50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:55:34.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.817+0000 7fbb62800640 1 --2- 172.21.15.8:0/252603523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb44006100 0x7fbb64156f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:34.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.821+0000 7fbb62800640 1 -- 172.21.15.8:0/252603523 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb64158d40 con 0x7fbb48004d50 2024-03-23T23:55:34.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.825+0000 7fbb62800640 1 --2- 172.21.15.8:0/252603523 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb48004d50 0x7fbb641f8280 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbb64072400 tx=0x7fbb5c0183c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:55:34.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.829+0000 7fbb5a000640 1 -- 172.21.15.8:0/252603523 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c018d70 con 0x7fbb48004d50 2024-03-23T23:55:34.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.833+0000 7fbb5a000640 1 -- 172.21.15.8:0/252603523 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5c00b0d0 con 0x7fbb48004d50 2024-03-23T23:55:34.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.833+0000 7fbb68e00640 1 -- 172.21.15.8:0/252603523 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb640accc0 con 0x7fbb48004d50 2024-03-23T23:55:34.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.833+0000 7fbb68e00640 1 -- 172.21.15.8:0/252603523 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb64157a30 con 0x7fbb48004d50 2024-03-23T23:55:34.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.833+0000 7fbb68e00640 1 -- 172.21.15.8:0/252603523 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb64157820 con 0x7fbb48004d50 2024-03-23T23:55:34.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.837+0000 7fbb5a000640 1 -- 172.21.15.8:0/252603523 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c026020 con 0x7fbb48004d50 2024-03-23T23:55:34.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.841+0000 7fbb5a000640 1 -- 172.21.15.8:0/252603523 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fbb5c029020 con 0x7fbb48004d50 2024-03-23T23:55:34.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.841+0000 7fbb5a000640 1 --2- 172.21.15.8:0/252603523 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbb440690b0 0x7fbb4406b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:34.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.841+0000 7fbb5a000640 1 -- 172.21.15.8:0/252603523 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fbb5c012040 con 0x7fbb48004d50 2024-03-23T23:55:34.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.841+0000 7fbb61e00640 1 --2- 172.21.15.8:0/252603523 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbb440690b0 0x7fbb4406b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:34.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.849+0000 7fbb61e00640 1 --2- 172.21.15.8:0/252603523 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbb440690b0 0x7fbb4406b570 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbb540ae000 tx=0x7fbb540aa070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:55:34.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:34.869+0000 7fbb5a000640 1 -- 172.21.15.8:0/252603523 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fbb5c057790 con 0x7fbb48004d50 2024-03-23T23:55:35.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.333+0000 7fbb68e00640 1 -- 172.21.15.8:0/252603523 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fbb6404f480 con 0x7fbb48004d50 2024-03-23T23:55:35.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.337+0000 7fbb5a000640 1 -- 172.21.15.8:0/252603523 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1555 (secure 0 0 0) 0x7fbb5c057090 con 0x7fbb48004d50 2024-03-23T23:55:35.339 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":104,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:55:35.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.341+0000 7fbb68e00640 1 -- 172.21.15.8:0/252603523 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbb440690b0 msgr2=0x7fbb4406b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:35.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.341+0000 7fbb68e00640 1 --2- 172.21.15.8:0/252603523 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbb440690b0 0x7fbb4406b570 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbb540ae000 tx=0x7fbb540aa070 comp rx=0 tx=0).stop 2024-03-23T23:55:35.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.341+0000 7fbb68e00640 1 -- 172.21.15.8:0/252603523 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb48004d50 msgr2=0x7fbb641f8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:35.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.341+0000 7fbb68e00640 1 --2- 172.21.15.8:0/252603523 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb48004d50 0x7fbb641f8280 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbb64072400 tx=0x7fbb5c0183c0 comp rx=0 tx=0).stop 2024-03-23T23:55:35.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.341+0000 7fbb68e00640 1 -- 172.21.15.8:0/252603523 shutdown_connections 2024-03-23T23:55:35.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.341+0000 7fbb68e00640 1 --2- 172.21.15.8:0/252603523 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbb440690b0 0x7fbb4406b570 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:35.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.341+0000 7fbb68e00640 1 --2- 172.21.15.8:0/252603523 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb48004d50 0x7fbb641f8280 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:35.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.341+0000 7fbb68e00640 1 --2- 172.21.15.8:0/252603523 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb48004040 0x7fbb641f7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:35.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.341+0000 7fbb68e00640 1 --2- 172.21.15.8:0/252603523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb44006100 0x7fbb64156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:35.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.341+0000 7fbb68e00640 1 -- 172.21.15.8:0/252603523 >> 172.21.15.8:0/252603523 conn(0x7fbb640c8180 msgr2=0x7fbb640c8560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:55:35.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.341+0000 7fbb68e00640 1 -- 172.21.15.8:0/252603523 shutdown_connections 2024-03-23T23:55:35.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.341+0000 7fbb68e00640 1 -- 172.21.15.8:0/252603523 wait complete. 2024-03-23T23:55:35.366 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-03-23T23:55:35.366 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-03-23T23:55:35.366 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:55:35.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.545+0000 7f44cf000640 1 Processor -- start 2024-03-23T23:55:35.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.545+0000 7f44cf000640 1 -- start start 2024-03-23T23:55:35.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.545+0000 7f44cf000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44c814d8b0 0x7f44c80c7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:35.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.545+0000 7f44cf000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c80c7670 con 0x7f44c80c5560 2024-03-23T23:55:35.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.545+0000 7f44cf000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c80710e0 con 0x7f44c8070b50 2024-03-23T23:55:35.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.545+0000 7f44cf000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c80c4830 con 0x7f44c814d8b0 2024-03-23T23:55:35.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.545+0000 7f44cd000640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f44c80c5560 legacy=0x7f44c806ed00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2024-03-23T23:55:35.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.545+0000 7f44c7e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44c814d8b0 0x7f44c80c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:35.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.545+0000 7f44c7e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44c814d8b0 0x7f44c80c7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:55602/0 (socket says 172.21.15.8:55602) 2024-03-23T23:55:35.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.545+0000 7f44c7e00640 1 -- 172.21.15.8:0/3666516132 learned_addr learned my addr 172.21.15.8:0/3666516132 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:55:35.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.549+0000 7f44c7400640 1 -- 172.21.15.8:0/3666516132 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513532775 0 0) 0x7f44c80710e0 con 0x7f44c8070b50 2024-03-23T23:55:35.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.549+0000 7f44c7400640 1 -- 172.21.15.8:0/3666516132 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44ac003530 con 0x7f44c8070b50 2024-03-23T23:55:35.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.549+0000 7f44c7400640 1 -- 172.21.15.8:0/3666516132 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2896620882 0 0) 0x7f44ac003530 con 0x7f44c8070b50 2024-03-23T23:55:35.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.549+0000 7f44c7400640 1 -- 172.21.15.8:0/3666516132 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44c814d8b0 msgr2=0x7f44c80c7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:55:35.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.549+0000 7f44c7400640 1 --2- 172.21.15.8:0/3666516132 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44c814d8b0 0x7f44c80c7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:35.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.549+0000 7f44c7400640 1 -- 172.21.15.8:0/3666516132 >> v1:172.21.15.8:6789/0 conn(0x7f44c80c5560 legacy=0x7f44c806ed00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:55:35.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.549+0000 7f44c7400640 1 -- 172.21.15.8:0/3666516132 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c80c4a80 con 0x7f44c8070b50 2024-03-23T23:55:35.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.549+0000 7f44c7400640 1 -- 172.21.15.8:0/3666516132 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7f44b0001680 con 0x7f44c8070b50 2024-03-23T23:55:35.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.549+0000 7f44c7400640 1 -- 172.21.15.8:0/3666516132 >> v1:172.21.15.196:6789/0 conn(0x7f44c8070b50 legacy=0x7f44c81541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:35.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.549+0000 7f44c7400640 1 --2- 172.21.15.8:0/3666516132 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44c814d8b0 0x7f44ac0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:35.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.549+0000 7f44c7400640 1 --2- 172.21.15.8:0/3666516132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44ac003f20 0x7f44ac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:35.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.549+0000 7f44c7400640 1 --2- 172.21.15.8:0/3666516132 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44ac004d50 0x7f44ac0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:35.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.549+0000 7f44c7400640 1 -- 172.21.15.8:0/3666516132 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c80c4830 con 0x7f44ac003f20 2024-03-23T23:55:35.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.549+0000 7f44c7400640 1 -- 172.21.15.8:0/3666516132 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac00ba80 con 0x7f44ac004d50 2024-03-23T23:55:35.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.549+0000 7f44c7400640 1 -- 172.21.15.8:0/3666516132 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac00bc80 con 0x7f44c814d8b0 2024-03-23T23:55:35.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.549+0000 7f44bfe00640 1 -- 172.21.15.8:0/3666516132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44ac003f20 msgr2=0x7f44ac004810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:55:35.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.549+0000 7f44bfe00640 1 --2- 172.21.15.8:0/3666516132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44ac003f20 0x7f44ac004810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:55:35.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.549+0000 7f44c7e00640 1 --2- 172.21.15.8:0/3666516132 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44c814d8b0 0x7f44ac0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:35.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.549+0000 7f44cd000640 1 --2- 172.21.15.8:0/3666516132 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44ac004d50 0x7f44ac0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:35.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.549+0000 7f44c7e00640 1 -- 172.21.15.8:0/3666516132 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44ac004d50 msgr2=0x7f44ac0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:55:35.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.549+0000 7f44c7e00640 1 --2- 172.21.15.8:0/3666516132 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44ac004d50 0x7f44ac0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:35.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.549+0000 7f44c7e00640 1 -- 172.21.15.8:0/3666516132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44ac003f20 msgr2=0x7f44ac004810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:55:35.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.549+0000 7f44c7e00640 1 --2- 172.21.15.8:0/3666516132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44ac003f20 0x7f44ac004810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:35.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.549+0000 7f44c7e00640 1 -- 172.21.15.8:0/3666516132 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ac003530 con 0x7f44c814d8b0 2024-03-23T23:55:35.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.553+0000 7f44c7e00640 1 --2- 172.21.15.8:0/3666516132 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44c814d8b0 0x7f44ac0039c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f44b8009b90 tx=0x7f44b801cb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ec436582c891b6c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:55:35.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.557+0000 7f44c7400640 1 -- 172.21.15.8:0/3666516132 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b80b2070 con 0x7f44c814d8b0 2024-03-23T23:55:35.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.557+0000 7f44c7400640 1 -- 172.21.15.8:0/3666516132 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b80a5770 con 0x7f44c814d8b0 2024-03-23T23:55:35.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.557+0000 7f44c7400640 1 -- 172.21.15.8:0/3666516132 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b8009760 con 0x7f44c814d8b0 2024-03-23T23:55:35.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.557+0000 7f44cf000640 1 -- 172.21.15.8:0/3666516132 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44c814d8b0 msgr2=0x7f44ac0039c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:35.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.557+0000 7f44cf000640 1 --2- 172.21.15.8:0/3666516132 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44c814d8b0 0x7f44ac0039c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f44b8009b90 tx=0x7f44b801cb70 comp rx=0 tx=0).stop 2024-03-23T23:55:35.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.557+0000 7f44cd000640 1 -- 172.21.15.8:0/3666516132 reap_dead start 2024-03-23T23:55:35.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.557+0000 7f44cf000640 1 -- 172.21.15.8:0/3666516132 shutdown_connections 2024-03-23T23:55:35.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.557+0000 7f44cf000640 1 -- 172.21.15.8:0/3666516132 >> 172.21.15.8:0/3666516132 conn(0x7f44c80aafe0 msgr2=0x7f44c80ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:55:35.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.557+0000 7f44cf000640 1 -- 172.21.15.8:0/3666516132 shutdown_connections 2024-03-23T23:55:35.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.557+0000 7f44cf000640 1 -- 172.21.15.8:0/3666516132 wait complete. 2024-03-23T23:55:35.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.557+0000 7f44cf000640 1 Processor -- start 2024-03-23T23:55:35.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.557+0000 7f44cf000640 1 -- start start 2024-03-23T23:55:35.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.557+0000 7f44cf000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44c814d8b0 0x7f44c80aec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:35.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.557+0000 7f44cf000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44c8154b20 0x7f44c81ea4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:35.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.557+0000 7f44cf000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c814f7c0 0x7f44c814fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:35.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.557+0000 7f44cf000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c806f410 con 0x7f44c814f7c0 2024-03-23T23:55:35.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.557+0000 7f44cf000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c80c50d0 con 0x7f44c8154b20 2024-03-23T23:55:35.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.557+0000 7f44cf000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c806f590 con 0x7f44c814d8b0 2024-03-23T23:55:35.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.561+0000 7f44cd000640 1 -- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c814f7c0 msgr2=0x7f44c814fc40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:55:35.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.561+0000 7f44cd000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c814f7c0 0x7f44c814fc40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:55:35.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.561+0000 7f44bfe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44c8154b20 0x7f44c81ea4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:35.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.561+0000 7f44bfe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44c8154b20 0x7f44c81ea4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:37868/0 (socket says 172.21.15.8:37868) 2024-03-23T23:55:35.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.561+0000 7f44bfe00640 1 -- 172.21.15.8:0/495479650 learned_addr learned my addr 172.21.15.8:0/495479650 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:55:35.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.561+0000 7f44bfe00640 1 -- 172.21.15.8:0/495479650 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44c814d8b0 msgr2=0x7f44c80aec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:35.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.561+0000 7f44bfe00640 1 --2- 172.21.15.8:0/495479650 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44c814d8b0 0x7f44c80aec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:35.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.561+0000 7f44bfe00640 1 -- 172.21.15.8:0/495479650 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c814f7c0 msgr2=0x7f44c814fc40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:55:35.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.561+0000 7f44bfe00640 1 --2- 172.21.15.8:0/495479650 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c814f7c0 0x7f44c814fc40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:35.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.561+0000 7f44bfe00640 1 -- 172.21.15.8:0/495479650 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c814ed20 con 0x7f44c8154b20 2024-03-23T23:55:35.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.561+0000 7f44bfe00640 1 --2- 172.21.15.8:0/495479650 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44c8154b20 0x7f44c81ea4f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f44b000f550 tx=0x7f44b000fa10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:55:35.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.561+0000 7f44c4c00640 1 -- 172.21.15.8:0/495479650 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b001b070 con 0x7f44c8154b20 2024-03-23T23:55:35.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.561+0000 7f44c4c00640 1 -- 172.21.15.8:0/495479650 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b000a560 con 0x7f44c8154b20 2024-03-23T23:55:35.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.561+0000 7f44c4c00640 1 -- 172.21.15.8:0/495479650 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b0007a00 con 0x7f44c8154b20 2024-03-23T23:55:35.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.561+0000 7f44cf000640 1 -- 172.21.15.8:0/495479650 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c81eae40 con 0x7f44c8154b20 2024-03-23T23:55:35.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.561+0000 7f44cf000640 1 -- 172.21.15.8:0/495479650 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c81eb120 con 0x7f44c8154b20 2024-03-23T23:55:35.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.561+0000 7f44cf000640 1 --2- 172.21.15.8:0/495479650 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44c8150180 0x7f44c80ac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:35.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.561+0000 7f44cf000640 1 -- 172.21.15.8:0/495479650 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c80af190 con 0x7f44c8150180 2024-03-23T23:55:35.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.565+0000 7f44c7e00640 1 --2- 172.21.15.8:0/495479650 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44c8150180 0x7f44c80ac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:35.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.565+0000 7f44c7e00640 1 -- 172.21.15.8:0/495479650 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f44c8068270 con 0x7f44c8150180 2024-03-23T23:55:35.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.565+0000 7f44c4c00640 1 -- 172.21.15.8:0/495479650 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f44b001e070 con 0x7f44c8154b20 2024-03-23T23:55:35.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.565+0000 7f44c7e00640 1 --2- 172.21.15.8:0/495479650 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44c8150180 0x7f44c80ac2e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f44b8009b60 tx=0x7f44b80a5cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:55:35.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.565+0000 7f44c4c00640 1 --2- 172.21.15.8:0/495479650 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f44a4067660 0x7f44a4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:35.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.565+0000 7f44c4c00640 1 -- 172.21.15.8:0/495479650 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f44b0087f10 con 0x7f44c8154b20 2024-03-23T23:55:35.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.565+0000 7f44c4c00640 1 -- 172.21.15.8:0/495479650 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b80b2040 con 0x7f44c8150180 2024-03-23T23:55:35.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.569+0000 7f44c4c00640 1 -- 172.21.15.8:0/495479650 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f44b8009760 con 0x7f44c8150180 2024-03-23T23:55:35.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.569+0000 7f44c4c00640 1 -- 172.21.15.8:0/495479650 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44c8150180 msgr2=0x7f44c80ac2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:35.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.569+0000 7f44c4c00640 1 --2- 172.21.15.8:0/495479650 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44c8150180 0x7f44c80ac2e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f44b8009b60 tx=0x7f44b80a5cb0 comp rx=0 tx=0).stop 2024-03-23T23:55:35.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.569+0000 7f44c4c00640 1 -- 172.21.15.8:0/495479650 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44c8150180 msgr2=0x7f44c80ac2e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:55:35.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.569+0000 7f44c4c00640 1 --2- 172.21.15.8:0/495479650 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44c8150180 0x7f44c80ac2e0 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f44b8009b60 tx=0x7f44b80a5cb0 comp rx=0 tx=0).stop 2024-03-23T23:55:35.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.569+0000 7f44cd000640 1 --2- 172.21.15.8:0/495479650 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f44a4067660 0x7f44a4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:35.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.569+0000 7f44cd000640 1 --2- 172.21.15.8:0/495479650 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f44a4067660 0x7f44a4069b20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f44c80c6d70 tx=0x7f44c0003b40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:55:35.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.573+0000 7f44cf000640 1 --2- 172.21.15.8:0/495479650 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44c80ac820 0x7f44c80acc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:35.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.573+0000 7f44cf000640 1 -- 172.21.15.8:0/495479650 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c80ad170 con 0x7f44c80ac820 2024-03-23T23:55:35.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.577+0000 7f44c7e00640 1 --2- 172.21.15.8:0/495479650 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44c80ac820 0x7f44c80acc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:35.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.581+0000 7f44c7e00640 1 -- 172.21.15.8:0/495479650 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f44c806d330 con 0x7f44c80ac820 2024-03-23T23:55:35.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.581+0000 7f44c7e00640 1 --2- 172.21.15.8:0/495479650 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44c80ac820 0x7f44c80acc30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f44b8000c10 tx=0x7f44b80a7070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:55:35.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.581+0000 7f44c4c00640 1 -- 172.21.15.8:0/495479650 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b80c3070 con 0x7f44c80ac820 2024-03-23T23:55:35.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.581+0000 7f44c4c00640 1 -- 172.21.15.8:0/495479650 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5031 (secure 0 0 0) 0x7f44b8003620 con 0x7f44c80ac820 2024-03-23T23:55:35.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.581+0000 7f44c4c00640 1 -- 172.21.15.8:0/495479650 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44c80ac820 msgr2=0x7f44c80acc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:35.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.581+0000 7f44c4c00640 1 --2- 172.21.15.8:0/495479650 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44c80ac820 0x7f44c80acc30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f44b8000c10 tx=0x7f44b80a7070 comp rx=0 tx=0).stop 2024-03-23T23:55:35.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.581+0000 7f44c4c00640 1 -- 172.21.15.8:0/495479650 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44c80ac820 msgr2=0x7f44c80acc30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:55:35.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.581+0000 7f44c4c00640 1 --2- 172.21.15.8:0/495479650 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44c80ac820 0x7f44c80acc30 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f44b8000c10 tx=0x7f44b80a7070 comp rx=0 tx=0).stop 2024-03-23T23:55:35.584 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:55:35.584 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:55:35.584 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:55:35.584 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:55:35.585 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 104, 2024-03-23T23:55:35.585 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:55:35.585 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:55:35.585 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:55:35.585 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:55:35.585 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 0, 2024-03-23T23:55:35.585 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:55:35.585 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:55:35.585 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:55:35.585 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:55:35.585 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:55:35.585 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:55:35.585 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:55:35.586 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:55:35.586 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:55:35.586 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:55:35.586 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:55:35.586 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:55:35.586 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:55:35.586 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:55:35.586 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:55:35.586 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:55:35.586 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:55:35.586 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:55:35.586 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:55:35.586 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:55:35.587 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:55:35.587 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:55:35.587 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:55:35.587 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:55:35.587 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:55:35.587 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:55:35.587 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:55:35.587 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:55:35.587 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:55:35.587 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:35.587 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:55:35.587 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:55:35.587 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:55:35.587 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:55:35.588 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:55:35.588 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:55:35.588 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:55:35.588 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:55:35.588 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:55:35.588 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:55:35.588 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:55:35.588 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:55:35.588 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:55:35.588 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:55:35.588 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:55:35.588 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:55:35.588 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:55:35.588 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:55:35.589 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:55:35.589 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:55:35.589 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:55:35.589 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:55:35.589 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:55:35.589 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:55:35.589 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:55:35.589 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:55:35.589 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:55:35.589 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:55:35.589 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:55:35.589 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:55:35.589 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:35.590 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:55:35.590 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:35.590 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:55:35.590 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:55:35.590 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:55:35.590 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:55:35.590 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:35.590 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:55:35.590 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:55:35.590 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:55:35.590 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:35.590 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:35.590 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:55:35.590 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:55:35.591 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:55:35.591 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:35.591 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:55:35.591 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:35.591 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:55:35.591 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:55:35.591 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:55:35.591 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:55:35.591 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:55:35.591 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:35.591 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:35.591 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:55:35.591 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:55:35.592 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:55:35.592 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:55:35.592 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:35.592 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:55:35.592 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:55:35.592 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:55:35.592 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:35.592 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:35.592 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:55:35.592 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:55:35.592 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:55:35.592 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:35.592 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:55:35.593 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:35.593 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:55:35.593 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:55:35.593 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:55:35.593 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:55:35.593 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:55:35.593 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:35.593 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:35.593 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:55:35.593 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:55:35.593 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:55:35.593 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:55:35.593 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:35.593 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:55:35.594 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:55:35.594 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:55:35.594 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:35.594 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:35.594 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:55:35.594 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:55:35.594 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:55:35.594 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:35.594 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:55:35.594 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:35.594 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:55:35.594 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:55:35.594 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:55:35.595 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:55:35.595 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:55:35.595 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:35.595 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:55:35.595 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:35.595 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:55:35.595 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:55:35.595 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:35.595 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:55:35.595 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:55:35.595 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:55:35.595 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:35.595 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:55:35.595 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:55:35.596 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:35.596 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:55:35.596 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:55:35.596 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:55:35.596 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:35.596 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:55:35.596 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:55:35.596 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:35.596 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:55:35.596 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:55:35.596 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:55:35.596 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:35.596 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:55:35.597 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:55:35.597 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:35.597 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:55:35.597 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:55:35.597 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:55:35.597 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:35.597 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:55:35.597 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:55:35.597 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:35.597 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:55:35.597 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:55:35.597 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:55:35.597 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:35.597 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:55:35.598 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:35.598 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:55:35.598 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:55:35.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.581+0000 7f44cf000640 1 -- 172.21.15.8:0/495479650 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f44a4067660 msgr2=0x7f44a4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:35.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.581+0000 7f44cf000640 1 --2- 172.21.15.8:0/495479650 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f44a4067660 0x7f44a4069b20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f44c80c6d70 tx=0x7f44c0003b40 comp rx=0 tx=0).stop 2024-03-23T23:55:35.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.581+0000 7f44cf000640 1 -- 172.21.15.8:0/495479650 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44c8154b20 msgr2=0x7f44c81ea4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:35.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.581+0000 7f44cf000640 1 --2- 172.21.15.8:0/495479650 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44c8154b20 0x7f44c81ea4f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f44b000f550 tx=0x7f44b000fa10 comp rx=0 tx=0).stop 2024-03-23T23:55:35.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.581+0000 7f44cd000640 1 -- 172.21.15.8:0/495479650 reap_dead start 2024-03-23T23:55:35.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.581+0000 7f44cf000640 1 -- 172.21.15.8:0/495479650 shutdown_connections 2024-03-23T23:55:35.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.581+0000 7f44cf000640 1 --2- 172.21.15.8:0/495479650 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44c8154b20 0x7f44c81ea4f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:35.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.581+0000 7f44cf000640 1 -- 172.21.15.8:0/495479650 >> 172.21.15.8:0/495479650 conn(0x7f44c80aafe0 msgr2=0x7f44c814cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:55:35.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.581+0000 7f44cf000640 1 -- 172.21.15.8:0/495479650 shutdown_connections 2024-03-23T23:55:35.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.581+0000 7f44cf000640 1 -- 172.21.15.8:0/495479650 wait complete. 2024-03-23T23:55:35.605 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T23:55:35.606 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-03-23T23:55:35.606 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:55:35.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.781+0000 7fd8d1800640 1 Processor -- start 2024-03-23T23:55:35.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.781+0000 7fd8d1800640 1 -- start start 2024-03-23T23:55:35.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.785+0000 7fd8d1800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd8cc14d8b0 0x7fd8cc0c7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:35.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.785+0000 7fd8d1800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8cc0c5560 0x7fd8cc06ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:35.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.785+0000 7fd8d1800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8cc0c7670 con 0x7fd8cc070b50 2024-03-23T23:55:35.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.785+0000 7fd8d1800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8cc0c4830 con 0x7fd8cc14d8b0 2024-03-23T23:55:35.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.785+0000 7fd8d1800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc0c50d0 con 0x7fd8cc0c5560 2024-03-23T23:55:35.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.785+0000 7fd8caa00640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7fd8cc14d8b0 msgr2=0x7fd8cc0c7130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:55:35.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.785+0000 7fd8caa00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd8cc14d8b0 0x7fd8cc0c7130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:55:35.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.789+0000 7fd8c2000640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fd8cc070b50 0x7fd8cc1541b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:59642/0 (socket says 172.21.15.8:59642) 2024-03-23T23:55:35.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.789+0000 7fd8c2000640 1 -- 172.21.15.8:0/3573975210 learned_addr learned my addr 172.21.15.8:0/3573975210 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:55:35.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.793+0000 7fd8cb400640 1 --2- 172.21.15.8:0/3573975210 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8cc0c5560 0x7fd8cc06ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:35.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.793+0000 7fd8cb400640 1 -- 172.21.15.8:0/3573975210 >> v2:172.21.15.8:3300/0 conn(0x7fd8cc14d8b0 msgr2=0x7fd8cc0c7130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:55:35.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.793+0000 7fd8cb400640 1 --2- 172.21.15.8:0/3573975210 >> v2:172.21.15.8:3300/0 conn(0x7fd8cc14d8b0 0x7fd8cc0c7130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:35.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.793+0000 7fd8cb400640 1 -- 172.21.15.8:0/3573975210 >> v1:172.21.15.196:6789/0 conn(0x7fd8cc070b50 legacy=0x7fd8cc1541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:35.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.793+0000 7fd8cb400640 1 -- 172.21.15.8:0/3573975210 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8cc0710e0 con 0x7fd8cc0c5560 2024-03-23T23:55:35.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.797+0000 7fd8cb400640 1 --2- 172.21.15.8:0/3573975210 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8cc0c5560 0x7fd8cc06ed00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd8c40097c0 tx=0x7fd8c401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef0dfe014309b6a2 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:55:35.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.813+0000 7fd8ca000640 1 -- 172.21.15.8:0/3573975210 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c40b0070 con 0x7fd8cc0c5560 2024-03-23T23:55:35.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.813+0000 7fd8ca000640 1 -- 172.21.15.8:0/3573975210 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c40ab600 con 0x7fd8cc0c5560 2024-03-23T23:55:35.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.813+0000 7fd8ca000640 1 -- 172.21.15.8:0/3573975210 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c40aba10 con 0x7fd8cc0c5560 2024-03-23T23:55:35.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.817+0000 7fd8d1800640 1 -- 172.21.15.8:0/3573975210 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8cc0c5560 msgr2=0x7fd8cc06ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:35.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.817+0000 7fd8d1800640 1 --2- 172.21.15.8:0/3573975210 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8cc0c5560 0x7fd8cc06ed00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd8c40097c0 tx=0x7fd8c401c4e0 comp rx=0 tx=0).stop 2024-03-23T23:55:35.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.825+0000 7fd8d1800640 1 -- 172.21.15.8:0/3573975210 shutdown_connections 2024-03-23T23:55:35.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.825+0000 7fd8d1800640 1 --2- 172.21.15.8:0/3573975210 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8cc0c5560 0x7fd8cc06ed00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:35.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.825+0000 7fd8d1800640 1 --2- 172.21.15.8:0/3573975210 >> v2:172.21.15.8:3300/0 conn(0x7fd8cc14d8b0 0x7fd8cc0c7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:35.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.825+0000 7fd8d1800640 1 -- 172.21.15.8:0/3573975210 >> 172.21.15.8:0/3573975210 conn(0x7fd8cc0aafe0 msgr2=0x7fd8cc0ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:55:35.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.829+0000 7fd8d1800640 1 -- 172.21.15.8:0/3573975210 shutdown_connections 2024-03-23T23:55:35.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.829+0000 7fd8d1800640 1 -- 172.21.15.8:0/3573975210 wait complete. 2024-03-23T23:55:35.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.833+0000 7fd8d1800640 1 Processor -- start 2024-03-23T23:55:35.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.833+0000 7fd8d1800640 1 -- start start 2024-03-23T23:55:35.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.833+0000 7fd8d1800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8cc070b50 0x7fd8cc14ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:35.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.837+0000 7fd8d1800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8cc0c5560 0x7fd8cc1515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:35.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.837+0000 7fd8d1800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8cc14d8b0 0x7fd8cc151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:35.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.837+0000 7fd8d1800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc160a50 con 0x7fd8cc14d8b0 2024-03-23T23:55:35.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.837+0000 7fd8d1800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc1608d0 con 0x7fd8cc0c5560 2024-03-23T23:55:35.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.837+0000 7fd8d1800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc160bd0 con 0x7fd8cc070b50 2024-03-23T23:55:35.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.837+0000 7fd8cb400640 1 -- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8cc14d8b0 msgr2=0x7fd8cc151ae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:3300/0 2024-03-23T23:55:35.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.837+0000 7fd8cb400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8cc14d8b0 0x7fd8cc151ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:55:35.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.837+0000 7fd8c2000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8cc0c5560 0x7fd8cc1515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:35.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.837+0000 7fd8c2000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8cc0c5560 0x7fd8cc1515a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:37900/0 (socket says 172.21.15.8:37900) 2024-03-23T23:55:35.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.837+0000 7fd8c2000640 1 -- 172.21.15.8:0/2199600856 learned_addr learned my addr 172.21.15.8:0/2199600856 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:55:35.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.837+0000 7fd8c2000640 1 -- 172.21.15.8:0/2199600856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8cc070b50 msgr2=0x7fd8cc14ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:35.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.837+0000 7fd8c2000640 1 --2- 172.21.15.8:0/2199600856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8cc070b50 0x7fd8cc14ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:35.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.841+0000 7fd8c2000640 1 -- 172.21.15.8:0/2199600856 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8cc14d8b0 msgr2=0x7fd8cc151ae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:55:35.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.841+0000 7fd8c2000640 1 --2- 172.21.15.8:0/2199600856 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8cc14d8b0 0x7fd8cc151ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:35.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.841+0000 7fd8c2000640 1 -- 172.21.15.8:0/2199600856 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8cc149340 con 0x7fd8cc0c5560 2024-03-23T23:55:35.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.841+0000 7fd8c2000640 1 --2- 172.21.15.8:0/2199600856 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8cc0c5560 0x7fd8cc1515a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc00cbc0 tx=0x7fd8bc00a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:55:35.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.841+0000 7fd8c3400640 1 -- 172.21.15.8:0/2199600856 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc017070 con 0x7fd8cc0c5560 2024-03-23T23:55:35.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.841+0000 7fd8c3400640 1 -- 172.21.15.8:0/2199600856 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8bc00aca0 con 0x7fd8cc0c5560 2024-03-23T23:55:35.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.841+0000 7fd8c3400640 1 -- 172.21.15.8:0/2199600856 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc012600 con 0x7fd8cc0c5560 2024-03-23T23:55:35.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.841+0000 7fd8d1800640 1 -- 172.21.15.8:0/2199600856 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8cc1ef830 con 0x7fd8cc0c5560 2024-03-23T23:55:35.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.841+0000 7fd8d1800640 1 -- 172.21.15.8:0/2199600856 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8cc142400 con 0x7fd8cc0c5560 2024-03-23T23:55:35.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.845+0000 7fd8d1800640 1 --2- 172.21.15.8:0/2199600856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8cc14bfc0 0x7fd8cc152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:35.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.845+0000 7fd8d1800640 1 -- 172.21.15.8:0/2199600856 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc1efa00 con 0x7fd8cc14bfc0 2024-03-23T23:55:35.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.845+0000 7fd8caa00640 1 --2- 172.21.15.8:0/2199600856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8cc14bfc0 0x7fd8cc152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:35.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.849+0000 7fd8c3400640 1 -- 172.21.15.8:0/2199600856 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd8bc01a070 con 0x7fd8cc0c5560 2024-03-23T23:55:35.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.849+0000 7fd8caa00640 1 -- 172.21.15.8:0/2199600856 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd8cc068270 con 0x7fd8cc14bfc0 2024-03-23T23:55:35.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.849+0000 7fd8c3400640 1 --2- 172.21.15.8:0/2199600856 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd8a8067660 0x7fd8a8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:35.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.849+0000 7fd8caa00640 1 --2- 172.21.15.8:0/2199600856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8cc14bfc0 0x7fd8cc152460 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4003990 tx=0x7fd8b400b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:55:35.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.853+0000 7fd8c3400640 1 -- 172.21.15.8:0/2199600856 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fd8bc085840 con 0x7fd8cc0c5560 2024-03-23T23:55:35.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.853+0000 7fd8c3400640 1 -- 172.21.15.8:0/2199600856 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4016070 con 0x7fd8cc14bfc0 2024-03-23T23:55:35.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.853+0000 7fd8c3400640 1 -- 172.21.15.8:0/2199600856 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fd8b4003dd0 con 0x7fd8cc14bfc0 2024-03-23T23:55:35.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.853+0000 7fd8c3400640 1 -- 172.21.15.8:0/2199600856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8cc14bfc0 msgr2=0x7fd8cc152460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:35.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.853+0000 7fd8c3400640 1 --2- 172.21.15.8:0/2199600856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8cc14bfc0 0x7fd8cc152460 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4003990 tx=0x7fd8b400b8e0 comp rx=0 tx=0).stop 2024-03-23T23:55:35.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.853+0000 7fd8c3400640 1 -- 172.21.15.8:0/2199600856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8cc14bfc0 msgr2=0x7fd8cc152460 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:55:35.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.853+0000 7fd8c3400640 1 --2- 172.21.15.8:0/2199600856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8cc14bfc0 0x7fd8cc152460 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4003990 tx=0x7fd8b400b8e0 comp rx=0 tx=0).stop 2024-03-23T23:55:35.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.857+0000 7fd8cb400640 1 --2- 172.21.15.8:0/2199600856 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd8a8067660 0x7fd8a8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:35.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.869+0000 7fd8cb400640 1 --2- 172.21.15.8:0/2199600856 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd8a8067660 0x7fd8a8069b20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd8c40ad000 tx=0x7fd8c4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:55:35.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.885+0000 7fd8d1800640 1 --2- 172.21.15.8:0/2199600856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8cc14b5a0 0x7fd8cc1529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:35.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.885+0000 7fd8d1800640 1 -- 172.21.15.8:0/2199600856 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc14bd00 con 0x7fd8cc14b5a0 2024-03-23T23:55:35.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.885+0000 7fd8caa00640 1 --2- 172.21.15.8:0/2199600856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8cc14b5a0 0x7fd8cc1529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:35.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.885+0000 7fd8caa00640 1 -- 172.21.15.8:0/2199600856 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd8cc0c3c30 con 0x7fd8cc14b5a0 2024-03-23T23:55:35.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.889+0000 7fd8caa00640 1 --2- 172.21.15.8:0/2199600856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8cc14b5a0 0x7fd8cc1529a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4003990 tx=0x7fd8b40059e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:55:35.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.889+0000 7fd8c3400640 1 -- 172.21.15.8:0/2199600856 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4016040 con 0x7fd8cc14b5a0 2024-03-23T23:55:35.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.889+0000 7fd8c3400640 1 -- 172.21.15.8:0/2199600856 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5029 (secure 0 0 0) 0x7fd8b4011400 con 0x7fd8cc14b5a0 2024-03-23T23:55:35.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.889+0000 7fd8c3400640 1 -- 172.21.15.8:0/2199600856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8cc14b5a0 msgr2=0x7fd8cc1529a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:35.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.889+0000 7fd8c3400640 1 --2- 172.21.15.8:0/2199600856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8cc14b5a0 0x7fd8cc1529a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4003990 tx=0x7fd8b40059e0 comp rx=0 tx=0).stop 2024-03-23T23:55:35.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.889+0000 7fd8c3400640 1 -- 172.21.15.8:0/2199600856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8cc14b5a0 msgr2=0x7fd8cc1529a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:55:35.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.889+0000 7fd8c3400640 1 --2- 172.21.15.8:0/2199600856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8cc14b5a0 0x7fd8cc1529a0 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4003990 tx=0x7fd8b40059e0 comp rx=0 tx=0).stop 2024-03-23T23:55:35.895 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:55:35.895 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:55:35.896 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:55:35.896 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:55:35.896 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 104, 2024-03-23T23:55:35.896 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:55:35.896 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:55:35.896 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:55:35.896 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:55:35.896 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 1, 2024-03-23T23:55:35.896 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:55:35.896 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:55:35.896 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:55:35.896 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:55:35.896 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:55:35.897 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:55:35.897 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:55:35.897 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:55:35.897 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:55:35.897 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:55:35.897 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:55:35.897 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:55:35.897 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:55:35.897 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:55:35.897 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:55:35.897 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:55:35.897 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:55:35.897 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:55:35.897 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:55:35.898 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:55:35.898 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:55:35.898 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:55:35.898 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:55:35.898 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:55:35.898 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:55:35.898 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:55:35.898 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:55:35.898 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:55:35.898 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:55:35.898 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:35.898 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:55:35.898 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:55:35.899 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:55:35.899 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:55:35.899 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:55:35.899 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:55:35.899 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:55:35.899 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:55:35.899 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:55:35.899 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:55:35.899 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:55:35.899 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:55:35.899 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:55:35.899 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:55:35.899 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:55:35.899 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:55:35.900 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:55:35.900 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:55:35.900 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:55:35.900 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:55:35.900 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:55:35.900 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:55:35.900 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:55:35.900 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:55:35.900 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:55:35.900 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:55:35.900 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:55:35.900 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:55:35.900 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:55:35.900 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:55:35.901 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:35.901 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:55:35.901 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:35.901 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:55:35.901 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:55:35.901 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:55:35.901 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:55:35.901 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:35.901 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:55:35.901 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:55:35.901 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:55:35.901 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:35.901 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:35.901 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:55:35.902 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:55:35.902 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:55:35.902 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:35.902 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:55:35.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:35.902 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:55:35.902 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:55:35.902 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:55:35.902 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:55:35.902 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:55:35.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:35.902 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:35.902 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:55:35.903 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:55:35.903 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:55:35.903 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:55:35.903 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:35.903 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:55:35.903 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:55:35.903 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:55:35.903 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:35.903 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:35.903 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:55:35.903 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:55:35.903 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:55:35.903 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:35.903 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:55:35.904 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:35.904 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:55:35.904 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:55:35.904 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:55:35.904 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:55:35.904 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:55:35.904 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:35.904 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:35.904 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:55:35.904 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:55:35.904 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:55:35.904 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:55:35.904 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:35.904 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:55:35.905 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:55:35.905 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:55:35.905 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:35.905 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:35.905 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:55:35.905 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:55:35.905 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:55:35.905 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:35.905 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:55:35.905 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:35.905 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:55:35.905 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:55:35.905 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:55:35.905 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:55:35.906 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:55:35.906 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:35.906 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:55:35.906 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:35.906 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:55:35.906 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:55:35.906 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:35.906 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:55:35.906 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:55:35.906 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:55:35.906 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:35.906 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:55:35.906 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:55:35.906 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:35.907 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:55:35.907 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:55:35.907 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:55:35.907 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:35.907 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:55:35.907 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:55:35.907 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:35.907 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:55:35.907 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:55:35.907 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5 2024-03-23T23:55:35.907 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:35.907 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:55:35.907 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:55:35.907 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:35.908 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:55:35.908 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:55:35.908 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:55:35.908 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:35.908 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:55:35.908 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:55:35.908 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:55:35.908 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:55:35.908 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:55:35.908 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:55:35.908 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:55:35.908 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:55:35.908 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:55:35.908 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:55:35.909 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:55:35.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.897+0000 7fd8d1800640 1 -- 172.21.15.8:0/2199600856 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd8a8067660 msgr2=0x7fd8a8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:35.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.897+0000 7fd8d1800640 1 --2- 172.21.15.8:0/2199600856 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd8a8067660 0x7fd8a8069b20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd8c40ad000 tx=0x7fd8c4008040 comp rx=0 tx=0).stop 2024-03-23T23:55:35.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.897+0000 7fd8cb400640 1 -- 172.21.15.8:0/2199600856 reap_dead start 2024-03-23T23:55:35.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.897+0000 7fd8d1800640 1 -- 172.21.15.8:0/2199600856 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8cc0c5560 msgr2=0x7fd8cc1515a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:55:35.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.897+0000 7fd8d1800640 1 --2- 172.21.15.8:0/2199600856 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8cc0c5560 0x7fd8cc1515a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc00cbc0 tx=0x7fd8bc00a060 comp rx=0 tx=0).stop 2024-03-23T23:55:35.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.897+0000 7fd8d1800640 1 -- 172.21.15.8:0/2199600856 shutdown_connections 2024-03-23T23:55:35.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.897+0000 7fd8d1800640 1 --2- 172.21.15.8:0/2199600856 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8cc0c5560 0x7fd8cc1515a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:55:35.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.897+0000 7fd8d1800640 1 -- 172.21.15.8:0/2199600856 >> 172.21.15.8:0/2199600856 conn(0x7fd8cc0aafe0 msgr2=0x7fd8cc06d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:55:35.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.897+0000 7fd8d1800640 1 -- 172.21.15.8:0/2199600856 shutdown_connections 2024-03-23T23:55:35.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:55:35.897+0000 7fd8d1800640 1 -- 172.21.15.8:0/2199600856 wait complete. 2024-03-23T23:55:35.960 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T23:55:35.960 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-03-23T23:55:46.716 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:55:46.720 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:55:55.961 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-03-23T23:55:55.961 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-03-23T23:55:55.961 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-23T23:55:55.962 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-23T23:55:55.967 INFO:tasks.ceph.mon.a:Started 2024-03-23T23:55:55.967 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-03-23T23:55:55.967 INFO:tasks.ceph.mon.c:Sent signal 19 2024-03-23T23:55:55.967 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-03-23T23:56:10.968 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-03-23T23:56:10.968 INFO:tasks.ceph.mon.c:Sent signal 18 2024-03-23T23:56:10.968 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T23:56:10.969 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:56:11.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:11.272+0000 7fd286200640 1 Processor -- start 2024-03-23T23:56:11.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:11.272+0000 7fd286200640 1 -- start start 2024-03-23T23:56:11.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:11.276+0000 7fd286200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd280155b20 0x7fd28015d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:11.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:11.276+0000 7fd286200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd280073500 con 0x7fd280071620 2024-03-23T23:56:11.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:11.276+0000 7fd286200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd280152670 con 0x7fd2800aba70 2024-03-23T23:56:11.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:11.276+0000 7fd27f400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd280071620 0x7fd2800c1e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:35854/0 (socket says 172.21.15.8:35854) 2024-03-23T23:56:11.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:11.276+0000 7fd27f400640 1 -- 172.21.15.8:0/197160581 learned_addr learned my addr 172.21.15.8:0/197160581 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:56:11.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:11.276+0000 7fd286200640 1 -- 172.21.15.8:0/197160581 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd280152420 con 0x7fd280155b20 2024-03-23T23:56:11.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:11.276+0000 7fd27fe00640 1 --2- 172.21.15.8:0/197160581 >> v2:172.21.15.196:3300/0 conn(0x7fd280155b20 0x7fd28015d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:11.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:11.276+0000 7fd27fe00640 1 -- 172.21.15.8:0/197160581 >> v2:172.21.15.196:3300/0 conn(0x7fd280155b20 msgr2=0x7fd28015d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:56:11.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:11.276+0000 7fd27fe00640 1 -- 172.21.15.8:0/197160581 >> v2:172.21.15.196:3300/0 conn(0x7fd280155b20 msgr2=0x7fd28015d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:56:11.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:11.276+0000 7fd27fe00640 1 --2- 172.21.15.8:0/197160581 >> v2:172.21.15.196:3300/0 conn(0x7fd280155b20 0x7fd28015d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:56:11.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:11.280+0000 7fd27fe00640 1 --2- 172.21.15.8:0/197160581 >> v2:172.21.15.196:3300/0 conn(0x7fd280155b20 0x7fd28015d290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:56:11.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:11.484+0000 7fd27fe00640 1 --2- 172.21.15.8:0/197160581 >> v2:172.21.15.196:3300/0 conn(0x7fd280155b20 0x7fd28015d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:11.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:11.488+0000 7fd27fe00640 1 -- 172.21.15.8:0/197160581 >> v2:172.21.15.196:3300/0 conn(0x7fd280155b20 msgr2=0x7fd28015d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:56:11.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:11.488+0000 7fd27fe00640 1 -- 172.21.15.8:0/197160581 >> v2:172.21.15.196:3300/0 conn(0x7fd280155b20 msgr2=0x7fd28015d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:56:11.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:11.488+0000 7fd27fe00640 1 --2- 172.21.15.8:0/197160581 >> v2:172.21.15.196:3300/0 conn(0x7fd280155b20 0x7fd28015d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:56:11.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:11.488+0000 7fd27fe00640 1 --2- 172.21.15.8:0/197160581 >> v2:172.21.15.196:3300/0 conn(0x7fd280155b20 0x7fd28015d290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:56:11.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:11.896+0000 7fd27fe00640 1 --2- 172.21.15.8:0/197160581 >> v2:172.21.15.196:3300/0 conn(0x7fd280155b20 0x7fd28015d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:11.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:11.896+0000 7fd27fe00640 1 -- 172.21.15.8:0/197160581 >> v2:172.21.15.196:3300/0 conn(0x7fd280155b20 msgr2=0x7fd28015d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:56:11.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:11.896+0000 7fd27fe00640 1 -- 172.21.15.8:0/197160581 >> v2:172.21.15.196:3300/0 conn(0x7fd280155b20 msgr2=0x7fd28015d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:56:11.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:11.896+0000 7fd27fe00640 1 --2- 172.21.15.8:0/197160581 >> v2:172.21.15.196:3300/0 conn(0x7fd280155b20 0x7fd28015d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:56:11.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:11.896+0000 7fd27fe00640 1 --2- 172.21.15.8:0/197160581 >> v2:172.21.15.196:3300/0 conn(0x7fd280155b20 0x7fd28015d290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:56:12.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:12.700+0000 7fd27fe00640 1 --2- 172.21.15.8:0/197160581 >> v2:172.21.15.196:3300/0 conn(0x7fd280155b20 0x7fd28015d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:12.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:12.704+0000 7fd27fe00640 1 -- 172.21.15.8:0/197160581 >> v2:172.21.15.196:3300/0 conn(0x7fd280155b20 msgr2=0x7fd28015d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:56:12.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:12.704+0000 7fd27fe00640 1 -- 172.21.15.8:0/197160581 >> v2:172.21.15.196:3300/0 conn(0x7fd280155b20 msgr2=0x7fd28015d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:56:12.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:12.704+0000 7fd27fe00640 1 --2- 172.21.15.8:0/197160581 >> v2:172.21.15.196:3300/0 conn(0x7fd280155b20 0x7fd28015d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:56:12.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:12.704+0000 7fd27fe00640 1 --2- 172.21.15.8:0/197160581 >> v2:172.21.15.196:3300/0 conn(0x7fd280155b20 0x7fd28015d290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:56:13.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:13.924+0000 7fd27ea00640 1 -- 172.21.15.8:0/197160581 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2508171415 0 0) 0x7fd280152670 con 0x7fd2800aba70 2024-03-23T23:56:13.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:13.924+0000 7fd27ea00640 1 -- 172.21.15.8:0/197160581 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd264003530 con 0x7fd2800aba70 2024-03-23T23:56:14.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.020+0000 7fd27ea00640 1 -- 172.21.15.8:0/197160581 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1964602565 0 0) 0x7fd264003530 con 0x7fd2800aba70 2024-03-23T23:56:14.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.020+0000 7fd27ea00640 1 -- 172.21.15.8:0/197160581 >> v2:172.21.15.196:3300/0 conn(0x7fd280155b20 msgr2=0x7fd28015d290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:56:14.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.020+0000 7fd27ea00640 1 --2- 172.21.15.8:0/197160581 >> v2:172.21.15.196:3300/0 conn(0x7fd280155b20 0x7fd28015d290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:14.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.020+0000 7fd27ea00640 1 -- 172.21.15.8:0/197160581 >> v1:172.21.15.8:6789/0 conn(0x7fd280071620 legacy=0x7fd2800c1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:14.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.020+0000 7fd27ea00640 1 -- 172.21.15.8:0/197160581 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd280155040 con 0x7fd2800aba70 2024-03-23T23:56:14.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.020+0000 7fd27ea00640 1 -- 172.21.15.8:0/197160581 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7fd268001680 con 0x7fd2800aba70 2024-03-23T23:56:14.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.020+0000 7fd27ea00640 1 -- 172.21.15.8:0/197160581 >> v1:172.21.15.196:6789/0 conn(0x7fd2800aba70 legacy=0x7fd28014ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:14.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.024+0000 7fd27ea00640 1 --2- 172.21.15.8:0/197160581 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd264003a80 0x7fd264003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:14.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.024+0000 7fd27f400640 1 --2- 172.21.15.8:0/197160581 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd264003a80 0x7fd264003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:14.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.024+0000 7fd27ea00640 1 --2- 172.21.15.8:0/197160581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd264004810 0x7fd264004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:14.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.024+0000 7fd27ea00640 1 --2- 172.21.15.8:0/197160581 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2640051d0 0x7fd26400ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:14.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.024+0000 7fd27ea00640 1 -- 172.21.15.8:0/197160581 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd280152420 con 0x7fd264004810 2024-03-23T23:56:14.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.024+0000 7fd27ea00640 1 -- 172.21.15.8:0/197160581 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd264010730 con 0x7fd2640051d0 2024-03-23T23:56:14.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.024+0000 7fd27ea00640 1 -- 172.21.15.8:0/197160581 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd264010930 con 0x7fd264003a80 2024-03-23T23:56:14.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.024+0000 7fd277e00640 1 --2- 172.21.15.8:0/197160581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd264004810 0x7fd264004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:14.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.024+0000 7fd27fe00640 1 --2- 172.21.15.8:0/197160581 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2640051d0 0x7fd26400ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:14.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.024+0000 7fd277e00640 1 -- 172.21.15.8:0/197160581 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd264003a80 msgr2=0x7fd264003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:14.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.024+0000 7fd277e00640 1 --2- 172.21.15.8:0/197160581 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd264003a80 0x7fd264003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:14.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.024+0000 7fd277e00640 1 -- 172.21.15.8:0/197160581 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2640051d0 msgr2=0x7fd26400ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:14.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.024+0000 7fd277e00640 1 --2- 172.21.15.8:0/197160581 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2640051d0 0x7fd26400ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:14.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.024+0000 7fd277e00640 1 -- 172.21.15.8:0/197160581 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd264003530 con 0x7fd264004810 2024-03-23T23:56:14.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.028+0000 7fd27fe00640 1 -- 172.21.15.8:0/197160581 reap_dead start 2024-03-23T23:56:14.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.028+0000 7fd277e00640 1 --2- 172.21.15.8:0/197160581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd264004810 0x7fd264004c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd268007f40 tx=0x7fd26801cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620bd82d670d30d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:14.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.032+0000 7fd27ea00640 1 -- 172.21.15.8:0/197160581 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2680b2070 con 0x7fd264004810 2024-03-23T23:56:14.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.032+0000 7fd27ea00640 1 -- 172.21.15.8:0/197160581 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2680a5840 con 0x7fd264004810 2024-03-23T23:56:14.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.032+0000 7fd27ea00640 1 -- 172.21.15.8:0/197160581 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd268007b60 con 0x7fd264004810 2024-03-23T23:56:14.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.036+0000 7fd286200640 1 -- 172.21.15.8:0/197160581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd264004810 msgr2=0x7fd264004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:14.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.036+0000 7fd286200640 1 --2- 172.21.15.8:0/197160581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd264004810 0x7fd264004c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd268007f40 tx=0x7fd26801cb00 comp rx=0 tx=0).stop 2024-03-23T23:56:14.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.036+0000 7fd286200640 1 -- 172.21.15.8:0/197160581 shutdown_connections 2024-03-23T23:56:14.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.036+0000 7fd286200640 1 --2- 172.21.15.8:0/197160581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd264004810 0x7fd264004c90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:14.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.036+0000 7fd286200640 1 -- 172.21.15.8:0/197160581 >> 172.21.15.8:0/197160581 conn(0x7fd2800c7170 msgr2=0x7fd2800c7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:14.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.036+0000 7fd286200640 1 -- 172.21.15.8:0/197160581 shutdown_connections 2024-03-23T23:56:14.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.036+0000 7fd286200640 1 -- 172.21.15.8:0/197160581 wait complete. 2024-03-23T23:56:14.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.040+0000 7fd286200640 1 Processor -- start 2024-03-23T23:56:14.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.040+0000 7fd286200640 1 -- start start 2024-03-23T23:56:14.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.040+0000 7fd286200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd264004810 0x7fd2800c5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:14.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.040+0000 7fd286200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd28014e0f0 0x7fd28014ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:14.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.040+0000 7fd286200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd28014dba0 0x7fd28014d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:14.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.040+0000 7fd286200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28014ebe0 con 0x7fd28014e0f0 2024-03-23T23:56:14.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.040+0000 7fd286200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd280071c10 con 0x7fd264004810 2024-03-23T23:56:14.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.040+0000 7fd286200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28014ed60 con 0x7fd28014dba0 2024-03-23T23:56:14.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.044+0000 7fd277e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd28014e0f0 0x7fd28014ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:14.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.044+0000 7fd27f400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd264004810 0x7fd2800c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:14.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.044+0000 7fd27fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd28014dba0 0x7fd28014d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:14.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.044+0000 7fd27fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd28014dba0 0x7fd28014d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:36168/0 (socket says 172.21.15.8:36168) 2024-03-23T23:56:14.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.044+0000 7fd277e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd28014e0f0 0x7fd28014ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48208/0 (socket says 172.21.15.8:48208) 2024-03-23T23:56:14.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.044+0000 7fd277e00640 1 -- 172.21.15.8:0/1234931154 learned_addr learned my addr 172.21.15.8:0/1234931154 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:56:14.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.044+0000 7fd277e00640 1 -- 172.21.15.8:0/1234931154 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd28014dba0 msgr2=0x7fd28014d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:14.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.044+0000 7fd277e00640 1 --2- 172.21.15.8:0/1234931154 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd28014dba0 0x7fd28014d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:14.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.044+0000 7fd277e00640 1 -- 172.21.15.8:0/1234931154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd264004810 msgr2=0x7fd2800c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:14.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.044+0000 7fd277e00640 1 --2- 172.21.15.8:0/1234931154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd264004810 0x7fd2800c5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:14.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.044+0000 7fd277e00640 1 -- 172.21.15.8:0/1234931154 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd28006eaf0 con 0x7fd28014e0f0 2024-03-23T23:56:14.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.044+0000 7fd277e00640 1 --2- 172.21.15.8:0/1234931154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd28014e0f0 0x7fd28014ce50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd2680b0040 tx=0x7fd2680198a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:14.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.044+0000 7fd277400640 1 -- 172.21.15.8:0/1234931154 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2680b2040 con 0x7fd28014e0f0 2024-03-23T23:56:14.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.044+0000 7fd277400640 1 -- 172.21.15.8:0/1234931154 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2680bb070 con 0x7fd28014e0f0 2024-03-23T23:56:14.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.044+0000 7fd277400640 1 -- 172.21.15.8:0/1234931154 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd268001bd0 con 0x7fd28014e0f0 2024-03-23T23:56:14.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.044+0000 7fd286200640 1 -- 172.21.15.8:0/1234931154 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2801fbf00 con 0x7fd28014e0f0 2024-03-23T23:56:14.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.044+0000 7fd286200640 1 -- 172.21.15.8:0/1234931154 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd28006cc50 con 0x7fd28014e0f0 2024-03-23T23:56:14.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.044+0000 7fd286200640 1 -- 172.21.15.8:0/1234931154 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd28004f480 con 0x7fd28014e0f0 2024-03-23T23:56:14.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.048+0000 7fd277400640 1 -- 172.21.15.8:0/1234931154 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd2680a5840 con 0x7fd28014e0f0 2024-03-23T23:56:14.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.052+0000 7fd277400640 1 --2- 172.21.15.8:0/1234931154 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd25c0676b0 0x7fd25c069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:14.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.052+0000 7fd277400640 1 -- 172.21.15.8:0/1234931154 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fd268120230 con 0x7fd28014e0f0 2024-03-23T23:56:14.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.056+0000 7fd27f400640 1 --2- 172.21.15.8:0/1234931154 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd25c0676b0 0x7fd25c069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:14.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.060+0000 7fd277400640 1 -- 172.21.15.8:0/1234931154 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fd268016810 con 0x7fd28014e0f0 2024-03-23T23:56:14.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.072+0000 7fd27f400640 1 --2- 172.21.15.8:0/1234931154 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd25c0676b0 0x7fd25c069b70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd270000f70 tx=0x7fd2700011a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:14.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.580+0000 7fd286200640 1 -- 172.21.15.8:0/1234931154 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd2800aafc0 con 0x7fd28014e0f0 2024-03-23T23:56:14.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.580+0000 7fd277400640 1 -- 172.21.15.8:0/1234931154 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1561 (secure 0 0 0) 0x7fd2680f0580 con 0x7fd28014e0f0 2024-03-23T23:56:14.584 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":110,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:56:14.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.584+0000 7fd286200640 1 -- 172.21.15.8:0/1234931154 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd25c0676b0 msgr2=0x7fd25c069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:14.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.584+0000 7fd286200640 1 --2- 172.21.15.8:0/1234931154 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd25c0676b0 0x7fd25c069b70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd270000f70 tx=0x7fd2700011a0 comp rx=0 tx=0).stop 2024-03-23T23:56:14.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.584+0000 7fd286200640 1 -- 172.21.15.8:0/1234931154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd28014e0f0 msgr2=0x7fd28014ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:14.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.584+0000 7fd286200640 1 --2- 172.21.15.8:0/1234931154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd28014e0f0 0x7fd28014ce50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd2680b0040 tx=0x7fd2680198a0 comp rx=0 tx=0).stop 2024-03-23T23:56:14.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.584+0000 7fd286200640 1 -- 172.21.15.8:0/1234931154 shutdown_connections 2024-03-23T23:56:14.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.584+0000 7fd286200640 1 --2- 172.21.15.8:0/1234931154 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd25c0676b0 0x7fd25c069b70 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:14.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.584+0000 7fd286200640 1 --2- 172.21.15.8:0/1234931154 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd28014dba0 0x7fd28014d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:14.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.584+0000 7fd286200640 1 --2- 172.21.15.8:0/1234931154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd28014e0f0 0x7fd28014ce50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:14.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.584+0000 7fd286200640 1 --2- 172.21.15.8:0/1234931154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd264004810 0x7fd2800c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:14.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.584+0000 7fd286200640 1 -- 172.21.15.8:0/1234931154 >> 172.21.15.8:0/1234931154 conn(0x7fd2800c7170 msgr2=0x7fd280150290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:14.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.584+0000 7fd286200640 1 -- 172.21.15.8:0/1234931154 shutdown_connections 2024-03-23T23:56:14.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.584+0000 7fd286200640 1 -- 172.21.15.8:0/1234931154 wait complete. 2024-03-23T23:56:14.617 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T23:56:14.617 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T23:56:14.617 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:56:14.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.968+0000 7f5366a00640 1 Processor -- start 2024-03-23T23:56:14.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.968+0000 7f5366a00640 1 -- start start 2024-03-23T23:56:14.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.976+0000 7f5366a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f536015a670 0x7f53600c2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:14.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.976+0000 7f5366a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53600712f0 con 0x7f53600c2d60 2024-03-23T23:56:14.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.976+0000 7f5366a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5360159b90 con 0x7f5360157180 2024-03-23T23:56:14.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.976+0000 7f5366000640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f53600c2d60 0x7f5360164380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:52090/0 (socket says 172.21.15.8:52090) 2024-03-23T23:56:14.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.980+0000 7f5366000640 1 -- 172.21.15.8:0/3350341854 learned_addr learned my addr 172.21.15.8:0/3350341854 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:56:14.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.980+0000 7f535fe00640 1 -- 172.21.15.8:0/3350341854 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2783962337 0 0) 0x7f53600712f0 con 0x7f53600c2d60 2024-03-23T23:56:14.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.980+0000 7f5366a00640 1 -- 172.21.15.8:0/3350341854 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5360157560 con 0x7f536015a670 2024-03-23T23:56:14.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.980+0000 7f535fe00640 1 -- 172.21.15.8:0/3350341854 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5348003530 con 0x7f53600c2d60 2024-03-23T23:56:14.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.980+0000 7f5364c00640 1 --2- 172.21.15.8:0/3350341854 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f536015a670 0x7f53600c2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:14.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.980+0000 7f535fe00640 1 -- 172.21.15.8:0/3350341854 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 77224501 0 0) 0x7f5348003530 con 0x7f53600c2d60 2024-03-23T23:56:14.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.980+0000 7f535fe00640 1 -- 172.21.15.8:0/3350341854 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f536015a670 msgr2=0x7f53600c2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:14.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.980+0000 7f535fe00640 1 --2- 172.21.15.8:0/3350341854 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f536015a670 0x7f53600c2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:14.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.980+0000 7f535fe00640 1 -- 172.21.15.8:0/3350341854 >> v1:172.21.15.196:6789/0 conn(0x7f5360157180 legacy=0x7f5360070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:14.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.980+0000 7f535fe00640 1 -- 172.21.15.8:0/3350341854 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5360159e70 con 0x7f53600c2d60 2024-03-23T23:56:14.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.984+0000 7f535fe00640 1 -- 172.21.15.8:0/3350341854 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7f5358001a00 con 0x7f53600c2d60 2024-03-23T23:56:14.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.984+0000 7f535fe00640 1 -- 172.21.15.8:0/3350341854 >> v1:172.21.15.8:6789/0 conn(0x7f53600c2d60 legacy=0x7f5360164380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:14.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.984+0000 7f535fe00640 1 --2- 172.21.15.8:0/3350341854 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53480039f0 0x7f5348003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:14.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.984+0000 7f535fe00640 1 --2- 172.21.15.8:0/3350341854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5348004810 0x7f5348004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:14.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.984+0000 7f535fe00640 1 --2- 172.21.15.8:0/3350341854 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f536015a670 0x7f5348005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:14.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.984+0000 7f535fe00640 1 -- 172.21.15.8:0/3350341854 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5360157560 con 0x7f5348004810 2024-03-23T23:56:14.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.984+0000 7f535fe00640 1 -- 172.21.15.8:0/3350341854 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534800bb60 con 0x7f53480039f0 2024-03-23T23:56:14.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.984+0000 7f535fe00640 1 -- 172.21.15.8:0/3350341854 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534800bd30 con 0x7f536015a670 2024-03-23T23:56:14.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.984+0000 7f5364c00640 1 --2- 172.21.15.8:0/3350341854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5348004810 0x7f5348004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:14.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.984+0000 7f5364c00640 1 -- 172.21.15.8:0/3350341854 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f536015a670 msgr2=0x7f5348005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:14.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.984+0000 7f5364c00640 1 --2- 172.21.15.8:0/3350341854 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f536015a670 0x7f5348005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:14.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.984+0000 7f5364c00640 1 -- 172.21.15.8:0/3350341854 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53480039f0 msgr2=0x7f5348003e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:56:14.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.984+0000 7f5364c00640 1 --2- 172.21.15.8:0/3350341854 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53480039f0 0x7f5348003e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:14.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:14.984+0000 7f5364c00640 1 -- 172.21.15.8:0/3350341854 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5360159b90 con 0x7f5348004810 2024-03-23T23:56:15.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.004+0000 7f5364c00640 1 --2- 172.21.15.8:0/3350341854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5348004810 0x7f5348004c90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f534c00ba60 tx=0x7f534c01c6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c44dfd9e27568385 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:15.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.008+0000 7f535fe00640 1 -- 172.21.15.8:0/3350341854 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c00b600 con 0x7f5348004810 2024-03-23T23:56:15.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.008+0000 7f535fe00640 1 -- 172.21.15.8:0/3350341854 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534c0aa630 con 0x7f5348004810 2024-03-23T23:56:15.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.008+0000 7f535fe00640 1 -- 172.21.15.8:0/3350341854 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c0aaa20 con 0x7f5348004810 2024-03-23T23:56:15.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.008+0000 7f5366a00640 1 -- 172.21.15.8:0/3350341854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5348004810 msgr2=0x7f5348004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:15.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.008+0000 7f5366a00640 1 --2- 172.21.15.8:0/3350341854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5348004810 0x7f5348004c90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f534c00ba60 tx=0x7f534c01c6c0 comp rx=0 tx=0).stop 2024-03-23T23:56:15.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.008+0000 7f5366000640 1 -- 172.21.15.8:0/3350341854 reap_dead start 2024-03-23T23:56:15.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.012+0000 7f5366a00640 1 -- 172.21.15.8:0/3350341854 shutdown_connections 2024-03-23T23:56:15.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.012+0000 7f5366a00640 1 -- 172.21.15.8:0/3350341854 >> 172.21.15.8:0/3350341854 conn(0x7f53600c3910 msgr2=0x7f53600c3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:15.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.012+0000 7f5366a00640 1 -- 172.21.15.8:0/3350341854 shutdown_connections 2024-03-23T23:56:15.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.016+0000 7f5366a00640 1 -- 172.21.15.8:0/3350341854 wait complete. 2024-03-23T23:56:15.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.020+0000 7f5366a00640 1 Processor -- start 2024-03-23T23:56:15.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.024+0000 7f5366a00640 1 -- start start 2024-03-23T23:56:15.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.028+0000 7f5366a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5348004810 0x7f53600c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:15.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.028+0000 7f5366a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f536014a0c0 0x7f5360155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:15.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.028+0000 7f5366a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53601491b0 0x7f5360149630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:15.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.028+0000 7f5366a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536015a1e0 con 0x7f536014a0c0 2024-03-23T23:56:15.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.028+0000 7f5366a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536006ccf0 con 0x7f53601491b0 2024-03-23T23:56:15.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.028+0000 7f5366a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f536006cf40 con 0x7f5348004810 2024-03-23T23:56:15.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.028+0000 7f5365600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5348004810 0x7f53600c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:15.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.028+0000 7f5365600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5348004810 0x7f53600c68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:36192/0 (socket says 172.21.15.8:36192) 2024-03-23T23:56:15.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.028+0000 7f5365600640 1 -- 172.21.15.8:0/3696023681 learned_addr learned my addr 172.21.15.8:0/3696023681 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:56:15.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.028+0000 7f5364c00640 1 --2- 172.21.15.8:0/3696023681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f536014a0c0 0x7f5360155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:15.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.028+0000 7f5364c00640 1 -- 172.21.15.8:0/3696023681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5348004810 msgr2=0x7f53600c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:15.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.028+0000 7f5364c00640 1 --2- 172.21.15.8:0/3696023681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5348004810 0x7f53600c68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:15.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.028+0000 7f5364c00640 1 -- 172.21.15.8:0/3696023681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53601491b0 msgr2=0x7f5360149630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:56:15.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.028+0000 7f5364c00640 1 --2- 172.21.15.8:0/3696023681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53601491b0 0x7f5360149630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:15.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.028+0000 7f5364c00640 1 -- 172.21.15.8:0/3696023681 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f536014a540 con 0x7f536014a0c0 2024-03-23T23:56:15.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.036+0000 7f5364c00640 1 --2- 172.21.15.8:0/3696023681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f536014a0c0 0x7f5360155c60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f53480057b0 tx=0x7f534c019460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:15.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.036+0000 7f535d600640 1 -- 172.21.15.8:0/3696023681 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c004020 con 0x7f536014a0c0 2024-03-23T23:56:15.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.036+0000 7f535d600640 1 -- 172.21.15.8:0/3696023681 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534c0041e0 con 0x7f536014a0c0 2024-03-23T23:56:15.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.036+0000 7f535d600640 1 -- 172.21.15.8:0/3696023681 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c003620 con 0x7f536014a0c0 2024-03-23T23:56:15.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.040+0000 7f5366a00640 1 -- 172.21.15.8:0/3696023681 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5360149de0 con 0x7f536014a0c0 2024-03-23T23:56:15.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.040+0000 7f5366a00640 1 -- 172.21.15.8:0/3696023681 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53601561a0 con 0x7f536014a0c0 2024-03-23T23:56:15.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.044+0000 7f535d600640 1 -- 172.21.15.8:0/3696023681 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f534c0037c0 con 0x7f536014a0c0 2024-03-23T23:56:15.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.044+0000 7f535d600640 1 --2- 172.21.15.8:0/3696023681 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f53400676b0 0x7f5340069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:15.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.044+0000 7f5365600640 1 --2- 172.21.15.8:0/3696023681 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f53400676b0 0x7f5340069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:15.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.048+0000 7f535d600640 1 -- 172.21.15.8:0/3696023681 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f534c0ee110 con 0x7f536014a0c0 2024-03-23T23:56:15.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.048+0000 7f5365600640 1 --2- 172.21.15.8:0/3696023681 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f53400676b0 0x7f5340069b70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5360150d00 tx=0x7f5354007e80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:15.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.048+0000 7f5366a00640 1 --2- 172.21.15.8:0/3696023681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f536014cc20 0x7f53601ef330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:15.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.048+0000 7f5366a00640 1 -- 172.21.15.8:0/3696023681 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5360149b70 con 0x7f536014cc20 2024-03-23T23:56:15.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.052+0000 7f5366000640 1 --2- 172.21.15.8:0/3696023681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f536014cc20 0x7f53601ef330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:15.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.052+0000 7f5366000640 1 -- 172.21.15.8:0/3696023681 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f536004f410 con 0x7f536014cc20 2024-03-23T23:56:15.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.052+0000 7f5366000640 1 --2- 172.21.15.8:0/3696023681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f536014cc20 0x7f53601ef330 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f53600504c0 tx=0x7f535800fc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:15.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.052+0000 7f535d600640 1 -- 172.21.15.8:0/3696023681 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535801a070 con 0x7f536014cc20 2024-03-23T23:56:15.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.052+0000 7f535d600640 1 -- 172.21.15.8:0/3696023681 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f535800d9a0 con 0x7f536014cc20 2024-03-23T23:56:15.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.052+0000 7f535d600640 1 -- 172.21.15.8:0/3696023681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f536014cc20 msgr2=0x7f53601ef330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:15.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.052+0000 7f535d600640 1 --2- 172.21.15.8:0/3696023681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f536014cc20 0x7f53601ef330 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f53600504c0 tx=0x7f535800fc50 comp rx=0 tx=0).stop 2024-03-23T23:56:15.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.052+0000 7f535d600640 1 -- 172.21.15.8:0/3696023681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f536014cc20 msgr2=0x7f53601ef330 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:56:15.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.052+0000 7f535d600640 1 --2- 172.21.15.8:0/3696023681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f536014cc20 0x7f53601ef330 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f53600504c0 tx=0x7f535800fc50 comp rx=0 tx=0).stop 2024-03-23T23:56:15.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.072+0000 7f5366a00640 1 --2- 172.21.15.8:0/3696023681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53601ef870 0x7f53601efc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:15.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.072+0000 7f5366a00640 1 -- 172.21.15.8:0/3696023681 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53601567b0 con 0x7f53601ef870 2024-03-23T23:56:15.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.072+0000 7f5366000640 1 --2- 172.21.15.8:0/3696023681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53601ef870 0x7f53601efc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:15.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.076+0000 7f5366000640 1 -- 172.21.15.8:0/3696023681 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f53601517a0 con 0x7f53601ef870 2024-03-23T23:56:15.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.076+0000 7f5366000640 1 --2- 172.21.15.8:0/3696023681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53601ef870 0x7f53601efc80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f536014d4e0 tx=0x7f5360159a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:15.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.076+0000 7f535d600640 1 -- 172.21.15.8:0/3696023681 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5358027450 con 0x7f53601ef870 2024-03-23T23:56:15.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.076+0000 7f535d600640 1 -- 172.21.15.8:0/3696023681 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4532 (secure 0 0 0) 0x7f53580275f0 con 0x7f53601ef870 2024-03-23T23:56:15.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.076+0000 7f535d600640 1 -- 172.21.15.8:0/3696023681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53601ef870 msgr2=0x7f53601efc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:15.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.076+0000 7f535d600640 1 --2- 172.21.15.8:0/3696023681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53601ef870 0x7f53601efc80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f536014d4e0 tx=0x7f5360159a80 comp rx=0 tx=0).stop 2024-03-23T23:56:15.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.076+0000 7f535d600640 1 -- 172.21.15.8:0/3696023681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53601ef870 msgr2=0x7f53601efc80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:56:15.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.076+0000 7f535d600640 1 --2- 172.21.15.8:0/3696023681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53601ef870 0x7f53601efc80 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f536014d4e0 tx=0x7f5360159a80 comp rx=0 tx=0).stop 2024-03-23T23:56:15.080 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:56:15.080 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:56:15.080 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:56:15.081 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:56:15.081 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 110, 2024-03-23T23:56:15.081 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:56:15.081 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:56:15.081 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:56:15.081 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:56:15.081 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:15.081 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 1, 2024-03-23T23:56:15.081 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:56:15.081 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:56:15.081 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:56:15.081 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:56:15.082 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:56:15.082 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:56:15.082 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:56:15.082 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:56:15.082 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:56:15.082 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:56:15.082 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:56:15.082 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:56:15.082 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:56:15.082 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:56:15.082 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:15.082 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:56:15.082 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:56:15.083 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:56:15.083 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:56:15.083 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:56:15.083 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:56:15.083 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:56:15.083 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:56:15.083 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:56:15.083 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:56:15.083 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:56:15.083 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:56:15.083 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:56:15.083 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:15.083 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.084 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:56:15.084 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:56:15.084 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:56:15.084 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:56:15.084 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:56:15.084 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:56:15.084 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:56:15.084 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:56:15.084 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:56:15.084 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:56:15.084 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:56:15.084 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:56:15.084 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:56:15.084 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:56:15.085 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:56:15.085 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:56:15.085 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:56:15.085 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:56:15.085 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:56:15.085 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:56:15.085 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:56:15.085 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:56:15.085 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:56:15.085 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:56:15.085 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:56:15.085 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:56:15.085 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:56:15.085 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:56:15.086 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:15.086 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:56:15.086 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.086 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:56:15.086 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.086 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:56:15.086 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:56:15.086 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:56:15.086 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:56:15.086 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.086 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:56:15.086 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:56:15.086 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:15.087 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.087 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.087 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:56:15.087 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:56:15.087 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:15.087 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:15.087 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:15.087 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.087 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:56:15.087 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:56:15.087 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:56:15.087 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:56:15.087 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:56:15.088 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.088 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.088 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:56:15.088 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:56:15.088 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:56:15.088 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:56:15.088 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.088 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:56:15.088 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:56:15.088 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:15.088 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.088 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.089 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:56:15.089 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:56:15.089 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:15.089 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:15.089 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:15.089 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.089 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:56:15.089 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:56:15.089 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:56:15.089 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:56:15.089 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:56:15.089 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.090 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.090 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:56:15.090 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:56:15.090 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:56:15.090 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:56:15.090 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.090 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:56:15.090 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:56:15.090 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:15.090 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.090 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.090 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:56:15.091 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:56:15.091 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:15.091 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:15.091 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:15.091 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.091 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:56:15.091 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:56:15.091 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:56:15.091 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:56:15.091 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:56:15.091 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:15.092 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:15.092 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.092 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:56:15.092 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:56:15.092 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.092 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:15.092 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:15.092 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:56:15.092 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:15.092 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:15.092 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:56:15.093 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.093 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:15.093 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:15.093 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:56:15.093 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:15.093 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:15.093 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.093 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:56:15.093 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:56:15.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.076+0000 7f5352a00640 1 -- 172.21.15.8:0/3696023681 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f53400676b0 msgr2=0x7f5340069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:15.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.076+0000 7f5352a00640 1 --2- 172.21.15.8:0/3696023681 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f53400676b0 0x7f5340069b70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5360150d00 tx=0x7f5354007e80 comp rx=0 tx=0).stop 2024-03-23T23:56:15.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.076+0000 7f5352a00640 1 -- 172.21.15.8:0/3696023681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f536014a0c0 msgr2=0x7f5360155c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:15.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.076+0000 7f5352a00640 1 --2- 172.21.15.8:0/3696023681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f536014a0c0 0x7f5360155c60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f53480057b0 tx=0x7f534c019460 comp rx=0 tx=0).stop 2024-03-23T23:56:15.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.080+0000 7f5366000640 1 -- 172.21.15.8:0/3696023681 reap_dead start 2024-03-23T23:56:15.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.080+0000 7f5352a00640 1 -- 172.21.15.8:0/3696023681 shutdown_connections 2024-03-23T23:56:15.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.080+0000 7f5352a00640 1 -- 172.21.15.8:0/3696023681 >> 172.21.15.8:0/3696023681 conn(0x7f53600c3910 msgr2=0x7f53601578f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:15.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.080+0000 7f5352a00640 1 -- 172.21.15.8:0/3696023681 shutdown_connections 2024-03-23T23:56:15.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.080+0000 7f5352a00640 1 -- 172.21.15.8:0/3696023681 wait complete. 2024-03-23T23:56:15.120 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:56:15.120 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T23:56:15.120 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:56:15.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.344+0000 7f1499c00640 1 Processor -- start 2024-03-23T23:56:15.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.344+0000 7f1499c00640 1 -- start start 2024-03-23T23:56:15.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.344+0000 7f1499c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1494151240 0x7f1494071c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:15.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.344+0000 7f1499c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1494072340 0x7f14940c4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:15.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.344+0000 7f1499c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f149406ca20 con 0x7f14940c7170 2024-03-23T23:56:15.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.344+0000 7f1499c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14940727d0 con 0x7f1494151240 2024-03-23T23:56:15.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.344+0000 7f1499c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1494154900 con 0x7f1494072340 2024-03-23T23:56:15.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.344+0000 7f1492a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1494151240 0x7f1494071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:15.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.344+0000 7f1492a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1494151240 0x7f1494071c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:46778/0 (socket says 172.21.15.8:46778) 2024-03-23T23:56:15.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.344+0000 7f1492a00640 1 -- 172.21.15.8:0/1052488582 learned_addr learned my addr 172.21.15.8:0/1052488582 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:56:15.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.348+0000 7f1492a00640 1 -- 172.21.15.8:0/1052488582 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1494072340 msgr2=0x7f14940c4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:15.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.348+0000 7f1492a00640 1 --2- 172.21.15.8:0/1052488582 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1494072340 0x7f14940c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:15.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.348+0000 7f1492a00640 1 -- 172.21.15.8:0/1052488582 >> v1:172.21.15.196:6789/0 conn(0x7f14940c7170 legacy=0x7f149406c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:15.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.348+0000 7f1492a00640 1 -- 172.21.15.8:0/1052488582 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149406ff10 con 0x7f1494151240 2024-03-23T23:56:15.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.360+0000 7f1492a00640 1 --2- 172.21.15.8:0/1052488582 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1494151240 0x7f1494071c60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1484009870 tx=0x7f148401c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93e8e9faf11176d1 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:15.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.364+0000 7f1491600640 1 -- 172.21.15.8:0/1052488582 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14840b0070 con 0x7f1494151240 2024-03-23T23:56:15.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.364+0000 7f1491600640 1 -- 172.21.15.8:0/1052488582 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14840ab600 con 0x7f1494151240 2024-03-23T23:56:15.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.364+0000 7f1491600640 1 -- 172.21.15.8:0/1052488582 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14840ab9d0 con 0x7f1494151240 2024-03-23T23:56:15.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.368+0000 7f1499c00640 1 -- 172.21.15.8:0/1052488582 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1494151240 msgr2=0x7f1494071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:15.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.368+0000 7f1499c00640 1 --2- 172.21.15.8:0/1052488582 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1494151240 0x7f1494071c60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1484009870 tx=0x7f148401c420 comp rx=0 tx=0).stop 2024-03-23T23:56:15.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.368+0000 7f1499c00640 1 -- 172.21.15.8:0/1052488582 shutdown_connections 2024-03-23T23:56:15.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.368+0000 7f1499c00640 1 --2- 172.21.15.8:0/1052488582 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1494072340 0x7f14940c4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:15.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.368+0000 7f1499c00640 1 --2- 172.21.15.8:0/1052488582 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1494151240 0x7f1494071c60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:15.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.368+0000 7f1499c00640 1 -- 172.21.15.8:0/1052488582 >> 172.21.15.8:0/1052488582 conn(0x7f14940c7e70 msgr2=0x7f14940c8280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:15.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.368+0000 7f1499c00640 1 -- 172.21.15.8:0/1052488582 shutdown_connections 2024-03-23T23:56:15.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.368+0000 7f1499c00640 1 -- 172.21.15.8:0/1052488582 wait complete. 2024-03-23T23:56:15.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.372+0000 7f1499c00640 1 Processor -- start 2024-03-23T23:56:15.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.372+0000 7f1499c00640 1 -- start start 2024-03-23T23:56:15.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.372+0000 7f1499c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1494072340 0x7f14941fe700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:15.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.372+0000 7f1499c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14940c7170 0x7f1494151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:15.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.372+0000 7f1499c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1494151240 0x7f14940aac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:15.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.372+0000 7f1499c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1494160a50 con 0x7f1494072340 2024-03-23T23:56:15.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.372+0000 7f1499c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149406edb0 con 0x7f14940c7170 2024-03-23T23:56:15.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.372+0000 7f1499c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1494160bd0 con 0x7f1494151240 2024-03-23T23:56:15.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.376+0000 7f1492a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1494072340 0x7f14941fe700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:15.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.376+0000 7f1492a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1494072340 0x7f14941fe700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48226/0 (socket says 172.21.15.8:48226) 2024-03-23T23:56:15.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.376+0000 7f1492a00640 1 -- 172.21.15.8:0/2905756539 learned_addr learned my addr 172.21.15.8:0/2905756539 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:56:15.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.376+0000 7f1492000640 1 --2- 172.21.15.8:0/2905756539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14940c7170 0x7f1494151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:15.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.376+0000 7f1493400640 1 --2- 172.21.15.8:0/2905756539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1494151240 0x7f14940aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:15.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.376+0000 7f1492a00640 1 -- 172.21.15.8:0/2905756539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1494151240 msgr2=0x7f14940aac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:15.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.376+0000 7f1492a00640 1 --2- 172.21.15.8:0/2905756539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1494151240 0x7f14940aac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:15.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.376+0000 7f1492a00640 1 -- 172.21.15.8:0/2905756539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14940c7170 msgr2=0x7f1494151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:15.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.376+0000 7f1492a00640 1 --2- 172.21.15.8:0/2905756539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14940c7170 0x7f1494151830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:15.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.376+0000 7f1492a00640 1 -- 172.21.15.8:0/2905756539 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1494150250 con 0x7f1494072340 2024-03-23T23:56:15.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.376+0000 7f1492a00640 1 --2- 172.21.15.8:0/2905756539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1494072340 0x7f14941fe700 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f14840ae040 tx=0x7f148401ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:15.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.376+0000 7f148aa00640 1 -- 172.21.15.8:0/2905756539 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14840ba020 con 0x7f1494072340 2024-03-23T23:56:15.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.376+0000 7f148aa00640 1 -- 172.21.15.8:0/2905756539 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14840b6640 con 0x7f1494072340 2024-03-23T23:56:15.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.376+0000 7f148aa00640 1 -- 172.21.15.8:0/2905756539 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14840b0040 con 0x7f1494072340 2024-03-23T23:56:15.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.380+0000 7f1499c00640 1 -- 172.21.15.8:0/2905756539 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f149414df60 con 0x7f1494072340 2024-03-23T23:56:15.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.380+0000 7f1499c00640 1 -- 172.21.15.8:0/2905756539 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14941ff330 con 0x7f1494072340 2024-03-23T23:56:15.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.380+0000 7f1499c00640 1 --2- 172.21.15.8:0/2905756539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1494153970 0x7f14940ab160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:15.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.380+0000 7f1499c00640 1 -- 172.21.15.8:0/2905756539 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149414dd10 con 0x7f1494153970 2024-03-23T23:56:15.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.380+0000 7f148aa00640 1 -- 172.21.15.8:0/2905756539 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f14840bd020 con 0x7f1494072340 2024-03-23T23:56:15.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.384+0000 7f148aa00640 1 --2- 172.21.15.8:0/2905756539 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f14740676b0 0x7f1474069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:15.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.384+0000 7f148aa00640 1 -- 172.21.15.8:0/2905756539 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f148411f3c0 con 0x7f1494072340 2024-03-23T23:56:15.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.384+0000 7f1493400640 1 --2- 172.21.15.8:0/2905756539 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f14740676b0 0x7f1474069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:15.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.384+0000 7f1492000640 1 --2- 172.21.15.8:0/2905756539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1494153970 0x7f14940ab160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:15.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.388+0000 7f1492000640 1 -- 172.21.15.8:0/2905756539 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1494068980 con 0x7f1494153970 2024-03-23T23:56:15.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.388+0000 7f1492000640 1 --2- 172.21.15.8:0/2905756539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1494153970 0x7f14940ab160 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f149406bc50 tx=0x7f148000f9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:15.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.388+0000 7f148aa00640 1 -- 172.21.15.8:0/2905756539 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14800052e0 con 0x7f1494153970 2024-03-23T23:56:15.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.388+0000 7f148aa00640 1 -- 172.21.15.8:0/2905756539 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f1480018070 con 0x7f1494153970 2024-03-23T23:56:15.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.388+0000 7f148aa00640 1 -- 172.21.15.8:0/2905756539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1494153970 msgr2=0x7f14940ab160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:15.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.388+0000 7f148aa00640 1 --2- 172.21.15.8:0/2905756539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1494153970 0x7f14940ab160 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f149406bc50 tx=0x7f148000f9f0 comp rx=0 tx=0).stop 2024-03-23T23:56:15.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.388+0000 7f148aa00640 1 -- 172.21.15.8:0/2905756539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1494153970 msgr2=0x7f14940ab160 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:56:15.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.388+0000 7f148aa00640 1 --2- 172.21.15.8:0/2905756539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1494153970 0x7f14940ab160 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f149406bc50 tx=0x7f148000f9f0 comp rx=0 tx=0).stop 2024-03-23T23:56:15.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.396+0000 7f1493400640 1 --2- 172.21.15.8:0/2905756539 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f14740676b0 0x7f1474069b70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1494152770 tx=0x7f148c009410 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:15.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.400+0000 7f1499c00640 1 --2- 172.21.15.8:0/2905756539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14941fec40 0x7f14940ab6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:15.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.400+0000 7f1499c00640 1 -- 172.21.15.8:0/2905756539 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14940ac680 con 0x7f14941fec40 2024-03-23T23:56:15.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.408+0000 7f1492000640 1 --2- 172.21.15.8:0/2905756539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14941fec40 0x7f14940ab6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:15.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.416+0000 7f1492000640 1 -- 172.21.15.8:0/2905756539 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f149414e130 con 0x7f14941fec40 2024-03-23T23:56:15.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.420+0000 7f1492000640 1 --2- 172.21.15.8:0/2905756539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14941fec40 0x7f14940ab6a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1480017000 tx=0x7f1480001030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:15.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.420+0000 7f148aa00640 1 -- 172.21.15.8:0/2905756539 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14800039a0 con 0x7f14941fec40 2024-03-23T23:56:15.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.424+0000 7f148aa00640 1 -- 172.21.15.8:0/2905756539 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5183 (secure 0 0 0) 0x7f14800039a0 con 0x7f14941fec40 2024-03-23T23:56:15.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.424+0000 7f148aa00640 1 -- 172.21.15.8:0/2905756539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14941fec40 msgr2=0x7f14940ab6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:15.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.424+0000 7f148aa00640 1 --2- 172.21.15.8:0/2905756539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14941fec40 0x7f14940ab6a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1480017000 tx=0x7f1480001030 comp rx=0 tx=0).stop 2024-03-23T23:56:15.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.424+0000 7f148aa00640 1 -- 172.21.15.8:0/2905756539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14941fec40 msgr2=0x7f14940ab6a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:56:15.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.424+0000 7f148aa00640 1 --2- 172.21.15.8:0/2905756539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14941fec40 0x7f14940ab6a0 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1480017000 tx=0x7f1480001030 comp rx=0 tx=0).stop 2024-03-23T23:56:15.426 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:56:15.426 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:56:15.426 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:56:15.426 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:56:15.427 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 110, 2024-03-23T23:56:15.427 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:56:15.427 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:56:15.427 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:56:15.427 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:56:15.427 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:15.427 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 1, 2024-03-23T23:56:15.427 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:56:15.427 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:56:15.427 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:56:15.427 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:56:15.427 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:56:15.428 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:56:15.428 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:56:15.428 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:56:15.428 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:56:15.428 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:56:15.428 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:56:15.428 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:56:15.428 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:56:15.428 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:56:15.428 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:15.428 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:56:15.429 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:56:15.429 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:56:15.429 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:56:15.429 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:56:15.429 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:56:15.429 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:56:15.429 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:56:15.429 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:56:15.429 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:56:15.429 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:56:15.429 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:56:15.430 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:56:15.430 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:15.430 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.430 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:56:15.430 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:56:15.430 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:56:15.430 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:56:15.430 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:56:15.430 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:56:15.430 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:56:15.430 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:56:15.430 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:56:15.431 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:56:15.431 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:56:15.431 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:56:15.431 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:56:15.431 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:56:15.431 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:56:15.431 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:56:15.431 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:56:15.431 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:56:15.431 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:56:15.431 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:56:15.432 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:56:15.432 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:56:15.432 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:56:15.432 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:56:15.432 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:56:15.432 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:56:15.432 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:56:15.432 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:56:15.432 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:15.432 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:56:15.432 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.432 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:56:15.433 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.433 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:56:15.433 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:56:15.433 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:56:15.433 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:56:15.433 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.433 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:56:15.433 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:56:15.433 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:15.433 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.433 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.433 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:56:15.434 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:56:15.434 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:15.434 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:15.434 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:15.434 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.434 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:56:15.434 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:56:15.434 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:56:15.434 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:56:15.434 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:56:15.435 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.435 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.435 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:56:15.435 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:56:15.435 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:56:15.435 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:56:15.435 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.435 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:56:15.435 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:56:15.435 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:15.435 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.435 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.435 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:56:15.436 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:56:15.436 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:15.436 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:15.436 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:15.436 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.436 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:56:15.436 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:56:15.437 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:56:15.437 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:56:15.437 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:56:15.437 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.437 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.437 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:56:15.437 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:56:15.437 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:56:15.437 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:56:15.437 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.437 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:56:15.437 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:56:15.438 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:15.438 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.438 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.438 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:56:15.438 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:56:15.438 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:15.438 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:15.438 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:15.438 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.439 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:56:15.439 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:56:15.439 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:56:15.439 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:56:15.439 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:56:15.439 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:15.439 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:15.439 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.439 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:56:15.439 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:56:15.439 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.440 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:15.440 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:15.440 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:56:15.440 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:15.440 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:15.440 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:56:15.440 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.440 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:15.440 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:15.440 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:56:15.441 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:15.441 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:15.441 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:56:15.441 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.441 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:15.441 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:15.441 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:56:15.441 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:15.441 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:15.441 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:56:15.441 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.441 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:56:15.442 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:15.442 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:56:15.442 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.442 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.442 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:15.442 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:15.442 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:56:15.442 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:15.442 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:15.442 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:56:15.442 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.443 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:15.443 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:15.443 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:56:15.443 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:15.443 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:15.443 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.443 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:56:15.443 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:56:15.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.424+0000 7f147fe00640 1 -- 172.21.15.8:0/2905756539 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f14740676b0 msgr2=0x7f1474069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:15.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.424+0000 7f147fe00640 1 --2- 172.21.15.8:0/2905756539 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f14740676b0 0x7f1474069b70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1494152770 tx=0x7f148c009410 comp rx=0 tx=0).stop 2024-03-23T23:56:15.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.424+0000 7f147fe00640 1 -- 172.21.15.8:0/2905756539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1494072340 msgr2=0x7f14941fe700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:15.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.424+0000 7f147fe00640 1 --2- 172.21.15.8:0/2905756539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1494072340 0x7f14941fe700 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f14840ae040 tx=0x7f148401ac60 comp rx=0 tx=0).stop 2024-03-23T23:56:15.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.424+0000 7f1493400640 1 -- 172.21.15.8:0/2905756539 reap_dead start 2024-03-23T23:56:15.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.424+0000 7f1493400640 1 -- 172.21.15.8:0/2905756539 reap_dead start 2024-03-23T23:56:15.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.424+0000 7f147fe00640 1 -- 172.21.15.8:0/2905756539 shutdown_connections 2024-03-23T23:56:15.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.424+0000 7f147fe00640 1 -- 172.21.15.8:0/2905756539 >> 172.21.15.8:0/2905756539 conn(0x7f14940c7e70 msgr2=0x7f14940a9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:15.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.424+0000 7f147fe00640 1 -- 172.21.15.8:0/2905756539 shutdown_connections 2024-03-23T23:56:15.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.424+0000 7f147fe00640 1 -- 172.21.15.8:0/2905756539 wait complete. 2024-03-23T23:56:15.466 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:56:15.466 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T23:56:15.466 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:56:15.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.836+0000 7f927c600640 1 Processor -- start 2024-03-23T23:56:15.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.836+0000 7f927c600640 1 -- start start 2024-03-23T23:56:15.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.840+0000 7f927c600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f927415f430 0x7f927415f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:15.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.840+0000 7f927c600640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f927415fd50 con 0x7f92740c25e0 2024-03-23T23:56:15.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.840+0000 7f927c600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92740ac540 con 0x7f9274072850 2024-03-23T23:56:15.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.840+0000 7f927c600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92740aa7d0 con 0x7f927415f430 2024-03-23T23:56:15.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.844+0000 7f9279200640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f9274072850 0x7f9274072cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:45206/0 (socket says 172.21.15.8:45206) 2024-03-23T23:56:15.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.844+0000 7f9279200640 1 -- 172.21.15.8:0/1816694896 learned_addr learned my addr 172.21.15.8:0/1816694896 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:56:15.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.844+0000 7f9273e00640 1 -- 172.21.15.8:0/1816694896 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2307180131 0 0) 0x7f92740ac540 con 0x7f9274072850 2024-03-23T23:56:15.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.844+0000 7f9273e00640 1 -- 172.21.15.8:0/1816694896 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f925c003530 con 0x7f9274072850 2024-03-23T23:56:15.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.848+0000 7f9273e00640 1 -- 172.21.15.8:0/1816694896 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 354733779 0 0) 0x7f925c003530 con 0x7f9274072850 2024-03-23T23:56:15.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.848+0000 7f9273e00640 1 -- 172.21.15.8:0/1816694896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f927415f430 msgr2=0x7f927415f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:15.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.848+0000 7f9273e00640 1 --2- 172.21.15.8:0/1816694896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f927415f430 0x7f927415f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:15.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.848+0000 7f9273e00640 1 -- 172.21.15.8:0/1816694896 >> v1:172.21.15.8:6789/0 conn(0x7f92740c25e0 legacy=0x7f92740c2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:15.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.848+0000 7f9273e00640 1 -- 172.21.15.8:0/1816694896 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92740aa180 con 0x7f9274072850 2024-03-23T23:56:15.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.848+0000 7f9273e00640 1 -- 172.21.15.8:0/1816694896 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7f9268001680 con 0x7f9274072850 2024-03-23T23:56:15.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.848+0000 7f9273e00640 1 -- 172.21.15.8:0/1816694896 >> v1:172.21.15.196:6789/0 conn(0x7f9274072850 legacy=0x7f9274072cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:15.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.848+0000 7f9273e00640 1 --2- 172.21.15.8:0/1816694896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f927415f430 0x7f925c0037b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:15.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.848+0000 7f9273e00640 1 --2- 172.21.15.8:0/1816694896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f925c003cf0 0x7f925c004170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:15.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.848+0000 7f9273e00640 1 --2- 172.21.15.8:0/1816694896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f925c00b1b0 0x7f925c00d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:15.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.848+0000 7f9273e00640 1 -- 172.21.15.8:0/1816694896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92740aa7d0 con 0x7f925c003cf0 2024-03-23T23:56:15.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.848+0000 7f9273e00640 1 -- 172.21.15.8:0/1816694896 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c00df70 con 0x7f925c00b1b0 2024-03-23T23:56:15.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.848+0000 7f9273e00640 1 -- 172.21.15.8:0/1816694896 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925c00e170 con 0x7f927415f430 2024-03-23T23:56:15.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.848+0000 7f9279200640 1 --2- 172.21.15.8:0/1816694896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f925c003cf0 0x7f925c004170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:15.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.848+0000 7f9279200640 1 -- 172.21.15.8:0/1816694896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f927415f430 msgr2=0x7f925c0037b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:15.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.848+0000 7f9279200640 1 --2- 172.21.15.8:0/1816694896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f927415f430 0x7f925c0037b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:15.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.852+0000 7f9279200640 1 -- 172.21.15.8:0/1816694896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f925c00b1b0 msgr2=0x7f925c00d640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:56:15.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.852+0000 7f9279200640 1 --2- 172.21.15.8:0/1816694896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f925c00b1b0 0x7f925c00d640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:15.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.852+0000 7f9279200640 1 -- 172.21.15.8:0/1816694896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92740aa180 con 0x7f925c003cf0 2024-03-23T23:56:15.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.856+0000 7f9279200640 1 --2- 172.21.15.8:0/1816694896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f925c003cf0 0x7f925c004170 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f926800c370 tx=0x7f926801cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae0ba357c3f5bd82 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:15.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.856+0000 7f9273e00640 1 -- 172.21.15.8:0/1816694896 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9268007e00 con 0x7f925c003cf0 2024-03-23T23:56:15.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.856+0000 7f9273e00640 1 -- 172.21.15.8:0/1816694896 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92680a9030 con 0x7f925c003cf0 2024-03-23T23:56:15.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.856+0000 7f927c600640 1 -- 172.21.15.8:0/1816694896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f925c003cf0 msgr2=0x7f925c004170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:15.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.856+0000 7f927c600640 1 --2- 172.21.15.8:0/1816694896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f925c003cf0 0x7f925c004170 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f926800c370 tx=0x7f926801cdc0 comp rx=0 tx=0).stop 2024-03-23T23:56:15.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.856+0000 7f927b000640 1 -- 172.21.15.8:0/1816694896 reap_dead start 2024-03-23T23:56:15.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.860+0000 7f927c600640 1 -- 172.21.15.8:0/1816694896 shutdown_connections 2024-03-23T23:56:15.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.860+0000 7f927c600640 1 -- 172.21.15.8:0/1816694896 >> 172.21.15.8:0/1816694896 conn(0x7f92740c3bd0 msgr2=0x7f92740c3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:15.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.860+0000 7f927c600640 1 -- 172.21.15.8:0/1816694896 shutdown_connections 2024-03-23T23:56:15.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.860+0000 7f927c600640 1 -- 172.21.15.8:0/1816694896 wait complete. 2024-03-23T23:56:15.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.864+0000 7f927c600640 1 Processor -- start 2024-03-23T23:56:15.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.868+0000 7f927c600640 1 -- start start 2024-03-23T23:56:15.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.868+0000 7f927c600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f925c003cf0 0x7f9274071480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:15.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.868+0000 7f927c600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f92741f05b0 0x7f92741fb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:15.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.868+0000 7f927c600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f927415cfc0 0x7f92741fba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:15.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.868+0000 7f9279c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f925c003cf0 0x7f9274071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:15.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.868+0000 7f9279c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f925c003cf0 0x7f9274071480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:46822/0 (socket says 172.21.15.8:46822) 2024-03-23T23:56:15.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.868+0000 7f9279200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f92741f05b0 0x7f92741fb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:15.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.872+0000 7f9279200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f92741f05b0 0x7f92741fb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:36240/0 (socket says 172.21.15.8:36240) 2024-03-23T23:56:15.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.872+0000 7f9279c00640 1 -- 172.21.15.8:0/2190437491 learned_addr learned my addr 172.21.15.8:0/2190437491 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:56:15.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.872+0000 7f927c600640 1 -- 172.21.15.8:0/2190437491 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9274162c50 con 0x7f927415cfc0 2024-03-23T23:56:15.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.872+0000 7f927c600640 1 -- 172.21.15.8:0/2190437491 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9274162ad0 con 0x7f925c003cf0 2024-03-23T23:56:15.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.872+0000 7f927c600640 1 -- 172.21.15.8:0/2190437491 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9274162dd0 con 0x7f92741f05b0 2024-03-23T23:56:15.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.872+0000 7f927b000640 1 --2- 172.21.15.8:0/2190437491 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f927415cfc0 0x7f92741fba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:15.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.876+0000 7f927b000640 1 -- 172.21.15.8:0/2190437491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f92741f05b0 msgr2=0x7f92741fb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:15.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.876+0000 7f927b000640 1 --2- 172.21.15.8:0/2190437491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f92741f05b0 0x7f92741fb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:15.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.876+0000 7f927b000640 1 -- 172.21.15.8:0/2190437491 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f925c003cf0 msgr2=0x7f9274071480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:15.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.876+0000 7f927b000640 1 --2- 172.21.15.8:0/2190437491 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f925c003cf0 0x7f9274071480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:15.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.876+0000 7f927b000640 1 -- 172.21.15.8:0/2190437491 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92741f1480 con 0x7f927415cfc0 2024-03-23T23:56:15.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.876+0000 7f927b000640 1 --2- 172.21.15.8:0/2190437491 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f927415cfc0 0x7f92741fba20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f925c004e40 tx=0x7f926000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:15.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.880+0000 7f9271600640 1 -- 172.21.15.8:0/2190437491 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9260007480 con 0x7f927415cfc0 2024-03-23T23:56:15.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.880+0000 7f9271600640 1 -- 172.21.15.8:0/2190437491 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9260007640 con 0x7f927415cfc0 2024-03-23T23:56:15.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.880+0000 7f9271600640 1 -- 172.21.15.8:0/2190437491 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9260004260 con 0x7f927415cfc0 2024-03-23T23:56:15.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.880+0000 7f927c600640 1 -- 172.21.15.8:0/2190437491 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92741efad0 con 0x7f927415cfc0 2024-03-23T23:56:15.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.880+0000 7f927c600640 1 -- 172.21.15.8:0/2190437491 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92741f0090 con 0x7f927415cfc0 2024-03-23T23:56:15.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.880+0000 7f9266a00640 1 --2- 172.21.15.8:0/2190437491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f927415cbc0 0x7f92741fea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:15.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.884+0000 7f9266a00640 1 -- 172.21.15.8:0/2190437491 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92741ef930 con 0x7f927415cbc0 2024-03-23T23:56:15.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.888+0000 7f9279c00640 1 --2- 172.21.15.8:0/2190437491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f927415cbc0 0x7f92741fea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:15.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.888+0000 7f9271600640 1 -- 172.21.15.8:0/2190437491 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f9260011070 con 0x7f927415cfc0 2024-03-23T23:56:15.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.888+0000 7f9271600640 1 --2- 172.21.15.8:0/2190437491 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f92540676b0 0x7f9254069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:15.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.892+0000 7f9271600640 1 -- 172.21.15.8:0/2190437491 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f9260052e30 con 0x7f927415cfc0 2024-03-23T23:56:15.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.892+0000 7f9279c00640 1 -- 172.21.15.8:0/2190437491 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9274068270 con 0x7f927415cbc0 2024-03-23T23:56:15.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.904+0000 7f9279c00640 1 --2- 172.21.15.8:0/2190437491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f927415cbc0 0x7f92741fea50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f926c00eb40 tx=0x7f926c00c0c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:15.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.904+0000 7f9271600640 1 -- 172.21.15.8:0/2190437491 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926c018020 con 0x7f927415cbc0 2024-03-23T23:56:15.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.908+0000 7f9271600640 1 -- 172.21.15.8:0/2190437491 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f926c00ccf0 con 0x7f927415cbc0 2024-03-23T23:56:15.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.908+0000 7f9271600640 1 -- 172.21.15.8:0/2190437491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f927415cbc0 msgr2=0x7f92741fea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:15.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.908+0000 7f9271600640 1 --2- 172.21.15.8:0/2190437491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f927415cbc0 0x7f92741fea50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f926c00eb40 tx=0x7f926c00c0c0 comp rx=0 tx=0).stop 2024-03-23T23:56:15.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.908+0000 7f9271600640 1 -- 172.21.15.8:0/2190437491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f927415cbc0 msgr2=0x7f92741fea50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:56:15.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.908+0000 7f9271600640 1 --2- 172.21.15.8:0/2190437491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f927415cbc0 0x7f92741fea50 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f926c00eb40 tx=0x7f926c00c0c0 comp rx=0 tx=0).stop 2024-03-23T23:56:15.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.908+0000 7f9279200640 1 --2- 172.21.15.8:0/2190437491 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f92540676b0 0x7f9254069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:15.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.912+0000 7f9279200640 1 --2- 172.21.15.8:0/2190437491 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f92540676b0 0x7f9254069b70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f92680ac000 tx=0x7f92680a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:15.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.920+0000 7f9266a00640 1 --2- 172.21.15.8:0/2190437491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9274163630 0x7f92741fef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:15.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.920+0000 7f9266a00640 1 -- 172.21.15.8:0/2190437491 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92741f02d0 con 0x7f9274163630 2024-03-23T23:56:15.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.932+0000 7f9279c00640 1 --2- 172.21.15.8:0/2190437491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9274163630 0x7f92741fef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:15.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.944+0000 7f9279c00640 1 -- 172.21.15.8:0/2190437491 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f92740c38e0 con 0x7f9274163630 2024-03-23T23:56:15.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.948+0000 7f9279c00640 1 --2- 172.21.15.8:0/2190437491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9274163630 0x7f92741fef90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f926c019000 tx=0x7f926c004c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:15.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.948+0000 7f9271600640 1 -- 172.21.15.8:0/2190437491 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926c014d60 con 0x7f9274163630 2024-03-23T23:56:15.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.952+0000 7f9271600640 1 -- 172.21.15.8:0/2190437491 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5040 (secure 0 0 0) 0x7f926c028410 con 0x7f9274163630 2024-03-23T23:56:15.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.952+0000 7f9271600640 1 -- 172.21.15.8:0/2190437491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9274163630 msgr2=0x7f92741fef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:15.954 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:56:15.955 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:56:15.955 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:56:15.955 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:56:15.955 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 110, 2024-03-23T23:56:15.955 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:56:15.955 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:56:15.955 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:56:15.955 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:56:15.955 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:15.955 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 1, 2024-03-23T23:56:15.955 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:56:15.956 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:56:15.956 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:56:15.956 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:56:15.956 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:56:15.956 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:56:15.956 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:56:15.956 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:56:15.956 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:56:15.956 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:56:15.956 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:56:15.956 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:56:15.957 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:56:15.957 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:56:15.957 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:15.957 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:56:15.957 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:56:15.957 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:56:15.957 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:56:15.957 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:56:15.957 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:56:15.957 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:56:15.957 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:56:15.957 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:56:15.958 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:56:15.958 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:56:15.958 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:56:15.958 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:56:15.958 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:15.958 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.958 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:56:15.958 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:56:15.958 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:56:15.958 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:56:15.958 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:56:15.958 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:56:15.958 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:56:15.958 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:56:15.959 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:56:15.959 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:56:15.959 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:56:15.959 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:56:15.959 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:56:15.959 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:56:15.959 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:56:15.959 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:56:15.959 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:56:15.959 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:56:15.959 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:56:15.959 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:56:15.959 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:56:15.959 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:56:15.960 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:56:15.960 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:56:15.960 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:56:15.960 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:56:15.960 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:56:15.960 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:56:15.960 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:15.960 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:56:15.960 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.960 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:56:15.961 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.961 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:56:15.961 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:56:15.961 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:56:15.961 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:56:15.961 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.961 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:56:15.961 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:56:15.961 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:15.961 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.961 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.961 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:56:15.961 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:56:15.961 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:15.962 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:15.962 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:15.962 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.962 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:56:15.962 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:56:15.962 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:56:15.962 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:56:15.962 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:56:15.962 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.962 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.962 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:56:15.962 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:56:15.962 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:56:15.963 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:56:15.963 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.963 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:56:15.963 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:56:15.963 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:15.963 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.963 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.963 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:56:15.963 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:56:15.963 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:15.963 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:15.963 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:15.963 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.963 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:56:15.964 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:56:15.964 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:56:15.964 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:56:15.964 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:56:15.964 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.964 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.964 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:56:15.964 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:56:15.964 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:56:15.964 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:56:15.964 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.964 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:56:15.964 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:56:15.964 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:15.964 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.965 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.965 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:56:15.965 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:56:15.965 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:15.965 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:15.965 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:15.965 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.965 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:56:15.965 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:56:15.965 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:56:15.965 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:56:15.965 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:56:15.965 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:15.965 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:15.966 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.966 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:56:15.966 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:56:15.966 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.966 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:15.966 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:15.966 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:56:15.966 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:15.966 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:15.966 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:56:15.966 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.966 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:15.966 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:15.967 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:56:15.967 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:15.967 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:15.967 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:56:15.967 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.967 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:15.967 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:15.967 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5 2024-03-23T23:56:15.967 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:15.967 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:15.967 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:56:15.967 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.967 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:15.967 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:15.967 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:56:15.968 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:15.968 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:15.968 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:56:15.968 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:15.968 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:15.968 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:15.968 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:56:15.968 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:15.968 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:15.968 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:15.968 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:56:15.968 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:56:15.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.952+0000 7f9271600640 1 --2- 172.21.15.8:0/2190437491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9274163630 0x7f92741fef90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f926c019000 tx=0x7f926c004c00 comp rx=0 tx=0).stop 2024-03-23T23:56:15.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.952+0000 7f9271600640 1 -- 172.21.15.8:0/2190437491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9274163630 msgr2=0x7f92741fef90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:56:15.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.952+0000 7f9271600640 1 --2- 172.21.15.8:0/2190437491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9274163630 0x7f92741fef90 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f926c019000 tx=0x7f926c004c00 comp rx=0 tx=0).stop 2024-03-23T23:56:15.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.952+0000 7f9266a00640 1 -- 172.21.15.8:0/2190437491 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f92540676b0 msgr2=0x7f9254069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:15.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.952+0000 7f9266a00640 1 --2- 172.21.15.8:0/2190437491 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f92540676b0 0x7f9254069b70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f92680ac000 tx=0x7f92680a7000 comp rx=0 tx=0).stop 2024-03-23T23:56:15.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.952+0000 7f9266a00640 1 -- 172.21.15.8:0/2190437491 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f927415cfc0 msgr2=0x7f92741fba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:15.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.952+0000 7f927b000640 1 -- 172.21.15.8:0/2190437491 reap_dead start 2024-03-23T23:56:15.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.952+0000 7f9266a00640 1 --2- 172.21.15.8:0/2190437491 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f927415cfc0 0x7f92741fba20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f925c004e40 tx=0x7f926000c820 comp rx=0 tx=0).stop 2024-03-23T23:56:15.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.952+0000 7f9266a00640 1 -- 172.21.15.8:0/2190437491 shutdown_connections 2024-03-23T23:56:15.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.952+0000 7f9266a00640 1 --2- 172.21.15.8:0/2190437491 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f927415cfc0 0x7f92741fba20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:15.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.952+0000 7f9266a00640 1 -- 172.21.15.8:0/2190437491 >> 172.21.15.8:0/2190437491 conn(0x7f92740c3bd0 msgr2=0x7f9274161ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:15.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.952+0000 7f9266a00640 1 -- 172.21.15.8:0/2190437491 shutdown_connections 2024-03-23T23:56:15.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:15.952+0000 7f9266a00640 1 -- 172.21.15.8:0/2190437491 wait complete. 2024-03-23T23:56:16.010 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:56:16.011 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-03-23T23:56:16.011 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-03-23T23:56:16.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.344+0000 7fb618c00640 1 Processor -- start 2024-03-23T23:56:16.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.344+0000 7fb618c00640 1 -- start start 2024-03-23T23:56:16.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.348+0000 7fb618c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb6140ab2e0 0x7fb614150550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:16.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.348+0000 7fb618c00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6140a9680 con 0x7fb61406eeb0 2024-03-23T23:56:16.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.348+0000 7fb618c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6140a9960 con 0x7fb614070f00 2024-03-23T23:56:16.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.348+0000 7fb618c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6141536e0 con 0x7fb6140ab2e0 2024-03-23T23:56:16.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.352+0000 7fb613e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb6140ab2e0 0x7fb614150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:16.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.352+0000 7fb613400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fb61406eeb0 0x7fb614157300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:52114/0 (socket says 172.21.15.8:52114) 2024-03-23T23:56:16.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.352+0000 7fb613400640 1 -- 172.21.15.8:0/2516176308 learned_addr learned my addr 172.21.15.8:0/2516176308 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:56:16.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.352+0000 7fb613e00640 1 -- 172.21.15.8:0/2516176308 >> v1:172.21.15.196:6789/0 conn(0x7fb614070f00 legacy=0x7fb614153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:16.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.352+0000 7fb612000640 1 -- 172.21.15.8:0/2516176308 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1572737155 0 0) 0x7fb6140a9680 con 0x7fb61406eeb0 2024-03-23T23:56:16.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.352+0000 7fb613e00640 1 -- 172.21.15.8:0/2516176308 >> v1:172.21.15.8:6789/0 conn(0x7fb61406eeb0 legacy=0x7fb614157300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:16.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.352+0000 7fb613e00640 1 -- 172.21.15.8:0/2516176308 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6140a9c40 con 0x7fb6140ab2e0 2024-03-23T23:56:16.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.380+0000 7fb613e00640 1 --2- 172.21.15.8:0/2516176308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb6140ab2e0 0x7fb614150550 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb6040097f0 tx=0x7fb60401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=117e3a0b2630bbc6 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:16.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.384+0000 7fb612000640 1 -- 172.21.15.8:0/2516176308 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6040b0070 con 0x7fb6140ab2e0 2024-03-23T23:56:16.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.388+0000 7fb612000640 1 -- 172.21.15.8:0/2516176308 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6040ab600 con 0x7fb6140ab2e0 2024-03-23T23:56:16.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.388+0000 7fb612000640 1 -- 172.21.15.8:0/2516176308 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6040ab9d0 con 0x7fb6140ab2e0 2024-03-23T23:56:16.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.392+0000 7fb618c00640 1 -- 172.21.15.8:0/2516176308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb6140ab2e0 msgr2=0x7fb614150550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:16.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.392+0000 7fb618c00640 1 --2- 172.21.15.8:0/2516176308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb6140ab2e0 0x7fb614150550 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb6040097f0 tx=0x7fb60401c4a0 comp rx=0 tx=0).stop 2024-03-23T23:56:16.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.392+0000 7fb618c00640 1 -- 172.21.15.8:0/2516176308 shutdown_connections 2024-03-23T23:56:16.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.392+0000 7fb618c00640 1 --2- 172.21.15.8:0/2516176308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb6140ab2e0 0x7fb614150550 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:16.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.392+0000 7fb618c00640 1 -- 172.21.15.8:0/2516176308 >> 172.21.15.8:0/2516176308 conn(0x7fb6140c3910 msgr2=0x7fb6140c3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:16.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.392+0000 7fb618c00640 1 -- 172.21.15.8:0/2516176308 shutdown_connections 2024-03-23T23:56:16.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.392+0000 7fb618c00640 1 -- 172.21.15.8:0/2516176308 wait complete. 2024-03-23T23:56:16.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.396+0000 7fb618c00640 1 Processor -- start 2024-03-23T23:56:16.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.400+0000 7fb618c00640 1 -- start start 2024-03-23T23:56:16.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.404+0000 7fb618c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb61406eeb0 0x7fb614149910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:16.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.404+0000 7fb618c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb614070f00 0x7fb61414b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:16.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.404+0000 7fb618c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6140ab2e0 0x7fb614141660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:16.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.404+0000 7fb618c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61406f410 con 0x7fb6140ab2e0 2024-03-23T23:56:16.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.404+0000 7fb618c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61406f290 con 0x7fb614070f00 2024-03-23T23:56:16.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.404+0000 7fb618c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6141614b0 con 0x7fb61406eeb0 2024-03-23T23:56:16.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.404+0000 7fb612a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb614070f00 0x7fb61414b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:16.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.404+0000 7fb612a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb614070f00 0x7fb61414b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:46830/0 (socket says 172.21.15.8:46830) 2024-03-23T23:56:16.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.404+0000 7fb612a00640 1 -- 172.21.15.8:0/3428906022 learned_addr learned my addr 172.21.15.8:0/3428906022 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:56:16.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.408+0000 7fb612a00640 1 -- 172.21.15.8:0/3428906022 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb61406eeb0 msgr2=0x7fb614149910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:56:16.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.408+0000 7fb612a00640 1 --2- 172.21.15.8:0/3428906022 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb61406eeb0 0x7fb614149910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:16.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.408+0000 7fb612a00640 1 -- 172.21.15.8:0/3428906022 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6140ab2e0 msgr2=0x7fb614141660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:56:16.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.408+0000 7fb612a00640 1 --2- 172.21.15.8:0/3428906022 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6140ab2e0 0x7fb614141660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:16.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.408+0000 7fb612a00640 1 -- 172.21.15.8:0/3428906022 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb614149f20 con 0x7fb614070f00 2024-03-23T23:56:16.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.412+0000 7fb612a00640 1 --2- 172.21.15.8:0/3428906022 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb614070f00 0x7fb61414b4d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb60000b470 tx=0x7fb60000b930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:16.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.420+0000 7fb60b400640 1 -- 172.21.15.8:0/3428906022 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb600015030 con 0x7fb614070f00 2024-03-23T23:56:16.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.420+0000 7fb60b400640 1 -- 172.21.15.8:0/3428906022 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb600004020 con 0x7fb614070f00 2024-03-23T23:56:16.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.420+0000 7fb60b400640 1 -- 172.21.15.8:0/3428906022 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb600004410 con 0x7fb614070f00 2024-03-23T23:56:16.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.420+0000 7fb618c00640 1 -- 172.21.15.8:0/3428906022 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6141ed1f0 con 0x7fb614070f00 2024-03-23T23:56:16.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.420+0000 7fb618c00640 1 -- 172.21.15.8:0/3428906022 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6141ed7b0 con 0x7fb614070f00 2024-03-23T23:56:16.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.424+0000 7fb618c00640 1 -- 172.21.15.8:0/3428906022 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6141ed9b0 con 0x7fb614070f00 2024-03-23T23:56:16.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.428+0000 7fb60b400640 1 -- 172.21.15.8:0/3428906022 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb600018070 con 0x7fb614070f00 2024-03-23T23:56:16.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.436+0000 7fb60b400640 1 --2- 172.21.15.8:0/3428906022 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb5f406bb70 0x7fb5f406e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:16.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.436+0000 7fb60b400640 1 -- 172.21.15.8:0/3428906022 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fb6000861f0 con 0x7fb614070f00 2024-03-23T23:56:16.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.436+0000 7fb613400640 1 --2- 172.21.15.8:0/3428906022 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb5f406bb70 0x7fb5f406e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:16.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.440+0000 7fb613400640 1 --2- 172.21.15.8:0/3428906022 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb5f406bb70 0x7fb5f406e030 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb60c001c30 tx=0x7fb60c007cf0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:16.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:16.496+0000 7fb60b400640 1 -- 172.21.15.8:0/3428906022 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fb6141ed9b0 con 0x7fb614070f00 2024-03-23T23:56:16.884 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:56:16.891 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:56:17.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:17.196+0000 7fb618c00640 1 -- 172.21.15.8:0/3428906022 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fb61404f410 con 0x7fb614070f00 2024-03-23T23:56:17.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:17.212+0000 7fb60b400640 1 -- 172.21.15.8:0/3428906022 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fb60000d040 con 0x7fb614070f00 2024-03-23T23:56:17.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:17.220+0000 7fb618c00640 1 -- 172.21.15.8:0/3428906022 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb5f406bb70 msgr2=0x7fb5f406e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:17.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:17.220+0000 7fb618c00640 1 --2- 172.21.15.8:0/3428906022 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb5f406bb70 0x7fb5f406e030 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb60c001c30 tx=0x7fb60c007cf0 comp rx=0 tx=0).stop 2024-03-23T23:56:17.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:17.220+0000 7fb618c00640 1 -- 172.21.15.8:0/3428906022 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb614070f00 msgr2=0x7fb61414b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:17.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:17.220+0000 7fb618c00640 1 --2- 172.21.15.8:0/3428906022 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb614070f00 0x7fb61414b4d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb60000b470 tx=0x7fb60000b930 comp rx=0 tx=0).stop 2024-03-23T23:56:17.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:17.220+0000 7fb618c00640 1 -- 172.21.15.8:0/3428906022 shutdown_connections 2024-03-23T23:56:17.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:17.220+0000 7fb618c00640 1 --2- 172.21.15.8:0/3428906022 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6140ab2e0 0x7fb614141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:17.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:17.220+0000 7fb618c00640 1 --2- 172.21.15.8:0/3428906022 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb614070f00 0x7fb61414b4d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:17.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:17.220+0000 7fb618c00640 1 --2- 172.21.15.8:0/3428906022 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb5f406bb70 0x7fb5f406e030 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:17.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:17.220+0000 7fb618c00640 1 --2- 172.21.15.8:0/3428906022 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb61406eeb0 0x7fb614149910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:17.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:17.220+0000 7fb618c00640 1 -- 172.21.15.8:0/3428906022 >> 172.21.15.8:0/3428906022 conn(0x7fb6140c3910 msgr2=0x7fb6140c1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:17.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:17.224+0000 7fb618c00640 1 -- 172.21.15.8:0/3428906022 shutdown_connections 2024-03-23T23:56:17.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:17.224+0000 7fb618c00640 1 -- 172.21.15.8:0/3428906022 wait complete. 2024-03-23T23:56:17.339 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-03-23T23:56:27.340 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T23:56:27.340 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:56:27.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.668+0000 7f740ac00640 1 Processor -- start 2024-03-23T23:56:27.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.668+0000 7f740ac00640 1 -- start start 2024-03-23T23:56:27.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.672+0000 7f740ac00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7404163380 0x7f7404165770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:27.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.676+0000 7f7409800640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f7404157180 0x7f7404070be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:54726/0 (socket says 172.21.15.8:54726) 2024-03-23T23:56:27.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.676+0000 7f7409800640 1 -- 172.21.15.8:0/3819494395 learned_addr learned my addr 172.21.15.8:0/3819494395 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:56:27.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.676+0000 7f740a200640 1 --2- 172.21.15.8:0/3819494395 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7404163380 0x7f7404165770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:27.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.676+0000 7f740ac00640 1 -- 172.21.15.8:0/3819494395 --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74040712f0 con 0x7f740415a670 2024-03-23T23:56:27.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.676+0000 7f740ac00640 1 -- 172.21.15.8:0/3819494395 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7404159b90 con 0x7f7404157180 2024-03-23T23:56:27.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.676+0000 7f7403e00640 1 -- 172.21.15.8:0/3819494395 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 941750279 0 0) 0x7f74040712f0 con 0x7f740415a670 2024-03-23T23:56:27.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.676+0000 7f740ac00640 1 -- 172.21.15.8:0/3819494395 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7404157560 con 0x7f7404163380 2024-03-23T23:56:27.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.680+0000 7f7403e00640 1 -- 172.21.15.8:0/3819494395 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73ec003530 con 0x7f740415a670 2024-03-23T23:56:27.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.684+0000 7f740a200640 1 -- 172.21.15.8:0/3819494395 >> v1:172.21.15.196:6789/0 conn(0x7f7404157180 legacy=0x7f7404070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:27.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.688+0000 7f740a200640 1 -- 172.21.15.8:0/3819494395 >> v1:172.21.15.8:6789/0 conn(0x7f740415a670 legacy=0x7f74040c2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:27.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.688+0000 7f740a200640 1 -- 172.21.15.8:0/3819494395 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7404159e70 con 0x7f7404163380 2024-03-23T23:56:27.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.712+0000 7f740a200640 1 --2- 172.21.15.8:0/3819494395 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7404163380 0x7f7404165770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f73fc009dc0 tx=0x7f73fc01c9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11324dfdb6739711 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:27.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.728+0000 7f7403e00640 1 -- 172.21.15.8:0/3819494395 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc0b2070 con 0x7f7404163380 2024-03-23T23:56:27.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.728+0000 7f7403e00640 1 -- 172.21.15.8:0/3819494395 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73fc0a5850 con 0x7f7404163380 2024-03-23T23:56:27.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.728+0000 7f7403e00640 1 -- 172.21.15.8:0/3819494395 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc0a5c20 con 0x7f7404163380 2024-03-23T23:56:27.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.728+0000 7f740ac00640 1 -- 172.21.15.8:0/3819494395 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7404163380 msgr2=0x7f7404165770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:27.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.728+0000 7f740ac00640 1 --2- 172.21.15.8:0/3819494395 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7404163380 0x7f7404165770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f73fc009dc0 tx=0x7f73fc01c9d0 comp rx=0 tx=0).stop 2024-03-23T23:56:27.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.736+0000 7f740ac00640 1 -- 172.21.15.8:0/3819494395 shutdown_connections 2024-03-23T23:56:27.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.736+0000 7f740ac00640 1 --2- 172.21.15.8:0/3819494395 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7404163380 0x7f7404165770 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:27.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.736+0000 7f740ac00640 1 -- 172.21.15.8:0/3819494395 >> 172.21.15.8:0/3819494395 conn(0x7f74040c3910 msgr2=0x7f74040c3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:27.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.736+0000 7f740ac00640 1 -- 172.21.15.8:0/3819494395 shutdown_connections 2024-03-23T23:56:27.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.736+0000 7f740ac00640 1 -- 172.21.15.8:0/3819494395 wait complete. 2024-03-23T23:56:27.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.740+0000 7f740ac00640 1 Processor -- start 2024-03-23T23:56:27.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.744+0000 7f740ac00640 1 -- start start 2024-03-23T23:56:27.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.752+0000 7f740ac00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7404157180 0x7f7404164f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:27.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.752+0000 7f740ac00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f740415a670 0x7f7404165440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:27.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.752+0000 7f740ac00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7404163380 0x7f74040a9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:27.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.752+0000 7f740ac00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740415a1e0 con 0x7f7404163380 2024-03-23T23:56:27.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.752+0000 7f740ac00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740406ccf0 con 0x7f7404157180 2024-03-23T23:56:27.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.752+0000 7f740ac00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740406f440 con 0x7f740415a670 2024-03-23T23:56:27.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.752+0000 7f7408e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f740415a670 0x7f7404165440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:27.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.752+0000 7f7408e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f740415a670 0x7f7404165440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:37668/0 (socket says 172.21.15.8:37668) 2024-03-23T23:56:27.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.752+0000 7f7408e00640 1 -- 172.21.15.8:0/3627706648 learned_addr learned my addr 172.21.15.8:0/3627706648 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:56:27.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.756+0000 7f740a200640 1 --2- 172.21.15.8:0/3627706648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7404163380 0x7f74040a9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:27.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.756+0000 7f740a200640 1 -- 172.21.15.8:0/3627706648 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f740415a670 msgr2=0x7f7404165440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:27.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.756+0000 7f740a200640 1 --2- 172.21.15.8:0/3627706648 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f740415a670 0x7f7404165440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:27.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.756+0000 7f740a200640 1 -- 172.21.15.8:0/3627706648 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7404157180 msgr2=0x7f7404164f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:27.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.756+0000 7f740a200640 1 --2- 172.21.15.8:0/3627706648 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7404157180 0x7f7404164f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:27.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.756+0000 7f740a200640 1 -- 172.21.15.8:0/3627706648 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74040ac180 con 0x7f7404163380 2024-03-23T23:56:27.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.760+0000 7f740a200640 1 --2- 172.21.15.8:0/3627706648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7404163380 0x7f74040a9470 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f73fc0ac000 tx=0x7f73fc019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:27.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.760+0000 7f7401600640 1 -- 172.21.15.8:0/3627706648 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc0bb020 con 0x7f7404163380 2024-03-23T23:56:27.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.760+0000 7f7401600640 1 -- 172.21.15.8:0/3627706648 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73fc0ad440 con 0x7f7404163380 2024-03-23T23:56:27.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.760+0000 7f7401600640 1 -- 172.21.15.8:0/3627706648 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc0b2040 con 0x7f7404163380 2024-03-23T23:56:27.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.760+0000 7f740ac00640 1 -- 172.21.15.8:0/3627706648 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74041625a0 con 0x7f7404163380 2024-03-23T23:56:27.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.764+0000 7f740ac00640 1 -- 172.21.15.8:0/3627706648 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74040c5be0 con 0x7f7404163380 2024-03-23T23:56:27.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.768+0000 7f740ac00640 1 -- 172.21.15.8:0/3627706648 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f740404f410 con 0x7f7404163380 2024-03-23T23:56:27.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.768+0000 7f7401600640 1 -- 172.21.15.8:0/3627706648 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f73fc0be020 con 0x7f7404163380 2024-03-23T23:56:27.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.772+0000 7f7401600640 1 --2- 172.21.15.8:0/3627706648 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f73e4067760 0x7f73e4069c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:27.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.772+0000 7f7401600640 1 -- 172.21.15.8:0/3627706648 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f73fc002020 con 0x7f7404163380 2024-03-23T23:56:27.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.776+0000 7f7409800640 1 --2- 172.21.15.8:0/3627706648 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f73e4067760 0x7f73e4069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:27.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.788+0000 7f7409800640 1 --2- 172.21.15.8:0/3627706648 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f73e4067760 0x7f73e4069c20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f73f8001600 tx=0x7f73f8007a50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:27.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:27.792+0000 7f7401600640 1 -- 172.21.15.8:0/3627706648 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f73fc0165c0 con 0x7f7404163380 2024-03-23T23:56:28.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:28.640+0000 7f740ac00640 1 -- 172.21.15.8:0/3627706648 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f74041566f0 con 0x7f7404163380 2024-03-23T23:56:28.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:28.644+0000 7f7401600640 1 -- 172.21.15.8:0/3627706648 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1562 (secure 0 0 0) 0x7f73fc0f07d0 con 0x7f7404163380 2024-03-23T23:56:28.646 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":110,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:56:28.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:28.648+0000 7f740ac00640 1 -- 172.21.15.8:0/3627706648 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f73e4067760 msgr2=0x7f73e4069c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:28.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:28.648+0000 7f740ac00640 1 --2- 172.21.15.8:0/3627706648 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f73e4067760 0x7f73e4069c20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f73f8001600 tx=0x7f73f8007a50 comp rx=0 tx=0).stop 2024-03-23T23:56:28.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:28.648+0000 7f740ac00640 1 -- 172.21.15.8:0/3627706648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7404163380 msgr2=0x7f74040a9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:28.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:28.648+0000 7f740ac00640 1 --2- 172.21.15.8:0/3627706648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7404163380 0x7f74040a9470 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f73fc0ac000 tx=0x7f73fc019770 comp rx=0 tx=0).stop 2024-03-23T23:56:28.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:28.648+0000 7f740ac00640 1 -- 172.21.15.8:0/3627706648 shutdown_connections 2024-03-23T23:56:28.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:28.648+0000 7f740ac00640 1 --2- 172.21.15.8:0/3627706648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7404163380 0x7f74040a9470 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:28.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:28.648+0000 7f740ac00640 1 --2- 172.21.15.8:0/3627706648 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f73e4067760 0x7f73e4069c20 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:28.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:28.648+0000 7f740ac00640 1 --2- 172.21.15.8:0/3627706648 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f740415a670 0x7f7404165440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:28.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:28.648+0000 7f740ac00640 1 --2- 172.21.15.8:0/3627706648 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7404157180 0x7f7404164f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:28.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:28.648+0000 7f740ac00640 1 -- 172.21.15.8:0/3627706648 >> 172.21.15.8:0/3627706648 conn(0x7f74040c3910 msgr2=0x7f7404153130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:28.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:28.648+0000 7f740ac00640 1 -- 172.21.15.8:0/3627706648 shutdown_connections 2024-03-23T23:56:28.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:28.648+0000 7f740ac00640 1 -- 172.21.15.8:0/3627706648 wait complete. 2024-03-23T23:56:28.723 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T23:56:28.723 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-03-23T23:56:28.723 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T23:56:28.724 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:56:29.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.256+0000 7f9dc7000640 1 Processor -- start 2024-03-23T23:56:29.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.256+0000 7f9dc7000640 1 -- start start 2024-03-23T23:56:29.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.264+0000 7f9dc7000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9db80d7b60 0x7f9db8046160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:29.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.264+0000 7f9dc7000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9db80dbfe0 0x7f9db80e4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:29.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.264+0000 7f9dc7000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db800bb00 con 0x7f9db80466a0 2024-03-23T23:56:29.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.264+0000 7f9dc7000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9db8007410 con 0x7f9db80dbfe0 2024-03-23T23:56:29.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.264+0000 7f9dc7000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db8007130 con 0x7f9db80d7b60 2024-03-23T23:56:29.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.264+0000 7f9dc5200640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f9db80466a0 0x7f9db80db8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:54732/0 (socket says 172.21.15.8:54732) 2024-03-23T23:56:29.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.264+0000 7f9dc5200640 1 -- 172.21.15.8:0/2152452661 learned_addr learned my addr 172.21.15.8:0/2152452661 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:56:29.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.264+0000 7f9dc6600640 1 --2- 172.21.15.8:0/2152452661 >> v2:172.21.15.8:3300/0 conn(0x7f9db80dbfe0 0x7f9db80e4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:29.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.264+0000 7f9dc5c00640 1 --2- 172.21.15.8:0/2152452661 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9db80d7b60 0x7f9db8046160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:29.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.264+0000 7f9dc6600640 1 -- 172.21.15.8:0/2152452661 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9db80d7b60 msgr2=0x7f9db8046160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:29.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.268+0000 7f9dc6600640 1 --2- 172.21.15.8:0/2152452661 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9db80d7b60 0x7f9db8046160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.268+0000 7f9dc6600640 1 -- 172.21.15.8:0/2152452661 >> v1:172.21.15.196:6789/0 conn(0x7f9db80466a0 legacy=0x7f9db80db8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:29.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.268+0000 7f9dc6600640 1 -- 172.21.15.8:0/2152452661 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db80da4f0 con 0x7f9db80dbfe0 2024-03-23T23:56:29.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.284+0000 7f9dc6600640 1 --2- 172.21.15.8:0/2152452661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9db80dbfe0 0x7f9db80e4d60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9dc002d610 tx=0x7f9dc0098330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf46e0020f20d99e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:29.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.284+0000 7f9dbfe00640 1 -- 172.21.15.8:0/2152452661 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc012c070 con 0x7f9db80dbfe0 2024-03-23T23:56:29.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.284+0000 7f9dbfe00640 1 -- 172.21.15.8:0/2152452661 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc0127620 con 0x7f9db80dbfe0 2024-03-23T23:56:29.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.284+0000 7f9dbfe00640 1 -- 172.21.15.8:0/2152452661 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc0127ad0 con 0x7f9db80dbfe0 2024-03-23T23:56:29.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.288+0000 7f9dc7000640 1 -- 172.21.15.8:0/2152452661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9db80dbfe0 msgr2=0x7f9db80e4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:29.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.288+0000 7f9dc7000640 1 --2- 172.21.15.8:0/2152452661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9db80dbfe0 0x7f9db80e4d60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9dc002d610 tx=0x7f9dc0098330 comp rx=0 tx=0).stop 2024-03-23T23:56:29.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.296+0000 7f9dc7000640 1 -- 172.21.15.8:0/2152452661 shutdown_connections 2024-03-23T23:56:29.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.296+0000 7f9dc7000640 1 --2- 172.21.15.8:0/2152452661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9db80dbfe0 0x7f9db80e4d60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.296+0000 7f9dc7000640 1 --2- 172.21.15.8:0/2152452661 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9db80d7b60 0x7f9db8046160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.296+0000 7f9dc7000640 1 -- 172.21.15.8:0/2152452661 >> 172.21.15.8:0/2152452661 conn(0x7f9db8005ef0 msgr2=0x7f9db8006300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:29.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.296+0000 7f9dc7000640 1 -- 172.21.15.8:0/2152452661 shutdown_connections 2024-03-23T23:56:29.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.296+0000 7f9dc7000640 1 -- 172.21.15.8:0/2152452661 wait complete. 2024-03-23T23:56:29.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.296+0000 7f9dc7000640 1 Processor -- start 2024-03-23T23:56:29.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.308+0000 7f9dc7000640 1 -- start start 2024-03-23T23:56:29.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.312+0000 7f9dc7000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9db80466a0 0x7f9db80c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:29.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.312+0000 7f9dc7000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9db80d7b60 0x7f9db80c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:29.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.312+0000 7f9dc7000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9db80dbfe0 0x7f9db817a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:29.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.312+0000 7f9dc7000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db8045af0 con 0x7f9db80dbfe0 2024-03-23T23:56:29.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.312+0000 7f9dc7000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db8006c30 con 0x7f9db80d7b60 2024-03-23T23:56:29.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.312+0000 7f9dc7000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db80db2b0 con 0x7f9db80466a0 2024-03-23T23:56:29.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.312+0000 7f9dc5c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9db80466a0 0x7f9db80c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:29.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.312+0000 7f9dc5c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9db80466a0 0x7f9db80c7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:37676/0 (socket says 172.21.15.8:37676) 2024-03-23T23:56:29.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.312+0000 7f9dc5c00640 1 -- 172.21.15.8:0/1864892863 learned_addr learned my addr 172.21.15.8:0/1864892863 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:56:29.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.312+0000 7f9dc6600640 1 --2- 172.21.15.8:0/1864892863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9db80dbfe0 0x7f9db817a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:29.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.312+0000 7f9dc5c00640 1 -- 172.21.15.8:0/1864892863 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9db80d7b60 msgr2=0x7f9db80c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:29.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.312+0000 7f9dc5c00640 1 --2- 172.21.15.8:0/1864892863 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9db80d7b60 0x7f9db80c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.312+0000 7f9dc5c00640 1 -- 172.21.15.8:0/1864892863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9db80dbfe0 msgr2=0x7f9db817a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:29.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.312+0000 7f9dc5c00640 1 --2- 172.21.15.8:0/1864892863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9db80dbfe0 0x7f9db817a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.312+0000 7f9dc5c00640 1 -- 172.21.15.8:0/1864892863 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db80d8550 con 0x7f9db80466a0 2024-03-23T23:56:29.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.316+0000 7f9dc5c00640 1 --2- 172.21.15.8:0/1864892863 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9db80466a0 0x7f9db80c7ab0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9db400d5f0 tx=0x7f9db400dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:29.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.316+0000 7f9dbd600640 1 -- 172.21.15.8:0/1864892863 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db40125f0 con 0x7f9db80466a0 2024-03-23T23:56:29.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.316+0000 7f9dbd600640 1 -- 172.21.15.8:0/1864892863 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db4019070 con 0x7f9db80466a0 2024-03-23T23:56:29.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.316+0000 7f9dbd600640 1 -- 172.21.15.8:0/1864892863 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db40129b0 con 0x7f9db80466a0 2024-03-23T23:56:29.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.316+0000 7f9dc7000640 1 -- 172.21.15.8:0/1864892863 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db80d9aa0 con 0x7f9db80466a0 2024-03-23T23:56:29.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.316+0000 7f9dc7000640 1 -- 172.21.15.8:0/1864892863 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db80da020 con 0x7f9db80466a0 2024-03-23T23:56:29.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.324+0000 7f9db2a00640 1 --2- 172.21.15.8:0/1864892863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9db80d4ee0 0x7f9db80d68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:29.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.324+0000 7f9db2a00640 1 -- 172.21.15.8:0/1864892863 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db80d6e30 con 0x7f9db80d4ee0 2024-03-23T23:56:29.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.324+0000 7f9dc5200640 1 --2- 172.21.15.8:0/1864892863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9db80d4ee0 0x7f9db80d68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:29.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.324+0000 7f9dbd600640 1 -- 172.21.15.8:0/1864892863 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f9db4012b50 con 0x7f9db80466a0 2024-03-23T23:56:29.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.328+0000 7f9dbd600640 1 --2- 172.21.15.8:0/1864892863 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9da0067730 0x7f9da0069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:29.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.328+0000 7f9dbd600640 1 -- 172.21.15.8:0/1864892863 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f9db4085f70 con 0x7f9db80466a0 2024-03-23T23:56:29.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.328+0000 7f9dc5200640 1 -- 172.21.15.8:0/1864892863 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9db80da1f0 con 0x7f9db80d4ee0 2024-03-23T23:56:29.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.336+0000 7f9dc5200640 1 --2- 172.21.15.8:0/1864892863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9db80d4ee0 0x7f9db80d68f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9db80459b0 tx=0x7f9dac00c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:29.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.336+0000 7f9dc6600640 1 --2- 172.21.15.8:0/1864892863 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9da0067730 0x7f9da0069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:29.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.336+0000 7f9dbd600640 1 -- 172.21.15.8:0/1864892863 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac017070 con 0x7f9db80d4ee0 2024-03-23T23:56:29.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.336+0000 7f9dbd600640 1 -- 172.21.15.8:0/1864892863 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f9dac005cf0 con 0x7f9db80d4ee0 2024-03-23T23:56:29.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.336+0000 7f9dbd600640 1 -- 172.21.15.8:0/1864892863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9db80d4ee0 msgr2=0x7f9db80d68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:29.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.336+0000 7f9dbd600640 1 --2- 172.21.15.8:0/1864892863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9db80d4ee0 0x7f9db80d68f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9db80459b0 tx=0x7f9dac00c7a0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.336+0000 7f9dbd600640 1 -- 172.21.15.8:0/1864892863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9db80d4ee0 msgr2=0x7f9db80d68f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:56:29.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.336+0000 7f9dbd600640 1 --2- 172.21.15.8:0/1864892863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9db80d4ee0 0x7f9db80d68f0 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9db80459b0 tx=0x7f9dac00c7a0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.348+0000 7f9dc6600640 1 --2- 172.21.15.8:0/1864892863 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9da0067730 0x7f9da0069bf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9db8008570 tx=0x7f9dc0122000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:29.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.368+0000 7f9db2a00640 1 --2- 172.21.15.8:0/1864892863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9db80d57b0 0x7f9db817ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:29.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.368+0000 7f9dc5200640 1 --2- 172.21.15.8:0/1864892863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9db80d57b0 0x7f9db817ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:29.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.368+0000 7f9db2a00640 1 -- 172.21.15.8:0/1864892863 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db8006a10 con 0x7f9db80d57b0 2024-03-23T23:56:29.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.368+0000 7f9dc5200640 1 -- 172.21.15.8:0/1864892863 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9db800a210 con 0x7f9db80d57b0 2024-03-23T23:56:29.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.368+0000 7f9dc5200640 1 --2- 172.21.15.8:0/1864892863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9db80d57b0 0x7f9db817ac60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9db80cbe80 tx=0x7f9dac005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:29.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.372+0000 7f9dbd600640 1 -- 172.21.15.8:0/1864892863 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac017030 con 0x7f9db80d57b0 2024-03-23T23:56:29.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.372+0000 7f9dbd600640 1 -- 172.21.15.8:0/1864892863 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4533 (secure 0 0 0) 0x7f9dac022420 con 0x7f9db80d57b0 2024-03-23T23:56:29.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.372+0000 7f9dbd600640 1 -- 172.21.15.8:0/1864892863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9db80d57b0 msgr2=0x7f9db817ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:29.375 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:56:29.375 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:56:29.375 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:56:29.375 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:56:29.375 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 110, 2024-03-23T23:56:29.375 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:56:29.375 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:56:29.375 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:56:29.375 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:56:29.376 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:29.376 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 15, 2024-03-23T23:56:29.376 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:56:29.376 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:56:29.376 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:56:29.376 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:56:29.376 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:56:29.376 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:56:29.376 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:56:29.376 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:56:29.376 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:56:29.376 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:56:29.376 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:56:29.376 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:56:29.377 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:56:29.377 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:56:29.377 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:29.377 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:56:29.377 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:56:29.377 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:56:29.377 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:56:29.377 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:56:29.377 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:56:29.377 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:56:29.377 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:56:29.377 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:56:29.377 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:56:29.377 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:56:29.378 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:56:29.378 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:56:29.378 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:29.378 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:29.378 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:56:29.378 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:56:29.378 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:56:29.378 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:56:29.378 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:56:29.378 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:56:29.378 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:56:29.378 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:56:29.378 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:56:29.379 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:56:29.379 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:56:29.379 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:56:29.379 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:56:29.379 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:56:29.379 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:56:29.379 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:56:29.379 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:56:29.379 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:56:29.379 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:56:29.379 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:56:29.379 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:56:29.379 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:56:29.379 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:56:29.379 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:56:29.380 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:56:29.380 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:56:29.380 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:56:29.380 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:56:29.380 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:29.380 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:56:29.380 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:29.380 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:56:29.380 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:29.380 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:56:29.380 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:56:29.381 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:56:29.381 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:56:29.381 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:29.381 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:56:29.381 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:56:29.381 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:29.381 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:29.381 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:29.381 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:56:29.381 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:56:29.381 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:29.381 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:29.381 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:29.382 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:29.382 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:56:29.382 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:56:29.382 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:56:29.382 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:56:29.382 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:56:29.382 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:29.382 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:29.382 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:56:29.382 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:56:29.382 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:56:29.383 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:56:29.383 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:29.383 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:56:29.383 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:56:29.383 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:29.383 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:29.383 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:29.383 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:56:29.383 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:56:29.383 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:29.383 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:29.383 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:29.383 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:29.384 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:56:29.384 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:56:29.384 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:56:29.384 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:56:29.384 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:56:29.384 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:29.384 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:29.384 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:56:29.384 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:56:29.384 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:56:29.384 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:56:29.384 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:29.384 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:56:29.385 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:56:29.385 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:29.385 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:29.385 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:29.385 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:56:29.385 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:56:29.385 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:29.385 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:29.385 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:29.385 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:29.385 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:56:29.385 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:56:29.385 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:56:29.385 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:56:29.386 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:56:29.386 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:29.386 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:29.386 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:29.386 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:56:29.386 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:56:29.386 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:29.386 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:29.386 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:29.386 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:56:29.386 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:29.386 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:29.386 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:56:29.387 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:29.387 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:29.387 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:29.387 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:56:29.387 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:29.387 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:29.387 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:29.387 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:56:29.387 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:56:29.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.372+0000 7f9dbd600640 1 --2- 172.21.15.8:0/1864892863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9db80d57b0 0x7f9db817ac60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9db80cbe80 tx=0x7f9dac005800 comp rx=0 tx=0).stop 2024-03-23T23:56:29.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.372+0000 7f9dbd600640 1 -- 172.21.15.8:0/1864892863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9db80d57b0 msgr2=0x7f9db817ac60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:56:29.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.372+0000 7f9dbd600640 1 --2- 172.21.15.8:0/1864892863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9db80d57b0 0x7f9db817ac60 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9db80cbe80 tx=0x7f9dac005800 comp rx=0 tx=0).stop 2024-03-23T23:56:29.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.372+0000 7f9db2a00640 1 -- 172.21.15.8:0/1864892863 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9da0067730 msgr2=0x7f9da0069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:29.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.376+0000 7f9db2a00640 1 --2- 172.21.15.8:0/1864892863 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9da0067730 0x7f9da0069bf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9db8008570 tx=0x7f9dc0122000 comp rx=0 tx=0).stop 2024-03-23T23:56:29.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.376+0000 7f9db2a00640 1 -- 172.21.15.8:0/1864892863 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9db80466a0 msgr2=0x7f9db80c7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:29.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.376+0000 7f9db2a00640 1 --2- 172.21.15.8:0/1864892863 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9db80466a0 0x7f9db80c7ab0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9db400d5f0 tx=0x7f9db400dab0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.376+0000 7f9dc6600640 1 -- 172.21.15.8:0/1864892863 reap_dead start 2024-03-23T23:56:29.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.376+0000 7f9dc6600640 1 -- 172.21.15.8:0/1864892863 reap_dead start 2024-03-23T23:56:29.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.376+0000 7f9db2a00640 1 -- 172.21.15.8:0/1864892863 shutdown_connections 2024-03-23T23:56:29.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.376+0000 7f9db2a00640 1 -- 172.21.15.8:0/1864892863 >> 172.21.15.8:0/1864892863 conn(0x7f9db8005ef0 msgr2=0x7f9db80db700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:29.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.376+0000 7f9db2a00640 1 -- 172.21.15.8:0/1864892863 shutdown_connections 2024-03-23T23:56:29.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.376+0000 7f9db2a00640 1 -- 172.21.15.8:0/1864892863 wait complete. 2024-03-23T23:56:29.434 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:56:29.434 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T23:56:29.434 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:56:29.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.740+0000 7f3cace00640 1 Processor -- start 2024-03-23T23:56:29.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.740+0000 7f3cace00640 1 -- start start 2024-03-23T23:56:29.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.748+0000 7f3cace00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ca814edf0 0x7f3ca8151800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:29.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.748+0000 7f3cace00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3ca8154df0 0x7f3ca80c3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:29.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.748+0000 7f3cace00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3ca80c4070 0x7f3ca806e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:29.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.748+0000 7f3cace00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca806ddd0 con 0x7f3ca8154df0 2024-03-23T23:56:29.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.748+0000 7f3cace00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca8155360 con 0x7f3ca80c4070 2024-03-23T23:56:29.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.748+0000 7f3cace00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca8155640 con 0x7f3ca814edf0 2024-03-23T23:56:29.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.748+0000 7f3ca5400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3ca8154df0 0x7f3ca80c3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:29.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.748+0000 7f3ca5400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3ca8154df0 0x7f3ca80c3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57576/0 (socket says 172.21.15.8:57576) 2024-03-23T23:56:29.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.748+0000 7f3ca5400640 1 -- 172.21.15.8:0/3318136368 learned_addr learned my addr 172.21.15.8:0/3318136368 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:56:29.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.748+0000 7f3ca5e00640 1 --2- 172.21.15.8:0/3318136368 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ca814edf0 0x7f3ca8151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:29.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.748+0000 7f3ca5400640 1 -- 172.21.15.8:0/3318136368 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ca814edf0 msgr2=0x7f3ca8151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:29.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.748+0000 7f3ca5400640 1 --2- 172.21.15.8:0/3318136368 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ca814edf0 0x7f3ca8151800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.748+0000 7f3ca5400640 1 -- 172.21.15.8:0/3318136368 >> v2:172.21.15.196:3300/0 conn(0x7f3ca80c4070 msgr2=0x7f3ca806e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:29.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.748+0000 7f3ca5400640 1 --2- 172.21.15.8:0/3318136368 >> v2:172.21.15.196:3300/0 conn(0x7f3ca80c4070 0x7f3ca806e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.752+0000 7f3ca5400640 1 -- 172.21.15.8:0/3318136368 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca8155920 con 0x7f3ca8154df0 2024-03-23T23:56:29.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.756+0000 7f3ca5400640 1 --2- 172.21.15.8:0/3318136368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ca8154df0 0x7f3ca80c3b30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3c980091e0 tx=0x7f3c9801e1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb822e4c71813f7 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:29.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.760+0000 7f3ca4a00640 1 -- 172.21.15.8:0/3318136368 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c980a7700 con 0x7f3ca8154df0 2024-03-23T23:56:29.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.760+0000 7f3ca4a00640 1 -- 172.21.15.8:0/3318136368 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c980a78a0 con 0x7f3ca8154df0 2024-03-23T23:56:29.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.760+0000 7f3ca4a00640 1 -- 172.21.15.8:0/3318136368 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c980a7c70 con 0x7f3ca8154df0 2024-03-23T23:56:29.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.764+0000 7f3cace00640 1 -- 172.21.15.8:0/3318136368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ca8154df0 msgr2=0x7f3ca80c3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:29.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.764+0000 7f3cace00640 1 --2- 172.21.15.8:0/3318136368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ca8154df0 0x7f3ca80c3b30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3c980091e0 tx=0x7f3c9801e1b0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.764+0000 7f3cace00640 1 -- 172.21.15.8:0/3318136368 shutdown_connections 2024-03-23T23:56:29.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.764+0000 7f3cace00640 1 --2- 172.21.15.8:0/3318136368 >> v2:172.21.15.196:3300/0 conn(0x7f3ca80c4070 0x7f3ca806e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.764+0000 7f3cace00640 1 --2- 172.21.15.8:0/3318136368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ca8154df0 0x7f3ca80c3b30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.764+0000 7f3cace00640 1 --2- 172.21.15.8:0/3318136368 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ca814edf0 0x7f3ca8151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.764+0000 7f3cace00640 1 -- 172.21.15.8:0/3318136368 >> 172.21.15.8:0/3318136368 conn(0x7f3ca806b170 msgr2=0x7f3ca806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:29.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.768+0000 7f3cace00640 1 -- 172.21.15.8:0/3318136368 shutdown_connections 2024-03-23T23:56:29.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.768+0000 7f3cace00640 1 -- 172.21.15.8:0/3318136368 wait complete. 2024-03-23T23:56:29.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.768+0000 7f3cace00640 1 Processor -- start 2024-03-23T23:56:29.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.772+0000 7f3cace00640 1 -- start start 2024-03-23T23:56:29.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.772+0000 7f3cace00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ca80c4070 0x7f3ca8153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:29.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.772+0000 7f3cace00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ca814edf0 0x7f3ca81edec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:29.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.772+0000 7f3cace00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ca8154df0 0x7f3ca8144630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:29.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.772+0000 7f3cace00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca80c45d0 con 0x7f3ca80c4070 2024-03-23T23:56:29.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.772+0000 7f3ca5e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ca80c4070 0x7f3ca8153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:29.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.772+0000 7f3cace00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca806ebb0 con 0x7f3ca814edf0 2024-03-23T23:56:29.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.772+0000 7f3ca5400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ca814edf0 0x7f3ca81edec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:29.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.776+0000 7f3ca5e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ca80c4070 0x7f3ca8153de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57584/0 (socket says 172.21.15.8:57584) 2024-03-23T23:56:29.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.776+0000 7f3ca5e00640 1 -- 172.21.15.8:0/2449119396 learned_addr learned my addr 172.21.15.8:0/2449119396 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:56:29.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.776+0000 7f3ca6800640 1 --2- 172.21.15.8:0/2449119396 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ca8154df0 0x7f3ca8144630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:29.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.776+0000 7f3cace00640 1 -- 172.21.15.8:0/2449119396 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca80c4750 con 0x7f3ca8154df0 2024-03-23T23:56:29.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.776+0000 7f3ca5e00640 1 -- 172.21.15.8:0/2449119396 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ca8154df0 msgr2=0x7f3ca8144630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:29.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.776+0000 7f3ca5e00640 1 --2- 172.21.15.8:0/2449119396 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ca8154df0 0x7f3ca8144630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.776+0000 7f3ca5e00640 1 -- 172.21.15.8:0/2449119396 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ca814edf0 msgr2=0x7f3ca81edec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:29.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.776+0000 7f3ca5e00640 1 --2- 172.21.15.8:0/2449119396 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ca814edf0 0x7f3ca81edec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.776+0000 7f3ca5e00640 1 -- 172.21.15.8:0/2449119396 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca81eb1a0 con 0x7f3ca80c4070 2024-03-23T23:56:29.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.776+0000 7f3ca6800640 1 --2- 172.21.15.8:0/2449119396 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ca8154df0 0x7f3ca8144630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:56:29.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.780+0000 7f3ca5e00640 1 --2- 172.21.15.8:0/2449119396 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ca80c4070 0x7f3ca8153de0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0007ef0 tx=0x7f3ca000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:29.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.780+0000 7f3c9e000640 1 -- 172.21.15.8:0/2449119396 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0014620 con 0x7f3ca80c4070 2024-03-23T23:56:29.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.780+0000 7f3c9e000640 1 -- 172.21.15.8:0/2449119396 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca0019070 con 0x7f3ca80c4070 2024-03-23T23:56:29.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.780+0000 7f3c9e000640 1 -- 172.21.15.8:0/2449119396 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0014a00 con 0x7f3ca80c4070 2024-03-23T23:56:29.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.780+0000 7f3cace00640 1 -- 172.21.15.8:0/2449119396 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ca80c6200 con 0x7f3ca80c4070 2024-03-23T23:56:29.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.780+0000 7f3cace00640 1 -- 172.21.15.8:0/2449119396 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca814e580 con 0x7f3ca80c4070 2024-03-23T23:56:29.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.784+0000 7f3cace00640 1 --2- 172.21.15.8:0/2449119396 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ca81ead10 0x7f3ca8144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:29.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.784+0000 7f3cace00640 1 -- 172.21.15.8:0/2449119396 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca80c1910 con 0x7f3ca81ead10 2024-03-23T23:56:29.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.784+0000 7f3ca5400640 1 --2- 172.21.15.8:0/2449119396 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ca81ead10 0x7f3ca8144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:29.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.784+0000 7f3c9e000640 1 -- 172.21.15.8:0/2449119396 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3ca0014ba0 con 0x7f3ca80c4070 2024-03-23T23:56:29.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.788+0000 7f3c9e000640 1 --2- 172.21.15.8:0/2449119396 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3c88067730 0x7f3c88069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:29.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.788+0000 7f3c9e000640 1 -- 172.21.15.8:0/2449119396 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f3ca00864a0 con 0x7f3ca80c4070 2024-03-23T23:56:29.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.788+0000 7f3ca6800640 1 --2- 172.21.15.8:0/2449119396 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3c88067730 0x7f3c88069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:29.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.788+0000 7f3ca5400640 1 -- 172.21.15.8:0/2449119396 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3ca8068270 con 0x7f3ca81ead10 2024-03-23T23:56:29.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.796+0000 7f3ca5400640 1 --2- 172.21.15.8:0/2449119396 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ca81ead10 0x7f3ca8144b70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3ca80c4e30 tx=0x7f3c9801a4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:29.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.796+0000 7f3ca6800640 1 --2- 172.21.15.8:0/2449119396 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3c88067730 0x7f3c88069bf0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3c94006fd0 tx=0x7f3c94008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:29.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.808+0000 7f3c9e000640 1 -- 172.21.15.8:0/2449119396 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c980bd070 con 0x7f3ca81ead10 2024-03-23T23:56:29.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.808+0000 7f3c9e000640 1 -- 172.21.15.8:0/2449119396 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f3c980af620 con 0x7f3ca81ead10 2024-03-23T23:56:29.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.808+0000 7f3c9e000640 1 -- 172.21.15.8:0/2449119396 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ca81ead10 msgr2=0x7f3ca8144b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:29.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.808+0000 7f3c9e000640 1 --2- 172.21.15.8:0/2449119396 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ca81ead10 0x7f3ca8144b70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3ca80c4e30 tx=0x7f3c9801a4f0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.808+0000 7f3c9e000640 1 -- 172.21.15.8:0/2449119396 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ca81ead10 msgr2=0x7f3ca8144b70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:56:29.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.808+0000 7f3c9e000640 1 --2- 172.21.15.8:0/2449119396 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ca81ead10 0x7f3ca8144b70 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3ca80c4e30 tx=0x7f3c9801a4f0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.848+0000 7f3cace00640 1 --2- 172.21.15.8:0/2449119396 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ca80aa330 0x7f3ca80c4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:29.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.848+0000 7f3cace00640 1 -- 172.21.15.8:0/2449119396 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca81edd10 con 0x7f3ca80aa330 2024-03-23T23:56:29.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.852+0000 7f3ca5400640 1 --2- 172.21.15.8:0/2449119396 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ca80aa330 0x7f3ca80c4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:29.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.852+0000 7f3ca5400640 1 -- 172.21.15.8:0/2449119396 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3ca80c2060 con 0x7f3ca80aa330 2024-03-23T23:56:29.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.856+0000 7f3ca5400640 1 --2- 172.21.15.8:0/2449119396 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ca80aa330 0x7f3ca80c4e30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3c98000c10 tx=0x7f3c980a8000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:29.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.856+0000 7f3c9e000640 1 -- 172.21.15.8:0/2449119396 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c980bd040 con 0x7f3ca80aa330 2024-03-23T23:56:29.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.860+0000 7f3c9e000640 1 -- 172.21.15.8:0/2449119396 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5184 (secure 0 0 0) 0x7f3c980c1450 con 0x7f3ca80aa330 2024-03-23T23:56:29.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.860+0000 7f3c9e000640 1 -- 172.21.15.8:0/2449119396 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ca80aa330 msgr2=0x7f3ca80c4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:29.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.860+0000 7f3c9e000640 1 --2- 172.21.15.8:0/2449119396 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ca80aa330 0x7f3ca80c4e30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3c98000c10 tx=0x7f3c980a8000 comp rx=0 tx=0).stop 2024-03-23T23:56:29.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.860+0000 7f3c9e000640 1 -- 172.21.15.8:0/2449119396 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ca80aa330 msgr2=0x7f3ca80c4e30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:56:29.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.860+0000 7f3c9e000640 1 --2- 172.21.15.8:0/2449119396 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ca80aa330 0x7f3ca80c4e30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.863 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:56:29.863 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:56:29.863 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:56:29.863 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:56:29.863 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 110, 2024-03-23T23:56:29.864 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:56:29.864 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:56:29.864 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:56:29.864 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:56:29.864 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:29.864 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 15, 2024-03-23T23:56:29.864 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:56:29.864 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:56:29.864 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:56:29.864 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:56:29.864 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:56:29.864 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:56:29.864 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:56:29.864 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:56:29.865 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:56:29.865 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:56:29.865 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:56:29.865 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:56:29.865 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:56:29.865 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:56:29.865 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:29.865 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:56:29.865 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:56:29.865 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:56:29.865 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:56:29.865 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:56:29.865 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:56:29.865 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:56:29.866 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:56:29.866 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:56:29.866 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:56:29.866 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:56:29.866 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:56:29.866 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:56:29.866 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:29.866 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:29.866 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:56:29.866 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:56:29.866 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:56:29.866 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:56:29.866 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:56:29.866 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:56:29.867 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:56:29.867 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:56:29.867 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:56:29.867 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:56:29.867 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:56:29.867 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:56:29.867 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:56:29.867 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:56:29.867 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:56:29.867 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:56:29.867 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:56:29.867 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:56:29.867 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:56:29.867 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:56:29.868 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:56:29.868 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:56:29.868 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:56:29.868 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:56:29.868 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:56:29.868 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:56:29.868 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:56:29.868 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:56:29.868 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:29.868 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:56:29.868 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:29.868 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:56:29.868 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:29.868 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:56:29.868 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:56:29.869 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:56:29.869 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:56:29.869 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:29.869 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:56:29.869 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:56:29.869 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:29.869 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:29.869 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:29.869 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:56:29.869 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:56:29.869 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:29.869 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:29.869 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:29.869 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:29.870 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:56:29.870 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:56:29.870 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:56:29.870 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:56:29.870 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:56:29.870 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:29.870 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:29.870 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:56:29.870 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:56:29.870 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:56:29.870 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:56:29.870 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:29.870 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:56:29.870 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:56:29.871 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:29.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:29.871 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:29.871 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:56:29.871 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:56:29.871 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:29.871 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:29.871 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:29.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:29.871 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:56:29.871 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:56:29.871 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:56:29.871 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:56:29.871 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:56:29.872 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:29.872 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:29.872 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:56:29.872 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:56:29.872 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:56:29.872 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:56:29.872 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:29.872 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:56:29.872 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:56:29.872 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:29.872 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:29.872 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:29.872 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:56:29.872 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:56:29.873 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:29.873 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:29.873 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:29.873 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:29.873 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:56:29.873 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:56:29.873 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:56:29.873 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:56:29.873 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:56:29.873 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:29.873 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:29.873 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:29.873 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:56:29.873 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:56:29.874 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:29.874 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:29.874 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:29.874 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:56:29.874 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:29.874 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:29.874 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:56:29.874 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:29.874 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:29.874 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:29.874 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:56:29.874 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:29.874 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:29.874 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:56:29.875 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:29.875 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:29.875 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:29.875 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:56:29.875 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:29.875 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:29.875 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:56:29.875 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:29.875 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:56:29.875 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:29.875 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:56:29.875 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:29.875 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:29.875 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:29.875 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:29.876 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:56:29.876 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:29.876 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:29.876 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:56:29.876 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:29.876 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:29.876 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:29.876 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:56:29.876 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:29.876 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:29.876 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:29.876 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:56:29.876 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:56:29.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.868+0000 7f3cace00640 1 -- 172.21.15.8:0/2449119396 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3c88067730 msgr2=0x7f3c88069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:29.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.868+0000 7f3cace00640 1 --2- 172.21.15.8:0/2449119396 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3c88067730 0x7f3c88069bf0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3c94006fd0 tx=0x7f3c94008040 comp rx=0 tx=0).stop 2024-03-23T23:56:29.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.868+0000 7f3cace00640 1 -- 172.21.15.8:0/2449119396 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ca80c4070 msgr2=0x7f3ca8153de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:29.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.868+0000 7f3cace00640 1 --2- 172.21.15.8:0/2449119396 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ca80c4070 0x7f3ca8153de0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0007ef0 tx=0x7f3ca000e4b0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.868+0000 7f3ca6800640 1 -- 172.21.15.8:0/2449119396 reap_dead start 2024-03-23T23:56:29.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.872+0000 7f3cace00640 1 -- 172.21.15.8:0/2449119396 shutdown_connections 2024-03-23T23:56:29.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.872+0000 7f3cace00640 1 --2- 172.21.15.8:0/2449119396 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ca80c4070 0x7f3ca8153de0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.872+0000 7f3cace00640 1 -- 172.21.15.8:0/2449119396 >> 172.21.15.8:0/2449119396 conn(0x7f3ca806b170 msgr2=0x7f3ca80c3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:29.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.872+0000 7f3cace00640 1 -- 172.21.15.8:0/2449119396 shutdown_connections 2024-03-23T23:56:29.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:29.872+0000 7f3cace00640 1 -- 172.21.15.8:0/2449119396 wait complete. 2024-03-23T23:56:29.991 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:56:29.991 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T23:56:29.991 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:56:30.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.396+0000 7f132e000640 1 Processor -- start 2024-03-23T23:56:30.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.396+0000 7f132e000640 1 -- start start 2024-03-23T23:56:30.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.400+0000 7f132e000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f13200da360 0x7f13200e1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:30.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.400+0000 7f132e000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f132004b330 con 0x7f132000a9c0 2024-03-23T23:56:30.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.400+0000 7f132e000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1320046330 con 0x7f132000bd90 2024-03-23T23:56:30.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.400+0000 7f132e000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13200077c0 con 0x7f13200da360 2024-03-23T23:56:30.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.400+0000 7f1327400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f132000bd90 0x7f13200d3ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:54744/0 (socket says 172.21.15.8:54744) 2024-03-23T23:56:30.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.400+0000 7f1327400640 1 -- 172.21.15.8:0/1339887126 learned_addr learned my addr 172.21.15.8:0/1339887126 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:56:30.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.400+0000 7f1326000640 1 -- 172.21.15.8:0/1339887126 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1983090370 0 0) 0x7f1320046330 con 0x7f132000bd90 2024-03-23T23:56:30.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.400+0000 7f1326000640 1 -- 172.21.15.8:0/1339887126 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1310003530 con 0x7f132000bd90 2024-03-23T23:56:30.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.400+0000 7f1327e00640 1 --2- 172.21.15.8:0/1339887126 >> v2:172.21.15.196:3300/0 conn(0x7f13200da360 0x7f13200e1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:30.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.400+0000 7f1327e00640 1 -- 172.21.15.8:0/1339887126 >> v1:172.21.15.196:6789/0 conn(0x7f132000bd90 legacy=0x7f13200d3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:30.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.400+0000 7f1327e00640 1 -- 172.21.15.8:0/1339887126 >> v1:172.21.15.8:6789/0 conn(0x7f132000a9c0 legacy=0x7f13200d9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:30.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.400+0000 7f1327e00640 1 -- 172.21.15.8:0/1339887126 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1320046610 con 0x7f13200da360 2024-03-23T23:56:30.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.416+0000 7f1327e00640 1 --2- 172.21.15.8:0/1339887126 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f13200da360 0x7f13200e1cb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f13280695d0 tx=0x7f1328099100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8781c3ee12c7c356 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:30.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.424+0000 7f1326000640 1 -- 172.21.15.8:0/1339887126 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1328121ad0 con 0x7f13200da360 2024-03-23T23:56:30.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.424+0000 7f1326000640 1 -- 172.21.15.8:0/1339887126 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1328121c70 con 0x7f13200da360 2024-03-23T23:56:30.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.424+0000 7f1326000640 1 -- 172.21.15.8:0/1339887126 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132806f6c0 con 0x7f13200da360 2024-03-23T23:56:30.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.424+0000 7f132e000640 1 -- 172.21.15.8:0/1339887126 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f13200da360 msgr2=0x7f13200e1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:30.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.424+0000 7f132e000640 1 --2- 172.21.15.8:0/1339887126 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f13200da360 0x7f13200e1cb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f13280695d0 tx=0x7f1328099100 comp rx=0 tx=0).stop 2024-03-23T23:56:30.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.424+0000 7f132e000640 1 -- 172.21.15.8:0/1339887126 shutdown_connections 2024-03-23T23:56:30.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.424+0000 7f132e000640 1 --2- 172.21.15.8:0/1339887126 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f13200da360 0x7f13200e1cb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:30.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.424+0000 7f132e000640 1 -- 172.21.15.8:0/1339887126 >> 172.21.15.8:0/1339887126 conn(0x7f1320048290 msgr2=0x7f13200486a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:30.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.424+0000 7f132e000640 1 -- 172.21.15.8:0/1339887126 shutdown_connections 2024-03-23T23:56:30.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.424+0000 7f132e000640 1 -- 172.21.15.8:0/1339887126 wait complete. 2024-03-23T23:56:30.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.428+0000 7f132e000640 1 Processor -- start 2024-03-23T23:56:30.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.428+0000 7f132e000640 1 -- start start 2024-03-23T23:56:30.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.428+0000 7f132e000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f132000a9c0 0x7f132003f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:30.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.428+0000 7f132e000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f132000bd90 0x7f132002f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:30.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.428+0000 7f132e000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f13200da360 0x7f132002f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:30.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.428+0000 7f132e000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132004af50 con 0x7f132000a9c0 2024-03-23T23:56:30.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.428+0000 7f132e000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1320046980 con 0x7f13200da360 2024-03-23T23:56:30.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.428+0000 7f132e000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132004b0d0 con 0x7f132000bd90 2024-03-23T23:56:30.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.432+0000 7f1327400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f132000a9c0 0x7f132003f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:30.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.432+0000 7f1327400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f132000a9c0 0x7f132003f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57590/0 (socket says 172.21.15.8:57590) 2024-03-23T23:56:30.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.432+0000 7f1327400640 1 -- 172.21.15.8:0/3748989300 learned_addr learned my addr 172.21.15.8:0/3748989300 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:56:30.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.432+0000 7f1327e00640 1 --2- 172.21.15.8:0/3748989300 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f13200da360 0x7f132002f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:30.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.436+0000 7f1327e00640 1 -- 172.21.15.8:0/3748989300 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f132000bd90 msgr2=0x7f132002f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:30.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.436+0000 7f1327e00640 1 --2- 172.21.15.8:0/3748989300 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f132000bd90 0x7f132002f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:30.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.436+0000 7f1327e00640 1 -- 172.21.15.8:0/3748989300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f132000a9c0 msgr2=0x7f132003f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:30.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.436+0000 7f1327e00640 1 --2- 172.21.15.8:0/3748989300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f132000a9c0 0x7f132003f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:30.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.436+0000 7f1327e00640 1 -- 172.21.15.8:0/3748989300 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132000a0b0 con 0x7f13200da360 2024-03-23T23:56:30.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.436+0000 7f1327e00640 1 --2- 172.21.15.8:0/3748989300 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f13200da360 0x7f132002f620 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1328050260 tx=0x7f1328095f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:30.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.440+0000 7f131b400640 1 -- 172.21.15.8:0/3748989300 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1328129850 con 0x7f13200da360 2024-03-23T23:56:30.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.440+0000 7f131b400640 1 -- 172.21.15.8:0/3748989300 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13281299f0 con 0x7f13200da360 2024-03-23T23:56:30.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.440+0000 7f131b400640 1 -- 172.21.15.8:0/3748989300 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1328129da0 con 0x7f13200da360 2024-03-23T23:56:30.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.440+0000 7f132e000640 1 -- 172.21.15.8:0/3748989300 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1320042040 con 0x7f13200da360 2024-03-23T23:56:30.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.440+0000 7f132e000640 1 -- 172.21.15.8:0/3748989300 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1320180450 con 0x7f13200da360 2024-03-23T23:56:30.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.440+0000 7f1318c00640 1 --2- 172.21.15.8:0/3748989300 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12fc002a80 0x7f12fc004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:30.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.444+0000 7f1318c00640 1 -- 172.21.15.8:0/3748989300 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc007ed0 con 0x7f12fc002a80 2024-03-23T23:56:30.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.444+0000 7f1327400640 1 --2- 172.21.15.8:0/3748989300 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12fc002a80 0x7f12fc004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:30.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.444+0000 7f1327400640 1 -- 172.21.15.8:0/3748989300 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f12fc0080d0 con 0x7f12fc002a80 2024-03-23T23:56:30.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.444+0000 7f1327400640 1 --2- 172.21.15.8:0/3748989300 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12fc002a80 0x7f12fc004f40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f131c005890 tx=0x7f131c00fc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:30.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.444+0000 7f131b400640 1 -- 172.21.15.8:0/3748989300 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f1328133480 con 0x7f13200da360 2024-03-23T23:56:30.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.448+0000 7f131b400640 1 --2- 172.21.15.8:0/3748989300 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f13080676e0 0x7f1308069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:30.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.448+0000 7f131b400640 1 -- 172.21.15.8:0/3748989300 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f132819afd0 con 0x7f13200da360 2024-03-23T23:56:30.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.448+0000 7f131b400640 1 -- 172.21.15.8:0/3748989300 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c0058c0 con 0x7f12fc002a80 2024-03-23T23:56:30.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.448+0000 7f131b400640 1 -- 172.21.15.8:0/3748989300 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f131c018070 con 0x7f12fc002a80 2024-03-23T23:56:30.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.448+0000 7f131b400640 1 -- 172.21.15.8:0/3748989300 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12fc002a80 msgr2=0x7f12fc004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:30.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.448+0000 7f131b400640 1 --2- 172.21.15.8:0/3748989300 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12fc002a80 0x7f12fc004f40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f131c005890 tx=0x7f131c00fc00 comp rx=0 tx=0).stop 2024-03-23T23:56:30.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.448+0000 7f131b400640 1 -- 172.21.15.8:0/3748989300 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12fc002a80 msgr2=0x7f12fc004f40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:56:30.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.448+0000 7f131b400640 1 --2- 172.21.15.8:0/3748989300 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12fc002a80 0x7f12fc004f40 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f131c005890 tx=0x7f131c00fc00 comp rx=0 tx=0).stop 2024-03-23T23:56:30.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.456+0000 7f1326a00640 1 --2- 172.21.15.8:0/3748989300 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f13080676e0 0x7f1308069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:30.464 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.460+0000 7f1318c00640 1 --2- 172.21.15.8:0/3748989300 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12fc006ec0 0x7f12fc007350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:30.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.460+0000 7f1318c00640 1 -- 172.21.15.8:0/3748989300 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc00a4b0 con 0x7f12fc006ec0 2024-03-23T23:56:30.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.464+0000 7f1327400640 1 --2- 172.21.15.8:0/3748989300 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12fc006ec0 0x7f12fc007350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:30.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.472+0000 7f1327400640 1 -- 172.21.15.8:0/3748989300 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f12fc007890 con 0x7f12fc006ec0 2024-03-23T23:56:30.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.472+0000 7f1326a00640 1 --2- 172.21.15.8:0/3748989300 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f13080676e0 0x7f1308069ba0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f13200d5960 tx=0x7f1314006bb0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:30.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.472+0000 7f1327400640 1 --2- 172.21.15.8:0/3748989300 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12fc006ec0 0x7f12fc007350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f131c005890 tx=0x7f131c000ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:30.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.476+0000 7f131b400640 1 -- 172.21.15.8:0/3748989300 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c0070d0 con 0x7f12fc006ec0 2024-03-23T23:56:30.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.480+0000 7f131b400640 1 -- 172.21.15.8:0/3748989300 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5041 (secure 0 0 0) 0x7f131c0070d0 con 0x7f12fc006ec0 2024-03-23T23:56:30.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.480+0000 7f131b400640 1 -- 172.21.15.8:0/3748989300 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12fc006ec0 msgr2=0x7f12fc007350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:30.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.480+0000 7f131b400640 1 --2- 172.21.15.8:0/3748989300 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12fc006ec0 0x7f12fc007350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f131c005890 tx=0x7f131c000ee0 comp rx=0 tx=0).stop 2024-03-23T23:56:30.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.480+0000 7f131b400640 1 -- 172.21.15.8:0/3748989300 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12fc006ec0 msgr2=0x7f12fc007350 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:56:30.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.480+0000 7f131b400640 1 --2- 172.21.15.8:0/3748989300 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12fc006ec0 0x7f12fc007350 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f131c005890 tx=0x7f131c000ee0 comp rx=0 tx=0).stop 2024-03-23T23:56:30.484 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:56:30.484 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:56:30.484 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:56:30.484 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:56:30.484 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 110, 2024-03-23T23:56:30.484 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:56:30.485 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:56:30.485 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:56:30.485 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:56:30.485 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:30.485 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 16, 2024-03-23T23:56:30.485 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:56:30.485 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:56:30.485 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:56:30.485 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:56:30.485 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:56:30.485 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:56:30.485 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:56:30.485 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:56:30.486 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:56:30.486 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:56:30.486 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:56:30.486 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:56:30.486 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:56:30.486 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:56:30.486 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:30.486 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:56:30.486 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:56:30.487 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:56:30.487 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:56:30.487 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:56:30.487 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:56:30.487 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:56:30.487 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:56:30.487 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:56:30.487 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:56:30.488 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:56:30.488 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:56:30.488 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:56:30.488 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:30.488 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:30.488 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:56:30.488 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:56:30.488 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:56:30.488 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:56:30.489 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:56:30.489 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:56:30.489 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:56:30.489 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:56:30.489 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:56:30.490 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:56:30.490 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:56:30.490 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:56:30.490 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:56:30.490 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:56:30.490 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:56:30.490 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:56:30.491 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:56:30.491 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:56:30.491 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:56:30.491 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:56:30.491 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:56:30.491 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:56:30.491 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:56:30.492 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:56:30.492 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:56:30.492 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:56:30.492 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:56:30.492 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:56:30.492 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:30.492 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:56:30.492 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:30.492 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:56:30.492 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:30.493 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:56:30.493 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:56:30.493 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:56:30.493 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:56:30.493 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:30.493 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:56:30.493 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:56:30.493 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:30.494 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:30.494 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:30.494 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:56:30.494 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:56:30.494 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:30.494 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:30.494 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:30.494 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:30.494 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:56:30.494 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:56:30.495 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:56:30.495 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:56:30.495 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:56:30.495 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:30.495 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:30.495 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:56:30.495 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:56:30.495 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:56:30.495 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:56:30.495 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:30.496 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:56:30.496 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:56:30.496 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:30.496 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:30.496 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:30.496 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:56:30.496 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:56:30.496 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:30.496 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:30.496 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:30.496 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:30.496 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:56:30.497 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:56:30.497 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:56:30.497 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:56:30.497 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:56:30.497 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:30.497 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:30.498 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:56:30.498 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:56:30.498 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:56:30.498 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:56:30.498 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:30.498 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:56:30.498 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:56:30.499 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:30.499 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:30.499 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:30.499 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:56:30.499 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:56:30.499 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:30.500 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:30.500 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:30.500 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:30.500 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:56:30.500 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:56:30.500 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:56:30.501 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:56:30.501 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:56:30.501 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:30.501 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:30.501 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:30.501 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:56:30.501 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:56:30.501 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:30.502 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:30.502 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:30.502 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:56:30.502 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:30.502 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:30.502 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:56:30.502 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:30.502 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:30.502 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:30.502 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:56:30.502 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:30.503 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:30.503 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:56:30.503 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:30.503 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:30.503 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:30.503 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5 2024-03-23T23:56:30.503 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:30.503 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:30.503 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:56:30.503 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:30.503 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:30.503 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:30.504 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:56:30.504 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:30.504 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:30.504 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:56:30.504 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:30.504 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:30.504 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:30.504 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:56:30.504 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:30.504 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:30.504 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:30.505 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:56:30.505 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:56:30.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.480+0000 7f1318c00640 1 -- 172.21.15.8:0/3748989300 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f13080676e0 msgr2=0x7f1308069ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:30.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.480+0000 7f1318c00640 1 --2- 172.21.15.8:0/3748989300 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f13080676e0 0x7f1308069ba0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f13200d5960 tx=0x7f1314006bb0 comp rx=0 tx=0).stop 2024-03-23T23:56:30.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.480+0000 7f1318c00640 1 -- 172.21.15.8:0/3748989300 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f13200da360 msgr2=0x7f132002f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:30.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.480+0000 7f1318c00640 1 --2- 172.21.15.8:0/3748989300 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f13200da360 0x7f132002f620 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1328050260 tx=0x7f1328095f70 comp rx=0 tx=0).stop 2024-03-23T23:56:30.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.488+0000 7f1327e00640 1 -- 172.21.15.8:0/3748989300 reap_dead start 2024-03-23T23:56:30.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.488+0000 7f1327e00640 1 -- 172.21.15.8:0/3748989300 reap_dead start 2024-03-23T23:56:30.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.488+0000 7f1318c00640 1 -- 172.21.15.8:0/3748989300 shutdown_connections 2024-03-23T23:56:30.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.488+0000 7f1318c00640 1 -- 172.21.15.8:0/3748989300 >> 172.21.15.8:0/3748989300 conn(0x7f1320048290 msgr2=0x7f1320049ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:30.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.488+0000 7f1318c00640 1 -- 172.21.15.8:0/3748989300 shutdown_connections 2024-03-23T23:56:30.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.488+0000 7f1318c00640 1 -- 172.21.15.8:0/3748989300 wait complete. 2024-03-23T23:56:30.524 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:56:30.525 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-03-23T23:56:30.525 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-03-23T23:56:30.525 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-03-23T23:56:30.525 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-03-23T23:56:30.526 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-23T23:56:30.526 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:56:30.610 INFO:tasks.ceph.mon.c:Stopped 2024-03-23T23:56:30.610 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-03-23T23:56:30.610 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:56:30.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.848+0000 7feb5f000640 1 Processor -- start 2024-03-23T23:56:30.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.848+0000 7feb5f000640 1 -- start start 2024-03-23T23:56:30.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.852+0000 7feb5f000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7feb5814fcd0 0x7feb580c4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:30.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.852+0000 7feb5f000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7feb580a9470 0x7feb58152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:30.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.852+0000 7feb5f000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feb5806fce0 0x7feb58155b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:30.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.852+0000 7feb5f000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb581527b0 con 0x7feb580a9470 2024-03-23T23:56:30.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.852+0000 7feb5f000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb58071fd0 con 0x7feb5814fcd0 2024-03-23T23:56:30.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.852+0000 7feb5f000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb580722b0 con 0x7feb5806fce0 2024-03-23T23:56:30.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.852+0000 7feb57e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7feb5814fcd0 0x7feb580c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:30.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.852+0000 7feb57e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7feb5814fcd0 0x7feb580c4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:57722/0 (socket says 172.21.15.8:57722) 2024-03-23T23:56:30.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.852+0000 7feb57e00640 1 -- 172.21.15.8:0/3214004815 learned_addr learned my addr 172.21.15.8:0/3214004815 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:56:30.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.852+0000 7feb5d000640 1 -- 172.21.15.8:0/3214004815 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feb5806fce0 msgr2=0x7feb58155b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:56:30.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.852+0000 7feb5d000640 1 --2- 172.21.15.8:0/3214004815 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feb5806fce0 0x7feb58155b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:56:30.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.852+0000 7feb57400640 1 --2- 172.21.15.8:0/3214004815 >> v2:172.21.15.8:3300/0 conn(0x7feb580a9470 0x7feb58152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:30.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.852+0000 7feb57e00640 1 -- 172.21.15.8:0/3214004815 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feb5806fce0 msgr2=0x7feb58155b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:56:30.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.852+0000 7feb57e00640 1 --2- 172.21.15.8:0/3214004815 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feb5806fce0 0x7feb58155b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:30.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.852+0000 7feb57e00640 1 -- 172.21.15.8:0/3214004815 >> v2:172.21.15.8:3300/0 conn(0x7feb580a9470 msgr2=0x7feb58152cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:30.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.852+0000 7feb57e00640 1 --2- 172.21.15.8:0/3214004815 >> v2:172.21.15.8:3300/0 conn(0x7feb580a9470 0x7feb58152cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:30.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.852+0000 7feb57e00640 1 -- 172.21.15.8:0/3214004815 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb58072590 con 0x7feb5814fcd0 2024-03-23T23:56:30.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.856+0000 7feb57e00640 1 --2- 172.21.15.8:0/3214004815 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feb5814fcd0 0x7feb580c4190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7feb580724c0 tx=0x7feb4401c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94ca9daeb14485c1 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:30.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.856+0000 7feb56a00640 1 -- 172.21.15.8:0/3214004815 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb440b0070 con 0x7feb5814fcd0 2024-03-23T23:56:30.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.856+0000 7feb56a00640 1 -- 172.21.15.8:0/3214004815 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb440ab600 con 0x7feb5814fcd0 2024-03-23T23:56:30.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.860+0000 7feb5f000640 1 -- 172.21.15.8:0/3214004815 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feb5814fcd0 msgr2=0x7feb580c4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:30.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.860+0000 7feb5f000640 1 --2- 172.21.15.8:0/3214004815 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feb5814fcd0 0x7feb580c4190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7feb580724c0 tx=0x7feb4401c440 comp rx=0 tx=0).stop 2024-03-23T23:56:30.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.860+0000 7feb5f000640 1 -- 172.21.15.8:0/3214004815 shutdown_connections 2024-03-23T23:56:30.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.860+0000 7feb5f000640 1 --2- 172.21.15.8:0/3214004815 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feb5806fce0 0x7feb58155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:30.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.860+0000 7feb5f000640 1 --2- 172.21.15.8:0/3214004815 >> v2:172.21.15.8:3300/0 conn(0x7feb580a9470 0x7feb58152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:30.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.860+0000 7feb5f000640 1 --2- 172.21.15.8:0/3214004815 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feb5814fcd0 0x7feb580c4190 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:30.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.860+0000 7feb5f000640 1 -- 172.21.15.8:0/3214004815 >> 172.21.15.8:0/3214004815 conn(0x7feb580c8180 msgr2=0x7feb580c8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:30.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.860+0000 7feb5f000640 1 -- 172.21.15.8:0/3214004815 shutdown_connections 2024-03-23T23:56:30.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.860+0000 7feb5f000640 1 -- 172.21.15.8:0/3214004815 wait complete. 2024-03-23T23:56:30.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.860+0000 7feb5f000640 1 Processor -- start 2024-03-23T23:56:30.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.860+0000 7feb5f000640 1 -- start start 2024-03-23T23:56:30.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.864+0000 7feb5f000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feb5806fce0 0x7feb58151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:30.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.864+0000 7feb5f000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb580a9470 0x7feb580c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:30.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.864+0000 7feb5f000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feb5814fcd0 0x7feb580abd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:30.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.864+0000 7feb5f000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb580aa990 con 0x7feb580a9470 2024-03-23T23:56:30.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.864+0000 7feb5f000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5815ef30 con 0x7feb5806fce0 2024-03-23T23:56:30.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.864+0000 7feb5f000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb580aab10 con 0x7feb5814fcd0 2024-03-23T23:56:30.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.864+0000 7feb5d000640 1 -- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feb5814fcd0 msgr2=0x7feb580abd10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:56:30.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.864+0000 7feb5d000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feb5814fcd0 0x7feb580abd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:56:30.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.864+0000 7feb57400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb580a9470 0x7feb580c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:30.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.864+0000 7feb57400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb580a9470 0x7feb580c7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57620/0 (socket says 172.21.15.8:57620) 2024-03-23T23:56:30.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.864+0000 7feb57400640 1 -- 172.21.15.8:0/1090164051 learned_addr learned my addr 172.21.15.8:0/1090164051 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:56:30.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.864+0000 7feb57400640 1 -- 172.21.15.8:0/1090164051 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feb5814fcd0 msgr2=0x7feb580abd10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:56:30.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.864+0000 7feb57400640 1 --2- 172.21.15.8:0/1090164051 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feb5814fcd0 0x7feb580abd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:30.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.864+0000 7feb57400640 1 -- 172.21.15.8:0/1090164051 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feb5806fce0 msgr2=0x7feb58151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:30.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.864+0000 7feb57400640 1 --2- 172.21.15.8:0/1090164051 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feb5806fce0 0x7feb58151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:30.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.864+0000 7feb57400640 1 -- 172.21.15.8:0/1090164051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb580c7160 con 0x7feb580a9470 2024-03-23T23:56:30.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.864+0000 7feb57400640 1 --2- 172.21.15.8:0/1090164051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb580a9470 0x7feb580c7670 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7feb4800d830 tx=0x7feb4800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:30.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.864+0000 7feb4fe00640 1 -- 172.21.15.8:0/1090164051 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb48018020 con 0x7feb580a9470 2024-03-23T23:56:30.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.864+0000 7feb4fe00640 1 -- 172.21.15.8:0/1090164051 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb480096a0 con 0x7feb580a9470 2024-03-23T23:56:30.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.864+0000 7feb4fe00640 1 -- 172.21.15.8:0/1090164051 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb48009a50 con 0x7feb580a9470 2024-03-23T23:56:30.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.864+0000 7feb5f000640 1 -- 172.21.15.8:0/1090164051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb580c6520 con 0x7feb580a9470 2024-03-23T23:56:30.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.868+0000 7feb5f000640 1 -- 172.21.15.8:0/1090164051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb580c6240 con 0x7feb580a9470 2024-03-23T23:56:30.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.868+0000 7feb5f000640 1 -- 172.21.15.8:0/1090164051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb5804f480 con 0x7feb580a9470 2024-03-23T23:56:30.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.872+0000 7feb4fe00640 1 -- 172.21.15.8:0/1090164051 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7feb4801b020 con 0x7feb580a9470 2024-03-23T23:56:30.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.872+0000 7feb4fe00640 1 --2- 172.21.15.8:0/1090164051 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7feb38067660 0x7feb38069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:30.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.872+0000 7feb4fe00640 1 -- 172.21.15.8:0/1090164051 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7feb48086950 con 0x7feb580a9470 2024-03-23T23:56:30.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.876+0000 7feb57e00640 1 --2- 172.21.15.8:0/1090164051 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7feb38067660 0x7feb38069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:30.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.880+0000 7feb4fe00640 1 -- 172.21.15.8:0/1090164051 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7feb48022020 con 0x7feb580a9470 2024-03-23T23:56:30.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:30.888+0000 7feb57e00640 1 --2- 172.21.15.8:0/1090164051 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7feb38067660 0x7feb38069b20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7feb440ad000 tx=0x7feb44004740 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:31.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:31.508+0000 7feb5f000640 1 -- 172.21.15.8:0/1090164051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7feb58073080 con 0x7feb580a9470 2024-03-23T23:56:31.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:31.508+0000 7feb4fe00640 1 -- 172.21.15.8:0/1090164051 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1562 (secure 0 0 0) 0x7feb48025350 con 0x7feb580a9470 2024-03-23T23:56:31.917 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":110,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:56:31.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:31.512+0000 7feb5f000640 1 -- 172.21.15.8:0/1090164051 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7feb38067660 msgr2=0x7feb38069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:31.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:31.512+0000 7feb5f000640 1 --2- 172.21.15.8:0/1090164051 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7feb38067660 0x7feb38069b20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7feb440ad000 tx=0x7feb44004740 comp rx=0 tx=0).stop 2024-03-23T23:56:31.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:31.512+0000 7feb5f000640 1 -- 172.21.15.8:0/1090164051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb580a9470 msgr2=0x7feb580c7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:31.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:31.512+0000 7feb5f000640 1 --2- 172.21.15.8:0/1090164051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb580a9470 0x7feb580c7670 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7feb4800d830 tx=0x7feb4800dcf0 comp rx=0 tx=0).stop 2024-03-23T23:56:31.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:31.516+0000 7feb5f000640 1 -- 172.21.15.8:0/1090164051 shutdown_connections 2024-03-23T23:56:31.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:31.516+0000 7feb5f000640 1 --2- 172.21.15.8:0/1090164051 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7feb38067660 0x7feb38069b20 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:31.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:31.516+0000 7feb5f000640 1 --2- 172.21.15.8:0/1090164051 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feb5814fcd0 0x7feb580abd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:31.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:31.516+0000 7feb5f000640 1 --2- 172.21.15.8:0/1090164051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb580a9470 0x7feb580c7670 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:31.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:31.516+0000 7feb5f000640 1 --2- 172.21.15.8:0/1090164051 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feb5806fce0 0x7feb58151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:31.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:31.516+0000 7feb5f000640 1 -- 172.21.15.8:0/1090164051 >> 172.21.15.8:0/1090164051 conn(0x7feb580c8180 msgr2=0x7feb580c3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:31.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:31.516+0000 7feb5f000640 1 -- 172.21.15.8:0/1090164051 shutdown_connections 2024-03-23T23:56:31.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:31.516+0000 7feb5f000640 1 -- 172.21.15.8:0/1090164051 wait complete. 2024-03-23T23:56:34.921 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:56:35.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.476+0000 7f222e200640 1 Processor -- start 2024-03-23T23:56:35.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.476+0000 7f222e200640 1 -- start start 2024-03-23T23:56:35.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.480+0000 7f222e200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2228152d00 0x7f22280cb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:35.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.480+0000 7f222e200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f222806d7b0 0x7f2228155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:35.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.480+0000 7f222e200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22281530e0 con 0x7f22280c8f60 2024-03-23T23:56:35.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.480+0000 7f222e200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22280c99c0 con 0x7f222806d7b0 2024-03-23T23:56:35.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.480+0000 7f222e200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22280c5a80 con 0x7f2228152d00 2024-03-23T23:56:35.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.480+0000 7f222d800640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f22280c8f60 0x7f22281560e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:43000/0 (socket says 172.21.15.8:43000) 2024-03-23T23:56:35.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.480+0000 7f222d800640 1 -- 172.21.15.8:0/169301853 learned_addr learned my addr 172.21.15.8:0/169301853 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:56:35.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.480+0000 7f222ce00640 1 --2- 172.21.15.8:0/169301853 >> v2:172.21.15.196:3300/0 conn(0x7f2228152d00 0x7f22280cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:35.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.480+0000 7f2227e00640 1 --2- 172.21.15.8:0/169301853 >> v2:172.21.15.8:3300/0 conn(0x7f222806d7b0 0x7f2228155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:35.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.484+0000 7f2227e00640 1 -- 172.21.15.8:0/169301853 >> v2:172.21.15.196:3300/0 conn(0x7f2228152d00 msgr2=0x7f22280cb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:35.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.484+0000 7f2227e00640 1 --2- 172.21.15.8:0/169301853 >> v2:172.21.15.196:3300/0 conn(0x7f2228152d00 0x7f22280cb360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:35.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.484+0000 7f2227e00640 1 -- 172.21.15.8:0/169301853 >> v1:172.21.15.8:6789/0 conn(0x7f22280c8f60 legacy=0x7f22281560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:35.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.484+0000 7f2227e00640 1 -- 172.21.15.8:0/169301853 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22280c5d60 con 0x7f222806d7b0 2024-03-23T23:56:35.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.496+0000 7f2227e00640 1 --2- 172.21.15.8:0/169301853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f222806d7b0 0x7f2228155ba0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f22281532b0 tx=0x7f221801c610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c1940b2cb690db0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:35.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.500+0000 7f2227400640 1 -- 172.21.15.8:0/169301853 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22180ab5f0 con 0x7f222806d7b0 2024-03-23T23:56:35.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.500+0000 7f2227400640 1 -- 172.21.15.8:0/169301853 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22180b0070 con 0x7f222806d7b0 2024-03-23T23:56:35.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.500+0000 7f2227400640 1 -- 172.21.15.8:0/169301853 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22180ab9b0 con 0x7f222806d7b0 2024-03-23T23:56:35.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.500+0000 7f222e200640 1 -- 172.21.15.8:0/169301853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f222806d7b0 msgr2=0x7f2228155ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:35.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.500+0000 7f222e200640 1 --2- 172.21.15.8:0/169301853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f222806d7b0 0x7f2228155ba0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f22281532b0 tx=0x7f221801c610 comp rx=0 tx=0).stop 2024-03-23T23:56:35.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.508+0000 7f222e200640 1 -- 172.21.15.8:0/169301853 shutdown_connections 2024-03-23T23:56:35.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.508+0000 7f222e200640 1 --2- 172.21.15.8:0/169301853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f222806d7b0 0x7f2228155ba0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:35.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.508+0000 7f222e200640 1 --2- 172.21.15.8:0/169301853 >> v2:172.21.15.196:3300/0 conn(0x7f2228152d00 0x7f22280cb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:35.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.508+0000 7f222e200640 1 -- 172.21.15.8:0/169301853 >> 172.21.15.8:0/169301853 conn(0x7f22280745c0 msgr2=0x7f22280749d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:35.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.508+0000 7f222e200640 1 -- 172.21.15.8:0/169301853 shutdown_connections 2024-03-23T23:56:35.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.508+0000 7f222e200640 1 -- 172.21.15.8:0/169301853 wait complete. 2024-03-23T23:56:35.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.512+0000 7f222e200640 1 Processor -- start 2024-03-23T23:56:35.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.516+0000 7f222e200640 1 -- start start 2024-03-23T23:56:35.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.520+0000 7f222e200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f222806d7b0 0x7f22280ad170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:35.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.520+0000 7f222ce00640 1 -- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f222806d7b0 msgr2=0x7f22280ad170 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:56:35.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.520+0000 7f222ce00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f222806d7b0 0x7f22280ad170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:56:35.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.520+0000 7f222e200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22280c8f60 0x7f2228157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:35.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.520+0000 7f222e200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2228152d00 0x7f22281fb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:35.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.520+0000 7f222e200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22281629c0 con 0x7f2228152d00 2024-03-23T23:56:35.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.520+0000 7f222e200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2228162840 con 0x7f22280c8f60 2024-03-23T23:56:35.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.520+0000 7f222e200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2228162b40 con 0x7f222806d7b0 2024-03-23T23:56:35.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.524+0000 7f222d800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2228152d00 0x7f22281fb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:35.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.524+0000 7f2227e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22280c8f60 0x7f2228157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:35.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.524+0000 7f222d800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2228152d00 0x7f22281fb710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47544/0 (socket says 172.21.15.8:47544) 2024-03-23T23:56:35.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.524+0000 7f222d800640 1 -- 172.21.15.8:0/3448443519 learned_addr learned my addr 172.21.15.8:0/3448443519 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:56:35.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.524+0000 7f222d800640 1 -- 172.21.15.8:0/3448443519 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f222806d7b0 msgr2=0x7f22280ad170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:56:35.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.524+0000 7f222d800640 1 --2- 172.21.15.8:0/3448443519 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f222806d7b0 0x7f22280ad170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:35.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.524+0000 7f222d800640 1 -- 172.21.15.8:0/3448443519 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22280c8f60 msgr2=0x7f2228157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:35.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.524+0000 7f222d800640 1 --2- 172.21.15.8:0/3448443519 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22280c8f60 0x7f2228157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:35.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.524+0000 7f222d800640 1 -- 172.21.15.8:0/3448443519 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2228158b20 con 0x7f2228152d00 2024-03-23T23:56:35.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.524+0000 7f2227e00640 1 --2- 172.21.15.8:0/3448443519 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22280c8f60 0x7f2228157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:56:35.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.524+0000 7f222d800640 1 --2- 172.21.15.8:0/3448443519 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2228152d00 0x7f22281fb710 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f221400b3e0 tx=0x7f221400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:35.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.528+0000 7f2224c00640 1 -- 172.21.15.8:0/3448443519 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2214015020 con 0x7f2228152d00 2024-03-23T23:56:35.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.528+0000 7f2224c00640 1 -- 172.21.15.8:0/3448443519 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2214011830 con 0x7f2228152d00 2024-03-23T23:56:35.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.528+0000 7f2224c00640 1 -- 172.21.15.8:0/3448443519 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2214011c00 con 0x7f2228152d00 2024-03-23T23:56:35.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.528+0000 7f222e200640 1 -- 172.21.15.8:0/3448443519 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f222815f7c0 con 0x7f2228152d00 2024-03-23T23:56:35.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.528+0000 7f222e200640 1 -- 172.21.15.8:0/3448443519 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22281ff230 con 0x7f2228152d00 2024-03-23T23:56:35.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.528+0000 7f221e000640 1 -- 172.21.15.8:0/3448443519 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f222806b9b0 con 0x7f2228152d00 2024-03-23T23:56:35.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.532+0000 7f2224c00640 1 -- 172.21.15.8:0/3448443519 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f2214018020 con 0x7f2228152d00 2024-03-23T23:56:35.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.532+0000 7f2224c00640 1 --2- 172.21.15.8:0/3448443519 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2208067660 0x7f2208069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:35.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.540+0000 7f222ce00640 1 --2- 172.21.15.8:0/3448443519 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2208067660 0x7f2208069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:35.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.544+0000 7f222ce00640 1 --2- 172.21.15.8:0/3448443519 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2208067660 0x7f2208069b20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2220009a70 tx=0x7f222000b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:35.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.548+0000 7f2224c00640 1 -- 172.21.15.8:0/3448443519 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f2214052eb0 con 0x7f2228152d00 2024-03-23T23:56:35.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:35.556+0000 7f2224c00640 1 -- 172.21.15.8:0/3448443519 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f221408d020 con 0x7f2228152d00 2024-03-23T23:56:36.329 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":110,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:56:36.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:36.320+0000 7f221e000640 1 -- 172.21.15.8:0/3448443519 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f2228075800 con 0x7f2228152d00 2024-03-23T23:56:36.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:36.320+0000 7f2224c00640 1 -- 172.21.15.8:0/3448443519 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1562 (secure 0 0 0) 0x7f2228158b20 con 0x7f2228152d00 2024-03-23T23:56:36.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:36.328+0000 7f221e000640 1 -- 172.21.15.8:0/3448443519 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2208067660 msgr2=0x7f2208069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:36.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:36.328+0000 7f221e000640 1 --2- 172.21.15.8:0/3448443519 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2208067660 0x7f2208069b20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2220009a70 tx=0x7f222000b040 comp rx=0 tx=0).stop 2024-03-23T23:56:36.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:36.328+0000 7f221e000640 1 -- 172.21.15.8:0/3448443519 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2228152d00 msgr2=0x7f22281fb710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:36.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:36.328+0000 7f221e000640 1 --2- 172.21.15.8:0/3448443519 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2228152d00 0x7f22281fb710 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f221400b3e0 tx=0x7f221400b8a0 comp rx=0 tx=0).stop 2024-03-23T23:56:36.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:36.328+0000 7f221e000640 1 -- 172.21.15.8:0/3448443519 shutdown_connections 2024-03-23T23:56:36.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:36.328+0000 7f221e000640 1 --2- 172.21.15.8:0/3448443519 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2228152d00 0x7f22281fb710 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:36.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:36.328+0000 7f221e000640 1 --2- 172.21.15.8:0/3448443519 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22280c8f60 0x7f2228157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:36.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:36.328+0000 7f221e000640 1 --2- 172.21.15.8:0/3448443519 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2208067660 0x7f2208069b20 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:36.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:36.328+0000 7f221e000640 1 --2- 172.21.15.8:0/3448443519 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f222806d7b0 0x7f22280ad170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:36.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:36.328+0000 7f221e000640 1 -- 172.21.15.8:0/3448443519 >> 172.21.15.8:0/3448443519 conn(0x7f22280745c0 msgr2=0x7f2228153eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:36.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:36.328+0000 7f221e000640 1 -- 172.21.15.8:0/3448443519 shutdown_connections 2024-03-23T23:56:36.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:36.328+0000 7f221e000640 1 -- 172.21.15.8:0/3448443519 wait complete. 2024-03-23T23:56:39.429 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:56:39.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.732+0000 7fd1b0e00640 1 Processor -- start 2024-03-23T23:56:39.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.736+0000 7fd1b0e00640 1 -- start start 2024-03-23T23:56:39.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.736+0000 7fd1b0e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd1a40dbd10 0x7fd1a40e2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:39.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.736+0000 7fd1b0e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a40de8a0 con 0x7fd1a400b0f0 2024-03-23T23:56:39.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.736+0000 7fd1b0e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a4047650 con 0x7fd1a40ded50 2024-03-23T23:56:39.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.736+0000 7fd1b0e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1a40e2c80 con 0x7fd1a40dbd10 2024-03-23T23:56:39.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.740+0000 7fd1a9400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd1a400b0f0 0x7fd1a4006f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:43016/0 (socket says 172.21.15.8:43016) 2024-03-23T23:56:39.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.740+0000 7fd1a9400640 1 -- 172.21.15.8:0/2550364093 learned_addr learned my addr 172.21.15.8:0/2550364093 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:56:39.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.744+0000 7fd1a9e00640 1 --2- 172.21.15.8:0/2550364093 >> v2:172.21.15.8:3300/0 conn(0x7fd1a40dbd10 0x7fd1a40e2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:39.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.748+0000 7fd1a9e00640 1 -- 172.21.15.8:0/2550364093 >> v1:172.21.15.196:6789/0 conn(0x7fd1a40ded50 legacy=0x7fd1a40df200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:39.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.748+0000 7fd1a9e00640 1 -- 172.21.15.8:0/2550364093 >> v1:172.21.15.8:6789/0 conn(0x7fd1a400b0f0 legacy=0x7fd1a4006f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:39.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.748+0000 7fd1a9e00640 1 -- 172.21.15.8:0/2550364093 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a4047930 con 0x7fd1a40dbd10 2024-03-23T23:56:39.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.760+0000 7fd1a9e00640 1 --2- 172.21.15.8:0/2550364093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1a40dbd10 0x7fd1a40e2740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd19c0097c0 tx=0x7fd19c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aac56e2864a02f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:39.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.760+0000 7fd1a8a00640 1 -- 172.21.15.8:0/2550364093 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c0b2070 con 0x7fd1a40dbd10 2024-03-23T23:56:39.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.760+0000 7fd1a8a00640 1 -- 172.21.15.8:0/2550364093 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd19c0ad680 con 0x7fd1a40dbd10 2024-03-23T23:56:39.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.760+0000 7fd1a8a00640 1 -- 172.21.15.8:0/2550364093 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c0b2070 con 0x7fd1a40dbd10 2024-03-23T23:56:39.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.764+0000 7fd1b0e00640 1 -- 172.21.15.8:0/2550364093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1a40dbd10 msgr2=0x7fd1a40e2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:39.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.764+0000 7fd1b0e00640 1 --2- 172.21.15.8:0/2550364093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1a40dbd10 0x7fd1a40e2740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd19c0097c0 tx=0x7fd19c01c400 comp rx=0 tx=0).stop 2024-03-23T23:56:39.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.764+0000 7fd1b0e00640 1 -- 172.21.15.8:0/2550364093 shutdown_connections 2024-03-23T23:56:39.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.764+0000 7fd1b0e00640 1 --2- 172.21.15.8:0/2550364093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1a40dbd10 0x7fd1a40e2740 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:39.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.764+0000 7fd1b0e00640 1 -- 172.21.15.8:0/2550364093 >> 172.21.15.8:0/2550364093 conn(0x7fd1a4048290 msgr2=0x7fd1a40486a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:39.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.768+0000 7fd1b0e00640 1 -- 172.21.15.8:0/2550364093 shutdown_connections 2024-03-23T23:56:39.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.768+0000 7fd1b0e00640 1 -- 172.21.15.8:0/2550364093 wait complete. 2024-03-23T23:56:39.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.772+0000 7fd1b0e00640 1 Processor -- start 2024-03-23T23:56:39.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.772+0000 7fd1b0e00640 1 -- start start 2024-03-23T23:56:39.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.776+0000 7fd1b0e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd1a400b0f0 0x7fd1a4043ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:39.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.776+0000 7fd1b0e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1a40dbd10 0x7fd1a40419e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:39.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.776+0000 7fd1a9e00640 1 -- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd1a400b0f0 msgr2=0x7fd1a4043ed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:56:39.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.776+0000 7fd1a9e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd1a400b0f0 0x7fd1a4043ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:56:39.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.776+0000 7fd1b0e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd1a40ded50 0x7fd1a402f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:39.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.780+0000 7fd1b0e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a40dc0f0 con 0x7fd1a40dbd10 2024-03-23T23:56:39.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.780+0000 7fd1b0e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a40dfc80 con 0x7fd1a40ded50 2024-03-23T23:56:39.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.780+0000 7fd1b0e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a4007640 con 0x7fd1a400b0f0 2024-03-23T23:56:39.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.780+0000 7fd1aa800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd1a40ded50 0x7fd1a402f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:39.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.780+0000 7fd1aa800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd1a40ded50 0x7fd1a402f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:49450/0 (socket says 172.21.15.8:49450) 2024-03-23T23:56:39.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.780+0000 7fd1aa800640 1 -- 172.21.15.8:0/496700213 learned_addr learned my addr 172.21.15.8:0/496700213 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:56:39.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.780+0000 7fd1a9400640 1 --2- 172.21.15.8:0/496700213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1a40dbd10 0x7fd1a40419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:39.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.780+0000 7fd1aa800640 1 -- 172.21.15.8:0/496700213 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd1a400b0f0 msgr2=0x7fd1a4043ed0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:56:39.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.780+0000 7fd1aa800640 1 --2- 172.21.15.8:0/496700213 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd1a400b0f0 0x7fd1a4043ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:39.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.780+0000 7fd1aa800640 1 -- 172.21.15.8:0/496700213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1a40dbd10 msgr2=0x7fd1a40419e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:39.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.780+0000 7fd1aa800640 1 --2- 172.21.15.8:0/496700213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1a40dbd10 0x7fd1a40419e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:39.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.780+0000 7fd1aa800640 1 -- 172.21.15.8:0/496700213 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a4044410 con 0x7fd1a40ded50 2024-03-23T23:56:39.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.792+0000 7fd1aa800640 1 --2- 172.21.15.8:0/496700213 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd1a40ded50 0x7fd1a402f300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac06a690 tx=0x7fd1ac073410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:39.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.792+0000 7fd1a2000640 1 -- 172.21.15.8:0/496700213 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac06f410 con 0x7fd1a40ded50 2024-03-23T23:56:39.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.792+0000 7fd1a2000640 1 -- 172.21.15.8:0/496700213 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ac08f030 con 0x7fd1a40ded50 2024-03-23T23:56:39.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.792+0000 7fd1a2000640 1 -- 172.21.15.8:0/496700213 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac06f890 con 0x7fd1a40ded50 2024-03-23T23:56:39.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.796+0000 7fd1b0e00640 1 -- 172.21.15.8:0/496700213 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a402e6f0 con 0x7fd1a40ded50 2024-03-23T23:56:39.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.796+0000 7fd1b0e00640 1 -- 172.21.15.8:0/496700213 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a40db4f0 con 0x7fd1a40ded50 2024-03-23T23:56:39.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.804+0000 7fd197400640 1 -- 172.21.15.8:0/496700213 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a4005300 con 0x7fd1a40ded50 2024-03-23T23:56:39.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.808+0000 7fd1a2000640 1 -- 172.21.15.8:0/496700213 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd1ac06fa30 con 0x7fd1a40ded50 2024-03-23T23:56:39.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.812+0000 7fd1a2000640 1 --2- 172.21.15.8:0/496700213 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd18c067690 0x7fd18c069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:39.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.812+0000 7fd1a2000640 1 -- 172.21.15.8:0/496700213 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fd1ac1010f0 con 0x7fd1a40ded50 2024-03-23T23:56:39.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.812+0000 7fd1a9e00640 1 --2- 172.21.15.8:0/496700213 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd18c067690 0x7fd18c069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:39.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.836+0000 7fd1a2000640 1 -- 172.21.15.8:0/496700213 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fd1ac0d19a0 con 0x7fd1a40ded50 2024-03-23T23:56:39.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:39.840+0000 7fd1a9e00640 1 --2- 172.21.15.8:0/496700213 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd18c067690 0x7fd18c069b50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd19c0af000 tx=0x7fd19c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:40.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:40.484+0000 7fd197400640 1 -- 172.21.15.8:0/496700213 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd1a40dd650 con 0x7fd1a40ded50 2024-03-23T23:56:45.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.356+0000 7fd1a2000640 1 -- 172.21.15.8:0/496700213 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1555 (secure 0 0 0) 0x7fd1ac0d12a0 con 0x7fd1a40ded50 2024-03-23T23:56:45.360 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":114,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:56:45.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.364+0000 7fd197400640 1 -- 172.21.15.8:0/496700213 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd18c067690 msgr2=0x7fd18c069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:45.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.364+0000 7fd197400640 1 --2- 172.21.15.8:0/496700213 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd18c067690 0x7fd18c069b50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd19c0af000 tx=0x7fd19c008040 comp rx=0 tx=0).stop 2024-03-23T23:56:45.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.364+0000 7fd197400640 1 -- 172.21.15.8:0/496700213 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd1a40ded50 msgr2=0x7fd1a402f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:45.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.364+0000 7fd197400640 1 --2- 172.21.15.8:0/496700213 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd1a40ded50 0x7fd1a402f300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac06a690 tx=0x7fd1ac073410 comp rx=0 tx=0).stop 2024-03-23T23:56:45.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.364+0000 7fd197400640 1 -- 172.21.15.8:0/496700213 shutdown_connections 2024-03-23T23:56:45.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.364+0000 7fd197400640 1 --2- 172.21.15.8:0/496700213 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd1a40ded50 0x7fd1a402f300 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:45.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.364+0000 7fd197400640 1 --2- 172.21.15.8:0/496700213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1a40dbd10 0x7fd1a40419e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:45.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.364+0000 7fd197400640 1 --2- 172.21.15.8:0/496700213 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd18c067690 0x7fd18c069b50 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:45.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.364+0000 7fd197400640 1 --2- 172.21.15.8:0/496700213 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd1a400b0f0 0x7fd1a4043ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:45.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.364+0000 7fd197400640 1 -- 172.21.15.8:0/496700213 >> 172.21.15.8:0/496700213 conn(0x7fd1a4048290 msgr2=0x7fd1a40e1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:45.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.368+0000 7fd197400640 1 -- 172.21.15.8:0/496700213 shutdown_connections 2024-03-23T23:56:45.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.368+0000 7fd197400640 1 -- 172.21.15.8:0/496700213 wait complete. 2024-03-23T23:56:45.465 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-03-23T23:56:45.465 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-03-23T23:56:45.465 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:56:45.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.960+0000 7f2f16600640 1 Processor -- start 2024-03-23T23:56:45.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.960+0000 7f2f16600640 1 -- start start 2024-03-23T23:56:45.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.968+0000 7f2f16600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2f100c2820 0x7f2f100c2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:45.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.968+0000 7f2f16600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2f10151ba0 0x7f2f10151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:45.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.968+0000 7f2f16600640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f1006ccc0 con 0x7f2f1014ede0 2024-03-23T23:56:45.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.968+0000 7f2f16600640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f100c3760 con 0x7f2f100c2820 2024-03-23T23:56:45.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.968+0000 7f2f16600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f10151710 con 0x7f2f10151ba0 2024-03-23T23:56:45.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.968+0000 7f2f0fe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2f100c2820 0x7f2f100c2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:45.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.968+0000 7f2f0fe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2f100c2820 0x7f2f100c2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48824/0 (socket says 172.21.15.8:48824) 2024-03-23T23:56:45.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.968+0000 7f2f0fe00640 1 -- 172.21.15.8:0/3478322669 learned_addr learned my addr 172.21.15.8:0/3478322669 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:56:45.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.968+0000 7f2f15c00640 1 --2- 172.21.15.8:0/3478322669 >> v2:172.21.15.196:3300/0 conn(0x7f2f10151ba0 0x7f2f10151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:45.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.968+0000 7f2f0fe00640 1 -- 172.21.15.8:0/3478322669 >> v2:172.21.15.196:3300/0 conn(0x7f2f10151ba0 msgr2=0x7f2f10151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:45.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.968+0000 7f2f0fe00640 1 --2- 172.21.15.8:0/3478322669 >> v2:172.21.15.196:3300/0 conn(0x7f2f10151ba0 0x7f2f10151fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:45.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.968+0000 7f2f0fe00640 1 -- 172.21.15.8:0/3478322669 >> v1:172.21.15.8:6789/0 conn(0x7f2f1014ede0 legacy=0x7f2f10072b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:45.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.968+0000 7f2f0fe00640 1 -- 172.21.15.8:0/3478322669 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1006cfa0 con 0x7f2f100c2820 2024-03-23T23:56:45.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.984+0000 7f2f0fe00640 1 --2- 172.21.15.8:0/3478322669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f100c2820 0x7f2f100c2c70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2f100728d0 tx=0x7f2efc01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded86cf3aa53cf9b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:45.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.984+0000 7f2f0f400640 1 -- 172.21.15.8:0/3478322669 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc0b0070 con 0x7f2f100c2820 2024-03-23T23:56:45.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.984+0000 7f2f0f400640 1 -- 172.21.15.8:0/3478322669 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2efc0ab600 con 0x7f2f100c2820 2024-03-23T23:56:45.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.984+0000 7f2f0f400640 1 -- 172.21.15.8:0/3478322669 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc0ab9d0 con 0x7f2f100c2820 2024-03-23T23:56:45.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.988+0000 7f2f16600640 1 -- 172.21.15.8:0/3478322669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f100c2820 msgr2=0x7f2f100c2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:45.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.988+0000 7f2f16600640 1 --2- 172.21.15.8:0/3478322669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f100c2820 0x7f2f100c2c70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2f100728d0 tx=0x7f2efc01c4e0 comp rx=0 tx=0).stop 2024-03-23T23:56:45.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.988+0000 7f2f16600640 1 -- 172.21.15.8:0/3478322669 shutdown_connections 2024-03-23T23:56:45.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.988+0000 7f2f16600640 1 --2- 172.21.15.8:0/3478322669 >> v2:172.21.15.196:3300/0 conn(0x7f2f10151ba0 0x7f2f10151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:45.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.988+0000 7f2f16600640 1 --2- 172.21.15.8:0/3478322669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f100c2820 0x7f2f100c2c70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:45.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.988+0000 7f2f16600640 1 -- 172.21.15.8:0/3478322669 >> 172.21.15.8:0/3478322669 conn(0x7f2f100c3910 msgr2=0x7f2f100c3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:45.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.988+0000 7f2f16600640 1 -- 172.21.15.8:0/3478322669 shutdown_connections 2024-03-23T23:56:45.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.988+0000 7f2f16600640 1 -- 172.21.15.8:0/3478322669 wait complete. 2024-03-23T23:56:45.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.992+0000 7f2f16600640 1 Processor -- start 2024-03-23T23:56:45.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.992+0000 7f2f16600640 1 -- start start 2024-03-23T23:56:45.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.992+0000 7f2f16600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f100c2820 0x7f2f101388a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:45.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.992+0000 7f2f16600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f1014ede0 0x7f2f100aac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:45.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.992+0000 7f2f16600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f10151ba0 0x7f2f100ab140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:45.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.996+0000 7f2f0fe00640 1 -- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f1014ede0 msgr2=0x7f2f100aac00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:56:45.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.996+0000 7f2f0fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f1014ede0 0x7f2f100aac00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:56:45.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.996+0000 7f2f15200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f100c2820 0x7f2f101388a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:45.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.996+0000 7f2f15200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f100c2820 0x7f2f101388a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:59506/0 (socket says 172.21.15.8:59506) 2024-03-23T23:56:45.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.996+0000 7f2f15c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f10151ba0 0x7f2f100ab140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:45.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.996+0000 7f2f15c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f10151ba0 0x7f2f100ab140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48836/0 (socket says 172.21.15.8:48836) 2024-03-23T23:56:45.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.996+0000 7f2f15200640 1 -- 172.21.15.8:0/1543601927 learned_addr learned my addr 172.21.15.8:0/1543601927 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:56:45.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.996+0000 7f2f16600640 1 -- 172.21.15.8:0/1543601927 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1006c940 con 0x7f2f10151ba0 2024-03-23T23:56:45.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.996+0000 7f2f16600640 1 -- 172.21.15.8:0/1543601927 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f101524f0 con 0x7f2f100c2820 2024-03-23T23:56:45.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.996+0000 7f2f16600640 1 -- 172.21.15.8:0/1543601927 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1015e790 con 0x7f2f1014ede0 2024-03-23T23:56:46.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.996+0000 7f2f15c00640 1 -- 172.21.15.8:0/1543601927 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f1014ede0 msgr2=0x7f2f100aac00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:56:46.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.996+0000 7f2f15c00640 1 --2- 172.21.15.8:0/1543601927 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f1014ede0 0x7f2f100aac00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:46.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.996+0000 7f2f15c00640 1 -- 172.21.15.8:0/1543601927 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f100c2820 msgr2=0x7f2f101388a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:46.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.996+0000 7f2f15c00640 1 --2- 172.21.15.8:0/1543601927 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f100c2820 0x7f2f101388a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:46.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.996+0000 7f2f15c00640 1 -- 172.21.15.8:0/1543601927 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f100aa750 con 0x7f2f10151ba0 2024-03-23T23:56:46.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:45.996+0000 7f2f15200640 1 --2- 172.21.15.8:0/1543601927 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f100c2820 0x7f2f101388a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:46.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.000+0000 7f2f15c00640 1 --2- 172.21.15.8:0/1543601927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f10151ba0 0x7f2f100ab140 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2f000097d0 tx=0x7f2f00009c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:46.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.000+0000 7f2f0cc00640 1 -- 172.21.15.8:0/1543601927 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0001b070 con 0x7f2f10151ba0 2024-03-23T23:56:46.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.000+0000 7f2f0cc00640 1 -- 172.21.15.8:0/1543601927 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0000b9c0 con 0x7f2f10151ba0 2024-03-23T23:56:46.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.000+0000 7f2f0cc00640 1 -- 172.21.15.8:0/1543601927 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f00016630 con 0x7f2f10151ba0 2024-03-23T23:56:46.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.000+0000 7f2f16600640 1 -- 172.21.15.8:0/1543601927 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f10141500 con 0x7f2f10151ba0 2024-03-23T23:56:46.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.000+0000 7f2f16600640 1 -- 172.21.15.8:0/1543601927 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f10141ac0 con 0x7f2f10151ba0 2024-03-23T23:56:46.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.000+0000 7f2f16600640 1 --2- 172.21.15.8:0/1543601927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f100ab680 0x7f2f1014d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:46.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.000+0000 7f2f16600640 1 -- 172.21.15.8:0/1543601927 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f10068790 con 0x7f2f100ab680 2024-03-23T23:56:46.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.004+0000 7f2f15200640 1 --2- 172.21.15.8:0/1543601927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f100ab680 0x7f2f1014d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:46.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.004+0000 7f2f15200640 1 -- 172.21.15.8:0/1543601927 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2f1014cbb0 con 0x7f2f100ab680 2024-03-23T23:56:46.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.004+0000 7f2f15200640 1 --2- 172.21.15.8:0/1543601927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f100ab680 0x7f2f1014d8f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800da60 tx=0x7f2f0800df20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:46.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.008+0000 7f2f0cc00640 1 -- 172.21.15.8:0/1543601927 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f08003d90 con 0x7f2f100ab680 2024-03-23T23:56:46.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.008+0000 7f2f0cc00640 1 -- 172.21.15.8:0/1543601927 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f2f0001e070 con 0x7f2f10151ba0 2024-03-23T23:56:46.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.008+0000 7f2f0cc00640 1 --2- 172.21.15.8:0/1543601927 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2ef0067560 0x7f2ef0069a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:46.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.008+0000 7f2f0cc00640 1 -- 172.21.15.8:0/1543601927 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f2f08017070 con 0x7f2f100ab680 2024-03-23T23:56:46.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.008+0000 7f2f0cc00640 1 -- 172.21.15.8:0/1543601927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f100ab680 msgr2=0x7f2f1014d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:46.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.008+0000 7f2f0cc00640 1 --2- 172.21.15.8:0/1543601927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f100ab680 0x7f2f1014d8f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800da60 tx=0x7f2f0800df20 comp rx=0 tx=0).stop 2024-03-23T23:56:46.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.012+0000 7f2f0cc00640 1 -- 172.21.15.8:0/1543601927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f100ab680 msgr2=0x7f2f1014d8f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:56:46.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.012+0000 7f2f0cc00640 1 --2- 172.21.15.8:0/1543601927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f100ab680 0x7f2f1014d8f0 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800da60 tx=0x7f2f0800df20 comp rx=0 tx=0).stop 2024-03-23T23:56:46.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.012+0000 7f2f0fe00640 1 --2- 172.21.15.8:0/1543601927 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2ef0067560 0x7f2ef0069a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:46.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.012+0000 7f2f0cc00640 1 -- 172.21.15.8:0/1543601927 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f2f00053fa0 con 0x7f2f10151ba0 2024-03-23T23:56:46.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.016+0000 7f2f0fe00640 1 --2- 172.21.15.8:0/1543601927 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2ef0067560 0x7f2ef0069a20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0ad000 tx=0x7f2efc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:46.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.032+0000 7f2f16600640 1 --2- 172.21.15.8:0/1543601927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f10138de0 0x7f2f1014de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:46.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.032+0000 7f2f16600640 1 -- 172.21.15.8:0/1543601927 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f100aa920 con 0x7f2f10138de0 2024-03-23T23:56:46.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.032+0000 7f2f15200640 1 --2- 172.21.15.8:0/1543601927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f10138de0 0x7f2f1014de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:46.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.048+0000 7f2f15200640 1 -- 172.21.15.8:0/1543601927 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2f1004f410 con 0x7f2f10138de0 2024-03-23T23:56:46.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.048+0000 7f2f15200640 1 --2- 172.21.15.8:0/1543601927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f10138de0 0x7f2f1014de30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800da60 tx=0x7f2f080013b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:46.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.048+0000 7f2f0cc00640 1 -- 172.21.15.8:0/1543601927 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0800b9c0 con 0x7f2f10138de0 2024-03-23T23:56:46.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.052+0000 7f2f0cc00640 1 -- 172.21.15.8:0/1543601927 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4861 (secure 0 0 0) 0x7f2f0801de50 con 0x7f2f10138de0 2024-03-23T23:56:46.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.052+0000 7f2f0cc00640 1 -- 172.21.15.8:0/1543601927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f10138de0 msgr2=0x7f2f1014de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:46.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.052+0000 7f2f0cc00640 1 --2- 172.21.15.8:0/1543601927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f10138de0 0x7f2f1014de30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800da60 tx=0x7f2f080013b0 comp rx=0 tx=0).stop 2024-03-23T23:56:46.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.052+0000 7f2f0cc00640 1 -- 172.21.15.8:0/1543601927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f10138de0 msgr2=0x7f2f1014de30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:56:46.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.052+0000 7f2f0cc00640 1 --2- 172.21.15.8:0/1543601927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f10138de0 0x7f2f1014de30 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800da60 tx=0x7f2f080013b0 comp rx=0 tx=0).stop 2024-03-23T23:56:46.054 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:56:46.054 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:56:46.054 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:56:46.054 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:56:46.055 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 114, 2024-03-23T23:56:46.055 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:56:46.055 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:56:46.055 INFO:teuthology.orchestra.run.smithi008.stdout: 1 2024-03-23T23:56:46.055 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:46.055 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 0, 2024-03-23T23:56:46.055 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:56:46.055 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:56:46.055 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:56:46.055 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:56:46.055 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:56:46.055 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:56:46.055 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:56:46.055 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:56:46.055 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:56:46.056 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:56:46.056 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:56:46.056 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:56:46.056 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:56:46.056 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:56:46.056 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:46.056 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:56:46.056 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:56:46.056 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:56:46.056 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:56:46.056 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:56:46.056 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:56:46.056 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:56:46.056 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:56:46.057 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:56:46.057 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:56:46.057 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:56:46.057 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:56:46.057 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:56:46.057 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:46.057 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:46.057 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:56:46.057 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:56:46.057 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:56:46.057 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:56:46.057 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:56:46.057 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:56:46.058 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:56:46.058 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:56:46.058 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:56:46.058 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:56:46.058 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:56:46.058 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:56:46.058 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:56:46.058 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:56:46.058 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:56:46.058 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:56:46.058 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:56:46.058 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:56:46.058 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:56:46.058 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:56:46.059 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:56:46.059 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:56:46.059 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:56:46.059 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:56:46.059 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:56:46.059 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:56:46.059 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:56:46.059 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:56:46.059 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:46.059 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:56:46.059 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:46.059 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:56:46.059 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:46.060 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:56:46.060 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:56:46.060 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:56:46.060 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:56:46.060 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:46.060 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:56:46.060 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:56:46.060 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:46.060 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:46.060 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:46.060 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:56:46.060 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:56:46.060 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:46.060 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:46.061 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:46.061 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:46.061 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:56:46.061 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:56:46.061 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:56:46.061 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:56:46.061 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:56:46.061 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:46.061 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:46.061 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:56:46.061 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:56:46.061 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:56:46.061 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:56:46.061 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:46.062 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:56:46.062 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:56:46.062 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:46.062 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:46.062 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:46.062 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:56:46.062 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:56:46.062 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:46.062 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:46.062 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:46.062 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:46.062 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:56:46.062 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:56:46.063 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:56:46.063 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:56:46.063 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:56:46.063 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:46.063 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:46.063 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:56:46.063 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:56:46.063 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:56:46.063 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:56:46.063 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:46.063 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:56:46.063 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:56:46.063 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:46.063 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:46.064 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:46.064 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:56:46.064 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:56:46.064 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:46.064 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:46.064 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:46.064 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:46.064 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:56:46.064 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:56:46.064 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:56:46.064 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:56:46.064 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:56:46.064 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:46.065 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:46.065 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:46.065 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:56:46.065 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:56:46.065 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:46.065 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:46.065 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:46.065 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:56:46.065 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:46.065 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:46.065 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:56:46.065 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:46.065 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:46.065 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:46.066 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5 2024-03-23T23:56:46.066 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:46.066 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:46.066 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:56:46.066 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:46.066 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:46.066 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:46.066 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:56:46.066 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:46.066 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:46.066 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:56:46.067 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:46.067 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:46.067 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:46.067 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:56:46.067 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:46.067 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:46.067 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:46.067 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:56:46.067 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:56:46.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.060+0000 7f2f16600640 1 -- 172.21.15.8:0/1543601927 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2ef0067560 msgr2=0x7f2ef0069a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:46.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.060+0000 7f2f16600640 1 --2- 172.21.15.8:0/1543601927 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2ef0067560 0x7f2ef0069a20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0ad000 tx=0x7f2efc008040 comp rx=0 tx=0).stop 2024-03-23T23:56:46.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.060+0000 7f2f16600640 1 -- 172.21.15.8:0/1543601927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f10151ba0 msgr2=0x7f2f100ab140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:46.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.060+0000 7f2f16600640 1 --2- 172.21.15.8:0/1543601927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f10151ba0 0x7f2f100ab140 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2f000097d0 tx=0x7f2f00009c90 comp rx=0 tx=0).stop 2024-03-23T23:56:46.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.064+0000 7f2f15c00640 1 -- 172.21.15.8:0/1543601927 reap_dead start 2024-03-23T23:56:46.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.064+0000 7f2f15c00640 1 -- 172.21.15.8:0/1543601927 reap_dead start 2024-03-23T23:56:46.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.064+0000 7f2f16600640 1 -- 172.21.15.8:0/1543601927 shutdown_connections 2024-03-23T23:56:46.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.064+0000 7f2f16600640 1 -- 172.21.15.8:0/1543601927 >> 172.21.15.8:0/1543601927 conn(0x7f2f100c3910 msgr2=0x7f2f100c3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:46.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.064+0000 7f2f16600640 1 -- 172.21.15.8:0/1543601927 shutdown_connections 2024-03-23T23:56:46.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.068+0000 7f2f16600640 1 -- 172.21.15.8:0/1543601927 wait complete. 2024-03-23T23:56:46.122 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T23:56:46.123 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-03-23T23:56:46.123 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:56:46.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.452+0000 7f8d27200640 1 Processor -- start 2024-03-23T23:56:46.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.452+0000 7f8d27200640 1 -- start start 2024-03-23T23:56:46.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.456+0000 7f8d27200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8d2015d2e0 0x7f8d2006cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:46.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.456+0000 7f8d27200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8d2006e680 0x7f8d2015d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:46.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.456+0000 7f8d27200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d200ace80 con 0x7f8d20070e00 2024-03-23T23:56:46.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.456+0000 7f8d27200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d200acc30 con 0x7f8d2006e680 2024-03-23T23:56:46.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.456+0000 7f8d27200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d20072f30 con 0x7f8d2015d2e0 2024-03-23T23:56:46.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.456+0000 7f8d26800640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f8d20070e00 0x7f8d200c2ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:33496/0 (socket says 172.21.15.8:33496) 2024-03-23T23:56:46.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.456+0000 7f8d26800640 1 -- 172.21.15.8:0/1820234139 learned_addr learned my addr 172.21.15.8:0/1820234139 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:56:46.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.456+0000 7f8d25e00640 1 --2- 172.21.15.8:0/1820234139 >> v2:172.21.15.196:3300/0 conn(0x7f8d2015d2e0 0x7f8d2006cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:46.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.456+0000 7f8d25400640 1 --2- 172.21.15.8:0/1820234139 >> v2:172.21.15.8:3300/0 conn(0x7f8d2006e680 0x7f8d2015d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:46.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.456+0000 7f8d24a00640 1 -- 172.21.15.8:0/1820234139 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2846256695 0 0) 0x7f8d200ace80 con 0x7f8d20070e00 2024-03-23T23:56:46.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.456+0000 7f8d24a00640 1 -- 172.21.15.8:0/1820234139 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d08003530 con 0x7f8d20070e00 2024-03-23T23:56:46.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.460+0000 7f8d25e00640 1 -- 172.21.15.8:0/1820234139 >> v2:172.21.15.8:3300/0 conn(0x7f8d2006e680 msgr2=0x7f8d2015d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:46.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.460+0000 7f8d25e00640 1 --2- 172.21.15.8:0/1820234139 >> v2:172.21.15.8:3300/0 conn(0x7f8d2006e680 0x7f8d2015d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:46.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.460+0000 7f8d25e00640 1 -- 172.21.15.8:0/1820234139 >> v1:172.21.15.8:6789/0 conn(0x7f8d20070e00 legacy=0x7f8d200c2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:46.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.460+0000 7f8d25e00640 1 -- 172.21.15.8:0/1820234139 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d200ad160 con 0x7f8d2015d2e0 2024-03-23T23:56:46.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.480+0000 7f8d25e00640 1 --2- 172.21.15.8:0/1820234139 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d2015d2e0 0x7f8d2006cdf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8d20070a70 tx=0x7f8d1001c4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47eb59d7b9028f29 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:46.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.480+0000 7f8d24a00640 1 -- 172.21.15.8:0/1820234139 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d100b0070 con 0x7f8d2015d2e0 2024-03-23T23:56:46.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.480+0000 7f8d24a00640 1 -- 172.21.15.8:0/1820234139 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d100ab600 con 0x7f8d2015d2e0 2024-03-23T23:56:46.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.480+0000 7f8d24a00640 1 -- 172.21.15.8:0/1820234139 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d100b0070 con 0x7f8d2015d2e0 2024-03-23T23:56:46.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.484+0000 7f8d27200640 1 -- 172.21.15.8:0/1820234139 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d2015d2e0 msgr2=0x7f8d2006cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:46.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.484+0000 7f8d27200640 1 --2- 172.21.15.8:0/1820234139 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d2015d2e0 0x7f8d2006cdf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8d20070a70 tx=0x7f8d1001c4c0 comp rx=0 tx=0).stop 2024-03-23T23:56:46.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.484+0000 7f8d27200640 1 -- 172.21.15.8:0/1820234139 shutdown_connections 2024-03-23T23:56:46.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.484+0000 7f8d27200640 1 --2- 172.21.15.8:0/1820234139 >> v2:172.21.15.8:3300/0 conn(0x7f8d2006e680 0x7f8d2015d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:46.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.484+0000 7f8d27200640 1 --2- 172.21.15.8:0/1820234139 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d2015d2e0 0x7f8d2006cdf0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:46.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.484+0000 7f8d27200640 1 -- 172.21.15.8:0/1820234139 >> 172.21.15.8:0/1820234139 conn(0x7f8d2006b170 msgr2=0x7f8d2006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:46.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.484+0000 7f8d27200640 1 -- 172.21.15.8:0/1820234139 shutdown_connections 2024-03-23T23:56:46.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.484+0000 7f8d27200640 1 -- 172.21.15.8:0/1820234139 wait complete. 2024-03-23T23:56:46.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.488+0000 7f8d27200640 1 Processor -- start 2024-03-23T23:56:46.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.496+0000 7f8d27200640 1 -- start start 2024-03-23T23:56:46.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.496+0000 7f8d27200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8d2006e680 0x7f8d201537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:46.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.496+0000 7f8d27200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d20070e00 0x7f8d20156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:46.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.496+0000 7f8d27200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d2015d2e0 0x7f8d201550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:46.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.496+0000 7f8d27200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2015dd80 con 0x7f8d2015d2e0 2024-03-23T23:56:46.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.496+0000 7f8d27200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2015dc00 con 0x7f8d20070e00 2024-03-23T23:56:46.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.496+0000 7f8d27200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d201504e0 con 0x7f8d2006e680 2024-03-23T23:56:46.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.496+0000 7f8d25e00640 1 -- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8d2006e680 msgr2=0x7f8d201537b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3301/0 2024-03-23T23:56:46.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.496+0000 7f8d25e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8d2006e680 0x7f8d201537b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:56:46.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.500+0000 7f8d25400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d20070e00 0x7f8d20156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:46.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.500+0000 7f8d25400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d20070e00 0x7f8d20156d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:59522/0 (socket says 172.21.15.8:59522) 2024-03-23T23:56:46.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.500+0000 7f8d25400640 1 -- 172.21.15.8:0/3871221383 learned_addr learned my addr 172.21.15.8:0/3871221383 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:56:46.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.500+0000 7f8d25400640 1 -- 172.21.15.8:0/3871221383 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8d2006e680 msgr2=0x7f8d201537b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:56:46.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.500+0000 7f8d25400640 1 --2- 172.21.15.8:0/3871221383 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8d2006e680 0x7f8d201537b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:46.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.500+0000 7f8d25400640 1 -- 172.21.15.8:0/3871221383 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d2015d2e0 msgr2=0x7f8d201550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:46.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.500+0000 7f8d25400640 1 --2- 172.21.15.8:0/3871221383 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d2015d2e0 0x7f8d201550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:46.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.500+0000 7f8d25400640 1 -- 172.21.15.8:0/3871221383 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d20154310 con 0x7f8d20070e00 2024-03-23T23:56:46.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.504+0000 7f8d25400640 1 --2- 172.21.15.8:0/3871221383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d20070e00 0x7f8d20156d90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c007ef0 tx=0x7f8d1c00e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:46.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.508+0000 7f8d1a000640 1 -- 172.21.15.8:0/3871221383 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c014620 con 0x7f8d20070e00 2024-03-23T23:56:46.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.508+0000 7f8d1a000640 1 -- 172.21.15.8:0/3871221383 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d1c019070 con 0x7f8d20070e00 2024-03-23T23:56:46.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.508+0000 7f8d1a000640 1 -- 172.21.15.8:0/3871221383 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c014a00 con 0x7f8d20070e00 2024-03-23T23:56:46.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.508+0000 7f8d27200640 1 -- 172.21.15.8:0/3871221383 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d201545f0 con 0x7f8d20070e00 2024-03-23T23:56:46.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.508+0000 7f8d27200640 1 -- 172.21.15.8:0/3871221383 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d20153cf0 con 0x7f8d20070e00 2024-03-23T23:56:46.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.512+0000 7f8d0f400640 1 --2- 172.21.15.8:0/3871221383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cfc002a80 0x7f8cfc004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:46.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.512+0000 7f8d0f400640 1 -- 172.21.15.8:0/3871221383 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc007ed0 con 0x7f8cfc002a80 2024-03-23T23:56:46.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.512+0000 7f8d25e00640 1 --2- 172.21.15.8:0/3871221383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cfc002a80 0x7f8cfc004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:46.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.516+0000 7f8d1a000640 1 -- 172.21.15.8:0/3871221383 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f8d1c014ba0 con 0x7f8d20070e00 2024-03-23T23:56:46.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.520+0000 7f8d1a000640 1 --2- 172.21.15.8:0/3871221383 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8d04067660 0x7f8d04069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:46.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.520+0000 7f8d1a000640 1 -- 172.21.15.8:0/3871221383 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f8d1c086530 con 0x7f8d20070e00 2024-03-23T23:56:46.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.520+0000 7f8d26800640 1 --2- 172.21.15.8:0/3871221383 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8d04067660 0x7f8d04069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:46.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.524+0000 7f8d26800640 1 --2- 172.21.15.8:0/3871221383 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8d04067660 0x7f8d04069b20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8d14001560 tx=0x7f8d14007900 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:46.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.528+0000 7f8d25e00640 1 -- 172.21.15.8:0/3871221383 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8cfc0080d0 con 0x7f8cfc002a80 2024-03-23T23:56:46.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.528+0000 7f8d25e00640 1 --2- 172.21.15.8:0/3871221383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cfc002a80 0x7f8cfc004f40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8d200ac9d0 tx=0x7f8d1001ad00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:46.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.544+0000 7f8d1a000640 1 -- 172.21.15.8:0/3871221383 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d100b0070 con 0x7f8cfc002a80 2024-03-23T23:56:46.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.544+0000 7f8d1a000640 1 -- 172.21.15.8:0/3871221383 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f8d100b7450 con 0x7f8cfc002a80 2024-03-23T23:56:46.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.544+0000 7f8d1a000640 1 -- 172.21.15.8:0/3871221383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cfc002a80 msgr2=0x7f8cfc004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:46.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.544+0000 7f8d1a000640 1 --2- 172.21.15.8:0/3871221383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cfc002a80 0x7f8cfc004f40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8d200ac9d0 tx=0x7f8d1001ad00 comp rx=0 tx=0).stop 2024-03-23T23:56:46.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.544+0000 7f8d1a000640 1 -- 172.21.15.8:0/3871221383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cfc002a80 msgr2=0x7f8cfc004f40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:56:46.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.544+0000 7f8d1a000640 1 --2- 172.21.15.8:0/3871221383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cfc002a80 0x7f8cfc004f40 secure :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8d200ac9d0 tx=0x7f8d1001ad00 comp rx=0 tx=0).stop 2024-03-23T23:56:46.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.584+0000 7f8d0f400640 1 --2- 172.21.15.8:0/3871221383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cfc006f10 0x7f8cfc0073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:46.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.584+0000 7f8d0f400640 1 -- 172.21.15.8:0/3871221383 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc00a4b0 con 0x7f8cfc006f10 2024-03-23T23:56:46.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.588+0000 7f8d25e00640 1 --2- 172.21.15.8:0/3871221383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cfc006f10 0x7f8cfc0073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:46.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.592+0000 7f8d25e00640 1 -- 172.21.15.8:0/3871221383 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8cfc0078e0 con 0x7f8cfc006f10 2024-03-23T23:56:46.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.596+0000 7f8d25e00640 1 --2- 172.21.15.8:0/3871221383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cfc006f10 0x7f8cfc0073a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8d10000c10 tx=0x7f8d10019260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:46.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.600+0000 7f8d1a000640 1 -- 172.21.15.8:0/3871221383 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d100c3070 con 0x7f8cfc006f10 2024-03-23T23:56:46.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.612+0000 7f8d1a000640 1 -- 172.21.15.8:0/3871221383 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5172 (secure 0 0 0) 0x7f8d100bf750 con 0x7f8cfc006f10 2024-03-23T23:56:46.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.612+0000 7f8d1a000640 1 -- 172.21.15.8:0/3871221383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cfc006f10 msgr2=0x7f8cfc0073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:46.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.612+0000 7f8d1a000640 1 --2- 172.21.15.8:0/3871221383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cfc006f10 0x7f8cfc0073a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8d10000c10 tx=0x7f8d10019260 comp rx=0 tx=0).stop 2024-03-23T23:56:46.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.612+0000 7f8d1a000640 1 -- 172.21.15.8:0/3871221383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cfc006f10 msgr2=0x7f8cfc0073a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:56:46.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.612+0000 7f8d1a000640 1 --2- 172.21.15.8:0/3871221383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cfc006f10 0x7f8cfc0073a0 secure :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8d10000c10 tx=0x7f8d10019260 comp rx=0 tx=0).stop 2024-03-23T23:56:46.614 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:56:46.615 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:56:46.615 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:56:46.615 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:56:46.615 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 114, 2024-03-23T23:56:46.615 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:56:46.615 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:56:46.615 INFO:teuthology.orchestra.run.smithi008.stdout: 1 2024-03-23T23:56:46.615 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:46.615 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 1, 2024-03-23T23:56:46.615 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:56:46.615 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:56:46.615 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:56:46.616 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:56:46.616 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:56:46.616 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:56:46.616 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:56:46.616 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:56:46.616 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:56:46.616 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:56:46.616 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:56:46.616 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:56:46.616 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:56:46.616 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:56:46.617 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:46.617 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:56:46.617 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:56:46.617 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:56:46.617 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:56:46.617 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:56:46.617 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:56:46.617 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:56:46.617 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:56:46.618 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:56:46.618 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:56:46.618 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:56:46.618 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:56:46.618 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:56:46.618 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:46.618 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:46.618 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:56:46.618 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:56:46.618 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:56:46.618 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:56:46.619 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:56:46.619 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:56:46.619 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:56:46.619 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:56:46.619 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:56:46.619 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:56:46.619 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:56:46.619 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:56:46.619 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:56:46.619 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:56:46.619 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:56:46.620 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:56:46.620 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:56:46.620 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:56:46.620 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:56:46.620 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:56:46.620 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:56:46.620 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:56:46.620 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:56:46.620 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:56:46.620 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:56:46.620 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:56:46.621 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:56:46.621 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:56:46.621 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:46.621 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:56:46.621 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:46.621 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:56:46.621 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:46.621 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:56:46.621 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:56:46.621 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:56:46.621 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:56:46.621 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:46.621 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:56:46.622 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:56:46.622 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:46.622 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:46.622 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:46.622 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:56:46.622 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:56:46.622 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:46.622 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:46.622 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:46.622 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:46.622 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:56:46.623 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:56:46.623 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:56:46.623 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:56:46.623 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:56:46.623 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:46.623 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:46.623 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:56:46.623 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:56:46.623 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:56:46.623 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:56:46.623 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:46.623 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:56:46.624 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:56:46.624 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:46.624 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:46.624 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:46.624 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:56:46.624 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:56:46.624 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:46.624 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:46.624 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:46.624 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:46.624 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:56:46.624 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:56:46.625 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:56:46.625 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:56:46.625 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:56:46.625 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:46.625 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:46.625 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:56:46.625 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:56:46.625 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:56:46.625 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:56:46.625 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:46.625 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:56:46.625 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:56:46.626 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:46.626 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:46.626 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:46.626 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:56:46.626 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:56:46.626 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:56:46.626 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:46.626 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:46.626 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:46.626 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:56:46.626 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:56:46.626 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:56:46.627 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:56:46.627 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:56:46.627 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:46.627 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:46.627 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:46.627 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:56:46.627 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:56:46.627 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:46.627 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:46.627 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:46.627 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:56:46.627 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:46.628 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:46.628 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:56:46.628 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:46.628 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:46.628 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:46.628 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:56:46.628 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:46.628 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:46.628 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:56:46.628 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:46.628 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:46.628 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:46.629 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:56:46.629 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:46.629 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:46.629 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:56:46.629 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:46.629 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:56:46.629 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:46.629 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:56:46.629 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:46.629 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:46.629 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:46.630 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:46.630 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:56:46.630 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:46.630 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:56:46.630 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:56:46.630 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:56:46.630 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:56:46.630 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:56:46.630 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:56:46.630 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:56:46.630 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:56:46.630 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:56:46.631 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:56:46.631 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:56:46.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.612+0000 7f8d0f400640 1 -- 172.21.15.8:0/3871221383 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8d04067660 msgr2=0x7f8d04069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:46.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.612+0000 7f8d0f400640 1 --2- 172.21.15.8:0/3871221383 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8d04067660 0x7f8d04069b20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8d14001560 tx=0x7f8d14007900 comp rx=0 tx=0).stop 2024-03-23T23:56:46.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.612+0000 7f8d26800640 1 -- 172.21.15.8:0/3871221383 reap_dead start 2024-03-23T23:56:46.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.616+0000 7f8d0f400640 1 -- 172.21.15.8:0/3871221383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d20070e00 msgr2=0x7f8d20156d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:46.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.616+0000 7f8d0f400640 1 --2- 172.21.15.8:0/3871221383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d20070e00 0x7f8d20156d90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c007ef0 tx=0x7f8d1c00e4b0 comp rx=0 tx=0).stop 2024-03-23T23:56:46.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.620+0000 7f8d0f400640 1 -- 172.21.15.8:0/3871221383 shutdown_connections 2024-03-23T23:56:46.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.620+0000 7f8d0f400640 1 --2- 172.21.15.8:0/3871221383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d20070e00 0x7f8d20156d90 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c007ef0 tx=0x7f8d1c00e4b0 comp rx=0 tx=0).stop 2024-03-23T23:56:46.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.620+0000 7f8d0f400640 1 -- 172.21.15.8:0/3871221383 >> 172.21.15.8:0/3871221383 conn(0x7f8d2006b170 msgr2=0x7f8d200c5ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:46.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.624+0000 7f8d0f400640 1 -- 172.21.15.8:0/3871221383 shutdown_connections 2024-03-23T23:56:46.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:56:46.624+0000 7f8d0f400640 1 -- 172.21.15.8:0/3871221383 wait complete. 2024-03-23T23:56:46.757 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T23:56:46.757 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-03-23T23:56:47.211 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:56:47.215 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:57:06.758 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-03-23T23:57:06.758 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-03-23T23:57:06.759 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-23T23:57:06.759 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-23T23:57:06.769 INFO:tasks.ceph.mon.c:Started 2024-03-23T23:57:06.769 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T23:57:06.769 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:57:07.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.503+0000 7f79e8000640 1 Processor -- start 2024-03-23T23:57:07.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.503+0000 7f79e8000640 1 -- start start 2024-03-23T23:57:07.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.503+0000 7f79e8000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f79e00c3e60 0x7f79e006caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:07.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.507+0000 7f79e8000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79e00aa390 0x7f79e014b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:07.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.507+0000 7f79e8000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f79e014bae0 0x7f79e01519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:07.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.507+0000 7f79e8000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e0155e70 con 0x7f79e014bae0 2024-03-23T23:57:07.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.507+0000 7f79e8000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e01550b0 con 0x7f79e00c3e60 2024-03-23T23:57:07.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.507+0000 7f79e8000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e0155390 con 0x7f79e00aa390 2024-03-23T23:57:07.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.507+0000 7f79e5600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f79e00c3e60 0x7f79e006caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:07.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.507+0000 7f79e5600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f79e00c3e60 0x7f79e006caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:56002/0 (socket says 172.21.15.8:56002) 2024-03-23T23:57:07.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.507+0000 7f79e5600640 1 -- 172.21.15.8:0/1377503593 learned_addr learned my addr 172.21.15.8:0/1377503593 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:57:07.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.507+0000 7f79e6000640 1 --2- 172.21.15.8:0/1377503593 >> v2:172.21.15.8:3300/0 conn(0x7f79e014bae0 0x7f79e01519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:07.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.511+0000 7f79e4c00640 1 --2- 172.21.15.8:0/1377503593 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79e00aa390 0x7f79e014b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:07.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.511+0000 7f79e4c00640 1 -- 172.21.15.8:0/1377503593 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79e00aa390 msgr2=0x7f79e014b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T23:57:07.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.511+0000 7f79e4c00640 1 -- 172.21.15.8:0/1377503593 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79e00aa390 msgr2=0x7f79e014b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:57:07.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.511+0000 7f79e4c00640 1 --2- 172.21.15.8:0/1377503593 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79e00aa390 0x7f79e014b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:57:07.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.511+0000 7f79e4c00640 1 --2- 172.21.15.8:0/1377503593 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79e00aa390 0x7f79e014b5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:57:07.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.511+0000 7f79e6000640 1 -- 172.21.15.8:0/1377503593 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79e00aa390 msgr2=0x7f79e014b5a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:57:07.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.511+0000 7f79e6000640 1 --2- 172.21.15.8:0/1377503593 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79e00aa390 0x7f79e014b5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:07.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.511+0000 7f79e6000640 1 -- 172.21.15.8:0/1377503593 >> v2:172.21.15.196:3300/0 conn(0x7f79e00c3e60 msgr2=0x7f79e006caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:57:07.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.511+0000 7f79e6000640 1 --2- 172.21.15.8:0/1377503593 >> v2:172.21.15.196:3300/0 conn(0x7f79e00c3e60 0x7f79e006caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:07.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.511+0000 7f79e6000640 1 -- 172.21.15.8:0/1377503593 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e0155670 con 0x7f79e014bae0 2024-03-23T23:57:07.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.523+0000 7f79e6000640 1 --2- 172.21.15.8:0/1377503593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79e014bae0 0x7f79e01519b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f79e006c100 tx=0x7f79d8020ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22763c9d7732c4ad server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:07.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.523+0000 7f79dfe00640 1 -- 172.21.15.8:0/1377503593 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d80a9d30 con 0x7f79e014bae0 2024-03-23T23:57:07.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.523+0000 7f79dfe00640 1 -- 172.21.15.8:0/1377503593 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d800d0d0 con 0x7f79e014bae0 2024-03-23T23:57:07.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.523+0000 7f79dfe00640 1 -- 172.21.15.8:0/1377503593 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d800d4e0 con 0x7f79e014bae0 2024-03-23T23:57:07.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.531+0000 7f79e8000640 1 -- 172.21.15.8:0/1377503593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79e014bae0 msgr2=0x7f79e01519b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:07.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.531+0000 7f79e8000640 1 --2- 172.21.15.8:0/1377503593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79e014bae0 0x7f79e01519b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f79e006c100 tx=0x7f79d8020ce0 comp rx=0 tx=0).stop 2024-03-23T23:57:07.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.531+0000 7f79e8000640 1 -- 172.21.15.8:0/1377503593 shutdown_connections 2024-03-23T23:57:07.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.531+0000 7f79e8000640 1 --2- 172.21.15.8:0/1377503593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79e014bae0 0x7f79e01519b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:07.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.531+0000 7f79e8000640 1 --2- 172.21.15.8:0/1377503593 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79e00aa390 0x7f79e014b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:07.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.531+0000 7f79e8000640 1 --2- 172.21.15.8:0/1377503593 >> v2:172.21.15.196:3300/0 conn(0x7f79e00c3e60 0x7f79e006caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:07.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.531+0000 7f79e8000640 1 -- 172.21.15.8:0/1377503593 >> 172.21.15.8:0/1377503593 conn(0x7f79e006b170 msgr2=0x7f79e006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:57:07.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.535+0000 7f79e8000640 1 -- 172.21.15.8:0/1377503593 shutdown_connections 2024-03-23T23:57:07.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.535+0000 7f79e8000640 1 -- 172.21.15.8:0/1377503593 wait complete. 2024-03-23T23:57:07.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.543+0000 7f79e8000640 1 Processor -- start 2024-03-23T23:57:07.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.547+0000 7f79e8000640 1 -- start start 2024-03-23T23:57:07.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.547+0000 7f79e8000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79e00aa390 0x7f79e0154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:07.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.547+0000 7f79e8000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79e00c3e60 0x7f79e0071670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:07.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.547+0000 7f79e8000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79e014bae0 0x7f79e00c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:07.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.547+0000 7f79e8000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e0152480 con 0x7f79e00aa390 2024-03-23T23:57:07.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.547+0000 7f79e8000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e0152300 con 0x7f79e014bae0 2024-03-23T23:57:07.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.547+0000 7f79e8000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e00c4240 con 0x7f79e00c3e60 2024-03-23T23:57:07.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.547+0000 7f79e5600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79e00aa390 0x7f79e0154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:07.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.547+0000 7f79e5600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79e00aa390 0x7f79e0154200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42502/0 (socket says 172.21.15.8:42502) 2024-03-23T23:57:07.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.547+0000 7f79e5600640 1 -- 172.21.15.8:0/3559513626 learned_addr learned my addr 172.21.15.8:0/3559513626 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:57:07.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.547+0000 7f79e4c00640 1 --2- 172.21.15.8:0/3559513626 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79e00c3e60 0x7f79e0071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:07.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.547+0000 7f79e4c00640 1 -- 172.21.15.8:0/3559513626 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79e00c3e60 msgr2=0x7f79e0071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-03-23T23:57:07.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.547+0000 7f79e4c00640 1 -- 172.21.15.8:0/3559513626 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79e00c3e60 msgr2=0x7f79e0071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T23:57:07.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.547+0000 7f79e4c00640 1 --2- 172.21.15.8:0/3559513626 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79e00c3e60 0x7f79e0071670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:57:07.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.547+0000 7f79e4c00640 1 --2- 172.21.15.8:0/3559513626 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79e00c3e60 0x7f79e0071670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:57:07.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.551+0000 7f79e5600640 1 -- 172.21.15.8:0/3559513626 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79e00c3e60 msgr2=0x7f79e0071670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:57:07.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.551+0000 7f79e5600640 1 --2- 172.21.15.8:0/3559513626 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79e00c3e60 0x7f79e0071670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:07.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.551+0000 7f79e5600640 1 -- 172.21.15.8:0/3559513626 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79e014bae0 msgr2=0x7f79e00c73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:07.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.551+0000 7f79e5600640 1 --2- 172.21.15.8:0/3559513626 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79e014bae0 0x7f79e00c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:07.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.551+0000 7f79e5600640 1 -- 172.21.15.8:0/3559513626 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e0153760 con 0x7f79e00aa390 2024-03-23T23:57:07.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.551+0000 7f79e5600640 1 --2- 172.21.15.8:0/3559513626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79e00aa390 0x7f79e0154200 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00aa80 tx=0x7f79cc00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:07.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.555+0000 7f79dd600640 1 -- 172.21.15.8:0/3559513626 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc00da20 con 0x7f79e00aa390 2024-03-23T23:57:07.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.555+0000 7f79dd600640 1 -- 172.21.15.8:0/3559513626 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79cc019070 con 0x7f79e00aa390 2024-03-23T23:57:07.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.555+0000 7f79dd600640 1 -- 172.21.15.8:0/3559513626 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc00ddc0 con 0x7f79e00aa390 2024-03-23T23:57:07.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.555+0000 7f79e8000640 1 -- 172.21.15.8:0/3559513626 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e00c5710 con 0x7f79e00aa390 2024-03-23T23:57:07.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.555+0000 7f79e8000640 1 -- 172.21.15.8:0/3559513626 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e0153a00 con 0x7f79e00aa390 2024-03-23T23:57:07.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.567+0000 7f79e8000640 1 -- 172.21.15.8:0/3559513626 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79bc0052a0 con 0x7f79e00aa390 2024-03-23T23:57:07.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.587+0000 7f79dd600640 1 -- 172.21.15.8:0/3559513626 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f79cc01e460 con 0x7f79e00aa390 2024-03-23T23:57:07.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.587+0000 7f79dd600640 1 --2- 172.21.15.8:0/3559513626 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f79c0067760 0x7f79c0069c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:07.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.587+0000 7f79dd600640 1 -- 172.21.15.8:0/3559513626 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f79cc086990 con 0x7f79e00aa390 2024-03-23T23:57:07.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.587+0000 7f79e4c00640 1 --2- 172.21.15.8:0/3559513626 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f79c0067760 0x7f79c0069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:07.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.591+0000 7f79e4c00640 1 --2- 172.21.15.8:0/3559513626 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f79c0067760 0x7f79c0069c20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f79e00734d0 tx=0x7f79d400c3f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:07.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:07.603+0000 7f79dd600640 1 -- 172.21.15.8:0/3559513626 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f79cc057230 con 0x7f79e00aa390 2024-03-23T23:57:08.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:08.511+0000 7f79e8000640 1 -- 172.21.15.8:0/3559513626 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f79bc005590 con 0x7f79e00aa390 2024-03-23T23:57:08.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:08.511+0000 7f79dd600640 1 -- 172.21.15.8:0/3559513626 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1556 (secure 0 0 0) 0x7f79cc056b30 con 0x7f79e00aa390 2024-03-23T23:57:08.517 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":114,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:57:08.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:08.535+0000 7f79e8000640 1 -- 172.21.15.8:0/3559513626 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f79c0067760 msgr2=0x7f79c0069c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:08.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:08.535+0000 7f79e8000640 1 --2- 172.21.15.8:0/3559513626 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f79c0067760 0x7f79c0069c20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f79e00734d0 tx=0x7f79d400c3f0 comp rx=0 tx=0).stop 2024-03-23T23:57:08.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:08.535+0000 7f79e8000640 1 -- 172.21.15.8:0/3559513626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79e00aa390 msgr2=0x7f79e0154200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:08.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:08.535+0000 7f79e8000640 1 --2- 172.21.15.8:0/3559513626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79e00aa390 0x7f79e0154200 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00aa80 tx=0x7f79cc00af40 comp rx=0 tx=0).stop 2024-03-23T23:57:08.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:08.543+0000 7f79e8000640 1 -- 172.21.15.8:0/3559513626 shutdown_connections 2024-03-23T23:57:08.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:08.543+0000 7f79e8000640 1 --2- 172.21.15.8:0/3559513626 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79e014bae0 0x7f79e00c73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:08.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:08.543+0000 7f79e8000640 1 --2- 172.21.15.8:0/3559513626 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f79c0067760 0x7f79c0069c20 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:08.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:08.543+0000 7f79e8000640 1 --2- 172.21.15.8:0/3559513626 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79e00c3e60 0x7f79e0071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:08.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:08.543+0000 7f79e8000640 1 --2- 172.21.15.8:0/3559513626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79e00aa390 0x7f79e0154200 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:08.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:08.543+0000 7f79e8000640 1 -- 172.21.15.8:0/3559513626 >> 172.21.15.8:0/3559513626 conn(0x7f79e006b170 msgr2=0x7f79e0150d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:57:08.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:08.547+0000 7f79e8000640 1 -- 172.21.15.8:0/3559513626 shutdown_connections 2024-03-23T23:57:08.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:08.547+0000 7f79e8000640 1 -- 172.21.15.8:0/3559513626 wait complete. 2024-03-23T23:57:11.667 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:57:12.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.447+0000 7f8850200640 1 Processor -- start 2024-03-23T23:57:12.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.447+0000 7f8850200640 1 -- start start 2024-03-23T23:57:12.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.451+0000 7f8850200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f884814ee70 0x7f8848071d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:12.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.451+0000 7f8850200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88481517a0 con 0x7f88480ac410 2024-03-23T23:57:12.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.451+0000 7f8850200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88480aa970 con 0x7f8848072d80 2024-03-23T23:57:12.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.451+0000 7f8850200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88480c21e0 con 0x7f884814ee70 2024-03-23T23:57:12.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.455+0000 7f884ce00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f88480ac410 0x7f884814e760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:52362/0 (socket says 172.21.15.8:52362) 2024-03-23T23:57:12.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.455+0000 7f884ce00640 1 -- 172.21.15.8:0/3808062581 learned_addr learned my addr 172.21.15.8:0/3808062581 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:57:12.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.455+0000 7f884ec00640 1 --2- 172.21.15.8:0/3808062581 >> v2:172.21.15.196:3300/0 conn(0x7f884814ee70 0x7f8848071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:12.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.455+0000 7f884ec00640 1 -- 172.21.15.8:0/3808062581 >> v1:172.21.15.196:6789/0 conn(0x7f8848072d80 legacy=0x7f88480c1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:57:12.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.455+0000 7f884ec00640 1 -- 172.21.15.8:0/3808062581 >> v1:172.21.15.8:6789/0 conn(0x7f88480ac410 legacy=0x7f884814e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:12.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.455+0000 7f884ec00640 1 -- 172.21.15.8:0/3808062581 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88480aac50 con 0x7f884814ee70 2024-03-23T23:57:12.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.475+0000 7f884ec00640 1 --2- 172.21.15.8:0/3808062581 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f884814ee70 0x7f8848071d80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f883c0097c0 tx=0x7f883c01c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eda599b8ef8be061 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:12.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.487+0000 7f8847e00640 1 -- 172.21.15.8:0/3808062581 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c0b0070 con 0x7f884814ee70 2024-03-23T23:57:12.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.487+0000 7f8847e00640 1 -- 172.21.15.8:0/3808062581 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883c0ab600 con 0x7f884814ee70 2024-03-23T23:57:12.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.487+0000 7f8847e00640 1 -- 172.21.15.8:0/3808062581 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c0ab9d0 con 0x7f884814ee70 2024-03-23T23:57:12.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.491+0000 7f8850200640 1 -- 172.21.15.8:0/3808062581 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f884814ee70 msgr2=0x7f8848071d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:12.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.491+0000 7f8850200640 1 --2- 172.21.15.8:0/3808062581 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f884814ee70 0x7f8848071d80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f883c0097c0 tx=0x7f883c01c460 comp rx=0 tx=0).stop 2024-03-23T23:57:12.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.499+0000 7f8850200640 1 -- 172.21.15.8:0/3808062581 shutdown_connections 2024-03-23T23:57:12.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.499+0000 7f8850200640 1 --2- 172.21.15.8:0/3808062581 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f884814ee70 0x7f8848071d80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:12.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.499+0000 7f8850200640 1 -- 172.21.15.8:0/3808062581 >> 172.21.15.8:0/3808062581 conn(0x7f88480c3bd0 msgr2=0x7f88480c3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:57:12.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.499+0000 7f8850200640 1 -- 172.21.15.8:0/3808062581 shutdown_connections 2024-03-23T23:57:12.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.499+0000 7f8850200640 1 -- 172.21.15.8:0/3808062581 wait complete. 2024-03-23T23:57:12.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.511+0000 7f8850200640 1 Processor -- start 2024-03-23T23:57:12.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.511+0000 7f8850200640 1 -- start start 2024-03-23T23:57:12.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.515+0000 7f8850200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8848072d80 0x7f88481eff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:12.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.515+0000 7f8850200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88480ac410 0x7f88481f04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:12.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.515+0000 7f8850200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f884814ee70 0x7f884814c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:12.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.515+0000 7f8850200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88480732e0 con 0x7f884814ee70 2024-03-23T23:57:12.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.515+0000 7f8850200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8848073160 con 0x7f88480ac410 2024-03-23T23:57:12.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.515+0000 7f884ec00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f884814ee70 0x7f884814c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:12.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.515+0000 7f884ec00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f884814ee70 0x7f884814c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42518/0 (socket says 172.21.15.8:42518) 2024-03-23T23:57:12.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.515+0000 7f884ec00640 1 -- 172.21.15.8:0/3029051977 learned_addr learned my addr 172.21.15.8:0/3029051977 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:57:12.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.519+0000 7f8850200640 1 -- 172.21.15.8:0/3029051977 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884815f950 con 0x7f8848072d80 2024-03-23T23:57:12.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.519+0000 7f884d800640 1 --2- 172.21.15.8:0/3029051977 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8848072d80 0x7f88481eff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:12.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.519+0000 7f884ce00640 1 --2- 172.21.15.8:0/3029051977 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88480ac410 0x7f88481f04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:12.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.519+0000 7f884ec00640 1 -- 172.21.15.8:0/3029051977 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8848072d80 msgr2=0x7f88481eff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:12.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.519+0000 7f884ec00640 1 --2- 172.21.15.8:0/3029051977 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8848072d80 0x7f88481eff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:12.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.519+0000 7f884ec00640 1 -- 172.21.15.8:0/3029051977 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88480ac410 msgr2=0x7f88481f04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:12.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.519+0000 7f884ec00640 1 --2- 172.21.15.8:0/3029051977 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88480ac410 0x7f88481f04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:12.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.519+0000 7f884ec00640 1 -- 172.21.15.8:0/3029051977 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88480c1540 con 0x7f884814ee70 2024-03-23T23:57:12.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.519+0000 7f884ce00640 1 --2- 172.21.15.8:0/3029051977 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88480ac410 0x7f88481f04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:57:12.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.519+0000 7f884ec00640 1 --2- 172.21.15.8:0/3029051977 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f884814ee70 0x7f884814c870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f883c0ae040 tx=0x7f883c01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:12.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.519+0000 7f8845600640 1 -- 172.21.15.8:0/3029051977 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c0b0050 con 0x7f884814ee70 2024-03-23T23:57:12.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.519+0000 7f8845600640 1 -- 172.21.15.8:0/3029051977 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883c0bc070 con 0x7f884814ee70 2024-03-23T23:57:12.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.519+0000 7f8845600640 1 -- 172.21.15.8:0/3029051977 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c0b5850 con 0x7f884814ee70 2024-03-23T23:57:12.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.523+0000 7f8850200640 1 -- 172.21.15.8:0/3029051977 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88481f0a90 con 0x7f884814ee70 2024-03-23T23:57:12.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.523+0000 7f8850200640 1 -- 172.21.15.8:0/3029051977 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f884814b9d0 con 0x7f884814ee70 2024-03-23T23:57:12.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.527+0000 7f8850200640 1 -- 172.21.15.8:0/3029051977 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f884814bbd0 con 0x7f884814ee70 2024-03-23T23:57:12.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.539+0000 7f8845600640 1 -- 172.21.15.8:0/3029051977 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f883c0b59f0 con 0x7f884814ee70 2024-03-23T23:57:12.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.543+0000 7f8845600640 1 --2- 172.21.15.8:0/3029051977 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8828067660 0x7f8828069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:12.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.543+0000 7f8845600640 1 -- 172.21.15.8:0/3029051977 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f883c120c90 con 0x7f884814ee70 2024-03-23T23:57:12.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.543+0000 7f884d800640 1 --2- 172.21.15.8:0/3029051977 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8828067660 0x7f8828069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:12.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.551+0000 7f884d800640 1 --2- 172.21.15.8:0/3029051977 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8828067660 0x7f8828069b20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f88481504e0 tx=0x7f8834009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:12.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:12.555+0000 7f8845600640 1 -- 172.21.15.8:0/3029051977 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f884814bbd0 con 0x7f884814ee70 2024-03-23T23:57:13.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:13.907+0000 7f8850200640 1 -- 172.21.15.8:0/3029051977 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f8848068270 con 0x7f884814ee70 2024-03-23T23:57:13.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:13.915+0000 7f8845600640 1 -- 172.21.15.8:0/3029051977 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1561 (secure 0 0 0) 0x7f883c016050 con 0x7f884814ee70 2024-03-23T23:57:13.918 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":116,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:57:13.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:13.923+0000 7f8850200640 1 -- 172.21.15.8:0/3029051977 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8828067660 msgr2=0x7f8828069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:13.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:13.927+0000 7f8850200640 1 --2- 172.21.15.8:0/3029051977 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8828067660 0x7f8828069b20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f88481504e0 tx=0x7f8834009040 comp rx=0 tx=0).stop 2024-03-23T23:57:13.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:13.927+0000 7f8850200640 1 -- 172.21.15.8:0/3029051977 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f884814ee70 msgr2=0x7f884814c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:13.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:13.927+0000 7f8850200640 1 --2- 172.21.15.8:0/3029051977 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f884814ee70 0x7f884814c870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f883c0ae040 tx=0x7f883c01aca0 comp rx=0 tx=0).stop 2024-03-23T23:57:13.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:13.927+0000 7f8850200640 1 -- 172.21.15.8:0/3029051977 shutdown_connections 2024-03-23T23:57:13.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:13.927+0000 7f8850200640 1 --2- 172.21.15.8:0/3029051977 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f884814ee70 0x7f884814c870 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:13.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:13.927+0000 7f8850200640 1 --2- 172.21.15.8:0/3029051977 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88480ac410 0x7f88481f04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:13.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:13.927+0000 7f8850200640 1 --2- 172.21.15.8:0/3029051977 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8828067660 0x7f8828069b20 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:13.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:13.927+0000 7f8850200640 1 --2- 172.21.15.8:0/3029051977 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8848072d80 0x7f88481eff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:13.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:13.927+0000 7f8850200640 1 -- 172.21.15.8:0/3029051977 >> 172.21.15.8:0/3029051977 conn(0x7f88480c3bd0 msgr2=0x7f884814f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:57:13.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:13.927+0000 7f8850200640 1 -- 172.21.15.8:0/3029051977 shutdown_connections 2024-03-23T23:57:13.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:13.927+0000 7f8850200640 1 -- 172.21.15.8:0/3029051977 wait complete. 2024-03-23T23:57:14.102 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T23:57:14.102 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T23:57:14.102 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:57:14.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.435+0000 7f7c5bc00640 1 Processor -- start 2024-03-23T23:57:14.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.435+0000 7f7c5bc00640 1 -- start start 2024-03-23T23:57:14.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.447+0000 7f7c5bc00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7c540c1e30 0x7f7c54151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:14.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.447+0000 7f7c5bc00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c540c29a0 con 0x7f7c540c2340 2024-03-23T23:57:14.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.447+0000 7f7c5bc00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c540c3a30 con 0x7f7c5414f1b0 2024-03-23T23:57:14.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.447+0000 7f7c5bc00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c540c3d10 con 0x7f7c540c1e30 2024-03-23T23:57:14.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.447+0000 7f7c59c00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f7c540c2340 0x7f7c54152410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34666/0 (socket says 172.21.15.8:34666) 2024-03-23T23:57:14.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.447+0000 7f7c59c00640 1 -- 172.21.15.8:0/1756794425 learned_addr learned my addr 172.21.15.8:0/1756794425 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:57:14.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.451+0000 7f7c53400640 1 -- 172.21.15.8:0/1756794425 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2239874275 0 0) 0x7f7c540c29a0 con 0x7f7c540c2340 2024-03-23T23:57:14.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.451+0000 7f7c53400640 1 -- 172.21.15.8:0/1756794425 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c38003530 con 0x7f7c540c2340 2024-03-23T23:57:14.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.451+0000 7f7c53400640 1 -- 172.21.15.8:0/1756794425 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3701558809 0 0) 0x7f7c38003530 con 0x7f7c540c2340 2024-03-23T23:57:14.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.451+0000 7f7c53400640 1 -- 172.21.15.8:0/1756794425 >> v2:172.21.15.8:3300/0 conn(0x7f7c540c1e30 msgr2=0x7f7c54151ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:57:14.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.451+0000 7f7c53400640 1 --2- 172.21.15.8:0/1756794425 >> v2:172.21.15.8:3300/0 conn(0x7f7c540c1e30 0x7f7c54151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:14.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.451+0000 7f7c53400640 1 -- 172.21.15.8:0/1756794425 >> v1:172.21.15.196:6789/0 conn(0x7f7c5414f1b0 legacy=0x7f7c540c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:57:14.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.451+0000 7f7c53400640 1 -- 172.21.15.8:0/1756794425 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c540c2c40 con 0x7f7c540c2340 2024-03-23T23:57:14.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.451+0000 7f7c53400640 1 -- 172.21.15.8:0/1756794425 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7f7c4c001a00 con 0x7f7c540c2340 2024-03-23T23:57:14.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.451+0000 7f7c53400640 1 -- 172.21.15.8:0/1756794425 >> v1:172.21.15.8:6789/0 conn(0x7f7c540c2340 legacy=0x7f7c54152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:14.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.451+0000 7f7c53400640 1 --2- 172.21.15.8:0/1756794425 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7c38004bf0 0x7f7c380037b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:14.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.451+0000 7f7c53400640 1 --2- 172.21.15.8:0/1756794425 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c38004050 0x7f7c38009010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:14.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.451+0000 7f7c53400640 1 --2- 172.21.15.8:0/1756794425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c380095c0 0x7f7c38009a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:14.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.451+0000 7f7c53400640 1 -- 172.21.15.8:0/1756794425 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c540c3d10 con 0x7f7c380095c0 2024-03-23T23:57:14.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.451+0000 7f7c53400640 1 -- 172.21.15.8:0/1756794425 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3800a350 con 0x7f7c38004050 2024-03-23T23:57:14.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.451+0000 7f7c53400640 1 -- 172.21.15.8:0/1756794425 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3800a550 con 0x7f7c38004bf0 2024-03-23T23:57:14.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.451+0000 7f7c59c00640 1 --2- 172.21.15.8:0/1756794425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c380095c0 0x7f7c38009a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:14.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.455+0000 7f7c59c00640 1 -- 172.21.15.8:0/1756794425 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7c38004bf0 msgr2=0x7f7c380037b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:57:14.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.455+0000 7f7c59c00640 1 --2- 172.21.15.8:0/1756794425 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7c38004bf0 0x7f7c380037b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:14.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.455+0000 7f7c59c00640 1 -- 172.21.15.8:0/1756794425 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c38004050 msgr2=0x7f7c38009010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:57:14.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.455+0000 7f7c59c00640 1 --2- 172.21.15.8:0/1756794425 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c38004050 0x7f7c38009010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:14.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.455+0000 7f7c59c00640 1 -- 172.21.15.8:0/1756794425 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c38003530 con 0x7f7c380095c0 2024-03-23T23:57:14.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.475+0000 7f7c59c00640 1 --2- 172.21.15.8:0/1756794425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c380095c0 0x7f7c38009a70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c01b7b0 tx=0x7f7c4c02e2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab9b3f960ca33f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:14.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.475+0000 7f7c59c00640 1 -- 172.21.15.8:0/1756794425 reap_dead start 2024-03-23T23:57:14.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.487+0000 7f7c53400640 1 -- 172.21.15.8:0/1756794425 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c01b3d0 con 0x7f7c380095c0 2024-03-23T23:57:14.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.487+0000 7f7c53400640 1 -- 172.21.15.8:0/1756794425 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4c0bd620 con 0x7f7c380095c0 2024-03-23T23:57:14.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.487+0000 7f7c53400640 1 -- 172.21.15.8:0/1756794425 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c0bda10 con 0x7f7c380095c0 2024-03-23T23:57:14.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.491+0000 7f7c5bc00640 1 -- 172.21.15.8:0/1756794425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c380095c0 msgr2=0x7f7c38009a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:14.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.491+0000 7f7c5bc00640 1 --2- 172.21.15.8:0/1756794425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c380095c0 0x7f7c38009a70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c01b7b0 tx=0x7f7c4c02e2a0 comp rx=0 tx=0).stop 2024-03-23T23:57:14.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.491+0000 7f7c5bc00640 1 -- 172.21.15.8:0/1756794425 shutdown_connections 2024-03-23T23:57:14.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.491+0000 7f7c5bc00640 1 --2- 172.21.15.8:0/1756794425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c380095c0 0x7f7c38009a70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:14.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.491+0000 7f7c5bc00640 1 -- 172.21.15.8:0/1756794425 >> 172.21.15.8:0/1756794425 conn(0x7f7c540c7430 msgr2=0x7f7c540c7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:57:14.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.495+0000 7f7c5bc00640 1 -- 172.21.15.8:0/1756794425 shutdown_connections 2024-03-23T23:57:14.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.499+0000 7f7c5bc00640 1 -- 172.21.15.8:0/1756794425 wait complete. 2024-03-23T23:57:14.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.499+0000 7f7c5bc00640 1 Processor -- start 2024-03-23T23:57:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.507+0000 7f7c5bc00640 1 -- start start 2024-03-23T23:57:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.511+0000 7f7c5bc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c380095c0 0x7f7c541554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.511+0000 7f7c5bc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c541ed330 0x7f7c541487e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:14.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.511+0000 7f7c53e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c541ed330 0x7f7c541487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:14.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.511+0000 7f7c53e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c541ed330 0x7f7c541487e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41040/0 (socket says 172.21.15.8:41040) 2024-03-23T23:57:14.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.511+0000 7f7c59200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c380095c0 0x7f7c541554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:14.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.511+0000 7f7c59200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c380095c0 0x7f7c541554c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:59982/0 (socket says 172.21.15.8:59982) 2024-03-23T23:57:14.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.511+0000 7f7c53e00640 1 -- 172.21.15.8:0/2145188434 learned_addr learned my addr 172.21.15.8:0/2145188434 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:57:14.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.511+0000 7f7c5bc00640 1 --2- 172.21.15.8:0/2145188434 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7c54148d20 0x7f7c54146db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:14.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.511+0000 7f7c5bc00640 1 -- 172.21.15.8:0/2145188434 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c540c4250 con 0x7f7c541ed330 2024-03-23T23:57:14.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.511+0000 7f7c5bc00640 1 -- 172.21.15.8:0/2145188434 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c540c40d0 con 0x7f7c380095c0 2024-03-23T23:57:14.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.511+0000 7f7c5bc00640 1 -- 172.21.15.8:0/2145188434 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c540c43d0 con 0x7f7c54148d20 2024-03-23T23:57:14.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.515+0000 7f7c59200640 1 -- 172.21.15.8:0/2145188434 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7c54148d20 msgr2=0x7f7c54146db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:14.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.515+0000 7f7c59200640 1 --2- 172.21.15.8:0/2145188434 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7c54148d20 0x7f7c54146db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:14.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.515+0000 7f7c59200640 1 -- 172.21.15.8:0/2145188434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c541ed330 msgr2=0x7f7c541487e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:14.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.515+0000 7f7c59200640 1 --2- 172.21.15.8:0/2145188434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c541ed330 0x7f7c541487e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:14.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.515+0000 7f7c59200640 1 -- 172.21.15.8:0/2145188434 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c541455a0 con 0x7f7c380095c0 2024-03-23T23:57:14.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.515+0000 7f7c53e00640 1 --2- 172.21.15.8:0/2145188434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c541ed330 0x7f7c541487e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:57:14.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.515+0000 7f7c59200640 1 --2- 172.21.15.8:0/2145188434 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c380095c0 0x7f7c541554c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c00c440 tx=0x7f7c3c00c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:14.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.531+0000 7f7c50c00640 1 -- 172.21.15.8:0/2145188434 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c017070 con 0x7f7c380095c0 2024-03-23T23:57:14.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.531+0000 7f7c50c00640 1 -- 172.21.15.8:0/2145188434 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3c003600 con 0x7f7c380095c0 2024-03-23T23:57:14.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.531+0000 7f7c50c00640 1 -- 172.21.15.8:0/2145188434 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c0039f0 con 0x7f7c380095c0 2024-03-23T23:57:14.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.531+0000 7f7c5bc00640 1 -- 172.21.15.8:0/2145188434 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c54145880 con 0x7f7c380095c0 2024-03-23T23:57:14.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.531+0000 7f7c5bc00640 1 -- 172.21.15.8:0/2145188434 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c54145e40 con 0x7f7c380095c0 2024-03-23T23:57:14.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.539+0000 7f7c5bc00640 1 --2- 172.21.15.8:0/2145188434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c54146040 0x7f7c541472f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:14.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.539+0000 7f7c5bc00640 1 -- 172.21.15.8:0/2145188434 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c54155a00 con 0x7f7c54146040 2024-03-23T23:57:14.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.539+0000 7f7c53e00640 1 --2- 172.21.15.8:0/2145188434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c54146040 0x7f7c541472f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:14.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.539+0000 7f7c50c00640 1 -- 172.21.15.8:0/2145188434 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f7c3c01a070 con 0x7f7c380095c0 2024-03-23T23:57:14.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.539+0000 7f7c53e00640 1 -- 172.21.15.8:0/2145188434 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7c54068270 con 0x7f7c54146040 2024-03-23T23:57:14.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.543+0000 7f7c50c00640 1 --2- 172.21.15.8:0/2145188434 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7c30067730 0x7f7c30069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:14.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.543+0000 7f7c50c00640 1 -- 172.21.15.8:0/2145188434 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f7c3c084f20 con 0x7f7c380095c0 2024-03-23T23:57:14.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.543+0000 7f7c59c00640 1 --2- 172.21.15.8:0/2145188434 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7c30067730 0x7f7c30069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:14.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.547+0000 7f7c53e00640 1 --2- 172.21.15.8:0/2145188434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c54146040 0x7f7c541472f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7c540719b0 tx=0x7f7c4400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:14.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.547+0000 7f7c50c00640 1 -- 172.21.15.8:0/2145188434 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44017070 con 0x7f7c54146040 2024-03-23T23:57:14.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.547+0000 7f7c50c00640 1 -- 172.21.15.8:0/2145188434 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f7c4400ca50 con 0x7f7c54146040 2024-03-23T23:57:14.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.547+0000 7f7c50c00640 1 -- 172.21.15.8:0/2145188434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c54146040 msgr2=0x7f7c541472f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:14.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.547+0000 7f7c50c00640 1 --2- 172.21.15.8:0/2145188434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c54146040 0x7f7c541472f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7c540719b0 tx=0x7f7c4400ef70 comp rx=0 tx=0).stop 2024-03-23T23:57:14.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.547+0000 7f7c50c00640 1 -- 172.21.15.8:0/2145188434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c54146040 msgr2=0x7f7c541472f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:57:14.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.547+0000 7f7c50c00640 1 --2- 172.21.15.8:0/2145188434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c54146040 0x7f7c541472f0 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7c540719b0 tx=0x7f7c4400ef70 comp rx=0 tx=0).stop 2024-03-23T23:57:14.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.555+0000 7f7c59c00640 1 --2- 172.21.15.8:0/2145188434 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7c30067730 0x7f7c30069bf0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7c5406f820 tx=0x7f7c540c2e10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:14.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.603+0000 7f7c5bc00640 1 --2- 172.21.15.8:0/2145188434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c541e9d80 0x7f7c541ea160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:14.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.603+0000 7f7c5bc00640 1 -- 172.21.15.8:0/2145188434 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5415c430 con 0x7f7c541e9d80 2024-03-23T23:57:14.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.603+0000 7f7c53e00640 1 --2- 172.21.15.8:0/2145188434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c541e9d80 0x7f7c541ea160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:14.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.603+0000 7f7c53e00640 1 -- 172.21.15.8:0/2145188434 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7c5406fb20 con 0x7f7c541e9d80 2024-03-23T23:57:14.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.607+0000 7f7c53e00640 1 --2- 172.21.15.8:0/2145188434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c541e9d80 0x7f7c541ea160 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7c54146910 tx=0x7f7c44004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:14.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.611+0000 7f7c50c00640 1 -- 172.21.15.8:0/2145188434 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44017070 con 0x7f7c541e9d80 2024-03-23T23:57:14.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.611+0000 7f7c50c00640 1 -- 172.21.15.8:0/2145188434 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4872 (secure 0 0 0) 0x7f7c440065a0 con 0x7f7c541e9d80 2024-03-23T23:57:14.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.611+0000 7f7c50c00640 1 -- 172.21.15.8:0/2145188434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c541e9d80 msgr2=0x7f7c541ea160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:14.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.611+0000 7f7c50c00640 1 --2- 172.21.15.8:0/2145188434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c541e9d80 0x7f7c541ea160 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7c54146910 tx=0x7f7c44004740 comp rx=0 tx=0).stop 2024-03-23T23:57:14.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.611+0000 7f7c50c00640 1 -- 172.21.15.8:0/2145188434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c541e9d80 msgr2=0x7f7c541ea160 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:57:14.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.611+0000 7f7c50c00640 1 --2- 172.21.15.8:0/2145188434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c541e9d80 0x7f7c541ea160 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7c54146910 tx=0x7f7c44004740 comp rx=0 tx=0).stop 2024-03-23T23:57:14.626 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:57:14.626 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:57:14.626 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:57:14.627 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:57:14.627 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 116, 2024-03-23T23:57:14.627 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:57:14.627 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:57:14.627 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:57:14.627 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:57:14.627 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:14.627 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 3, 2024-03-23T23:57:14.627 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:57:14.627 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:57:14.627 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:57:14.627 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:57:14.628 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:57:14.628 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:57:14.628 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:57:14.628 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:57:14.628 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:57:14.628 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:57:14.628 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:57:14.628 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:57:14.628 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:57:14.628 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:57:14.628 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:14.628 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:57:14.628 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:57:14.628 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:57:14.629 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:57:14.629 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:57:14.629 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:57:14.629 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:57:14.629 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:57:14.629 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:57:14.629 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:57:14.629 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:57:14.629 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:57:14.629 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:57:14.629 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:14.629 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:14.629 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:57:14.629 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:57:14.630 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:57:14.630 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:57:14.630 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:57:14.630 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:57:14.630 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:57:14.630 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:57:14.630 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:57:14.630 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:57:14.630 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:57:14.630 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:57:14.630 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:57:14.630 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:57:14.630 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:57:14.631 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:57:14.631 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:57:14.631 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:57:14.631 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:57:14.631 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:57:14.631 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:57:14.631 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:57:14.631 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:57:14.631 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:57:14.631 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:57:14.631 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:57:14.631 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:57:14.631 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:57:14.631 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:14.632 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:57:14.632 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:14.632 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:57:14.632 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:14.632 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:57:14.632 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:57:14.632 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:57:14.632 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:57:14.632 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:14.632 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:57:14.632 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:57:14.632 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:14.632 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:14.632 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:14.633 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:57:14.633 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:57:14.633 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:14.633 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:14.633 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:14.633 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:14.633 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:57:14.633 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:57:14.633 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:57:14.633 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:57:14.633 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:57:14.633 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:14.633 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:14.634 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:57:14.634 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:57:14.634 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:57:14.634 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:57:14.634 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:14.634 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:57:14.634 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:57:14.634 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:14.634 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:14.634 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:14.634 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:57:14.634 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:57:14.634 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:14.634 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:14.635 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:14.635 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:14.635 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:57:14.635 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:57:14.635 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:57:14.635 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:57:14.635 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:57:14.635 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:14.635 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:14.635 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:57:14.635 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:57:14.635 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:57:14.635 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:57:14.636 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:14.636 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:57:14.636 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:57:14.636 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:14.636 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:14.636 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:14.636 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:57:14.636 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:57:14.636 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:14.636 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:14.636 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:14.636 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:14.636 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:57:14.636 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:57:14.637 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:57:14.637 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:57:14.637 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:57:14.637 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:14.637 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:14.637 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:14.637 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:57:14.637 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:57:14.637 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:14.637 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:57:14.637 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:14.637 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:57:14.637 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:14.638 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:14.638 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:57:14.638 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:14.638 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:57:14.638 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:14.638 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5 2024-03-23T23:57:14.638 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:14.638 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:14.638 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:57:14.638 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:14.638 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:57:14.638 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:14.638 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:57:14.639 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:14.639 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:14.639 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:57:14.639 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:14.639 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:57:14.639 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:14.639 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:57:14.639 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:14.639 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:14.639 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:14.639 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:57:14.639 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:57:14.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.627+0000 7f7c5bc00640 1 -- 172.21.15.8:0/2145188434 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7c30067730 msgr2=0x7f7c30069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:14.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.627+0000 7f7c5bc00640 1 --2- 172.21.15.8:0/2145188434 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7c30067730 0x7f7c30069bf0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7c5406f820 tx=0x7f7c540c2e10 comp rx=0 tx=0).stop 2024-03-23T23:57:14.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.627+0000 7f7c5bc00640 1 -- 172.21.15.8:0/2145188434 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c380095c0 msgr2=0x7f7c541554c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:14.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.627+0000 7f7c5bc00640 1 --2- 172.21.15.8:0/2145188434 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c380095c0 0x7f7c541554c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c00c440 tx=0x7f7c3c00c900 comp rx=0 tx=0).stop 2024-03-23T23:57:14.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.627+0000 7f7c59c00640 1 -- 172.21.15.8:0/2145188434 reap_dead start 2024-03-23T23:57:14.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.627+0000 7f7c59c00640 1 -- 172.21.15.8:0/2145188434 reap_dead start 2024-03-23T23:57:14.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.627+0000 7f7c5bc00640 1 -- 172.21.15.8:0/2145188434 shutdown_connections 2024-03-23T23:57:14.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.627+0000 7f7c5bc00640 1 -- 172.21.15.8:0/2145188434 >> 172.21.15.8:0/2145188434 conn(0x7f7c540c7430 msgr2=0x7f7c5414e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:57:14.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.631+0000 7f7c5bc00640 1 -- 172.21.15.8:0/2145188434 shutdown_connections 2024-03-23T23:57:14.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:14.635+0000 7f7c5bc00640 1 -- 172.21.15.8:0/2145188434 wait complete. 2024-03-23T23:57:14.761 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:57:14.761 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T23:57:14.761 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:57:15.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.251+0000 7f0488c00640 1 Processor -- start 2024-03-23T23:57:15.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.251+0000 7f0488c00640 1 -- start start 2024-03-23T23:57:15.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.251+0000 7f0488c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f04840c33c0 0x7f048415a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:15.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.251+0000 7f0488c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f048406cdf0 0x7f0484070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:15.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.251+0000 7f0488c00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f048406d280 con 0x7f0484071340 2024-03-23T23:57:15.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.251+0000 7f0488c00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0484071d80 con 0x7f048406cdf0 2024-03-23T23:57:15.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.251+0000 7f0488c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0484073420 con 0x7f04840c33c0 2024-03-23T23:57:15.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.251+0000 7f0482a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f048406cdf0 0x7f0484070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:15.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.251+0000 7f0483e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f0484071340 0x7f048406df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34680/0 (socket says 172.21.15.8:34680) 2024-03-23T23:57:15.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.255+0000 7f0483e00640 1 -- 172.21.15.8:0/3136239640 learned_addr learned my addr 172.21.15.8:0/3136239640 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:57:15.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.251+0000 7f0482a00640 1 --2- 172.21.15.8:0/3136239640 >> v2:172.21.15.8:3300/0 conn(0x7f048406cdf0 0x7f0484070e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41074/0 (socket says 172.21.15.8:41074) 2024-03-23T23:57:15.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.255+0000 7f0483400640 1 --2- 172.21.15.8:0/3136239640 >> v2:172.21.15.196:3300/0 conn(0x7f04840c33c0 0x7f048415a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:15.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.255+0000 7f0482a00640 1 -- 172.21.15.8:0/3136239640 >> v2:172.21.15.196:3300/0 conn(0x7f04840c33c0 msgr2=0x7f048415a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:57:15.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.255+0000 7f0482a00640 1 --2- 172.21.15.8:0/3136239640 >> v2:172.21.15.196:3300/0 conn(0x7f04840c33c0 0x7f048415a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:15.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.255+0000 7f0482a00640 1 -- 172.21.15.8:0/3136239640 >> v1:172.21.15.8:6789/0 conn(0x7f0484071340 legacy=0x7f048406df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:15.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.255+0000 7f0482a00640 1 -- 172.21.15.8:0/3136239640 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0484072dd0 con 0x7f048406cdf0 2024-03-23T23:57:15.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.267+0000 7f0482a00640 1 --2- 172.21.15.8:0/3136239640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f048406cdf0 0x7f0484070e00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f04840709a0 tx=0x7f047001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da6d2857ff3621fa server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:15.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.271+0000 7f0482000640 1 -- 172.21.15.8:0/3136239640 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04700b0070 con 0x7f048406cdf0 2024-03-23T23:57:15.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.271+0000 7f0482000640 1 -- 172.21.15.8:0/3136239640 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04700ab600 con 0x7f048406cdf0 2024-03-23T23:57:15.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.271+0000 7f0482000640 1 -- 172.21.15.8:0/3136239640 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04700ab9d0 con 0x7f048406cdf0 2024-03-23T23:57:15.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.283+0000 7f0488c00640 1 -- 172.21.15.8:0/3136239640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f048406cdf0 msgr2=0x7f0484070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:15.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.283+0000 7f0488c00640 1 --2- 172.21.15.8:0/3136239640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f048406cdf0 0x7f0484070e00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f04840709a0 tx=0x7f047001c480 comp rx=0 tx=0).stop 2024-03-23T23:57:15.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.283+0000 7f0488c00640 1 -- 172.21.15.8:0/3136239640 shutdown_connections 2024-03-23T23:57:15.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.283+0000 7f0488c00640 1 --2- 172.21.15.8:0/3136239640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f048406cdf0 0x7f0484070e00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:15.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.283+0000 7f0488c00640 1 --2- 172.21.15.8:0/3136239640 >> v2:172.21.15.196:3300/0 conn(0x7f04840c33c0 0x7f048415a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:15.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.283+0000 7f0488c00640 1 -- 172.21.15.8:0/3136239640 >> 172.21.15.8:0/3136239640 conn(0x7f048406b170 msgr2=0x7f048406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:57:15.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.287+0000 7f0488c00640 1 -- 172.21.15.8:0/3136239640 shutdown_connections 2024-03-23T23:57:15.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.287+0000 7f0488c00640 1 -- 172.21.15.8:0/3136239640 wait complete. 2024-03-23T23:57:15.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.287+0000 7f0488c00640 1 Processor -- start 2024-03-23T23:57:15.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.287+0000 7f0488c00640 1 -- start start 2024-03-23T23:57:15.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.291+0000 7f0488c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0484071340 0x7f048415ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:15.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.291+0000 7f0488c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f04840c33c0 0x7f04841fe8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:15.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.291+0000 7f0488c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f04841fee30 0x7f0484150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:15.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.291+0000 7f0488c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0484153ea0 con 0x7f0484071340 2024-03-23T23:57:15.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.291+0000 7f0488c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f048406ec80 con 0x7f04840c33c0 2024-03-23T23:57:15.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.291+0000 7f0488c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0484166bd0 con 0x7f04841fee30 2024-03-23T23:57:15.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.295+0000 7f0483e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f04841fee30 0x7f0484150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:15.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.295+0000 7f0483e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f04841fee30 0x7f0484150150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:56274/0 (socket says 172.21.15.8:56274) 2024-03-23T23:57:15.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.295+0000 7f0483e00640 1 -- 172.21.15.8:0/1279408809 learned_addr learned my addr 172.21.15.8:0/1279408809 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:57:15.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.295+0000 7f0483400640 1 --2- 172.21.15.8:0/1279408809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0484071340 0x7f048415ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:15.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.295+0000 7f0483e00640 1 -- 172.21.15.8:0/1279408809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f04840c33c0 msgr2=0x7f04841fe8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:15.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.295+0000 7f0483e00640 1 --2- 172.21.15.8:0/1279408809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f04840c33c0 0x7f04841fe8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:15.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.295+0000 7f0483e00640 1 -- 172.21.15.8:0/1279408809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0484071340 msgr2=0x7f048415ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:15.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.295+0000 7f0483e00640 1 --2- 172.21.15.8:0/1279408809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0484071340 0x7f048415ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:15.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.295+0000 7f0483e00640 1 -- 172.21.15.8:0/1279408809 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04841ff380 con 0x7f04841fee30 2024-03-23T23:57:15.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.295+0000 7f0483e00640 1 --2- 172.21.15.8:0/1279408809 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f04841fee30 0x7f0484150150 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f047c00caa0 tx=0x7f047c00cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:15.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.299+0000 7f047b400640 1 -- 172.21.15.8:0/1279408809 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047c017070 con 0x7f04841fee30 2024-03-23T23:57:15.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.299+0000 7f047b400640 1 -- 172.21.15.8:0/1279408809 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047c00ac00 con 0x7f04841fee30 2024-03-23T23:57:15.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.299+0000 7f047b400640 1 -- 172.21.15.8:0/1279408809 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047c012620 con 0x7f04841fee30 2024-03-23T23:57:15.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.307+0000 7f0488c00640 1 -- 172.21.15.8:0/1279408809 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f048415c240 con 0x7f04841fee30 2024-03-23T23:57:15.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.307+0000 7f0488c00640 1 -- 172.21.15.8:0/1279408809 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f048415c800 con 0x7f04841fee30 2024-03-23T23:57:15.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.307+0000 7f0488c00640 1 --2- 172.21.15.8:0/1279408809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f048406cdf0 0x7f0484150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:15.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.307+0000 7f0488c00640 1 -- 172.21.15.8:0/1279408809 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f048415f160 con 0x7f048406cdf0 2024-03-23T23:57:15.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.307+0000 7f0483400640 1 --2- 172.21.15.8:0/1279408809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f048406cdf0 0x7f0484150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:15.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.315+0000 7f0483400640 1 -- 172.21.15.8:0/1279408809 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f048404f410 con 0x7f048406cdf0 2024-03-23T23:57:15.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.315+0000 7f0483400640 1 --2- 172.21.15.8:0/1279408809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f048406cdf0 0x7f0484150690 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f047400d530 tx=0x7f047400d9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:15.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.315+0000 7f047b400640 1 -- 172.21.15.8:0/1279408809 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f047c01a070 con 0x7f04841fee30 2024-03-23T23:57:15.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.323+0000 7f047b400640 1 --2- 172.21.15.8:0/1279408809 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f04640676b0 0x7f0464069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:15.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.323+0000 7f047b400640 1 -- 172.21.15.8:0/1279408809 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f047c085990 con 0x7f04841fee30 2024-03-23T23:57:15.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.323+0000 7f047b400640 1 -- 172.21.15.8:0/1279408809 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0474004230 con 0x7f048406cdf0 2024-03-23T23:57:15.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.323+0000 7f047b400640 1 -- 172.21.15.8:0/1279408809 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f04740043d0 con 0x7f048406cdf0 2024-03-23T23:57:15.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.323+0000 7f047b400640 1 -- 172.21.15.8:0/1279408809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f048406cdf0 msgr2=0x7f0484150690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:15.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.323+0000 7f047b400640 1 --2- 172.21.15.8:0/1279408809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f048406cdf0 0x7f0484150690 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f047400d530 tx=0x7f047400d9f0 comp rx=0 tx=0).stop 2024-03-23T23:57:15.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.323+0000 7f047b400640 1 -- 172.21.15.8:0/1279408809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f048406cdf0 msgr2=0x7f0484150690 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:57:15.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.323+0000 7f047b400640 1 --2- 172.21.15.8:0/1279408809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f048406cdf0 0x7f0484150690 secure :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f047400d530 tx=0x7f047400d9f0 comp rx=0 tx=0).stop 2024-03-23T23:57:15.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.327+0000 7f0482a00640 1 --2- 172.21.15.8:0/1279408809 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f04640676b0 0x7f0464069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:15.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.331+0000 7f0482a00640 1 --2- 172.21.15.8:0/1279408809 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f04640676b0 0x7f0464069b70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f04700ad000 tx=0x7f0470004740 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:15.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.363+0000 7f0488c00640 1 --2- 172.21.15.8:0/1279408809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f048415cb70 0x7f04841fb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:15.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.363+0000 7f0488c00640 1 -- 172.21.15.8:0/1279408809 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f048415aaf0 con 0x7f048415cb70 2024-03-23T23:57:15.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.363+0000 7f0483400640 1 --2- 172.21.15.8:0/1279408809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f048415cb70 0x7f04841fb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:15.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.371+0000 7f0483400640 1 -- 172.21.15.8:0/1279408809 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f048415de50 con 0x7f048415cb70 2024-03-23T23:57:15.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.383+0000 7f0483400640 1 --2- 172.21.15.8:0/1279408809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f048415cb70 0x7f04841fb0a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f047400d530 tx=0x7f04740046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:15.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.387+0000 7f047b400640 1 -- 172.21.15.8:0/1279408809 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0474004230 con 0x7f048415cb70 2024-03-23T23:57:15.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.387+0000 7f047b400640 1 -- 172.21.15.8:0/1279408809 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5183 (secure 0 0 0) 0x7f0474003ab0 con 0x7f048415cb70 2024-03-23T23:57:15.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.387+0000 7f047b400640 1 -- 172.21.15.8:0/1279408809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f048415cb70 msgr2=0x7f04841fb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:15.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.387+0000 7f047b400640 1 --2- 172.21.15.8:0/1279408809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f048415cb70 0x7f04841fb0a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f047400d530 tx=0x7f04740046d0 comp rx=0 tx=0).stop 2024-03-23T23:57:15.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.387+0000 7f047b400640 1 -- 172.21.15.8:0/1279408809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f048415cb70 msgr2=0x7f04841fb0a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:57:15.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.387+0000 7f047b400640 1 --2- 172.21.15.8:0/1279408809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f048415cb70 0x7f04841fb0a0 secure :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f047400d530 tx=0x7f04740046d0 comp rx=0 tx=0).stop 2024-03-23T23:57:15.396 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:57:15.396 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:57:15.396 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:57:15.396 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:57:15.396 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 116, 2024-03-23T23:57:15.396 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:57:15.396 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:57:15.396 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:57:15.396 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:57:15.396 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:15.396 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 3, 2024-03-23T23:57:15.396 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:57:15.397 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:57:15.397 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:57:15.397 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:57:15.397 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:57:15.397 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:57:15.397 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:57:15.397 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:57:15.397 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:57:15.397 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:57:15.397 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:57:15.397 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:57:15.397 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:57:15.397 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:57:15.397 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:15.398 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:57:15.398 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:57:15.398 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:57:15.398 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:57:15.398 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:57:15.398 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:57:15.398 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:57:15.398 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:57:15.398 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:57:15.398 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:57:15.398 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:57:15.399 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:57:15.399 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:57:15.399 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:15.399 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:15.399 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:57:15.399 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:57:15.399 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:57:15.399 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:57:15.399 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:57:15.399 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:57:15.399 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:57:15.399 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:57:15.399 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:57:15.399 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:57:15.400 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:57:15.400 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:57:15.400 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:57:15.400 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:57:15.400 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:57:15.400 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:57:15.400 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:57:15.400 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:57:15.400 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:57:15.400 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:57:15.400 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:57:15.400 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:57:15.400 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:57:15.400 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:57:15.401 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:57:15.401 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:57:15.401 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:57:15.401 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:57:15.401 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:15.401 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:57:15.401 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:15.401 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:57:15.401 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:15.401 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:57:15.401 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:57:15.401 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:57:15.401 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:57:15.401 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:15.402 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:57:15.402 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:57:15.402 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:15.402 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:15.402 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:15.402 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:57:15.402 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:57:15.402 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:15.402 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:15.402 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:15.402 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:15.402 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:57:15.402 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:57:15.403 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:57:15.403 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:57:15.403 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:57:15.403 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:15.403 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:15.403 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:57:15.403 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:57:15.403 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:57:15.403 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:57:15.403 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:15.403 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:57:15.403 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:57:15.404 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:15.404 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:15.404 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:15.404 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:57:15.404 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:57:15.404 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:15.404 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:15.404 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:15.404 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:15.404 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:57:15.404 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:57:15.404 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:57:15.405 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:57:15.405 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:57:15.405 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:15.405 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:15.405 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:57:15.405 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:57:15.405 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:57:15.405 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:57:15.405 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:15.405 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:57:15.405 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:57:15.405 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:15.405 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:15.405 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:15.406 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:57:15.406 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:57:15.406 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:15.406 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:15.406 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:15.406 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:15.406 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:57:15.406 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:57:15.406 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:57:15.406 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:57:15.406 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:57:15.406 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:15.406 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:15.407 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:15.407 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:57:15.407 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:57:15.407 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:15.407 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:57:15.407 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:15.407 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:57:15.407 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:15.407 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:15.407 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:57:15.407 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:15.407 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:57:15.407 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:15.407 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:57:15.408 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:15.408 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:15.408 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:57:15.408 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:15.408 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:57:15.408 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:15.408 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:57:15.408 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:15.408 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:15.408 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:57:15.408 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:15.409 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:57:15.409 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:15.409 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:57:15.409 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:15.409 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:15.409 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:57:15.409 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:15.409 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:57:15.409 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:15.409 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:15.409 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:57:15.409 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:15.409 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:57:15.409 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:15.410 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:57:15.410 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:15.410 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:15.410 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:15.410 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:57:15.410 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:57:15.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.395+0000 7f0488c00640 1 -- 172.21.15.8:0/1279408809 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f04640676b0 msgr2=0x7f0464069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:15.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.395+0000 7f0488c00640 1 --2- 172.21.15.8:0/1279408809 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f04640676b0 0x7f0464069b70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f04700ad000 tx=0x7f0470004740 comp rx=0 tx=0).stop 2024-03-23T23:57:15.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.395+0000 7f0488c00640 1 -- 172.21.15.8:0/1279408809 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f04841fee30 msgr2=0x7f0484150150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:15.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.395+0000 7f0488c00640 1 --2- 172.21.15.8:0/1279408809 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f04841fee30 0x7f0484150150 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f047c00caa0 tx=0x7f047c00cf60 comp rx=0 tx=0).stop 2024-03-23T23:57:15.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.395+0000 7f0483e00640 1 -- 172.21.15.8:0/1279408809 reap_dead start 2024-03-23T23:57:15.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.395+0000 7f0483e00640 1 -- 172.21.15.8:0/1279408809 reap_dead start 2024-03-23T23:57:15.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.399+0000 7f0488c00640 1 -- 172.21.15.8:0/1279408809 shutdown_connections 2024-03-23T23:57:15.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.399+0000 7f0488c00640 1 -- 172.21.15.8:0/1279408809 >> 172.21.15.8:0/1279408809 conn(0x7f048406b170 msgr2=0x7f04840c61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:57:15.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.399+0000 7f0488c00640 1 -- 172.21.15.8:0/1279408809 shutdown_connections 2024-03-23T23:57:15.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:15.399+0000 7f0488c00640 1 -- 172.21.15.8:0/1279408809 wait complete. 2024-03-23T23:57:15.529 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:57:15.530 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T23:57:15.530 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:57:16.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.083+0000 7f57b5c00640 1 Processor -- start 2024-03-23T23:57:16.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.083+0000 7f57b5c00640 1 -- start start 2024-03-23T23:57:16.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.087+0000 7f57b5c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57b00c4430 0x7f57b014eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:16.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.087+0000 7f57b5c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f57b0072b30 0x7f57b00c2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:16.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.087+0000 7f57b5c00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b006cfa0 con 0x7f57b00c2d60 2024-03-23T23:57:16.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.087+0000 7f57b5c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b00c3760 con 0x7f57b0072b30 2024-03-23T23:57:16.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.087+0000 7f57b5c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b0151710 con 0x7f57b00c4430 2024-03-23T23:57:16.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.087+0000 7f57af400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f57b0072b30 0x7f57b00c2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:16.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.087+0000 7f57af400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f57b0072b30 0x7f57b00c2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:60040/0 (socket says 172.21.15.8:60040) 2024-03-23T23:57:16.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.087+0000 7f57af400640 1 -- 172.21.15.8:0/737500197 learned_addr learned my addr 172.21.15.8:0/737500197 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:57:16.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.091+0000 7f57afe00640 1 --2- 172.21.15.8:0/737500197 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57b00c4430 0x7f57b014eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:16.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.091+0000 7f57af400640 1 -- 172.21.15.8:0/737500197 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57b00c4430 msgr2=0x7f57b014eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:57:16.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.091+0000 7f57af400640 1 --2- 172.21.15.8:0/737500197 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57b00c4430 0x7f57b014eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:16.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.091+0000 7f57af400640 1 -- 172.21.15.8:0/737500197 >> v1:172.21.15.8:6789/0 conn(0x7f57b00c2d60 legacy=0x7f57b0151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:57:16.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.091+0000 7f57af400640 1 -- 172.21.15.8:0/737500197 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b006d280 con 0x7f57b0072b30 2024-03-23T23:57:16.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.103+0000 7f57af400640 1 --2- 172.21.15.8:0/737500197 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57b0072b30 0x7f57b00c2820 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f57a0009870 tx=0x7f57a001ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8034da839b1ac390 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:16.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.107+0000 7f57aea00640 1 -- 172.21.15.8:0/737500197 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a00b5070 con 0x7f57b0072b30 2024-03-23T23:57:16.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.107+0000 7f57aea00640 1 -- 172.21.15.8:0/737500197 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a00a89d0 con 0x7f57b0072b30 2024-03-23T23:57:16.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.107+0000 7f57aea00640 1 -- 172.21.15.8:0/737500197 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a00a8da0 con 0x7f57b0072b30 2024-03-23T23:57:16.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.111+0000 7f57b5c00640 1 -- 172.21.15.8:0/737500197 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57b0072b30 msgr2=0x7f57b00c2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:16.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.111+0000 7f57b5c00640 1 --2- 172.21.15.8:0/737500197 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57b0072b30 0x7f57b00c2820 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f57a0009870 tx=0x7f57a001ed30 comp rx=0 tx=0).stop 2024-03-23T23:57:16.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.111+0000 7f57b5c00640 1 -- 172.21.15.8:0/737500197 shutdown_connections 2024-03-23T23:57:16.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.111+0000 7f57b5c00640 1 --2- 172.21.15.8:0/737500197 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57b0072b30 0x7f57b00c2820 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:16.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.111+0000 7f57b5c00640 1 --2- 172.21.15.8:0/737500197 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57b00c4430 0x7f57b014eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:16.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.111+0000 7f57b5c00640 1 -- 172.21.15.8:0/737500197 >> 172.21.15.8:0/737500197 conn(0x7f57b00c3910 msgr2=0x7f57b00c3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:57:16.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.111+0000 7f57b5c00640 1 -- 172.21.15.8:0/737500197 shutdown_connections 2024-03-23T23:57:16.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.111+0000 7f57b5c00640 1 -- 172.21.15.8:0/737500197 wait complete. 2024-03-23T23:57:16.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.119+0000 7f57b5c00640 1 Processor -- start 2024-03-23T23:57:16.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.123+0000 7f57b5c00640 1 -- start start 2024-03-23T23:57:16.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.127+0000 7f57b5c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57b0072b30 0x7f57b00aa320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:16.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.127+0000 7f57b5c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57b00c2d60 0x7f57b01353a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:16.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.127+0000 7f57b5c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57b00c4430 0x7f57b01358e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:16.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.127+0000 7f57b5c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b006c940 con 0x7f57b0072b30 2024-03-23T23:57:16.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.127+0000 7f57b5c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b0070be0 con 0x7f57b00c2d60 2024-03-23T23:57:16.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.127+0000 7f57b5c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b0072f50 con 0x7f57b00c4430 2024-03-23T23:57:16.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.127+0000 7f57afe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57b0072b30 0x7f57b00aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:16.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.127+0000 7f57af400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57b00c2d60 0x7f57b01353a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:16.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.127+0000 7f57af400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57b00c2d60 0x7f57b01353a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:60056/0 (socket says 172.21.15.8:60056) 2024-03-23T23:57:16.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.127+0000 7f57af400640 1 -- 172.21.15.8:0/1516702234 learned_addr learned my addr 172.21.15.8:0/1516702234 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:57:16.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.131+0000 7f57b5200640 1 --2- 172.21.15.8:0/1516702234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57b00c4430 0x7f57b01358e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:16.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.131+0000 7f57afe00640 1 -- 172.21.15.8:0/1516702234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57b00c4430 msgr2=0x7f57b01358e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:16.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.131+0000 7f57afe00640 1 --2- 172.21.15.8:0/1516702234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57b00c4430 0x7f57b01358e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:16.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.131+0000 7f57afe00640 1 -- 172.21.15.8:0/1516702234 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57b00c2d60 msgr2=0x7f57b01353a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:16.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.131+0000 7f57afe00640 1 --2- 172.21.15.8:0/1516702234 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57b00c2d60 0x7f57b01353a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:16.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.131+0000 7f57afe00640 1 -- 172.21.15.8:0/1516702234 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b0134860 con 0x7f57b0072b30 2024-03-23T23:57:16.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.131+0000 7f57b5200640 1 --2- 172.21.15.8:0/1516702234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57b00c4430 0x7f57b01358e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:57:16.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.131+0000 7f57afe00640 1 --2- 172.21.15.8:0/1516702234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57b0072b30 0x7f57b00aa320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f57a800ebc0 tx=0x7f57a800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:16.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.135+0000 7f57a7e00640 1 -- 172.21.15.8:0/1516702234 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a8018020 con 0x7f57b0072b30 2024-03-23T23:57:16.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.135+0000 7f57a7e00640 1 -- 172.21.15.8:0/1516702234 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a800cda0 con 0x7f57b0072b30 2024-03-23T23:57:16.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.135+0000 7f57a7e00640 1 -- 172.21.15.8:0/1516702234 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a80146c0 con 0x7f57b0072b30 2024-03-23T23:57:16.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.135+0000 7f57b5c00640 1 -- 172.21.15.8:0/1516702234 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b00a9700 con 0x7f57b0072b30 2024-03-23T23:57:16.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.135+0000 7f57b5c00640 1 -- 172.21.15.8:0/1516702234 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b00ac3c0 con 0x7f57b0072b30 2024-03-23T23:57:16.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.139+0000 7f57a7e00640 1 -- 172.21.15.8:0/1516702234 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f57a801b020 con 0x7f57b0072b30 2024-03-23T23:57:16.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.143+0000 7f57a7e00640 1 --2- 172.21.15.8:0/1516702234 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5790067660 0x7f5790069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:16.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.143+0000 7f57a7e00640 1 -- 172.21.15.8:0/1516702234 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f57a8086990 con 0x7f57b0072b30 2024-03-23T23:57:16.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.143+0000 7f57b5c00640 1 --2- 172.21.15.8:0/1516702234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5788002a80 0x7f5788004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:16.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.143+0000 7f57b5c00640 1 -- 172.21.15.8:0/1516702234 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5788007ed0 con 0x7f5788002a80 2024-03-23T23:57:16.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.147+0000 7f57b5200640 1 --2- 172.21.15.8:0/1516702234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5788002a80 0x7f5788004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:16.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.147+0000 7f57af400640 1 --2- 172.21.15.8:0/1516702234 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5790067660 0x7f5790069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:16.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.151+0000 7f57b5200640 1 -- 172.21.15.8:0/1516702234 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f57880080d0 con 0x7f5788002a80 2024-03-23T23:57:16.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.155+0000 7f57af400640 1 --2- 172.21.15.8:0/1516702234 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5790067660 0x7f5790069b20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f57a0009870 tx=0x7f57a00aa070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:16.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.159+0000 7f57b5200640 1 --2- 172.21.15.8:0/1516702234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5788002a80 0x7f5788004f40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f579c00d3f0 tx=0x7f579c00d8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:16.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.163+0000 7f57a7e00640 1 -- 172.21.15.8:0/1516702234 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c005480 con 0x7f5788002a80 2024-03-23T23:57:16.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.163+0000 7f57a7e00640 1 -- 172.21.15.8:0/1516702234 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f579c017070 con 0x7f5788002a80 2024-03-23T23:57:16.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.163+0000 7f57a7e00640 1 -- 172.21.15.8:0/1516702234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5788002a80 msgr2=0x7f5788004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:16.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.163+0000 7f57a7e00640 1 --2- 172.21.15.8:0/1516702234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5788002a80 0x7f5788004f40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f579c00d3f0 tx=0x7f579c00d8b0 comp rx=0 tx=0).stop 2024-03-23T23:57:16.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.163+0000 7f57a7e00640 1 -- 172.21.15.8:0/1516702234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5788002a80 msgr2=0x7f5788004f40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:57:16.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.163+0000 7f57a7e00640 1 --2- 172.21.15.8:0/1516702234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5788002a80 0x7f5788004f40 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f579c00d3f0 tx=0x7f579c00d8b0 comp rx=0 tx=0).stop 2024-03-23T23:57:16.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.191+0000 7f57b5c00640 1 --2- 172.21.15.8:0/1516702234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5788006f10 0x7f57880073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:16.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.191+0000 7f57b5c00640 1 -- 172.21.15.8:0/1516702234 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578800a4b0 con 0x7f5788006f10 2024-03-23T23:57:16.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.191+0000 7f57b5200640 1 --2- 172.21.15.8:0/1516702234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5788006f10 0x7f57880073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:16.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.199+0000 7f57b5200640 1 -- 172.21.15.8:0/1516702234 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f57880078e0 con 0x7f5788006f10 2024-03-23T23:57:16.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.207+0000 7f57b5200640 1 --2- 172.21.15.8:0/1516702234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5788006f10 0x7f57880073a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f579c016000 tx=0x7f579c001030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:16.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.207+0000 7f57a7e00640 1 -- 172.21.15.8:0/1516702234 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c01c030 con 0x7f5788006f10 2024-03-23T23:57:16.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.207+0000 7f57a7e00640 1 -- 172.21.15.8:0/1516702234 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4530 (secure 0 0 0) 0x7f579c01c1d0 con 0x7f5788006f10 2024-03-23T23:57:16.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.207+0000 7f57a7e00640 1 -- 172.21.15.8:0/1516702234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5788006f10 msgr2=0x7f57880073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:16.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.207+0000 7f57a7e00640 1 --2- 172.21.15.8:0/1516702234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5788006f10 0x7f57880073a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f579c016000 tx=0x7f579c001030 comp rx=0 tx=0).stop 2024-03-23T23:57:16.211 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:57:16.211 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:57:16.211 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:57:16.212 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:57:16.212 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 116, 2024-03-23T23:57:16.212 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:57:16.212 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:57:16.212 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:57:16.212 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:57:16.212 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:16.212 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 4, 2024-03-23T23:57:16.212 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:57:16.212 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:57:16.212 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:57:16.212 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:57:16.212 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:57:16.212 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:57:16.212 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:57:16.213 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:57:16.213 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:57:16.213 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:57:16.213 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:57:16.213 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:57:16.213 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:57:16.213 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:57:16.213 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:16.213 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:57:16.213 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:57:16.213 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:57:16.213 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:57:16.213 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:57:16.213 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:57:16.214 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:57:16.214 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:57:16.214 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:57:16.214 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:57:16.214 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:57:16.214 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:57:16.214 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:57:16.214 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:16.214 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:16.214 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:57:16.214 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:57:16.214 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:57:16.214 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:57:16.214 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:57:16.215 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:57:16.215 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:57:16.215 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:57:16.215 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:57:16.215 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:57:16.215 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:57:16.215 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:57:16.215 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:57:16.215 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:57:16.215 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:57:16.215 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:57:16.215 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:57:16.215 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:57:16.215 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:57:16.216 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:57:16.216 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:57:16.216 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:57:16.216 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:57:16.216 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:57:16.216 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:57:16.216 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:57:16.216 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:57:16.216 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:57:16.216 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:16.216 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:57:16.216 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:16.216 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:57:16.217 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:16.217 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:57:16.217 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:57:16.217 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:57:16.217 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:57:16.217 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:16.217 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:57:16.217 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:57:16.217 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:16.217 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:16.217 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:16.217 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:57:16.217 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:57:16.217 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:16.218 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:16.218 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:16.218 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:16.218 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:57:16.218 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:57:16.218 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:57:16.218 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:57:16.218 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:57:16.218 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:16.218 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:16.218 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:57:16.218 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:57:16.218 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:57:16.218 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:57:16.219 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:16.219 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:57:16.219 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:57:16.219 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:16.219 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:16.219 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:16.219 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:57:16.219 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:57:16.219 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:16.219 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:16.219 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:16.219 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:16.219 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:57:16.220 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:57:16.220 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:57:16.220 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:57:16.220 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:57:16.220 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:16.220 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:16.220 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:57:16.220 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:57:16.220 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:57:16.220 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:57:16.220 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:16.220 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:57:16.220 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:57:16.220 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:16.221 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:16.221 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:16.221 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:57:16.221 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:57:16.221 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:16.221 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:16.221 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:16.221 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:16.221 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:57:16.221 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:57:16.221 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:57:16.221 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:57:16.221 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:57:16.221 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:16.222 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:16.222 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:16.222 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:57:16.222 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:57:16.222 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:16.222 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:57:16.222 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:16.222 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:57:16.222 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:16.222 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:16.222 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:57:16.222 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:16.222 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:57:16.222 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:16.223 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:57:16.223 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:16.223 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:16.223 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:16.223 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:57:16.223 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:57:16.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.207+0000 7f57a7e00640 1 -- 172.21.15.8:0/1516702234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5788006f10 msgr2=0x7f57880073a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:57:16.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.207+0000 7f57a7e00640 1 --2- 172.21.15.8:0/1516702234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5788006f10 0x7f57880073a0 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f579c016000 tx=0x7f579c001030 comp rx=0 tx=0).stop 2024-03-23T23:57:16.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.215+0000 7f57b5c00640 1 -- 172.21.15.8:0/1516702234 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5790067660 msgr2=0x7f5790069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:16.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.215+0000 7f57b5c00640 1 --2- 172.21.15.8:0/1516702234 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5790067660 0x7f5790069b20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f57a0009870 tx=0x7f57a00aa070 comp rx=0 tx=0).stop 2024-03-23T23:57:16.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.215+0000 7f57b5c00640 1 -- 172.21.15.8:0/1516702234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57b0072b30 msgr2=0x7f57b00aa320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:16.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.215+0000 7f57b5c00640 1 --2- 172.21.15.8:0/1516702234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57b0072b30 0x7f57b00aa320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f57a800ebc0 tx=0x7f57a800c490 comp rx=0 tx=0).stop 2024-03-23T23:57:16.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.219+0000 7f57b5200640 1 -- 172.21.15.8:0/1516702234 reap_dead start 2024-03-23T23:57:16.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.219+0000 7f57b5c00640 1 -- 172.21.15.8:0/1516702234 shutdown_connections 2024-03-23T23:57:16.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.219+0000 7f57b5c00640 1 -- 172.21.15.8:0/1516702234 >> 172.21.15.8:0/1516702234 conn(0x7f57b00c3910 msgr2=0x7f57b00c3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:57:16.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.223+0000 7f57b5c00640 1 -- 172.21.15.8:0/1516702234 shutdown_connections 2024-03-23T23:57:16.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.223+0000 7f57b5c00640 1 -- 172.21.15.8:0/1516702234 wait complete. 2024-03-23T23:57:16.310 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:57:16.311 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-03-23T23:57:16.311 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-03-23T23:57:16.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.787+0000 7f0d63200640 1 Processor -- start 2024-03-23T23:57:16.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.791+0000 7f0d63200640 1 -- start start 2024-03-23T23:57:16.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.795+0000 7f0d63200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0d580d3c40 0x7f0d580496e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:16.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.795+0000 7f0d63200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d580d71f0 con 0x7f0d5804ae60 2024-03-23T23:57:16.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.795+0000 7f0d63200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d58046970 con 0x7f0d5804b2f0 2024-03-23T23:57:16.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.795+0000 7f0d63200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d580d6fa0 con 0x7f0d580d3c40 2024-03-23T23:57:16.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.795+0000 7f0d61e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0d580d3c40 0x7f0d580496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:16.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.795+0000 7f0d61e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0d580d3c40 0x7f0d580496e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:60072/0 (socket says 172.21.15.8:60072) 2024-03-23T23:57:16.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.795+0000 7f0d61e00640 1 -- 172.21.15.8:0/2503077711 learned_addr learned my addr 172.21.15.8:0/2503077711 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:57:16.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.795+0000 7f0d60a00640 1 -- 172.21.15.8:0/2503077711 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2383344661 0 0) 0x7f0d58046970 con 0x7f0d5804b2f0 2024-03-23T23:57:16.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.795+0000 7f0d60a00640 1 -- 172.21.15.8:0/2503077711 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d44003530 con 0x7f0d5804b2f0 2024-03-23T23:57:16.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.799+0000 7f0d61e00640 1 -- 172.21.15.8:0/2503077711 >> v1:172.21.15.196:6789/0 conn(0x7f0d5804b2f0 legacy=0x7f0d580e0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:16.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.799+0000 7f0d61e00640 1 -- 172.21.15.8:0/2503077711 >> v1:172.21.15.8:6789/0 conn(0x7f0d5804ae60 legacy=0x7f0d58006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:57:16.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.799+0000 7f0d61e00640 1 -- 172.21.15.8:0/2503077711 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5802e0d0 con 0x7f0d580d3c40 2024-03-23T23:57:16.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.811+0000 7f0d61e00640 1 --2- 172.21.15.8:0/2503077711 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0d580d3c40 0x7f0d580496e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c00dc90 tx=0x7f0d4c020730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f25948da3e1aa963 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:16.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.819+0000 7f0d60a00640 1 -- 172.21.15.8:0/2503077711 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c0b0070 con 0x7f0d580d3c40 2024-03-23T23:57:16.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.819+0000 7f0d60a00640 1 -- 172.21.15.8:0/2503077711 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4c00b450 con 0x7f0d580d3c40 2024-03-23T23:57:16.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.819+0000 7f0d60a00640 1 -- 172.21.15.8:0/2503077711 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c00d2d0 con 0x7f0d580d3c40 2024-03-23T23:57:16.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.823+0000 7f0d63200640 1 -- 172.21.15.8:0/2503077711 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0d580d3c40 msgr2=0x7f0d580496e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:16.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.823+0000 7f0d63200640 1 --2- 172.21.15.8:0/2503077711 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0d580d3c40 0x7f0d580496e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c00dc90 tx=0x7f0d4c020730 comp rx=0 tx=0).stop 2024-03-23T23:57:16.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.827+0000 7f0d63200640 1 -- 172.21.15.8:0/2503077711 shutdown_connections 2024-03-23T23:57:16.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.827+0000 7f0d63200640 1 --2- 172.21.15.8:0/2503077711 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0d580d3c40 0x7f0d580496e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:16.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.827+0000 7f0d63200640 1 -- 172.21.15.8:0/2503077711 >> 172.21.15.8:0/2503077711 conn(0x7f0d58005ef0 msgr2=0x7f0d58006300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:57:16.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.831+0000 7f0d63200640 1 -- 172.21.15.8:0/2503077711 shutdown_connections 2024-03-23T23:57:16.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.831+0000 7f0d63200640 1 -- 172.21.15.8:0/2503077711 wait complete. 2024-03-23T23:57:16.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.835+0000 7f0d63200640 1 Processor -- start 2024-03-23T23:57:16.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.839+0000 7f0d63200640 1 -- start start 2024-03-23T23:57:16.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.843+0000 7f0d63200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d5804ae60 0x7f0d5817a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:16.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.843+0000 7f0d63200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d5804b2f0 0x7f0d580d2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:16.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.843+0000 7f0d63200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0d580d3c40 0x7f0d580d2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:16.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.843+0000 7f0d63200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d580d74d0 con 0x7f0d5804ae60 2024-03-23T23:57:16.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.843+0000 7f0d63200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d58007850 con 0x7f0d580d3c40 2024-03-23T23:57:16.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.843+0000 7f0d63200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d58046ce0 con 0x7f0d5804b2f0 2024-03-23T23:57:16.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.847+0000 7f0d61e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d5804ae60 0x7f0d5817a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:16.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.847+0000 7f0d61e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d5804ae60 0x7f0d5817a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41104/0 (socket says 172.21.15.8:41104) 2024-03-23T23:57:16.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.847+0000 7f0d61e00640 1 -- 172.21.15.8:0/2072926095 learned_addr learned my addr 172.21.15.8:0/2072926095 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:57:16.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.847+0000 7f0d61e00640 1 -- 172.21.15.8:0/2072926095 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d5804b2f0 msgr2=0x7f0d580d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:16.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.847+0000 7f0d61e00640 1 --2- 172.21.15.8:0/2072926095 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d5804b2f0 0x7f0d580d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:16.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.847+0000 7f0d61e00640 1 -- 172.21.15.8:0/2072926095 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0d580d3c40 msgr2=0x7f0d580d2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:16.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.847+0000 7f0d61e00640 1 --2- 172.21.15.8:0/2072926095 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0d580d3c40 0x7f0d580d2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:16.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.847+0000 7f0d61e00640 1 -- 172.21.15.8:0/2072926095 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d58043710 con 0x7f0d5804ae60 2024-03-23T23:57:16.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.851+0000 7f0d61e00640 1 --2- 172.21.15.8:0/2072926095 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d5804ae60 0x7f0d5817a750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c00dc90 tx=0x7f0d4c01d4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:16.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.851+0000 7f0d56000640 1 -- 172.21.15.8:0/2072926095 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c0b0040 con 0x7f0d5804ae60 2024-03-23T23:57:16.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.851+0000 7f0d56000640 1 -- 172.21.15.8:0/2072926095 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4c0be070 con 0x7f0d5804ae60 2024-03-23T23:57:16.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.851+0000 7f0d63200640 1 -- 172.21.15.8:0/2072926095 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d58030dd0 con 0x7f0d5804ae60 2024-03-23T23:57:16.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.855+0000 7f0d63200640 1 -- 172.21.15.8:0/2072926095 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d5817b280 con 0x7f0d5804ae60 2024-03-23T23:57:16.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.855+0000 7f0d56000640 1 -- 172.21.15.8:0/2072926095 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c0b5450 con 0x7f0d5804ae60 2024-03-23T23:57:16.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.863+0000 7f0d63200640 1 -- 172.21.15.8:0/2072926095 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d380052a0 con 0x7f0d5804ae60 2024-03-23T23:57:16.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.863+0000 7f0d56000640 1 -- 172.21.15.8:0/2072926095 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f0d4c0b3070 con 0x7f0d5804ae60 2024-03-23T23:57:16.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.863+0000 7f0d56000640 1 --2- 172.21.15.8:0/2072926095 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0d40067730 0x7f0d40069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:16.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.863+0000 7f0d56000640 1 -- 172.21.15.8:0/2072926095 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f0d4c11fae0 con 0x7f0d5804ae60 2024-03-23T23:57:16.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.867+0000 7f0d61400640 1 --2- 172.21.15.8:0/2072926095 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0d40067730 0x7f0d40069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:16.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.867+0000 7f0d61400640 1 --2- 172.21.15.8:0/2072926095 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0d40067730 0x7f0d40069bf0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0d50007fd0 tx=0x7f0d500079a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:16.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:16.895+0000 7f0d56000640 1 -- 172.21.15.8:0/2072926095 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f0d4c01a440 con 0x7f0d5804ae60 2024-03-23T23:57:17.328 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:57:17.336 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:57:18.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:18.247+0000 7f0d63200640 1 -- 172.21.15.8:0/2072926095 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f0d38005da0 con 0x7f0d5804ae60 2024-03-23T23:57:18.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:18.255+0000 7f0d56000640 1 -- 172.21.15.8:0/2072926095 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f0d4c0f04a0 con 0x7f0d5804ae60 2024-03-23T23:57:18.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:18.275+0000 7f0d63200640 1 -- 172.21.15.8:0/2072926095 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0d40067730 msgr2=0x7f0d40069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:18.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:18.275+0000 7f0d63200640 1 --2- 172.21.15.8:0/2072926095 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0d40067730 0x7f0d40069bf0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0d50007fd0 tx=0x7f0d500079a0 comp rx=0 tx=0).stop 2024-03-23T23:57:18.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:18.275+0000 7f0d63200640 1 -- 172.21.15.8:0/2072926095 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d5804ae60 msgr2=0x7f0d5817a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:18.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:18.275+0000 7f0d63200640 1 --2- 172.21.15.8:0/2072926095 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d5804ae60 0x7f0d5817a750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c00dc90 tx=0x7f0d4c01d4d0 comp rx=0 tx=0).stop 2024-03-23T23:57:18.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:18.275+0000 7f0d63200640 1 -- 172.21.15.8:0/2072926095 shutdown_connections 2024-03-23T23:57:18.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:18.275+0000 7f0d63200640 1 --2- 172.21.15.8:0/2072926095 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0d580d3c40 0x7f0d580d2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:18.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:18.275+0000 7f0d63200640 1 --2- 172.21.15.8:0/2072926095 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0d40067730 0x7f0d40069bf0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:18.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:18.275+0000 7f0d63200640 1 --2- 172.21.15.8:0/2072926095 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d5804b2f0 0x7f0d580d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:18.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:18.275+0000 7f0d63200640 1 --2- 172.21.15.8:0/2072926095 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d5804ae60 0x7f0d5817a750 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:18.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:18.275+0000 7f0d63200640 1 -- 172.21.15.8:0/2072926095 >> 172.21.15.8:0/2072926095 conn(0x7f0d58005ef0 msgr2=0x7f0d5802c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:57:18.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:18.279+0000 7f0d63200640 1 -- 172.21.15.8:0/2072926095 shutdown_connections 2024-03-23T23:57:18.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:18.279+0000 7f0d63200640 1 -- 172.21.15.8:0/2072926095 wait complete. 2024-03-23T23:57:18.362 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-03-23T23:57:28.363 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T23:57:28.364 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:57:28.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.651+0000 7f45cfe00640 1 Processor -- start 2024-03-23T23:57:28.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.651+0000 7f45cfe00640 1 -- start start 2024-03-23T23:57:28.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.651+0000 7f45cfe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45d0156f80 0x7f45d0072b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:28.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.651+0000 7f45cfe00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d0071d50 con 0x7f45d0071450 2024-03-23T23:57:28.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.651+0000 7f45cfe00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d0072030 con 0x7f45d006c940 2024-03-23T23:57:28.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.651+0000 7f45cfe00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d0072310 con 0x7f45d0156f80 2024-03-23T23:57:28.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.651+0000 7f45cf400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f45d0071450 0x7f45d006d0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:54654/0 (socket says 172.21.15.8:54654) 2024-03-23T23:57:28.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.651+0000 7f45cf400640 1 -- 172.21.15.8:0/1436035709 learned_addr learned my addr 172.21.15.8:0/1436035709 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:57:28.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.655+0000 7f45cd600640 1 -- 172.21.15.8:0/1436035709 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3190669569 0 0) 0x7f45d0072030 con 0x7f45d006c940 2024-03-23T23:57:28.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.655+0000 7f45cd600640 1 -- 172.21.15.8:0/1436035709 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45b4003530 con 0x7f45d006c940 2024-03-23T23:57:28.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.655+0000 7f45cd600640 1 -- 172.21.15.8:0/1436035709 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3365884360 0 0) 0x7f45d0071d50 con 0x7f45d0071450 2024-03-23T23:57:28.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.655+0000 7f45cd600640 1 -- 172.21.15.8:0/1436035709 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45d0072030 con 0x7f45d0071450 2024-03-23T23:57:28.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.655+0000 7f45cd600640 1 -- 172.21.15.8:0/1436035709 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4260947234 0 0) 0x7f45d0072030 con 0x7f45d0071450 2024-03-23T23:57:28.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.655+0000 7f45cd600640 1 -- 172.21.15.8:0/1436035709 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45d0156f80 msgr2=0x7f45d0072b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:57:28.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.655+0000 7f45cd600640 1 --2- 172.21.15.8:0/1436035709 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45d0156f80 0x7f45d0072b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:28.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.655+0000 7f45cd600640 1 -- 172.21.15.8:0/1436035709 >> v1:172.21.15.196:6789/0 conn(0x7f45d006c940 legacy=0x7f45d00c1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:28.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.655+0000 7f45cd600640 1 -- 172.21.15.8:0/1436035709 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d00725f0 con 0x7f45d0071450 2024-03-23T23:57:28.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.655+0000 7f45cd600640 1 -- 172.21.15.8:0/1436035709 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7f45c8001680 con 0x7f45d0071450 2024-03-23T23:57:28.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.655+0000 7f45cd600640 1 -- 172.21.15.8:0/1436035709 >> v1:172.21.15.8:6789/0 conn(0x7f45d0071450 legacy=0x7f45d006d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:28.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.655+0000 7f45cd600640 1 --2- 172.21.15.8:0/1436035709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45b4004be0 0x7f45b4004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:28.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.655+0000 7f45cd600640 1 --2- 172.21.15.8:0/1436035709 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45b40037b0 0x7f45b4003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:28.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.655+0000 7f45cd600640 1 --2- 172.21.15.8:0/1436035709 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45b4004290 0x7f45b400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:28.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.655+0000 7f45cd600640 1 -- 172.21.15.8:0/1436035709 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d0072310 con 0x7f45b4004be0 2024-03-23T23:57:28.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.655+0000 7f45cd600640 1 -- 172.21.15.8:0/1436035709 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b400c1a0 con 0x7f45b40037b0 2024-03-23T23:57:28.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.655+0000 7f45cd600640 1 -- 172.21.15.8:0/1436035709 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b400c3a0 con 0x7f45b4004290 2024-03-23T23:57:28.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.655+0000 7f45cea00640 1 --2- 172.21.15.8:0/1436035709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45b4004be0 0x7f45b4004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:28.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.659+0000 7f45ce000640 1 --2- 172.21.15.8:0/1436035709 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45b40037b0 0x7f45b4003c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:28.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.659+0000 7f45cea00640 1 -- 172.21.15.8:0/1436035709 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45b4004290 msgr2=0x7f45b400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:57:28.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.659+0000 7f45cea00640 1 --2- 172.21.15.8:0/1436035709 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45b4004290 0x7f45b400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:28.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.659+0000 7f45cea00640 1 -- 172.21.15.8:0/1436035709 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45b40037b0 msgr2=0x7f45b4003c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:57:28.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.659+0000 7f45cea00640 1 --2- 172.21.15.8:0/1436035709 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45b40037b0 0x7f45b4003c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:28.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.659+0000 7f45cea00640 1 -- 172.21.15.8:0/1436035709 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d0072030 con 0x7f45b4004be0 2024-03-23T23:57:28.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.667+0000 7f45cea00640 1 --2- 172.21.15.8:0/1436035709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45b4004be0 0x7f45b4004fe0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f45d0070d70 tx=0x7f45c001cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d0aa241f61c652c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:28.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.667+0000 7f45cd600640 1 -- 172.21.15.8:0/1436035709 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c00b2070 con 0x7f45b4004be0 2024-03-23T23:57:28.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.667+0000 7f45cd600640 1 -- 172.21.15.8:0/1436035709 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c00a5ba0 con 0x7f45b4004be0 2024-03-23T23:57:28.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.667+0000 7f45cd600640 1 -- 172.21.15.8:0/1436035709 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c0009a30 con 0x7f45b4004be0 2024-03-23T23:57:28.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.667+0000 7f45cfe00640 1 -- 172.21.15.8:0/1436035709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45b4004be0 msgr2=0x7f45b4004fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:28.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.667+0000 7f45cfe00640 1 --2- 172.21.15.8:0/1436035709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45b4004be0 0x7f45b4004fe0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f45d0070d70 tx=0x7f45c001cd90 comp rx=0 tx=0).stop 2024-03-23T23:57:28.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.667+0000 7f45cf400640 1 -- 172.21.15.8:0/1436035709 reap_dead start 2024-03-23T23:57:28.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.671+0000 7f45cfe00640 1 -- 172.21.15.8:0/1436035709 shutdown_connections 2024-03-23T23:57:28.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.671+0000 7f45cfe00640 1 -- 172.21.15.8:0/1436035709 >> 172.21.15.8:0/1436035709 conn(0x7f45d00c6e10 msgr2=0x7f45d00c7220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:57:28.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.675+0000 7f45cfe00640 1 -- 172.21.15.8:0/1436035709 shutdown_connections 2024-03-23T23:57:28.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.675+0000 7f45cfe00640 1 -- 172.21.15.8:0/1436035709 wait complete. 2024-03-23T23:57:28.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.675+0000 7f45cfe00640 1 Processor -- start 2024-03-23T23:57:28.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.675+0000 7f45cfe00640 1 -- start start 2024-03-23T23:57:28.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.679+0000 7f45cfe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45b4004be0 0x7f45d0150640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:28.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.679+0000 7f45cfe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45d00c1120 0x7f45d01f6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:28.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.679+0000 7f45cfe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45d0150b80 0x7f45d01f65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:28.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.679+0000 7f45cea00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45b4004be0 0x7f45d0150640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:28.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.679+0000 7f45cea00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45b4004be0 0x7f45d0150640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:36132/0 (socket says 172.21.15.8:36132) 2024-03-23T23:57:28.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.679+0000 7f45cf400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45d0150b80 0x7f45d01f65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:28.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.679+0000 7f45cf400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45d0150b80 0x7f45d01f65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36058/0 (socket says 172.21.15.8:36058) 2024-03-23T23:57:28.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.679+0000 7f45cea00640 1 -- 172.21.15.8:0/3100153096 learned_addr learned my addr 172.21.15.8:0/3100153096 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:57:28.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.679+0000 7f45cfe00640 1 -- 172.21.15.8:0/3100153096 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d015d0d0 con 0x7f45d0150b80 2024-03-23T23:57:28.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.679+0000 7f45cfe00640 1 -- 172.21.15.8:0/3100153096 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d015cf50 con 0x7f45b4004be0 2024-03-23T23:57:28.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.679+0000 7f45cfe00640 1 -- 172.21.15.8:0/3100153096 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d0165b00 con 0x7f45d00c1120 2024-03-23T23:57:28.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.679+0000 7f45ce000640 1 --2- 172.21.15.8:0/3100153096 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45d00c1120 0x7f45d01f6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:28.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.683+0000 7f45cf400640 1 -- 172.21.15.8:0/3100153096 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45d00c1120 msgr2=0x7f45d01f6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:28.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.683+0000 7f45cf400640 1 --2- 172.21.15.8:0/3100153096 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45d00c1120 0x7f45d01f6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:28.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.683+0000 7f45cf400640 1 -- 172.21.15.8:0/3100153096 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45b4004be0 msgr2=0x7f45d0150640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:28.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.683+0000 7f45cf400640 1 --2- 172.21.15.8:0/3100153096 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45b4004be0 0x7f45d0150640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:28.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.683+0000 7f45cf400640 1 -- 172.21.15.8:0/3100153096 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d01f6bc0 con 0x7f45d0150b80 2024-03-23T23:57:28.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.683+0000 7f45cf400640 1 --2- 172.21.15.8:0/3100153096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45d0150b80 0x7f45d01f65c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f45d00c1540 tx=0x7f45c800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:28.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.683+0000 7f45c6a00640 1 -- 172.21.15.8:0/3100153096 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c80074e0 con 0x7f45d0150b80 2024-03-23T23:57:28.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.683+0000 7f45c6a00640 1 -- 172.21.15.8:0/3100153096 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c80047f0 con 0x7f45d0150b80 2024-03-23T23:57:28.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.683+0000 7f45c6a00640 1 -- 172.21.15.8:0/3100153096 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c8007680 con 0x7f45d0150b80 2024-03-23T23:57:28.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.683+0000 7f45cfe00640 1 -- 172.21.15.8:0/3100153096 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d01f6ea0 con 0x7f45d0150b80 2024-03-23T23:57:28.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.683+0000 7f45cfe00640 1 -- 172.21.15.8:0/3100153096 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d00a97f0 con 0x7f45d0150b80 2024-03-23T23:57:28.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.687+0000 7f45bbe00640 1 -- 172.21.15.8:0/3100153096 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a40052a0 con 0x7f45d0150b80 2024-03-23T23:57:28.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.691+0000 7f45c6a00640 1 -- 172.21.15.8:0/3100153096 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f45c8004be0 con 0x7f45d0150b80 2024-03-23T23:57:28.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.691+0000 7f45c6a00640 1 --2- 172.21.15.8:0/3100153096 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f45b0067730 0x7f45b0069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:28.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.699+0000 7f45cea00640 1 --2- 172.21.15.8:0/3100153096 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f45b0067730 0x7f45b0069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:28.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.699+0000 7f45c6a00640 1 -- 172.21.15.8:0/3100153096 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f45c80855b0 con 0x7f45d0150b80 2024-03-23T23:57:28.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.703+0000 7f45cea00640 1 --2- 172.21.15.8:0/3100153096 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f45b0067730 0x7f45b0069bf0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f45c001cbc0 tx=0x7f45c0004b60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:28.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:28.707+0000 7f45c6a00640 1 -- 172.21.15.8:0/3100153096 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f45c8055ee0 con 0x7f45d0150b80 2024-03-23T23:57:29.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.259+0000 7f45bbe00640 1 -- 172.21.15.8:0/3100153096 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f45a4005590 con 0x7f45d0150b80 2024-03-23T23:57:29.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.259+0000 7f45c6a00640 1 -- 172.21.15.8:0/3100153096 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1562 (secure 0 0 0) 0x7f45c80557e0 con 0x7f45d0150b80 2024-03-23T23:57:29.265 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":116,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:57:29.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.271+0000 7f45bbe00640 1 -- 172.21.15.8:0/3100153096 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f45b0067730 msgr2=0x7f45b0069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:29.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.271+0000 7f45bbe00640 1 --2- 172.21.15.8:0/3100153096 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f45b0067730 0x7f45b0069bf0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f45c001cbc0 tx=0x7f45c0004b60 comp rx=0 tx=0).stop 2024-03-23T23:57:29.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.271+0000 7f45bbe00640 1 -- 172.21.15.8:0/3100153096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45d0150b80 msgr2=0x7f45d01f65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:29.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.271+0000 7f45bbe00640 1 --2- 172.21.15.8:0/3100153096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45d0150b80 0x7f45d01f65c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f45d00c1540 tx=0x7f45c800c890 comp rx=0 tx=0).stop 2024-03-23T23:57:29.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.271+0000 7f45bbe00640 1 -- 172.21.15.8:0/3100153096 shutdown_connections 2024-03-23T23:57:29.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.271+0000 7f45bbe00640 1 --2- 172.21.15.8:0/3100153096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45d0150b80 0x7f45d01f65c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:29.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.271+0000 7f45bbe00640 1 --2- 172.21.15.8:0/3100153096 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f45b0067730 0x7f45b0069bf0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:29.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.271+0000 7f45bbe00640 1 --2- 172.21.15.8:0/3100153096 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45d00c1120 0x7f45d01f6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:29.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.271+0000 7f45bbe00640 1 --2- 172.21.15.8:0/3100153096 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45b4004be0 0x7f45d0150640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:29.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.271+0000 7f45bbe00640 1 -- 172.21.15.8:0/3100153096 >> 172.21.15.8:0/3100153096 conn(0x7f45d00c6e10 msgr2=0x7f45d015af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:57:29.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.271+0000 7f45bbe00640 1 -- 172.21.15.8:0/3100153096 shutdown_connections 2024-03-23T23:57:29.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.271+0000 7f45bbe00640 1 -- 172.21.15.8:0/3100153096 wait complete. 2024-03-23T23:57:29.322 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T23:57:29.322 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-03-23T23:57:29.322 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T23:57:29.322 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:57:29.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.587+0000 7f9f9de00640 1 Processor -- start 2024-03-23T23:57:29.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.591+0000 7f9f9de00640 1 -- start start 2024-03-23T23:57:29.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.591+0000 7f9f9de00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9f9806dcb0 0x7f9f981517b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:29.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.591+0000 7f9f9de00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9f98072ff0 0x7f9f98151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:29.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.591+0000 7f9f9de00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f9806e1d0 con 0x7f9f9814ef10 2024-03-23T23:57:29.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.595+0000 7f9f9de00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f9806d940 con 0x7f9f98072ff0 2024-03-23T23:57:29.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.595+0000 7f9f9de00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f98152510 con 0x7f9f9806dcb0 2024-03-23T23:57:29.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.595+0000 7f9f9ca00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f9f9814ef10 0x7f9f980c1ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:51482/0 (socket says 172.21.15.8:51482) 2024-03-23T23:57:29.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.595+0000 7f9f9ca00640 1 -- 172.21.15.8:0/2929719046 learned_addr learned my addr 172.21.15.8:0/2929719046 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:57:29.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.595+0000 7f9f97400640 1 -- 172.21.15.8:0/2929719046 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 677084869 0 0) 0x7f9f9806e1d0 con 0x7f9f9814ef10 2024-03-23T23:57:29.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.595+0000 7f9f97400640 1 -- 172.21.15.8:0/2929719046 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f7c003530 con 0x7f9f9814ef10 2024-03-23T23:57:29.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.595+0000 7f9f9d400640 1 --2- 172.21.15.8:0/2929719046 >> v2:172.21.15.8:3300/0 conn(0x7f9f98072ff0 0x7f9f98151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:29.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.599+0000 7f9f9d400640 1 -- 172.21.15.8:0/2929719046 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9f9806dcb0 msgr2=0x7f9f981517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:57:29.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.599+0000 7f9f9d400640 1 --2- 172.21.15.8:0/2929719046 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9f9806dcb0 0x7f9f981517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:29.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.599+0000 7f9f9d400640 1 -- 172.21.15.8:0/2929719046 >> v1:172.21.15.196:6789/0 conn(0x7f9f9814ef10 legacy=0x7f9f980c1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:29.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.599+0000 7f9f9d400640 1 -- 172.21.15.8:0/2929719046 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f98152230 con 0x7f9f98072ff0 2024-03-23T23:57:29.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.607+0000 7f9f9d400640 1 --2- 172.21.15.8:0/2929719046 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f98072ff0 0x7f9f98151cf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9f880097c0 tx=0x7f9f8801d640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db172d2830ea11c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:29.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.611+0000 7f9f97400640 1 -- 172.21.15.8:0/2929719046 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f880ad070 con 0x7f9f98072ff0 2024-03-23T23:57:29.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.611+0000 7f9f97400640 1 -- 172.21.15.8:0/2929719046 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f880a7630 con 0x7f9f98072ff0 2024-03-23T23:57:29.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.611+0000 7f9f97400640 1 -- 172.21.15.8:0/2929719046 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f880a7a00 con 0x7f9f98072ff0 2024-03-23T23:57:29.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.611+0000 7f9f9de00640 1 -- 172.21.15.8:0/2929719046 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f98072ff0 msgr2=0x7f9f98151cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:29.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.611+0000 7f9f9de00640 1 --2- 172.21.15.8:0/2929719046 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f98072ff0 0x7f9f98151cf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9f880097c0 tx=0x7f9f8801d640 comp rx=0 tx=0).stop 2024-03-23T23:57:29.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.611+0000 7f9f9de00640 1 -- 172.21.15.8:0/2929719046 shutdown_connections 2024-03-23T23:57:29.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.611+0000 7f9f9de00640 1 --2- 172.21.15.8:0/2929719046 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f98072ff0 0x7f9f98151cf0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:29.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.611+0000 7f9f9de00640 1 --2- 172.21.15.8:0/2929719046 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9f9806dcb0 0x7f9f981517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:29.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.611+0000 7f9f9de00640 1 -- 172.21.15.8:0/2929719046 >> 172.21.15.8:0/2929719046 conn(0x7f9f9806b170 msgr2=0x7f9f9806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:57:29.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.615+0000 7f9f9de00640 1 -- 172.21.15.8:0/2929719046 shutdown_connections 2024-03-23T23:57:29.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.615+0000 7f9f9de00640 1 -- 172.21.15.8:0/2929719046 wait complete. 2024-03-23T23:57:29.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.619+0000 7f9f9de00640 1 Processor -- start 2024-03-23T23:57:29.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.619+0000 7f9f9de00640 1 -- start start 2024-03-23T23:57:29.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.623+0000 7f9f9de00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f9806dcb0 0x7f9f98155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:29.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.623+0000 7f9f9de00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9f98072ff0 0x7f9f9815a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:29.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.623+0000 7f9f9de00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9f9814ef10 0x7f9f980ac310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:29.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.623+0000 7f9f9de00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9815ec40 con 0x7f9f9806dcb0 2024-03-23T23:57:29.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.623+0000 7f9f9de00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9815eac0 con 0x7f9f9814ef10 2024-03-23T23:57:29.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.623+0000 7f9f9de00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9815edc0 con 0x7f9f98072ff0 2024-03-23T23:57:29.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.623+0000 7f9f97e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9f98072ff0 0x7f9f9815a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:29.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.623+0000 7f9f97e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9f98072ff0 0x7f9f9815a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:57744/0 (socket says 172.21.15.8:57744) 2024-03-23T23:57:29.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.623+0000 7f9f97e00640 1 -- 172.21.15.8:0/392011819 learned_addr learned my addr 172.21.15.8:0/392011819 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:57:29.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.627+0000 7f9f9d400640 1 --2- 172.21.15.8:0/392011819 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9f9814ef10 0x7f9f980ac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:29.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.627+0000 7f9f9d400640 1 -- 172.21.15.8:0/392011819 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9f98072ff0 msgr2=0x7f9f9815a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:29.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.627+0000 7f9f9d400640 1 --2- 172.21.15.8:0/392011819 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9f98072ff0 0x7f9f9815a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:29.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.627+0000 7f9f9d400640 1 -- 172.21.15.8:0/392011819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f9806dcb0 msgr2=0x7f9f98155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:29.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.627+0000 7f9f9d400640 1 --2- 172.21.15.8:0/392011819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f9806dcb0 0x7f9f98155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:29.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.627+0000 7f9f9d400640 1 -- 172.21.15.8:0/392011819 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f980c6c30 con 0x7f9f9814ef10 2024-03-23T23:57:29.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.627+0000 7f9f9d400640 1 --2- 172.21.15.8:0/392011819 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9f9814ef10 0x7f9f980ac310 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9f880ac000 tx=0x7f9f8801a3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:29.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.635+0000 7f9f94c00640 1 -- 172.21.15.8:0/392011819 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f880ad050 con 0x7f9f9814ef10 2024-03-23T23:57:29.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.635+0000 7f9f94c00640 1 -- 172.21.15.8:0/392011819 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f880b6070 con 0x7f9f9814ef10 2024-03-23T23:57:29.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.635+0000 7f9f94c00640 1 -- 172.21.15.8:0/392011819 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f880b2a60 con 0x7f9f9814ef10 2024-03-23T23:57:29.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.635+0000 7f9f9de00640 1 -- 172.21.15.8:0/392011819 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9813b960 con 0x7f9f9814ef10 2024-03-23T23:57:29.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.635+0000 7f9f9de00640 1 -- 172.21.15.8:0/392011819 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f981ef2d0 con 0x7f9f9814ef10 2024-03-23T23:57:29.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.635+0000 7f9f9de00640 1 --2- 172.21.15.8:0/392011819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f9813ce20 0x7f9f980ac850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:29.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.635+0000 7f9f9de00640 1 -- 172.21.15.8:0/392011819 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f981eee20 con 0x7f9f9813ce20 2024-03-23T23:57:29.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.639+0000 7f9f9ca00640 1 --2- 172.21.15.8:0/392011819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f9813ce20 0x7f9f980ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:29.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.639+0000 7f9f9ca00640 1 -- 172.21.15.8:0/392011819 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9f9813bb30 con 0x7f9f9813ce20 2024-03-23T23:57:29.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.639+0000 7f9f9ca00640 1 --2- 172.21.15.8:0/392011819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f9813ce20 0x7f9f980ac850 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000c9d0 tx=0x7f9f9000ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:29.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.639+0000 7f9f94c00640 1 -- 172.21.15.8:0/392011819 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f9f880b0070 con 0x7f9f9814ef10 2024-03-23T23:57:29.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.643+0000 7f9f94c00640 1 --2- 172.21.15.8:0/392011819 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9f78067660 0x7f9f78069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:29.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.643+0000 7f9f94c00640 1 -- 172.21.15.8:0/392011819 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f9f8811fe10 con 0x7f9f9814ef10 2024-03-23T23:57:29.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.643+0000 7f9f94c00640 1 -- 172.21.15.8:0/392011819 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f90017070 con 0x7f9f9813ce20 2024-03-23T23:57:29.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.643+0000 7f9f97e00640 1 --2- 172.21.15.8:0/392011819 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9f78067660 0x7f9f78069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:29.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.643+0000 7f9f94c00640 1 -- 172.21.15.8:0/392011819 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f9f9000ab90 con 0x7f9f9813ce20 2024-03-23T23:57:29.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.643+0000 7f9f94c00640 1 -- 172.21.15.8:0/392011819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f9813ce20 msgr2=0x7f9f980ac850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:29.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.643+0000 7f9f94c00640 1 --2- 172.21.15.8:0/392011819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f9813ce20 0x7f9f980ac850 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000c9d0 tx=0x7f9f9000ce90 comp rx=0 tx=0).stop 2024-03-23T23:57:29.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.643+0000 7f9f94c00640 1 -- 172.21.15.8:0/392011819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f9813ce20 msgr2=0x7f9f980ac850 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:57:29.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.643+0000 7f9f94c00640 1 --2- 172.21.15.8:0/392011819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f9813ce20 0x7f9f980ac850 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000c9d0 tx=0x7f9f9000ce90 comp rx=0 tx=0).stop 2024-03-23T23:57:29.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.647+0000 7f9f97e00640 1 --2- 172.21.15.8:0/392011819 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9f78067660 0x7f9f78069b20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9f9814b9c0 tx=0x7f9f84009210 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:29.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.659+0000 7f9f9de00640 1 --2- 172.21.15.8:0/392011819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f9813be40 0x7f9f9813c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:29.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.659+0000 7f9f9de00640 1 -- 172.21.15.8:0/392011819 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9804f410 con 0x7f9f9813be40 2024-03-23T23:57:29.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.659+0000 7f9f9ca00640 1 --2- 172.21.15.8:0/392011819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f9813be40 0x7f9f9813c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:29.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.663+0000 7f9f9ca00640 1 -- 172.21.15.8:0/392011819 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9f9806cf60 con 0x7f9f9813be40 2024-03-23T23:57:29.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.667+0000 7f9f9ca00640 1 --2- 172.21.15.8:0/392011819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f9813be40 0x7f9f9813c250 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9f90005c10 tx=0x7f9f900014e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:29.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.671+0000 7f9f94c00640 1 -- 172.21.15.8:0/392011819 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f90017040 con 0x7f9f9813be40 2024-03-23T23:57:29.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.671+0000 7f9f94c00640 1 -- 172.21.15.8:0/392011819 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4873 (secure 0 0 0) 0x7f9f9000ad40 con 0x7f9f9813be40 2024-03-23T23:57:29.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.671+0000 7f9f94c00640 1 -- 172.21.15.8:0/392011819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f9813be40 msgr2=0x7f9f9813c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:29.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.671+0000 7f9f94c00640 1 --2- 172.21.15.8:0/392011819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f9813be40 0x7f9f9813c250 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9f90005c10 tx=0x7f9f900014e0 comp rx=0 tx=0).stop 2024-03-23T23:57:29.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.671+0000 7f9f94c00640 1 -- 172.21.15.8:0/392011819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f9813be40 msgr2=0x7f9f9813c250 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:57:29.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.671+0000 7f9f94c00640 1 --2- 172.21.15.8:0/392011819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f9813be40 0x7f9f9813c250 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9f90005c10 tx=0x7f9f900014e0 comp rx=0 tx=0).stop 2024-03-23T23:57:29.675 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:57:29.675 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:57:29.675 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:57:29.675 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:57:29.676 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 116, 2024-03-23T23:57:29.676 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:57:29.676 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:57:29.676 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:57:29.676 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:57:29.676 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:29.676 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 18, 2024-03-23T23:57:29.676 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:57:29.676 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:57:29.676 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:57:29.676 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:57:29.676 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:57:29.676 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:57:29.677 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:57:29.677 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:57:29.677 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:57:29.677 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:57:29.677 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:57:29.677 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:57:29.677 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:57:29.677 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:57:29.677 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:29.677 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:57:29.677 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:57:29.677 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:57:29.677 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:57:29.678 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:57:29.678 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:57:29.678 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:57:29.678 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:57:29.678 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:57:29.678 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:57:29.678 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:57:29.678 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:57:29.678 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:57:29.678 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:29.678 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:29.678 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:57:29.678 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:57:29.678 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:57:29.679 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:57:29.679 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:57:29.679 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:57:29.679 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:57:29.679 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:57:29.679 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:57:29.679 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:57:29.679 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:57:29.679 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:57:29.679 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:57:29.679 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:57:29.679 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:57:29.679 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:57:29.679 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:57:29.680 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:57:29.680 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:57:29.680 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:57:29.680 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:57:29.680 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:57:29.680 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:57:29.680 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:57:29.680 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:57:29.680 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:57:29.680 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:57:29.680 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:57:29.680 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:29.680 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:57:29.680 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:29.680 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:57:29.681 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:29.681 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:57:29.681 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:57:29.681 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:57:29.681 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:57:29.681 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:29.681 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:57:29.681 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:57:29.681 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:29.681 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:29.681 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:29.681 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:57:29.681 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:57:29.681 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:29.682 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:29.682 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:29.682 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:29.682 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:57:29.682 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:57:29.682 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:57:29.682 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:57:29.682 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:57:29.682 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:29.682 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:29.682 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:57:29.682 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:57:29.682 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:57:29.683 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:57:29.683 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:29.683 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:57:29.683 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:57:29.683 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:29.683 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:29.683 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:29.683 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:57:29.683 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:57:29.683 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:29.683 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:29.683 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:29.683 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:29.683 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:57:29.684 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:57:29.684 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:57:29.684 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:57:29.684 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:57:29.684 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:29.684 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:29.684 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:57:29.684 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:57:29.684 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:57:29.684 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:57:29.684 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:29.684 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:57:29.684 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:57:29.684 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:29.684 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:29.685 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:29.685 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:57:29.685 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:57:29.685 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:29.685 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:29.685 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:29.685 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:29.685 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:57:29.685 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:57:29.685 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:57:29.685 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:57:29.685 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:57:29.685 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:29.685 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:29.686 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:29.686 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:57:29.686 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:57:29.686 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:29.686 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:57:29.686 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:29.686 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:57:29.686 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:29.686 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:29.686 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:57:29.686 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:29.686 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:57:29.686 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:29.687 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5 2024-03-23T23:57:29.687 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:29.687 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:29.687 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:57:29.687 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:29.687 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:57:29.687 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:29.687 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:57:29.687 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:29.687 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:29.687 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:57:29.687 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:29.687 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:57:29.687 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:29.687 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:57:29.688 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:29.688 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:29.688 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:29.688 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:57:29.688 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:57:29.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.671+0000 7f9f9de00640 1 -- 172.21.15.8:0/392011819 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9f78067660 msgr2=0x7f9f78069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:29.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.671+0000 7f9f9de00640 1 --2- 172.21.15.8:0/392011819 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9f78067660 0x7f9f78069b20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9f9814b9c0 tx=0x7f9f84009210 comp rx=0 tx=0).stop 2024-03-23T23:57:29.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.671+0000 7f9f9de00640 1 -- 172.21.15.8:0/392011819 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9f9814ef10 msgr2=0x7f9f980ac310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:29.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.671+0000 7f9f9de00640 1 --2- 172.21.15.8:0/392011819 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9f9814ef10 0x7f9f980ac310 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9f880ac000 tx=0x7f9f8801a3e0 comp rx=0 tx=0).stop 2024-03-23T23:57:29.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.675+0000 7f9f9d400640 1 -- 172.21.15.8:0/392011819 reap_dead start 2024-03-23T23:57:29.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.675+0000 7f9f9d400640 1 -- 172.21.15.8:0/392011819 reap_dead start 2024-03-23T23:57:29.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.675+0000 7f9f9de00640 1 -- 172.21.15.8:0/392011819 shutdown_connections 2024-03-23T23:57:29.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.675+0000 7f9f9de00640 1 -- 172.21.15.8:0/392011819 >> 172.21.15.8:0/392011819 conn(0x7f9f9806b170 msgr2=0x7f9f9814ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:57:29.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.675+0000 7f9f9de00640 1 -- 172.21.15.8:0/392011819 shutdown_connections 2024-03-23T23:57:29.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:29.675+0000 7f9f9de00640 1 -- 172.21.15.8:0/392011819 wait complete. 2024-03-23T23:57:29.719 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:57:29.719 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T23:57:29.719 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:57:30.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.011+0000 7f0818a00640 1 Processor -- start 2024-03-23T23:57:30.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.011+0000 7f0818a00640 1 -- start start 2024-03-23T23:57:30.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.015+0000 7f0818a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0814070be0 0x7f0814156020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:30.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.015+0000 7f0818a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f081406e220 con 0x7f081406d4d0 2024-03-23T23:57:30.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.015+0000 7f0818a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f081406e500 con 0x7f081413ec50 2024-03-23T23:57:30.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.015+0000 7f0813e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0814070be0 0x7f0814156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:30.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.015+0000 7f0813e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0814070be0 0x7f0814156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36108/0 (socket says 172.21.15.8:36108) 2024-03-23T23:57:30.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.015+0000 7f0813e00640 1 -- 172.21.15.8:0/37767793 learned_addr learned my addr 172.21.15.8:0/37767793 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:57:30.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.015+0000 7f0818a00640 1 -- 172.21.15.8:0/37767793 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f081406e7e0 con 0x7f0814070be0 2024-03-23T23:57:30.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.015+0000 7f0813e00640 1 -- 172.21.15.8:0/37767793 >> v1:172.21.15.196:6789/0 conn(0x7f081413ec50 legacy=0x7f08140c2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:57:30.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.015+0000 7f0813e00640 1 -- 172.21.15.8:0/37767793 >> v1:172.21.15.8:6789/0 conn(0x7f081406d4d0 legacy=0x7f0814155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:30.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.015+0000 7f0813e00640 1 -- 172.21.15.8:0/37767793 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081406eac0 con 0x7f0814070be0 2024-03-23T23:57:30.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.019+0000 7f0813e00640 1 --2- 172.21.15.8:0/37767793 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0814070be0 0x7f0814156020 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0800009870 tx=0x7f080001c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b95a50a7cb6413e1 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:30.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.023+0000 7f0812000640 1 -- 172.21.15.8:0/37767793 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08000b0070 con 0x7f0814070be0 2024-03-23T23:57:30.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.023+0000 7f0812000640 1 -- 172.21.15.8:0/37767793 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08000ab600 con 0x7f0814070be0 2024-03-23T23:57:30.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.023+0000 7f0812000640 1 -- 172.21.15.8:0/37767793 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08000ab9d0 con 0x7f0814070be0 2024-03-23T23:57:30.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.023+0000 7f0818a00640 1 -- 172.21.15.8:0/37767793 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0814070be0 msgr2=0x7f0814156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:30.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.023+0000 7f0818a00640 1 --2- 172.21.15.8:0/37767793 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0814070be0 0x7f0814156020 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0800009870 tx=0x7f080001c320 comp rx=0 tx=0).stop 2024-03-23T23:57:30.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.023+0000 7f0818a00640 1 -- 172.21.15.8:0/37767793 shutdown_connections 2024-03-23T23:57:30.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.023+0000 7f0818a00640 1 --2- 172.21.15.8:0/37767793 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0814070be0 0x7f0814156020 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:30.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.023+0000 7f0818a00640 1 -- 172.21.15.8:0/37767793 >> 172.21.15.8:0/37767793 conn(0x7f08140c3910 msgr2=0x7f08140c3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:57:30.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.027+0000 7f0818a00640 1 -- 172.21.15.8:0/37767793 shutdown_connections 2024-03-23T23:57:30.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.027+0000 7f0818a00640 1 -- 172.21.15.8:0/37767793 wait complete. 2024-03-23T23:57:30.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.031+0000 7f0818a00640 1 Processor -- start 2024-03-23T23:57:30.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.031+0000 7f0818a00640 1 -- start start 2024-03-23T23:57:30.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.035+0000 7f0818a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f081406d4d0 0x7f08140ab150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:30.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.035+0000 7f0818a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0814070be0 0x7f081413b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:30.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.035+0000 7f0818a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f081413ec50 0x7f08140a9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:30.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.035+0000 7f0813400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f081406d4d0 0x7f08140ab150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:30.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.035+0000 7f0813400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f081406d4d0 0x7f08140ab150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:36152/0 (socket says 172.21.15.8:36152) 2024-03-23T23:57:30.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.035+0000 7f0813e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f081413ec50 0x7f08140a9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:30.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.035+0000 7f0813e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f081413ec50 0x7f08140a9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36122/0 (socket says 172.21.15.8:36122) 2024-03-23T23:57:30.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.035+0000 7f0813400640 1 -- 172.21.15.8:0/2073401316 learned_addr learned my addr 172.21.15.8:0/2073401316 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:57:30.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.035+0000 7f0818a00640 1 -- 172.21.15.8:0/2073401316 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08140c2f30 con 0x7f081413ec50 2024-03-23T23:57:30.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.035+0000 7f0818a00640 1 -- 172.21.15.8:0/2073401316 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081406deb0 con 0x7f081406d4d0 2024-03-23T23:57:30.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.035+0000 7f0818a00640 1 -- 172.21.15.8:0/2073401316 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08140c30b0 con 0x7f0814070be0 2024-03-23T23:57:30.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.035+0000 7f0812a00640 1 --2- 172.21.15.8:0/2073401316 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0814070be0 0x7f081413b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:30.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.039+0000 7f0813e00640 1 -- 172.21.15.8:0/2073401316 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0814070be0 msgr2=0x7f081413b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:30.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.039+0000 7f0813e00640 1 --2- 172.21.15.8:0/2073401316 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0814070be0 0x7f081413b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:30.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.039+0000 7f0813e00640 1 -- 172.21.15.8:0/2073401316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f081406d4d0 msgr2=0x7f08140ab150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:30.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.039+0000 7f0813e00640 1 --2- 172.21.15.8:0/2073401316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f081406d4d0 0x7f08140ab150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:30.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.039+0000 7f0813e00640 1 -- 172.21.15.8:0/2073401316 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08140abff0 con 0x7f081413ec50 2024-03-23T23:57:30.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.039+0000 7f0813e00640 1 --2- 172.21.15.8:0/2073401316 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f081413ec50 0x7f08140a9620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0814073410 tx=0x7f080001ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:30.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.039+0000 7f080b400640 1 -- 172.21.15.8:0/2073401316 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08000ba020 con 0x7f081413ec50 2024-03-23T23:57:30.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.039+0000 7f080b400640 1 -- 172.21.15.8:0/2073401316 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08000aa970 con 0x7f081413ec50 2024-03-23T23:57:30.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.039+0000 7f080b400640 1 -- 172.21.15.8:0/2073401316 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08000b0040 con 0x7f081413ec50 2024-03-23T23:57:30.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.039+0000 7f0818a00640 1 -- 172.21.15.8:0/2073401316 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08140ac2d0 con 0x7f081413ec50 2024-03-23T23:57:30.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.043+0000 7f0818a00640 1 -- 172.21.15.8:0/2073401316 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0814152290 con 0x7f081413ec50 2024-03-23T23:57:30.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.043+0000 7f0818a00640 1 --2- 172.21.15.8:0/2073401316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08140c4430 0x7f08140a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:30.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.043+0000 7f0818a00640 1 -- 172.21.15.8:0/2073401316 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081404f410 con 0x7f08140c4430 2024-03-23T23:57:30.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.043+0000 7f080b400640 1 -- 172.21.15.8:0/2073401316 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f08000bd020 con 0x7f081413ec50 2024-03-23T23:57:30.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.047+0000 7f080b400640 1 --2- 172.21.15.8:0/2073401316 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f07f4067690 0x7f07f4069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:30.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.047+0000 7f080b400640 1 -- 172.21.15.8:0/2073401316 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f0800120210 con 0x7f081413ec50 2024-03-23T23:57:30.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.047+0000 7f0813400640 1 --2- 172.21.15.8:0/2073401316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08140c4430 0x7f08140a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:30.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.051+0000 7f0812a00640 1 --2- 172.21.15.8:0/2073401316 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f07f4067690 0x7f07f4069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:30.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.051+0000 7f0813400640 1 -- 172.21.15.8:0/2073401316 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0814068980 con 0x7f08140c4430 2024-03-23T23:57:30.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.055+0000 7f0812a00640 1 --2- 172.21.15.8:0/2073401316 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f07f4067690 0x7f07f4069b50 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f08141528e0 tx=0x7f080400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:30.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.055+0000 7f0813400640 1 --2- 172.21.15.8:0/2073401316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08140c4430 0x7f08140a9b60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f080c00ef70 tx=0x7f080c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:30.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.059+0000 7f080b400640 1 -- 172.21.15.8:0/2073401316 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080c018030 con 0x7f08140c4430 2024-03-23T23:57:30.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.059+0000 7f080b400640 1 -- 172.21.15.8:0/2073401316 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f080c00cd40 con 0x7f08140c4430 2024-03-23T23:57:30.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.059+0000 7f080b400640 1 -- 172.21.15.8:0/2073401316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08140c4430 msgr2=0x7f08140a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:30.065 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.059+0000 7f080b400640 1 --2- 172.21.15.8:0/2073401316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08140c4430 0x7f08140a9b60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f080c00ef70 tx=0x7f080c00c490 comp rx=0 tx=0).stop 2024-03-23T23:57:30.065 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.059+0000 7f080b400640 1 -- 172.21.15.8:0/2073401316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08140c4430 msgr2=0x7f08140a9b60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:57:30.065 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.059+0000 7f080b400640 1 --2- 172.21.15.8:0/2073401316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08140c4430 0x7f08140a9b60 secure :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f080c00ef70 tx=0x7f080c00c490 comp rx=0 tx=0).stop 2024-03-23T23:57:30.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.071+0000 7f0818a00640 1 --2- 172.21.15.8:0/2073401316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08140aa0a0 0x7f0814150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:30.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.071+0000 7f0818a00640 1 -- 172.21.15.8:0/2073401316 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08140c3230 con 0x7f08140aa0a0 2024-03-23T23:57:30.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.075+0000 7f0813400640 1 --2- 172.21.15.8:0/2073401316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08140aa0a0 0x7f0814150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:30.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.083+0000 7f0813400640 1 -- 172.21.15.8:0/2073401316 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f08141526c0 con 0x7f08140aa0a0 2024-03-23T23:57:30.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.083+0000 7f0813400640 1 --2- 172.21.15.8:0/2073401316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08140aa0a0 0x7f0814150040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f080c00d010 tx=0x7f080c004a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:30.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.083+0000 7f080b400640 1 -- 172.21.15.8:0/2073401316 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080c018030 con 0x7f08140aa0a0 2024-03-23T23:57:30.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.083+0000 7f080b400640 1 -- 172.21.15.8:0/2073401316 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5184 (secure 0 0 0) 0x7f080c01e240 con 0x7f08140aa0a0 2024-03-23T23:57:30.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.083+0000 7f080b400640 1 -- 172.21.15.8:0/2073401316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08140aa0a0 msgr2=0x7f0814150040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:30.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.083+0000 7f080b400640 1 --2- 172.21.15.8:0/2073401316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08140aa0a0 0x7f0814150040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f080c00d010 tx=0x7f080c004a80 comp rx=0 tx=0).stop 2024-03-23T23:57:30.089 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:57:30.089 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:57:30.089 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:57:30.089 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:57:30.089 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 116, 2024-03-23T23:57:30.089 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:57:30.090 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:57:30.090 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:57:30.090 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:57:30.090 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:30.090 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 18, 2024-03-23T23:57:30.090 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:57:30.090 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:57:30.090 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:57:30.090 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:57:30.090 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:57:30.090 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:57:30.091 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:57:30.091 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:57:30.091 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:57:30.091 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:57:30.091 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:57:30.091 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:57:30.091 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:57:30.091 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:57:30.091 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:30.091 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:57:30.091 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:57:30.092 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:57:30.092 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:57:30.092 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:57:30.092 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:57:30.092 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:57:30.092 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:57:30.092 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:57:30.092 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:57:30.093 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:57:30.093 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:57:30.093 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:57:30.093 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:30.093 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:30.093 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:57:30.093 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:57:30.093 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:57:30.093 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:57:30.093 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:57:30.093 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:57:30.094 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:57:30.094 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:57:30.094 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:57:30.094 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:57:30.094 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:57:30.094 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:57:30.094 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:57:30.094 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:57:30.094 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:57:30.095 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:57:30.095 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:57:30.095 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:57:30.095 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:57:30.095 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:57:30.095 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:57:30.095 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:57:30.095 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:57:30.095 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:57:30.095 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:57:30.095 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:57:30.096 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:57:30.096 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:57:30.096 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:30.096 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:57:30.096 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:30.096 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:57:30.096 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:30.096 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:57:30.096 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:57:30.097 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:57:30.097 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:57:30.097 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:30.097 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:57:30.097 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:57:30.097 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:30.097 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:30.097 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:30.097 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:57:30.098 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:57:30.098 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:30.098 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:30.098 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:30.098 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:30.098 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:57:30.098 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:57:30.098 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:57:30.098 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:57:30.098 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:57:30.099 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:30.099 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:30.099 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:57:30.099 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:57:30.099 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:57:30.099 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:57:30.099 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:30.099 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:57:30.099 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:57:30.099 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:30.099 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:30.100 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:30.100 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:57:30.100 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:57:30.100 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:30.100 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:30.100 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:30.100 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:30.100 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:57:30.100 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:57:30.100 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:57:30.100 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:57:30.100 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:57:30.101 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:30.101 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:30.101 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:57:30.101 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:57:30.101 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:57:30.101 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:57:30.101 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:30.101 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:57:30.101 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:57:30.102 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:30.102 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:30.102 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:30.102 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:57:30.102 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:57:30.102 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:30.102 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:30.103 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:30.103 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:30.103 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:57:30.103 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:57:30.103 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:57:30.103 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:57:30.103 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:57:30.103 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:30.103 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:30.103 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:30.103 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:57:30.104 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:57:30.104 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:30.104 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:57:30.104 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:30.104 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:57:30.104 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:30.105 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:30.105 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:57:30.105 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:30.105 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:57:30.105 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:30.105 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4 2024-03-23T23:57:30.105 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:30.105 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:30.105 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:57:30.106 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:30.106 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:57:30.106 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:30.106 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:57:30.106 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:30.106 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:30.106 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:57:30.106 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:30.107 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:57:30.107 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:30.107 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:57:30.107 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:30.107 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:30.107 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:57:30.107 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:30.107 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 3 2024-03-23T23:57:30.107 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:30.107 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:30.108 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:57:30.108 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:30.108 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:57:30.108 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:30.108 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:57:30.108 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:30.108 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:30.108 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:30.108 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:57:30.108 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:57:30.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.083+0000 7f080b400640 1 -- 172.21.15.8:0/2073401316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08140aa0a0 msgr2=0x7f0814150040 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:57:30.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.083+0000 7f080b400640 1 --2- 172.21.15.8:0/2073401316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08140aa0a0 0x7f0814150040 secure :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f080c00d010 tx=0x7f080c004a80 comp rx=0 tx=0).stop 2024-03-23T23:57:30.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.087+0000 7f0818a00640 1 -- 172.21.15.8:0/2073401316 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f07f4067690 msgr2=0x7f07f4069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:30.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.087+0000 7f0818a00640 1 --2- 172.21.15.8:0/2073401316 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f07f4067690 0x7f07f4069b50 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f08141528e0 tx=0x7f080400b040 comp rx=0 tx=0).stop 2024-03-23T23:57:30.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.087+0000 7f0818a00640 1 -- 172.21.15.8:0/2073401316 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f081413ec50 msgr2=0x7f08140a9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:30.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.087+0000 7f0818a00640 1 --2- 172.21.15.8:0/2073401316 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f081413ec50 0x7f08140a9620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0814073410 tx=0x7f080001ab60 comp rx=0 tx=0).stop 2024-03-23T23:57:30.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.087+0000 7f0813e00640 1 -- 172.21.15.8:0/2073401316 reap_dead start 2024-03-23T23:57:30.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.087+0000 7f0813e00640 1 -- 172.21.15.8:0/2073401316 reap_dead start 2024-03-23T23:57:30.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.087+0000 7f0818a00640 1 -- 172.21.15.8:0/2073401316 shutdown_connections 2024-03-23T23:57:30.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.087+0000 7f0818a00640 1 -- 172.21.15.8:0/2073401316 >> 172.21.15.8:0/2073401316 conn(0x7f08140c3910 msgr2=0x7f08140c2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:57:30.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.087+0000 7f0818a00640 1 -- 172.21.15.8:0/2073401316 shutdown_connections 2024-03-23T23:57:30.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.087+0000 7f0818a00640 1 -- 172.21.15.8:0/2073401316 wait complete. 2024-03-23T23:57:30.134 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:57:30.135 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T23:57:30.135 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:57:30.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.399+0000 7fbfda400640 1 Processor -- start 2024-03-23T23:57:30.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.399+0000 7fbfda400640 1 -- start start 2024-03-23T23:57:30.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.403+0000 7fbfda400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbfd40c4bf0 0x7fbfd415df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:30.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.403+0000 7fbfda400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd40c3ff0 0x7fbfd415b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:30.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.403+0000 7fbfda400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd406cf20 con 0x7fbfd415b970 2024-03-23T23:57:30.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.403+0000 7fbfda400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd406db30 con 0x7fbfd40c4bf0 2024-03-23T23:57:30.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.403+0000 7fbfda400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd406d200 con 0x7fbfd40c3ff0 2024-03-23T23:57:30.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.403+0000 7fbfd3400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbfd40c4bf0 0x7fbfd415df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:30.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.403+0000 7fbfd3400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbfd40c4bf0 0x7fbfd415df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36128/0 (socket says 172.21.15.8:36128) 2024-03-23T23:57:30.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.403+0000 7fbfd3400640 1 -- 172.21.15.8:0/1629329094 learned_addr learned my addr 172.21.15.8:0/1629329094 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:57:30.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.403+0000 7fbfd3400640 1 -- 172.21.15.8:0/1629329094 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd40c3ff0 msgr2=0x7fbfd415b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:57:30.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.403+0000 7fbfd3400640 1 --2- 172.21.15.8:0/1629329094 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd40c3ff0 0x7fbfd415b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:30.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.403+0000 7fbfd3400640 1 -- 172.21.15.8:0/1629329094 >> v1:172.21.15.8:6789/0 conn(0x7fbfd415b970 legacy=0x7fbfd415a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:57:30.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.403+0000 7fbfd3400640 1 -- 172.21.15.8:0/1629329094 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd406d4e0 con 0x7fbfd40c4bf0 2024-03-23T23:57:30.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.411+0000 7fbfd3400640 1 --2- 172.21.15.8:0/1629329094 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbfd40c4bf0 0x7fbfd415df40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc009e80 tx=0x7fbfcc01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b87cdf5f3a8d630 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:30.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.411+0000 7fbfd2000640 1 -- 172.21.15.8:0/1629329094 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc0a64f0 con 0x7fbfd40c4bf0 2024-03-23T23:57:30.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.411+0000 7fbfd2000640 1 -- 172.21.15.8:0/1629329094 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfcc0a6690 con 0x7fbfd40c4bf0 2024-03-23T23:57:30.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.411+0000 7fbfd2000640 1 -- 172.21.15.8:0/1629329094 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc0a6a60 con 0x7fbfd40c4bf0 2024-03-23T23:57:30.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.415+0000 7fbfda400640 1 -- 172.21.15.8:0/1629329094 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbfd40c4bf0 msgr2=0x7fbfd415df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:30.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.415+0000 7fbfda400640 1 --2- 172.21.15.8:0/1629329094 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbfd40c4bf0 0x7fbfd415df40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc009e80 tx=0x7fbfcc01c940 comp rx=0 tx=0).stop 2024-03-23T23:57:30.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.415+0000 7fbfda400640 1 -- 172.21.15.8:0/1629329094 shutdown_connections 2024-03-23T23:57:30.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.415+0000 7fbfda400640 1 --2- 172.21.15.8:0/1629329094 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd40c3ff0 0x7fbfd415b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:30.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.415+0000 7fbfda400640 1 --2- 172.21.15.8:0/1629329094 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbfd40c4bf0 0x7fbfd415df40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:30.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.415+0000 7fbfda400640 1 -- 172.21.15.8:0/1629329094 >> 172.21.15.8:0/1629329094 conn(0x7fbfd40743f0 msgr2=0x7fbfd4074800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:57:30.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.415+0000 7fbfda400640 1 -- 172.21.15.8:0/1629329094 shutdown_connections 2024-03-23T23:57:30.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.415+0000 7fbfda400640 1 -- 172.21.15.8:0/1629329094 wait complete. 2024-03-23T23:57:30.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.419+0000 7fbfda400640 1 Processor -- start 2024-03-23T23:57:30.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.419+0000 7fbfda400640 1 -- start start 2024-03-23T23:57:30.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.419+0000 7fbfda400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbfd40c3ff0 0x7fbfd41f1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:30.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.419+0000 7fbfda400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbfd40c4bf0 0x7fbfd406f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:30.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.419+0000 7fbfda400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd415b970 0x7fbfd41f5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:30.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.419+0000 7fbfda400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd415be00 con 0x7fbfd40c3ff0 2024-03-23T23:57:30.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.419+0000 7fbfda400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd40c51e0 con 0x7fbfd40c4bf0 2024-03-23T23:57:30.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.419+0000 7fbfda400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd415bf80 con 0x7fbfd415b970 2024-03-23T23:57:30.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.419+0000 7fbfd3400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbfd40c3ff0 0x7fbfd41f1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:30.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.419+0000 7fbfd3400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbfd40c3ff0 0x7fbfd41f1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36144/0 (socket says 172.21.15.8:36144) 2024-03-23T23:57:30.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.419+0000 7fbfd3400640 1 -- 172.21.15.8:0/3697865991 learned_addr learned my addr 172.21.15.8:0/3697865991 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:57:30.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.423+0000 7fbfd3e00640 1 --2- 172.21.15.8:0/3697865991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd415b970 0x7fbfd41f5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:30.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.423+0000 7fbfd3400640 1 -- 172.21.15.8:0/3697865991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd415b970 msgr2=0x7fbfd41f5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:30.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.423+0000 7fbfd3400640 1 --2- 172.21.15.8:0/3697865991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd415b970 0x7fbfd41f5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:30.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.423+0000 7fbfd3400640 1 -- 172.21.15.8:0/3697865991 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbfd40c4bf0 msgr2=0x7fbfd406f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:30.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.423+0000 7fbfd3400640 1 --2- 172.21.15.8:0/3697865991 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbfd40c4bf0 0x7fbfd406f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:30.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.423+0000 7fbfd3400640 1 -- 172.21.15.8:0/3697865991 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd41f2840 con 0x7fbfd40c3ff0 2024-03-23T23:57:30.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.423+0000 7fbfd3400640 1 --2- 172.21.15.8:0/3697865991 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbfd40c3ff0 0x7fbfd41f1ff0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc01d1e0 tx=0x7fbfcc0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:30.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.427+0000 7fbfcb400640 1 -- 172.21.15.8:0/3697865991 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc0a6840 con 0x7fbfd40c3ff0 2024-03-23T23:57:30.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.427+0000 7fbfcb400640 1 -- 172.21.15.8:0/3697865991 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfcc0a6a00 con 0x7fbfd40c3ff0 2024-03-23T23:57:30.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.427+0000 7fbfda400640 1 -- 172.21.15.8:0/3697865991 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd41f2b20 con 0x7fbfd40c3ff0 2024-03-23T23:57:30.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.427+0000 7fbfcb400640 1 -- 172.21.15.8:0/3697865991 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc0a6df0 con 0x7fbfd40c3ff0 2024-03-23T23:57:30.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.427+0000 7fbfda400640 1 -- 172.21.15.8:0/3697865991 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd41f57f0 con 0x7fbfd40c3ff0 2024-03-23T23:57:30.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.431+0000 7fbfcb400640 1 -- 172.21.15.8:0/3697865991 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fbfcc0af480 con 0x7fbfd40c3ff0 2024-03-23T23:57:30.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.431+0000 7fbfc8c00640 1 --2- 172.21.15.8:0/3697865991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd41f6250 0x7fbfd414ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:30.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.431+0000 7fbfc8c00640 1 -- 172.21.15.8:0/3697865991 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd41f5a30 con 0x7fbfd41f6250 2024-03-23T23:57:30.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.435+0000 7fbfcb400640 1 --2- 172.21.15.8:0/3697865991 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbfb4067730 0x7fbfb4069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:30.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.435+0000 7fbfcb400640 1 -- 172.21.15.8:0/3697865991 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fbfcc11fef0 con 0x7fbfd40c3ff0 2024-03-23T23:57:30.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.435+0000 7fbfd3e00640 1 --2- 172.21.15.8:0/3697865991 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbfb4067730 0x7fbfb4069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:30.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.435+0000 7fbfd2a00640 1 --2- 172.21.15.8:0/3697865991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd41f6250 0x7fbfd414ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:30.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.439+0000 7fbfd2a00640 1 -- 172.21.15.8:0/3697865991 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbfd4068270 con 0x7fbfd41f6250 2024-03-23T23:57:30.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.439+0000 7fbfd2a00640 1 --2- 172.21.15.8:0/3697865991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd41f6250 0x7fbfd414ef80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4074840 tx=0x7fbfc400b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:30.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.439+0000 7fbfcb400640 1 -- 172.21.15.8:0/3697865991 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4015020 con 0x7fbfd41f6250 2024-03-23T23:57:30.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.439+0000 7fbfcb400640 1 -- 172.21.15.8:0/3697865991 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fbfc4011830 con 0x7fbfd41f6250 2024-03-23T23:57:30.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.439+0000 7fbfcb400640 1 -- 172.21.15.8:0/3697865991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd41f6250 msgr2=0x7fbfd414ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:30.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.439+0000 7fbfcb400640 1 --2- 172.21.15.8:0/3697865991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd41f6250 0x7fbfd414ef80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4074840 tx=0x7fbfc400b7a0 comp rx=0 tx=0).stop 2024-03-23T23:57:30.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.439+0000 7fbfcb400640 1 -- 172.21.15.8:0/3697865991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd41f6250 msgr2=0x7fbfd414ef80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:57:30.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.439+0000 7fbfcb400640 1 --2- 172.21.15.8:0/3697865991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd41f6250 0x7fbfd414ef80 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4074840 tx=0x7fbfc400b7a0 comp rx=0 tx=0).stop 2024-03-23T23:57:30.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.439+0000 7fbfd3e00640 1 --2- 172.21.15.8:0/3697865991 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbfb4067730 0x7fbfb4069bf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40aa800 tx=0x7fbfc0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:30.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.455+0000 7fbfc8c00640 1 --2- 172.21.15.8:0/3697865991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd41f34a0 0x7fbfd40c2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:30.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.455+0000 7fbfc8c00640 1 -- 172.21.15.8:0/3697865991 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd41f55a0 con 0x7fbfd41f34a0 2024-03-23T23:57:30.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.455+0000 7fbfd2a00640 1 --2- 172.21.15.8:0/3697865991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd41f34a0 0x7fbfd40c2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:30.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.455+0000 7fbfd2a00640 1 -- 172.21.15.8:0/3697865991 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fbfd414fc80 con 0x7fbfd41f34a0 2024-03-23T23:57:30.464 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.459+0000 7fbfd2a00640 1 --2- 172.21.15.8:0/3697865991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd41f34a0 0x7fbfd40c2600 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4074840 tx=0x7fbfc4004740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:30.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.463+0000 7fbfcb400640 1 -- 172.21.15.8:0/3697865991 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4015040 con 0x7fbfd41f34a0 2024-03-23T23:57:30.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.471+0000 7fbfcb400640 1 -- 172.21.15.8:0/3697865991 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4531 (secure 0 0 0) 0x7fbfc401c220 con 0x7fbfd41f34a0 2024-03-23T23:57:30.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.471+0000 7fbfcb400640 1 -- 172.21.15.8:0/3697865991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd41f34a0 msgr2=0x7fbfd40c2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:30.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.471+0000 7fbfcb400640 1 --2- 172.21.15.8:0/3697865991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd41f34a0 0x7fbfd40c2600 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4074840 tx=0x7fbfc4004740 comp rx=0 tx=0).stop 2024-03-23T23:57:30.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.471+0000 7fbfcb400640 1 -- 172.21.15.8:0/3697865991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd41f34a0 msgr2=0x7fbfd40c2600 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:57:30.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.471+0000 7fbfcb400640 1 --2- 172.21.15.8:0/3697865991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd41f34a0 0x7fbfd40c2600 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4074840 tx=0x7fbfc4004740 comp rx=0 tx=0).stop 2024-03-23T23:57:30.476 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:57:30.477 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:57:30.477 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:57:30.477 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:57:30.477 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 116, 2024-03-23T23:57:30.477 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:57:30.477 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:57:30.477 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:57:30.477 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:57:30.477 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:30.477 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 18, 2024-03-23T23:57:30.478 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:57:30.478 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:57:30.478 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:57:30.478 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:57:30.478 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:57:30.478 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:57:30.478 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:57:30.478 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:57:30.478 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:57:30.479 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:57:30.479 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:57:30.479 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:57:30.479 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:57:30.479 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:57:30.479 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:30.479 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:57:30.480 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:57:30.480 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:57:30.480 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:57:30.480 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:57:30.480 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:57:30.480 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:57:30.481 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:57:30.482 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:57:30.482 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:57:30.482 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:57:30.482 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:57:30.482 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:57:30.483 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:30.483 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:30.483 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:57:30.483 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:57:30.483 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:57:30.483 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:57:30.483 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:57:30.483 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:57:30.483 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:57:30.483 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:57:30.483 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:57:30.483 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:57:30.484 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:57:30.484 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:57:30.484 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:57:30.484 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:57:30.484 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:57:30.484 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:57:30.484 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:57:30.484 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:57:30.484 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:57:30.484 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:57:30.484 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:57:30.484 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:57:30.484 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:57:30.485 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:57:30.485 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:57:30.485 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:57:30.485 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:57:30.485 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:57:30.485 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:30.485 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:57:30.485 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:30.485 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:57:30.485 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:30.485 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:57:30.485 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:57:30.485 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:57:30.485 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:57:30.486 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:30.486 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:57:30.486 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:57:30.486 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:30.486 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:30.486 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:30.486 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:57:30.486 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:57:30.486 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:30.486 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:30.486 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:30.486 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:30.486 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:57:30.487 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:57:30.487 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:57:30.487 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:57:30.487 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:57:30.487 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:30.487 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:30.487 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:57:30.487 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:57:30.487 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:57:30.487 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:57:30.487 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:30.487 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:57:30.489 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:57:30.489 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:30.489 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:30.489 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:30.489 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:57:30.489 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:57:30.489 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:30.490 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:30.490 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:30.490 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:30.490 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:57:30.490 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:57:30.490 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:57:30.490 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:57:30.490 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:57:30.490 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:30.490 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:30.490 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:57:30.490 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:57:30.490 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:57:30.490 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:57:30.491 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:30.491 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:57:30.491 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:57:30.491 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:30.491 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:30.491 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:30.491 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:57:30.491 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:57:30.491 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:30.491 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:30.491 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:30.491 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:30.491 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:57:30.491 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:57:30.492 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:57:30.492 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:57:30.492 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:57:30.492 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:30.492 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:30.492 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:30.492 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:57:30.492 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:57:30.492 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:30.492 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:57:30.492 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:30.492 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:57:30.492 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:30.493 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:30.493 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:57:30.493 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:30.493 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:57:30.493 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:30.493 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:57:30.493 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:30.493 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:30.493 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:30.494 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:57:30.494 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:57:30.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.475+0000 7fbfc8c00640 1 -- 172.21.15.8:0/3697865991 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbfb4067730 msgr2=0x7fbfb4069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:30.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.475+0000 7fbfc8c00640 1 --2- 172.21.15.8:0/3697865991 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbfb4067730 0x7fbfb4069bf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40aa800 tx=0x7fbfc0009040 comp rx=0 tx=0).stop 2024-03-23T23:57:30.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.475+0000 7fbfc8c00640 1 -- 172.21.15.8:0/3697865991 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbfd40c3ff0 msgr2=0x7fbfd41f1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:30.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.475+0000 7fbfc8c00640 1 --2- 172.21.15.8:0/3697865991 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbfd40c3ff0 0x7fbfd41f1ff0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc01d1e0 tx=0x7fbfcc0196e0 comp rx=0 tx=0).stop 2024-03-23T23:57:30.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.475+0000 7fbfd3e00640 1 -- 172.21.15.8:0/3697865991 reap_dead start 2024-03-23T23:57:30.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.475+0000 7fbfd3e00640 1 -- 172.21.15.8:0/3697865991 reap_dead start 2024-03-23T23:57:30.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.475+0000 7fbfc8c00640 1 -- 172.21.15.8:0/3697865991 shutdown_connections 2024-03-23T23:57:30.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.475+0000 7fbfc8c00640 1 -- 172.21.15.8:0/3697865991 >> 172.21.15.8:0/3697865991 conn(0x7fbfd40743f0 msgr2=0x7fbfd40acc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:57:30.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.475+0000 7fbfc8c00640 1 -- 172.21.15.8:0/3697865991 shutdown_connections 2024-03-23T23:57:30.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.475+0000 7fbfc8c00640 1 -- 172.21.15.8:0/3697865991 wait complete. 2024-03-23T23:57:30.521 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:57:30.522 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-03-23T23:57:30.522 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-03-23T23:57:30.522 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-03-23T23:57:30.522 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-03-23T23:57:30.523 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-23T23:57:30.523 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:57:30.605 INFO:tasks.ceph.mon.b:Stopped 2024-03-23T23:57:30.605 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-03-23T23:57:30.605 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:57:30.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.843+0000 7f0570e00640 1 Processor -- start 2024-03-23T23:57:30.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.843+0000 7f0570e00640 1 -- start start 2024-03-23T23:57:30.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.843+0000 7f0570e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f056c152ff0 0x7f056c06bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:30.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.843+0000 7f0570e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f056c072970 0x7f056c0c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:30.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.843+0000 7f0570e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f056c156220 0x7f056c06b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:30.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.843+0000 7f0570e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056c155d90 con 0x7f056c156220 2024-03-23T23:57:30.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.843+0000 7f0570e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056c1533d0 con 0x7f056c152ff0 2024-03-23T23:57:30.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.843+0000 7f0570e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056c0a9470 con 0x7f056c072970 2024-03-23T23:57:30.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.843+0000 7f0569e00640 1 -- >> v2:172.21.15.196:3300/0 conn(0x7f056c152ff0 msgr2=0x7f056c06bd10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:57:30.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.843+0000 7f0569e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f056c152ff0 0x7f056c06bd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:57:30.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.843+0000 7f056a800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f056c156220 0x7f056c06b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:30.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.843+0000 7f056a800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f056c156220 0x7f056c06b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36214/0 (socket says 172.21.15.8:36214) 2024-03-23T23:57:30.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.843+0000 7f056a800640 1 -- 172.21.15.8:0/2932745347 learned_addr learned my addr 172.21.15.8:0/2932745347 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:57:30.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.847+0000 7f056a800640 1 -- 172.21.15.8:0/2932745347 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f056c072970 msgr2=0x7f056c0c39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:57:30.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.847+0000 7f056a800640 1 --2- 172.21.15.8:0/2932745347 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f056c072970 0x7f056c0c39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:30.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.847+0000 7f056a800640 1 -- 172.21.15.8:0/2932745347 >> v2:172.21.15.196:3300/0 conn(0x7f056c152ff0 msgr2=0x7f056c06bd10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:57:30.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.847+0000 7f056a800640 1 --2- 172.21.15.8:0/2932745347 >> v2:172.21.15.196:3300/0 conn(0x7f056c152ff0 0x7f056c06bd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:30.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.847+0000 7f056a800640 1 -- 172.21.15.8:0/2932745347 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056c0aa680 con 0x7f056c156220 2024-03-23T23:57:30.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.851+0000 7f056a800640 1 --2- 172.21.15.8:0/2932745347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f056c156220 0x7f056c06b170 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f056c06cfe0 tx=0x7f056401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c1194343bec2388 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:30.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.851+0000 7f0568a00640 1 -- 172.21.15.8:0/2932745347 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05640a5710 con 0x7f056c156220 2024-03-23T23:57:30.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.851+0000 7f0568a00640 1 -- 172.21.15.8:0/2932745347 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05640a58b0 con 0x7f056c156220 2024-03-23T23:57:30.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.851+0000 7f0568a00640 1 -- 172.21.15.8:0/2932745347 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05640a5c80 con 0x7f056c156220 2024-03-23T23:57:30.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.855+0000 7f0570e00640 1 -- 172.21.15.8:0/2932745347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f056c156220 msgr2=0x7f056c06b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:30.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.855+0000 7f0570e00640 1 --2- 172.21.15.8:0/2932745347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f056c156220 0x7f056c06b170 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f056c06cfe0 tx=0x7f056401c9a0 comp rx=0 tx=0).stop 2024-03-23T23:57:30.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.855+0000 7f0570e00640 1 -- 172.21.15.8:0/2932745347 shutdown_connections 2024-03-23T23:57:30.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.855+0000 7f0570e00640 1 --2- 172.21.15.8:0/2932745347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f056c156220 0x7f056c06b170 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:30.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.855+0000 7f0570e00640 1 --2- 172.21.15.8:0/2932745347 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f056c072970 0x7f056c0c39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:30.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.855+0000 7f0570e00640 1 --2- 172.21.15.8:0/2932745347 >> v2:172.21.15.196:3300/0 conn(0x7f056c152ff0 0x7f056c06bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:30.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.855+0000 7f0570e00640 1 -- 172.21.15.8:0/2932745347 >> 172.21.15.8:0/2932745347 conn(0x7f056c06c280 msgr2=0x7f056c06c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:57:30.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.855+0000 7f0570e00640 1 -- 172.21.15.8:0/2932745347 shutdown_connections 2024-03-23T23:57:30.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.855+0000 7f0570e00640 1 -- 172.21.15.8:0/2932745347 wait complete. 2024-03-23T23:57:30.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.855+0000 7f0570e00640 1 Processor -- start 2024-03-23T23:57:30.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.855+0000 7f0570e00640 1 -- start start 2024-03-23T23:57:30.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.859+0000 7f0570e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f056c072970 0x7f056c1ef860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:30.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.859+0000 7f0570e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f056c152ff0 0x7f056c1f69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:30.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.859+0000 7f0570e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f056c156220 0x7f056c149980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:30.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.859+0000 7f0570e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c159930 con 0x7f056c152ff0 2024-03-23T23:57:30.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.859+0000 7f0570e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c1597b0 con 0x7f056c072970 2024-03-23T23:57:30.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.859+0000 7f0570e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056c159ab0 con 0x7f056c156220 2024-03-23T23:57:30.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.859+0000 7f0569e00640 1 -- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f056c072970 msgr2=0x7f056c1ef860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:57:30.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.859+0000 7f0569e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f056c072970 0x7f056c1ef860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:57:30.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.859+0000 7f056a800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f056c156220 0x7f056c149980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:30.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.859+0000 7f056a800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f056c156220 0x7f056c149980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:57872/0 (socket says 172.21.15.8:57872) 2024-03-23T23:57:30.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.859+0000 7f056a800640 1 -- 172.21.15.8:0/2775506024 learned_addr learned my addr 172.21.15.8:0/2775506024 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:57:30.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.859+0000 7f0569400640 1 --2- 172.21.15.8:0/2775506024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f056c152ff0 0x7f056c1f69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:30.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.863+0000 7f0569400640 1 -- 172.21.15.8:0/2775506024 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f056c156220 msgr2=0x7f056c149980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:30.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.863+0000 7f0569400640 1 --2- 172.21.15.8:0/2775506024 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f056c156220 0x7f056c149980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:30.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.863+0000 7f0569400640 1 -- 172.21.15.8:0/2775506024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f056c072970 msgr2=0x7f056c1ef860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:57:30.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.863+0000 7f0569400640 1 --2- 172.21.15.8:0/2775506024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f056c072970 0x7f056c1ef860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:30.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.863+0000 7f0569400640 1 -- 172.21.15.8:0/2775506024 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056c0c7340 con 0x7f056c152ff0 2024-03-23T23:57:30.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.863+0000 7f0569400640 1 --2- 172.21.15.8:0/2775506024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f056c152ff0 0x7f056c1f69b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f055800b3c0 tx=0x7f055800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:30.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.867+0000 7f0562000640 1 -- 172.21.15.8:0/2775506024 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0558011830 con 0x7f056c152ff0 2024-03-23T23:57:30.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.867+0000 7f0562000640 1 -- 172.21.15.8:0/2775506024 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0558016070 con 0x7f056c152ff0 2024-03-23T23:57:30.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.867+0000 7f0562000640 1 -- 172.21.15.8:0/2775506024 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0558011bf0 con 0x7f056c152ff0 2024-03-23T23:57:30.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.867+0000 7f0570e00640 1 -- 172.21.15.8:0/2775506024 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f056c0c7620 con 0x7f056c152ff0 2024-03-23T23:57:30.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.867+0000 7f0570e00640 1 -- 172.21.15.8:0/2775506024 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f056c1f61b0 con 0x7f056c152ff0 2024-03-23T23:57:30.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.871+0000 7f0570e00640 1 -- 172.21.15.8:0/2775506024 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f056c04f480 con 0x7f056c152ff0 2024-03-23T23:57:30.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.871+0000 7f0562000640 1 -- 172.21.15.8:0/2775506024 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f055801b460 con 0x7f056c152ff0 2024-03-23T23:57:30.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.871+0000 7f0562000640 1 --2- 172.21.15.8:0/2775506024 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f054c067690 0x7f054c069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:30.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.875+0000 7f0562000640 1 -- 172.21.15.8:0/2775506024 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f0558085870 con 0x7f056c152ff0 2024-03-23T23:57:30.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.875+0000 7f0569e00640 1 --2- 172.21.15.8:0/2775506024 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f054c067690 0x7f054c069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:30.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.879+0000 7f0569e00640 1 --2- 172.21.15.8:0/2775506024 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f054c067690 0x7f054c069b50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f055c003940 tx=0x7f055c006d90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:30.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:30.883+0000 7f0562000640 1 -- 172.21.15.8:0/2775506024 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f0558056110 con 0x7f056c152ff0 2024-03-23T23:57:31.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:31.427+0000 7f0570e00640 1 -- 172.21.15.8:0/2775506024 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f056c071f30 con 0x7f056c152ff0 2024-03-23T23:57:31.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:31.431+0000 7f0562000640 1 -- 172.21.15.8:0/2775506024 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1562 (secure 0 0 0) 0x7f0558055a10 con 0x7f056c152ff0 2024-03-23T23:57:31.434 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":116,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:57:31.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:31.435+0000 7f0570e00640 1 -- 172.21.15.8:0/2775506024 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f054c067690 msgr2=0x7f054c069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:31.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:31.435+0000 7f0570e00640 1 --2- 172.21.15.8:0/2775506024 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f054c067690 0x7f054c069b50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f055c003940 tx=0x7f055c006d90 comp rx=0 tx=0).stop 2024-03-23T23:57:31.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:31.435+0000 7f0570e00640 1 -- 172.21.15.8:0/2775506024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f056c152ff0 msgr2=0x7f056c1f69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:31.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:31.435+0000 7f0570e00640 1 --2- 172.21.15.8:0/2775506024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f056c152ff0 0x7f056c1f69b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f055800b3c0 tx=0x7f055800b880 comp rx=0 tx=0).stop 2024-03-23T23:57:31.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:31.435+0000 7f0570e00640 1 -- 172.21.15.8:0/2775506024 shutdown_connections 2024-03-23T23:57:31.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:31.435+0000 7f0570e00640 1 --2- 172.21.15.8:0/2775506024 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f054c067690 0x7f054c069b50 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:31.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:31.435+0000 7f0570e00640 1 --2- 172.21.15.8:0/2775506024 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f056c156220 0x7f056c149980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:31.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:31.435+0000 7f0570e00640 1 --2- 172.21.15.8:0/2775506024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f056c152ff0 0x7f056c1f69b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:31.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:31.435+0000 7f0570e00640 1 --2- 172.21.15.8:0/2775506024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f056c072970 0x7f056c1ef860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:31.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:31.435+0000 7f0570e00640 1 -- 172.21.15.8:0/2775506024 >> 172.21.15.8:0/2775506024 conn(0x7f056c06c280 msgr2=0x7f056c150c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:57:31.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:31.435+0000 7f0570e00640 1 -- 172.21.15.8:0/2775506024 shutdown_connections 2024-03-23T23:57:31.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:31.435+0000 7f0570e00640 1 -- 172.21.15.8:0/2775506024 wait complete. 2024-03-23T23:57:34.472 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:57:34.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.675+0000 7f64f9600640 1 Processor -- start 2024-03-23T23:57:34.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.679+0000 7f64f9600640 1 -- start start 2024-03-23T23:57:34.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.679+0000 7f64f9600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f64f4152f80 0x7f64f40c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:34.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.679+0000 7f64f9600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f64f40c6bc0 0x7f64f40c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:34.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.679+0000 7f64f9600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f4159c20 con 0x7f64f40c93b0 2024-03-23T23:57:34.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.679+0000 7f64f9600640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64f41596f0 con 0x7f64f4152f80 2024-03-23T23:57:34.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.679+0000 7f64f9600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64f40c5b10 con 0x7f64f40c6bc0 2024-03-23T23:57:34.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.679+0000 7f64f8c00640 1 -- >> v1:172.21.15.196:6789/0 conn(0x7f64f40c93b0 legacy=0x7f64f406b8c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-03-23T23:57:34.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.679+0000 7f64f3e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f64f4152f80 0x7f64f40c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:34.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.679+0000 7f64f3400640 1 -- >> v2:172.21.15.196:3300/0 conn(0x7f64f40c6bc0 msgr2=0x7f64f40c8e70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:57:34.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.679+0000 7f64f3400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f64f40c6bc0 0x7f64f40c8e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:57:34.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.679+0000 7f64f3e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f64f4152f80 0x7f64f40c5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49202/0 (socket says 172.21.15.8:49202) 2024-03-23T23:57:34.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.679+0000 7f64f3e00640 1 -- 172.21.15.8:0/2152473500 learned_addr learned my addr 172.21.15.8:0/2152473500 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:57:34.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.679+0000 7f64f3e00640 1 -- 172.21.15.8:0/2152473500 >> v2:172.21.15.196:3300/0 conn(0x7f64f40c6bc0 msgr2=0x7f64f40c8e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:57:34.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.679+0000 7f64f3e00640 1 --2- 172.21.15.8:0/2152473500 >> v2:172.21.15.196:3300/0 conn(0x7f64f40c6bc0 0x7f64f40c8e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:34.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.679+0000 7f64f3e00640 1 -- 172.21.15.8:0/2152473500 >> v1:172.21.15.196:6789/0 conn(0x7f64f40c93b0 legacy=0x7f64f406b8c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:57:34.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.679+0000 7f64f3e00640 1 -- 172.21.15.8:0/2152473500 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f40c72f0 con 0x7f64f4152f80 2024-03-23T23:57:34.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.683+0000 7f64f3e00640 1 --2- 172.21.15.8:0/2152473500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64f4152f80 0x7f64f40c5fa0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f64f40b10b0 tx=0x7f64e401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ecba5bd9cd05dd server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:34.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.683+0000 7f64f2a00640 1 -- 172.21.15.8:0/2152473500 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e40b0070 con 0x7f64f4152f80 2024-03-23T23:57:34.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.683+0000 7f64f2a00640 1 -- 172.21.15.8:0/2152473500 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e40ab600 con 0x7f64f4152f80 2024-03-23T23:57:34.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.683+0000 7f64f2a00640 1 -- 172.21.15.8:0/2152473500 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e40ab9d0 con 0x7f64f4152f80 2024-03-23T23:57:34.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.683+0000 7f64f9600640 1 -- 172.21.15.8:0/2152473500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64f4152f80 msgr2=0x7f64f40c5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:34.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.683+0000 7f64f9600640 1 --2- 172.21.15.8:0/2152473500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64f4152f80 0x7f64f40c5fa0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f64f40b10b0 tx=0x7f64e401c3e0 comp rx=0 tx=0).stop 2024-03-23T23:57:34.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.683+0000 7f64f9600640 1 -- 172.21.15.8:0/2152473500 shutdown_connections 2024-03-23T23:57:34.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.683+0000 7f64f9600640 1 --2- 172.21.15.8:0/2152473500 >> v2:172.21.15.196:3300/0 conn(0x7f64f40c6bc0 0x7f64f40c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:34.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.683+0000 7f64f9600640 1 --2- 172.21.15.8:0/2152473500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64f4152f80 0x7f64f40c5fa0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:34.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.683+0000 7f64f9600640 1 -- 172.21.15.8:0/2152473500 >> 172.21.15.8:0/2152473500 conn(0x7f64f40accb0 msgr2=0x7f64f40ad0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:57:34.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.683+0000 7f64f9600640 1 -- 172.21.15.8:0/2152473500 shutdown_connections 2024-03-23T23:57:34.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.683+0000 7f64f9600640 1 -- 172.21.15.8:0/2152473500 wait complete. 2024-03-23T23:57:34.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.687+0000 7f64f9600640 1 Processor -- start 2024-03-23T23:57:34.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.687+0000 7f64f9600640 1 -- start start 2024-03-23T23:57:34.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.687+0000 7f64f9600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f64f40c6bc0 0x7f64f4148be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:34.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.687+0000 7f64f9600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64f40c93b0 0x7f64f41eea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:34.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.687+0000 7f64f9600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f64f4152f80 0x7f64f41eefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:34.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.687+0000 7f64f9600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f4162410 con 0x7f64f40c93b0 2024-03-23T23:57:34.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.687+0000 7f64f9600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f4162290 con 0x7f64f4152f80 2024-03-23T23:57:34.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.687+0000 7f64f9600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f4162590 con 0x7f64f40c6bc0 2024-03-23T23:57:34.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.687+0000 7f64f8c00640 1 -- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f64f4152f80 msgr2=0x7f64f41eefc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:57:34.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.687+0000 7f64f3400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64f40c93b0 0x7f64f41eea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:34.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.687+0000 7f64f8c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f64f4152f80 0x7f64f41eefc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:57:34.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.687+0000 7f64f3400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64f40c93b0 0x7f64f41eea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49206/0 (socket says 172.21.15.8:49206) 2024-03-23T23:57:34.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.687+0000 7f64f3400640 1 -- 172.21.15.8:0/724696742 learned_addr learned my addr 172.21.15.8:0/724696742 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:57:34.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.687+0000 7f64f3e00640 1 --2- 172.21.15.8:0/724696742 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f64f40c6bc0 0x7f64f4148be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:34.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.687+0000 7f64f3400640 1 -- 172.21.15.8:0/724696742 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f64f40c6bc0 msgr2=0x7f64f4148be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:34.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.687+0000 7f64f3400640 1 --2- 172.21.15.8:0/724696742 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f64f40c6bc0 0x7f64f4148be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:34.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.687+0000 7f64f3400640 1 -- 172.21.15.8:0/724696742 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f64f4152f80 msgr2=0x7f64f41eefc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:57:34.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.687+0000 7f64f3400640 1 --2- 172.21.15.8:0/724696742 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f64f4152f80 0x7f64f41eefc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:34.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.687+0000 7f64f3400640 1 -- 172.21.15.8:0/724696742 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f40c1de0 con 0x7f64f40c93b0 2024-03-23T23:57:34.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.687+0000 7f64f3400640 1 --2- 172.21.15.8:0/724696742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64f40c93b0 0x7f64f41eea80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f64dc00b560 tx=0x7f64dc00ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:34.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.687+0000 7f64ebe00640 1 -- 172.21.15.8:0/724696742 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc013020 con 0x7f64f40c93b0 2024-03-23T23:57:34.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.687+0000 7f64ebe00640 1 -- 172.21.15.8:0/724696742 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64dc003df0 con 0x7f64f40c93b0 2024-03-23T23:57:34.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.687+0000 7f64f9600640 1 -- 172.21.15.8:0/724696742 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64f414c910 con 0x7f64f40c93b0 2024-03-23T23:57:34.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.687+0000 7f64ebe00640 1 -- 172.21.15.8:0/724696742 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc0052b0 con 0x7f64f40c93b0 2024-03-23T23:57:34.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.687+0000 7f64f9600640 1 -- 172.21.15.8:0/724696742 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f4155650 con 0x7f64f40c93b0 2024-03-23T23:57:34.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.691+0000 7f64f9600640 1 -- 172.21.15.8:0/724696742 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64cc0052a0 con 0x7f64f40c93b0 2024-03-23T23:57:34.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.691+0000 7f64ebe00640 1 -- 172.21.15.8:0/724696742 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f64dc016020 con 0x7f64f40c93b0 2024-03-23T23:57:34.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.691+0000 7f64ebe00640 1 --2- 172.21.15.8:0/724696742 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f64d0067640 0x7f64d0069b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:34.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.691+0000 7f64ebe00640 1 -- 172.21.15.8:0/724696742 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f64dc085930 con 0x7f64f40c93b0 2024-03-23T23:57:34.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.691+0000 7f64f3e00640 1 --2- 172.21.15.8:0/724696742 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f64d0067640 0x7f64d0069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:34.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.695+0000 7f64f3e00640 1 --2- 172.21.15.8:0/724696742 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f64d0067640 0x7f64d0069b00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f64e40ad000 tx=0x7f64e40a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:34.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:34.699+0000 7f64ebe00640 1 -- 172.21.15.8:0/724696742 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f64dc01d020 con 0x7f64f40c93b0 2024-03-23T23:57:35.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:35.071+0000 7f64f9600640 1 -- 172.21.15.8:0/724696742 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f64cc005590 con 0x7f64f40c93b0 2024-03-23T23:57:35.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:35.071+0000 7f64ebe00640 1 -- 172.21.15.8:0/724696742 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1562 (secure 0 0 0) 0x7f64dc083e20 con 0x7f64f40c93b0 2024-03-23T23:57:35.074 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":116,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:57:35.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:35.071+0000 7f64f9600640 1 -- 172.21.15.8:0/724696742 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f64d0067640 msgr2=0x7f64d0069b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:35.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:35.071+0000 7f64f9600640 1 --2- 172.21.15.8:0/724696742 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f64d0067640 0x7f64d0069b00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f64e40ad000 tx=0x7f64e40a6000 comp rx=0 tx=0).stop 2024-03-23T23:57:35.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:35.071+0000 7f64f9600640 1 -- 172.21.15.8:0/724696742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64f40c93b0 msgr2=0x7f64f41eea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:35.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:35.071+0000 7f64f9600640 1 --2- 172.21.15.8:0/724696742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64f40c93b0 0x7f64f41eea80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f64dc00b560 tx=0x7f64dc00ba20 comp rx=0 tx=0).stop 2024-03-23T23:57:35.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:35.071+0000 7f64f9600640 1 -- 172.21.15.8:0/724696742 shutdown_connections 2024-03-23T23:57:35.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:35.071+0000 7f64f9600640 1 --2- 172.21.15.8:0/724696742 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f64f4152f80 0x7f64f41eefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:35.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:35.071+0000 7f64f9600640 1 --2- 172.21.15.8:0/724696742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64f40c93b0 0x7f64f41eea80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:35.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:35.071+0000 7f64f9600640 1 --2- 172.21.15.8:0/724696742 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f64d0067640 0x7f64d0069b00 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:35.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:35.071+0000 7f64f9600640 1 --2- 172.21.15.8:0/724696742 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f64f40c6bc0 0x7f64f4148be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:35.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:35.071+0000 7f64f9600640 1 -- 172.21.15.8:0/724696742 >> 172.21.15.8:0/724696742 conn(0x7f64f40accb0 msgr2=0x7f64f40c7980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:57:35.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:35.071+0000 7f64f9600640 1 -- 172.21.15.8:0/724696742 shutdown_connections 2024-03-23T23:57:35.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:35.071+0000 7f64f9600640 1 -- 172.21.15.8:0/724696742 wait complete. 2024-03-23T23:57:38.104 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:57:38.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.271+0000 7fd0bdc00640 1 Processor -- start 2024-03-23T23:57:38.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.271+0000 7fd0bdc00640 1 -- start start 2024-03-23T23:57:38.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.275+0000 7fd0bdc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0b80c1b70 0x7fd0b8154220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:38.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.275+0000 7fd0bdc00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b814a560 con 0x7fd0b806e350 2024-03-23T23:57:38.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.275+0000 7fd0bdc00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b80c2070 con 0x7fd0b814a180 2024-03-23T23:57:38.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.275+0000 7fd0bdc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b80c2350 con 0x7fd0b80c1b70 2024-03-23T23:57:38.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.275+0000 7fd0b6a00640 1 -- >> v1:172.21.15.196:6789/0 conn(0x7fd0b814a180 legacy=0x7fd0b80c3620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-03-23T23:57:38.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.275+0000 7fd0b7400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd0b806e350 0x7fd0b806e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:58208/0 (socket says 172.21.15.8:58208) 2024-03-23T23:57:38.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.275+0000 7fd0b7400640 1 -- 172.21.15.8:0/3458459843 learned_addr learned my addr 172.21.15.8:0/3458459843 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:57:38.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.275+0000 7fd0afe00640 1 --2- 172.21.15.8:0/3458459843 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0b80c1b70 0x7fd0b8154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:38.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.275+0000 7fd0afe00640 1 -- 172.21.15.8:0/3458459843 >> v1:172.21.15.196:6789/0 conn(0x7fd0b814a180 legacy=0x7fd0b80c3620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:57:38.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.275+0000 7fd0afe00640 1 -- 172.21.15.8:0/3458459843 >> v1:172.21.15.8:6789/0 conn(0x7fd0b806e350 legacy=0x7fd0b806e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:38.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.275+0000 7fd0afe00640 1 -- 172.21.15.8:0/3458459843 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b80c2630 con 0x7fd0b80c1b70 2024-03-23T23:57:38.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.279+0000 7fd0afe00640 1 --2- 172.21.15.8:0/3458459843 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0b80c1b70 0x7fd0b8154220 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00097f0 tx=0x7fd0a001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=827af4afa2c2da9d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:38.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.279+0000 7fd0b6000640 1 -- 172.21.15.8:0/3458459843 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a00ab430 con 0x7fd0b80c1b70 2024-03-23T23:57:38.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.279+0000 7fd0b6000640 1 -- 172.21.15.8:0/3458459843 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a00b0070 con 0x7fd0b80c1b70 2024-03-23T23:57:38.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.279+0000 7fd0b6000640 1 -- 172.21.15.8:0/3458459843 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a00ab7f0 con 0x7fd0b80c1b70 2024-03-23T23:57:38.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.279+0000 7fd0bdc00640 1 -- 172.21.15.8:0/3458459843 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0b80c1b70 msgr2=0x7fd0b8154220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:38.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.279+0000 7fd0bdc00640 1 --2- 172.21.15.8:0/3458459843 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0b80c1b70 0x7fd0b8154220 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00097f0 tx=0x7fd0a001c410 comp rx=0 tx=0).stop 2024-03-23T23:57:38.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.279+0000 7fd0bdc00640 1 -- 172.21.15.8:0/3458459843 shutdown_connections 2024-03-23T23:57:38.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.279+0000 7fd0bdc00640 1 --2- 172.21.15.8:0/3458459843 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0b80c1b70 0x7fd0b8154220 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:38.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.279+0000 7fd0bdc00640 1 -- 172.21.15.8:0/3458459843 >> 172.21.15.8:0/3458459843 conn(0x7fd0b806b170 msgr2=0x7fd0b806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:57:38.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.279+0000 7fd0bdc00640 1 -- 172.21.15.8:0/3458459843 shutdown_connections 2024-03-23T23:57:38.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.279+0000 7fd0bdc00640 1 -- 172.21.15.8:0/3458459843 wait complete. 2024-03-23T23:57:38.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.283+0000 7fd0bdc00640 1 Processor -- start 2024-03-23T23:57:38.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.283+0000 7fd0bdc00640 1 -- start start 2024-03-23T23:57:38.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.283+0000 7fd0bdc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0b806e350 0x7fd0b8156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:38.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.283+0000 7fd0bdc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0b80c1b70 0x7fd0b80aa420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:38.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.283+0000 7fd0bdc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0b814a180 0x7fd0b80aa960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:38.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.283+0000 7fd0bdc00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b80c3eb0 con 0x7fd0b814a180 2024-03-23T23:57:38.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.283+0000 7fd0bdc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b80c3d30 con 0x7fd0b80c1b70 2024-03-23T23:57:38.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.283+0000 7fd0bdc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b81617c0 con 0x7fd0b806e350 2024-03-23T23:57:38.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.283+0000 7fd0afe00640 1 -- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0b80c1b70 msgr2=0x7fd0b80aa420 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:57:38.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.283+0000 7fd0afe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0b80c1b70 0x7fd0b80aa420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:57:38.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.283+0000 7fd0b7400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0b814a180 0x7fd0b80aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:38.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.283+0000 7fd0b6a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0b806e350 0x7fd0b8156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:38.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.283+0000 7fd0b7400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0b814a180 0x7fd0b80aa960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49214/0 (socket says 172.21.15.8:49214) 2024-03-23T23:57:38.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.283+0000 7fd0b7400640 1 -- 172.21.15.8:0/1983751885 learned_addr learned my addr 172.21.15.8:0/1983751885 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:57:38.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.283+0000 7fd0b7400640 1 -- 172.21.15.8:0/1983751885 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0b806e350 msgr2=0x7fd0b8156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:38.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.283+0000 7fd0b7400640 1 --2- 172.21.15.8:0/1983751885 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0b806e350 0x7fd0b8156280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:38.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.283+0000 7fd0b7400640 1 -- 172.21.15.8:0/1983751885 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0b80c1b70 msgr2=0x7fd0b80aa420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:57:38.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.283+0000 7fd0b7400640 1 --2- 172.21.15.8:0/1983751885 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0b80c1b70 0x7fd0b80aa420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:38.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.283+0000 7fd0b7400640 1 -- 172.21.15.8:0/1983751885 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b8157710 con 0x7fd0b814a180 2024-03-23T23:57:38.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.283+0000 7fd0b7400640 1 --2- 172.21.15.8:0/1983751885 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0b814a180 0x7fd0b80aa960 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd0b000ca70 tx=0x7fd0b000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:38.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.287+0000 7fd0aea00640 1 -- 172.21.15.8:0/1983751885 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0017070 con 0x7fd0b814a180 2024-03-23T23:57:38.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.287+0000 7fd0aea00640 1 -- 172.21.15.8:0/1983751885 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b000abd0 con 0x7fd0b814a180 2024-03-23T23:57:38.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.287+0000 7fd0aea00640 1 -- 172.21.15.8:0/1983751885 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0012400 con 0x7fd0b814a180 2024-03-23T23:57:38.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.287+0000 7fd0bdc00640 1 -- 172.21.15.8:0/1983751885 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b80bcd40 con 0x7fd0b814a180 2024-03-23T23:57:38.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.287+0000 7fd0bdc00640 1 -- 172.21.15.8:0/1983751885 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b81567c0 con 0x7fd0b814a180 2024-03-23T23:57:38.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.287+0000 7fd0bdc00640 1 -- 172.21.15.8:0/1983751885 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b804f480 con 0x7fd0b814a180 2024-03-23T23:57:38.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.287+0000 7fd0aea00640 1 -- 172.21.15.8:0/1983751885 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd0b001a070 con 0x7fd0b814a180 2024-03-23T23:57:38.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.287+0000 7fd0aea00640 1 --2- 172.21.15.8:0/1983751885 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd094067610 0x7fd094069ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:38.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.287+0000 7fd0aea00640 1 -- 172.21.15.8:0/1983751885 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fd0b0085870 con 0x7fd0b814a180 2024-03-23T23:57:38.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.291+0000 7fd0b6a00640 1 --2- 172.21.15.8:0/1983751885 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd094067610 0x7fd094069ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:38.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.291+0000 7fd0b6a00640 1 --2- 172.21.15.8:0/1983751885 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd094067610 0x7fd094069ad0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd0a80093d0 tx=0x7fd0a8009360 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:38.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.299+0000 7fd0aea00640 1 -- 172.21.15.8:0/1983751885 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fd0b0055ad0 con 0x7fd0b814a180 2024-03-23T23:57:38.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.595+0000 7fd0bdc00640 1 -- 172.21.15.8:0/1983751885 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd0b80c3400 con 0x7fd0b814a180 2024-03-23T23:57:38.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.595+0000 7fd0aea00640 1 -- 172.21.15.8:0/1983751885 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1562 (secure 0 0 0) 0x7fd0b0059b70 con 0x7fd0b814a180 2024-03-23T23:57:38.598 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":116,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":27,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:57:38.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.595+0000 7fd0bdc00640 1 -- 172.21.15.8:0/1983751885 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd094067610 msgr2=0x7fd094069ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:38.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.595+0000 7fd0bdc00640 1 --2- 172.21.15.8:0/1983751885 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd094067610 0x7fd094069ad0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd0a80093d0 tx=0x7fd0a8009360 comp rx=0 tx=0).stop 2024-03-23T23:57:38.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.595+0000 7fd0bdc00640 1 -- 172.21.15.8:0/1983751885 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0b814a180 msgr2=0x7fd0b80aa960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:38.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.595+0000 7fd0bdc00640 1 --2- 172.21.15.8:0/1983751885 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0b814a180 0x7fd0b80aa960 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd0b000ca70 tx=0x7fd0b000cf30 comp rx=0 tx=0).stop 2024-03-23T23:57:38.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.595+0000 7fd0bdc00640 1 -- 172.21.15.8:0/1983751885 shutdown_connections 2024-03-23T23:57:38.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.595+0000 7fd0bdc00640 1 --2- 172.21.15.8:0/1983751885 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0b814a180 0x7fd0b80aa960 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:38.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.595+0000 7fd0bdc00640 1 --2- 172.21.15.8:0/1983751885 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0b80c1b70 0x7fd0b80aa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:38.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.595+0000 7fd0bdc00640 1 --2- 172.21.15.8:0/1983751885 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd094067610 0x7fd094069ad0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:38.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.595+0000 7fd0bdc00640 1 --2- 172.21.15.8:0/1983751885 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0b806e350 0x7fd0b8156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:38.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.595+0000 7fd0bdc00640 1 -- 172.21.15.8:0/1983751885 >> 172.21.15.8:0/1983751885 conn(0x7fd0b806b170 msgr2=0x7fd0b80c3620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:57:38.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.595+0000 7fd0bdc00640 1 -- 172.21.15.8:0/1983751885 shutdown_connections 2024-03-23T23:57:38.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:38.595+0000 7fd0bdc00640 1 -- 172.21.15.8:0/1983751885 wait complete. 2024-03-23T23:57:41.186 INFO:tasks.workunit.client.1.smithi196.stdout:Syncing()...36 sec 2024-03-23T23:57:41.186 INFO:tasks.workunit.client.1.smithi196.stdout:FFSB benchmark finished at: Sat Mar 23 23:57:41 2024 2024-03-23T23:57:41.186 INFO:tasks.workunit.client.1.smithi196.stdout: 2024-03-23T23:57:41.186 INFO:tasks.workunit.client.1.smithi196.stdout:Results: 2024-03-23T23:57:41.186 INFO:tasks.workunit.client.1.smithi196.stdout:Benchmark took 346.38 sec 2024-03-23T23:57:41.186 INFO:tasks.workunit.client.1.smithi196.stdout: 2024-03-23T23:57:41.186 INFO:tasks.workunit.client.1.smithi196.stdout:Total Results 2024-03-23T23:57:41.186 INFO:tasks.workunit.client.1.smithi196.stdout:=============== 2024-03-23T23:57:41.186 INFO:tasks.workunit.client.1.smithi196.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-03-23T23:57:41.187 INFO:tasks.workunit.client.1.smithi196.stdout: ======= ============ ========= ======= =========== ========== 2024-03-23T23:57:41.187 INFO:tasks.workunit.client.1.smithi196.stdout: write : 16793600 48483.04 100.000% 100.000% 189MB/sec 2024-03-23T23:57:41.187 INFO:tasks.workunit.client.1.smithi196.stdout:- 2024-03-23T23:57:41.187 INFO:tasks.workunit.client.1.smithi196.stdout:48483.04 Transactions per Second 2024-03-23T23:57:41.187 INFO:tasks.workunit.client.1.smithi196.stdout: 2024-03-23T23:57:41.187 INFO:tasks.workunit.client.1.smithi196.stdout:Throughput Results 2024-03-23T23:57:41.187 INFO:tasks.workunit.client.1.smithi196.stdout:=================== 2024-03-23T23:57:41.187 INFO:tasks.workunit.client.1.smithi196.stdout:Write Throughput: 189MB/sec 2024-03-23T23:57:41.343 INFO:tasks.workunit.client.1.smithi196.stdout: 2024-03-23T23:57:41.344 INFO:tasks.workunit.client.1.smithi196.stdout:System Call Latency statistics in millisecs 2024-03-23T23:57:41.344 INFO:tasks.workunit.client.1.smithi196.stdout:===== 2024-03-23T23:57:41.344 INFO:tasks.workunit.client.1.smithi196.stdout: Min Avg Max Total Calls 2024-03-23T23:57:41.344 INFO:tasks.workunit.client.1.smithi196.stdout: ======== ======== ======== ============ 2024-03-23T23:57:41.344 INFO:tasks.workunit.client.1.smithi196.stdout:[ open] 0.021000 0.282480 44.811001 13120 2024-03-23T23:57:41.344 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-03-23T23:57:41.344 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-03-23T23:57:41.344 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-03-23T23:57:41.344 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-03-23T23:57:41.344 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-03-23T23:57:41.344 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-03-23T23:57:41.345 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-03-23T23:57:41.345 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[7] 20.000000 - 50.000000 : 43 2024-03-23T23:57:41.345 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[8] 10.000000 - 20.000000 : 58 2024-03-23T23:57:41.345 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[9] 5.000000 - 10.000000 : 91 2024-03-23T23:57:41.345 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[10] 2.000000 - 5.000000 : 86 2024-03-23T23:57:41.345 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[11] 1.000000 - 2.000000 : 56 2024-03-23T23:57:41.345 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[12] 0.500000 - 1.000000 : 38 2024-03-23T23:57:41.345 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[13] 0.200000 - 0.500000 : 60 2024-03-23T23:57:41.345 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[14] 0.100000 - 0.200000 : 241 2024-03-23T23:57:41.345 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[15] 0.050000 - 0.100000 : 1266 2024-03-23T23:57:41.345 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[16] 0.020000 - 0.050000 : 11181 2024-03-23T23:57:41.345 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-03-23T23:57:41.345 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-03-23T23:57:41.346 INFO:tasks.workunit.client.1.smithi196.stdout: 2024-03-23T23:57:41.346 INFO:tasks.workunit.client.1.smithi196.stdout:[ write] 0.003000 0.574940 18746.982422 16793600 2024-03-23T23:57:41.346 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[0] 5000.000000 - 10000.000000 : 288 2024-03-23T23:57:41.346 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[1] 2000.000000 - 5000.000000 : 1249 2024-03-23T23:57:41.346 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[2] 1000.000000 - 2000.000000 : 802 2024-03-23T23:57:41.346 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[3] 500.000000 - 1000.000000 : 575 2024-03-23T23:57:41.346 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[4] 200.000000 - 500.000000 : 796 2024-03-23T23:57:41.346 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[5] 100.000000 - 200.000000 : 1050 2024-03-23T23:57:41.346 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[6] 50.000000 - 100.000000 : 6856 2024-03-23T23:57:41.346 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[7] 20.000000 - 50.000000 : 18770 2024-03-23T23:57:41.346 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[8] 10.000000 - 20.000000 : 8044 2024-03-23T23:57:41.346 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[9] 5.000000 - 10.000000 : 9782 2024-03-23T23:57:41.346 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[10] 2.000000 - 5.000000 : 14362 2024-03-23T23:57:41.347 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[11] 1.000000 - 2.000000 : 7964 2024-03-23T23:57:41.347 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[12] 0.500000 - 1.000000 : 7011 2024-03-23T23:57:41.347 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[13] 0.200000 - 0.500000 : 14201 2024-03-23T23:57:41.347 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[14] 0.100000 - 0.200000 : 19325 2024-03-23T23:57:41.347 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[15] 0.050000 - 0.100000 : 45880 2024-03-23T23:57:41.347 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[16] 0.020000 - 0.050000 : 351856 2024-03-23T23:57:41.347 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[17] 0.010000 - 0.020000 : 5677488 2024-03-23T23:57:41.347 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[18] 0.000000 - 0.010000 : 10607269 2024-03-23T23:57:41.347 INFO:tasks.workunit.client.1.smithi196.stdout: 2024-03-23T23:57:41.347 INFO:tasks.workunit.client.1.smithi196.stdout:[ lseek] 0.000000 0.002595 64.068001 16793600 2024-03-23T23:57:41.347 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-03-23T23:57:41.347 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-03-23T23:57:41.348 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-03-23T23:57:41.348 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-03-23T23:57:41.348 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-03-23T23:57:41.348 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-03-23T23:57:41.348 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[6] 50.000000 - 100.000000 : 8 2024-03-23T23:57:41.348 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[7] 20.000000 - 50.000000 : 214 2024-03-23T23:57:41.348 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[8] 10.000000 - 20.000000 : 515 2024-03-23T23:57:41.348 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[9] 5.000000 - 10.000000 : 827 2024-03-23T23:57:41.348 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[10] 2.000000 - 5.000000 : 1205 2024-03-23T23:57:41.348 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[11] 1.000000 - 2.000000 : 753 2024-03-23T23:57:41.348 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[12] 0.500000 - 1.000000 : 625 2024-03-23T23:57:41.348 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[13] 0.200000 - 0.500000 : 1084 2024-03-23T23:57:41.348 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[14] 0.100000 - 0.200000 : 1147 2024-03-23T23:57:41.348 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[15] 0.050000 - 0.100000 : 2459 2024-03-23T23:57:41.349 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[16] 0.020000 - 0.050000 : 8554 2024-03-23T23:57:41.349 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[17] 0.010000 - 0.020000 : 12073 2024-03-23T23:57:41.349 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[18] 0.000000 - 0.010000 : 16764136 2024-03-23T23:57:41.349 INFO:tasks.workunit.client.1.smithi196.stdout: 2024-03-23T23:57:41.349 INFO:tasks.workunit.client.1.smithi196.stdout:[ close] 0.004000 0.021756 15.850000 13120 2024-03-23T23:57:41.349 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-03-23T23:57:41.349 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-03-23T23:57:41.349 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-03-23T23:57:41.349 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-03-23T23:57:41.349 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-03-23T23:57:41.349 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-03-23T23:57:41.349 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-03-23T23:57:41.349 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2024-03-23T23:57:41.349 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[8] 10.000000 - 20.000000 : 5 2024-03-23T23:57:41.350 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[9] 5.000000 - 10.000000 : 7 2024-03-23T23:57:41.350 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[10] 2.000000 - 5.000000 : 6 2024-03-23T23:57:41.350 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[11] 1.000000 - 2.000000 : 4 2024-03-23T23:57:41.350 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[12] 0.500000 - 1.000000 : 4 2024-03-23T23:57:41.350 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[13] 0.200000 - 0.500000 : 8 2024-03-23T23:57:41.350 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[14] 0.100000 - 0.200000 : 6 2024-03-23T23:57:41.350 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[15] 0.050000 - 0.100000 : 18 2024-03-23T23:57:41.350 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[16] 0.020000 - 0.050000 : 92 2024-03-23T23:57:41.350 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[17] 0.010000 - 0.020000 : 8649 2024-03-23T23:57:41.350 INFO:tasks.workunit.client.1.smithi196.stdout: msec_range[18] 0.000000 - 0.010000 : 4321 2024-03-23T23:57:41.350 INFO:tasks.workunit.client.1.smithi196.stdout: 2024-03-23T23:57:41.350 INFO:tasks.workunit.client.1.smithi196.stdout: 2024-03-23T23:57:41.350 INFO:tasks.workunit.client.1.smithi196.stdout: 2024-03-23T23:57:41.351 INFO:tasks.workunit.client.1.smithi196.stdout: 2024-03-23T23:57:41.351 INFO:tasks.workunit.client.1.smithi196.stdout:5.3% User Time 2024-03-23T23:57:41.351 INFO:tasks.workunit.client.1.smithi196.stdout:51.8% System Time 2024-03-23T23:57:41.351 INFO:tasks.workunit.client.1.smithi196.stdout:57.1% CPU Utilization 2024-03-23T23:57:41.365 INFO:tasks.workunit.client.1.smithi196.stderr:+ cd .. 2024-03-23T23:57:41.365 INFO:tasks.workunit.client.1.smithi196.stderr:+ rm -r tmp ffsb 2024-03-23T23:57:41.627 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:57:41.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:41.767+0000 7f63e1a00640 1 Processor -- start 2024-03-23T23:57:41.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:41.767+0000 7f63e1a00640 1 -- start start 2024-03-23T23:57:41.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:41.767+0000 7f63e1a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f63dc0c1b70 0x7f63dc154220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:41.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:41.767+0000 7f63e1a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63dc06e350 0x7f63dc06e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:41.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:41.767+0000 7f63e1a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63dc14a560 con 0x7f63dc14a180 2024-03-23T23:57:41.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:41.767+0000 7f63e1a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63dc0c2070 con 0x7f63dc0c1b70 2024-03-23T23:57:41.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:41.767+0000 7f63e1a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc0c2350 con 0x7f63dc06e350 2024-03-23T23:57:41.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:41.767+0000 7f63da000640 1 -- >> v2:172.21.15.196:3300/0 conn(0x7f63dc0c1b70 msgr2=0x7f63dc154220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:57:41.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:41.767+0000 7f63da000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f63dc0c1b70 0x7f63dc154220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:57:41.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:41.767+0000 7f63daa00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f63dc14a180 0x7f63dc0c3620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:58212/0 (socket says 172.21.15.8:58212) 2024-03-23T23:57:41.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:41.767+0000 7f63daa00640 1 -- 172.21.15.8:0/1100637151 learned_addr learned my addr 172.21.15.8:0/1100637151 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:57:41.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:41.767+0000 7f63db400640 1 --2- 172.21.15.8:0/1100637151 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63dc06e350 0x7f63dc06e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:41.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:41.767+0000 7f63db400640 1 -- 172.21.15.8:0/1100637151 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63dc06e350 msgr2=0x7f63dc06e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T23:57:41.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:41.767+0000 7f63db400640 1 -- 172.21.15.8:0/1100637151 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63dc06e350 msgr2=0x7f63dc06e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:57:41.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:41.767+0000 7f63db400640 1 --2- 172.21.15.8:0/1100637151 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63dc06e350 0x7f63dc06e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:57:41.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:41.767+0000 7f63db400640 1 --2- 172.21.15.8:0/1100637151 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63dc06e350 0x7f63dc06e7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:57:41.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:41.971+0000 7f63da000640 1 -- 172.21.15.8:0/1100637151 >> v2:172.21.15.196:3300/0 conn(0x7f63dc0c1b70 msgr2=0x7f63dc154220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:57:41.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:41.971+0000 7f63da000640 1 --2- 172.21.15.8:0/1100637151 >> v2:172.21.15.196:3300/0 conn(0x7f63dc0c1b70 0x7f63dc154220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:57:41.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:41.971+0000 7f63db400640 1 --2- 172.21.15.8:0/1100637151 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63dc06e350 0x7f63dc06e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:41.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:41.971+0000 7f63db400640 1 -- 172.21.15.8:0/1100637151 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63dc06e350 msgr2=0x7f63dc06e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T23:57:41.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:41.971+0000 7f63db400640 1 -- 172.21.15.8:0/1100637151 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63dc06e350 msgr2=0x7f63dc06e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:57:41.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:41.971+0000 7f63db400640 1 --2- 172.21.15.8:0/1100637151 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63dc06e350 0x7f63dc06e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:57:41.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:41.971+0000 7f63db400640 1 --2- 172.21.15.8:0/1100637151 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63dc06e350 0x7f63dc06e7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:57:42.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:42.375+0000 7f63da000640 1 -- 172.21.15.8:0/1100637151 >> v2:172.21.15.196:3300/0 conn(0x7f63dc0c1b70 msgr2=0x7f63dc154220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:57:42.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:42.375+0000 7f63da000640 1 --2- 172.21.15.8:0/1100637151 >> v2:172.21.15.196:3300/0 conn(0x7f63dc0c1b70 0x7f63dc154220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:57:42.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:42.375+0000 7f63db400640 1 --2- 172.21.15.8:0/1100637151 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63dc06e350 0x7f63dc06e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:42.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:42.375+0000 7f63db400640 1 -- 172.21.15.8:0/1100637151 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63dc06e350 msgr2=0x7f63dc06e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T23:57:42.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:42.375+0000 7f63db400640 1 -- 172.21.15.8:0/1100637151 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63dc06e350 msgr2=0x7f63dc06e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:57:42.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:42.375+0000 7f63db400640 1 --2- 172.21.15.8:0/1100637151 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63dc06e350 0x7f63dc06e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:57:42.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:42.375+0000 7f63db400640 1 --2- 172.21.15.8:0/1100637151 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63dc06e350 0x7f63dc06e7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:57:43.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:43.179+0000 7f63da000640 1 -- 172.21.15.8:0/1100637151 >> v2:172.21.15.196:3300/0 conn(0x7f63dc0c1b70 msgr2=0x7f63dc154220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:57:43.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:43.179+0000 7f63da000640 1 --2- 172.21.15.8:0/1100637151 >> v2:172.21.15.196:3300/0 conn(0x7f63dc0c1b70 0x7f63dc154220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:57:43.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:43.179+0000 7f63db400640 1 --2- 172.21.15.8:0/1100637151 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63dc06e350 0x7f63dc06e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:43.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:43.179+0000 7f63db400640 1 -- 172.21.15.8:0/1100637151 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63dc06e350 msgr2=0x7f63dc06e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:57:43.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:43.179+0000 7f63db400640 1 -- 172.21.15.8:0/1100637151 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63dc06e350 msgr2=0x7f63dc06e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:57:43.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:43.179+0000 7f63db400640 1 --2- 172.21.15.8:0/1100637151 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63dc06e350 0x7f63dc06e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:57:43.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:43.179+0000 7f63db400640 1 --2- 172.21.15.8:0/1100637151 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63dc06e350 0x7f63dc06e7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:57:44.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.767+0000 7f63d3e00640 1 -- 172.21.15.8:0/1100637151 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63dc06e350 msgr2=0x7f63dc06e7e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:57:44.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.767+0000 7f63d3e00640 1 --2- 172.21.15.8:0/1100637151 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63dc06e350 0x7f63dc06e7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:44.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.767+0000 7f63d3e00640 1 -- 172.21.15.8:0/1100637151 >> v2:172.21.15.196:3300/0 conn(0x7f63dc0c1b70 msgr2=0x7f63dc154220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:57:44.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.767+0000 7f63d3e00640 1 --2- 172.21.15.8:0/1100637151 >> v2:172.21.15.196:3300/0 conn(0x7f63dc0c1b70 0x7f63dc154220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:44.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.767+0000 7f63d3e00640 1 -- 172.21.15.8:0/1100637151 >> v1:172.21.15.8:6789/0 conn(0x7f63dc14a180 legacy=0x7f63dc0c3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:44.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.767+0000 7f63d3e00640 1 --2- 172.21.15.8:0/1100637151 >> v2:172.21.15.8:3300/0 conn(0x7f63bc0036d0 0x7f63bc005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:44.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.767+0000 7f63d3e00640 1 -- 172.21.15.8:0/1100637151 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63dc0c2630 con 0x7f63bc0061a0 2024-03-23T23:57:44.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.767+0000 7f63d3e00640 1 -- 172.21.15.8:0/1100637151 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63dc0c2070 con 0x7f63bc0036d0 2024-03-23T23:57:44.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.767+0000 7f63da000640 1 -- 172.21.15.8:0/1100637151 >> v1:172.21.15.196:6789/0 conn(0x7f63bc0061a0 legacy=0x7f63bc008640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-03-23T23:57:44.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.767+0000 7f63daa00640 1 --2- 172.21.15.8:0/1100637151 >> v2:172.21.15.8:3300/0 conn(0x7f63bc0036d0 0x7f63bc005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:44.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.767+0000 7f63daa00640 1 -- 172.21.15.8:0/1100637151 >> v2:172.21.15.8:3300/0 conn(0x7f63bc0036d0 msgr2=0x7f63bc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:57:44.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.767+0000 7f63daa00640 1 -- 172.21.15.8:0/1100637151 >> v2:172.21.15.8:3300/0 conn(0x7f63bc0036d0 msgr2=0x7f63bc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:57:44.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.767+0000 7f63daa00640 1 --2- 172.21.15.8:0/1100637151 >> v2:172.21.15.8:3300/0 conn(0x7f63bc0036d0 0x7f63bc005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:57:44.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.767+0000 7f63daa00640 1 --2- 172.21.15.8:0/1100637151 >> v2:172.21.15.8:3300/0 conn(0x7f63bc0036d0 0x7f63bc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:57:44.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.971+0000 7f63da000640 1 -- 172.21.15.8:0/1100637151 >> v1:172.21.15.196:6789/0 conn(0x7f63bc0061a0 legacy=0x7f63bc008640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-03-23T23:57:44.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.971+0000 7f63daa00640 1 --2- 172.21.15.8:0/1100637151 >> v2:172.21.15.8:3300/0 conn(0x7f63bc0036d0 0x7f63bc005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:44.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.971+0000 7f63daa00640 1 -- 172.21.15.8:0/1100637151 >> v1:172.21.15.196:6789/0 conn(0x7f63bc0061a0 legacy=0x7f63bc008640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:57:44.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.971+0000 7f63daa00640 1 -- 172.21.15.8:0/1100637151 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63bc00af90 con 0x7f63bc0036d0 2024-03-23T23:57:44.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.971+0000 7f63daa00640 1 --2- 172.21.15.8:0/1100637151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63bc0036d0 0x7f63bc005b50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f63cc007d30 tx=0x7f63cc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f5593e0d97e8cb server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:44.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.971+0000 7f63d9600640 1 -- 172.21.15.8:0/1100637151 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc0a95f0 con 0x7f63bc0036d0 2024-03-23T23:57:44.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.971+0000 7f63d9600640 1 -- 172.21.15.8:0/1100637151 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63cc0a97b0 con 0x7f63bc0036d0 2024-03-23T23:57:44.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.971+0000 7f63d9600640 1 -- 172.21.15.8:0/1100637151 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc0a9ba0 con 0x7f63bc0036d0 2024-03-23T23:57:44.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.975+0000 7f63e1a00640 1 -- 172.21.15.8:0/1100637151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63bc0036d0 msgr2=0x7f63bc005b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:44.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.975+0000 7f63e1a00640 1 --2- 172.21.15.8:0/1100637151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63bc0036d0 0x7f63bc005b50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f63cc007d30 tx=0x7f63cc01c4d0 comp rx=0 tx=0).stop 2024-03-23T23:57:44.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.975+0000 7f63db400640 1 -- 172.21.15.8:0/1100637151 reap_dead start 2024-03-23T23:57:44.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.975+0000 7f63e1a00640 1 -- 172.21.15.8:0/1100637151 shutdown_connections 2024-03-23T23:57:44.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.975+0000 7f63e1a00640 1 --2- 172.21.15.8:0/1100637151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63bc0036d0 0x7f63bc005b50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:44.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.975+0000 7f63e1a00640 1 -- 172.21.15.8:0/1100637151 >> 172.21.15.8:0/1100637151 conn(0x7f63dc06b170 msgr2=0x7f63dc06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:57:44.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.975+0000 7f63e1a00640 1 -- 172.21.15.8:0/1100637151 shutdown_connections 2024-03-23T23:57:44.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.975+0000 7f63e1a00640 1 -- 172.21.15.8:0/1100637151 wait complete. 2024-03-23T23:57:44.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.975+0000 7f63e1a00640 1 Processor -- start 2024-03-23T23:57:44.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.975+0000 7f63e1a00640 1 -- start start 2024-03-23T23:57:44.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.979+0000 7f63e1a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63bc0036d0 0x7f63dc151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:44.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.979+0000 7f63e1a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63dc157f60 0x7f63dc1574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:44.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.979+0000 7f63e1a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63dc138830 0x7f63dc138ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:44.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.979+0000 7f63e1a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc160930 con 0x7f63dc157f60 2024-03-23T23:57:44.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.979+0000 7f63e1a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc1607b0 con 0x7f63bc0036d0 2024-03-23T23:57:44.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.979+0000 7f63e1a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc160ab0 con 0x7f63dc138830 2024-03-23T23:57:44.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.979+0000 7f63daa00640 1 -- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63bc0036d0 msgr2=0x7f63dc151a80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:57:44.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.979+0000 7f63daa00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63bc0036d0 0x7f63dc151a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:57:44.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.979+0000 7f63da000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63dc157f60 0x7f63dc1574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:44.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.979+0000 7f63da000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63dc157f60 0x7f63dc1574a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37350/0 (socket says 172.21.15.8:37350) 2024-03-23T23:57:44.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.979+0000 7f63da000640 1 -- 172.21.15.8:0/1266946195 learned_addr learned my addr 172.21.15.8:0/1266946195 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:57:44.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.979+0000 7f63db400640 1 --2- 172.21.15.8:0/1266946195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63dc138830 0x7f63dc138ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:44.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.979+0000 7f63da000640 1 -- 172.21.15.8:0/1266946195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63dc138830 msgr2=0x7f63dc138ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:44.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.979+0000 7f63da000640 1 --2- 172.21.15.8:0/1266946195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63dc138830 0x7f63dc138ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:44.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.979+0000 7f63da000640 1 -- 172.21.15.8:0/1266946195 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63bc0036d0 msgr2=0x7f63dc151a80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:57:44.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.979+0000 7f63da000640 1 --2- 172.21.15.8:0/1266946195 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63bc0036d0 0x7f63dc151a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:44.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.979+0000 7f63da000640 1 -- 172.21.15.8:0/1266946195 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63dc159540 con 0x7f63dc157f60 2024-03-23T23:57:44.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.979+0000 7f63db400640 1 --2- 172.21.15.8:0/1266946195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63dc138830 0x7f63dc138ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:57:44.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.979+0000 7f63da000640 1 --2- 172.21.15.8:0/1266946195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63dc157f60 0x7f63dc1574a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f63c800b880 tx=0x7f63c800bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:44.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.979+0000 7f63d2a00640 1 -- 172.21.15.8:0/1266946195 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c800ca50 con 0x7f63dc157f60 2024-03-23T23:57:44.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.979+0000 7f63d2a00640 1 -- 172.21.15.8:0/1266946195 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c8010030 con 0x7f63dc157f60 2024-03-23T23:57:44.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.979+0000 7f63d2a00640 1 -- 172.21.15.8:0/1266946195 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c8016430 con 0x7f63dc157f60 2024-03-23T23:57:44.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.979+0000 7f63e1a00640 1 -- 172.21.15.8:0/1266946195 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63dc0c17c0 con 0x7f63dc157f60 2024-03-23T23:57:44.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.979+0000 7f63e1a00640 1 -- 172.21.15.8:0/1266946195 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63dc155570 con 0x7f63dc157f60 2024-03-23T23:57:44.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.979+0000 7f63e1a00640 1 -- 172.21.15.8:0/1266946195 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63dc04f480 con 0x7f63dc157f60 2024-03-23T23:57:44.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.983+0000 7f63d2a00640 1 -- 172.21.15.8:0/1266946195 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f63c80153e0 con 0x7f63dc157f60 2024-03-23T23:57:44.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.983+0000 7f63d2a00640 1 --2- 172.21.15.8:0/1266946195 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f63bc068460 0x7f63bc06a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:44.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.983+0000 7f63d2a00640 1 -- 172.21.15.8:0/1266946195 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f63c8085920 con 0x7f63dc157f60 2024-03-23T23:57:44.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.983+0000 7f63daa00640 1 --2- 172.21.15.8:0/1266946195 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f63bc068460 0x7f63bc06a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:44.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.983+0000 7f63daa00640 1 --2- 172.21.15.8:0/1266946195 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f63bc068460 0x7f63bc06a920 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f63cc0ae000 tx=0x7f63cc0a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:44.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:44.987+0000 7f63d2a00640 1 -- 172.21.15.8:0/1266946195 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f63c80561d0 con 0x7f63dc157f60 2024-03-23T23:57:45.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.259+0000 7f63e1a00640 1 -- 172.21.15.8:0/1266946195 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f63dc0c3400 con 0x7f63dc157f60 2024-03-23T23:57:45.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.263+0000 7f63d2a00640 1 -- 172.21.15.8:0/1266946195 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1555 (secure 0 0 0) 0x7f63c8055ad0 con 0x7f63dc157f60 2024-03-23T23:57:45.265 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":120,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:57:45.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.263+0000 7f63e1a00640 1 -- 172.21.15.8:0/1266946195 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f63bc068460 msgr2=0x7f63bc06a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:45.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.263+0000 7f63e1a00640 1 --2- 172.21.15.8:0/1266946195 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f63bc068460 0x7f63bc06a920 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f63cc0ae000 tx=0x7f63cc0a7000 comp rx=0 tx=0).stop 2024-03-23T23:57:45.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.263+0000 7f63e1a00640 1 -- 172.21.15.8:0/1266946195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63dc157f60 msgr2=0x7f63dc1574a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:45.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.263+0000 7f63e1a00640 1 --2- 172.21.15.8:0/1266946195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63dc157f60 0x7f63dc1574a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f63c800b880 tx=0x7f63c800bd40 comp rx=0 tx=0).stop 2024-03-23T23:57:45.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.263+0000 7f63e1a00640 1 -- 172.21.15.8:0/1266946195 shutdown_connections 2024-03-23T23:57:45.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.263+0000 7f63e1a00640 1 --2- 172.21.15.8:0/1266946195 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f63bc068460 0x7f63bc06a920 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:45.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.263+0000 7f63e1a00640 1 --2- 172.21.15.8:0/1266946195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63dc138830 0x7f63dc138ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:45.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.263+0000 7f63e1a00640 1 --2- 172.21.15.8:0/1266946195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63dc157f60 0x7f63dc1574a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:45.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.263+0000 7f63e1a00640 1 --2- 172.21.15.8:0/1266946195 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63bc0036d0 0x7f63dc151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:45.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.263+0000 7f63e1a00640 1 -- 172.21.15.8:0/1266946195 >> 172.21.15.8:0/1266946195 conn(0x7f63dc06b170 msgr2=0x7f63dc1491d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:57:45.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.263+0000 7f63e1a00640 1 -- 172.21.15.8:0/1266946195 shutdown_connections 2024-03-23T23:57:45.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.263+0000 7f63e1a00640 1 -- 172.21.15.8:0/1266946195 wait complete. 2024-03-23T23:57:45.293 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-03-23T23:57:45.293 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-03-23T23:57:45.293 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:57:45.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.439+0000 7fa2bf600640 1 Processor -- start 2024-03-23T23:57:45.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.439+0000 7fa2bf600640 1 -- start start 2024-03-23T23:57:45.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.439+0000 7fa2bf600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2b814fc70 0x7fa2b80c3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:45.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.439+0000 7fa2bf600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa2b80c3d00 0x7fa2b80c4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:45.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.439+0000 7fa2bf600640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2b80c2f70 con 0x7fa2b8152850 2024-03-23T23:57:45.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.439+0000 7fa2bf600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2b80c36a0 con 0x7fa2b80c3d00 2024-03-23T23:57:45.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.439+0000 7fa2bf600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b8155e70 con 0x7fa2b814fc70 2024-03-23T23:57:45.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.439+0000 7fa2b7e00640 1 -- >> v2:172.21.15.196:3300/0 conn(0x7fa2b80c3d00 msgr2=0x7fa2b80c4160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:57:45.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.439+0000 7fa2b7e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa2b80c3d00 0x7fa2b80c4160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:57:45.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.439+0000 7fa2bd600640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fa2b8152850 0x7fa2b8152ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46620/0 (socket says 172.21.15.8:46620) 2024-03-23T23:57:45.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.439+0000 7fa2bd600640 1 -- 172.21.15.8:0/1413444776 learned_addr learned my addr 172.21.15.8:0/1413444776 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:57:45.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.439+0000 7fa2bcc00640 1 --2- 172.21.15.8:0/1413444776 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2b814fc70 0x7fa2b80c3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:45.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.439+0000 7fa2b7400640 1 -- 172.21.15.8:0/1413444776 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1494915115 0 0) 0x7fa2b80c2f70 con 0x7fa2b8152850 2024-03-23T23:57:45.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.439+0000 7fa2b7400640 1 -- 172.21.15.8:0/1413444776 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2a0005740 con 0x7fa2b8152850 2024-03-23T23:57:45.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.439+0000 7fa2bcc00640 1 -- 172.21.15.8:0/1413444776 >> v2:172.21.15.196:3300/0 conn(0x7fa2b80c3d00 msgr2=0x7fa2b80c4160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:57:45.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.439+0000 7fa2bcc00640 1 --2- 172.21.15.8:0/1413444776 >> v2:172.21.15.196:3300/0 conn(0x7fa2b80c3d00 0x7fa2b80c4160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:45.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.439+0000 7fa2bcc00640 1 -- 172.21.15.8:0/1413444776 >> v1:172.21.15.8:6789/0 conn(0x7fa2b8152850 legacy=0x7fa2b8152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:45.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.439+0000 7fa2bcc00640 1 -- 172.21.15.8:0/1413444776 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b8156150 con 0x7fa2b814fc70 2024-03-23T23:57:45.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.443+0000 7fa2bcc00640 1 --2- 172.21.15.8:0/1413444776 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2b814fc70 0x7fa2b80c3160 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0097c0 tx=0x7fa2ac01c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aeb7d5a31378ea86 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:45.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.443+0000 7fa2b7400640 1 -- 172.21.15.8:0/1413444776 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac0b0070 con 0x7fa2b814fc70 2024-03-23T23:57:45.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.443+0000 7fa2b7400640 1 -- 172.21.15.8:0/1413444776 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ac0ab600 con 0x7fa2b814fc70 2024-03-23T23:57:45.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.443+0000 7fa2b7400640 1 -- 172.21.15.8:0/1413444776 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac0ab9b0 con 0x7fa2b814fc70 2024-03-23T23:57:45.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.443+0000 7fa2bf600640 1 -- 172.21.15.8:0/1413444776 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2b814fc70 msgr2=0x7fa2b80c3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:45.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.443+0000 7fa2bf600640 1 --2- 172.21.15.8:0/1413444776 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2b814fc70 0x7fa2b80c3160 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0097c0 tx=0x7fa2ac01c430 comp rx=0 tx=0).stop 2024-03-23T23:57:45.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.443+0000 7fa2bf600640 1 -- 172.21.15.8:0/1413444776 shutdown_connections 2024-03-23T23:57:45.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.443+0000 7fa2bf600640 1 --2- 172.21.15.8:0/1413444776 >> v2:172.21.15.196:3300/0 conn(0x7fa2b80c3d00 0x7fa2b80c4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:45.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.443+0000 7fa2bf600640 1 --2- 172.21.15.8:0/1413444776 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2b814fc70 0x7fa2b80c3160 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:45.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.443+0000 7fa2bf600640 1 -- 172.21.15.8:0/1413444776 >> 172.21.15.8:0/1413444776 conn(0x7fa2b806b170 msgr2=0x7fa2b806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:57:45.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.443+0000 7fa2bf600640 1 -- 172.21.15.8:0/1413444776 shutdown_connections 2024-03-23T23:57:45.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.443+0000 7fa2bf600640 1 -- 172.21.15.8:0/1413444776 wait complete. 2024-03-23T23:57:45.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.447+0000 7fa2bf600640 1 Processor -- start 2024-03-23T23:57:45.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.447+0000 7fa2bf600640 1 -- start start 2024-03-23T23:57:45.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.447+0000 7fa2bf600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2b80c3d00 0x7fa2b80acf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:45.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.447+0000 7fa2bf600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2b814fc70 0x7fa2b8145120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:45.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.447+0000 7fa2bf600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa2b8152850 0x7fa2b81f1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:45.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.447+0000 7fa2bf600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b8150050 con 0x7fa2b80c3d00 2024-03-23T23:57:45.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.447+0000 7fa2bf600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b80c18d0 con 0x7fa2b8152850 2024-03-23T23:57:45.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.447+0000 7fa2bf600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b81533f0 con 0x7fa2b814fc70 2024-03-23T23:57:45.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.447+0000 7fa2bd600640 1 -- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa2b8152850 msgr2=0x7fa2b81f1bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:57:45.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.447+0000 7fa2bcc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2b80c3d00 0x7fa2b80acf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:45.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.447+0000 7fa2bd600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa2b8152850 0x7fa2b81f1bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:57:45.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.447+0000 7fa2bcc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2b80c3d00 0x7fa2b80acf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37358/0 (socket says 172.21.15.8:37358) 2024-03-23T23:57:45.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.447+0000 7fa2bcc00640 1 -- 172.21.15.8:0/2330297460 learned_addr learned my addr 172.21.15.8:0/2330297460 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:57:45.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.447+0000 7fa2b7e00640 1 --2- 172.21.15.8:0/2330297460 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2b814fc70 0x7fa2b8145120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:45.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.447+0000 7fa2bcc00640 1 -- 172.21.15.8:0/2330297460 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2b814fc70 msgr2=0x7fa2b8145120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:45.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.447+0000 7fa2bcc00640 1 --2- 172.21.15.8:0/2330297460 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2b814fc70 0x7fa2b8145120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:45.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.447+0000 7fa2bcc00640 1 -- 172.21.15.8:0/2330297460 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa2b8152850 msgr2=0x7fa2b81f1bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:57:45.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.447+0000 7fa2bcc00640 1 --2- 172.21.15.8:0/2330297460 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa2b8152850 0x7fa2b81f1bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:45.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.447+0000 7fa2bcc00640 1 -- 172.21.15.8:0/2330297460 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b8153b50 con 0x7fa2b80c3d00 2024-03-23T23:57:45.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.447+0000 7fa2bcc00640 1 --2- 172.21.15.8:0/2330297460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2b80c3d00 0x7fa2b80acf60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0097c0 tx=0x7fa2ac01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:45.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.447+0000 7fa2b4c00640 1 -- 172.21.15.8:0/2330297460 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac0b0040 con 0x7fa2b80c3d00 2024-03-23T23:57:45.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.447+0000 7fa2b4c00640 1 -- 172.21.15.8:0/2330297460 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ac004030 con 0x7fa2b80c3d00 2024-03-23T23:57:45.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.447+0000 7fa2bf600640 1 -- 172.21.15.8:0/2330297460 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2b8153e30 con 0x7fa2b80c3d00 2024-03-23T23:57:45.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.447+0000 7fa2b4c00640 1 -- 172.21.15.8:0/2330297460 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac006e20 con 0x7fa2b80c3d00 2024-03-23T23:57:45.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.447+0000 7fa2bf600640 1 -- 172.21.15.8:0/2330297460 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b81524a0 con 0x7fa2b80c3d00 2024-03-23T23:57:45.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.451+0000 7fa2bf600640 1 --2- 172.21.15.8:0/2330297460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2b81ee0a0 0x7fa2b81f2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:45.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.451+0000 7fa2bf600640 1 -- 172.21.15.8:0/2330297460 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b8068270 con 0x7fa2b81ee0a0 2024-03-23T23:57:45.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.451+0000 7fa2b7e00640 1 --2- 172.21.15.8:0/2330297460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2b81ee0a0 0x7fa2b81f2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:45.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.451+0000 7fa2b7e00640 1 -- 172.21.15.8:0/2330297460 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa2b815ce40 con 0x7fa2b81ee0a0 2024-03-23T23:57:45.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.451+0000 7fa2b7e00640 1 --2- 172.21.15.8:0/2330297460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2b81ee0a0 0x7fa2b81f2110 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8145cb0 tx=0x7fa2a4009a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:45.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.451+0000 7fa2b4c00640 1 -- 172.21.15.8:0/2330297460 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a4016070 con 0x7fa2b81ee0a0 2024-03-23T23:57:45.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.451+0000 7fa2b4c00640 1 -- 172.21.15.8:0/2330297460 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fa2ac003620 con 0x7fa2b80c3d00 2024-03-23T23:57:45.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.451+0000 7fa2b4c00640 1 --2- 172.21.15.8:0/2330297460 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa298067560 0x7fa298069a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:45.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.451+0000 7fa2b4c00640 1 -- 172.21.15.8:0/2330297460 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fa2a4012600 con 0x7fa2b81ee0a0 2024-03-23T23:57:45.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.451+0000 7fa2b4c00640 1 -- 172.21.15.8:0/2330297460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2b81ee0a0 msgr2=0x7fa2b81f2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:45.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.451+0000 7fa2b4c00640 1 --2- 172.21.15.8:0/2330297460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2b81ee0a0 0x7fa2b81f2110 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8145cb0 tx=0x7fa2a4009a40 comp rx=0 tx=0).stop 2024-03-23T23:57:45.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.451+0000 7fa2b4c00640 1 -- 172.21.15.8:0/2330297460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2b81ee0a0 msgr2=0x7fa2b81f2110 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:57:45.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.451+0000 7fa2b4c00640 1 --2- 172.21.15.8:0/2330297460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2b81ee0a0 0x7fa2b81f2110 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:45.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.451+0000 7fa2b4c00640 1 -- 172.21.15.8:0/2330297460 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fa2ac120670 con 0x7fa2b80c3d00 2024-03-23T23:57:45.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.451+0000 7fa2bd600640 1 --2- 172.21.15.8:0/2330297460 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa298067560 0x7fa298069a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:45.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.455+0000 7fa2bd600640 1 --2- 172.21.15.8:0/2330297460 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa298067560 0x7fa298069a20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa2b81f16f0 tx=0x7fa2b00016c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:45.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.459+0000 7fa2bf600640 1 --2- 172.21.15.8:0/2330297460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2b8145660 0x7fa2b813f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:45.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.459+0000 7fa2bf600640 1 -- 172.21.15.8:0/2330297460 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b80c11e0 con 0x7fa2b8145660 2024-03-23T23:57:45.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.459+0000 7fa2b7e00640 1 --2- 172.21.15.8:0/2330297460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2b8145660 0x7fa2b813f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:45.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.459+0000 7fa2b7e00640 1 -- 172.21.15.8:0/2330297460 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa2b80c14c0 con 0x7fa2b8145660 2024-03-23T23:57:45.464 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.459+0000 7fa2b7e00640 1 --2- 172.21.15.8:0/2330297460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2b8145660 0x7fa2b813f5e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4018000 tx=0x7fa2a40059e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:45.464 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.459+0000 7fa2b4c00640 1 -- 172.21.15.8:0/2330297460 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a4005a50 con 0x7fa2b8145660 2024-03-23T23:57:45.464 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.459+0000 7fa2b4c00640 1 -- 172.21.15.8:0/2330297460 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5174 (secure 0 0 0) 0x7fa2a4005a50 con 0x7fa2b8145660 2024-03-23T23:57:45.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.459+0000 7fa2b4c00640 1 -- 172.21.15.8:0/2330297460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2b8145660 msgr2=0x7fa2b813f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:45.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.459+0000 7fa2b4c00640 1 --2- 172.21.15.8:0/2330297460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2b8145660 0x7fa2b813f5e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4018000 tx=0x7fa2a40059e0 comp rx=0 tx=0).stop 2024-03-23T23:57:45.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.459+0000 7fa2b4c00640 1 -- 172.21.15.8:0/2330297460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2b8145660 msgr2=0x7fa2b813f5e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:57:45.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.459+0000 7fa2b4c00640 1 --2- 172.21.15.8:0/2330297460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2b8145660 0x7fa2b813f5e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:45.465 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:57:45.465 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:57:45.465 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:57:45.465 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:57:45.465 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 120, 2024-03-23T23:57:45.466 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:57:45.466 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:57:45.466 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:57:45.466 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:45.466 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 0, 2024-03-23T23:57:45.466 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:57:45.466 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:57:45.466 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:57:45.466 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:57:45.466 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:57:45.466 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:57:45.466 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:57:45.466 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:57:45.466 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:57:45.467 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:57:45.467 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:57:45.467 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:57:45.467 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:57:45.467 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:57:45.467 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:45.467 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:57:45.467 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:57:45.467 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:57:45.467 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:57:45.467 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:57:45.467 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:57:45.467 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:57:45.467 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:57:45.468 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:57:45.468 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:57:45.468 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:57:45.468 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:57:45.468 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:57:45.468 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:45.468 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:45.468 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:57:45.468 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:57:45.468 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:57:45.468 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:57:45.468 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:57:45.468 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:57:45.468 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:57:45.469 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:57:45.469 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:57:45.469 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:57:45.469 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:57:45.469 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:57:45.469 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:57:45.469 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:57:45.469 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:57:45.469 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:57:45.469 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:57:45.469 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:57:45.469 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:57:45.469 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:57:45.469 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:57:45.470 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:57:45.470 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:57:45.470 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:57:45.470 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:57:45.470 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:57:45.470 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:57:45.470 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:57:45.470 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:45.470 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:57:45.470 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:45.470 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:57:45.470 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:45.470 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:57:45.470 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:57:45.471 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:57:45.471 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:57:45.471 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:45.471 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:57:45.471 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:57:45.471 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:45.471 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:45.471 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:45.471 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:57:45.471 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:57:45.471 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:45.471 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:45.471 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:45.471 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:45.472 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:57:45.472 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:57:45.472 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:57:45.472 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:57:45.472 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:57:45.472 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:45.472 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:45.472 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:57:45.472 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:57:45.472 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:57:45.472 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:57:45.472 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:45.472 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:57:45.472 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:57:45.473 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:45.473 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:45.473 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:45.473 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:57:45.473 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:57:45.473 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:45.473 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:45.473 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:45.473 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:45.473 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:57:45.473 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:57:45.473 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:57:45.473 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:57:45.473 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:57:45.473 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:45.474 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:45.474 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:57:45.474 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:57:45.474 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:57:45.474 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:57:45.474 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:45.474 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:57:45.474 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:57:45.474 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:45.474 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:45.474 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:45.474 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:57:45.474 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:57:45.474 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:45.475 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:45.475 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:45.475 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:45.475 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:57:45.475 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:57:45.475 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:57:45.475 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:57:45.475 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:57:45.475 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:45.476 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:45.476 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:45.476 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:57:45.476 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:57:45.476 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:45.476 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:57:45.476 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:45.476 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:57:45.476 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:45.476 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:45.476 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:57:45.476 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:45.476 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:57:45.476 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:45.476 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:57:45.477 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:45.477 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:45.477 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:57:45.477 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:45.477 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:57:45.477 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:45.477 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 7 2024-03-23T23:57:45.477 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:45.477 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:45.477 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:57:45.477 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:45.477 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:57:45.477 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:45.477 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:57:45.478 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:45.478 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:45.478 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:57:45.478 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:45.478 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5 2024-03-23T23:57:45.478 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:45.478 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:45.478 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:57:45.478 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:45.478 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:57:45.478 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:45.478 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:57:45.478 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:45.478 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:45.479 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:45.479 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:57:45.479 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:57:45.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.459+0000 7fa2bf600640 1 -- 172.21.15.8:0/2330297460 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa298067560 msgr2=0x7fa298069a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:45.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.459+0000 7fa2bf600640 1 --2- 172.21.15.8:0/2330297460 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa298067560 0x7fa298069a20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa2b81f16f0 tx=0x7fa2b00016c0 comp rx=0 tx=0).stop 2024-03-23T23:57:45.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.459+0000 7fa2bf600640 1 -- 172.21.15.8:0/2330297460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2b80c3d00 msgr2=0x7fa2b80acf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:45.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.459+0000 7fa2bf600640 1 --2- 172.21.15.8:0/2330297460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2b80c3d00 0x7fa2b80acf60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0097c0 tx=0x7fa2ac01ac70 comp rx=0 tx=0).stop 2024-03-23T23:57:45.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.459+0000 7fa2bd600640 1 -- 172.21.15.8:0/2330297460 reap_dead start 2024-03-23T23:57:45.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.459+0000 7fa2bd600640 1 -- 172.21.15.8:0/2330297460 reap_dead start 2024-03-23T23:57:45.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.459+0000 7fa2bf600640 1 -- 172.21.15.8:0/2330297460 shutdown_connections 2024-03-23T23:57:45.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.459+0000 7fa2bf600640 1 -- 172.21.15.8:0/2330297460 >> 172.21.15.8:0/2330297460 conn(0x7fa2b806b170 msgr2=0x7fa2b806b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:57:45.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.463+0000 7fa2bf600640 1 -- 172.21.15.8:0/2330297460 shutdown_connections 2024-03-23T23:57:45.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.463+0000 7fa2bf600640 1 -- 172.21.15.8:0/2330297460 wait complete. 2024-03-23T23:57:45.485 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T23:57:45.485 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-03-23T23:57:45.485 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:57:45.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.627+0000 7fc828a00640 1 Processor -- start 2024-03-23T23:57:45.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.627+0000 7fc828a00640 1 -- start start 2024-03-23T23:57:45.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.627+0000 7fc828a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc8240c3c00 0x7fc8241558d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:45.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.627+0000 7fc828a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc824155e10 0x7fc82415cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:45.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.627+0000 7fc828a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc824073180 con 0x7fc82414c490 2024-03-23T23:57:45.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.627+0000 7fc828a00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc82406e9b0 con 0x7fc8240c3c00 2024-03-23T23:57:45.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.627+0000 7fc828a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8240c3420 con 0x7fc824155e10 2024-03-23T23:57:45.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.627+0000 7fc822800640 1 -- >> v1:172.21.15.196:6789/0 conn(0x7fc82414c490 legacy=0x7fc82406e2a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-03-23T23:57:45.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.627+0000 7fc821e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc8240c3c00 0x7fc8241558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:45.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.627+0000 7fc821e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc8240c3c00 0x7fc8241558d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37400/0 (socket says 172.21.15.8:37400) 2024-03-23T23:57:45.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.627+0000 7fc821e00640 1 -- 172.21.15.8:0/991392808 learned_addr learned my addr 172.21.15.8:0/991392808 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:57:45.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.627+0000 7fc823200640 1 --2- 172.21.15.8:0/991392808 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc824155e10 0x7fc82415cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:45.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.627+0000 7fc821e00640 1 -- 172.21.15.8:0/991392808 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc824155e10 msgr2=0x7fc82415cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:57:45.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.627+0000 7fc821e00640 1 --2- 172.21.15.8:0/991392808 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc824155e10 0x7fc82415cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:45.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.627+0000 7fc821e00640 1 -- 172.21.15.8:0/991392808 >> v1:172.21.15.196:6789/0 conn(0x7fc82414c490 legacy=0x7fc82406e2a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:57:45.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.627+0000 7fc821e00640 1 -- 172.21.15.8:0/991392808 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8241563f0 con 0x7fc8240c3c00 2024-03-23T23:57:45.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.631+0000 7fc821e00640 1 --2- 172.21.15.8:0/991392808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8240c3c00 0x7fc8241558d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc810009870 tx=0x7fc81001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf7c6b3b04d9434f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:45.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.631+0000 7fc821400640 1 -- 172.21.15.8:0/991392808 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8100b2070 con 0x7fc8240c3c00 2024-03-23T23:57:45.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.631+0000 7fc821400640 1 -- 172.21.15.8:0/991392808 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8100a9070 con 0x7fc8240c3c00 2024-03-23T23:57:45.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.631+0000 7fc821400640 1 -- 172.21.15.8:0/991392808 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8100ad880 con 0x7fc8240c3c00 2024-03-23T23:57:45.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.631+0000 7fc828a00640 1 -- 172.21.15.8:0/991392808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8240c3c00 msgr2=0x7fc8241558d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:45.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.631+0000 7fc828a00640 1 --2- 172.21.15.8:0/991392808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8240c3c00 0x7fc8241558d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc810009870 tx=0x7fc81001c490 comp rx=0 tx=0).stop 2024-03-23T23:57:45.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.631+0000 7fc828a00640 1 -- 172.21.15.8:0/991392808 shutdown_connections 2024-03-23T23:57:45.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.631+0000 7fc828a00640 1 --2- 172.21.15.8:0/991392808 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc824155e10 0x7fc82415cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:45.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.631+0000 7fc828a00640 1 --2- 172.21.15.8:0/991392808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8240c3c00 0x7fc8241558d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:45.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.631+0000 7fc828a00640 1 -- 172.21.15.8:0/991392808 >> 172.21.15.8:0/991392808 conn(0x7fc8240c4990 msgr2=0x7fc8240c4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:57:45.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.631+0000 7fc828a00640 1 -- 172.21.15.8:0/991392808 shutdown_connections 2024-03-23T23:57:45.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.631+0000 7fc828a00640 1 -- 172.21.15.8:0/991392808 wait complete. 2024-03-23T23:57:45.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.635+0000 7fc828a00640 1 Processor -- start 2024-03-23T23:57:45.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.635+0000 7fc828a00640 1 -- start start 2024-03-23T23:57:45.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.635+0000 7fc828a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8240c3c00 0x7fc82414aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:45.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.635+0000 7fc828a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc82414c490 0x7fc824146740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:45.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.635+0000 7fc828a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc824155e10 0x7fc82413b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:45.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.635+0000 7fc828a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8240c44d0 con 0x7fc8240c3c00 2024-03-23T23:57:45.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.635+0000 7fc828a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82406dbd0 con 0x7fc824155e10 2024-03-23T23:57:45.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.635+0000 7fc828a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8240c4650 con 0x7fc82414c490 2024-03-23T23:57:45.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.635+0000 7fc823200640 1 -- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc824155e10 msgr2=0x7fc82413b6e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.196:3300/0 2024-03-23T23:57:45.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.635+0000 7fc823200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc824155e10 0x7fc82413b6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:57:45.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.635+0000 7fc822800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8240c3c00 0x7fc82414aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:45.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.635+0000 7fc821e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc82414c490 0x7fc824146740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:45.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.635+0000 7fc822800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8240c3c00 0x7fc82414aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37406/0 (socket says 172.21.15.8:37406) 2024-03-23T23:57:45.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.635+0000 7fc822800640 1 -- 172.21.15.8:0/1191049182 learned_addr learned my addr 172.21.15.8:0/1191049182 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:57:45.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.635+0000 7fc822800640 1 -- 172.21.15.8:0/1191049182 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc82414c490 msgr2=0x7fc824146740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:45.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.635+0000 7fc822800640 1 --2- 172.21.15.8:0/1191049182 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc82414c490 0x7fc824146740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:45.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.635+0000 7fc822800640 1 -- 172.21.15.8:0/1191049182 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc824155e10 msgr2=0x7fc82413b6e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:57:45.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.635+0000 7fc822800640 1 --2- 172.21.15.8:0/1191049182 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc824155e10 0x7fc82413b6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:45.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.635+0000 7fc822800640 1 -- 172.21.15.8:0/1191049182 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82414b030 con 0x7fc8240c3c00 2024-03-23T23:57:45.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.635+0000 7fc822800640 1 --2- 172.21.15.8:0/1191049182 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8240c3c00 0x7fc82414aaf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc81400b510 tx=0x7fc81400b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:45.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.635+0000 7fc81aa00640 1 -- 172.21.15.8:0/1191049182 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc814003d80 con 0x7fc8240c3c00 2024-03-23T23:57:45.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.635+0000 7fc81aa00640 1 -- 172.21.15.8:0/1191049182 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc814015070 con 0x7fc8240c3c00 2024-03-23T23:57:45.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.635+0000 7fc81aa00640 1 -- 172.21.15.8:0/1191049182 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8140052b0 con 0x7fc8240c3c00 2024-03-23T23:57:45.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.635+0000 7fc828a00640 1 -- 172.21.15.8:0/1191049182 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8240c75d0 con 0x7fc8240c3c00 2024-03-23T23:57:45.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.635+0000 7fc828a00640 1 -- 172.21.15.8:0/1191049182 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc824148550 con 0x7fc8240c3c00 2024-03-23T23:57:45.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.639+0000 7fc828a00640 1 --2- 172.21.15.8:0/1191049182 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc82413bc20 0x7fc824154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:45.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.639+0000 7fc828a00640 1 -- 172.21.15.8:0/1191049182 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82404f410 con 0x7fc82413bc20 2024-03-23T23:57:45.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.639+0000 7fc821e00640 1 --2- 172.21.15.8:0/1191049182 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc82413bc20 0x7fc824154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:45.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.639+0000 7fc821e00640 1 -- 172.21.15.8:0/1191049182 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc8240c2000 con 0x7fc82413bc20 2024-03-23T23:57:45.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.639+0000 7fc81aa00640 1 -- 172.21.15.8:0/1191049182 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc814005450 con 0x7fc8240c3c00 2024-03-23T23:57:45.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.639+0000 7fc821e00640 1 --2- 172.21.15.8:0/1191049182 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc82413bc20 0x7fc824154060 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc8240c7df0 tx=0x7fc81001acd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:45.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.639+0000 7fc81aa00640 1 --2- 172.21.15.8:0/1191049182 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc804067640 0x7fc804069b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:45.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.639+0000 7fc81aa00640 1 -- 172.21.15.8:0/1191049182 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fc814085920 con 0x7fc8240c3c00 2024-03-23T23:57:45.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.639+0000 7fc81aa00640 1 -- 172.21.15.8:0/1191049182 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8100bd070 con 0x7fc82413bc20 2024-03-23T23:57:45.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.639+0000 7fc81aa00640 1 -- 172.21.15.8:0/1191049182 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fc8100b3040 con 0x7fc82413bc20 2024-03-23T23:57:45.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.639+0000 7fc823200640 1 --2- 172.21.15.8:0/1191049182 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc804067640 0x7fc804069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:45.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.639+0000 7fc81aa00640 1 -- 172.21.15.8:0/1191049182 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc82413bc20 msgr2=0x7fc824154060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:45.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.639+0000 7fc81aa00640 1 --2- 172.21.15.8:0/1191049182 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc82413bc20 0x7fc824154060 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc8240c7df0 tx=0x7fc81001acd0 comp rx=0 tx=0).stop 2024-03-23T23:57:45.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.639+0000 7fc81aa00640 1 -- 172.21.15.8:0/1191049182 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc82413bc20 msgr2=0x7fc824154060 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:57:45.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.639+0000 7fc81aa00640 1 --2- 172.21.15.8:0/1191049182 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc82413bc20 0x7fc824154060 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc8240c7df0 tx=0x7fc81001acd0 comp rx=0 tx=0).stop 2024-03-23T23:57:45.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.639+0000 7fc823200640 1 --2- 172.21.15.8:0/1191049182 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc804067640 0x7fc804069b00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc81c009a70 tx=0x7fc81c00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:45.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.647+0000 7fc828a00640 1 --2- 172.21.15.8:0/1191049182 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc8241545a0 0x7fc824145240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:57:45.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.647+0000 7fc828a00640 1 -- 172.21.15.8:0/1191049182 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc824072d50 con 0x7fc8241545a0 2024-03-23T23:57:45.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.647+0000 7fc821e00640 1 --2- 172.21.15.8:0/1191049182 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc8241545a0 0x7fc824145240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:57:45.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.647+0000 7fc821e00640 1 -- 172.21.15.8:0/1191049182 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc8240c42b0 con 0x7fc8241545a0 2024-03-23T23:57:45.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.647+0000 7fc821e00640 1 --2- 172.21.15.8:0/1191049182 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc8241545a0 0x7fc824145240 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc81001ab40 tx=0x7fc810019230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:57:45.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.647+0000 7fc81aa00640 1 -- 172.21.15.8:0/1191049182 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8100c4070 con 0x7fc8241545a0 2024-03-23T23:57:45.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.647+0000 7fc81aa00640 1 -- 172.21.15.8:0/1191049182 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5002 (secure 0 0 0) 0x7fc810003d70 con 0x7fc8241545a0 2024-03-23T23:57:45.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.647+0000 7fc81aa00640 1 -- 172.21.15.8:0/1191049182 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc8241545a0 msgr2=0x7fc824145240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:45.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.647+0000 7fc81aa00640 1 --2- 172.21.15.8:0/1191049182 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc8241545a0 0x7fc824145240 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc81001ab40 tx=0x7fc810019230 comp rx=0 tx=0).stop 2024-03-23T23:57:45.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.647+0000 7fc81aa00640 1 -- 172.21.15.8:0/1191049182 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc8241545a0 msgr2=0x7fc824145240 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:57:45.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.647+0000 7fc81aa00640 1 --2- 172.21.15.8:0/1191049182 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc8241545a0 0x7fc824145240 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc81001ab40 tx=0x7fc810019230 comp rx=0 tx=0).stop 2024-03-23T23:57:45.652 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:57:45.652 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:57:45.652 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:57:45.652 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:57:45.652 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 120, 2024-03-23T23:57:45.653 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:57:45.653 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:57:45.653 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:57:45.653 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:45.653 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 0, 2024-03-23T23:57:45.653 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:57:45.653 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:57:45.653 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:57:45.653 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:57:45.653 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:57:45.653 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:57:45.653 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:57:45.653 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:57:45.653 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:57:45.654 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:57:45.654 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:57:45.654 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:57:45.654 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:57:45.654 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:57:45.654 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:45.654 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:57:45.654 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:57:45.654 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:57:45.654 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:57:45.654 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:57:45.654 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:57:45.654 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:57:45.655 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:57:45.655 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:57:45.655 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:57:45.655 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:57:45.655 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:57:45.655 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:57:45.655 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:45.655 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:45.655 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:57:45.655 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:57:45.655 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:57:45.655 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:57:45.655 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:57:45.655 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:57:45.656 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:57:45.656 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:57:45.656 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:57:45.656 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:57:45.656 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:57:45.656 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:57:45.656 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:57:45.656 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:57:45.656 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:57:45.656 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:57:45.656 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:57:45.656 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:57:45.656 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:57:45.656 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:57:45.657 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:57:45.657 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:57:45.657 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:57:45.657 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:57:45.657 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:57:45.657 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:57:45.657 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:57:45.657 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:57:45.657 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:45.657 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:57:45.657 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:45.657 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:57:45.657 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:45.658 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:57:45.658 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:57:45.658 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:57:45.658 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:57:45.658 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:45.658 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:57:45.658 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:57:45.658 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:45.658 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:45.658 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:45.658 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:57:45.658 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:57:45.658 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:45.659 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:45.659 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:45.659 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:45.659 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:57:45.659 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:57:45.659 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:57:45.659 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:57:45.659 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:57:45.659 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:45.659 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:45.659 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:57:45.659 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:57:45.659 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:57:45.659 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:57:45.660 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:45.660 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:57:45.660 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:57:45.660 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:45.660 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:45.660 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:45.660 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:57:45.660 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:57:45.660 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:45.660 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:45.660 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:45.660 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:45.660 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:57:45.660 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:57:45.661 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:57:45.661 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:57:45.661 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:57:45.661 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:45.661 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:45.661 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:57:45.661 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:57:45.661 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:57:45.661 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:57:45.661 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:45.661 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:57:45.661 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:57:45.661 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:45.661 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:45.662 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:45.662 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:57:45.662 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:57:45.662 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:57:45.662 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:45.662 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:45.662 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:45.662 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:57:45.662 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:57:45.662 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:57:45.662 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:57:45.662 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:57:45.662 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:45.662 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:45.663 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:45.663 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:57:45.663 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:57:45.663 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:45.663 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:57:45.663 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:45.663 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:57:45.663 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:45.663 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:45.663 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:57:45.663 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:45.663 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:57:45.663 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:45.663 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:57:45.664 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:45.664 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:45.664 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:57:45.664 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:45.664 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:57:45.664 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:45.664 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:57:45.664 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:45.664 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:57:45.664 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:57:45.664 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:45.664 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:57:45.664 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:45.664 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:57:45.665 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:45.665 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:57:45.665 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:57:45.665 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:57:45.665 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:57:45.665 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:57:45.665 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:57:45.665 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:57:45.665 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:57:45.665 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:57:45.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.647+0000 7fc828a00640 1 -- 172.21.15.8:0/1191049182 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc804067640 msgr2=0x7fc804069b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:45.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.647+0000 7fc828a00640 1 --2- 172.21.15.8:0/1191049182 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc804067640 0x7fc804069b00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc81c009a70 tx=0x7fc81c00b040 comp rx=0 tx=0).stop 2024-03-23T23:57:45.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.647+0000 7fc828a00640 1 -- 172.21.15.8:0/1191049182 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8240c3c00 msgr2=0x7fc82414aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:57:45.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.647+0000 7fc828a00640 1 --2- 172.21.15.8:0/1191049182 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8240c3c00 0x7fc82414aaf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc81400b510 tx=0x7fc81400b9d0 comp rx=0 tx=0).stop 2024-03-23T23:57:45.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.647+0000 7fc823200640 1 -- 172.21.15.8:0/1191049182 reap_dead start 2024-03-23T23:57:45.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.647+0000 7fc828a00640 1 -- 172.21.15.8:0/1191049182 shutdown_connections 2024-03-23T23:57:45.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.647+0000 7fc828a00640 1 --2- 172.21.15.8:0/1191049182 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8240c3c00 0x7fc82414aaf0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:57:45.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.647+0000 7fc828a00640 1 -- 172.21.15.8:0/1191049182 >> 172.21.15.8:0/1191049182 conn(0x7fc8240c4990 msgr2=0x7fc824144830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:57:45.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.647+0000 7fc828a00640 1 -- 172.21.15.8:0/1191049182 shutdown_connections 2024-03-23T23:57:45.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:57:45.647+0000 7fc828a00640 1 -- 172.21.15.8:0/1191049182 wait complete. 2024-03-23T23:57:45.672 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T23:57:45.672 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-03-23T23:57:47.449 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:57:47.452 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:57:53.555 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-23T23:57:53.556 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-03-23T23:57:53.580 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.1... 2024-03-23T23:57:53.580 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-03-23T23:57:54.414 DEBUG:teuthology.parallel:result is None 2024-03-23T23:57:54.414 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-23T23:57:54.438 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-23T23:57:54.438 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-03-23T23:57:54.464 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-03-23T23:57:54.464 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2024-03-23T23:57:54.480 INFO:tasks.mon_thrash:joining mon_thrasher 2024-03-23T23:58:05.673 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-03-23T23:58:05.674 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-03-23T23:58:05.674 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-23T23:58:05.674 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-23T23:58:05.677 INFO:tasks.ceph.mon.b:Started 2024-03-23T23:58:05.677 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T23:58:05.678 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:58:05.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.835+0000 7fb1f0a00640 1 Processor -- start 2024-03-23T23:58:05.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.835+0000 7fb1f0a00640 1 -- start start 2024-03-23T23:58:05.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.835+0000 7fb1f0a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb1ec071030 0x7fb1ec0abf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:05.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.835+0000 7fb1f0a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ec0c86a0 con 0x7fb1ec0c89b0 2024-03-23T23:58:05.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.835+0000 7fb1f0a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ec0c52a0 con 0x7fb1ec0c4ac0 2024-03-23T23:58:05.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.835+0000 7fb1f0a00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1ec0c5580 con 0x7fb1ec071030 2024-03-23T23:58:05.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.835+0000 7fb1ea800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb1ec071030 0x7fb1ec0abf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:05.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.835+0000 7fb1ea800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb1ec071030 0x7fb1ec0abf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35892/0 (socket says 172.21.15.8:35892) 2024-03-23T23:58:05.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.835+0000 7fb1ea800640 1 -- 172.21.15.8:0/2393541715 learned_addr learned my addr 172.21.15.8:0/2393541715 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:05.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.835+0000 7fb1e9e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fb1ec0c89b0 0x7fb1ec0c7f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:33126/0 (socket says 172.21.15.8:33126) 2024-03-23T23:58:05.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.835+0000 7fb1ea800640 1 -- 172.21.15.8:0/2393541715 >> v1:172.21.15.196:6789/0 conn(0x7fb1ec0c4ac0 legacy=0x7fb1ec157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:05.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.835+0000 7fb1ea800640 1 -- 172.21.15.8:0/2393541715 >> v1:172.21.15.8:6789/0 conn(0x7fb1ec0c89b0 legacy=0x7fb1ec0c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:05.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.835+0000 7fb1ea800640 1 -- 172.21.15.8:0/2393541715 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ec0c7790 con 0x7fb1ec071030 2024-03-23T23:58:05.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.835+0000 7fb1e9400640 1 -- 172.21.15.8:0/2393541715 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 704407741 0 0) 0x7fb1ec0c86a0 con 0x7fb1ec0c89b0 2024-03-23T23:58:05.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.839+0000 7fb1ea800640 1 --2- 172.21.15.8:0/2393541715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1ec071030 0x7fb1ec0abf30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc009870 tx=0x7fb1dc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e34b031b9649b3bb server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:05.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.839+0000 7fb1e9400640 1 -- 172.21.15.8:0/2393541715 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc0b0070 con 0x7fb1ec071030 2024-03-23T23:58:05.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.839+0000 7fb1e9400640 1 -- 172.21.15.8:0/2393541715 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1dc0ab600 con 0x7fb1ec071030 2024-03-23T23:58:05.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.839+0000 7fb1e9400640 1 -- 172.21.15.8:0/2393541715 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc0ab9d0 con 0x7fb1ec071030 2024-03-23T23:58:05.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.839+0000 7fb1f0a00640 1 -- 172.21.15.8:0/2393541715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1ec071030 msgr2=0x7fb1ec0abf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:05.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.839+0000 7fb1f0a00640 1 --2- 172.21.15.8:0/2393541715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1ec071030 0x7fb1ec0abf30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc009870 tx=0x7fb1dc01c4d0 comp rx=0 tx=0).stop 2024-03-23T23:58:05.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.839+0000 7fb1f0a00640 1 -- 172.21.15.8:0/2393541715 shutdown_connections 2024-03-23T23:58:05.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.839+0000 7fb1f0a00640 1 --2- 172.21.15.8:0/2393541715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1ec071030 0x7fb1ec0abf30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:05.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.839+0000 7fb1f0a00640 1 -- 172.21.15.8:0/2393541715 >> 172.21.15.8:0/2393541715 conn(0x7fb1ec0aac30 msgr2=0x7fb1ec0ab040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:05.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.839+0000 7fb1f0a00640 1 -- 172.21.15.8:0/2393541715 shutdown_connections 2024-03-23T23:58:05.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.839+0000 7fb1f0a00640 1 -- 172.21.15.8:0/2393541715 wait complete. 2024-03-23T23:58:05.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.839+0000 7fb1f0a00640 1 Processor -- start 2024-03-23T23:58:05.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.839+0000 7fb1f0a00640 1 -- start start 2024-03-23T23:58:05.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.843+0000 7fb1f0a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1ec071030 0x7fb1ec146bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:05.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.843+0000 7fb1f0a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1ec0c4ac0 0x7fb1ec14d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:05.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.843+0000 7fb1f0a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1ec0c89b0 0x7fb1ec0ad5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:05.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.843+0000 7fb1f0a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec161950 con 0x7fb1ec0c4ac0 2024-03-23T23:58:05.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.843+0000 7fb1f0a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec071620 con 0x7fb1ec0c89b0 2024-03-23T23:58:05.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.843+0000 7fb1f0a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec161ad0 con 0x7fb1ec071030 2024-03-23T23:58:05.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.843+0000 7fb1e9e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1ec0c4ac0 0x7fb1ec14d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:05.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.843+0000 7fb1ea800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1ec071030 0x7fb1ec146bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:05.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.843+0000 7fb1ea800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1ec071030 0x7fb1ec146bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:33236/0 (socket says 172.21.15.8:33236) 2024-03-23T23:58:05.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.843+0000 7fb1ea800640 1 -- 172.21.15.8:0/3088444095 learned_addr learned my addr 172.21.15.8:0/3088444095 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:05.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.843+0000 7fb1e9e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1ec0c4ac0 0x7fb1ec14d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35906/0 (socket says 172.21.15.8:35906) 2024-03-23T23:58:05.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.843+0000 7fb1eb200640 1 --2- 172.21.15.8:0/3088444095 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1ec0c89b0 0x7fb1ec0ad5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:05.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.843+0000 7fb1eb200640 1 -- 172.21.15.8:0/3088444095 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1ec0c89b0 msgr2=0x7fb1ec0ad5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-03-23T23:58:05.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.843+0000 7fb1eb200640 1 -- 172.21.15.8:0/3088444095 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1ec0c89b0 msgr2=0x7fb1ec0ad5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T23:58:05.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.843+0000 7fb1eb200640 1 --2- 172.21.15.8:0/3088444095 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1ec0c89b0 0x7fb1ec0ad5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:58:05.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.843+0000 7fb1eb200640 1 --2- 172.21.15.8:0/3088444095 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1ec0c89b0 0x7fb1ec0ad5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:58:05.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.843+0000 7fb1e9e00640 1 -- 172.21.15.8:0/3088444095 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1ec071030 msgr2=0x7fb1ec146bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:05.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.843+0000 7fb1e9e00640 1 --2- 172.21.15.8:0/3088444095 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1ec071030 0x7fb1ec146bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:05.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.843+0000 7fb1e9e00640 1 -- 172.21.15.8:0/3088444095 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1ec0c89b0 msgr2=0x7fb1ec0ad5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:58:05.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.843+0000 7fb1e9e00640 1 --2- 172.21.15.8:0/3088444095 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1ec0c89b0 0x7fb1ec0ad5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:05.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.843+0000 7fb1e9e00640 1 -- 172.21.15.8:0/3088444095 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ec1ec000 con 0x7fb1ec0c4ac0 2024-03-23T23:58:05.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.843+0000 7fb1ea800640 1 --2- 172.21.15.8:0/3088444095 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1ec071030 0x7fb1ec146bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:58:05.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.843+0000 7fb1e9e00640 1 --2- 172.21.15.8:0/3088444095 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1ec0c4ac0 0x7fb1ec14d180 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8000c10 tx=0x7fb1d800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:05.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.843+0000 7fb1e2a00640 1 -- 172.21.15.8:0/3088444095 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d80074e0 con 0x7fb1ec0c4ac0 2024-03-23T23:58:05.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.843+0000 7fb1e2a00640 1 -- 172.21.15.8:0/3088444095 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d8007680 con 0x7fb1ec0c4ac0 2024-03-23T23:58:05.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.843+0000 7fb1f0a00640 1 -- 172.21.15.8:0/3088444095 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1ec1ec2e0 con 0x7fb1ec0c4ac0 2024-03-23T23:58:05.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.843+0000 7fb1e2a00640 1 -- 172.21.15.8:0/3088444095 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d8004a30 con 0x7fb1ec0c4ac0 2024-03-23T23:58:05.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.843+0000 7fb1f0a00640 1 -- 172.21.15.8:0/3088444095 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1ec1ec8a0 con 0x7fb1ec0c4ac0 2024-03-23T23:58:05.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.843+0000 7fb1f0a00640 1 -- 172.21.15.8:0/3088444095 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1ec04f410 con 0x7fb1ec0c4ac0 2024-03-23T23:58:05.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.847+0000 7fb1e2a00640 1 -- 172.21.15.8:0/3088444095 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb1d8011070 con 0x7fb1ec0c4ac0 2024-03-23T23:58:05.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.847+0000 7fb1e2a00640 1 --2- 172.21.15.8:0/3088444095 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb1cc067660 0x7fb1cc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:05.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.847+0000 7fb1e2a00640 1 -- 172.21.15.8:0/3088444095 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fb1d80857f0 con 0x7fb1ec0c4ac0 2024-03-23T23:58:05.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.847+0000 7fb1ea800640 1 --2- 172.21.15.8:0/3088444095 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb1cc067660 0x7fb1cc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:05.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.847+0000 7fb1ea800640 1 --2- 172.21.15.8:0/3088444095 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb1cc067660 0x7fb1cc069b20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc01a100 tx=0x7fb1dc0a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:05.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:05.851+0000 7fb1e2a00640 1 -- 172.21.15.8:0/3088444095 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fb1d8056010 con 0x7fb1ec0c4ac0 2024-03-23T23:58:06.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:06.079+0000 7fb1f0a00640 1 -- 172.21.15.8:0/3088444095 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb1ec0c4760 con 0x7fb1ec0c4ac0 2024-03-23T23:58:06.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:06.079+0000 7fb1e2a00640 1 -- 172.21.15.8:0/3088444095 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1556 (secure 0 0 0) 0x7fb1d8055910 con 0x7fb1ec0c4ac0 2024-03-23T23:58:06.078 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":120,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:58:06.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:06.079+0000 7fb1f0a00640 1 -- 172.21.15.8:0/3088444095 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb1cc067660 msgr2=0x7fb1cc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:06.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:06.079+0000 7fb1f0a00640 1 --2- 172.21.15.8:0/3088444095 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb1cc067660 0x7fb1cc069b20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc01a100 tx=0x7fb1dc0a6000 comp rx=0 tx=0).stop 2024-03-23T23:58:06.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:06.079+0000 7fb1f0a00640 1 -- 172.21.15.8:0/3088444095 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1ec0c4ac0 msgr2=0x7fb1ec14d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:06.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:06.079+0000 7fb1f0a00640 1 --2- 172.21.15.8:0/3088444095 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1ec0c4ac0 0x7fb1ec14d180 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8000c10 tx=0x7fb1d800c8e0 comp rx=0 tx=0).stop 2024-03-23T23:58:06.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:06.079+0000 7fb1f0a00640 1 -- 172.21.15.8:0/3088444095 shutdown_connections 2024-03-23T23:58:06.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:06.079+0000 7fb1f0a00640 1 --2- 172.21.15.8:0/3088444095 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1ec0c89b0 0x7fb1ec0ad5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:06.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:06.079+0000 7fb1f0a00640 1 --2- 172.21.15.8:0/3088444095 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1ec0c4ac0 0x7fb1ec14d180 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:06.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:06.079+0000 7fb1f0a00640 1 --2- 172.21.15.8:0/3088444095 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb1cc067660 0x7fb1cc069b20 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:06.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:06.079+0000 7fb1f0a00640 1 --2- 172.21.15.8:0/3088444095 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1ec071030 0x7fb1ec146bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:06.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:06.079+0000 7fb1f0a00640 1 -- 172.21.15.8:0/3088444095 >> 172.21.15.8:0/3088444095 conn(0x7fb1ec0aac30 msgr2=0x7fb1ec06ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:06.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:06.079+0000 7fb1f0a00640 1 -- 172.21.15.8:0/3088444095 shutdown_connections 2024-03-23T23:58:06.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:06.079+0000 7fb1f0a00640 1 -- 172.21.15.8:0/3088444095 wait complete. 2024-03-23T23:58:09.100 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:58:09.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.243+0000 7fc088400640 1 Processor -- start 2024-03-23T23:58:09.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.243+0000 7fc088400640 1 -- start start 2024-03-23T23:58:09.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.243+0000 7fc088400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc0800c2ee0 0x7fc080152630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:09.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.243+0000 7fc088400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc080070e90 0x7fc0801562c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:09.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.243+0000 7fc088400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc080152b70 con 0x7fc0800ac250 2024-03-23T23:58:09.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.243+0000 7fc088400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc080155e30 con 0x7fc0800c2ee0 2024-03-23T23:58:09.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.243+0000 7fc088400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc080152e10 con 0x7fc080070e90 2024-03-23T23:58:09.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.243+0000 7fc085a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc0800c2ee0 0x7fc080152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:09.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.243+0000 7fc086400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fc0800ac250 0x7fc08014c270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:33136/0 (socket says 172.21.15.8:33136) 2024-03-23T23:58:09.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.243+0000 7fc086400640 1 -- 172.21.15.8:0/1705170824 learned_addr learned my addr 172.21.15.8:0/1705170824 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:58:09.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.243+0000 7fc085000640 1 --2- 172.21.15.8:0/1705170824 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc080070e90 0x7fc0801562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:09.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.243+0000 7fc085a00640 1 -- 172.21.15.8:0/1705170824 >> v2:172.21.15.196:3300/0 conn(0x7fc0800c2ee0 msgr2=0x7fc080152630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:58:09.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.243+0000 7fc085a00640 1 -- 172.21.15.8:0/1705170824 >> v2:172.21.15.196:3300/0 conn(0x7fc0800c2ee0 msgr2=0x7fc080152630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:58:09.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.243+0000 7fc085a00640 1 --2- 172.21.15.8:0/1705170824 >> v2:172.21.15.196:3300/0 conn(0x7fc0800c2ee0 0x7fc080152630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:58:09.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.243+0000 7fc085a00640 1 --2- 172.21.15.8:0/1705170824 >> v2:172.21.15.196:3300/0 conn(0x7fc0800c2ee0 0x7fc080152630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:58:09.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.243+0000 7fc085000640 1 -- 172.21.15.8:0/1705170824 >> v2:172.21.15.196:3300/0 conn(0x7fc0800c2ee0 msgr2=0x7fc080152630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:58:09.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.243+0000 7fc085000640 1 --2- 172.21.15.8:0/1705170824 >> v2:172.21.15.196:3300/0 conn(0x7fc0800c2ee0 0x7fc080152630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:09.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.243+0000 7fc085000640 1 -- 172.21.15.8:0/1705170824 >> v1:172.21.15.8:6789/0 conn(0x7fc0800ac250 legacy=0x7fc08014c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:09.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.243+0000 7fc085000640 1 -- 172.21.15.8:0/1705170824 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0801530f0 con 0x7fc080070e90 2024-03-23T23:58:09.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.243+0000 7fc07fe00640 1 -- 172.21.15.8:0/1705170824 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2482419526 0 0) 0x7fc080152b70 con 0x7fc0800ac250 2024-03-23T23:58:09.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.247+0000 7fc085000640 1 --2- 172.21.15.8:0/1705170824 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc080070e90 0x7fc0801562c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc06c0097c0 tx=0x7fc06c01c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9721b556ef8c56b7 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:09.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.247+0000 7fc07fe00640 1 -- 172.21.15.8:0/1705170824 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c0b0070 con 0x7fc080070e90 2024-03-23T23:58:09.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.247+0000 7fc07fe00640 1 -- 172.21.15.8:0/1705170824 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06c0ab600 con 0x7fc080070e90 2024-03-23T23:58:09.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.247+0000 7fc07fe00640 1 -- 172.21.15.8:0/1705170824 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c0ab9d0 con 0x7fc080070e90 2024-03-23T23:58:09.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.247+0000 7fc088400640 1 -- 172.21.15.8:0/1705170824 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc080070e90 msgr2=0x7fc0801562c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:09.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.247+0000 7fc088400640 1 --2- 172.21.15.8:0/1705170824 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc080070e90 0x7fc0801562c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc06c0097c0 tx=0x7fc06c01c410 comp rx=0 tx=0).stop 2024-03-23T23:58:09.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.247+0000 7fc088400640 1 -- 172.21.15.8:0/1705170824 shutdown_connections 2024-03-23T23:58:09.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.247+0000 7fc088400640 1 --2- 172.21.15.8:0/1705170824 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc080070e90 0x7fc0801562c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:09.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.247+0000 7fc088400640 1 --2- 172.21.15.8:0/1705170824 >> v2:172.21.15.196:3300/0 conn(0x7fc0800c2ee0 0x7fc080152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:09.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.247+0000 7fc088400640 1 -- 172.21.15.8:0/1705170824 >> 172.21.15.8:0/1705170824 conn(0x7fc08006b170 msgr2=0x7fc08006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:09.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.247+0000 7fc088400640 1 -- 172.21.15.8:0/1705170824 shutdown_connections 2024-03-23T23:58:09.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.247+0000 7fc088400640 1 -- 172.21.15.8:0/1705170824 wait complete. 2024-03-23T23:58:09.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.247+0000 7fc088400640 1 Processor -- start 2024-03-23T23:58:09.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.247+0000 7fc088400640 1 -- start start 2024-03-23T23:58:09.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.251+0000 7fc088400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc080070e90 0x7fc08013a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:09.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.251+0000 7fc088400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0800ac250 0x7fc0801ee8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:09.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.251+0000 7fc088400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0800c2ee0 0x7fc08013d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:09.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.251+0000 7fc088400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08015d7c0 con 0x7fc0800ac250 2024-03-23T23:58:09.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.251+0000 7fc088400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0800c34d0 con 0x7fc0800c2ee0 2024-03-23T23:58:09.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.251+0000 7fc088400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08015d940 con 0x7fc080070e90 2024-03-23T23:58:09.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.251+0000 7fc085000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0800ac250 0x7fc0801ee8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:09.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.251+0000 7fc085a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc080070e90 0x7fc08013a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:09.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.251+0000 7fc085000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0800ac250 0x7fc0801ee8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35908/0 (socket says 172.21.15.8:35908) 2024-03-23T23:58:09.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.251+0000 7fc085000640 1 -- 172.21.15.8:0/1631166074 learned_addr learned my addr 172.21.15.8:0/1631166074 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:09.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.251+0000 7fc086400640 1 --2- 172.21.15.8:0/1631166074 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0800c2ee0 0x7fc08013d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:09.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.251+0000 7fc086400640 1 -- 172.21.15.8:0/1631166074 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0800c2ee0 msgr2=0x7fc08013d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-03-23T23:58:09.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.251+0000 7fc086400640 1 -- 172.21.15.8:0/1631166074 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0800c2ee0 msgr2=0x7fc08013d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T23:58:09.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.251+0000 7fc086400640 1 --2- 172.21.15.8:0/1631166074 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0800c2ee0 0x7fc08013d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:58:09.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.251+0000 7fc086400640 1 --2- 172.21.15.8:0/1631166074 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0800c2ee0 0x7fc08013d890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:58:09.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.251+0000 7fc085000640 1 -- 172.21.15.8:0/1631166074 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc080070e90 msgr2=0x7fc08013a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:09.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.251+0000 7fc085000640 1 --2- 172.21.15.8:0/1631166074 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc080070e90 0x7fc08013a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:09.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.251+0000 7fc085000640 1 -- 172.21.15.8:0/1631166074 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0800c2ee0 msgr2=0x7fc08013d890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:58:09.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.251+0000 7fc085000640 1 --2- 172.21.15.8:0/1631166074 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0800c2ee0 0x7fc08013d890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:09.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.251+0000 7fc085000640 1 -- 172.21.15.8:0/1631166074 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0801557f0 con 0x7fc0800ac250 2024-03-23T23:58:09.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.251+0000 7fc085000640 1 --2- 172.21.15.8:0/1631166074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0800ac250 0x7fc0801ee8e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc06c0097c0 tx=0x7fc06c01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:09.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.251+0000 7fc07d600640 1 -- 172.21.15.8:0/1631166074 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c0bb070 con 0x7fc0800ac250 2024-03-23T23:58:09.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.251+0000 7fc07d600640 1 -- 172.21.15.8:0/1631166074 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06c004020 con 0x7fc0800ac250 2024-03-23T23:58:09.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.251+0000 7fc088400640 1 -- 172.21.15.8:0/1631166074 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc08013fe50 con 0x7fc0800ac250 2024-03-23T23:58:09.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.251+0000 7fc07d600640 1 -- 172.21.15.8:0/1631166074 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c0b0040 con 0x7fc0800ac250 2024-03-23T23:58:09.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.251+0000 7fc088400640 1 -- 172.21.15.8:0/1631166074 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc080140410 con 0x7fc0800ac250 2024-03-23T23:58:09.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.251+0000 7fc088400640 1 -- 172.21.15.8:0/1631166074 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc08004f480 con 0x7fc0800ac250 2024-03-23T23:58:09.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.255+0000 7fc07d600640 1 -- 172.21.15.8:0/1631166074 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc06c003620 con 0x7fc0800ac250 2024-03-23T23:58:09.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.255+0000 7fc07d600640 1 --2- 172.21.15.8:0/1631166074 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc060067690 0x7fc060069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:09.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.255+0000 7fc07d600640 1 -- 172.21.15.8:0/1631166074 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fc06c120090 con 0x7fc0800ac250 2024-03-23T23:58:09.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.255+0000 7fc085a00640 1 --2- 172.21.15.8:0/1631166074 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc060067690 0x7fc060069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:09.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.255+0000 7fc085a00640 1 --2- 172.21.15.8:0/1631166074 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc060067690 0x7fc060069b50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc074000ee0 tx=0x7fc074008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:09.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.263+0000 7fc07d600640 1 -- 172.21.15.8:0/1631166074 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fc06c016090 con 0x7fc0800ac250 2024-03-23T23:58:09.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.487+0000 7fc088400640 1 -- 172.21.15.8:0/1631166074 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc080149a20 con 0x7fc0800ac250 2024-03-23T23:58:09.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.487+0000 7fc07d600640 1 -- 172.21.15.8:0/1631166074 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1556 (secure 0 0 0) 0x7fc06c0f0940 con 0x7fc0800ac250 2024-03-23T23:58:09.488 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":120,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:58:09.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.491+0000 7fc088400640 1 -- 172.21.15.8:0/1631166074 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc060067690 msgr2=0x7fc060069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:09.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.491+0000 7fc088400640 1 --2- 172.21.15.8:0/1631166074 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc060067690 0x7fc060069b50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc074000ee0 tx=0x7fc074008040 comp rx=0 tx=0).stop 2024-03-23T23:58:09.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.491+0000 7fc088400640 1 -- 172.21.15.8:0/1631166074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0800ac250 msgr2=0x7fc0801ee8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:09.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.491+0000 7fc088400640 1 --2- 172.21.15.8:0/1631166074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0800ac250 0x7fc0801ee8e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc06c0097c0 tx=0x7fc06c01ac50 comp rx=0 tx=0).stop 2024-03-23T23:58:09.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.491+0000 7fc088400640 1 -- 172.21.15.8:0/1631166074 shutdown_connections 2024-03-23T23:58:09.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.491+0000 7fc088400640 1 --2- 172.21.15.8:0/1631166074 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0800c2ee0 0x7fc08013d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:09.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.491+0000 7fc088400640 1 --2- 172.21.15.8:0/1631166074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0800ac250 0x7fc0801ee8e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:09.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.491+0000 7fc088400640 1 --2- 172.21.15.8:0/1631166074 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc060067690 0x7fc060069b50 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:09.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.491+0000 7fc088400640 1 --2- 172.21.15.8:0/1631166074 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc080070e90 0x7fc08013a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:09.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.491+0000 7fc088400640 1 -- 172.21.15.8:0/1631166074 >> 172.21.15.8:0/1631166074 conn(0x7fc08006b170 msgr2=0x7fc0800c3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:09.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.491+0000 7fc088400640 1 -- 172.21.15.8:0/1631166074 shutdown_connections 2024-03-23T23:58:09.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:09.491+0000 7fc088400640 1 -- 172.21.15.8:0/1631166074 wait complete. 2024-03-23T23:58:12.509 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:58:12.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.651+0000 7fc911200640 1 Processor -- start 2024-03-23T23:58:12.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.651+0000 7fc911200640 1 -- start start 2024-03-23T23:58:12.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.651+0000 7fc911200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc90c0c2ee0 0x7fc90c152630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:12.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.651+0000 7fc911200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc90c0ac250 0x7fc90c14c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:12.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.651+0000 7fc911200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc90c152b70 con 0x7fc90c070e90 2024-03-23T23:58:12.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.651+0000 7fc911200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc90c155e30 con 0x7fc90c0c2ee0 2024-03-23T23:58:12.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.651+0000 7fc911200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c152e10 con 0x7fc90c0ac250 2024-03-23T23:58:12.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.651+0000 7fc909e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc90c0c2ee0 0x7fc90c152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:12.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.651+0000 7fc903e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fc90c070e90 0x7fc90c1562c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:33150/0 (socket says 172.21.15.8:33150) 2024-03-23T23:58:12.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.651+0000 7fc903e00640 1 -- 172.21.15.8:0/1707701482 learned_addr learned my addr 172.21.15.8:0/1707701482 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:58:12.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.651+0000 7fc90a800640 1 --2- 172.21.15.8:0/1707701482 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc90c0ac250 0x7fc90c14c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:12.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.651+0000 7fc909e00640 1 -- 172.21.15.8:0/1707701482 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc90c0ac250 msgr2=0x7fc90c14c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:12.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.651+0000 7fc909e00640 1 --2- 172.21.15.8:0/1707701482 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc90c0ac250 0x7fc90c14c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.651+0000 7fc909e00640 1 -- 172.21.15.8:0/1707701482 >> v1:172.21.15.8:6789/0 conn(0x7fc90c070e90 legacy=0x7fc90c1562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:12.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.651+0000 7fc909e00640 1 -- 172.21.15.8:0/1707701482 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90c1530f0 con 0x7fc90c0c2ee0 2024-03-23T23:58:12.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.651+0000 7fc909400640 1 -- 172.21.15.8:0/1707701482 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2929307409 0 0) 0x7fc90c152b70 con 0x7fc90c070e90 2024-03-23T23:58:12.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.659+0000 7fc909e00640 1 --2- 172.21.15.8:0/1707701482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc90c0c2ee0 0x7fc90c152630 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc0097c0 tx=0x7fc8fc01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7953a2b4dea911c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:12.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.659+0000 7fc909400640 1 -- 172.21.15.8:0/1707701482 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc0b0070 con 0x7fc90c0c2ee0 2024-03-23T23:58:12.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.659+0000 7fc909400640 1 -- 172.21.15.8:0/1707701482 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8fc0ab600 con 0x7fc90c0c2ee0 2024-03-23T23:58:12.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.659+0000 7fc909400640 1 -- 172.21.15.8:0/1707701482 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc0ab9d0 con 0x7fc90c0c2ee0 2024-03-23T23:58:12.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.659+0000 7fc911200640 1 -- 172.21.15.8:0/1707701482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc90c0c2ee0 msgr2=0x7fc90c152630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:12.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.659+0000 7fc911200640 1 --2- 172.21.15.8:0/1707701482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc90c0c2ee0 0x7fc90c152630 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc0097c0 tx=0x7fc8fc01c410 comp rx=0 tx=0).stop 2024-03-23T23:58:12.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.659+0000 7fc911200640 1 -- 172.21.15.8:0/1707701482 shutdown_connections 2024-03-23T23:58:12.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.659+0000 7fc911200640 1 --2- 172.21.15.8:0/1707701482 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc90c0ac250 0x7fc90c14c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.659+0000 7fc911200640 1 --2- 172.21.15.8:0/1707701482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc90c0c2ee0 0x7fc90c152630 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.659+0000 7fc911200640 1 -- 172.21.15.8:0/1707701482 >> 172.21.15.8:0/1707701482 conn(0x7fc90c06b170 msgr2=0x7fc90c06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:12.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.659+0000 7fc911200640 1 -- 172.21.15.8:0/1707701482 shutdown_connections 2024-03-23T23:58:12.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.659+0000 7fc911200640 1 -- 172.21.15.8:0/1707701482 wait complete. 2024-03-23T23:58:12.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.659+0000 7fc911200640 1 Processor -- start 2024-03-23T23:58:12.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.659+0000 7fc911200640 1 -- start start 2024-03-23T23:58:12.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.659+0000 7fc911200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc90c070e90 0x7fc90c154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:12.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.659+0000 7fc911200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc90c0ac250 0x7fc90c144cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:12.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.659+0000 7fc911200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc90c0c2ee0 0x7fc90c145210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:12.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.659+0000 7fc911200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c0c1b70 con 0x7fc90c0ac250 2024-03-23T23:58:12.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.659+0000 7fc911200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c0c3510 con 0x7fc90c0c2ee0 2024-03-23T23:58:12.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.659+0000 7fc911200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c0c1cf0 con 0x7fc90c070e90 2024-03-23T23:58:12.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.663+0000 7fc909e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc90c070e90 0x7fc90c154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:12.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.663+0000 7fc909e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc90c070e90 0x7fc90c154dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:33264/0 (socket says 172.21.15.8:33264) 2024-03-23T23:58:12.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.663+0000 7fc909e00640 1 -- 172.21.15.8:0/4168418727 learned_addr learned my addr 172.21.15.8:0/4168418727 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:12.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.663+0000 7fc903e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc90c0ac250 0x7fc90c144cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:12.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.663+0000 7fc90a800640 1 --2- 172.21.15.8:0/4168418727 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc90c0c2ee0 0x7fc90c145210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:12.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.663+0000 7fc90a800640 1 -- 172.21.15.8:0/4168418727 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc90c0c2ee0 msgr2=0x7fc90c145210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-03-23T23:58:12.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.663+0000 7fc90a800640 1 -- 172.21.15.8:0/4168418727 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc90c0c2ee0 msgr2=0x7fc90c145210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T23:58:12.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.663+0000 7fc90a800640 1 --2- 172.21.15.8:0/4168418727 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc90c0c2ee0 0x7fc90c145210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:58:12.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.663+0000 7fc90a800640 1 --2- 172.21.15.8:0/4168418727 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc90c0c2ee0 0x7fc90c145210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:58:12.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.663+0000 7fc909e00640 1 -- 172.21.15.8:0/4168418727 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc90c0c2ee0 msgr2=0x7fc90c145210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:58:12.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.663+0000 7fc909e00640 1 --2- 172.21.15.8:0/4168418727 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc90c0c2ee0 0x7fc90c145210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.663+0000 7fc909e00640 1 -- 172.21.15.8:0/4168418727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc90c0ac250 msgr2=0x7fc90c144cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:12.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.663+0000 7fc909e00640 1 --2- 172.21.15.8:0/4168418727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc90c0ac250 0x7fc90c144cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.663+0000 7fc909e00640 1 -- 172.21.15.8:0/4168418727 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90c143090 con 0x7fc90c070e90 2024-03-23T23:58:12.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.663+0000 7fc909e00640 1 --2- 172.21.15.8:0/4168418727 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc90c070e90 0x7fc90c154dc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc0ae040 tx=0x7fc8fc01ac50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:12.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.663+0000 7fc902000640 1 -- 172.21.15.8:0/4168418727 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc0bb070 con 0x7fc90c070e90 2024-03-23T23:58:12.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.663+0000 7fc902000640 1 -- 172.21.15.8:0/4168418727 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8fc004020 con 0x7fc90c070e90 2024-03-23T23:58:12.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.663+0000 7fc902000640 1 -- 172.21.15.8:0/4168418727 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc0b0040 con 0x7fc90c070e90 2024-03-23T23:58:12.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.663+0000 7fc911200640 1 -- 172.21.15.8:0/4168418727 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc90c0c5c60 con 0x7fc90c070e90 2024-03-23T23:58:12.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.663+0000 7fc911200640 1 -- 172.21.15.8:0/4168418727 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc90c0c6220 con 0x7fc90c070e90 2024-03-23T23:58:12.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.663+0000 7fc911200640 1 -- 172.21.15.8:0/4168418727 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc90c04f480 con 0x7fc90c070e90 2024-03-23T23:58:12.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.663+0000 7fc902000640 1 -- 172.21.15.8:0/4168418727 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc8fc003620 con 0x7fc90c070e90 2024-03-23T23:58:12.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.667+0000 7fc902000640 1 --2- 172.21.15.8:0/4168418727 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc8e8067660 0x7fc8e8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:12.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.667+0000 7fc902000640 1 -- 172.21.15.8:0/4168418727 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fc8fc11ff80 con 0x7fc90c070e90 2024-03-23T23:58:12.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.667+0000 7fc903e00640 1 --2- 172.21.15.8:0/4168418727 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc8e8067660 0x7fc8e8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:12.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.667+0000 7fc903e00640 1 --2- 172.21.15.8:0/4168418727 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc8e8067660 0x7fc8e8069b20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc90c13fa80 tx=0x7fc8f4007d60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:12.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.671+0000 7fc902000640 1 -- 172.21.15.8:0/4168418727 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fc90c143090 con 0x7fc90c070e90 2024-03-23T23:58:12.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.891+0000 7fc911200640 1 -- 172.21.15.8:0/4168418727 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc90c0c4d00 con 0x7fc90c070e90 2024-03-23T23:58:12.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.891+0000 7fc902000640 1 -- 172.21.15.8:0/4168418727 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1561 (secure 0 0 0) 0x7fc8fc016090 con 0x7fc90c070e90 2024-03-23T23:58:12.890 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":122,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:58:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.891+0000 7fc911200640 1 -- 172.21.15.8:0/4168418727 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc8e8067660 msgr2=0x7fc8e8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.891+0000 7fc911200640 1 --2- 172.21.15.8:0/4168418727 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc8e8067660 0x7fc8e8069b20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc90c13fa80 tx=0x7fc8f4007d60 comp rx=0 tx=0).stop 2024-03-23T23:58:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.891+0000 7fc911200640 1 -- 172.21.15.8:0/4168418727 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc90c070e90 msgr2=0x7fc90c154dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.891+0000 7fc911200640 1 --2- 172.21.15.8:0/4168418727 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc90c070e90 0x7fc90c154dc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc0ae040 tx=0x7fc8fc01ac50 comp rx=0 tx=0).stop 2024-03-23T23:58:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.891+0000 7fc911200640 1 -- 172.21.15.8:0/4168418727 shutdown_connections 2024-03-23T23:58:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.891+0000 7fc911200640 1 --2- 172.21.15.8:0/4168418727 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc90c0c2ee0 0x7fc90c145210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.891+0000 7fc911200640 1 --2- 172.21.15.8:0/4168418727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc90c0ac250 0x7fc90c144cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.891+0000 7fc911200640 1 --2- 172.21.15.8:0/4168418727 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc8e8067660 0x7fc8e8069b20 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.891+0000 7fc911200640 1 --2- 172.21.15.8:0/4168418727 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc90c070e90 0x7fc90c154dc0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.891+0000 7fc911200640 1 -- 172.21.15.8:0/4168418727 >> 172.21.15.8:0/4168418727 conn(0x7fc90c06b170 msgr2=0x7fc90c0c05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.891+0000 7fc911200640 1 -- 172.21.15.8:0/4168418727 shutdown_connections 2024-03-23T23:58:12.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:12.891+0000 7fc911200640 1 -- 172.21.15.8:0/4168418727 wait complete. 2024-03-23T23:58:12.913 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T23:58:12.913 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T23:58:12.913 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T23:58:13.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.079+0000 7fde8e800640 1 Processor -- start 2024-03-23T23:58:13.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.079+0000 7fde8e800640 1 -- start start 2024-03-23T23:58:13.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.079+0000 7fde8e800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fde88156ee0 0x7fde88073230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.079+0000 7fde8e800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde880ac270 0x7fde880ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.079+0000 7fde8e800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde88073770 con 0x7fde88149bd0 2024-03-23T23:58:13.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.079+0000 7fde8e800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde880aa390 con 0x7fde88156ee0 2024-03-23T23:58:13.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.079+0000 7fde8e800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde8806e720 con 0x7fde880ac270 2024-03-23T23:58:13.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.079+0000 7fde7ea00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fde88149bd0 0x7fde8814a060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46082/0 (socket says 172.21.15.8:46082) 2024-03-23T23:58:13.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.079+0000 7fde87400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fde88156ee0 0x7fde88073230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.079+0000 7fde7ea00640 1 -- 172.21.15.8:0/1506364764 learned_addr learned my addr 172.21.15.8:0/1506364764 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:58:13.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.079+0000 7fde87e00640 1 --2- 172.21.15.8:0/1506364764 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde880ac270 0x7fde880ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.079+0000 7fde87400640 1 -- 172.21.15.8:0/1506364764 >> v2:172.21.15.196:3300/0 conn(0x7fde88156ee0 msgr2=0x7fde88073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:58:13.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.079+0000 7fde87400640 1 -- 172.21.15.8:0/1506364764 >> v2:172.21.15.196:3300/0 conn(0x7fde88156ee0 msgr2=0x7fde88073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:58:13.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.079+0000 7fde87400640 1 --2- 172.21.15.8:0/1506364764 >> v2:172.21.15.196:3300/0 conn(0x7fde88156ee0 0x7fde88073230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:58:13.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.079+0000 7fde87400640 1 --2- 172.21.15.8:0/1506364764 >> v2:172.21.15.196:3300/0 conn(0x7fde88156ee0 0x7fde88073230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:58:13.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.079+0000 7fde86a00640 1 -- 172.21.15.8:0/1506364764 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2874499917 0 0) 0x7fde88073770 con 0x7fde88149bd0 2024-03-23T23:58:13.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.079+0000 7fde86a00640 1 -- 172.21.15.8:0/1506364764 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde6c003530 con 0x7fde88149bd0 2024-03-23T23:58:13.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.079+0000 7fde87e00640 1 -- 172.21.15.8:0/1506364764 >> v2:172.21.15.196:3300/0 conn(0x7fde88156ee0 msgr2=0x7fde88073230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:58:13.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.079+0000 7fde87e00640 1 --2- 172.21.15.8:0/1506364764 >> v2:172.21.15.196:3300/0 conn(0x7fde88156ee0 0x7fde88073230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.079+0000 7fde87e00640 1 -- 172.21.15.8:0/1506364764 >> v1:172.21.15.8:6789/0 conn(0x7fde88149bd0 legacy=0x7fde8814a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.079+0000 7fde87e00640 1 -- 172.21.15.8:0/1506364764 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde8806ea00 con 0x7fde880ac270 2024-03-23T23:58:13.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.087+0000 7fde87e00640 1 --2- 172.21.15.8:0/1506364764 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde880ac270 0x7fde880ac6e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fde800097c0 tx=0x7fde8001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f19b0dfc2f40b8 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:13.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.087+0000 7fde86a00640 1 -- 172.21.15.8:0/1506364764 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde800b1070 con 0x7fde880ac270 2024-03-23T23:58:13.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.087+0000 7fde86a00640 1 -- 172.21.15.8:0/1506364764 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde800a8050 con 0x7fde880ac270 2024-03-23T23:58:13.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.087+0000 7fde86a00640 1 -- 172.21.15.8:0/1506364764 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde800ac840 con 0x7fde880ac270 2024-03-23T23:58:13.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.087+0000 7fde8e800640 1 -- 172.21.15.8:0/1506364764 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde880ac270 msgr2=0x7fde880ac6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.087+0000 7fde8e800640 1 --2- 172.21.15.8:0/1506364764 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde880ac270 0x7fde880ac6e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fde800097c0 tx=0x7fde8001c3e0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.087+0000 7fde8e800640 1 -- 172.21.15.8:0/1506364764 shutdown_connections 2024-03-23T23:58:13.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.087+0000 7fde8e800640 1 --2- 172.21.15.8:0/1506364764 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde880ac270 0x7fde880ac6e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.087+0000 7fde8e800640 1 --2- 172.21.15.8:0/1506364764 >> v2:172.21.15.196:3300/0 conn(0x7fde88156ee0 0x7fde88073230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.087+0000 7fde8e800640 1 -- 172.21.15.8:0/1506364764 >> 172.21.15.8:0/1506364764 conn(0x7fde8806b170 msgr2=0x7fde8806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:13.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.087+0000 7fde8e800640 1 -- 172.21.15.8:0/1506364764 shutdown_connections 2024-03-23T23:58:13.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.087+0000 7fde8e800640 1 -- 172.21.15.8:0/1506364764 wait complete. 2024-03-23T23:58:13.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.087+0000 7fde8e800640 1 Processor -- start 2024-03-23T23:58:13.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.087+0000 7fde8e800640 1 -- start start 2024-03-23T23:58:13.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.087+0000 7fde8e800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde880ac270 0x7fde8814e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde8e800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde88149bd0 0x7fde88150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde8e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde88156ee0 0x7fde881449f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde8e800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde881579f0 con 0x7fde88156ee0 2024-03-23T23:58:13.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde8e800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde88157870 con 0x7fde880ac270 2024-03-23T23:58:13.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde8e800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde881572c0 con 0x7fde88149bd0 2024-03-23T23:58:13.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde87400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde880ac270 0x7fde8814e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde7ea00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde88149bd0 0x7fde88150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde87400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde880ac270 0x7fde8814e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:57394/0 (socket says 172.21.15.8:57394) 2024-03-23T23:58:13.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde87400640 1 -- 172.21.15.8:0/669656820 learned_addr learned my addr 172.21.15.8:0/669656820 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:13.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde87e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde88156ee0 0x7fde881449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde87400640 1 -- 172.21.15.8:0/669656820 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde880ac270 msgr2=0x7fde8814e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-03-23T23:58:13.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde87400640 1 -- 172.21.15.8:0/669656820 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde880ac270 msgr2=0x7fde8814e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T23:58:13.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde87400640 1 --2- 172.21.15.8:0/669656820 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde880ac270 0x7fde8814e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:58:13.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde87400640 1 --2- 172.21.15.8:0/669656820 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde880ac270 0x7fde8814e710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:58:13.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde87e00640 1 -- 172.21.15.8:0/669656820 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde88149bd0 msgr2=0x7fde88150a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde87e00640 1 --2- 172.21.15.8:0/669656820 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde88149bd0 0x7fde88150a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde87e00640 1 -- 172.21.15.8:0/669656820 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde880ac270 msgr2=0x7fde8814e710 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:58:13.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde87e00640 1 --2- 172.21.15.8:0/669656820 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde880ac270 0x7fde8814e710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde87e00640 1 -- 172.21.15.8:0/669656820 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde88150380 con 0x7fde88156ee0 2024-03-23T23:58:13.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde7ea00640 1 --2- 172.21.15.8:0/669656820 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde88149bd0 0x7fde88150a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:58:13.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde87e00640 1 --2- 172.21.15.8:0/669656820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde88156ee0 0x7fde881449f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fde800ac000 tx=0x7fde80019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:13.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde7fe00640 1 -- 172.21.15.8:0/669656820 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde800b1040 con 0x7fde88156ee0 2024-03-23T23:58:13.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde7fe00640 1 -- 172.21.15.8:0/669656820 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde800bb070 con 0x7fde88156ee0 2024-03-23T23:58:13.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde8e800640 1 -- 172.21.15.8:0/669656820 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde880c5eb0 con 0x7fde88156ee0 2024-03-23T23:58:13.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde7fe00640 1 -- 172.21.15.8:0/669656820 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde80006e20 con 0x7fde88156ee0 2024-03-23T23:58:13.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde8e800640 1 -- 172.21.15.8:0/669656820 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde880c6470 con 0x7fde88156ee0 2024-03-23T23:58:13.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde8e800640 1 --2- 172.21.15.8:0/669656820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde8814fe80 0x7fde880c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde8e800640 1 -- 172.21.15.8:0/669656820 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde880c7950 con 0x7fde8814fe80 2024-03-23T23:58:13.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde87400640 1 --2- 172.21.15.8:0/669656820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde8814fe80 0x7fde880c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde87400640 1 -- 172.21.15.8:0/669656820 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fde88068270 con 0x7fde8814fe80 2024-03-23T23:58:13.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde87400640 1 --2- 172.21.15.8:0/669656820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde8814fe80 0x7fde880c7410 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fde78010770 tx=0x7fde78010c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:13.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde7fe00640 1 -- 172.21.15.8:0/669656820 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde78019020 con 0x7fde8814fe80 2024-03-23T23:58:13.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde7fe00640 1 -- 172.21.15.8:0/669656820 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fde78010e80 con 0x7fde8814fe80 2024-03-23T23:58:13.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde7fe00640 1 -- 172.21.15.8:0/669656820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde8814fe80 msgr2=0x7fde880c7410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde7fe00640 1 --2- 172.21.15.8:0/669656820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde8814fe80 0x7fde880c7410 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fde78010770 tx=0x7fde78010c30 comp rx=0 tx=0).stop 2024-03-23T23:58:13.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde7fe00640 1 -- 172.21.15.8:0/669656820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde8814fe80 msgr2=0x7fde880c7410 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:58:13.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.091+0000 7fde7fe00640 1 --2- 172.21.15.8:0/669656820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde8814fe80 0x7fde880c7410 secure :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fde78010770 tx=0x7fde78010c30 comp rx=0 tx=0).stop 2024-03-23T23:58:13.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.095+0000 7fde7fe00640 1 -- 172.21.15.8:0/669656820 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fde800b5610 con 0x7fde88156ee0 2024-03-23T23:58:13.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.095+0000 7fde7fe00640 1 --2- 172.21.15.8:0/669656820 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fde64067140 0x7fde64069600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.095+0000 7fde7fe00640 1 -- 172.21.15.8:0/669656820 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fde8011f950 con 0x7fde88156ee0 2024-03-23T23:58:13.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.095+0000 7fde87400640 1 --2- 172.21.15.8:0/669656820 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fde64067140 0x7fde64069600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.095+0000 7fde87400640 1 --2- 172.21.15.8:0/669656820 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fde64067140 0x7fde64069600 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fde7800e5e0 tx=0x7fde78008000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:13.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.099+0000 7fde8e800640 1 --2- 172.21.15.8:0/669656820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde88144f30 0x7fde881eef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.099+0000 7fde8e800640 1 -- 172.21.15.8:0/669656820 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde88150f50 con 0x7fde88144f30 2024-03-23T23:58:13.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.099+0000 7fde7ea00640 1 --2- 172.21.15.8:0/669656820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde88144f30 0x7fde881eef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.099+0000 7fde7ea00640 1 -- 172.21.15.8:0/669656820 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fde8806c4a0 con 0x7fde88144f30 2024-03-23T23:58:13.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.099+0000 7fde7ea00640 1 --2- 172.21.15.8:0/669656820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde88144f30 0x7fde881eef00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fde881560b0 tx=0x7fde7000d870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:13.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.099+0000 7fde7fe00640 1 -- 172.21.15.8:0/669656820 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde70007320 con 0x7fde88144f30 2024-03-23T23:58:13.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.099+0000 7fde7fe00640 1 -- 172.21.15.8:0/669656820 <== mon.0 v2:172.21.15.8:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5185 (secure 0 0 0) 0x7fde70007320 con 0x7fde88144f30 2024-03-23T23:58:13.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.099+0000 7fde7fe00640 1 -- 172.21.15.8:0/669656820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde88144f30 msgr2=0x7fde881eef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.099+0000 7fde7fe00640 1 --2- 172.21.15.8:0/669656820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde88144f30 0x7fde881eef00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fde881560b0 tx=0x7fde7000d870 comp rx=0 tx=0).stop 2024-03-23T23:58:13.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.099+0000 7fde7fe00640 1 -- 172.21.15.8:0/669656820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde88144f30 msgr2=0x7fde881eef00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:58:13.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.099+0000 7fde7fe00640 1 --2- 172.21.15.8:0/669656820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde88144f30 0x7fde881eef00 secure :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fde881560b0 tx=0x7fde7000d870 comp rx=0 tx=0).stop 2024-03-23T23:58:13.101 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:58:13.101 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:58:13.101 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:58:13.101 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "leader", 2024-03-23T23:58:13.101 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 122, 2024-03-23T23:58:13.102 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:58:13.102 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:58:13.102 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:58:13.102 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:58:13.102 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:58:13.102 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 1, 2024-03-23T23:58:13.102 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:58:13.102 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:58:13.102 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:58:13.102 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:58:13.102 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:58:13.103 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:58:13.103 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:58:13.103 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:58:13.103 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:58:13.103 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:58:13.103 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:58:13.103 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:58:13.103 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:58:13.103 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:58:13.103 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:58:13.103 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:58:13.103 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:58:13.103 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:58:13.103 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:58:13.104 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:58:13.104 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:58:13.104 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:58:13.104 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:58:13.104 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:58:13.104 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:58:13.104 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:58:13.104 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:58:13.104 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:58:13.104 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:58:13.104 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.104 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:58:13.104 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:58:13.104 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:58:13.105 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:58:13.105 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:58:13.105 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:58:13.105 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:58:13.105 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:58:13.105 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:58:13.105 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:58:13.105 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:58:13.105 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:58:13.105 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:58:13.105 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:58:13.105 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:58:13.105 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:58:13.105 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:58:13.106 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:58:13.106 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:58:13.106 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:58:13.106 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:58:13.106 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:58:13.106 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:58:13.106 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:58:13.106 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:58:13.106 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:58:13.106 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:58:13.106 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:58:13.106 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:58:13.106 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:58:13.106 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.107 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:58:13.107 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.107 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:58:13.107 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:58:13.107 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:58:13.107 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:58:13.107 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.107 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:58:13.107 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:58:13.107 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:58:13.107 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.107 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.107 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:58:13.107 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:58:13.107 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:58:13.108 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:58:13.108 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:58:13.108 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.108 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:58:13.108 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:58:13.108 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:58:13.108 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:58:13.108 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:58:13.108 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.108 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.108 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:58:13.108 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:58:13.108 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:58:13.108 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:58:13.109 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.109 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:58:13.109 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:58:13.109 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:58:13.109 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.109 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.109 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:58:13.109 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:58:13.109 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:58:13.109 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:58:13.109 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:58:13.109 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.109 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:58:13.109 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:58:13.109 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:58:13.110 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:58:13.110 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:58:13.110 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.110 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.110 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:58:13.110 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:58:13.110 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:58:13.110 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:58:13.110 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.110 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:58:13.110 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:58:13.110 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:58:13.110 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.110 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.111 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:58:13.111 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:58:13.111 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:58:13.111 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:58:13.111 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:58:13.111 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.111 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:58:13.111 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:58:13.111 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:58:13.111 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:58:13.111 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:58:13.111 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:58:13.111 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:58:13.111 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.111 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:58:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:58:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:58:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:58:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:58:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:58:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:58:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:58:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:58:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:58:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:58:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:58:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:58:13.113 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:58:13.113 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.113 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:58:13.113 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:58:13.113 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 7 2024-03-23T23:58:13.113 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:58:13.113 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:58:13.113 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:58:13.113 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.113 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:58:13.113 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:58:13.113 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:58:13.113 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.113 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.113 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:58:13.114 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:58:13.114 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5 2024-03-23T23:58:13.114 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:58:13.114 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:58:13.114 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": [ 2024-03-23T23:58:13.114 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.114 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:58:13.114 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:58:13.114 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:58:13.114 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:58:13.114 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:58:13.114 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.114 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:58:13.115 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:58:13.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.099+0000 7fde8e800640 1 -- 172.21.15.8:0/669656820 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fde64067140 msgr2=0x7fde64069600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.099+0000 7fde8e800640 1 --2- 172.21.15.8:0/669656820 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fde64067140 0x7fde64069600 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fde7800e5e0 tx=0x7fde78008000 comp rx=0 tx=0).stop 2024-03-23T23:58:13.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.099+0000 7fde8e800640 1 -- 172.21.15.8:0/669656820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde88156ee0 msgr2=0x7fde881449f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.099+0000 7fde8e800640 1 --2- 172.21.15.8:0/669656820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde88156ee0 0x7fde881449f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fde800ac000 tx=0x7fde80019180 comp rx=0 tx=0).stop 2024-03-23T23:58:13.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.099+0000 7fde87e00640 1 -- 172.21.15.8:0/669656820 reap_dead start 2024-03-23T23:58:13.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.099+0000 7fde87e00640 1 -- 172.21.15.8:0/669656820 reap_dead start 2024-03-23T23:58:13.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.099+0000 7fde8e800640 1 -- 172.21.15.8:0/669656820 shutdown_connections 2024-03-23T23:58:13.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.099+0000 7fde8e800640 1 -- 172.21.15.8:0/669656820 >> 172.21.15.8:0/669656820 conn(0x7fde8806b170 msgr2=0x7fde880c3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:13.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.099+0000 7fde8e800640 1 -- 172.21.15.8:0/669656820 shutdown_connections 2024-03-23T23:58:13.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.103+0000 7fde8e800640 1 -- 172.21.15.8:0/669656820 wait complete. 2024-03-23T23:58:13.120 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:58:13.120 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T23:58:13.120 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T23:58:13.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.271+0000 7f9655400640 1 Processor -- start 2024-03-23T23:58:13.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.271+0000 7f9655400640 1 -- start start 2024-03-23T23:58:13.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.271+0000 7f9655400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f965014d8b0 0x7f96500c7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.271+0000 7f9655400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f96500c5560 0x7f965006ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.271+0000 7f9655400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96500c7670 con 0x7f9650070b50 2024-03-23T23:58:13.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.271+0000 7f9655400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96500c4830 con 0x7f96500c5560 2024-03-23T23:58:13.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.271+0000 7f9655400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96500c50d0 con 0x7f965014d8b0 2024-03-23T23:58:13.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.271+0000 7f964f200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f96500c5560 0x7f965006ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.271+0000 7f964f200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f96500c5560 0x7f965006ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36872/0 (socket says 172.21.15.8:36872) 2024-03-23T23:58:13.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.271+0000 7f964f200640 1 -- 172.21.15.8:0/896532870 learned_addr learned my addr 172.21.15.8:0/896532870 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:13.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.271+0000 7f964de00640 1 --1- 172.21.15.8:0/896532870 >> v1:172.21.15.196:6789/0 conn(0x7f9650070b50 0x7f96501541b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:38956/0 (socket says 172.21.15.8:38956) 2024-03-23T23:58:13.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.271+0000 7f964e800640 1 --2- 172.21.15.8:0/896532870 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f965014d8b0 0x7f96500c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.271+0000 7f964f200640 1 -- 172.21.15.8:0/896532870 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f965014d8b0 msgr2=0x7f96500c7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:13.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.271+0000 7f964f200640 1 --2- 172.21.15.8:0/896532870 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f965014d8b0 0x7f96500c7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.271+0000 7f964f200640 1 -- 172.21.15.8:0/896532870 >> v1:172.21.15.196:6789/0 conn(0x7f9650070b50 legacy=0x7f96501541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.271+0000 7f964f200640 1 -- 172.21.15.8:0/896532870 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96500710e0 con 0x7f96500c5560 2024-03-23T23:58:13.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.275+0000 7f964f200640 1 --2- 172.21.15.8:0/896532870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96500c5560 0x7f965006ed00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9648009e50 tx=0x7f964801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452168b0943be207 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:13.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.275+0000 7f964d400640 1 -- 172.21.15.8:0/896532870 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96480a5700 con 0x7f96500c5560 2024-03-23T23:58:13.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.275+0000 7f964d400640 1 -- 172.21.15.8:0/896532870 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96480a58a0 con 0x7f96500c5560 2024-03-23T23:58:13.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.275+0000 7f964d400640 1 -- 172.21.15.8:0/896532870 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96480a5c70 con 0x7f96500c5560 2024-03-23T23:58:13.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.275+0000 7f9655400640 1 -- 172.21.15.8:0/896532870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96500c5560 msgr2=0x7f965006ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.275+0000 7f9655400640 1 --2- 172.21.15.8:0/896532870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96500c5560 0x7f965006ed00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9648009e50 tx=0x7f964801ca30 comp rx=0 tx=0).stop 2024-03-23T23:58:13.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.275+0000 7f9655400640 1 -- 172.21.15.8:0/896532870 shutdown_connections 2024-03-23T23:58:13.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.275+0000 7f9655400640 1 --2- 172.21.15.8:0/896532870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96500c5560 0x7f965006ed00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.275+0000 7f9655400640 1 --2- 172.21.15.8:0/896532870 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f965014d8b0 0x7f96500c7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.275+0000 7f9655400640 1 -- 172.21.15.8:0/896532870 >> 172.21.15.8:0/896532870 conn(0x7f96500aafe0 msgr2=0x7f96500ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:13.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.275+0000 7f9655400640 1 -- 172.21.15.8:0/896532870 shutdown_connections 2024-03-23T23:58:13.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.275+0000 7f9655400640 1 -- 172.21.15.8:0/896532870 wait complete. 2024-03-23T23:58:13.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.279+0000 7f9655400640 1 Processor -- start 2024-03-23T23:58:13.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.279+0000 7f9655400640 1 -- start start 2024-03-23T23:58:13.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.279+0000 7f9655400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9650070b50 0x7f9650155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.279+0000 7f9655400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96500c5560 0x7f96501ee9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.279+0000 7f9655400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f965014d8b0 0x7f96501eef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.279+0000 7f9655400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9650160a50 con 0x7f9650070b50 2024-03-23T23:58:13.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.279+0000 7f9655400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96501608d0 con 0x7f965014d8b0 2024-03-23T23:58:13.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.279+0000 7f9655400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9650160bd0 con 0x7f96500c5560 2024-03-23T23:58:13.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.279+0000 7f964e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9650070b50 0x7f9650155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.279+0000 7f964e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9650070b50 0x7f9650155840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36876/0 (socket says 172.21.15.8:36876) 2024-03-23T23:58:13.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.279+0000 7f964e800640 1 -- 172.21.15.8:0/2827723214 learned_addr learned my addr 172.21.15.8:0/2827723214 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:13.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.279+0000 7f964de00640 1 --2- 172.21.15.8:0/2827723214 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96500c5560 0x7f96501ee9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.279+0000 7f964f200640 1 --2- 172.21.15.8:0/2827723214 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f965014d8b0 0x7f96501eef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.279+0000 7f964e800640 1 -- 172.21.15.8:0/2827723214 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96500c5560 msgr2=0x7f96501ee9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.279+0000 7f964e800640 1 --2- 172.21.15.8:0/2827723214 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96500c5560 0x7f96501ee9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.279+0000 7f964e800640 1 -- 172.21.15.8:0/2827723214 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f965014d8b0 msgr2=0x7f96501eef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.279+0000 7f964e800640 1 --2- 172.21.15.8:0/2827723214 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f965014d8b0 0x7f96501eef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.279+0000 7f964e800640 1 -- 172.21.15.8:0/2827723214 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96501ef4f0 con 0x7f9650070b50 2024-03-23T23:58:13.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.279+0000 7f964de00640 1 --2- 172.21.15.8:0/2827723214 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96500c5560 0x7f96501ee9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:58:13.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.279+0000 7f964e800640 1 --2- 172.21.15.8:0/2827723214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9650070b50 0x7f9650155840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f964000e960 tx=0x7f964000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:13.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.279+0000 7f9646a00640 1 -- 172.21.15.8:0/2827723214 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9640017070 con 0x7f9650070b50 2024-03-23T23:58:13.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.279+0000 7f9646a00640 1 -- 172.21.15.8:0/2827723214 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964000ca00 con 0x7f9650070b50 2024-03-23T23:58:13.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.279+0000 7f9646a00640 1 -- 172.21.15.8:0/2827723214 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964000cdb0 con 0x7f9650070b50 2024-03-23T23:58:13.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.279+0000 7f9655400640 1 -- 172.21.15.8:0/2827723214 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9650155560 con 0x7f9650070b50 2024-03-23T23:58:13.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.279+0000 7f9655400640 1 -- 172.21.15.8:0/2827723214 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f965014cfc0 con 0x7f9650070b50 2024-03-23T23:58:13.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.283+0000 7f9655400640 1 --2- 172.21.15.8:0/2827723214 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96500aab10 0x7f965014b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.283+0000 7f9655400640 1 -- 172.21.15.8:0/2827723214 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9650068270 con 0x7f96500aab10 2024-03-23T23:58:13.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.283+0000 7f964de00640 1 --2- 172.21.15.8:0/2827723214 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96500aab10 0x7f965014b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.283+0000 7f964de00640 1 -- 172.21.15.8:0/2827723214 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f96500c3c30 con 0x7f96500aab10 2024-03-23T23:58:13.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.283+0000 7f964de00640 1 --2- 172.21.15.8:0/2827723214 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96500aab10 0x7f965014b040 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9650151420 tx=0x7f963c001c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:13.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.283+0000 7f9646a00640 1 -- 172.21.15.8:0/2827723214 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f964001a070 con 0x7f9650070b50 2024-03-23T23:58:13.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.283+0000 7f9646a00640 1 --2- 172.21.15.8:0/2827723214 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9630067690 0x7f9630069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.283+0000 7f9646a00640 1 -- 172.21.15.8:0/2827723214 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f9640085e70 con 0x7f9650070b50 2024-03-23T23:58:13.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.283+0000 7f9646a00640 1 -- 172.21.15.8:0/2827723214 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963c00f9b0 con 0x7f96500aab10 2024-03-23T23:58:13.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.283+0000 7f964f200640 1 --2- 172.21.15.8:0/2827723214 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9630067690 0x7f9630069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.283+0000 7f9646a00640 1 -- 172.21.15.8:0/2827723214 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f963c018070 con 0x7f96500aab10 2024-03-23T23:58:13.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.283+0000 7f9646a00640 1 -- 172.21.15.8:0/2827723214 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96500aab10 msgr2=0x7f965014b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.283+0000 7f9646a00640 1 --2- 172.21.15.8:0/2827723214 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96500aab10 0x7f965014b040 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9650151420 tx=0x7f963c001c40 comp rx=0 tx=0).stop 2024-03-23T23:58:13.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.283+0000 7f9646a00640 1 -- 172.21.15.8:0/2827723214 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96500aab10 msgr2=0x7f965014b040 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:58:13.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.283+0000 7f9646a00640 1 --2- 172.21.15.8:0/2827723214 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96500aab10 0x7f965014b040 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9650151420 tx=0x7f963c001c40 comp rx=0 tx=0).stop 2024-03-23T23:58:13.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.283+0000 7f964f200640 1 --2- 172.21.15.8:0/2827723214 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9630067690 0x7f9630069b50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f96480ae000 tx=0x7f96480a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:13.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.295+0000 7f9655400640 1 --2- 172.21.15.8:0/2827723214 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9650154b20 0x7f965014b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.295+0000 7f9655400640 1 -- 172.21.15.8:0/2827723214 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96500c3350 con 0x7f9650154b20 2024-03-23T23:58:13.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.295+0000 7f964de00640 1 --2- 172.21.15.8:0/2827723214 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9650154b20 0x7f965014b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.299+0000 7f964de00640 1 -- 172.21.15.8:0/2827723214 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f96500c44c0 con 0x7f9650154b20 2024-03-23T23:58:13.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.299+0000 7f964de00640 1 --2- 172.21.15.8:0/2827723214 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9650154b20 0x7f965014b580 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9650067c40 tx=0x7f963c000ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:13.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.299+0000 7f9646a00640 1 -- 172.21.15.8:0/2827723214 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963c01ee10 con 0x7f9650154b20 2024-03-23T23:58:13.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.299+0000 7f9646a00640 1 -- 172.21.15.8:0/2827723214 <== mon.1 v2:172.21.15.196:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4530 (secure 0 0 0) 0x7f963c01ee10 con 0x7f9650154b20 2024-03-23T23:58:13.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.299+0000 7f9646a00640 1 -- 172.21.15.8:0/2827723214 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9650154b20 msgr2=0x7f965014b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.299+0000 7f9646a00640 1 --2- 172.21.15.8:0/2827723214 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9650154b20 0x7f965014b580 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9650067c40 tx=0x7f963c000ee0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.299+0000 7f9646a00640 1 -- 172.21.15.8:0/2827723214 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9650154b20 msgr2=0x7f965014b580 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:58:13.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.299+0000 7f9646a00640 1 --2- 172.21.15.8:0/2827723214 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9650154b20 0x7f965014b580 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9650067c40 tx=0x7f963c000ee0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.299 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:58:13.299 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:58:13.299 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:58:13.299 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:58:13.299 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 122, 2024-03-23T23:58:13.299 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:58:13.299 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:58:13.299 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:58:13.299 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:58:13.300 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:58:13.300 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 2, 2024-03-23T23:58:13.300 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:58:13.300 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:58:13.300 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:58:13.300 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:58:13.300 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:58:13.300 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:58:13.300 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:58:13.300 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:58:13.300 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:58:13.300 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:58:13.300 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:58:13.300 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:58:13.301 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:58:13.301 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:58:13.301 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:58:13.301 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:58:13.301 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:58:13.301 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:58:13.301 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:58:13.301 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:58:13.301 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:58:13.301 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:58:13.301 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:58:13.301 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:58:13.301 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:58:13.301 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:58:13.301 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:58:13.302 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:58:13.302 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:58:13.302 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.302 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:58:13.302 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:58:13.302 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:58:13.302 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:58:13.302 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:58:13.302 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:58:13.302 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:58:13.302 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:58:13.302 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:58:13.302 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:58:13.302 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:58:13.303 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:58:13.303 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:58:13.303 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:58:13.303 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:58:13.303 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:58:13.303 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:58:13.303 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:58:13.303 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:58:13.303 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:58:13.303 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:58:13.303 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:58:13.303 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:58:13.303 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:58:13.304 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:58:13.304 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:58:13.304 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:58:13.304 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:58:13.304 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:58:13.304 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:58:13.304 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.304 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:58:13.304 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.304 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:58:13.304 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:58:13.304 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:58:13.304 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:58:13.305 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.305 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:58:13.305 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:58:13.305 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:58:13.305 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.305 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.305 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:58:13.305 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:58:13.305 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:58:13.305 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:58:13.305 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:58:13.305 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.305 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:58:13.305 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:58:13.306 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:58:13.306 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:58:13.306 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:58:13.306 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.306 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.306 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:58:13.306 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:58:13.306 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:58:13.306 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:58:13.306 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.306 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:58:13.306 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:58:13.306 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:58:13.306 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.307 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.307 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:58:13.307 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:58:13.307 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:58:13.307 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:58:13.307 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:58:13.307 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.307 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:58:13.307 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:58:13.307 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:58:13.307 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:58:13.307 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:58:13.307 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.308 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.308 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:58:13.308 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:58:13.308 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:58:13.308 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:58:13.308 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.308 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:58:13.308 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:58:13.308 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:58:13.308 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.308 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.308 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:58:13.308 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:58:13.308 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:58:13.309 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:58:13.309 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:58:13.309 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.309 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:58:13.309 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:58:13.309 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:58:13.309 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:58:13.309 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:58:13.309 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:58:13.309 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:58:13.309 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.309 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:58:13.309 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:58:13.309 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.310 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:58:13.310 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:58:13.310 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:58:13.310 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:58:13.310 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:58:13.310 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:58:13.310 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.310 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:58:13.310 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:58:13.310 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:58:13.310 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:58:13.310 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:58:13.310 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.310 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:58:13.311 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:58:13.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.299+0000 7f9655400640 1 -- 172.21.15.8:0/2827723214 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9630067690 msgr2=0x7f9630069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.299+0000 7f9655400640 1 --2- 172.21.15.8:0/2827723214 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9630067690 0x7f9630069b50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f96480ae000 tx=0x7f96480a7070 comp rx=0 tx=0).stop 2024-03-23T23:58:13.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.299+0000 7f9655400640 1 -- 172.21.15.8:0/2827723214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9650070b50 msgr2=0x7f9650155840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.299+0000 7f9655400640 1 --2- 172.21.15.8:0/2827723214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9650070b50 0x7f9650155840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f964000e960 tx=0x7f964000ee20 comp rx=0 tx=0).stop 2024-03-23T23:58:13.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.299+0000 7f964f200640 1 -- 172.21.15.8:0/2827723214 reap_dead start 2024-03-23T23:58:13.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.299+0000 7f964f200640 1 -- 172.21.15.8:0/2827723214 reap_dead start 2024-03-23T23:58:13.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.299+0000 7f9655400640 1 -- 172.21.15.8:0/2827723214 shutdown_connections 2024-03-23T23:58:13.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.299+0000 7f9655400640 1 -- 172.21.15.8:0/2827723214 >> 172.21.15.8:0/2827723214 conn(0x7f96500aafe0 msgr2=0x7f96500c2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:13.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.299+0000 7f9655400640 1 -- 172.21.15.8:0/2827723214 shutdown_connections 2024-03-23T23:58:13.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.299+0000 7f9655400640 1 -- 172.21.15.8:0/2827723214 wait complete. 2024-03-23T23:58:13.317 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:58:13.317 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T23:58:13.317 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T23:58:13.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.471+0000 7fee62800640 1 Processor -- start 2024-03-23T23:58:13.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.471+0000 7fee62800640 1 -- start start 2024-03-23T23:58:13.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.471+0000 7fee62800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee5c0c4e40 0x7fee5c161310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.471+0000 7fee62800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee5c0c4340 con 0x7fee5c06d6e0 2024-03-23T23:58:13.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.471+0000 7fee62800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee5c0c4060 con 0x7fee5c0c8a50 2024-03-23T23:58:13.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.471+0000 7fee62800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c0c4740 con 0x7fee5c0c4e40 2024-03-23T23:58:13.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.471+0000 7fee5aa00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fee5c06d6e0 0x7fee5c155a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46090/0 (socket says 172.21.15.8:46090) 2024-03-23T23:58:13.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.471+0000 7fee5b400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fee5c0c8a50 0x7fee5c0c2660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:38966/0 (socket says 172.21.15.8:38966) 2024-03-23T23:58:13.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.471+0000 7fee5aa00640 1 -- 172.21.15.8:0/480176027 learned_addr learned my addr 172.21.15.8:0/480176027 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:58:13.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.471+0000 7fee5be00640 1 --2- 172.21.15.8:0/480176027 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee5c0c4e40 0x7fee5c161310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.471+0000 7fee5a000640 1 -- 172.21.15.8:0/480176027 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 207127749 0 0) 0x7fee5c0c4060 con 0x7fee5c0c8a50 2024-03-23T23:58:13.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.471+0000 7fee5be00640 1 -- 172.21.15.8:0/480176027 >> v1:172.21.15.196:6789/0 conn(0x7fee5c0c8a50 legacy=0x7fee5c0c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.471+0000 7fee5be00640 1 -- 172.21.15.8:0/480176027 >> v1:172.21.15.8:6789/0 conn(0x7fee5c06d6e0 legacy=0x7fee5c155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.471+0000 7fee5be00640 1 -- 172.21.15.8:0/480176027 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5c0c3570 con 0x7fee5c0c4e40 2024-03-23T23:58:13.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.475+0000 7fee5be00640 1 --2- 172.21.15.8:0/480176027 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee5c0c4e40 0x7fee5c161310 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fee54009dc0 tx=0x7fee5401c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecd98701c6fa9004 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:13.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.475+0000 7fee5a000640 1 -- 172.21.15.8:0/480176027 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee540b2070 con 0x7fee5c0c4e40 2024-03-23T23:58:13.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.475+0000 7fee5a000640 1 -- 172.21.15.8:0/480176027 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee540a57a0 con 0x7fee5c0c4e40 2024-03-23T23:58:13.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.475+0000 7fee5a000640 1 -- 172.21.15.8:0/480176027 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee540a5b70 con 0x7fee5c0c4e40 2024-03-23T23:58:13.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.475+0000 7fee62800640 1 -- 172.21.15.8:0/480176027 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee5c0c4e40 msgr2=0x7fee5c161310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.475+0000 7fee62800640 1 --2- 172.21.15.8:0/480176027 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee5c0c4e40 0x7fee5c161310 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fee54009dc0 tx=0x7fee5401c760 comp rx=0 tx=0).stop 2024-03-23T23:58:13.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.475+0000 7fee62800640 1 -- 172.21.15.8:0/480176027 shutdown_connections 2024-03-23T23:58:13.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.475+0000 7fee62800640 1 --2- 172.21.15.8:0/480176027 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee5c0c4e40 0x7fee5c161310 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.475+0000 7fee62800640 1 -- 172.21.15.8:0/480176027 >> 172.21.15.8:0/480176027 conn(0x7fee5c0aafe0 msgr2=0x7fee5c0ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:13.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.475+0000 7fee62800640 1 -- 172.21.15.8:0/480176027 shutdown_connections 2024-03-23T23:58:13.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.475+0000 7fee62800640 1 -- 172.21.15.8:0/480176027 wait complete. 2024-03-23T23:58:13.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.479+0000 7fee62800640 1 Processor -- start 2024-03-23T23:58:13.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.479+0000 7fee62800640 1 -- start start 2024-03-23T23:58:13.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.479+0000 7fee62800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee5c0c4e40 0x7fee5c0ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.479+0000 7fee62800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee5c0c8a50 0x7fee5c158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.479+0000 7fee62800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee5c0ad7e0 0x7fee5c158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.479+0000 7fee62800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c0c8e30 con 0x7fee5c0c8a50 2024-03-23T23:58:13.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.479+0000 7fee62800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c06e1e0 con 0x7fee5c0c4e40 2024-03-23T23:58:13.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.479+0000 7fee62800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c1584d0 con 0x7fee5c0ad7e0 2024-03-23T23:58:13.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.479+0000 7fee5aa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee5c0c8a50 0x7fee5c158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.479+0000 7fee5b400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee5c0c4e40 0x7fee5c0ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.479+0000 7fee5aa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee5c0c8a50 0x7fee5c158960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36882/0 (socket says 172.21.15.8:36882) 2024-03-23T23:58:13.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.479+0000 7fee5aa00640 1 -- 172.21.15.8:0/2251999117 learned_addr learned my addr 172.21.15.8:0/2251999117 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:13.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.479+0000 7fee5be00640 1 --2- 172.21.15.8:0/2251999117 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee5c0ad7e0 0x7fee5c158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.479+0000 7fee5aa00640 1 -- 172.21.15.8:0/2251999117 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee5c0ad7e0 msgr2=0x7fee5c158ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.479+0000 7fee5aa00640 1 --2- 172.21.15.8:0/2251999117 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee5c0ad7e0 0x7fee5c158ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.479+0000 7fee5aa00640 1 -- 172.21.15.8:0/2251999117 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee5c0c4e40 msgr2=0x7fee5c0ac2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.479+0000 7fee5aa00640 1 --2- 172.21.15.8:0/2251999117 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee5c0c4e40 0x7fee5c0ac2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.479+0000 7fee5aa00640 1 -- 172.21.15.8:0/2251999117 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5c157ec0 con 0x7fee5c0c8a50 2024-03-23T23:58:13.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.479+0000 7fee5be00640 1 --2- 172.21.15.8:0/2251999117 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee5c0ad7e0 0x7fee5c158ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:58:13.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.479+0000 7fee5aa00640 1 --2- 172.21.15.8:0/2251999117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee5c0c8a50 0x7fee5c158960 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fee4800c780 tx=0x7fee4800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:13.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.479+0000 7fee53400640 1 -- 172.21.15.8:0/2251999117 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee48018070 con 0x7fee5c0c8a50 2024-03-23T23:58:13.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.479+0000 7fee53400640 1 -- 172.21.15.8:0/2251999117 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee480074e0 con 0x7fee5c0c8a50 2024-03-23T23:58:13.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.479+0000 7fee62800640 1 -- 172.21.15.8:0/2251999117 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee5c1f21b0 con 0x7fee5c0c8a50 2024-03-23T23:58:13.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.479+0000 7fee53400640 1 -- 172.21.15.8:0/2251999117 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee48004a30 con 0x7fee5c0c8a50 2024-03-23T23:58:13.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.483+0000 7fee62800640 1 -- 172.21.15.8:0/2251999117 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee5c14b1e0 con 0x7fee5c0c8a50 2024-03-23T23:58:13.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.483+0000 7fee62800640 1 --2- 172.21.15.8:0/2251999117 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee5c1593e0 0x7fee5c146970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.483+0000 7fee62800640 1 -- 172.21.15.8:0/2251999117 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c158680 con 0x7fee5c1593e0 2024-03-23T23:58:13.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.483+0000 7fee5b400640 1 --2- 172.21.15.8:0/2251999117 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee5c1593e0 0x7fee5c146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.483+0000 7fee5b400640 1 -- 172.21.15.8:0/2251999117 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fee5c068270 con 0x7fee5c1593e0 2024-03-23T23:58:13.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.483+0000 7fee53400640 1 -- 172.21.15.8:0/2251999117 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fee4801b070 con 0x7fee5c0c8a50 2024-03-23T23:58:13.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.483+0000 7fee5b400640 1 --2- 172.21.15.8:0/2251999117 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee5c1593e0 0x7fee5c146970 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0af010 tx=0x7fee4c001810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:13.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.483+0000 7fee53400640 1 --2- 172.21.15.8:0/2251999117 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fee3c067660 0x7fee3c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.483+0000 7fee53400640 1 -- 172.21.15.8:0/2251999117 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fee480850d0 con 0x7fee5c0c8a50 2024-03-23T23:58:13.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.483+0000 7fee5be00640 1 --2- 172.21.15.8:0/2251999117 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fee3c067660 0x7fee3c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.483+0000 7fee53400640 1 -- 172.21.15.8:0/2251999117 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c019070 con 0x7fee5c1593e0 2024-03-23T23:58:13.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.483+0000 7fee53400640 1 -- 172.21.15.8:0/2251999117 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fee4c011580 con 0x7fee5c1593e0 2024-03-23T23:58:13.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.483+0000 7fee53400640 1 -- 172.21.15.8:0/2251999117 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee5c1593e0 msgr2=0x7fee5c146970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.483+0000 7fee53400640 1 --2- 172.21.15.8:0/2251999117 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee5c1593e0 0x7fee5c146970 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0af010 tx=0x7fee4c001810 comp rx=0 tx=0).stop 2024-03-23T23:58:13.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.483+0000 7fee53400640 1 -- 172.21.15.8:0/2251999117 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee5c1593e0 msgr2=0x7fee5c146970 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:58:13.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.483+0000 7fee53400640 1 --2- 172.21.15.8:0/2251999117 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee5c1593e0 0x7fee5c146970 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0af010 tx=0x7fee4c001810 comp rx=0 tx=0).stop 2024-03-23T23:58:13.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.487+0000 7fee5be00640 1 --2- 172.21.15.8:0/2251999117 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fee3c067660 0x7fee3c069b20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fee540af000 tx=0x7fee540a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:13.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.499+0000 7fee62800640 1 --2- 172.21.15.8:0/2251999117 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee5c06d6e0 0x7fee5c146eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.499+0000 7fee62800640 1 -- 172.21.15.8:0/2251999117 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c0c8fb0 con 0x7fee5c06d6e0 2024-03-23T23:58:13.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.499+0000 7fee5b400640 1 --2- 172.21.15.8:0/2251999117 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee5c06d6e0 0x7fee5c146eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.499+0000 7fee5b400640 1 -- 172.21.15.8:0/2251999117 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fee5c0c32b0 con 0x7fee5c06d6e0 2024-03-23T23:58:13.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.499+0000 7fee5b400640 1 --2- 172.21.15.8:0/2251999117 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee5c06d6e0 0x7fee5c146eb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0af010 tx=0x7fee4c000ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:13.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.499+0000 7fee53400640 1 -- 172.21.15.8:0/2251999117 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c019030 con 0x7fee5c06d6e0 2024-03-23T23:58:13.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.499+0000 7fee53400640 1 -- 172.21.15.8:0/2251999117 <== mon.2 v2:172.21.15.196:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5013 (secure 0 0 0) 0x7fee4c027450 con 0x7fee5c06d6e0 2024-03-23T23:58:13.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.499+0000 7fee53400640 1 -- 172.21.15.8:0/2251999117 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee5c06d6e0 msgr2=0x7fee5c146eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.499+0000 7fee53400640 1 --2- 172.21.15.8:0/2251999117 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee5c06d6e0 0x7fee5c146eb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0af010 tx=0x7fee4c000ee0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.499+0000 7fee53400640 1 -- 172.21.15.8:0/2251999117 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee5c06d6e0 msgr2=0x7fee5c146eb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T23:58:13.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.499+0000 7fee53400640 1 --2- 172.21.15.8:0/2251999117 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee5c06d6e0 0x7fee5c146eb0 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0af010 tx=0x7fee4c000ee0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.500 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:58:13.500 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:58:13.500 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:58:13.500 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "peon", 2024-03-23T23:58:13.500 INFO:teuthology.orchestra.run.smithi008.stdout: "election_epoch": 122, 2024-03-23T23:58:13.500 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum": [ 2024-03-23T23:58:13.500 INFO:teuthology.orchestra.run.smithi008.stdout: 0, 2024-03-23T23:58:13.500 INFO:teuthology.orchestra.run.smithi008.stdout: 1, 2024-03-23T23:58:13.500 INFO:teuthology.orchestra.run.smithi008.stdout: 2 2024-03-23T23:58:13.500 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:58:13.500 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_age": 2, 2024-03-23T23:58:13.500 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:58:13.501 INFO:teuthology.orchestra.run.smithi008.stdout: "required_con": "2450521708007866372", 2024-03-23T23:58:13.501 INFO:teuthology.orchestra.run.smithi008.stdout: "required_mon": [ 2024-03-23T23:58:13.501 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:58:13.501 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:58:13.501 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:58:13.501 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:58:13.501 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:58:13.501 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:58:13.501 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:58:13.501 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:58:13.501 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:58:13.501 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:58:13.502 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:58:13.502 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:58:13.502 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_con": "4540701547738038271", 2024-03-23T23:58:13.502 INFO:teuthology.orchestra.run.smithi008.stdout: "quorum_mon": [ 2024-03-23T23:58:13.502 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:58:13.502 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:58:13.502 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:58:13.502 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:58:13.502 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:58:13.502 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:58:13.502 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:58:13.502 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:58:13.502 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:58:13.503 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:58:13.503 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:58:13.503 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:58:13.503 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.503 INFO:teuthology.orchestra.run.smithi008.stdout: "outside_quorum": [], 2024-03-23T23:58:13.503 INFO:teuthology.orchestra.run.smithi008.stdout: "extra_probe_peers": [], 2024-03-23T23:58:13.503 INFO:teuthology.orchestra.run.smithi008.stdout: "sync_provider": [], 2024-03-23T23:58:13.503 INFO:teuthology.orchestra.run.smithi008.stdout: "monmap": { 2024-03-23T23:58:13.503 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 1, 2024-03-23T23:58:13.503 INFO:teuthology.orchestra.run.smithi008.stdout: "fsid": "c1a2a381-bc04-418a-8aea-f38031d04f8d", 2024-03-23T23:58:13.503 INFO:teuthology.orchestra.run.smithi008.stdout: "modified": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:58:13.503 INFO:teuthology.orchestra.run.smithi008.stdout: "created": "2024-03-23T23:41:42.202826Z", 2024-03-23T23:58:13.503 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release": 19, 2024-03-23T23:58:13.504 INFO:teuthology.orchestra.run.smithi008.stdout: "min_mon_release_name": "squid", 2024-03-23T23:58:13.504 INFO:teuthology.orchestra.run.smithi008.stdout: "election_strategy": 1, 2024-03-23T23:58:13.504 INFO:teuthology.orchestra.run.smithi008.stdout: "disallowed_leaders: ": "", 2024-03-23T23:58:13.504 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false, 2024-03-23T23:58:13.504 INFO:teuthology.orchestra.run.smithi008.stdout: "tiebreaker_mon": "", 2024-03-23T23:58:13.504 INFO:teuthology.orchestra.run.smithi008.stdout: "removed_ranks: ": "", 2024-03-23T23:58:13.504 INFO:teuthology.orchestra.run.smithi008.stdout: "features": { 2024-03-23T23:58:13.504 INFO:teuthology.orchestra.run.smithi008.stdout: "persistent": [ 2024-03-23T23:58:13.504 INFO:teuthology.orchestra.run.smithi008.stdout: "kraken", 2024-03-23T23:58:13.504 INFO:teuthology.orchestra.run.smithi008.stdout: "luminous", 2024-03-23T23:58:13.504 INFO:teuthology.orchestra.run.smithi008.stdout: "mimic", 2024-03-23T23:58:13.504 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap-prune", 2024-03-23T23:58:13.504 INFO:teuthology.orchestra.run.smithi008.stdout: "nautilus", 2024-03-23T23:58:13.504 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus", 2024-03-23T23:58:13.505 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific", 2024-03-23T23:58:13.505 INFO:teuthology.orchestra.run.smithi008.stdout: "elector-pinging", 2024-03-23T23:58:13.505 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy", 2024-03-23T23:58:13.505 INFO:teuthology.orchestra.run.smithi008.stdout: "reef", 2024-03-23T23:58:13.505 INFO:teuthology.orchestra.run.smithi008.stdout: "squid" 2024-03-23T23:58:13.505 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:58:13.505 INFO:teuthology.orchestra.run.smithi008.stdout: "optional": [] 2024-03-23T23:58:13.505 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.505 INFO:teuthology.orchestra.run.smithi008.stdout: "mons": [ 2024-03-23T23:58:13.505 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.505 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 0, 2024-03-23T23:58:13.505 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "a", 2024-03-23T23:58:13.505 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:58:13.505 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:58:13.506 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.506 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:58:13.506 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:3300", 2024-03-23T23:58:13.506 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:58:13.506 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.506 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.506 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:58:13.506 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789", 2024-03-23T23:58:13.506 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:58:13.506 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:58:13.506 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:58:13.506 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.506 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6789/0", 2024-03-23T23:58:13.506 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.8:6789/0", 2024-03-23T23:58:13.507 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:58:13.507 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:58:13.507 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:58:13.507 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.507 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.507 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 1, 2024-03-23T23:58:13.507 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "b", 2024-03-23T23:58:13.507 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:58:13.507 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:58:13.507 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.507 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:58:13.507 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3300", 2024-03-23T23:58:13.508 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:58:13.508 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.508 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.508 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:58:13.508 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789", 2024-03-23T23:58:13.508 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:58:13.508 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:58:13.508 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:58:13.508 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.508 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6789/0", 2024-03-23T23:58:13.508 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6789/0", 2024-03-23T23:58:13.508 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:58:13.508 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:58:13.508 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:58:13.508 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.509 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.509 INFO:teuthology.orchestra.run.smithi008.stdout: "rank": 2, 2024-03-23T23:58:13.509 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "c", 2024-03-23T23:58:13.509 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addrs": { 2024-03-23T23:58:13.509 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-23T23:58:13.509 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.509 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-23T23:58:13.509 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:3301", 2024-03-23T23:58:13.509 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:58:13.509 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.509 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.509 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-23T23:58:13.509 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790", 2024-03-23T23:58:13.509 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 0 2024-03-23T23:58:13.510 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:58:13.510 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:58:13.510 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.510 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.196:6790/0", 2024-03-23T23:58:13.510 INFO:teuthology.orchestra.run.smithi008.stdout: "public_addr": "172.21.15.196:6790/0", 2024-03-23T23:58:13.510 INFO:teuthology.orchestra.run.smithi008.stdout: "priority": 0, 2024-03-23T23:58:13.510 INFO:teuthology.orchestra.run.smithi008.stdout: "weight": 0, 2024-03-23T23:58:13.510 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_location": "{}" 2024-03-23T23:58:13.510 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:58:13.510 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:58:13.510 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.510 INFO:teuthology.orchestra.run.smithi008.stdout: "feature_map": { 2024-03-23T23:58:13.510 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": [ 2024-03-23T23:58:13.510 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.511 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:58:13.511 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:58:13.511 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:58:13.511 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:58:13.511 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:58:13.511 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": [ 2024-03-23T23:58:13.511 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.511 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:58:13.511 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:58:13.511 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:58:13.511 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:58:13.511 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:58:13.511 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": [ 2024-03-23T23:58:13.511 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.512 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:58:13.512 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:58:13.512 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:58:13.512 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:58:13.512 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-23T23:58:13.512 INFO:teuthology.orchestra.run.smithi008.stdout: "client": [ 2024-03-23T23:58:13.512 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.512 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T23:58:13.512 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:58:13.512 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 1 2024-03-23T23:58:13.512 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.512 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-23T23:58:13.512 INFO:teuthology.orchestra.run.smithi008.stdout: "features": "0x3f03cffffffdffff", 2024-03-23T23:58:13.512 INFO:teuthology.orchestra.run.smithi008.stdout: "release": "luminous", 2024-03-23T23:58:13.513 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 2 2024-03-23T23:58:13.513 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-23T23:58:13.513 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-23T23:58:13.513 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-23T23:58:13.513 INFO:teuthology.orchestra.run.smithi008.stdout: "stretch_mode": false 2024-03-23T23:58:13.513 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:58:13.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.499+0000 7fee62800640 1 -- 172.21.15.8:0/2251999117 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fee3c067660 msgr2=0x7fee3c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.499+0000 7fee62800640 1 --2- 172.21.15.8:0/2251999117 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fee3c067660 0x7fee3c069b20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fee540af000 tx=0x7fee540a7070 comp rx=0 tx=0).stop 2024-03-23T23:58:13.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.499+0000 7fee62800640 1 -- 172.21.15.8:0/2251999117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee5c0c8a50 msgr2=0x7fee5c158960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.499+0000 7fee62800640 1 --2- 172.21.15.8:0/2251999117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee5c0c8a50 0x7fee5c158960 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fee4800c780 tx=0x7fee4800cc40 comp rx=0 tx=0).stop 2024-03-23T23:58:13.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.499+0000 7fee5be00640 1 -- 172.21.15.8:0/2251999117 reap_dead start 2024-03-23T23:58:13.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.499+0000 7fee5be00640 1 -- 172.21.15.8:0/2251999117 reap_dead start 2024-03-23T23:58:13.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.499+0000 7fee62800640 1 -- 172.21.15.8:0/2251999117 shutdown_connections 2024-03-23T23:58:13.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.499+0000 7fee62800640 1 -- 172.21.15.8:0/2251999117 >> 172.21.15.8:0/2251999117 conn(0x7fee5c0aafe0 msgr2=0x7fee5c0c3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:13.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.499+0000 7fee62800640 1 -- 172.21.15.8:0/2251999117 shutdown_connections 2024-03-23T23:58:13.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.499+0000 7fee62800640 1 -- 172.21.15.8:0/2251999117 wait complete. 2024-03-23T23:58:13.525 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T23:58:13.525 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-03-23T23:58:13.525 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-03-23T23:58:13.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.667+0000 7f418cc00640 1 Processor -- start 2024-03-23T23:58:13.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.667+0000 7f418cc00640 1 -- start start 2024-03-23T23:58:13.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.667+0000 7f418cc00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4188156ee0 0x7f4188073230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.667+0000 7f418cc00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4188073770 con 0x7f4188149bd0 2024-03-23T23:58:13.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.667+0000 7f418cc00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41880aa390 con 0x7f41880ac270 2024-03-23T23:58:13.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.667+0000 7f418cc00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f418806e720 con 0x7f4188156ee0 2024-03-23T23:58:13.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.667+0000 7f417d400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f4188149bd0 0x7f418814a060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46098/0 (socket says 172.21.15.8:46098) 2024-03-23T23:58:13.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.667+0000 7f417d400640 1 -- 172.21.15.8:0/1555781707 learned_addr learned my addr 172.21.15.8:0/1555781707 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:58:13.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.667+0000 7f4185e00640 1 --2- 172.21.15.8:0/1555781707 >> v2:172.21.15.196:3300/0 conn(0x7f4188156ee0 0x7f4188073230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.667+0000 7f4185400640 1 -- 172.21.15.8:0/1555781707 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2634000237 0 0) 0x7f4188073770 con 0x7f4188149bd0 2024-03-23T23:58:13.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.667+0000 7f4185400640 1 -- 172.21.15.8:0/1555781707 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f416c003530 con 0x7f4188149bd0 2024-03-23T23:58:13.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.667+0000 7f4185e00640 1 -- 172.21.15.8:0/1555781707 >> v1:172.21.15.196:6789/0 conn(0x7f41880ac270 legacy=0x7f41880ac6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.667+0000 7f4185e00640 1 -- 172.21.15.8:0/1555781707 >> v1:172.21.15.8:6789/0 conn(0x7f4188149bd0 legacy=0x7f418814a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.667+0000 7f4185e00640 1 -- 172.21.15.8:0/1555781707 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418806ea00 con 0x7f4188156ee0 2024-03-23T23:58:13.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.671+0000 7f4185e00640 1 --2- 172.21.15.8:0/1555781707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4188156ee0 0x7f4188073230 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f41780097c0 tx=0x7f417801c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afe31a5b0e24f0e9 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:13.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.671+0000 7f4185400640 1 -- 172.21.15.8:0/1555781707 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41780b1070 con 0x7f4188156ee0 2024-03-23T23:58:13.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.671+0000 7f4185400640 1 -- 172.21.15.8:0/1555781707 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41780a8050 con 0x7f4188156ee0 2024-03-23T23:58:13.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.671+0000 7f4185400640 1 -- 172.21.15.8:0/1555781707 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41780ac840 con 0x7f4188156ee0 2024-03-23T23:58:13.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.671+0000 7f418cc00640 1 -- 172.21.15.8:0/1555781707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4188156ee0 msgr2=0x7f4188073230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.671+0000 7f418cc00640 1 --2- 172.21.15.8:0/1555781707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4188156ee0 0x7f4188073230 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f41780097c0 tx=0x7f417801c3e0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.671+0000 7f418cc00640 1 -- 172.21.15.8:0/1555781707 shutdown_connections 2024-03-23T23:58:13.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.671+0000 7f418cc00640 1 --2- 172.21.15.8:0/1555781707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4188156ee0 0x7f4188073230 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.671+0000 7f418cc00640 1 -- 172.21.15.8:0/1555781707 >> 172.21.15.8:0/1555781707 conn(0x7f418806b170 msgr2=0x7f418806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:13.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.671+0000 7f418cc00640 1 -- 172.21.15.8:0/1555781707 shutdown_connections 2024-03-23T23:58:13.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.671+0000 7f418cc00640 1 -- 172.21.15.8:0/1555781707 wait complete. 2024-03-23T23:58:13.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.675+0000 7f418cc00640 1 Processor -- start 2024-03-23T23:58:13.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.675+0000 7f418cc00640 1 -- start start 2024-03-23T23:58:13.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.675+0000 7f418cc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41880ac270 0x7f418814dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.675+0000 7f418cc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4188149bd0 0x7f41880c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.675+0000 7f418cc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4188156ee0 0x7f41881edf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.675+0000 7f418cc00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41881579f0 con 0x7f41880ac270 2024-03-23T23:58:13.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.675+0000 7f418cc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4188157870 con 0x7f4188156ee0 2024-03-23T23:58:13.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.675+0000 7f418cc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41880acdf0 con 0x7f4188149bd0 2024-03-23T23:58:13.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.675+0000 7f4185e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41880ac270 0x7f418814dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.675+0000 7f4185e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41880ac270 0x7f418814dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36886/0 (socket says 172.21.15.8:36886) 2024-03-23T23:58:13.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.675+0000 7f4185e00640 1 -- 172.21.15.8:0/3112223183 learned_addr learned my addr 172.21.15.8:0/3112223183 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:13.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.675+0000 7f417d400640 1 --2- 172.21.15.8:0/3112223183 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4188149bd0 0x7f41880c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.675+0000 7f4186800640 1 --2- 172.21.15.8:0/3112223183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4188156ee0 0x7f41881edf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.675+0000 7f4185e00640 1 -- 172.21.15.8:0/3112223183 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4188149bd0 msgr2=0x7f41880c34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.675+0000 7f4185e00640 1 --2- 172.21.15.8:0/3112223183 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4188149bd0 0x7f41880c34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.675+0000 7f4185e00640 1 -- 172.21.15.8:0/3112223183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4188156ee0 msgr2=0x7f41881edf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.675+0000 7f4185e00640 1 --2- 172.21.15.8:0/3112223183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4188156ee0 0x7f41881edf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.675+0000 7f4185e00640 1 -- 172.21.15.8:0/3112223183 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41881f23f0 con 0x7f41880ac270 2024-03-23T23:58:13.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.675+0000 7f4185e00640 1 --2- 172.21.15.8:0/3112223183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41880ac270 0x7f418814dd50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f41780af040 tx=0x7f417801ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:13.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.675+0000 7f417ea00640 1 -- 172.21.15.8:0/3112223183 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41780b1050 con 0x7f41880ac270 2024-03-23T23:58:13.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.675+0000 7f417ea00640 1 -- 172.21.15.8:0/3112223183 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41780b2040 con 0x7f41880ac270 2024-03-23T23:58:13.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.675+0000 7f417ea00640 1 -- 172.21.15.8:0/3112223183 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4178006e20 con 0x7f41880ac270 2024-03-23T23:58:13.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.675+0000 7f418cc00640 1 -- 172.21.15.8:0/3112223183 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41881f1670 con 0x7f41880ac270 2024-03-23T23:58:13.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.675+0000 7f418cc00640 1 -- 172.21.15.8:0/3112223183 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41881f1910 con 0x7f41880ac270 2024-03-23T23:58:13.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.675+0000 7f418cc00640 1 -- 172.21.15.8:0/3112223183 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4188154860 con 0x7f41880ac270 2024-03-23T23:58:13.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.679+0000 7f417ea00640 1 -- 172.21.15.8:0/3112223183 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f41780bf060 con 0x7f41880ac270 2024-03-23T23:58:13.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.679+0000 7f417ea00640 1 --2- 172.21.15.8:0/3112223183 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4164067660 0x7f4164069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.679+0000 7f417ea00640 1 -- 172.21.15.8:0/3112223183 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f417811f580 con 0x7f41880ac270 2024-03-23T23:58:13.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.679+0000 7f417d400640 1 --2- 172.21.15.8:0/3112223183 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4164067660 0x7f4164069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.679+0000 7f417d400640 1 --2- 172.21.15.8:0/3112223183 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4164067660 0x7f4164069b20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f41880c8220 tx=0x7f4170001a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:13.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.683+0000 7f417ea00640 1 -- 172.21.15.8:0/3112223183 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f4178016090 con 0x7f41880ac270 2024-03-23T23:58:13.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.911+0000 7f418cc00640 1 -- 172.21.15.8:0/3112223183 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f41881575a0 con 0x7f41880ac270 2024-03-23T23:58:13.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.911+0000 7f417ea00640 1 -- 172.21.15.8:0/3112223183 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f41780ef7e0 con 0x7f41880ac270 2024-03-23T23:58:13.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.911+0000 7f418cc00640 1 -- 172.21.15.8:0/3112223183 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4164067660 msgr2=0x7f4164069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.911+0000 7f418cc00640 1 --2- 172.21.15.8:0/3112223183 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4164067660 0x7f4164069b20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f41880c8220 tx=0x7f4170001a00 comp rx=0 tx=0).stop 2024-03-23T23:58:13.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.911+0000 7f418cc00640 1 -- 172.21.15.8:0/3112223183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41880ac270 msgr2=0x7f418814dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.911+0000 7f418cc00640 1 --2- 172.21.15.8:0/3112223183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41880ac270 0x7f418814dd50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f41780af040 tx=0x7f417801ac20 comp rx=0 tx=0).stop 2024-03-23T23:58:13.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.911+0000 7f418cc00640 1 -- 172.21.15.8:0/3112223183 shutdown_connections 2024-03-23T23:58:13.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.915+0000 7f418cc00640 1 --2- 172.21.15.8:0/3112223183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4188156ee0 0x7f41881edf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.915+0000 7f418cc00640 1 --2- 172.21.15.8:0/3112223183 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4164067660 0x7f4164069b20 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.915+0000 7f418cc00640 1 --2- 172.21.15.8:0/3112223183 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4188149bd0 0x7f41880c34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.915+0000 7f418cc00640 1 --2- 172.21.15.8:0/3112223183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41880ac270 0x7f418814dd50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.915+0000 7f418cc00640 1 -- 172.21.15.8:0/3112223183 >> 172.21.15.8:0/3112223183 conn(0x7f418806b170 msgr2=0x7f4188156510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:13.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.915+0000 7f418cc00640 1 -- 172.21.15.8:0/3112223183 shutdown_connections 2024-03-23T23:58:13.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:13.915+0000 7f418cc00640 1 -- 172.21.15.8:0/3112223183 wait complete. 2024-03-23T23:58:13.934 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-03-23T23:58:17.506 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:58:17.509 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:58:23.936 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T23:58:24.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.078+0000 7fa2c1000640 1 Processor -- start 2024-03-23T23:58:24.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.078+0000 7fa2c1000640 1 -- start start 2024-03-23T23:58:24.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.078+0000 7fa2c1000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa2bc1509b0 0x7fa2bc0a9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.078+0000 7fa2c1000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa2bc0a99b0 0x7fa2bc06dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.078+0000 7fa2c1000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2bc150d90 con 0x7fa2bc153360 2024-03-23T23:58:24.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.078+0000 7fa2c1000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2bc0abf90 con 0x7fa2bc0a99b0 2024-03-23T23:58:24.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.078+0000 7fa2c1000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2bc0ac420 con 0x7fa2bc1509b0 2024-03-23T23:58:24.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.078+0000 7fa2b3e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa2bc0a99b0 0x7fa2bc06dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:24.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.078+0000 7fa2b3e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa2bc0a99b0 0x7fa2bc06dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58462/0 (socket says 172.21.15.8:58462) 2024-03-23T23:58:24.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.078+0000 7fa2b3e00640 1 -- 172.21.15.8:0/1084629943 learned_addr learned my addr 172.21.15.8:0/1084629943 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:24.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.078+0000 7fa2bb400640 1 --2- 172.21.15.8:0/1084629943 >> v2:172.21.15.196:3300/0 conn(0x7fa2bc1509b0 0x7fa2bc0a9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:24.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.078+0000 7fa2b3e00640 1 -- 172.21.15.8:0/1084629943 >> v2:172.21.15.196:3300/0 conn(0x7fa2bc1509b0 msgr2=0x7fa2bc0a9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:24.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.078+0000 7fa2b3e00640 1 --2- 172.21.15.8:0/1084629943 >> v2:172.21.15.196:3300/0 conn(0x7fa2bc1509b0 0x7fa2bc0a9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.078+0000 7fa2b3e00640 1 -- 172.21.15.8:0/1084629943 >> v1:172.21.15.196:6789/0 conn(0x7fa2bc153360 legacy=0x7fa2bc156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:24.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.078+0000 7fa2b3e00640 1 -- 172.21.15.8:0/1084629943 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2bc0ab380 con 0x7fa2bc0a99b0 2024-03-23T23:58:24.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.082+0000 7fa2b3e00640 1 --2- 172.21.15.8:0/1084629943 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2bc0a99b0 0x7fa2bc06dbd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc068100 tx=0x7fa2a401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a4cf95addeceb9 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:24.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.082+0000 7fa2baa00640 1 -- 172.21.15.8:0/1084629943 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a40b1070 con 0x7fa2bc0a99b0 2024-03-23T23:58:24.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.082+0000 7fa2baa00640 1 -- 172.21.15.8:0/1084629943 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a40ac630 con 0x7fa2bc0a99b0 2024-03-23T23:58:24.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.082+0000 7fa2baa00640 1 -- 172.21.15.8:0/1084629943 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a40a8050 con 0x7fa2bc0a99b0 2024-03-23T23:58:24.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.082+0000 7fa2c1000640 1 -- 172.21.15.8:0/1084629943 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2bc0a99b0 msgr2=0x7fa2bc06dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:24.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.082+0000 7fa2c1000640 1 --2- 172.21.15.8:0/1084629943 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2bc0a99b0 0x7fa2bc06dbd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc068100 tx=0x7fa2a401c3d0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.082+0000 7fa2c1000640 1 -- 172.21.15.8:0/1084629943 shutdown_connections 2024-03-23T23:58:24.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.082+0000 7fa2c1000640 1 --2- 172.21.15.8:0/1084629943 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2bc0a99b0 0x7fa2bc06dbd0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.082+0000 7fa2c1000640 1 --2- 172.21.15.8:0/1084629943 >> v2:172.21.15.196:3300/0 conn(0x7fa2bc1509b0 0x7fa2bc0a9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.082+0000 7fa2c1000640 1 -- 172.21.15.8:0/1084629943 >> 172.21.15.8:0/1084629943 conn(0x7fa2bc0c6e10 msgr2=0x7fa2bc0c7220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:24.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.082+0000 7fa2c1000640 1 -- 172.21.15.8:0/1084629943 shutdown_connections 2024-03-23T23:58:24.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.082+0000 7fa2c1000640 1 -- 172.21.15.8:0/1084629943 wait complete. 2024-03-23T23:58:24.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.086+0000 7fa2c1000640 1 Processor -- start 2024-03-23T23:58:24.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.086+0000 7fa2c1000640 1 -- start start 2024-03-23T23:58:24.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.086+0000 7fa2c1000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2bc0a99b0 0x7fa2bc14f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.086+0000 7fa2c1000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2bc1509b0 0x7fa2bc1563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.086+0000 7fa2c1000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa2bc153360 0x7fa2bc148760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.086+0000 7fa2c1000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc06e520 con 0x7fa2bc0a99b0 2024-03-23T23:58:24.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.086+0000 7fa2c1000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc06f060 con 0x7fa2bc153360 2024-03-23T23:58:24.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.086+0000 7fa2c1000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc160d00 con 0x7fa2bc1509b0 2024-03-23T23:58:24.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.086+0000 7fa2bb400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2bc0a99b0 0x7fa2bc14f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:24.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.086+0000 7fa2bb400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2bc0a99b0 0x7fa2bc14f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58478/0 (socket says 172.21.15.8:58478) 2024-03-23T23:58:24.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.086+0000 7fa2bb400640 1 -- 172.21.15.8:0/1594394147 learned_addr learned my addr 172.21.15.8:0/1594394147 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:24.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.086+0000 7fa2bbe00640 1 --2- 172.21.15.8:0/1594394147 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa2bc153360 0x7fa2bc148760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:24.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.086+0000 7fa2b3e00640 1 --2- 172.21.15.8:0/1594394147 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2bc1509b0 0x7fa2bc1563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:24.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.086+0000 7fa2bb400640 1 -- 172.21.15.8:0/1594394147 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2bc1509b0 msgr2=0x7fa2bc1563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:24.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.086+0000 7fa2bb400640 1 --2- 172.21.15.8:0/1594394147 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2bc1509b0 0x7fa2bc1563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.086+0000 7fa2bb400640 1 -- 172.21.15.8:0/1594394147 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa2bc153360 msgr2=0x7fa2bc148760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:24.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.086+0000 7fa2bb400640 1 --2- 172.21.15.8:0/1594394147 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa2bc153360 0x7fa2bc148760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.086+0000 7fa2bb400640 1 -- 172.21.15.8:0/1594394147 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2bc155fd0 con 0x7fa2bc0a99b0 2024-03-23T23:58:24.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.086+0000 7fa2bb400640 1 --2- 172.21.15.8:0/1594394147 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2bc0a99b0 0x7fa2bc14f7a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac00e8a0 tx=0x7fa2ac00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:24.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.086+0000 7fa2b3400640 1 -- 172.21.15.8:0/1594394147 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac017070 con 0x7fa2bc0a99b0 2024-03-23T23:58:24.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.086+0000 7fa2b3400640 1 -- 172.21.15.8:0/1594394147 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ac00c940 con 0x7fa2bc0a99b0 2024-03-23T23:58:24.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.086+0000 7fa2c1000640 1 -- 172.21.15.8:0/1594394147 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2bc0c4b60 con 0x7fa2bc0a99b0 2024-03-23T23:58:24.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.086+0000 7fa2b3400640 1 -- 172.21.15.8:0/1594394147 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac00ccf0 con 0x7fa2bc0a99b0 2024-03-23T23:58:24.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.086+0000 7fa2c1000640 1 -- 172.21.15.8:0/1594394147 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2bc155210 con 0x7fa2bc0a99b0 2024-03-23T23:58:24.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.086+0000 7fa2c1000640 1 -- 172.21.15.8:0/1594394147 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2bc04f410 con 0x7fa2bc0a99b0 2024-03-23T23:58:24.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.090+0000 7fa2b3400640 1 -- 172.21.15.8:0/1594394147 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fa2ac01a070 con 0x7fa2bc0a99b0 2024-03-23T23:58:24.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.090+0000 7fa2b3400640 1 --2- 172.21.15.8:0/1594394147 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa298067660 0x7fa298069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.090+0000 7fa2b3400640 1 -- 172.21.15.8:0/1594394147 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fa2ac085b90 con 0x7fa2bc0a99b0 2024-03-23T23:58:24.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.090+0000 7fa2b3e00640 1 --2- 172.21.15.8:0/1594394147 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa298067660 0x7fa298069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:24.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.090+0000 7fa2b3e00640 1 --2- 172.21.15.8:0/1594394147 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa298067660 0x7fa298069b20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40ae000 tx=0x7fa2a4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:24.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.098+0000 7fa2b3400640 1 -- 172.21.15.8:0/1594394147 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fa2ac055d60 con 0x7fa2bc0a99b0 2024-03-23T23:58:24.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.294+0000 7fa2c1000640 1 -- 172.21.15.8:0/1594394147 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2bc06cd50 con 0x7fa2bc0a99b0 2024-03-23T23:58:24.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.298+0000 7fa2b3400640 1 -- 172.21.15.8:0/1594394147 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6245 (secure 0 0 0) 0x7fa2ac059e00 con 0x7fa2bc0a99b0 2024-03-23T23:58:24.298 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:58:24.298 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6836/3149325777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3149325777},{"type":"v1","addr":"172.21.15.196:6836","nonce":3149325777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6833/1542162403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1542162403},{"type":"v1","addr":"172.21.15.8:6833","nonce":1542162403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T23:42:40.070799+0000","modified":"2024-03-23T23:42:44.080269+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6837/3402347550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":3402347550},{"type":"v1","addr":"172.21.15.196:6837","nonce":3402347550}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T23:42:50.113972+0000","modified":"2024-03-23T23:42:54.152778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.8:6835/3531853933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3531853933},{"type":"v1","addr":"172.21.15.8:6835","nonce":3531853933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4269,"qdb_cluster":[4269]},"id":2}]} 2024-03-23T23:58:24.298 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 15 2024-03-23T23:58:24.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.298+0000 7fa2c1000640 1 -- 172.21.15.8:0/1594394147 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa298067660 msgr2=0x7fa298069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:24.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.298+0000 7fa2c1000640 1 --2- 172.21.15.8:0/1594394147 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa298067660 0x7fa298069b20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40ae000 tx=0x7fa2a4008040 comp rx=0 tx=0).stop 2024-03-23T23:58:24.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.298+0000 7fa2c1000640 1 -- 172.21.15.8:0/1594394147 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2bc0a99b0 msgr2=0x7fa2bc14f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:24.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.298+0000 7fa2c1000640 1 --2- 172.21.15.8:0/1594394147 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2bc0a99b0 0x7fa2bc14f7a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac00e8a0 tx=0x7fa2ac00eca0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.298+0000 7fa2c1000640 1 -- 172.21.15.8:0/1594394147 shutdown_connections 2024-03-23T23:58:24.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.298+0000 7fa2c1000640 1 --2- 172.21.15.8:0/1594394147 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa2bc153360 0x7fa2bc148760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.298+0000 7fa2c1000640 1 --2- 172.21.15.8:0/1594394147 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fa298067660 0x7fa298069b20 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.298+0000 7fa2c1000640 1 --2- 172.21.15.8:0/1594394147 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2bc1509b0 0x7fa2bc1563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.298+0000 7fa2c1000640 1 --2- 172.21.15.8:0/1594394147 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2bc0a99b0 0x7fa2bc14f7a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.298+0000 7fa2c1000640 1 -- 172.21.15.8:0/1594394147 >> 172.21.15.8:0/1594394147 conn(0x7fa2bc0c6e10 msgr2=0x7fa2bc0c1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:24.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.298+0000 7fa2c1000640 1 -- 172.21.15.8:0/1594394147 shutdown_connections 2024-03-23T23:58:24.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.298+0000 7fa2c1000640 1 -- 172.21.15.8:0/1594394147 wait complete. 2024-03-23T23:58:24.321 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T23:58:24.322 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T23:58:24.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.466+0000 7fbaaa200640 1 Processor -- start 2024-03-23T23:58:24.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.466+0000 7fbaaa200640 1 -- start start 2024-03-23T23:58:24.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.466+0000 7fbaaa200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbaa414a180 0x7fbaa4154220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.466+0000 7fbaaa200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbaa40c1b70 0x7fbaa40c3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.466+0000 7fbaaa200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa414a560 con 0x7fbaa40c3b60 2024-03-23T23:58:24.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.466+0000 7fbaaa200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa40c2070 con 0x7fbaa414a180 2024-03-23T23:58:24.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.466+0000 7fbaaa200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa40c2350 con 0x7fbaa40c1b70 2024-03-23T23:58:24.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.466+0000 7fbaa3400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbaa414a180 0x7fbaa4154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:24.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.466+0000 7fbaa3e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fbaa40c3b60 0x7fbaa406e350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:35370/0 (socket says 172.21.15.8:35370) 2024-03-23T23:58:24.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.466+0000 7fbaa3e00640 1 -- 172.21.15.8:0/2938625094 learned_addr learned my addr 172.21.15.8:0/2938625094 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:58:24.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.466+0000 7fba9be00640 1 --2- 172.21.15.8:0/2938625094 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbaa40c1b70 0x7fbaa40c3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:24.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.466+0000 7fbaa2a00640 1 -- 172.21.15.8:0/2938625094 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1513554735 0 0) 0x7fbaa414a560 con 0x7fbaa40c3b60 2024-03-23T23:58:24.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.466+0000 7fbaa2a00640 1 -- 172.21.15.8:0/2938625094 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba88003530 con 0x7fbaa40c3b60 2024-03-23T23:58:24.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.466+0000 7fbaa3400640 1 -- 172.21.15.8:0/2938625094 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbaa40c1b70 msgr2=0x7fbaa40c3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:24.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.466+0000 7fbaa3400640 1 --2- 172.21.15.8:0/2938625094 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbaa40c1b70 0x7fbaa40c3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.466+0000 7fbaa3400640 1 -- 172.21.15.8:0/2938625094 >> v1:172.21.15.8:6789/0 conn(0x7fbaa40c3b60 legacy=0x7fbaa406e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:24.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.466+0000 7fbaa3400640 1 -- 172.21.15.8:0/2938625094 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa40c2630 con 0x7fbaa414a180 2024-03-23T23:58:24.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.470+0000 7fbaa3400640 1 --2- 172.21.15.8:0/2938625094 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbaa414a180 0x7fbaa4154220 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fba940097c0 tx=0x7fba9401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b1fd1beff88b1de server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:24.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.470+0000 7fbaa2a00640 1 -- 172.21.15.8:0/2938625094 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba940ab430 con 0x7fbaa414a180 2024-03-23T23:58:24.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.470+0000 7fbaa2a00640 1 -- 172.21.15.8:0/2938625094 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba940b0070 con 0x7fbaa414a180 2024-03-23T23:58:24.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.470+0000 7fbaa2a00640 1 -- 172.21.15.8:0/2938625094 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba940ab7f0 con 0x7fbaa414a180 2024-03-23T23:58:24.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.470+0000 7fbaaa200640 1 -- 172.21.15.8:0/2938625094 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbaa414a180 msgr2=0x7fbaa4154220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:24.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.470+0000 7fbaaa200640 1 --2- 172.21.15.8:0/2938625094 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbaa414a180 0x7fbaa4154220 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fba940097c0 tx=0x7fba9401c410 comp rx=0 tx=0).stop 2024-03-23T23:58:24.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.470+0000 7fbaaa200640 1 -- 172.21.15.8:0/2938625094 shutdown_connections 2024-03-23T23:58:24.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.470+0000 7fbaaa200640 1 --2- 172.21.15.8:0/2938625094 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbaa40c1b70 0x7fbaa40c3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.470+0000 7fbaaa200640 1 --2- 172.21.15.8:0/2938625094 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbaa414a180 0x7fbaa4154220 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.470+0000 7fbaaa200640 1 -- 172.21.15.8:0/2938625094 >> 172.21.15.8:0/2938625094 conn(0x7fbaa406b170 msgr2=0x7fbaa406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:24.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.470+0000 7fbaaa200640 1 -- 172.21.15.8:0/2938625094 shutdown_connections 2024-03-23T23:58:24.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.470+0000 7fbaaa200640 1 -- 172.21.15.8:0/2938625094 wait complete. 2024-03-23T23:58:24.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.474+0000 7fbaaa200640 1 Processor -- start 2024-03-23T23:58:24.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.474+0000 7fbaaa200640 1 -- start start 2024-03-23T23:58:24.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.474+0000 7fbaaa200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbaa40c1b70 0x7fbaa41469f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.474+0000 7fbaaa200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbaa40c3b60 0x7fbaa415c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.474+0000 7fbaaa200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbaa414a180 0x7fbaa4142e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.474+0000 7fbaaa200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa41607b0 con 0x7fbaa414a180 2024-03-23T23:58:24.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.474+0000 7fbaaa200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa406f080 con 0x7fbaa40c1b70 2024-03-23T23:58:24.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.474+0000 7fbaaa200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa4160930 con 0x7fbaa40c3b60 2024-03-23T23:58:24.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.474+0000 7fbaa3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbaa414a180 0x7fbaa4142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:24.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.474+0000 7fbaa3400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbaa40c1b70 0x7fbaa41469f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:24.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.474+0000 7fbaa3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbaa414a180 0x7fbaa4142e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58496/0 (socket says 172.21.15.8:58496) 2024-03-23T23:58:24.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.474+0000 7fbaa3e00640 1 -- 172.21.15.8:0/2738131963 learned_addr learned my addr 172.21.15.8:0/2738131963 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:24.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.474+0000 7fba9be00640 1 --2- 172.21.15.8:0/2738131963 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbaa40c3b60 0x7fbaa415c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:24.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.474+0000 7fbaa3400640 1 -- 172.21.15.8:0/2738131963 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbaa40c3b60 msgr2=0x7fbaa415c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:24.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.474+0000 7fbaa3400640 1 --2- 172.21.15.8:0/2738131963 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbaa40c3b60 0x7fbaa415c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.474+0000 7fbaa3400640 1 -- 172.21.15.8:0/2738131963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbaa414a180 msgr2=0x7fbaa4142e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:24.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.474+0000 7fbaa3400640 1 --2- 172.21.15.8:0/2738131963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbaa414a180 0x7fbaa4142e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.474+0000 7fbaa3400640 1 -- 172.21.15.8:0/2738131963 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa41f2580 con 0x7fbaa40c1b70 2024-03-23T23:58:24.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.474+0000 7fbaa3e00640 1 --2- 172.21.15.8:0/2738131963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbaa414a180 0x7fbaa4142e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:58:24.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.474+0000 7fbaa3400640 1 --2- 172.21.15.8:0/2738131963 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbaa40c1b70 0x7fbaa41469f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40ac8f0 tx=0x7fba940191b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:24.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.474+0000 7fba9b400640 1 -- 172.21.15.8:0/2738131963 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba940bd480 con 0x7fbaa40c1b70 2024-03-23T23:58:24.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.474+0000 7fba9b400640 1 -- 172.21.15.8:0/2738131963 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba940bd620 con 0x7fbaa40c1b70 2024-03-23T23:58:24.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.474+0000 7fbaaa200640 1 -- 172.21.15.8:0/2738131963 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa41f17c0 con 0x7fbaa40c1b70 2024-03-23T23:58:24.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.474+0000 7fba9b400640 1 -- 172.21.15.8:0/2738131963 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba940bda10 con 0x7fbaa40c1b70 2024-03-23T23:58:24.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.474+0000 7fbaaa200640 1 -- 172.21.15.8:0/2738131963 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa41f1d80 con 0x7fbaa40c1b70 2024-03-23T23:58:24.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.478+0000 7fbaaa200640 1 -- 172.21.15.8:0/2738131963 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa404f480 con 0x7fbaa40c1b70 2024-03-23T23:58:24.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.478+0000 7fba9b400640 1 -- 172.21.15.8:0/2738131963 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fba940bdbb0 con 0x7fbaa40c1b70 2024-03-23T23:58:24.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.478+0000 7fba9b400640 1 --2- 172.21.15.8:0/2738131963 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fba80067660 0x7fba80069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.478+0000 7fba9b400640 1 -- 172.21.15.8:0/2738131963 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fba94120090 con 0x7fbaa40c1b70 2024-03-23T23:58:24.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.478+0000 7fba9be00640 1 --2- 172.21.15.8:0/2738131963 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fba80067660 0x7fba80069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:24.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.478+0000 7fba9be00640 1 --2- 172.21.15.8:0/2738131963 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fba80067660 0x7fba80069b20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbaa413f6e0 tx=0x7fba8c009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:24.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.486+0000 7fba9b400640 1 -- 172.21.15.8:0/2738131963 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fba94016090 con 0x7fbaa40c1b70 2024-03-23T23:58:24.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.710+0000 7fbaaa200640 1 -- 172.21.15.8:0/2738131963 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fbaa40c3400 con 0x7fbaa40c1b70 2024-03-23T23:58:24.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.710+0000 7fba9b400640 1 -- 172.21.15.8:0/2738131963 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1562 (secure 0 0 0) 0x7fba940f0380 con 0x7fbaa40c1b70 2024-03-23T23:58:24.712 INFO:teuthology.orchestra.run.smithi008.stdout:{"election_epoch":122,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","modified":"2024-03-23T23:41:42.202826Z","created":"2024-03-23T23:41:42.202826Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T23:58:24.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.714+0000 7fbaaa200640 1 -- 172.21.15.8:0/2738131963 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fba80067660 msgr2=0x7fba80069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:24.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.714+0000 7fbaaa200640 1 --2- 172.21.15.8:0/2738131963 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fba80067660 0x7fba80069b20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbaa413f6e0 tx=0x7fba8c009190 comp rx=0 tx=0).stop 2024-03-23T23:58:24.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.714+0000 7fbaaa200640 1 -- 172.21.15.8:0/2738131963 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbaa40c1b70 msgr2=0x7fbaa41469f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:24.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.714+0000 7fbaaa200640 1 --2- 172.21.15.8:0/2738131963 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbaa40c1b70 0x7fbaa41469f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40ac8f0 tx=0x7fba940191b0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.714+0000 7fbaaa200640 1 -- 172.21.15.8:0/2738131963 shutdown_connections 2024-03-23T23:58:24.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.714+0000 7fbaaa200640 1 --2- 172.21.15.8:0/2738131963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbaa414a180 0x7fbaa4142e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.714+0000 7fbaaa200640 1 --2- 172.21.15.8:0/2738131963 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fba80067660 0x7fba80069b20 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.714+0000 7fbaaa200640 1 --2- 172.21.15.8:0/2738131963 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbaa40c3b60 0x7fbaa415c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.714+0000 7fbaaa200640 1 --2- 172.21.15.8:0/2738131963 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbaa40c1b70 0x7fbaa41469f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.714+0000 7fbaaa200640 1 -- 172.21.15.8:0/2738131963 >> 172.21.15.8:0/2738131963 conn(0x7fbaa406b170 msgr2=0x7fbaa406b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:24.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.714+0000 7fbaaa200640 1 -- 172.21.15.8:0/2738131963 shutdown_connections 2024-03-23T23:58:24.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.714+0000 7fbaaa200640 1 -- 172.21.15.8:0/2738131963 wait complete. 2024-03-23T23:58:24.733 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T23:58:24.733 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-03-23T23:58:24.742 INFO:tasks.kclient:Unmounting kernel clients... 2024-03-23T23:58:24.742 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-23T23:58:24.742 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-23T23:58:24.751 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-23T23:58:24.751 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-23T23:58:24.801 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:58:24.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.982+0000 7f2d51000640 1 Processor -- start 2024-03-23T23:58:24.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.982+0000 7f2d51000640 1 -- start start 2024-03-23T23:58:24.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.986+0000 7f2d51000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2d4c0711a0 0x7f2d4c153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.986+0000 7f2d51000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2d4c0c6dd0 0x7f2d4c154200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.986+0000 7f2d51000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d4c0c4670 con 0x7f2d4c0c8a40 2024-03-23T23:58:24.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.986+0000 7f2d51000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d4c0c4940 con 0x7f2d4c0711a0 2024-03-23T23:58:24.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.986+0000 7f2d51000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d4c153830 con 0x7f2d4c0c6dd0 2024-03-23T23:58:24.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.986+0000 7f2d4b400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2d4c0711a0 0x7f2d4c153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:24.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.986+0000 7f2d4b400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2d4c0711a0 0x7f2d4c153cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58512/0 (socket says 172.21.15.8:58512) 2024-03-23T23:58:24.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.986+0000 7f2d4b400640 1 -- 172.21.15.8:0/1927172242 learned_addr learned my addr 172.21.15.8:0/1927172242 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:24.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.986+0000 7f2d43e00640 1 --2- 172.21.15.8:0/1927172242 >> v2:172.21.15.196:3300/0 conn(0x7f2d4c0c6dd0 0x7f2d4c154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:24.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.986+0000 7f2d4b400640 1 -- 172.21.15.8:0/1927172242 >> v2:172.21.15.196:3300/0 conn(0x7f2d4c0c6dd0 msgr2=0x7f2d4c154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:24.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.986+0000 7f2d4b400640 1 --2- 172.21.15.8:0/1927172242 >> v2:172.21.15.196:3300/0 conn(0x7f2d4c0c6dd0 0x7f2d4c154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.986+0000 7f2d4b400640 1 -- 172.21.15.8:0/1927172242 >> v1:172.21.15.8:6789/0 conn(0x7f2d4c0c8a40 legacy=0x7f2d4c1508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:24.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.986+0000 7f2d4b400640 1 -- 172.21.15.8:0/1927172242 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4c0c4b90 con 0x7f2d4c0711a0 2024-03-23T23:58:24.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.990+0000 7f2d4b400640 1 --2- 172.21.15.8:0/1927172242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d4c0711a0 0x7f2d4c153cc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c06c1b0 tx=0x7f2d3c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb14f6382e119775 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:24.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.990+0000 7f2d4aa00640 1 -- 172.21.15.8:0/1927172242 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c0b0070 con 0x7f2d4c0711a0 2024-03-23T23:58:24.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.990+0000 7f2d4aa00640 1 -- 172.21.15.8:0/1927172242 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3c0ab600 con 0x7f2d4c0711a0 2024-03-23T23:58:24.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.990+0000 7f2d4aa00640 1 -- 172.21.15.8:0/1927172242 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c0ab9d0 con 0x7f2d4c0711a0 2024-03-23T23:58:24.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.990+0000 7f2d51000640 1 -- 172.21.15.8:0/1927172242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d4c0711a0 msgr2=0x7f2d4c153cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:24.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.990+0000 7f2d51000640 1 --2- 172.21.15.8:0/1927172242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d4c0711a0 0x7f2d4c153cc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c06c1b0 tx=0x7f2d3c01c490 comp rx=0 tx=0).stop 2024-03-23T23:58:24.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.990+0000 7f2d51000640 1 -- 172.21.15.8:0/1927172242 shutdown_connections 2024-03-23T23:58:24.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.990+0000 7f2d51000640 1 --2- 172.21.15.8:0/1927172242 >> v2:172.21.15.196:3300/0 conn(0x7f2d4c0c6dd0 0x7f2d4c154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.990+0000 7f2d51000640 1 --2- 172.21.15.8:0/1927172242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d4c0711a0 0x7f2d4c153cc0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.990+0000 7f2d51000640 1 -- 172.21.15.8:0/1927172242 >> 172.21.15.8:0/1927172242 conn(0x7f2d4c0aac80 msgr2=0x7f2d4c0ab090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:24.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.990+0000 7f2d51000640 1 -- 172.21.15.8:0/1927172242 shutdown_connections 2024-03-23T23:58:24.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.990+0000 7f2d51000640 1 -- 172.21.15.8:0/1927172242 wait complete. 2024-03-23T23:58:24.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.994+0000 7f2d51000640 1 Processor -- start 2024-03-23T23:58:24.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.994+0000 7f2d51000640 1 -- start start 2024-03-23T23:58:24.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.994+0000 7f2d51000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d4c0711a0 0x7f2d4c146dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.994+0000 7f2d51000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d4c0c6dd0 0x7f2d4c1f0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.994+0000 7f2d51000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2d4c0c8a40 0x7f2d4c0a9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.994+0000 7f2d51000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c1606c0 con 0x7f2d4c0711a0 2024-03-23T23:58:24.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.994+0000 7f2d51000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c071790 con 0x7f2d4c0c8a40 2024-03-23T23:58:24.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.994+0000 7f2d51000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c160840 con 0x7f2d4c0c6dd0 2024-03-23T23:58:24.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.994+0000 7f2d4b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d4c0711a0 0x7f2d4c146dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:24.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.994+0000 7f2d4b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d4c0711a0 0x7f2d4c146dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58526/0 (socket says 172.21.15.8:58526) 2024-03-23T23:58:24.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.994+0000 7f2d4b400640 1 -- 172.21.15.8:0/2857278322 learned_addr learned my addr 172.21.15.8:0/2857278322 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:24.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.994+0000 7f2d43e00640 1 --2- 172.21.15.8:0/2857278322 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d4c0c6dd0 0x7f2d4c1f0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:24.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.994+0000 7f2d4be00640 1 --2- 172.21.15.8:0/2857278322 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2d4c0c8a40 0x7f2d4c0a9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:24.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.994+0000 7f2d4b400640 1 -- 172.21.15.8:0/2857278322 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d4c0c6dd0 msgr2=0x7f2d4c1f0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:24.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.994+0000 7f2d4b400640 1 --2- 172.21.15.8:0/2857278322 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d4c0c6dd0 0x7f2d4c1f0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.994+0000 7f2d4b400640 1 -- 172.21.15.8:0/2857278322 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2d4c0c8a40 msgr2=0x7f2d4c0a9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:24.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.994+0000 7f2d4b400640 1 --2- 172.21.15.8:0/2857278322 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2d4c0c8a40 0x7f2d4c0a9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.994+0000 7f2d4b400640 1 -- 172.21.15.8:0/2857278322 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4c1483f0 con 0x7f2d4c0711a0 2024-03-23T23:58:24.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.994+0000 7f2d4b400640 1 --2- 172.21.15.8:0/2857278322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d4c0711a0 0x7f2d4c146dc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c0ae040 tx=0x7f2d3c019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:24.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.994+0000 7f2d43400640 1 -- 172.21.15.8:0/2857278322 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c0b0040 con 0x7f2d4c0711a0 2024-03-23T23:58:24.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.994+0000 7f2d43400640 1 -- 172.21.15.8:0/2857278322 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3c0b9070 con 0x7f2d4c0711a0 2024-03-23T23:58:24.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.994+0000 7f2d43400640 1 -- 172.21.15.8:0/2857278322 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c0b4680 con 0x7f2d4c0711a0 2024-03-23T23:58:24.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.994+0000 7f2d51000640 1 -- 172.21.15.8:0/2857278322 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d4c1486d0 con 0x7f2d4c0711a0 2024-03-23T23:58:24.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.994+0000 7f2d51000640 1 -- 172.21.15.8:0/2857278322 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d4c1efe00 con 0x7f2d4c0711a0 2024-03-23T23:58:24.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.998+0000 7f2d51000640 1 -- 172.21.15.8:0/2857278322 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d4c04f410 con 0x7f2d4c0711a0 2024-03-23T23:58:24.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.998+0000 7f2d43400640 1 -- 172.21.15.8:0/2857278322 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f2d3c0b4820 con 0x7f2d4c0711a0 2024-03-23T23:58:24.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.998+0000 7f2d43400640 1 --2- 172.21.15.8:0/2857278322 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2d280676b0 0x7f2d28069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.998+0000 7f2d43400640 1 -- 172.21.15.8:0/2857278322 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f2d3c11f7a0 con 0x7f2d4c0711a0 2024-03-23T23:58:25.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.998+0000 7f2d43e00640 1 --2- 172.21.15.8:0/2857278322 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2d280676b0 0x7f2d28069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:25.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:24.998+0000 7f2d43e00640 1 --2- 172.21.15.8:0/2857278322 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2d280676b0 0x7f2d28069b70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c150560 tx=0x7f2d34009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:25.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.002+0000 7f2d43400640 1 -- 172.21.15.8:0/2857278322 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f2d3c016110 con 0x7f2d4c0711a0 2024-03-23T23:58:25.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.166+0000 7f2d51000640 1 -- 172.21.15.8:0/2857278322 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d4c1effd0 con 0x7f2d4c0711a0 2024-03-23T23:58:25.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.170+0000 7f2d43400640 1 -- 172.21.15.8:0/2857278322 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20567 (secure 0 0 0) 0x7f2d3c0ef9f0 con 0x7f2d4c0711a0 2024-03-23T23:58:25.169 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:58:25.170 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":27,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","created":"2024-03-23T23:42:15.169430+0000","modified":"2024-03-23T23:43:21.884365+0000","last_up_change":"2024-03-23T23:42:26.509742+0000","last_in_change":"2024-03-23T23:42:17.662330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:42:26.327445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-23T23:42:38.218800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-23T23:42:39.054195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-23T23:42:48.327799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-23T23:42:49.113061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e967bf31-21d6-4d11-bc3d-0df8177a1b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6809","nonce":2187201732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6811","nonce":2187201732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6815","nonce":2187201732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6813","nonce":2187201732}]},"public_addr":"172.21.15.8:6809/2187201732","cluster_addr":"172.21.15.8:6811/2187201732","heartbeat_back_addr":"172.21.15.8:6815/2187201732","heartbeat_front_addr":"172.21.15.8:6813/2187201732","state":["exists","up"]},{"osd":1,"uuid":"c8e33701-7acd-4474-8402-d52461171fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6818","nonce":3205168010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6822","nonce":3205168010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6830","nonce":3205168010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6826","nonce":3205168010}]},"public_addr":"172.21.15.8:6818/3205168010","cluster_addr":"172.21.15.8:6822/3205168010","heartbeat_back_addr":"172.21.15.8:6830/3205168010","heartbeat_front_addr":"172.21.15.8:6826/3205168010","state":["exists","up"]},{"osd":2,"uuid":"ceebdbf7-4c2f-4757-b52d-fd8b20e77570","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6801","nonce":475463656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6803","nonce":475463656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6807","nonce":475463656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6805","nonce":475463656}]},"public_addr":"172.21.15.8:6801/475463656","cluster_addr":"172.21.15.8:6803/475463656","heartbeat_back_addr":"172.21.15.8:6807/475463656","heartbeat_front_addr":"172.21.15.8:6805/475463656","state":["exists","up"]},{"osd":3,"uuid":"89e258da-5767-429e-8441-edf877d2f3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6819","nonce":1514082871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6821","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6823","nonce":1514082871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6829","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6831","nonce":1514082871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6825","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6827","nonce":1514082871}]},"public_addr":"172.21.15.8:6819/1514082871","cluster_addr":"172.21.15.8:6823/1514082871","heartbeat_back_addr":"172.21.15.8:6831/1514082871","heartbeat_front_addr":"172.21.15.8:6827/1514082871","state":["exists","up"]},{"osd":4,"uuid":"2b7451ae-ea16-4f0a-ae50-04fde75e45ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6825","nonce":3516578147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6827","nonce":3516578147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6831","nonce":3516578147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6829","nonce":3516578147}]},"public_addr":"172.21.15.196:6825/3516578147","cluster_addr":"172.21.15.196:6827/3516578147","heartbeat_back_addr":"172.21.15.196:6831/3516578147","heartbeat_front_addr":"172.21.15.196:6829/3516578147","state":["exists","up"]},{"osd":5,"uuid":"e68a8914-e591-466a-bc9e-f2d7c67aac13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6802","nonce":830595758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6806","nonce":830595758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6814","nonce":830595758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6810","nonce":830595758}]},"public_addr":"172.21.15.196:6802/830595758","cluster_addr":"172.21.15.196:6806/830595758","heartbeat_back_addr":"172.21.15.196:6814/830595758","heartbeat_front_addr":"172.21.15.196:6810/830595758","state":["exists","up"]},{"osd":6,"uuid":"e47723c5-50a0-4cd8-92d9-01972072b422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6801","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6803","nonce":472639906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6805","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6807","nonce":472639906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6815","nonce":472639906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6811","nonce":472639906}]},"public_addr":"172.21.15.196:6803/472639906","cluster_addr":"172.21.15.196:6807/472639906","heartbeat_back_addr":"172.21.15.196:6815/472639906","heartbeat_front_addr":"172.21.15.196:6811/472639906","state":["exists","up"]},{"osd":7,"uuid":"e1e9113d-8005-47b3-9a75-9e701199f1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6817","nonce":4151820349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6819","nonce":4151820349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6823","nonce":4151820349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6821","nonce":4151820349}]},"public_addr":"172.21.15.196:6817/4151820349","cluster_addr":"172.21.15.196:6819/4151820349","heartbeat_back_addr":"172.21.15.196:6823/4151820349","heartbeat_front_addr":"172.21.15.196:6821/4151820349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.221790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.265974+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.190319+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.376359+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.329657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.402958+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.300703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.133121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:58:25.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.170+0000 7f2d51000640 1 -- 172.21.15.8:0/2857278322 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2d280676b0 msgr2=0x7f2d28069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:25.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.170+0000 7f2d51000640 1 --2- 172.21.15.8:0/2857278322 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2d280676b0 0x7f2d28069b70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c150560 tx=0x7f2d34009190 comp rx=0 tx=0).stop 2024-03-23T23:58:25.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.170+0000 7f2d51000640 1 -- 172.21.15.8:0/2857278322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d4c0711a0 msgr2=0x7f2d4c146dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:25.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.170+0000 7f2d51000640 1 --2- 172.21.15.8:0/2857278322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d4c0711a0 0x7f2d4c146dc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c0ae040 tx=0x7f2d3c019230 comp rx=0 tx=0).stop 2024-03-23T23:58:25.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.170+0000 7f2d51000640 1 -- 172.21.15.8:0/2857278322 shutdown_connections 2024-03-23T23:58:25.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.170+0000 7f2d51000640 1 --2- 172.21.15.8:0/2857278322 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2d4c0c8a40 0x7f2d4c0a9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:25.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.170+0000 7f2d51000640 1 --2- 172.21.15.8:0/2857278322 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2d280676b0 0x7f2d28069b70 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:25.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.170+0000 7f2d51000640 1 --2- 172.21.15.8:0/2857278322 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d4c0c6dd0 0x7f2d4c1f0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:25.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.170+0000 7f2d51000640 1 --2- 172.21.15.8:0/2857278322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d4c0711a0 0x7f2d4c146dc0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:25.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.170+0000 7f2d51000640 1 -- 172.21.15.8:0/2857278322 >> 172.21.15.8:0/2857278322 conn(0x7f2d4c0aac80 msgr2=0x7f2d4c0c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:25.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.170+0000 7f2d51000640 1 -- 172.21.15.8:0/2857278322 shutdown_connections 2024-03-23T23:58:25.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.170+0000 7f2d51000640 1 -- 172.21.15.8:0/2857278322 wait complete. 2024-03-23T23:58:25.192 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-23T23:42:26.327445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-03-23T23:42:38.218800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-03-23T23:42:39.054195+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-03-23T23:42:48.327799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-03-23T23:42:49.113061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-23T23:58:25.193 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-23T23:58:25.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.334+0000 7fcfa4a00640 1 Processor -- start 2024-03-23T23:58:25.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.334+0000 7fcfa4a00640 1 -- start start 2024-03-23T23:58:25.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.338+0000 7fcfa4a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcfa014d9d0 0x7fcfa0154030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:25.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.338+0000 7fcfa4a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fcfa006fd60 0x7fcfa00701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:25.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.338+0000 7fcfa4a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fcfa01571d0 0x7fcfa0157660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:25.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.338+0000 7fcfa4a00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa00c4830 con 0x7fcfa006fd60 2024-03-23T23:58:25.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.338+0000 7fcfa4a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa0156d40 con 0x7fcfa01571d0 2024-03-23T23:58:25.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.338+0000 7fcfa4a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa00c3700 con 0x7fcfa014d9d0 2024-03-23T23:58:25.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.338+0000 7fcf9d400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fcfa006fd60 0x7fcfa00701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:25.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.338+0000 7fcf9d400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fcfa006fd60 0x7fcfa00701a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58528/0 (socket says 172.21.15.8:58528) 2024-03-23T23:58:25.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.338+0000 7fcf9d400640 1 -- 172.21.15.8:0/4237946215 learned_addr learned my addr 172.21.15.8:0/4237946215 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:25.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.338+0000 7fcf9de00640 1 --2- 172.21.15.8:0/4237946215 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcfa014d9d0 0x7fcfa0154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:25.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.338+0000 7fcf9e800640 1 --2- 172.21.15.8:0/4237946215 >> v2:172.21.15.196:3300/0 conn(0x7fcfa01571d0 0x7fcfa0157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:25.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.338+0000 7fcf9d400640 1 -- 172.21.15.8:0/4237946215 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcfa014d9d0 msgr2=0x7fcfa0154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:25.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.338+0000 7fcf9d400640 1 --2- 172.21.15.8:0/4237946215 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcfa014d9d0 0x7fcfa0154030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:25.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.338+0000 7fcf9d400640 1 -- 172.21.15.8:0/4237946215 >> v2:172.21.15.196:3300/0 conn(0x7fcfa01571d0 msgr2=0x7fcfa0157660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:25.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.338+0000 7fcf9d400640 1 --2- 172.21.15.8:0/4237946215 >> v2:172.21.15.196:3300/0 conn(0x7fcfa01571d0 0x7fcfa0157660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:25.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.338+0000 7fcf9d400640 1 -- 172.21.15.8:0/4237946215 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa0154570 con 0x7fcfa006fd60 2024-03-23T23:58:25.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.338+0000 7fcf9e800640 1 --2- 172.21.15.8:0/4237946215 >> v2:172.21.15.196:3300/0 conn(0x7fcfa01571d0 0x7fcfa0157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:58:25.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.342+0000 7fcf9d400640 1 --2- 172.21.15.8:0/4237946215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfa006fd60 0x7fcfa00701a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0073220 tx=0x7fcf8c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eac0d252876c0ed server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:25.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.342+0000 7fcf9ca00640 1 -- 172.21.15.8:0/4237946215 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c0b0070 con 0x7fcfa006fd60 2024-03-23T23:58:25.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.342+0000 7fcf9ca00640 1 -- 172.21.15.8:0/4237946215 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8c0ab600 con 0x7fcfa006fd60 2024-03-23T23:58:25.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.342+0000 7fcf9ca00640 1 -- 172.21.15.8:0/4237946215 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c0ab9d0 con 0x7fcfa006fd60 2024-03-23T23:58:25.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.342+0000 7fcfa4a00640 1 -- 172.21.15.8:0/4237946215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfa006fd60 msgr2=0x7fcfa00701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:25.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.342+0000 7fcfa4a00640 1 --2- 172.21.15.8:0/4237946215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfa006fd60 0x7fcfa00701a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0073220 tx=0x7fcf8c01c400 comp rx=0 tx=0).stop 2024-03-23T23:58:25.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.342+0000 7fcfa4a00640 1 -- 172.21.15.8:0/4237946215 shutdown_connections 2024-03-23T23:58:25.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.342+0000 7fcfa4a00640 1 --2- 172.21.15.8:0/4237946215 >> v2:172.21.15.196:3300/0 conn(0x7fcfa01571d0 0x7fcfa0157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:25.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.342+0000 7fcfa4a00640 1 --2- 172.21.15.8:0/4237946215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfa006fd60 0x7fcfa00701a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:25.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.342+0000 7fcfa4a00640 1 --2- 172.21.15.8:0/4237946215 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcfa014d9d0 0x7fcfa0154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:25.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.342+0000 7fcfa4a00640 1 -- 172.21.15.8:0/4237946215 >> 172.21.15.8:0/4237946215 conn(0x7fcfa00c4a70 msgr2=0x7fcfa00c4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:25.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.342+0000 7fcfa4a00640 1 -- 172.21.15.8:0/4237946215 shutdown_connections 2024-03-23T23:58:25.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.342+0000 7fcfa4a00640 1 -- 172.21.15.8:0/4237946215 wait complete. 2024-03-23T23:58:25.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.342+0000 7fcfa4a00640 1 Processor -- start 2024-03-23T23:58:25.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.342+0000 7fcfa4a00640 1 -- start start 2024-03-23T23:58:25.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.346+0000 7fcfa4a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfa006fd60 0x7fcfa00c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:25.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.346+0000 7fcfa4a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcfa014d9d0 0x7fcfa00c13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:25.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.346+0000 7fcfa4a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcfa01571d0 0x7fcfa0143540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:25.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.346+0000 7fcfa4a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa00a95f0 con 0x7fcfa006fd60 2024-03-23T23:58:25.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.346+0000 7fcfa4a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa00a9470 con 0x7fcfa01571d0 2024-03-23T23:58:25.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.346+0000 7fcfa4a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa00c3b60 con 0x7fcfa014d9d0 2024-03-23T23:58:25.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.346+0000 7fcf9de00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfa006fd60 0x7fcfa00c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:25.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.346+0000 7fcf9de00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfa006fd60 0x7fcfa00c73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58532/0 (socket says 172.21.15.8:58532) 2024-03-23T23:58:25.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.346+0000 7fcf9de00640 1 -- 172.21.15.8:0/3155931762 learned_addr learned my addr 172.21.15.8:0/3155931762 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:25.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.346+0000 7fcf9d400640 1 --2- 172.21.15.8:0/3155931762 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcfa014d9d0 0x7fcfa00c13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:25.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.346+0000 7fcf9e800640 1 --2- 172.21.15.8:0/3155931762 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcfa01571d0 0x7fcfa0143540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:25.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.346+0000 7fcf9de00640 1 -- 172.21.15.8:0/3155931762 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcfa014d9d0 msgr2=0x7fcfa00c13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:25.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.346+0000 7fcf9de00640 1 --2- 172.21.15.8:0/3155931762 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcfa014d9d0 0x7fcfa00c13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:25.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.346+0000 7fcf9de00640 1 -- 172.21.15.8:0/3155931762 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcfa01571d0 msgr2=0x7fcfa0143540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:25.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.346+0000 7fcf9de00640 1 --2- 172.21.15.8:0/3155931762 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcfa01571d0 0x7fcfa0143540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:25.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.346+0000 7fcf9de00640 1 -- 172.21.15.8:0/3155931762 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa01f2570 con 0x7fcfa006fd60 2024-03-23T23:58:25.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.346+0000 7fcf9de00640 1 --2- 172.21.15.8:0/3155931762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfa006fd60 0x7fcfa00c73d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000e8a0 tx=0x7fcf9000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:25.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.346+0000 7fcf96000640 1 -- 172.21.15.8:0/3155931762 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf90017070 con 0x7fcfa006fd60 2024-03-23T23:58:25.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.346+0000 7fcf96000640 1 -- 172.21.15.8:0/3155931762 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9000c730 con 0x7fcfa006fd60 2024-03-23T23:58:25.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.346+0000 7fcfa4a00640 1 -- 172.21.15.8:0/3155931762 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa0149010 con 0x7fcfa006fd60 2024-03-23T23:58:25.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.346+0000 7fcf96000640 1 -- 172.21.15.8:0/3155931762 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9000cb20 con 0x7fcfa006fd60 2024-03-23T23:58:25.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.346+0000 7fcfa4a00640 1 -- 172.21.15.8:0/3155931762 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa00c18e0 con 0x7fcfa006fd60 2024-03-23T23:58:25.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.346+0000 7fcfa4a00640 1 -- 172.21.15.8:0/3155931762 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa00c1bd0 con 0x7fcfa006fd60 2024-03-23T23:58:25.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.350+0000 7fcf96000640 1 -- 172.21.15.8:0/3155931762 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fcf9001a070 con 0x7fcfa006fd60 2024-03-23T23:58:25.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.350+0000 7fcf96000640 1 --2- 172.21.15.8:0/3155931762 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcf80067690 0x7fcf80069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:25.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.350+0000 7fcf96000640 1 -- 172.21.15.8:0/3155931762 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fcf90085c20 con 0x7fcfa006fd60 2024-03-23T23:58:25.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.350+0000 7fcf9d400640 1 --2- 172.21.15.8:0/3155931762 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcf80067690 0x7fcf80069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:25.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.350+0000 7fcf9d400640 1 --2- 172.21.15.8:0/3155931762 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcf80067690 0x7fcf80069b50 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c0ad000 tx=0x7fcf8c0a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:25.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.354+0000 7fcf96000640 1 -- 172.21.15.8:0/3155931762 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fcfa00c1bd0 con 0x7fcfa006fd60 2024-03-23T23:58:25.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.518+0000 7fcfa4a00640 1 -- 172.21.15.8:0/3155931762 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcfa004f410 con 0x7fcfa006fd60 2024-03-23T23:58:25.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.518+0000 7fcf96000640 1 -- 172.21.15.8:0/3155931762 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf90085020 con 0x7fcfa006fd60 2024-03-23T23:58:25.520 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-03-23T23:58:25.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.522+0000 7fcfa4a00640 1 -- 172.21.15.8:0/3155931762 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcf80067690 msgr2=0x7fcf80069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:25.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.522+0000 7fcfa4a00640 1 --2- 172.21.15.8:0/3155931762 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcf80067690 0x7fcf80069b50 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c0ad000 tx=0x7fcf8c0a6000 comp rx=0 tx=0).stop 2024-03-23T23:58:25.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.522+0000 7fcfa4a00640 1 -- 172.21.15.8:0/3155931762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfa006fd60 msgr2=0x7fcfa00c73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:25.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.522+0000 7fcfa4a00640 1 --2- 172.21.15.8:0/3155931762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfa006fd60 0x7fcfa00c73d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000e8a0 tx=0x7fcf9000eca0 comp rx=0 tx=0).stop 2024-03-23T23:58:25.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.522+0000 7fcfa4a00640 1 -- 172.21.15.8:0/3155931762 shutdown_connections 2024-03-23T23:58:25.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.522+0000 7fcfa4a00640 1 --2- 172.21.15.8:0/3155931762 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcfa01571d0 0x7fcfa0143540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:25.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.522+0000 7fcfa4a00640 1 --2- 172.21.15.8:0/3155931762 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fcf80067690 0x7fcf80069b50 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:25.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.522+0000 7fcfa4a00640 1 --2- 172.21.15.8:0/3155931762 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcfa014d9d0 0x7fcfa00c13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:25.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.522+0000 7fcfa4a00640 1 --2- 172.21.15.8:0/3155931762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfa006fd60 0x7fcfa00c73d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:25.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.522+0000 7fcfa4a00640 1 -- 172.21.15.8:0/3155931762 >> 172.21.15.8:0/3155931762 conn(0x7fcfa00c4a70 msgr2=0x7fcfa0071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:25.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.522+0000 7fcfa4a00640 1 -- 172.21.15.8:0/3155931762 shutdown_connections 2024-03-23T23:58:25.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.522+0000 7fcfa4a00640 1 -- 172.21.15.8:0/3155931762 wait complete. 2024-03-23T23:58:25.540 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-03-23T23:58:25.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.706+0000 7f1f79a00640 1 Processor -- start 2024-03-23T23:58:25.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.706+0000 7f1f79a00640 1 -- start start 2024-03-23T23:58:25.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.706+0000 7f1f79a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f740c6e40 0x7f1f740c2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:25.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.710+0000 7f1f79a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1f7415e100 0x7f1f741604f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:25.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.710+0000 7f1f79a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f741531f0 con 0x7f1f740c2370 2024-03-23T23:58:25.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.710+0000 7f1f79a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f7406d6a0 con 0x7f1f7415e100 2024-03-23T23:58:25.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.710+0000 7f1f79a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f741559a0 con 0x7f1f740c6e40 2024-03-23T23:58:25.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.710+0000 7f1f72a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f1f740c2370 0x7f1f7406db30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:35386/0 (socket says 172.21.15.8:35386) 2024-03-23T23:58:25.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.710+0000 7f1f73400640 1 --2- 172.21.15.8:0/431454558 >> v2:172.21.15.196:3300/0 conn(0x7f1f7415e100 0x7f1f741604f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:25.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.710+0000 7f1f72a00640 1 -- 172.21.15.8:0/431454558 learned_addr learned my addr 172.21.15.8:0/431454558 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:58:25.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.710+0000 7f1f6a000640 1 --2- 172.21.15.8:0/431454558 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f740c6e40 0x7f1f740c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:25.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.710+0000 7f1f73400640 1 -- 172.21.15.8:0/431454558 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f740c6e40 msgr2=0x7f1f740c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:25.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.710+0000 7f1f73400640 1 --2- 172.21.15.8:0/431454558 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f740c6e40 0x7f1f740c2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:25.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.710+0000 7f1f73400640 1 -- 172.21.15.8:0/431454558 >> v1:172.21.15.8:6789/0 conn(0x7f1f740c2370 legacy=0x7f1f7406db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:25.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.710+0000 7f1f73400640 1 -- 172.21.15.8:0/431454558 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f7406d050 con 0x7f1f7415e100 2024-03-23T23:58:25.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.710+0000 7f1f72000640 1 -- 172.21.15.8:0/431454558 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3426084116 0 0) 0x7f1f741531f0 con 0x7f1f740c2370 2024-03-23T23:58:25.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.710+0000 7f1f73400640 1 --2- 172.21.15.8:0/431454558 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f7415e100 0x7f1f741604f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c009d90 tx=0x7f1f6c01c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88f9a97359e32c49 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:25.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.714+0000 7f1f72000640 1 -- 172.21.15.8:0/431454558 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c0b2070 con 0x7f1f7415e100 2024-03-23T23:58:25.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.714+0000 7f1f72000640 1 -- 172.21.15.8:0/431454558 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6c0a58b0 con 0x7f1f7415e100 2024-03-23T23:58:25.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.714+0000 7f1f72000640 1 -- 172.21.15.8:0/431454558 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c0a5c80 con 0x7f1f7415e100 2024-03-23T23:58:25.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.714+0000 7f1f79a00640 1 -- 172.21.15.8:0/431454558 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f7415e100 msgr2=0x7f1f741604f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:25.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.714+0000 7f1f79a00640 1 --2- 172.21.15.8:0/431454558 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f7415e100 0x7f1f741604f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c009d90 tx=0x7f1f6c01c8e0 comp rx=0 tx=0).stop 2024-03-23T23:58:25.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.714+0000 7f1f79a00640 1 -- 172.21.15.8:0/431454558 shutdown_connections 2024-03-23T23:58:25.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.714+0000 7f1f79a00640 1 --2- 172.21.15.8:0/431454558 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f7415e100 0x7f1f741604f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:25.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.714+0000 7f1f79a00640 1 --2- 172.21.15.8:0/431454558 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f740c6e40 0x7f1f740c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:25.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.714+0000 7f1f79a00640 1 -- 172.21.15.8:0/431454558 >> 172.21.15.8:0/431454558 conn(0x7f1f740aacf0 msgr2=0x7f1f740ab100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:25.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.714+0000 7f1f79a00640 1 -- 172.21.15.8:0/431454558 shutdown_connections 2024-03-23T23:58:25.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.714+0000 7f1f79a00640 1 -- 172.21.15.8:0/431454558 wait complete. 2024-03-23T23:58:25.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.714+0000 7f1f79a00640 1 Processor -- start 2024-03-23T23:58:25.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.714+0000 7f1f79a00640 1 -- start start 2024-03-23T23:58:25.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.714+0000 7f1f79a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f740c2370 0x7f1f741f13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:25.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.714+0000 7f1f79a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f740c6e40 0x7f1f7414f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:25.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.714+0000 7f1f79a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f7415e100 0x7f1f7414fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:25.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.714+0000 7f1f79a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f740c8be0 con 0x7f1f740c6e40 2024-03-23T23:58:25.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.714+0000 7f1f79a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f740ab810 con 0x7f1f740c2370 2024-03-23T23:58:25.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.714+0000 7f1f79a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f740c8360 con 0x7f1f7415e100 2024-03-23T23:58:25.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.714+0000 7f1f6a000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f740c6e40 0x7f1f7414f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:25.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.714+0000 7f1f6a000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f740c6e40 0x7f1f7414f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58544/0 (socket says 172.21.15.8:58544) 2024-03-23T23:58:25.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.714+0000 7f1f6a000640 1 -- 172.21.15.8:0/3290114695 learned_addr learned my addr 172.21.15.8:0/3290114695 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:25.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.714+0000 7f1f72a00640 1 --2- 172.21.15.8:0/3290114695 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f740c2370 0x7f1f741f13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:25.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.714+0000 7f1f73400640 1 --2- 172.21.15.8:0/3290114695 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f7415e100 0x7f1f7414fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:25.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.718+0000 7f1f6a000640 1 -- 172.21.15.8:0/3290114695 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f7415e100 msgr2=0x7f1f7414fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:25.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.718+0000 7f1f6a000640 1 --2- 172.21.15.8:0/3290114695 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f7415e100 0x7f1f7414fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:25.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.718+0000 7f1f6a000640 1 -- 172.21.15.8:0/3290114695 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f740c2370 msgr2=0x7f1f741f13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:25.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.718+0000 7f1f6a000640 1 --2- 172.21.15.8:0/3290114695 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f740c2370 0x7f1f741f13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:25.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.718+0000 7f1f6a000640 1 -- 172.21.15.8:0/3290114695 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f7415a280 con 0x7f1f740c6e40 2024-03-23T23:58:25.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.718+0000 7f1f6a000640 1 --2- 172.21.15.8:0/3290114695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f740c6e40 0x7f1f7414f630 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c00e870 tx=0x7f1f5c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:25.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.718+0000 7f1f6b400640 1 -- 172.21.15.8:0/3290114695 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c017070 con 0x7f1f740c6e40 2024-03-23T23:58:25.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.718+0000 7f1f6b400640 1 -- 172.21.15.8:0/3290114695 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5c00c940 con 0x7f1f740c6e40 2024-03-23T23:58:25.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.718+0000 7f1f6b400640 1 -- 172.21.15.8:0/3290114695 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c00ccf0 con 0x7f1f740c6e40 2024-03-23T23:58:25.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.718+0000 7f1f79a00640 1 -- 172.21.15.8:0/3290114695 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f741f1e30 con 0x7f1f740c6e40 2024-03-23T23:58:25.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.718+0000 7f1f79a00640 1 -- 172.21.15.8:0/3290114695 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f74160830 con 0x7f1f740c6e40 2024-03-23T23:58:25.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.718+0000 7f1f79a00640 1 -- 172.21.15.8:0/3290114695 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f7404f410 con 0x7f1f740c6e40 2024-03-23T23:58:25.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.718+0000 7f1f6b400640 1 -- 172.21.15.8:0/3290114695 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f1f5c01a070 con 0x7f1f740c6e40 2024-03-23T23:58:25.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.718+0000 7f1f6b400640 1 --2- 172.21.15.8:0/3290114695 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1f50067660 0x7f1f50069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:25.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.718+0000 7f1f6b400640 1 -- 172.21.15.8:0/3290114695 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f1f5c085a60 con 0x7f1f740c6e40 2024-03-23T23:58:25.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.722+0000 7f1f72a00640 1 --2- 172.21.15.8:0/3290114695 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1f50067660 0x7f1f50069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:25.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.722+0000 7f1f72a00640 1 --2- 172.21.15.8:0/3290114695 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1f50067660 0x7f1f50069b20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1f64000f70 tx=0x7f1f64007df0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:25.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.726+0000 7f1f6b400640 1 -- 172.21.15.8:0/3290114695 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f1f5c055cc0 con 0x7f1f740c6e40 2024-03-23T23:58:25.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.926+0000 7f1f79a00640 1 -- 172.21.15.8:0/3290114695 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1f740c3460 con 0x7f1f740c6e40 2024-03-23T23:58:25.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.926+0000 7f1f6b400640 1 -- 172.21.15.8:0/3290114695 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v27) v1 ==== 99+0+11 (secure 0 0 0) 0x7f1f5c059d60 con 0x7f1f740c6e40 2024-03-23T23:58:25.928 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-03-23T23:58:25.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.930+0000 7f1f79a00640 1 -- 172.21.15.8:0/3290114695 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1f50067660 msgr2=0x7f1f50069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:25.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.930+0000 7f1f79a00640 1 --2- 172.21.15.8:0/3290114695 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1f50067660 0x7f1f50069b20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1f64000f70 tx=0x7f1f64007df0 comp rx=0 tx=0).stop 2024-03-23T23:58:25.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.930+0000 7f1f79a00640 1 -- 172.21.15.8:0/3290114695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f740c6e40 msgr2=0x7f1f7414f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:25.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.930+0000 7f1f79a00640 1 --2- 172.21.15.8:0/3290114695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f740c6e40 0x7f1f7414f630 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c00e870 tx=0x7f1f5c00ec70 comp rx=0 tx=0).stop 2024-03-23T23:58:25.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.930+0000 7f1f79a00640 1 -- 172.21.15.8:0/3290114695 shutdown_connections 2024-03-23T23:58:25.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.930+0000 7f1f79a00640 1 --2- 172.21.15.8:0/3290114695 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1f50067660 0x7f1f50069b20 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:25.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.930+0000 7f1f79a00640 1 --2- 172.21.15.8:0/3290114695 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f7415e100 0x7f1f7414fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:25.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.930+0000 7f1f79a00640 1 --2- 172.21.15.8:0/3290114695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f740c6e40 0x7f1f7414f630 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:25.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.930+0000 7f1f79a00640 1 --2- 172.21.15.8:0/3290114695 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f740c2370 0x7f1f741f13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:25.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.930+0000 7f1f79a00640 1 -- 172.21.15.8:0/3290114695 >> 172.21.15.8:0/3290114695 conn(0x7f1f740aacf0 msgr2=0x7f1f740ab0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:25.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.930+0000 7f1f79a00640 1 -- 172.21.15.8:0/3290114695 shutdown_connections 2024-03-23T23:58:25.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:25.930+0000 7f1f79a00640 1 -- 172.21.15.8:0/3290114695 wait complete. 2024-03-23T23:58:25.957 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-03-23T23:58:26.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.098+0000 7f2ed2a00640 1 Processor -- start 2024-03-23T23:58:26.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.102+0000 7f2ed2a00640 1 -- start start 2024-03-23T23:58:26.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.102+0000 7f2ed2a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ecc152ff0 0x7f2ecc0714f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.102+0000 7f2ed2a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2ecc0c2390 0x7f2ecc0c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.102+0000 7f2ed2a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ecc159dd0 con 0x7f2ecc159860 2024-03-23T23:58:26.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.102+0000 7f2ed2a00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ecc0701f0 con 0x7f2ecc0c2390 2024-03-23T23:58:26.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.102+0000 7f2ed2a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc0704d0 con 0x7f2ecc152ff0 2024-03-23T23:58:26.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.102+0000 7f2ed0a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2ecc0c2390 0x7f2ecc0c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.102+0000 7f2ecbe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ecc152ff0 0x7f2ecc0714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.102+0000 7f2ec3e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f2ecc159860 0x7f2ecc06ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:35392/0 (socket says 172.21.15.8:35392) 2024-03-23T23:58:26.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.102+0000 7f2ec3e00640 1 -- 172.21.15.8:0/722724534 learned_addr learned my addr 172.21.15.8:0/722724534 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:58:26.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.102+0000 7f2ed0a00640 1 -- 172.21.15.8:0/722724534 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ecc152ff0 msgr2=0x7f2ecc0714f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:26.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.102+0000 7f2ed0a00640 1 --2- 172.21.15.8:0/722724534 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ecc152ff0 0x7f2ecc0714f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.102+0000 7f2ed0a00640 1 -- 172.21.15.8:0/722724534 >> v1:172.21.15.8:6789/0 conn(0x7f2ecc159860 legacy=0x7f2ecc06ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.102+0000 7f2ed0a00640 1 -- 172.21.15.8:0/722724534 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ecc0707b0 con 0x7f2ecc0c2390 2024-03-23T23:58:26.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.106+0000 7f2ed0a00640 1 --2- 172.21.15.8:0/722724534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ecc0c2390 0x7f2ecc0c2800 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4009d90 tx=0x7f2ec401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=843927d7f7eb5f9c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:26.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.106+0000 7f2ecb400640 1 -- 172.21.15.8:0/722724534 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec40b2070 con 0x7f2ecc0c2390 2024-03-23T23:58:26.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.106+0000 7f2ecb400640 1 -- 172.21.15.8:0/722724534 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec40a57a0 con 0x7f2ecc0c2390 2024-03-23T23:58:26.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.106+0000 7f2ecb400640 1 -- 172.21.15.8:0/722724534 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec40a5b70 con 0x7f2ecc0c2390 2024-03-23T23:58:26.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.106+0000 7f2ed2a00640 1 -- 172.21.15.8:0/722724534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ecc0c2390 msgr2=0x7f2ecc0c2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.106+0000 7f2ed2a00640 1 --2- 172.21.15.8:0/722724534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ecc0c2390 0x7f2ecc0c2800 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4009d90 tx=0x7f2ec401c8e0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.106+0000 7f2ed2a00640 1 -- 172.21.15.8:0/722724534 shutdown_connections 2024-03-23T23:58:26.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.106+0000 7f2ed2a00640 1 --2- 172.21.15.8:0/722724534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ecc0c2390 0x7f2ecc0c2800 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.106+0000 7f2ed2a00640 1 --2- 172.21.15.8:0/722724534 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ecc152ff0 0x7f2ecc0714f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.106+0000 7f2ed2a00640 1 -- 172.21.15.8:0/722724534 >> 172.21.15.8:0/722724534 conn(0x7f2ecc0aad10 msgr2=0x7f2ecc0ab120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:26.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.106+0000 7f2ed2a00640 1 -- 172.21.15.8:0/722724534 shutdown_connections 2024-03-23T23:58:26.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.106+0000 7f2ed2a00640 1 -- 172.21.15.8:0/722724534 wait complete. 2024-03-23T23:58:26.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.110+0000 7f2ed2a00640 1 Processor -- start 2024-03-23T23:58:26.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.110+0000 7f2ed2a00640 1 -- start start 2024-03-23T23:58:26.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.110+0000 7f2ed2a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ecc0c2390 0x7f2ecc14bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.110+0000 7f2ed2a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ecc152ff0 0x7f2ecc06d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.110+0000 7f2ed2a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ecc159860 0x7f2ecc06c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.110+0000 7f2ed2a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc0c75a0 con 0x7f2ecc0c2390 2024-03-23T23:58:26.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.110+0000 7f2ed2a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc0c7420 con 0x7f2ecc152ff0 2024-03-23T23:58:26.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.110+0000 7f2ed2a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc162a00 con 0x7f2ecc159860 2024-03-23T23:58:26.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.110+0000 7f2ecbe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ecc0c2390 0x7f2ecc14bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.110+0000 7f2ecbe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ecc0c2390 0x7f2ecc14bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58556/0 (socket says 172.21.15.8:58556) 2024-03-23T23:58:26.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.110+0000 7f2ecbe00640 1 -- 172.21.15.8:0/3850117640 learned_addr learned my addr 172.21.15.8:0/3850117640 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:26.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.110+0000 7f2ed0a00640 1 --2- 172.21.15.8:0/3850117640 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ecc159860 0x7f2ecc06c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.110+0000 7f2ec3e00640 1 --2- 172.21.15.8:0/3850117640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ecc152ff0 0x7f2ecc06d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.110+0000 7f2ecbe00640 1 -- 172.21.15.8:0/3850117640 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ecc159860 msgr2=0x7f2ecc06c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.110+0000 7f2ecbe00640 1 --2- 172.21.15.8:0/3850117640 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ecc159860 0x7f2ecc06c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.110+0000 7f2ecbe00640 1 -- 172.21.15.8:0/3850117640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ecc152ff0 msgr2=0x7f2ecc06d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.110+0000 7f2ecbe00640 1 --2- 172.21.15.8:0/3850117640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ecc152ff0 0x7f2ecc06d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.110+0000 7f2ecbe00640 1 -- 172.21.15.8:0/3850117640 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ecc1f1c50 con 0x7f2ecc0c2390 2024-03-23T23:58:26.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.110+0000 7f2ecbe00640 1 --2- 172.21.15.8:0/3850117640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ecc0c2390 0x7f2ecc14bf20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc00e960 tx=0x7f2ebc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:26.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.110+0000 7f2ec8c00640 1 -- 172.21.15.8:0/3850117640 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc017070 con 0x7f2ecc0c2390 2024-03-23T23:58:26.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.110+0000 7f2ec8c00640 1 -- 172.21.15.8:0/3850117640 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ebc00ca00 con 0x7f2ecc0c2390 2024-03-23T23:58:26.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.110+0000 7f2ed2a00640 1 -- 172.21.15.8:0/3850117640 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ecc14b3b0 con 0x7f2ecc0c2390 2024-03-23T23:58:26.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.110+0000 7f2ec8c00640 1 -- 172.21.15.8:0/3850117640 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc00cdb0 con 0x7f2ecc0c2390 2024-03-23T23:58:26.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.110+0000 7f2ed2a00640 1 -- 172.21.15.8:0/3850117640 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ecc1f21d0 con 0x7f2ecc0c2390 2024-03-23T23:58:26.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.110+0000 7f2ed2a00640 1 -- 172.21.15.8:0/3850117640 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ecc04f410 con 0x7f2ecc0c2390 2024-03-23T23:58:26.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.114+0000 7f2ec8c00640 1 -- 172.21.15.8:0/3850117640 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f2ebc01a070 con 0x7f2ecc0c2390 2024-03-23T23:58:26.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.114+0000 7f2ec8c00640 1 --2- 172.21.15.8:0/3850117640 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2ea8067660 0x7f2ea8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.114+0000 7f2ec8c00640 1 -- 172.21.15.8:0/3850117640 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f2ebc085cb0 con 0x7f2ecc0c2390 2024-03-23T23:58:26.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.114+0000 7f2ec3e00640 1 --2- 172.21.15.8:0/3850117640 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2ea8067660 0x7f2ea8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.114+0000 7f2ec3e00640 1 --2- 172.21.15.8:0/3850117640 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2ea8067660 0x7f2ea8069b20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc06f110 tx=0x7f2eb4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:26.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.118+0000 7f2ec8c00640 1 -- 172.21.15.8:0/3850117640 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f2ebc055e80 con 0x7f2ecc0c2390 2024-03-23T23:58:26.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.358+0000 7f2ed2a00640 1 -- 172.21.15.8:0/3850117640 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7f2ecc06b590 con 0x7f2ecc0c2390 2024-03-23T23:58:26.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.358+0000 7f2ec8c00640 1 -- 172.21.15.8:0/3850117640 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v27) v1 ==== 95+0+11 (secure 0 0 0) 0x7f2ebc059f20 con 0x7f2ecc0c2390 2024-03-23T23:58:26.361 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-03-23T23:58:26.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.362+0000 7f2ed2a00640 1 -- 172.21.15.8:0/3850117640 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2ea8067660 msgr2=0x7f2ea8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.362+0000 7f2ed2a00640 1 --2- 172.21.15.8:0/3850117640 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2ea8067660 0x7f2ea8069b20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc06f110 tx=0x7f2eb4009040 comp rx=0 tx=0).stop 2024-03-23T23:58:26.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.362+0000 7f2ed2a00640 1 -- 172.21.15.8:0/3850117640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ecc0c2390 msgr2=0x7f2ecc14bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.362+0000 7f2ed2a00640 1 --2- 172.21.15.8:0/3850117640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ecc0c2390 0x7f2ecc14bf20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc00e960 tx=0x7f2ebc00ee20 comp rx=0 tx=0).stop 2024-03-23T23:58:26.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.362+0000 7f2ed2a00640 1 -- 172.21.15.8:0/3850117640 shutdown_connections 2024-03-23T23:58:26.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.362+0000 7f2ed2a00640 1 --2- 172.21.15.8:0/3850117640 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2ea8067660 0x7f2ea8069b20 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.362+0000 7f2ed2a00640 1 --2- 172.21.15.8:0/3850117640 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ecc159860 0x7f2ecc06c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.362+0000 7f2ed2a00640 1 --2- 172.21.15.8:0/3850117640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ecc152ff0 0x7f2ecc06d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.362+0000 7f2ed2a00640 1 --2- 172.21.15.8:0/3850117640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ecc0c2390 0x7f2ecc14bf20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.362+0000 7f2ed2a00640 1 -- 172.21.15.8:0/3850117640 >> 172.21.15.8:0/3850117640 conn(0x7f2ecc0aad10 msgr2=0x7f2ecc15f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:26.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.362+0000 7f2ed2a00640 1 -- 172.21.15.8:0/3850117640 shutdown_connections 2024-03-23T23:58:26.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.362+0000 7f2ed2a00640 1 -- 172.21.15.8:0/3850117640 wait complete. 2024-03-23T23:58:26.383 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-03-23T23:58:26.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.526+0000 7f7eab200640 1 Processor -- start 2024-03-23T23:58:26.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.526+0000 7f7eab200640 1 -- start start 2024-03-23T23:58:26.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.526+0000 7f7eab200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ea40a9500 0x7f7ea406dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.526+0000 7f7eab200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea406fb50 con 0x7f7ea40c3080 2024-03-23T23:58:26.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.526+0000 7f7eab200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea414c9c0 con 0x7f7ea414c5e0 2024-03-23T23:58:26.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.526+0000 7f7eab200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea4156ae0 con 0x7f7ea40a9500 2024-03-23T23:58:26.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.526+0000 7f7ea9200640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f7ea40c3080 0x7f7ea4155b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:35402/0 (socket says 172.21.15.8:35402) 2024-03-23T23:58:26.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.526+0000 7f7ea9200640 1 -- 172.21.15.8:0/2432040439 learned_addr learned my addr 172.21.15.8:0/2432040439 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:58:26.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.526+0000 7f7e9b400640 1 --2- 172.21.15.8:0/2432040439 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ea40a9500 0x7f7ea406dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.526+0000 7f7ea3400640 1 -- 172.21.15.8:0/2432040439 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3233812187 0 0) 0x7f7ea406fb50 con 0x7f7ea40c3080 2024-03-23T23:58:26.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.526+0000 7f7ea3400640 1 -- 172.21.15.8:0/2432040439 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e88005740 con 0x7f7ea40c3080 2024-03-23T23:58:26.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.526+0000 7f7ea3400640 1 -- 172.21.15.8:0/2432040439 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 472872860 0 0) 0x7f7ea414c9c0 con 0x7f7ea414c5e0 2024-03-23T23:58:26.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.530+0000 7f7ea3400640 1 -- 172.21.15.8:0/2432040439 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ea406fb50 con 0x7f7ea414c5e0 2024-03-23T23:58:26.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.530+0000 7f7e9b400640 1 -- 172.21.15.8:0/2432040439 >> v1:172.21.15.196:6789/0 conn(0x7f7ea414c5e0 legacy=0x7f7ea40c2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.530+0000 7f7e9b400640 1 -- 172.21.15.8:0/2432040439 >> v1:172.21.15.8:6789/0 conn(0x7f7ea40c3080 legacy=0x7f7ea4155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.530+0000 7f7e9b400640 1 -- 172.21.15.8:0/2432040439 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea4156800 con 0x7f7ea40a9500 2024-03-23T23:58:26.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.530+0000 7f7e9b400640 1 --2- 172.21.15.8:0/2432040439 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ea40a9500 0x7f7ea406dfd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c0097f0 tx=0x7f7e8c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3597e93e3a7bc10 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:26.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.530+0000 7f7ea3400640 1 -- 172.21.15.8:0/2432040439 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c0b0070 con 0x7f7ea40a9500 2024-03-23T23:58:26.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.530+0000 7f7ea3400640 1 -- 172.21.15.8:0/2432040439 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c0ab600 con 0x7f7ea40a9500 2024-03-23T23:58:26.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.530+0000 7f7ea3400640 1 -- 172.21.15.8:0/2432040439 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c0ab9d0 con 0x7f7ea40a9500 2024-03-23T23:58:26.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.530+0000 7f7eab200640 1 -- 172.21.15.8:0/2432040439 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ea40a9500 msgr2=0x7f7ea406dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.530+0000 7f7eab200640 1 --2- 172.21.15.8:0/2432040439 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ea40a9500 0x7f7ea406dfd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c0097f0 tx=0x7f7e8c01c450 comp rx=0 tx=0).stop 2024-03-23T23:58:26.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.530+0000 7f7eab200640 1 -- 172.21.15.8:0/2432040439 shutdown_connections 2024-03-23T23:58:26.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.530+0000 7f7eab200640 1 --2- 172.21.15.8:0/2432040439 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ea40a9500 0x7f7ea406dfd0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.530+0000 7f7eab200640 1 -- 172.21.15.8:0/2432040439 >> 172.21.15.8:0/2432040439 conn(0x7f7ea40c4a70 msgr2=0x7f7ea40c4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:26.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.534+0000 7f7eab200640 1 -- 172.21.15.8:0/2432040439 shutdown_connections 2024-03-23T23:58:26.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.534+0000 7f7eab200640 1 -- 172.21.15.8:0/2432040439 wait complete. 2024-03-23T23:58:26.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.534+0000 7f7eab200640 1 Processor -- start 2024-03-23T23:58:26.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.534+0000 7f7eab200640 1 -- start start 2024-03-23T23:58:26.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.534+0000 7f7eab200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ea40a9500 0x7f7ea41ef4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.534+0000 7f7eab200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ea40c3080 0x7f7ea41f2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.534+0000 7f7eab200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ea414c5e0 0x7f7ea41438a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.534+0000 7f7eab200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea406bdd0 con 0x7f7ea414c5e0 2024-03-23T23:58:26.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.534+0000 7f7eab200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea406bc50 con 0x7f7ea40c3080 2024-03-23T23:58:26.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.534+0000 7f7eab200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea406bf50 con 0x7f7ea40a9500 2024-03-23T23:58:26.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.534+0000 7f7ea9200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ea414c5e0 0x7f7ea41438a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.534+0000 7f7ea3e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ea40a9500 0x7f7ea41ef4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.534+0000 7f7e9b400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ea40c3080 0x7f7ea41f2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.534+0000 7f7ea9200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ea414c5e0 0x7f7ea41438a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58562/0 (socket says 172.21.15.8:58562) 2024-03-23T23:58:26.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.534+0000 7f7e9b400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ea40c3080 0x7f7ea41f2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:56438/0 (socket says 172.21.15.8:56438) 2024-03-23T23:58:26.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.534+0000 7f7ea9200640 1 -- 172.21.15.8:0/360487822 learned_addr learned my addr 172.21.15.8:0/360487822 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:26.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.534+0000 7f7e9b400640 1 -- 172.21.15.8:0/360487822 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ea40a9500 msgr2=0x7f7ea41ef4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.534+0000 7f7e9b400640 1 --2- 172.21.15.8:0/360487822 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ea40a9500 0x7f7ea41ef4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.534+0000 7f7e9b400640 1 -- 172.21.15.8:0/360487822 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ea414c5e0 msgr2=0x7f7ea41438a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.534+0000 7f7e9b400640 1 --2- 172.21.15.8:0/360487822 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ea414c5e0 0x7f7ea41438a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.534+0000 7f7e9b400640 1 -- 172.21.15.8:0/360487822 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea41551a0 con 0x7f7ea40c3080 2024-03-23T23:58:26.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.534+0000 7f7ea9200640 1 --2- 172.21.15.8:0/360487822 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ea414c5e0 0x7f7ea41438a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:58:26.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.534+0000 7f7e9b400640 1 --2- 172.21.15.8:0/360487822 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ea40c3080 0x7f7ea41f2900 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c0ab000 tx=0x7f7e8c0191f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:26.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.538+0000 7f7ea0c00640 1 -- 172.21.15.8:0/360487822 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c0b0040 con 0x7f7ea40c3080 2024-03-23T23:58:26.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.538+0000 7f7ea0c00640 1 -- 172.21.15.8:0/360487822 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c0b9070 con 0x7f7ea40c3080 2024-03-23T23:58:26.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.538+0000 7f7ea0c00640 1 -- 172.21.15.8:0/360487822 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c0b4670 con 0x7f7ea40c3080 2024-03-23T23:58:26.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.538+0000 7f7eab200640 1 -- 172.21.15.8:0/360487822 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea4155480 con 0x7f7ea40c3080 2024-03-23T23:58:26.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.538+0000 7f7eab200640 1 -- 172.21.15.8:0/360487822 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea4143de0 con 0x7f7ea40c3080 2024-03-23T23:58:26.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.538+0000 7f7eab200640 1 -- 172.21.15.8:0/360487822 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ea404f410 con 0x7f7ea40c3080 2024-03-23T23:58:26.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.538+0000 7f7ea0c00640 1 -- 172.21.15.8:0/360487822 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f7e8c0b4810 con 0x7f7ea40c3080 2024-03-23T23:58:26.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.538+0000 7f7ea0c00640 1 --2- 172.21.15.8:0/360487822 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7e80067690 0x7f7e80069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.538+0000 7f7ea0c00640 1 -- 172.21.15.8:0/360487822 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f7e8c11f740 con 0x7f7ea40c3080 2024-03-23T23:58:26.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.538+0000 7f7ea3e00640 1 --2- 172.21.15.8:0/360487822 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7e80067690 0x7f7e80069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.542+0000 7f7ea3e00640 1 --2- 172.21.15.8:0/360487822 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7e80067690 0x7f7e80069b50 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7e940011f0 tx=0x7f7e94009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:26.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.550+0000 7f7ea0c00640 1 -- 172.21.15.8:0/360487822 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f7e8c0160d0 con 0x7f7ea40c3080 2024-03-23T23:58:26.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.714+0000 7f7eab200640 1 -- 172.21.15.8:0/360487822 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7ea40aa660 con 0x7f7ea40c3080 2024-03-23T23:58:26.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.714+0000 7f7ea0c00640 1 -- 172.21.15.8:0/360487822 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v27) v1 ==== 99+0+11 (secure 0 0 0) 0x7f7e8c0ef910 con 0x7f7ea40c3080 2024-03-23T23:58:26.714 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-03-23T23:58:26.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.714+0000 7f7eab200640 1 -- 172.21.15.8:0/360487822 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7e80067690 msgr2=0x7f7e80069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.714+0000 7f7eab200640 1 --2- 172.21.15.8:0/360487822 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7e80067690 0x7f7e80069b50 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7e940011f0 tx=0x7f7e94009040 comp rx=0 tx=0).stop 2024-03-23T23:58:26.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.714+0000 7f7eab200640 1 -- 172.21.15.8:0/360487822 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ea40c3080 msgr2=0x7f7ea41f2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.714+0000 7f7eab200640 1 --2- 172.21.15.8:0/360487822 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ea40c3080 0x7f7ea41f2900 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c0ab000 tx=0x7f7e8c0191f0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.714+0000 7f7eab200640 1 -- 172.21.15.8:0/360487822 shutdown_connections 2024-03-23T23:58:26.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.714+0000 7f7eab200640 1 --2- 172.21.15.8:0/360487822 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ea414c5e0 0x7f7ea41438a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.714+0000 7f7eab200640 1 --2- 172.21.15.8:0/360487822 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ea40c3080 0x7f7ea41f2900 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.714+0000 7f7eab200640 1 --2- 172.21.15.8:0/360487822 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7e80067690 0x7f7e80069b50 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.714+0000 7f7eab200640 1 --2- 172.21.15.8:0/360487822 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ea40a9500 0x7f7ea41ef4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.714+0000 7f7eab200640 1 -- 172.21.15.8:0/360487822 >> 172.21.15.8:0/360487822 conn(0x7f7ea40c4a70 msgr2=0x7f7ea414b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:26.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.714+0000 7f7eab200640 1 -- 172.21.15.8:0/360487822 shutdown_connections 2024-03-23T23:58:26.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.714+0000 7f7eab200640 1 -- 172.21.15.8:0/360487822 wait complete. 2024-03-23T23:58:26.735 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-03-23T23:58:26.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.878+0000 7f2072a00640 1 Processor -- start 2024-03-23T23:58:26.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.878+0000 7f2072a00640 1 -- start start 2024-03-23T23:58:26.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.878+0000 7f2072a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f206c159860 0x7f206c0714f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.878+0000 7f2072a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f206c0c2390 0x7f206c0c2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.878+0000 7f2072a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f206c159dd0 con 0x7f206c152ff0 2024-03-23T23:58:26.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.878+0000 7f2072a00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f206c0701f0 con 0x7f206c0c2390 2024-03-23T23:58:26.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.878+0000 7f2072a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f206c0704d0 con 0x7f206c159860 2024-03-23T23:58:26.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.878+0000 7f2070a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f206c0c2390 0x7f206c0c2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.878+0000 7f2063e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f206c159860 0x7f206c0714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.878+0000 7f206be00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f206c152ff0 0x7f206c06ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:44338/0 (socket says 172.21.15.8:44338) 2024-03-23T23:58:26.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.878+0000 7f2070a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f206c0c2390 0x7f206c0c2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58568/0 (socket says 172.21.15.8:58568) 2024-03-23T23:58:26.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.878+0000 7f206be00640 1 -- 172.21.15.8:0/685368749 learned_addr learned my addr 172.21.15.8:0/685368749 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:58:26.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.878+0000 7f2070a00640 1 -- 172.21.15.8:0/685368749 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f206c159860 msgr2=0x7f206c0714f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:26.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.878+0000 7f2070a00640 1 --2- 172.21.15.8:0/685368749 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f206c159860 0x7f206c0714f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.878+0000 7f2070a00640 1 -- 172.21.15.8:0/685368749 >> v1:172.21.15.196:6789/0 conn(0x7f206c152ff0 legacy=0x7f206c06ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.878+0000 7f206b400640 1 -- 172.21.15.8:0/685368749 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 704445918 0 0) 0x7f206c159dd0 con 0x7f206c152ff0 2024-03-23T23:58:26.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.878+0000 7f2070a00640 1 -- 172.21.15.8:0/685368749 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f206c0707b0 con 0x7f206c0c2390 2024-03-23T23:58:26.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.878+0000 7f2063e00640 1 --2- 172.21.15.8:0/685368749 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f206c159860 0x7f206c0714f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:58:26.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.886+0000 7f2070a00640 1 --2- 172.21.15.8:0/685368749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f206c0c2390 0x7f206c0c2820 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2064009d90 tx=0x7f206401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e926c1fa3a7b034 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:26.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.886+0000 7f206b400640 1 -- 172.21.15.8:0/685368749 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20640b2070 con 0x7f206c0c2390 2024-03-23T23:58:26.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.886+0000 7f206b400640 1 -- 172.21.15.8:0/685368749 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20640a57a0 con 0x7f206c0c2390 2024-03-23T23:58:26.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.886+0000 7f206b400640 1 -- 172.21.15.8:0/685368749 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20640a5b70 con 0x7f206c0c2390 2024-03-23T23:58:26.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.886+0000 7f2072a00640 1 -- 172.21.15.8:0/685368749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f206c0c2390 msgr2=0x7f206c0c2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.886+0000 7f2072a00640 1 --2- 172.21.15.8:0/685368749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f206c0c2390 0x7f206c0c2820 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2064009d90 tx=0x7f206401c8e0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.886+0000 7f2072a00640 1 -- 172.21.15.8:0/685368749 shutdown_connections 2024-03-23T23:58:26.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.886+0000 7f2072a00640 1 --2- 172.21.15.8:0/685368749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f206c0c2390 0x7f206c0c2820 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.886+0000 7f2072a00640 1 --2- 172.21.15.8:0/685368749 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f206c159860 0x7f206c0714f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.886+0000 7f2072a00640 1 -- 172.21.15.8:0/685368749 >> 172.21.15.8:0/685368749 conn(0x7f206c0aad10 msgr2=0x7f206c0ab120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:26.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.886+0000 7f2072a00640 1 -- 172.21.15.8:0/685368749 shutdown_connections 2024-03-23T23:58:26.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.886+0000 7f2072a00640 1 -- 172.21.15.8:0/685368749 wait complete. 2024-03-23T23:58:26.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.886+0000 7f2072a00640 1 Processor -- start 2024-03-23T23:58:26.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.886+0000 7f2072a00640 1 -- start start 2024-03-23T23:58:26.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.890+0000 7f2072a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f206c0c2390 0x7f206c153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.890+0000 7f2072a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f206c152ff0 0x7f206c14cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.890+0000 7f2072a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f206c159860 0x7f206c151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.890+0000 7f2072a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c0c75a0 con 0x7f206c159860 2024-03-23T23:58:26.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.890+0000 7f2072a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c0c7420 con 0x7f206c0c2390 2024-03-23T23:58:26.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.890+0000 7f2072a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f206c162a00 con 0x7f206c152ff0 2024-03-23T23:58:26.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.890+0000 7f2070a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f206c159860 0x7f206c151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.890+0000 7f2070a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f206c159860 0x7f206c151d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58570/0 (socket says 172.21.15.8:58570) 2024-03-23T23:58:26.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.890+0000 7f2070a00640 1 -- 172.21.15.8:0/1835021855 learned_addr learned my addr 172.21.15.8:0/1835021855 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:26.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.890+0000 7f2063e00640 1 --2- 172.21.15.8:0/1835021855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f206c152ff0 0x7f206c14cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.890+0000 7f206be00640 1 --2- 172.21.15.8:0/1835021855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f206c0c2390 0x7f206c153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.890+0000 7f2070a00640 1 -- 172.21.15.8:0/1835021855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f206c152ff0 msgr2=0x7f206c14cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.890+0000 7f2070a00640 1 --2- 172.21.15.8:0/1835021855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f206c152ff0 0x7f206c14cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.890+0000 7f2070a00640 1 -- 172.21.15.8:0/1835021855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f206c0c2390 msgr2=0x7f206c153940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.890+0000 7f2070a00640 1 --2- 172.21.15.8:0/1835021855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f206c0c2390 0x7f206c153940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.890+0000 7f2070a00640 1 -- 172.21.15.8:0/1835021855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f206c14d050 con 0x7f206c159860 2024-03-23T23:58:26.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.890+0000 7f2070a00640 1 --2- 172.21.15.8:0/1835021855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f206c159860 0x7f206c151d40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f206401af90 tx=0x7f2064019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:26.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.890+0000 7f2068c00640 1 -- 172.21.15.8:0/1835021855 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20640bd020 con 0x7f206c159860 2024-03-23T23:58:26.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.890+0000 7f2068c00640 1 -- 172.21.15.8:0/1835021855 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20640b8470 con 0x7f206c159860 2024-03-23T23:58:26.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.890+0000 7f2068c00640 1 -- 172.21.15.8:0/1835021855 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20640b2040 con 0x7f206c159860 2024-03-23T23:58:26.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.890+0000 7f2072a00640 1 -- 172.21.15.8:0/1835021855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f206c14c0d0 con 0x7f206c159860 2024-03-23T23:58:26.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.890+0000 7f2072a00640 1 -- 172.21.15.8:0/1835021855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f206c152a00 con 0x7f206c159860 2024-03-23T23:58:26.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.890+0000 7f2072a00640 1 -- 172.21.15.8:0/1835021855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f206c04f410 con 0x7f206c159860 2024-03-23T23:58:26.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.894+0000 7f2068c00640 1 -- 172.21.15.8:0/1835021855 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f20640c0020 con 0x7f206c159860 2024-03-23T23:58:26.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.894+0000 7f2068c00640 1 --2- 172.21.15.8:0/1835021855 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2048067660 0x7f2048069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.894+0000 7f2068c00640 1 -- 172.21.15.8:0/1835021855 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f2064120890 con 0x7f206c159860 2024-03-23T23:58:26.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.894+0000 7f206be00640 1 --2- 172.21.15.8:0/1835021855 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2048067660 0x7f2048069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.894+0000 7f206be00640 1 --2- 172.21.15.8:0/1835021855 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2048067660 0x7f2048069b20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f205c007fd0 tx=0x7f205c007d60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:26.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:26.898+0000 7f2068c00640 1 -- 172.21.15.8:0/1835021855 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f20640c7030 con 0x7f206c159860 2024-03-23T23:58:27.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.058+0000 7f2072a00640 1 -- 172.21.15.8:0/1835021855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) v1 -- 0x7f206c152c60 con 0x7f206c159860 2024-03-23T23:58:27.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.058+0000 7f2068c00640 1 -- 172.21.15.8:0/1835021855 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v27) v1 ==== 95+0+11 (secure 0 0 0) 0x7f2064016560 con 0x7f206c159860 2024-03-23T23:58:27.061 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-03-23T23:58:27.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.062+0000 7f2072a00640 1 -- 172.21.15.8:0/1835021855 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2048067660 msgr2=0x7f2048069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:27.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.062+0000 7f2072a00640 1 --2- 172.21.15.8:0/1835021855 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2048067660 0x7f2048069b20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f205c007fd0 tx=0x7f205c007d60 comp rx=0 tx=0).stop 2024-03-23T23:58:27.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.062+0000 7f2072a00640 1 -- 172.21.15.8:0/1835021855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f206c159860 msgr2=0x7f206c151d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:27.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.062+0000 7f2072a00640 1 --2- 172.21.15.8:0/1835021855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f206c159860 0x7f206c151d40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f206401af90 tx=0x7f2064019680 comp rx=0 tx=0).stop 2024-03-23T23:58:27.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.062+0000 7f2072a00640 1 -- 172.21.15.8:0/1835021855 shutdown_connections 2024-03-23T23:58:27.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.062+0000 7f2072a00640 1 --2- 172.21.15.8:0/1835021855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f206c159860 0x7f206c151d40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.062+0000 7f2072a00640 1 --2- 172.21.15.8:0/1835021855 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2048067660 0x7f2048069b20 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.062+0000 7f2072a00640 1 --2- 172.21.15.8:0/1835021855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f206c152ff0 0x7f206c14cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.062+0000 7f2072a00640 1 --2- 172.21.15.8:0/1835021855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f206c0c2390 0x7f206c153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.062+0000 7f2072a00640 1 -- 172.21.15.8:0/1835021855 >> 172.21.15.8:0/1835021855 conn(0x7f206c0aad10 msgr2=0x7f206c0a9ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:27.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.062+0000 7f2072a00640 1 -- 172.21.15.8:0/1835021855 shutdown_connections 2024-03-23T23:58:27.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.062+0000 7f2072a00640 1 -- 172.21.15.8:0/1835021855 wait complete. 2024-03-23T23:58:27.082 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-23T23:58:27.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.226+0000 7f4b34800640 1 Processor -- start 2024-03-23T23:58:27.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.226+0000 7f4b34800640 1 -- start start 2024-03-23T23:58:27.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.226+0000 7f4b34800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4b2c156ee0 0x7f4b2c073230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.226+0000 7f4b34800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4b2c149bd0 0x7f4b2c14a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.226+0000 7f4b34800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b2c0ac270 0x7f4b2c0ac6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.226+0000 7f4b34800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2c073770 con 0x7f4b2c156ee0 2024-03-23T23:58:27.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.226+0000 7f4b34800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2c14a5a0 con 0x7f4b2c149bd0 2024-03-23T23:58:27.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.226+0000 7f4b34800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c0aa390 con 0x7f4b2c0ac270 2024-03-23T23:58:27.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.230+0000 7f4b31e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4b2c156ee0 0x7f4b2c073230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.230+0000 7f4b31e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4b2c156ee0 0x7f4b2c073230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58576/0 (socket says 172.21.15.8:58576) 2024-03-23T23:58:27.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.230+0000 7f4b31e00640 1 -- 172.21.15.8:0/2240611770 learned_addr learned my addr 172.21.15.8:0/2240611770 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:27.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.230+0000 7f4b32800640 1 --2- 172.21.15.8:0/2240611770 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b2c0ac270 0x7f4b2c0ac6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.230+0000 7f4b31400640 1 --2- 172.21.15.8:0/2240611770 >> v2:172.21.15.196:3300/0 conn(0x7f4b2c149bd0 0x7f4b2c14a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.230+0000 7f4b31e00640 1 -- 172.21.15.8:0/2240611770 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b2c0ac270 msgr2=0x7f4b2c0ac6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:27.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.230+0000 7f4b31e00640 1 --2- 172.21.15.8:0/2240611770 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b2c0ac270 0x7f4b2c0ac6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.230+0000 7f4b31e00640 1 -- 172.21.15.8:0/2240611770 >> v2:172.21.15.196:3300/0 conn(0x7f4b2c149bd0 msgr2=0x7f4b2c14a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:27.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.230+0000 7f4b31e00640 1 --2- 172.21.15.8:0/2240611770 >> v2:172.21.15.196:3300/0 conn(0x7f4b2c149bd0 0x7f4b2c14a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.230+0000 7f4b31e00640 1 -- 172.21.15.8:0/2240611770 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c06e720 con 0x7f4b2c156ee0 2024-03-23T23:58:27.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.234+0000 7f4b31e00640 1 --2- 172.21.15.8:0/2240611770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b2c156ee0 0x7f4b2c073230 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c1514a0 tx=0x7f4b2001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49712d99a50e0ccd server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:27.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.234+0000 7f4b30a00640 1 -- 172.21.15.8:0/2240611770 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b200ab640 con 0x7f4b2c156ee0 2024-03-23T23:58:27.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.234+0000 7f4b30a00640 1 -- 172.21.15.8:0/2240611770 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b200b0070 con 0x7f4b2c156ee0 2024-03-23T23:58:27.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.234+0000 7f4b30a00640 1 -- 172.21.15.8:0/2240611770 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b200aba00 con 0x7f4b2c156ee0 2024-03-23T23:58:27.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.234+0000 7f4b34800640 1 -- 172.21.15.8:0/2240611770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b2c156ee0 msgr2=0x7f4b2c073230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:27.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.234+0000 7f4b34800640 1 --2- 172.21.15.8:0/2240611770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b2c156ee0 0x7f4b2c073230 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c1514a0 tx=0x7f4b2001c460 comp rx=0 tx=0).stop 2024-03-23T23:58:27.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.234+0000 7f4b34800640 1 -- 172.21.15.8:0/2240611770 shutdown_connections 2024-03-23T23:58:27.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.234+0000 7f4b34800640 1 --2- 172.21.15.8:0/2240611770 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b2c0ac270 0x7f4b2c0ac6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.234+0000 7f4b34800640 1 --2- 172.21.15.8:0/2240611770 >> v2:172.21.15.196:3300/0 conn(0x7f4b2c149bd0 0x7f4b2c14a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.234+0000 7f4b34800640 1 --2- 172.21.15.8:0/2240611770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b2c156ee0 0x7f4b2c073230 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.234+0000 7f4b34800640 1 -- 172.21.15.8:0/2240611770 >> 172.21.15.8:0/2240611770 conn(0x7f4b2c06b170 msgr2=0x7f4b2c06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:27.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.234+0000 7f4b34800640 1 -- 172.21.15.8:0/2240611770 shutdown_connections 2024-03-23T23:58:27.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.234+0000 7f4b34800640 1 -- 172.21.15.8:0/2240611770 wait complete. 2024-03-23T23:58:27.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.234+0000 7f4b34800640 1 Processor -- start 2024-03-23T23:58:27.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.234+0000 7f4b34800640 1 -- start start 2024-03-23T23:58:27.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.238+0000 7f4b34800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4b2c0ac270 0x7f4b2c14dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.238+0000 7f4b34800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b2c149bd0 0x7f4b2c13fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.238+0000 7f4b34800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b2c156ee0 0x7f4b2c1ef2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.238+0000 7f4b34800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c157870 con 0x7f4b2c156ee0 2024-03-23T23:58:27.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.238+0000 7f4b34800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c0aa930 con 0x7f4b2c0ac270 2024-03-23T23:58:27.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.238+0000 7f4b34800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c1579f0 con 0x7f4b2c149bd0 2024-03-23T23:58:27.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.238+0000 7f4b32800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b2c156ee0 0x7f4b2c1ef2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.238+0000 7f4b32800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b2c156ee0 0x7f4b2c1ef2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58590/0 (socket says 172.21.15.8:58590) 2024-03-23T23:58:27.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.238+0000 7f4b32800640 1 -- 172.21.15.8:0/2256476723 learned_addr learned my addr 172.21.15.8:0/2256476723 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:27.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.238+0000 7f4b31e00640 1 --2- 172.21.15.8:0/2256476723 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4b2c0ac270 0x7f4b2c14dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.238+0000 7f4b31400640 1 --2- 172.21.15.8:0/2256476723 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b2c149bd0 0x7f4b2c13fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.238+0000 7f4b32800640 1 -- 172.21.15.8:0/2256476723 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b2c149bd0 msgr2=0x7f4b2c13fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:27.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.238+0000 7f4b32800640 1 --2- 172.21.15.8:0/2256476723 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b2c149bd0 0x7f4b2c13fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.238+0000 7f4b32800640 1 -- 172.21.15.8:0/2256476723 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4b2c0ac270 msgr2=0x7f4b2c14dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:27.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.238+0000 7f4b32800640 1 --2- 172.21.15.8:0/2256476723 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4b2c0ac270 0x7f4b2c14dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.238+0000 7f4b32800640 1 -- 172.21.15.8:0/2256476723 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c141a30 con 0x7f4b2c156ee0 2024-03-23T23:58:27.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.238+0000 7f4b32800640 1 --2- 172.21.15.8:0/2256476723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b2c156ee0 0x7f4b2c1ef2a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4b2800ef00 tx=0x7f4b2800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:27.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.238+0000 7f4b26000640 1 -- 172.21.15.8:0/2256476723 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b28018020 con 0x7f4b2c156ee0 2024-03-23T23:58:27.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.238+0000 7f4b26000640 1 -- 172.21.15.8:0/2256476723 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2800bd20 con 0x7f4b2c156ee0 2024-03-23T23:58:27.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.238+0000 7f4b34800640 1 -- 172.21.15.8:0/2256476723 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2c14fdb0 con 0x7f4b2c156ee0 2024-03-23T23:58:27.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.238+0000 7f4b26000640 1 -- 172.21.15.8:0/2256476723 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b28014640 con 0x7f4b2c156ee0 2024-03-23T23:58:27.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.238+0000 7f4b34800640 1 -- 172.21.15.8:0/2256476723 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b2c14f630 con 0x7f4b2c156ee0 2024-03-23T23:58:27.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.238+0000 7f4b34800640 1 -- 172.21.15.8:0/2256476723 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b2c068270 con 0x7f4b2c156ee0 2024-03-23T23:58:27.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.242+0000 7f4b26000640 1 -- 172.21.15.8:0/2256476723 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f4b2801b020 con 0x7f4b2c156ee0 2024-03-23T23:58:27.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.242+0000 7f4b26000640 1 --2- 172.21.15.8:0/2256476723 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4b10067690 0x7f4b10069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.242+0000 7f4b26000640 1 -- 172.21.15.8:0/2256476723 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f4b28086110 con 0x7f4b2c156ee0 2024-03-23T23:58:27.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.242+0000 7f4b31e00640 1 --2- 172.21.15.8:0/2256476723 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4b10067690 0x7f4b10069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.242+0000 7f4b31e00640 1 --2- 172.21.15.8:0/2256476723 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4b10067690 0x7f4b10069b50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4b200af000 tx=0x7f4b20004740 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:27.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.246+0000 7f4b26000640 1 -- 172.21.15.8:0/2256476723 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f4b28022070 con 0x7f4b2c156ee0 2024-03-23T23:58:27.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.422+0000 7f4b34800640 1 -- 172.21.15.8:0/2256476723 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4b2c14fb80 con 0x7f4b2c156ee0 2024-03-23T23:58:27.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.426+0000 7f4b26000640 1 -- 172.21.15.8:0/2256476723 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4b28056370 con 0x7f4b2c156ee0 2024-03-23T23:58:27.425 INFO:teuthology.orchestra.run.smithi008.stderr:listed 0 entries 2024-03-23T23:58:27.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.426+0000 7f4b34800640 1 -- 172.21.15.8:0/2256476723 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4b10067690 msgr2=0x7f4b10069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:27.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.426+0000 7f4b34800640 1 --2- 172.21.15.8:0/2256476723 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4b10067690 0x7f4b10069b50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4b200af000 tx=0x7f4b20004740 comp rx=0 tx=0).stop 2024-03-23T23:58:27.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.426+0000 7f4b34800640 1 -- 172.21.15.8:0/2256476723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b2c156ee0 msgr2=0x7f4b2c1ef2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:27.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.426+0000 7f4b34800640 1 --2- 172.21.15.8:0/2256476723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b2c156ee0 0x7f4b2c1ef2a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4b2800ef00 tx=0x7f4b2800b480 comp rx=0 tx=0).stop 2024-03-23T23:58:27.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.426+0000 7f4b34800640 1 -- 172.21.15.8:0/2256476723 shutdown_connections 2024-03-23T23:58:27.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.426+0000 7f4b34800640 1 --2- 172.21.15.8:0/2256476723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b2c156ee0 0x7f4b2c1ef2a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.426+0000 7f4b34800640 1 --2- 172.21.15.8:0/2256476723 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4b10067690 0x7f4b10069b50 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.426+0000 7f4b34800640 1 --2- 172.21.15.8:0/2256476723 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b2c149bd0 0x7f4b2c13fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.426+0000 7f4b34800640 1 --2- 172.21.15.8:0/2256476723 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4b2c0ac270 0x7f4b2c14dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.426+0000 7f4b34800640 1 -- 172.21.15.8:0/2256476723 >> 172.21.15.8:0/2256476723 conn(0x7f4b2c06b170 msgr2=0x7f4b2c06b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:27.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.426+0000 7f4b34800640 1 -- 172.21.15.8:0/2256476723 shutdown_connections 2024-03-23T23:58:27.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.426+0000 7f4b34800640 1 -- 172.21.15.8:0/2256476723 wait complete. 2024-03-23T23:58:27.447 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-23T23:58:27.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:58:27.447 DEBUG:teuthology.orchestra.run.smithi008:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-03-23T23:58:27.540 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi008.front.sepia.ceph.com 2024-03-23T23:58:27.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:58:27.541 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-23T23:58:27.576 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-23T23:58:27.576 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-23T23:58:27.618 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-23T23:58:27.618 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-23T23:58:27.694 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:58:27.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.838+0000 7f5608e00640 1 Processor -- start 2024-03-23T23:58:27.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.838+0000 7f5608e00640 1 -- start start 2024-03-23T23:58:27.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.838+0000 7f5608e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5604149bd0 0x7f560414a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.838+0000 7f5608e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f56040ac270 0x7f56040ac700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.838+0000 7f5608e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56040aa390 con 0x7f5604156ee0 2024-03-23T23:58:27.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.838+0000 7f5608e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f560406e720 con 0x7f56040ac270 2024-03-23T23:58:27.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.838+0000 7f5608e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560406ea00 con 0x7f5604149bd0 2024-03-23T23:58:27.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.838+0000 7f5601e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f5604156ee0 0x7f5604073230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:35408/0 (socket says 172.21.15.8:35408) 2024-03-23T23:58:27.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.838+0000 7f5601e00640 1 -- 172.21.15.8:0/3416823835 learned_addr learned my addr 172.21.15.8:0/3416823835 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:58:27.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.838+0000 7f5602800640 1 --2- 172.21.15.8:0/3416823835 >> v2:172.21.15.196:3300/0 conn(0x7f56040ac270 0x7f56040ac700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.838+0000 7f55f9400640 1 --2- 172.21.15.8:0/3416823835 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5604149bd0 0x7f560414a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.838+0000 7f5601400640 1 -- 172.21.15.8:0/3416823835 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 530127448 0 0) 0x7f56040aa390 con 0x7f5604156ee0 2024-03-23T23:58:27.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.838+0000 7f5601400640 1 -- 172.21.15.8:0/3416823835 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55e8003530 con 0x7f5604156ee0 2024-03-23T23:58:27.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.838+0000 7f5602800640 1 -- 172.21.15.8:0/3416823835 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5604149bd0 msgr2=0x7f560414a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:27.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.838+0000 7f5602800640 1 --2- 172.21.15.8:0/3416823835 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5604149bd0 0x7f560414a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.838+0000 7f5602800640 1 -- 172.21.15.8:0/3416823835 >> v1:172.21.15.8:6789/0 conn(0x7f5604156ee0 legacy=0x7f5604073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:27.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.838+0000 7f5602800640 1 -- 172.21.15.8:0/3416823835 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560406ece0 con 0x7f56040ac270 2024-03-23T23:58:27.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.842+0000 7f5602800640 1 --2- 172.21.15.8:0/3416823835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f56040ac270 0x7f56040ac700 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f55fc009d90 tx=0x7f55fc01c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4047d531d6dd3d57 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:27.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.842+0000 7f5601400640 1 -- 172.21.15.8:0/3416823835 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc0b2070 con 0x7f56040ac270 2024-03-23T23:58:27.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.842+0000 7f5601400640 1 -- 172.21.15.8:0/3416823835 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55fc0a5970 con 0x7f56040ac270 2024-03-23T23:58:27.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.842+0000 7f5601400640 1 -- 172.21.15.8:0/3416823835 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc0a5d40 con 0x7f56040ac270 2024-03-23T23:58:27.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.842+0000 7f5608e00640 1 -- 172.21.15.8:0/3416823835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f56040ac270 msgr2=0x7f56040ac700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:27.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.842+0000 7f5608e00640 1 --2- 172.21.15.8:0/3416823835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f56040ac270 0x7f56040ac700 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f55fc009d90 tx=0x7f55fc01c8b0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.842+0000 7f5608e00640 1 -- 172.21.15.8:0/3416823835 shutdown_connections 2024-03-23T23:58:27.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.842+0000 7f5608e00640 1 --2- 172.21.15.8:0/3416823835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f56040ac270 0x7f56040ac700 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.842+0000 7f5608e00640 1 --2- 172.21.15.8:0/3416823835 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5604149bd0 0x7f560414a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.842+0000 7f5608e00640 1 -- 172.21.15.8:0/3416823835 >> 172.21.15.8:0/3416823835 conn(0x7f560406b170 msgr2=0x7f560406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:27.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.842+0000 7f5608e00640 1 -- 172.21.15.8:0/3416823835 shutdown_connections 2024-03-23T23:58:27.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.842+0000 7f5608e00640 1 -- 172.21.15.8:0/3416823835 wait complete. 2024-03-23T23:58:27.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.846+0000 7f5608e00640 1 Processor -- start 2024-03-23T23:58:27.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.846+0000 7f5608e00640 1 -- start start 2024-03-23T23:58:27.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.846+0000 7f5608e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56040ac270 0x7f5604141ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.846+0000 7f5608e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5604149bd0 0x7f5604142020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.846+0000 7f5608e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5604156ee0 0x7f56041f1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.846+0000 7f5608e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56041579f0 con 0x7f56040ac270 2024-03-23T23:58:27.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.846+0000 7f5608e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5604157870 con 0x7f5604149bd0 2024-03-23T23:58:27.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.846+0000 7f5608e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56041572c0 con 0x7f5604156ee0 2024-03-23T23:58:27.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.846+0000 7f5601e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56040ac270 0x7f5604141ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.846+0000 7f5601e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56040ac270 0x7f5604141ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58592/0 (socket says 172.21.15.8:58592) 2024-03-23T23:58:27.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.846+0000 7f5601e00640 1 -- 172.21.15.8:0/1420732635 learned_addr learned my addr 172.21.15.8:0/1420732635 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:27.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.846+0000 7f55f9400640 1 --2- 172.21.15.8:0/1420732635 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5604149bd0 0x7f5604142020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.846+0000 7f5602800640 1 --2- 172.21.15.8:0/1420732635 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5604156ee0 0x7f56041f1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.846+0000 7f5601e00640 1 -- 172.21.15.8:0/1420732635 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5604156ee0 msgr2=0x7f56041f1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:27.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.846+0000 7f5601e00640 1 --2- 172.21.15.8:0/1420732635 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5604156ee0 0x7f56041f1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.846+0000 7f5601e00640 1 -- 172.21.15.8:0/1420732635 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5604149bd0 msgr2=0x7f5604142020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:27.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.846+0000 7f5601e00640 1 --2- 172.21.15.8:0/1420732635 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5604149bd0 0x7f5604142020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.846+0000 7f5601e00640 1 -- 172.21.15.8:0/1420732635 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5604151a30 con 0x7f56040ac270 2024-03-23T23:58:27.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.846+0000 7f5601e00640 1 --2- 172.21.15.8:0/1420732635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56040ac270 0x7f5604141ae0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f55f400c480 tx=0x7f55f400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:27.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.846+0000 7f55faa00640 1 -- 172.21.15.8:0/1420732635 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f4017070 con 0x7f56040ac270 2024-03-23T23:58:27.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.846+0000 7f55faa00640 1 -- 172.21.15.8:0/1420732635 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f4005cf0 con 0x7f56040ac270 2024-03-23T23:58:27.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.846+0000 7f55faa00640 1 -- 172.21.15.8:0/1420732635 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f4007290 con 0x7f56040ac270 2024-03-23T23:58:27.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.846+0000 7f5608e00640 1 -- 172.21.15.8:0/1420732635 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56040733a0 con 0x7f56040ac270 2024-03-23T23:58:27.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.846+0000 7f5608e00640 1 -- 172.21.15.8:0/1420732635 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5604152200 con 0x7f56040ac270 2024-03-23T23:58:27.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.850+0000 7f5608e00640 1 -- 172.21.15.8:0/1420732635 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5604068270 con 0x7f56040ac270 2024-03-23T23:58:27.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.850+0000 7f55faa00640 1 -- 172.21.15.8:0/1420732635 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f55f401a070 con 0x7f56040ac270 2024-03-23T23:58:27.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.850+0000 7f55faa00640 1 --2- 172.21.15.8:0/1420732635 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f55e0067660 0x7f55e0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.850+0000 7f55faa00640 1 -- 172.21.15.8:0/1420732635 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f55f4085010 con 0x7f56040ac270 2024-03-23T23:58:27.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.850+0000 7f55f9400640 1 --2- 172.21.15.8:0/1420732635 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f55e0067660 0x7f55e0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.850+0000 7f55f9400640 1 --2- 172.21.15.8:0/1420732635 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f55e0067660 0x7f55e0069b20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5604154870 tx=0x7f55ec009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:27.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:27.854+0000 7f55faa00640 1 -- 172.21.15.8:0/1420732635 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f55f4055270 con 0x7f56040ac270 2024-03-23T23:58:28.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.082+0000 7f5608e00640 1 -- 172.21.15.8:0/1420732635 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5604151500 con 0x7f56040ac270 2024-03-23T23:58:28.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.082+0000 7f55faa00640 1 -- 172.21.15.8:0/1420732635 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20567 (secure 0 0 0) 0x7f55f4059310 con 0x7f56040ac270 2024-03-23T23:58:28.084 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:58:28.084 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":27,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","created":"2024-03-23T23:42:15.169430+0000","modified":"2024-03-23T23:43:21.884365+0000","last_up_change":"2024-03-23T23:42:26.509742+0000","last_in_change":"2024-03-23T23:42:17.662330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:42:26.327445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-23T23:42:38.218800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-23T23:42:39.054195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-23T23:42:48.327799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-23T23:42:49.113061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e967bf31-21d6-4d11-bc3d-0df8177a1b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6809","nonce":2187201732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6811","nonce":2187201732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6815","nonce":2187201732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6813","nonce":2187201732}]},"public_addr":"172.21.15.8:6809/2187201732","cluster_addr":"172.21.15.8:6811/2187201732","heartbeat_back_addr":"172.21.15.8:6815/2187201732","heartbeat_front_addr":"172.21.15.8:6813/2187201732","state":["exists","up"]},{"osd":1,"uuid":"c8e33701-7acd-4474-8402-d52461171fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6818","nonce":3205168010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6822","nonce":3205168010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6830","nonce":3205168010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6826","nonce":3205168010}]},"public_addr":"172.21.15.8:6818/3205168010","cluster_addr":"172.21.15.8:6822/3205168010","heartbeat_back_addr":"172.21.15.8:6830/3205168010","heartbeat_front_addr":"172.21.15.8:6826/3205168010","state":["exists","up"]},{"osd":2,"uuid":"ceebdbf7-4c2f-4757-b52d-fd8b20e77570","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6801","nonce":475463656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6803","nonce":475463656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6807","nonce":475463656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6805","nonce":475463656}]},"public_addr":"172.21.15.8:6801/475463656","cluster_addr":"172.21.15.8:6803/475463656","heartbeat_back_addr":"172.21.15.8:6807/475463656","heartbeat_front_addr":"172.21.15.8:6805/475463656","state":["exists","up"]},{"osd":3,"uuid":"89e258da-5767-429e-8441-edf877d2f3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6819","nonce":1514082871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6821","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6823","nonce":1514082871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6829","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6831","nonce":1514082871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6825","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6827","nonce":1514082871}]},"public_addr":"172.21.15.8:6819/1514082871","cluster_addr":"172.21.15.8:6823/1514082871","heartbeat_back_addr":"172.21.15.8:6831/1514082871","heartbeat_front_addr":"172.21.15.8:6827/1514082871","state":["exists","up"]},{"osd":4,"uuid":"2b7451ae-ea16-4f0a-ae50-04fde75e45ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6825","nonce":3516578147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6827","nonce":3516578147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6831","nonce":3516578147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6829","nonce":3516578147}]},"public_addr":"172.21.15.196:6825/3516578147","cluster_addr":"172.21.15.196:6827/3516578147","heartbeat_back_addr":"172.21.15.196:6831/3516578147","heartbeat_front_addr":"172.21.15.196:6829/3516578147","state":["exists","up"]},{"osd":5,"uuid":"e68a8914-e591-466a-bc9e-f2d7c67aac13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6802","nonce":830595758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6806","nonce":830595758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6814","nonce":830595758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6810","nonce":830595758}]},"public_addr":"172.21.15.196:6802/830595758","cluster_addr":"172.21.15.196:6806/830595758","heartbeat_back_addr":"172.21.15.196:6814/830595758","heartbeat_front_addr":"172.21.15.196:6810/830595758","state":["exists","up"]},{"osd":6,"uuid":"e47723c5-50a0-4cd8-92d9-01972072b422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6801","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6803","nonce":472639906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6805","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6807","nonce":472639906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6815","nonce":472639906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6811","nonce":472639906}]},"public_addr":"172.21.15.196:6803/472639906","cluster_addr":"172.21.15.196:6807/472639906","heartbeat_back_addr":"172.21.15.196:6815/472639906","heartbeat_front_addr":"172.21.15.196:6811/472639906","state":["exists","up"]},{"osd":7,"uuid":"e1e9113d-8005-47b3-9a75-9e701199f1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6817","nonce":4151820349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6819","nonce":4151820349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6823","nonce":4151820349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6821","nonce":4151820349}]},"public_addr":"172.21.15.196:6817/4151820349","cluster_addr":"172.21.15.196:6819/4151820349","heartbeat_back_addr":"172.21.15.196:6823/4151820349","heartbeat_front_addr":"172.21.15.196:6821/4151820349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.221790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.265974+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.190319+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.376359+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.329657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.402958+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.300703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.133121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:58:28.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.086+0000 7f5608e00640 1 -- 172.21.15.8:0/1420732635 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f55e0067660 msgr2=0x7f55e0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:28.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.086+0000 7f5608e00640 1 --2- 172.21.15.8:0/1420732635 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f55e0067660 0x7f55e0069b20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5604154870 tx=0x7f55ec009190 comp rx=0 tx=0).stop 2024-03-23T23:58:28.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.086+0000 7f5608e00640 1 -- 172.21.15.8:0/1420732635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56040ac270 msgr2=0x7f5604141ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:28.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.086+0000 7f5608e00640 1 --2- 172.21.15.8:0/1420732635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56040ac270 0x7f5604141ae0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f55f400c480 tx=0x7f55f400c940 comp rx=0 tx=0).stop 2024-03-23T23:58:28.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.086+0000 7f5608e00640 1 -- 172.21.15.8:0/1420732635 shutdown_connections 2024-03-23T23:58:28.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.086+0000 7f5608e00640 1 --2- 172.21.15.8:0/1420732635 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f55e0067660 0x7f55e0069b20 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.086+0000 7f5608e00640 1 --2- 172.21.15.8:0/1420732635 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5604156ee0 0x7f56041f1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.086+0000 7f5608e00640 1 --2- 172.21.15.8:0/1420732635 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5604149bd0 0x7f5604142020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.086+0000 7f5608e00640 1 --2- 172.21.15.8:0/1420732635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56040ac270 0x7f5604141ae0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.086+0000 7f5608e00640 1 -- 172.21.15.8:0/1420732635 >> 172.21.15.8:0/1420732635 conn(0x7f560406b170 msgr2=0x7f56040c2300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:28.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.086+0000 7f5608e00640 1 -- 172.21.15.8:0/1420732635 shutdown_connections 2024-03-23T23:58:28.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.086+0000 7f5608e00640 1 -- 172.21.15.8:0/1420732635 wait complete. 2024-03-23T23:58:28.105 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-23T23:42:26.327445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-03-23T23:42:38.218800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-03-23T23:42:39.054195+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-03-23T23:42:48.327799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-03-23T23:42:49.113061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-23T23:58:28.106 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-23T23:58:28.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.250+0000 7f8417000640 1 Processor -- start 2024-03-23T23:58:28.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.250+0000 7f8417000640 1 -- start start 2024-03-23T23:58:28.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.250+0000 7f8417000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f84100710a0 0x7f84101572d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:28.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.250+0000 7f8417000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f84100c4420 0x7f841015df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:28.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.250+0000 7f8417000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84100c7fe0 con 0x7f8410157810 2024-03-23T23:58:28.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.250+0000 7f8417000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84100c3880 con 0x7f84100c4420 2024-03-23T23:58:28.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.250+0000 7f8417000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84100c7d90 con 0x7f84100710a0 2024-03-23T23:58:28.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.250+0000 7f8416600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f84100c4420 0x7f841015df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:28.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.250+0000 7f8416600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f84100c4420 0x7f841015df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58600/0 (socket says 172.21.15.8:58600) 2024-03-23T23:58:28.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.250+0000 7f8416600640 1 -- 172.21.15.8:0/2244255329 learned_addr learned my addr 172.21.15.8:0/2244255329 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:28.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.250+0000 7f8415c00640 1 --2- 172.21.15.8:0/2244255329 >> v2:172.21.15.196:3300/0 conn(0x7f84100710a0 0x7f84101572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:28.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.250+0000 7f8416600640 1 -- 172.21.15.8:0/2244255329 >> v2:172.21.15.196:3300/0 conn(0x7f84100710a0 msgr2=0x7f84101572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:28.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.250+0000 7f8416600640 1 --2- 172.21.15.8:0/2244255329 >> v2:172.21.15.196:3300/0 conn(0x7f84100710a0 0x7f84101572d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.250+0000 7f8416600640 1 -- 172.21.15.8:0/2244255329 >> v1:172.21.15.196:6789/0 conn(0x7f8410157810 legacy=0x7f84100c3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:28.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.250+0000 7f8416600640 1 -- 172.21.15.8:0/2244255329 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84100c82c0 con 0x7f84100c4420 2024-03-23T23:58:28.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.254+0000 7f8416600640 1 --2- 172.21.15.8:0/2244255329 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84100c4420 0x7f841015df80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f841004fde0 tx=0x7f840801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e18f7ebfa4e397 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:28.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.254+0000 7f840fe00640 1 -- 172.21.15.8:0/2244255329 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84080a5670 con 0x7f84100c4420 2024-03-23T23:58:28.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.254+0000 7f840fe00640 1 -- 172.21.15.8:0/2244255329 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84080a5810 con 0x7f84100c4420 2024-03-23T23:58:28.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.254+0000 7f840fe00640 1 -- 172.21.15.8:0/2244255329 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84080a5be0 con 0x7f84100c4420 2024-03-23T23:58:28.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.254+0000 7f8417000640 1 -- 172.21.15.8:0/2244255329 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84100c4420 msgr2=0x7f841015df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:28.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.254+0000 7f8417000640 1 --2- 172.21.15.8:0/2244255329 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84100c4420 0x7f841015df80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f841004fde0 tx=0x7f840801c8a0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.254+0000 7f8417000640 1 -- 172.21.15.8:0/2244255329 shutdown_connections 2024-03-23T23:58:28.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.254+0000 7f8417000640 1 --2- 172.21.15.8:0/2244255329 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84100c4420 0x7f841015df80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.254+0000 7f8417000640 1 --2- 172.21.15.8:0/2244255329 >> v2:172.21.15.196:3300/0 conn(0x7f84100710a0 0x7f84101572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.254+0000 7f8417000640 1 -- 172.21.15.8:0/2244255329 >> 172.21.15.8:0/2244255329 conn(0x7f84100aac30 msgr2=0x7f84100ab040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:28.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.254+0000 7f8417000640 1 -- 172.21.15.8:0/2244255329 shutdown_connections 2024-03-23T23:58:28.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.254+0000 7f8417000640 1 -- 172.21.15.8:0/2244255329 wait complete. 2024-03-23T23:58:28.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.258+0000 7f8417000640 1 Processor -- start 2024-03-23T23:58:28.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.258+0000 7f8417000640 1 -- start start 2024-03-23T23:58:28.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.258+0000 7f8417000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84100710a0 0x7f84101ee980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:28.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.258+0000 7f8417000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84100c4420 0x7f8410152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:28.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.258+0000 7f8417000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8410157810 0x7f84101542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:28.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.258+0000 7f8417000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84100c8b20 con 0x7f84100c4420 2024-03-23T23:58:28.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.258+0000 7f8417000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84100c48d0 con 0x7f84100710a0 2024-03-23T23:58:28.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.258+0000 7f8417000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84100c8ca0 con 0x7f8410157810 2024-03-23T23:58:28.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.258+0000 7f8415200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84100c4420 0x7f8410152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:28.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.258+0000 7f8415200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84100c4420 0x7f8410152f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58604/0 (socket says 172.21.15.8:58604) 2024-03-23T23:58:28.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.258+0000 7f8415200640 1 -- 172.21.15.8:0/1385785715 learned_addr learned my addr 172.21.15.8:0/1385785715 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:28.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.258+0000 7f8415c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84100710a0 0x7f84101ee980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:28.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.258+0000 7f8416600640 1 --2- 172.21.15.8:0/1385785715 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8410157810 0x7f84101542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:28.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.258+0000 7f8415c00640 1 -- 172.21.15.8:0/1385785715 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8410157810 msgr2=0x7f84101542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:28.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.258+0000 7f8415c00640 1 --2- 172.21.15.8:0/1385785715 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8410157810 0x7f84101542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.258+0000 7f8415c00640 1 -- 172.21.15.8:0/1385785715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84100c4420 msgr2=0x7f8410152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:28.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.258+0000 7f8415c00640 1 --2- 172.21.15.8:0/1385785715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84100c4420 0x7f8410152f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.258+0000 7f8415c00640 1 -- 172.21.15.8:0/1385785715 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84101555f0 con 0x7f84100710a0 2024-03-23T23:58:28.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.258+0000 7f8415c00640 1 --2- 172.21.15.8:0/1385785715 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84100710a0 0x7f84101ee980 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f840400e8a0 tx=0x7f840400ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:28.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.258+0000 7f840d600640 1 -- 172.21.15.8:0/1385785715 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8404017070 con 0x7f84100710a0 2024-03-23T23:58:28.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.258+0000 7f840d600640 1 -- 172.21.15.8:0/1385785715 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840400c940 con 0x7f84100710a0 2024-03-23T23:58:28.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.258+0000 7f840d600640 1 -- 172.21.15.8:0/1385785715 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840400cd10 con 0x7f84100710a0 2024-03-23T23:58:28.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.258+0000 7f8417000640 1 -- 172.21.15.8:0/1385785715 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84101558d0 con 0x7f84100710a0 2024-03-23T23:58:28.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.258+0000 7f8417000640 1 -- 172.21.15.8:0/1385785715 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f841014e070 con 0x7f84100710a0 2024-03-23T23:58:28.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.262+0000 7f8417000640 1 -- 172.21.15.8:0/1385785715 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8410075800 con 0x7f84100710a0 2024-03-23T23:58:28.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.262+0000 7f840d600640 1 -- 172.21.15.8:0/1385785715 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f840401a070 con 0x7f84100710a0 2024-03-23T23:58:28.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.262+0000 7f840d600640 1 --2- 172.21.15.8:0/1385785715 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f83f0067660 0x7f83f0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:28.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.262+0000 7f840d600640 1 -- 172.21.15.8:0/1385785715 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f84040859b0 con 0x7f84100710a0 2024-03-23T23:58:28.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.262+0000 7f8415200640 1 --2- 172.21.15.8:0/1385785715 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f83f0067660 0x7f83f0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:28.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.262+0000 7f8415200640 1 --2- 172.21.15.8:0/1385785715 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f83f0067660 0x7f83f0069b20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f84100a7ce0 tx=0x7f83fc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:28.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.266+0000 7f840d600640 1 -- 172.21.15.8:0/1385785715 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f8404055c90 con 0x7f84100710a0 2024-03-23T23:58:28.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.430+0000 7f8417000640 1 -- 172.21.15.8:0/1385785715 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f84100a9eb0 con 0x7f84100710a0 2024-03-23T23:58:28.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.430+0000 7f840d600640 1 -- 172.21.15.8:0/1385785715 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8404059d30 con 0x7f84100710a0 2024-03-23T23:58:28.432 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-03-23T23:58:28.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.434+0000 7f8417000640 1 -- 172.21.15.8:0/1385785715 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f83f0067660 msgr2=0x7f83f0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:28.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.434+0000 7f8417000640 1 --2- 172.21.15.8:0/1385785715 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f83f0067660 0x7f83f0069b20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f84100a7ce0 tx=0x7f83fc009040 comp rx=0 tx=0).stop 2024-03-23T23:58:28.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.434+0000 7f8417000640 1 -- 172.21.15.8:0/1385785715 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84100710a0 msgr2=0x7f84101ee980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:28.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.434+0000 7f8417000640 1 --2- 172.21.15.8:0/1385785715 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84100710a0 0x7f84101ee980 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f840400e8a0 tx=0x7f840400ed60 comp rx=0 tx=0).stop 2024-03-23T23:58:28.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.434+0000 7f8417000640 1 -- 172.21.15.8:0/1385785715 shutdown_connections 2024-03-23T23:58:28.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.434+0000 7f8417000640 1 --2- 172.21.15.8:0/1385785715 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f83f0067660 0x7f83f0069b20 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.434+0000 7f8417000640 1 --2- 172.21.15.8:0/1385785715 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8410157810 0x7f84101542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.434+0000 7f8417000640 1 --2- 172.21.15.8:0/1385785715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84100c4420 0x7f8410152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.434+0000 7f8417000640 1 --2- 172.21.15.8:0/1385785715 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84100710a0 0x7f84101ee980 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.434+0000 7f8417000640 1 -- 172.21.15.8:0/1385785715 >> 172.21.15.8:0/1385785715 conn(0x7f84100aac30 msgr2=0x7f84100c6a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:28.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.434+0000 7f8417000640 1 -- 172.21.15.8:0/1385785715 shutdown_connections 2024-03-23T23:58:28.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.434+0000 7f8417000640 1 -- 172.21.15.8:0/1385785715 wait complete. 2024-03-23T23:58:28.453 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-03-23T23:58:28.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.594+0000 7ff2a8c00640 1 Processor -- start 2024-03-23T23:58:28.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.594+0000 7ff2a8c00640 1 -- start start 2024-03-23T23:58:28.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.598+0000 7ff2a8c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff2a4159860 0x7ff2a40714f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:28.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.598+0000 7ff2a8c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff2a40c2390 0x7ff2a40c27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:28.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.598+0000 7ff2a8c00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a4159dd0 con 0x7ff2a4152ff0 2024-03-23T23:58:28.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.598+0000 7ff2a8c00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a40701f0 con 0x7ff2a4159860 2024-03-23T23:58:28.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.598+0000 7ff2a8c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a40704d0 con 0x7ff2a40c2390 2024-03-23T23:58:28.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.598+0000 7ff29be00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff2a4159860 0x7ff2a40714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:28.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.598+0000 7ff2a1e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff2a4152ff0 0x7ff2a406ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:35412/0 (socket says 172.21.15.8:35412) 2024-03-23T23:58:28.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.598+0000 7ff2a1e00640 1 -- 172.21.15.8:0/1910598317 learned_addr learned my addr 172.21.15.8:0/1910598317 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:58:28.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.598+0000 7ff2a2800640 1 --2- 172.21.15.8:0/1910598317 >> v2:172.21.15.196:3300/0 conn(0x7ff2a40c2390 0x7ff2a40c27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:28.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.598+0000 7ff2a1400640 1 -- 172.21.15.8:0/1910598317 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 613709907 0 0) 0x7ff2a4159dd0 con 0x7ff2a4152ff0 2024-03-23T23:58:28.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.598+0000 7ff2a1400640 1 -- 172.21.15.8:0/1910598317 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff288003530 con 0x7ff2a4152ff0 2024-03-23T23:58:28.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.598+0000 7ff29be00640 1 -- 172.21.15.8:0/1910598317 >> v2:172.21.15.196:3300/0 conn(0x7ff2a40c2390 msgr2=0x7ff2a40c27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:28.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.598+0000 7ff29be00640 1 --2- 172.21.15.8:0/1910598317 >> v2:172.21.15.196:3300/0 conn(0x7ff2a40c2390 0x7ff2a40c27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.598+0000 7ff29be00640 1 -- 172.21.15.8:0/1910598317 >> v1:172.21.15.8:6789/0 conn(0x7ff2a4152ff0 legacy=0x7ff2a406ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:28.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.598+0000 7ff29be00640 1 -- 172.21.15.8:0/1910598317 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a40707b0 con 0x7ff2a4159860 2024-03-23T23:58:28.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.602+0000 7ff29be00640 1 --2- 172.21.15.8:0/1910598317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2a4159860 0x7ff2a40714f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4070c20 tx=0x7ff28c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a2eb13c9633698 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:28.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.602+0000 7ff2a1400640 1 -- 172.21.15.8:0/1910598317 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c0b0070 con 0x7ff2a4159860 2024-03-23T23:58:28.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.602+0000 7ff2a1400640 1 -- 172.21.15.8:0/1910598317 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28c0ab600 con 0x7ff2a4159860 2024-03-23T23:58:28.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.602+0000 7ff2a1400640 1 -- 172.21.15.8:0/1910598317 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c0ab9b0 con 0x7ff2a4159860 2024-03-23T23:58:28.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.602+0000 7ff2a8c00640 1 -- 172.21.15.8:0/1910598317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2a4159860 msgr2=0x7ff2a40714f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:28.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.602+0000 7ff2a8c00640 1 --2- 172.21.15.8:0/1910598317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2a4159860 0x7ff2a40714f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4070c20 tx=0x7ff28c01c3f0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.602+0000 7ff2a8c00640 1 -- 172.21.15.8:0/1910598317 shutdown_connections 2024-03-23T23:58:28.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.602+0000 7ff2a8c00640 1 --2- 172.21.15.8:0/1910598317 >> v2:172.21.15.196:3300/0 conn(0x7ff2a40c2390 0x7ff2a40c27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.602+0000 7ff2a8c00640 1 --2- 172.21.15.8:0/1910598317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2a4159860 0x7ff2a40714f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.602+0000 7ff2a8c00640 1 -- 172.21.15.8:0/1910598317 >> 172.21.15.8:0/1910598317 conn(0x7ff2a40aad10 msgr2=0x7ff2a40ab120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:28.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.602+0000 7ff2a8c00640 1 -- 172.21.15.8:0/1910598317 shutdown_connections 2024-03-23T23:58:28.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.602+0000 7ff2a8c00640 1 -- 172.21.15.8:0/1910598317 wait complete. 2024-03-23T23:58:28.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.602+0000 7ff2a8c00640 1 Processor -- start 2024-03-23T23:58:28.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.602+0000 7ff2a8c00640 1 -- start start 2024-03-23T23:58:28.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.606+0000 7ff2a8c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2a40c2390 0x7ff2a41561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:28.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.606+0000 7ff2a8c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff2a4152ff0 0x7ff2a4158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:28.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.606+0000 7ff2a8c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff2a4159860 0x7ff2a415f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:28.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.606+0000 7ff2a8c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a40c75a0 con 0x7ff2a40c2390 2024-03-23T23:58:28.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.606+0000 7ff2a8c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a40c7420 con 0x7ff2a4159860 2024-03-23T23:58:28.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.606+0000 7ff2a8c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a4162a00 con 0x7ff2a4152ff0 2024-03-23T23:58:28.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.606+0000 7ff2a1e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2a40c2390 0x7ff2a41561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:28.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.606+0000 7ff2a1e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2a40c2390 0x7ff2a41561a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58612/0 (socket says 172.21.15.8:58612) 2024-03-23T23:58:28.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.606+0000 7ff2a1e00640 1 -- 172.21.15.8:0/694922967 learned_addr learned my addr 172.21.15.8:0/694922967 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:28.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.606+0000 7ff2a2800640 1 --2- 172.21.15.8:0/694922967 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff2a4159860 0x7ff2a415f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:28.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.606+0000 7ff29be00640 1 --2- 172.21.15.8:0/694922967 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff2a4152ff0 0x7ff2a4158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:28.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.606+0000 7ff2a1e00640 1 -- 172.21.15.8:0/694922967 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff2a4152ff0 msgr2=0x7ff2a4158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:28.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.606+0000 7ff2a1e00640 1 --2- 172.21.15.8:0/694922967 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff2a4152ff0 0x7ff2a4158980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.606+0000 7ff2a1e00640 1 -- 172.21.15.8:0/694922967 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff2a4159860 msgr2=0x7ff2a415f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:28.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.606+0000 7ff2a1e00640 1 --2- 172.21.15.8:0/694922967 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff2a4159860 0x7ff2a415f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.606+0000 7ff2a1e00640 1 -- 172.21.15.8:0/694922967 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a41f1790 con 0x7ff2a40c2390 2024-03-23T23:58:28.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.606+0000 7ff2a1e00640 1 --2- 172.21.15.8:0/694922967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2a40c2390 0x7ff2a41561a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff29400c450 tx=0x7ff29400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:28.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.606+0000 7ff29a000640 1 -- 172.21.15.8:0/694922967 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff294017070 con 0x7ff2a40c2390 2024-03-23T23:58:28.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.606+0000 7ff29a000640 1 -- 172.21.15.8:0/694922967 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff294005cf0 con 0x7ff2a40c2390 2024-03-23T23:58:28.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.606+0000 7ff2a8c00640 1 -- 172.21.15.8:0/694922967 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a4156f80 con 0x7ff2a40c2390 2024-03-23T23:58:28.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.606+0000 7ff29a000640 1 -- 172.21.15.8:0/694922967 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff294007290 con 0x7ff2a40c2390 2024-03-23T23:58:28.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.606+0000 7ff2a8c00640 1 -- 172.21.15.8:0/694922967 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a41f1d10 con 0x7ff2a40c2390 2024-03-23T23:58:28.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.606+0000 7ff2a8c00640 1 -- 172.21.15.8:0/694922967 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a404f410 con 0x7ff2a40c2390 2024-03-23T23:58:28.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.610+0000 7ff29a000640 1 -- 172.21.15.8:0/694922967 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff29401a070 con 0x7ff2a40c2390 2024-03-23T23:58:28.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.610+0000 7ff29a000640 1 --2- 172.21.15.8:0/694922967 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff280067690 0x7ff280069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:28.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.610+0000 7ff29a000640 1 -- 172.21.15.8:0/694922967 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7ff294085070 con 0x7ff2a40c2390 2024-03-23T23:58:28.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.610+0000 7ff29be00640 1 --2- 172.21.15.8:0/694922967 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff280067690 0x7ff280069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:28.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.610+0000 7ff29be00640 1 --2- 172.21.15.8:0/694922967 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff280067690 0x7ff280069b50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff28c0ad000 tx=0x7ff28c0a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:28.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.614+0000 7ff29a000640 1 -- 172.21.15.8:0/694922967 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7ff294055240 con 0x7ff2a40c2390 2024-03-23T23:58:28.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.778+0000 7ff2a8c00640 1 -- 172.21.15.8:0/694922967 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff2a40c8d40 con 0x7ff2a40c2390 2024-03-23T23:58:28.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.778+0000 7ff29a000640 1 -- 172.21.15.8:0/694922967 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v27) v1 ==== 99+0+11 (secure 0 0 0) 0x7ff2940592e0 con 0x7ff2a40c2390 2024-03-23T23:58:28.778 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-03-23T23:58:28.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.778+0000 7ff2a8c00640 1 -- 172.21.15.8:0/694922967 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff280067690 msgr2=0x7ff280069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:28.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.778+0000 7ff2a8c00640 1 --2- 172.21.15.8:0/694922967 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff280067690 0x7ff280069b50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff28c0ad000 tx=0x7ff28c0a6000 comp rx=0 tx=0).stop 2024-03-23T23:58:28.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.778+0000 7ff2a8c00640 1 -- 172.21.15.8:0/694922967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2a40c2390 msgr2=0x7ff2a41561a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:28.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.778+0000 7ff2a8c00640 1 --2- 172.21.15.8:0/694922967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2a40c2390 0x7ff2a41561a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff29400c450 tx=0x7ff29400c910 comp rx=0 tx=0).stop 2024-03-23T23:58:28.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.778+0000 7ff2a8c00640 1 -- 172.21.15.8:0/694922967 shutdown_connections 2024-03-23T23:58:28.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.778+0000 7ff2a8c00640 1 --2- 172.21.15.8:0/694922967 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff2a4159860 0x7ff2a415f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.778+0000 7ff2a8c00640 1 --2- 172.21.15.8:0/694922967 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff280067690 0x7ff280069b50 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.778+0000 7ff2a8c00640 1 --2- 172.21.15.8:0/694922967 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff2a4152ff0 0x7ff2a4158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.778+0000 7ff2a8c00640 1 --2- 172.21.15.8:0/694922967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2a40c2390 0x7ff2a41561a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.778+0000 7ff2a8c00640 1 -- 172.21.15.8:0/694922967 >> 172.21.15.8:0/694922967 conn(0x7ff2a40aad10 msgr2=0x7ff2a40c3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:28.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.778+0000 7ff2a8c00640 1 -- 172.21.15.8:0/694922967 shutdown_connections 2024-03-23T23:58:28.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.778+0000 7ff2a8c00640 1 -- 172.21.15.8:0/694922967 wait complete. 2024-03-23T23:58:28.800 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-03-23T23:58:28.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.942+0000 7f3a2bc00640 1 Processor -- start 2024-03-23T23:58:28.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.942+0000 7f3a2bc00640 1 -- start start 2024-03-23T23:58:28.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.946+0000 7f3a2bc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a24152ff0 0x7f3a240714f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:28.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.946+0000 7f3a2bc00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3a24159860 0x7f3a2406ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:28.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.946+0000 7f3a2bc00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a24159dd0 con 0x7f3a2406f190 2024-03-23T23:58:28.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.946+0000 7f3a2bc00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a240701f0 con 0x7f3a24159860 2024-03-23T23:58:28.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.946+0000 7f3a2bc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a240704d0 con 0x7f3a24152ff0 2024-03-23T23:58:28.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.946+0000 7f3a1be00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3a24159860 0x7f3a2406ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:28.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.946+0000 7f3a29c00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f3a2406f190 0x7f3a240c2390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:35422/0 (socket says 172.21.15.8:35422) 2024-03-23T23:58:28.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.946+0000 7f3a29c00640 1 -- 172.21.15.8:0/2145272549 learned_addr learned my addr 172.21.15.8:0/2145272549 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:58:28.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.946+0000 7f3a29200640 1 --2- 172.21.15.8:0/2145272549 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a24152ff0 0x7f3a240714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:28.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.946+0000 7f3a1be00640 1 -- 172.21.15.8:0/2145272549 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a24152ff0 msgr2=0x7f3a240714f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:28.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.946+0000 7f3a1be00640 1 --2- 172.21.15.8:0/2145272549 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a24152ff0 0x7f3a240714f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.946+0000 7f3a1be00640 1 -- 172.21.15.8:0/2145272549 >> v1:172.21.15.8:6789/0 conn(0x7f3a2406f190 legacy=0x7f3a240c2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:28.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.946+0000 7f3a1be00640 1 -- 172.21.15.8:0/2145272549 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a240707b0 con 0x7f3a24159860 2024-03-23T23:58:28.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.946+0000 7f3a23e00640 1 -- 172.21.15.8:0/2145272549 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2999688843 0 0) 0x7f3a24159dd0 con 0x7f3a2406f190 2024-03-23T23:58:28.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.946+0000 7f3a1be00640 1 --2- 172.21.15.8:0/2145272549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a24159860 0x7f3a2406ec50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0097c0 tx=0x7f3a0c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88962bc6d3d19286 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:28.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.950+0000 7f3a23e00640 1 -- 172.21.15.8:0/2145272549 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c0b0070 con 0x7f3a24159860 2024-03-23T23:58:28.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.950+0000 7f3a23e00640 1 -- 172.21.15.8:0/2145272549 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0c0ab600 con 0x7f3a24159860 2024-03-23T23:58:28.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.950+0000 7f3a23e00640 1 -- 172.21.15.8:0/2145272549 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c0ab9d0 con 0x7f3a24159860 2024-03-23T23:58:28.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.950+0000 7f3a2bc00640 1 -- 172.21.15.8:0/2145272549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a24159860 msgr2=0x7f3a2406ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:28.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.950+0000 7f3a2bc00640 1 --2- 172.21.15.8:0/2145272549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a24159860 0x7f3a2406ec50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0097c0 tx=0x7f3a0c01c410 comp rx=0 tx=0).stop 2024-03-23T23:58:28.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.950+0000 7f3a2bc00640 1 -- 172.21.15.8:0/2145272549 shutdown_connections 2024-03-23T23:58:28.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.950+0000 7f3a2bc00640 1 --2- 172.21.15.8:0/2145272549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a24159860 0x7f3a2406ec50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.950+0000 7f3a2bc00640 1 --2- 172.21.15.8:0/2145272549 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a24152ff0 0x7f3a240714f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.950+0000 7f3a2bc00640 1 -- 172.21.15.8:0/2145272549 >> 172.21.15.8:0/2145272549 conn(0x7f3a240aad10 msgr2=0x7f3a240ab120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:28.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.950+0000 7f3a2bc00640 1 -- 172.21.15.8:0/2145272549 shutdown_connections 2024-03-23T23:58:28.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.950+0000 7f3a2bc00640 1 -- 172.21.15.8:0/2145272549 wait complete. 2024-03-23T23:58:28.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.950+0000 7f3a2bc00640 1 Processor -- start 2024-03-23T23:58:28.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.950+0000 7f3a2bc00640 1 -- start start 2024-03-23T23:58:28.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.950+0000 7f3a2bc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a2406f190 0x7f3a2406cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:28.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.950+0000 7f3a2bc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a24152ff0 0x7f3a24151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:28.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.950+0000 7f3a2bc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3a24159860 0x7f3a2414a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:28.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.950+0000 7f3a2bc00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a240c75a0 con 0x7f3a24152ff0 2024-03-23T23:58:28.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.950+0000 7f3a2bc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a240c7420 con 0x7f3a24159860 2024-03-23T23:58:28.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.950+0000 7f3a2bc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a24162a00 con 0x7f3a2406f190 2024-03-23T23:58:28.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.950+0000 7f3a1be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a24152ff0 0x7f3a24151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:28.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.950+0000 7f3a1be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a24152ff0 0x7f3a24151e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58632/0 (socket says 172.21.15.8:58632) 2024-03-23T23:58:28.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.950+0000 7f3a1be00640 1 -- 172.21.15.8:0/679655477 learned_addr learned my addr 172.21.15.8:0/679655477 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:28.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.950+0000 7f3a29200640 1 --2- 172.21.15.8:0/679655477 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a2406f190 0x7f3a2406cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:28.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.954+0000 7f3a29c00640 1 --2- 172.21.15.8:0/679655477 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3a24159860 0x7f3a2414a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:28.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.954+0000 7f3a1be00640 1 -- 172.21.15.8:0/679655477 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a2406f190 msgr2=0x7f3a2406cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:28.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.954+0000 7f3a1be00640 1 --2- 172.21.15.8:0/679655477 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a2406f190 0x7f3a2406cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.954+0000 7f3a1be00640 1 -- 172.21.15.8:0/679655477 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3a24159860 msgr2=0x7f3a2414a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:28.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.954+0000 7f3a1be00640 1 --2- 172.21.15.8:0/679655477 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3a24159860 0x7f3a2414a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.954+0000 7f3a1be00640 1 -- 172.21.15.8:0/679655477 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2406d1b0 con 0x7f3a24152ff0 2024-03-23T23:58:28.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.954+0000 7f3a1be00640 1 --2- 172.21.15.8:0/679655477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a24152ff0 0x7f3a24151e20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0ae040 tx=0x7f3a0c0191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:28.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.954+0000 7f3a21600640 1 -- 172.21.15.8:0/679655477 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c0b0040 con 0x7f3a24152ff0 2024-03-23T23:58:28.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.954+0000 7f3a21600640 1 -- 172.21.15.8:0/679655477 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0c0b43f0 con 0x7f3a24152ff0 2024-03-23T23:58:28.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.954+0000 7f3a21600640 1 -- 172.21.15.8:0/679655477 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c0b47c0 con 0x7f3a24152ff0 2024-03-23T23:58:28.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.954+0000 7f3a2bc00640 1 -- 172.21.15.8:0/679655477 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a2406d490 con 0x7f3a24152ff0 2024-03-23T23:58:28.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.954+0000 7f3a2bc00640 1 -- 172.21.15.8:0/679655477 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a24154250 con 0x7f3a24152ff0 2024-03-23T23:58:28.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.954+0000 7f3a2bc00640 1 -- 172.21.15.8:0/679655477 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a2404f410 con 0x7f3a24152ff0 2024-03-23T23:58:28.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.954+0000 7f3a21600640 1 -- 172.21.15.8:0/679655477 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3a0c0b4960 con 0x7f3a24152ff0 2024-03-23T23:58:28.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.954+0000 7f3a21600640 1 --2- 172.21.15.8:0/679655477 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3a00067660 0x7f3a00069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:28.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.954+0000 7f3a21600640 1 -- 172.21.15.8:0/679655477 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f3a0c11f6c0 con 0x7f3a24152ff0 2024-03-23T23:58:28.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.958+0000 7f3a29200640 1 --2- 172.21.15.8:0/679655477 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3a00067660 0x7f3a00069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:28.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.958+0000 7f3a29200640 1 --2- 172.21.15.8:0/679655477 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3a00067660 0x7f3a00069b20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3a240c6d10 tx=0x7f3a14009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:28.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:28.958+0000 7f3a21600640 1 -- 172.21.15.8:0/679655477 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f3a0c016090 con 0x7f3a24152ff0 2024-03-23T23:58:29.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.122+0000 7f3a2bc00640 1 -- 172.21.15.8:0/679655477 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7f3a240c8d40 con 0x7f3a24152ff0 2024-03-23T23:58:29.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.122+0000 7f3a21600640 1 -- 172.21.15.8:0/679655477 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v27) v1 ==== 95+0+11 (secure 0 0 0) 0x7f3a0c0ef920 con 0x7f3a24152ff0 2024-03-23T23:58:29.125 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-03-23T23:58:29.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.126+0000 7f3a2bc00640 1 -- 172.21.15.8:0/679655477 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3a00067660 msgr2=0x7f3a00069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.126+0000 7f3a2bc00640 1 --2- 172.21.15.8:0/679655477 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3a00067660 0x7f3a00069b20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3a240c6d10 tx=0x7f3a14009190 comp rx=0 tx=0).stop 2024-03-23T23:58:29.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.126+0000 7f3a2bc00640 1 -- 172.21.15.8:0/679655477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a24152ff0 msgr2=0x7f3a24151e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.126+0000 7f3a2bc00640 1 --2- 172.21.15.8:0/679655477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a24152ff0 0x7f3a24151e20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0ae040 tx=0x7f3a0c0191b0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.126+0000 7f3a2bc00640 1 -- 172.21.15.8:0/679655477 shutdown_connections 2024-03-23T23:58:29.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.126+0000 7f3a2bc00640 1 --2- 172.21.15.8:0/679655477 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3a24159860 0x7f3a2414a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.126+0000 7f3a2bc00640 1 --2- 172.21.15.8:0/679655477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a24152ff0 0x7f3a24151e20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.126+0000 7f3a2bc00640 1 --2- 172.21.15.8:0/679655477 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3a00067660 0x7f3a00069b20 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.126+0000 7f3a2bc00640 1 --2- 172.21.15.8:0/679655477 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a2406f190 0x7f3a2406cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.126+0000 7f3a2bc00640 1 -- 172.21.15.8:0/679655477 >> 172.21.15.8:0/679655477 conn(0x7f3a240aad10 msgr2=0x7f3a24070cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:29.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.126+0000 7f3a2bc00640 1 -- 172.21.15.8:0/679655477 shutdown_connections 2024-03-23T23:58:29.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.126+0000 7f3a2bc00640 1 -- 172.21.15.8:0/679655477 wait complete. 2024-03-23T23:58:29.147 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-03-23T23:58:29.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.290+0000 7f2271000640 1 Processor -- start 2024-03-23T23:58:29.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.290+0000 7f2271000640 1 -- start start 2024-03-23T23:58:29.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.290+0000 7f2271000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f226c0c6e40 0x7f226c0c2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.290+0000 7f2271000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f226c15e100 0x7f226c1604f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.290+0000 7f2271000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f226c1531f0 con 0x7f226c0c2370 2024-03-23T23:58:29.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.290+0000 7f2271000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f226c06d6a0 con 0x7f226c15e100 2024-03-23T23:58:29.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.290+0000 7f2271000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f226c1559a0 con 0x7f226c0c6e40 2024-03-23T23:58:29.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.290+0000 7f226a800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f226c15e100 0x7f226c1604f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.290+0000 7f226a800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f226c15e100 0x7f226c1604f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58646/0 (socket says 172.21.15.8:58646) 2024-03-23T23:58:29.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.290+0000 7f226a800640 1 -- 172.21.15.8:0/3622163126 learned_addr learned my addr 172.21.15.8:0/3622163126 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:29.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.290+0000 7f2269e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f226c0c2370 0x7f226c06db30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:35426/0 (socket says 172.21.15.8:35426) 2024-03-23T23:58:29.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.290+0000 7f2263e00640 1 --2- 172.21.15.8:0/3622163126 >> v2:172.21.15.196:3300/0 conn(0x7f226c0c6e40 0x7f226c0c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.294+0000 7f2263e00640 1 -- 172.21.15.8:0/3622163126 >> v2:172.21.15.8:3300/0 conn(0x7f226c15e100 msgr2=0x7f226c1604f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:29.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.294+0000 7f2263e00640 1 --2- 172.21.15.8:0/3622163126 >> v2:172.21.15.8:3300/0 conn(0x7f226c15e100 0x7f226c1604f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.294+0000 7f2263e00640 1 -- 172.21.15.8:0/3622163126 >> v1:172.21.15.8:6789/0 conn(0x7f226c0c2370 legacy=0x7f226c06db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.294+0000 7f2263e00640 1 -- 172.21.15.8:0/3622163126 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226c06d050 con 0x7f226c0c6e40 2024-03-23T23:58:29.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.294+0000 7f226a800640 1 --2- 172.21.15.8:0/3622163126 >> v2:172.21.15.8:3300/0 conn(0x7f226c15e100 0x7f226c1604f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:58:29.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.294+0000 7f2269400640 1 -- 172.21.15.8:0/3622163126 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1703568697 0 0) 0x7f226c1531f0 con 0x7f226c0c2370 2024-03-23T23:58:29.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.294+0000 7f2263e00640 1 --2- 172.21.15.8:0/3622163126 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f226c0c6e40 0x7f226c0c2750 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f226c0c6a70 tx=0x7f225401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=428d36747fb0a60a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:29.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.294+0000 7f2269400640 1 -- 172.21.15.8:0/3622163126 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22540b0070 con 0x7f226c0c6e40 2024-03-23T23:58:29.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.294+0000 7f2269400640 1 -- 172.21.15.8:0/3622163126 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22540ab600 con 0x7f226c0c6e40 2024-03-23T23:58:29.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.294+0000 7f2269400640 1 -- 172.21.15.8:0/3622163126 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22540ab9d0 con 0x7f226c0c6e40 2024-03-23T23:58:29.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.294+0000 7f2271000640 1 -- 172.21.15.8:0/3622163126 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f226c0c6e40 msgr2=0x7f226c0c2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.294+0000 7f2271000640 1 --2- 172.21.15.8:0/3622163126 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f226c0c6e40 0x7f226c0c2750 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f226c0c6a70 tx=0x7f225401c3f0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.294+0000 7f2271000640 1 -- 172.21.15.8:0/3622163126 shutdown_connections 2024-03-23T23:58:29.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.294+0000 7f2271000640 1 --2- 172.21.15.8:0/3622163126 >> v2:172.21.15.8:3300/0 conn(0x7f226c15e100 0x7f226c1604f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.294+0000 7f2271000640 1 --2- 172.21.15.8:0/3622163126 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f226c0c6e40 0x7f226c0c2750 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.294+0000 7f2271000640 1 -- 172.21.15.8:0/3622163126 >> 172.21.15.8:0/3622163126 conn(0x7f226c0aacf0 msgr2=0x7f226c0ab100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:29.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.294+0000 7f2271000640 1 -- 172.21.15.8:0/3622163126 shutdown_connections 2024-03-23T23:58:29.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.298+0000 7f2271000640 1 -- 172.21.15.8:0/3622163126 wait complete. 2024-03-23T23:58:29.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.298+0000 7f2271000640 1 Processor -- start 2024-03-23T23:58:29.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.298+0000 7f2271000640 1 -- start start 2024-03-23T23:58:29.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.298+0000 7f2271000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f226c0c2370 0x7f226c1ef5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.298+0000 7f2271000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f226c0c6e40 0x7f226c1f1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.298+0000 7f2271000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f226c15e100 0x7f226c1f1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.298+0000 7f2271000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226c0c8be0 con 0x7f226c0c2370 2024-03-23T23:58:29.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.298+0000 7f2271000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226c0ab810 con 0x7f226c15e100 2024-03-23T23:58:29.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.298+0000 7f2271000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226c0c8360 con 0x7f226c0c6e40 2024-03-23T23:58:29.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.298+0000 7f2269e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f226c0c2370 0x7f226c1ef5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.298+0000 7f2269e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f226c0c2370 0x7f226c1ef5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58652/0 (socket says 172.21.15.8:58652) 2024-03-23T23:58:29.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.298+0000 7f2269e00640 1 -- 172.21.15.8:0/3334054676 learned_addr learned my addr 172.21.15.8:0/3334054676 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:29.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.298+0000 7f226a800640 1 --2- 172.21.15.8:0/3334054676 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f226c15e100 0x7f226c1f1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.298+0000 7f2263e00640 1 --2- 172.21.15.8:0/3334054676 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f226c0c6e40 0x7f226c1f1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.298+0000 7f2269e00640 1 -- 172.21.15.8:0/3334054676 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f226c0c6e40 msgr2=0x7f226c1f1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.298+0000 7f2269e00640 1 --2- 172.21.15.8:0/3334054676 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f226c0c6e40 0x7f226c1f1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.298+0000 7f2269e00640 1 -- 172.21.15.8:0/3334054676 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f226c15e100 msgr2=0x7f226c1f1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.298+0000 7f2269e00640 1 --2- 172.21.15.8:0/3334054676 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f226c15e100 0x7f226c1f1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.298+0000 7f2269e00640 1 -- 172.21.15.8:0/3334054676 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226c1f2420 con 0x7f226c0c2370 2024-03-23T23:58:29.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.298+0000 7f2269e00640 1 --2- 172.21.15.8:0/3334054676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f226c0c2370 0x7f226c1ef5a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f225c00c4b0 tx=0x7f225c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:29.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.298+0000 7f2262000640 1 -- 172.21.15.8:0/3334054676 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c018070 con 0x7f226c0c2370 2024-03-23T23:58:29.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.298+0000 7f2262000640 1 -- 172.21.15.8:0/3334054676 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225c007500 con 0x7f226c0c2370 2024-03-23T23:58:29.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.298+0000 7f2271000640 1 -- 172.21.15.8:0/3334054676 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f226c15ad40 con 0x7f226c0c2370 2024-03-23T23:58:29.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.298+0000 7f2262000640 1 -- 172.21.15.8:0/3334054676 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c004a30 con 0x7f226c0c2370 2024-03-23T23:58:29.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.298+0000 7f2271000640 1 -- 172.21.15.8:0/3334054676 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226c15b300 con 0x7f226c0c2370 2024-03-23T23:58:29.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.302+0000 7f2271000640 1 -- 172.21.15.8:0/3334054676 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f226c04f410 con 0x7f226c0c2370 2024-03-23T23:58:29.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.302+0000 7f2262000640 1 -- 172.21.15.8:0/3334054676 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f225c01b070 con 0x7f226c0c2370 2024-03-23T23:58:29.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.302+0000 7f2262000640 1 --2- 172.21.15.8:0/3334054676 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2248067660 0x7f2248069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.302+0000 7f2262000640 1 -- 172.21.15.8:0/3334054676 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f225c084ef0 con 0x7f226c0c2370 2024-03-23T23:58:29.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.302+0000 7f2263e00640 1 --2- 172.21.15.8:0/3334054676 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2248067660 0x7f2248069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.302+0000 7f2263e00640 1 --2- 172.21.15.8:0/3334054676 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2248067660 0x7f2248069b20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f22540ad000 tx=0x7f22540a4f90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:29.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.310+0000 7f2262000640 1 -- 172.21.15.8:0/3334054676 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f225c055150 con 0x7f226c0c2370 2024-03-23T23:58:29.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.474+0000 7f2271000640 1 -- 172.21.15.8:0/3334054676 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) v1 -- 0x7f226c0af2d0 con 0x7f226c0c2370 2024-03-23T23:58:29.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.474+0000 7f2262000640 1 -- 172.21.15.8:0/3334054676 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v27) v1 ==== 99+0+11 (secure 0 0 0) 0x7f225c0591f0 con 0x7f226c0c2370 2024-03-23T23:58:29.475 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-03-23T23:58:29.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.474+0000 7f2271000640 1 -- 172.21.15.8:0/3334054676 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2248067660 msgr2=0x7f2248069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.474+0000 7f2271000640 1 --2- 172.21.15.8:0/3334054676 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2248067660 0x7f2248069b20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f22540ad000 tx=0x7f22540a4f90 comp rx=0 tx=0).stop 2024-03-23T23:58:29.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.474+0000 7f2271000640 1 -- 172.21.15.8:0/3334054676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f226c0c2370 msgr2=0x7f226c1ef5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.474+0000 7f2271000640 1 --2- 172.21.15.8:0/3334054676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f226c0c2370 0x7f226c1ef5a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f225c00c4b0 tx=0x7f225c00c970 comp rx=0 tx=0).stop 2024-03-23T23:58:29.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.474+0000 7f2271000640 1 -- 172.21.15.8:0/3334054676 shutdown_connections 2024-03-23T23:58:29.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.474+0000 7f2271000640 1 --2- 172.21.15.8:0/3334054676 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f226c15e100 0x7f226c1f1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.474+0000 7f2271000640 1 --2- 172.21.15.8:0/3334054676 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2248067660 0x7f2248069b20 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.474+0000 7f2271000640 1 --2- 172.21.15.8:0/3334054676 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f226c0c6e40 0x7f226c1f1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.474+0000 7f2271000640 1 --2- 172.21.15.8:0/3334054676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f226c0c2370 0x7f226c1ef5a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.474+0000 7f2271000640 1 -- 172.21.15.8:0/3334054676 >> 172.21.15.8:0/3334054676 conn(0x7f226c0aacf0 msgr2=0x7f226c06db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:29.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.474+0000 7f2271000640 1 -- 172.21.15.8:0/3334054676 shutdown_connections 2024-03-23T23:58:29.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.474+0000 7f2271000640 1 -- 172.21.15.8:0/3334054676 wait complete. 2024-03-23T23:58:29.505 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-03-23T23:58:29.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.650+0000 7f62b9000640 1 Processor -- start 2024-03-23T23:58:29.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.650+0000 7f62b9000640 1 -- start start 2024-03-23T23:58:29.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.650+0000 7f62b9000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f62b414c5e0 0x7f62b406dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.650+0000 7f62b9000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f62b40a9500 0x7f62b40c2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.650+0000 7f62b9000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62b406fb50 con 0x7f62b40c2eb0 2024-03-23T23:58:29.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.650+0000 7f62b9000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62b4156ae0 con 0x7f62b414c5e0 2024-03-23T23:58:29.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.650+0000 7f62b9000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b414c9c0 con 0x7f62b40a9500 2024-03-23T23:58:29.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.650+0000 7f62b1e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f62b414c5e0 0x7f62b406dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.650+0000 7f62b2800640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f62b40c2eb0 0x7f62b4155b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:35440/0 (socket says 172.21.15.8:35440) 2024-03-23T23:58:29.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.650+0000 7f62b2800640 1 -- 172.21.15.8:0/3086263737 learned_addr learned my addr 172.21.15.8:0/3086263737 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:58:29.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.650+0000 7f62b1400640 1 --2- 172.21.15.8:0/3086263737 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f62b40a9500 0x7f62b40c2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.650+0000 7f62b1e00640 1 -- 172.21.15.8:0/3086263737 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f62b40a9500 msgr2=0x7f62b40c2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:29.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.650+0000 7f62b1e00640 1 --2- 172.21.15.8:0/3086263737 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f62b40a9500 0x7f62b40c2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.650+0000 7f62b1e00640 1 -- 172.21.15.8:0/3086263737 >> v1:172.21.15.8:6789/0 conn(0x7f62b40c2eb0 legacy=0x7f62b4155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.650+0000 7f62b1e00640 1 -- 172.21.15.8:0/3086263737 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b4156800 con 0x7f62b414c5e0 2024-03-23T23:58:29.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.650+0000 7f62b0a00640 1 -- 172.21.15.8:0/3086263737 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 113110271 0 0) 0x7f62b406fb50 con 0x7f62b40c2eb0 2024-03-23T23:58:29.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.654+0000 7f62b1e00640 1 --2- 172.21.15.8:0/3086263737 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62b414c5e0 0x7f62b406dfd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f62a40097c0 tx=0x7f62a401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f32c3c9beddba84 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:29.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.654+0000 7f62b0a00640 1 -- 172.21.15.8:0/3086263737 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a40b0070 con 0x7f62b414c5e0 2024-03-23T23:58:29.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.654+0000 7f62b0a00640 1 -- 172.21.15.8:0/3086263737 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a40ab600 con 0x7f62b414c5e0 2024-03-23T23:58:29.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.654+0000 7f62b0a00640 1 -- 172.21.15.8:0/3086263737 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a40ab9d0 con 0x7f62b414c5e0 2024-03-23T23:58:29.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.654+0000 7f62b9000640 1 -- 172.21.15.8:0/3086263737 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62b414c5e0 msgr2=0x7f62b406dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.654+0000 7f62b9000640 1 --2- 172.21.15.8:0/3086263737 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62b414c5e0 0x7f62b406dfd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f62a40097c0 tx=0x7f62a401c410 comp rx=0 tx=0).stop 2024-03-23T23:58:29.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.654+0000 7f62b9000640 1 -- 172.21.15.8:0/3086263737 shutdown_connections 2024-03-23T23:58:29.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.654+0000 7f62b9000640 1 --2- 172.21.15.8:0/3086263737 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f62b40a9500 0x7f62b40c2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.654+0000 7f62b9000640 1 --2- 172.21.15.8:0/3086263737 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62b414c5e0 0x7f62b406dfd0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.654+0000 7f62b9000640 1 -- 172.21.15.8:0/3086263737 >> 172.21.15.8:0/3086263737 conn(0x7f62b40c4a70 msgr2=0x7f62b40c4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:29.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.654+0000 7f62b9000640 1 -- 172.21.15.8:0/3086263737 shutdown_connections 2024-03-23T23:58:29.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.654+0000 7f62b9000640 1 -- 172.21.15.8:0/3086263737 wait complete. 2024-03-23T23:58:29.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.658+0000 7f62b9000640 1 Processor -- start 2024-03-23T23:58:29.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.658+0000 7f62b9000640 1 -- start start 2024-03-23T23:58:29.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.658+0000 7f62b9000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f62b40a9500 0x7f62b415b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.658+0000 7f62b9000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62b40c2eb0 0x7f62b4155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.658+0000 7f62b9000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62b414c5e0 0x7f62b41408d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.658+0000 7f62b9000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b415f840 con 0x7f62b414c5e0 2024-03-23T23:58:29.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.658+0000 7f62b9000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b415f6c0 con 0x7f62b40c2eb0 2024-03-23T23:58:29.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.658+0000 7f62b9000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b415f9c0 con 0x7f62b40a9500 2024-03-23T23:58:29.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.658+0000 7f62b1e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f62b40a9500 0x7f62b415b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.658+0000 7f62b2800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62b414c5e0 0x7f62b41408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.658+0000 7f62b1e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f62b40a9500 0x7f62b415b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:51412/0 (socket says 172.21.15.8:51412) 2024-03-23T23:58:29.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.658+0000 7f62b1e00640 1 -- 172.21.15.8:0/2855916417 learned_addr learned my addr 172.21.15.8:0/2855916417 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:29.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.658+0000 7f62b1400640 1 --2- 172.21.15.8:0/2855916417 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62b40c2eb0 0x7f62b4155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.662+0000 7f62b1e00640 1 -- 172.21.15.8:0/2855916417 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62b40c2eb0 msgr2=0x7f62b4155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.662+0000 7f62b1e00640 1 --2- 172.21.15.8:0/2855916417 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62b40c2eb0 0x7f62b4155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.662+0000 7f62b1e00640 1 -- 172.21.15.8:0/2855916417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62b414c5e0 msgr2=0x7f62b41408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.662+0000 7f62b1e00640 1 --2- 172.21.15.8:0/2855916417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62b414c5e0 0x7f62b41408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.662+0000 7f62b1e00640 1 -- 172.21.15.8:0/2855916417 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b4144b40 con 0x7f62b40a9500 2024-03-23T23:58:29.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.662+0000 7f62b1e00640 1 --2- 172.21.15.8:0/2855916417 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f62b40a9500 0x7f62b415b4e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f62a401a040 tx=0x7f62a401ac50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:29.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.662+0000 7f62aa000640 1 -- 172.21.15.8:0/2855916417 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a40b0050 con 0x7f62b40a9500 2024-03-23T23:58:29.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.662+0000 7f62aa000640 1 -- 172.21.15.8:0/2855916417 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a40bc070 con 0x7f62b40a9500 2024-03-23T23:58:29.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.662+0000 7f62b9000640 1 -- 172.21.15.8:0/2855916417 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b4144de0 con 0x7f62b40a9500 2024-03-23T23:58:29.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.662+0000 7f62aa000640 1 -- 172.21.15.8:0/2855916417 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a40b5830 con 0x7f62b40a9500 2024-03-23T23:58:29.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.662+0000 7f62b9000640 1 -- 172.21.15.8:0/2855916417 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b41453a0 con 0x7f62b40a9500 2024-03-23T23:58:29.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.662+0000 7f62b9000640 1 -- 172.21.15.8:0/2855916417 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b404f410 con 0x7f62b40a9500 2024-03-23T23:58:29.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.662+0000 7f62aa000640 1 -- 172.21.15.8:0/2855916417 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f62a40b59d0 con 0x7f62b40a9500 2024-03-23T23:58:29.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.666+0000 7f62aa000640 1 --2- 172.21.15.8:0/2855916417 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6294067660 0x7f6294069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.666+0000 7f62aa000640 1 -- 172.21.15.8:0/2855916417 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f62a4120470 con 0x7f62b40a9500 2024-03-23T23:58:29.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.666+0000 7f62b1400640 1 --2- 172.21.15.8:0/2855916417 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6294067660 0x7f6294069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.666+0000 7f62b1400640 1 --2- 172.21.15.8:0/2855916417 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6294067660 0x7f6294069b20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f62b414b220 tx=0x7f62a0009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:29.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.670+0000 7f62aa000640 1 -- 172.21.15.8:0/2855916417 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f62a4016090 con 0x7f62b40a9500 2024-03-23T23:58:29.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.834+0000 7f62b9000640 1 -- 172.21.15.8:0/2855916417 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) v1 -- 0x7f62b40c4e50 con 0x7f62b40a9500 2024-03-23T23:58:29.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.834+0000 7f62aa000640 1 -- 172.21.15.8:0/2855916417 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v27) v1 ==== 95+0+11 (secure 0 0 0) 0x7f62a40df020 con 0x7f62b40a9500 2024-03-23T23:58:29.837 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-03-23T23:58:29.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.838+0000 7f62b9000640 1 -- 172.21.15.8:0/2855916417 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6294067660 msgr2=0x7f6294069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.838+0000 7f62b9000640 1 --2- 172.21.15.8:0/2855916417 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6294067660 0x7f6294069b20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f62b414b220 tx=0x7f62a0009190 comp rx=0 tx=0).stop 2024-03-23T23:58:29.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.838+0000 7f62b9000640 1 -- 172.21.15.8:0/2855916417 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f62b40a9500 msgr2=0x7f62b415b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.838+0000 7f62b9000640 1 --2- 172.21.15.8:0/2855916417 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f62b40a9500 0x7f62b415b4e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f62a401a040 tx=0x7f62a401ac50 comp rx=0 tx=0).stop 2024-03-23T23:58:29.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.838+0000 7f62b9000640 1 -- 172.21.15.8:0/2855916417 shutdown_connections 2024-03-23T23:58:29.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.838+0000 7f62b9000640 1 --2- 172.21.15.8:0/2855916417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62b414c5e0 0x7f62b41408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.838+0000 7f62b9000640 1 --2- 172.21.15.8:0/2855916417 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62b40c2eb0 0x7f62b4155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.838+0000 7f62b9000640 1 --2- 172.21.15.8:0/2855916417 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6294067660 0x7f6294069b20 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.838+0000 7f62b9000640 1 --2- 172.21.15.8:0/2855916417 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f62b40a9500 0x7f62b415b4e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.838+0000 7f62b9000640 1 -- 172.21.15.8:0/2855916417 >> 172.21.15.8:0/2855916417 conn(0x7f62b40c4a70 msgr2=0x7f62b414a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:29.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.838+0000 7f62b9000640 1 -- 172.21.15.8:0/2855916417 shutdown_connections 2024-03-23T23:58:29.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.838+0000 7f62b9000640 1 -- 172.21.15.8:0/2855916417 wait complete. 2024-03-23T23:58:29.858 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-23T23:58:30.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.998+0000 7f53aa200640 1 Processor -- start 2024-03-23T23:58:30.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:29.998+0000 7f53aa200640 1 -- start start 2024-03-23T23:58:30.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.002+0000 7f53aa200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53a414fc70 0x7f53a40c3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:30.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.002+0000 7f53aa200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f53a40c4160 0x7f53a4152f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:30.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.002+0000 7f53aa200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a40c2f70 con 0x7f53a40c3d00 2024-03-23T23:58:30.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.002+0000 7f53aa200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53a40c36a0 con 0x7f53a40c4160 2024-03-23T23:58:30.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.002+0000 7f53aa200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a4155e70 con 0x7f53a414fc70 2024-03-23T23:58:30.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.002+0000 7f53a3400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53a414fc70 0x7f53a40c3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:30.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.002+0000 7f53a3400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53a414fc70 0x7f53a40c3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:51418/0 (socket says 172.21.15.8:51418) 2024-03-23T23:58:30.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.002+0000 7f53a3400640 1 -- 172.21.15.8:0/3519819450 learned_addr learned my addr 172.21.15.8:0/3519819450 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:30.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.002+0000 7f53a3e00640 1 --2- 172.21.15.8:0/3519819450 >> v2:172.21.15.196:3300/0 conn(0x7f53a40c4160 0x7f53a4152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:30.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.002+0000 7f53a3400640 1 -- 172.21.15.8:0/3519819450 >> v2:172.21.15.196:3300/0 conn(0x7f53a40c4160 msgr2=0x7f53a4152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:30.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.002+0000 7f53a3400640 1 --2- 172.21.15.8:0/3519819450 >> v2:172.21.15.196:3300/0 conn(0x7f53a40c4160 0x7f53a4152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:30.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.002+0000 7f53a3400640 1 -- 172.21.15.8:0/3519819450 >> v1:172.21.15.196:6789/0 conn(0x7f53a40c3d00 legacy=0x7f53a4152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:30.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.002+0000 7f53a3400640 1 -- 172.21.15.8:0/3519819450 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a4156150 con 0x7f53a414fc70 2024-03-23T23:58:30.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.006+0000 7f53a3400640 1 --2- 172.21.15.8:0/3519819450 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53a414fc70 0x7f53a40c3160 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5394009870 tx=0x7f539401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bda8a3c91e92447b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:30.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.006+0000 7f53a2a00640 1 -- 172.21.15.8:0/3519819450 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53940b1070 con 0x7f53a414fc70 2024-03-23T23:58:30.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.006+0000 7f53a2a00640 1 -- 172.21.15.8:0/3519819450 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53940a8050 con 0x7f53a414fc70 2024-03-23T23:58:30.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.006+0000 7f53a2a00640 1 -- 172.21.15.8:0/3519819450 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53940ac860 con 0x7f53a414fc70 2024-03-23T23:58:30.007 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.006+0000 7f53aa200640 1 -- 172.21.15.8:0/3519819450 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53a414fc70 msgr2=0x7f53a40c3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:30.007 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.006+0000 7f53aa200640 1 --2- 172.21.15.8:0/3519819450 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53a414fc70 0x7f53a40c3160 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5394009870 tx=0x7f539401c4d0 comp rx=0 tx=0).stop 2024-03-23T23:58:30.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.006+0000 7f53aa200640 1 -- 172.21.15.8:0/3519819450 shutdown_connections 2024-03-23T23:58:30.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.006+0000 7f53aa200640 1 --2- 172.21.15.8:0/3519819450 >> v2:172.21.15.196:3300/0 conn(0x7f53a40c4160 0x7f53a4152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:30.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.006+0000 7f53aa200640 1 --2- 172.21.15.8:0/3519819450 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53a414fc70 0x7f53a40c3160 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:30.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.006+0000 7f53aa200640 1 -- 172.21.15.8:0/3519819450 >> 172.21.15.8:0/3519819450 conn(0x7f53a406b170 msgr2=0x7f53a406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:30.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.006+0000 7f53aa200640 1 -- 172.21.15.8:0/3519819450 shutdown_connections 2024-03-23T23:58:30.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.006+0000 7f53aa200640 1 -- 172.21.15.8:0/3519819450 wait complete. 2024-03-23T23:58:30.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.006+0000 7f53aa200640 1 Processor -- start 2024-03-23T23:58:30.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.006+0000 7f53aa200640 1 -- start start 2024-03-23T23:58:30.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.010+0000 7f53aa200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53a40c3d00 0x7f53a40c5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:30.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.010+0000 7f53aa200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53a40c4160 0x7f53a40c73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:30.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.010+0000 7f53aa200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53a414fc70 0x7f53a4155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:30.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.010+0000 7f53aa200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a40c18d0 con 0x7f53a40c4160 2024-03-23T23:58:30.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.010+0000 7f53aa200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a41534a0 con 0x7f53a40c3d00 2024-03-23T23:58:30.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.010+0000 7f53aa200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a4150050 con 0x7f53a414fc70 2024-03-23T23:58:30.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.010+0000 7f539be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53a40c4160 0x7f53a40c73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:30.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.010+0000 7f53a3400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53a40c3d00 0x7f53a40c5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:30.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.010+0000 7f539be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53a40c4160 0x7f53a40c73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58656/0 (socket says 172.21.15.8:58656) 2024-03-23T23:58:30.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.010+0000 7f539be00640 1 -- 172.21.15.8:0/2687607598 learned_addr learned my addr 172.21.15.8:0/2687607598 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:30.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.010+0000 7f53a3e00640 1 --2- 172.21.15.8:0/2687607598 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53a414fc70 0x7f53a4155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:30.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.010+0000 7f53a3400640 1 -- 172.21.15.8:0/2687607598 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53a414fc70 msgr2=0x7f53a4155480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:30.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.010+0000 7f53a3400640 1 --2- 172.21.15.8:0/2687607598 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53a414fc70 0x7f53a4155480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:30.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.010+0000 7f53a3400640 1 -- 172.21.15.8:0/2687607598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53a40c4160 msgr2=0x7f53a40c73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:30.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.010+0000 7f53a3400640 1 --2- 172.21.15.8:0/2687607598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53a40c4160 0x7f53a40c73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.010+0000 7f53a3400640 1 -- 172.21.15.8:0/2687607598 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a40c7c90 con 0x7f53a40c3d00 2024-03-23T23:58:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.010+0000 7f539be00640 1 --2- 172.21.15.8:0/2687607598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53a40c4160 0x7f53a40c73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:58:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.010+0000 7f53a3400640 1 --2- 172.21.15.8:0/2687607598 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53a40c3d00 0x7f53a40c5870 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f53940ac000 tx=0x7f5394019270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:30.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.010+0000 7f539b400640 1 -- 172.21.15.8:0/2687607598 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53940b1040 con 0x7f53a40c3d00 2024-03-23T23:58:30.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.010+0000 7f539b400640 1 -- 172.21.15.8:0/2687607598 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53940acbd0 con 0x7f53a40c3d00 2024-03-23T23:58:30.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.010+0000 7f539b400640 1 -- 172.21.15.8:0/2687607598 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53940b5440 con 0x7f53a40c3d00 2024-03-23T23:58:30.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.010+0000 7f53aa200640 1 -- 172.21.15.8:0/2687607598 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a40c5250 con 0x7f53a40c3d00 2024-03-23T23:58:30.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.010+0000 7f53aa200640 1 -- 172.21.15.8:0/2687607598 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a4145960 con 0x7f53a40c3d00 2024-03-23T23:58:30.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.010+0000 7f53aa200640 1 -- 172.21.15.8:0/2687607598 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53a40c5070 con 0x7f53a40c3d00 2024-03-23T23:58:30.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.010+0000 7f539b400640 1 -- 172.21.15.8:0/2687607598 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f53940bc020 con 0x7f53a40c3d00 2024-03-23T23:58:30.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.014+0000 7f539b400640 1 --2- 172.21.15.8:0/2687607598 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5380067660 0x7f5380069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:30.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.014+0000 7f539b400640 1 -- 172.21.15.8:0/2687607598 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f539411edf0 con 0x7f53a40c3d00 2024-03-23T23:58:30.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.014+0000 7f539be00640 1 --2- 172.21.15.8:0/2687607598 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5380067660 0x7f5380069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:30.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.014+0000 7f539be00640 1 --2- 172.21.15.8:0/2687607598 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5380067660 0x7f5380069b20 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f53a41539f0 tx=0x7f538c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:30.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.018+0000 7f539b400640 1 -- 172.21.15.8:0/2687607598 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f53a40c5070 con 0x7f53a40c3d00 2024-03-23T23:58:30.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.194+0000 7f53aa200640 1 -- 172.21.15.8:0/2687607598 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f53a4068270 con 0x7f53a40c3d00 2024-03-23T23:58:30.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.194+0000 7f539b400640 1 -- 172.21.15.8:0/2687607598 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f53940c3020 con 0x7f53a40c3d00 2024-03-23T23:58:30.196 INFO:teuthology.orchestra.run.smithi008.stderr:listed 0 entries 2024-03-23T23:58:30.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.198+0000 7f53aa200640 1 -- 172.21.15.8:0/2687607598 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5380067660 msgr2=0x7f5380069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:30.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.198+0000 7f53aa200640 1 --2- 172.21.15.8:0/2687607598 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5380067660 0x7f5380069b20 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f53a41539f0 tx=0x7f538c009040 comp rx=0 tx=0).stop 2024-03-23T23:58:30.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.198+0000 7f53aa200640 1 -- 172.21.15.8:0/2687607598 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53a40c3d00 msgr2=0x7f53a40c5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:30.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.198+0000 7f53aa200640 1 --2- 172.21.15.8:0/2687607598 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53a40c3d00 0x7f53a40c5870 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f53940ac000 tx=0x7f5394019270 comp rx=0 tx=0).stop 2024-03-23T23:58:30.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.198+0000 7f53aa200640 1 -- 172.21.15.8:0/2687607598 shutdown_connections 2024-03-23T23:58:30.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.198+0000 7f53aa200640 1 --2- 172.21.15.8:0/2687607598 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f5380067660 0x7f5380069b20 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:30.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.198+0000 7f53aa200640 1 --2- 172.21.15.8:0/2687607598 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53a414fc70 0x7f53a4155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:30.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.198+0000 7f53aa200640 1 --2- 172.21.15.8:0/2687607598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53a40c4160 0x7f53a40c73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:30.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.198+0000 7f53aa200640 1 --2- 172.21.15.8:0/2687607598 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53a40c3d00 0x7f53a40c5870 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:30.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.198+0000 7f53aa200640 1 -- 172.21.15.8:0/2687607598 >> 172.21.15.8:0/2687607598 conn(0x7f53a406b170 msgr2=0x7f53a414ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:30.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.198+0000 7f53aa200640 1 -- 172.21.15.8:0/2687607598 shutdown_connections 2024-03-23T23:58:30.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:30.198+0000 7f53aa200640 1 -- 172.21.15.8:0/2687607598 wait complete. 2024-03-23T23:58:30.217 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-03-23T23:58:30.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:58:30.217 DEBUG:teuthology.orchestra.run.smithi196:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-03-23T23:58:30.325 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi196.front.sepia.ceph.com 2024-03-23T23:58:30.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:58:30.325 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-23T23:58:30.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:58:30.412 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2024-03-23T23:58:30.433 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-23T23:58:30.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:58:30.434 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-23T23:58:30.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:58:30.512 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link delete ceph-brx 2024-03-23T23:58:30.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:58:30.717 DEBUG:teuthology.orchestra.run.smithi196:> ip netns list 2024-03-23T23:58:30.785 INFO:teuthology.orchestra.run.smithi196.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-23T23:58:30.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:58:30.786 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-23T23:58:30.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T23:58:30.807 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link delete ceph-brx 2024-03-23T23:58:31.022 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-23T23:58:31.030 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-23T23:58:31.031 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T23:58:31.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.170+0000 7feab1c00640 1 Processor -- start 2024-03-23T23:58:31.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.170+0000 7feab1c00640 1 -- start start 2024-03-23T23:58:31.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.170+0000 7feab1c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7feaac0c3d00 0x7feaac0c4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:31.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.170+0000 7feab1c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feaac152850 0x7feaac152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:31.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.170+0000 7feab1c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaac0c2f70 con 0x7feaac14fc70 2024-03-23T23:58:31.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.170+0000 7feab1c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaac155e70 con 0x7feaac0c3d00 2024-03-23T23:58:31.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.170+0000 7feab1c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaac156150 con 0x7feaac152850 2024-03-23T23:58:31.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.170+0000 7feaab400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feaac152850 0x7feaac152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:31.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.170+0000 7feaa2000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7feaac0c3d00 0x7feaac0c4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:31.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.170+0000 7feaaaa00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7feaac14fc70 0x7feaac0c3160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:44372/0 (socket says 172.21.15.8:44372) 2024-03-23T23:58:31.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.170+0000 7feaaaa00640 1 -- 172.21.15.8:0/3418442744 learned_addr learned my addr 172.21.15.8:0/3418442744 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:58:31.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.174+0000 7feaab400640 1 -- 172.21.15.8:0/3418442744 >> v2:172.21.15.196:3300/0 conn(0x7feaac0c3d00 msgr2=0x7feaac0c4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:31.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.174+0000 7feaab400640 1 --2- 172.21.15.8:0/3418442744 >> v2:172.21.15.196:3300/0 conn(0x7feaac0c3d00 0x7feaac0c4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.174+0000 7feaab400640 1 -- 172.21.15.8:0/3418442744 >> v1:172.21.15.196:6789/0 conn(0x7feaac14fc70 legacy=0x7feaac0c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.174+0000 7feaab400640 1 -- 172.21.15.8:0/3418442744 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac156430 con 0x7feaac152850 2024-03-23T23:58:31.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.174+0000 7feaa2000640 1 --2- 172.21.15.8:0/3418442744 >> v2:172.21.15.196:3300/0 conn(0x7feaac0c3d00 0x7feaac0c4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:58:31.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.174+0000 7feaab400640 1 --2- 172.21.15.8:0/3418442744 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feaac152850 0x7feaac152cc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feaa40097c0 tx=0x7feaa401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=218bbbaeb36f31a6 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:31.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.174+0000 7feaaa000640 1 -- 172.21.15.8:0/3418442744 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa40b0070 con 0x7feaac152850 2024-03-23T23:58:31.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.174+0000 7feaaa000640 1 -- 172.21.15.8:0/3418442744 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa40ab600 con 0x7feaac152850 2024-03-23T23:58:31.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.174+0000 7feaaa000640 1 -- 172.21.15.8:0/3418442744 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa40ab9d0 con 0x7feaac152850 2024-03-23T23:58:31.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.174+0000 7feab1c00640 1 -- 172.21.15.8:0/3418442744 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feaac152850 msgr2=0x7feaac152cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.174+0000 7feab1c00640 1 --2- 172.21.15.8:0/3418442744 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feaac152850 0x7feaac152cc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feaa40097c0 tx=0x7feaa401c410 comp rx=0 tx=0).stop 2024-03-23T23:58:31.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.178+0000 7feab1c00640 1 -- 172.21.15.8:0/3418442744 shutdown_connections 2024-03-23T23:58:31.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.178+0000 7feab1c00640 1 --2- 172.21.15.8:0/3418442744 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feaac152850 0x7feaac152cc0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.178+0000 7feab1c00640 1 --2- 172.21.15.8:0/3418442744 >> v2:172.21.15.196:3300/0 conn(0x7feaac0c3d00 0x7feaac0c4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.178+0000 7feab1c00640 1 -- 172.21.15.8:0/3418442744 >> 172.21.15.8:0/3418442744 conn(0x7feaac06b170 msgr2=0x7feaac06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:31.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.178+0000 7feab1c00640 1 -- 172.21.15.8:0/3418442744 shutdown_connections 2024-03-23T23:58:31.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.178+0000 7feab1c00640 1 -- 172.21.15.8:0/3418442744 wait complete. 2024-03-23T23:58:31.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.178+0000 7feab1c00640 1 Processor -- start 2024-03-23T23:58:31.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.178+0000 7feab1c00640 1 -- start start 2024-03-23T23:58:31.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.178+0000 7feab1c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feaac0c3d00 0x7feaac15c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:31.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.178+0000 7feab1c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feaac14fc70 0x7feaac145640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:31.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.178+0000 7feab1c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feaac152850 0x7feaac149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:31.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.178+0000 7feab1c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac15f880 con 0x7feaac152850 2024-03-23T23:58:31.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.178+0000 7feab1c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac150050 con 0x7feaac14fc70 2024-03-23T23:58:31.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.178+0000 7feab1c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaac15fa00 con 0x7feaac0c3d00 2024-03-23T23:58:31.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.178+0000 7feaaaa00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feaac0c3d00 0x7feaac15c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:31.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.178+0000 7feaa2000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feaac14fc70 0x7feaac145640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:31.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.178+0000 7feaaaa00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feaac0c3d00 0x7feaac15c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:51440/0 (socket says 172.21.15.8:51440) 2024-03-23T23:58:31.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.178+0000 7feaab400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feaac152850 0x7feaac149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:31.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.178+0000 7feaaaa00640 1 -- 172.21.15.8:0/2019817715 learned_addr learned my addr 172.21.15.8:0/2019817715 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:31.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.178+0000 7feaa2000640 1 -- 172.21.15.8:0/2019817715 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feaac0c3d00 msgr2=0x7feaac15c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.178+0000 7feaa2000640 1 --2- 172.21.15.8:0/2019817715 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feaac0c3d00 0x7feaac15c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.178+0000 7feaa2000640 1 -- 172.21.15.8:0/2019817715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feaac152850 msgr2=0x7feaac149fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.178+0000 7feaa2000640 1 --2- 172.21.15.8:0/2019817715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feaac152850 0x7feaac149fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.178+0000 7feaa2000640 1 -- 172.21.15.8:0/2019817715 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac14c120 con 0x7feaac14fc70 2024-03-23T23:58:31.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.178+0000 7feaa2000640 1 --2- 172.21.15.8:0/2019817715 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feaac14fc70 0x7feaac145640 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fea9400e9e0 tx=0x7fea9400eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:31.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.178+0000 7feaa3400640 1 -- 172.21.15.8:0/2019817715 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea94017070 con 0x7feaac14fc70 2024-03-23T23:58:31.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.178+0000 7feaa3400640 1 -- 172.21.15.8:0/2019817715 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9400c9d0 con 0x7feaac14fc70 2024-03-23T23:58:31.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.178+0000 7feab1c00640 1 -- 172.21.15.8:0/2019817715 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaac0ab080 con 0x7feaac14fc70 2024-03-23T23:58:31.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.178+0000 7feaa3400640 1 -- 172.21.15.8:0/2019817715 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9400cdc0 con 0x7feaac14fc70 2024-03-23T23:58:31.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.182+0000 7feab1c00640 1 -- 172.21.15.8:0/2019817715 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaac14c3e0 con 0x7feaac14fc70 2024-03-23T23:58:31.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.182+0000 7feab1c00640 1 -- 172.21.15.8:0/2019817715 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaac068270 con 0x7feaac14fc70 2024-03-23T23:58:31.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.182+0000 7feaa3400640 1 -- 172.21.15.8:0/2019817715 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fea9401a070 con 0x7feaac14fc70 2024-03-23T23:58:31.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.182+0000 7feaa3400640 1 --2- 172.21.15.8:0/2019817715 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fea88067690 0x7fea88069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:31.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.182+0000 7feaa3400640 1 -- 172.21.15.8:0/2019817715 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fea94085a40 con 0x7feaac14fc70 2024-03-23T23:58:31.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.182+0000 7feaaaa00640 1 --2- 172.21.15.8:0/2019817715 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fea88067690 0x7fea88069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:31.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.182+0000 7feaaaa00640 1 --2- 172.21.15.8:0/2019817715 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fea88067690 0x7fea88069b50 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fea9c005c10 tx=0x7fea9c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:31.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.186+0000 7feaa3400640 1 -- 172.21.15.8:0/2019817715 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fea94055ca0 con 0x7feaac14fc70 2024-03-23T23:58:31.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.346+0000 7feab1c00640 1 -- 172.21.15.8:0/2019817715 --> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feaac06b550 con 0x7fea88067690 2024-03-23T23:58:31.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.362+0000 7feaa3400640 1 -- 172.21.15.8:0/2019817715 <== mgr.4098 v2:172.21.15.196:6832/1295060067 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+494228 (secure 0 0 0) 0x7feaac06b550 con 0x7fea88067690 2024-03-23T23:58:31.369 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:58:31.372 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-03-23T23:58:31.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.366+0000 7feab1c00640 1 -- 172.21.15.8:0/2019817715 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fea88067690 msgr2=0x7fea88069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.366+0000 7feab1c00640 1 --2- 172.21.15.8:0/2019817715 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fea88067690 0x7fea88069b50 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fea9c005c10 tx=0x7fea9c009040 comp rx=0 tx=0).stop 2024-03-23T23:58:31.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.366+0000 7feab1c00640 1 -- 172.21.15.8:0/2019817715 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feaac14fc70 msgr2=0x7feaac145640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.366+0000 7feab1c00640 1 --2- 172.21.15.8:0/2019817715 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feaac14fc70 0x7feaac145640 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fea9400e9e0 tx=0x7fea9400eea0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.366+0000 7feab1c00640 1 -- 172.21.15.8:0/2019817715 shutdown_connections 2024-03-23T23:58:31.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.366+0000 7feab1c00640 1 --2- 172.21.15.8:0/2019817715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feaac152850 0x7feaac149fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.366+0000 7feab1c00640 1 --2- 172.21.15.8:0/2019817715 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feaac14fc70 0x7feaac145640 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.366+0000 7feab1c00640 1 --2- 172.21.15.8:0/2019817715 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fea88067690 0x7fea88069b50 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.366+0000 7feab1c00640 1 --2- 172.21.15.8:0/2019817715 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feaac0c3d00 0x7feaac15c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.366+0000 7feab1c00640 1 -- 172.21.15.8:0/2019817715 >> 172.21.15.8:0/2019817715 conn(0x7feaac06b170 msgr2=0x7feaac14dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:31.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.366+0000 7feab1c00640 1 -- 172.21.15.8:0/2019817715 shutdown_connections 2024-03-23T23:58:31.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.366+0000 7feab1c00640 1 -- 172.21.15.8:0/2019817715 wait complete. 2024-03-23T23:58:31.388 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":501,"stamp":"2024-03-23T23:58:29.726696+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":192276356,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":195,"num_read_kb":347,"num_write":9956061,"num_write_kb":116277055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":661393,"ondisk_log_size":661393,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":6481808,"kb_used_data":377872,"kb_used_omap":12,"kb_used_meta":6103859,"kb_avail":748492912,"statfs":{"total":773094113280,"available":766456741888,"internally_reserved":0,"allocated":386940928,"data_stored":385473696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":6250352176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,4,0,4,2,5,22],"upper_bound":512},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006588"},"pg_stats":[{"pgid":"5.18","version":"27'5444","reported_seq":5466,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.644986+0000","last_change":"2024-03-23T23:42:50.736219+0000","last_active":"2024-03-23T23:57:57.644986+0000","last_peered":"2024-03-23T23:57:57.644986+0000","last_clean":"2024-03-23T23:57:57.644986+0000","last_became_active":"2024-03-23T23:42:50.735940+0000","last_became_peered":"2024-03-23T23:42:50.735940+0000","last_unstale":"2024-03-23T23:57:57.644986+0000","last_undegraded":"2024-03-23T23:57:57.644986+0000","last_fullsized":"2024-03-23T23:57:57.644986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5444,"log_dups_size":0,"ondisk_log_size":5444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:11:44.111477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80864,"num_write_kb":923838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"27'57","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:59.870845+0000","last_change":"2024-03-23T23:42:39.693858+0000","last_active":"2024-03-23T23:54:59.870845+0000","last_peered":"2024-03-23T23:54:59.870845+0000","last_clean":"2024-03-23T23:54:59.870845+0000","last_became_active":"2024-03-23T23:42:39.693636+0000","last_became_peered":"2024-03-23T23:42:39.693636+0000","last_unstale":"2024-03-23T23:54:59.870845+0000","last_undegraded":"2024-03-23T23:54:59.870845+0000","last_fullsized":"2024-03-23T23:54:59.870845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:44:07.213123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'5379","reported_seq":5410,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:59.180370+0000","last_change":"2024-03-23T23:42:40.685708+0000","last_active":"2024-03-23T23:54:59.180370+0000","last_peered":"2024-03-23T23:54:59.180370+0000","last_clean":"2024-03-23T23:54:59.180370+0000","last_became_active":"2024-03-23T23:42:40.682755+0000","last_became_peered":"2024-03-23T23:42:40.682755+0000","last_unstale":"2024-03-23T23:54:59.180370+0000","last_undegraded":"2024-03-23T23:54:59.180370+0000","last_fullsized":"2024-03-23T23:54:59.180370+0000","mapping_epoch":19,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5279,"log_dups_size":0,"ondisk_log_size":5279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:04.633288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79922,"num_write_kb":951101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'4","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.420544+0000","last_change":"2024-03-23T23:42:49.750108+0000","last_active":"2024-03-23T23:57:53.420544+0000","last_peered":"2024-03-23T23:57:53.420544+0000","last_clean":"2024-03-23T23:57:53.420544+0000","last_became_active":"2024-03-23T23:42:49.749634+0000","last_became_peered":"2024-03-23T23:42:49.749634+0000","last_unstale":"2024-03-23T23:57:53.420544+0000","last_undegraded":"2024-03-23T23:57:53.420544+0000","last_fullsized":"2024-03-23T23:57:53.420544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:49:16.758908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"27'6017","reported_seq":6039,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.604581+0000","last_change":"2024-03-23T23:42:50.752450+0000","last_active":"2024-03-23T23:57:57.604581+0000","last_peered":"2024-03-23T23:57:57.604581+0000","last_clean":"2024-03-23T23:57:57.604581+0000","last_became_active":"2024-03-23T23:42:50.752078+0000","last_became_peered":"2024-03-23T23:42:50.752078+0000","last_unstale":"2024-03-23T23:57:57.604581+0000","last_undegraded":"2024-03-23T23:57:57.604581+0000","last_fullsized":"2024-03-23T23:57:57.604581+0000","mapping_epoch":23,"log_start":"27'300","ondisk_log_start":"27'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5717,"log_dups_size":0,"ondisk_log_size":5717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:28:43.677331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89116,"num_write_kb":998926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"27'15","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:59.180396+0000","last_change":"2024-03-23T23:42:39.687108+0000","last_active":"2024-03-23T23:54:59.180396+0000","last_peered":"2024-03-23T23:54:59.180396+0000","last_clean":"2024-03-23T23:54:59.180396+0000","last_became_active":"2024-03-23T23:42:39.686875+0000","last_became_peered":"2024-03-23T23:42:39.686875+0000","last_unstale":"2024-03-23T23:54:59.180396+0000","last_undegraded":"2024-03-23T23:54:59.180396+0000","last_fullsized":"2024-03-23T23:54:59.180396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:05:52.079172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'7359","reported_seq":7390,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:59.870831+0000","last_change":"2024-03-23T23:42:40.698746+0000","last_active":"2024-03-23T23:54:59.870831+0000","last_peered":"2024-03-23T23:54:59.870831+0000","last_clean":"2024-03-23T23:54:59.870831+0000","last_became_active":"2024-03-23T23:42:40.698003+0000","last_became_peered":"2024-03-23T23:42:40.698003+0000","last_unstale":"2024-03-23T23:54:59.870831+0000","last_undegraded":"2024-03-23T23:54:59.870831+0000","last_fullsized":"2024-03-23T23:54:59.870831+0000","mapping_epoch":19,"log_start":"27'500","ondisk_log_start":"27'500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":6859,"log_dups_size":0,"ondisk_log_size":6859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:53:46.437114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110287,"num_write_kb":1353580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'28","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:32.652461+0000","last_change":"2024-03-23T23:42:49.728923+0000","last_active":"2024-03-23T23:57:32.652461+0000","last_peered":"2024-03-23T23:57:32.652461+0000","last_clean":"2024-03-23T23:57:32.652461+0000","last_became_active":"2024-03-23T23:42:49.728261+0000","last_became_peered":"2024-03-23T23:42:49.728261+0000","last_unstale":"2024-03-23T23:57:32.652461+0000","last_undegraded":"2024-03-23T23:57:32.652461+0000","last_fullsized":"2024-03-23T23:57:32.652461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:22.375891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"27'4523","reported_seq":4545,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.357209+0000","last_change":"2024-03-23T23:42:50.755852+0000","last_active":"2024-03-23T23:57:53.357209+0000","last_peered":"2024-03-23T23:57:53.357209+0000","last_clean":"2024-03-23T23:57:53.357209+0000","last_became_active":"2024-03-23T23:42:50.755600+0000","last_became_peered":"2024-03-23T23:42:50.755600+0000","last_unstale":"2024-03-23T23:57:53.357209+0000","last_undegraded":"2024-03-23T23:57:53.357209+0000","last_fullsized":"2024-03-23T23:57:53.357209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4523,"log_dups_size":0,"ondisk_log_size":4523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:29:47.303374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67405,"num_write_kb":746106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"27'60","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:17.810639+0000","last_change":"2024-03-23T23:42:39.696690+0000","last_active":"2024-03-23T23:55:17.810639+0000","last_peered":"2024-03-23T23:55:17.810639+0000","last_clean":"2024-03-23T23:55:17.810639+0000","last_became_active":"2024-03-23T23:42:39.696342+0000","last_became_peered":"2024-03-23T23:42:39.696342+0000","last_unstale":"2024-03-23T23:55:17.810639+0000","last_undegraded":"2024-03-23T23:55:17.810639+0000","last_fullsized":"2024-03-23T23:55:17.810639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:42:37.702720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":12316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'4666","reported_seq":4696,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.711924+0000","last_change":"2024-03-23T23:42:40.700355+0000","last_active":"2024-03-23T23:58:27.711924+0000","last_peered":"2024-03-23T23:58:27.711924+0000","last_clean":"2024-03-23T23:58:27.711924+0000","last_became_active":"2024-03-23T23:42:40.697668+0000","last_became_peered":"2024-03-23T23:42:40.697668+0000","last_unstale":"2024-03-23T23:58:27.711924+0000","last_undegraded":"2024-03-23T23:58:27.711924+0000","last_fullsized":"2024-03-23T23:58:27.711924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4666,"log_dups_size":0,"ondisk_log_size":4666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:23:43.515519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69534,"num_write_kb":791816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'1354","reported_seq":1378,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.424228+0000","last_change":"2024-03-23T23:42:49.744792+0000","last_active":"2024-03-23T23:57:53.424228+0000","last_peered":"2024-03-23T23:57:53.424228+0000","last_clean":"2024-03-23T23:57:53.424228+0000","last_became_active":"2024-03-23T23:42:49.744561+0000","last_became_peered":"2024-03-23T23:42:49.744561+0000","last_unstale":"2024-03-23T23:57:53.424228+0000","last_undegraded":"2024-03-23T23:57:53.424228+0000","last_fullsized":"2024-03-23T23:57:53.424228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1354,"log_dups_size":0,"ondisk_log_size":1354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:07:58.222020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1348,"num_write_kb":4325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"27'4452","reported_seq":4474,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.400820+0000","last_change":"2024-03-23T23:42:50.755575+0000","last_active":"2024-03-23T23:57:53.400820+0000","last_peered":"2024-03-23T23:57:53.400820+0000","last_clean":"2024-03-23T23:57:53.400820+0000","last_became_active":"2024-03-23T23:42:50.755337+0000","last_became_peered":"2024-03-23T23:42:50.755337+0000","last_unstale":"2024-03-23T23:57:53.400820+0000","last_undegraded":"2024-03-23T23:57:53.400820+0000","last_fullsized":"2024-03-23T23:57:53.400820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4452,"log_dups_size":0,"ondisk_log_size":4452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:13.911327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65733,"num_write_kb":735312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"27'16","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:12.437892+0000","last_change":"2024-03-23T23:42:39.696707+0000","last_active":"2024-03-23T23:55:12.437892+0000","last_peered":"2024-03-23T23:55:12.437892+0000","last_clean":"2024-03-23T23:55:12.437892+0000","last_became_active":"2024-03-23T23:42:39.696401+0000","last_became_peered":"2024-03-23T23:42:39.696401+0000","last_unstale":"2024-03-23T23:55:12.437892+0000","last_undegraded":"2024-03-23T23:55:12.437892+0000","last_fullsized":"2024-03-23T23:55:12.437892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:55.757707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'6122","reported_seq":6152,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.741740+0000","last_change":"2024-03-23T23:42:40.700389+0000","last_active":"2024-03-23T23:58:27.741740+0000","last_peered":"2024-03-23T23:58:27.741740+0000","last_clean":"2024-03-23T23:58:27.741740+0000","last_became_active":"2024-03-23T23:42:40.699770+0000","last_became_peered":"2024-03-23T23:42:40.699770+0000","last_unstale":"2024-03-23T23:58:27.741740+0000","last_undegraded":"2024-03-23T23:58:27.741740+0000","last_fullsized":"2024-03-23T23:58:27.741740+0000","mapping_epoch":19,"log_start":"27'200","ondisk_log_start":"27'200","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5922,"log_dups_size":0,"ondisk_log_size":5922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:27.675824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91052,"num_write_kb":1089478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'300","reported_seq":324,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:01.092701+0000","last_change":"2024-03-23T23:42:49.745710+0000","last_active":"2024-03-23T23:58:01.092701+0000","last_peered":"2024-03-23T23:58:01.092701+0000","last_clean":"2024-03-23T23:58:01.092701+0000","last_became_active":"2024-03-23T23:42:49.745526+0000","last_became_peered":"2024-03-23T23:42:49.745526+0000","last_unstale":"2024-03-23T23:58:01.092701+0000","last_undegraded":"2024-03-23T23:58:01.092701+0000","last_fullsized":"2024-03-23T23:58:01.092701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:05:26.746849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5723539,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":5807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"27'5350","reported_seq":5373,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.637559+0000","last_change":"2024-03-23T23:42:50.747274+0000","last_active":"2024-03-23T23:57:57.637559+0000","last_peered":"2024-03-23T23:57:57.637559+0000","last_clean":"2024-03-23T23:57:57.637559+0000","last_became_active":"2024-03-23T23:42:50.746937+0000","last_became_peered":"2024-03-23T23:42:50.746937+0000","last_unstale":"2024-03-23T23:57:57.637559+0000","last_undegraded":"2024-03-23T23:57:57.637559+0000","last_fullsized":"2024-03-23T23:57:57.637559+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5350,"log_dups_size":0,"ondisk_log_size":5350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:19.610436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":11,"num_write":79434,"num_write_kb":896560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"27'5252","reported_seq":5283,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.632377+0000","last_change":"2024-03-23T23:42:40.682467+0000","last_active":"2024-03-23T23:58:27.632377+0000","last_peered":"2024-03-23T23:58:27.632377+0000","last_clean":"2024-03-23T23:58:27.632377+0000","last_became_active":"2024-03-23T23:42:40.682192+0000","last_became_peered":"2024-03-23T23:42:40.682192+0000","last_unstale":"2024-03-23T23:58:27.632377+0000","last_undegraded":"2024-03-23T23:58:27.632377+0000","last_fullsized":"2024-03-23T23:58:27.632377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5252,"log_dups_size":0,"ondisk_log_size":5252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:37:24.839568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78193,"num_write_kb":930302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'10","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:56:06.895925+0000","last_change":"2024-03-23T23:42:39.696528+0000","last_active":"2024-03-23T23:56:06.895925+0000","last_peered":"2024-03-23T23:56:06.895925+0000","last_clean":"2024-03-23T23:56:06.895925+0000","last_became_active":"2024-03-23T23:42:39.696207+0000","last_became_peered":"2024-03-23T23:42:39.696207+0000","last_unstale":"2024-03-23T23:56:06.895925+0000","last_undegraded":"2024-03-23T23:56:06.895925+0000","last_fullsized":"2024-03-23T23:56:06.895925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:02.190910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'10","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.352552+0000","last_change":"2024-03-23T23:42:49.734156+0000","last_active":"2024-03-23T23:57:53.352552+0000","last_peered":"2024-03-23T23:57:53.352552+0000","last_clean":"2024-03-23T23:57:53.352552+0000","last_became_active":"2024-03-23T23:42:49.733888+0000","last_became_peered":"2024-03-23T23:42:49.733888+0000","last_unstale":"2024-03-23T23:57:53.352552+0000","last_undegraded":"2024-03-23T23:57:53.352552+0000","last_fullsized":"2024-03-23T23:57:53.352552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:23:52.568123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"27'5587","reported_seq":5609,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.623975+0000","last_change":"2024-03-23T23:42:50.759749+0000","last_active":"2024-03-23T23:57:57.623975+0000","last_peered":"2024-03-23T23:57:57.623975+0000","last_clean":"2024-03-23T23:57:57.623975+0000","last_became_active":"2024-03-23T23:42:50.758670+0000","last_became_peered":"2024-03-23T23:42:50.758670+0000","last_unstale":"2024-03-23T23:57:57.623975+0000","last_undegraded":"2024-03-23T23:57:57.623975+0000","last_fullsized":"2024-03-23T23:57:57.623975+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5587,"log_dups_size":0,"ondisk_log_size":5587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:16:02.318732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82815,"num_write_kb":936767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"27'4454","reported_seq":4485,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:56:10.697294+0000","last_change":"2024-03-23T23:42:40.674574+0000","last_active":"2024-03-23T23:56:10.697294+0000","last_peered":"2024-03-23T23:56:10.697294+0000","last_clean":"2024-03-23T23:56:10.697294+0000","last_became_active":"2024-03-23T23:42:40.674293+0000","last_became_peered":"2024-03-23T23:42:40.674293+0000","last_unstale":"2024-03-23T23:56:10.697294+0000","last_undegraded":"2024-03-23T23:56:10.697294+0000","last_fullsized":"2024-03-23T23:56:10.697294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4454,"log_dups_size":0,"ondisk_log_size":4454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:37:24.839568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66336,"num_write_kb":780596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'214","reported_seq":247,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:03.769036+0000","last_change":"2024-03-23T23:42:39.683165+0000","last_active":"2024-03-23T23:58:03.769036+0000","last_peered":"2024-03-23T23:58:03.769036+0000","last_clean":"2024-03-23T23:58:03.769036+0000","last_became_active":"2024-03-23T23:42:39.680121+0000","last_became_peered":"2024-03-23T23:42:39.680121+0000","last_unstale":"2024-03-23T23:58:03.769036+0000","last_undegraded":"2024-03-23T23:58:03.769036+0000","last_fullsized":"2024-03-23T23:58:03.769036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:02.190910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1240926,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":210,"num_write_kb":1369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'5","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.428505+0000","last_change":"2024-03-23T23:42:49.745016+0000","last_active":"2024-03-23T23:57:53.428505+0000","last_peered":"2024-03-23T23:57:53.428505+0000","last_clean":"2024-03-23T23:57:53.428505+0000","last_became_active":"2024-03-23T23:42:49.744742+0000","last_became_peered":"2024-03-23T23:42:49.744742+0000","last_unstale":"2024-03-23T23:57:53.428505+0000","last_undegraded":"2024-03-23T23:57:53.428505+0000","last_fullsized":"2024-03-23T23:57:53.428505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:30.033743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"27'4308","reported_seq":4330,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.615870+0000","last_change":"2024-03-23T23:42:50.749792+0000","last_active":"2024-03-23T23:57:57.615870+0000","last_peered":"2024-03-23T23:57:57.615870+0000","last_clean":"2024-03-23T23:57:57.615870+0000","last_became_active":"2024-03-23T23:42:50.749491+0000","last_became_peered":"2024-03-23T23:42:50.749491+0000","last_unstale":"2024-03-23T23:57:57.615870+0000","last_undegraded":"2024-03-23T23:57:57.615870+0000","last_fullsized":"2024-03-23T23:57:57.615870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4308,"log_dups_size":0,"ondisk_log_size":4308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:25:44.894505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64025,"num_write_kb":713675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'4679","reported_seq":4710,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:45.299407+0000","last_change":"2024-03-23T23:42:40.682999+0000","last_active":"2024-03-23T23:55:45.299407+0000","last_peered":"2024-03-23T23:55:45.299407+0000","last_clean":"2024-03-23T23:55:45.299407+0000","last_became_active":"2024-03-23T23:42:40.682672+0000","last_became_peered":"2024-03-23T23:42:40.682672+0000","last_unstale":"2024-03-23T23:55:45.299407+0000","last_undegraded":"2024-03-23T23:55:45.299407+0000","last_fullsized":"2024-03-23T23:55:45.299407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4679,"log_dups_size":0,"ondisk_log_size":4679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:59:45.154553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69709,"num_write_kb":858998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'2","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:47.349873+0000","last_change":"2024-03-23T23:42:39.691470+0000","last_active":"2024-03-23T23:55:47.349873+0000","last_peered":"2024-03-23T23:55:47.349873+0000","last_clean":"2024-03-23T23:55:47.349873+0000","last_became_active":"2024-03-23T23:42:39.691124+0000","last_became_peered":"2024-03-23T23:42:39.691124+0000","last_unstale":"2024-03-23T23:55:47.349873+0000","last_undegraded":"2024-03-23T23:55:47.349873+0000","last_fullsized":"2024-03-23T23:55:47.349873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:55.757707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'23","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.418054+0000","last_change":"2024-03-23T23:42:49.750016+0000","last_active":"2024-03-23T23:57:53.418054+0000","last_peered":"2024-03-23T23:57:53.418054+0000","last_clean":"2024-03-23T23:57:53.418054+0000","last_became_active":"2024-03-23T23:42:49.749279+0000","last_became_peered":"2024-03-23T23:42:49.749279+0000","last_unstale":"2024-03-23T23:57:53.418054+0000","last_undegraded":"2024-03-23T23:57:53.418054+0000","last_fullsized":"2024-03-23T23:57:53.418054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:41:14.671834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"27'6849","reported_seq":6871,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.375906+0000","last_change":"2024-03-23T23:42:50.753669+0000","last_active":"2024-03-23T23:57:53.375906+0000","last_peered":"2024-03-23T23:57:53.375906+0000","last_clean":"2024-03-23T23:57:53.375906+0000","last_became_active":"2024-03-23T23:42:50.752674+0000","last_became_peered":"2024-03-23T23:42:50.752674+0000","last_unstale":"2024-03-23T23:57:53.375906+0000","last_undegraded":"2024-03-23T23:57:53.375906+0000","last_fullsized":"2024-03-23T23:57:53.375906+0000","mapping_epoch":23,"log_start":"27'900","ondisk_log_start":"27'900","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5949,"log_dups_size":0,"ondisk_log_size":5949,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:39:04.727316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101780,"num_write_kb":1163482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"27'4769","reported_seq":4800,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.622856+0000","last_change":"2024-03-23T23:42:40.685051+0000","last_active":"2024-03-23T23:58:27.622856+0000","last_peered":"2024-03-23T23:58:27.622856+0000","last_clean":"2024-03-23T23:58:27.622856+0000","last_became_active":"2024-03-23T23:42:40.684677+0000","last_became_peered":"2024-03-23T23:42:40.684677+0000","last_unstale":"2024-03-23T23:58:27.622856+0000","last_undegraded":"2024-03-23T23:58:27.622856+0000","last_fullsized":"2024-03-23T23:58:27.622856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4769,"log_dups_size":0,"ondisk_log_size":4769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:20.920978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71276,"num_write_kb":829070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'20","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:44.378481+0000","last_change":"2024-03-23T23:42:39.695253+0000","last_active":"2024-03-23T23:55:44.378481+0000","last_peered":"2024-03-23T23:55:44.378481+0000","last_clean":"2024-03-23T23:55:44.378481+0000","last_became_active":"2024-03-23T23:42:39.694746+0000","last_became_peered":"2024-03-23T23:42:39.694746+0000","last_unstale":"2024-03-23T23:55:44.378481+0000","last_undegraded":"2024-03-23T23:55:44.378481+0000","last_fullsized":"2024-03-23T23:55:44.378481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:57.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'20","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.414354+0000","last_change":"2024-03-23T23:42:49.724285+0000","last_active":"2024-03-23T23:57:53.414354+0000","last_peered":"2024-03-23T23:57:53.414354+0000","last_clean":"2024-03-23T23:57:53.414354+0000","last_became_active":"2024-03-23T23:42:49.724009+0000","last_became_peered":"2024-03-23T23:42:49.724009+0000","last_unstale":"2024-03-23T23:57:53.414354+0000","last_undegraded":"2024-03-23T23:57:53.414354+0000","last_fullsized":"2024-03-23T23:57:53.414354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:01:04.035970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"27'4299","reported_seq":4322,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.609217+0000","last_change":"2024-03-23T23:42:50.746737+0000","last_active":"2024-03-23T23:57:57.609217+0000","last_peered":"2024-03-23T23:57:57.609217+0000","last_clean":"2024-03-23T23:57:57.609217+0000","last_became_active":"2024-03-23T23:42:50.746492+0000","last_became_peered":"2024-03-23T23:42:50.746492+0000","last_unstale":"2024-03-23T23:57:57.609217+0000","last_undegraded":"2024-03-23T23:57:57.609217+0000","last_fullsized":"2024-03-23T23:57:57.609217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4299,"log_dups_size":0,"ondisk_log_size":4299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:50.597847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63604,"num_write_kb":723087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"27'5735","reported_seq":5766,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:30.259034+0000","last_change":"2024-03-23T23:42:40.680963+0000","last_active":"2024-03-23T23:55:30.259034+0000","last_peered":"2024-03-23T23:55:30.259034+0000","last_clean":"2024-03-23T23:55:30.259034+0000","last_became_active":"2024-03-23T23:42:40.680744+0000","last_became_peered":"2024-03-23T23:42:40.680744+0000","last_unstale":"2024-03-23T23:55:30.259034+0000","last_undegraded":"2024-03-23T23:55:30.259034+0000","last_fullsized":"2024-03-23T23:55:30.259034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5735,"log_dups_size":0,"ondisk_log_size":5735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:17:19.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85158,"num_write_kb":1014619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'8","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:33.079685+0000","last_change":"2024-03-23T23:42:39.691813+0000","last_active":"2024-03-23T23:55:33.079685+0000","last_peered":"2024-03-23T23:55:33.079685+0000","last_clean":"2024-03-23T23:55:33.079685+0000","last_became_active":"2024-03-23T23:42:39.691519+0000","last_became_peered":"2024-03-23T23:42:39.691519+0000","last_unstale":"2024-03-23T23:55:33.079685+0000","last_undegraded":"2024-03-23T23:55:33.079685+0000","last_fullsized":"2024-03-23T23:55:33.079685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:27:41.386662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'34","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.597772+0000","last_change":"2024-03-23T23:42:49.734197+0000","last_active":"2024-03-23T23:57:57.597772+0000","last_peered":"2024-03-23T23:57:57.597772+0000","last_clean":"2024-03-23T23:57:57.597772+0000","last_became_active":"2024-03-23T23:42:49.733715+0000","last_became_peered":"2024-03-23T23:42:49.733715+0000","last_unstale":"2024-03-23T23:57:57.597772+0000","last_undegraded":"2024-03-23T23:57:57.597772+0000","last_fullsized":"2024-03-23T23:57:57.597772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:36.728428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84646,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":105,"num_write":31,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"27'4486","reported_seq":4509,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.331762+0000","last_change":"2024-03-23T23:42:50.739957+0000","last_active":"2024-03-23T23:57:53.331762+0000","last_peered":"2024-03-23T23:57:53.331762+0000","last_clean":"2024-03-23T23:57:53.331762+0000","last_became_active":"2024-03-23T23:42:50.739706+0000","last_became_peered":"2024-03-23T23:42:50.739706+0000","last_unstale":"2024-03-23T23:57:53.331762+0000","last_undegraded":"2024-03-23T23:57:53.331762+0000","last_fullsized":"2024-03-23T23:57:53.331762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4486,"log_dups_size":0,"ondisk_log_size":4486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:49:17.763463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66952,"num_write_kb":756851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'4348","reported_seq":4365,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:56:17.626811+0000","last_change":"2024-03-23T23:43:22.034415+0000","last_active":"2024-03-23T23:56:17.626811+0000","last_peered":"2024-03-23T23:56:17.626811+0000","last_clean":"2024-03-23T23:56:17.626811+0000","last_became_active":"2024-03-23T23:43:22.034125+0000","last_became_peered":"2024-03-23T23:43:22.034125+0000","last_unstale":"2024-03-23T23:56:17.626811+0000","last_undegraded":"2024-03-23T23:56:17.626811+0000","last_fullsized":"2024-03-23T23:56:17.626811+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4348,"log_dups_size":0,"ondisk_log_size":4348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:48:14.925511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64538,"num_write_kb":790050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"27'316","reported_seq":349,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:58.787567+0000","last_change":"2024-03-23T23:42:39.678962+0000","last_active":"2024-03-23T23:57:58.787567+0000","last_peered":"2024-03-23T23:57:58.787567+0000","last_clean":"2024-03-23T23:57:58.787567+0000","last_became_active":"2024-03-23T23:42:39.678603+0000","last_became_peered":"2024-03-23T23:42:39.678603+0000","last_unstale":"2024-03-23T23:57:58.787567+0000","last_undegraded":"2024-03-23T23:57:58.787567+0000","last_fullsized":"2024-03-23T23:57:58.787567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:43:46.206865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'39","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.605592+0000","last_change":"2024-03-23T23:42:49.740561+0000","last_active":"2024-03-23T23:57:57.605592+0000","last_peered":"2024-03-23T23:57:57.605592+0000","last_clean":"2024-03-23T23:57:57.605592+0000","last_became_active":"2024-03-23T23:42:49.740290+0000","last_became_peered":"2024-03-23T23:42:49.740290+0000","last_unstale":"2024-03-23T23:57:57.605592+0000","last_undegraded":"2024-03-23T23:57:57.605592+0000","last_fullsized":"2024-03-23T23:57:57.605592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:21:24.160603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"27'5042","reported_seq":5065,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.336174+0000","last_change":"2024-03-23T23:42:50.751107+0000","last_active":"2024-03-23T23:57:53.336174+0000","last_peered":"2024-03-23T23:57:53.336174+0000","last_clean":"2024-03-23T23:57:53.336174+0000","last_became_active":"2024-03-23T23:42:50.750859+0000","last_became_peered":"2024-03-23T23:42:50.750859+0000","last_unstale":"2024-03-23T23:57:53.336174+0000","last_undegraded":"2024-03-23T23:57:53.336174+0000","last_fullsized":"2024-03-23T23:57:53.336174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5042,"log_dups_size":0,"ondisk_log_size":5042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:49:17.763463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75095,"num_write_kb":843705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"27'6320","reported_seq":6351,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:16.720538+0000","last_change":"2024-03-23T23:42:40.686486+0000","last_active":"2024-03-23T23:55:16.720538+0000","last_peered":"2024-03-23T23:55:16.720538+0000","last_clean":"2024-03-23T23:55:16.720538+0000","last_became_active":"2024-03-23T23:42:40.686186+0000","last_became_peered":"2024-03-23T23:42:40.686186+0000","last_unstale":"2024-03-23T23:55:16.720538+0000","last_undegraded":"2024-03-23T23:55:16.720538+0000","last_fullsized":"2024-03-23T23:55:16.720538+0000","mapping_epoch":19,"log_start":"27'600","ondisk_log_start":"27'600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5720,"log_dups_size":0,"ondisk_log_size":5720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:46:30.427072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94311,"num_write_kb":1142337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'2","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:28.330121+0000","last_change":"2024-03-23T23:42:39.695099+0000","last_active":"2024-03-23T23:55:28.330121+0000","last_peered":"2024-03-23T23:55:28.330121+0000","last_clean":"2024-03-23T23:55:28.330121+0000","last_became_active":"2024-03-23T23:42:39.694720+0000","last_became_peered":"2024-03-23T23:42:39.694720+0000","last_unstale":"2024-03-23T23:55:28.330121+0000","last_undegraded":"2024-03-23T23:55:28.330121+0000","last_fullsized":"2024-03-23T23:55:28.330121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:58:07.880313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'3","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.398311+0000","last_change":"2024-03-23T23:42:49.739099+0000","last_active":"2024-03-23T23:57:53.398311+0000","last_peered":"2024-03-23T23:57:53.398311+0000","last_clean":"2024-03-23T23:57:53.398311+0000","last_became_active":"2024-03-23T23:42:49.738198+0000","last_became_peered":"2024-03-23T23:42:49.738198+0000","last_unstale":"2024-03-23T23:57:53.398311+0000","last_undegraded":"2024-03-23T23:57:53.398311+0000","last_fullsized":"2024-03-23T23:57:53.398311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:57:34.600362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"27'5382","reported_seq":5405,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.232621+0000","last_change":"2024-03-23T23:42:50.754941+0000","last_active":"2024-03-23T23:57:53.232621+0000","last_peered":"2024-03-23T23:57:53.232621+0000","last_clean":"2024-03-23T23:57:53.232621+0000","last_became_active":"2024-03-23T23:42:50.754585+0000","last_became_peered":"2024-03-23T23:42:50.754585+0000","last_unstale":"2024-03-23T23:57:53.232621+0000","last_undegraded":"2024-03-23T23:57:53.232621+0000","last_fullsized":"2024-03-23T23:57:53.232621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5382,"log_dups_size":0,"ondisk_log_size":5382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:42:23.236324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80225,"num_write_kb":941986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'4652","reported_seq":4683,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.714118+0000","last_change":"2024-03-23T23:42:40.700610+0000","last_active":"2024-03-23T23:58:27.714118+0000","last_peered":"2024-03-23T23:58:27.714118+0000","last_clean":"2024-03-23T23:58:27.714118+0000","last_became_active":"2024-03-23T23:42:40.700112+0000","last_became_peered":"2024-03-23T23:42:40.700112+0000","last_unstale":"2024-03-23T23:58:27.714118+0000","last_undegraded":"2024-03-23T23:58:27.714118+0000","last_fullsized":"2024-03-23T23:58:27.714118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4652,"log_dups_size":0,"ondisk_log_size":4652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:07:49.169416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68979,"num_write_kb":836174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'2","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:16.720561+0000","last_change":"2024-03-23T23:42:39.686509+0000","last_active":"2024-03-23T23:55:16.720561+0000","last_peered":"2024-03-23T23:55:16.720561+0000","last_clean":"2024-03-23T23:55:16.720561+0000","last_became_active":"2024-03-23T23:42:39.686094+0000","last_became_peered":"2024-03-23T23:42:39.686094+0000","last_unstale":"2024-03-23T23:55:16.720561+0000","last_undegraded":"2024-03-23T23:55:16.720561+0000","last_fullsized":"2024-03-23T23:55:16.720561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:57:20.394530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'68","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:14.252046+0000","last_change":"2024-03-23T23:42:49.738274+0000","last_active":"2024-03-23T23:57:14.252046+0000","last_peered":"2024-03-23T23:57:14.252046+0000","last_clean":"2024-03-23T23:57:14.252046+0000","last_became_active":"2024-03-23T23:42:49.737916+0000","last_became_peered":"2024-03-23T23:42:49.737916+0000","last_unstale":"2024-03-23T23:57:14.252046+0000","last_undegraded":"2024-03-23T23:57:14.252046+0000","last_fullsized":"2024-03-23T23:57:14.252046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:18:12.997092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":8223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"27'4721","reported_seq":4744,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.612019+0000","last_change":"2024-03-23T23:42:50.764148+0000","last_active":"2024-03-23T23:57:57.612019+0000","last_peered":"2024-03-23T23:57:57.612019+0000","last_clean":"2024-03-23T23:57:57.612019+0000","last_became_active":"2024-03-23T23:42:50.763768+0000","last_became_peered":"2024-03-23T23:42:50.763768+0000","last_unstale":"2024-03-23T23:57:57.612019+0000","last_undegraded":"2024-03-23T23:57:57.612019+0000","last_fullsized":"2024-03-23T23:57:57.612019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4721,"log_dups_size":0,"ondisk_log_size":4721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:52:48.699642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69706,"num_write_kb":805786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"27'5477","reported_seq":5508,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.746904+0000","last_change":"2024-03-23T23:42:40.679988+0000","last_active":"2024-03-23T23:58:27.746904+0000","last_peered":"2024-03-23T23:58:27.746904+0000","last_clean":"2024-03-23T23:58:27.746904+0000","last_became_active":"2024-03-23T23:42:40.679488+0000","last_became_peered":"2024-03-23T23:42:40.679488+0000","last_unstale":"2024-03-23T23:58:27.746904+0000","last_undegraded":"2024-03-23T23:58:27.746904+0000","last_fullsized":"2024-03-23T23:58:27.746904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5477,"log_dups_size":0,"ondisk_log_size":5477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:10:32.251287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82124,"num_write_kb":1001722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'28","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:10.724250+0000","last_change":"2024-03-23T23:42:39.679741+0000","last_active":"2024-03-23T23:55:10.724250+0000","last_peered":"2024-03-23T23:55:10.724250+0000","last_clean":"2024-03-23T23:55:10.724250+0000","last_became_active":"2024-03-23T23:42:39.678864+0000","last_became_peered":"2024-03-23T23:42:39.678864+0000","last_unstale":"2024-03-23T23:55:10.724250+0000","last_undegraded":"2024-03-23T23:55:10.724250+0000","last_fullsized":"2024-03-23T23:55:10.724250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:50.559059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":8210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.412448+0000","last_change":"2024-03-23T23:42:49.739837+0000","last_active":"2024-03-23T23:57:53.412448+0000","last_peered":"2024-03-23T23:57:53.412448+0000","last_clean":"2024-03-23T23:57:53.412448+0000","last_became_active":"2024-03-23T23:42:49.739570+0000","last_became_peered":"2024-03-23T23:42:49.739570+0000","last_unstale":"2024-03-23T23:57:53.412448+0000","last_undegraded":"2024-03-23T23:57:53.412448+0000","last_fullsized":"2024-03-23T23:57:53.412448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:57:34.600362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'5781","reported_seq":5805,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.375500+0000","last_change":"2024-03-23T23:42:50.753912+0000","last_active":"2024-03-23T23:57:53.375500+0000","last_peered":"2024-03-23T23:57:53.375500+0000","last_clean":"2024-03-23T23:57:53.375500+0000","last_became_active":"2024-03-23T23:42:50.753629+0000","last_became_peered":"2024-03-23T23:42:50.753629+0000","last_unstale":"2024-03-23T23:57:53.375500+0000","last_undegraded":"2024-03-23T23:57:53.375500+0000","last_fullsized":"2024-03-23T23:57:53.375500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5781,"log_dups_size":0,"ondisk_log_size":5781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:40:32.748113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":85415,"num_write_kb":969479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'4110","reported_seq":4141,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:56.682446+0000","last_change":"2024-03-23T23:42:40.682840+0000","last_active":"2024-03-23T23:54:56.682446+0000","last_peered":"2024-03-23T23:54:56.682446+0000","last_clean":"2024-03-23T23:54:56.682446+0000","last_became_active":"2024-03-23T23:42:40.682391+0000","last_became_peered":"2024-03-23T23:42:40.682391+0000","last_unstale":"2024-03-23T23:54:56.682446+0000","last_undegraded":"2024-03-23T23:54:56.682446+0000","last_fullsized":"2024-03-23T23:54:56.682446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4110,"log_dups_size":0,"ondisk_log_size":4110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:42:14.952953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61030,"num_write_kb":768099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'47","reported_seq":124,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:03.449051+0000","last_change":"2024-03-23T23:42:39.680763+0000","last_active":"2024-03-23T23:58:03.449051+0000","last_peered":"2024-03-23T23:58:03.449051+0000","last_clean":"2024-03-23T23:58:03.449051+0000","last_became_active":"2024-03-23T23:42:39.680494+0000","last_became_peered":"2024-03-23T23:42:39.680494+0000","last_unstale":"2024-03-23T23:58:03.449051+0000","last_undegraded":"2024-03-23T23:58:03.449051+0000","last_fullsized":"2024-03-23T23:58:03.449051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:57.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84561,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":115,"num_write":44,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.616866+0000","last_change":"2024-03-23T23:42:49.737456+0000","last_active":"2024-03-23T23:57:57.616866+0000","last_peered":"2024-03-23T23:57:57.616866+0000","last_clean":"2024-03-23T23:57:57.616866+0000","last_became_active":"2024-03-23T23:42:49.737196+0000","last_became_peered":"2024-03-23T23:42:49.737196+0000","last_unstale":"2024-03-23T23:57:57.616866+0000","last_undegraded":"2024-03-23T23:57:57.616866+0000","last_fullsized":"2024-03-23T23:57:57.616866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:49:42.789292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"27'4471","reported_seq":4494,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.644697+0000","last_change":"2024-03-23T23:42:50.763308+0000","last_active":"2024-03-23T23:57:57.644697+0000","last_peered":"2024-03-23T23:57:57.644697+0000","last_clean":"2024-03-23T23:57:57.644697+0000","last_became_active":"2024-03-23T23:42:50.763007+0000","last_became_peered":"2024-03-23T23:42:50.763007+0000","last_unstale":"2024-03-23T23:57:57.644697+0000","last_undegraded":"2024-03-23T23:57:57.644697+0000","last_fullsized":"2024-03-23T23:57:57.644697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4471,"log_dups_size":0,"ondisk_log_size":4471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:32:46.055472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66536,"num_write_kb":757522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"27'4405","reported_seq":4436,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:59.870747+0000","last_change":"2024-03-23T23:42:40.675570+0000","last_active":"2024-03-23T23:54:59.870747+0000","last_peered":"2024-03-23T23:54:59.870747+0000","last_clean":"2024-03-23T23:54:59.870747+0000","last_became_active":"2024-03-23T23:42:40.674390+0000","last_became_peered":"2024-03-23T23:42:40.674390+0000","last_unstale":"2024-03-23T23:54:59.870747+0000","last_undegraded":"2024-03-23T23:54:59.870747+0000","last_fullsized":"2024-03-23T23:54:59.870747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4405,"log_dups_size":0,"ondisk_log_size":4405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:31:34.412092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65732,"num_write_kb":804228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'44","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:56.789441+0000","last_change":"2024-03-23T23:42:39.690057+0000","last_active":"2024-03-23T23:54:56.789441+0000","last_peered":"2024-03-23T23:54:56.789441+0000","last_clean":"2024-03-23T23:54:56.789441+0000","last_became_active":"2024-03-23T23:42:39.689763+0000","last_became_peered":"2024-03-23T23:42:39.689763+0000","last_unstale":"2024-03-23T23:54:56.789441+0000","last_undegraded":"2024-03-23T23:54:56.789441+0000","last_fullsized":"2024-03-23T23:54:56.789441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:01.607584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'353","reported_seq":378,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:56.316413+0000","last_change":"2024-03-23T23:42:49.734213+0000","last_active":"2024-03-23T23:57:56.316413+0000","last_peered":"2024-03-23T23:57:56.316413+0000","last_clean":"2024-03-23T23:57:56.316413+0000","last_became_active":"2024-03-23T23:42:49.733115+0000","last_became_peered":"2024-03-23T23:42:49.733115+0000","last_unstale":"2024-03-23T23:57:56.316413+0000","last_undegraded":"2024-03-23T23:57:56.316413+0000","last_fullsized":"2024-03-23T23:57:56.316413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:18:12.997092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":737,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"27'6371","reported_seq":6394,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.408620+0000","last_change":"2024-03-23T23:42:50.759000+0000","last_active":"2024-03-23T23:57:53.408620+0000","last_peered":"2024-03-23T23:57:53.408620+0000","last_clean":"2024-03-23T23:57:53.408620+0000","last_became_active":"2024-03-23T23:42:50.758552+0000","last_became_peered":"2024-03-23T23:42:50.758552+0000","last_unstale":"2024-03-23T23:57:53.408620+0000","last_undegraded":"2024-03-23T23:57:53.408620+0000","last_fullsized":"2024-03-23T23:57:53.408620+0000","mapping_epoch":23,"log_start":"27'700","ondisk_log_start":"27'700","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5671,"log_dups_size":0,"ondisk_log_size":5671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:04:26.911514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94645,"num_write_kb":1081333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"27'5070","reported_seq":5101,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:09.384653+0000","last_change":"2024-03-23T23:42:40.700998+0000","last_active":"2024-03-23T23:55:09.384653+0000","last_peered":"2024-03-23T23:55:09.384653+0000","last_clean":"2024-03-23T23:55:09.384653+0000","last_became_active":"2024-03-23T23:42:40.700788+0000","last_became_peered":"2024-03-23T23:42:40.700788+0000","last_unstale":"2024-03-23T23:55:09.384653+0000","last_undegraded":"2024-03-23T23:55:09.384653+0000","last_fullsized":"2024-03-23T23:55:09.384653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5070,"log_dups_size":0,"ondisk_log_size":5070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:14:44.739525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75375,"num_write_kb":887789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'3","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:16.319491+0000","last_change":"2024-03-23T23:42:39.687712+0000","last_active":"2024-03-23T23:55:16.319491+0000","last_peered":"2024-03-23T23:55:16.319491+0000","last_clean":"2024-03-23T23:55:16.319491+0000","last_became_active":"2024-03-23T23:42:39.687378+0000","last_became_peered":"2024-03-23T23:42:39.687378+0000","last_unstale":"2024-03-23T23:55:16.319491+0000","last_undegraded":"2024-03-23T23:55:16.319491+0000","last_fullsized":"2024-03-23T23:55:16.319491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:20:38.456655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":189,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:45.391600+0000","last_change":"2024-03-23T23:42:27.940270+0000","last_active":"2024-03-23T23:54:45.391600+0000","last_peered":"2024-03-23T23:54:45.391600+0000","last_clean":"2024-03-23T23:54:45.391600+0000","last_became_active":"2024-03-23T23:42:27.939061+0000","last_became_peered":"2024-03-23T23:42:27.939061+0000","last_unstale":"2024-03-23T23:54:45.391600+0000","last_undegraded":"2024-03-23T23:54:45.391600+0000","last_fullsized":"2024-03-23T23:54:45.391600+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:26.509742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:26.509742+0000","last_clean_scrub_stamp":"2024-03-23T23:42:26.509742+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:49.258623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'3","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:46.805802+0000","last_change":"2024-03-23T23:42:49.729231+0000","last_active":"2024-03-23T23:57:46.805802+0000","last_peered":"2024-03-23T23:57:46.805802+0000","last_clean":"2024-03-23T23:57:46.805802+0000","last_became_active":"2024-03-23T23:42:49.728990+0000","last_became_peered":"2024-03-23T23:42:49.728990+0000","last_unstale":"2024-03-23T23:57:46.805802+0000","last_undegraded":"2024-03-23T23:57:46.805802+0000","last_fullsized":"2024-03-23T23:57:46.805802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:01:04.035970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"27'4432","reported_seq":4455,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.635596+0000","last_change":"2024-03-23T23:42:50.757668+0000","last_active":"2024-03-23T23:57:57.635596+0000","last_peered":"2024-03-23T23:57:57.635596+0000","last_clean":"2024-03-23T23:57:57.635596+0000","last_became_active":"2024-03-23T23:42:50.756900+0000","last_became_peered":"2024-03-23T23:42:50.756900+0000","last_unstale":"2024-03-23T23:57:57.635596+0000","last_undegraded":"2024-03-23T23:57:57.635596+0000","last_fullsized":"2024-03-23T23:57:57.635596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4432,"log_dups_size":0,"ondisk_log_size":4432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:24:53.959288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65770,"num_write_kb":738740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'5479","reported_seq":5510,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:56:12.049278+0000","last_change":"2024-03-23T23:42:40.711591+0000","last_active":"2024-03-23T23:56:12.049278+0000","last_peered":"2024-03-23T23:56:12.049278+0000","last_clean":"2024-03-23T23:56:12.049278+0000","last_became_active":"2024-03-23T23:42:40.711306+0000","last_became_peered":"2024-03-23T23:42:40.711306+0000","last_unstale":"2024-03-23T23:56:12.049278+0000","last_undegraded":"2024-03-23T23:56:12.049278+0000","last_fullsized":"2024-03-23T23:56:12.049278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5479,"log_dups_size":0,"ondisk_log_size":5479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:34:16.693372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81537,"num_write_kb":972707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'5","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:56:12.626312+0000","last_change":"2024-03-23T23:42:39.684163+0000","last_active":"2024-03-23T23:56:12.626312+0000","last_peered":"2024-03-23T23:56:12.626312+0000","last_clean":"2024-03-23T23:56:12.626312+0000","last_became_active":"2024-03-23T23:42:39.683211+0000","last_became_peered":"2024-03-23T23:42:39.683211+0000","last_unstale":"2024-03-23T23:56:12.626312+0000","last_undegraded":"2024-03-23T23:56:12.626312+0000","last_fullsized":"2024-03-23T23:56:12.626312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:47:27.092873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'123","reported_seq":148,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.630825+0000","last_change":"2024-03-23T23:42:49.735824+0000","last_active":"2024-03-23T23:57:57.630825+0000","last_peered":"2024-03-23T23:57:57.630825+0000","last_clean":"2024-03-23T23:57:57.630825+0000","last_became_active":"2024-03-23T23:42:49.735473+0000","last_became_peered":"2024-03-23T23:42:49.735473+0000","last_unstale":"2024-03-23T23:57:57.630825+0000","last_undegraded":"2024-03-23T23:57:57.630825+0000","last_fullsized":"2024-03-23T23:57:57.630825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:44:12.438729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":4181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"27'5300","reported_seq":5323,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.624025+0000","last_change":"2024-03-23T23:42:50.745563+0000","last_active":"2024-03-23T23:57:57.624025+0000","last_peered":"2024-03-23T23:57:57.624025+0000","last_clean":"2024-03-23T23:57:57.624025+0000","last_became_active":"2024-03-23T23:42:50.745256+0000","last_became_peered":"2024-03-23T23:42:50.745256+0000","last_unstale":"2024-03-23T23:57:57.624025+0000","last_undegraded":"2024-03-23T23:57:57.624025+0000","last_fullsized":"2024-03-23T23:57:57.624025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5300,"log_dups_size":0,"ondisk_log_size":5300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:34:26.750531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78242,"num_write_kb":887262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'5423","reported_seq":5455,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.664901+0000","last_change":"2024-03-23T23:42:40.700124+0000","last_active":"2024-03-23T23:58:27.664901+0000","last_peered":"2024-03-23T23:58:27.664901+0000","last_clean":"2024-03-23T23:58:27.664901+0000","last_became_active":"2024-03-23T23:42:40.697369+0000","last_became_peered":"2024-03-23T23:42:40.697369+0000","last_unstale":"2024-03-23T23:58:27.664901+0000","last_undegraded":"2024-03-23T23:58:27.664901+0000","last_fullsized":"2024-03-23T23:58:27.664901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5423,"log_dups_size":0,"ondisk_log_size":5423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:20.981139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":11,"num_write":80814,"num_write_kb":947944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'24","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:37.147000+0000","last_change":"2024-03-23T23:42:39.681013+0000","last_active":"2024-03-23T23:54:37.147000+0000","last_peered":"2024-03-23T23:54:37.147000+0000","last_clean":"2024-03-23T23:54:37.147000+0000","last_became_active":"2024-03-23T23:42:39.680669+0000","last_became_peered":"2024-03-23T23:42:39.680669+0000","last_unstale":"2024-03-23T23:54:37.147000+0000","last_undegraded":"2024-03-23T23:54:37.147000+0000","last_fullsized":"2024-03-23T23:54:37.147000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:58:07.880313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'391","reported_seq":416,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.611265+0000","last_change":"2024-03-23T23:42:49.736747+0000","last_active":"2024-03-23T23:57:57.611265+0000","last_peered":"2024-03-23T23:57:57.611265+0000","last_clean":"2024-03-23T23:57:57.611265+0000","last_became_active":"2024-03-23T23:42:49.734508+0000","last_became_peered":"2024-03-23T23:42:49.734508+0000","last_unstale":"2024-03-23T23:57:57.611265+0000","last_undegraded":"2024-03-23T23:57:57.611265+0000","last_fullsized":"2024-03-23T23:57:57.611265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:54.356082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":4222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"27'4745","reported_seq":4768,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.077169+0000","last_change":"2024-03-23T23:42:50.751141+0000","last_active":"2024-03-23T23:57:53.077169+0000","last_peered":"2024-03-23T23:57:53.077169+0000","last_clean":"2024-03-23T23:57:53.077169+0000","last_became_active":"2024-03-23T23:42:50.750269+0000","last_became_peered":"2024-03-23T23:42:50.750269+0000","last_unstale":"2024-03-23T23:57:53.077169+0000","last_undegraded":"2024-03-23T23:57:53.077169+0000","last_fullsized":"2024-03-23T23:57:53.077169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4745,"log_dups_size":0,"ondisk_log_size":4745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:46:10.784416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70383,"num_write_kb":794086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"27'6871","reported_seq":6901,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:37.279880+0000","last_change":"2024-03-23T23:42:40.706713+0000","last_active":"2024-03-23T23:54:37.279880+0000","last_peered":"2024-03-23T23:54:37.279880+0000","last_clean":"2024-03-23T23:54:37.279880+0000","last_became_active":"2024-03-23T23:42:40.704328+0000","last_became_peered":"2024-03-23T23:42:40.704328+0000","last_unstale":"2024-03-23T23:54:37.279880+0000","last_undegraded":"2024-03-23T23:54:37.279880+0000","last_fullsized":"2024-03-23T23:54:37.279880+0000","mapping_epoch":19,"log_start":"27'1200","ondisk_log_start":"27'1200","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5671,"log_dups_size":0,"ondisk_log_size":5671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:15:52.261572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102549,"num_write_kb":1203650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'21","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:36.237288+0000","last_change":"2024-03-23T23:42:39.681906+0000","last_active":"2024-03-23T23:54:36.237288+0000","last_peered":"2024-03-23T23:54:36.237288+0000","last_clean":"2024-03-23T23:54:36.237288+0000","last_became_active":"2024-03-23T23:42:39.680506+0000","last_became_peered":"2024-03-23T23:42:39.680506+0000","last_unstale":"2024-03-23T23:54:36.237288+0000","last_undegraded":"2024-03-23T23:54:36.237288+0000","last_fullsized":"2024-03-23T23:54:36.237288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:44:07.213123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'28","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.608886+0000","last_change":"2024-03-23T23:42:49.737735+0000","last_active":"2024-03-23T23:57:57.608886+0000","last_peered":"2024-03-23T23:57:57.608886+0000","last_clean":"2024-03-23T23:57:57.608886+0000","last_became_active":"2024-03-23T23:42:49.737434+0000","last_became_peered":"2024-03-23T23:42:49.737434+0000","last_unstale":"2024-03-23T23:57:57.608886+0000","last_undegraded":"2024-03-23T23:57:57.608886+0000","last_fullsized":"2024-03-23T23:57:57.608886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:58:10.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"27'4776","reported_seq":4799,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.347083+0000","last_change":"2024-03-23T23:42:50.746922+0000","last_active":"2024-03-23T23:57:53.347083+0000","last_peered":"2024-03-23T23:57:53.347083+0000","last_clean":"2024-03-23T23:57:53.347083+0000","last_became_active":"2024-03-23T23:42:50.746105+0000","last_became_peered":"2024-03-23T23:42:50.746105+0000","last_unstale":"2024-03-23T23:57:53.347083+0000","last_undegraded":"2024-03-23T23:57:53.347083+0000","last_fullsized":"2024-03-23T23:57:53.347083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4776,"log_dups_size":0,"ondisk_log_size":4776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:46:40.484231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70705,"num_write_kb":815494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"27'4261","reported_seq":4292,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:56:12.049336+0000","last_change":"2024-03-23T23:42:40.696584+0000","last_active":"2024-03-23T23:56:12.049336+0000","last_peered":"2024-03-23T23:56:12.049336+0000","last_clean":"2024-03-23T23:56:12.049336+0000","last_became_active":"2024-03-23T23:42:40.696141+0000","last_became_peered":"2024-03-23T23:42:40.696141+0000","last_unstale":"2024-03-23T23:56:12.049336+0000","last_undegraded":"2024-03-23T23:56:12.049336+0000","last_fullsized":"2024-03-23T23:56:12.049336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4261,"log_dups_size":0,"ondisk_log_size":4261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:45.303477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63684,"num_write_kb":761063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'239","reported_seq":271,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:40.459673+0000","last_change":"2024-03-23T23:42:39.686863+0000","last_active":"2024-03-23T23:54:40.459673+0000","last_peered":"2024-03-23T23:54:40.459673+0000","last_clean":"2024-03-23T23:54:40.459673+0000","last_became_active":"2024-03-23T23:42:39.686491+0000","last_became_peered":"2024-03-23T23:42:39.686491+0000","last_unstale":"2024-03-23T23:54:40.459673+0000","last_undegraded":"2024-03-23T23:54:40.459673+0000","last_fullsized":"2024-03-23T23:54:40.459673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:38:13.752628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.422658+0000","last_change":"2024-03-23T23:42:49.733982+0000","last_active":"2024-03-23T23:57:53.422658+0000","last_peered":"2024-03-23T23:57:53.422658+0000","last_clean":"2024-03-23T23:57:53.422658+0000","last_became_active":"2024-03-23T23:42:49.733389+0000","last_became_peered":"2024-03-23T23:42:49.733389+0000","last_unstale":"2024-03-23T23:57:53.422658+0000","last_undegraded":"2024-03-23T23:57:53.422658+0000","last_fullsized":"2024-03-23T23:57:53.422658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:13.685893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"27'5244","reported_seq":5266,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.379934+0000","last_change":"2024-03-23T23:42:50.764083+0000","last_active":"2024-03-23T23:57:53.379934+0000","last_peered":"2024-03-23T23:57:53.379934+0000","last_clean":"2024-03-23T23:57:53.379934+0000","last_became_active":"2024-03-23T23:42:50.763871+0000","last_became_peered":"2024-03-23T23:42:50.763871+0000","last_unstale":"2024-03-23T23:57:53.379934+0000","last_undegraded":"2024-03-23T23:57:53.379934+0000","last_fullsized":"2024-03-23T23:57:53.379934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5244,"log_dups_size":0,"ondisk_log_size":5244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:32:46.055472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77731,"num_write_kb":860727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"27'4086","reported_seq":4116,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:40.473448+0000","last_change":"2024-03-23T23:42:40.700961+0000","last_active":"2024-03-23T23:54:40.473448+0000","last_peered":"2024-03-23T23:54:40.473448+0000","last_clean":"2024-03-23T23:54:40.473448+0000","last_became_active":"2024-03-23T23:42:40.700800+0000","last_became_peered":"2024-03-23T23:42:40.700800+0000","last_unstale":"2024-03-23T23:54:40.473448+0000","last_undegraded":"2024-03-23T23:54:40.473448+0000","last_fullsized":"2024-03-23T23:54:40.473448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4086,"log_dups_size":0,"ondisk_log_size":4086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:54:27.641281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60579,"num_write_kb":760058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'15","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:56:27.877534+0000","last_change":"2024-03-23T23:42:39.676075+0000","last_active":"2024-03-23T23:56:27.877534+0000","last_peered":"2024-03-23T23:56:27.877534+0000","last_clean":"2024-03-23T23:56:27.877534+0000","last_became_active":"2024-03-23T23:42:39.675770+0000","last_became_peered":"2024-03-23T23:42:39.675770+0000","last_unstale":"2024-03-23T23:56:27.877534+0000","last_undegraded":"2024-03-23T23:56:27.877534+0000","last_fullsized":"2024-03-23T23:56:27.877534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:24:11.933075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'4","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.425856+0000","last_change":"2024-03-23T23:42:49.739529+0000","last_active":"2024-03-23T23:57:53.425856+0000","last_peered":"2024-03-23T23:57:53.425856+0000","last_clean":"2024-03-23T23:57:53.425856+0000","last_became_active":"2024-03-23T23:42:49.738053+0000","last_became_peered":"2024-03-23T23:42:49.738053+0000","last_unstale":"2024-03-23T23:57:53.425856+0000","last_undegraded":"2024-03-23T23:57:53.425856+0000","last_fullsized":"2024-03-23T23:57:53.425856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:52:57.561036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"27'5766","reported_seq":5788,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.641792+0000","last_change":"2024-03-23T23:42:50.771347+0000","last_active":"2024-03-23T23:57:57.641792+0000","last_peered":"2024-03-23T23:57:57.641792+0000","last_clean":"2024-03-23T23:57:57.641792+0000","last_became_active":"2024-03-23T23:42:50.770998+0000","last_became_peered":"2024-03-23T23:42:50.770998+0000","last_unstale":"2024-03-23T23:57:57.641792+0000","last_undegraded":"2024-03-23T23:57:57.641792+0000","last_fullsized":"2024-03-23T23:57:57.641792+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5766,"log_dups_size":0,"ondisk_log_size":5766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:57:04.394872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85663,"num_write_kb":962089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'4463","reported_seq":4493,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.663853+0000","last_change":"2024-03-23T23:42:40.677314+0000","last_active":"2024-03-23T23:58:27.663853+0000","last_peered":"2024-03-23T23:58:27.663853+0000","last_clean":"2024-03-23T23:58:27.663853+0000","last_became_active":"2024-03-23T23:42:40.675416+0000","last_became_peered":"2024-03-23T23:42:40.675416+0000","last_unstale":"2024-03-23T23:58:27.663853+0000","last_undegraded":"2024-03-23T23:58:27.663853+0000","last_fullsized":"2024-03-23T23:58:27.663853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4463,"log_dups_size":0,"ondisk_log_size":4463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:01:06.338641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66376,"num_write_kb":804237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'5","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:40.155565+0000","last_change":"2024-03-23T23:42:39.681827+0000","last_active":"2024-03-23T23:54:40.155565+0000","last_peered":"2024-03-23T23:54:40.155565+0000","last_clean":"2024-03-23T23:54:40.155565+0000","last_became_active":"2024-03-23T23:42:39.681418+0000","last_became_peered":"2024-03-23T23:42:39.681418+0000","last_unstale":"2024-03-23T23:54:40.155565+0000","last_undegraded":"2024-03-23T23:54:40.155565+0000","last_fullsized":"2024-03-23T23:54:40.155565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:50.559059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.389366+0000","last_change":"2024-03-23T23:42:49.744708+0000","last_active":"2024-03-23T23:57:53.389366+0000","last_peered":"2024-03-23T23:57:53.389366+0000","last_clean":"2024-03-23T23:57:53.389366+0000","last_became_active":"2024-03-23T23:42:49.744422+0000","last_became_peered":"2024-03-23T23:42:49.744422+0000","last_unstale":"2024-03-23T23:57:53.389366+0000","last_undegraded":"2024-03-23T23:57:53.389366+0000","last_fullsized":"2024-03-23T23:57:53.389366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:25:43.889950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"27'4213","reported_seq":4235,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.282231+0000","last_change":"2024-03-23T23:42:50.753064+0000","last_active":"2024-03-23T23:57:53.282231+0000","last_peered":"2024-03-23T23:57:53.282231+0000","last_clean":"2024-03-23T23:57:53.282231+0000","last_became_active":"2024-03-23T23:42:50.752783+0000","last_became_peered":"2024-03-23T23:42:50.752783+0000","last_unstale":"2024-03-23T23:57:53.282231+0000","last_undegraded":"2024-03-23T23:57:53.282231+0000","last_fullsized":"2024-03-23T23:57:53.282231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4213,"log_dups_size":0,"ondisk_log_size":4213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:39:49.888359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62346,"num_write_kb":725472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'5165","reported_seq":5195,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:36.864823+0000","last_change":"2024-03-23T23:42:40.704046+0000","last_active":"2024-03-23T23:54:36.864823+0000","last_peered":"2024-03-23T23:54:36.864823+0000","last_clean":"2024-03-23T23:54:36.864823+0000","last_became_active":"2024-03-23T23:42:40.703787+0000","last_became_peered":"2024-03-23T23:42:40.703787+0000","last_unstale":"2024-03-23T23:54:36.864823+0000","last_undegraded":"2024-03-23T23:54:36.864823+0000","last_fullsized":"2024-03-23T23:54:36.864823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5165,"log_dups_size":0,"ondisk_log_size":5165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:16:16.737284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76955,"num_write_kb":929765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'3","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:39.321849+0000","last_change":"2024-03-23T23:42:39.688483+0000","last_active":"2024-03-23T23:54:39.321849+0000","last_peered":"2024-03-23T23:54:39.321849+0000","last_clean":"2024-03-23T23:54:39.321849+0000","last_became_active":"2024-03-23T23:42:39.688141+0000","last_became_peered":"2024-03-23T23:42:39.688141+0000","last_unstale":"2024-03-23T23:54:39.321849+0000","last_undegraded":"2024-03-23T23:54:39.321849+0000","last_fullsized":"2024-03-23T23:54:39.321849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:32.254099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'1143","reported_seq":1167,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:41.085476+0000","last_change":"2024-03-23T23:42:49.749027+0000","last_active":"2024-03-23T23:57:41.085476+0000","last_peered":"2024-03-23T23:57:41.085476+0000","last_clean":"2024-03-23T23:57:41.085476+0000","last_became_active":"2024-03-23T23:42:49.748687+0000","last_became_peered":"2024-03-23T23:42:49.748687+0000","last_unstale":"2024-03-23T23:57:41.085476+0000","last_undegraded":"2024-03-23T23:57:41.085476+0000","last_fullsized":"2024-03-23T23:57:41.085476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1143,"log_dups_size":0,"ondisk_log_size":1143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:27.818117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1141,"num_write_kb":4625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"27'6475","reported_seq":6497,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.605446+0000","last_change":"2024-03-23T23:42:50.752273+0000","last_active":"2024-03-23T23:57:57.605446+0000","last_peered":"2024-03-23T23:57:57.605446+0000","last_clean":"2024-03-23T23:57:57.605446+0000","last_became_active":"2024-03-23T23:42:50.751874+0000","last_became_peered":"2024-03-23T23:42:50.751874+0000","last_unstale":"2024-03-23T23:57:57.605446+0000","last_undegraded":"2024-03-23T23:57:57.605446+0000","last_fullsized":"2024-03-23T23:57:57.605446+0000","mapping_epoch":23,"log_start":"27'1200","ondisk_log_start":"27'1200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5275,"log_dups_size":0,"ondisk_log_size":5275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:20:53.750917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96407,"num_write_kb":1089798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'4551","reported_seq":4581,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:36.914752+0000","last_change":"2024-03-23T23:42:40.688909+0000","last_active":"2024-03-23T23:54:36.914752+0000","last_peered":"2024-03-23T23:54:36.914752+0000","last_clean":"2024-03-23T23:54:36.914752+0000","last_became_active":"2024-03-23T23:42:40.688636+0000","last_became_peered":"2024-03-23T23:42:40.688636+0000","last_unstale":"2024-03-23T23:54:36.914752+0000","last_undegraded":"2024-03-23T23:54:36.914752+0000","last_fullsized":"2024-03-23T23:54:36.914752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4551,"log_dups_size":0,"ondisk_log_size":4551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:26:16.171920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68087,"num_write_kb":816248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'60","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:36.937202+0000","last_change":"2024-03-23T23:42:39.681926+0000","last_active":"2024-03-23T23:54:36.937202+0000","last_peered":"2024-03-23T23:54:36.937202+0000","last_clean":"2024-03-23T23:54:36.937202+0000","last_became_active":"2024-03-23T23:42:39.681028+0000","last_became_peered":"2024-03-23T23:42:39.681028+0000","last_unstale":"2024-03-23T23:54:36.937202+0000","last_undegraded":"2024-03-23T23:54:36.937202+0000","last_fullsized":"2024-03-23T23:54:36.937202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:24:11.933075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":8222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'22","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.622922+0000","last_change":"2024-03-23T23:42:49.741915+0000","last_active":"2024-03-23T23:57:57.622922+0000","last_peered":"2024-03-23T23:57:57.622922+0000","last_clean":"2024-03-23T23:57:57.622922+0000","last_became_active":"2024-03-23T23:42:49.741650+0000","last_became_peered":"2024-03-23T23:42:49.741650+0000","last_unstale":"2024-03-23T23:57:57.622922+0000","last_undegraded":"2024-03-23T23:57:57.622922+0000","last_fullsized":"2024-03-23T23:57:57.622922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:11:43.106922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"27'5248","reported_seq":5270,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.606881+0000","last_change":"2024-03-23T23:42:50.752979+0000","last_active":"2024-03-23T23:57:57.606881+0000","last_peered":"2024-03-23T23:57:57.606881+0000","last_clean":"2024-03-23T23:57:57.606881+0000","last_became_active":"2024-03-23T23:42:50.751848+0000","last_became_peered":"2024-03-23T23:42:50.751848+0000","last_unstale":"2024-03-23T23:57:57.606881+0000","last_undegraded":"2024-03-23T23:57:57.606881+0000","last_fullsized":"2024-03-23T23:57:57.606881+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5248,"log_dups_size":0,"ondisk_log_size":5248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:39:04.727316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77613,"num_write_kb":898929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'4158","reported_seq":4188,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:40.074107+0000","last_change":"2024-03-23T23:42:40.689988+0000","last_active":"2024-03-23T23:54:40.074107+0000","last_peered":"2024-03-23T23:54:40.074107+0000","last_clean":"2024-03-23T23:54:40.074107+0000","last_became_active":"2024-03-23T23:42:40.689477+0000","last_became_peered":"2024-03-23T23:42:40.689477+0000","last_unstale":"2024-03-23T23:54:40.074107+0000","last_undegraded":"2024-03-23T23:54:40.074107+0000","last_fullsized":"2024-03-23T23:54:40.074107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4158,"log_dups_size":0,"ondisk_log_size":4158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:46:30.427072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61832,"num_write_kb":761424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'1204","reported_seq":1236,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:58.775515+0000","last_change":"2024-03-23T23:42:39.689429+0000","last_active":"2024-03-23T23:57:58.775515+0000","last_peered":"2024-03-23T23:57:58.775515+0000","last_clean":"2024-03-23T23:57:58.775515+0000","last_became_active":"2024-03-23T23:42:39.688066+0000","last_became_peered":"2024-03-23T23:42:39.688066+0000","last_unstale":"2024-03-23T23:57:58.775515+0000","last_undegraded":"2024-03-23T23:57:58.775515+0000","last_fullsized":"2024-03-23T23:57:58.775515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1204,"log_dups_size":0,"ondisk_log_size":1204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:32.254099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1202,"num_write_kb":4648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.627061+0000","last_change":"2024-03-23T23:42:49.733543+0000","last_active":"2024-03-23T23:57:57.627061+0000","last_peered":"2024-03-23T23:57:57.627061+0000","last_clean":"2024-03-23T23:57:57.627061+0000","last_became_active":"2024-03-23T23:42:49.733197+0000","last_became_peered":"2024-03-23T23:42:49.733197+0000","last_unstale":"2024-03-23T23:57:57.627061+0000","last_undegraded":"2024-03-23T23:57:57.627061+0000","last_fullsized":"2024-03-23T23:57:57.627061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:45:20.189501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"27'4652","reported_seq":4674,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.381633+0000","last_change":"2024-03-23T23:42:50.756687+0000","last_active":"2024-03-23T23:57:53.381633+0000","last_peered":"2024-03-23T23:57:53.381633+0000","last_clean":"2024-03-23T23:57:53.381633+0000","last_became_active":"2024-03-23T23:42:50.756371+0000","last_became_peered":"2024-03-23T23:42:50.756371+0000","last_unstale":"2024-03-23T23:57:53.381633+0000","last_undegraded":"2024-03-23T23:57:53.381633+0000","last_fullsized":"2024-03-23T23:57:53.381633+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4652,"log_dups_size":0,"ondisk_log_size":4652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:29:47.303374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69148,"num_write_kb":786028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'6424","reported_seq":6454,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.751614+0000","last_change":"2024-03-23T23:42:40.683025+0000","last_active":"2024-03-23T23:58:27.751614+0000","last_peered":"2024-03-23T23:58:27.751614+0000","last_clean":"2024-03-23T23:58:27.751614+0000","last_became_active":"2024-03-23T23:42:40.682798+0000","last_became_peered":"2024-03-23T23:42:40.682798+0000","last_unstale":"2024-03-23T23:58:27.751614+0000","last_undegraded":"2024-03-23T23:58:27.751614+0000","last_fullsized":"2024-03-23T23:58:27.751614+0000","mapping_epoch":19,"log_start":"27'900","ondisk_log_start":"27'900","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5524,"log_dups_size":0,"ondisk_log_size":5524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:51.565112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96000,"num_write_kb":1116606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'29","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:04.033139+0000","last_change":"2024-03-23T23:42:39.681675+0000","last_active":"2024-03-23T23:57:04.033139+0000","last_peered":"2024-03-23T23:57:04.033139+0000","last_clean":"2024-03-23T23:57:04.033139+0000","last_became_active":"2024-03-23T23:42:39.681364+0000","last_became_peered":"2024-03-23T23:42:39.681364+0000","last_unstale":"2024-03-23T23:57:04.033139+0000","last_undegraded":"2024-03-23T23:57:04.033139+0000","last_fullsized":"2024-03-23T23:57:04.033139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:42:37.702720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'47","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.606954+0000","last_change":"2024-03-23T23:42:49.723350+0000","last_active":"2024-03-23T23:57:57.606954+0000","last_peered":"2024-03-23T23:57:57.606954+0000","last_clean":"2024-03-23T23:57:57.606954+0000","last_became_active":"2024-03-23T23:42:49.723058+0000","last_became_peered":"2024-03-23T23:42:49.723058+0000","last_unstale":"2024-03-23T23:57:57.606954+0000","last_undegraded":"2024-03-23T23:57:57.606954+0000","last_fullsized":"2024-03-23T23:57:57.606954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:43:02.835034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":8215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"27'4265","reported_seq":4287,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.406354+0000","last_change":"2024-03-23T23:42:50.746422+0000","last_active":"2024-03-23T23:57:53.406354+0000","last_peered":"2024-03-23T23:57:53.406354+0000","last_clean":"2024-03-23T23:57:53.406354+0000","last_became_active":"2024-03-23T23:42:50.746104+0000","last_became_peered":"2024-03-23T23:42:50.746104+0000","last_unstale":"2024-03-23T23:57:53.406354+0000","last_undegraded":"2024-03-23T23:57:53.406354+0000","last_fullsized":"2024-03-23T23:57:53.406354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4265,"log_dups_size":0,"ondisk_log_size":4265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:40:34.077584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63135,"num_write_kb":732213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"27'5357","reported_seq":5392,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:49.844589+0000","last_change":"2024-03-23T23:43:22.035935+0000","last_active":"2024-03-23T23:54:49.844589+0000","last_peered":"2024-03-23T23:54:49.844589+0000","last_clean":"2024-03-23T23:54:49.844589+0000","last_became_active":"2024-03-23T23:43:22.035573+0000","last_became_peered":"2024-03-23T23:43:22.035573+0000","last_unstale":"2024-03-23T23:54:49.844589+0000","last_undegraded":"2024-03-23T23:54:49.844589+0000","last_fullsized":"2024-03-23T23:54:49.844589+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5357,"log_dups_size":0,"ondisk_log_size":5357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:11:19.211377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80141,"num_write_kb":923583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'4","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:43.402674+0000","last_change":"2024-03-23T23:42:39.691092+0000","last_active":"2024-03-23T23:54:43.402674+0000","last_peered":"2024-03-23T23:54:43.402674+0000","last_clean":"2024-03-23T23:54:43.402674+0000","last_became_active":"2024-03-23T23:42:39.687473+0000","last_became_peered":"2024-03-23T23:42:39.687473+0000","last_unstale":"2024-03-23T23:54:43.402674+0000","last_undegraded":"2024-03-23T23:54:43.402674+0000","last_fullsized":"2024-03-23T23:54:43.402674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:08:03.578884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'15","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.419543+0000","last_change":"2024-03-23T23:42:49.748693+0000","last_active":"2024-03-23T23:57:53.419543+0000","last_peered":"2024-03-23T23:57:53.419543+0000","last_clean":"2024-03-23T23:57:53.419543+0000","last_became_active":"2024-03-23T23:42:49.748389+0000","last_became_peered":"2024-03-23T23:42:49.748389+0000","last_unstale":"2024-03-23T23:57:53.419543+0000","last_undegraded":"2024-03-23T23:57:53.419543+0000","last_fullsized":"2024-03-23T23:57:53.419543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:58:10.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"27'4542","reported_seq":4564,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.326027+0000","last_change":"2024-03-23T23:42:50.749547+0000","last_active":"2024-03-23T23:57:53.326027+0000","last_peered":"2024-03-23T23:57:53.326027+0000","last_clean":"2024-03-23T23:57:53.326027+0000","last_became_active":"2024-03-23T23:42:50.749066+0000","last_became_peered":"2024-03-23T23:42:50.749066+0000","last_unstale":"2024-03-23T23:57:53.326027+0000","last_undegraded":"2024-03-23T23:57:53.326027+0000","last_fullsized":"2024-03-23T23:57:53.326027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4542,"log_dups_size":0,"ondisk_log_size":4542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:09:19.723830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67689,"num_write_kb":774425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'5731","reported_seq":5747,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:22.403506+0000","last_change":"2024-03-23T23:43:22.034371+0000","last_active":"2024-03-23T23:55:22.403506+0000","last_peered":"2024-03-23T23:55:22.403506+0000","last_clean":"2024-03-23T23:55:22.403506+0000","last_became_active":"2024-03-23T23:43:22.034063+0000","last_became_peered":"2024-03-23T23:43:22.034063+0000","last_unstale":"2024-03-23T23:55:22.403506+0000","last_undegraded":"2024-03-23T23:55:22.403506+0000","last_fullsized":"2024-03-23T23:55:22.403506+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5731,"log_dups_size":0,"ondisk_log_size":5731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:49:33.736688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85448,"num_write_kb":1013349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'3","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:46.901728+0000","last_change":"2024-03-23T23:42:39.684669+0000","last_active":"2024-03-23T23:54:46.901728+0000","last_peered":"2024-03-23T23:54:46.901728+0000","last_clean":"2024-03-23T23:54:46.901728+0000","last_became_active":"2024-03-23T23:42:39.684360+0000","last_became_peered":"2024-03-23T23:42:39.684360+0000","last_unstale":"2024-03-23T23:54:46.901728+0000","last_undegraded":"2024-03-23T23:54:46.901728+0000","last_fullsized":"2024-03-23T23:54:46.901728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:19.914926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'5","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.418360+0000","last_change":"2024-03-23T23:42:49.741577+0000","last_active":"2024-03-23T23:57:53.418360+0000","last_peered":"2024-03-23T23:57:53.418360+0000","last_clean":"2024-03-23T23:57:53.418360+0000","last_became_active":"2024-03-23T23:42:49.741270+0000","last_became_peered":"2024-03-23T23:42:49.741270+0000","last_unstale":"2024-03-23T23:57:53.418360+0000","last_undegraded":"2024-03-23T23:57:53.418360+0000","last_fullsized":"2024-03-23T23:57:53.418360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:11:43.106922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"27'7534","reported_seq":7557,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.649402+0000","last_change":"2024-03-23T23:42:50.751992+0000","last_active":"2024-03-23T23:57:57.649402+0000","last_peered":"2024-03-23T23:57:57.649402+0000","last_clean":"2024-03-23T23:57:57.649402+0000","last_became_active":"2024-03-23T23:42:50.748281+0000","last_became_peered":"2024-03-23T23:42:50.748281+0000","last_unstale":"2024-03-23T23:57:57.649402+0000","last_undegraded":"2024-03-23T23:57:57.649402+0000","last_fullsized":"2024-03-23T23:57:57.649402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":7534,"log_dups_size":0,"ondisk_log_size":7534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:57.968968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112036,"num_write_kb":1284404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"27'34","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.409576+0000","last_change":"2024-03-23T23:42:49.741658+0000","last_active":"2024-03-23T23:57:53.409576+0000","last_peered":"2024-03-23T23:57:53.409576+0000","last_clean":"2024-03-23T23:57:53.409576+0000","last_became_active":"2024-03-23T23:42:49.740899+0000","last_became_peered":"2024-03-23T23:42:49.740899+0000","last_unstale":"2024-03-23T23:57:53.409576+0000","last_undegraded":"2024-03-23T23:57:53.409576+0000","last_fullsized":"2024-03-23T23:57:53.409576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:45:20.189501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'6191","reported_seq":6221,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:56.682472+0000","last_change":"2024-03-23T23:42:40.679384+0000","last_active":"2024-03-23T23:54:56.682472+0000","last_peered":"2024-03-23T23:54:56.682472+0000","last_clean":"2024-03-23T23:54:56.682472+0000","last_became_active":"2024-03-23T23:42:40.679070+0000","last_became_peered":"2024-03-23T23:42:40.679070+0000","last_unstale":"2024-03-23T23:54:56.682472+0000","last_undegraded":"2024-03-23T23:54:56.682472+0000","last_fullsized":"2024-03-23T23:54:56.682472+0000","mapping_epoch":19,"log_start":"27'500","ondisk_log_start":"27'500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5691,"log_dups_size":0,"ondisk_log_size":5691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:26:16.171920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92139,"num_write_kb":1051130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'28","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:54.268838+0000","last_change":"2024-03-23T23:42:39.682839+0000","last_active":"2024-03-23T23:54:54.268838+0000","last_peered":"2024-03-23T23:54:54.268838+0000","last_clean":"2024-03-23T23:54:54.268838+0000","last_became_active":"2024-03-23T23:42:39.682584+0000","last_became_peered":"2024-03-23T23:42:39.682584+0000","last_unstale":"2024-03-23T23:54:54.268838+0000","last_undegraded":"2024-03-23T23:54:54.268838+0000","last_fullsized":"2024-03-23T23:54:54.268838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:19.914926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":8211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"27'5266","reported_seq":5289,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.414132+0000","last_change":"2024-03-23T23:42:50.752596+0000","last_active":"2024-03-23T23:57:53.414132+0000","last_peered":"2024-03-23T23:57:53.414132+0000","last_clean":"2024-03-23T23:57:53.414132+0000","last_became_active":"2024-03-23T23:42:50.751598+0000","last_became_peered":"2024-03-23T23:42:50.751598+0000","last_unstale":"2024-03-23T23:57:53.414132+0000","last_undegraded":"2024-03-23T23:57:53.414132+0000","last_fullsized":"2024-03-23T23:57:53.414132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5266,"log_dups_size":0,"ondisk_log_size":5266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:37:19.741781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78296,"num_write_kb":918025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"27'25","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.611935+0000","last_change":"2024-03-23T23:42:49.734629+0000","last_active":"2024-03-23T23:57:57.611935+0000","last_peered":"2024-03-23T23:57:57.611935+0000","last_clean":"2024-03-23T23:57:57.611935+0000","last_became_active":"2024-03-23T23:42:49.734309+0000","last_became_peered":"2024-03-23T23:42:49.734309+0000","last_unstale":"2024-03-23T23:57:57.611935+0000","last_undegraded":"2024-03-23T23:57:57.611935+0000","last_fullsized":"2024-03-23T23:57:57.611935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:46.760020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'5375","reported_seq":5405,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:59.176057+0000","last_change":"2024-03-23T23:42:40.674605+0000","last_active":"2024-03-23T23:54:59.176057+0000","last_peered":"2024-03-23T23:54:59.176057+0000","last_clean":"2024-03-23T23:54:59.176057+0000","last_became_active":"2024-03-23T23:42:40.674366+0000","last_became_peered":"2024-03-23T23:42:40.674366+0000","last_unstale":"2024-03-23T23:54:59.176057+0000","last_undegraded":"2024-03-23T23:54:59.176057+0000","last_fullsized":"2024-03-23T23:54:59.176057+0000","mapping_epoch":19,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5275,"log_dups_size":0,"ondisk_log_size":5275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80001,"num_write_kb":974706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'8","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:59.176089+0000","last_change":"2024-03-23T23:42:39.688646+0000","last_active":"2024-03-23T23:54:59.176089+0000","last_peered":"2024-03-23T23:54:59.176089+0000","last_clean":"2024-03-23T23:54:59.176089+0000","last_became_active":"2024-03-23T23:42:39.687489+0000","last_became_peered":"2024-03-23T23:42:39.687489+0000","last_unstale":"2024-03-23T23:54:59.176089+0000","last_undegraded":"2024-03-23T23:54:59.176089+0000","last_fullsized":"2024-03-23T23:54:59.176089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:07:12.649156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"27'6117","reported_seq":6139,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.615686+0000","last_change":"2024-03-23T23:42:50.748511+0000","last_active":"2024-03-23T23:57:57.615686+0000","last_peered":"2024-03-23T23:57:57.615686+0000","last_clean":"2024-03-23T23:57:57.615686+0000","last_became_active":"2024-03-23T23:42:50.747154+0000","last_became_peered":"2024-03-23T23:42:50.747154+0000","last_unstale":"2024-03-23T23:57:57.615686+0000","last_undegraded":"2024-03-23T23:57:57.615686+0000","last_fullsized":"2024-03-23T23:57:57.615686+0000","mapping_epoch":23,"log_start":"27'400","ondisk_log_start":"27'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5717,"log_dups_size":0,"ondisk_log_size":5717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:09:19.723830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91134,"num_write_kb":1034218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"27'17","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:02.411457+0000","last_change":"2024-03-23T23:42:39.681458+0000","last_active":"2024-03-23T23:55:02.411457+0000","last_peered":"2024-03-23T23:55:02.411457+0000","last_clean":"2024-03-23T23:55:02.411457+0000","last_became_active":"2024-03-23T23:42:39.681158+0000","last_became_peered":"2024-03-23T23:42:39.681158+0000","last_unstale":"2024-03-23T23:55:02.411457+0000","last_undegraded":"2024-03-23T23:55:02.411457+0000","last_fullsized":"2024-03-23T23:55:02.411457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:08:03.578884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'4511","reported_seq":4541,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:14.933151+0000","last_change":"2024-03-23T23:42:40.676571+0000","last_active":"2024-03-23T23:55:14.933151+0000","last_peered":"2024-03-23T23:55:14.933151+0000","last_clean":"2024-03-23T23:55:14.933151+0000","last_became_active":"2024-03-23T23:42:40.675877+0000","last_became_peered":"2024-03-23T23:42:40.675877+0000","last_unstale":"2024-03-23T23:55:14.933151+0000","last_undegraded":"2024-03-23T23:55:14.933151+0000","last_fullsized":"2024-03-23T23:55:14.933151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4511,"log_dups_size":0,"ondisk_log_size":4511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:52.220411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67585,"num_write_kb":780136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'19","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:56.350382+0000","last_change":"2024-03-23T23:42:49.734208+0000","last_active":"2024-03-23T23:57:56.350382+0000","last_peered":"2024-03-23T23:57:56.350382+0000","last_clean":"2024-03-23T23:57:56.350382+0000","last_became_active":"2024-03-23T23:42:49.732943+0000","last_became_peered":"2024-03-23T23:42:49.732943+0000","last_unstale":"2024-03-23T23:57:56.350382+0000","last_undegraded":"2024-03-23T23:57:56.350382+0000","last_fullsized":"2024-03-23T23:57:56.350382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:43.683275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"27'4594","reported_seq":4616,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.367947+0000","last_change":"2024-03-23T23:42:50.752722+0000","last_active":"2024-03-23T23:57:53.367947+0000","last_peered":"2024-03-23T23:57:53.367947+0000","last_clean":"2024-03-23T23:57:53.367947+0000","last_became_active":"2024-03-23T23:42:50.749400+0000","last_became_peered":"2024-03-23T23:42:50.749400+0000","last_unstale":"2024-03-23T23:57:53.367947+0000","last_undegraded":"2024-03-23T23:57:53.367947+0000","last_fullsized":"2024-03-23T23:57:53.367947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4594,"log_dups_size":0,"ondisk_log_size":4594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:16:44.027189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67787,"num_write_kb":753464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'1303","reported_seq":1335,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:04.355170+0000","last_change":"2024-03-23T23:42:39.688422+0000","last_active":"2024-03-23T23:55:04.355170+0000","last_peered":"2024-03-23T23:55:04.355170+0000","last_clean":"2024-03-23T23:55:04.355170+0000","last_became_active":"2024-03-23T23:42:39.687423+0000","last_became_peered":"2024-03-23T23:42:39.687423+0000","last_unstale":"2024-03-23T23:55:04.355170+0000","last_undegraded":"2024-03-23T23:55:04.355170+0000","last_fullsized":"2024-03-23T23:55:04.355170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1303,"log_dups_size":0,"ondisk_log_size":1303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:20:38.456655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1297,"num_write_kb":4300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'4605","reported_seq":4635,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.670982+0000","last_change":"2024-03-23T23:42:40.680801+0000","last_active":"2024-03-23T23:58:27.670982+0000","last_peered":"2024-03-23T23:58:27.670982+0000","last_clean":"2024-03-23T23:58:27.670982+0000","last_became_active":"2024-03-23T23:42:40.680511+0000","last_became_peered":"2024-03-23T23:42:40.680511+0000","last_unstale":"2024-03-23T23:58:27.670982+0000","last_undegraded":"2024-03-23T23:58:27.670982+0000","last_fullsized":"2024-03-23T23:58:27.670982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4605,"log_dups_size":0,"ondisk_log_size":4605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:27:42.392714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68637,"num_write_kb":787014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'90","reported_seq":114,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.422374+0000","last_change":"2024-03-23T23:42:49.751291+0000","last_active":"2024-03-23T23:57:53.422374+0000","last_peered":"2024-03-23T23:57:53.422374+0000","last_clean":"2024-03-23T23:57:53.422374+0000","last_became_active":"2024-03-23T23:42:49.749695+0000","last_became_peered":"2024-03-23T23:42:49.749695+0000","last_unstale":"2024-03-23T23:57:53.422374+0000","last_undegraded":"2024-03-23T23:57:53.422374+0000","last_fullsized":"2024-03-23T23:57:53.422374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:40:33.073029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":12324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"27'4641","reported_seq":4664,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.624601+0000","last_change":"2024-03-23T23:42:50.752672+0000","last_active":"2024-03-23T23:57:57.624601+0000","last_peered":"2024-03-23T23:57:57.624601+0000","last_clean":"2024-03-23T23:57:57.624601+0000","last_became_active":"2024-03-23T23:42:50.752394+0000","last_became_peered":"2024-03-23T23:42:50.752394+0000","last_unstale":"2024-03-23T23:57:57.624601+0000","last_undegraded":"2024-03-23T23:57:57.624601+0000","last_fullsized":"2024-03-23T23:57:57.624601+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4641,"log_dups_size":0,"ondisk_log_size":4641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:51:01.385876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69093,"num_write_kb":797343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'5268","reported_seq":5299,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.664423+0000","last_change":"2024-03-23T23:42:40.679042+0000","last_active":"2024-03-23T23:58:27.664423+0000","last_peered":"2024-03-23T23:58:27.664423+0000","last_clean":"2024-03-23T23:58:27.664423+0000","last_became_active":"2024-03-23T23:42:40.678518+0000","last_became_peered":"2024-03-23T23:42:40.678518+0000","last_unstale":"2024-03-23T23:58:27.664423+0000","last_undegraded":"2024-03-23T23:58:27.664423+0000","last_fullsized":"2024-03-23T23:58:27.664423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5268,"log_dups_size":0,"ondisk_log_size":5268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:12:14.359173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78308,"num_write_kb":963226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"27'6095","reported_seq":6118,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.627377+0000","last_change":"2024-03-23T23:42:50.757132+0000","last_active":"2024-03-23T23:57:57.627377+0000","last_peered":"2024-03-23T23:57:57.627377+0000","last_clean":"2024-03-23T23:57:57.627377+0000","last_became_active":"2024-03-23T23:42:50.756813+0000","last_became_peered":"2024-03-23T23:42:50.756813+0000","last_unstale":"2024-03-23T23:57:57.627377+0000","last_undegraded":"2024-03-23T23:57:57.627377+0000","last_fullsized":"2024-03-23T23:57:57.627377+0000","mapping_epoch":23,"log_start":"27'400","ondisk_log_start":"27'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5695,"log_dups_size":0,"ondisk_log_size":5695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:04:26.911514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90451,"num_write_kb":1016115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"27'5490","reported_seq":5521,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:17.343498+0000","last_change":"2024-03-23T23:42:40.702411+0000","last_active":"2024-03-23T23:55:17.343498+0000","last_peered":"2024-03-23T23:55:17.343498+0000","last_clean":"2024-03-23T23:55:17.343498+0000","last_became_active":"2024-03-23T23:42:40.701398+0000","last_became_peered":"2024-03-23T23:42:40.701398+0000","last_unstale":"2024-03-23T23:55:17.343498+0000","last_undegraded":"2024-03-23T23:55:17.343498+0000","last_fullsized":"2024-03-23T23:55:17.343498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5490,"log_dups_size":0,"ondisk_log_size":5490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:03.196963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81712,"num_write_kb":960011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"27'5505","reported_seq":5528,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.437164+0000","last_change":"2024-03-23T23:42:50.756769+0000","last_active":"2024-03-23T23:57:53.437164+0000","last_peered":"2024-03-23T23:57:53.437164+0000","last_clean":"2024-03-23T23:57:53.437164+0000","last_became_active":"2024-03-23T23:42:50.756503+0000","last_became_peered":"2024-03-23T23:42:50.756503+0000","last_unstale":"2024-03-23T23:57:53.437164+0000","last_undegraded":"2024-03-23T23:57:53.437164+0000","last_fullsized":"2024-03-23T23:57:53.437164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5505,"log_dups_size":0,"ondisk_log_size":5505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:50.597847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81671,"num_write_kb":934046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"27'5990","reported_seq":6026,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.684080+0000","last_change":"2024-03-23T23:43:22.035915+0000","last_active":"2024-03-23T23:58:27.684080+0000","last_peered":"2024-03-23T23:58:27.684080+0000","last_clean":"2024-03-23T23:58:27.684080+0000","last_became_active":"2024-03-23T23:43:22.035611+0000","last_became_peered":"2024-03-23T23:43:22.035611+0000","last_unstale":"2024-03-23T23:58:27.684080+0000","last_undegraded":"2024-03-23T23:58:27.684080+0000","last_fullsized":"2024-03-23T23:58:27.684080+0000","mapping_epoch":26,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5890,"log_dups_size":0,"ondisk_log_size":5890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:49:53.121428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89084,"num_write_kb":1042929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"27'5549","reported_seq":5572,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:56.668950+0000","last_change":"2024-03-23T23:42:50.748726+0000","last_active":"2024-03-23T23:57:56.668950+0000","last_peered":"2024-03-23T23:57:56.668950+0000","last_clean":"2024-03-23T23:57:56.668950+0000","last_became_active":"2024-03-23T23:42:50.748105+0000","last_became_peered":"2024-03-23T23:42:50.748105+0000","last_unstale":"2024-03-23T23:57:56.668950+0000","last_undegraded":"2024-03-23T23:57:56.668950+0000","last_fullsized":"2024-03-23T23:57:56.668950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5549,"log_dups_size":0,"ondisk_log_size":5549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:54.910408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82238,"num_write_kb":945396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"27'5023","reported_seq":5054,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:24.969744+0000","last_change":"2024-03-23T23:42:40.673293+0000","last_active":"2024-03-23T23:55:24.969744+0000","last_peered":"2024-03-23T23:55:24.969744+0000","last_clean":"2024-03-23T23:55:24.969744+0000","last_became_active":"2024-03-23T23:42:40.672910+0000","last_became_peered":"2024-03-23T23:42:40.672910+0000","last_unstale":"2024-03-23T23:55:24.969744+0000","last_undegraded":"2024-03-23T23:55:24.969744+0000","last_fullsized":"2024-03-23T23:55:24.969744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5023,"log_dups_size":0,"ondisk_log_size":5023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:42:14.952953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74941,"num_write_kb":923200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"27'5960","reported_seq":5983,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.620022+0000","last_change":"2024-03-23T23:42:50.750291+0000","last_active":"2024-03-23T23:57:57.620022+0000","last_peered":"2024-03-23T23:57:57.620022+0000","last_clean":"2024-03-23T23:57:57.620022+0000","last_became_active":"2024-03-23T23:42:50.749908+0000","last_became_peered":"2024-03-23T23:42:50.749908+0000","last_unstale":"2024-03-23T23:57:57.620022+0000","last_undegraded":"2024-03-23T23:57:57.620022+0000","last_fullsized":"2024-03-23T23:57:57.620022+0000","mapping_epoch":23,"log_start":"27'200","ondisk_log_start":"27'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5760,"log_dups_size":0,"ondisk_log_size":5760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:54.910408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88637,"num_write_kb":993297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"27'5450","reported_seq":5481,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:34.943004+0000","last_change":"2024-03-23T23:42:40.685370+0000","last_active":"2024-03-23T23:55:34.943004+0000","last_peered":"2024-03-23T23:55:34.943004+0000","last_clean":"2024-03-23T23:55:34.943004+0000","last_became_active":"2024-03-23T23:42:40.685120+0000","last_became_peered":"2024-03-23T23:42:40.685120+0000","last_unstale":"2024-03-23T23:55:34.943004+0000","last_undegraded":"2024-03-23T23:55:34.943004+0000","last_fullsized":"2024-03-23T23:55:34.943004+0000","mapping_epoch":19,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5350,"log_dups_size":0,"ondisk_log_size":5350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81249,"num_write_kb":968622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"27'5333","reported_seq":5356,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.397151+0000","last_change":"2024-03-23T23:42:50.747361+0000","last_active":"2024-03-23T23:57:53.397151+0000","last_peered":"2024-03-23T23:57:53.397151+0000","last_clean":"2024-03-23T23:57:53.397151+0000","last_became_active":"2024-03-23T23:42:50.746310+0000","last_became_peered":"2024-03-23T23:42:50.746310+0000","last_unstale":"2024-03-23T23:57:53.397151+0000","last_undegraded":"2024-03-23T23:57:53.397151+0000","last_fullsized":"2024-03-23T23:57:53.397151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5333,"log_dups_size":0,"ondisk_log_size":5333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:57.968968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79170,"num_write_kb":877684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"27'5331","reported_seq":5362,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:36.999666+0000","last_change":"2024-03-23T23:42:40.677168+0000","last_active":"2024-03-23T23:55:36.999666+0000","last_peered":"2024-03-23T23:55:36.999666+0000","last_clean":"2024-03-23T23:55:36.999666+0000","last_became_active":"2024-03-23T23:42:40.676912+0000","last_became_peered":"2024-03-23T23:42:40.676912+0000","last_unstale":"2024-03-23T23:55:36.999666+0000","last_undegraded":"2024-03-23T23:55:36.999666+0000","last_fullsized":"2024-03-23T23:55:36.999666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5331,"log_dups_size":0,"ondisk_log_size":5331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:17:19.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79200,"num_write_kb":983244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"27'5388","reported_seq":5411,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.409572+0000","last_change":"2024-03-23T23:42:50.749305+0000","last_active":"2024-03-23T23:57:53.409572+0000","last_peered":"2024-03-23T23:57:53.409572+0000","last_clean":"2024-03-23T23:57:53.409572+0000","last_became_active":"2024-03-23T23:42:50.748798+0000","last_became_peered":"2024-03-23T23:42:50.748798+0000","last_unstale":"2024-03-23T23:57:53.409572+0000","last_undegraded":"2024-03-23T23:57:53.409572+0000","last_fullsized":"2024-03-23T23:57:53.409572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5388,"log_dups_size":0,"ondisk_log_size":5388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:19.610436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80551,"num_write_kb":913314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"27'4477","reported_seq":4507,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.728675+0000","last_change":"2024-03-23T23:42:40.694420+0000","last_active":"2024-03-23T23:58:27.728675+0000","last_peered":"2024-03-23T23:58:27.728675+0000","last_clean":"2024-03-23T23:58:27.728675+0000","last_became_active":"2024-03-23T23:42:40.693867+0000","last_became_peered":"2024-03-23T23:42:40.693867+0000","last_unstale":"2024-03-23T23:58:27.728675+0000","last_undegraded":"2024-03-23T23:58:27.728675+0000","last_fullsized":"2024-03-23T23:58:27.728675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4477,"log_dups_size":0,"ondisk_log_size":4477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:54.557634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66343,"num_write_kb":822171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"27'5440","reported_seq":5463,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.388213+0000","last_change":"2024-03-23T23:42:50.754149+0000","last_active":"2024-03-23T23:57:53.388213+0000","last_peered":"2024-03-23T23:57:53.388213+0000","last_clean":"2024-03-23T23:57:53.388213+0000","last_became_active":"2024-03-23T23:42:50.753471+0000","last_became_peered":"2024-03-23T23:42:50.753471+0000","last_unstale":"2024-03-23T23:57:53.388213+0000","last_undegraded":"2024-03-23T23:57:53.388213+0000","last_fullsized":"2024-03-23T23:57:53.388213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5440,"log_dups_size":0,"ondisk_log_size":5440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:28.822672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80762,"num_write_kb":909623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'5932","reported_seq":5963,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:50.436288+0000","last_change":"2024-03-23T23:42:40.685177+0000","last_active":"2024-03-23T23:55:50.436288+0000","last_peered":"2024-03-23T23:55:50.436288+0000","last_clean":"2024-03-23T23:55:50.436288+0000","last_became_active":"2024-03-23T23:42:40.684495+0000","last_became_peered":"2024-03-23T23:42:40.684495+0000","last_unstale":"2024-03-23T23:55:50.436288+0000","last_undegraded":"2024-03-23T23:55:50.436288+0000","last_fullsized":"2024-03-23T23:55:50.436288+0000","mapping_epoch":19,"log_start":"27'600","ondisk_log_start":"27'600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5332,"log_dups_size":0,"ondisk_log_size":5332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:27.675824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88442,"num_write_kb":1073631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"27'5672","reported_seq":5694,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.401288+0000","last_change":"2024-03-23T23:42:50.746438+0000","last_active":"2024-03-23T23:57:53.401288+0000","last_peered":"2024-03-23T23:57:53.401288+0000","last_clean":"2024-03-23T23:57:53.401288+0000","last_became_active":"2024-03-23T23:42:50.745771+0000","last_became_peered":"2024-03-23T23:42:50.745771+0000","last_unstale":"2024-03-23T23:57:53.401288+0000","last_undegraded":"2024-03-23T23:57:53.401288+0000","last_fullsized":"2024-03-23T23:57:53.401288+0000","mapping_epoch":23,"log_start":"27'400","ondisk_log_start":"27'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5272,"log_dups_size":0,"ondisk_log_size":5272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:22:17.484059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83950,"num_write_kb":942381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'5332","reported_seq":5363,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.685598+0000","last_change":"2024-03-23T23:42:40.701852+0000","last_active":"2024-03-23T23:58:27.685598+0000","last_peered":"2024-03-23T23:58:27.685598+0000","last_clean":"2024-03-23T23:58:27.685598+0000","last_became_active":"2024-03-23T23:42:40.701566+0000","last_became_peered":"2024-03-23T23:42:40.701566+0000","last_unstale":"2024-03-23T23:58:27.685598+0000","last_undegraded":"2024-03-23T23:58:27.685598+0000","last_fullsized":"2024-03-23T23:58:27.685598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5332,"log_dups_size":0,"ondisk_log_size":5332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79247,"num_write_kb":918114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"27'6948","reported_seq":6970,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.632915+0000","last_change":"2024-03-23T23:42:50.758879+0000","last_active":"2024-03-23T23:57:57.632915+0000","last_peered":"2024-03-23T23:57:57.632915+0000","last_clean":"2024-03-23T23:57:57.632915+0000","last_became_active":"2024-03-23T23:42:50.758564+0000","last_became_peered":"2024-03-23T23:42:50.758564+0000","last_unstale":"2024-03-23T23:57:57.632915+0000","last_undegraded":"2024-03-23T23:57:57.632915+0000","last_fullsized":"2024-03-23T23:57:57.632915+0000","mapping_epoch":23,"log_start":"27'1200","ondisk_log_start":"27'1200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5748,"log_dups_size":0,"ondisk_log_size":5748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:11:29.268536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103363,"num_write_kb":1190294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"27'4871","reported_seq":4902,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:56:10.679759+0000","last_change":"2024-03-23T23:42:40.684899+0000","last_active":"2024-03-23T23:56:10.679759+0000","last_peered":"2024-03-23T23:56:10.679759+0000","last_clean":"2024-03-23T23:56:10.679759+0000","last_became_active":"2024-03-23T23:42:40.684603+0000","last_became_peered":"2024-03-23T23:42:40.684603+0000","last_unstale":"2024-03-23T23:56:10.679759+0000","last_undegraded":"2024-03-23T23:56:10.679759+0000","last_fullsized":"2024-03-23T23:56:10.679759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4871,"log_dups_size":0,"ondisk_log_size":4871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:54.557634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72674,"num_write_kb":866936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"27'4839","reported_seq":4861,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.400027+0000","last_change":"2024-03-23T23:42:50.754096+0000","last_active":"2024-03-23T23:57:53.400027+0000","last_peered":"2024-03-23T23:57:53.400027+0000","last_clean":"2024-03-23T23:57:53.400027+0000","last_became_active":"2024-03-23T23:42:50.753602+0000","last_became_peered":"2024-03-23T23:42:50.753602+0000","last_unstale":"2024-03-23T23:57:53.400027+0000","last_undegraded":"2024-03-23T23:57:53.400027+0000","last_fullsized":"2024-03-23T23:57:53.400027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4839,"log_dups_size":0,"ondisk_log_size":4839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:16:26.794444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71433,"num_write_kb":836622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"27'5267","reported_seq":5283,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:35.994504+0000","last_change":"2024-03-23T23:43:22.035247+0000","last_active":"2024-03-23T23:54:35.994504+0000","last_peered":"2024-03-23T23:54:35.994504+0000","last_clean":"2024-03-23T23:54:35.994504+0000","last_became_active":"2024-03-23T23:43:22.034831+0000","last_became_peered":"2024-03-23T23:43:22.034831+0000","last_unstale":"2024-03-23T23:54:35.994504+0000","last_undegraded":"2024-03-23T23:54:35.994504+0000","last_fullsized":"2024-03-23T23:54:35.994504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5267,"log_dups_size":0,"ondisk_log_size":5267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:42:13.179165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78302,"num_write_kb":947936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2d","version":"27'6034","reported_seq":6056,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.233044+0000","last_change":"2024-03-23T23:42:50.741324+0000","last_active":"2024-03-23T23:57:53.233044+0000","last_peered":"2024-03-23T23:57:53.233044+0000","last_clean":"2024-03-23T23:57:53.233044+0000","last_became_active":"2024-03-23T23:42:50.741065+0000","last_became_peered":"2024-03-23T23:42:50.741065+0000","last_unstale":"2024-03-23T23:57:53.233044+0000","last_undegraded":"2024-03-23T23:57:53.233044+0000","last_fullsized":"2024-03-23T23:57:53.233044+0000","mapping_epoch":23,"log_start":"27'700","ondisk_log_start":"27'700","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5334,"log_dups_size":0,"ondisk_log_size":5334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:13.911327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89207,"num_write_kb":985993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"27'6134","reported_seq":6164,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:37.412090+0000","last_change":"2024-03-23T23:42:40.689122+0000","last_active":"2024-03-23T23:54:37.412090+0000","last_peered":"2024-03-23T23:54:37.412090+0000","last_clean":"2024-03-23T23:54:37.412090+0000","last_became_active":"2024-03-23T23:42:40.688875+0000","last_became_peered":"2024-03-23T23:42:40.688875+0000","last_unstale":"2024-03-23T23:54:37.412090+0000","last_undegraded":"2024-03-23T23:54:37.412090+0000","last_fullsized":"2024-03-23T23:54:37.412090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":6134,"log_dups_size":0,"ondisk_log_size":6134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:27:03.132032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91123,"num_write_kb":1098161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"27'5331","reported_seq":5353,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.218888+0000","last_change":"2024-03-23T23:42:50.762055+0000","last_active":"2024-03-23T23:57:53.218888+0000","last_peered":"2024-03-23T23:57:53.218888+0000","last_clean":"2024-03-23T23:57:53.218888+0000","last_became_active":"2024-03-23T23:42:50.761762+0000","last_became_peered":"2024-03-23T23:42:50.761762+0000","last_unstale":"2024-03-23T23:57:53.218888+0000","last_undegraded":"2024-03-23T23:57:53.218888+0000","last_fullsized":"2024-03-23T23:57:53.218888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5331,"log_dups_size":0,"ondisk_log_size":5331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:28.822672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79322,"num_write_kb":913380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'4790","reported_seq":4820,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.610687+0000","last_change":"2024-03-23T23:42:40.683701+0000","last_active":"2024-03-23T23:58:27.610687+0000","last_peered":"2024-03-23T23:58:27.610687+0000","last_clean":"2024-03-23T23:58:27.610687+0000","last_became_active":"2024-03-23T23:42:40.683377+0000","last_became_peered":"2024-03-23T23:42:40.683377+0000","last_unstale":"2024-03-23T23:58:27.610687+0000","last_undegraded":"2024-03-23T23:58:27.610687+0000","last_fullsized":"2024-03-23T23:58:27.610687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4790,"log_dups_size":0,"ondisk_log_size":4790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71235,"num_write_kb":860094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"27'6313","reported_seq":6335,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.618034+0000","last_change":"2024-03-23T23:42:50.754372+0000","last_active":"2024-03-23T23:57:57.618034+0000","last_peered":"2024-03-23T23:57:57.618034+0000","last_clean":"2024-03-23T23:57:57.618034+0000","last_became_active":"2024-03-23T23:42:50.754072+0000","last_became_peered":"2024-03-23T23:42:50.754072+0000","last_unstale":"2024-03-23T23:57:57.618034+0000","last_undegraded":"2024-03-23T23:57:57.618034+0000","last_fullsized":"2024-03-23T23:57:57.618034+0000","mapping_epoch":23,"log_start":"27'800","ondisk_log_start":"27'800","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5513,"log_dups_size":0,"ondisk_log_size":5513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:40:34.077584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93450,"num_write_kb":1059053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"27'5789","reported_seq":5819,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:35.865197+0000","last_change":"2024-03-23T23:42:40.689769+0000","last_active":"2024-03-23T23:54:35.865197+0000","last_peered":"2024-03-23T23:54:35.865197+0000","last_clean":"2024-03-23T23:54:35.865197+0000","last_became_active":"2024-03-23T23:42:40.689111+0000","last_became_peered":"2024-03-23T23:42:40.689111+0000","last_unstale":"2024-03-23T23:54:35.865197+0000","last_undegraded":"2024-03-23T23:54:35.865197+0000","last_fullsized":"2024-03-23T23:54:35.865197+0000","mapping_epoch":19,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5689,"log_dups_size":0,"ondisk_log_size":5689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:40:22.690954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86245,"num_write_kb":1027145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"27'5272","reported_seq":5295,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.618695+0000","last_change":"2024-03-23T23:42:50.759792+0000","last_active":"2024-03-23T23:57:57.618695+0000","last_peered":"2024-03-23T23:57:57.618695+0000","last_clean":"2024-03-23T23:57:57.618695+0000","last_became_active":"2024-03-23T23:42:50.759604+0000","last_became_peered":"2024-03-23T23:42:50.759604+0000","last_unstale":"2024-03-23T23:57:57.618695+0000","last_undegraded":"2024-03-23T23:57:57.618695+0000","last_fullsized":"2024-03-23T23:57:57.618695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5272,"log_dups_size":0,"ondisk_log_size":5272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:15:25.617521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77877,"num_write_kb":893934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"27'5674","reported_seq":5704,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:39.315453+0000","last_change":"2024-03-23T23:42:40.690961+0000","last_active":"2024-03-23T23:54:39.315453+0000","last_peered":"2024-03-23T23:54:39.315453+0000","last_clean":"2024-03-23T23:54:39.315453+0000","last_became_active":"2024-03-23T23:42:40.690690+0000","last_became_peered":"2024-03-23T23:42:40.690690+0000","last_unstale":"2024-03-23T23:54:39.315453+0000","last_undegraded":"2024-03-23T23:54:39.315453+0000","last_fullsized":"2024-03-23T23:54:39.315453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5674,"log_dups_size":0,"ondisk_log_size":5674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:56.763759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84510,"num_write_kb":984289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"27'4965","reported_seq":4988,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.424315+0000","last_change":"2024-03-23T23:42:50.764821+0000","last_active":"2024-03-23T23:57:53.424315+0000","last_peered":"2024-03-23T23:57:53.424315+0000","last_clean":"2024-03-23T23:57:53.424315+0000","last_became_active":"2024-03-23T23:42:50.764563+0000","last_became_peered":"2024-03-23T23:42:50.764563+0000","last_unstale":"2024-03-23T23:57:53.424315+0000","last_undegraded":"2024-03-23T23:57:53.424315+0000","last_fullsized":"2024-03-23T23:57:53.424315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4965,"log_dups_size":0,"ondisk_log_size":4965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:48:24.982671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73421,"num_write_kb":840152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"27'6976","reported_seq":7006,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.731575+0000","last_change":"2024-03-23T23:42:40.708540+0000","last_active":"2024-03-23T23:58:27.731575+0000","last_peered":"2024-03-23T23:58:27.731575+0000","last_clean":"2024-03-23T23:58:27.731575+0000","last_became_active":"2024-03-23T23:42:40.708031+0000","last_became_peered":"2024-03-23T23:42:40.708031+0000","last_unstale":"2024-03-23T23:58:27.731575+0000","last_undegraded":"2024-03-23T23:58:27.731575+0000","last_fullsized":"2024-03-23T23:58:27.731575+0000","mapping_epoch":19,"log_start":"27'1000","ondisk_log_start":"27'1000","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5976,"log_dups_size":0,"ondisk_log_size":5976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:44:03.386124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104041,"num_write_kb":1238038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"27'5675","reported_seq":5697,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.391999+0000","last_change":"2024-03-23T23:42:50.771062+0000","last_active":"2024-03-23T23:57:53.391999+0000","last_peered":"2024-03-23T23:57:53.391999+0000","last_clean":"2024-03-23T23:57:53.391999+0000","last_became_active":"2024-03-23T23:42:50.770790+0000","last_became_peered":"2024-03-23T23:42:50.770790+0000","last_unstale":"2024-03-23T23:57:53.391999+0000","last_undegraded":"2024-03-23T23:57:53.391999+0000","last_fullsized":"2024-03-23T23:57:53.391999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5675,"log_dups_size":0,"ondisk_log_size":5675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:13:07.156401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84043,"num_write_kb":972100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"27'4954","reported_seq":4984,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.678147+0000","last_change":"2024-03-23T23:42:40.697920+0000","last_active":"2024-03-23T23:58:27.678147+0000","last_peered":"2024-03-23T23:58:27.678147+0000","last_clean":"2024-03-23T23:58:27.678147+0000","last_became_active":"2024-03-23T23:42:40.697694+0000","last_became_peered":"2024-03-23T23:42:40.697694+0000","last_unstale":"2024-03-23T23:58:27.678147+0000","last_undegraded":"2024-03-23T23:58:27.678147+0000","last_fullsized":"2024-03-23T23:58:27.678147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4954,"log_dups_size":0,"ondisk_log_size":4954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73634,"num_write_kb":894008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"27'6050","reported_seq":6072,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.384523+0000","last_change":"2024-03-23T23:42:50.751694+0000","last_active":"2024-03-23T23:57:53.384523+0000","last_peered":"2024-03-23T23:57:53.384523+0000","last_clean":"2024-03-23T23:57:53.384523+0000","last_became_active":"2024-03-23T23:42:50.751452+0000","last_became_peered":"2024-03-23T23:42:50.751452+0000","last_unstale":"2024-03-23T23:57:53.384523+0000","last_undegraded":"2024-03-23T23:57:53.384523+0000","last_fullsized":"2024-03-23T23:57:53.384523+0000","mapping_epoch":23,"log_start":"27'500","ondisk_log_start":"27'500","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5550,"log_dups_size":0,"ondisk_log_size":5550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:57:49.981068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89888,"num_write_kb":1063697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"27'4428","reported_seq":4458,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:37.598513+0000","last_change":"2024-03-23T23:42:40.681928+0000","last_active":"2024-03-23T23:54:37.598513+0000","last_peered":"2024-03-23T23:54:37.598513+0000","last_clean":"2024-03-23T23:54:37.598513+0000","last_became_active":"2024-03-23T23:42:40.681337+0000","last_became_peered":"2024-03-23T23:42:40.681337+0000","last_unstale":"2024-03-23T23:54:37.598513+0000","last_undegraded":"2024-03-23T23:54:37.598513+0000","last_fullsized":"2024-03-23T23:54:37.598513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4428,"log_dups_size":0,"ondisk_log_size":4428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:52.220411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65733,"num_write_kb":782831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"27'3540","reported_seq":3562,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.388876+0000","last_change":"2024-03-23T23:42:50.769003+0000","last_active":"2024-03-23T23:57:53.388876+0000","last_peered":"2024-03-23T23:57:53.388876+0000","last_clean":"2024-03-23T23:57:53.388876+0000","last_became_active":"2024-03-23T23:42:50.768695+0000","last_became_peered":"2024-03-23T23:42:50.768695+0000","last_unstale":"2024-03-23T23:57:53.388876+0000","last_undegraded":"2024-03-23T23:57:53.388876+0000","last_fullsized":"2024-03-23T23:57:53.388876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":3540,"log_dups_size":0,"ondisk_log_size":3540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:17:11.847056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52531,"num_write_kb":593656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'4793","reported_seq":4823,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:39.306467+0000","last_change":"2024-03-23T23:42:40.680934+0000","last_active":"2024-03-23T23:54:39.306467+0000","last_peered":"2024-03-23T23:54:39.306467+0000","last_clean":"2024-03-23T23:54:39.306467+0000","last_became_active":"2024-03-23T23:42:40.680643+0000","last_became_peered":"2024-03-23T23:42:40.680643+0000","last_unstale":"2024-03-23T23:54:39.306467+0000","last_undegraded":"2024-03-23T23:54:39.306467+0000","last_fullsized":"2024-03-23T23:54:39.306467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4793,"log_dups_size":0,"ondisk_log_size":4793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:34.630671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71159,"num_write_kb":844038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"27'5005","reported_seq":5027,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:52.852956+0000","last_change":"2024-03-23T23:42:50.762401+0000","last_active":"2024-03-23T23:57:52.852956+0000","last_peered":"2024-03-23T23:57:52.852956+0000","last_clean":"2024-03-23T23:57:52.852956+0000","last_became_active":"2024-03-23T23:42:50.762183+0000","last_became_peered":"2024-03-23T23:42:50.762183+0000","last_unstale":"2024-03-23T23:57:52.852956+0000","last_undegraded":"2024-03-23T23:57:52.852956+0000","last_fullsized":"2024-03-23T23:57:52.852956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5005,"log_dups_size":0,"ondisk_log_size":5005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:13:10.497921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74336,"num_write_kb":853450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"27'4014","reported_seq":4044,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:38.734157+0000","last_change":"2024-03-23T23:42:40.682736+0000","last_active":"2024-03-23T23:54:38.734157+0000","last_peered":"2024-03-23T23:54:38.734157+0000","last_clean":"2024-03-23T23:54:38.734157+0000","last_became_active":"2024-03-23T23:42:40.682410+0000","last_became_peered":"2024-03-23T23:42:40.682410+0000","last_unstale":"2024-03-23T23:54:38.734157+0000","last_undegraded":"2024-03-23T23:54:38.734157+0000","last_fullsized":"2024-03-23T23:54:38.734157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4014,"log_dups_size":0,"ondisk_log_size":4014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:01:06.338641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59528,"num_write_kb":755074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"27'4691","reported_seq":4713,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.622134+0000","last_change":"2024-03-23T23:42:50.749204+0000","last_active":"2024-03-23T23:57:57.622134+0000","last_peered":"2024-03-23T23:57:57.622134+0000","last_clean":"2024-03-23T23:57:57.622134+0000","last_became_active":"2024-03-23T23:42:50.748809+0000","last_became_peered":"2024-03-23T23:42:50.748809+0000","last_unstale":"2024-03-23T23:57:57.622134+0000","last_undegraded":"2024-03-23T23:57:57.622134+0000","last_fullsized":"2024-03-23T23:57:57.622134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4691,"log_dups_size":0,"ondisk_log_size":4691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:39:49.888359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69546,"num_write_kb":808803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'3645","reported_seq":3675,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.744600+0000","last_change":"2024-03-23T23:42:40.682523+0000","last_active":"2024-03-23T23:58:27.744600+0000","last_peered":"2024-03-23T23:58:27.744600+0000","last_clean":"2024-03-23T23:58:27.744600+0000","last_became_active":"2024-03-23T23:42:40.682155+0000","last_became_peered":"2024-03-23T23:42:40.682155+0000","last_unstale":"2024-03-23T23:58:27.744600+0000","last_undegraded":"2024-03-23T23:58:27.744600+0000","last_fullsized":"2024-03-23T23:58:27.744600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":3645,"log_dups_size":0,"ondisk_log_size":3645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:33.260151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54155,"num_write_kb":623068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"27'4090","reported_seq":4113,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.414650+0000","last_change":"2024-03-23T23:42:50.746115+0000","last_active":"2024-03-23T23:57:53.414650+0000","last_peered":"2024-03-23T23:57:53.414650+0000","last_clean":"2024-03-23T23:57:53.414650+0000","last_became_active":"2024-03-23T23:42:50.745858+0000","last_became_peered":"2024-03-23T23:42:50.745858+0000","last_unstale":"2024-03-23T23:57:53.414650+0000","last_undegraded":"2024-03-23T23:57:53.414650+0000","last_fullsized":"2024-03-23T23:57:53.414650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4090,"log_dups_size":0,"ondisk_log_size":4090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:00:43.318455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":60470,"num_write_kb":714617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"27'5162","reported_seq":5192,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.639052+0000","last_change":"2024-03-23T23:42:40.702089+0000","last_active":"2024-03-23T23:58:27.639052+0000","last_peered":"2024-03-23T23:58:27.639052+0000","last_clean":"2024-03-23T23:58:27.639052+0000","last_became_active":"2024-03-23T23:42:40.701874+0000","last_became_peered":"2024-03-23T23:42:40.701874+0000","last_unstale":"2024-03-23T23:58:27.639052+0000","last_undegraded":"2024-03-23T23:58:27.639052+0000","last_fullsized":"2024-03-23T23:58:27.639052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5162,"log_dups_size":0,"ondisk_log_size":5162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76848,"num_write_kb":918422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"27'4942","reported_seq":4964,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.417067+0000","last_change":"2024-03-23T23:42:50.773115+0000","last_active":"2024-03-23T23:57:53.417067+0000","last_peered":"2024-03-23T23:57:53.417067+0000","last_clean":"2024-03-23T23:57:53.417067+0000","last_became_active":"2024-03-23T23:42:50.772849+0000","last_became_peered":"2024-03-23T23:42:50.772849+0000","last_unstale":"2024-03-23T23:57:53.417067+0000","last_undegraded":"2024-03-23T23:57:53.417067+0000","last_fullsized":"2024-03-23T23:57:53.417067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4942,"log_dups_size":0,"ondisk_log_size":4942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:29:42.898728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73640,"num_write_kb":854588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"27'5693","reported_seq":5722,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.736454+0000","last_change":"2024-03-23T23:42:40.703254+0000","last_active":"2024-03-23T23:58:27.736454+0000","last_peered":"2024-03-23T23:58:27.736454+0000","last_clean":"2024-03-23T23:58:27.736454+0000","last_became_active":"2024-03-23T23:42:40.702447+0000","last_became_peered":"2024-03-23T23:42:40.702447+0000","last_unstale":"2024-03-23T23:58:27.736454+0000","last_undegraded":"2024-03-23T23:58:27.736454+0000","last_fullsized":"2024-03-23T23:58:27.736454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5693,"log_dups_size":0,"ondisk_log_size":5693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:59:45.154553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84473,"num_write_kb":1008808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"27'4442","reported_seq":4464,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.421588+0000","last_change":"2024-03-23T23:42:50.748946+0000","last_active":"2024-03-23T23:57:53.421588+0000","last_peered":"2024-03-23T23:57:53.421588+0000","last_clean":"2024-03-23T23:57:53.421588+0000","last_became_active":"2024-03-23T23:42:50.745205+0000","last_became_peered":"2024-03-23T23:42:50.745205+0000","last_unstale":"2024-03-23T23:57:53.421588+0000","last_undegraded":"2024-03-23T23:57:53.421588+0000","last_fullsized":"2024-03-23T23:57:53.421588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4442,"log_dups_size":0,"ondisk_log_size":4442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:58:16.372010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65706,"num_write_kb":746784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"27'6094","reported_seq":6124,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:56.815848+0000","last_change":"2024-03-23T23:42:40.714331+0000","last_active":"2024-03-23T23:54:56.815848+0000","last_peered":"2024-03-23T23:54:56.815848+0000","last_clean":"2024-03-23T23:54:56.815848+0000","last_became_active":"2024-03-23T23:42:40.713737+0000","last_became_peered":"2024-03-23T23:42:40.713737+0000","last_unstale":"2024-03-23T23:54:56.815848+0000","last_undegraded":"2024-03-23T23:54:56.815848+0000","last_fullsized":"2024-03-23T23:54:56.815848+0000","mapping_epoch":19,"log_start":"27'400","ondisk_log_start":"27'400","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5694,"log_dups_size":0,"ondisk_log_size":5694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:24:43.902129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90841,"num_write_kb":1111853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"27'6495","reported_seq":6518,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.399771+0000","last_change":"2024-03-23T23:42:50.746666+0000","last_active":"2024-03-23T23:57:53.399771+0000","last_peered":"2024-03-23T23:57:53.399771+0000","last_clean":"2024-03-23T23:57:53.399771+0000","last_became_active":"2024-03-23T23:42:50.746149+0000","last_became_peered":"2024-03-23T23:42:50.746149+0000","last_unstale":"2024-03-23T23:57:53.399771+0000","last_undegraded":"2024-03-23T23:57:53.399771+0000","last_fullsized":"2024-03-23T23:57:53.399771+0000","mapping_epoch":23,"log_start":"27'1200","ondisk_log_start":"27'1200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5295,"log_dups_size":0,"ondisk_log_size":5295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:42:58.533499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96498,"num_write_kb":1062339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"27'5291","reported_seq":5321,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:04.355114+0000","last_change":"2024-03-23T23:42:40.710655+0000","last_active":"2024-03-23T23:55:04.355114+0000","last_peered":"2024-03-23T23:55:04.355114+0000","last_clean":"2024-03-23T23:55:04.355114+0000","last_became_active":"2024-03-23T23:42:40.710362+0000","last_became_peered":"2024-03-23T23:42:40.710362+0000","last_unstale":"2024-03-23T23:55:04.355114+0000","last_undegraded":"2024-03-23T23:55:04.355114+0000","last_fullsized":"2024-03-23T23:55:04.355114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5291,"log_dups_size":0,"ondisk_log_size":5291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:12:14.359173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79360,"num_write_kb":955033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"27'4846","reported_seq":4869,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.646399+0000","last_change":"2024-03-23T23:42:50.753397+0000","last_active":"2024-03-23T23:57:57.646399+0000","last_peered":"2024-03-23T23:57:57.646399+0000","last_clean":"2024-03-23T23:57:57.646399+0000","last_became_active":"2024-03-23T23:42:50.753085+0000","last_became_peered":"2024-03-23T23:42:50.753085+0000","last_unstale":"2024-03-23T23:57:57.646399+0000","last_undegraded":"2024-03-23T23:57:57.646399+0000","last_fullsized":"2024-03-23T23:57:57.646399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4846,"log_dups_size":0,"ondisk_log_size":4846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:25:44.894505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71990,"num_write_kb":829684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"27'5525","reported_seq":5555,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:07.300744+0000","last_change":"2024-03-23T23:42:40.689380+0000","last_active":"2024-03-23T23:55:07.300744+0000","last_peered":"2024-03-23T23:55:07.300744+0000","last_clean":"2024-03-23T23:55:07.300744+0000","last_became_active":"2024-03-23T23:42:40.689023+0000","last_became_peered":"2024-03-23T23:42:40.689023+0000","last_unstale":"2024-03-23T23:55:07.300744+0000","last_undegraded":"2024-03-23T23:55:07.300744+0000","last_fullsized":"2024-03-23T23:55:07.300744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5525,"log_dups_size":0,"ondisk_log_size":5525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:17:19.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82240,"num_write_kb":999067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"27'4487","reported_seq":4510,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.305636+0000","last_change":"2024-03-23T23:42:50.756133+0000","last_active":"2024-03-23T23:57:53.305636+0000","last_peered":"2024-03-23T23:57:53.305636+0000","last_clean":"2024-03-23T23:57:53.305636+0000","last_became_active":"2024-03-23T23:42:50.755405+0000","last_became_peered":"2024-03-23T23:42:50.755405+0000","last_unstale":"2024-03-23T23:57:53.305636+0000","last_undegraded":"2024-03-23T23:57:53.305636+0000","last_fullsized":"2024-03-23T23:57:53.305636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4487,"log_dups_size":0,"ondisk_log_size":4487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:46:10.784416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66847,"num_write_kb":769767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"27'4564","reported_seq":4594,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.681397+0000","last_change":"2024-03-23T23:42:40.698234+0000","last_active":"2024-03-23T23:58:27.681397+0000","last_peered":"2024-03-23T23:58:27.681397+0000","last_clean":"2024-03-23T23:58:27.681397+0000","last_became_active":"2024-03-23T23:42:40.695978+0000","last_became_peered":"2024-03-23T23:42:40.695978+0000","last_unstale":"2024-03-23T23:58:27.681397+0000","last_undegraded":"2024-03-23T23:58:27.681397+0000","last_fullsized":"2024-03-23T23:58:27.681397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4564,"log_dups_size":0,"ondisk_log_size":4564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:04.633288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67848,"num_write_kb":796612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"27'5522","reported_seq":5545,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.400864+0000","last_change":"2024-03-23T23:42:50.752051+0000","last_active":"2024-03-23T23:57:53.400864+0000","last_peered":"2024-03-23T23:57:53.400864+0000","last_clean":"2024-03-23T23:57:53.400864+0000","last_became_active":"2024-03-23T23:42:50.751738+0000","last_became_peered":"2024-03-23T23:42:50.751738+0000","last_unstale":"2024-03-23T23:57:53.400864+0000","last_undegraded":"2024-03-23T23:57:53.400864+0000","last_fullsized":"2024-03-23T23:57:53.400864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5522,"log_dups_size":0,"ondisk_log_size":5522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:20:53.750917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81884,"num_write_kb":915818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'4910","reported_seq":4940,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:17.782378+0000","last_change":"2024-03-23T23:42:40.698407+0000","last_active":"2024-03-23T23:55:17.782378+0000","last_peered":"2024-03-23T23:55:17.782378+0000","last_clean":"2024-03-23T23:55:17.782378+0000","last_became_active":"2024-03-23T23:42:40.698092+0000","last_became_peered":"2024-03-23T23:42:40.698092+0000","last_unstale":"2024-03-23T23:55:17.782378+0000","last_undegraded":"2024-03-23T23:55:17.782378+0000","last_fullsized":"2024-03-23T23:55:17.782378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4910,"log_dups_size":0,"ondisk_log_size":4910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:00:33.261296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73128,"num_write_kb":826128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"27'4578","reported_seq":4600,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.631712+0000","last_change":"2024-03-23T23:42:50.753000+0000","last_active":"2024-03-23T23:57:57.631712+0000","last_peered":"2024-03-23T23:57:57.631712+0000","last_clean":"2024-03-23T23:57:57.631712+0000","last_became_active":"2024-03-23T23:42:50.752614+0000","last_became_peered":"2024-03-23T23:42:50.752614+0000","last_unstale":"2024-03-23T23:57:57.631712+0000","last_undegraded":"2024-03-23T23:57:57.631712+0000","last_fullsized":"2024-03-23T23:57:57.631712+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4578,"log_dups_size":0,"ondisk_log_size":4578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:57:04.394872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67913,"num_write_kb":776364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"27'4451","reported_seq":4482,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.674349+0000","last_change":"2024-03-23T23:42:40.700631+0000","last_active":"2024-03-23T23:58:27.674349+0000","last_peered":"2024-03-23T23:58:27.674349+0000","last_clean":"2024-03-23T23:58:27.674349+0000","last_became_active":"2024-03-23T23:42:40.697932+0000","last_became_peered":"2024-03-23T23:42:40.697932+0000","last_unstale":"2024-03-23T23:58:27.674349+0000","last_undegraded":"2024-03-23T23:58:27.674349+0000","last_fullsized":"2024-03-23T23:58:27.674349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4451,"log_dups_size":0,"ondisk_log_size":4451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:05:17.694245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66105,"num_write_kb":808863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"27'4921","reported_seq":4943,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.637912+0000","last_change":"2024-03-23T23:42:50.765991+0000","last_active":"2024-03-23T23:57:57.637912+0000","last_peered":"2024-03-23T23:57:57.637912+0000","last_clean":"2024-03-23T23:57:57.637912+0000","last_became_active":"2024-03-23T23:42:50.765716+0000","last_became_peered":"2024-03-23T23:42:50.765716+0000","last_unstale":"2024-03-23T23:57:57.637912+0000","last_undegraded":"2024-03-23T23:57:57.637912+0000","last_fullsized":"2024-03-23T23:57:57.637912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4921,"log_dups_size":0,"ondisk_log_size":4921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:49:52.067143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72768,"num_write_kb":776524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'5355","reported_seq":5386,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:59.870796+0000","last_change":"2024-03-23T23:42:40.683983+0000","last_active":"2024-03-23T23:54:59.870796+0000","last_peered":"2024-03-23T23:54:59.870796+0000","last_clean":"2024-03-23T23:54:59.870796+0000","last_became_active":"2024-03-23T23:42:40.683711+0000","last_became_peered":"2024-03-23T23:42:40.683711+0000","last_unstale":"2024-03-23T23:54:59.870796+0000","last_undegraded":"2024-03-23T23:54:59.870796+0000","last_fullsized":"2024-03-23T23:54:59.870796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5355,"log_dups_size":0,"ondisk_log_size":5355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:51:30.695597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79587,"num_write_kb":960150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"27'5549","reported_seq":5571,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.188872+0000","last_change":"2024-03-23T23:42:50.766544+0000","last_active":"2024-03-23T23:57:53.188872+0000","last_peered":"2024-03-23T23:57:53.188872+0000","last_clean":"2024-03-23T23:57:53.188872+0000","last_became_active":"2024-03-23T23:42:50.766328+0000","last_became_peered":"2024-03-23T23:42:50.766328+0000","last_unstale":"2024-03-23T23:57:53.188872+0000","last_undegraded":"2024-03-23T23:57:53.188872+0000","last_fullsized":"2024-03-23T23:57:53.188872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5549,"log_dups_size":0,"ondisk_log_size":5549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:28:43.677331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82850,"num_write_kb":926357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"27'6240","reported_seq":6271,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:06.694455+0000","last_change":"2024-03-23T23:42:40.678622+0000","last_active":"2024-03-23T23:55:06.694455+0000","last_peered":"2024-03-23T23:55:06.694455+0000","last_clean":"2024-03-23T23:55:06.694455+0000","last_became_active":"2024-03-23T23:42:40.678325+0000","last_became_peered":"2024-03-23T23:42:40.678325+0000","last_unstale":"2024-03-23T23:55:06.694455+0000","last_undegraded":"2024-03-23T23:55:06.694455+0000","last_fullsized":"2024-03-23T23:55:06.694455+0000","mapping_epoch":19,"log_start":"27'500","ondisk_log_start":"27'500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5740,"log_dups_size":0,"ondisk_log_size":5740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:54:27.641281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92992,"num_write_kb":1109347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"27'5524","reported_seq":5546,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.633709+0000","last_change":"2024-03-23T23:42:50.750690+0000","last_active":"2024-03-23T23:57:57.633709+0000","last_peered":"2024-03-23T23:57:57.633709+0000","last_clean":"2024-03-23T23:57:57.633709+0000","last_became_active":"2024-03-23T23:42:50.750466+0000","last_became_peered":"2024-03-23T23:42:50.750466+0000","last_unstale":"2024-03-23T23:57:57.633709+0000","last_undegraded":"2024-03-23T23:57:57.633709+0000","last_fullsized":"2024-03-23T23:57:57.633709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5524,"log_dups_size":0,"ondisk_log_size":5524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:13:07.156401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82257,"num_write_kb":938007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"27'4800","reported_seq":4831,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:12.437938+0000","last_change":"2024-03-23T23:42:40.701959+0000","last_active":"2024-03-23T23:55:12.437938+0000","last_peered":"2024-03-23T23:55:12.437938+0000","last_clean":"2024-03-23T23:55:12.437938+0000","last_became_active":"2024-03-23T23:42:40.700855+0000","last_became_peered":"2024-03-23T23:42:40.700855+0000","last_unstale":"2024-03-23T23:55:12.437938+0000","last_undegraded":"2024-03-23T23:55:12.437938+0000","last_fullsized":"2024-03-23T23:55:12.437938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4800,"log_dups_size":0,"ondisk_log_size":4800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:49:42.009983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71971,"num_write_kb":878476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":4985198,"num_write_kb":56700971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326994,"ondisk_log_size":326994,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":98084343,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":31,"num_read_kb":105,"num_write":4486,"num_write_kb":97547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":196231168,"data_stored":196168686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4209,"ondisk_log_size":4209,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":11,"num_write":4962178,"num_write_kb":59383104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326261,"ondisk_log_size":326261,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":93601645,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":44,"num_read_kb":115,"num_write":4040,"num_write_kb":93017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":187260928,"data_stored":187203290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3812,"ondisk_log_size":3812,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509634,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":612204,"kb_used_data":49444,"kb_used_omap":1,"kb_used_meta":562750,"kb_avail":93759636,"statfs":{"total":96636764160,"available":96009867264,"internally_reserved":0,"allocated":50630656,"data_stored":50448059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":576256454},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509630,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":889852,"kb_used_data":37236,"kb_used_omap":1,"kb_used_meta":852606,"kb_avail":93481988,"statfs":{"total":96636764160,"available":95725555712,"internally_reserved":0,"allocated":38129664,"data_stored":37949267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":873068997},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509629,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":997916,"kb_used_data":67412,"kb_used_omap":1,"kb_used_meta":930494,"kb_avail":93373924,"statfs":{"total":96636764160,"available":95614898176,"internally_reserved":0,"allocated":69029888,"data_stored":68838098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":952826309},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,4,0,4,2,5,22],"upper_bound":512},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509630,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":977816,"kb_used_data":56336,"kb_used_omap":1,"kb_used_meta":921470,"kb_avail":93394024,"statfs":{"total":96636764160,"available":95635480576,"internally_reserved":0,"allocated":57688064,"data_stored":57497163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":943585735},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542332,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":916712,"kb_used_data":58208,"kb_used_omap":1,"kb_used_meta":858494,"kb_avail":93455128,"statfs":{"total":96636764160,"available":95698051072,"internally_reserved":0,"allocated":59604992,"data_stored":59426419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":879098314},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542337,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":575412,"kb_used_data":12652,"kb_used_omap":1,"kb_used_meta":562750,"kb_avail":93796428,"statfs":{"total":96636764160,"available":96047542272,"internally_reserved":0,"allocated":12955648,"data_stored":12782666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":576256453},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542336,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":775788,"kb_used_data":62948,"kb_used_omap":1,"kb_used_meta":712830,"kb_avail":93596052,"statfs":{"total":96636764160,"available":95842357248,"internally_reserved":0,"allocated":64458752,"data_stored":64271463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":729938373},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542335,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":736108,"kb_used_data":33636,"kb_used_omap":1,"kb_used_meta":702462,"kb_avail":93635732,"statfs":{"total":96636764160,"available":95882989568,"internally_reserved":0,"allocated":34443264,"data_stored":34260561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":719321541},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25178112,"data_stored":25166462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22220800,"data_stored":22212606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4280320,"data_stored":4278865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18112512,"data_stored":18103375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":33566720,"data_stored":33554558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20971610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20979712,"data_stored":20972192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":41947136,"data_stored":41943622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41955328,"data_stored":41943734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8392704,"data_stored":8388678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":39292928,"data_stored":39278665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":35180544,"data_stored":35168417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16871424,"data_stored":16862534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29368320,"data_stored":29360744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16777306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T23:58:31.396 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T23:58:31.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.570+0000 7fee6f800640 1 Processor -- start 2024-03-23T23:58:31.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.570+0000 7fee6f800640 1 -- start start 2024-03-23T23:58:31.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.570+0000 7fee6f800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee68156ee0 0x7fee68073230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:31.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.570+0000 7fee6f800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee68073770 con 0x7fee68149bd0 2024-03-23T23:58:31.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.570+0000 7fee6f800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee680aa390 con 0x7fee680ac270 2024-03-23T23:58:31.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.570+0000 7fee6f800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6806e720 con 0x7fee68156ee0 2024-03-23T23:58:31.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.570+0000 7fee67e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fee68149bd0 0x7fee6814a030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:35456/0 (socket says 172.21.15.8:35456) 2024-03-23T23:58:31.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.570+0000 7fee67e00640 1 -- 172.21.15.8:0/2265889006 learned_addr learned my addr 172.21.15.8:0/2265889006 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:58:31.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.570+0000 7fee6ce00640 1 --2- 172.21.15.8:0/2265889006 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee68156ee0 0x7fee68073230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:31.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.570+0000 7fee67400640 1 -- 172.21.15.8:0/2265889006 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 392140101 0 0) 0x7fee68073770 con 0x7fee68149bd0 2024-03-23T23:58:31.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.570+0000 7fee67400640 1 -- 172.21.15.8:0/2265889006 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee50003530 con 0x7fee68149bd0 2024-03-23T23:58:31.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.570+0000 7fee67400640 1 -- 172.21.15.8:0/2265889006 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1613103787 0 0) 0x7fee680aa390 con 0x7fee680ac270 2024-03-23T23:58:31.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.570+0000 7fee67400640 1 -- 172.21.15.8:0/2265889006 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee68073770 con 0x7fee680ac270 2024-03-23T23:58:31.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.570+0000 7fee6ce00640 1 -- 172.21.15.8:0/2265889006 >> v1:172.21.15.196:6789/0 conn(0x7fee680ac270 legacy=0x7fee680ac6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.570+0000 7fee6ce00640 1 -- 172.21.15.8:0/2265889006 >> v1:172.21.15.8:6789/0 conn(0x7fee68149bd0 legacy=0x7fee6814a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.570+0000 7fee6ce00640 1 -- 172.21.15.8:0/2265889006 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6806ea00 con 0x7fee68156ee0 2024-03-23T23:58:31.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.574+0000 7fee6ce00640 1 --2- 172.21.15.8:0/2265889006 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee68156ee0 0x7fee68073230 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0097f0 tx=0x7fee5c01c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5da2a86f4d372560 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:31.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.574+0000 7fee67400640 1 -- 172.21.15.8:0/2265889006 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c0b1070 con 0x7fee68156ee0 2024-03-23T23:58:31.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.574+0000 7fee67400640 1 -- 172.21.15.8:0/2265889006 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5c0a8050 con 0x7fee68156ee0 2024-03-23T23:58:31.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.574+0000 7fee67400640 1 -- 172.21.15.8:0/2265889006 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c0ac860 con 0x7fee68156ee0 2024-03-23T23:58:31.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.574+0000 7fee6f800640 1 -- 172.21.15.8:0/2265889006 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee68156ee0 msgr2=0x7fee68073230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.574+0000 7fee6f800640 1 --2- 172.21.15.8:0/2265889006 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee68156ee0 0x7fee68073230 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0097f0 tx=0x7fee5c01c3e0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.574+0000 7fee6f800640 1 -- 172.21.15.8:0/2265889006 shutdown_connections 2024-03-23T23:58:31.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.574+0000 7fee6f800640 1 --2- 172.21.15.8:0/2265889006 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee68156ee0 0x7fee68073230 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.574+0000 7fee6f800640 1 -- 172.21.15.8:0/2265889006 >> 172.21.15.8:0/2265889006 conn(0x7fee6806b170 msgr2=0x7fee6806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:31.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.574+0000 7fee6f800640 1 -- 172.21.15.8:0/2265889006 shutdown_connections 2024-03-23T23:58:31.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.574+0000 7fee6f800640 1 -- 172.21.15.8:0/2265889006 wait complete. 2024-03-23T23:58:31.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.578+0000 7fee6f800640 1 Processor -- start 2024-03-23T23:58:31.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.578+0000 7fee6f800640 1 -- start start 2024-03-23T23:58:31.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.578+0000 7fee6f800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee680ac270 0x7fee68142030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:31.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.578+0000 7fee6f800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee68149bd0 0x7fee681f1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:31.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.578+0000 7fee6f800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee68156ee0 0x7fee681ee6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:31.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.578+0000 7fee6f800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee681579f0 con 0x7fee68149bd0 2024-03-23T23:58:31.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.578+0000 7fee6f800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee68157870 con 0x7fee68156ee0 2024-03-23T23:58:31.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.578+0000 7fee6f800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee680acdf0 con 0x7fee680ac270 2024-03-23T23:58:31.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.578+0000 7fee67e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee68149bd0 0x7fee681f1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:31.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.578+0000 7fee6ce00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee680ac270 0x7fee68142030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:31.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.578+0000 7fee67e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee68149bd0 0x7fee681f1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58672/0 (socket says 172.21.15.8:58672) 2024-03-23T23:58:31.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.578+0000 7fee67e00640 1 -- 172.21.15.8:0/268768400 learned_addr learned my addr 172.21.15.8:0/268768400 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:31.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.578+0000 7fee6d800640 1 --2- 172.21.15.8:0/268768400 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee68156ee0 0x7fee681ee6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:31.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.578+0000 7fee6ce00640 1 -- 172.21.15.8:0/268768400 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee68156ee0 msgr2=0x7fee681ee6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.578+0000 7fee6ce00640 1 --2- 172.21.15.8:0/268768400 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee68156ee0 0x7fee681ee6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.578+0000 7fee6ce00640 1 -- 172.21.15.8:0/268768400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee68149bd0 msgr2=0x7fee681f1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.578+0000 7fee6ce00640 1 --2- 172.21.15.8:0/268768400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee68149bd0 0x7fee681f1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.578+0000 7fee6ce00640 1 -- 172.21.15.8:0/268768400 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee68072a40 con 0x7fee680ac270 2024-03-23T23:58:31.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.578+0000 7fee6ce00640 1 --2- 172.21.15.8:0/268768400 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee680ac270 0x7fee68142030 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fee6806c190 tx=0x7fee5c019180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:31.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.578+0000 7fee64c00640 1 -- 172.21.15.8:0/268768400 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c0b1040 con 0x7fee680ac270 2024-03-23T23:58:31.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.578+0000 7fee64c00640 1 -- 172.21.15.8:0/268768400 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5c0acba0 con 0x7fee680ac270 2024-03-23T23:58:31.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.578+0000 7fee6f800640 1 -- 172.21.15.8:0/268768400 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee680721a0 con 0x7fee680ac270 2024-03-23T23:58:31.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.578+0000 7fee64c00640 1 -- 172.21.15.8:0/268768400 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c0b5410 con 0x7fee680ac270 2024-03-23T23:58:31.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.578+0000 7fee6f800640 1 -- 172.21.15.8:0/268768400 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee68072760 con 0x7fee680ac270 2024-03-23T23:58:31.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.582+0000 7fee6f800640 1 -- 172.21.15.8:0/268768400 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee68068270 con 0x7fee680ac270 2024-03-23T23:58:31.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.582+0000 7fee64c00640 1 -- 172.21.15.8:0/268768400 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fee5c0bd020 con 0x7fee680ac270 2024-03-23T23:58:31.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.582+0000 7fee64c00640 1 --2- 172.21.15.8:0/268768400 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fee48067660 0x7fee48069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:31.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.582+0000 7fee64c00640 1 -- 172.21.15.8:0/268768400 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fee5c11eed0 con 0x7fee680ac270 2024-03-23T23:58:31.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.582+0000 7fee67e00640 1 --2- 172.21.15.8:0/268768400 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fee48067660 0x7fee48069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:31.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.586+0000 7fee67e00640 1 --2- 172.21.15.8:0/268768400 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fee48067660 0x7fee48069b20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fee680c8090 tx=0x7fee54009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:31.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.586+0000 7fee64c00640 1 -- 172.21.15.8:0/268768400 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fee5c0c4060 con 0x7fee680ac270 2024-03-23T23:58:31.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.746+0000 7fee6f800640 1 -- 172.21.15.8:0/268768400 --> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fee68154860 con 0x7fee48067660 2024-03-23T23:58:31.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.758+0000 7fee64c00640 1 -- 172.21.15.8:0/268768400 <== mgr.4098 v2:172.21.15.196:6832/1295060067 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+494266 (secure 0 0 0) 0x7fee68154860 con 0x7fee48067660 2024-03-23T23:58:31.765 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:58:31.768 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-03-23T23:58:31.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.762+0000 7fee6f800640 1 -- 172.21.15.8:0/268768400 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fee48067660 msgr2=0x7fee48069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.762+0000 7fee6f800640 1 --2- 172.21.15.8:0/268768400 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fee48067660 0x7fee48069b20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fee680c8090 tx=0x7fee54009040 comp rx=0 tx=0).stop 2024-03-23T23:58:31.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.762+0000 7fee6f800640 1 -- 172.21.15.8:0/268768400 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee680ac270 msgr2=0x7fee68142030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.762+0000 7fee6f800640 1 --2- 172.21.15.8:0/268768400 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee680ac270 0x7fee68142030 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fee6806c190 tx=0x7fee5c019180 comp rx=0 tx=0).stop 2024-03-23T23:58:31.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.762+0000 7fee6f800640 1 -- 172.21.15.8:0/268768400 shutdown_connections 2024-03-23T23:58:31.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.762+0000 7fee6f800640 1 --2- 172.21.15.8:0/268768400 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee68156ee0 0x7fee681ee6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.762+0000 7fee6f800640 1 --2- 172.21.15.8:0/268768400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee68149bd0 0x7fee681f1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.762+0000 7fee6f800640 1 --2- 172.21.15.8:0/268768400 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fee48067660 0x7fee48069b20 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.762+0000 7fee6f800640 1 --2- 172.21.15.8:0/268768400 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee680ac270 0x7fee68142030 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.762+0000 7fee6f800640 1 -- 172.21.15.8:0/268768400 >> 172.21.15.8:0/268768400 conn(0x7fee6806b170 msgr2=0x7fee680c06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:31.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.766+0000 7fee6f800640 1 -- 172.21.15.8:0/268768400 shutdown_connections 2024-03-23T23:58:31.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.766+0000 7fee6f800640 1 -- 172.21.15.8:0/268768400 wait complete. 2024-03-23T23:58:31.785 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":502,"stamp":"2024-03-23T23:58:31.727130+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":192276605,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":195,"num_read_kb":347,"num_write":9956067,"num_write_kb":116277057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":661720,"ondisk_log_size":661720,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":6481812,"kb_used_data":377876,"kb_used_omap":12,"kb_used_meta":6103859,"kb_avail":748492908,"statfs":{"total":773094113280,"available":766456737792,"internally_reserved":0,"allocated":386945024,"data_stored":385473945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":6250352176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,4,0,4,2,5,22],"upper_bound":512},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":249,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006457"},"pg_stats":[{"pgid":"5.18","version":"27'5444","reported_seq":5466,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.644986+0000","last_change":"2024-03-23T23:42:50.736219+0000","last_active":"2024-03-23T23:57:57.644986+0000","last_peered":"2024-03-23T23:57:57.644986+0000","last_clean":"2024-03-23T23:57:57.644986+0000","last_became_active":"2024-03-23T23:42:50.735940+0000","last_became_peered":"2024-03-23T23:42:50.735940+0000","last_unstale":"2024-03-23T23:57:57.644986+0000","last_undegraded":"2024-03-23T23:57:57.644986+0000","last_fullsized":"2024-03-23T23:57:57.644986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5444,"log_dups_size":0,"ondisk_log_size":5444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:11:44.111477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80864,"num_write_kb":923838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"27'57","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:59.870845+0000","last_change":"2024-03-23T23:42:39.693858+0000","last_active":"2024-03-23T23:54:59.870845+0000","last_peered":"2024-03-23T23:54:59.870845+0000","last_clean":"2024-03-23T23:54:59.870845+0000","last_became_active":"2024-03-23T23:42:39.693636+0000","last_became_peered":"2024-03-23T23:42:39.693636+0000","last_unstale":"2024-03-23T23:54:59.870845+0000","last_undegraded":"2024-03-23T23:54:59.870845+0000","last_fullsized":"2024-03-23T23:54:59.870845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:44:07.213123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'5379","reported_seq":5410,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:59.180370+0000","last_change":"2024-03-23T23:42:40.685708+0000","last_active":"2024-03-23T23:54:59.180370+0000","last_peered":"2024-03-23T23:54:59.180370+0000","last_clean":"2024-03-23T23:54:59.180370+0000","last_became_active":"2024-03-23T23:42:40.682755+0000","last_became_peered":"2024-03-23T23:42:40.682755+0000","last_unstale":"2024-03-23T23:54:59.180370+0000","last_undegraded":"2024-03-23T23:54:59.180370+0000","last_fullsized":"2024-03-23T23:54:59.180370+0000","mapping_epoch":19,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5279,"log_dups_size":0,"ondisk_log_size":5279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:04.633288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79922,"num_write_kb":951101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'4","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.420544+0000","last_change":"2024-03-23T23:42:49.750108+0000","last_active":"2024-03-23T23:57:53.420544+0000","last_peered":"2024-03-23T23:57:53.420544+0000","last_clean":"2024-03-23T23:57:53.420544+0000","last_became_active":"2024-03-23T23:42:49.749634+0000","last_became_peered":"2024-03-23T23:42:49.749634+0000","last_unstale":"2024-03-23T23:57:53.420544+0000","last_undegraded":"2024-03-23T23:57:53.420544+0000","last_fullsized":"2024-03-23T23:57:53.420544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:49:16.758908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"27'6028","reported_seq":6050,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.461302+0000","last_change":"2024-03-23T23:42:50.752450+0000","last_active":"2024-03-23T23:58:30.461302+0000","last_peered":"2024-03-23T23:58:30.461302+0000","last_clean":"2024-03-23T23:58:30.461302+0000","last_became_active":"2024-03-23T23:42:50.752078+0000","last_became_peered":"2024-03-23T23:42:50.752078+0000","last_unstale":"2024-03-23T23:58:30.461302+0000","last_undegraded":"2024-03-23T23:58:30.461302+0000","last_fullsized":"2024-03-23T23:58:30.461302+0000","mapping_epoch":23,"log_start":"27'300","ondisk_log_start":"27'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5728,"log_dups_size":0,"ondisk_log_size":5728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:28:43.677331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89116,"num_write_kb":998926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"27'15","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:59.180396+0000","last_change":"2024-03-23T23:42:39.687108+0000","last_active":"2024-03-23T23:54:59.180396+0000","last_peered":"2024-03-23T23:54:59.180396+0000","last_clean":"2024-03-23T23:54:59.180396+0000","last_became_active":"2024-03-23T23:42:39.686875+0000","last_became_peered":"2024-03-23T23:42:39.686875+0000","last_unstale":"2024-03-23T23:54:59.180396+0000","last_undegraded":"2024-03-23T23:54:59.180396+0000","last_fullsized":"2024-03-23T23:54:59.180396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:05:52.079172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'7365","reported_seq":7396,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.667492+0000","last_change":"2024-03-23T23:42:40.698746+0000","last_active":"2024-03-23T23:58:27.667492+0000","last_peered":"2024-03-23T23:58:27.667492+0000","last_clean":"2024-03-23T23:58:27.667492+0000","last_became_active":"2024-03-23T23:42:40.698003+0000","last_became_peered":"2024-03-23T23:42:40.698003+0000","last_unstale":"2024-03-23T23:58:27.667492+0000","last_undegraded":"2024-03-23T23:58:27.667492+0000","last_fullsized":"2024-03-23T23:58:27.667492+0000","mapping_epoch":19,"log_start":"27'500","ondisk_log_start":"27'500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":6865,"log_dups_size":0,"ondisk_log_size":6865,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:53:46.437114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110287,"num_write_kb":1353580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'28","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:32.652461+0000","last_change":"2024-03-23T23:42:49.728923+0000","last_active":"2024-03-23T23:57:32.652461+0000","last_peered":"2024-03-23T23:57:32.652461+0000","last_clean":"2024-03-23T23:57:32.652461+0000","last_became_active":"2024-03-23T23:42:49.728261+0000","last_became_peered":"2024-03-23T23:42:49.728261+0000","last_unstale":"2024-03-23T23:57:32.652461+0000","last_undegraded":"2024-03-23T23:57:32.652461+0000","last_fullsized":"2024-03-23T23:57:32.652461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:22.375891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"27'4523","reported_seq":4545,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.357209+0000","last_change":"2024-03-23T23:42:50.755852+0000","last_active":"2024-03-23T23:57:53.357209+0000","last_peered":"2024-03-23T23:57:53.357209+0000","last_clean":"2024-03-23T23:57:53.357209+0000","last_became_active":"2024-03-23T23:42:50.755600+0000","last_became_peered":"2024-03-23T23:42:50.755600+0000","last_unstale":"2024-03-23T23:57:53.357209+0000","last_undegraded":"2024-03-23T23:57:53.357209+0000","last_fullsized":"2024-03-23T23:57:53.357209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4523,"log_dups_size":0,"ondisk_log_size":4523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:29:47.303374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67405,"num_write_kb":746106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"27'60","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:17.810639+0000","last_change":"2024-03-23T23:42:39.696690+0000","last_active":"2024-03-23T23:55:17.810639+0000","last_peered":"2024-03-23T23:55:17.810639+0000","last_clean":"2024-03-23T23:55:17.810639+0000","last_became_active":"2024-03-23T23:42:39.696342+0000","last_became_peered":"2024-03-23T23:42:39.696342+0000","last_unstale":"2024-03-23T23:55:17.810639+0000","last_undegraded":"2024-03-23T23:55:17.810639+0000","last_fullsized":"2024-03-23T23:55:17.810639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:42:37.702720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":12316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'4666","reported_seq":4696,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.711924+0000","last_change":"2024-03-23T23:42:40.700355+0000","last_active":"2024-03-23T23:58:27.711924+0000","last_peered":"2024-03-23T23:58:27.711924+0000","last_clean":"2024-03-23T23:58:27.711924+0000","last_became_active":"2024-03-23T23:42:40.697668+0000","last_became_peered":"2024-03-23T23:42:40.697668+0000","last_unstale":"2024-03-23T23:58:27.711924+0000","last_undegraded":"2024-03-23T23:58:27.711924+0000","last_fullsized":"2024-03-23T23:58:27.711924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4666,"log_dups_size":0,"ondisk_log_size":4666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:23:43.515519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69534,"num_write_kb":791816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'1354","reported_seq":1378,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.424228+0000","last_change":"2024-03-23T23:42:49.744792+0000","last_active":"2024-03-23T23:57:53.424228+0000","last_peered":"2024-03-23T23:57:53.424228+0000","last_clean":"2024-03-23T23:57:53.424228+0000","last_became_active":"2024-03-23T23:42:49.744561+0000","last_became_peered":"2024-03-23T23:42:49.744561+0000","last_unstale":"2024-03-23T23:57:53.424228+0000","last_undegraded":"2024-03-23T23:57:53.424228+0000","last_fullsized":"2024-03-23T23:57:53.424228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1354,"log_dups_size":0,"ondisk_log_size":1354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:07:58.222020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1348,"num_write_kb":4325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"27'4452","reported_seq":4474,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.400820+0000","last_change":"2024-03-23T23:42:50.755575+0000","last_active":"2024-03-23T23:57:53.400820+0000","last_peered":"2024-03-23T23:57:53.400820+0000","last_clean":"2024-03-23T23:57:53.400820+0000","last_became_active":"2024-03-23T23:42:50.755337+0000","last_became_peered":"2024-03-23T23:42:50.755337+0000","last_unstale":"2024-03-23T23:57:53.400820+0000","last_undegraded":"2024-03-23T23:57:53.400820+0000","last_fullsized":"2024-03-23T23:57:53.400820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4452,"log_dups_size":0,"ondisk_log_size":4452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:13.911327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65733,"num_write_kb":735312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"27'16","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:12.437892+0000","last_change":"2024-03-23T23:42:39.696707+0000","last_active":"2024-03-23T23:55:12.437892+0000","last_peered":"2024-03-23T23:55:12.437892+0000","last_clean":"2024-03-23T23:55:12.437892+0000","last_became_active":"2024-03-23T23:42:39.696401+0000","last_became_peered":"2024-03-23T23:42:39.696401+0000","last_unstale":"2024-03-23T23:55:12.437892+0000","last_undegraded":"2024-03-23T23:55:12.437892+0000","last_fullsized":"2024-03-23T23:55:12.437892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:55.757707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'6122","reported_seq":6152,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.741740+0000","last_change":"2024-03-23T23:42:40.700389+0000","last_active":"2024-03-23T23:58:27.741740+0000","last_peered":"2024-03-23T23:58:27.741740+0000","last_clean":"2024-03-23T23:58:27.741740+0000","last_became_active":"2024-03-23T23:42:40.699770+0000","last_became_peered":"2024-03-23T23:42:40.699770+0000","last_unstale":"2024-03-23T23:58:27.741740+0000","last_undegraded":"2024-03-23T23:58:27.741740+0000","last_fullsized":"2024-03-23T23:58:27.741740+0000","mapping_epoch":19,"log_start":"27'200","ondisk_log_start":"27'200","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5922,"log_dups_size":0,"ondisk_log_size":5922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:27.675824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91052,"num_write_kb":1089478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'300","reported_seq":324,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:01.092701+0000","last_change":"2024-03-23T23:42:49.745710+0000","last_active":"2024-03-23T23:58:01.092701+0000","last_peered":"2024-03-23T23:58:01.092701+0000","last_clean":"2024-03-23T23:58:01.092701+0000","last_became_active":"2024-03-23T23:42:49.745526+0000","last_became_peered":"2024-03-23T23:42:49.745526+0000","last_unstale":"2024-03-23T23:58:01.092701+0000","last_undegraded":"2024-03-23T23:58:01.092701+0000","last_fullsized":"2024-03-23T23:58:01.092701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:05:26.746849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5723539,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":5807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"27'5356","reported_seq":5380,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.415680+0000","last_change":"2024-03-23T23:42:50.747274+0000","last_active":"2024-03-23T23:58:30.415680+0000","last_peered":"2024-03-23T23:58:30.415680+0000","last_clean":"2024-03-23T23:58:30.415680+0000","last_became_active":"2024-03-23T23:42:50.746937+0000","last_became_peered":"2024-03-23T23:42:50.746937+0000","last_unstale":"2024-03-23T23:58:30.415680+0000","last_undegraded":"2024-03-23T23:58:30.415680+0000","last_fullsized":"2024-03-23T23:58:30.415680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5356,"log_dups_size":0,"ondisk_log_size":5356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:19.610436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":11,"num_write":79434,"num_write_kb":896560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"27'5252","reported_seq":5283,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.632377+0000","last_change":"2024-03-23T23:42:40.682467+0000","last_active":"2024-03-23T23:58:27.632377+0000","last_peered":"2024-03-23T23:58:27.632377+0000","last_clean":"2024-03-23T23:58:27.632377+0000","last_became_active":"2024-03-23T23:42:40.682192+0000","last_became_peered":"2024-03-23T23:42:40.682192+0000","last_unstale":"2024-03-23T23:58:27.632377+0000","last_undegraded":"2024-03-23T23:58:27.632377+0000","last_fullsized":"2024-03-23T23:58:27.632377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5252,"log_dups_size":0,"ondisk_log_size":5252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:37:24.839568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78193,"num_write_kb":930302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'10","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:56:06.895925+0000","last_change":"2024-03-23T23:42:39.696528+0000","last_active":"2024-03-23T23:56:06.895925+0000","last_peered":"2024-03-23T23:56:06.895925+0000","last_clean":"2024-03-23T23:56:06.895925+0000","last_became_active":"2024-03-23T23:42:39.696207+0000","last_became_peered":"2024-03-23T23:42:39.696207+0000","last_unstale":"2024-03-23T23:56:06.895925+0000","last_undegraded":"2024-03-23T23:56:06.895925+0000","last_fullsized":"2024-03-23T23:56:06.895925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:02.190910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'10","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.352552+0000","last_change":"2024-03-23T23:42:49.734156+0000","last_active":"2024-03-23T23:57:53.352552+0000","last_peered":"2024-03-23T23:57:53.352552+0000","last_clean":"2024-03-23T23:57:53.352552+0000","last_became_active":"2024-03-23T23:42:49.733888+0000","last_became_peered":"2024-03-23T23:42:49.733888+0000","last_unstale":"2024-03-23T23:57:53.352552+0000","last_undegraded":"2024-03-23T23:57:53.352552+0000","last_fullsized":"2024-03-23T23:57:53.352552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:23:52.568123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"27'5594","reported_seq":5616,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.404958+0000","last_change":"2024-03-23T23:42:50.759749+0000","last_active":"2024-03-23T23:58:30.404958+0000","last_peered":"2024-03-23T23:58:30.404958+0000","last_clean":"2024-03-23T23:58:30.404958+0000","last_became_active":"2024-03-23T23:42:50.758670+0000","last_became_peered":"2024-03-23T23:42:50.758670+0000","last_unstale":"2024-03-23T23:58:30.404958+0000","last_undegraded":"2024-03-23T23:58:30.404958+0000","last_fullsized":"2024-03-23T23:58:30.404958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5594,"log_dups_size":0,"ondisk_log_size":5594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:16:02.318732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82815,"num_write_kb":936767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"27'4454","reported_seq":4485,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:56:10.697294+0000","last_change":"2024-03-23T23:42:40.674574+0000","last_active":"2024-03-23T23:56:10.697294+0000","last_peered":"2024-03-23T23:56:10.697294+0000","last_clean":"2024-03-23T23:56:10.697294+0000","last_became_active":"2024-03-23T23:42:40.674293+0000","last_became_peered":"2024-03-23T23:42:40.674293+0000","last_unstale":"2024-03-23T23:56:10.697294+0000","last_undegraded":"2024-03-23T23:56:10.697294+0000","last_fullsized":"2024-03-23T23:56:10.697294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4454,"log_dups_size":0,"ondisk_log_size":4454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:37:24.839568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66336,"num_write_kb":780596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'216","reported_seq":249,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.480173+0000","last_change":"2024-03-23T23:42:39.683165+0000","last_active":"2024-03-23T23:58:27.480173+0000","last_peered":"2024-03-23T23:58:27.480173+0000","last_clean":"2024-03-23T23:58:27.480173+0000","last_became_active":"2024-03-23T23:42:39.680121+0000","last_became_peered":"2024-03-23T23:42:39.680121+0000","last_unstale":"2024-03-23T23:58:27.480173+0000","last_undegraded":"2024-03-23T23:58:27.480173+0000","last_fullsized":"2024-03-23T23:58:27.480173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:02.190910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1241175,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":1371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'5","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.428505+0000","last_change":"2024-03-23T23:42:49.745016+0000","last_active":"2024-03-23T23:57:53.428505+0000","last_peered":"2024-03-23T23:57:53.428505+0000","last_clean":"2024-03-23T23:57:53.428505+0000","last_became_active":"2024-03-23T23:42:49.744742+0000","last_became_peered":"2024-03-23T23:42:49.744742+0000","last_unstale":"2024-03-23T23:57:53.428505+0000","last_undegraded":"2024-03-23T23:57:53.428505+0000","last_fullsized":"2024-03-23T23:57:53.428505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:30.033743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"27'4308","reported_seq":4330,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.615870+0000","last_change":"2024-03-23T23:42:50.749792+0000","last_active":"2024-03-23T23:57:57.615870+0000","last_peered":"2024-03-23T23:57:57.615870+0000","last_clean":"2024-03-23T23:57:57.615870+0000","last_became_active":"2024-03-23T23:42:50.749491+0000","last_became_peered":"2024-03-23T23:42:50.749491+0000","last_unstale":"2024-03-23T23:57:57.615870+0000","last_undegraded":"2024-03-23T23:57:57.615870+0000","last_fullsized":"2024-03-23T23:57:57.615870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4308,"log_dups_size":0,"ondisk_log_size":4308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:25:44.894505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64025,"num_write_kb":713675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'4679","reported_seq":4710,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:45.299407+0000","last_change":"2024-03-23T23:42:40.682999+0000","last_active":"2024-03-23T23:55:45.299407+0000","last_peered":"2024-03-23T23:55:45.299407+0000","last_clean":"2024-03-23T23:55:45.299407+0000","last_became_active":"2024-03-23T23:42:40.682672+0000","last_became_peered":"2024-03-23T23:42:40.682672+0000","last_unstale":"2024-03-23T23:55:45.299407+0000","last_undegraded":"2024-03-23T23:55:45.299407+0000","last_fullsized":"2024-03-23T23:55:45.299407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4679,"log_dups_size":0,"ondisk_log_size":4679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:59:45.154553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69709,"num_write_kb":858998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'2","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:47.349873+0000","last_change":"2024-03-23T23:42:39.691470+0000","last_active":"2024-03-23T23:55:47.349873+0000","last_peered":"2024-03-23T23:55:47.349873+0000","last_clean":"2024-03-23T23:55:47.349873+0000","last_became_active":"2024-03-23T23:42:39.691124+0000","last_became_peered":"2024-03-23T23:42:39.691124+0000","last_unstale":"2024-03-23T23:55:47.349873+0000","last_undegraded":"2024-03-23T23:55:47.349873+0000","last_fullsized":"2024-03-23T23:55:47.349873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:55.757707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'23","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.418054+0000","last_change":"2024-03-23T23:42:49.750016+0000","last_active":"2024-03-23T23:57:53.418054+0000","last_peered":"2024-03-23T23:57:53.418054+0000","last_clean":"2024-03-23T23:57:53.418054+0000","last_became_active":"2024-03-23T23:42:49.749279+0000","last_became_peered":"2024-03-23T23:42:49.749279+0000","last_unstale":"2024-03-23T23:57:53.418054+0000","last_undegraded":"2024-03-23T23:57:53.418054+0000","last_fullsized":"2024-03-23T23:57:53.418054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:41:14.671834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"27'6849","reported_seq":6871,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.375906+0000","last_change":"2024-03-23T23:42:50.753669+0000","last_active":"2024-03-23T23:57:53.375906+0000","last_peered":"2024-03-23T23:57:53.375906+0000","last_clean":"2024-03-23T23:57:53.375906+0000","last_became_active":"2024-03-23T23:42:50.752674+0000","last_became_peered":"2024-03-23T23:42:50.752674+0000","last_unstale":"2024-03-23T23:57:53.375906+0000","last_undegraded":"2024-03-23T23:57:53.375906+0000","last_fullsized":"2024-03-23T23:57:53.375906+0000","mapping_epoch":23,"log_start":"27'900","ondisk_log_start":"27'900","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5949,"log_dups_size":0,"ondisk_log_size":5949,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:39:04.727316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101780,"num_write_kb":1163482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"27'4769","reported_seq":4800,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.622856+0000","last_change":"2024-03-23T23:42:40.685051+0000","last_active":"2024-03-23T23:58:27.622856+0000","last_peered":"2024-03-23T23:58:27.622856+0000","last_clean":"2024-03-23T23:58:27.622856+0000","last_became_active":"2024-03-23T23:42:40.684677+0000","last_became_peered":"2024-03-23T23:42:40.684677+0000","last_unstale":"2024-03-23T23:58:27.622856+0000","last_undegraded":"2024-03-23T23:58:27.622856+0000","last_fullsized":"2024-03-23T23:58:27.622856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4769,"log_dups_size":0,"ondisk_log_size":4769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:20.920978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71276,"num_write_kb":829070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'20","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:44.378481+0000","last_change":"2024-03-23T23:42:39.695253+0000","last_active":"2024-03-23T23:55:44.378481+0000","last_peered":"2024-03-23T23:55:44.378481+0000","last_clean":"2024-03-23T23:55:44.378481+0000","last_became_active":"2024-03-23T23:42:39.694746+0000","last_became_peered":"2024-03-23T23:42:39.694746+0000","last_unstale":"2024-03-23T23:55:44.378481+0000","last_undegraded":"2024-03-23T23:55:44.378481+0000","last_fullsized":"2024-03-23T23:55:44.378481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:57.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'20","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.414354+0000","last_change":"2024-03-23T23:42:49.724285+0000","last_active":"2024-03-23T23:57:53.414354+0000","last_peered":"2024-03-23T23:57:53.414354+0000","last_clean":"2024-03-23T23:57:53.414354+0000","last_became_active":"2024-03-23T23:42:49.724009+0000","last_became_peered":"2024-03-23T23:42:49.724009+0000","last_unstale":"2024-03-23T23:57:53.414354+0000","last_undegraded":"2024-03-23T23:57:53.414354+0000","last_fullsized":"2024-03-23T23:57:53.414354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:01:04.035970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"27'4299","reported_seq":4322,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.609217+0000","last_change":"2024-03-23T23:42:50.746737+0000","last_active":"2024-03-23T23:57:57.609217+0000","last_peered":"2024-03-23T23:57:57.609217+0000","last_clean":"2024-03-23T23:57:57.609217+0000","last_became_active":"2024-03-23T23:42:50.746492+0000","last_became_peered":"2024-03-23T23:42:50.746492+0000","last_unstale":"2024-03-23T23:57:57.609217+0000","last_undegraded":"2024-03-23T23:57:57.609217+0000","last_fullsized":"2024-03-23T23:57:57.609217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4299,"log_dups_size":0,"ondisk_log_size":4299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:50.597847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63604,"num_write_kb":723087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"27'5742","reported_seq":5773,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.651182+0000","last_change":"2024-03-23T23:42:40.680963+0000","last_active":"2024-03-23T23:58:27.651182+0000","last_peered":"2024-03-23T23:58:27.651182+0000","last_clean":"2024-03-23T23:58:27.651182+0000","last_became_active":"2024-03-23T23:42:40.680744+0000","last_became_peered":"2024-03-23T23:42:40.680744+0000","last_unstale":"2024-03-23T23:58:27.651182+0000","last_undegraded":"2024-03-23T23:58:27.651182+0000","last_fullsized":"2024-03-23T23:58:27.651182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5742,"log_dups_size":0,"ondisk_log_size":5742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:17:19.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85158,"num_write_kb":1014619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'8","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:33.079685+0000","last_change":"2024-03-23T23:42:39.691813+0000","last_active":"2024-03-23T23:55:33.079685+0000","last_peered":"2024-03-23T23:55:33.079685+0000","last_clean":"2024-03-23T23:55:33.079685+0000","last_became_active":"2024-03-23T23:42:39.691519+0000","last_became_peered":"2024-03-23T23:42:39.691519+0000","last_unstale":"2024-03-23T23:55:33.079685+0000","last_undegraded":"2024-03-23T23:55:33.079685+0000","last_fullsized":"2024-03-23T23:55:33.079685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:27:41.386662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'34","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.597772+0000","last_change":"2024-03-23T23:42:49.734197+0000","last_active":"2024-03-23T23:57:57.597772+0000","last_peered":"2024-03-23T23:57:57.597772+0000","last_clean":"2024-03-23T23:57:57.597772+0000","last_became_active":"2024-03-23T23:42:49.733715+0000","last_became_peered":"2024-03-23T23:42:49.733715+0000","last_unstale":"2024-03-23T23:57:57.597772+0000","last_undegraded":"2024-03-23T23:57:57.597772+0000","last_fullsized":"2024-03-23T23:57:57.597772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:36.728428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84646,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":105,"num_write":31,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"27'4486","reported_seq":4509,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.331762+0000","last_change":"2024-03-23T23:42:50.739957+0000","last_active":"2024-03-23T23:57:53.331762+0000","last_peered":"2024-03-23T23:57:53.331762+0000","last_clean":"2024-03-23T23:57:53.331762+0000","last_became_active":"2024-03-23T23:42:50.739706+0000","last_became_peered":"2024-03-23T23:42:50.739706+0000","last_unstale":"2024-03-23T23:57:53.331762+0000","last_undegraded":"2024-03-23T23:57:53.331762+0000","last_fullsized":"2024-03-23T23:57:53.331762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4486,"log_dups_size":0,"ondisk_log_size":4486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:49:17.763463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66952,"num_write_kb":756851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'4353","reported_seq":4370,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.622699+0000","last_change":"2024-03-23T23:43:22.034415+0000","last_active":"2024-03-23T23:58:27.622699+0000","last_peered":"2024-03-23T23:58:27.622699+0000","last_clean":"2024-03-23T23:58:27.622699+0000","last_became_active":"2024-03-23T23:43:22.034125+0000","last_became_peered":"2024-03-23T23:43:22.034125+0000","last_unstale":"2024-03-23T23:58:27.622699+0000","last_undegraded":"2024-03-23T23:58:27.622699+0000","last_fullsized":"2024-03-23T23:58:27.622699+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4353,"log_dups_size":0,"ondisk_log_size":4353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:48:14.925511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64538,"num_write_kb":790050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"27'317","reported_seq":350,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:03.787850+0000","last_change":"2024-03-23T23:42:39.678962+0000","last_active":"2024-03-23T23:58:03.787850+0000","last_peered":"2024-03-23T23:58:03.787850+0000","last_clean":"2024-03-23T23:58:03.787850+0000","last_became_active":"2024-03-23T23:42:39.678603+0000","last_became_peered":"2024-03-23T23:42:39.678603+0000","last_unstale":"2024-03-23T23:58:03.787850+0000","last_undegraded":"2024-03-23T23:58:03.787850+0000","last_fullsized":"2024-03-23T23:58:03.787850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:43:46.206865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":650,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'39","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.605592+0000","last_change":"2024-03-23T23:42:49.740561+0000","last_active":"2024-03-23T23:57:57.605592+0000","last_peered":"2024-03-23T23:57:57.605592+0000","last_clean":"2024-03-23T23:57:57.605592+0000","last_became_active":"2024-03-23T23:42:49.740290+0000","last_became_peered":"2024-03-23T23:42:49.740290+0000","last_unstale":"2024-03-23T23:57:57.605592+0000","last_undegraded":"2024-03-23T23:57:57.605592+0000","last_fullsized":"2024-03-23T23:57:57.605592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:21:24.160603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"27'5042","reported_seq":5065,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.336174+0000","last_change":"2024-03-23T23:42:50.751107+0000","last_active":"2024-03-23T23:57:53.336174+0000","last_peered":"2024-03-23T23:57:53.336174+0000","last_clean":"2024-03-23T23:57:53.336174+0000","last_became_active":"2024-03-23T23:42:50.750859+0000","last_became_peered":"2024-03-23T23:42:50.750859+0000","last_unstale":"2024-03-23T23:57:53.336174+0000","last_undegraded":"2024-03-23T23:57:53.336174+0000","last_fullsized":"2024-03-23T23:57:53.336174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5042,"log_dups_size":0,"ondisk_log_size":5042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:49:17.763463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75095,"num_write_kb":843705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"27'6329","reported_seq":6360,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.644598+0000","last_change":"2024-03-23T23:42:40.686486+0000","last_active":"2024-03-23T23:58:27.644598+0000","last_peered":"2024-03-23T23:58:27.644598+0000","last_clean":"2024-03-23T23:58:27.644598+0000","last_became_active":"2024-03-23T23:42:40.686186+0000","last_became_peered":"2024-03-23T23:42:40.686186+0000","last_unstale":"2024-03-23T23:58:27.644598+0000","last_undegraded":"2024-03-23T23:58:27.644598+0000","last_fullsized":"2024-03-23T23:58:27.644598+0000","mapping_epoch":19,"log_start":"27'600","ondisk_log_start":"27'600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5729,"log_dups_size":0,"ondisk_log_size":5729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:46:30.427072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94311,"num_write_kb":1142337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'2","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:28.330121+0000","last_change":"2024-03-23T23:42:39.695099+0000","last_active":"2024-03-23T23:55:28.330121+0000","last_peered":"2024-03-23T23:55:28.330121+0000","last_clean":"2024-03-23T23:55:28.330121+0000","last_became_active":"2024-03-23T23:42:39.694720+0000","last_became_peered":"2024-03-23T23:42:39.694720+0000","last_unstale":"2024-03-23T23:55:28.330121+0000","last_undegraded":"2024-03-23T23:55:28.330121+0000","last_fullsized":"2024-03-23T23:55:28.330121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:58:07.880313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'3","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.398311+0000","last_change":"2024-03-23T23:42:49.739099+0000","last_active":"2024-03-23T23:57:53.398311+0000","last_peered":"2024-03-23T23:57:53.398311+0000","last_clean":"2024-03-23T23:57:53.398311+0000","last_became_active":"2024-03-23T23:42:49.738198+0000","last_became_peered":"2024-03-23T23:42:49.738198+0000","last_unstale":"2024-03-23T23:57:53.398311+0000","last_undegraded":"2024-03-23T23:57:53.398311+0000","last_fullsized":"2024-03-23T23:57:53.398311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:57:34.600362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"27'5389","reported_seq":5412,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.487900+0000","last_change":"2024-03-23T23:42:50.754941+0000","last_active":"2024-03-23T23:58:30.487900+0000","last_peered":"2024-03-23T23:58:30.487900+0000","last_clean":"2024-03-23T23:58:30.487900+0000","last_became_active":"2024-03-23T23:42:50.754585+0000","last_became_peered":"2024-03-23T23:42:50.754585+0000","last_unstale":"2024-03-23T23:58:30.487900+0000","last_undegraded":"2024-03-23T23:58:30.487900+0000","last_fullsized":"2024-03-23T23:58:30.487900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5389,"log_dups_size":0,"ondisk_log_size":5389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:42:23.236324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80225,"num_write_kb":941986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'4652","reported_seq":4683,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.714118+0000","last_change":"2024-03-23T23:42:40.700610+0000","last_active":"2024-03-23T23:58:27.714118+0000","last_peered":"2024-03-23T23:58:27.714118+0000","last_clean":"2024-03-23T23:58:27.714118+0000","last_became_active":"2024-03-23T23:42:40.700112+0000","last_became_peered":"2024-03-23T23:42:40.700112+0000","last_unstale":"2024-03-23T23:58:27.714118+0000","last_undegraded":"2024-03-23T23:58:27.714118+0000","last_fullsized":"2024-03-23T23:58:27.714118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4652,"log_dups_size":0,"ondisk_log_size":4652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:07:49.169416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68979,"num_write_kb":836174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'2","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:16.720561+0000","last_change":"2024-03-23T23:42:39.686509+0000","last_active":"2024-03-23T23:55:16.720561+0000","last_peered":"2024-03-23T23:55:16.720561+0000","last_clean":"2024-03-23T23:55:16.720561+0000","last_became_active":"2024-03-23T23:42:39.686094+0000","last_became_peered":"2024-03-23T23:42:39.686094+0000","last_unstale":"2024-03-23T23:55:16.720561+0000","last_undegraded":"2024-03-23T23:55:16.720561+0000","last_fullsized":"2024-03-23T23:55:16.720561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:57:20.394530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'68","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:14.252046+0000","last_change":"2024-03-23T23:42:49.738274+0000","last_active":"2024-03-23T23:57:14.252046+0000","last_peered":"2024-03-23T23:57:14.252046+0000","last_clean":"2024-03-23T23:57:14.252046+0000","last_became_active":"2024-03-23T23:42:49.737916+0000","last_became_peered":"2024-03-23T23:42:49.737916+0000","last_unstale":"2024-03-23T23:57:14.252046+0000","last_undegraded":"2024-03-23T23:57:14.252046+0000","last_fullsized":"2024-03-23T23:57:14.252046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:18:12.997092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":8223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"27'4725","reported_seq":4748,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.346920+0000","last_change":"2024-03-23T23:42:50.764148+0000","last_active":"2024-03-23T23:58:30.346920+0000","last_peered":"2024-03-23T23:58:30.346920+0000","last_clean":"2024-03-23T23:58:30.346920+0000","last_became_active":"2024-03-23T23:42:50.763768+0000","last_became_peered":"2024-03-23T23:42:50.763768+0000","last_unstale":"2024-03-23T23:58:30.346920+0000","last_undegraded":"2024-03-23T23:58:30.346920+0000","last_fullsized":"2024-03-23T23:58:30.346920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4725,"log_dups_size":0,"ondisk_log_size":4725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:52:48.699642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69706,"num_write_kb":805786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"27'5477","reported_seq":5508,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.746904+0000","last_change":"2024-03-23T23:42:40.679988+0000","last_active":"2024-03-23T23:58:27.746904+0000","last_peered":"2024-03-23T23:58:27.746904+0000","last_clean":"2024-03-23T23:58:27.746904+0000","last_became_active":"2024-03-23T23:42:40.679488+0000","last_became_peered":"2024-03-23T23:42:40.679488+0000","last_unstale":"2024-03-23T23:58:27.746904+0000","last_undegraded":"2024-03-23T23:58:27.746904+0000","last_fullsized":"2024-03-23T23:58:27.746904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5477,"log_dups_size":0,"ondisk_log_size":5477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:10:32.251287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82124,"num_write_kb":1001722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'28","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:10.724250+0000","last_change":"2024-03-23T23:42:39.679741+0000","last_active":"2024-03-23T23:55:10.724250+0000","last_peered":"2024-03-23T23:55:10.724250+0000","last_clean":"2024-03-23T23:55:10.724250+0000","last_became_active":"2024-03-23T23:42:39.678864+0000","last_became_peered":"2024-03-23T23:42:39.678864+0000","last_unstale":"2024-03-23T23:55:10.724250+0000","last_undegraded":"2024-03-23T23:55:10.724250+0000","last_fullsized":"2024-03-23T23:55:10.724250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:50.559059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":8210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.412448+0000","last_change":"2024-03-23T23:42:49.739837+0000","last_active":"2024-03-23T23:57:53.412448+0000","last_peered":"2024-03-23T23:57:53.412448+0000","last_clean":"2024-03-23T23:57:53.412448+0000","last_became_active":"2024-03-23T23:42:49.739570+0000","last_became_peered":"2024-03-23T23:42:49.739570+0000","last_unstale":"2024-03-23T23:57:53.412448+0000","last_undegraded":"2024-03-23T23:57:53.412448+0000","last_fullsized":"2024-03-23T23:57:53.412448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:57:34.600362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'5788","reported_seq":5812,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.452017+0000","last_change":"2024-03-23T23:42:50.753912+0000","last_active":"2024-03-23T23:58:30.452017+0000","last_peered":"2024-03-23T23:58:30.452017+0000","last_clean":"2024-03-23T23:58:30.452017+0000","last_became_active":"2024-03-23T23:42:50.753629+0000","last_became_peered":"2024-03-23T23:42:50.753629+0000","last_unstale":"2024-03-23T23:58:30.452017+0000","last_undegraded":"2024-03-23T23:58:30.452017+0000","last_fullsized":"2024-03-23T23:58:30.452017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5788,"log_dups_size":0,"ondisk_log_size":5788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:40:32.748113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":85415,"num_write_kb":969479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'4118","reported_seq":4149,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.626759+0000","last_change":"2024-03-23T23:42:40.682840+0000","last_active":"2024-03-23T23:58:27.626759+0000","last_peered":"2024-03-23T23:58:27.626759+0000","last_clean":"2024-03-23T23:58:27.626759+0000","last_became_active":"2024-03-23T23:42:40.682391+0000","last_became_peered":"2024-03-23T23:42:40.682391+0000","last_unstale":"2024-03-23T23:58:27.626759+0000","last_undegraded":"2024-03-23T23:58:27.626759+0000","last_fullsized":"2024-03-23T23:58:27.626759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4118,"log_dups_size":0,"ondisk_log_size":4118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:42:14.952953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61030,"num_write_kb":768099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'47","reported_seq":124,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:03.449051+0000","last_change":"2024-03-23T23:42:39.680763+0000","last_active":"2024-03-23T23:58:03.449051+0000","last_peered":"2024-03-23T23:58:03.449051+0000","last_clean":"2024-03-23T23:58:03.449051+0000","last_became_active":"2024-03-23T23:42:39.680494+0000","last_became_peered":"2024-03-23T23:42:39.680494+0000","last_unstale":"2024-03-23T23:58:03.449051+0000","last_undegraded":"2024-03-23T23:58:03.449051+0000","last_fullsized":"2024-03-23T23:58:03.449051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:57.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84561,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":115,"num_write":44,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.616866+0000","last_change":"2024-03-23T23:42:49.737456+0000","last_active":"2024-03-23T23:57:57.616866+0000","last_peered":"2024-03-23T23:57:57.616866+0000","last_clean":"2024-03-23T23:57:57.616866+0000","last_became_active":"2024-03-23T23:42:49.737196+0000","last_became_peered":"2024-03-23T23:42:49.737196+0000","last_unstale":"2024-03-23T23:57:57.616866+0000","last_undegraded":"2024-03-23T23:57:57.616866+0000","last_fullsized":"2024-03-23T23:57:57.616866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:49:42.789292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"27'4471","reported_seq":4494,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.644697+0000","last_change":"2024-03-23T23:42:50.763308+0000","last_active":"2024-03-23T23:57:57.644697+0000","last_peered":"2024-03-23T23:57:57.644697+0000","last_clean":"2024-03-23T23:57:57.644697+0000","last_became_active":"2024-03-23T23:42:50.763007+0000","last_became_peered":"2024-03-23T23:42:50.763007+0000","last_unstale":"2024-03-23T23:57:57.644697+0000","last_undegraded":"2024-03-23T23:57:57.644697+0000","last_fullsized":"2024-03-23T23:57:57.644697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4471,"log_dups_size":0,"ondisk_log_size":4471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:32:46.055472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66536,"num_write_kb":757522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"27'4410","reported_seq":4441,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.601171+0000","last_change":"2024-03-23T23:42:40.675570+0000","last_active":"2024-03-23T23:58:27.601171+0000","last_peered":"2024-03-23T23:58:27.601171+0000","last_clean":"2024-03-23T23:58:27.601171+0000","last_became_active":"2024-03-23T23:42:40.674390+0000","last_became_peered":"2024-03-23T23:42:40.674390+0000","last_unstale":"2024-03-23T23:58:27.601171+0000","last_undegraded":"2024-03-23T23:58:27.601171+0000","last_fullsized":"2024-03-23T23:58:27.601171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4410,"log_dups_size":0,"ondisk_log_size":4410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:31:34.412092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65732,"num_write_kb":804228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'44","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:56.789441+0000","last_change":"2024-03-23T23:42:39.690057+0000","last_active":"2024-03-23T23:54:56.789441+0000","last_peered":"2024-03-23T23:54:56.789441+0000","last_clean":"2024-03-23T23:54:56.789441+0000","last_became_active":"2024-03-23T23:42:39.689763+0000","last_became_peered":"2024-03-23T23:42:39.689763+0000","last_unstale":"2024-03-23T23:54:56.789441+0000","last_undegraded":"2024-03-23T23:54:56.789441+0000","last_fullsized":"2024-03-23T23:54:56.789441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:01.607584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'354","reported_seq":379,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.316884+0000","last_change":"2024-03-23T23:42:49.734213+0000","last_active":"2024-03-23T23:57:57.316884+0000","last_peered":"2024-03-23T23:57:57.316884+0000","last_clean":"2024-03-23T23:57:57.316884+0000","last_became_active":"2024-03-23T23:42:49.733115+0000","last_became_peered":"2024-03-23T23:42:49.733115+0000","last_unstale":"2024-03-23T23:57:57.316884+0000","last_undegraded":"2024-03-23T23:57:57.316884+0000","last_fullsized":"2024-03-23T23:57:57.316884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:18:12.997092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":739,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"27'6371","reported_seq":6394,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.408620+0000","last_change":"2024-03-23T23:42:50.759000+0000","last_active":"2024-03-23T23:57:53.408620+0000","last_peered":"2024-03-23T23:57:53.408620+0000","last_clean":"2024-03-23T23:57:53.408620+0000","last_became_active":"2024-03-23T23:42:50.758552+0000","last_became_peered":"2024-03-23T23:42:50.758552+0000","last_unstale":"2024-03-23T23:57:53.408620+0000","last_undegraded":"2024-03-23T23:57:53.408620+0000","last_fullsized":"2024-03-23T23:57:53.408620+0000","mapping_epoch":23,"log_start":"27'700","ondisk_log_start":"27'700","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5671,"log_dups_size":0,"ondisk_log_size":5671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:04:26.911514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94645,"num_write_kb":1081333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"27'5070","reported_seq":5101,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:09.384653+0000","last_change":"2024-03-23T23:42:40.700998+0000","last_active":"2024-03-23T23:55:09.384653+0000","last_peered":"2024-03-23T23:55:09.384653+0000","last_clean":"2024-03-23T23:55:09.384653+0000","last_became_active":"2024-03-23T23:42:40.700788+0000","last_became_peered":"2024-03-23T23:42:40.700788+0000","last_unstale":"2024-03-23T23:55:09.384653+0000","last_undegraded":"2024-03-23T23:55:09.384653+0000","last_fullsized":"2024-03-23T23:55:09.384653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5070,"log_dups_size":0,"ondisk_log_size":5070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:14:44.739525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75375,"num_write_kb":887789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'3","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:16.319491+0000","last_change":"2024-03-23T23:42:39.687712+0000","last_active":"2024-03-23T23:55:16.319491+0000","last_peered":"2024-03-23T23:55:16.319491+0000","last_clean":"2024-03-23T23:55:16.319491+0000","last_became_active":"2024-03-23T23:42:39.687378+0000","last_became_peered":"2024-03-23T23:42:39.687378+0000","last_unstale":"2024-03-23T23:55:16.319491+0000","last_undegraded":"2024-03-23T23:55:16.319491+0000","last_fullsized":"2024-03-23T23:55:16.319491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:20:38.456655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":189,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:45.391600+0000","last_change":"2024-03-23T23:42:27.940270+0000","last_active":"2024-03-23T23:54:45.391600+0000","last_peered":"2024-03-23T23:54:45.391600+0000","last_clean":"2024-03-23T23:54:45.391600+0000","last_became_active":"2024-03-23T23:42:27.939061+0000","last_became_peered":"2024-03-23T23:42:27.939061+0000","last_unstale":"2024-03-23T23:54:45.391600+0000","last_undegraded":"2024-03-23T23:54:45.391600+0000","last_fullsized":"2024-03-23T23:54:45.391600+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:26.509742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:26.509742+0000","last_clean_scrub_stamp":"2024-03-23T23:42:26.509742+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:49.258623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'3","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:46.805802+0000","last_change":"2024-03-23T23:42:49.729231+0000","last_active":"2024-03-23T23:57:46.805802+0000","last_peered":"2024-03-23T23:57:46.805802+0000","last_clean":"2024-03-23T23:57:46.805802+0000","last_became_active":"2024-03-23T23:42:49.728990+0000","last_became_peered":"2024-03-23T23:42:49.728990+0000","last_unstale":"2024-03-23T23:57:46.805802+0000","last_undegraded":"2024-03-23T23:57:46.805802+0000","last_fullsized":"2024-03-23T23:57:46.805802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:01:04.035970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"27'4440","reported_seq":4463,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.456673+0000","last_change":"2024-03-23T23:42:50.757668+0000","last_active":"2024-03-23T23:58:30.456673+0000","last_peered":"2024-03-23T23:58:30.456673+0000","last_clean":"2024-03-23T23:58:30.456673+0000","last_became_active":"2024-03-23T23:42:50.756900+0000","last_became_peered":"2024-03-23T23:42:50.756900+0000","last_unstale":"2024-03-23T23:58:30.456673+0000","last_undegraded":"2024-03-23T23:58:30.456673+0000","last_fullsized":"2024-03-23T23:58:30.456673+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4440,"log_dups_size":0,"ondisk_log_size":4440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:24:53.959288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65770,"num_write_kb":738740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'5479","reported_seq":5510,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:56:12.049278+0000","last_change":"2024-03-23T23:42:40.711591+0000","last_active":"2024-03-23T23:56:12.049278+0000","last_peered":"2024-03-23T23:56:12.049278+0000","last_clean":"2024-03-23T23:56:12.049278+0000","last_became_active":"2024-03-23T23:42:40.711306+0000","last_became_peered":"2024-03-23T23:42:40.711306+0000","last_unstale":"2024-03-23T23:56:12.049278+0000","last_undegraded":"2024-03-23T23:56:12.049278+0000","last_fullsized":"2024-03-23T23:56:12.049278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5479,"log_dups_size":0,"ondisk_log_size":5479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:34:16.693372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81537,"num_write_kb":972707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'5","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:56:12.626312+0000","last_change":"2024-03-23T23:42:39.684163+0000","last_active":"2024-03-23T23:56:12.626312+0000","last_peered":"2024-03-23T23:56:12.626312+0000","last_clean":"2024-03-23T23:56:12.626312+0000","last_became_active":"2024-03-23T23:42:39.683211+0000","last_became_peered":"2024-03-23T23:42:39.683211+0000","last_unstale":"2024-03-23T23:56:12.626312+0000","last_undegraded":"2024-03-23T23:56:12.626312+0000","last_fullsized":"2024-03-23T23:56:12.626312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:47:27.092873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'123","reported_seq":148,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.630825+0000","last_change":"2024-03-23T23:42:49.735824+0000","last_active":"2024-03-23T23:57:57.630825+0000","last_peered":"2024-03-23T23:57:57.630825+0000","last_clean":"2024-03-23T23:57:57.630825+0000","last_became_active":"2024-03-23T23:42:49.735473+0000","last_became_peered":"2024-03-23T23:42:49.735473+0000","last_unstale":"2024-03-23T23:57:57.630825+0000","last_undegraded":"2024-03-23T23:57:57.630825+0000","last_fullsized":"2024-03-23T23:57:57.630825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:44:12.438729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":4181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"27'5305","reported_seq":5328,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.377773+0000","last_change":"2024-03-23T23:42:50.745563+0000","last_active":"2024-03-23T23:58:30.377773+0000","last_peered":"2024-03-23T23:58:30.377773+0000","last_clean":"2024-03-23T23:58:30.377773+0000","last_became_active":"2024-03-23T23:42:50.745256+0000","last_became_peered":"2024-03-23T23:42:50.745256+0000","last_unstale":"2024-03-23T23:58:30.377773+0000","last_undegraded":"2024-03-23T23:58:30.377773+0000","last_fullsized":"2024-03-23T23:58:30.377773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5305,"log_dups_size":0,"ondisk_log_size":5305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:34:26.750531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78242,"num_write_kb":887262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'5423","reported_seq":5455,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.664901+0000","last_change":"2024-03-23T23:42:40.700124+0000","last_active":"2024-03-23T23:58:27.664901+0000","last_peered":"2024-03-23T23:58:27.664901+0000","last_clean":"2024-03-23T23:58:27.664901+0000","last_became_active":"2024-03-23T23:42:40.697369+0000","last_became_peered":"2024-03-23T23:42:40.697369+0000","last_unstale":"2024-03-23T23:58:27.664901+0000","last_undegraded":"2024-03-23T23:58:27.664901+0000","last_fullsized":"2024-03-23T23:58:27.664901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5423,"log_dups_size":0,"ondisk_log_size":5423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:20.981139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":11,"num_write":80814,"num_write_kb":947944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'24","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:56:17.671836+0000","last_change":"2024-03-23T23:42:39.681013+0000","last_active":"2024-03-23T23:56:17.671836+0000","last_peered":"2024-03-23T23:56:17.671836+0000","last_clean":"2024-03-23T23:56:17.671836+0000","last_became_active":"2024-03-23T23:42:39.680669+0000","last_became_peered":"2024-03-23T23:42:39.680669+0000","last_unstale":"2024-03-23T23:56:17.671836+0000","last_undegraded":"2024-03-23T23:56:17.671836+0000","last_fullsized":"2024-03-23T23:56:17.671836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:58:07.880313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'391","reported_seq":416,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.611265+0000","last_change":"2024-03-23T23:42:49.736747+0000","last_active":"2024-03-23T23:57:57.611265+0000","last_peered":"2024-03-23T23:57:57.611265+0000","last_clean":"2024-03-23T23:57:57.611265+0000","last_became_active":"2024-03-23T23:42:49.734508+0000","last_became_peered":"2024-03-23T23:42:49.734508+0000","last_unstale":"2024-03-23T23:57:57.611265+0000","last_undegraded":"2024-03-23T23:57:57.611265+0000","last_fullsized":"2024-03-23T23:57:57.611265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:54.356082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":4222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"27'4745","reported_seq":4768,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.077169+0000","last_change":"2024-03-23T23:42:50.751141+0000","last_active":"2024-03-23T23:57:53.077169+0000","last_peered":"2024-03-23T23:57:53.077169+0000","last_clean":"2024-03-23T23:57:53.077169+0000","last_became_active":"2024-03-23T23:42:50.750269+0000","last_became_peered":"2024-03-23T23:42:50.750269+0000","last_unstale":"2024-03-23T23:57:53.077169+0000","last_undegraded":"2024-03-23T23:57:53.077169+0000","last_fullsized":"2024-03-23T23:57:53.077169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4745,"log_dups_size":0,"ondisk_log_size":4745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:46:10.784416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70383,"num_write_kb":794086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"27'6871","reported_seq":6901,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:37.279880+0000","last_change":"2024-03-23T23:42:40.706713+0000","last_active":"2024-03-23T23:54:37.279880+0000","last_peered":"2024-03-23T23:54:37.279880+0000","last_clean":"2024-03-23T23:54:37.279880+0000","last_became_active":"2024-03-23T23:42:40.704328+0000","last_became_peered":"2024-03-23T23:42:40.704328+0000","last_unstale":"2024-03-23T23:54:37.279880+0000","last_undegraded":"2024-03-23T23:54:37.279880+0000","last_fullsized":"2024-03-23T23:54:37.279880+0000","mapping_epoch":19,"log_start":"27'1200","ondisk_log_start":"27'1200","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5671,"log_dups_size":0,"ondisk_log_size":5671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:15:52.261572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102549,"num_write_kb":1203650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'21","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:36.237288+0000","last_change":"2024-03-23T23:42:39.681906+0000","last_active":"2024-03-23T23:54:36.237288+0000","last_peered":"2024-03-23T23:54:36.237288+0000","last_clean":"2024-03-23T23:54:36.237288+0000","last_became_active":"2024-03-23T23:42:39.680506+0000","last_became_peered":"2024-03-23T23:42:39.680506+0000","last_unstale":"2024-03-23T23:54:36.237288+0000","last_undegraded":"2024-03-23T23:54:36.237288+0000","last_fullsized":"2024-03-23T23:54:36.237288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:44:07.213123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'28","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.608886+0000","last_change":"2024-03-23T23:42:49.737735+0000","last_active":"2024-03-23T23:57:57.608886+0000","last_peered":"2024-03-23T23:57:57.608886+0000","last_clean":"2024-03-23T23:57:57.608886+0000","last_became_active":"2024-03-23T23:42:49.737434+0000","last_became_peered":"2024-03-23T23:42:49.737434+0000","last_unstale":"2024-03-23T23:57:57.608886+0000","last_undegraded":"2024-03-23T23:57:57.608886+0000","last_fullsized":"2024-03-23T23:57:57.608886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:58:10.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"27'4785","reported_seq":4808,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.430329+0000","last_change":"2024-03-23T23:42:50.746922+0000","last_active":"2024-03-23T23:58:30.430329+0000","last_peered":"2024-03-23T23:58:30.430329+0000","last_clean":"2024-03-23T23:58:30.430329+0000","last_became_active":"2024-03-23T23:42:50.746105+0000","last_became_peered":"2024-03-23T23:42:50.746105+0000","last_unstale":"2024-03-23T23:58:30.430329+0000","last_undegraded":"2024-03-23T23:58:30.430329+0000","last_fullsized":"2024-03-23T23:58:30.430329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4785,"log_dups_size":0,"ondisk_log_size":4785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:46:40.484231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70705,"num_write_kb":815494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"27'4261","reported_seq":4292,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:56:12.049336+0000","last_change":"2024-03-23T23:42:40.696584+0000","last_active":"2024-03-23T23:56:12.049336+0000","last_peered":"2024-03-23T23:56:12.049336+0000","last_clean":"2024-03-23T23:56:12.049336+0000","last_became_active":"2024-03-23T23:42:40.696141+0000","last_became_peered":"2024-03-23T23:42:40.696141+0000","last_unstale":"2024-03-23T23:56:12.049336+0000","last_undegraded":"2024-03-23T23:56:12.049336+0000","last_fullsized":"2024-03-23T23:56:12.049336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4261,"log_dups_size":0,"ondisk_log_size":4261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:45.303477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63684,"num_write_kb":761063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'239","reported_seq":271,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:40.459673+0000","last_change":"2024-03-23T23:42:39.686863+0000","last_active":"2024-03-23T23:54:40.459673+0000","last_peered":"2024-03-23T23:54:40.459673+0000","last_clean":"2024-03-23T23:54:40.459673+0000","last_became_active":"2024-03-23T23:42:39.686491+0000","last_became_peered":"2024-03-23T23:42:39.686491+0000","last_unstale":"2024-03-23T23:54:40.459673+0000","last_undegraded":"2024-03-23T23:54:40.459673+0000","last_fullsized":"2024-03-23T23:54:40.459673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:38:13.752628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.422658+0000","last_change":"2024-03-23T23:42:49.733982+0000","last_active":"2024-03-23T23:57:53.422658+0000","last_peered":"2024-03-23T23:57:53.422658+0000","last_clean":"2024-03-23T23:57:53.422658+0000","last_became_active":"2024-03-23T23:42:49.733389+0000","last_became_peered":"2024-03-23T23:42:49.733389+0000","last_unstale":"2024-03-23T23:57:53.422658+0000","last_undegraded":"2024-03-23T23:57:53.422658+0000","last_fullsized":"2024-03-23T23:57:53.422658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:13.685893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"27'5244","reported_seq":5266,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.379934+0000","last_change":"2024-03-23T23:42:50.764083+0000","last_active":"2024-03-23T23:57:53.379934+0000","last_peered":"2024-03-23T23:57:53.379934+0000","last_clean":"2024-03-23T23:57:53.379934+0000","last_became_active":"2024-03-23T23:42:50.763871+0000","last_became_peered":"2024-03-23T23:42:50.763871+0000","last_unstale":"2024-03-23T23:57:53.379934+0000","last_undegraded":"2024-03-23T23:57:53.379934+0000","last_fullsized":"2024-03-23T23:57:53.379934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5244,"log_dups_size":0,"ondisk_log_size":5244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:32:46.055472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77731,"num_write_kb":860727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"27'4086","reported_seq":4116,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:40.473448+0000","last_change":"2024-03-23T23:42:40.700961+0000","last_active":"2024-03-23T23:54:40.473448+0000","last_peered":"2024-03-23T23:54:40.473448+0000","last_clean":"2024-03-23T23:54:40.473448+0000","last_became_active":"2024-03-23T23:42:40.700800+0000","last_became_peered":"2024-03-23T23:42:40.700800+0000","last_unstale":"2024-03-23T23:54:40.473448+0000","last_undegraded":"2024-03-23T23:54:40.473448+0000","last_fullsized":"2024-03-23T23:54:40.473448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4086,"log_dups_size":0,"ondisk_log_size":4086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:54:27.641281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60579,"num_write_kb":760058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'15","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:56:27.877534+0000","last_change":"2024-03-23T23:42:39.676075+0000","last_active":"2024-03-23T23:56:27.877534+0000","last_peered":"2024-03-23T23:56:27.877534+0000","last_clean":"2024-03-23T23:56:27.877534+0000","last_became_active":"2024-03-23T23:42:39.675770+0000","last_became_peered":"2024-03-23T23:42:39.675770+0000","last_unstale":"2024-03-23T23:56:27.877534+0000","last_undegraded":"2024-03-23T23:56:27.877534+0000","last_fullsized":"2024-03-23T23:56:27.877534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:24:11.933075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'4","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.425856+0000","last_change":"2024-03-23T23:42:49.739529+0000","last_active":"2024-03-23T23:57:53.425856+0000","last_peered":"2024-03-23T23:57:53.425856+0000","last_clean":"2024-03-23T23:57:53.425856+0000","last_became_active":"2024-03-23T23:42:49.738053+0000","last_became_peered":"2024-03-23T23:42:49.738053+0000","last_unstale":"2024-03-23T23:57:53.425856+0000","last_undegraded":"2024-03-23T23:57:53.425856+0000","last_fullsized":"2024-03-23T23:57:53.425856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:52:57.561036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"27'5766","reported_seq":5788,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.641792+0000","last_change":"2024-03-23T23:42:50.771347+0000","last_active":"2024-03-23T23:57:57.641792+0000","last_peered":"2024-03-23T23:57:57.641792+0000","last_clean":"2024-03-23T23:57:57.641792+0000","last_became_active":"2024-03-23T23:42:50.770998+0000","last_became_peered":"2024-03-23T23:42:50.770998+0000","last_unstale":"2024-03-23T23:57:57.641792+0000","last_undegraded":"2024-03-23T23:57:57.641792+0000","last_fullsized":"2024-03-23T23:57:57.641792+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5766,"log_dups_size":0,"ondisk_log_size":5766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:57:04.394872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85663,"num_write_kb":962089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'4463","reported_seq":4493,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.663853+0000","last_change":"2024-03-23T23:42:40.677314+0000","last_active":"2024-03-23T23:58:27.663853+0000","last_peered":"2024-03-23T23:58:27.663853+0000","last_clean":"2024-03-23T23:58:27.663853+0000","last_became_active":"2024-03-23T23:42:40.675416+0000","last_became_peered":"2024-03-23T23:42:40.675416+0000","last_unstale":"2024-03-23T23:58:27.663853+0000","last_undegraded":"2024-03-23T23:58:27.663853+0000","last_fullsized":"2024-03-23T23:58:27.663853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4463,"log_dups_size":0,"ondisk_log_size":4463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:01:06.338641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66376,"num_write_kb":804237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'5","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:40.155565+0000","last_change":"2024-03-23T23:42:39.681827+0000","last_active":"2024-03-23T23:54:40.155565+0000","last_peered":"2024-03-23T23:54:40.155565+0000","last_clean":"2024-03-23T23:54:40.155565+0000","last_became_active":"2024-03-23T23:42:39.681418+0000","last_became_peered":"2024-03-23T23:42:39.681418+0000","last_unstale":"2024-03-23T23:54:40.155565+0000","last_undegraded":"2024-03-23T23:54:40.155565+0000","last_fullsized":"2024-03-23T23:54:40.155565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:50.559059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.389366+0000","last_change":"2024-03-23T23:42:49.744708+0000","last_active":"2024-03-23T23:57:53.389366+0000","last_peered":"2024-03-23T23:57:53.389366+0000","last_clean":"2024-03-23T23:57:53.389366+0000","last_became_active":"2024-03-23T23:42:49.744422+0000","last_became_peered":"2024-03-23T23:42:49.744422+0000","last_unstale":"2024-03-23T23:57:53.389366+0000","last_undegraded":"2024-03-23T23:57:53.389366+0000","last_fullsized":"2024-03-23T23:57:53.389366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:25:43.889950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"27'4213","reported_seq":4235,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.282231+0000","last_change":"2024-03-23T23:42:50.753064+0000","last_active":"2024-03-23T23:57:53.282231+0000","last_peered":"2024-03-23T23:57:53.282231+0000","last_clean":"2024-03-23T23:57:53.282231+0000","last_became_active":"2024-03-23T23:42:50.752783+0000","last_became_peered":"2024-03-23T23:42:50.752783+0000","last_unstale":"2024-03-23T23:57:53.282231+0000","last_undegraded":"2024-03-23T23:57:53.282231+0000","last_fullsized":"2024-03-23T23:57:53.282231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4213,"log_dups_size":0,"ondisk_log_size":4213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:39:49.888359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62346,"num_write_kb":725472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'5165","reported_seq":5195,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:36.864823+0000","last_change":"2024-03-23T23:42:40.704046+0000","last_active":"2024-03-23T23:54:36.864823+0000","last_peered":"2024-03-23T23:54:36.864823+0000","last_clean":"2024-03-23T23:54:36.864823+0000","last_became_active":"2024-03-23T23:42:40.703787+0000","last_became_peered":"2024-03-23T23:42:40.703787+0000","last_unstale":"2024-03-23T23:54:36.864823+0000","last_undegraded":"2024-03-23T23:54:36.864823+0000","last_fullsized":"2024-03-23T23:54:36.864823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5165,"log_dups_size":0,"ondisk_log_size":5165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:16:16.737284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76955,"num_write_kb":929765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'3","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:39.321849+0000","last_change":"2024-03-23T23:42:39.688483+0000","last_active":"2024-03-23T23:54:39.321849+0000","last_peered":"2024-03-23T23:54:39.321849+0000","last_clean":"2024-03-23T23:54:39.321849+0000","last_became_active":"2024-03-23T23:42:39.688141+0000","last_became_peered":"2024-03-23T23:42:39.688141+0000","last_unstale":"2024-03-23T23:54:39.321849+0000","last_undegraded":"2024-03-23T23:54:39.321849+0000","last_fullsized":"2024-03-23T23:54:39.321849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:32.254099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'1143","reported_seq":1167,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:41.085476+0000","last_change":"2024-03-23T23:42:49.749027+0000","last_active":"2024-03-23T23:57:41.085476+0000","last_peered":"2024-03-23T23:57:41.085476+0000","last_clean":"2024-03-23T23:57:41.085476+0000","last_became_active":"2024-03-23T23:42:49.748687+0000","last_became_peered":"2024-03-23T23:42:49.748687+0000","last_unstale":"2024-03-23T23:57:41.085476+0000","last_undegraded":"2024-03-23T23:57:41.085476+0000","last_fullsized":"2024-03-23T23:57:41.085476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1143,"log_dups_size":0,"ondisk_log_size":1143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:27.818117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1141,"num_write_kb":4625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"27'6475","reported_seq":6497,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.605446+0000","last_change":"2024-03-23T23:42:50.752273+0000","last_active":"2024-03-23T23:57:57.605446+0000","last_peered":"2024-03-23T23:57:57.605446+0000","last_clean":"2024-03-23T23:57:57.605446+0000","last_became_active":"2024-03-23T23:42:50.751874+0000","last_became_peered":"2024-03-23T23:42:50.751874+0000","last_unstale":"2024-03-23T23:57:57.605446+0000","last_undegraded":"2024-03-23T23:57:57.605446+0000","last_fullsized":"2024-03-23T23:57:57.605446+0000","mapping_epoch":23,"log_start":"27'1200","ondisk_log_start":"27'1200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5275,"log_dups_size":0,"ondisk_log_size":5275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:20:53.750917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96407,"num_write_kb":1089798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'4560","reported_seq":4590,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.616020+0000","last_change":"2024-03-23T23:42:40.688909+0000","last_active":"2024-03-23T23:58:27.616020+0000","last_peered":"2024-03-23T23:58:27.616020+0000","last_clean":"2024-03-23T23:58:27.616020+0000","last_became_active":"2024-03-23T23:42:40.688636+0000","last_became_peered":"2024-03-23T23:42:40.688636+0000","last_unstale":"2024-03-23T23:58:27.616020+0000","last_undegraded":"2024-03-23T23:58:27.616020+0000","last_fullsized":"2024-03-23T23:58:27.616020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4560,"log_dups_size":0,"ondisk_log_size":4560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:26:16.171920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68087,"num_write_kb":816248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'60","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:36.937202+0000","last_change":"2024-03-23T23:42:39.681926+0000","last_active":"2024-03-23T23:54:36.937202+0000","last_peered":"2024-03-23T23:54:36.937202+0000","last_clean":"2024-03-23T23:54:36.937202+0000","last_became_active":"2024-03-23T23:42:39.681028+0000","last_became_peered":"2024-03-23T23:42:39.681028+0000","last_unstale":"2024-03-23T23:54:36.937202+0000","last_undegraded":"2024-03-23T23:54:36.937202+0000","last_fullsized":"2024-03-23T23:54:36.937202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:24:11.933075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":8222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'22","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.622922+0000","last_change":"2024-03-23T23:42:49.741915+0000","last_active":"2024-03-23T23:57:57.622922+0000","last_peered":"2024-03-23T23:57:57.622922+0000","last_clean":"2024-03-23T23:57:57.622922+0000","last_became_active":"2024-03-23T23:42:49.741650+0000","last_became_peered":"2024-03-23T23:42:49.741650+0000","last_unstale":"2024-03-23T23:57:57.622922+0000","last_undegraded":"2024-03-23T23:57:57.622922+0000","last_fullsized":"2024-03-23T23:57:57.622922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:11:43.106922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"27'5248","reported_seq":5270,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.606881+0000","last_change":"2024-03-23T23:42:50.752979+0000","last_active":"2024-03-23T23:57:57.606881+0000","last_peered":"2024-03-23T23:57:57.606881+0000","last_clean":"2024-03-23T23:57:57.606881+0000","last_became_active":"2024-03-23T23:42:50.751848+0000","last_became_peered":"2024-03-23T23:42:50.751848+0000","last_unstale":"2024-03-23T23:57:57.606881+0000","last_undegraded":"2024-03-23T23:57:57.606881+0000","last_fullsized":"2024-03-23T23:57:57.606881+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5248,"log_dups_size":0,"ondisk_log_size":5248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:39:04.727316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77613,"num_write_kb":898929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'4158","reported_seq":4188,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:40.074107+0000","last_change":"2024-03-23T23:42:40.689988+0000","last_active":"2024-03-23T23:54:40.074107+0000","last_peered":"2024-03-23T23:54:40.074107+0000","last_clean":"2024-03-23T23:54:40.074107+0000","last_became_active":"2024-03-23T23:42:40.689477+0000","last_became_peered":"2024-03-23T23:42:40.689477+0000","last_unstale":"2024-03-23T23:54:40.074107+0000","last_undegraded":"2024-03-23T23:54:40.074107+0000","last_fullsized":"2024-03-23T23:54:40.074107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4158,"log_dups_size":0,"ondisk_log_size":4158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:46:30.427072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61832,"num_write_kb":761424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'1204","reported_seq":1236,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:58.775515+0000","last_change":"2024-03-23T23:42:39.689429+0000","last_active":"2024-03-23T23:57:58.775515+0000","last_peered":"2024-03-23T23:57:58.775515+0000","last_clean":"2024-03-23T23:57:58.775515+0000","last_became_active":"2024-03-23T23:42:39.688066+0000","last_became_peered":"2024-03-23T23:42:39.688066+0000","last_unstale":"2024-03-23T23:57:58.775515+0000","last_undegraded":"2024-03-23T23:57:58.775515+0000","last_fullsized":"2024-03-23T23:57:58.775515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1204,"log_dups_size":0,"ondisk_log_size":1204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:32.254099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1202,"num_write_kb":4648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.627061+0000","last_change":"2024-03-23T23:42:49.733543+0000","last_active":"2024-03-23T23:57:57.627061+0000","last_peered":"2024-03-23T23:57:57.627061+0000","last_clean":"2024-03-23T23:57:57.627061+0000","last_became_active":"2024-03-23T23:42:49.733197+0000","last_became_peered":"2024-03-23T23:42:49.733197+0000","last_unstale":"2024-03-23T23:57:57.627061+0000","last_undegraded":"2024-03-23T23:57:57.627061+0000","last_fullsized":"2024-03-23T23:57:57.627061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:45:20.189501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"27'4661","reported_seq":4683,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.405077+0000","last_change":"2024-03-23T23:42:50.756687+0000","last_active":"2024-03-23T23:58:30.405077+0000","last_peered":"2024-03-23T23:58:30.405077+0000","last_clean":"2024-03-23T23:58:30.405077+0000","last_became_active":"2024-03-23T23:42:50.756371+0000","last_became_peered":"2024-03-23T23:42:50.756371+0000","last_unstale":"2024-03-23T23:58:30.405077+0000","last_undegraded":"2024-03-23T23:58:30.405077+0000","last_fullsized":"2024-03-23T23:58:30.405077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4661,"log_dups_size":0,"ondisk_log_size":4661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:29:47.303374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69148,"num_write_kb":786028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'6424","reported_seq":6454,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.751614+0000","last_change":"2024-03-23T23:42:40.683025+0000","last_active":"2024-03-23T23:58:27.751614+0000","last_peered":"2024-03-23T23:58:27.751614+0000","last_clean":"2024-03-23T23:58:27.751614+0000","last_became_active":"2024-03-23T23:42:40.682798+0000","last_became_peered":"2024-03-23T23:42:40.682798+0000","last_unstale":"2024-03-23T23:58:27.751614+0000","last_undegraded":"2024-03-23T23:58:27.751614+0000","last_fullsized":"2024-03-23T23:58:27.751614+0000","mapping_epoch":19,"log_start":"27'900","ondisk_log_start":"27'900","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5524,"log_dups_size":0,"ondisk_log_size":5524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:51.565112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96000,"num_write_kb":1116606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'29","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:04.033139+0000","last_change":"2024-03-23T23:42:39.681675+0000","last_active":"2024-03-23T23:57:04.033139+0000","last_peered":"2024-03-23T23:57:04.033139+0000","last_clean":"2024-03-23T23:57:04.033139+0000","last_became_active":"2024-03-23T23:42:39.681364+0000","last_became_peered":"2024-03-23T23:42:39.681364+0000","last_unstale":"2024-03-23T23:57:04.033139+0000","last_undegraded":"2024-03-23T23:57:04.033139+0000","last_fullsized":"2024-03-23T23:57:04.033139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:42:37.702720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'47","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.606954+0000","last_change":"2024-03-23T23:42:49.723350+0000","last_active":"2024-03-23T23:57:57.606954+0000","last_peered":"2024-03-23T23:57:57.606954+0000","last_clean":"2024-03-23T23:57:57.606954+0000","last_became_active":"2024-03-23T23:42:49.723058+0000","last_became_peered":"2024-03-23T23:42:49.723058+0000","last_unstale":"2024-03-23T23:57:57.606954+0000","last_undegraded":"2024-03-23T23:57:57.606954+0000","last_fullsized":"2024-03-23T23:57:57.606954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:43:02.835034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":8215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"27'4265","reported_seq":4287,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.406354+0000","last_change":"2024-03-23T23:42:50.746422+0000","last_active":"2024-03-23T23:57:53.406354+0000","last_peered":"2024-03-23T23:57:53.406354+0000","last_clean":"2024-03-23T23:57:53.406354+0000","last_became_active":"2024-03-23T23:42:50.746104+0000","last_became_peered":"2024-03-23T23:42:50.746104+0000","last_unstale":"2024-03-23T23:57:53.406354+0000","last_undegraded":"2024-03-23T23:57:53.406354+0000","last_fullsized":"2024-03-23T23:57:53.406354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4265,"log_dups_size":0,"ondisk_log_size":4265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:40:34.077584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63135,"num_write_kb":732213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"27'5366","reported_seq":5401,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.601851+0000","last_change":"2024-03-23T23:43:22.035935+0000","last_active":"2024-03-23T23:58:27.601851+0000","last_peered":"2024-03-23T23:58:27.601851+0000","last_clean":"2024-03-23T23:58:27.601851+0000","last_became_active":"2024-03-23T23:43:22.035573+0000","last_became_peered":"2024-03-23T23:43:22.035573+0000","last_unstale":"2024-03-23T23:58:27.601851+0000","last_undegraded":"2024-03-23T23:58:27.601851+0000","last_fullsized":"2024-03-23T23:58:27.601851+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5366,"log_dups_size":0,"ondisk_log_size":5366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:11:19.211377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80141,"num_write_kb":923583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'4","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:43.402674+0000","last_change":"2024-03-23T23:42:39.691092+0000","last_active":"2024-03-23T23:54:43.402674+0000","last_peered":"2024-03-23T23:54:43.402674+0000","last_clean":"2024-03-23T23:54:43.402674+0000","last_became_active":"2024-03-23T23:42:39.687473+0000","last_became_peered":"2024-03-23T23:42:39.687473+0000","last_unstale":"2024-03-23T23:54:43.402674+0000","last_undegraded":"2024-03-23T23:54:43.402674+0000","last_fullsized":"2024-03-23T23:54:43.402674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:08:03.578884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'15","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.419543+0000","last_change":"2024-03-23T23:42:49.748693+0000","last_active":"2024-03-23T23:57:53.419543+0000","last_peered":"2024-03-23T23:57:53.419543+0000","last_clean":"2024-03-23T23:57:53.419543+0000","last_became_active":"2024-03-23T23:42:49.748389+0000","last_became_peered":"2024-03-23T23:42:49.748389+0000","last_unstale":"2024-03-23T23:57:53.419543+0000","last_undegraded":"2024-03-23T23:57:53.419543+0000","last_fullsized":"2024-03-23T23:57:53.419543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:58:10.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"27'4542","reported_seq":4564,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.326027+0000","last_change":"2024-03-23T23:42:50.749547+0000","last_active":"2024-03-23T23:57:53.326027+0000","last_peered":"2024-03-23T23:57:53.326027+0000","last_clean":"2024-03-23T23:57:53.326027+0000","last_became_active":"2024-03-23T23:42:50.749066+0000","last_became_peered":"2024-03-23T23:42:50.749066+0000","last_unstale":"2024-03-23T23:57:53.326027+0000","last_undegraded":"2024-03-23T23:57:53.326027+0000","last_fullsized":"2024-03-23T23:57:53.326027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4542,"log_dups_size":0,"ondisk_log_size":4542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:09:19.723830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67689,"num_write_kb":774425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'5741","reported_seq":5757,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.693565+0000","last_change":"2024-03-23T23:43:22.034371+0000","last_active":"2024-03-23T23:58:27.693565+0000","last_peered":"2024-03-23T23:58:27.693565+0000","last_clean":"2024-03-23T23:58:27.693565+0000","last_became_active":"2024-03-23T23:43:22.034063+0000","last_became_peered":"2024-03-23T23:43:22.034063+0000","last_unstale":"2024-03-23T23:58:27.693565+0000","last_undegraded":"2024-03-23T23:58:27.693565+0000","last_fullsized":"2024-03-23T23:58:27.693565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5741,"log_dups_size":0,"ondisk_log_size":5741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:49:33.736688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85448,"num_write_kb":1013349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'3","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:46.901728+0000","last_change":"2024-03-23T23:42:39.684669+0000","last_active":"2024-03-23T23:54:46.901728+0000","last_peered":"2024-03-23T23:54:46.901728+0000","last_clean":"2024-03-23T23:54:46.901728+0000","last_became_active":"2024-03-23T23:42:39.684360+0000","last_became_peered":"2024-03-23T23:42:39.684360+0000","last_unstale":"2024-03-23T23:54:46.901728+0000","last_undegraded":"2024-03-23T23:54:46.901728+0000","last_fullsized":"2024-03-23T23:54:46.901728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:19.914926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'5","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.418360+0000","last_change":"2024-03-23T23:42:49.741577+0000","last_active":"2024-03-23T23:57:53.418360+0000","last_peered":"2024-03-23T23:57:53.418360+0000","last_clean":"2024-03-23T23:57:53.418360+0000","last_became_active":"2024-03-23T23:42:49.741270+0000","last_became_peered":"2024-03-23T23:42:49.741270+0000","last_unstale":"2024-03-23T23:57:53.418360+0000","last_undegraded":"2024-03-23T23:57:53.418360+0000","last_fullsized":"2024-03-23T23:57:53.418360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:11:43.106922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"27'7534","reported_seq":7557,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.649402+0000","last_change":"2024-03-23T23:42:50.751992+0000","last_active":"2024-03-23T23:57:57.649402+0000","last_peered":"2024-03-23T23:57:57.649402+0000","last_clean":"2024-03-23T23:57:57.649402+0000","last_became_active":"2024-03-23T23:42:50.748281+0000","last_became_peered":"2024-03-23T23:42:50.748281+0000","last_unstale":"2024-03-23T23:57:57.649402+0000","last_undegraded":"2024-03-23T23:57:57.649402+0000","last_fullsized":"2024-03-23T23:57:57.649402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":7534,"log_dups_size":0,"ondisk_log_size":7534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:57.968968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112036,"num_write_kb":1284404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"27'34","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.409576+0000","last_change":"2024-03-23T23:42:49.741658+0000","last_active":"2024-03-23T23:57:53.409576+0000","last_peered":"2024-03-23T23:57:53.409576+0000","last_clean":"2024-03-23T23:57:53.409576+0000","last_became_active":"2024-03-23T23:42:49.740899+0000","last_became_peered":"2024-03-23T23:42:49.740899+0000","last_unstale":"2024-03-23T23:57:53.409576+0000","last_undegraded":"2024-03-23T23:57:53.409576+0000","last_fullsized":"2024-03-23T23:57:53.409576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:45:20.189501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'6202","reported_seq":6232,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.643775+0000","last_change":"2024-03-23T23:42:40.679384+0000","last_active":"2024-03-23T23:58:27.643775+0000","last_peered":"2024-03-23T23:58:27.643775+0000","last_clean":"2024-03-23T23:58:27.643775+0000","last_became_active":"2024-03-23T23:42:40.679070+0000","last_became_peered":"2024-03-23T23:42:40.679070+0000","last_unstale":"2024-03-23T23:58:27.643775+0000","last_undegraded":"2024-03-23T23:58:27.643775+0000","last_fullsized":"2024-03-23T23:58:27.643775+0000","mapping_epoch":19,"log_start":"27'500","ondisk_log_start":"27'500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5702,"log_dups_size":0,"ondisk_log_size":5702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:26:16.171920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92139,"num_write_kb":1051130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'28","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:54.268838+0000","last_change":"2024-03-23T23:42:39.682839+0000","last_active":"2024-03-23T23:54:54.268838+0000","last_peered":"2024-03-23T23:54:54.268838+0000","last_clean":"2024-03-23T23:54:54.268838+0000","last_became_active":"2024-03-23T23:42:39.682584+0000","last_became_peered":"2024-03-23T23:42:39.682584+0000","last_unstale":"2024-03-23T23:54:54.268838+0000","last_undegraded":"2024-03-23T23:54:54.268838+0000","last_fullsized":"2024-03-23T23:54:54.268838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:19.914926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":8211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"27'5271","reported_seq":5294,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.311967+0000","last_change":"2024-03-23T23:42:50.752596+0000","last_active":"2024-03-23T23:58:30.311967+0000","last_peered":"2024-03-23T23:58:30.311967+0000","last_clean":"2024-03-23T23:58:30.311967+0000","last_became_active":"2024-03-23T23:42:50.751598+0000","last_became_peered":"2024-03-23T23:42:50.751598+0000","last_unstale":"2024-03-23T23:58:30.311967+0000","last_undegraded":"2024-03-23T23:58:30.311967+0000","last_fullsized":"2024-03-23T23:58:30.311967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5271,"log_dups_size":0,"ondisk_log_size":5271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:37:19.741781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78296,"num_write_kb":918025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"27'25","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.611935+0000","last_change":"2024-03-23T23:42:49.734629+0000","last_active":"2024-03-23T23:57:57.611935+0000","last_peered":"2024-03-23T23:57:57.611935+0000","last_clean":"2024-03-23T23:57:57.611935+0000","last_became_active":"2024-03-23T23:42:49.734309+0000","last_became_peered":"2024-03-23T23:42:49.734309+0000","last_unstale":"2024-03-23T23:57:57.611935+0000","last_undegraded":"2024-03-23T23:57:57.611935+0000","last_fullsized":"2024-03-23T23:57:57.611935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:46.760020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'5375","reported_seq":5405,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:59.176057+0000","last_change":"2024-03-23T23:42:40.674605+0000","last_active":"2024-03-23T23:54:59.176057+0000","last_peered":"2024-03-23T23:54:59.176057+0000","last_clean":"2024-03-23T23:54:59.176057+0000","last_became_active":"2024-03-23T23:42:40.674366+0000","last_became_peered":"2024-03-23T23:42:40.674366+0000","last_unstale":"2024-03-23T23:54:59.176057+0000","last_undegraded":"2024-03-23T23:54:59.176057+0000","last_fullsized":"2024-03-23T23:54:59.176057+0000","mapping_epoch":19,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5275,"log_dups_size":0,"ondisk_log_size":5275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80001,"num_write_kb":974706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'8","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:59.176089+0000","last_change":"2024-03-23T23:42:39.688646+0000","last_active":"2024-03-23T23:54:59.176089+0000","last_peered":"2024-03-23T23:54:59.176089+0000","last_clean":"2024-03-23T23:54:59.176089+0000","last_became_active":"2024-03-23T23:42:39.687489+0000","last_became_peered":"2024-03-23T23:42:39.687489+0000","last_unstale":"2024-03-23T23:54:59.176089+0000","last_undegraded":"2024-03-23T23:54:59.176089+0000","last_fullsized":"2024-03-23T23:54:59.176089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:07:12.649156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"27'6132","reported_seq":6154,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.509771+0000","last_change":"2024-03-23T23:42:50.748511+0000","last_active":"2024-03-23T23:58:30.509771+0000","last_peered":"2024-03-23T23:58:30.509771+0000","last_clean":"2024-03-23T23:58:30.509771+0000","last_became_active":"2024-03-23T23:42:50.747154+0000","last_became_peered":"2024-03-23T23:42:50.747154+0000","last_unstale":"2024-03-23T23:58:30.509771+0000","last_undegraded":"2024-03-23T23:58:30.509771+0000","last_fullsized":"2024-03-23T23:58:30.509771+0000","mapping_epoch":23,"log_start":"27'400","ondisk_log_start":"27'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5732,"log_dups_size":0,"ondisk_log_size":5732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:09:19.723830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91134,"num_write_kb":1034218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"27'17","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:02.411457+0000","last_change":"2024-03-23T23:42:39.681458+0000","last_active":"2024-03-23T23:55:02.411457+0000","last_peered":"2024-03-23T23:55:02.411457+0000","last_clean":"2024-03-23T23:55:02.411457+0000","last_became_active":"2024-03-23T23:42:39.681158+0000","last_became_peered":"2024-03-23T23:42:39.681158+0000","last_unstale":"2024-03-23T23:55:02.411457+0000","last_undegraded":"2024-03-23T23:55:02.411457+0000","last_fullsized":"2024-03-23T23:55:02.411457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:08:03.578884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'4519","reported_seq":4549,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.740359+0000","last_change":"2024-03-23T23:42:40.676571+0000","last_active":"2024-03-23T23:58:27.740359+0000","last_peered":"2024-03-23T23:58:27.740359+0000","last_clean":"2024-03-23T23:58:27.740359+0000","last_became_active":"2024-03-23T23:42:40.675877+0000","last_became_peered":"2024-03-23T23:42:40.675877+0000","last_unstale":"2024-03-23T23:58:27.740359+0000","last_undegraded":"2024-03-23T23:58:27.740359+0000","last_fullsized":"2024-03-23T23:58:27.740359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4519,"log_dups_size":0,"ondisk_log_size":4519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:52.220411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67585,"num_write_kb":780136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'19","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:56.350382+0000","last_change":"2024-03-23T23:42:49.734208+0000","last_active":"2024-03-23T23:57:56.350382+0000","last_peered":"2024-03-23T23:57:56.350382+0000","last_clean":"2024-03-23T23:57:56.350382+0000","last_became_active":"2024-03-23T23:42:49.732943+0000","last_became_peered":"2024-03-23T23:42:49.732943+0000","last_unstale":"2024-03-23T23:57:56.350382+0000","last_undegraded":"2024-03-23T23:57:56.350382+0000","last_fullsized":"2024-03-23T23:57:56.350382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:43.683275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"27'4594","reported_seq":4616,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.367947+0000","last_change":"2024-03-23T23:42:50.752722+0000","last_active":"2024-03-23T23:57:53.367947+0000","last_peered":"2024-03-23T23:57:53.367947+0000","last_clean":"2024-03-23T23:57:53.367947+0000","last_became_active":"2024-03-23T23:42:50.749400+0000","last_became_peered":"2024-03-23T23:42:50.749400+0000","last_unstale":"2024-03-23T23:57:53.367947+0000","last_undegraded":"2024-03-23T23:57:53.367947+0000","last_fullsized":"2024-03-23T23:57:53.367947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4594,"log_dups_size":0,"ondisk_log_size":4594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:16:44.027189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67787,"num_write_kb":753464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'1303","reported_seq":1335,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:04.355170+0000","last_change":"2024-03-23T23:42:39.688422+0000","last_active":"2024-03-23T23:55:04.355170+0000","last_peered":"2024-03-23T23:55:04.355170+0000","last_clean":"2024-03-23T23:55:04.355170+0000","last_became_active":"2024-03-23T23:42:39.687423+0000","last_became_peered":"2024-03-23T23:42:39.687423+0000","last_unstale":"2024-03-23T23:55:04.355170+0000","last_undegraded":"2024-03-23T23:55:04.355170+0000","last_fullsized":"2024-03-23T23:55:04.355170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1303,"log_dups_size":0,"ondisk_log_size":1303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:20:38.456655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1297,"num_write_kb":4300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'4605","reported_seq":4635,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.670982+0000","last_change":"2024-03-23T23:42:40.680801+0000","last_active":"2024-03-23T23:58:27.670982+0000","last_peered":"2024-03-23T23:58:27.670982+0000","last_clean":"2024-03-23T23:58:27.670982+0000","last_became_active":"2024-03-23T23:42:40.680511+0000","last_became_peered":"2024-03-23T23:42:40.680511+0000","last_unstale":"2024-03-23T23:58:27.670982+0000","last_undegraded":"2024-03-23T23:58:27.670982+0000","last_fullsized":"2024-03-23T23:58:27.670982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4605,"log_dups_size":0,"ondisk_log_size":4605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:27:42.392714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68637,"num_write_kb":787014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'90","reported_seq":114,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.422374+0000","last_change":"2024-03-23T23:42:49.751291+0000","last_active":"2024-03-23T23:57:53.422374+0000","last_peered":"2024-03-23T23:57:53.422374+0000","last_clean":"2024-03-23T23:57:53.422374+0000","last_became_active":"2024-03-23T23:42:49.749695+0000","last_became_peered":"2024-03-23T23:42:49.749695+0000","last_unstale":"2024-03-23T23:57:53.422374+0000","last_undegraded":"2024-03-23T23:57:53.422374+0000","last_fullsized":"2024-03-23T23:57:53.422374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:40:33.073029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":12324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"27'4641","reported_seq":4664,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.624601+0000","last_change":"2024-03-23T23:42:50.752672+0000","last_active":"2024-03-23T23:57:57.624601+0000","last_peered":"2024-03-23T23:57:57.624601+0000","last_clean":"2024-03-23T23:57:57.624601+0000","last_became_active":"2024-03-23T23:42:50.752394+0000","last_became_peered":"2024-03-23T23:42:50.752394+0000","last_unstale":"2024-03-23T23:57:57.624601+0000","last_undegraded":"2024-03-23T23:57:57.624601+0000","last_fullsized":"2024-03-23T23:57:57.624601+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4641,"log_dups_size":0,"ondisk_log_size":4641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:51:01.385876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69093,"num_write_kb":797343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'5268","reported_seq":5299,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.664423+0000","last_change":"2024-03-23T23:42:40.679042+0000","last_active":"2024-03-23T23:58:27.664423+0000","last_peered":"2024-03-23T23:58:27.664423+0000","last_clean":"2024-03-23T23:58:27.664423+0000","last_became_active":"2024-03-23T23:42:40.678518+0000","last_became_peered":"2024-03-23T23:42:40.678518+0000","last_unstale":"2024-03-23T23:58:27.664423+0000","last_undegraded":"2024-03-23T23:58:27.664423+0000","last_fullsized":"2024-03-23T23:58:27.664423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5268,"log_dups_size":0,"ondisk_log_size":5268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:12:14.359173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78308,"num_write_kb":963226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"27'6097","reported_seq":6120,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.364444+0000","last_change":"2024-03-23T23:42:50.757132+0000","last_active":"2024-03-23T23:58:30.364444+0000","last_peered":"2024-03-23T23:58:30.364444+0000","last_clean":"2024-03-23T23:58:30.364444+0000","last_became_active":"2024-03-23T23:42:50.756813+0000","last_became_peered":"2024-03-23T23:42:50.756813+0000","last_unstale":"2024-03-23T23:58:30.364444+0000","last_undegraded":"2024-03-23T23:58:30.364444+0000","last_fullsized":"2024-03-23T23:58:30.364444+0000","mapping_epoch":23,"log_start":"27'400","ondisk_log_start":"27'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5697,"log_dups_size":0,"ondisk_log_size":5697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:04:26.911514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90451,"num_write_kb":1016115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"27'5502","reported_seq":5533,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.668122+0000","last_change":"2024-03-23T23:42:40.702411+0000","last_active":"2024-03-23T23:58:27.668122+0000","last_peered":"2024-03-23T23:58:27.668122+0000","last_clean":"2024-03-23T23:58:27.668122+0000","last_became_active":"2024-03-23T23:42:40.701398+0000","last_became_peered":"2024-03-23T23:42:40.701398+0000","last_unstale":"2024-03-23T23:58:27.668122+0000","last_undegraded":"2024-03-23T23:58:27.668122+0000","last_fullsized":"2024-03-23T23:58:27.668122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5502,"log_dups_size":0,"ondisk_log_size":5502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:03.196963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81712,"num_write_kb":960011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"27'5505","reported_seq":5528,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.437164+0000","last_change":"2024-03-23T23:42:50.756769+0000","last_active":"2024-03-23T23:57:53.437164+0000","last_peered":"2024-03-23T23:57:53.437164+0000","last_clean":"2024-03-23T23:57:53.437164+0000","last_became_active":"2024-03-23T23:42:50.756503+0000","last_became_peered":"2024-03-23T23:42:50.756503+0000","last_unstale":"2024-03-23T23:57:53.437164+0000","last_undegraded":"2024-03-23T23:57:53.437164+0000","last_fullsized":"2024-03-23T23:57:53.437164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5505,"log_dups_size":0,"ondisk_log_size":5505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:50.597847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81671,"num_write_kb":934046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"27'5990","reported_seq":6026,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.684080+0000","last_change":"2024-03-23T23:43:22.035915+0000","last_active":"2024-03-23T23:58:27.684080+0000","last_peered":"2024-03-23T23:58:27.684080+0000","last_clean":"2024-03-23T23:58:27.684080+0000","last_became_active":"2024-03-23T23:43:22.035611+0000","last_became_peered":"2024-03-23T23:43:22.035611+0000","last_unstale":"2024-03-23T23:58:27.684080+0000","last_undegraded":"2024-03-23T23:58:27.684080+0000","last_fullsized":"2024-03-23T23:58:27.684080+0000","mapping_epoch":26,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5890,"log_dups_size":0,"ondisk_log_size":5890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:49:53.121428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89084,"num_write_kb":1042929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"27'5555","reported_seq":5578,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.504307+0000","last_change":"2024-03-23T23:42:50.748726+0000","last_active":"2024-03-23T23:58:30.504307+0000","last_peered":"2024-03-23T23:58:30.504307+0000","last_clean":"2024-03-23T23:58:30.504307+0000","last_became_active":"2024-03-23T23:42:50.748105+0000","last_became_peered":"2024-03-23T23:42:50.748105+0000","last_unstale":"2024-03-23T23:58:30.504307+0000","last_undegraded":"2024-03-23T23:58:30.504307+0000","last_fullsized":"2024-03-23T23:58:30.504307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5555,"log_dups_size":0,"ondisk_log_size":5555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:54.910408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82238,"num_write_kb":945396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"27'5030","reported_seq":5061,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.692277+0000","last_change":"2024-03-23T23:42:40.673293+0000","last_active":"2024-03-23T23:58:27.692277+0000","last_peered":"2024-03-23T23:58:27.692277+0000","last_clean":"2024-03-23T23:58:27.692277+0000","last_became_active":"2024-03-23T23:42:40.672910+0000","last_became_peered":"2024-03-23T23:42:40.672910+0000","last_unstale":"2024-03-23T23:58:27.692277+0000","last_undegraded":"2024-03-23T23:58:27.692277+0000","last_fullsized":"2024-03-23T23:58:27.692277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5030,"log_dups_size":0,"ondisk_log_size":5030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:42:14.952953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74941,"num_write_kb":923200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"27'5960","reported_seq":5983,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.620022+0000","last_change":"2024-03-23T23:42:50.750291+0000","last_active":"2024-03-23T23:57:57.620022+0000","last_peered":"2024-03-23T23:57:57.620022+0000","last_clean":"2024-03-23T23:57:57.620022+0000","last_became_active":"2024-03-23T23:42:50.749908+0000","last_became_peered":"2024-03-23T23:42:50.749908+0000","last_unstale":"2024-03-23T23:57:57.620022+0000","last_undegraded":"2024-03-23T23:57:57.620022+0000","last_fullsized":"2024-03-23T23:57:57.620022+0000","mapping_epoch":23,"log_start":"27'200","ondisk_log_start":"27'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5760,"log_dups_size":0,"ondisk_log_size":5760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:54.910408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88637,"num_write_kb":993297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"27'5450","reported_seq":5481,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:34.943004+0000","last_change":"2024-03-23T23:42:40.685370+0000","last_active":"2024-03-23T23:55:34.943004+0000","last_peered":"2024-03-23T23:55:34.943004+0000","last_clean":"2024-03-23T23:55:34.943004+0000","last_became_active":"2024-03-23T23:42:40.685120+0000","last_became_peered":"2024-03-23T23:42:40.685120+0000","last_unstale":"2024-03-23T23:55:34.943004+0000","last_undegraded":"2024-03-23T23:55:34.943004+0000","last_fullsized":"2024-03-23T23:55:34.943004+0000","mapping_epoch":19,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5350,"log_dups_size":0,"ondisk_log_size":5350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81249,"num_write_kb":968622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"27'5333","reported_seq":5356,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.397151+0000","last_change":"2024-03-23T23:42:50.747361+0000","last_active":"2024-03-23T23:57:53.397151+0000","last_peered":"2024-03-23T23:57:53.397151+0000","last_clean":"2024-03-23T23:57:53.397151+0000","last_became_active":"2024-03-23T23:42:50.746310+0000","last_became_peered":"2024-03-23T23:42:50.746310+0000","last_unstale":"2024-03-23T23:57:53.397151+0000","last_undegraded":"2024-03-23T23:57:53.397151+0000","last_fullsized":"2024-03-23T23:57:53.397151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5333,"log_dups_size":0,"ondisk_log_size":5333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:57.968968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79170,"num_write_kb":877684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"27'5337","reported_seq":5368,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.589587+0000","last_change":"2024-03-23T23:42:40.677168+0000","last_active":"2024-03-23T23:58:27.589587+0000","last_peered":"2024-03-23T23:58:27.589587+0000","last_clean":"2024-03-23T23:58:27.589587+0000","last_became_active":"2024-03-23T23:42:40.676912+0000","last_became_peered":"2024-03-23T23:42:40.676912+0000","last_unstale":"2024-03-23T23:58:27.589587+0000","last_undegraded":"2024-03-23T23:58:27.589587+0000","last_fullsized":"2024-03-23T23:58:27.589587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5337,"log_dups_size":0,"ondisk_log_size":5337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:17:19.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79200,"num_write_kb":983244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"27'5388","reported_seq":5411,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.409572+0000","last_change":"2024-03-23T23:42:50.749305+0000","last_active":"2024-03-23T23:57:53.409572+0000","last_peered":"2024-03-23T23:57:53.409572+0000","last_clean":"2024-03-23T23:57:53.409572+0000","last_became_active":"2024-03-23T23:42:50.748798+0000","last_became_peered":"2024-03-23T23:42:50.748798+0000","last_unstale":"2024-03-23T23:57:53.409572+0000","last_undegraded":"2024-03-23T23:57:53.409572+0000","last_fullsized":"2024-03-23T23:57:53.409572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5388,"log_dups_size":0,"ondisk_log_size":5388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:19.610436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80551,"num_write_kb":913314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"27'4477","reported_seq":4507,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.728675+0000","last_change":"2024-03-23T23:42:40.694420+0000","last_active":"2024-03-23T23:58:27.728675+0000","last_peered":"2024-03-23T23:58:27.728675+0000","last_clean":"2024-03-23T23:58:27.728675+0000","last_became_active":"2024-03-23T23:42:40.693867+0000","last_became_peered":"2024-03-23T23:42:40.693867+0000","last_unstale":"2024-03-23T23:58:27.728675+0000","last_undegraded":"2024-03-23T23:58:27.728675+0000","last_fullsized":"2024-03-23T23:58:27.728675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4477,"log_dups_size":0,"ondisk_log_size":4477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:54.557634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66343,"num_write_kb":822171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"27'5440","reported_seq":5463,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.388213+0000","last_change":"2024-03-23T23:42:50.754149+0000","last_active":"2024-03-23T23:57:53.388213+0000","last_peered":"2024-03-23T23:57:53.388213+0000","last_clean":"2024-03-23T23:57:53.388213+0000","last_became_active":"2024-03-23T23:42:50.753471+0000","last_became_peered":"2024-03-23T23:42:50.753471+0000","last_unstale":"2024-03-23T23:57:53.388213+0000","last_undegraded":"2024-03-23T23:57:53.388213+0000","last_fullsized":"2024-03-23T23:57:53.388213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5440,"log_dups_size":0,"ondisk_log_size":5440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:28.822672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80762,"num_write_kb":909623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'5932","reported_seq":5963,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:50.436288+0000","last_change":"2024-03-23T23:42:40.685177+0000","last_active":"2024-03-23T23:55:50.436288+0000","last_peered":"2024-03-23T23:55:50.436288+0000","last_clean":"2024-03-23T23:55:50.436288+0000","last_became_active":"2024-03-23T23:42:40.684495+0000","last_became_peered":"2024-03-23T23:42:40.684495+0000","last_unstale":"2024-03-23T23:55:50.436288+0000","last_undegraded":"2024-03-23T23:55:50.436288+0000","last_fullsized":"2024-03-23T23:55:50.436288+0000","mapping_epoch":19,"log_start":"27'600","ondisk_log_start":"27'600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5332,"log_dups_size":0,"ondisk_log_size":5332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:27.675824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88442,"num_write_kb":1073631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"27'5672","reported_seq":5694,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.401288+0000","last_change":"2024-03-23T23:42:50.746438+0000","last_active":"2024-03-23T23:57:53.401288+0000","last_peered":"2024-03-23T23:57:53.401288+0000","last_clean":"2024-03-23T23:57:53.401288+0000","last_became_active":"2024-03-23T23:42:50.745771+0000","last_became_peered":"2024-03-23T23:42:50.745771+0000","last_unstale":"2024-03-23T23:57:53.401288+0000","last_undegraded":"2024-03-23T23:57:53.401288+0000","last_fullsized":"2024-03-23T23:57:53.401288+0000","mapping_epoch":23,"log_start":"27'400","ondisk_log_start":"27'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5272,"log_dups_size":0,"ondisk_log_size":5272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:22:17.484059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83950,"num_write_kb":942381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'5332","reported_seq":5363,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.685598+0000","last_change":"2024-03-23T23:42:40.701852+0000","last_active":"2024-03-23T23:58:27.685598+0000","last_peered":"2024-03-23T23:58:27.685598+0000","last_clean":"2024-03-23T23:58:27.685598+0000","last_became_active":"2024-03-23T23:42:40.701566+0000","last_became_peered":"2024-03-23T23:42:40.701566+0000","last_unstale":"2024-03-23T23:58:27.685598+0000","last_undegraded":"2024-03-23T23:58:27.685598+0000","last_fullsized":"2024-03-23T23:58:27.685598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5332,"log_dups_size":0,"ondisk_log_size":5332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79247,"num_write_kb":918114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"27'6948","reported_seq":6970,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.632915+0000","last_change":"2024-03-23T23:42:50.758879+0000","last_active":"2024-03-23T23:57:57.632915+0000","last_peered":"2024-03-23T23:57:57.632915+0000","last_clean":"2024-03-23T23:57:57.632915+0000","last_became_active":"2024-03-23T23:42:50.758564+0000","last_became_peered":"2024-03-23T23:42:50.758564+0000","last_unstale":"2024-03-23T23:57:57.632915+0000","last_undegraded":"2024-03-23T23:57:57.632915+0000","last_fullsized":"2024-03-23T23:57:57.632915+0000","mapping_epoch":23,"log_start":"27'1200","ondisk_log_start":"27'1200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5748,"log_dups_size":0,"ondisk_log_size":5748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:11:29.268536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103363,"num_write_kb":1190294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"27'4871","reported_seq":4902,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:56:10.679759+0000","last_change":"2024-03-23T23:42:40.684899+0000","last_active":"2024-03-23T23:56:10.679759+0000","last_peered":"2024-03-23T23:56:10.679759+0000","last_clean":"2024-03-23T23:56:10.679759+0000","last_became_active":"2024-03-23T23:42:40.684603+0000","last_became_peered":"2024-03-23T23:42:40.684603+0000","last_unstale":"2024-03-23T23:56:10.679759+0000","last_undegraded":"2024-03-23T23:56:10.679759+0000","last_fullsized":"2024-03-23T23:56:10.679759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4871,"log_dups_size":0,"ondisk_log_size":4871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:54.557634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72674,"num_write_kb":866936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"27'4847","reported_seq":4869,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.452843+0000","last_change":"2024-03-23T23:42:50.754096+0000","last_active":"2024-03-23T23:58:30.452843+0000","last_peered":"2024-03-23T23:58:30.452843+0000","last_clean":"2024-03-23T23:58:30.452843+0000","last_became_active":"2024-03-23T23:42:50.753602+0000","last_became_peered":"2024-03-23T23:42:50.753602+0000","last_unstale":"2024-03-23T23:58:30.452843+0000","last_undegraded":"2024-03-23T23:58:30.452843+0000","last_fullsized":"2024-03-23T23:58:30.452843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4847,"log_dups_size":0,"ondisk_log_size":4847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:16:26.794444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71433,"num_write_kb":836622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"27'5277","reported_seq":5293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.656567+0000","last_change":"2024-03-23T23:43:22.035247+0000","last_active":"2024-03-23T23:58:27.656567+0000","last_peered":"2024-03-23T23:58:27.656567+0000","last_clean":"2024-03-23T23:58:27.656567+0000","last_became_active":"2024-03-23T23:43:22.034831+0000","last_became_peered":"2024-03-23T23:43:22.034831+0000","last_unstale":"2024-03-23T23:58:27.656567+0000","last_undegraded":"2024-03-23T23:58:27.656567+0000","last_fullsized":"2024-03-23T23:58:27.656567+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5277,"log_dups_size":0,"ondisk_log_size":5277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:42:13.179165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78302,"num_write_kb":947936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2d","version":"27'6034","reported_seq":6056,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.233044+0000","last_change":"2024-03-23T23:42:50.741324+0000","last_active":"2024-03-23T23:57:53.233044+0000","last_peered":"2024-03-23T23:57:53.233044+0000","last_clean":"2024-03-23T23:57:53.233044+0000","last_became_active":"2024-03-23T23:42:50.741065+0000","last_became_peered":"2024-03-23T23:42:50.741065+0000","last_unstale":"2024-03-23T23:57:53.233044+0000","last_undegraded":"2024-03-23T23:57:53.233044+0000","last_fullsized":"2024-03-23T23:57:53.233044+0000","mapping_epoch":23,"log_start":"27'700","ondisk_log_start":"27'700","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5334,"log_dups_size":0,"ondisk_log_size":5334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:13.911327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89207,"num_write_kb":985993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"27'6145","reported_seq":6176,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.746964+0000","last_change":"2024-03-23T23:42:40.689122+0000","last_active":"2024-03-23T23:58:27.746964+0000","last_peered":"2024-03-23T23:58:27.746964+0000","last_clean":"2024-03-23T23:58:27.746964+0000","last_became_active":"2024-03-23T23:42:40.688875+0000","last_became_peered":"2024-03-23T23:42:40.688875+0000","last_unstale":"2024-03-23T23:58:27.746964+0000","last_undegraded":"2024-03-23T23:58:27.746964+0000","last_fullsized":"2024-03-23T23:58:27.746964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":6145,"log_dups_size":0,"ondisk_log_size":6145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:27:03.132032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91123,"num_write_kb":1098161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"27'5331","reported_seq":5353,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.218888+0000","last_change":"2024-03-23T23:42:50.762055+0000","last_active":"2024-03-23T23:57:53.218888+0000","last_peered":"2024-03-23T23:57:53.218888+0000","last_clean":"2024-03-23T23:57:53.218888+0000","last_became_active":"2024-03-23T23:42:50.761762+0000","last_became_peered":"2024-03-23T23:42:50.761762+0000","last_unstale":"2024-03-23T23:57:53.218888+0000","last_undegraded":"2024-03-23T23:57:53.218888+0000","last_fullsized":"2024-03-23T23:57:53.218888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5331,"log_dups_size":0,"ondisk_log_size":5331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:28.822672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79322,"num_write_kb":913380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'4790","reported_seq":4820,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.610687+0000","last_change":"2024-03-23T23:42:40.683701+0000","last_active":"2024-03-23T23:58:27.610687+0000","last_peered":"2024-03-23T23:58:27.610687+0000","last_clean":"2024-03-23T23:58:27.610687+0000","last_became_active":"2024-03-23T23:42:40.683377+0000","last_became_peered":"2024-03-23T23:42:40.683377+0000","last_unstale":"2024-03-23T23:58:27.610687+0000","last_undegraded":"2024-03-23T23:58:27.610687+0000","last_fullsized":"2024-03-23T23:58:27.610687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4790,"log_dups_size":0,"ondisk_log_size":4790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71235,"num_write_kb":860094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"27'6313","reported_seq":6335,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.618034+0000","last_change":"2024-03-23T23:42:50.754372+0000","last_active":"2024-03-23T23:57:57.618034+0000","last_peered":"2024-03-23T23:57:57.618034+0000","last_clean":"2024-03-23T23:57:57.618034+0000","last_became_active":"2024-03-23T23:42:50.754072+0000","last_became_peered":"2024-03-23T23:42:50.754072+0000","last_unstale":"2024-03-23T23:57:57.618034+0000","last_undegraded":"2024-03-23T23:57:57.618034+0000","last_fullsized":"2024-03-23T23:57:57.618034+0000","mapping_epoch":23,"log_start":"27'800","ondisk_log_start":"27'800","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5513,"log_dups_size":0,"ondisk_log_size":5513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:40:34.077584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93450,"num_write_kb":1059053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"27'5789","reported_seq":5819,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:35.865197+0000","last_change":"2024-03-23T23:42:40.689769+0000","last_active":"2024-03-23T23:54:35.865197+0000","last_peered":"2024-03-23T23:54:35.865197+0000","last_clean":"2024-03-23T23:54:35.865197+0000","last_became_active":"2024-03-23T23:42:40.689111+0000","last_became_peered":"2024-03-23T23:42:40.689111+0000","last_unstale":"2024-03-23T23:54:35.865197+0000","last_undegraded":"2024-03-23T23:54:35.865197+0000","last_fullsized":"2024-03-23T23:54:35.865197+0000","mapping_epoch":19,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5689,"log_dups_size":0,"ondisk_log_size":5689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:40:22.690954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86245,"num_write_kb":1027145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"27'5272","reported_seq":5295,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.618695+0000","last_change":"2024-03-23T23:42:50.759792+0000","last_active":"2024-03-23T23:57:57.618695+0000","last_peered":"2024-03-23T23:57:57.618695+0000","last_clean":"2024-03-23T23:57:57.618695+0000","last_became_active":"2024-03-23T23:42:50.759604+0000","last_became_peered":"2024-03-23T23:42:50.759604+0000","last_unstale":"2024-03-23T23:57:57.618695+0000","last_undegraded":"2024-03-23T23:57:57.618695+0000","last_fullsized":"2024-03-23T23:57:57.618695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5272,"log_dups_size":0,"ondisk_log_size":5272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:15:25.617521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77877,"num_write_kb":893934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"27'5684","reported_seq":5714,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.676056+0000","last_change":"2024-03-23T23:42:40.690961+0000","last_active":"2024-03-23T23:58:27.676056+0000","last_peered":"2024-03-23T23:58:27.676056+0000","last_clean":"2024-03-23T23:58:27.676056+0000","last_became_active":"2024-03-23T23:42:40.690690+0000","last_became_peered":"2024-03-23T23:42:40.690690+0000","last_unstale":"2024-03-23T23:58:27.676056+0000","last_undegraded":"2024-03-23T23:58:27.676056+0000","last_fullsized":"2024-03-23T23:58:27.676056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5684,"log_dups_size":0,"ondisk_log_size":5684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:56.763759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84510,"num_write_kb":984289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"27'4973","reported_seq":4996,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.379563+0000","last_change":"2024-03-23T23:42:50.764821+0000","last_active":"2024-03-23T23:58:30.379563+0000","last_peered":"2024-03-23T23:58:30.379563+0000","last_clean":"2024-03-23T23:58:30.379563+0000","last_became_active":"2024-03-23T23:42:50.764563+0000","last_became_peered":"2024-03-23T23:42:50.764563+0000","last_unstale":"2024-03-23T23:58:30.379563+0000","last_undegraded":"2024-03-23T23:58:30.379563+0000","last_fullsized":"2024-03-23T23:58:30.379563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4973,"log_dups_size":0,"ondisk_log_size":4973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:48:24.982671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73421,"num_write_kb":840152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"27'6976","reported_seq":7006,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.731575+0000","last_change":"2024-03-23T23:42:40.708540+0000","last_active":"2024-03-23T23:58:27.731575+0000","last_peered":"2024-03-23T23:58:27.731575+0000","last_clean":"2024-03-23T23:58:27.731575+0000","last_became_active":"2024-03-23T23:42:40.708031+0000","last_became_peered":"2024-03-23T23:42:40.708031+0000","last_unstale":"2024-03-23T23:58:27.731575+0000","last_undegraded":"2024-03-23T23:58:27.731575+0000","last_fullsized":"2024-03-23T23:58:27.731575+0000","mapping_epoch":19,"log_start":"27'1000","ondisk_log_start":"27'1000","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5976,"log_dups_size":0,"ondisk_log_size":5976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:44:03.386124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104041,"num_write_kb":1238038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"27'5691","reported_seq":5713,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.449795+0000","last_change":"2024-03-23T23:42:50.771062+0000","last_active":"2024-03-23T23:58:30.449795+0000","last_peered":"2024-03-23T23:58:30.449795+0000","last_clean":"2024-03-23T23:58:30.449795+0000","last_became_active":"2024-03-23T23:42:50.770790+0000","last_became_peered":"2024-03-23T23:42:50.770790+0000","last_unstale":"2024-03-23T23:58:30.449795+0000","last_undegraded":"2024-03-23T23:58:30.449795+0000","last_fullsized":"2024-03-23T23:58:30.449795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5691,"log_dups_size":0,"ondisk_log_size":5691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:13:07.156401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84043,"num_write_kb":972100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"27'4954","reported_seq":4984,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.678147+0000","last_change":"2024-03-23T23:42:40.697920+0000","last_active":"2024-03-23T23:58:27.678147+0000","last_peered":"2024-03-23T23:58:27.678147+0000","last_clean":"2024-03-23T23:58:27.678147+0000","last_became_active":"2024-03-23T23:42:40.697694+0000","last_became_peered":"2024-03-23T23:42:40.697694+0000","last_unstale":"2024-03-23T23:58:27.678147+0000","last_undegraded":"2024-03-23T23:58:27.678147+0000","last_fullsized":"2024-03-23T23:58:27.678147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4954,"log_dups_size":0,"ondisk_log_size":4954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73634,"num_write_kb":894008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"27'6050","reported_seq":6072,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.384523+0000","last_change":"2024-03-23T23:42:50.751694+0000","last_active":"2024-03-23T23:57:53.384523+0000","last_peered":"2024-03-23T23:57:53.384523+0000","last_clean":"2024-03-23T23:57:53.384523+0000","last_became_active":"2024-03-23T23:42:50.751452+0000","last_became_peered":"2024-03-23T23:42:50.751452+0000","last_unstale":"2024-03-23T23:57:53.384523+0000","last_undegraded":"2024-03-23T23:57:53.384523+0000","last_fullsized":"2024-03-23T23:57:53.384523+0000","mapping_epoch":23,"log_start":"27'500","ondisk_log_start":"27'500","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5550,"log_dups_size":0,"ondisk_log_size":5550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:57:49.981068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89888,"num_write_kb":1063697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"27'4435","reported_seq":4465,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.667717+0000","last_change":"2024-03-23T23:42:40.681928+0000","last_active":"2024-03-23T23:58:27.667717+0000","last_peered":"2024-03-23T23:58:27.667717+0000","last_clean":"2024-03-23T23:58:27.667717+0000","last_became_active":"2024-03-23T23:42:40.681337+0000","last_became_peered":"2024-03-23T23:42:40.681337+0000","last_unstale":"2024-03-23T23:58:27.667717+0000","last_undegraded":"2024-03-23T23:58:27.667717+0000","last_fullsized":"2024-03-23T23:58:27.667717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4435,"log_dups_size":0,"ondisk_log_size":4435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:52.220411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65733,"num_write_kb":782831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"27'3540","reported_seq":3562,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.388876+0000","last_change":"2024-03-23T23:42:50.769003+0000","last_active":"2024-03-23T23:57:53.388876+0000","last_peered":"2024-03-23T23:57:53.388876+0000","last_clean":"2024-03-23T23:57:53.388876+0000","last_became_active":"2024-03-23T23:42:50.768695+0000","last_became_peered":"2024-03-23T23:42:50.768695+0000","last_unstale":"2024-03-23T23:57:53.388876+0000","last_undegraded":"2024-03-23T23:57:53.388876+0000","last_fullsized":"2024-03-23T23:57:53.388876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":3540,"log_dups_size":0,"ondisk_log_size":3540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:17:11.847056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52531,"num_write_kb":593656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'4800","reported_seq":4830,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.657178+0000","last_change":"2024-03-23T23:42:40.680934+0000","last_active":"2024-03-23T23:58:27.657178+0000","last_peered":"2024-03-23T23:58:27.657178+0000","last_clean":"2024-03-23T23:58:27.657178+0000","last_became_active":"2024-03-23T23:42:40.680643+0000","last_became_peered":"2024-03-23T23:42:40.680643+0000","last_unstale":"2024-03-23T23:58:27.657178+0000","last_undegraded":"2024-03-23T23:58:27.657178+0000","last_fullsized":"2024-03-23T23:58:27.657178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4800,"log_dups_size":0,"ondisk_log_size":4800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:34.630671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71159,"num_write_kb":844038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"27'5005","reported_seq":5027,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:52.852956+0000","last_change":"2024-03-23T23:42:50.762401+0000","last_active":"2024-03-23T23:57:52.852956+0000","last_peered":"2024-03-23T23:57:52.852956+0000","last_clean":"2024-03-23T23:57:52.852956+0000","last_became_active":"2024-03-23T23:42:50.762183+0000","last_became_peered":"2024-03-23T23:42:50.762183+0000","last_unstale":"2024-03-23T23:57:52.852956+0000","last_undegraded":"2024-03-23T23:57:52.852956+0000","last_fullsized":"2024-03-23T23:57:52.852956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5005,"log_dups_size":0,"ondisk_log_size":5005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:13:10.497921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74336,"num_write_kb":853450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"27'4014","reported_seq":4044,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:38.734157+0000","last_change":"2024-03-23T23:42:40.682736+0000","last_active":"2024-03-23T23:54:38.734157+0000","last_peered":"2024-03-23T23:54:38.734157+0000","last_clean":"2024-03-23T23:54:38.734157+0000","last_became_active":"2024-03-23T23:42:40.682410+0000","last_became_peered":"2024-03-23T23:42:40.682410+0000","last_unstale":"2024-03-23T23:54:38.734157+0000","last_undegraded":"2024-03-23T23:54:38.734157+0000","last_fullsized":"2024-03-23T23:54:38.734157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4014,"log_dups_size":0,"ondisk_log_size":4014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:01:06.338641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59528,"num_write_kb":755074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"27'4691","reported_seq":4713,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.622134+0000","last_change":"2024-03-23T23:42:50.749204+0000","last_active":"2024-03-23T23:57:57.622134+0000","last_peered":"2024-03-23T23:57:57.622134+0000","last_clean":"2024-03-23T23:57:57.622134+0000","last_became_active":"2024-03-23T23:42:50.748809+0000","last_became_peered":"2024-03-23T23:42:50.748809+0000","last_unstale":"2024-03-23T23:57:57.622134+0000","last_undegraded":"2024-03-23T23:57:57.622134+0000","last_fullsized":"2024-03-23T23:57:57.622134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4691,"log_dups_size":0,"ondisk_log_size":4691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:39:49.888359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69546,"num_write_kb":808803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'3645","reported_seq":3675,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.744600+0000","last_change":"2024-03-23T23:42:40.682523+0000","last_active":"2024-03-23T23:58:27.744600+0000","last_peered":"2024-03-23T23:58:27.744600+0000","last_clean":"2024-03-23T23:58:27.744600+0000","last_became_active":"2024-03-23T23:42:40.682155+0000","last_became_peered":"2024-03-23T23:42:40.682155+0000","last_unstale":"2024-03-23T23:58:27.744600+0000","last_undegraded":"2024-03-23T23:58:27.744600+0000","last_fullsized":"2024-03-23T23:58:27.744600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":3645,"log_dups_size":0,"ondisk_log_size":3645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:33.260151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54155,"num_write_kb":623068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"27'4100","reported_seq":4123,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.407456+0000","last_change":"2024-03-23T23:42:50.746115+0000","last_active":"2024-03-23T23:58:30.407456+0000","last_peered":"2024-03-23T23:58:30.407456+0000","last_clean":"2024-03-23T23:58:30.407456+0000","last_became_active":"2024-03-23T23:42:50.745858+0000","last_became_peered":"2024-03-23T23:42:50.745858+0000","last_unstale":"2024-03-23T23:58:30.407456+0000","last_undegraded":"2024-03-23T23:58:30.407456+0000","last_fullsized":"2024-03-23T23:58:30.407456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4100,"log_dups_size":0,"ondisk_log_size":4100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:00:43.318455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":60470,"num_write_kb":714617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"27'5162","reported_seq":5192,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.639052+0000","last_change":"2024-03-23T23:42:40.702089+0000","last_active":"2024-03-23T23:58:27.639052+0000","last_peered":"2024-03-23T23:58:27.639052+0000","last_clean":"2024-03-23T23:58:27.639052+0000","last_became_active":"2024-03-23T23:42:40.701874+0000","last_became_peered":"2024-03-23T23:42:40.701874+0000","last_unstale":"2024-03-23T23:58:27.639052+0000","last_undegraded":"2024-03-23T23:58:27.639052+0000","last_fullsized":"2024-03-23T23:58:27.639052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5162,"log_dups_size":0,"ondisk_log_size":5162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76848,"num_write_kb":918422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"27'4942","reported_seq":4964,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.417067+0000","last_change":"2024-03-23T23:42:50.773115+0000","last_active":"2024-03-23T23:57:53.417067+0000","last_peered":"2024-03-23T23:57:53.417067+0000","last_clean":"2024-03-23T23:57:53.417067+0000","last_became_active":"2024-03-23T23:42:50.772849+0000","last_became_peered":"2024-03-23T23:42:50.772849+0000","last_unstale":"2024-03-23T23:57:53.417067+0000","last_undegraded":"2024-03-23T23:57:53.417067+0000","last_fullsized":"2024-03-23T23:57:53.417067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4942,"log_dups_size":0,"ondisk_log_size":4942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:29:42.898728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73640,"num_write_kb":854588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"27'5693","reported_seq":5722,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.736454+0000","last_change":"2024-03-23T23:42:40.703254+0000","last_active":"2024-03-23T23:58:27.736454+0000","last_peered":"2024-03-23T23:58:27.736454+0000","last_clean":"2024-03-23T23:58:27.736454+0000","last_became_active":"2024-03-23T23:42:40.702447+0000","last_became_peered":"2024-03-23T23:42:40.702447+0000","last_unstale":"2024-03-23T23:58:27.736454+0000","last_undegraded":"2024-03-23T23:58:27.736454+0000","last_fullsized":"2024-03-23T23:58:27.736454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5693,"log_dups_size":0,"ondisk_log_size":5693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:59:45.154553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84473,"num_write_kb":1008808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"27'4442","reported_seq":4464,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.421588+0000","last_change":"2024-03-23T23:42:50.748946+0000","last_active":"2024-03-23T23:57:53.421588+0000","last_peered":"2024-03-23T23:57:53.421588+0000","last_clean":"2024-03-23T23:57:53.421588+0000","last_became_active":"2024-03-23T23:42:50.745205+0000","last_became_peered":"2024-03-23T23:42:50.745205+0000","last_unstale":"2024-03-23T23:57:53.421588+0000","last_undegraded":"2024-03-23T23:57:53.421588+0000","last_fullsized":"2024-03-23T23:57:53.421588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4442,"log_dups_size":0,"ondisk_log_size":4442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:58:16.372010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65706,"num_write_kb":746784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"27'6094","reported_seq":6124,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:56.815848+0000","last_change":"2024-03-23T23:42:40.714331+0000","last_active":"2024-03-23T23:54:56.815848+0000","last_peered":"2024-03-23T23:54:56.815848+0000","last_clean":"2024-03-23T23:54:56.815848+0000","last_became_active":"2024-03-23T23:42:40.713737+0000","last_became_peered":"2024-03-23T23:42:40.713737+0000","last_unstale":"2024-03-23T23:54:56.815848+0000","last_undegraded":"2024-03-23T23:54:56.815848+0000","last_fullsized":"2024-03-23T23:54:56.815848+0000","mapping_epoch":19,"log_start":"27'400","ondisk_log_start":"27'400","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5694,"log_dups_size":0,"ondisk_log_size":5694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:24:43.902129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90841,"num_write_kb":1111853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"27'6495","reported_seq":6518,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.399771+0000","last_change":"2024-03-23T23:42:50.746666+0000","last_active":"2024-03-23T23:57:53.399771+0000","last_peered":"2024-03-23T23:57:53.399771+0000","last_clean":"2024-03-23T23:57:53.399771+0000","last_became_active":"2024-03-23T23:42:50.746149+0000","last_became_peered":"2024-03-23T23:42:50.746149+0000","last_unstale":"2024-03-23T23:57:53.399771+0000","last_undegraded":"2024-03-23T23:57:53.399771+0000","last_fullsized":"2024-03-23T23:57:53.399771+0000","mapping_epoch":23,"log_start":"27'1200","ondisk_log_start":"27'1200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5295,"log_dups_size":0,"ondisk_log_size":5295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:42:58.533499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96498,"num_write_kb":1062339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"27'5291","reported_seq":5321,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:04.355114+0000","last_change":"2024-03-23T23:42:40.710655+0000","last_active":"2024-03-23T23:55:04.355114+0000","last_peered":"2024-03-23T23:55:04.355114+0000","last_clean":"2024-03-23T23:55:04.355114+0000","last_became_active":"2024-03-23T23:42:40.710362+0000","last_became_peered":"2024-03-23T23:42:40.710362+0000","last_unstale":"2024-03-23T23:55:04.355114+0000","last_undegraded":"2024-03-23T23:55:04.355114+0000","last_fullsized":"2024-03-23T23:55:04.355114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5291,"log_dups_size":0,"ondisk_log_size":5291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:12:14.359173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79360,"num_write_kb":955033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"27'4846","reported_seq":4869,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.646399+0000","last_change":"2024-03-23T23:42:50.753397+0000","last_active":"2024-03-23T23:57:57.646399+0000","last_peered":"2024-03-23T23:57:57.646399+0000","last_clean":"2024-03-23T23:57:57.646399+0000","last_became_active":"2024-03-23T23:42:50.753085+0000","last_became_peered":"2024-03-23T23:42:50.753085+0000","last_unstale":"2024-03-23T23:57:57.646399+0000","last_undegraded":"2024-03-23T23:57:57.646399+0000","last_fullsized":"2024-03-23T23:57:57.646399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4846,"log_dups_size":0,"ondisk_log_size":4846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:25:44.894505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71990,"num_write_kb":829684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"27'5525","reported_seq":5555,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:07.300744+0000","last_change":"2024-03-23T23:42:40.689380+0000","last_active":"2024-03-23T23:55:07.300744+0000","last_peered":"2024-03-23T23:55:07.300744+0000","last_clean":"2024-03-23T23:55:07.300744+0000","last_became_active":"2024-03-23T23:42:40.689023+0000","last_became_peered":"2024-03-23T23:42:40.689023+0000","last_unstale":"2024-03-23T23:55:07.300744+0000","last_undegraded":"2024-03-23T23:55:07.300744+0000","last_fullsized":"2024-03-23T23:55:07.300744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5525,"log_dups_size":0,"ondisk_log_size":5525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:17:19.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82240,"num_write_kb":999067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"27'4495","reported_seq":4518,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.417023+0000","last_change":"2024-03-23T23:42:50.756133+0000","last_active":"2024-03-23T23:58:30.417023+0000","last_peered":"2024-03-23T23:58:30.417023+0000","last_clean":"2024-03-23T23:58:30.417023+0000","last_became_active":"2024-03-23T23:42:50.755405+0000","last_became_peered":"2024-03-23T23:42:50.755405+0000","last_unstale":"2024-03-23T23:58:30.417023+0000","last_undegraded":"2024-03-23T23:58:30.417023+0000","last_fullsized":"2024-03-23T23:58:30.417023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4495,"log_dups_size":0,"ondisk_log_size":4495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:46:10.784416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66847,"num_write_kb":769767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"27'4564","reported_seq":4594,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.681397+0000","last_change":"2024-03-23T23:42:40.698234+0000","last_active":"2024-03-23T23:58:27.681397+0000","last_peered":"2024-03-23T23:58:27.681397+0000","last_clean":"2024-03-23T23:58:27.681397+0000","last_became_active":"2024-03-23T23:42:40.695978+0000","last_became_peered":"2024-03-23T23:42:40.695978+0000","last_unstale":"2024-03-23T23:58:27.681397+0000","last_undegraded":"2024-03-23T23:58:27.681397+0000","last_fullsized":"2024-03-23T23:58:27.681397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4564,"log_dups_size":0,"ondisk_log_size":4564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:04.633288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67848,"num_write_kb":796612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"27'5522","reported_seq":5545,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.400864+0000","last_change":"2024-03-23T23:42:50.752051+0000","last_active":"2024-03-23T23:57:53.400864+0000","last_peered":"2024-03-23T23:57:53.400864+0000","last_clean":"2024-03-23T23:57:53.400864+0000","last_became_active":"2024-03-23T23:42:50.751738+0000","last_became_peered":"2024-03-23T23:42:50.751738+0000","last_unstale":"2024-03-23T23:57:53.400864+0000","last_undegraded":"2024-03-23T23:57:53.400864+0000","last_fullsized":"2024-03-23T23:57:53.400864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5522,"log_dups_size":0,"ondisk_log_size":5522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:20:53.750917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81884,"num_write_kb":915818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'4910","reported_seq":4940,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:17.782378+0000","last_change":"2024-03-23T23:42:40.698407+0000","last_active":"2024-03-23T23:55:17.782378+0000","last_peered":"2024-03-23T23:55:17.782378+0000","last_clean":"2024-03-23T23:55:17.782378+0000","last_became_active":"2024-03-23T23:42:40.698092+0000","last_became_peered":"2024-03-23T23:42:40.698092+0000","last_unstale":"2024-03-23T23:55:17.782378+0000","last_undegraded":"2024-03-23T23:55:17.782378+0000","last_fullsized":"2024-03-23T23:55:17.782378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4910,"log_dups_size":0,"ondisk_log_size":4910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:00:33.261296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73128,"num_write_kb":826128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"27'4578","reported_seq":4600,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.631712+0000","last_change":"2024-03-23T23:42:50.753000+0000","last_active":"2024-03-23T23:57:57.631712+0000","last_peered":"2024-03-23T23:57:57.631712+0000","last_clean":"2024-03-23T23:57:57.631712+0000","last_became_active":"2024-03-23T23:42:50.752614+0000","last_became_peered":"2024-03-23T23:42:50.752614+0000","last_unstale":"2024-03-23T23:57:57.631712+0000","last_undegraded":"2024-03-23T23:57:57.631712+0000","last_fullsized":"2024-03-23T23:57:57.631712+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4578,"log_dups_size":0,"ondisk_log_size":4578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:57:04.394872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67913,"num_write_kb":776364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"27'4451","reported_seq":4482,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.674349+0000","last_change":"2024-03-23T23:42:40.700631+0000","last_active":"2024-03-23T23:58:27.674349+0000","last_peered":"2024-03-23T23:58:27.674349+0000","last_clean":"2024-03-23T23:58:27.674349+0000","last_became_active":"2024-03-23T23:42:40.697932+0000","last_became_peered":"2024-03-23T23:42:40.697932+0000","last_unstale":"2024-03-23T23:58:27.674349+0000","last_undegraded":"2024-03-23T23:58:27.674349+0000","last_fullsized":"2024-03-23T23:58:27.674349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4451,"log_dups_size":0,"ondisk_log_size":4451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:05:17.694245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66105,"num_write_kb":808863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"27'4925","reported_seq":4947,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.418583+0000","last_change":"2024-03-23T23:42:50.765991+0000","last_active":"2024-03-23T23:58:30.418583+0000","last_peered":"2024-03-23T23:58:30.418583+0000","last_clean":"2024-03-23T23:58:30.418583+0000","last_became_active":"2024-03-23T23:42:50.765716+0000","last_became_peered":"2024-03-23T23:42:50.765716+0000","last_unstale":"2024-03-23T23:58:30.418583+0000","last_undegraded":"2024-03-23T23:58:30.418583+0000","last_fullsized":"2024-03-23T23:58:30.418583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4925,"log_dups_size":0,"ondisk_log_size":4925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:49:52.067143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72768,"num_write_kb":776524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'5362","reported_seq":5393,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.647477+0000","last_change":"2024-03-23T23:42:40.683983+0000","last_active":"2024-03-23T23:58:27.647477+0000","last_peered":"2024-03-23T23:58:27.647477+0000","last_clean":"2024-03-23T23:58:27.647477+0000","last_became_active":"2024-03-23T23:42:40.683711+0000","last_became_peered":"2024-03-23T23:42:40.683711+0000","last_unstale":"2024-03-23T23:58:27.647477+0000","last_undegraded":"2024-03-23T23:58:27.647477+0000","last_fullsized":"2024-03-23T23:58:27.647477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5362,"log_dups_size":0,"ondisk_log_size":5362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:51:30.695597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79587,"num_write_kb":960150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"27'5549","reported_seq":5571,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.188872+0000","last_change":"2024-03-23T23:42:50.766544+0000","last_active":"2024-03-23T23:57:53.188872+0000","last_peered":"2024-03-23T23:57:53.188872+0000","last_clean":"2024-03-23T23:57:53.188872+0000","last_became_active":"2024-03-23T23:42:50.766328+0000","last_became_peered":"2024-03-23T23:42:50.766328+0000","last_unstale":"2024-03-23T23:57:53.188872+0000","last_undegraded":"2024-03-23T23:57:53.188872+0000","last_fullsized":"2024-03-23T23:57:53.188872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5549,"log_dups_size":0,"ondisk_log_size":5549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:28:43.677331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82850,"num_write_kb":926357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"27'6244","reported_seq":6275,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.641054+0000","last_change":"2024-03-23T23:42:40.678622+0000","last_active":"2024-03-23T23:58:27.641054+0000","last_peered":"2024-03-23T23:58:27.641054+0000","last_clean":"2024-03-23T23:58:27.641054+0000","last_became_active":"2024-03-23T23:42:40.678325+0000","last_became_peered":"2024-03-23T23:42:40.678325+0000","last_unstale":"2024-03-23T23:58:27.641054+0000","last_undegraded":"2024-03-23T23:58:27.641054+0000","last_fullsized":"2024-03-23T23:58:27.641054+0000","mapping_epoch":19,"log_start":"27'500","ondisk_log_start":"27'500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5744,"log_dups_size":0,"ondisk_log_size":5744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:54:27.641281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92992,"num_write_kb":1109347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"27'5524","reported_seq":5546,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.633709+0000","last_change":"2024-03-23T23:42:50.750690+0000","last_active":"2024-03-23T23:57:57.633709+0000","last_peered":"2024-03-23T23:57:57.633709+0000","last_clean":"2024-03-23T23:57:57.633709+0000","last_became_active":"2024-03-23T23:42:50.750466+0000","last_became_peered":"2024-03-23T23:42:50.750466+0000","last_unstale":"2024-03-23T23:57:57.633709+0000","last_undegraded":"2024-03-23T23:57:57.633709+0000","last_fullsized":"2024-03-23T23:57:57.633709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5524,"log_dups_size":0,"ondisk_log_size":5524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:13:07.156401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82257,"num_write_kb":938007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"27'4800","reported_seq":4831,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:12.437938+0000","last_change":"2024-03-23T23:42:40.701959+0000","last_active":"2024-03-23T23:55:12.437938+0000","last_peered":"2024-03-23T23:55:12.437938+0000","last_clean":"2024-03-23T23:55:12.437938+0000","last_became_active":"2024-03-23T23:42:40.700855+0000","last_became_peered":"2024-03-23T23:42:40.700855+0000","last_unstale":"2024-03-23T23:55:12.437938+0000","last_undegraded":"2024-03-23T23:55:12.437938+0000","last_fullsized":"2024-03-23T23:55:12.437938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4800,"log_dups_size":0,"ondisk_log_size":4800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:49:42.009983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71971,"num_write_kb":878476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":4985198,"num_write_kb":56700971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":327149,"ondisk_log_size":327149,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":98084343,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":31,"num_read_kb":105,"num_write":4488,"num_write_kb":97547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":196231168,"data_stored":196168686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4210,"ondisk_log_size":4210,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":11,"num_write":4962178,"num_write_kb":59383104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326429,"ondisk_log_size":326429,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":93601894,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":44,"num_read_kb":115,"num_write":4044,"num_write_kb":93019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":187265024,"data_stored":187203539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3815,"ondisk_log_size":3815,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509634,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":612204,"kb_used_data":49444,"kb_used_omap":1,"kb_used_meta":562750,"kb_avail":93759636,"statfs":{"total":96636764160,"available":96009867264,"internally_reserved":0,"allocated":50630656,"data_stored":50448059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":576256454},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509630,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":889852,"kb_used_data":37236,"kb_used_omap":1,"kb_used_meta":852606,"kb_avail":93481988,"statfs":{"total":96636764160,"available":95725555712,"internally_reserved":0,"allocated":38129664,"data_stored":37949267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":873068997},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509629,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":997916,"kb_used_data":67412,"kb_used_omap":1,"kb_used_meta":930494,"kb_avail":93373924,"statfs":{"total":96636764160,"available":95614898176,"internally_reserved":0,"allocated":69029888,"data_stored":68838098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":952826309},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,4,0,4,2,5,22],"upper_bound":512},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509630,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":977816,"kb_used_data":56336,"kb_used_omap":1,"kb_used_meta":921470,"kb_avail":93394024,"statfs":{"total":96636764160,"available":95635480576,"internally_reserved":0,"allocated":57688064,"data_stored":57497163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":943585735},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542332,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":916712,"kb_used_data":58208,"kb_used_omap":1,"kb_used_meta":858494,"kb_avail":93455128,"statfs":{"total":96636764160,"available":95698051072,"internally_reserved":0,"allocated":59604992,"data_stored":59426419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":879098314},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542338,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":575412,"kb_used_data":12652,"kb_used_omap":1,"kb_used_meta":562750,"kb_avail":93796428,"statfs":{"total":96636764160,"available":96047542272,"internally_reserved":0,"allocated":12955648,"data_stored":12782666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":576256453},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542337,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":775792,"kb_used_data":62952,"kb_used_omap":1,"kb_used_meta":712830,"kb_avail":93596048,"statfs":{"total":96636764160,"available":95842353152,"internally_reserved":0,"allocated":64462848,"data_stored":64271712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":729938373},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542336,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":736108,"kb_used_data":33636,"kb_used_omap":1,"kb_used_meta":702462,"kb_avail":93635732,"statfs":{"total":96636764160,"available":95882989568,"internally_reserved":0,"allocated":34443264,"data_stored":34260561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":719321541},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25178112,"data_stored":25166462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22224896,"data_stored":22212855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4280320,"data_stored":4278865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18112512,"data_stored":18103375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":33566720,"data_stored":33554558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20971610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20979712,"data_stored":20972192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":41947136,"data_stored":41943622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41955328,"data_stored":41943734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8392704,"data_stored":8388678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":39292928,"data_stored":39278665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":35180544,"data_stored":35168417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16871424,"data_stored":16862534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29368320,"data_stored":29360744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16777306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T23:58:31.792 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-23T23:58:31.792 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T23:58:31.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.966+0000 7f8cb1400640 1 Processor -- start 2024-03-23T23:58:31.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.966+0000 7f8cb1400640 1 -- start start 2024-03-23T23:58:31.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.966+0000 7f8cb1400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8cac14fc70 0x7f8cac0aab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:31.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.966+0000 7f8cb1400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8cac06f630 0x7f8cac0720a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:31.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.966+0000 7f8cb1400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cac073080 con 0x7f8cac0725e0 2024-03-23T23:58:31.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.966+0000 7f8cb1400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cac070790 con 0x7f8cac06f630 2024-03-23T23:58:31.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.966+0000 7f8cb1400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac06edc0 con 0x7f8cac14fc70 2024-03-23T23:58:31.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.966+0000 7f8caa800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8cac14fc70 0x7f8cac0aab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:31.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.966+0000 7f8caa800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8cac14fc70 0x7f8cac0aab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:51460/0 (socket says 172.21.15.8:51460) 2024-03-23T23:58:31.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.966+0000 7f8caa800640 1 -- 172.21.15.8:0/4292764827 learned_addr learned my addr 172.21.15.8:0/4292764827 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:31.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.966+0000 7f8ca1e00640 1 --2- 172.21.15.8:0/4292764827 >> v2:172.21.15.196:3300/0 conn(0x7f8cac06f630 0x7f8cac0720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:31.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.966+0000 7f8caa800640 1 -- 172.21.15.8:0/4292764827 >> v2:172.21.15.196:3300/0 conn(0x7f8cac06f630 msgr2=0x7f8cac0720a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:31.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.966+0000 7f8caa800640 1 --2- 172.21.15.8:0/4292764827 >> v2:172.21.15.196:3300/0 conn(0x7f8cac06f630 0x7f8cac0720a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.966+0000 7f8caa800640 1 -- 172.21.15.8:0/4292764827 >> v1:172.21.15.196:6789/0 conn(0x7f8cac0725e0 legacy=0x7f8cac0a9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.966+0000 7f8caa800640 1 -- 172.21.15.8:0/4292764827 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac06f010 con 0x7f8cac14fc70 2024-03-23T23:58:31.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.970+0000 7f8caa800640 1 --2- 172.21.15.8:0/4292764827 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8cac14fc70 0x7f8cac0aab80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00bb10 tx=0x7f8c9c01eba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30661a443cf51899 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:31.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.970+0000 7f8ca9e00640 1 -- 172.21.15.8:0/4292764827 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c0b4070 con 0x7f8cac14fc70 2024-03-23T23:58:31.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.970+0000 7f8ca9e00640 1 -- 172.21.15.8:0/4292764827 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9c0a7a60 con 0x7f8cac14fc70 2024-03-23T23:58:31.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.970+0000 7f8ca9e00640 1 -- 172.21.15.8:0/4292764827 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c0a7e30 con 0x7f8cac14fc70 2024-03-23T23:58:31.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.970+0000 7f8cb1400640 1 -- 172.21.15.8:0/4292764827 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8cac14fc70 msgr2=0x7f8cac0aab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.970+0000 7f8cb1400640 1 --2- 172.21.15.8:0/4292764827 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8cac14fc70 0x7f8cac0aab80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00bb10 tx=0x7f8c9c01eba0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.970+0000 7f8cb1400640 1 -- 172.21.15.8:0/4292764827 shutdown_connections 2024-03-23T23:58:31.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.970+0000 7f8cb1400640 1 --2- 172.21.15.8:0/4292764827 >> v2:172.21.15.196:3300/0 conn(0x7f8cac06f630 0x7f8cac0720a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.970+0000 7f8cb1400640 1 --2- 172.21.15.8:0/4292764827 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8cac14fc70 0x7f8cac0aab80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.970+0000 7f8cb1400640 1 -- 172.21.15.8:0/4292764827 >> 172.21.15.8:0/4292764827 conn(0x7f8cac0c4d80 msgr2=0x7f8cac0c5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:31.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.970+0000 7f8cb1400640 1 -- 172.21.15.8:0/4292764827 shutdown_connections 2024-03-23T23:58:31.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.970+0000 7f8cb1400640 1 -- 172.21.15.8:0/4292764827 wait complete. 2024-03-23T23:58:31.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.974+0000 7f8cb1400640 1 Processor -- start 2024-03-23T23:58:31.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.974+0000 7f8cb1400640 1 -- start start 2024-03-23T23:58:31.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.974+0000 7f8cb1400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cac06f630 0x7f8cac154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:31.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.974+0000 7f8cb1400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8cac0725e0 0x7f8cac0c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:31.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.974+0000 7f8cb1400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cac14fc70 0x7f8cac0c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:31.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.974+0000 7f8cb1400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac0aa1b0 con 0x7f8cac06f630 2024-03-23T23:58:31.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.974+0000 7f8cb1400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac150050 con 0x7f8cac14fc70 2024-03-23T23:58:31.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.974+0000 7f8cb1400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac0aa330 con 0x7f8cac0725e0 2024-03-23T23:58:31.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.974+0000 7f8caa800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cac06f630 0x7f8cac154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:31.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.974+0000 7f8caa800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cac06f630 0x7f8cac154c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58682/0 (socket says 172.21.15.8:58682) 2024-03-23T23:58:31.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.974+0000 7f8caa800640 1 -- 172.21.15.8:0/2460108318 learned_addr learned my addr 172.21.15.8:0/2460108318 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:31.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.974+0000 7f8ca1e00640 1 --2- 172.21.15.8:0/2460108318 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8cac0725e0 0x7f8cac0c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:31.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.974+0000 7f8cab200640 1 --2- 172.21.15.8:0/2460108318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cac14fc70 0x7f8cac0c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:31.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.974+0000 7f8ca1e00640 1 -- 172.21.15.8:0/2460108318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cac14fc70 msgr2=0x7f8cac0c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.974+0000 7f8ca1e00640 1 --2- 172.21.15.8:0/2460108318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cac14fc70 0x7f8cac0c7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.974+0000 7f8ca1e00640 1 -- 172.21.15.8:0/2460108318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cac06f630 msgr2=0x7f8cac154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.974+0000 7f8ca1e00640 1 --2- 172.21.15.8:0/2460108318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cac06f630 0x7f8cac154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.974+0000 7f8ca1e00640 1 -- 172.21.15.8:0/2460108318 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac1efb00 con 0x7f8cac0725e0 2024-03-23T23:58:31.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.974+0000 7f8caa800640 1 --2- 172.21.15.8:0/2460108318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cac06f630 0x7f8cac154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:58:31.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.974+0000 7f8ca1e00640 1 --2- 172.21.15.8:0/2460108318 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8cac0725e0 0x7f8cac0c76c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400ef90 tx=0x7f8c9400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:31.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.974+0000 7f8ca3400640 1 -- 172.21.15.8:0/2460108318 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c94018020 con 0x7f8cac0725e0 2024-03-23T23:58:31.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.974+0000 7f8ca3400640 1 -- 172.21.15.8:0/2460108318 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c94014480 con 0x7f8cac0725e0 2024-03-23T23:58:31.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.974+0000 7f8cb1400640 1 -- 172.21.15.8:0/2460108318 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cac1eeef0 con 0x7f8cac0725e0 2024-03-23T23:58:31.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.974+0000 7f8ca3400640 1 -- 172.21.15.8:0/2460108318 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c94014830 con 0x7f8cac0725e0 2024-03-23T23:58:31.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.974+0000 7f8cb1400640 1 -- 172.21.15.8:0/2460108318 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cac1ef4b0 con 0x7f8cac0725e0 2024-03-23T23:58:31.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.974+0000 7f8cb1400640 1 -- 172.21.15.8:0/2460108318 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cac068270 con 0x7f8cac0725e0 2024-03-23T23:58:31.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.978+0000 7f8ca3400640 1 -- 172.21.15.8:0/2460108318 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f8c9401b020 con 0x7f8cac0725e0 2024-03-23T23:58:31.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.978+0000 7f8ca3400640 1 --2- 172.21.15.8:0/2460108318 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8c88067660 0x7f8c88069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:31.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.978+0000 7f8ca3400640 1 -- 172.21.15.8:0/2460108318 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f8c94086a60 con 0x7f8cac0725e0 2024-03-23T23:58:31.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.978+0000 7f8caa800640 1 --2- 172.21.15.8:0/2460108318 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8c88067660 0x7f8c88069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:31.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.978+0000 7f8caa800640 1 --2- 172.21.15.8:0/2460108318 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8c88067660 0x7f8c88069b20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00bb10 tx=0x7f8c9c0a9070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:31.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:31.982+0000 7f8ca3400640 1 -- 172.21.15.8:0/2460108318 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f8c94022020 con 0x7f8cac0725e0 2024-03-23T23:58:32.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.142+0000 7f8cb1400640 1 -- 172.21.15.8:0/2460108318 --> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8cac149d00 con 0x7f8c88067660 2024-03-23T23:58:32.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.154+0000 7f8ca3400640 1 -- 172.21.15.8:0/2460108318 <== mgr.4098 v2:172.21.15.196:6832/1295060067 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+494266 (secure 0 0 0) 0x7f8cac149d00 con 0x7f8c88067660 2024-03-23T23:58:32.162 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:58:32.165 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-03-23T23:58:32.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.162+0000 7f8cb1400640 1 -- 172.21.15.8:0/2460108318 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8c88067660 msgr2=0x7f8c88069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:32.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.162+0000 7f8cb1400640 1 --2- 172.21.15.8:0/2460108318 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8c88067660 0x7f8c88069b20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00bb10 tx=0x7f8c9c0a9070 comp rx=0 tx=0).stop 2024-03-23T23:58:32.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.162+0000 7f8cb1400640 1 -- 172.21.15.8:0/2460108318 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8cac0725e0 msgr2=0x7f8cac0c76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:32.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.162+0000 7f8cb1400640 1 --2- 172.21.15.8:0/2460108318 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8cac0725e0 0x7f8cac0c76c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400ef90 tx=0x7f8c9400c490 comp rx=0 tx=0).stop 2024-03-23T23:58:32.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.162+0000 7f8cb1400640 1 -- 172.21.15.8:0/2460108318 shutdown_connections 2024-03-23T23:58:32.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.162+0000 7f8cb1400640 1 --2- 172.21.15.8:0/2460108318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cac14fc70 0x7f8cac0c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:32.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.162+0000 7f8cb1400640 1 --2- 172.21.15.8:0/2460108318 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8c88067660 0x7f8c88069b20 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:32.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.162+0000 7f8cb1400640 1 --2- 172.21.15.8:0/2460108318 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8cac0725e0 0x7f8cac0c76c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:32.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.162+0000 7f8cb1400640 1 --2- 172.21.15.8:0/2460108318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cac06f630 0x7f8cac154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:32.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.162+0000 7f8cb1400640 1 -- 172.21.15.8:0/2460108318 >> 172.21.15.8:0/2460108318 conn(0x7f8cac0c4d80 msgr2=0x7f8cac14c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:32.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.162+0000 7f8cb1400640 1 -- 172.21.15.8:0/2460108318 shutdown_connections 2024-03-23T23:58:32.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.162+0000 7f8cb1400640 1 -- 172.21.15.8:0/2460108318 wait complete. 2024-03-23T23:58:32.181 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":502,"stamp":"2024-03-23T23:58:31.727130+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":192276605,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":195,"num_read_kb":347,"num_write":9956067,"num_write_kb":116277057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":661720,"ondisk_log_size":661720,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":6481812,"kb_used_data":377876,"kb_used_omap":12,"kb_used_meta":6103859,"kb_avail":748492908,"statfs":{"total":773094113280,"available":766456737792,"internally_reserved":0,"allocated":386945024,"data_stored":385473945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":6250352176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,4,0,4,2,5,22],"upper_bound":512},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":249,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006457"},"pg_stats":[{"pgid":"5.18","version":"27'5444","reported_seq":5466,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.644986+0000","last_change":"2024-03-23T23:42:50.736219+0000","last_active":"2024-03-23T23:57:57.644986+0000","last_peered":"2024-03-23T23:57:57.644986+0000","last_clean":"2024-03-23T23:57:57.644986+0000","last_became_active":"2024-03-23T23:42:50.735940+0000","last_became_peered":"2024-03-23T23:42:50.735940+0000","last_unstale":"2024-03-23T23:57:57.644986+0000","last_undegraded":"2024-03-23T23:57:57.644986+0000","last_fullsized":"2024-03-23T23:57:57.644986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5444,"log_dups_size":0,"ondisk_log_size":5444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:11:44.111477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80864,"num_write_kb":923838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"27'57","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:59.870845+0000","last_change":"2024-03-23T23:42:39.693858+0000","last_active":"2024-03-23T23:54:59.870845+0000","last_peered":"2024-03-23T23:54:59.870845+0000","last_clean":"2024-03-23T23:54:59.870845+0000","last_became_active":"2024-03-23T23:42:39.693636+0000","last_became_peered":"2024-03-23T23:42:39.693636+0000","last_unstale":"2024-03-23T23:54:59.870845+0000","last_undegraded":"2024-03-23T23:54:59.870845+0000","last_fullsized":"2024-03-23T23:54:59.870845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:44:07.213123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'5379","reported_seq":5410,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:59.180370+0000","last_change":"2024-03-23T23:42:40.685708+0000","last_active":"2024-03-23T23:54:59.180370+0000","last_peered":"2024-03-23T23:54:59.180370+0000","last_clean":"2024-03-23T23:54:59.180370+0000","last_became_active":"2024-03-23T23:42:40.682755+0000","last_became_peered":"2024-03-23T23:42:40.682755+0000","last_unstale":"2024-03-23T23:54:59.180370+0000","last_undegraded":"2024-03-23T23:54:59.180370+0000","last_fullsized":"2024-03-23T23:54:59.180370+0000","mapping_epoch":19,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5279,"log_dups_size":0,"ondisk_log_size":5279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:04.633288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79922,"num_write_kb":951101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'4","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.420544+0000","last_change":"2024-03-23T23:42:49.750108+0000","last_active":"2024-03-23T23:57:53.420544+0000","last_peered":"2024-03-23T23:57:53.420544+0000","last_clean":"2024-03-23T23:57:53.420544+0000","last_became_active":"2024-03-23T23:42:49.749634+0000","last_became_peered":"2024-03-23T23:42:49.749634+0000","last_unstale":"2024-03-23T23:57:53.420544+0000","last_undegraded":"2024-03-23T23:57:53.420544+0000","last_fullsized":"2024-03-23T23:57:53.420544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:49:16.758908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"27'6028","reported_seq":6050,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.461302+0000","last_change":"2024-03-23T23:42:50.752450+0000","last_active":"2024-03-23T23:58:30.461302+0000","last_peered":"2024-03-23T23:58:30.461302+0000","last_clean":"2024-03-23T23:58:30.461302+0000","last_became_active":"2024-03-23T23:42:50.752078+0000","last_became_peered":"2024-03-23T23:42:50.752078+0000","last_unstale":"2024-03-23T23:58:30.461302+0000","last_undegraded":"2024-03-23T23:58:30.461302+0000","last_fullsized":"2024-03-23T23:58:30.461302+0000","mapping_epoch":23,"log_start":"27'300","ondisk_log_start":"27'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5728,"log_dups_size":0,"ondisk_log_size":5728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:28:43.677331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89116,"num_write_kb":998926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"27'15","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:59.180396+0000","last_change":"2024-03-23T23:42:39.687108+0000","last_active":"2024-03-23T23:54:59.180396+0000","last_peered":"2024-03-23T23:54:59.180396+0000","last_clean":"2024-03-23T23:54:59.180396+0000","last_became_active":"2024-03-23T23:42:39.686875+0000","last_became_peered":"2024-03-23T23:42:39.686875+0000","last_unstale":"2024-03-23T23:54:59.180396+0000","last_undegraded":"2024-03-23T23:54:59.180396+0000","last_fullsized":"2024-03-23T23:54:59.180396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:05:52.079172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'7365","reported_seq":7396,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.667492+0000","last_change":"2024-03-23T23:42:40.698746+0000","last_active":"2024-03-23T23:58:27.667492+0000","last_peered":"2024-03-23T23:58:27.667492+0000","last_clean":"2024-03-23T23:58:27.667492+0000","last_became_active":"2024-03-23T23:42:40.698003+0000","last_became_peered":"2024-03-23T23:42:40.698003+0000","last_unstale":"2024-03-23T23:58:27.667492+0000","last_undegraded":"2024-03-23T23:58:27.667492+0000","last_fullsized":"2024-03-23T23:58:27.667492+0000","mapping_epoch":19,"log_start":"27'500","ondisk_log_start":"27'500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":6865,"log_dups_size":0,"ondisk_log_size":6865,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:53:46.437114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110287,"num_write_kb":1353580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'28","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:32.652461+0000","last_change":"2024-03-23T23:42:49.728923+0000","last_active":"2024-03-23T23:57:32.652461+0000","last_peered":"2024-03-23T23:57:32.652461+0000","last_clean":"2024-03-23T23:57:32.652461+0000","last_became_active":"2024-03-23T23:42:49.728261+0000","last_became_peered":"2024-03-23T23:42:49.728261+0000","last_unstale":"2024-03-23T23:57:32.652461+0000","last_undegraded":"2024-03-23T23:57:32.652461+0000","last_fullsized":"2024-03-23T23:57:32.652461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:22.375891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"27'4523","reported_seq":4545,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.357209+0000","last_change":"2024-03-23T23:42:50.755852+0000","last_active":"2024-03-23T23:57:53.357209+0000","last_peered":"2024-03-23T23:57:53.357209+0000","last_clean":"2024-03-23T23:57:53.357209+0000","last_became_active":"2024-03-23T23:42:50.755600+0000","last_became_peered":"2024-03-23T23:42:50.755600+0000","last_unstale":"2024-03-23T23:57:53.357209+0000","last_undegraded":"2024-03-23T23:57:53.357209+0000","last_fullsized":"2024-03-23T23:57:53.357209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4523,"log_dups_size":0,"ondisk_log_size":4523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:29:47.303374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67405,"num_write_kb":746106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"27'60","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:17.810639+0000","last_change":"2024-03-23T23:42:39.696690+0000","last_active":"2024-03-23T23:55:17.810639+0000","last_peered":"2024-03-23T23:55:17.810639+0000","last_clean":"2024-03-23T23:55:17.810639+0000","last_became_active":"2024-03-23T23:42:39.696342+0000","last_became_peered":"2024-03-23T23:42:39.696342+0000","last_unstale":"2024-03-23T23:55:17.810639+0000","last_undegraded":"2024-03-23T23:55:17.810639+0000","last_fullsized":"2024-03-23T23:55:17.810639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:42:37.702720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":12316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'4666","reported_seq":4696,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.711924+0000","last_change":"2024-03-23T23:42:40.700355+0000","last_active":"2024-03-23T23:58:27.711924+0000","last_peered":"2024-03-23T23:58:27.711924+0000","last_clean":"2024-03-23T23:58:27.711924+0000","last_became_active":"2024-03-23T23:42:40.697668+0000","last_became_peered":"2024-03-23T23:42:40.697668+0000","last_unstale":"2024-03-23T23:58:27.711924+0000","last_undegraded":"2024-03-23T23:58:27.711924+0000","last_fullsized":"2024-03-23T23:58:27.711924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4666,"log_dups_size":0,"ondisk_log_size":4666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:23:43.515519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69534,"num_write_kb":791816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'1354","reported_seq":1378,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.424228+0000","last_change":"2024-03-23T23:42:49.744792+0000","last_active":"2024-03-23T23:57:53.424228+0000","last_peered":"2024-03-23T23:57:53.424228+0000","last_clean":"2024-03-23T23:57:53.424228+0000","last_became_active":"2024-03-23T23:42:49.744561+0000","last_became_peered":"2024-03-23T23:42:49.744561+0000","last_unstale":"2024-03-23T23:57:53.424228+0000","last_undegraded":"2024-03-23T23:57:53.424228+0000","last_fullsized":"2024-03-23T23:57:53.424228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1354,"log_dups_size":0,"ondisk_log_size":1354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:07:58.222020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1348,"num_write_kb":4325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"27'4452","reported_seq":4474,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.400820+0000","last_change":"2024-03-23T23:42:50.755575+0000","last_active":"2024-03-23T23:57:53.400820+0000","last_peered":"2024-03-23T23:57:53.400820+0000","last_clean":"2024-03-23T23:57:53.400820+0000","last_became_active":"2024-03-23T23:42:50.755337+0000","last_became_peered":"2024-03-23T23:42:50.755337+0000","last_unstale":"2024-03-23T23:57:53.400820+0000","last_undegraded":"2024-03-23T23:57:53.400820+0000","last_fullsized":"2024-03-23T23:57:53.400820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4452,"log_dups_size":0,"ondisk_log_size":4452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:13.911327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65733,"num_write_kb":735312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"27'16","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:12.437892+0000","last_change":"2024-03-23T23:42:39.696707+0000","last_active":"2024-03-23T23:55:12.437892+0000","last_peered":"2024-03-23T23:55:12.437892+0000","last_clean":"2024-03-23T23:55:12.437892+0000","last_became_active":"2024-03-23T23:42:39.696401+0000","last_became_peered":"2024-03-23T23:42:39.696401+0000","last_unstale":"2024-03-23T23:55:12.437892+0000","last_undegraded":"2024-03-23T23:55:12.437892+0000","last_fullsized":"2024-03-23T23:55:12.437892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:55.757707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'6122","reported_seq":6152,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.741740+0000","last_change":"2024-03-23T23:42:40.700389+0000","last_active":"2024-03-23T23:58:27.741740+0000","last_peered":"2024-03-23T23:58:27.741740+0000","last_clean":"2024-03-23T23:58:27.741740+0000","last_became_active":"2024-03-23T23:42:40.699770+0000","last_became_peered":"2024-03-23T23:42:40.699770+0000","last_unstale":"2024-03-23T23:58:27.741740+0000","last_undegraded":"2024-03-23T23:58:27.741740+0000","last_fullsized":"2024-03-23T23:58:27.741740+0000","mapping_epoch":19,"log_start":"27'200","ondisk_log_start":"27'200","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5922,"log_dups_size":0,"ondisk_log_size":5922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:27.675824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91052,"num_write_kb":1089478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'300","reported_seq":324,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:01.092701+0000","last_change":"2024-03-23T23:42:49.745710+0000","last_active":"2024-03-23T23:58:01.092701+0000","last_peered":"2024-03-23T23:58:01.092701+0000","last_clean":"2024-03-23T23:58:01.092701+0000","last_became_active":"2024-03-23T23:42:49.745526+0000","last_became_peered":"2024-03-23T23:42:49.745526+0000","last_unstale":"2024-03-23T23:58:01.092701+0000","last_undegraded":"2024-03-23T23:58:01.092701+0000","last_fullsized":"2024-03-23T23:58:01.092701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:05:26.746849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5723539,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":5807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"27'5356","reported_seq":5380,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.415680+0000","last_change":"2024-03-23T23:42:50.747274+0000","last_active":"2024-03-23T23:58:30.415680+0000","last_peered":"2024-03-23T23:58:30.415680+0000","last_clean":"2024-03-23T23:58:30.415680+0000","last_became_active":"2024-03-23T23:42:50.746937+0000","last_became_peered":"2024-03-23T23:42:50.746937+0000","last_unstale":"2024-03-23T23:58:30.415680+0000","last_undegraded":"2024-03-23T23:58:30.415680+0000","last_fullsized":"2024-03-23T23:58:30.415680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5356,"log_dups_size":0,"ondisk_log_size":5356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:19.610436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":11,"num_write":79434,"num_write_kb":896560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"27'5252","reported_seq":5283,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.632377+0000","last_change":"2024-03-23T23:42:40.682467+0000","last_active":"2024-03-23T23:58:27.632377+0000","last_peered":"2024-03-23T23:58:27.632377+0000","last_clean":"2024-03-23T23:58:27.632377+0000","last_became_active":"2024-03-23T23:42:40.682192+0000","last_became_peered":"2024-03-23T23:42:40.682192+0000","last_unstale":"2024-03-23T23:58:27.632377+0000","last_undegraded":"2024-03-23T23:58:27.632377+0000","last_fullsized":"2024-03-23T23:58:27.632377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5252,"log_dups_size":0,"ondisk_log_size":5252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:37:24.839568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78193,"num_write_kb":930302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'10","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:56:06.895925+0000","last_change":"2024-03-23T23:42:39.696528+0000","last_active":"2024-03-23T23:56:06.895925+0000","last_peered":"2024-03-23T23:56:06.895925+0000","last_clean":"2024-03-23T23:56:06.895925+0000","last_became_active":"2024-03-23T23:42:39.696207+0000","last_became_peered":"2024-03-23T23:42:39.696207+0000","last_unstale":"2024-03-23T23:56:06.895925+0000","last_undegraded":"2024-03-23T23:56:06.895925+0000","last_fullsized":"2024-03-23T23:56:06.895925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:02.190910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'10","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.352552+0000","last_change":"2024-03-23T23:42:49.734156+0000","last_active":"2024-03-23T23:57:53.352552+0000","last_peered":"2024-03-23T23:57:53.352552+0000","last_clean":"2024-03-23T23:57:53.352552+0000","last_became_active":"2024-03-23T23:42:49.733888+0000","last_became_peered":"2024-03-23T23:42:49.733888+0000","last_unstale":"2024-03-23T23:57:53.352552+0000","last_undegraded":"2024-03-23T23:57:53.352552+0000","last_fullsized":"2024-03-23T23:57:53.352552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:23:52.568123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"27'5594","reported_seq":5616,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.404958+0000","last_change":"2024-03-23T23:42:50.759749+0000","last_active":"2024-03-23T23:58:30.404958+0000","last_peered":"2024-03-23T23:58:30.404958+0000","last_clean":"2024-03-23T23:58:30.404958+0000","last_became_active":"2024-03-23T23:42:50.758670+0000","last_became_peered":"2024-03-23T23:42:50.758670+0000","last_unstale":"2024-03-23T23:58:30.404958+0000","last_undegraded":"2024-03-23T23:58:30.404958+0000","last_fullsized":"2024-03-23T23:58:30.404958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5594,"log_dups_size":0,"ondisk_log_size":5594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:16:02.318732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82815,"num_write_kb":936767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"27'4454","reported_seq":4485,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:56:10.697294+0000","last_change":"2024-03-23T23:42:40.674574+0000","last_active":"2024-03-23T23:56:10.697294+0000","last_peered":"2024-03-23T23:56:10.697294+0000","last_clean":"2024-03-23T23:56:10.697294+0000","last_became_active":"2024-03-23T23:42:40.674293+0000","last_became_peered":"2024-03-23T23:42:40.674293+0000","last_unstale":"2024-03-23T23:56:10.697294+0000","last_undegraded":"2024-03-23T23:56:10.697294+0000","last_fullsized":"2024-03-23T23:56:10.697294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4454,"log_dups_size":0,"ondisk_log_size":4454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:37:24.839568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66336,"num_write_kb":780596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'216","reported_seq":249,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.480173+0000","last_change":"2024-03-23T23:42:39.683165+0000","last_active":"2024-03-23T23:58:27.480173+0000","last_peered":"2024-03-23T23:58:27.480173+0000","last_clean":"2024-03-23T23:58:27.480173+0000","last_became_active":"2024-03-23T23:42:39.680121+0000","last_became_peered":"2024-03-23T23:42:39.680121+0000","last_unstale":"2024-03-23T23:58:27.480173+0000","last_undegraded":"2024-03-23T23:58:27.480173+0000","last_fullsized":"2024-03-23T23:58:27.480173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:02.190910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1241175,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":1371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'5","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.428505+0000","last_change":"2024-03-23T23:42:49.745016+0000","last_active":"2024-03-23T23:57:53.428505+0000","last_peered":"2024-03-23T23:57:53.428505+0000","last_clean":"2024-03-23T23:57:53.428505+0000","last_became_active":"2024-03-23T23:42:49.744742+0000","last_became_peered":"2024-03-23T23:42:49.744742+0000","last_unstale":"2024-03-23T23:57:53.428505+0000","last_undegraded":"2024-03-23T23:57:53.428505+0000","last_fullsized":"2024-03-23T23:57:53.428505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:30.033743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"27'4308","reported_seq":4330,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.615870+0000","last_change":"2024-03-23T23:42:50.749792+0000","last_active":"2024-03-23T23:57:57.615870+0000","last_peered":"2024-03-23T23:57:57.615870+0000","last_clean":"2024-03-23T23:57:57.615870+0000","last_became_active":"2024-03-23T23:42:50.749491+0000","last_became_peered":"2024-03-23T23:42:50.749491+0000","last_unstale":"2024-03-23T23:57:57.615870+0000","last_undegraded":"2024-03-23T23:57:57.615870+0000","last_fullsized":"2024-03-23T23:57:57.615870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4308,"log_dups_size":0,"ondisk_log_size":4308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:25:44.894505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64025,"num_write_kb":713675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'4679","reported_seq":4710,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:45.299407+0000","last_change":"2024-03-23T23:42:40.682999+0000","last_active":"2024-03-23T23:55:45.299407+0000","last_peered":"2024-03-23T23:55:45.299407+0000","last_clean":"2024-03-23T23:55:45.299407+0000","last_became_active":"2024-03-23T23:42:40.682672+0000","last_became_peered":"2024-03-23T23:42:40.682672+0000","last_unstale":"2024-03-23T23:55:45.299407+0000","last_undegraded":"2024-03-23T23:55:45.299407+0000","last_fullsized":"2024-03-23T23:55:45.299407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4679,"log_dups_size":0,"ondisk_log_size":4679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:59:45.154553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69709,"num_write_kb":858998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'2","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:47.349873+0000","last_change":"2024-03-23T23:42:39.691470+0000","last_active":"2024-03-23T23:55:47.349873+0000","last_peered":"2024-03-23T23:55:47.349873+0000","last_clean":"2024-03-23T23:55:47.349873+0000","last_became_active":"2024-03-23T23:42:39.691124+0000","last_became_peered":"2024-03-23T23:42:39.691124+0000","last_unstale":"2024-03-23T23:55:47.349873+0000","last_undegraded":"2024-03-23T23:55:47.349873+0000","last_fullsized":"2024-03-23T23:55:47.349873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:55.757707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'23","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.418054+0000","last_change":"2024-03-23T23:42:49.750016+0000","last_active":"2024-03-23T23:57:53.418054+0000","last_peered":"2024-03-23T23:57:53.418054+0000","last_clean":"2024-03-23T23:57:53.418054+0000","last_became_active":"2024-03-23T23:42:49.749279+0000","last_became_peered":"2024-03-23T23:42:49.749279+0000","last_unstale":"2024-03-23T23:57:53.418054+0000","last_undegraded":"2024-03-23T23:57:53.418054+0000","last_fullsized":"2024-03-23T23:57:53.418054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:41:14.671834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"27'6849","reported_seq":6871,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.375906+0000","last_change":"2024-03-23T23:42:50.753669+0000","last_active":"2024-03-23T23:57:53.375906+0000","last_peered":"2024-03-23T23:57:53.375906+0000","last_clean":"2024-03-23T23:57:53.375906+0000","last_became_active":"2024-03-23T23:42:50.752674+0000","last_became_peered":"2024-03-23T23:42:50.752674+0000","last_unstale":"2024-03-23T23:57:53.375906+0000","last_undegraded":"2024-03-23T23:57:53.375906+0000","last_fullsized":"2024-03-23T23:57:53.375906+0000","mapping_epoch":23,"log_start":"27'900","ondisk_log_start":"27'900","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5949,"log_dups_size":0,"ondisk_log_size":5949,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:39:04.727316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101780,"num_write_kb":1163482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"27'4769","reported_seq":4800,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.622856+0000","last_change":"2024-03-23T23:42:40.685051+0000","last_active":"2024-03-23T23:58:27.622856+0000","last_peered":"2024-03-23T23:58:27.622856+0000","last_clean":"2024-03-23T23:58:27.622856+0000","last_became_active":"2024-03-23T23:42:40.684677+0000","last_became_peered":"2024-03-23T23:42:40.684677+0000","last_unstale":"2024-03-23T23:58:27.622856+0000","last_undegraded":"2024-03-23T23:58:27.622856+0000","last_fullsized":"2024-03-23T23:58:27.622856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4769,"log_dups_size":0,"ondisk_log_size":4769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:20.920978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71276,"num_write_kb":829070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'20","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:44.378481+0000","last_change":"2024-03-23T23:42:39.695253+0000","last_active":"2024-03-23T23:55:44.378481+0000","last_peered":"2024-03-23T23:55:44.378481+0000","last_clean":"2024-03-23T23:55:44.378481+0000","last_became_active":"2024-03-23T23:42:39.694746+0000","last_became_peered":"2024-03-23T23:42:39.694746+0000","last_unstale":"2024-03-23T23:55:44.378481+0000","last_undegraded":"2024-03-23T23:55:44.378481+0000","last_fullsized":"2024-03-23T23:55:44.378481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:57.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'20","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.414354+0000","last_change":"2024-03-23T23:42:49.724285+0000","last_active":"2024-03-23T23:57:53.414354+0000","last_peered":"2024-03-23T23:57:53.414354+0000","last_clean":"2024-03-23T23:57:53.414354+0000","last_became_active":"2024-03-23T23:42:49.724009+0000","last_became_peered":"2024-03-23T23:42:49.724009+0000","last_unstale":"2024-03-23T23:57:53.414354+0000","last_undegraded":"2024-03-23T23:57:53.414354+0000","last_fullsized":"2024-03-23T23:57:53.414354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:01:04.035970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"27'4299","reported_seq":4322,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.609217+0000","last_change":"2024-03-23T23:42:50.746737+0000","last_active":"2024-03-23T23:57:57.609217+0000","last_peered":"2024-03-23T23:57:57.609217+0000","last_clean":"2024-03-23T23:57:57.609217+0000","last_became_active":"2024-03-23T23:42:50.746492+0000","last_became_peered":"2024-03-23T23:42:50.746492+0000","last_unstale":"2024-03-23T23:57:57.609217+0000","last_undegraded":"2024-03-23T23:57:57.609217+0000","last_fullsized":"2024-03-23T23:57:57.609217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4299,"log_dups_size":0,"ondisk_log_size":4299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:50.597847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63604,"num_write_kb":723087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"27'5742","reported_seq":5773,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.651182+0000","last_change":"2024-03-23T23:42:40.680963+0000","last_active":"2024-03-23T23:58:27.651182+0000","last_peered":"2024-03-23T23:58:27.651182+0000","last_clean":"2024-03-23T23:58:27.651182+0000","last_became_active":"2024-03-23T23:42:40.680744+0000","last_became_peered":"2024-03-23T23:42:40.680744+0000","last_unstale":"2024-03-23T23:58:27.651182+0000","last_undegraded":"2024-03-23T23:58:27.651182+0000","last_fullsized":"2024-03-23T23:58:27.651182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5742,"log_dups_size":0,"ondisk_log_size":5742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:17:19.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85158,"num_write_kb":1014619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'8","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:33.079685+0000","last_change":"2024-03-23T23:42:39.691813+0000","last_active":"2024-03-23T23:55:33.079685+0000","last_peered":"2024-03-23T23:55:33.079685+0000","last_clean":"2024-03-23T23:55:33.079685+0000","last_became_active":"2024-03-23T23:42:39.691519+0000","last_became_peered":"2024-03-23T23:42:39.691519+0000","last_unstale":"2024-03-23T23:55:33.079685+0000","last_undegraded":"2024-03-23T23:55:33.079685+0000","last_fullsized":"2024-03-23T23:55:33.079685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:27:41.386662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'34","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.597772+0000","last_change":"2024-03-23T23:42:49.734197+0000","last_active":"2024-03-23T23:57:57.597772+0000","last_peered":"2024-03-23T23:57:57.597772+0000","last_clean":"2024-03-23T23:57:57.597772+0000","last_became_active":"2024-03-23T23:42:49.733715+0000","last_became_peered":"2024-03-23T23:42:49.733715+0000","last_unstale":"2024-03-23T23:57:57.597772+0000","last_undegraded":"2024-03-23T23:57:57.597772+0000","last_fullsized":"2024-03-23T23:57:57.597772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:36.728428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84646,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":105,"num_write":31,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"27'4486","reported_seq":4509,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.331762+0000","last_change":"2024-03-23T23:42:50.739957+0000","last_active":"2024-03-23T23:57:53.331762+0000","last_peered":"2024-03-23T23:57:53.331762+0000","last_clean":"2024-03-23T23:57:53.331762+0000","last_became_active":"2024-03-23T23:42:50.739706+0000","last_became_peered":"2024-03-23T23:42:50.739706+0000","last_unstale":"2024-03-23T23:57:53.331762+0000","last_undegraded":"2024-03-23T23:57:53.331762+0000","last_fullsized":"2024-03-23T23:57:53.331762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4486,"log_dups_size":0,"ondisk_log_size":4486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:49:17.763463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66952,"num_write_kb":756851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'4353","reported_seq":4370,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.622699+0000","last_change":"2024-03-23T23:43:22.034415+0000","last_active":"2024-03-23T23:58:27.622699+0000","last_peered":"2024-03-23T23:58:27.622699+0000","last_clean":"2024-03-23T23:58:27.622699+0000","last_became_active":"2024-03-23T23:43:22.034125+0000","last_became_peered":"2024-03-23T23:43:22.034125+0000","last_unstale":"2024-03-23T23:58:27.622699+0000","last_undegraded":"2024-03-23T23:58:27.622699+0000","last_fullsized":"2024-03-23T23:58:27.622699+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4353,"log_dups_size":0,"ondisk_log_size":4353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:48:14.925511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64538,"num_write_kb":790050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"27'317","reported_seq":350,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:03.787850+0000","last_change":"2024-03-23T23:42:39.678962+0000","last_active":"2024-03-23T23:58:03.787850+0000","last_peered":"2024-03-23T23:58:03.787850+0000","last_clean":"2024-03-23T23:58:03.787850+0000","last_became_active":"2024-03-23T23:42:39.678603+0000","last_became_peered":"2024-03-23T23:42:39.678603+0000","last_unstale":"2024-03-23T23:58:03.787850+0000","last_undegraded":"2024-03-23T23:58:03.787850+0000","last_fullsized":"2024-03-23T23:58:03.787850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:43:46.206865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":650,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'39","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.605592+0000","last_change":"2024-03-23T23:42:49.740561+0000","last_active":"2024-03-23T23:57:57.605592+0000","last_peered":"2024-03-23T23:57:57.605592+0000","last_clean":"2024-03-23T23:57:57.605592+0000","last_became_active":"2024-03-23T23:42:49.740290+0000","last_became_peered":"2024-03-23T23:42:49.740290+0000","last_unstale":"2024-03-23T23:57:57.605592+0000","last_undegraded":"2024-03-23T23:57:57.605592+0000","last_fullsized":"2024-03-23T23:57:57.605592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:21:24.160603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"27'5042","reported_seq":5065,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.336174+0000","last_change":"2024-03-23T23:42:50.751107+0000","last_active":"2024-03-23T23:57:53.336174+0000","last_peered":"2024-03-23T23:57:53.336174+0000","last_clean":"2024-03-23T23:57:53.336174+0000","last_became_active":"2024-03-23T23:42:50.750859+0000","last_became_peered":"2024-03-23T23:42:50.750859+0000","last_unstale":"2024-03-23T23:57:53.336174+0000","last_undegraded":"2024-03-23T23:57:53.336174+0000","last_fullsized":"2024-03-23T23:57:53.336174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5042,"log_dups_size":0,"ondisk_log_size":5042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:49:17.763463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75095,"num_write_kb":843705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"27'6329","reported_seq":6360,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.644598+0000","last_change":"2024-03-23T23:42:40.686486+0000","last_active":"2024-03-23T23:58:27.644598+0000","last_peered":"2024-03-23T23:58:27.644598+0000","last_clean":"2024-03-23T23:58:27.644598+0000","last_became_active":"2024-03-23T23:42:40.686186+0000","last_became_peered":"2024-03-23T23:42:40.686186+0000","last_unstale":"2024-03-23T23:58:27.644598+0000","last_undegraded":"2024-03-23T23:58:27.644598+0000","last_fullsized":"2024-03-23T23:58:27.644598+0000","mapping_epoch":19,"log_start":"27'600","ondisk_log_start":"27'600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5729,"log_dups_size":0,"ondisk_log_size":5729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:46:30.427072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94311,"num_write_kb":1142337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'2","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:28.330121+0000","last_change":"2024-03-23T23:42:39.695099+0000","last_active":"2024-03-23T23:55:28.330121+0000","last_peered":"2024-03-23T23:55:28.330121+0000","last_clean":"2024-03-23T23:55:28.330121+0000","last_became_active":"2024-03-23T23:42:39.694720+0000","last_became_peered":"2024-03-23T23:42:39.694720+0000","last_unstale":"2024-03-23T23:55:28.330121+0000","last_undegraded":"2024-03-23T23:55:28.330121+0000","last_fullsized":"2024-03-23T23:55:28.330121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:58:07.880313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'3","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.398311+0000","last_change":"2024-03-23T23:42:49.739099+0000","last_active":"2024-03-23T23:57:53.398311+0000","last_peered":"2024-03-23T23:57:53.398311+0000","last_clean":"2024-03-23T23:57:53.398311+0000","last_became_active":"2024-03-23T23:42:49.738198+0000","last_became_peered":"2024-03-23T23:42:49.738198+0000","last_unstale":"2024-03-23T23:57:53.398311+0000","last_undegraded":"2024-03-23T23:57:53.398311+0000","last_fullsized":"2024-03-23T23:57:53.398311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:57:34.600362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"27'5389","reported_seq":5412,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.487900+0000","last_change":"2024-03-23T23:42:50.754941+0000","last_active":"2024-03-23T23:58:30.487900+0000","last_peered":"2024-03-23T23:58:30.487900+0000","last_clean":"2024-03-23T23:58:30.487900+0000","last_became_active":"2024-03-23T23:42:50.754585+0000","last_became_peered":"2024-03-23T23:42:50.754585+0000","last_unstale":"2024-03-23T23:58:30.487900+0000","last_undegraded":"2024-03-23T23:58:30.487900+0000","last_fullsized":"2024-03-23T23:58:30.487900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5389,"log_dups_size":0,"ondisk_log_size":5389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:42:23.236324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80225,"num_write_kb":941986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'4652","reported_seq":4683,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.714118+0000","last_change":"2024-03-23T23:42:40.700610+0000","last_active":"2024-03-23T23:58:27.714118+0000","last_peered":"2024-03-23T23:58:27.714118+0000","last_clean":"2024-03-23T23:58:27.714118+0000","last_became_active":"2024-03-23T23:42:40.700112+0000","last_became_peered":"2024-03-23T23:42:40.700112+0000","last_unstale":"2024-03-23T23:58:27.714118+0000","last_undegraded":"2024-03-23T23:58:27.714118+0000","last_fullsized":"2024-03-23T23:58:27.714118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4652,"log_dups_size":0,"ondisk_log_size":4652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:07:49.169416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68979,"num_write_kb":836174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'2","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:16.720561+0000","last_change":"2024-03-23T23:42:39.686509+0000","last_active":"2024-03-23T23:55:16.720561+0000","last_peered":"2024-03-23T23:55:16.720561+0000","last_clean":"2024-03-23T23:55:16.720561+0000","last_became_active":"2024-03-23T23:42:39.686094+0000","last_became_peered":"2024-03-23T23:42:39.686094+0000","last_unstale":"2024-03-23T23:55:16.720561+0000","last_undegraded":"2024-03-23T23:55:16.720561+0000","last_fullsized":"2024-03-23T23:55:16.720561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:57:20.394530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'68","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:14.252046+0000","last_change":"2024-03-23T23:42:49.738274+0000","last_active":"2024-03-23T23:57:14.252046+0000","last_peered":"2024-03-23T23:57:14.252046+0000","last_clean":"2024-03-23T23:57:14.252046+0000","last_became_active":"2024-03-23T23:42:49.737916+0000","last_became_peered":"2024-03-23T23:42:49.737916+0000","last_unstale":"2024-03-23T23:57:14.252046+0000","last_undegraded":"2024-03-23T23:57:14.252046+0000","last_fullsized":"2024-03-23T23:57:14.252046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:18:12.997092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":8223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"27'4725","reported_seq":4748,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.346920+0000","last_change":"2024-03-23T23:42:50.764148+0000","last_active":"2024-03-23T23:58:30.346920+0000","last_peered":"2024-03-23T23:58:30.346920+0000","last_clean":"2024-03-23T23:58:30.346920+0000","last_became_active":"2024-03-23T23:42:50.763768+0000","last_became_peered":"2024-03-23T23:42:50.763768+0000","last_unstale":"2024-03-23T23:58:30.346920+0000","last_undegraded":"2024-03-23T23:58:30.346920+0000","last_fullsized":"2024-03-23T23:58:30.346920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4725,"log_dups_size":0,"ondisk_log_size":4725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:52:48.699642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69706,"num_write_kb":805786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"27'5477","reported_seq":5508,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.746904+0000","last_change":"2024-03-23T23:42:40.679988+0000","last_active":"2024-03-23T23:58:27.746904+0000","last_peered":"2024-03-23T23:58:27.746904+0000","last_clean":"2024-03-23T23:58:27.746904+0000","last_became_active":"2024-03-23T23:42:40.679488+0000","last_became_peered":"2024-03-23T23:42:40.679488+0000","last_unstale":"2024-03-23T23:58:27.746904+0000","last_undegraded":"2024-03-23T23:58:27.746904+0000","last_fullsized":"2024-03-23T23:58:27.746904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5477,"log_dups_size":0,"ondisk_log_size":5477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:10:32.251287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82124,"num_write_kb":1001722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'28","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:10.724250+0000","last_change":"2024-03-23T23:42:39.679741+0000","last_active":"2024-03-23T23:55:10.724250+0000","last_peered":"2024-03-23T23:55:10.724250+0000","last_clean":"2024-03-23T23:55:10.724250+0000","last_became_active":"2024-03-23T23:42:39.678864+0000","last_became_peered":"2024-03-23T23:42:39.678864+0000","last_unstale":"2024-03-23T23:55:10.724250+0000","last_undegraded":"2024-03-23T23:55:10.724250+0000","last_fullsized":"2024-03-23T23:55:10.724250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:50.559059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":8210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.412448+0000","last_change":"2024-03-23T23:42:49.739837+0000","last_active":"2024-03-23T23:57:53.412448+0000","last_peered":"2024-03-23T23:57:53.412448+0000","last_clean":"2024-03-23T23:57:53.412448+0000","last_became_active":"2024-03-23T23:42:49.739570+0000","last_became_peered":"2024-03-23T23:42:49.739570+0000","last_unstale":"2024-03-23T23:57:53.412448+0000","last_undegraded":"2024-03-23T23:57:53.412448+0000","last_fullsized":"2024-03-23T23:57:53.412448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:57:34.600362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'5788","reported_seq":5812,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.452017+0000","last_change":"2024-03-23T23:42:50.753912+0000","last_active":"2024-03-23T23:58:30.452017+0000","last_peered":"2024-03-23T23:58:30.452017+0000","last_clean":"2024-03-23T23:58:30.452017+0000","last_became_active":"2024-03-23T23:42:50.753629+0000","last_became_peered":"2024-03-23T23:42:50.753629+0000","last_unstale":"2024-03-23T23:58:30.452017+0000","last_undegraded":"2024-03-23T23:58:30.452017+0000","last_fullsized":"2024-03-23T23:58:30.452017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5788,"log_dups_size":0,"ondisk_log_size":5788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:40:32.748113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":85415,"num_write_kb":969479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'4118","reported_seq":4149,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.626759+0000","last_change":"2024-03-23T23:42:40.682840+0000","last_active":"2024-03-23T23:58:27.626759+0000","last_peered":"2024-03-23T23:58:27.626759+0000","last_clean":"2024-03-23T23:58:27.626759+0000","last_became_active":"2024-03-23T23:42:40.682391+0000","last_became_peered":"2024-03-23T23:42:40.682391+0000","last_unstale":"2024-03-23T23:58:27.626759+0000","last_undegraded":"2024-03-23T23:58:27.626759+0000","last_fullsized":"2024-03-23T23:58:27.626759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4118,"log_dups_size":0,"ondisk_log_size":4118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:42:14.952953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61030,"num_write_kb":768099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'47","reported_seq":124,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:03.449051+0000","last_change":"2024-03-23T23:42:39.680763+0000","last_active":"2024-03-23T23:58:03.449051+0000","last_peered":"2024-03-23T23:58:03.449051+0000","last_clean":"2024-03-23T23:58:03.449051+0000","last_became_active":"2024-03-23T23:42:39.680494+0000","last_became_peered":"2024-03-23T23:42:39.680494+0000","last_unstale":"2024-03-23T23:58:03.449051+0000","last_undegraded":"2024-03-23T23:58:03.449051+0000","last_fullsized":"2024-03-23T23:58:03.449051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:57.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84561,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":115,"num_write":44,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.616866+0000","last_change":"2024-03-23T23:42:49.737456+0000","last_active":"2024-03-23T23:57:57.616866+0000","last_peered":"2024-03-23T23:57:57.616866+0000","last_clean":"2024-03-23T23:57:57.616866+0000","last_became_active":"2024-03-23T23:42:49.737196+0000","last_became_peered":"2024-03-23T23:42:49.737196+0000","last_unstale":"2024-03-23T23:57:57.616866+0000","last_undegraded":"2024-03-23T23:57:57.616866+0000","last_fullsized":"2024-03-23T23:57:57.616866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:49:42.789292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"27'4471","reported_seq":4494,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.644697+0000","last_change":"2024-03-23T23:42:50.763308+0000","last_active":"2024-03-23T23:57:57.644697+0000","last_peered":"2024-03-23T23:57:57.644697+0000","last_clean":"2024-03-23T23:57:57.644697+0000","last_became_active":"2024-03-23T23:42:50.763007+0000","last_became_peered":"2024-03-23T23:42:50.763007+0000","last_unstale":"2024-03-23T23:57:57.644697+0000","last_undegraded":"2024-03-23T23:57:57.644697+0000","last_fullsized":"2024-03-23T23:57:57.644697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4471,"log_dups_size":0,"ondisk_log_size":4471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:32:46.055472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66536,"num_write_kb":757522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"27'4410","reported_seq":4441,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.601171+0000","last_change":"2024-03-23T23:42:40.675570+0000","last_active":"2024-03-23T23:58:27.601171+0000","last_peered":"2024-03-23T23:58:27.601171+0000","last_clean":"2024-03-23T23:58:27.601171+0000","last_became_active":"2024-03-23T23:42:40.674390+0000","last_became_peered":"2024-03-23T23:42:40.674390+0000","last_unstale":"2024-03-23T23:58:27.601171+0000","last_undegraded":"2024-03-23T23:58:27.601171+0000","last_fullsized":"2024-03-23T23:58:27.601171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4410,"log_dups_size":0,"ondisk_log_size":4410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:31:34.412092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65732,"num_write_kb":804228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'44","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:56.789441+0000","last_change":"2024-03-23T23:42:39.690057+0000","last_active":"2024-03-23T23:54:56.789441+0000","last_peered":"2024-03-23T23:54:56.789441+0000","last_clean":"2024-03-23T23:54:56.789441+0000","last_became_active":"2024-03-23T23:42:39.689763+0000","last_became_peered":"2024-03-23T23:42:39.689763+0000","last_unstale":"2024-03-23T23:54:56.789441+0000","last_undegraded":"2024-03-23T23:54:56.789441+0000","last_fullsized":"2024-03-23T23:54:56.789441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:01.607584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'354","reported_seq":379,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.316884+0000","last_change":"2024-03-23T23:42:49.734213+0000","last_active":"2024-03-23T23:57:57.316884+0000","last_peered":"2024-03-23T23:57:57.316884+0000","last_clean":"2024-03-23T23:57:57.316884+0000","last_became_active":"2024-03-23T23:42:49.733115+0000","last_became_peered":"2024-03-23T23:42:49.733115+0000","last_unstale":"2024-03-23T23:57:57.316884+0000","last_undegraded":"2024-03-23T23:57:57.316884+0000","last_fullsized":"2024-03-23T23:57:57.316884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:18:12.997092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":739,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"27'6371","reported_seq":6394,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.408620+0000","last_change":"2024-03-23T23:42:50.759000+0000","last_active":"2024-03-23T23:57:53.408620+0000","last_peered":"2024-03-23T23:57:53.408620+0000","last_clean":"2024-03-23T23:57:53.408620+0000","last_became_active":"2024-03-23T23:42:50.758552+0000","last_became_peered":"2024-03-23T23:42:50.758552+0000","last_unstale":"2024-03-23T23:57:53.408620+0000","last_undegraded":"2024-03-23T23:57:53.408620+0000","last_fullsized":"2024-03-23T23:57:53.408620+0000","mapping_epoch":23,"log_start":"27'700","ondisk_log_start":"27'700","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5671,"log_dups_size":0,"ondisk_log_size":5671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:04:26.911514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94645,"num_write_kb":1081333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"27'5070","reported_seq":5101,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:09.384653+0000","last_change":"2024-03-23T23:42:40.700998+0000","last_active":"2024-03-23T23:55:09.384653+0000","last_peered":"2024-03-23T23:55:09.384653+0000","last_clean":"2024-03-23T23:55:09.384653+0000","last_became_active":"2024-03-23T23:42:40.700788+0000","last_became_peered":"2024-03-23T23:42:40.700788+0000","last_unstale":"2024-03-23T23:55:09.384653+0000","last_undegraded":"2024-03-23T23:55:09.384653+0000","last_fullsized":"2024-03-23T23:55:09.384653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5070,"log_dups_size":0,"ondisk_log_size":5070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:14:44.739525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75375,"num_write_kb":887789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'3","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:16.319491+0000","last_change":"2024-03-23T23:42:39.687712+0000","last_active":"2024-03-23T23:55:16.319491+0000","last_peered":"2024-03-23T23:55:16.319491+0000","last_clean":"2024-03-23T23:55:16.319491+0000","last_became_active":"2024-03-23T23:42:39.687378+0000","last_became_peered":"2024-03-23T23:42:39.687378+0000","last_unstale":"2024-03-23T23:55:16.319491+0000","last_undegraded":"2024-03-23T23:55:16.319491+0000","last_fullsized":"2024-03-23T23:55:16.319491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:20:38.456655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":189,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:45.391600+0000","last_change":"2024-03-23T23:42:27.940270+0000","last_active":"2024-03-23T23:54:45.391600+0000","last_peered":"2024-03-23T23:54:45.391600+0000","last_clean":"2024-03-23T23:54:45.391600+0000","last_became_active":"2024-03-23T23:42:27.939061+0000","last_became_peered":"2024-03-23T23:42:27.939061+0000","last_unstale":"2024-03-23T23:54:45.391600+0000","last_undegraded":"2024-03-23T23:54:45.391600+0000","last_fullsized":"2024-03-23T23:54:45.391600+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:26.509742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:26.509742+0000","last_clean_scrub_stamp":"2024-03-23T23:42:26.509742+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:49.258623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'3","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:46.805802+0000","last_change":"2024-03-23T23:42:49.729231+0000","last_active":"2024-03-23T23:57:46.805802+0000","last_peered":"2024-03-23T23:57:46.805802+0000","last_clean":"2024-03-23T23:57:46.805802+0000","last_became_active":"2024-03-23T23:42:49.728990+0000","last_became_peered":"2024-03-23T23:42:49.728990+0000","last_unstale":"2024-03-23T23:57:46.805802+0000","last_undegraded":"2024-03-23T23:57:46.805802+0000","last_fullsized":"2024-03-23T23:57:46.805802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:01:04.035970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"27'4440","reported_seq":4463,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.456673+0000","last_change":"2024-03-23T23:42:50.757668+0000","last_active":"2024-03-23T23:58:30.456673+0000","last_peered":"2024-03-23T23:58:30.456673+0000","last_clean":"2024-03-23T23:58:30.456673+0000","last_became_active":"2024-03-23T23:42:50.756900+0000","last_became_peered":"2024-03-23T23:42:50.756900+0000","last_unstale":"2024-03-23T23:58:30.456673+0000","last_undegraded":"2024-03-23T23:58:30.456673+0000","last_fullsized":"2024-03-23T23:58:30.456673+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4440,"log_dups_size":0,"ondisk_log_size":4440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:24:53.959288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65770,"num_write_kb":738740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'5479","reported_seq":5510,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:56:12.049278+0000","last_change":"2024-03-23T23:42:40.711591+0000","last_active":"2024-03-23T23:56:12.049278+0000","last_peered":"2024-03-23T23:56:12.049278+0000","last_clean":"2024-03-23T23:56:12.049278+0000","last_became_active":"2024-03-23T23:42:40.711306+0000","last_became_peered":"2024-03-23T23:42:40.711306+0000","last_unstale":"2024-03-23T23:56:12.049278+0000","last_undegraded":"2024-03-23T23:56:12.049278+0000","last_fullsized":"2024-03-23T23:56:12.049278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5479,"log_dups_size":0,"ondisk_log_size":5479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:34:16.693372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81537,"num_write_kb":972707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'5","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:56:12.626312+0000","last_change":"2024-03-23T23:42:39.684163+0000","last_active":"2024-03-23T23:56:12.626312+0000","last_peered":"2024-03-23T23:56:12.626312+0000","last_clean":"2024-03-23T23:56:12.626312+0000","last_became_active":"2024-03-23T23:42:39.683211+0000","last_became_peered":"2024-03-23T23:42:39.683211+0000","last_unstale":"2024-03-23T23:56:12.626312+0000","last_undegraded":"2024-03-23T23:56:12.626312+0000","last_fullsized":"2024-03-23T23:56:12.626312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:47:27.092873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'123","reported_seq":148,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.630825+0000","last_change":"2024-03-23T23:42:49.735824+0000","last_active":"2024-03-23T23:57:57.630825+0000","last_peered":"2024-03-23T23:57:57.630825+0000","last_clean":"2024-03-23T23:57:57.630825+0000","last_became_active":"2024-03-23T23:42:49.735473+0000","last_became_peered":"2024-03-23T23:42:49.735473+0000","last_unstale":"2024-03-23T23:57:57.630825+0000","last_undegraded":"2024-03-23T23:57:57.630825+0000","last_fullsized":"2024-03-23T23:57:57.630825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:44:12.438729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":4181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"27'5305","reported_seq":5328,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.377773+0000","last_change":"2024-03-23T23:42:50.745563+0000","last_active":"2024-03-23T23:58:30.377773+0000","last_peered":"2024-03-23T23:58:30.377773+0000","last_clean":"2024-03-23T23:58:30.377773+0000","last_became_active":"2024-03-23T23:42:50.745256+0000","last_became_peered":"2024-03-23T23:42:50.745256+0000","last_unstale":"2024-03-23T23:58:30.377773+0000","last_undegraded":"2024-03-23T23:58:30.377773+0000","last_fullsized":"2024-03-23T23:58:30.377773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5305,"log_dups_size":0,"ondisk_log_size":5305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:34:26.750531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78242,"num_write_kb":887262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'5423","reported_seq":5455,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.664901+0000","last_change":"2024-03-23T23:42:40.700124+0000","last_active":"2024-03-23T23:58:27.664901+0000","last_peered":"2024-03-23T23:58:27.664901+0000","last_clean":"2024-03-23T23:58:27.664901+0000","last_became_active":"2024-03-23T23:42:40.697369+0000","last_became_peered":"2024-03-23T23:42:40.697369+0000","last_unstale":"2024-03-23T23:58:27.664901+0000","last_undegraded":"2024-03-23T23:58:27.664901+0000","last_fullsized":"2024-03-23T23:58:27.664901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5423,"log_dups_size":0,"ondisk_log_size":5423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:20.981139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":11,"num_write":80814,"num_write_kb":947944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'24","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:56:17.671836+0000","last_change":"2024-03-23T23:42:39.681013+0000","last_active":"2024-03-23T23:56:17.671836+0000","last_peered":"2024-03-23T23:56:17.671836+0000","last_clean":"2024-03-23T23:56:17.671836+0000","last_became_active":"2024-03-23T23:42:39.680669+0000","last_became_peered":"2024-03-23T23:42:39.680669+0000","last_unstale":"2024-03-23T23:56:17.671836+0000","last_undegraded":"2024-03-23T23:56:17.671836+0000","last_fullsized":"2024-03-23T23:56:17.671836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:58:07.880313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'391","reported_seq":416,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.611265+0000","last_change":"2024-03-23T23:42:49.736747+0000","last_active":"2024-03-23T23:57:57.611265+0000","last_peered":"2024-03-23T23:57:57.611265+0000","last_clean":"2024-03-23T23:57:57.611265+0000","last_became_active":"2024-03-23T23:42:49.734508+0000","last_became_peered":"2024-03-23T23:42:49.734508+0000","last_unstale":"2024-03-23T23:57:57.611265+0000","last_undegraded":"2024-03-23T23:57:57.611265+0000","last_fullsized":"2024-03-23T23:57:57.611265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:54.356082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":4222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"27'4745","reported_seq":4768,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.077169+0000","last_change":"2024-03-23T23:42:50.751141+0000","last_active":"2024-03-23T23:57:53.077169+0000","last_peered":"2024-03-23T23:57:53.077169+0000","last_clean":"2024-03-23T23:57:53.077169+0000","last_became_active":"2024-03-23T23:42:50.750269+0000","last_became_peered":"2024-03-23T23:42:50.750269+0000","last_unstale":"2024-03-23T23:57:53.077169+0000","last_undegraded":"2024-03-23T23:57:53.077169+0000","last_fullsized":"2024-03-23T23:57:53.077169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4745,"log_dups_size":0,"ondisk_log_size":4745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:46:10.784416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70383,"num_write_kb":794086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"27'6871","reported_seq":6901,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:37.279880+0000","last_change":"2024-03-23T23:42:40.706713+0000","last_active":"2024-03-23T23:54:37.279880+0000","last_peered":"2024-03-23T23:54:37.279880+0000","last_clean":"2024-03-23T23:54:37.279880+0000","last_became_active":"2024-03-23T23:42:40.704328+0000","last_became_peered":"2024-03-23T23:42:40.704328+0000","last_unstale":"2024-03-23T23:54:37.279880+0000","last_undegraded":"2024-03-23T23:54:37.279880+0000","last_fullsized":"2024-03-23T23:54:37.279880+0000","mapping_epoch":19,"log_start":"27'1200","ondisk_log_start":"27'1200","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5671,"log_dups_size":0,"ondisk_log_size":5671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:15:52.261572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102549,"num_write_kb":1203650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'21","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:36.237288+0000","last_change":"2024-03-23T23:42:39.681906+0000","last_active":"2024-03-23T23:54:36.237288+0000","last_peered":"2024-03-23T23:54:36.237288+0000","last_clean":"2024-03-23T23:54:36.237288+0000","last_became_active":"2024-03-23T23:42:39.680506+0000","last_became_peered":"2024-03-23T23:42:39.680506+0000","last_unstale":"2024-03-23T23:54:36.237288+0000","last_undegraded":"2024-03-23T23:54:36.237288+0000","last_fullsized":"2024-03-23T23:54:36.237288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:44:07.213123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'28","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.608886+0000","last_change":"2024-03-23T23:42:49.737735+0000","last_active":"2024-03-23T23:57:57.608886+0000","last_peered":"2024-03-23T23:57:57.608886+0000","last_clean":"2024-03-23T23:57:57.608886+0000","last_became_active":"2024-03-23T23:42:49.737434+0000","last_became_peered":"2024-03-23T23:42:49.737434+0000","last_unstale":"2024-03-23T23:57:57.608886+0000","last_undegraded":"2024-03-23T23:57:57.608886+0000","last_fullsized":"2024-03-23T23:57:57.608886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:58:10.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"27'4785","reported_seq":4808,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.430329+0000","last_change":"2024-03-23T23:42:50.746922+0000","last_active":"2024-03-23T23:58:30.430329+0000","last_peered":"2024-03-23T23:58:30.430329+0000","last_clean":"2024-03-23T23:58:30.430329+0000","last_became_active":"2024-03-23T23:42:50.746105+0000","last_became_peered":"2024-03-23T23:42:50.746105+0000","last_unstale":"2024-03-23T23:58:30.430329+0000","last_undegraded":"2024-03-23T23:58:30.430329+0000","last_fullsized":"2024-03-23T23:58:30.430329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4785,"log_dups_size":0,"ondisk_log_size":4785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:46:40.484231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70705,"num_write_kb":815494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"27'4261","reported_seq":4292,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:56:12.049336+0000","last_change":"2024-03-23T23:42:40.696584+0000","last_active":"2024-03-23T23:56:12.049336+0000","last_peered":"2024-03-23T23:56:12.049336+0000","last_clean":"2024-03-23T23:56:12.049336+0000","last_became_active":"2024-03-23T23:42:40.696141+0000","last_became_peered":"2024-03-23T23:42:40.696141+0000","last_unstale":"2024-03-23T23:56:12.049336+0000","last_undegraded":"2024-03-23T23:56:12.049336+0000","last_fullsized":"2024-03-23T23:56:12.049336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4261,"log_dups_size":0,"ondisk_log_size":4261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:45.303477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63684,"num_write_kb":761063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'239","reported_seq":271,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:40.459673+0000","last_change":"2024-03-23T23:42:39.686863+0000","last_active":"2024-03-23T23:54:40.459673+0000","last_peered":"2024-03-23T23:54:40.459673+0000","last_clean":"2024-03-23T23:54:40.459673+0000","last_became_active":"2024-03-23T23:42:39.686491+0000","last_became_peered":"2024-03-23T23:42:39.686491+0000","last_unstale":"2024-03-23T23:54:40.459673+0000","last_undegraded":"2024-03-23T23:54:40.459673+0000","last_fullsized":"2024-03-23T23:54:40.459673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:38:13.752628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.422658+0000","last_change":"2024-03-23T23:42:49.733982+0000","last_active":"2024-03-23T23:57:53.422658+0000","last_peered":"2024-03-23T23:57:53.422658+0000","last_clean":"2024-03-23T23:57:53.422658+0000","last_became_active":"2024-03-23T23:42:49.733389+0000","last_became_peered":"2024-03-23T23:42:49.733389+0000","last_unstale":"2024-03-23T23:57:53.422658+0000","last_undegraded":"2024-03-23T23:57:53.422658+0000","last_fullsized":"2024-03-23T23:57:53.422658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:13.685893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"27'5244","reported_seq":5266,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.379934+0000","last_change":"2024-03-23T23:42:50.764083+0000","last_active":"2024-03-23T23:57:53.379934+0000","last_peered":"2024-03-23T23:57:53.379934+0000","last_clean":"2024-03-23T23:57:53.379934+0000","last_became_active":"2024-03-23T23:42:50.763871+0000","last_became_peered":"2024-03-23T23:42:50.763871+0000","last_unstale":"2024-03-23T23:57:53.379934+0000","last_undegraded":"2024-03-23T23:57:53.379934+0000","last_fullsized":"2024-03-23T23:57:53.379934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5244,"log_dups_size":0,"ondisk_log_size":5244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:32:46.055472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77731,"num_write_kb":860727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"27'4086","reported_seq":4116,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:40.473448+0000","last_change":"2024-03-23T23:42:40.700961+0000","last_active":"2024-03-23T23:54:40.473448+0000","last_peered":"2024-03-23T23:54:40.473448+0000","last_clean":"2024-03-23T23:54:40.473448+0000","last_became_active":"2024-03-23T23:42:40.700800+0000","last_became_peered":"2024-03-23T23:42:40.700800+0000","last_unstale":"2024-03-23T23:54:40.473448+0000","last_undegraded":"2024-03-23T23:54:40.473448+0000","last_fullsized":"2024-03-23T23:54:40.473448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4086,"log_dups_size":0,"ondisk_log_size":4086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:54:27.641281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60579,"num_write_kb":760058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'15","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:56:27.877534+0000","last_change":"2024-03-23T23:42:39.676075+0000","last_active":"2024-03-23T23:56:27.877534+0000","last_peered":"2024-03-23T23:56:27.877534+0000","last_clean":"2024-03-23T23:56:27.877534+0000","last_became_active":"2024-03-23T23:42:39.675770+0000","last_became_peered":"2024-03-23T23:42:39.675770+0000","last_unstale":"2024-03-23T23:56:27.877534+0000","last_undegraded":"2024-03-23T23:56:27.877534+0000","last_fullsized":"2024-03-23T23:56:27.877534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:24:11.933075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'4","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.425856+0000","last_change":"2024-03-23T23:42:49.739529+0000","last_active":"2024-03-23T23:57:53.425856+0000","last_peered":"2024-03-23T23:57:53.425856+0000","last_clean":"2024-03-23T23:57:53.425856+0000","last_became_active":"2024-03-23T23:42:49.738053+0000","last_became_peered":"2024-03-23T23:42:49.738053+0000","last_unstale":"2024-03-23T23:57:53.425856+0000","last_undegraded":"2024-03-23T23:57:53.425856+0000","last_fullsized":"2024-03-23T23:57:53.425856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:52:57.561036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"27'5766","reported_seq":5788,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.641792+0000","last_change":"2024-03-23T23:42:50.771347+0000","last_active":"2024-03-23T23:57:57.641792+0000","last_peered":"2024-03-23T23:57:57.641792+0000","last_clean":"2024-03-23T23:57:57.641792+0000","last_became_active":"2024-03-23T23:42:50.770998+0000","last_became_peered":"2024-03-23T23:42:50.770998+0000","last_unstale":"2024-03-23T23:57:57.641792+0000","last_undegraded":"2024-03-23T23:57:57.641792+0000","last_fullsized":"2024-03-23T23:57:57.641792+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5766,"log_dups_size":0,"ondisk_log_size":5766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:57:04.394872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85663,"num_write_kb":962089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'4463","reported_seq":4493,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.663853+0000","last_change":"2024-03-23T23:42:40.677314+0000","last_active":"2024-03-23T23:58:27.663853+0000","last_peered":"2024-03-23T23:58:27.663853+0000","last_clean":"2024-03-23T23:58:27.663853+0000","last_became_active":"2024-03-23T23:42:40.675416+0000","last_became_peered":"2024-03-23T23:42:40.675416+0000","last_unstale":"2024-03-23T23:58:27.663853+0000","last_undegraded":"2024-03-23T23:58:27.663853+0000","last_fullsized":"2024-03-23T23:58:27.663853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4463,"log_dups_size":0,"ondisk_log_size":4463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:01:06.338641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66376,"num_write_kb":804237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'5","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:40.155565+0000","last_change":"2024-03-23T23:42:39.681827+0000","last_active":"2024-03-23T23:54:40.155565+0000","last_peered":"2024-03-23T23:54:40.155565+0000","last_clean":"2024-03-23T23:54:40.155565+0000","last_became_active":"2024-03-23T23:42:39.681418+0000","last_became_peered":"2024-03-23T23:42:39.681418+0000","last_unstale":"2024-03-23T23:54:40.155565+0000","last_undegraded":"2024-03-23T23:54:40.155565+0000","last_fullsized":"2024-03-23T23:54:40.155565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:50.559059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.389366+0000","last_change":"2024-03-23T23:42:49.744708+0000","last_active":"2024-03-23T23:57:53.389366+0000","last_peered":"2024-03-23T23:57:53.389366+0000","last_clean":"2024-03-23T23:57:53.389366+0000","last_became_active":"2024-03-23T23:42:49.744422+0000","last_became_peered":"2024-03-23T23:42:49.744422+0000","last_unstale":"2024-03-23T23:57:53.389366+0000","last_undegraded":"2024-03-23T23:57:53.389366+0000","last_fullsized":"2024-03-23T23:57:53.389366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:25:43.889950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"27'4213","reported_seq":4235,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.282231+0000","last_change":"2024-03-23T23:42:50.753064+0000","last_active":"2024-03-23T23:57:53.282231+0000","last_peered":"2024-03-23T23:57:53.282231+0000","last_clean":"2024-03-23T23:57:53.282231+0000","last_became_active":"2024-03-23T23:42:50.752783+0000","last_became_peered":"2024-03-23T23:42:50.752783+0000","last_unstale":"2024-03-23T23:57:53.282231+0000","last_undegraded":"2024-03-23T23:57:53.282231+0000","last_fullsized":"2024-03-23T23:57:53.282231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4213,"log_dups_size":0,"ondisk_log_size":4213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:39:49.888359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62346,"num_write_kb":725472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'5165","reported_seq":5195,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:36.864823+0000","last_change":"2024-03-23T23:42:40.704046+0000","last_active":"2024-03-23T23:54:36.864823+0000","last_peered":"2024-03-23T23:54:36.864823+0000","last_clean":"2024-03-23T23:54:36.864823+0000","last_became_active":"2024-03-23T23:42:40.703787+0000","last_became_peered":"2024-03-23T23:42:40.703787+0000","last_unstale":"2024-03-23T23:54:36.864823+0000","last_undegraded":"2024-03-23T23:54:36.864823+0000","last_fullsized":"2024-03-23T23:54:36.864823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5165,"log_dups_size":0,"ondisk_log_size":5165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:16:16.737284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76955,"num_write_kb":929765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'3","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:39.321849+0000","last_change":"2024-03-23T23:42:39.688483+0000","last_active":"2024-03-23T23:54:39.321849+0000","last_peered":"2024-03-23T23:54:39.321849+0000","last_clean":"2024-03-23T23:54:39.321849+0000","last_became_active":"2024-03-23T23:42:39.688141+0000","last_became_peered":"2024-03-23T23:42:39.688141+0000","last_unstale":"2024-03-23T23:54:39.321849+0000","last_undegraded":"2024-03-23T23:54:39.321849+0000","last_fullsized":"2024-03-23T23:54:39.321849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:32.254099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'1143","reported_seq":1167,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:41.085476+0000","last_change":"2024-03-23T23:42:49.749027+0000","last_active":"2024-03-23T23:57:41.085476+0000","last_peered":"2024-03-23T23:57:41.085476+0000","last_clean":"2024-03-23T23:57:41.085476+0000","last_became_active":"2024-03-23T23:42:49.748687+0000","last_became_peered":"2024-03-23T23:42:49.748687+0000","last_unstale":"2024-03-23T23:57:41.085476+0000","last_undegraded":"2024-03-23T23:57:41.085476+0000","last_fullsized":"2024-03-23T23:57:41.085476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1143,"log_dups_size":0,"ondisk_log_size":1143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:27.818117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1141,"num_write_kb":4625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"27'6475","reported_seq":6497,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.605446+0000","last_change":"2024-03-23T23:42:50.752273+0000","last_active":"2024-03-23T23:57:57.605446+0000","last_peered":"2024-03-23T23:57:57.605446+0000","last_clean":"2024-03-23T23:57:57.605446+0000","last_became_active":"2024-03-23T23:42:50.751874+0000","last_became_peered":"2024-03-23T23:42:50.751874+0000","last_unstale":"2024-03-23T23:57:57.605446+0000","last_undegraded":"2024-03-23T23:57:57.605446+0000","last_fullsized":"2024-03-23T23:57:57.605446+0000","mapping_epoch":23,"log_start":"27'1200","ondisk_log_start":"27'1200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5275,"log_dups_size":0,"ondisk_log_size":5275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:20:53.750917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96407,"num_write_kb":1089798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'4560","reported_seq":4590,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.616020+0000","last_change":"2024-03-23T23:42:40.688909+0000","last_active":"2024-03-23T23:58:27.616020+0000","last_peered":"2024-03-23T23:58:27.616020+0000","last_clean":"2024-03-23T23:58:27.616020+0000","last_became_active":"2024-03-23T23:42:40.688636+0000","last_became_peered":"2024-03-23T23:42:40.688636+0000","last_unstale":"2024-03-23T23:58:27.616020+0000","last_undegraded":"2024-03-23T23:58:27.616020+0000","last_fullsized":"2024-03-23T23:58:27.616020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4560,"log_dups_size":0,"ondisk_log_size":4560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:26:16.171920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68087,"num_write_kb":816248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'60","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:36.937202+0000","last_change":"2024-03-23T23:42:39.681926+0000","last_active":"2024-03-23T23:54:36.937202+0000","last_peered":"2024-03-23T23:54:36.937202+0000","last_clean":"2024-03-23T23:54:36.937202+0000","last_became_active":"2024-03-23T23:42:39.681028+0000","last_became_peered":"2024-03-23T23:42:39.681028+0000","last_unstale":"2024-03-23T23:54:36.937202+0000","last_undegraded":"2024-03-23T23:54:36.937202+0000","last_fullsized":"2024-03-23T23:54:36.937202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:24:11.933075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":8222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'22","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.622922+0000","last_change":"2024-03-23T23:42:49.741915+0000","last_active":"2024-03-23T23:57:57.622922+0000","last_peered":"2024-03-23T23:57:57.622922+0000","last_clean":"2024-03-23T23:57:57.622922+0000","last_became_active":"2024-03-23T23:42:49.741650+0000","last_became_peered":"2024-03-23T23:42:49.741650+0000","last_unstale":"2024-03-23T23:57:57.622922+0000","last_undegraded":"2024-03-23T23:57:57.622922+0000","last_fullsized":"2024-03-23T23:57:57.622922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:11:43.106922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"27'5248","reported_seq":5270,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.606881+0000","last_change":"2024-03-23T23:42:50.752979+0000","last_active":"2024-03-23T23:57:57.606881+0000","last_peered":"2024-03-23T23:57:57.606881+0000","last_clean":"2024-03-23T23:57:57.606881+0000","last_became_active":"2024-03-23T23:42:50.751848+0000","last_became_peered":"2024-03-23T23:42:50.751848+0000","last_unstale":"2024-03-23T23:57:57.606881+0000","last_undegraded":"2024-03-23T23:57:57.606881+0000","last_fullsized":"2024-03-23T23:57:57.606881+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5248,"log_dups_size":0,"ondisk_log_size":5248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:39:04.727316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77613,"num_write_kb":898929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'4158","reported_seq":4188,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:40.074107+0000","last_change":"2024-03-23T23:42:40.689988+0000","last_active":"2024-03-23T23:54:40.074107+0000","last_peered":"2024-03-23T23:54:40.074107+0000","last_clean":"2024-03-23T23:54:40.074107+0000","last_became_active":"2024-03-23T23:42:40.689477+0000","last_became_peered":"2024-03-23T23:42:40.689477+0000","last_unstale":"2024-03-23T23:54:40.074107+0000","last_undegraded":"2024-03-23T23:54:40.074107+0000","last_fullsized":"2024-03-23T23:54:40.074107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4158,"log_dups_size":0,"ondisk_log_size":4158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:46:30.427072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61832,"num_write_kb":761424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'1204","reported_seq":1236,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:58.775515+0000","last_change":"2024-03-23T23:42:39.689429+0000","last_active":"2024-03-23T23:57:58.775515+0000","last_peered":"2024-03-23T23:57:58.775515+0000","last_clean":"2024-03-23T23:57:58.775515+0000","last_became_active":"2024-03-23T23:42:39.688066+0000","last_became_peered":"2024-03-23T23:42:39.688066+0000","last_unstale":"2024-03-23T23:57:58.775515+0000","last_undegraded":"2024-03-23T23:57:58.775515+0000","last_fullsized":"2024-03-23T23:57:58.775515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1204,"log_dups_size":0,"ondisk_log_size":1204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:32.254099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1202,"num_write_kb":4648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.627061+0000","last_change":"2024-03-23T23:42:49.733543+0000","last_active":"2024-03-23T23:57:57.627061+0000","last_peered":"2024-03-23T23:57:57.627061+0000","last_clean":"2024-03-23T23:57:57.627061+0000","last_became_active":"2024-03-23T23:42:49.733197+0000","last_became_peered":"2024-03-23T23:42:49.733197+0000","last_unstale":"2024-03-23T23:57:57.627061+0000","last_undegraded":"2024-03-23T23:57:57.627061+0000","last_fullsized":"2024-03-23T23:57:57.627061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:45:20.189501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"27'4661","reported_seq":4683,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.405077+0000","last_change":"2024-03-23T23:42:50.756687+0000","last_active":"2024-03-23T23:58:30.405077+0000","last_peered":"2024-03-23T23:58:30.405077+0000","last_clean":"2024-03-23T23:58:30.405077+0000","last_became_active":"2024-03-23T23:42:50.756371+0000","last_became_peered":"2024-03-23T23:42:50.756371+0000","last_unstale":"2024-03-23T23:58:30.405077+0000","last_undegraded":"2024-03-23T23:58:30.405077+0000","last_fullsized":"2024-03-23T23:58:30.405077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4661,"log_dups_size":0,"ondisk_log_size":4661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:29:47.303374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69148,"num_write_kb":786028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'6424","reported_seq":6454,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.751614+0000","last_change":"2024-03-23T23:42:40.683025+0000","last_active":"2024-03-23T23:58:27.751614+0000","last_peered":"2024-03-23T23:58:27.751614+0000","last_clean":"2024-03-23T23:58:27.751614+0000","last_became_active":"2024-03-23T23:42:40.682798+0000","last_became_peered":"2024-03-23T23:42:40.682798+0000","last_unstale":"2024-03-23T23:58:27.751614+0000","last_undegraded":"2024-03-23T23:58:27.751614+0000","last_fullsized":"2024-03-23T23:58:27.751614+0000","mapping_epoch":19,"log_start":"27'900","ondisk_log_start":"27'900","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5524,"log_dups_size":0,"ondisk_log_size":5524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:51.565112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96000,"num_write_kb":1116606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'29","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:04.033139+0000","last_change":"2024-03-23T23:42:39.681675+0000","last_active":"2024-03-23T23:57:04.033139+0000","last_peered":"2024-03-23T23:57:04.033139+0000","last_clean":"2024-03-23T23:57:04.033139+0000","last_became_active":"2024-03-23T23:42:39.681364+0000","last_became_peered":"2024-03-23T23:42:39.681364+0000","last_unstale":"2024-03-23T23:57:04.033139+0000","last_undegraded":"2024-03-23T23:57:04.033139+0000","last_fullsized":"2024-03-23T23:57:04.033139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:42:37.702720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'47","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.606954+0000","last_change":"2024-03-23T23:42:49.723350+0000","last_active":"2024-03-23T23:57:57.606954+0000","last_peered":"2024-03-23T23:57:57.606954+0000","last_clean":"2024-03-23T23:57:57.606954+0000","last_became_active":"2024-03-23T23:42:49.723058+0000","last_became_peered":"2024-03-23T23:42:49.723058+0000","last_unstale":"2024-03-23T23:57:57.606954+0000","last_undegraded":"2024-03-23T23:57:57.606954+0000","last_fullsized":"2024-03-23T23:57:57.606954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:43:02.835034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":8215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"27'4265","reported_seq":4287,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.406354+0000","last_change":"2024-03-23T23:42:50.746422+0000","last_active":"2024-03-23T23:57:53.406354+0000","last_peered":"2024-03-23T23:57:53.406354+0000","last_clean":"2024-03-23T23:57:53.406354+0000","last_became_active":"2024-03-23T23:42:50.746104+0000","last_became_peered":"2024-03-23T23:42:50.746104+0000","last_unstale":"2024-03-23T23:57:53.406354+0000","last_undegraded":"2024-03-23T23:57:53.406354+0000","last_fullsized":"2024-03-23T23:57:53.406354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4265,"log_dups_size":0,"ondisk_log_size":4265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:40:34.077584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63135,"num_write_kb":732213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"27'5366","reported_seq":5401,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.601851+0000","last_change":"2024-03-23T23:43:22.035935+0000","last_active":"2024-03-23T23:58:27.601851+0000","last_peered":"2024-03-23T23:58:27.601851+0000","last_clean":"2024-03-23T23:58:27.601851+0000","last_became_active":"2024-03-23T23:43:22.035573+0000","last_became_peered":"2024-03-23T23:43:22.035573+0000","last_unstale":"2024-03-23T23:58:27.601851+0000","last_undegraded":"2024-03-23T23:58:27.601851+0000","last_fullsized":"2024-03-23T23:58:27.601851+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5366,"log_dups_size":0,"ondisk_log_size":5366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:11:19.211377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80141,"num_write_kb":923583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'4","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:43.402674+0000","last_change":"2024-03-23T23:42:39.691092+0000","last_active":"2024-03-23T23:54:43.402674+0000","last_peered":"2024-03-23T23:54:43.402674+0000","last_clean":"2024-03-23T23:54:43.402674+0000","last_became_active":"2024-03-23T23:42:39.687473+0000","last_became_peered":"2024-03-23T23:42:39.687473+0000","last_unstale":"2024-03-23T23:54:43.402674+0000","last_undegraded":"2024-03-23T23:54:43.402674+0000","last_fullsized":"2024-03-23T23:54:43.402674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:08:03.578884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'15","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.419543+0000","last_change":"2024-03-23T23:42:49.748693+0000","last_active":"2024-03-23T23:57:53.419543+0000","last_peered":"2024-03-23T23:57:53.419543+0000","last_clean":"2024-03-23T23:57:53.419543+0000","last_became_active":"2024-03-23T23:42:49.748389+0000","last_became_peered":"2024-03-23T23:42:49.748389+0000","last_unstale":"2024-03-23T23:57:53.419543+0000","last_undegraded":"2024-03-23T23:57:53.419543+0000","last_fullsized":"2024-03-23T23:57:53.419543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:58:10.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"27'4542","reported_seq":4564,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.326027+0000","last_change":"2024-03-23T23:42:50.749547+0000","last_active":"2024-03-23T23:57:53.326027+0000","last_peered":"2024-03-23T23:57:53.326027+0000","last_clean":"2024-03-23T23:57:53.326027+0000","last_became_active":"2024-03-23T23:42:50.749066+0000","last_became_peered":"2024-03-23T23:42:50.749066+0000","last_unstale":"2024-03-23T23:57:53.326027+0000","last_undegraded":"2024-03-23T23:57:53.326027+0000","last_fullsized":"2024-03-23T23:57:53.326027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4542,"log_dups_size":0,"ondisk_log_size":4542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:09:19.723830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67689,"num_write_kb":774425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'5741","reported_seq":5757,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.693565+0000","last_change":"2024-03-23T23:43:22.034371+0000","last_active":"2024-03-23T23:58:27.693565+0000","last_peered":"2024-03-23T23:58:27.693565+0000","last_clean":"2024-03-23T23:58:27.693565+0000","last_became_active":"2024-03-23T23:43:22.034063+0000","last_became_peered":"2024-03-23T23:43:22.034063+0000","last_unstale":"2024-03-23T23:58:27.693565+0000","last_undegraded":"2024-03-23T23:58:27.693565+0000","last_fullsized":"2024-03-23T23:58:27.693565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5741,"log_dups_size":0,"ondisk_log_size":5741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:49:33.736688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85448,"num_write_kb":1013349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'3","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:46.901728+0000","last_change":"2024-03-23T23:42:39.684669+0000","last_active":"2024-03-23T23:54:46.901728+0000","last_peered":"2024-03-23T23:54:46.901728+0000","last_clean":"2024-03-23T23:54:46.901728+0000","last_became_active":"2024-03-23T23:42:39.684360+0000","last_became_peered":"2024-03-23T23:42:39.684360+0000","last_unstale":"2024-03-23T23:54:46.901728+0000","last_undegraded":"2024-03-23T23:54:46.901728+0000","last_fullsized":"2024-03-23T23:54:46.901728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:19.914926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'5","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.418360+0000","last_change":"2024-03-23T23:42:49.741577+0000","last_active":"2024-03-23T23:57:53.418360+0000","last_peered":"2024-03-23T23:57:53.418360+0000","last_clean":"2024-03-23T23:57:53.418360+0000","last_became_active":"2024-03-23T23:42:49.741270+0000","last_became_peered":"2024-03-23T23:42:49.741270+0000","last_unstale":"2024-03-23T23:57:53.418360+0000","last_undegraded":"2024-03-23T23:57:53.418360+0000","last_fullsized":"2024-03-23T23:57:53.418360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:11:43.106922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"27'7534","reported_seq":7557,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.649402+0000","last_change":"2024-03-23T23:42:50.751992+0000","last_active":"2024-03-23T23:57:57.649402+0000","last_peered":"2024-03-23T23:57:57.649402+0000","last_clean":"2024-03-23T23:57:57.649402+0000","last_became_active":"2024-03-23T23:42:50.748281+0000","last_became_peered":"2024-03-23T23:42:50.748281+0000","last_unstale":"2024-03-23T23:57:57.649402+0000","last_undegraded":"2024-03-23T23:57:57.649402+0000","last_fullsized":"2024-03-23T23:57:57.649402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":7534,"log_dups_size":0,"ondisk_log_size":7534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:57.968968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112036,"num_write_kb":1284404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"27'34","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.409576+0000","last_change":"2024-03-23T23:42:49.741658+0000","last_active":"2024-03-23T23:57:53.409576+0000","last_peered":"2024-03-23T23:57:53.409576+0000","last_clean":"2024-03-23T23:57:53.409576+0000","last_became_active":"2024-03-23T23:42:49.740899+0000","last_became_peered":"2024-03-23T23:42:49.740899+0000","last_unstale":"2024-03-23T23:57:53.409576+0000","last_undegraded":"2024-03-23T23:57:53.409576+0000","last_fullsized":"2024-03-23T23:57:53.409576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:45:20.189501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'6202","reported_seq":6232,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.643775+0000","last_change":"2024-03-23T23:42:40.679384+0000","last_active":"2024-03-23T23:58:27.643775+0000","last_peered":"2024-03-23T23:58:27.643775+0000","last_clean":"2024-03-23T23:58:27.643775+0000","last_became_active":"2024-03-23T23:42:40.679070+0000","last_became_peered":"2024-03-23T23:42:40.679070+0000","last_unstale":"2024-03-23T23:58:27.643775+0000","last_undegraded":"2024-03-23T23:58:27.643775+0000","last_fullsized":"2024-03-23T23:58:27.643775+0000","mapping_epoch":19,"log_start":"27'500","ondisk_log_start":"27'500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5702,"log_dups_size":0,"ondisk_log_size":5702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:26:16.171920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92139,"num_write_kb":1051130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'28","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:54.268838+0000","last_change":"2024-03-23T23:42:39.682839+0000","last_active":"2024-03-23T23:54:54.268838+0000","last_peered":"2024-03-23T23:54:54.268838+0000","last_clean":"2024-03-23T23:54:54.268838+0000","last_became_active":"2024-03-23T23:42:39.682584+0000","last_became_peered":"2024-03-23T23:42:39.682584+0000","last_unstale":"2024-03-23T23:54:54.268838+0000","last_undegraded":"2024-03-23T23:54:54.268838+0000","last_fullsized":"2024-03-23T23:54:54.268838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:19.914926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":8211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"27'5271","reported_seq":5294,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.311967+0000","last_change":"2024-03-23T23:42:50.752596+0000","last_active":"2024-03-23T23:58:30.311967+0000","last_peered":"2024-03-23T23:58:30.311967+0000","last_clean":"2024-03-23T23:58:30.311967+0000","last_became_active":"2024-03-23T23:42:50.751598+0000","last_became_peered":"2024-03-23T23:42:50.751598+0000","last_unstale":"2024-03-23T23:58:30.311967+0000","last_undegraded":"2024-03-23T23:58:30.311967+0000","last_fullsized":"2024-03-23T23:58:30.311967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5271,"log_dups_size":0,"ondisk_log_size":5271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:37:19.741781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78296,"num_write_kb":918025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"27'25","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.611935+0000","last_change":"2024-03-23T23:42:49.734629+0000","last_active":"2024-03-23T23:57:57.611935+0000","last_peered":"2024-03-23T23:57:57.611935+0000","last_clean":"2024-03-23T23:57:57.611935+0000","last_became_active":"2024-03-23T23:42:49.734309+0000","last_became_peered":"2024-03-23T23:42:49.734309+0000","last_unstale":"2024-03-23T23:57:57.611935+0000","last_undegraded":"2024-03-23T23:57:57.611935+0000","last_fullsized":"2024-03-23T23:57:57.611935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:46.760020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'5375","reported_seq":5405,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:59.176057+0000","last_change":"2024-03-23T23:42:40.674605+0000","last_active":"2024-03-23T23:54:59.176057+0000","last_peered":"2024-03-23T23:54:59.176057+0000","last_clean":"2024-03-23T23:54:59.176057+0000","last_became_active":"2024-03-23T23:42:40.674366+0000","last_became_peered":"2024-03-23T23:42:40.674366+0000","last_unstale":"2024-03-23T23:54:59.176057+0000","last_undegraded":"2024-03-23T23:54:59.176057+0000","last_fullsized":"2024-03-23T23:54:59.176057+0000","mapping_epoch":19,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5275,"log_dups_size":0,"ondisk_log_size":5275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80001,"num_write_kb":974706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'8","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:59.176089+0000","last_change":"2024-03-23T23:42:39.688646+0000","last_active":"2024-03-23T23:54:59.176089+0000","last_peered":"2024-03-23T23:54:59.176089+0000","last_clean":"2024-03-23T23:54:59.176089+0000","last_became_active":"2024-03-23T23:42:39.687489+0000","last_became_peered":"2024-03-23T23:42:39.687489+0000","last_unstale":"2024-03-23T23:54:59.176089+0000","last_undegraded":"2024-03-23T23:54:59.176089+0000","last_fullsized":"2024-03-23T23:54:59.176089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:07:12.649156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"27'6132","reported_seq":6154,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.509771+0000","last_change":"2024-03-23T23:42:50.748511+0000","last_active":"2024-03-23T23:58:30.509771+0000","last_peered":"2024-03-23T23:58:30.509771+0000","last_clean":"2024-03-23T23:58:30.509771+0000","last_became_active":"2024-03-23T23:42:50.747154+0000","last_became_peered":"2024-03-23T23:42:50.747154+0000","last_unstale":"2024-03-23T23:58:30.509771+0000","last_undegraded":"2024-03-23T23:58:30.509771+0000","last_fullsized":"2024-03-23T23:58:30.509771+0000","mapping_epoch":23,"log_start":"27'400","ondisk_log_start":"27'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5732,"log_dups_size":0,"ondisk_log_size":5732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:09:19.723830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91134,"num_write_kb":1034218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"27'17","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:02.411457+0000","last_change":"2024-03-23T23:42:39.681458+0000","last_active":"2024-03-23T23:55:02.411457+0000","last_peered":"2024-03-23T23:55:02.411457+0000","last_clean":"2024-03-23T23:55:02.411457+0000","last_became_active":"2024-03-23T23:42:39.681158+0000","last_became_peered":"2024-03-23T23:42:39.681158+0000","last_unstale":"2024-03-23T23:55:02.411457+0000","last_undegraded":"2024-03-23T23:55:02.411457+0000","last_fullsized":"2024-03-23T23:55:02.411457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:08:03.578884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'4519","reported_seq":4549,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.740359+0000","last_change":"2024-03-23T23:42:40.676571+0000","last_active":"2024-03-23T23:58:27.740359+0000","last_peered":"2024-03-23T23:58:27.740359+0000","last_clean":"2024-03-23T23:58:27.740359+0000","last_became_active":"2024-03-23T23:42:40.675877+0000","last_became_peered":"2024-03-23T23:42:40.675877+0000","last_unstale":"2024-03-23T23:58:27.740359+0000","last_undegraded":"2024-03-23T23:58:27.740359+0000","last_fullsized":"2024-03-23T23:58:27.740359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4519,"log_dups_size":0,"ondisk_log_size":4519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:52.220411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67585,"num_write_kb":780136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'19","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:56.350382+0000","last_change":"2024-03-23T23:42:49.734208+0000","last_active":"2024-03-23T23:57:56.350382+0000","last_peered":"2024-03-23T23:57:56.350382+0000","last_clean":"2024-03-23T23:57:56.350382+0000","last_became_active":"2024-03-23T23:42:49.732943+0000","last_became_peered":"2024-03-23T23:42:49.732943+0000","last_unstale":"2024-03-23T23:57:56.350382+0000","last_undegraded":"2024-03-23T23:57:56.350382+0000","last_fullsized":"2024-03-23T23:57:56.350382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:43.683275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"27'4594","reported_seq":4616,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.367947+0000","last_change":"2024-03-23T23:42:50.752722+0000","last_active":"2024-03-23T23:57:53.367947+0000","last_peered":"2024-03-23T23:57:53.367947+0000","last_clean":"2024-03-23T23:57:53.367947+0000","last_became_active":"2024-03-23T23:42:50.749400+0000","last_became_peered":"2024-03-23T23:42:50.749400+0000","last_unstale":"2024-03-23T23:57:53.367947+0000","last_undegraded":"2024-03-23T23:57:53.367947+0000","last_fullsized":"2024-03-23T23:57:53.367947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4594,"log_dups_size":0,"ondisk_log_size":4594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:16:44.027189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67787,"num_write_kb":753464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'1303","reported_seq":1335,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:04.355170+0000","last_change":"2024-03-23T23:42:39.688422+0000","last_active":"2024-03-23T23:55:04.355170+0000","last_peered":"2024-03-23T23:55:04.355170+0000","last_clean":"2024-03-23T23:55:04.355170+0000","last_became_active":"2024-03-23T23:42:39.687423+0000","last_became_peered":"2024-03-23T23:42:39.687423+0000","last_unstale":"2024-03-23T23:55:04.355170+0000","last_undegraded":"2024-03-23T23:55:04.355170+0000","last_fullsized":"2024-03-23T23:55:04.355170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1303,"log_dups_size":0,"ondisk_log_size":1303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:20:38.456655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1297,"num_write_kb":4300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'4605","reported_seq":4635,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.670982+0000","last_change":"2024-03-23T23:42:40.680801+0000","last_active":"2024-03-23T23:58:27.670982+0000","last_peered":"2024-03-23T23:58:27.670982+0000","last_clean":"2024-03-23T23:58:27.670982+0000","last_became_active":"2024-03-23T23:42:40.680511+0000","last_became_peered":"2024-03-23T23:42:40.680511+0000","last_unstale":"2024-03-23T23:58:27.670982+0000","last_undegraded":"2024-03-23T23:58:27.670982+0000","last_fullsized":"2024-03-23T23:58:27.670982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4605,"log_dups_size":0,"ondisk_log_size":4605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:27:42.392714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68637,"num_write_kb":787014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'90","reported_seq":114,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.422374+0000","last_change":"2024-03-23T23:42:49.751291+0000","last_active":"2024-03-23T23:57:53.422374+0000","last_peered":"2024-03-23T23:57:53.422374+0000","last_clean":"2024-03-23T23:57:53.422374+0000","last_became_active":"2024-03-23T23:42:49.749695+0000","last_became_peered":"2024-03-23T23:42:49.749695+0000","last_unstale":"2024-03-23T23:57:53.422374+0000","last_undegraded":"2024-03-23T23:57:53.422374+0000","last_fullsized":"2024-03-23T23:57:53.422374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:40:33.073029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":12324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"27'4641","reported_seq":4664,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.624601+0000","last_change":"2024-03-23T23:42:50.752672+0000","last_active":"2024-03-23T23:57:57.624601+0000","last_peered":"2024-03-23T23:57:57.624601+0000","last_clean":"2024-03-23T23:57:57.624601+0000","last_became_active":"2024-03-23T23:42:50.752394+0000","last_became_peered":"2024-03-23T23:42:50.752394+0000","last_unstale":"2024-03-23T23:57:57.624601+0000","last_undegraded":"2024-03-23T23:57:57.624601+0000","last_fullsized":"2024-03-23T23:57:57.624601+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4641,"log_dups_size":0,"ondisk_log_size":4641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:51:01.385876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69093,"num_write_kb":797343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'5268","reported_seq":5299,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.664423+0000","last_change":"2024-03-23T23:42:40.679042+0000","last_active":"2024-03-23T23:58:27.664423+0000","last_peered":"2024-03-23T23:58:27.664423+0000","last_clean":"2024-03-23T23:58:27.664423+0000","last_became_active":"2024-03-23T23:42:40.678518+0000","last_became_peered":"2024-03-23T23:42:40.678518+0000","last_unstale":"2024-03-23T23:58:27.664423+0000","last_undegraded":"2024-03-23T23:58:27.664423+0000","last_fullsized":"2024-03-23T23:58:27.664423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5268,"log_dups_size":0,"ondisk_log_size":5268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:12:14.359173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78308,"num_write_kb":963226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"27'6097","reported_seq":6120,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.364444+0000","last_change":"2024-03-23T23:42:50.757132+0000","last_active":"2024-03-23T23:58:30.364444+0000","last_peered":"2024-03-23T23:58:30.364444+0000","last_clean":"2024-03-23T23:58:30.364444+0000","last_became_active":"2024-03-23T23:42:50.756813+0000","last_became_peered":"2024-03-23T23:42:50.756813+0000","last_unstale":"2024-03-23T23:58:30.364444+0000","last_undegraded":"2024-03-23T23:58:30.364444+0000","last_fullsized":"2024-03-23T23:58:30.364444+0000","mapping_epoch":23,"log_start":"27'400","ondisk_log_start":"27'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5697,"log_dups_size":0,"ondisk_log_size":5697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:04:26.911514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90451,"num_write_kb":1016115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"27'5502","reported_seq":5533,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.668122+0000","last_change":"2024-03-23T23:42:40.702411+0000","last_active":"2024-03-23T23:58:27.668122+0000","last_peered":"2024-03-23T23:58:27.668122+0000","last_clean":"2024-03-23T23:58:27.668122+0000","last_became_active":"2024-03-23T23:42:40.701398+0000","last_became_peered":"2024-03-23T23:42:40.701398+0000","last_unstale":"2024-03-23T23:58:27.668122+0000","last_undegraded":"2024-03-23T23:58:27.668122+0000","last_fullsized":"2024-03-23T23:58:27.668122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5502,"log_dups_size":0,"ondisk_log_size":5502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:03.196963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81712,"num_write_kb":960011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"27'5505","reported_seq":5528,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.437164+0000","last_change":"2024-03-23T23:42:50.756769+0000","last_active":"2024-03-23T23:57:53.437164+0000","last_peered":"2024-03-23T23:57:53.437164+0000","last_clean":"2024-03-23T23:57:53.437164+0000","last_became_active":"2024-03-23T23:42:50.756503+0000","last_became_peered":"2024-03-23T23:42:50.756503+0000","last_unstale":"2024-03-23T23:57:53.437164+0000","last_undegraded":"2024-03-23T23:57:53.437164+0000","last_fullsized":"2024-03-23T23:57:53.437164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5505,"log_dups_size":0,"ondisk_log_size":5505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:50.597847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81671,"num_write_kb":934046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"27'5990","reported_seq":6026,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.684080+0000","last_change":"2024-03-23T23:43:22.035915+0000","last_active":"2024-03-23T23:58:27.684080+0000","last_peered":"2024-03-23T23:58:27.684080+0000","last_clean":"2024-03-23T23:58:27.684080+0000","last_became_active":"2024-03-23T23:43:22.035611+0000","last_became_peered":"2024-03-23T23:43:22.035611+0000","last_unstale":"2024-03-23T23:58:27.684080+0000","last_undegraded":"2024-03-23T23:58:27.684080+0000","last_fullsized":"2024-03-23T23:58:27.684080+0000","mapping_epoch":26,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5890,"log_dups_size":0,"ondisk_log_size":5890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:49:53.121428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89084,"num_write_kb":1042929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"27'5555","reported_seq":5578,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.504307+0000","last_change":"2024-03-23T23:42:50.748726+0000","last_active":"2024-03-23T23:58:30.504307+0000","last_peered":"2024-03-23T23:58:30.504307+0000","last_clean":"2024-03-23T23:58:30.504307+0000","last_became_active":"2024-03-23T23:42:50.748105+0000","last_became_peered":"2024-03-23T23:42:50.748105+0000","last_unstale":"2024-03-23T23:58:30.504307+0000","last_undegraded":"2024-03-23T23:58:30.504307+0000","last_fullsized":"2024-03-23T23:58:30.504307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5555,"log_dups_size":0,"ondisk_log_size":5555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:54.910408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82238,"num_write_kb":945396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"27'5030","reported_seq":5061,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.692277+0000","last_change":"2024-03-23T23:42:40.673293+0000","last_active":"2024-03-23T23:58:27.692277+0000","last_peered":"2024-03-23T23:58:27.692277+0000","last_clean":"2024-03-23T23:58:27.692277+0000","last_became_active":"2024-03-23T23:42:40.672910+0000","last_became_peered":"2024-03-23T23:42:40.672910+0000","last_unstale":"2024-03-23T23:58:27.692277+0000","last_undegraded":"2024-03-23T23:58:27.692277+0000","last_fullsized":"2024-03-23T23:58:27.692277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5030,"log_dups_size":0,"ondisk_log_size":5030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:42:14.952953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74941,"num_write_kb":923200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"27'5960","reported_seq":5983,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.620022+0000","last_change":"2024-03-23T23:42:50.750291+0000","last_active":"2024-03-23T23:57:57.620022+0000","last_peered":"2024-03-23T23:57:57.620022+0000","last_clean":"2024-03-23T23:57:57.620022+0000","last_became_active":"2024-03-23T23:42:50.749908+0000","last_became_peered":"2024-03-23T23:42:50.749908+0000","last_unstale":"2024-03-23T23:57:57.620022+0000","last_undegraded":"2024-03-23T23:57:57.620022+0000","last_fullsized":"2024-03-23T23:57:57.620022+0000","mapping_epoch":23,"log_start":"27'200","ondisk_log_start":"27'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5760,"log_dups_size":0,"ondisk_log_size":5760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:54.910408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88637,"num_write_kb":993297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"27'5450","reported_seq":5481,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:34.943004+0000","last_change":"2024-03-23T23:42:40.685370+0000","last_active":"2024-03-23T23:55:34.943004+0000","last_peered":"2024-03-23T23:55:34.943004+0000","last_clean":"2024-03-23T23:55:34.943004+0000","last_became_active":"2024-03-23T23:42:40.685120+0000","last_became_peered":"2024-03-23T23:42:40.685120+0000","last_unstale":"2024-03-23T23:55:34.943004+0000","last_undegraded":"2024-03-23T23:55:34.943004+0000","last_fullsized":"2024-03-23T23:55:34.943004+0000","mapping_epoch":19,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5350,"log_dups_size":0,"ondisk_log_size":5350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81249,"num_write_kb":968622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"27'5333","reported_seq":5356,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.397151+0000","last_change":"2024-03-23T23:42:50.747361+0000","last_active":"2024-03-23T23:57:53.397151+0000","last_peered":"2024-03-23T23:57:53.397151+0000","last_clean":"2024-03-23T23:57:53.397151+0000","last_became_active":"2024-03-23T23:42:50.746310+0000","last_became_peered":"2024-03-23T23:42:50.746310+0000","last_unstale":"2024-03-23T23:57:53.397151+0000","last_undegraded":"2024-03-23T23:57:53.397151+0000","last_fullsized":"2024-03-23T23:57:53.397151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5333,"log_dups_size":0,"ondisk_log_size":5333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:57.968968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79170,"num_write_kb":877684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"27'5337","reported_seq":5368,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.589587+0000","last_change":"2024-03-23T23:42:40.677168+0000","last_active":"2024-03-23T23:58:27.589587+0000","last_peered":"2024-03-23T23:58:27.589587+0000","last_clean":"2024-03-23T23:58:27.589587+0000","last_became_active":"2024-03-23T23:42:40.676912+0000","last_became_peered":"2024-03-23T23:42:40.676912+0000","last_unstale":"2024-03-23T23:58:27.589587+0000","last_undegraded":"2024-03-23T23:58:27.589587+0000","last_fullsized":"2024-03-23T23:58:27.589587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5337,"log_dups_size":0,"ondisk_log_size":5337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:17:19.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79200,"num_write_kb":983244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"27'5388","reported_seq":5411,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.409572+0000","last_change":"2024-03-23T23:42:50.749305+0000","last_active":"2024-03-23T23:57:53.409572+0000","last_peered":"2024-03-23T23:57:53.409572+0000","last_clean":"2024-03-23T23:57:53.409572+0000","last_became_active":"2024-03-23T23:42:50.748798+0000","last_became_peered":"2024-03-23T23:42:50.748798+0000","last_unstale":"2024-03-23T23:57:53.409572+0000","last_undegraded":"2024-03-23T23:57:53.409572+0000","last_fullsized":"2024-03-23T23:57:53.409572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5388,"log_dups_size":0,"ondisk_log_size":5388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:19.610436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80551,"num_write_kb":913314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"27'4477","reported_seq":4507,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.728675+0000","last_change":"2024-03-23T23:42:40.694420+0000","last_active":"2024-03-23T23:58:27.728675+0000","last_peered":"2024-03-23T23:58:27.728675+0000","last_clean":"2024-03-23T23:58:27.728675+0000","last_became_active":"2024-03-23T23:42:40.693867+0000","last_became_peered":"2024-03-23T23:42:40.693867+0000","last_unstale":"2024-03-23T23:58:27.728675+0000","last_undegraded":"2024-03-23T23:58:27.728675+0000","last_fullsized":"2024-03-23T23:58:27.728675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4477,"log_dups_size":0,"ondisk_log_size":4477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:54.557634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66343,"num_write_kb":822171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"27'5440","reported_seq":5463,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.388213+0000","last_change":"2024-03-23T23:42:50.754149+0000","last_active":"2024-03-23T23:57:53.388213+0000","last_peered":"2024-03-23T23:57:53.388213+0000","last_clean":"2024-03-23T23:57:53.388213+0000","last_became_active":"2024-03-23T23:42:50.753471+0000","last_became_peered":"2024-03-23T23:42:50.753471+0000","last_unstale":"2024-03-23T23:57:53.388213+0000","last_undegraded":"2024-03-23T23:57:53.388213+0000","last_fullsized":"2024-03-23T23:57:53.388213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5440,"log_dups_size":0,"ondisk_log_size":5440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:28.822672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80762,"num_write_kb":909623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'5932","reported_seq":5963,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:50.436288+0000","last_change":"2024-03-23T23:42:40.685177+0000","last_active":"2024-03-23T23:55:50.436288+0000","last_peered":"2024-03-23T23:55:50.436288+0000","last_clean":"2024-03-23T23:55:50.436288+0000","last_became_active":"2024-03-23T23:42:40.684495+0000","last_became_peered":"2024-03-23T23:42:40.684495+0000","last_unstale":"2024-03-23T23:55:50.436288+0000","last_undegraded":"2024-03-23T23:55:50.436288+0000","last_fullsized":"2024-03-23T23:55:50.436288+0000","mapping_epoch":19,"log_start":"27'600","ondisk_log_start":"27'600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5332,"log_dups_size":0,"ondisk_log_size":5332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:27.675824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88442,"num_write_kb":1073631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"27'5672","reported_seq":5694,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.401288+0000","last_change":"2024-03-23T23:42:50.746438+0000","last_active":"2024-03-23T23:57:53.401288+0000","last_peered":"2024-03-23T23:57:53.401288+0000","last_clean":"2024-03-23T23:57:53.401288+0000","last_became_active":"2024-03-23T23:42:50.745771+0000","last_became_peered":"2024-03-23T23:42:50.745771+0000","last_unstale":"2024-03-23T23:57:53.401288+0000","last_undegraded":"2024-03-23T23:57:53.401288+0000","last_fullsized":"2024-03-23T23:57:53.401288+0000","mapping_epoch":23,"log_start":"27'400","ondisk_log_start":"27'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5272,"log_dups_size":0,"ondisk_log_size":5272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:22:17.484059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83950,"num_write_kb":942381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'5332","reported_seq":5363,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.685598+0000","last_change":"2024-03-23T23:42:40.701852+0000","last_active":"2024-03-23T23:58:27.685598+0000","last_peered":"2024-03-23T23:58:27.685598+0000","last_clean":"2024-03-23T23:58:27.685598+0000","last_became_active":"2024-03-23T23:42:40.701566+0000","last_became_peered":"2024-03-23T23:42:40.701566+0000","last_unstale":"2024-03-23T23:58:27.685598+0000","last_undegraded":"2024-03-23T23:58:27.685598+0000","last_fullsized":"2024-03-23T23:58:27.685598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5332,"log_dups_size":0,"ondisk_log_size":5332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79247,"num_write_kb":918114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"27'6948","reported_seq":6970,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.632915+0000","last_change":"2024-03-23T23:42:50.758879+0000","last_active":"2024-03-23T23:57:57.632915+0000","last_peered":"2024-03-23T23:57:57.632915+0000","last_clean":"2024-03-23T23:57:57.632915+0000","last_became_active":"2024-03-23T23:42:50.758564+0000","last_became_peered":"2024-03-23T23:42:50.758564+0000","last_unstale":"2024-03-23T23:57:57.632915+0000","last_undegraded":"2024-03-23T23:57:57.632915+0000","last_fullsized":"2024-03-23T23:57:57.632915+0000","mapping_epoch":23,"log_start":"27'1200","ondisk_log_start":"27'1200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5748,"log_dups_size":0,"ondisk_log_size":5748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:11:29.268536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103363,"num_write_kb":1190294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"27'4871","reported_seq":4902,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:56:10.679759+0000","last_change":"2024-03-23T23:42:40.684899+0000","last_active":"2024-03-23T23:56:10.679759+0000","last_peered":"2024-03-23T23:56:10.679759+0000","last_clean":"2024-03-23T23:56:10.679759+0000","last_became_active":"2024-03-23T23:42:40.684603+0000","last_became_peered":"2024-03-23T23:42:40.684603+0000","last_unstale":"2024-03-23T23:56:10.679759+0000","last_undegraded":"2024-03-23T23:56:10.679759+0000","last_fullsized":"2024-03-23T23:56:10.679759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4871,"log_dups_size":0,"ondisk_log_size":4871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:54.557634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72674,"num_write_kb":866936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"27'4847","reported_seq":4869,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.452843+0000","last_change":"2024-03-23T23:42:50.754096+0000","last_active":"2024-03-23T23:58:30.452843+0000","last_peered":"2024-03-23T23:58:30.452843+0000","last_clean":"2024-03-23T23:58:30.452843+0000","last_became_active":"2024-03-23T23:42:50.753602+0000","last_became_peered":"2024-03-23T23:42:50.753602+0000","last_unstale":"2024-03-23T23:58:30.452843+0000","last_undegraded":"2024-03-23T23:58:30.452843+0000","last_fullsized":"2024-03-23T23:58:30.452843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4847,"log_dups_size":0,"ondisk_log_size":4847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:16:26.794444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71433,"num_write_kb":836622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"27'5277","reported_seq":5293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.656567+0000","last_change":"2024-03-23T23:43:22.035247+0000","last_active":"2024-03-23T23:58:27.656567+0000","last_peered":"2024-03-23T23:58:27.656567+0000","last_clean":"2024-03-23T23:58:27.656567+0000","last_became_active":"2024-03-23T23:43:22.034831+0000","last_became_peered":"2024-03-23T23:43:22.034831+0000","last_unstale":"2024-03-23T23:58:27.656567+0000","last_undegraded":"2024-03-23T23:58:27.656567+0000","last_fullsized":"2024-03-23T23:58:27.656567+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5277,"log_dups_size":0,"ondisk_log_size":5277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:42:13.179165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78302,"num_write_kb":947936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2d","version":"27'6034","reported_seq":6056,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.233044+0000","last_change":"2024-03-23T23:42:50.741324+0000","last_active":"2024-03-23T23:57:53.233044+0000","last_peered":"2024-03-23T23:57:53.233044+0000","last_clean":"2024-03-23T23:57:53.233044+0000","last_became_active":"2024-03-23T23:42:50.741065+0000","last_became_peered":"2024-03-23T23:42:50.741065+0000","last_unstale":"2024-03-23T23:57:53.233044+0000","last_undegraded":"2024-03-23T23:57:53.233044+0000","last_fullsized":"2024-03-23T23:57:53.233044+0000","mapping_epoch":23,"log_start":"27'700","ondisk_log_start":"27'700","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5334,"log_dups_size":0,"ondisk_log_size":5334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:13.911327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89207,"num_write_kb":985993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"27'6145","reported_seq":6176,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.746964+0000","last_change":"2024-03-23T23:42:40.689122+0000","last_active":"2024-03-23T23:58:27.746964+0000","last_peered":"2024-03-23T23:58:27.746964+0000","last_clean":"2024-03-23T23:58:27.746964+0000","last_became_active":"2024-03-23T23:42:40.688875+0000","last_became_peered":"2024-03-23T23:42:40.688875+0000","last_unstale":"2024-03-23T23:58:27.746964+0000","last_undegraded":"2024-03-23T23:58:27.746964+0000","last_fullsized":"2024-03-23T23:58:27.746964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":6145,"log_dups_size":0,"ondisk_log_size":6145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:27:03.132032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91123,"num_write_kb":1098161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"27'5331","reported_seq":5353,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.218888+0000","last_change":"2024-03-23T23:42:50.762055+0000","last_active":"2024-03-23T23:57:53.218888+0000","last_peered":"2024-03-23T23:57:53.218888+0000","last_clean":"2024-03-23T23:57:53.218888+0000","last_became_active":"2024-03-23T23:42:50.761762+0000","last_became_peered":"2024-03-23T23:42:50.761762+0000","last_unstale":"2024-03-23T23:57:53.218888+0000","last_undegraded":"2024-03-23T23:57:53.218888+0000","last_fullsized":"2024-03-23T23:57:53.218888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5331,"log_dups_size":0,"ondisk_log_size":5331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:28.822672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79322,"num_write_kb":913380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'4790","reported_seq":4820,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.610687+0000","last_change":"2024-03-23T23:42:40.683701+0000","last_active":"2024-03-23T23:58:27.610687+0000","last_peered":"2024-03-23T23:58:27.610687+0000","last_clean":"2024-03-23T23:58:27.610687+0000","last_became_active":"2024-03-23T23:42:40.683377+0000","last_became_peered":"2024-03-23T23:42:40.683377+0000","last_unstale":"2024-03-23T23:58:27.610687+0000","last_undegraded":"2024-03-23T23:58:27.610687+0000","last_fullsized":"2024-03-23T23:58:27.610687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4790,"log_dups_size":0,"ondisk_log_size":4790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71235,"num_write_kb":860094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"27'6313","reported_seq":6335,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.618034+0000","last_change":"2024-03-23T23:42:50.754372+0000","last_active":"2024-03-23T23:57:57.618034+0000","last_peered":"2024-03-23T23:57:57.618034+0000","last_clean":"2024-03-23T23:57:57.618034+0000","last_became_active":"2024-03-23T23:42:50.754072+0000","last_became_peered":"2024-03-23T23:42:50.754072+0000","last_unstale":"2024-03-23T23:57:57.618034+0000","last_undegraded":"2024-03-23T23:57:57.618034+0000","last_fullsized":"2024-03-23T23:57:57.618034+0000","mapping_epoch":23,"log_start":"27'800","ondisk_log_start":"27'800","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5513,"log_dups_size":0,"ondisk_log_size":5513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:40:34.077584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93450,"num_write_kb":1059053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"27'5789","reported_seq":5819,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:35.865197+0000","last_change":"2024-03-23T23:42:40.689769+0000","last_active":"2024-03-23T23:54:35.865197+0000","last_peered":"2024-03-23T23:54:35.865197+0000","last_clean":"2024-03-23T23:54:35.865197+0000","last_became_active":"2024-03-23T23:42:40.689111+0000","last_became_peered":"2024-03-23T23:42:40.689111+0000","last_unstale":"2024-03-23T23:54:35.865197+0000","last_undegraded":"2024-03-23T23:54:35.865197+0000","last_fullsized":"2024-03-23T23:54:35.865197+0000","mapping_epoch":19,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5689,"log_dups_size":0,"ondisk_log_size":5689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:40:22.690954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86245,"num_write_kb":1027145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"27'5272","reported_seq":5295,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.618695+0000","last_change":"2024-03-23T23:42:50.759792+0000","last_active":"2024-03-23T23:57:57.618695+0000","last_peered":"2024-03-23T23:57:57.618695+0000","last_clean":"2024-03-23T23:57:57.618695+0000","last_became_active":"2024-03-23T23:42:50.759604+0000","last_became_peered":"2024-03-23T23:42:50.759604+0000","last_unstale":"2024-03-23T23:57:57.618695+0000","last_undegraded":"2024-03-23T23:57:57.618695+0000","last_fullsized":"2024-03-23T23:57:57.618695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5272,"log_dups_size":0,"ondisk_log_size":5272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:15:25.617521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77877,"num_write_kb":893934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"27'5684","reported_seq":5714,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.676056+0000","last_change":"2024-03-23T23:42:40.690961+0000","last_active":"2024-03-23T23:58:27.676056+0000","last_peered":"2024-03-23T23:58:27.676056+0000","last_clean":"2024-03-23T23:58:27.676056+0000","last_became_active":"2024-03-23T23:42:40.690690+0000","last_became_peered":"2024-03-23T23:42:40.690690+0000","last_unstale":"2024-03-23T23:58:27.676056+0000","last_undegraded":"2024-03-23T23:58:27.676056+0000","last_fullsized":"2024-03-23T23:58:27.676056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5684,"log_dups_size":0,"ondisk_log_size":5684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:56.763759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84510,"num_write_kb":984289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"27'4973","reported_seq":4996,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.379563+0000","last_change":"2024-03-23T23:42:50.764821+0000","last_active":"2024-03-23T23:58:30.379563+0000","last_peered":"2024-03-23T23:58:30.379563+0000","last_clean":"2024-03-23T23:58:30.379563+0000","last_became_active":"2024-03-23T23:42:50.764563+0000","last_became_peered":"2024-03-23T23:42:50.764563+0000","last_unstale":"2024-03-23T23:58:30.379563+0000","last_undegraded":"2024-03-23T23:58:30.379563+0000","last_fullsized":"2024-03-23T23:58:30.379563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4973,"log_dups_size":0,"ondisk_log_size":4973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:48:24.982671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73421,"num_write_kb":840152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"27'6976","reported_seq":7006,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.731575+0000","last_change":"2024-03-23T23:42:40.708540+0000","last_active":"2024-03-23T23:58:27.731575+0000","last_peered":"2024-03-23T23:58:27.731575+0000","last_clean":"2024-03-23T23:58:27.731575+0000","last_became_active":"2024-03-23T23:42:40.708031+0000","last_became_peered":"2024-03-23T23:42:40.708031+0000","last_unstale":"2024-03-23T23:58:27.731575+0000","last_undegraded":"2024-03-23T23:58:27.731575+0000","last_fullsized":"2024-03-23T23:58:27.731575+0000","mapping_epoch":19,"log_start":"27'1000","ondisk_log_start":"27'1000","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5976,"log_dups_size":0,"ondisk_log_size":5976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:44:03.386124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104041,"num_write_kb":1238038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"27'5691","reported_seq":5713,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.449795+0000","last_change":"2024-03-23T23:42:50.771062+0000","last_active":"2024-03-23T23:58:30.449795+0000","last_peered":"2024-03-23T23:58:30.449795+0000","last_clean":"2024-03-23T23:58:30.449795+0000","last_became_active":"2024-03-23T23:42:50.770790+0000","last_became_peered":"2024-03-23T23:42:50.770790+0000","last_unstale":"2024-03-23T23:58:30.449795+0000","last_undegraded":"2024-03-23T23:58:30.449795+0000","last_fullsized":"2024-03-23T23:58:30.449795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5691,"log_dups_size":0,"ondisk_log_size":5691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:13:07.156401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84043,"num_write_kb":972100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"27'4954","reported_seq":4984,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.678147+0000","last_change":"2024-03-23T23:42:40.697920+0000","last_active":"2024-03-23T23:58:27.678147+0000","last_peered":"2024-03-23T23:58:27.678147+0000","last_clean":"2024-03-23T23:58:27.678147+0000","last_became_active":"2024-03-23T23:42:40.697694+0000","last_became_peered":"2024-03-23T23:42:40.697694+0000","last_unstale":"2024-03-23T23:58:27.678147+0000","last_undegraded":"2024-03-23T23:58:27.678147+0000","last_fullsized":"2024-03-23T23:58:27.678147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4954,"log_dups_size":0,"ondisk_log_size":4954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73634,"num_write_kb":894008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"27'6050","reported_seq":6072,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.384523+0000","last_change":"2024-03-23T23:42:50.751694+0000","last_active":"2024-03-23T23:57:53.384523+0000","last_peered":"2024-03-23T23:57:53.384523+0000","last_clean":"2024-03-23T23:57:53.384523+0000","last_became_active":"2024-03-23T23:42:50.751452+0000","last_became_peered":"2024-03-23T23:42:50.751452+0000","last_unstale":"2024-03-23T23:57:53.384523+0000","last_undegraded":"2024-03-23T23:57:53.384523+0000","last_fullsized":"2024-03-23T23:57:53.384523+0000","mapping_epoch":23,"log_start":"27'500","ondisk_log_start":"27'500","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5550,"log_dups_size":0,"ondisk_log_size":5550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:57:49.981068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89888,"num_write_kb":1063697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"27'4435","reported_seq":4465,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.667717+0000","last_change":"2024-03-23T23:42:40.681928+0000","last_active":"2024-03-23T23:58:27.667717+0000","last_peered":"2024-03-23T23:58:27.667717+0000","last_clean":"2024-03-23T23:58:27.667717+0000","last_became_active":"2024-03-23T23:42:40.681337+0000","last_became_peered":"2024-03-23T23:42:40.681337+0000","last_unstale":"2024-03-23T23:58:27.667717+0000","last_undegraded":"2024-03-23T23:58:27.667717+0000","last_fullsized":"2024-03-23T23:58:27.667717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4435,"log_dups_size":0,"ondisk_log_size":4435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:52.220411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65733,"num_write_kb":782831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"27'3540","reported_seq":3562,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.388876+0000","last_change":"2024-03-23T23:42:50.769003+0000","last_active":"2024-03-23T23:57:53.388876+0000","last_peered":"2024-03-23T23:57:53.388876+0000","last_clean":"2024-03-23T23:57:53.388876+0000","last_became_active":"2024-03-23T23:42:50.768695+0000","last_became_peered":"2024-03-23T23:42:50.768695+0000","last_unstale":"2024-03-23T23:57:53.388876+0000","last_undegraded":"2024-03-23T23:57:53.388876+0000","last_fullsized":"2024-03-23T23:57:53.388876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":3540,"log_dups_size":0,"ondisk_log_size":3540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:17:11.847056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52531,"num_write_kb":593656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'4800","reported_seq":4830,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.657178+0000","last_change":"2024-03-23T23:42:40.680934+0000","last_active":"2024-03-23T23:58:27.657178+0000","last_peered":"2024-03-23T23:58:27.657178+0000","last_clean":"2024-03-23T23:58:27.657178+0000","last_became_active":"2024-03-23T23:42:40.680643+0000","last_became_peered":"2024-03-23T23:42:40.680643+0000","last_unstale":"2024-03-23T23:58:27.657178+0000","last_undegraded":"2024-03-23T23:58:27.657178+0000","last_fullsized":"2024-03-23T23:58:27.657178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4800,"log_dups_size":0,"ondisk_log_size":4800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:34.630671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71159,"num_write_kb":844038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"27'5005","reported_seq":5027,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:52.852956+0000","last_change":"2024-03-23T23:42:50.762401+0000","last_active":"2024-03-23T23:57:52.852956+0000","last_peered":"2024-03-23T23:57:52.852956+0000","last_clean":"2024-03-23T23:57:52.852956+0000","last_became_active":"2024-03-23T23:42:50.762183+0000","last_became_peered":"2024-03-23T23:42:50.762183+0000","last_unstale":"2024-03-23T23:57:52.852956+0000","last_undegraded":"2024-03-23T23:57:52.852956+0000","last_fullsized":"2024-03-23T23:57:52.852956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5005,"log_dups_size":0,"ondisk_log_size":5005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:13:10.497921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74336,"num_write_kb":853450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"27'4014","reported_seq":4044,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:38.734157+0000","last_change":"2024-03-23T23:42:40.682736+0000","last_active":"2024-03-23T23:54:38.734157+0000","last_peered":"2024-03-23T23:54:38.734157+0000","last_clean":"2024-03-23T23:54:38.734157+0000","last_became_active":"2024-03-23T23:42:40.682410+0000","last_became_peered":"2024-03-23T23:42:40.682410+0000","last_unstale":"2024-03-23T23:54:38.734157+0000","last_undegraded":"2024-03-23T23:54:38.734157+0000","last_fullsized":"2024-03-23T23:54:38.734157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4014,"log_dups_size":0,"ondisk_log_size":4014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:01:06.338641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59528,"num_write_kb":755074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"27'4691","reported_seq":4713,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.622134+0000","last_change":"2024-03-23T23:42:50.749204+0000","last_active":"2024-03-23T23:57:57.622134+0000","last_peered":"2024-03-23T23:57:57.622134+0000","last_clean":"2024-03-23T23:57:57.622134+0000","last_became_active":"2024-03-23T23:42:50.748809+0000","last_became_peered":"2024-03-23T23:42:50.748809+0000","last_unstale":"2024-03-23T23:57:57.622134+0000","last_undegraded":"2024-03-23T23:57:57.622134+0000","last_fullsized":"2024-03-23T23:57:57.622134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4691,"log_dups_size":0,"ondisk_log_size":4691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:39:49.888359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69546,"num_write_kb":808803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'3645","reported_seq":3675,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.744600+0000","last_change":"2024-03-23T23:42:40.682523+0000","last_active":"2024-03-23T23:58:27.744600+0000","last_peered":"2024-03-23T23:58:27.744600+0000","last_clean":"2024-03-23T23:58:27.744600+0000","last_became_active":"2024-03-23T23:42:40.682155+0000","last_became_peered":"2024-03-23T23:42:40.682155+0000","last_unstale":"2024-03-23T23:58:27.744600+0000","last_undegraded":"2024-03-23T23:58:27.744600+0000","last_fullsized":"2024-03-23T23:58:27.744600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":3645,"log_dups_size":0,"ondisk_log_size":3645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:33.260151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54155,"num_write_kb":623068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"27'4100","reported_seq":4123,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.407456+0000","last_change":"2024-03-23T23:42:50.746115+0000","last_active":"2024-03-23T23:58:30.407456+0000","last_peered":"2024-03-23T23:58:30.407456+0000","last_clean":"2024-03-23T23:58:30.407456+0000","last_became_active":"2024-03-23T23:42:50.745858+0000","last_became_peered":"2024-03-23T23:42:50.745858+0000","last_unstale":"2024-03-23T23:58:30.407456+0000","last_undegraded":"2024-03-23T23:58:30.407456+0000","last_fullsized":"2024-03-23T23:58:30.407456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4100,"log_dups_size":0,"ondisk_log_size":4100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:00:43.318455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":60470,"num_write_kb":714617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"27'5162","reported_seq":5192,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.639052+0000","last_change":"2024-03-23T23:42:40.702089+0000","last_active":"2024-03-23T23:58:27.639052+0000","last_peered":"2024-03-23T23:58:27.639052+0000","last_clean":"2024-03-23T23:58:27.639052+0000","last_became_active":"2024-03-23T23:42:40.701874+0000","last_became_peered":"2024-03-23T23:42:40.701874+0000","last_unstale":"2024-03-23T23:58:27.639052+0000","last_undegraded":"2024-03-23T23:58:27.639052+0000","last_fullsized":"2024-03-23T23:58:27.639052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5162,"log_dups_size":0,"ondisk_log_size":5162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76848,"num_write_kb":918422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"27'4942","reported_seq":4964,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.417067+0000","last_change":"2024-03-23T23:42:50.773115+0000","last_active":"2024-03-23T23:57:53.417067+0000","last_peered":"2024-03-23T23:57:53.417067+0000","last_clean":"2024-03-23T23:57:53.417067+0000","last_became_active":"2024-03-23T23:42:50.772849+0000","last_became_peered":"2024-03-23T23:42:50.772849+0000","last_unstale":"2024-03-23T23:57:53.417067+0000","last_undegraded":"2024-03-23T23:57:53.417067+0000","last_fullsized":"2024-03-23T23:57:53.417067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4942,"log_dups_size":0,"ondisk_log_size":4942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:29:42.898728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73640,"num_write_kb":854588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"27'5693","reported_seq":5722,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.736454+0000","last_change":"2024-03-23T23:42:40.703254+0000","last_active":"2024-03-23T23:58:27.736454+0000","last_peered":"2024-03-23T23:58:27.736454+0000","last_clean":"2024-03-23T23:58:27.736454+0000","last_became_active":"2024-03-23T23:42:40.702447+0000","last_became_peered":"2024-03-23T23:42:40.702447+0000","last_unstale":"2024-03-23T23:58:27.736454+0000","last_undegraded":"2024-03-23T23:58:27.736454+0000","last_fullsized":"2024-03-23T23:58:27.736454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5693,"log_dups_size":0,"ondisk_log_size":5693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:59:45.154553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84473,"num_write_kb":1008808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"27'4442","reported_seq":4464,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.421588+0000","last_change":"2024-03-23T23:42:50.748946+0000","last_active":"2024-03-23T23:57:53.421588+0000","last_peered":"2024-03-23T23:57:53.421588+0000","last_clean":"2024-03-23T23:57:53.421588+0000","last_became_active":"2024-03-23T23:42:50.745205+0000","last_became_peered":"2024-03-23T23:42:50.745205+0000","last_unstale":"2024-03-23T23:57:53.421588+0000","last_undegraded":"2024-03-23T23:57:53.421588+0000","last_fullsized":"2024-03-23T23:57:53.421588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4442,"log_dups_size":0,"ondisk_log_size":4442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:58:16.372010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65706,"num_write_kb":746784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"27'6094","reported_seq":6124,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:56.815848+0000","last_change":"2024-03-23T23:42:40.714331+0000","last_active":"2024-03-23T23:54:56.815848+0000","last_peered":"2024-03-23T23:54:56.815848+0000","last_clean":"2024-03-23T23:54:56.815848+0000","last_became_active":"2024-03-23T23:42:40.713737+0000","last_became_peered":"2024-03-23T23:42:40.713737+0000","last_unstale":"2024-03-23T23:54:56.815848+0000","last_undegraded":"2024-03-23T23:54:56.815848+0000","last_fullsized":"2024-03-23T23:54:56.815848+0000","mapping_epoch":19,"log_start":"27'400","ondisk_log_start":"27'400","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5694,"log_dups_size":0,"ondisk_log_size":5694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:24:43.902129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90841,"num_write_kb":1111853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"27'6495","reported_seq":6518,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.399771+0000","last_change":"2024-03-23T23:42:50.746666+0000","last_active":"2024-03-23T23:57:53.399771+0000","last_peered":"2024-03-23T23:57:53.399771+0000","last_clean":"2024-03-23T23:57:53.399771+0000","last_became_active":"2024-03-23T23:42:50.746149+0000","last_became_peered":"2024-03-23T23:42:50.746149+0000","last_unstale":"2024-03-23T23:57:53.399771+0000","last_undegraded":"2024-03-23T23:57:53.399771+0000","last_fullsized":"2024-03-23T23:57:53.399771+0000","mapping_epoch":23,"log_start":"27'1200","ondisk_log_start":"27'1200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5295,"log_dups_size":0,"ondisk_log_size":5295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:42:58.533499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96498,"num_write_kb":1062339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"27'5291","reported_seq":5321,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:04.355114+0000","last_change":"2024-03-23T23:42:40.710655+0000","last_active":"2024-03-23T23:55:04.355114+0000","last_peered":"2024-03-23T23:55:04.355114+0000","last_clean":"2024-03-23T23:55:04.355114+0000","last_became_active":"2024-03-23T23:42:40.710362+0000","last_became_peered":"2024-03-23T23:42:40.710362+0000","last_unstale":"2024-03-23T23:55:04.355114+0000","last_undegraded":"2024-03-23T23:55:04.355114+0000","last_fullsized":"2024-03-23T23:55:04.355114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5291,"log_dups_size":0,"ondisk_log_size":5291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:12:14.359173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79360,"num_write_kb":955033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"27'4846","reported_seq":4869,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.646399+0000","last_change":"2024-03-23T23:42:50.753397+0000","last_active":"2024-03-23T23:57:57.646399+0000","last_peered":"2024-03-23T23:57:57.646399+0000","last_clean":"2024-03-23T23:57:57.646399+0000","last_became_active":"2024-03-23T23:42:50.753085+0000","last_became_peered":"2024-03-23T23:42:50.753085+0000","last_unstale":"2024-03-23T23:57:57.646399+0000","last_undegraded":"2024-03-23T23:57:57.646399+0000","last_fullsized":"2024-03-23T23:57:57.646399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4846,"log_dups_size":0,"ondisk_log_size":4846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:25:44.894505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71990,"num_write_kb":829684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"27'5525","reported_seq":5555,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:07.300744+0000","last_change":"2024-03-23T23:42:40.689380+0000","last_active":"2024-03-23T23:55:07.300744+0000","last_peered":"2024-03-23T23:55:07.300744+0000","last_clean":"2024-03-23T23:55:07.300744+0000","last_became_active":"2024-03-23T23:42:40.689023+0000","last_became_peered":"2024-03-23T23:42:40.689023+0000","last_unstale":"2024-03-23T23:55:07.300744+0000","last_undegraded":"2024-03-23T23:55:07.300744+0000","last_fullsized":"2024-03-23T23:55:07.300744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5525,"log_dups_size":0,"ondisk_log_size":5525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:17:19.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82240,"num_write_kb":999067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"27'4495","reported_seq":4518,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.417023+0000","last_change":"2024-03-23T23:42:50.756133+0000","last_active":"2024-03-23T23:58:30.417023+0000","last_peered":"2024-03-23T23:58:30.417023+0000","last_clean":"2024-03-23T23:58:30.417023+0000","last_became_active":"2024-03-23T23:42:50.755405+0000","last_became_peered":"2024-03-23T23:42:50.755405+0000","last_unstale":"2024-03-23T23:58:30.417023+0000","last_undegraded":"2024-03-23T23:58:30.417023+0000","last_fullsized":"2024-03-23T23:58:30.417023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4495,"log_dups_size":0,"ondisk_log_size":4495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:46:10.784416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66847,"num_write_kb":769767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"27'4564","reported_seq":4594,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.681397+0000","last_change":"2024-03-23T23:42:40.698234+0000","last_active":"2024-03-23T23:58:27.681397+0000","last_peered":"2024-03-23T23:58:27.681397+0000","last_clean":"2024-03-23T23:58:27.681397+0000","last_became_active":"2024-03-23T23:42:40.695978+0000","last_became_peered":"2024-03-23T23:42:40.695978+0000","last_unstale":"2024-03-23T23:58:27.681397+0000","last_undegraded":"2024-03-23T23:58:27.681397+0000","last_fullsized":"2024-03-23T23:58:27.681397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4564,"log_dups_size":0,"ondisk_log_size":4564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:04.633288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67848,"num_write_kb":796612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"27'5522","reported_seq":5545,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.400864+0000","last_change":"2024-03-23T23:42:50.752051+0000","last_active":"2024-03-23T23:57:53.400864+0000","last_peered":"2024-03-23T23:57:53.400864+0000","last_clean":"2024-03-23T23:57:53.400864+0000","last_became_active":"2024-03-23T23:42:50.751738+0000","last_became_peered":"2024-03-23T23:42:50.751738+0000","last_unstale":"2024-03-23T23:57:53.400864+0000","last_undegraded":"2024-03-23T23:57:53.400864+0000","last_fullsized":"2024-03-23T23:57:53.400864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5522,"log_dups_size":0,"ondisk_log_size":5522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:20:53.750917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81884,"num_write_kb":915818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'4910","reported_seq":4940,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:17.782378+0000","last_change":"2024-03-23T23:42:40.698407+0000","last_active":"2024-03-23T23:55:17.782378+0000","last_peered":"2024-03-23T23:55:17.782378+0000","last_clean":"2024-03-23T23:55:17.782378+0000","last_became_active":"2024-03-23T23:42:40.698092+0000","last_became_peered":"2024-03-23T23:42:40.698092+0000","last_unstale":"2024-03-23T23:55:17.782378+0000","last_undegraded":"2024-03-23T23:55:17.782378+0000","last_fullsized":"2024-03-23T23:55:17.782378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4910,"log_dups_size":0,"ondisk_log_size":4910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:00:33.261296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73128,"num_write_kb":826128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"27'4578","reported_seq":4600,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.631712+0000","last_change":"2024-03-23T23:42:50.753000+0000","last_active":"2024-03-23T23:57:57.631712+0000","last_peered":"2024-03-23T23:57:57.631712+0000","last_clean":"2024-03-23T23:57:57.631712+0000","last_became_active":"2024-03-23T23:42:50.752614+0000","last_became_peered":"2024-03-23T23:42:50.752614+0000","last_unstale":"2024-03-23T23:57:57.631712+0000","last_undegraded":"2024-03-23T23:57:57.631712+0000","last_fullsized":"2024-03-23T23:57:57.631712+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4578,"log_dups_size":0,"ondisk_log_size":4578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:57:04.394872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67913,"num_write_kb":776364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"27'4451","reported_seq":4482,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.674349+0000","last_change":"2024-03-23T23:42:40.700631+0000","last_active":"2024-03-23T23:58:27.674349+0000","last_peered":"2024-03-23T23:58:27.674349+0000","last_clean":"2024-03-23T23:58:27.674349+0000","last_became_active":"2024-03-23T23:42:40.697932+0000","last_became_peered":"2024-03-23T23:42:40.697932+0000","last_unstale":"2024-03-23T23:58:27.674349+0000","last_undegraded":"2024-03-23T23:58:27.674349+0000","last_fullsized":"2024-03-23T23:58:27.674349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4451,"log_dups_size":0,"ondisk_log_size":4451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:05:17.694245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66105,"num_write_kb":808863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"27'4925","reported_seq":4947,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.418583+0000","last_change":"2024-03-23T23:42:50.765991+0000","last_active":"2024-03-23T23:58:30.418583+0000","last_peered":"2024-03-23T23:58:30.418583+0000","last_clean":"2024-03-23T23:58:30.418583+0000","last_became_active":"2024-03-23T23:42:50.765716+0000","last_became_peered":"2024-03-23T23:42:50.765716+0000","last_unstale":"2024-03-23T23:58:30.418583+0000","last_undegraded":"2024-03-23T23:58:30.418583+0000","last_fullsized":"2024-03-23T23:58:30.418583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4925,"log_dups_size":0,"ondisk_log_size":4925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:49:52.067143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72768,"num_write_kb":776524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'5362","reported_seq":5393,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.647477+0000","last_change":"2024-03-23T23:42:40.683983+0000","last_active":"2024-03-23T23:58:27.647477+0000","last_peered":"2024-03-23T23:58:27.647477+0000","last_clean":"2024-03-23T23:58:27.647477+0000","last_became_active":"2024-03-23T23:42:40.683711+0000","last_became_peered":"2024-03-23T23:42:40.683711+0000","last_unstale":"2024-03-23T23:58:27.647477+0000","last_undegraded":"2024-03-23T23:58:27.647477+0000","last_fullsized":"2024-03-23T23:58:27.647477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5362,"log_dups_size":0,"ondisk_log_size":5362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:51:30.695597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79587,"num_write_kb":960150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"27'5549","reported_seq":5571,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.188872+0000","last_change":"2024-03-23T23:42:50.766544+0000","last_active":"2024-03-23T23:57:53.188872+0000","last_peered":"2024-03-23T23:57:53.188872+0000","last_clean":"2024-03-23T23:57:53.188872+0000","last_became_active":"2024-03-23T23:42:50.766328+0000","last_became_peered":"2024-03-23T23:42:50.766328+0000","last_unstale":"2024-03-23T23:57:53.188872+0000","last_undegraded":"2024-03-23T23:57:53.188872+0000","last_fullsized":"2024-03-23T23:57:53.188872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5549,"log_dups_size":0,"ondisk_log_size":5549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:28:43.677331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82850,"num_write_kb":926357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"27'6244","reported_seq":6275,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.641054+0000","last_change":"2024-03-23T23:42:40.678622+0000","last_active":"2024-03-23T23:58:27.641054+0000","last_peered":"2024-03-23T23:58:27.641054+0000","last_clean":"2024-03-23T23:58:27.641054+0000","last_became_active":"2024-03-23T23:42:40.678325+0000","last_became_peered":"2024-03-23T23:42:40.678325+0000","last_unstale":"2024-03-23T23:58:27.641054+0000","last_undegraded":"2024-03-23T23:58:27.641054+0000","last_fullsized":"2024-03-23T23:58:27.641054+0000","mapping_epoch":19,"log_start":"27'500","ondisk_log_start":"27'500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5744,"log_dups_size":0,"ondisk_log_size":5744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:54:27.641281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92992,"num_write_kb":1109347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"27'5524","reported_seq":5546,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.633709+0000","last_change":"2024-03-23T23:42:50.750690+0000","last_active":"2024-03-23T23:57:57.633709+0000","last_peered":"2024-03-23T23:57:57.633709+0000","last_clean":"2024-03-23T23:57:57.633709+0000","last_became_active":"2024-03-23T23:42:50.750466+0000","last_became_peered":"2024-03-23T23:42:50.750466+0000","last_unstale":"2024-03-23T23:57:57.633709+0000","last_undegraded":"2024-03-23T23:57:57.633709+0000","last_fullsized":"2024-03-23T23:57:57.633709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5524,"log_dups_size":0,"ondisk_log_size":5524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:13:07.156401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82257,"num_write_kb":938007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"27'4800","reported_seq":4831,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:12.437938+0000","last_change":"2024-03-23T23:42:40.701959+0000","last_active":"2024-03-23T23:55:12.437938+0000","last_peered":"2024-03-23T23:55:12.437938+0000","last_clean":"2024-03-23T23:55:12.437938+0000","last_became_active":"2024-03-23T23:42:40.700855+0000","last_became_peered":"2024-03-23T23:42:40.700855+0000","last_unstale":"2024-03-23T23:55:12.437938+0000","last_undegraded":"2024-03-23T23:55:12.437938+0000","last_fullsized":"2024-03-23T23:55:12.437938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4800,"log_dups_size":0,"ondisk_log_size":4800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:49:42.009983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71971,"num_write_kb":878476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":4985198,"num_write_kb":56700971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":327149,"ondisk_log_size":327149,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":98084343,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":31,"num_read_kb":105,"num_write":4488,"num_write_kb":97547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":196231168,"data_stored":196168686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4210,"ondisk_log_size":4210,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":11,"num_write":4962178,"num_write_kb":59383104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326429,"ondisk_log_size":326429,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":93601894,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":44,"num_read_kb":115,"num_write":4044,"num_write_kb":93019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":187265024,"data_stored":187203539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3815,"ondisk_log_size":3815,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509634,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":612204,"kb_used_data":49444,"kb_used_omap":1,"kb_used_meta":562750,"kb_avail":93759636,"statfs":{"total":96636764160,"available":96009867264,"internally_reserved":0,"allocated":50630656,"data_stored":50448059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":576256454},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509630,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":889852,"kb_used_data":37236,"kb_used_omap":1,"kb_used_meta":852606,"kb_avail":93481988,"statfs":{"total":96636764160,"available":95725555712,"internally_reserved":0,"allocated":38129664,"data_stored":37949267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":873068997},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509629,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":997916,"kb_used_data":67412,"kb_used_omap":1,"kb_used_meta":930494,"kb_avail":93373924,"statfs":{"total":96636764160,"available":95614898176,"internally_reserved":0,"allocated":69029888,"data_stored":68838098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":952826309},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,4,0,4,2,5,22],"upper_bound":512},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509630,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":977816,"kb_used_data":56336,"kb_used_omap":1,"kb_used_meta":921470,"kb_avail":93394024,"statfs":{"total":96636764160,"available":95635480576,"internally_reserved":0,"allocated":57688064,"data_stored":57497163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":943585735},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542332,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":916712,"kb_used_data":58208,"kb_used_omap":1,"kb_used_meta":858494,"kb_avail":93455128,"statfs":{"total":96636764160,"available":95698051072,"internally_reserved":0,"allocated":59604992,"data_stored":59426419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":879098314},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542338,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":575412,"kb_used_data":12652,"kb_used_omap":1,"kb_used_meta":562750,"kb_avail":93796428,"statfs":{"total":96636764160,"available":96047542272,"internally_reserved":0,"allocated":12955648,"data_stored":12782666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":576256453},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542337,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":775792,"kb_used_data":62952,"kb_used_omap":1,"kb_used_meta":712830,"kb_avail":93596048,"statfs":{"total":96636764160,"available":95842353152,"internally_reserved":0,"allocated":64462848,"data_stored":64271712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":729938373},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542336,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":736108,"kb_used_data":33636,"kb_used_omap":1,"kb_used_meta":702462,"kb_avail":93635732,"statfs":{"total":96636764160,"available":95882989568,"internally_reserved":0,"allocated":34443264,"data_stored":34260561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":719321541},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25178112,"data_stored":25166462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22224896,"data_stored":22212855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4280320,"data_stored":4278865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18112512,"data_stored":18103375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":33566720,"data_stored":33554558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20971610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20979712,"data_stored":20972192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":41947136,"data_stored":41943622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41955328,"data_stored":41943734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8392704,"data_stored":8388678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":39292928,"data_stored":39278665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":35180544,"data_stored":35168417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16871424,"data_stored":16862534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29368320,"data_stored":29360744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16777306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T23:58:32.189 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:58:32.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.366+0000 7f955c600640 1 Processor -- start 2024-03-23T23:58:32.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.366+0000 7f955c600640 1 -- start start 2024-03-23T23:58:32.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.366+0000 7f955c600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f95540aadb0 0x7f9554071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:32.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.366+0000 7f955c600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f955406fea0 0x7f95540724e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:32.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.366+0000 7f955c600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95540a9610 con 0x7f955414d8b0 2024-03-23T23:58:32.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.366+0000 7f955c600640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f955406bdd0 con 0x7f95540aadb0 2024-03-23T23:58:32.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.366+0000 7f955c600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9554072a20 con 0x7f955406fea0 2024-03-23T23:58:32.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.366+0000 7f9559200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f95540aadb0 0x7f9554071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:32.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.366+0000 7f9559200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f95540aadb0 0x7f9554071fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58684/0 (socket says 172.21.15.8:58684) 2024-03-23T23:58:32.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.366+0000 7f9559c00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f955414d8b0 0x7f955406b170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:44394/0 (socket says 172.21.15.8:44394) 2024-03-23T23:58:32.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.366+0000 7f9559200640 1 -- 172.21.15.8:0/2265739092 learned_addr learned my addr 172.21.15.8:0/2265739092 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:32.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.366+0000 7f955a600640 1 --2- 172.21.15.8:0/2265739092 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f955406fea0 0x7f95540724e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:32.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.366+0000 7f9559200640 1 -- 172.21.15.8:0/2265739092 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f955406fea0 msgr2=0x7f95540724e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:32.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.366+0000 7f9559200640 1 --2- 172.21.15.8:0/2265739092 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f955406fea0 0x7f95540724e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:32.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.366+0000 7f9559200640 1 -- 172.21.15.8:0/2265739092 >> v1:172.21.15.196:6789/0 conn(0x7f955414d8b0 legacy=0x7f955406b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:32.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.366+0000 7f9559200640 1 -- 172.21.15.8:0/2265739092 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9554072bd0 con 0x7f95540aadb0 2024-03-23T23:58:32.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.366+0000 7f9553e00640 1 -- 172.21.15.8:0/2265739092 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438557035 0 0) 0x7f95540a9610 con 0x7f955414d8b0 2024-03-23T23:58:32.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.370+0000 7f9559200640 1 --2- 172.21.15.8:0/2265739092 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95540aadb0 0x7f9554071fa0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9540009870 tx=0x7f954001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d2a44344f3c510 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:32.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.374+0000 7f9553e00640 1 -- 172.21.15.8:0/2265739092 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95400b0070 con 0x7f95540aadb0 2024-03-23T23:58:32.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.374+0000 7f9553e00640 1 -- 172.21.15.8:0/2265739092 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9540004230 con 0x7f95540aadb0 2024-03-23T23:58:32.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.374+0000 7f9553e00640 1 -- 172.21.15.8:0/2265739092 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9540003620 con 0x7f95540aadb0 2024-03-23T23:58:32.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.374+0000 7f955c600640 1 -- 172.21.15.8:0/2265739092 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95540aadb0 msgr2=0x7f9554071fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:32.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.374+0000 7f955c600640 1 --2- 172.21.15.8:0/2265739092 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95540aadb0 0x7f9554071fa0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9540009870 tx=0x7f954001c440 comp rx=0 tx=0).stop 2024-03-23T23:58:32.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.374+0000 7f955c600640 1 -- 172.21.15.8:0/2265739092 shutdown_connections 2024-03-23T23:58:32.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.374+0000 7f955c600640 1 --2- 172.21.15.8:0/2265739092 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f955406fea0 0x7f95540724e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:32.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.374+0000 7f955c600640 1 --2- 172.21.15.8:0/2265739092 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95540aadb0 0x7f9554071fa0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:32.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.374+0000 7f955c600640 1 -- 172.21.15.8:0/2265739092 >> 172.21.15.8:0/2265739092 conn(0x7f955406c280 msgr2=0x7f955406c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:32.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.374+0000 7f955c600640 1 -- 172.21.15.8:0/2265739092 shutdown_connections 2024-03-23T23:58:32.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.374+0000 7f955c600640 1 -- 172.21.15.8:0/2265739092 wait complete. 2024-03-23T23:58:32.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.374+0000 7f955c600640 1 Processor -- start 2024-03-23T23:58:32.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.374+0000 7f955c600640 1 -- start start 2024-03-23T23:58:32.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.374+0000 7f955c600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f955406fea0 0x7f95540c7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:32.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.374+0000 7f955c600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95540aadb0 0x7f9554156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:32.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.374+0000 7f955c600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f955414d8b0 0x7f9554156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:32.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.374+0000 7f955c600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9554160b60 con 0x7f955406fea0 2024-03-23T23:58:32.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.374+0000 7f955c600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95541609e0 con 0x7f955414d8b0 2024-03-23T23:58:32.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.374+0000 7f955c600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9554160ce0 con 0x7f95540aadb0 2024-03-23T23:58:32.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.374+0000 7f9559c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f955406fea0 0x7f95540c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:32.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.374+0000 7f9559c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f955406fea0 0x7f95540c7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58696/0 (socket says 172.21.15.8:58696) 2024-03-23T23:58:32.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.374+0000 7f9559c00640 1 -- 172.21.15.8:0/234787370 learned_addr learned my addr 172.21.15.8:0/234787370 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:32.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.374+0000 7f955a600640 1 --2- 172.21.15.8:0/234787370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f955414d8b0 0x7f9554156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:32.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.374+0000 7f9559200640 1 --2- 172.21.15.8:0/234787370 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95540aadb0 0x7f9554156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:32.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.378+0000 7f9559c00640 1 -- 172.21.15.8:0/234787370 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95540aadb0 msgr2=0x7f9554156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:32.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.378+0000 7f9559c00640 1 --2- 172.21.15.8:0/234787370 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95540aadb0 0x7f9554156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:32.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.378+0000 7f9559c00640 1 -- 172.21.15.8:0/234787370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f955414d8b0 msgr2=0x7f9554156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:32.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.378+0000 7f9559c00640 1 --2- 172.21.15.8:0/234787370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f955414d8b0 0x7f9554156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:32.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.378+0000 7f9559c00640 1 -- 172.21.15.8:0/234787370 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f955414b670 con 0x7f955406fea0 2024-03-23T23:58:32.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.378+0000 7f9559c00640 1 --2- 172.21.15.8:0/234787370 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f955406fea0 0x7f95540c7090 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f954800c480 tx=0x7f954800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:32.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.378+0000 7f9551600640 1 -- 172.21.15.8:0/234787370 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9548018070 con 0x7f955406fea0 2024-03-23T23:58:32.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.378+0000 7f9551600640 1 -- 172.21.15.8:0/234787370 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95480074a0 con 0x7f955406fea0 2024-03-23T23:58:32.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.378+0000 7f9551600640 1 -- 172.21.15.8:0/234787370 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9548004a30 con 0x7f955406fea0 2024-03-23T23:58:32.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.378+0000 7f955c600640 1 -- 172.21.15.8:0/234787370 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f955414b910 con 0x7f955406fea0 2024-03-23T23:58:32.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.378+0000 7f955c600640 1 -- 172.21.15.8:0/234787370 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9554156400 con 0x7f955406fea0 2024-03-23T23:58:32.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.378+0000 7f955c600640 1 -- 172.21.15.8:0/234787370 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9554068270 con 0x7f955406fea0 2024-03-23T23:58:32.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.378+0000 7f9551600640 1 -- 172.21.15.8:0/234787370 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f954801b070 con 0x7f955406fea0 2024-03-23T23:58:32.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.382+0000 7f9551600640 1 --2- 172.21.15.8:0/234787370 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9534067660 0x7f9534069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:32.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.382+0000 7f9551600640 1 -- 172.21.15.8:0/234787370 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f9548084e90 con 0x7f955406fea0 2024-03-23T23:58:32.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.382+0000 7f9559200640 1 --2- 172.21.15.8:0/234787370 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9534067660 0x7f9534069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:32.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.382+0000 7f9559200640 1 --2- 172.21.15.8:0/234787370 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9534067660 0x7f9534069b20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f95400ad000 tx=0x7f95400a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:32.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.386+0000 7f9551600640 1 -- 172.21.15.8:0/234787370 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f95480550f0 con 0x7f955406fea0 2024-03-23T23:58:32.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.550+0000 7f955c600640 1 -- 172.21.15.8:0/234787370 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f955415dd90 con 0x7f955406fea0 2024-03-23T23:58:32.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.554+0000 7f9551600640 1 -- 172.21.15.8:0/234787370 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20567 (secure 0 0 0) 0x7f9548086090 con 0x7f955406fea0 2024-03-23T23:58:32.555 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:58:32.555 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":27,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","created":"2024-03-23T23:42:15.169430+0000","modified":"2024-03-23T23:43:21.884365+0000","last_up_change":"2024-03-23T23:42:26.509742+0000","last_in_change":"2024-03-23T23:42:17.662330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:42:26.327445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-23T23:42:38.218800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-23T23:42:39.054195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-23T23:42:48.327799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-23T23:42:49.113061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e967bf31-21d6-4d11-bc3d-0df8177a1b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6809","nonce":2187201732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6811","nonce":2187201732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6815","nonce":2187201732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6813","nonce":2187201732}]},"public_addr":"172.21.15.8:6809/2187201732","cluster_addr":"172.21.15.8:6811/2187201732","heartbeat_back_addr":"172.21.15.8:6815/2187201732","heartbeat_front_addr":"172.21.15.8:6813/2187201732","state":["exists","up"]},{"osd":1,"uuid":"c8e33701-7acd-4474-8402-d52461171fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6818","nonce":3205168010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6822","nonce":3205168010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6830","nonce":3205168010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6826","nonce":3205168010}]},"public_addr":"172.21.15.8:6818/3205168010","cluster_addr":"172.21.15.8:6822/3205168010","heartbeat_back_addr":"172.21.15.8:6830/3205168010","heartbeat_front_addr":"172.21.15.8:6826/3205168010","state":["exists","up"]},{"osd":2,"uuid":"ceebdbf7-4c2f-4757-b52d-fd8b20e77570","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6801","nonce":475463656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6803","nonce":475463656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6807","nonce":475463656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6805","nonce":475463656}]},"public_addr":"172.21.15.8:6801/475463656","cluster_addr":"172.21.15.8:6803/475463656","heartbeat_back_addr":"172.21.15.8:6807/475463656","heartbeat_front_addr":"172.21.15.8:6805/475463656","state":["exists","up"]},{"osd":3,"uuid":"89e258da-5767-429e-8441-edf877d2f3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6819","nonce":1514082871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6821","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6823","nonce":1514082871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6829","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6831","nonce":1514082871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6825","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6827","nonce":1514082871}]},"public_addr":"172.21.15.8:6819/1514082871","cluster_addr":"172.21.15.8:6823/1514082871","heartbeat_back_addr":"172.21.15.8:6831/1514082871","heartbeat_front_addr":"172.21.15.8:6827/1514082871","state":["exists","up"]},{"osd":4,"uuid":"2b7451ae-ea16-4f0a-ae50-04fde75e45ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6825","nonce":3516578147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6827","nonce":3516578147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6831","nonce":3516578147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6829","nonce":3516578147}]},"public_addr":"172.21.15.196:6825/3516578147","cluster_addr":"172.21.15.196:6827/3516578147","heartbeat_back_addr":"172.21.15.196:6831/3516578147","heartbeat_front_addr":"172.21.15.196:6829/3516578147","state":["exists","up"]},{"osd":5,"uuid":"e68a8914-e591-466a-bc9e-f2d7c67aac13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6802","nonce":830595758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6806","nonce":830595758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6814","nonce":830595758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6810","nonce":830595758}]},"public_addr":"172.21.15.196:6802/830595758","cluster_addr":"172.21.15.196:6806/830595758","heartbeat_back_addr":"172.21.15.196:6814/830595758","heartbeat_front_addr":"172.21.15.196:6810/830595758","state":["exists","up"]},{"osd":6,"uuid":"e47723c5-50a0-4cd8-92d9-01972072b422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6801","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6803","nonce":472639906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6805","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6807","nonce":472639906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6815","nonce":472639906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6811","nonce":472639906}]},"public_addr":"172.21.15.196:6803/472639906","cluster_addr":"172.21.15.196:6807/472639906","heartbeat_back_addr":"172.21.15.196:6815/472639906","heartbeat_front_addr":"172.21.15.196:6811/472639906","state":["exists","up"]},{"osd":7,"uuid":"e1e9113d-8005-47b3-9a75-9e701199f1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6817","nonce":4151820349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6819","nonce":4151820349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6823","nonce":4151820349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6821","nonce":4151820349}]},"public_addr":"172.21.15.196:6817/4151820349","cluster_addr":"172.21.15.196:6819/4151820349","heartbeat_back_addr":"172.21.15.196:6823/4151820349","heartbeat_front_addr":"172.21.15.196:6821/4151820349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.221790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.265974+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.190319+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.376359+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.329657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.402958+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.300703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.133121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:58:32.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.554+0000 7f955c600640 1 -- 172.21.15.8:0/234787370 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9534067660 msgr2=0x7f9534069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:32.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.554+0000 7f955c600640 1 --2- 172.21.15.8:0/234787370 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9534067660 0x7f9534069b20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f95400ad000 tx=0x7f95400a6000 comp rx=0 tx=0).stop 2024-03-23T23:58:32.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.554+0000 7f955c600640 1 -- 172.21.15.8:0/234787370 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f955406fea0 msgr2=0x7f95540c7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:32.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.554+0000 7f955c600640 1 --2- 172.21.15.8:0/234787370 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f955406fea0 0x7f95540c7090 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f954800c480 tx=0x7f954800c940 comp rx=0 tx=0).stop 2024-03-23T23:58:32.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.554+0000 7f955c600640 1 -- 172.21.15.8:0/234787370 shutdown_connections 2024-03-23T23:58:32.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.554+0000 7f955c600640 1 --2- 172.21.15.8:0/234787370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f955414d8b0 0x7f9554156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:32.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.554+0000 7f955c600640 1 --2- 172.21.15.8:0/234787370 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9534067660 0x7f9534069b20 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:32.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.554+0000 7f955c600640 1 --2- 172.21.15.8:0/234787370 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95540aadb0 0x7f9554156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:32.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.554+0000 7f955c600640 1 --2- 172.21.15.8:0/234787370 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f955406fea0 0x7f95540c7090 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:32.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.554+0000 7f955c600640 1 -- 172.21.15.8:0/234787370 >> 172.21.15.8:0/234787370 conn(0x7f955406c280 msgr2=0x7f9554153af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:32.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.554+0000 7f955c600640 1 -- 172.21.15.8:0/234787370 shutdown_connections 2024-03-23T23:58:32.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:32.554+0000 7f955c600640 1 -- 172.21.15.8:0/234787370 wait complete. 2024-03-23T23:58:33.577 INFO:tasks.ceph:Scrubbing osd.0 2024-03-23T23:58:33.577 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-23T23:58:33.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.726+0000 7f818ba00640 1 Processor -- start 2024-03-23T23:58:33.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.726+0000 7f818ba00640 1 -- start start 2024-03-23T23:58:33.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.726+0000 7f818ba00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f81841590a0 0x7f81840a6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:33.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.726+0000 7f818ba00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81840c7670 con 0x7f81841598c0 2024-03-23T23:58:33.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.726+0000 7f818ba00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81840a7220 con 0x7f81840c3da0 2024-03-23T23:58:33.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.726+0000 7f818ba00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818406bd20 con 0x7f81841590a0 2024-03-23T23:58:33.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.726+0000 7f817be00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f81841598c0 0x7f81840c5d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:55912/0 (socket says 172.21.15.8:55912) 2024-03-23T23:58:33.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.726+0000 7f817be00640 1 -- 172.21.15.8:0/2670780458 learned_addr learned my addr 172.21.15.8:0/2670780458 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:58:33.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.726+0000 7f8189000640 1 --2- 172.21.15.8:0/2670780458 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f81841590a0 0x7f81840a6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:33.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.726+0000 7f8183e00640 1 -- 172.21.15.8:0/2670780458 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3874047293 0 0) 0x7f81840c7670 con 0x7f81841598c0 2024-03-23T23:58:33.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.730+0000 7f8183e00640 1 -- 172.21.15.8:0/2670780458 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8168003530 con 0x7f81841598c0 2024-03-23T23:58:33.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.730+0000 7f8183e00640 1 -- 172.21.15.8:0/2670780458 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 133410757 0 0) 0x7f81840a7220 con 0x7f81840c3da0 2024-03-23T23:58:33.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.730+0000 7f8183e00640 1 -- 172.21.15.8:0/2670780458 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81840c7670 con 0x7f81840c3da0 2024-03-23T23:58:33.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.730+0000 7f8189000640 1 -- 172.21.15.8:0/2670780458 >> v1:172.21.15.196:6789/0 conn(0x7f81840c3da0 legacy=0x7f8184152cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:33.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.730+0000 7f8189000640 1 -- 172.21.15.8:0/2670780458 >> v1:172.21.15.8:6789/0 conn(0x7f81841598c0 legacy=0x7f81840c5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:33.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.730+0000 7f8189000640 1 -- 172.21.15.8:0/2670780458 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818406c000 con 0x7f81841590a0 2024-03-23T23:58:33.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.730+0000 7f8189000640 1 --2- 172.21.15.8:0/2670780458 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f81841590a0 0x7f81840a6ce0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f81740097f0 tx=0x7f817401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcdd1c043d4335b8 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:33.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.730+0000 7f8183e00640 1 -- 172.21.15.8:0/2670780458 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81740ab5f0 con 0x7f81841590a0 2024-03-23T23:58:33.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.730+0000 7f8183e00640 1 -- 172.21.15.8:0/2670780458 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81740b0070 con 0x7f81841590a0 2024-03-23T23:58:33.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.730+0000 7f8183e00640 1 -- 172.21.15.8:0/2670780458 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81740ab9b0 con 0x7f81841590a0 2024-03-23T23:58:33.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.730+0000 7f818ba00640 1 -- 172.21.15.8:0/2670780458 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f81841590a0 msgr2=0x7f81840a6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:33.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.730+0000 7f818ba00640 1 --2- 172.21.15.8:0/2670780458 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f81841590a0 0x7f81840a6ce0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f81740097f0 tx=0x7f817401c4e0 comp rx=0 tx=0).stop 2024-03-23T23:58:33.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.734+0000 7f818ba00640 1 -- 172.21.15.8:0/2670780458 shutdown_connections 2024-03-23T23:58:33.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.734+0000 7f818ba00640 1 --2- 172.21.15.8:0/2670780458 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f81841590a0 0x7f81840a6ce0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:33.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.734+0000 7f818ba00640 1 -- 172.21.15.8:0/2670780458 >> 172.21.15.8:0/2670780458 conn(0x7f81840a9640 msgr2=0x7f81840a9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:33.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.734+0000 7f818ba00640 1 -- 172.21.15.8:0/2670780458 shutdown_connections 2024-03-23T23:58:33.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.734+0000 7f818ba00640 1 -- 172.21.15.8:0/2670780458 wait complete. 2024-03-23T23:58:33.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.734+0000 7f818ba00640 1 Processor -- start 2024-03-23T23:58:33.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.734+0000 7f818ba00640 1 -- start start 2024-03-23T23:58:33.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.738+0000 7f818ba00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f81840c3da0 0x7f81841f1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:33.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.738+0000 7f818ba00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81841590a0 0x7f81840ab690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:33.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.738+0000 7f818ba00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f81841598c0 0x7f81840abbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:33.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.738+0000 7f818ba00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8184153540 con 0x7f81841590a0 2024-03-23T23:58:33.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.738+0000 7f818ba00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81841533c0 con 0x7f81840c3da0 2024-03-23T23:58:33.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.738+0000 7f818ba00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8184159480 con 0x7f81841598c0 2024-03-23T23:58:33.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.738+0000 7f817be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81841590a0 0x7f81840ab690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:33.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.738+0000 7f817be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81841590a0 0x7f81840ab690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46464/0 (socket says 172.21.15.8:46464) 2024-03-23T23:58:33.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.738+0000 7f817be00640 1 -- 172.21.15.8:0/3183920325 learned_addr learned my addr 172.21.15.8:0/3183920325 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:33.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.738+0000 7f8189000640 1 --2- 172.21.15.8:0/3183920325 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f81840c3da0 0x7f81841f1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:33.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.738+0000 7f8189a00640 1 --2- 172.21.15.8:0/3183920325 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f81841598c0 0x7f81840abbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:33.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.738+0000 7f817be00640 1 -- 172.21.15.8:0/3183920325 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f81841598c0 msgr2=0x7f81840abbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:33.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.738+0000 7f817be00640 1 --2- 172.21.15.8:0/3183920325 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f81841598c0 0x7f81840abbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:33.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.738+0000 7f817be00640 1 -- 172.21.15.8:0/3183920325 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f81840c3da0 msgr2=0x7f81841f1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:33.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.738+0000 7f817be00640 1 --2- 172.21.15.8:0/3183920325 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f81840c3da0 0x7f81841f1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:33.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.738+0000 7f817be00640 1 -- 172.21.15.8:0/3183920325 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81840a76b0 con 0x7f81841590a0 2024-03-23T23:58:33.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.738+0000 7f8189a00640 1 --2- 172.21.15.8:0/3183920325 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f81841598c0 0x7f81840abbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:58:33.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.738+0000 7f817be00640 1 --2- 172.21.15.8:0/3183920325 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81841590a0 0x7f81840ab690 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f816c00c420 tx=0x7f816c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:33.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.738+0000 7f8181600640 1 -- 172.21.15.8:0/3183920325 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c017070 con 0x7f81841590a0 2024-03-23T23:58:33.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.738+0000 7f8181600640 1 -- 172.21.15.8:0/3183920325 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816c005cf0 con 0x7f81841590a0 2024-03-23T23:58:33.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.738+0000 7f818ba00640 1 -- 172.21.15.8:0/3183920325 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81840acd40 con 0x7f81841590a0 2024-03-23T23:58:33.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.738+0000 7f8181600640 1 -- 172.21.15.8:0/3183920325 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c007310 con 0x7f81841590a0 2024-03-23T23:58:33.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.738+0000 7f818ba00640 1 -- 172.21.15.8:0/3183920325 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81840ac110 con 0x7f81841590a0 2024-03-23T23:58:33.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.738+0000 7f818ba00640 1 -- 172.21.15.8:0/3183920325 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f818404f480 con 0x7f81841590a0 2024-03-23T23:58:33.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.738+0000 7f8181600640 1 -- 172.21.15.8:0/3183920325 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f816c01a070 con 0x7f81841590a0 2024-03-23T23:58:33.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.742+0000 7f8181600640 1 --2- 172.21.15.8:0/3183920325 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8160067690 0x7f8160069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:33.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.742+0000 7f8181600640 1 -- 172.21.15.8:0/3183920325 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f816c084ff0 con 0x7f81841590a0 2024-03-23T23:58:33.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.742+0000 7f8181600640 1 --2- 172.21.15.8:0/3183920325 >> [v2:172.21.15.8:6808/2187201732,v1:172.21.15.8:6809/2187201732] conn(0x7f8160072090 0x7f8160074530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:33.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.742+0000 7f8181600640 1 -- 172.21.15.8:0/3183920325 --> [v2:172.21.15.8:6808/2187201732,v1:172.21.15.8:6809/2187201732] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f816c01be50 con 0x7f8160072090 2024-03-23T23:58:33.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.742+0000 7f8181600640 1 -- 172.21.15.8:0/3183920325 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f816c0875f0 con 0x7f81841590a0 2024-03-23T23:58:33.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.742+0000 7f8189000640 1 --2- 172.21.15.8:0/3183920325 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8160067690 0x7f8160069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:33.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.742+0000 7f8189a00640 1 --2- 172.21.15.8:0/3183920325 >> [v2:172.21.15.8:6808/2187201732,v1:172.21.15.8:6809/2187201732] conn(0x7f8160072090 0x7f8160074530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:33.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.742+0000 7f8189a00640 1 --2- 172.21.15.8:0/3183920325 >> [v2:172.21.15.8:6808/2187201732,v1:172.21.15.8:6809/2187201732] conn(0x7f8160072090 0x7f8160074530 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:33.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.742+0000 7f8189000640 1 --2- 172.21.15.8:0/3183920325 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8160067690 0x7f8160069b50 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f81740af000 tx=0x7f81740a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:33.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.742+0000 7f8181600640 1 -- 172.21.15.8:0/3183920325 <== osd.0 v2:172.21.15.8:6808/2187201732 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f816c01be50 con 0x7f8160072090 2024-03-23T23:58:33.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.754+0000 7f818ba00640 1 -- 172.21.15.8:0/3183920325 --> [v2:172.21.15.8:6808/2187201732,v1:172.21.15.8:6809/2187201732] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f818406c530 con 0x7f8160072090 2024-03-23T23:58:33.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.754+0000 7f8181600640 1 -- 172.21.15.8:0/3183920325 <== osd.0 v2:172.21.15.8:6808/2187201732 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f818406c530 con 0x7f8160072090 2024-03-23T23:58:33.757 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:58:33.757 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-23T23:58:33.757 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:58:33.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.758+0000 7f818ba00640 1 -- 172.21.15.8:0/3183920325 >> [v2:172.21.15.8:6808/2187201732,v1:172.21.15.8:6809/2187201732] conn(0x7f8160072090 msgr2=0x7f8160074530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:33.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.758+0000 7f818ba00640 1 --2- 172.21.15.8:0/3183920325 >> [v2:172.21.15.8:6808/2187201732,v1:172.21.15.8:6809/2187201732] conn(0x7f8160072090 0x7f8160074530 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:33.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.758+0000 7f818ba00640 1 -- 172.21.15.8:0/3183920325 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8160067690 msgr2=0x7f8160069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:33.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.758+0000 7f818ba00640 1 --2- 172.21.15.8:0/3183920325 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8160067690 0x7f8160069b50 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f81740af000 tx=0x7f81740a7000 comp rx=0 tx=0).stop 2024-03-23T23:58:33.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.758+0000 7f818ba00640 1 -- 172.21.15.8:0/3183920325 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81841590a0 msgr2=0x7f81840ab690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:33.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.758+0000 7f818ba00640 1 --2- 172.21.15.8:0/3183920325 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81841590a0 0x7f81840ab690 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f816c00c420 tx=0x7f816c00c8e0 comp rx=0 tx=0).stop 2024-03-23T23:58:33.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.758+0000 7f8189a00640 1 -- 172.21.15.8:0/3183920325 reap_dead start 2024-03-23T23:58:33.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.758+0000 7f818ba00640 1 -- 172.21.15.8:0/3183920325 shutdown_connections 2024-03-23T23:58:33.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.758+0000 7f818ba00640 1 -- 172.21.15.8:0/3183920325 >> 172.21.15.8:0/3183920325 conn(0x7f81840a9640 msgr2=0x7f81840c0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:33.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.758+0000 7f818ba00640 1 -- 172.21.15.8:0/3183920325 shutdown_connections 2024-03-23T23:58:33.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.758+0000 7f818ba00640 1 -- 172.21.15.8:0/3183920325 wait complete. 2024-03-23T23:58:33.775 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-23T23:58:33.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.918+0000 7f40bcc00640 1 Processor -- start 2024-03-23T23:58:33.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.918+0000 7f40bcc00640 1 -- start start 2024-03-23T23:58:33.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.918+0000 7f40bcc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40b8152ef0 0x7f40b8071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:33.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.918+0000 7f40bcc00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f40b80724e0 0x7f40b8155980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:33.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.918+0000 7f40bcc00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f40b806fd80 0x7f40b8155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:33.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.918+0000 7f40bcc00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b8159eb0 con 0x7f40b806fd80 2024-03-23T23:58:33.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.918+0000 7f40bcc00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b8159a20 con 0x7f40b80724e0 2024-03-23T23:58:33.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.918+0000 7f40bcc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b8072b40 con 0x7f40b8152ef0 2024-03-23T23:58:33.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.918+0000 7f40b6800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f40b806fd80 0x7f40b8155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:33.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.918+0000 7f40b5e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40b8152ef0 0x7f40b8071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:33.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.918+0000 7f40b5e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40b8152ef0 0x7f40b8071fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:58116/0 (socket says 172.21.15.8:58116) 2024-03-23T23:58:33.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.918+0000 7f40b5e00640 1 -- 172.21.15.8:0/4058652135 learned_addr learned my addr 172.21.15.8:0/4058652135 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:33.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.918+0000 7f40ad400640 1 --2- 172.21.15.8:0/4058652135 >> v2:172.21.15.196:3300/0 conn(0x7f40b80724e0 0x7f40b8155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:33.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.918+0000 7f40b5e00640 1 -- 172.21.15.8:0/4058652135 >> v2:172.21.15.196:3300/0 conn(0x7f40b80724e0 msgr2=0x7f40b8155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:33.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.918+0000 7f40b5e00640 1 --2- 172.21.15.8:0/4058652135 >> v2:172.21.15.196:3300/0 conn(0x7f40b80724e0 0x7f40b8155980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:33.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.918+0000 7f40b5e00640 1 -- 172.21.15.8:0/4058652135 >> v2:172.21.15.8:3300/0 conn(0x7f40b806fd80 msgr2=0x7f40b8155ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:33.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.918+0000 7f40b5e00640 1 --2- 172.21.15.8:0/4058652135 >> v2:172.21.15.8:3300/0 conn(0x7f40b806fd80 0x7f40b8155ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:33.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.918+0000 7f40b5e00640 1 -- 172.21.15.8:0/4058652135 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b81590f0 con 0x7f40b8152ef0 2024-03-23T23:58:33.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.918+0000 7f40b6800640 1 --2- 172.21.15.8:0/4058652135 >> v2:172.21.15.8:3300/0 conn(0x7f40b806fd80 0x7f40b8155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:58:33.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.922+0000 7f40b5e00640 1 --2- 172.21.15.8:0/4058652135 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40b8152ef0 0x7f40b8071fa0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f40b8071bb0 tx=0x7f40a801c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=809f8138cd3d934f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:33.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.922+0000 7f40b5400640 1 -- 172.21.15.8:0/4058652135 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a80a5670 con 0x7f40b8152ef0 2024-03-23T23:58:33.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.922+0000 7f40b5400640 1 -- 172.21.15.8:0/4058652135 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a80a5810 con 0x7f40b8152ef0 2024-03-23T23:58:33.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.922+0000 7f40b5400640 1 -- 172.21.15.8:0/4058652135 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a80a5be0 con 0x7f40b8152ef0 2024-03-23T23:58:33.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.922+0000 7f40bcc00640 1 -- 172.21.15.8:0/4058652135 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40b8152ef0 msgr2=0x7f40b8071fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:33.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.922+0000 7f40bcc00640 1 --2- 172.21.15.8:0/4058652135 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40b8152ef0 0x7f40b8071fa0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f40b8071bb0 tx=0x7f40a801c870 comp rx=0 tx=0).stop 2024-03-23T23:58:33.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.922+0000 7f40bcc00640 1 -- 172.21.15.8:0/4058652135 shutdown_connections 2024-03-23T23:58:33.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.922+0000 7f40bcc00640 1 --2- 172.21.15.8:0/4058652135 >> v2:172.21.15.8:3300/0 conn(0x7f40b806fd80 0x7f40b8155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:33.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.922+0000 7f40bcc00640 1 --2- 172.21.15.8:0/4058652135 >> v2:172.21.15.196:3300/0 conn(0x7f40b80724e0 0x7f40b8155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:33.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.922+0000 7f40bcc00640 1 --2- 172.21.15.8:0/4058652135 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40b8152ef0 0x7f40b8071fa0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:33.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.922+0000 7f40bcc00640 1 -- 172.21.15.8:0/4058652135 >> 172.21.15.8:0/4058652135 conn(0x7f40b806c280 msgr2=0x7f40b806c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:33.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.922+0000 7f40bcc00640 1 -- 172.21.15.8:0/4058652135 shutdown_connections 2024-03-23T23:58:33.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.922+0000 7f40bcc00640 1 -- 172.21.15.8:0/4058652135 wait complete. 2024-03-23T23:58:33.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.926+0000 7f40bcc00640 1 Processor -- start 2024-03-23T23:58:33.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.926+0000 7f40bcc00640 1 -- start start 2024-03-23T23:58:33.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.926+0000 7f40bcc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40b806fd80 0x7f40b8157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:33.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.926+0000 7f40bcc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40b80724e0 0x7f40b814bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:33.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.926+0000 7f40bcc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40b8152ef0 0x7f40b81492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:33.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.926+0000 7f40bcc00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b8156580 con 0x7f40b806fd80 2024-03-23T23:58:33.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.926+0000 7f40bcc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b8156400 con 0x7f40b8152ef0 2024-03-23T23:58:33.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.926+0000 7f40bcc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b80c1e70 con 0x7f40b80724e0 2024-03-23T23:58:33.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.926+0000 7f40b5e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40b806fd80 0x7f40b8157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:33.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.926+0000 7f40b5e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40b806fd80 0x7f40b8157130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46480/0 (socket says 172.21.15.8:46480) 2024-03-23T23:58:33.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.926+0000 7f40b5e00640 1 -- 172.21.15.8:0/1836092594 learned_addr learned my addr 172.21.15.8:0/1836092594 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:33.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.926+0000 7f40b6800640 1 --2- 172.21.15.8:0/1836092594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40b8152ef0 0x7f40b81492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:33.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.926+0000 7f40ad400640 1 --2- 172.21.15.8:0/1836092594 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40b80724e0 0x7f40b814bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:33.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.926+0000 7f40b5e00640 1 -- 172.21.15.8:0/1836092594 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40b80724e0 msgr2=0x7f40b814bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:33.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.926+0000 7f40b5e00640 1 --2- 172.21.15.8:0/1836092594 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40b80724e0 0x7f40b814bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:33.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.926+0000 7f40b5e00640 1 -- 172.21.15.8:0/1836092594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40b8152ef0 msgr2=0x7f40b81492d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:33.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.926+0000 7f40b5e00640 1 --2- 172.21.15.8:0/1836092594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40b8152ef0 0x7f40b81492d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:33.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.926+0000 7f40b5e00640 1 -- 172.21.15.8:0/1836092594 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b8157670 con 0x7f40b806fd80 2024-03-23T23:58:33.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.926+0000 7f40ad400640 1 --2- 172.21.15.8:0/1836092594 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40b80724e0 0x7f40b814bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:58:33.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.926+0000 7f40b5e00640 1 --2- 172.21.15.8:0/1836092594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40b806fd80 0x7f40b8157130 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f40a80af040 tx=0x7f40a8019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:33.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.926+0000 7f40aea00640 1 -- 172.21.15.8:0/1836092594 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a80bc020 con 0x7f40b806fd80 2024-03-23T23:58:33.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.926+0000 7f40aea00640 1 -- 172.21.15.8:0/1836092594 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a80b8690 con 0x7f40b806fd80 2024-03-23T23:58:33.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.926+0000 7f40aea00640 1 -- 172.21.15.8:0/1836092594 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a8009510 con 0x7f40b806fd80 2024-03-23T23:58:33.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.926+0000 7f40bcc00640 1 -- 172.21.15.8:0/1836092594 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b814c9e0 con 0x7f40b806fd80 2024-03-23T23:58:33.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.926+0000 7f40bcc00640 1 -- 172.21.15.8:0/1836092594 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b8158490 con 0x7f40b806fd80 2024-03-23T23:58:33.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.930+0000 7f40bcc00640 1 -- 172.21.15.8:0/1836092594 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40b8068270 con 0x7f40b806fd80 2024-03-23T23:58:33.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.930+0000 7f40aea00640 1 -- 172.21.15.8:0/1836092594 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f40a80bf020 con 0x7f40b806fd80 2024-03-23T23:58:33.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.930+0000 7f40aea00640 1 --2- 172.21.15.8:0/1836092594 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4094067660 0x7f4094069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:33.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.930+0000 7f40aea00640 1 -- 172.21.15.8:0/1836092594 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f40a8120a00 con 0x7f40b806fd80 2024-03-23T23:58:33.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.930+0000 7f40ad400640 1 --2- 172.21.15.8:0/1836092594 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4094067660 0x7f4094069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:33.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.930+0000 7f40ad400640 1 --2- 172.21.15.8:0/1836092594 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4094067660 0x7f4094069b20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f40b814c450 tx=0x7f40a0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:33.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:33.934+0000 7f40aea00640 1 -- 172.21.15.8:0/1836092594 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f40a80c6030 con 0x7f40b806fd80 2024-03-23T23:58:34.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.098+0000 7f40bcc00640 1 -- 172.21.15.8:0/1836092594 --> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f40b80c1c50 con 0x7f4094067660 2024-03-23T23:58:34.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.098+0000 7f40aea00640 1 -- 172.21.15.8:0/1836092594 <== mgr.4098 v2:172.21.15.196:6832/1295060067 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f40b80c1c50 con 0x7f4094067660 2024-03-23T23:58:34.099 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 0 to deep-scrub 2024-03-23T23:58:34.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.098+0000 7f40bcc00640 1 -- 172.21.15.8:0/1836092594 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4094067660 msgr2=0x7f4094069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:34.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.098+0000 7f40bcc00640 1 --2- 172.21.15.8:0/1836092594 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4094067660 0x7f4094069b20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f40b814c450 tx=0x7f40a0008040 comp rx=0 tx=0).stop 2024-03-23T23:58:34.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.098+0000 7f40bcc00640 1 -- 172.21.15.8:0/1836092594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40b806fd80 msgr2=0x7f40b8157130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:34.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.098+0000 7f40bcc00640 1 --2- 172.21.15.8:0/1836092594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40b806fd80 0x7f40b8157130 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f40a80af040 tx=0x7f40a8019610 comp rx=0 tx=0).stop 2024-03-23T23:58:34.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.098+0000 7f40bcc00640 1 -- 172.21.15.8:0/1836092594 shutdown_connections 2024-03-23T23:58:34.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.098+0000 7f40bcc00640 1 --2- 172.21.15.8:0/1836092594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40b8152ef0 0x7f40b81492d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:34.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.098+0000 7f40bcc00640 1 --2- 172.21.15.8:0/1836092594 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4094067660 0x7f4094069b20 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:34.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.098+0000 7f40bcc00640 1 --2- 172.21.15.8:0/1836092594 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40b80724e0 0x7f40b814bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:34.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.098+0000 7f40bcc00640 1 --2- 172.21.15.8:0/1836092594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40b806fd80 0x7f40b8157130 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:34.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.098+0000 7f40bcc00640 1 -- 172.21.15.8:0/1836092594 >> 172.21.15.8:0/1836092594 conn(0x7f40b806c280 msgr2=0x7f40b8151770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:34.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.098+0000 7f40bcc00640 1 -- 172.21.15.8:0/1836092594 shutdown_connections 2024-03-23T23:58:34.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.098+0000 7f40bcc00640 1 -- 172.21.15.8:0/1836092594 wait complete. 2024-03-23T23:58:34.119 INFO:tasks.ceph:Scrubbing osd.1 2024-03-23T23:58:34.120 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-23T23:58:34.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.262+0000 7f3ee2a00640 1 Processor -- start 2024-03-23T23:58:34.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.262+0000 7f3ee2a00640 1 -- start start 2024-03-23T23:58:34.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.266+0000 7f3ee2a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3edc152f80 0x7f3edc0c4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:34.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.266+0000 7f3ee2a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3edc0c5430 0x7f3edc0a80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:34.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.266+0000 7f3ee2a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3edc0a8600 0x7f3edc0c38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:34.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.266+0000 7f3ee2a00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3edc159b80 con 0x7f3edc0a8600 2024-03-23T23:58:34.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.266+0000 7f3ee2a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3edc153360 con 0x7f3edc0c5430 2024-03-23T23:58:34.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.266+0000 7f3ee2a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc158f70 con 0x7f3edc152f80 2024-03-23T23:58:34.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.266+0000 7f3ee0a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3edc0a8600 0x7f3edc0c38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:34.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.266+0000 7f3ee0a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3edc0a8600 0x7f3edc0c38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46482/0 (socket says 172.21.15.8:46482) 2024-03-23T23:58:34.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.266+0000 7f3ee0a00640 1 -- 172.21.15.8:0/1209334023 learned_addr learned my addr 172.21.15.8:0/1209334023 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:34.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.266+0000 7f3ed3400640 1 --2- 172.21.15.8:0/1209334023 >> v2:172.21.15.196:3300/0 conn(0x7f3edc0c5430 0x7f3edc0a80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:34.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.266+0000 7f3edbe00640 1 --2- 172.21.15.8:0/1209334023 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3edc152f80 0x7f3edc0c4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:34.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.266+0000 7f3ee0a00640 1 -- 172.21.15.8:0/1209334023 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3edc152f80 msgr2=0x7f3edc0c4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:34.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.266+0000 7f3ee0a00640 1 --2- 172.21.15.8:0/1209334023 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3edc152f80 0x7f3edc0c4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:34.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.266+0000 7f3ee0a00640 1 -- 172.21.15.8:0/1209334023 >> v2:172.21.15.196:3300/0 conn(0x7f3edc0c5430 msgr2=0x7f3edc0a80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:34.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.266+0000 7f3ee0a00640 1 --2- 172.21.15.8:0/1209334023 >> v2:172.21.15.196:3300/0 conn(0x7f3edc0c5430 0x7f3edc0a80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:34.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.266+0000 7f3ee0a00640 1 -- 172.21.15.8:0/1209334023 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3edc159250 con 0x7f3edc0a8600 2024-03-23T23:58:34.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.266+0000 7f3ed3400640 1 --2- 172.21.15.8:0/1209334023 >> v2:172.21.15.196:3300/0 conn(0x7f3edc0c5430 0x7f3edc0a80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:58:34.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.266+0000 7f3edbe00640 1 --2- 172.21.15.8:0/1209334023 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3edc152f80 0x7f3edc0c4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:58:34.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.270+0000 7f3ee0a00640 1 --2- 172.21.15.8:0/1209334023 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3edc0a8600 0x7f3edc0c38d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3edc0c6a20 tx=0x7f3ed401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59c77cf8889eac05 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:34.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.270+0000 7f3edb400640 1 -- 172.21.15.8:0/1209334023 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed40a56d0 con 0x7f3edc0a8600 2024-03-23T23:58:34.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.270+0000 7f3edb400640 1 -- 172.21.15.8:0/1209334023 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed40a5870 con 0x7f3edc0a8600 2024-03-23T23:58:34.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.270+0000 7f3edb400640 1 -- 172.21.15.8:0/1209334023 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed40a5c40 con 0x7f3edc0a8600 2024-03-23T23:58:34.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.270+0000 7f3ee2a00640 1 -- 172.21.15.8:0/1209334023 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3edc0a8600 msgr2=0x7f3edc0c38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:34.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.270+0000 7f3ee2a00640 1 --2- 172.21.15.8:0/1209334023 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3edc0a8600 0x7f3edc0c38d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3edc0c6a20 tx=0x7f3ed401c960 comp rx=0 tx=0).stop 2024-03-23T23:58:34.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.270+0000 7f3ee2a00640 1 -- 172.21.15.8:0/1209334023 shutdown_connections 2024-03-23T23:58:34.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.270+0000 7f3ee2a00640 1 --2- 172.21.15.8:0/1209334023 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3edc0a8600 0x7f3edc0c38d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:34.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.270+0000 7f3ee2a00640 1 --2- 172.21.15.8:0/1209334023 >> v2:172.21.15.196:3300/0 conn(0x7f3edc0c5430 0x7f3edc0a80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:34.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.270+0000 7f3ee2a00640 1 --2- 172.21.15.8:0/1209334023 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3edc152f80 0x7f3edc0c4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:34.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.270+0000 7f3ee2a00640 1 -- 172.21.15.8:0/1209334023 >> 172.21.15.8:0/1209334023 conn(0x7f3edc0aac80 msgr2=0x7f3edc0ab090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:34.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.270+0000 7f3ee2a00640 1 -- 172.21.15.8:0/1209334023 shutdown_connections 2024-03-23T23:58:34.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.270+0000 7f3ee2a00640 1 -- 172.21.15.8:0/1209334023 wait complete. 2024-03-23T23:58:34.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.274+0000 7f3ee2a00640 1 Processor -- start 2024-03-23T23:58:34.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.274+0000 7f3ee2a00640 1 -- start start 2024-03-23T23:58:34.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.274+0000 7f3ee2a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3edc0a8600 0x7f3edc0abc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:34.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.274+0000 7f3ee2a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3edc0c5430 0x7f3edc070070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:34.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.274+0000 7f3ee2a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3edc152f80 0x7f3edc15abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:34.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.274+0000 7f3ee2a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc155aa0 con 0x7f3edc0c5430 2024-03-23T23:58:34.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.274+0000 7f3ee2a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc155920 con 0x7f3edc152f80 2024-03-23T23:58:34.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.274+0000 7f3ee2a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc155c20 con 0x7f3edc0a8600 2024-03-23T23:58:34.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.274+0000 7f3ed3400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3edc0c5430 0x7f3edc070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:34.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.274+0000 7f3ed3400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3edc0c5430 0x7f3edc070070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46492/0 (socket says 172.21.15.8:46492) 2024-03-23T23:58:34.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.274+0000 7f3ed3400640 1 -- 172.21.15.8:0/4174607291 learned_addr learned my addr 172.21.15.8:0/4174607291 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:34.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.274+0000 7f3edbe00640 1 --2- 172.21.15.8:0/4174607291 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3edc0a8600 0x7f3edc0abc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:34.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.274+0000 7f3ee0a00640 1 --2- 172.21.15.8:0/4174607291 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3edc152f80 0x7f3edc15abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:34.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.274+0000 7f3ed3400640 1 -- 172.21.15.8:0/4174607291 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3edc0a8600 msgr2=0x7f3edc0abc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:34.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.274+0000 7f3ed3400640 1 --2- 172.21.15.8:0/4174607291 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3edc0a8600 0x7f3edc0abc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:34.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.274+0000 7f3ed3400640 1 -- 172.21.15.8:0/4174607291 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3edc152f80 msgr2=0x7f3edc15abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:34.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.274+0000 7f3ed3400640 1 --2- 172.21.15.8:0/4174607291 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3edc152f80 0x7f3edc15abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:34.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.274+0000 7f3ed3400640 1 -- 172.21.15.8:0/4174607291 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3edc0add60 con 0x7f3edc0c5430 2024-03-23T23:58:34.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.274+0000 7f3ed3400640 1 --2- 172.21.15.8:0/4174607291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3edc0c5430 0x7f3edc070070 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3ec400e9e0 tx=0x7f3ec400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:34.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.274+0000 7f3ed8c00640 1 -- 172.21.15.8:0/4174607291 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4017070 con 0x7f3edc0c5430 2024-03-23T23:58:34.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.274+0000 7f3ed8c00640 1 -- 172.21.15.8:0/4174607291 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec400ca30 con 0x7f3edc0c5430 2024-03-23T23:58:34.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.274+0000 7f3ed8c00640 1 -- 172.21.15.8:0/4174607291 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec400ce00 con 0x7f3edc0c5430 2024-03-23T23:58:34.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.274+0000 7f3ee2a00640 1 -- 172.21.15.8:0/4174607291 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3edc0c90c0 con 0x7f3edc0c5430 2024-03-23T23:58:34.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.274+0000 7f3ee2a00640 1 -- 172.21.15.8:0/4174607291 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3edc15a3b0 con 0x7f3edc0c5430 2024-03-23T23:58:34.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.274+0000 7f3ee2a00640 1 -- 172.21.15.8:0/4174607291 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3edc0c95e0 con 0x7f3edc0c5430 2024-03-23T23:58:34.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.278+0000 7f3ed8c00640 1 -- 172.21.15.8:0/4174607291 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3ec401a070 con 0x7f3edc0c5430 2024-03-23T23:58:34.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.278+0000 7f3ed8c00640 1 --2- 172.21.15.8:0/4174607291 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3eb8067690 0x7f3eb8069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:34.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.278+0000 7f3ed8c00640 1 -- 172.21.15.8:0/4174607291 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f3ec4085df0 con 0x7f3edc0c5430 2024-03-23T23:58:34.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.278+0000 7f3ed8c00640 1 --2- 172.21.15.8:0/4174607291 >> [v2:172.21.15.8:6816/3205168010,v1:172.21.15.8:6818/3205168010] conn(0x7f3eb8072090 0x7f3eb8074530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:34.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.278+0000 7f3ed8c00640 1 -- 172.21.15.8:0/4174607291 --> [v2:172.21.15.8:6816/3205168010,v1:172.21.15.8:6818/3205168010] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3eb8074c00 con 0x7f3eb8072090 2024-03-23T23:58:34.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.278+0000 7f3edbe00640 1 --2- 172.21.15.8:0/4174607291 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3eb8067690 0x7f3eb8069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:34.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.278+0000 7f3ed8c00640 1 -- 172.21.15.8:0/4174607291 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ec40884f0 con 0x7f3edc0c5430 2024-03-23T23:58:34.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.278+0000 7f3ee0a00640 1 --2- 172.21.15.8:0/4174607291 >> [v2:172.21.15.8:6816/3205168010,v1:172.21.15.8:6818/3205168010] conn(0x7f3eb8072090 0x7f3eb8074530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:34.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.278+0000 7f3edbe00640 1 --2- 172.21.15.8:0/4174607291 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3eb8067690 0x7f3eb8069b50 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc006e90 tx=0x7f3ecc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:34.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.278+0000 7f3ee0a00640 1 --2- 172.21.15.8:0/4174607291 >> [v2:172.21.15.8:6816/3205168010,v1:172.21.15.8:6818/3205168010] conn(0x7f3eb8072090 0x7f3eb8074530 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:34.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.278+0000 7f3ed8c00640 1 -- 172.21.15.8:0/4174607291 <== osd.1 v2:172.21.15.8:6816/3205168010 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3eb8074c00 con 0x7f3eb8072090 2024-03-23T23:58:34.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.294+0000 7f3ee2a00640 1 -- 172.21.15.8:0/4174607291 --> [v2:172.21.15.8:6816/3205168010,v1:172.21.15.8:6818/3205168010] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3edc04f480 con 0x7f3eb8072090 2024-03-23T23:58:34.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.294+0000 7f3ed8c00640 1 -- 172.21.15.8:0/4174607291 <== osd.1 v2:172.21.15.8:6816/3205168010 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3edc04f480 con 0x7f3eb8072090 2024-03-23T23:58:34.294 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:58:34.295 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-23T23:58:34.295 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:58:34.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.294+0000 7f3ee2a00640 1 -- 172.21.15.8:0/4174607291 >> [v2:172.21.15.8:6816/3205168010,v1:172.21.15.8:6818/3205168010] conn(0x7f3eb8072090 msgr2=0x7f3eb8074530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:34.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.294+0000 7f3ee2a00640 1 --2- 172.21.15.8:0/4174607291 >> [v2:172.21.15.8:6816/3205168010,v1:172.21.15.8:6818/3205168010] conn(0x7f3eb8072090 0x7f3eb8074530 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:34.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.294+0000 7f3ee2a00640 1 -- 172.21.15.8:0/4174607291 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3eb8067690 msgr2=0x7f3eb8069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:34.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.294+0000 7f3ee2a00640 1 --2- 172.21.15.8:0/4174607291 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f3eb8067690 0x7f3eb8069b50 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc006e90 tx=0x7f3ecc008040 comp rx=0 tx=0).stop 2024-03-23T23:58:34.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.294+0000 7f3ee2a00640 1 -- 172.21.15.8:0/4174607291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3edc0c5430 msgr2=0x7f3edc070070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:34.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.294+0000 7f3ee2a00640 1 --2- 172.21.15.8:0/4174607291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3edc0c5430 0x7f3edc070070 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3ec400e9e0 tx=0x7f3ec400eea0 comp rx=0 tx=0).stop 2024-03-23T23:58:34.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.294+0000 7f3ee0a00640 1 -- 172.21.15.8:0/4174607291 reap_dead start 2024-03-23T23:58:34.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.294+0000 7f3ee2a00640 1 -- 172.21.15.8:0/4174607291 shutdown_connections 2024-03-23T23:58:34.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.294+0000 7f3ee2a00640 1 -- 172.21.15.8:0/4174607291 >> 172.21.15.8:0/4174607291 conn(0x7f3edc0aac80 msgr2=0x7f3edc155fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:34.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.294+0000 7f3ee2a00640 1 -- 172.21.15.8:0/4174607291 shutdown_connections 2024-03-23T23:58:34.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.294+0000 7f3ee2a00640 1 -- 172.21.15.8:0/4174607291 wait complete. 2024-03-23T23:58:34.314 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-23T23:58:34.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.518+0000 7fe66e400640 1 Processor -- start 2024-03-23T23:58:34.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.518+0000 7fe66e400640 1 -- start start 2024-03-23T23:58:34.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.522+0000 7fe66e400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe66814d8b0 0x7fe6680c7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:34.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.522+0000 7fe66e400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe6680c5560 0x7fe66806ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:34.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.522+0000 7fe66e400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6680c7670 con 0x7fe668070b50 2024-03-23T23:58:34.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.522+0000 7fe66e400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6680c4830 con 0x7fe6680c5560 2024-03-23T23:58:34.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.522+0000 7fe66e400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6680c50d0 con 0x7fe66814d8b0 2024-03-23T23:58:34.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.522+0000 7fe667e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe6680c5560 0x7fe66806ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:34.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.522+0000 7fe667e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe6680c5560 0x7fe66806ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46502/0 (socket says 172.21.15.8:46502) 2024-03-23T23:58:34.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.522+0000 7fe667e00640 1 -- 172.21.15.8:0/1279719439 learned_addr learned my addr 172.21.15.8:0/1279719439 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:34.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.522+0000 7fe65fe00640 1 --1- 172.21.15.8:0/1279719439 >> v1:172.21.15.196:6789/0 conn(0x7fe668070b50 0x7fe6681541b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:57184/0 (socket says 172.21.15.8:57184) 2024-03-23T23:58:34.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.522+0000 7fe667400640 1 --2- 172.21.15.8:0/1279719439 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe66814d8b0 0x7fe6680c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:34.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.522+0000 7fe667e00640 1 -- 172.21.15.8:0/1279719439 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe66814d8b0 msgr2=0x7fe6680c7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:34.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.522+0000 7fe667e00640 1 --2- 172.21.15.8:0/1279719439 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe66814d8b0 0x7fe6680c7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:34.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.522+0000 7fe667e00640 1 -- 172.21.15.8:0/1279719439 >> v1:172.21.15.196:6789/0 conn(0x7fe668070b50 legacy=0x7fe6681541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:34.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.522+0000 7fe667e00640 1 -- 172.21.15.8:0/1279719439 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6680710e0 con 0x7fe6680c5560 2024-03-23T23:58:34.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.522+0000 7fe667400640 1 --2- 172.21.15.8:0/1279719439 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe66814d8b0 0x7fe6680c7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:58:34.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.526+0000 7fe667e00640 1 --2- 172.21.15.8:0/1279719439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6680c5560 0x7fe66806ed00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe660009e50 tx=0x7fe66001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14fdf4fe85c76440 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:34.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.526+0000 7fe666a00640 1 -- 172.21.15.8:0/1279719439 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6600a5700 con 0x7fe6680c5560 2024-03-23T23:58:34.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.526+0000 7fe666a00640 1 -- 172.21.15.8:0/1279719439 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6600a58a0 con 0x7fe6680c5560 2024-03-23T23:58:34.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.526+0000 7fe666a00640 1 -- 172.21.15.8:0/1279719439 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6600a5c70 con 0x7fe6680c5560 2024-03-23T23:58:34.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.526+0000 7fe66e400640 1 -- 172.21.15.8:0/1279719439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6680c5560 msgr2=0x7fe66806ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:34.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.526+0000 7fe66e400640 1 --2- 172.21.15.8:0/1279719439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6680c5560 0x7fe66806ed00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe660009e50 tx=0x7fe66001ca30 comp rx=0 tx=0).stop 2024-03-23T23:58:34.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.526+0000 7fe66e400640 1 -- 172.21.15.8:0/1279719439 shutdown_connections 2024-03-23T23:58:34.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.526+0000 7fe66e400640 1 --2- 172.21.15.8:0/1279719439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6680c5560 0x7fe66806ed00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:34.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.526+0000 7fe66e400640 1 --2- 172.21.15.8:0/1279719439 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe66814d8b0 0x7fe6680c7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:34.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.526+0000 7fe66e400640 1 -- 172.21.15.8:0/1279719439 >> 172.21.15.8:0/1279719439 conn(0x7fe6680aafe0 msgr2=0x7fe6680ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:34.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.526+0000 7fe66e400640 1 -- 172.21.15.8:0/1279719439 shutdown_connections 2024-03-23T23:58:34.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.526+0000 7fe66e400640 1 -- 172.21.15.8:0/1279719439 wait complete. 2024-03-23T23:58:34.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.526+0000 7fe66e400640 1 Processor -- start 2024-03-23T23:58:34.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.526+0000 7fe66e400640 1 -- start start 2024-03-23T23:58:34.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.526+0000 7fe66e400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe668070b50 0x7fe6680aea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:34.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.526+0000 7fe66e400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6680c5560 0x7fe6681446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:34.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.526+0000 7fe66e400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe66814d8b0 0x7fe668144c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:34.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.530+0000 7fe66e400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe668160a50 con 0x7fe6680c5560 2024-03-23T23:58:34.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.530+0000 7fe66e400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6681608d0 con 0x7fe66814d8b0 2024-03-23T23:58:34.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.530+0000 7fe66e400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe668160bd0 con 0x7fe668070b50 2024-03-23T23:58:34.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.530+0000 7fe65fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6680c5560 0x7fe6681446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:34.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.530+0000 7fe65fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6680c5560 0x7fe6681446c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46508/0 (socket says 172.21.15.8:46508) 2024-03-23T23:58:34.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.530+0000 7fe65fe00640 1 -- 172.21.15.8:0/3202349612 learned_addr learned my addr 172.21.15.8:0/3202349612 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:34.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.530+0000 7fe667e00640 1 --2- 172.21.15.8:0/3202349612 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe66814d8b0 0x7fe668144c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:34.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.530+0000 7fe667400640 1 --2- 172.21.15.8:0/3202349612 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe668070b50 0x7fe6680aea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:34.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.530+0000 7fe65fe00640 1 -- 172.21.15.8:0/3202349612 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe668070b50 msgr2=0x7fe6680aea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:34.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.530+0000 7fe65fe00640 1 --2- 172.21.15.8:0/3202349612 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe668070b50 0x7fe6680aea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:34.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.530+0000 7fe65fe00640 1 -- 172.21.15.8:0/3202349612 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe66814d8b0 msgr2=0x7fe668144c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:34.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.530+0000 7fe65fe00640 1 --2- 172.21.15.8:0/3202349612 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe66814d8b0 0x7fe668144c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:34.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.530+0000 7fe65fe00640 1 -- 172.21.15.8:0/3202349612 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe66814b2b0 con 0x7fe6680c5560 2024-03-23T23:58:34.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.530+0000 7fe65fe00640 1 --2- 172.21.15.8:0/3202349612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6680c5560 0x7fe6681446c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe65000c370 tx=0x7fe65000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:34.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.530+0000 7fe65f400640 1 -- 172.21.15.8:0/3202349612 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6500074e0 con 0x7fe6680c5560 2024-03-23T23:58:34.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.530+0000 7fe65f400640 1 -- 172.21.15.8:0/3202349612 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe650007680 con 0x7fe6680c5560 2024-03-23T23:58:34.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.530+0000 7fe65f400640 1 -- 172.21.15.8:0/3202349612 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe650004a30 con 0x7fe6680c5560 2024-03-23T23:58:34.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.530+0000 7fe66e400640 1 -- 172.21.15.8:0/3202349612 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe66814ba40 con 0x7fe6680c5560 2024-03-23T23:58:34.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.530+0000 7fe66e400640 1 -- 172.21.15.8:0/3202349612 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6680ac380 con 0x7fe6680c5560 2024-03-23T23:58:34.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.530+0000 7fe66e400640 1 -- 172.21.15.8:0/3202349612 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe668068270 con 0x7fe6680c5560 2024-03-23T23:58:34.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.530+0000 7fe65f400640 1 -- 172.21.15.8:0/3202349612 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fe65001a020 con 0x7fe6680c5560 2024-03-23T23:58:34.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.534+0000 7fe65f400640 1 --2- 172.21.15.8:0/3202349612 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe644067660 0x7fe644069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:34.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.534+0000 7fe65f400640 1 -- 172.21.15.8:0/3202349612 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fe650085260 con 0x7fe6680c5560 2024-03-23T23:58:34.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.534+0000 7fe667400640 1 --2- 172.21.15.8:0/3202349612 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe644067660 0x7fe644069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:34.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.534+0000 7fe667400640 1 --2- 172.21.15.8:0/3202349612 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe644067660 0x7fe644069b20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe658009950 tx=0x7fe658008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:34.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.538+0000 7fe65f400640 1 -- 172.21.15.8:0/3202349612 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fe650055560 con 0x7fe6680c5560 2024-03-23T23:58:34.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.698+0000 7fe66e400640 1 -- 172.21.15.8:0/3202349612 --> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe66806ed70 con 0x7fe644067660 2024-03-23T23:58:34.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.698+0000 7fe65f400640 1 -- 172.21.15.8:0/3202349612 <== mgr.4098 v2:172.21.15.196:6832/1295060067 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe66806ed70 con 0x7fe644067660 2024-03-23T23:58:34.701 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 1 to deep-scrub 2024-03-23T23:58:34.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.702+0000 7fe66e400640 1 -- 172.21.15.8:0/3202349612 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe644067660 msgr2=0x7fe644069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:34.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.702+0000 7fe66e400640 1 --2- 172.21.15.8:0/3202349612 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe644067660 0x7fe644069b20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe658009950 tx=0x7fe658008040 comp rx=0 tx=0).stop 2024-03-23T23:58:34.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.702+0000 7fe66e400640 1 -- 172.21.15.8:0/3202349612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6680c5560 msgr2=0x7fe6681446c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:34.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.702+0000 7fe66e400640 1 --2- 172.21.15.8:0/3202349612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6680c5560 0x7fe6681446c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe65000c370 tx=0x7fe65000c830 comp rx=0 tx=0).stop 2024-03-23T23:58:34.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.702+0000 7fe66e400640 1 -- 172.21.15.8:0/3202349612 shutdown_connections 2024-03-23T23:58:34.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.702+0000 7fe66e400640 1 --2- 172.21.15.8:0/3202349612 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe66814d8b0 0x7fe668144c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:34.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.702+0000 7fe66e400640 1 --2- 172.21.15.8:0/3202349612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6680c5560 0x7fe6681446c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:34.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.702+0000 7fe66e400640 1 --2- 172.21.15.8:0/3202349612 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe644067660 0x7fe644069b20 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:34.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.702+0000 7fe66e400640 1 --2- 172.21.15.8:0/3202349612 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe668070b50 0x7fe6680aea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:34.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.702+0000 7fe66e400640 1 -- 172.21.15.8:0/3202349612 >> 172.21.15.8:0/3202349612 conn(0x7fe6680aafe0 msgr2=0x7fe66806d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:34.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.702+0000 7fe66e400640 1 -- 172.21.15.8:0/3202349612 shutdown_connections 2024-03-23T23:58:34.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.702+0000 7fe66e400640 1 -- 172.21.15.8:0/3202349612 wait complete. 2024-03-23T23:58:34.723 INFO:tasks.ceph:Scrubbing osd.2 2024-03-23T23:58:34.723 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-23T23:58:34.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.866+0000 7ff713800640 1 Processor -- start 2024-03-23T23:58:34.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.866+0000 7ff713800640 1 -- start start 2024-03-23T23:58:34.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.870+0000 7ff713800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff70c0c59d0 0x7ff70c0c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:34.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.870+0000 7ff713800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff70c159c80 con 0x7ff70c0c31d0 2024-03-23T23:58:34.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.870+0000 7ff713800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff70c0c2410 con 0x7ff70c070610 2024-03-23T23:58:34.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.870+0000 7ff713800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff70c0c26f0 con 0x7ff70c0c59d0 2024-03-23T23:58:34.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.870+0000 7ff710e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff70c0c59d0 0x7ff70c0c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:34.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.870+0000 7ff711800640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7ff70c070610 0x7ff70c160100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:57196/0 (socket says 172.21.15.8:57196) 2024-03-23T23:58:34.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.870+0000 7ff710e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff70c0c59d0 0x7ff70c0c5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46518/0 (socket says 172.21.15.8:46518) 2024-03-23T23:58:34.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.870+0000 7ff711800640 1 -- 172.21.15.8:0/2887457635 learned_addr learned my addr 172.21.15.8:0/2887457635 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:58:34.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.870+0000 7ff70be00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff70c0c31d0 0x7ff70c06ff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:55924/0 (socket says 172.21.15.8:55924) 2024-03-23T23:58:34.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.870+0000 7ff710e00640 1 -- 172.21.15.8:0/2887457635 >> v1:172.21.15.196:6789/0 conn(0x7ff70c070610 legacy=0x7ff70c160100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:34.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.870+0000 7ff70b400640 1 -- 172.21.15.8:0/2887457635 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1029481224 0 0) 0x7ff70c0c2410 con 0x7ff70c070610 2024-03-23T23:58:34.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.870+0000 7ff710e00640 1 -- 172.21.15.8:0/2887457635 >> v1:172.21.15.8:6789/0 conn(0x7ff70c0c31d0 legacy=0x7ff70c06ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:34.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.870+0000 7ff710e00640 1 -- 172.21.15.8:0/2887457635 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70c0c29d0 con 0x7ff70c0c59d0 2024-03-23T23:58:34.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.874+0000 7ff710e00640 1 --2- 172.21.15.8:0/2887457635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff70c0c59d0 0x7ff70c0c5db0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff7000097c0 tx=0x7ff70001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10031c993888e14d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:34.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.874+0000 7ff70b400640 1 -- 172.21.15.8:0/2887457635 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7000b0070 con 0x7ff70c0c59d0 2024-03-23T23:58:34.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.874+0000 7ff70b400640 1 -- 172.21.15.8:0/2887457635 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7000ab600 con 0x7ff70c0c59d0 2024-03-23T23:58:34.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.874+0000 7ff70b400640 1 -- 172.21.15.8:0/2887457635 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7000ab9d0 con 0x7ff70c0c59d0 2024-03-23T23:58:34.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.874+0000 7ff713800640 1 -- 172.21.15.8:0/2887457635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff70c0c59d0 msgr2=0x7ff70c0c5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:34.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.874+0000 7ff713800640 1 --2- 172.21.15.8:0/2887457635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff70c0c59d0 0x7ff70c0c5db0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff7000097c0 tx=0x7ff70001c3a0 comp rx=0 tx=0).stop 2024-03-23T23:58:34.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.874+0000 7ff713800640 1 -- 172.21.15.8:0/2887457635 shutdown_connections 2024-03-23T23:58:34.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.874+0000 7ff713800640 1 --2- 172.21.15.8:0/2887457635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff70c0c59d0 0x7ff70c0c5db0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:34.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.874+0000 7ff713800640 1 -- 172.21.15.8:0/2887457635 >> 172.21.15.8:0/2887457635 conn(0x7ff70c0c8f40 msgr2=0x7ff70c0c9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:34.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.874+0000 7ff713800640 1 -- 172.21.15.8:0/2887457635 shutdown_connections 2024-03-23T23:58:34.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.874+0000 7ff713800640 1 -- 172.21.15.8:0/2887457635 wait complete. 2024-03-23T23:58:34.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.878+0000 7ff713800640 1 Processor -- start 2024-03-23T23:58:34.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.878+0000 7ff713800640 1 -- start start 2024-03-23T23:58:34.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.878+0000 7ff713800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff70c0c31d0 0x7ff70c1f1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:34.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.878+0000 7ff713800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff70c0c59d0 0x7ff70c1f1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:34.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.878+0000 7ff713800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff70c0abde0 0x7ff70c140ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:34.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.878+0000 7ff713800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70c164040 con 0x7ff70c0c31d0 2024-03-23T23:58:34.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.878+0000 7ff713800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70c0c7a80 con 0x7ff70c0c59d0 2024-03-23T23:58:34.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.878+0000 7ff713800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff70c1641c0 con 0x7ff70c0abde0 2024-03-23T23:58:34.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.878+0000 7ff710e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff70c0c31d0 0x7ff70c1f1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:34.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.878+0000 7ff710e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff70c0c31d0 0x7ff70c1f1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46532/0 (socket says 172.21.15.8:46532) 2024-03-23T23:58:34.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.878+0000 7ff710e00640 1 -- 172.21.15.8:0/2854964406 learned_addr learned my addr 172.21.15.8:0/2854964406 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:34.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.878+0000 7ff70be00640 1 --2- 172.21.15.8:0/2854964406 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff70c0c59d0 0x7ff70c1f1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:34.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.878+0000 7ff711800640 1 --2- 172.21.15.8:0/2854964406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff70c0abde0 0x7ff70c140ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:34.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.878+0000 7ff710e00640 1 -- 172.21.15.8:0/2854964406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff70c0abde0 msgr2=0x7ff70c140ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:34.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.878+0000 7ff710e00640 1 --2- 172.21.15.8:0/2854964406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff70c0abde0 0x7ff70c140ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:34.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.878+0000 7ff710e00640 1 -- 172.21.15.8:0/2854964406 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff70c0c59d0 msgr2=0x7ff70c1f1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:34.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.878+0000 7ff710e00640 1 --2- 172.21.15.8:0/2854964406 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff70c0c59d0 0x7ff70c1f1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:34.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.878+0000 7ff710e00640 1 -- 172.21.15.8:0/2854964406 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70c1f2500 con 0x7ff70c0c31d0 2024-03-23T23:58:34.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.878+0000 7ff710e00640 1 --2- 172.21.15.8:0/2854964406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff70c0c31d0 0x7ff70c1f1a80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff7000ae040 tx=0x7ff70001abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:34.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.878+0000 7ff708c00640 1 -- 172.21.15.8:0/2854964406 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7000b0050 con 0x7ff70c0c31d0 2024-03-23T23:58:34.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.878+0000 7ff708c00640 1 -- 172.21.15.8:0/2854964406 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7000bc070 con 0x7ff70c0c31d0 2024-03-23T23:58:34.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.878+0000 7ff713800640 1 -- 172.21.15.8:0/2854964406 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff70c0ac350 con 0x7ff70c0c31d0 2024-03-23T23:58:34.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.878+0000 7ff708c00640 1 -- 172.21.15.8:0/2854964406 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7000b5a50 con 0x7ff70c0c31d0 2024-03-23T23:58:34.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.878+0000 7ff713800640 1 -- 172.21.15.8:0/2854964406 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff70c0ae790 con 0x7ff70c0c31d0 2024-03-23T23:58:34.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.878+0000 7ff713800640 1 -- 172.21.15.8:0/2854964406 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff70c04f480 con 0x7ff70c0c31d0 2024-03-23T23:58:34.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.882+0000 7ff708c00640 1 -- 172.21.15.8:0/2854964406 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff7000ab4a0 con 0x7ff70c0c31d0 2024-03-23T23:58:34.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.882+0000 7ff708c00640 1 --2- 172.21.15.8:0/2854964406 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff6ec067660 0x7ff6ec069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:34.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.882+0000 7ff708c00640 1 -- 172.21.15.8:0/2854964406 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7ff700120430 con 0x7ff70c0c31d0 2024-03-23T23:58:34.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.882+0000 7ff70be00640 1 --2- 172.21.15.8:0/2854964406 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff6ec067660 0x7ff6ec069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:34.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.882+0000 7ff708c00640 1 --2- 172.21.15.8:0/2854964406 >> [v2:172.21.15.8:6800/475463656,v1:172.21.15.8:6801/475463656] conn(0x7ff6ec072050 0x7ff6ec0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:34.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.882+0000 7ff708c00640 1 -- 172.21.15.8:0/2854964406 --> [v2:172.21.15.8:6800/475463656,v1:172.21.15.8:6801/475463656] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff7000bce50 con 0x7ff6ec072050 2024-03-23T23:58:34.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.882+0000 7ff708c00640 1 -- 172.21.15.8:0/2854964406 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff700127050 con 0x7ff70c0c31d0 2024-03-23T23:58:34.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.882+0000 7ff711800640 1 --2- 172.21.15.8:0/2854964406 >> [v2:172.21.15.8:6800/475463656,v1:172.21.15.8:6801/475463656] conn(0x7ff6ec072050 0x7ff6ec0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:34.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.882+0000 7ff70be00640 1 --2- 172.21.15.8:0/2854964406 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff6ec067660 0x7ff6ec069b20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff70c0c3770 tx=0x7ff6f8007e50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:34.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.882+0000 7ff711800640 1 --2- 172.21.15.8:0/2854964406 >> [v2:172.21.15.8:6800/475463656,v1:172.21.15.8:6801/475463656] conn(0x7ff6ec072050 0x7ff6ec0744f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:34.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.882+0000 7ff708c00640 1 -- 172.21.15.8:0/2854964406 <== osd.2 v2:172.21.15.8:6800/475463656 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff7000bce50 con 0x7ff6ec072050 2024-03-23T23:58:34.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.898+0000 7ff713800640 1 -- 172.21.15.8:0/2854964406 --> [v2:172.21.15.8:6800/475463656,v1:172.21.15.8:6801/475463656] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff70c0c6690 con 0x7ff6ec072050 2024-03-23T23:58:34.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.898+0000 7ff708c00640 1 -- 172.21.15.8:0/2854964406 <== osd.2 v2:172.21.15.8:6800/475463656 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff70c0c6690 con 0x7ff6ec072050 2024-03-23T23:58:34.898 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:58:34.899 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-23T23:58:34.899 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:58:34.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.898+0000 7ff713800640 1 -- 172.21.15.8:0/2854964406 >> [v2:172.21.15.8:6800/475463656,v1:172.21.15.8:6801/475463656] conn(0x7ff6ec072050 msgr2=0x7ff6ec0744f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:34.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.898+0000 7ff713800640 1 --2- 172.21.15.8:0/2854964406 >> [v2:172.21.15.8:6800/475463656,v1:172.21.15.8:6801/475463656] conn(0x7ff6ec072050 0x7ff6ec0744f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:34.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.898+0000 7ff713800640 1 -- 172.21.15.8:0/2854964406 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff6ec067660 msgr2=0x7ff6ec069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:34.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.898+0000 7ff713800640 1 --2- 172.21.15.8:0/2854964406 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff6ec067660 0x7ff6ec069b20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff70c0c3770 tx=0x7ff6f8007e50 comp rx=0 tx=0).stop 2024-03-23T23:58:34.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.898+0000 7ff713800640 1 -- 172.21.15.8:0/2854964406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff70c0c31d0 msgr2=0x7ff70c1f1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:34.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.898+0000 7ff713800640 1 --2- 172.21.15.8:0/2854964406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff70c0c31d0 0x7ff70c1f1a80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff7000ae040 tx=0x7ff70001abe0 comp rx=0 tx=0).stop 2024-03-23T23:58:34.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.898+0000 7ff711800640 1 -- 172.21.15.8:0/2854964406 reap_dead start 2024-03-23T23:58:34.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.898+0000 7ff713800640 1 -- 172.21.15.8:0/2854964406 shutdown_connections 2024-03-23T23:58:34.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.898+0000 7ff713800640 1 -- 172.21.15.8:0/2854964406 >> 172.21.15.8:0/2854964406 conn(0x7ff70c0c8f40 msgr2=0x7ff70c067090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:34.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.898+0000 7ff713800640 1 -- 172.21.15.8:0/2854964406 shutdown_connections 2024-03-23T23:58:34.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:34.898+0000 7ff713800640 1 -- 172.21.15.8:0/2854964406 wait complete. 2024-03-23T23:58:34.925 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-23T23:58:35.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.066+0000 7f6d66c00640 1 Processor -- start 2024-03-23T23:58:35.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.066+0000 7f6d66c00640 1 -- start start 2024-03-23T23:58:35.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.070+0000 7f6d66c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6d600c8a50 0x7f6d600c2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:35.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.070+0000 7f6d66c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d600c2ba0 0x7f6d60160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:35.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.070+0000 7f6d66c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d600c4340 con 0x7f6d6006d6e0 2024-03-23T23:58:35.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.070+0000 7f6d66c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d600c4740 con 0x7f6d600c8a50 2024-03-23T23:58:35.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.070+0000 7f6d66c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d600c4060 con 0x7f6d600c2ba0 2024-03-23T23:58:35.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.070+0000 7f6d5fe00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6d600c8a50 0x7f6d600c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:35.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.070+0000 7f6d57e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f6d6006d6e0 0x7f6d60155a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:57212/0 (socket says 172.21.15.8:57212) 2024-03-23T23:58:35.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.070+0000 7f6d57e00640 1 -- 172.21.15.8:0/1866892745 learned_addr learned my addr 172.21.15.8:0/1866892745 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:58:35.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.070+0000 7f6d64c00640 1 --2- 172.21.15.8:0/1866892745 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d600c2ba0 0x7f6d60160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:35.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.070+0000 7f6d5f400640 1 -- 172.21.15.8:0/1866892745 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3006274272 0 0) 0x7f6d600c4340 con 0x7f6d6006d6e0 2024-03-23T23:58:35.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.070+0000 7f6d5f400640 1 -- 172.21.15.8:0/1866892745 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d44003530 con 0x7f6d6006d6e0 2024-03-23T23:58:35.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.070+0000 7f6d5fe00640 1 -- 172.21.15.8:0/1866892745 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d600c2ba0 msgr2=0x7f6d60160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:35.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.070+0000 7f6d5fe00640 1 --2- 172.21.15.8:0/1866892745 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d600c2ba0 0x7f6d60160300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.070+0000 7f6d5fe00640 1 -- 172.21.15.8:0/1866892745 >> v1:172.21.15.196:6789/0 conn(0x7f6d6006d6e0 legacy=0x7f6d60155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:35.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.070+0000 7f6d5fe00640 1 -- 172.21.15.8:0/1866892745 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d600c3570 con 0x7f6d600c8a50 2024-03-23T23:58:35.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.074+0000 7f6d5fe00640 1 --2- 172.21.15.8:0/1866892745 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d600c8a50 0x7f6d600c2660 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6d500097c0 tx=0x7f6d5001c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b989bb3a9ca21b90 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:35.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.074+0000 7f6d5f400640 1 -- 172.21.15.8:0/1866892745 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d500b1070 con 0x7f6d600c8a50 2024-03-23T23:58:35.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.074+0000 7f6d5f400640 1 -- 172.21.15.8:0/1866892745 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d500a8050 con 0x7f6d600c8a50 2024-03-23T23:58:35.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.074+0000 7f6d5f400640 1 -- 172.21.15.8:0/1866892745 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d500ac860 con 0x7f6d600c8a50 2024-03-23T23:58:35.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.074+0000 7f6d66c00640 1 -- 172.21.15.8:0/1866892745 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d600c8a50 msgr2=0x7f6d600c2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:35.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.074+0000 7f6d66c00640 1 --2- 172.21.15.8:0/1866892745 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d600c8a50 0x7f6d600c2660 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6d500097c0 tx=0x7f6d5001c3e0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.074+0000 7f6d66c00640 1 -- 172.21.15.8:0/1866892745 shutdown_connections 2024-03-23T23:58:35.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.074+0000 7f6d66c00640 1 --2- 172.21.15.8:0/1866892745 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d600c2ba0 0x7f6d60160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.074+0000 7f6d66c00640 1 --2- 172.21.15.8:0/1866892745 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d600c8a50 0x7f6d600c2660 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.074+0000 7f6d66c00640 1 -- 172.21.15.8:0/1866892745 >> 172.21.15.8:0/1866892745 conn(0x7f6d600aafe0 msgr2=0x7f6d600ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:35.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.074+0000 7f6d66c00640 1 -- 172.21.15.8:0/1866892745 shutdown_connections 2024-03-23T23:58:35.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.074+0000 7f6d66c00640 1 -- 172.21.15.8:0/1866892745 wait complete. 2024-03-23T23:58:35.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.074+0000 7f6d66c00640 1 Processor -- start 2024-03-23T23:58:35.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.074+0000 7f6d66c00640 1 -- start start 2024-03-23T23:58:35.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.074+0000 7f6d66c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d600c2ba0 0x7f6d60142270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:35.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.074+0000 7f6d66c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d600c8a50 0x7f6d601450b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:35.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.074+0000 7f6d66c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d601ef550 0x7f6d601efa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:35.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.078+0000 7f6d66c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6006e360 con 0x7f6d600c2ba0 2024-03-23T23:58:35.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.078+0000 7f6d66c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6006e1e0 con 0x7f6d601ef550 2024-03-23T23:58:35.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.078+0000 7f6d66c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d60156170 con 0x7f6d600c8a50 2024-03-23T23:58:35.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.078+0000 7f6d5fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d600c2ba0 0x7f6d60142270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:35.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.078+0000 7f6d5fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d600c2ba0 0x7f6d60142270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46538/0 (socket says 172.21.15.8:46538) 2024-03-23T23:58:35.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.078+0000 7f6d5fe00640 1 -- 172.21.15.8:0/3913743944 learned_addr learned my addr 172.21.15.8:0/3913743944 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:35.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.078+0000 7f6d57e00640 1 --2- 172.21.15.8:0/3913743944 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d600c8a50 0x7f6d601450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:35.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.078+0000 7f6d64c00640 1 --2- 172.21.15.8:0/3913743944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d601ef550 0x7f6d601efa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:35.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.078+0000 7f6d64c00640 1 -- 172.21.15.8:0/3913743944 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d600c8a50 msgr2=0x7f6d601450b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:35.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.078+0000 7f6d64c00640 1 --2- 172.21.15.8:0/3913743944 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d600c8a50 0x7f6d601450b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.078+0000 7f6d64c00640 1 -- 172.21.15.8:0/3913743944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d600c2ba0 msgr2=0x7f6d60142270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:35.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.078+0000 7f6d64c00640 1 --2- 172.21.15.8:0/3913743944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d600c2ba0 0x7f6d60142270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.078+0000 7f6d64c00640 1 -- 172.21.15.8:0/3913743944 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d601f17f0 con 0x7f6d601ef550 2024-03-23T23:58:35.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.078+0000 7f6d5fe00640 1 --2- 172.21.15.8:0/3913743944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d600c2ba0 0x7f6d60142270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:58:35.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.078+0000 7f6d64c00640 1 --2- 172.21.15.8:0/3913743944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d601ef550 0x7f6d601efa00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6d5800efc0 tx=0x7f6d5800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:35.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.078+0000 7f6d5cc00640 1 -- 172.21.15.8:0/3913743944 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d58018020 con 0x7f6d601ef550 2024-03-23T23:58:35.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.078+0000 7f6d5cc00640 1 -- 172.21.15.8:0/3913743944 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d58014480 con 0x7f6d601ef550 2024-03-23T23:58:35.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.078+0000 7f6d5cc00640 1 -- 172.21.15.8:0/3913743944 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d58014870 con 0x7f6d601ef550 2024-03-23T23:58:35.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.078+0000 7f6d66c00640 1 -- 172.21.15.8:0/3913743944 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d601f1ad0 con 0x7f6d601ef550 2024-03-23T23:58:35.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.078+0000 7f6d66c00640 1 -- 172.21.15.8:0/3913743944 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d601427b0 con 0x7f6d601ef550 2024-03-23T23:58:35.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.078+0000 7f6d66c00640 1 -- 172.21.15.8:0/3913743944 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d60068270 con 0x7f6d601ef550 2024-03-23T23:58:35.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.078+0000 7f6d5cc00640 1 -- 172.21.15.8:0/3913743944 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f6d5801b020 con 0x7f6d601ef550 2024-03-23T23:58:35.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.082+0000 7f6d5cc00640 1 --2- 172.21.15.8:0/3913743944 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6d3c067690 0x7f6d3c069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:35.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.082+0000 7f6d5cc00640 1 -- 172.21.15.8:0/3913743944 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f6d580868e0 con 0x7f6d601ef550 2024-03-23T23:58:35.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.082+0000 7f6d5fe00640 1 --2- 172.21.15.8:0/3913743944 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6d3c067690 0x7f6d3c069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:35.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.082+0000 7f6d5fe00640 1 --2- 172.21.15.8:0/3913743944 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6d3c067690 0x7f6d3c069b50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6d5001c420 tx=0x7f6d500a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:35.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.086+0000 7f6d5cc00640 1 -- 172.21.15.8:0/3913743944 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f6d58022030 con 0x7f6d601ef550 2024-03-23T23:58:35.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.250+0000 7f6d66c00640 1 -- 172.21.15.8:0/3913743944 --> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d601f2590 con 0x7f6d3c067690 2024-03-23T23:58:35.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.250+0000 7f6d5cc00640 1 -- 172.21.15.8:0/3913743944 <== mgr.4098 v2:172.21.15.196:6832/1295060067 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6d601f2590 con 0x7f6d3c067690 2024-03-23T23:58:35.251 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 2 to deep-scrub 2024-03-23T23:58:35.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.254+0000 7f6d66c00640 1 -- 172.21.15.8:0/3913743944 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6d3c067690 msgr2=0x7f6d3c069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:35.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.254+0000 7f6d66c00640 1 --2- 172.21.15.8:0/3913743944 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6d3c067690 0x7f6d3c069b50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6d5001c420 tx=0x7f6d500a7000 comp rx=0 tx=0).stop 2024-03-23T23:58:35.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.254+0000 7f6d66c00640 1 -- 172.21.15.8:0/3913743944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d601ef550 msgr2=0x7f6d601efa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:35.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.254+0000 7f6d66c00640 1 --2- 172.21.15.8:0/3913743944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d601ef550 0x7f6d601efa00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6d5800efc0 tx=0x7f6d5800c490 comp rx=0 tx=0).stop 2024-03-23T23:58:35.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.254+0000 7f6d66c00640 1 -- 172.21.15.8:0/3913743944 shutdown_connections 2024-03-23T23:58:35.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.254+0000 7f6d66c00640 1 --2- 172.21.15.8:0/3913743944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d601ef550 0x7f6d601efa00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.254+0000 7f6d66c00640 1 --2- 172.21.15.8:0/3913743944 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6d3c067690 0x7f6d3c069b50 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.254+0000 7f6d66c00640 1 --2- 172.21.15.8:0/3913743944 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d600c8a50 0x7f6d601450b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.254+0000 7f6d66c00640 1 --2- 172.21.15.8:0/3913743944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d600c2ba0 0x7f6d60142270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.254+0000 7f6d66c00640 1 -- 172.21.15.8:0/3913743944 >> 172.21.15.8:0/3913743944 conn(0x7f6d600aafe0 msgr2=0x7f6d6006f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:35.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.254+0000 7f6d66c00640 1 -- 172.21.15.8:0/3913743944 shutdown_connections 2024-03-23T23:58:35.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.254+0000 7f6d66c00640 1 -- 172.21.15.8:0/3913743944 wait complete. 2024-03-23T23:58:35.273 INFO:tasks.ceph:Scrubbing osd.3 2024-03-23T23:58:35.273 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-23T23:58:35.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.418+0000 7f6c0b600640 1 Processor -- start 2024-03-23T23:58:35.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.418+0000 7f6c0b600640 1 -- start start 2024-03-23T23:58:35.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.418+0000 7f6c0b600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6c04150da0 0x7f6c0406d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:35.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.418+0000 7f6c0b600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6c0406de30 0x7f6c04156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:35.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.418+0000 7f6c0b600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c0406e2c0 0x7f6c041570e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:35.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.418+0000 7f6c0b600640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c04154480 con 0x7f6c04150da0 2024-03-23T23:58:35.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.418+0000 7f6c0b600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c040aa180 con 0x7f6c0406de30 2024-03-23T23:58:35.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.418+0000 7f6c0b600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c040aa460 con 0x7f6c0406e2c0 2024-03-23T23:58:35.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.418+0000 7f6c08c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6c04150da0 0x7f6c0406d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:35.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.418+0000 7f6c03e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6c0406de30 0x7f6c04156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:35.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.418+0000 7f6c08c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6c04150da0 0x7f6c0406d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46540/0 (socket says 172.21.15.8:46540) 2024-03-23T23:58:35.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.418+0000 7f6c08c00640 1 -- 172.21.15.8:0/4107203358 learned_addr learned my addr 172.21.15.8:0/4107203358 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:35.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.418+0000 7f6c09600640 1 --2- 172.21.15.8:0/4107203358 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c0406e2c0 0x7f6c041570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:35.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.418+0000 7f6c08c00640 1 -- 172.21.15.8:0/4107203358 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c0406e2c0 msgr2=0x7f6c041570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:35.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.418+0000 7f6c08c00640 1 --2- 172.21.15.8:0/4107203358 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c0406e2c0 0x7f6c041570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.422+0000 7f6c08c00640 1 -- 172.21.15.8:0/4107203358 >> v2:172.21.15.196:3300/0 conn(0x7f6c0406de30 msgr2=0x7f6c04156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:35.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.422+0000 7f6c08c00640 1 --2- 172.21.15.8:0/4107203358 >> v2:172.21.15.196:3300/0 conn(0x7f6c0406de30 0x7f6c04156ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.422+0000 7f6c08c00640 1 -- 172.21.15.8:0/4107203358 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c040aa740 con 0x7f6c04150da0 2024-03-23T23:58:35.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.422+0000 7f6c03e00640 1 --2- 172.21.15.8:0/4107203358 >> v2:172.21.15.196:3300/0 conn(0x7f6c0406de30 0x7f6c04156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:58:35.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.422+0000 7f6c08c00640 1 --2- 172.21.15.8:0/4107203358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c04150da0 0x7f6c0406d8f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6c040c1700 tx=0x7f6bf801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c9e5f2730a45d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:35.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.422+0000 7f6c03400640 1 -- 172.21.15.8:0/4107203358 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf80b0070 con 0x7f6c04150da0 2024-03-23T23:58:35.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.422+0000 7f6c03400640 1 -- 172.21.15.8:0/4107203358 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf80ab600 con 0x7f6c04150da0 2024-03-23T23:58:35.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.422+0000 7f6c03400640 1 -- 172.21.15.8:0/4107203358 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf80ab9d0 con 0x7f6c04150da0 2024-03-23T23:58:35.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.426+0000 7f6c0b600640 1 -- 172.21.15.8:0/4107203358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c04150da0 msgr2=0x7f6c0406d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:35.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.426+0000 7f6c0b600640 1 --2- 172.21.15.8:0/4107203358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c04150da0 0x7f6c0406d8f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6c040c1700 tx=0x7f6bf801c460 comp rx=0 tx=0).stop 2024-03-23T23:58:35.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.426+0000 7f6c0b600640 1 -- 172.21.15.8:0/4107203358 shutdown_connections 2024-03-23T23:58:35.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.426+0000 7f6c0b600640 1 --2- 172.21.15.8:0/4107203358 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c0406e2c0 0x7f6c041570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.426+0000 7f6c0b600640 1 --2- 172.21.15.8:0/4107203358 >> v2:172.21.15.196:3300/0 conn(0x7f6c0406de30 0x7f6c04156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.426+0000 7f6c0b600640 1 --2- 172.21.15.8:0/4107203358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c04150da0 0x7f6c0406d8f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.426+0000 7f6c0b600640 1 -- 172.21.15.8:0/4107203358 >> 172.21.15.8:0/4107203358 conn(0x7f6c040c7060 msgr2=0x7f6c040c7470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:35.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.426+0000 7f6c0b600640 1 -- 172.21.15.8:0/4107203358 shutdown_connections 2024-03-23T23:58:35.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.426+0000 7f6c0b600640 1 -- 172.21.15.8:0/4107203358 wait complete. 2024-03-23T23:58:35.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.426+0000 7f6c0b600640 1 Processor -- start 2024-03-23T23:58:35.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.426+0000 7f6c0b600640 1 -- start start 2024-03-23T23:58:35.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.426+0000 7f6c0b600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c0406de30 0x7f6c0414a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:35.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.426+0000 7f6c0b600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c0406e2c0 0x7f6c04146670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:35.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.426+0000 7f6c0b600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c04150da0 0x7f6c04146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:35.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.426+0000 7f6c0b600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c041541b0 con 0x7f6c0406de30 2024-03-23T23:58:35.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.426+0000 7f6c0b600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c04154030 con 0x7f6c04150da0 2024-03-23T23:58:35.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.426+0000 7f6c0b600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c040ac5f0 con 0x7f6c0406e2c0 2024-03-23T23:58:35.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.426+0000 7f6c08c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c0406de30 0x7f6c0414a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:35.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.426+0000 7f6c08c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c0406de30 0x7f6c0414a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46548/0 (socket says 172.21.15.8:46548) 2024-03-23T23:58:35.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.426+0000 7f6c08c00640 1 -- 172.21.15.8:0/184810687 learned_addr learned my addr 172.21.15.8:0/184810687 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:35.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.426+0000 7f6c03e00640 1 --2- 172.21.15.8:0/184810687 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c0406e2c0 0x7f6c04146670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:35.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.426+0000 7f6c09600640 1 --2- 172.21.15.8:0/184810687 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c04150da0 0x7f6c04146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:35.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.426+0000 7f6c08c00640 1 -- 172.21.15.8:0/184810687 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c0406e2c0 msgr2=0x7f6c04146670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:35.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.426+0000 7f6c08c00640 1 --2- 172.21.15.8:0/184810687 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c0406e2c0 0x7f6c04146670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.426+0000 7f6c08c00640 1 -- 172.21.15.8:0/184810687 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c04150da0 msgr2=0x7f6c04146bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:35.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.426+0000 7f6c08c00640 1 --2- 172.21.15.8:0/184810687 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c04150da0 0x7f6c04146bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.426+0000 7f6c08c00640 1 -- 172.21.15.8:0/184810687 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c040aae40 con 0x7f6c0406de30 2024-03-23T23:58:35.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.426+0000 7f6c08c00640 1 --2- 172.21.15.8:0/184810687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c0406de30 0x7f6c0414a570 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6bf80ae040 tx=0x7f6bf801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:35.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.430+0000 7f6c00c00640 1 -- 172.21.15.8:0/184810687 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf80b0040 con 0x7f6c0406de30 2024-03-23T23:58:35.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.430+0000 7f6c00c00640 1 -- 172.21.15.8:0/184810687 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf80bc070 con 0x7f6c0406de30 2024-03-23T23:58:35.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.430+0000 7f6c00c00640 1 -- 172.21.15.8:0/184810687 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf80b6680 con 0x7f6c0406de30 2024-03-23T23:58:35.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.430+0000 7f6c0b600640 1 -- 172.21.15.8:0/184810687 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c041470f0 con 0x7f6c0406de30 2024-03-23T23:58:35.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.430+0000 7f6c0b600640 1 -- 172.21.15.8:0/184810687 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c04156610 con 0x7f6c0406de30 2024-03-23T23:58:35.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.430+0000 7f6c0b600640 1 -- 172.21.15.8:0/184810687 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6c04154bf0 con 0x7f6c0406de30 2024-03-23T23:58:35.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.430+0000 7f6c00c00640 1 -- 172.21.15.8:0/184810687 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f6bf80b6820 con 0x7f6c0406de30 2024-03-23T23:58:35.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.430+0000 7f6c00c00640 1 --2- 172.21.15.8:0/184810687 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6be4067660 0x7f6be4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:35.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.430+0000 7f6c00c00640 1 -- 172.21.15.8:0/184810687 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f6bf811fcd0 con 0x7f6c0406de30 2024-03-23T23:58:35.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.430+0000 7f6c00c00640 1 --2- 172.21.15.8:0/184810687 >> [v2:172.21.15.8:6817/1514082871,v1:172.21.15.8:6819/1514082871] conn(0x7f6be4072050 0x7f6be40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:35.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.430+0000 7f6c00c00640 1 -- 172.21.15.8:0/184810687 --> [v2:172.21.15.8:6817/1514082871,v1:172.21.15.8:6819/1514082871] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6bf80c2e50 con 0x7f6be4072050 2024-03-23T23:58:35.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.430+0000 7f6c00c00640 1 -- 172.21.15.8:0/184810687 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6bf81223d0 con 0x7f6c0406de30 2024-03-23T23:58:35.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.430+0000 7f6c03e00640 1 --2- 172.21.15.8:0/184810687 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6be4067660 0x7f6be4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:35.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.430+0000 7f6c09600640 1 --2- 172.21.15.8:0/184810687 >> [v2:172.21.15.8:6817/1514082871,v1:172.21.15.8:6819/1514082871] conn(0x7f6be4072050 0x7f6be40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:35.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.434+0000 7f6c09600640 1 --2- 172.21.15.8:0/184810687 >> [v2:172.21.15.8:6817/1514082871,v1:172.21.15.8:6819/1514082871] conn(0x7f6be4072050 0x7f6be40744f0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:35.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.434+0000 7f6c03e00640 1 --2- 172.21.15.8:0/184810687 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6be4067660 0x7f6be4069b20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0009580 tx=0x7f6bf0009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:35.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.434+0000 7f6c00c00640 1 -- 172.21.15.8:0/184810687 <== osd.3 v2:172.21.15.8:6817/1514082871 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f6bf80c2e50 con 0x7f6be4072050 2024-03-23T23:58:35.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.446+0000 7f6c0b600640 1 -- 172.21.15.8:0/184810687 --> [v2:172.21.15.8:6817/1514082871,v1:172.21.15.8:6819/1514082871] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6c0404f480 con 0x7f6be4072050 2024-03-23T23:58:35.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.446+0000 7f6c00c00640 1 -- 172.21.15.8:0/184810687 <== osd.3 v2:172.21.15.8:6817/1514082871 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6c0404f480 con 0x7f6be4072050 2024-03-23T23:58:35.448 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:58:35.448 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-23T23:58:35.448 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:58:35.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.446+0000 7f6c0b600640 1 -- 172.21.15.8:0/184810687 >> [v2:172.21.15.8:6817/1514082871,v1:172.21.15.8:6819/1514082871] conn(0x7f6be4072050 msgr2=0x7f6be40744f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:35.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.446+0000 7f6c0b600640 1 --2- 172.21.15.8:0/184810687 >> [v2:172.21.15.8:6817/1514082871,v1:172.21.15.8:6819/1514082871] conn(0x7f6be4072050 0x7f6be40744f0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.446+0000 7f6c0b600640 1 -- 172.21.15.8:0/184810687 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6be4067660 msgr2=0x7f6be4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:35.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.446+0000 7f6c0b600640 1 --2- 172.21.15.8:0/184810687 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6be4067660 0x7f6be4069b20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0009580 tx=0x7f6bf0009190 comp rx=0 tx=0).stop 2024-03-23T23:58:35.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.446+0000 7f6c0b600640 1 -- 172.21.15.8:0/184810687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c0406de30 msgr2=0x7f6c0414a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:35.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.446+0000 7f6c0b600640 1 --2- 172.21.15.8:0/184810687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c0406de30 0x7f6c0414a570 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6bf80ae040 tx=0x7f6bf801aca0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.446+0000 7f6c09600640 1 -- 172.21.15.8:0/184810687 reap_dead start 2024-03-23T23:58:35.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.446+0000 7f6c0b600640 1 -- 172.21.15.8:0/184810687 shutdown_connections 2024-03-23T23:58:35.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.446+0000 7f6c0b600640 1 -- 172.21.15.8:0/184810687 >> 172.21.15.8:0/184810687 conn(0x7f6c040c7060 msgr2=0x7f6c04070db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:35.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.446+0000 7f6c0b600640 1 -- 172.21.15.8:0/184810687 shutdown_connections 2024-03-23T23:58:35.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.446+0000 7f6c0b600640 1 -- 172.21.15.8:0/184810687 wait complete. 2024-03-23T23:58:35.473 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-23T23:58:35.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.618+0000 7f0cf8c00640 1 Processor -- start 2024-03-23T23:58:35.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.618+0000 7f0cf8c00640 1 -- start start 2024-03-23T23:58:35.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.618+0000 7f0cf8c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0cf414d8b0 0x7f0cf40c7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:35.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.618+0000 7f0cf8c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0cf40c5560 0x7f0cf406ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:35.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.618+0000 7f0cf8c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf40c7670 con 0x7f0cf4070b50 2024-03-23T23:58:35.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.618+0000 7f0cf8c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf40c4830 con 0x7f0cf414d8b0 2024-03-23T23:58:35.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.618+0000 7f0cf8c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf40c50d0 con 0x7f0cf40c5560 2024-03-23T23:58:35.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.618+0000 7f0cf1e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0cf414d8b0 0x7f0cf40c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:35.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.618+0000 7f0cf1400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f0cf4070b50 0x7f0cf41541b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:57214/0 (socket says 172.21.15.8:57214) 2024-03-23T23:58:35.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.618+0000 7f0cf1400640 1 -- 172.21.15.8:0/4191445092 learned_addr learned my addr 172.21.15.8:0/4191445092 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:58:35.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.618+0000 7f0cf2800640 1 --2- 172.21.15.8:0/4191445092 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0cf40c5560 0x7f0cf406ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:35.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.618+0000 7f0cf1e00640 1 -- 172.21.15.8:0/4191445092 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0cf40c5560 msgr2=0x7f0cf406ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:35.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.618+0000 7f0cf1e00640 1 --2- 172.21.15.8:0/4191445092 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0cf40c5560 0x7f0cf406ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.618+0000 7f0cf1e00640 1 -- 172.21.15.8:0/4191445092 >> v1:172.21.15.196:6789/0 conn(0x7f0cf4070b50 legacy=0x7f0cf41541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:35.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.618+0000 7f0cf1e00640 1 -- 172.21.15.8:0/4191445092 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf40710e0 con 0x7f0cf414d8b0 2024-03-23T23:58:35.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.618+0000 7f0cf0a00640 1 -- 172.21.15.8:0/4191445092 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2571792423 0 0) 0x7f0cf40c7670 con 0x7f0cf4070b50 2024-03-23T23:58:35.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.622+0000 7f0cf1e00640 1 --2- 172.21.15.8:0/4191445092 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0cf414d8b0 0x7f0cf40c7130 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0ce40097c0 tx=0x7f0ce401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b14d2ccfbe40272f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:35.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.622+0000 7f0cf0a00640 1 -- 172.21.15.8:0/4191445092 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce40b0070 con 0x7f0cf414d8b0 2024-03-23T23:58:35.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.622+0000 7f0cf0a00640 1 -- 172.21.15.8:0/4191445092 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce40ab600 con 0x7f0cf414d8b0 2024-03-23T23:58:35.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.622+0000 7f0cf0a00640 1 -- 172.21.15.8:0/4191445092 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce40ab9d0 con 0x7f0cf414d8b0 2024-03-23T23:58:35.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.622+0000 7f0cf8c00640 1 -- 172.21.15.8:0/4191445092 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0cf414d8b0 msgr2=0x7f0cf40c7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:35.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.622+0000 7f0cf8c00640 1 --2- 172.21.15.8:0/4191445092 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0cf414d8b0 0x7f0cf40c7130 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0ce40097c0 tx=0x7f0ce401c4a0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.622+0000 7f0cf8c00640 1 -- 172.21.15.8:0/4191445092 shutdown_connections 2024-03-23T23:58:35.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.622+0000 7f0cf8c00640 1 --2- 172.21.15.8:0/4191445092 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0cf40c5560 0x7f0cf406ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.622+0000 7f0cf8c00640 1 --2- 172.21.15.8:0/4191445092 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0cf414d8b0 0x7f0cf40c7130 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.622+0000 7f0cf8c00640 1 -- 172.21.15.8:0/4191445092 >> 172.21.15.8:0/4191445092 conn(0x7f0cf40aafe0 msgr2=0x7f0cf40ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:35.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.622+0000 7f0cf8c00640 1 -- 172.21.15.8:0/4191445092 shutdown_connections 2024-03-23T23:58:35.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.622+0000 7f0cf8c00640 1 -- 172.21.15.8:0/4191445092 wait complete. 2024-03-23T23:58:35.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.622+0000 7f0cf8c00640 1 Processor -- start 2024-03-23T23:58:35.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.622+0000 7f0cf8c00640 1 -- start start 2024-03-23T23:58:35.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.626+0000 7f0cf8c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0cf4070b50 0x7f0cf41ee150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:35.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.626+0000 7f0cf8c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0cf40c5560 0x7f0cf4147d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:35.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.626+0000 7f0cf8c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0cf414d8b0 0x7f0cf4141140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:35.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.626+0000 7f0cf8c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf4160a50 con 0x7f0cf4070b50 2024-03-23T23:58:35.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.626+0000 7f0cf8c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf41608d0 con 0x7f0cf40c5560 2024-03-23T23:58:35.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.626+0000 7f0cf8c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf4160bd0 con 0x7f0cf414d8b0 2024-03-23T23:58:35.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.626+0000 7f0cf1e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0cf4070b50 0x7f0cf41ee150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:35.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.626+0000 7f0cf1e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0cf4070b50 0x7f0cf41ee150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46564/0 (socket says 172.21.15.8:46564) 2024-03-23T23:58:35.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.626+0000 7f0cf1e00640 1 -- 172.21.15.8:0/4062592702 learned_addr learned my addr 172.21.15.8:0/4062592702 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:35.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.626+0000 7f0cf2800640 1 --2- 172.21.15.8:0/4062592702 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0cf414d8b0 0x7f0cf4141140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:35.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.626+0000 7f0cf1400640 1 --2- 172.21.15.8:0/4062592702 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0cf40c5560 0x7f0cf4147d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:35.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.626+0000 7f0cf1e00640 1 -- 172.21.15.8:0/4062592702 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0cf414d8b0 msgr2=0x7f0cf4141140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:35.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.626+0000 7f0cf1e00640 1 --2- 172.21.15.8:0/4062592702 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0cf414d8b0 0x7f0cf4141140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.626+0000 7f0cf1e00640 1 -- 172.21.15.8:0/4062592702 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0cf40c5560 msgr2=0x7f0cf4147d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:35.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.626+0000 7f0cf1e00640 1 --2- 172.21.15.8:0/4062592702 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0cf40c5560 0x7f0cf4147d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.626+0000 7f0cf1e00640 1 -- 172.21.15.8:0/4062592702 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf41ee730 con 0x7f0cf4070b50 2024-03-23T23:58:35.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.626+0000 7f0cf1e00640 1 --2- 172.21.15.8:0/4062592702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0cf4070b50 0x7f0cf41ee150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0ce401a0d0 tx=0x7f0ce401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:35.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.626+0000 7f0cea000640 1 -- 172.21.15.8:0/4062592702 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce40b0050 con 0x7f0cf4070b50 2024-03-23T23:58:35.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.626+0000 7f0cea000640 1 -- 172.21.15.8:0/4062592702 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce40bc070 con 0x7f0cf4070b50 2024-03-23T23:58:35.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.626+0000 7f0cea000640 1 -- 172.21.15.8:0/4062592702 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce40b5830 con 0x7f0cf4070b50 2024-03-23T23:58:35.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.626+0000 7f0cf8c00640 1 -- 172.21.15.8:0/4062592702 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf41eea10 con 0x7f0cf4070b50 2024-03-23T23:58:35.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.626+0000 7f0cf8c00640 1 -- 172.21.15.8:0/4062592702 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf41eefd0 con 0x7f0cf4070b50 2024-03-23T23:58:35.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.626+0000 7f0cf8c00640 1 -- 172.21.15.8:0/4062592702 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf4068270 con 0x7f0cf4070b50 2024-03-23T23:58:35.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.630+0000 7f0cea000640 1 -- 172.21.15.8:0/4062592702 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f0ce40b59d0 con 0x7f0cf4070b50 2024-03-23T23:58:35.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.630+0000 7f0cea000640 1 --2- 172.21.15.8:0/4062592702 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0cd4067690 0x7f0cd4069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:35.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.630+0000 7f0cea000640 1 -- 172.21.15.8:0/4062592702 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f0ce4120270 con 0x7f0cf4070b50 2024-03-23T23:58:35.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.630+0000 7f0cf1400640 1 --2- 172.21.15.8:0/4062592702 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0cd4067690 0x7f0cd4069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:35.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.630+0000 7f0cf1400640 1 --2- 172.21.15.8:0/4062592702 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0cd4067690 0x7f0cd4069b50 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f0cf414b7c0 tx=0x7f0ce0007df0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:35.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.634+0000 7f0cea000640 1 -- 172.21.15.8:0/4062592702 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f0ce4016090 con 0x7f0cf4070b50 2024-03-23T23:58:35.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.794+0000 7f0cf8c00640 1 -- 172.21.15.8:0/4062592702 --> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f0cf40c3c30 con 0x7f0cd4067690 2024-03-23T23:58:35.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.798+0000 7f0cea000640 1 -- 172.21.15.8:0/4062592702 <== mgr.4098 v2:172.21.15.196:6832/1295060067 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0cf40c3c30 con 0x7f0cd4067690 2024-03-23T23:58:35.798 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 3 to deep-scrub 2024-03-23T23:58:35.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.798+0000 7f0cf8c00640 1 -- 172.21.15.8:0/4062592702 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0cd4067690 msgr2=0x7f0cd4069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:35.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.798+0000 7f0cf8c00640 1 --2- 172.21.15.8:0/4062592702 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0cd4067690 0x7f0cd4069b50 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f0cf414b7c0 tx=0x7f0ce0007df0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.798+0000 7f0cf8c00640 1 -- 172.21.15.8:0/4062592702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0cf4070b50 msgr2=0x7f0cf41ee150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:35.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.798+0000 7f0cf8c00640 1 --2- 172.21.15.8:0/4062592702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0cf4070b50 0x7f0cf41ee150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0ce401a0d0 tx=0x7f0ce401ace0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.798+0000 7f0cf8c00640 1 -- 172.21.15.8:0/4062592702 shutdown_connections 2024-03-23T23:58:35.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.798+0000 7f0cf8c00640 1 --2- 172.21.15.8:0/4062592702 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f0cd4067690 0x7f0cd4069b50 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.798+0000 7f0cf8c00640 1 --2- 172.21.15.8:0/4062592702 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0cf414d8b0 0x7f0cf4141140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.798+0000 7f0cf8c00640 1 --2- 172.21.15.8:0/4062592702 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0cf40c5560 0x7f0cf4147d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.798+0000 7f0cf8c00640 1 --2- 172.21.15.8:0/4062592702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0cf4070b50 0x7f0cf41ee150 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.798+0000 7f0cf8c00640 1 -- 172.21.15.8:0/4062592702 >> 172.21.15.8:0/4062592702 conn(0x7f0cf40aafe0 msgr2=0x7f0cf414ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:35.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.798+0000 7f0cf8c00640 1 -- 172.21.15.8:0/4062592702 shutdown_connections 2024-03-23T23:58:35.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.798+0000 7f0cf8c00640 1 -- 172.21.15.8:0/4062592702 wait complete. 2024-03-23T23:58:35.825 INFO:tasks.ceph:Scrubbing osd.4 2024-03-23T23:58:35.825 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-23T23:58:35.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.970+0000 7f8887200640 1 Processor -- start 2024-03-23T23:58:35.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.970+0000 7f8887200640 1 -- start start 2024-03-23T23:58:35.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.970+0000 7f8887200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8888150b90 0x7f888806e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:35.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.970+0000 7f8887200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8888156ac0 0x7f8888156f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:35.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.970+0000 7f8887200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88880c8a80 con 0x7f88880c8580 2024-03-23T23:58:35.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.970+0000 7f8887200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88880702c0 con 0x7f8888156ac0 2024-03-23T23:58:35.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.970+0000 7f8887200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88880705a0 con 0x7f8888150b90 2024-03-23T23:58:35.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.970+0000 7f8886800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8888156ac0 0x7f8888156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:35.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.974+0000 7f887d400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f88880c8580 0x7f88880a7cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:57222/0 (socket says 172.21.15.8:57222) 2024-03-23T23:58:35.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.974+0000 7f887d400640 1 -- 172.21.15.8:0/863836993 learned_addr learned my addr 172.21.15.8:0/863836993 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:58:35.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.974+0000 7f8885e00640 1 --2- 172.21.15.8:0/863836993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8888150b90 0x7f888806e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:35.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.974+0000 7f8885400640 1 -- 172.21.15.8:0/863836993 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3688781069 0 0) 0x7f88880c8a80 con 0x7f88880c8580 2024-03-23T23:58:35.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.974+0000 7f8885400640 1 -- 172.21.15.8:0/863836993 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f886c003530 con 0x7f88880c8580 2024-03-23T23:58:35.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.974+0000 7f8886800640 1 -- 172.21.15.8:0/863836993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8888150b90 msgr2=0x7f888806e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:35.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.974+0000 7f8886800640 1 --2- 172.21.15.8:0/863836993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8888150b90 0x7f888806e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.974+0000 7f8886800640 1 -- 172.21.15.8:0/863836993 >> v1:172.21.15.196:6789/0 conn(0x7f88880c8580 legacy=0x7f88880a7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:35.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.974+0000 7f8886800640 1 -- 172.21.15.8:0/863836993 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8888070880 con 0x7f8888156ac0 2024-03-23T23:58:35.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.974+0000 7f8885e00640 1 --2- 172.21.15.8:0/863836993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8888150b90 0x7f888806e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:58:35.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.978+0000 7f8886800640 1 --2- 172.21.15.8:0/863836993 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8888156ac0 0x7f8888156f70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f88800097c0 tx=0x7f888001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c91d43201c6973 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:35.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.978+0000 7f8885400640 1 -- 172.21.15.8:0/863836993 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88800b0070 con 0x7f8888156ac0 2024-03-23T23:58:35.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.978+0000 7f8885400640 1 -- 172.21.15.8:0/863836993 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88800ab600 con 0x7f8888156ac0 2024-03-23T23:58:35.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.978+0000 7f8885400640 1 -- 172.21.15.8:0/863836993 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88800ab9d0 con 0x7f8888156ac0 2024-03-23T23:58:35.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.978+0000 7f8887200640 1 -- 172.21.15.8:0/863836993 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8888156ac0 msgr2=0x7f8888156f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:35.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.978+0000 7f8887200640 1 --2- 172.21.15.8:0/863836993 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8888156ac0 0x7f8888156f70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f88800097c0 tx=0x7f888001c410 comp rx=0 tx=0).stop 2024-03-23T23:58:35.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.978+0000 7f8887200640 1 -- 172.21.15.8:0/863836993 shutdown_connections 2024-03-23T23:58:35.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.978+0000 7f8887200640 1 --2- 172.21.15.8:0/863836993 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8888156ac0 0x7f8888156f70 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.978+0000 7f8887200640 1 --2- 172.21.15.8:0/863836993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8888150b90 0x7f888806e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.978+0000 7f8887200640 1 -- 172.21.15.8:0/863836993 >> 172.21.15.8:0/863836993 conn(0x7f88880c8de0 msgr2=0x7f88880c91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:35.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.978+0000 7f8887200640 1 -- 172.21.15.8:0/863836993 shutdown_connections 2024-03-23T23:58:35.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.978+0000 7f8887200640 1 -- 172.21.15.8:0/863836993 wait complete. 2024-03-23T23:58:35.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.982+0000 7f8887200640 1 Processor -- start 2024-03-23T23:58:35.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.982+0000 7f8887200640 1 -- start start 2024-03-23T23:58:35.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.982+0000 7f8887200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f88880c8580 0x7f88881512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:35.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.982+0000 7f8887200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8888150b90 0x7f888815d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:35.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.982+0000 7f8887200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8888156ac0 0x7f8888149f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:35.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.982+0000 7f8887200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88881608e0 con 0x7f8888150b90 2024-03-23T23:58:35.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.982+0000 7f8887200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8888160760 con 0x7f8888156ac0 2024-03-23T23:58:35.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.982+0000 7f8887200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8888160a60 con 0x7f88880c8580 2024-03-23T23:58:35.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.982+0000 7f887d400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8888150b90 0x7f888815d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:35.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.982+0000 7f8885e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f88880c8580 0x7f88881512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:35.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.982+0000 7f8885e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f88880c8580 0x7f88881512c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:58250/0 (socket says 172.21.15.8:58250) 2024-03-23T23:58:35.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.982+0000 7f8885e00640 1 -- 172.21.15.8:0/1229085761 learned_addr learned my addr 172.21.15.8:0/1229085761 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:35.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.982+0000 7f887d400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8888150b90 0x7f888815d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46576/0 (socket says 172.21.15.8:46576) 2024-03-23T23:58:35.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.982+0000 7f8886800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8888156ac0 0x7f8888149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:35.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.982+0000 7f8886800640 1 -- 172.21.15.8:0/1229085761 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f88880c8580 msgr2=0x7f88881512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:35.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.982+0000 7f8886800640 1 --2- 172.21.15.8:0/1229085761 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f88880c8580 0x7f88881512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.982+0000 7f8886800640 1 -- 172.21.15.8:0/1229085761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8888150b90 msgr2=0x7f888815d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:35.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.982+0000 7f8886800640 1 --2- 172.21.15.8:0/1229085761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8888150b90 0x7f888815d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:35.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.982+0000 7f8886800640 1 -- 172.21.15.8:0/1229085761 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8888151800 con 0x7f8888156ac0 2024-03-23T23:58:35.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.982+0000 7f887d400640 1 --2- 172.21.15.8:0/1229085761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8888150b90 0x7f888815d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:58:35.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.982+0000 7f8886800640 1 --2- 172.21.15.8:0/1229085761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8888156ac0 0x7f8888149f80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f88880c9c70 tx=0x7f88800191b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:35.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.982+0000 7f887ea00640 1 -- 172.21.15.8:0/1229085761 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88800b0040 con 0x7f8888156ac0 2024-03-23T23:58:35.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.982+0000 7f887ea00640 1 -- 172.21.15.8:0/1229085761 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88800b9070 con 0x7f8888156ac0 2024-03-23T23:58:35.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.982+0000 7f887ea00640 1 -- 172.21.15.8:0/1229085761 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88800b4690 con 0x7f8888156ac0 2024-03-23T23:58:35.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.982+0000 7f8887200640 1 -- 172.21.15.8:0/1229085761 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88880c58a0 con 0x7f8888156ac0 2024-03-23T23:58:35.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.986+0000 7f8887200640 1 -- 172.21.15.8:0/1229085761 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88881530d0 con 0x7f8888156ac0 2024-03-23T23:58:35.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.986+0000 7f8887200640 1 -- 172.21.15.8:0/1229085761 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8888153a70 con 0x7f8888156ac0 2024-03-23T23:58:35.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.986+0000 7f887ea00640 1 -- 172.21.15.8:0/1229085761 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f88800b4830 con 0x7f8888156ac0 2024-03-23T23:58:35.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.986+0000 7f887ea00640 1 --2- 172.21.15.8:0/1229085761 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8864067660 0x7f8864069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:35.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.986+0000 7f887ea00640 1 -- 172.21.15.8:0/1229085761 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f888011f7d0 con 0x7f8888156ac0 2024-03-23T23:58:35.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.986+0000 7f8885e00640 1 --2- 172.21.15.8:0/1229085761 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8864067660 0x7f8864069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:35.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.986+0000 7f887ea00640 1 --2- 172.21.15.8:0/1229085761 >> [v2:172.21.15.196:6824/3516578147,v1:172.21.15.196:6825/3516578147] conn(0x7f8864072050 0x7f88640744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:35.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.986+0000 7f887ea00640 1 -- 172.21.15.8:0/1229085761 --> [v2:172.21.15.196:6824/3516578147,v1:172.21.15.196:6825/3516578147] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f88800a8ec0 con 0x7f8864072050 2024-03-23T23:58:35.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.986+0000 7f887ea00640 1 -- 172.21.15.8:0/1229085761 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8880126050 con 0x7f8888156ac0 2024-03-23T23:58:35.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.990+0000 7f887d400640 1 --2- 172.21.15.8:0/1229085761 >> [v2:172.21.15.196:6824/3516578147,v1:172.21.15.196:6825/3516578147] conn(0x7f8864072050 0x7f88640744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:35.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.990+0000 7f8885e00640 1 --2- 172.21.15.8:0/1229085761 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8864067660 0x7f8864069b20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8878009580 tx=0x7f8878009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:35.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.990+0000 7f887d400640 1 --2- 172.21.15.8:0/1229085761 >> [v2:172.21.15.196:6824/3516578147,v1:172.21.15.196:6825/3516578147] conn(0x7f8864072050 0x7f88640744f0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:35.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:35.990+0000 7f887ea00640 1 -- 172.21.15.8:0/1229085761 <== osd.4 v2:172.21.15.196:6824/3516578147 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f88800a8ec0 con 0x7f8864072050 2024-03-23T23:58:36.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.010+0000 7f8887200640 1 -- 172.21.15.8:0/1229085761 --> [v2:172.21.15.196:6824/3516578147,v1:172.21.15.196:6825/3516578147] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f888804f410 con 0x7f8864072050 2024-03-23T23:58:36.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.010+0000 7f887ea00640 1 -- 172.21.15.8:0/1229085761 <== osd.4 v2:172.21.15.196:6824/3516578147 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f888804f410 con 0x7f8864072050 2024-03-23T23:58:36.011 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:58:36.011 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-23T23:58:36.011 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:58:36.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.010+0000 7f8887200640 1 -- 172.21.15.8:0/1229085761 >> [v2:172.21.15.196:6824/3516578147,v1:172.21.15.196:6825/3516578147] conn(0x7f8864072050 msgr2=0x7f88640744f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:36.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.010+0000 7f8887200640 1 --2- 172.21.15.8:0/1229085761 >> [v2:172.21.15.196:6824/3516578147,v1:172.21.15.196:6825/3516578147] conn(0x7f8864072050 0x7f88640744f0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:36.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.010+0000 7f8887200640 1 -- 172.21.15.8:0/1229085761 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8864067660 msgr2=0x7f8864069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:36.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.010+0000 7f8887200640 1 --2- 172.21.15.8:0/1229085761 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f8864067660 0x7f8864069b20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8878009580 tx=0x7f8878009190 comp rx=0 tx=0).stop 2024-03-23T23:58:36.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.010+0000 7f8887200640 1 -- 172.21.15.8:0/1229085761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8888156ac0 msgr2=0x7f8888149f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:36.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.010+0000 7f8887200640 1 --2- 172.21.15.8:0/1229085761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8888156ac0 0x7f8888149f80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f88880c9c70 tx=0x7f88800191b0 comp rx=0 tx=0).stop 2024-03-23T23:58:36.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.010+0000 7f8886800640 1 -- 172.21.15.8:0/1229085761 reap_dead start 2024-03-23T23:58:36.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.010+0000 7f8887200640 1 -- 172.21.15.8:0/1229085761 shutdown_connections 2024-03-23T23:58:36.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.010+0000 7f8887200640 1 -- 172.21.15.8:0/1229085761 >> 172.21.15.8:0/1229085761 conn(0x7f88880c8de0 msgr2=0x7f88880c5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:36.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.010+0000 7f8887200640 1 -- 172.21.15.8:0/1229085761 shutdown_connections 2024-03-23T23:58:36.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.010+0000 7f8887200640 1 -- 172.21.15.8:0/1229085761 wait complete. 2024-03-23T23:58:36.029 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-23T23:58:36.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.170+0000 7f465a800640 1 Processor -- start 2024-03-23T23:58:36.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.170+0000 7f465a800640 1 -- start start 2024-03-23T23:58:36.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.174+0000 7f465a800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f465406cdf0 0x7f46540acf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:36.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.174+0000 7f465a800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f465414feb0 con 0x7f465414fad0 2024-03-23T23:58:36.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.174+0000 7f465a800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4654071b90 con 0x7f4654073180 2024-03-23T23:58:36.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.174+0000 7f465a800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f465406ef20 con 0x7f465406cdf0 2024-03-23T23:58:36.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.174+0000 7f4658a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f465406cdf0 0x7f46540acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:36.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.174+0000 7f4659400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f465414fad0 0x7f4654071da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:55936/0 (socket says 172.21.15.8:55936) 2024-03-23T23:58:36.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.174+0000 7f4659400640 1 -- 172.21.15.8:0/514163043 learned_addr learned my addr 172.21.15.8:0/514163043 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:58:36.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.174+0000 7f4658a00640 1 -- 172.21.15.8:0/514163043 >> v1:172.21.15.196:6789/0 conn(0x7f4654073180 legacy=0x7f4654152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:36.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.174+0000 7f4658a00640 1 -- 172.21.15.8:0/514163043 >> v1:172.21.15.8:6789/0 conn(0x7f465414fad0 legacy=0x7f4654071da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:36.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.174+0000 7f4658a00640 1 -- 172.21.15.8:0/514163043 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46540c1c00 con 0x7f465406cdf0 2024-03-23T23:58:36.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.178+0000 7f4658a00640 1 --2- 172.21.15.8:0/514163043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f465406cdf0 0x7f46540acf10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f46400097c0 tx=0x7f464001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500ed905bd59e4ce server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:36.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.178+0000 7f4653e00640 1 -- 172.21.15.8:0/514163043 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46400b0070 con 0x7f465406cdf0 2024-03-23T23:58:36.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.178+0000 7f4653e00640 1 -- 172.21.15.8:0/514163043 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46400ab600 con 0x7f465406cdf0 2024-03-23T23:58:36.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.178+0000 7f4653e00640 1 -- 172.21.15.8:0/514163043 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46400ab9d0 con 0x7f465406cdf0 2024-03-23T23:58:36.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.178+0000 7f465a800640 1 -- 172.21.15.8:0/514163043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f465406cdf0 msgr2=0x7f46540acf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:36.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.178+0000 7f465a800640 1 --2- 172.21.15.8:0/514163043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f465406cdf0 0x7f46540acf10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f46400097c0 tx=0x7f464001c380 comp rx=0 tx=0).stop 2024-03-23T23:58:36.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.178+0000 7f465a800640 1 -- 172.21.15.8:0/514163043 shutdown_connections 2024-03-23T23:58:36.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.178+0000 7f465a800640 1 --2- 172.21.15.8:0/514163043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f465406cdf0 0x7f46540acf10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:36.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.178+0000 7f465a800640 1 -- 172.21.15.8:0/514163043 >> 172.21.15.8:0/514163043 conn(0x7f465406b170 msgr2=0x7f465406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:36.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.178+0000 7f465a800640 1 -- 172.21.15.8:0/514163043 shutdown_connections 2024-03-23T23:58:36.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.178+0000 7f465a800640 1 -- 172.21.15.8:0/514163043 wait complete. 2024-03-23T23:58:36.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.178+0000 7f465a800640 1 Processor -- start 2024-03-23T23:58:36.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.182+0000 7f465a800640 1 -- start start 2024-03-23T23:58:36.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.182+0000 7f465a800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f465406cdf0 0x7f4654151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:36.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.182+0000 7f465a800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4654073180 0x7f46540c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:36.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.182+0000 7f465a800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f465414fad0 0x7f4654145050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:36.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.182+0000 7f465a800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4654072630 con 0x7f4654073180 2024-03-23T23:58:36.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.182+0000 7f465a800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46540724b0 con 0x7f465406cdf0 2024-03-23T23:58:36.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.182+0000 7f465a800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4654153210 con 0x7f465414fad0 2024-03-23T23:58:36.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.182+0000 7f4658a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4654073180 0x7f46540c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:36.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.182+0000 7f4659400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f465406cdf0 0x7f4654151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:36.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.182+0000 7f4658a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4654073180 0x7f46540c5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46596/0 (socket says 172.21.15.8:46596) 2024-03-23T23:58:36.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.182+0000 7f4658a00640 1 -- 172.21.15.8:0/3045190477 learned_addr learned my addr 172.21.15.8:0/3045190477 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:36.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.182+0000 7f4659e00640 1 --2- 172.21.15.8:0/3045190477 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f465414fad0 0x7f4654145050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:36.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.182+0000 7f4658a00640 1 -- 172.21.15.8:0/3045190477 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f465414fad0 msgr2=0x7f4654145050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:36.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.182+0000 7f4658a00640 1 --2- 172.21.15.8:0/3045190477 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f465414fad0 0x7f4654145050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:36.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.182+0000 7f4658a00640 1 -- 172.21.15.8:0/3045190477 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f465406cdf0 msgr2=0x7f4654151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:36.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.182+0000 7f4658a00640 1 --2- 172.21.15.8:0/3045190477 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f465406cdf0 0x7f4654151560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:36.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.182+0000 7f4658a00640 1 -- 172.21.15.8:0/3045190477 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46541504a0 con 0x7f4654073180 2024-03-23T23:58:36.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.182+0000 7f4658a00640 1 --2- 172.21.15.8:0/3045190477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4654073180 0x7f46540c5890 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f46400097c0 tx=0x7f4640019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:36.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.182+0000 7f4651600640 1 -- 172.21.15.8:0/3045190477 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46400b8030 con 0x7f4654073180 2024-03-23T23:58:36.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.182+0000 7f4651600640 1 -- 172.21.15.8:0/3045190477 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46400b4410 con 0x7f4654073180 2024-03-23T23:58:36.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.182+0000 7f465a800640 1 -- 172.21.15.8:0/3045190477 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4654150780 con 0x7f4654073180 2024-03-23T23:58:36.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.182+0000 7f4651600640 1 -- 172.21.15.8:0/3045190477 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46400b0040 con 0x7f4654073180 2024-03-23T23:58:36.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.182+0000 7f465a800640 1 -- 172.21.15.8:0/3045190477 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4654151040 con 0x7f4654073180 2024-03-23T23:58:36.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.182+0000 7f465a800640 1 -- 172.21.15.8:0/3045190477 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4654150b50 con 0x7f4654073180 2024-03-23T23:58:36.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.186+0000 7f4651600640 1 -- 172.21.15.8:0/3045190477 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f46400bb070 con 0x7f4654073180 2024-03-23T23:58:36.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.186+0000 7f4651600640 1 --2- 172.21.15.8:0/3045190477 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4634067690 0x7f4634069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:36.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.186+0000 7f4651600640 1 -- 172.21.15.8:0/3045190477 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f464011f7e0 con 0x7f4654073180 2024-03-23T23:58:36.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.186+0000 7f4659400640 1 --2- 172.21.15.8:0/3045190477 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4634067690 0x7f4634069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:36.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.186+0000 7f4659400640 1 --2- 172.21.15.8:0/3045190477 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4634067690 0x7f4634069b50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4648005890 tx=0x7f4648009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:36.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.190+0000 7f4651600640 1 -- 172.21.15.8:0/3045190477 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f4640016090 con 0x7f4654073180 2024-03-23T23:58:36.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.366+0000 7f465a800640 1 -- 172.21.15.8:0/3045190477 --> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f465404f410 con 0x7f4634067690 2024-03-23T23:58:36.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.370+0000 7f4651600640 1 -- 172.21.15.8:0/3045190477 <== mgr.4098 v2:172.21.15.196:6832/1295060067 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f465404f410 con 0x7f4634067690 2024-03-23T23:58:36.370 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 4 to deep-scrub 2024-03-23T23:58:36.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.370+0000 7f465a800640 1 -- 172.21.15.8:0/3045190477 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4634067690 msgr2=0x7f4634069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:36.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.370+0000 7f465a800640 1 --2- 172.21.15.8:0/3045190477 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4634067690 0x7f4634069b50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4648005890 tx=0x7f4648009040 comp rx=0 tx=0).stop 2024-03-23T23:58:36.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.370+0000 7f465a800640 1 -- 172.21.15.8:0/3045190477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4654073180 msgr2=0x7f46540c5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:36.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.370+0000 7f465a800640 1 --2- 172.21.15.8:0/3045190477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4654073180 0x7f46540c5890 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f46400097c0 tx=0x7f4640019120 comp rx=0 tx=0).stop 2024-03-23T23:58:36.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.370+0000 7f465a800640 1 -- 172.21.15.8:0/3045190477 shutdown_connections 2024-03-23T23:58:36.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.370+0000 7f465a800640 1 --2- 172.21.15.8:0/3045190477 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f4634067690 0x7f4634069b50 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:36.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.370+0000 7f465a800640 1 --2- 172.21.15.8:0/3045190477 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f465414fad0 0x7f4654145050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:36.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.370+0000 7f465a800640 1 --2- 172.21.15.8:0/3045190477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4654073180 0x7f46540c5890 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:36.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.370+0000 7f465a800640 1 --2- 172.21.15.8:0/3045190477 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f465406cdf0 0x7f4654151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:36.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.370+0000 7f465a800640 1 -- 172.21.15.8:0/3045190477 >> 172.21.15.8:0/3045190477 conn(0x7f465406b170 msgr2=0x7f46540c0500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:36.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.370+0000 7f465a800640 1 -- 172.21.15.8:0/3045190477 shutdown_connections 2024-03-23T23:58:36.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.370+0000 7f465a800640 1 -- 172.21.15.8:0/3045190477 wait complete. 2024-03-23T23:58:36.392 INFO:tasks.ceph:Scrubbing osd.5 2024-03-23T23:58:36.392 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-23T23:58:36.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.538+0000 7f2949e00640 1 Processor -- start 2024-03-23T23:58:36.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.538+0000 7f2949e00640 1 -- start start 2024-03-23T23:58:36.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.538+0000 7f2949e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2944150da0 0x7f294406d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:36.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.538+0000 7f2949e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f294406e2c0 0x7f29441572b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:36.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.538+0000 7f2949e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2944154480 con 0x7f294406de30 2024-03-23T23:58:36.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.538+0000 7f2949e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29440aa180 con 0x7f294406e2c0 2024-03-23T23:58:36.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.538+0000 7f2949e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29440aa460 con 0x7f2944150da0 2024-03-23T23:58:36.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.538+0000 7f2943400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f294406e2c0 0x7f29441572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:36.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.538+0000 7f2943400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f294406e2c0 0x7f29441572b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46602/0 (socket says 172.21.15.8:46602) 2024-03-23T23:58:36.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.538+0000 7f2942000640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f294406de30 0x7f2944156ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:55938/0 (socket says 172.21.15.8:55938) 2024-03-23T23:58:36.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.538+0000 7f2943400640 1 -- 172.21.15.8:0/2511637518 learned_addr learned my addr 172.21.15.8:0/2511637518 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:36.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.538+0000 7f2942a00640 1 --2- 172.21.15.8:0/2511637518 >> v2:172.21.15.196:3300/0 conn(0x7f2944150da0 0x7f294406d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:36.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.538+0000 7f2943400640 1 -- 172.21.15.8:0/2511637518 >> v2:172.21.15.196:3300/0 conn(0x7f2944150da0 msgr2=0x7f294406d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:36.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.538+0000 7f2943400640 1 --2- 172.21.15.8:0/2511637518 >> v2:172.21.15.196:3300/0 conn(0x7f2944150da0 0x7f294406d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:36.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.538+0000 7f2943400640 1 -- 172.21.15.8:0/2511637518 >> v1:172.21.15.8:6789/0 conn(0x7f294406de30 legacy=0x7f2944156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:36.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.538+0000 7f2943400640 1 -- 172.21.15.8:0/2511637518 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29440aa740 con 0x7f294406e2c0 2024-03-23T23:58:36.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.538+0000 7f2941600640 1 -- 172.21.15.8:0/2511637518 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3295408645 0 0) 0x7f2944154480 con 0x7f294406de30 2024-03-23T23:58:36.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.542+0000 7f2943400640 1 --2- 172.21.15.8:0/2511637518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f294406e2c0 0x7f29441572b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f29440c4bb0 tx=0x7f293c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b0386d33d1c3fb server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:36.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.542+0000 7f2941600640 1 -- 172.21.15.8:0/2511637518 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c0a5740 con 0x7f294406e2c0 2024-03-23T23:58:36.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.542+0000 7f2941600640 1 -- 172.21.15.8:0/2511637518 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293c0a58e0 con 0x7f294406e2c0 2024-03-23T23:58:36.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.542+0000 7f2941600640 1 -- 172.21.15.8:0/2511637518 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c0a5cb0 con 0x7f294406e2c0 2024-03-23T23:58:36.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.542+0000 7f2949e00640 1 -- 172.21.15.8:0/2511637518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f294406e2c0 msgr2=0x7f29441572b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:36.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.542+0000 7f2949e00640 1 --2- 172.21.15.8:0/2511637518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f294406e2c0 0x7f29441572b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f29440c4bb0 tx=0x7f293c01c9f0 comp rx=0 tx=0).stop 2024-03-23T23:58:36.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.542+0000 7f2949e00640 1 -- 172.21.15.8:0/2511637518 shutdown_connections 2024-03-23T23:58:36.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.542+0000 7f2949e00640 1 --2- 172.21.15.8:0/2511637518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f294406e2c0 0x7f29441572b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:36.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.542+0000 7f2949e00640 1 --2- 172.21.15.8:0/2511637518 >> v2:172.21.15.196:3300/0 conn(0x7f2944150da0 0x7f294406d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:36.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.542+0000 7f2949e00640 1 -- 172.21.15.8:0/2511637518 >> 172.21.15.8:0/2511637518 conn(0x7f29440c7060 msgr2=0x7f29440c7470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:36.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.542+0000 7f2949e00640 1 -- 172.21.15.8:0/2511637518 shutdown_connections 2024-03-23T23:58:36.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.542+0000 7f2949e00640 1 -- 172.21.15.8:0/2511637518 wait complete. 2024-03-23T23:58:36.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.546+0000 7f2949e00640 1 Processor -- start 2024-03-23T23:58:36.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.546+0000 7f2949e00640 1 -- start start 2024-03-23T23:58:36.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.546+0000 7f2949e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f294406de30 0x7f29440c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:36.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.546+0000 7f2949e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f294406e2c0 0x7f29440c19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:36.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.546+0000 7f2949e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2944150da0 0x7f29441f1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:36.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.546+0000 7f2949e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29441541b0 con 0x7f294406de30 2024-03-23T23:58:36.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.546+0000 7f2949e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2944154030 con 0x7f294406e2c0 2024-03-23T23:58:36.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.546+0000 7f2949e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29441577f0 con 0x7f2944150da0 2024-03-23T23:58:36.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.546+0000 7f2942a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f294406de30 0x7f29440c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:36.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.546+0000 7f2942a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f294406de30 0x7f29440c40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46614/0 (socket says 172.21.15.8:46614) 2024-03-23T23:58:36.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.546+0000 7f2942a00640 1 -- 172.21.15.8:0/2057847038 learned_addr learned my addr 172.21.15.8:0/2057847038 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:36.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.546+0000 7f2943400640 1 --2- 172.21.15.8:0/2057847038 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2944150da0 0x7f29441f1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:36.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.546+0000 7f2942000640 1 --2- 172.21.15.8:0/2057847038 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f294406e2c0 0x7f29440c19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:36.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.546+0000 7f2942a00640 1 -- 172.21.15.8:0/2057847038 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2944150da0 msgr2=0x7f29441f1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:36.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.546+0000 7f2942a00640 1 --2- 172.21.15.8:0/2057847038 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2944150da0 0x7f29441f1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:36.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.546+0000 7f2942a00640 1 -- 172.21.15.8:0/2057847038 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f294406e2c0 msgr2=0x7f29440c19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:36.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.546+0000 7f2942a00640 1 --2- 172.21.15.8:0/2057847038 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f294406e2c0 0x7f29440c19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:36.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.546+0000 7f2942a00640 1 -- 172.21.15.8:0/2057847038 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2944153540 con 0x7f294406de30 2024-03-23T23:58:36.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.546+0000 7f2942a00640 1 --2- 172.21.15.8:0/2057847038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f294406de30 0x7f29440c40f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f293400e870 tx=0x7f293400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:36.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.546+0000 7f293b400640 1 -- 172.21.15.8:0/2057847038 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2934017070 con 0x7f294406de30 2024-03-23T23:58:36.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.546+0000 7f293b400640 1 -- 172.21.15.8:0/2057847038 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293400c940 con 0x7f294406de30 2024-03-23T23:58:36.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.546+0000 7f293b400640 1 -- 172.21.15.8:0/2057847038 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293400ccf0 con 0x7f294406de30 2024-03-23T23:58:36.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.546+0000 7f2949e00640 1 -- 172.21.15.8:0/2057847038 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2944153820 con 0x7f294406de30 2024-03-23T23:58:36.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.550+0000 7f2949e00640 1 -- 172.21.15.8:0/2057847038 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29441f15c0 con 0x7f294406de30 2024-03-23T23:58:36.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.550+0000 7f2949e00640 1 -- 172.21.15.8:0/2057847038 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f294404f480 con 0x7f294406de30 2024-03-23T23:58:36.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.550+0000 7f293b400640 1 -- 172.21.15.8:0/2057847038 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f293401a070 con 0x7f294406de30 2024-03-23T23:58:36.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.550+0000 7f293b400640 1 --2- 172.21.15.8:0/2057847038 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2924067660 0x7f2924069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:36.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.550+0000 7f293b400640 1 -- 172.21.15.8:0/2057847038 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f2934085e80 con 0x7f294406de30 2024-03-23T23:58:36.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.550+0000 7f293b400640 1 --2- 172.21.15.8:0/2057847038 >> [v2:172.21.15.196:6800/830595758,v1:172.21.15.196:6802/830595758] conn(0x7f2924072050 0x7f29240744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:36.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.550+0000 7f293b400640 1 -- 172.21.15.8:0/2057847038 --> [v2:172.21.15.196:6800/830595758,v1:172.21.15.196:6802/830595758] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2924074bc0 con 0x7f2924072050 2024-03-23T23:58:36.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.550+0000 7f293b400640 1 -- 172.21.15.8:0/2057847038 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2934086230 con 0x7f294406de30 2024-03-23T23:58:36.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.550+0000 7f2942000640 1 --2- 172.21.15.8:0/2057847038 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2924067660 0x7f2924069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:36.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.550+0000 7f2943400640 1 --2- 172.21.15.8:0/2057847038 >> [v2:172.21.15.196:6800/830595758,v1:172.21.15.196:6802/830595758] conn(0x7f2924072050 0x7f29240744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:36.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.554+0000 7f2942000640 1 --2- 172.21.15.8:0/2057847038 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2924067660 0x7f2924069b20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f294414b100 tx=0x7f2930007d60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:36.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.554+0000 7f2943400640 1 --2- 172.21.15.8:0/2057847038 >> [v2:172.21.15.196:6800/830595758,v1:172.21.15.196:6802/830595758] conn(0x7f2924072050 0x7f29240744f0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:36.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.554+0000 7f293b400640 1 -- 172.21.15.8:0/2057847038 <== osd.5 v2:172.21.15.196:6800/830595758 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2924074bc0 con 0x7f2924072050 2024-03-23T23:58:36.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.582+0000 7f2949e00640 1 -- 172.21.15.8:0/2057847038 --> [v2:172.21.15.196:6800/830595758,v1:172.21.15.196:6802/830595758] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f29441505b0 con 0x7f2924072050 2024-03-23T23:58:36.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.582+0000 7f293b400640 1 -- 172.21.15.8:0/2057847038 <== osd.5 v2:172.21.15.196:6800/830595758 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f29441505b0 con 0x7f2924072050 2024-03-23T23:58:36.582 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:58:36.582 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-23T23:58:36.582 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:58:36.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.582+0000 7f2949e00640 1 -- 172.21.15.8:0/2057847038 >> [v2:172.21.15.196:6800/830595758,v1:172.21.15.196:6802/830595758] conn(0x7f2924072050 msgr2=0x7f29240744f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:36.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.582+0000 7f2949e00640 1 --2- 172.21.15.8:0/2057847038 >> [v2:172.21.15.196:6800/830595758,v1:172.21.15.196:6802/830595758] conn(0x7f2924072050 0x7f29240744f0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:36.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.582+0000 7f2949e00640 1 -- 172.21.15.8:0/2057847038 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2924067660 msgr2=0x7f2924069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:36.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.582+0000 7f2949e00640 1 --2- 172.21.15.8:0/2057847038 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f2924067660 0x7f2924069b20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f294414b100 tx=0x7f2930007d60 comp rx=0 tx=0).stop 2024-03-23T23:58:36.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.582+0000 7f2949e00640 1 -- 172.21.15.8:0/2057847038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f294406de30 msgr2=0x7f29440c40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:36.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.582+0000 7f2949e00640 1 --2- 172.21.15.8:0/2057847038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f294406de30 0x7f29440c40f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f293400e870 tx=0x7f293400ec70 comp rx=0 tx=0).stop 2024-03-23T23:58:36.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.582+0000 7f2943400640 1 -- 172.21.15.8:0/2057847038 reap_dead start 2024-03-23T23:58:36.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.582+0000 7f2949e00640 1 -- 172.21.15.8:0/2057847038 shutdown_connections 2024-03-23T23:58:36.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.582+0000 7f2949e00640 1 -- 172.21.15.8:0/2057847038 >> 172.21.15.8:0/2057847038 conn(0x7f29440c7060 msgr2=0x7f294414fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:36.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.582+0000 7f2949e00640 1 -- 172.21.15.8:0/2057847038 shutdown_connections 2024-03-23T23:58:36.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.582+0000 7f2949e00640 1 -- 172.21.15.8:0/2057847038 wait complete. 2024-03-23T23:58:36.600 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-23T23:58:36.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.754+0000 7fb177200640 1 Processor -- start 2024-03-23T23:58:36.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.754+0000 7fb177200640 1 -- start start 2024-03-23T23:58:36.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.754+0000 7fb177200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb170149bd0 0x7fb17014a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:36.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.754+0000 7fb177200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb1700ac270 0x7fb1700ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:36.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.754+0000 7fb177200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17014a5a0 con 0x7fb170156ee0 2024-03-23T23:58:36.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.754+0000 7fb177200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1700aa390 con 0x7fb170149bd0 2024-03-23T23:58:36.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.754+0000 7fb177200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb17006e720 con 0x7fb1700ac270 2024-03-23T23:58:36.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.758+0000 7fb16f400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb170149bd0 0x7fb17014a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:36.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.758+0000 7fb175200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb1700ac270 0x7fb1700ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:36.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.758+0000 7fb16f400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb170149bd0 0x7fb17014a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46628/0 (socket says 172.21.15.8:46628) 2024-03-23T23:58:36.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.758+0000 7fb16f400640 1 -- 172.21.15.8:0/3405397390 learned_addr learned my addr 172.21.15.8:0/3405397390 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:36.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.758+0000 7fb175200640 1 --2- 172.21.15.8:0/3405397390 >> v2:172.21.15.196:3300/0 conn(0x7fb1700ac270 0x7fb1700ac6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.8:38188/0 (socket says 172.21.15.8:38188) 2024-03-23T23:58:36.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.758+0000 7fb16fe00640 1 --1- 172.21.15.8:0/3405397390 >> v1:172.21.15.196:6789/0 conn(0x7fb170156ee0 0x7fb170073230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:57240/0 (socket says 172.21.15.8:57240) 2024-03-23T23:58:36.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.758+0000 7fb16f400640 1 -- 172.21.15.8:0/3405397390 >> v2:172.21.15.196:3300/0 conn(0x7fb1700ac270 msgr2=0x7fb1700ac6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:36.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.758+0000 7fb16f400640 1 --2- 172.21.15.8:0/3405397390 >> v2:172.21.15.196:3300/0 conn(0x7fb1700ac270 0x7fb1700ac6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:36.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.758+0000 7fb16f400640 1 -- 172.21.15.8:0/3405397390 >> v1:172.21.15.196:6789/0 conn(0x7fb170156ee0 legacy=0x7fb170073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:36.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.758+0000 7fb16f400640 1 -- 172.21.15.8:0/3405397390 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17006ea00 con 0x7fb170149bd0 2024-03-23T23:58:36.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.762+0000 7fb16f400640 1 --2- 172.21.15.8:0/3405397390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb170149bd0 0x7fb17014a060 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb1701514d0 tx=0x7fb15c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b34abf7f939c5e74 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:36.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.762+0000 7fb16ea00640 1 -- 172.21.15.8:0/3405397390 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c0ab660 con 0x7fb170149bd0 2024-03-23T23:58:36.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.762+0000 7fb16ea00640 1 -- 172.21.15.8:0/3405397390 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15c0b0070 con 0x7fb170149bd0 2024-03-23T23:58:36.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.762+0000 7fb16ea00640 1 -- 172.21.15.8:0/3405397390 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c0aba20 con 0x7fb170149bd0 2024-03-23T23:58:36.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.762+0000 7fb177200640 1 -- 172.21.15.8:0/3405397390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb170149bd0 msgr2=0x7fb17014a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:36.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.762+0000 7fb177200640 1 --2- 172.21.15.8:0/3405397390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb170149bd0 0x7fb17014a060 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb1701514d0 tx=0x7fb15c01c460 comp rx=0 tx=0).stop 2024-03-23T23:58:36.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.762+0000 7fb177200640 1 -- 172.21.15.8:0/3405397390 shutdown_connections 2024-03-23T23:58:36.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.762+0000 7fb177200640 1 --2- 172.21.15.8:0/3405397390 >> v2:172.21.15.196:3300/0 conn(0x7fb1700ac270 0x7fb1700ac6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:36.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.762+0000 7fb177200640 1 --2- 172.21.15.8:0/3405397390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb170149bd0 0x7fb17014a060 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:36.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.762+0000 7fb177200640 1 -- 172.21.15.8:0/3405397390 >> 172.21.15.8:0/3405397390 conn(0x7fb17006b170 msgr2=0x7fb17006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:36.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.762+0000 7fb177200640 1 -- 172.21.15.8:0/3405397390 shutdown_connections 2024-03-23T23:58:36.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.762+0000 7fb177200640 1 -- 172.21.15.8:0/3405397390 wait complete. 2024-03-23T23:58:36.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.766+0000 7fb177200640 1 Processor -- start 2024-03-23T23:58:36.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.766+0000 7fb177200640 1 -- start start 2024-03-23T23:58:36.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.766+0000 7fb177200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1700ac270 0x7fb1701ec770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:36.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.766+0000 7fb177200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb170149bd0 0x7fb170143770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:36.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.766+0000 7fb177200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb170156ee0 0x7fb17013b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:36.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.766+0000 7fb177200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1701579f0 con 0x7fb170149bd0 2024-03-23T23:58:36.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.766+0000 7fb177200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb170157870 con 0x7fb170156ee0 2024-03-23T23:58:36.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.766+0000 7fb177200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1701572c0 con 0x7fb1700ac270 2024-03-23T23:58:36.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.766+0000 7fb16f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb170149bd0 0x7fb170143770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:36.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.766+0000 7fb16f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb170149bd0 0x7fb170143770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46638/0 (socket says 172.21.15.8:46638) 2024-03-23T23:58:36.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.766+0000 7fb16f400640 1 -- 172.21.15.8:0/1158445649 learned_addr learned my addr 172.21.15.8:0/1158445649 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:36.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.766+0000 7fb175200640 1 --2- 172.21.15.8:0/1158445649 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb170156ee0 0x7fb17013b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:36.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.766+0000 7fb16fe00640 1 --2- 172.21.15.8:0/1158445649 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1700ac270 0x7fb1701ec770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:36.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.766+0000 7fb16f400640 1 -- 172.21.15.8:0/1158445649 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1700ac270 msgr2=0x7fb1701ec770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:36.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.766+0000 7fb16f400640 1 --2- 172.21.15.8:0/1158445649 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1700ac270 0x7fb1701ec770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:36.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.766+0000 7fb16f400640 1 -- 172.21.15.8:0/1158445649 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb170156ee0 msgr2=0x7fb17013b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:36.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.766+0000 7fb16f400640 1 --2- 172.21.15.8:0/1158445649 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb170156ee0 0x7fb17013b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:36.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.766+0000 7fb16f400640 1 -- 172.21.15.8:0/1158445649 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17014daf0 con 0x7fb170149bd0 2024-03-23T23:58:36.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.766+0000 7fb16f400640 1 --2- 172.21.15.8:0/1158445649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb170149bd0 0x7fb170143770 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb15c019070 tx=0x7fb15c01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:36.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.770+0000 7fb167e00640 1 -- 172.21.15.8:0/1158445649 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c0be5f0 con 0x7fb170149bd0 2024-03-23T23:58:36.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.770+0000 7fb167e00640 1 -- 172.21.15.8:0/1158445649 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15c0be790 con 0x7fb170149bd0 2024-03-23T23:58:36.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.770+0000 7fb177200640 1 -- 172.21.15.8:0/1158445649 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17013c850 con 0x7fb170149bd0 2024-03-23T23:58:36.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.770+0000 7fb167e00640 1 -- 172.21.15.8:0/1158445649 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c0beb40 con 0x7fb170149bd0 2024-03-23T23:58:36.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.770+0000 7fb177200640 1 -- 172.21.15.8:0/1158445649 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17013ce10 con 0x7fb170149bd0 2024-03-23T23:58:36.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.770+0000 7fb177200640 1 -- 172.21.15.8:0/1158445649 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb170068270 con 0x7fb170149bd0 2024-03-23T23:58:36.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.770+0000 7fb167e00640 1 -- 172.21.15.8:0/1158445649 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb15c0c7440 con 0x7fb170149bd0 2024-03-23T23:58:36.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.770+0000 7fb167e00640 1 --2- 172.21.15.8:0/1158445649 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb1500676b0 0x7fb150069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:36.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.770+0000 7fb167e00640 1 -- 172.21.15.8:0/1158445649 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fb15c1207f0 con 0x7fb170149bd0 2024-03-23T23:58:36.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.770+0000 7fb16fe00640 1 --2- 172.21.15.8:0/1158445649 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb1500676b0 0x7fb150069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:36.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.774+0000 7fb16fe00640 1 --2- 172.21.15.8:0/1158445649 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb1500676b0 0x7fb150069b70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb160000f70 tx=0x7fb160007e90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:36.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:36.774+0000 7fb167e00640 1 -- 172.21.15.8:0/1158445649 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fb15c016110 con 0x7fb170149bd0 2024-03-23T23:58:37.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.030+0000 7fb177200640 1 -- 172.21.15.8:0/1158445649 --> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fb170154860 con 0x7fb1500676b0 2024-03-23T23:58:37.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.034+0000 7fb167e00640 1 -- 172.21.15.8:0/1158445649 <== mgr.4098 v2:172.21.15.196:6832/1295060067 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb170154860 con 0x7fb1500676b0 2024-03-23T23:58:37.033 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 5 to deep-scrub 2024-03-23T23:58:37.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.034+0000 7fb177200640 1 -- 172.21.15.8:0/1158445649 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb1500676b0 msgr2=0x7fb150069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:37.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.034+0000 7fb177200640 1 --2- 172.21.15.8:0/1158445649 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb1500676b0 0x7fb150069b70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb160000f70 tx=0x7fb160007e90 comp rx=0 tx=0).stop 2024-03-23T23:58:37.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.034+0000 7fb177200640 1 -- 172.21.15.8:0/1158445649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb170149bd0 msgr2=0x7fb170143770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:37.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.034+0000 7fb177200640 1 --2- 172.21.15.8:0/1158445649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb170149bd0 0x7fb170143770 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb15c019070 tx=0x7fb15c01aca0 comp rx=0 tx=0).stop 2024-03-23T23:58:37.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.034+0000 7fb177200640 1 -- 172.21.15.8:0/1158445649 shutdown_connections 2024-03-23T23:58:37.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.034+0000 7fb177200640 1 --2- 172.21.15.8:0/1158445649 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb170156ee0 0x7fb17013b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:37.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.034+0000 7fb177200640 1 --2- 172.21.15.8:0/1158445649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb170149bd0 0x7fb170143770 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:37.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.034+0000 7fb177200640 1 --2- 172.21.15.8:0/1158445649 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb1500676b0 0x7fb150069b70 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:37.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.034+0000 7fb177200640 1 --2- 172.21.15.8:0/1158445649 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1700ac270 0x7fb1701ec770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:37.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.034+0000 7fb177200640 1 -- 172.21.15.8:0/1158445649 >> 172.21.15.8:0/1158445649 conn(0x7fb17006b170 msgr2=0x7fb170155310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:37.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.034+0000 7fb177200640 1 -- 172.21.15.8:0/1158445649 shutdown_connections 2024-03-23T23:58:37.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.034+0000 7fb177200640 1 -- 172.21.15.8:0/1158445649 wait complete. 2024-03-23T23:58:37.064 INFO:tasks.ceph:Scrubbing osd.6 2024-03-23T23:58:37.064 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-03-23T23:58:37.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.210+0000 7fe2d2e00640 1 Processor -- start 2024-03-23T23:58:37.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.210+0000 7fe2d2e00640 1 -- start start 2024-03-23T23:58:37.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.210+0000 7fe2d2e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe2cc153040 0x7fe2cc072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:37.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.210+0000 7fe2d2e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2cc0c2400 con 0x7fe2cc0c1d00 2024-03-23T23:58:37.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.210+0000 7fe2d2e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2cc155940 con 0x7fe2cc06f3e0 2024-03-23T23:58:37.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.210+0000 7fe2d2e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc156270 con 0x7fe2cc153040 2024-03-23T23:58:37.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.210+0000 7fe2d0e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe2cc0c1d00 0x7fe2cc158e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:55946/0 (socket says 172.21.15.8:55946) 2024-03-23T23:58:37.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.210+0000 7fe2d0e00640 1 -- 172.21.15.8:0/3311298556 learned_addr learned my addr 172.21.15.8:0/3311298556 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:58:37.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.210+0000 7fe2c3e00640 1 --2- 172.21.15.8:0/3311298556 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe2cc153040 0x7fe2cc072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:37.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.210+0000 7fe2cb400640 1 -- 172.21.15.8:0/3311298556 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1610652517 0 0) 0x7fe2cc155940 con 0x7fe2cc06f3e0 2024-03-23T23:58:37.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.210+0000 7fe2cb400640 1 -- 172.21.15.8:0/3311298556 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2b0003530 con 0x7fe2cc06f3e0 2024-03-23T23:58:37.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.210+0000 7fe2cb400640 1 -- 172.21.15.8:0/3311298556 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108567883 0 0) 0x7fe2cc0c2400 con 0x7fe2cc0c1d00 2024-03-23T23:58:37.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.210+0000 7fe2c3e00640 1 -- 172.21.15.8:0/3311298556 >> v1:172.21.15.196:6789/0 conn(0x7fe2cc06f3e0 legacy=0x7fe2cc152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:37.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.210+0000 7fe2c3e00640 1 -- 172.21.15.8:0/3311298556 >> v1:172.21.15.8:6789/0 conn(0x7fe2cc0c1d00 legacy=0x7fe2cc158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:37.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.210+0000 7fe2c3e00640 1 -- 172.21.15.8:0/3311298556 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2cc155c20 con 0x7fe2cc153040 2024-03-23T23:58:37.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.214+0000 7fe2c3e00640 1 --2- 172.21.15.8:0/3311298556 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe2cc153040 0x7fe2cc072fb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40097f0 tx=0x7fe2b401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f80f8215a41a29f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:37.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.214+0000 7fe2cb400640 1 -- 172.21.15.8:0/3311298556 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b40b0070 con 0x7fe2cc153040 2024-03-23T23:58:37.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.214+0000 7fe2cb400640 1 -- 172.21.15.8:0/3311298556 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b40ab600 con 0x7fe2cc153040 2024-03-23T23:58:37.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.214+0000 7fe2cb400640 1 -- 172.21.15.8:0/3311298556 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b40ab9d0 con 0x7fe2cc153040 2024-03-23T23:58:37.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.214+0000 7fe2d2e00640 1 -- 172.21.15.8:0/3311298556 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe2cc153040 msgr2=0x7fe2cc072fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:37.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.214+0000 7fe2d2e00640 1 --2- 172.21.15.8:0/3311298556 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe2cc153040 0x7fe2cc072fb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40097f0 tx=0x7fe2b401c450 comp rx=0 tx=0).stop 2024-03-23T23:58:37.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.214+0000 7fe2d2e00640 1 -- 172.21.15.8:0/3311298556 shutdown_connections 2024-03-23T23:58:37.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.214+0000 7fe2d2e00640 1 --2- 172.21.15.8:0/3311298556 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe2cc153040 0x7fe2cc072fb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:37.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.214+0000 7fe2d2e00640 1 -- 172.21.15.8:0/3311298556 >> 172.21.15.8:0/3311298556 conn(0x7fe2cc06c280 msgr2=0x7fe2cc06c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:37.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.214+0000 7fe2d2e00640 1 -- 172.21.15.8:0/3311298556 shutdown_connections 2024-03-23T23:58:37.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.214+0000 7fe2d2e00640 1 -- 172.21.15.8:0/3311298556 wait complete. 2024-03-23T23:58:37.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.218+0000 7fe2d2e00640 1 Processor -- start 2024-03-23T23:58:37.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.218+0000 7fe2d2e00640 1 -- start start 2024-03-23T23:58:37.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.218+0000 7fe2d2e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe2cc06f3e0 0x7fe2cc14d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:37.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.218+0000 7fe2d2e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2cc0c1d00 0x7fe2cc0c6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:37.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.218+0000 7fe2d2e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe2cc153040 0x7fe2cc14a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:37.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.218+0000 7fe2d2e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc06f940 con 0x7fe2cc0c1d00 2024-03-23T23:58:37.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.218+0000 7fe2d2e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc06f7c0 con 0x7fe2cc153040 2024-03-23T23:58:37.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.218+0000 7fe2d2e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc1639e0 con 0x7fe2cc06f3e0 2024-03-23T23:58:37.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.218+0000 7fe2c3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2cc0c1d00 0x7fe2cc0c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:37.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.218+0000 7fe2c3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2cc0c1d00 0x7fe2cc0c6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46640/0 (socket says 172.21.15.8:46640) 2024-03-23T23:58:37.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.218+0000 7fe2c3e00640 1 -- 172.21.15.8:0/2197975961 learned_addr learned my addr 172.21.15.8:0/2197975961 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:37.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.218+0000 7fe2cbe00640 1 --2- 172.21.15.8:0/2197975961 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe2cc06f3e0 0x7fe2cc14d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:37.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.218+0000 7fe2d0e00640 1 --2- 172.21.15.8:0/2197975961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe2cc153040 0x7fe2cc14a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:37.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.218+0000 7fe2c3e00640 1 -- 172.21.15.8:0/2197975961 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe2cc06f3e0 msgr2=0x7fe2cc14d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:37.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.218+0000 7fe2c3e00640 1 --2- 172.21.15.8:0/2197975961 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe2cc06f3e0 0x7fe2cc14d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:37.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.218+0000 7fe2c3e00640 1 -- 172.21.15.8:0/2197975961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe2cc153040 msgr2=0x7fe2cc14a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:37.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.218+0000 7fe2c3e00640 1 --2- 172.21.15.8:0/2197975961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe2cc153040 0x7fe2cc14a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:37.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.218+0000 7fe2c3e00640 1 -- 172.21.15.8:0/2197975961 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2cc154330 con 0x7fe2cc0c1d00 2024-03-23T23:58:37.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.218+0000 7fe2c3e00640 1 --2- 172.21.15.8:0/2197975961 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2cc0c1d00 0x7fe2cc0c6290 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4009740 tx=0x7fe2b40191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:37.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.218+0000 7fe2c8c00640 1 -- 172.21.15.8:0/2197975961 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b40bb070 con 0x7fe2cc0c1d00 2024-03-23T23:58:37.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.218+0000 7fe2c8c00640 1 -- 172.21.15.8:0/2197975961 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b4004020 con 0x7fe2cc0c1d00 2024-03-23T23:58:37.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.218+0000 7fe2c8c00640 1 -- 172.21.15.8:0/2197975961 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b40b0040 con 0x7fe2cc0c1d00 2024-03-23T23:58:37.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.218+0000 7fe2d2e00640 1 -- 172.21.15.8:0/2197975961 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2cc160a40 con 0x7fe2cc0c1d00 2024-03-23T23:58:37.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.218+0000 7fe2d2e00640 1 -- 172.21.15.8:0/2197975961 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2cc1f1aa0 con 0x7fe2cc0c1d00 2024-03-23T23:58:37.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.218+0000 7fe2d2e00640 1 -- 172.21.15.8:0/2197975961 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe2cc0c67d0 con 0x7fe2cc0c1d00 2024-03-23T23:58:37.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.222+0000 7fe2c8c00640 1 -- 172.21.15.8:0/2197975961 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fe2b40b3040 con 0x7fe2cc0c1d00 2024-03-23T23:58:37.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.222+0000 7fe2c8c00640 1 --2- 172.21.15.8:0/2197975961 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe2a8067690 0x7fe2a8069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:37.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.222+0000 7fe2c8c00640 1 -- 172.21.15.8:0/2197975961 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fe2b4120110 con 0x7fe2cc0c1d00 2024-03-23T23:58:37.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.222+0000 7fe2c8c00640 1 --2- 172.21.15.8:0/2197975961 >> [v2:172.21.15.196:6801/472639906,v1:172.21.15.196:6803/472639906] conn(0x7fe2a8072090 0x7fe2a8074530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:37.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.222+0000 7fe2cbe00640 1 --2- 172.21.15.8:0/2197975961 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe2a8067690 0x7fe2a8069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:37.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.222+0000 7fe2c8c00640 1 -- 172.21.15.8:0/2197975961 --> [v2:172.21.15.196:6801/472639906,v1:172.21.15.196:6803/472639906] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe2b40b2e50 con 0x7fe2a8072090 2024-03-23T23:58:37.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.222+0000 7fe2c8c00640 1 -- 172.21.15.8:0/2197975961 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2b41205a0 con 0x7fe2cc0c1d00 2024-03-23T23:58:37.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.222+0000 7fe2d0e00640 1 --2- 172.21.15.8:0/2197975961 >> [v2:172.21.15.196:6801/472639906,v1:172.21.15.196:6803/472639906] conn(0x7fe2a8072090 0x7fe2a8074530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:37.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.222+0000 7fe2cbe00640 1 --2- 172.21.15.8:0/2197975961 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe2a8067690 0x7fe2a8069b50 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc0011f0 tx=0x7fe2bc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:37.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.222+0000 7fe2d0e00640 1 --2- 172.21.15.8:0/2197975961 >> [v2:172.21.15.196:6801/472639906,v1:172.21.15.196:6803/472639906] conn(0x7fe2a8072090 0x7fe2a8074530 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:37.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.222+0000 7fe2c8c00640 1 -- 172.21.15.8:0/2197975961 <== osd.6 v2:172.21.15.196:6801/472639906 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fe2b40b2e50 con 0x7fe2a8072090 2024-03-23T23:58:37.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.242+0000 7fe2d2e00640 1 -- 172.21.15.8:0/2197975961 --> [v2:172.21.15.196:6801/472639906,v1:172.21.15.196:6803/472639906] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe2cc04f480 con 0x7fe2a8072090 2024-03-23T23:58:37.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.242+0000 7fe2c8c00640 1 -- 172.21.15.8:0/2197975961 <== osd.6 v2:172.21.15.196:6801/472639906 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe2cc04f480 con 0x7fe2a8072090 2024-03-23T23:58:37.245 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:58:37.245 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-23T23:58:37.245 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:58:37.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.242+0000 7fe2d2e00640 1 -- 172.21.15.8:0/2197975961 >> [v2:172.21.15.196:6801/472639906,v1:172.21.15.196:6803/472639906] conn(0x7fe2a8072090 msgr2=0x7fe2a8074530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:37.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.242+0000 7fe2d2e00640 1 --2- 172.21.15.8:0/2197975961 >> [v2:172.21.15.196:6801/472639906,v1:172.21.15.196:6803/472639906] conn(0x7fe2a8072090 0x7fe2a8074530 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:37.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.246+0000 7fe2d2e00640 1 -- 172.21.15.8:0/2197975961 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe2a8067690 msgr2=0x7fe2a8069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:37.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.246+0000 7fe2d2e00640 1 --2- 172.21.15.8:0/2197975961 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe2a8067690 0x7fe2a8069b50 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc0011f0 tx=0x7fe2bc009040 comp rx=0 tx=0).stop 2024-03-23T23:58:37.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.246+0000 7fe2d2e00640 1 -- 172.21.15.8:0/2197975961 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2cc0c1d00 msgr2=0x7fe2cc0c6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:37.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.246+0000 7fe2d2e00640 1 --2- 172.21.15.8:0/2197975961 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2cc0c1d00 0x7fe2cc0c6290 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4009740 tx=0x7fe2b40191f0 comp rx=0 tx=0).stop 2024-03-23T23:58:37.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.246+0000 7fe2d0e00640 1 -- 172.21.15.8:0/2197975961 reap_dead start 2024-03-23T23:58:37.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.246+0000 7fe2d2e00640 1 -- 172.21.15.8:0/2197975961 shutdown_connections 2024-03-23T23:58:37.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.246+0000 7fe2d2e00640 1 -- 172.21.15.8:0/2197975961 >> 172.21.15.8:0/2197975961 conn(0x7fe2cc06c280 msgr2=0x7fe2cc0ad0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:37.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.246+0000 7fe2d2e00640 1 -- 172.21.15.8:0/2197975961 shutdown_connections 2024-03-23T23:58:37.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.246+0000 7fe2d2e00640 1 -- 172.21.15.8:0/2197975961 wait complete. 2024-03-23T23:58:37.264 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-03-23T23:58:37.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.418+0000 7fb0d9c00640 1 Processor -- start 2024-03-23T23:58:37.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.418+0000 7fb0d9c00640 1 -- start start 2024-03-23T23:58:37.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.418+0000 7fb0d9c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0d406ee90 0x7fb0d4072130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:37.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.418+0000 7fb0d9c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb0d4072670 0x7fb0d415e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:37.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.418+0000 7fb0d9c00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d41541b0 con 0x7fb0d4150da0 2024-03-23T23:58:37.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.418+0000 7fb0d9c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d40a9750 con 0x7fb0d4072670 2024-03-23T23:58:37.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.418+0000 7fb0d9c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d40a9470 con 0x7fb0d406ee90 2024-03-23T23:58:37.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.418+0000 7fb0d2a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fb0d4150da0 0x7fb0d406b170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:55950/0 (socket says 172.21.15.8:55950) 2024-03-23T23:58:37.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.418+0000 7fb0d2a00640 1 -- 172.21.15.8:0/1912477033 learned_addr learned my addr 172.21.15.8:0/1912477033 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:58:37.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.418+0000 7fb0cbe00640 1 --2- 172.21.15.8:0/1912477033 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0d406ee90 0x7fb0d4072130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:37.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.418+0000 7fb0d3400640 1 --2- 172.21.15.8:0/1912477033 >> v2:172.21.15.196:3300/0 conn(0x7fb0d4072670 0x7fb0d415e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:37.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.418+0000 7fb0d2000640 1 -- 172.21.15.8:0/1912477033 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1692273088 0 0) 0x7fb0d41541b0 con 0x7fb0d4150da0 2024-03-23T23:58:37.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.418+0000 7fb0cbe00640 1 -- 172.21.15.8:0/1912477033 >> v2:172.21.15.196:3300/0 conn(0x7fb0d4072670 msgr2=0x7fb0d415e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:37.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.418+0000 7fb0cbe00640 1 --2- 172.21.15.8:0/1912477033 >> v2:172.21.15.196:3300/0 conn(0x7fb0d4072670 0x7fb0d415e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:37.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.418+0000 7fb0cbe00640 1 -- 172.21.15.8:0/1912477033 >> v1:172.21.15.8:6789/0 conn(0x7fb0d4150da0 legacy=0x7fb0d406b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:37.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.418+0000 7fb0cbe00640 1 -- 172.21.15.8:0/1912477033 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d406bc20 con 0x7fb0d406ee90 2024-03-23T23:58:37.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.422+0000 7fb0cbe00640 1 --2- 172.21.15.8:0/1912477033 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0d406ee90 0x7fb0d4072130 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc0097c0 tx=0x7fb0bc01c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fde32d1823c26925 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:37.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.422+0000 7fb0d2000640 1 -- 172.21.15.8:0/1912477033 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc0b0070 con 0x7fb0d406ee90 2024-03-23T23:58:37.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.422+0000 7fb0d2000640 1 -- 172.21.15.8:0/1912477033 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0bc0ab600 con 0x7fb0d406ee90 2024-03-23T23:58:37.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.422+0000 7fb0d2000640 1 -- 172.21.15.8:0/1912477033 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc0ab9d0 con 0x7fb0d406ee90 2024-03-23T23:58:37.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.422+0000 7fb0d9c00640 1 -- 172.21.15.8:0/1912477033 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0d406ee90 msgr2=0x7fb0d4072130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:37.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.422+0000 7fb0d9c00640 1 --2- 172.21.15.8:0/1912477033 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0d406ee90 0x7fb0d4072130 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc0097c0 tx=0x7fb0bc01c410 comp rx=0 tx=0).stop 2024-03-23T23:58:37.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.422+0000 7fb0d9c00640 1 -- 172.21.15.8:0/1912477033 shutdown_connections 2024-03-23T23:58:37.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.422+0000 7fb0d9c00640 1 --2- 172.21.15.8:0/1912477033 >> v2:172.21.15.196:3300/0 conn(0x7fb0d4072670 0x7fb0d415e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:37.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.422+0000 7fb0d9c00640 1 --2- 172.21.15.8:0/1912477033 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0d406ee90 0x7fb0d4072130 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:37.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.422+0000 7fb0d9c00640 1 -- 172.21.15.8:0/1912477033 >> 172.21.15.8:0/1912477033 conn(0x7fb0d406c280 msgr2=0x7fb0d406c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:37.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.422+0000 7fb0d9c00640 1 -- 172.21.15.8:0/1912477033 shutdown_connections 2024-03-23T23:58:37.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.422+0000 7fb0d9c00640 1 -- 172.21.15.8:0/1912477033 wait complete. 2024-03-23T23:58:37.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.422+0000 7fb0d9c00640 1 Processor -- start 2024-03-23T23:58:37.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.422+0000 7fb0d9c00640 1 -- start start 2024-03-23T23:58:37.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.426+0000 7fb0d9c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0d406ee90 0x7fb0d40c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:37.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.426+0000 7fb0d9c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0d4072670 0x7fb0d40c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:37.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.426+0000 7fb0d9c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0d4150da0 0x7fb0d40c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:37.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.426+0000 7fb0d9c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d406b880 con 0x7fb0d406ee90 2024-03-23T23:58:37.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.426+0000 7fb0d9c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d4072e60 con 0x7fb0d4150da0 2024-03-23T23:58:37.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.426+0000 7fb0d9c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d406ba00 con 0x7fb0d4072670 2024-03-23T23:58:37.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.426+0000 7fb0d2a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0d406ee90 0x7fb0d40c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:37.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.426+0000 7fb0d2a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0d406ee90 0x7fb0d40c8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46656/0 (socket says 172.21.15.8:46656) 2024-03-23T23:58:37.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.426+0000 7fb0d2a00640 1 -- 172.21.15.8:0/4101947812 learned_addr learned my addr 172.21.15.8:0/4101947812 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:37.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.426+0000 7fb0cbe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0d4072670 0x7fb0d40c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:37.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.426+0000 7fb0d3400640 1 --2- 172.21.15.8:0/4101947812 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0d4150da0 0x7fb0d40c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:37.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.426+0000 7fb0d2a00640 1 -- 172.21.15.8:0/4101947812 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0d4072670 msgr2=0x7fb0d40c5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:37.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.426+0000 7fb0d2a00640 1 --2- 172.21.15.8:0/4101947812 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0d4072670 0x7fb0d40c5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:37.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.426+0000 7fb0d2a00640 1 -- 172.21.15.8:0/4101947812 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0d4150da0 msgr2=0x7fb0d40c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:37.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.426+0000 7fb0d2a00640 1 --2- 172.21.15.8:0/4101947812 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0d4150da0 0x7fb0d40c64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:37.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.426+0000 7fb0d2a00640 1 -- 172.21.15.8:0/4101947812 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d40c9130 con 0x7fb0d406ee90 2024-03-23T23:58:37.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.426+0000 7fb0cbe00640 1 --2- 172.21.15.8:0/4101947812 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0d4072670 0x7fb0d40c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:58:37.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.426+0000 7fb0d2a00640 1 --2- 172.21.15.8:0/4101947812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0d406ee90 0x7fb0d40c8440 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb0c400c480 tx=0x7fb0c400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:37.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.426+0000 7fb0caa00640 1 -- 172.21.15.8:0/4101947812 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c4018070 con 0x7fb0d406ee90 2024-03-23T23:58:37.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.426+0000 7fb0caa00640 1 -- 172.21.15.8:0/4101947812 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c4007500 con 0x7fb0d406ee90 2024-03-23T23:58:37.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.426+0000 7fb0d9c00640 1 -- 172.21.15.8:0/4101947812 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d41f00d0 con 0x7fb0d406ee90 2024-03-23T23:58:37.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.426+0000 7fb0caa00640 1 -- 172.21.15.8:0/4101947812 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c4004a30 con 0x7fb0d406ee90 2024-03-23T23:58:37.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.426+0000 7fb0d9c00640 1 -- 172.21.15.8:0/4101947812 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d4146300 con 0x7fb0d406ee90 2024-03-23T23:58:37.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.426+0000 7fb0d9c00640 1 -- 172.21.15.8:0/4101947812 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d4068270 con 0x7fb0d406ee90 2024-03-23T23:58:37.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.430+0000 7fb0caa00640 1 -- 172.21.15.8:0/4101947812 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb0c401b070 con 0x7fb0d406ee90 2024-03-23T23:58:37.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.430+0000 7fb0caa00640 1 --2- 172.21.15.8:0/4101947812 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb0b0067690 0x7fb0b0069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:37.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.430+0000 7fb0caa00640 1 -- 172.21.15.8:0/4101947812 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fb0c4084f40 con 0x7fb0d406ee90 2024-03-23T23:58:37.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.430+0000 7fb0cbe00640 1 --2- 172.21.15.8:0/4101947812 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb0b0067690 0x7fb0b0069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:37.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.430+0000 7fb0cbe00640 1 --2- 172.21.15.8:0/4101947812 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb0b0067690 0x7fb0b0069b50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc0ad000 tx=0x7fb0bc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:37.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.434+0000 7fb0caa00640 1 -- 172.21.15.8:0/4101947812 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fb0c40551a0 con 0x7fb0d406ee90 2024-03-23T23:58:37.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.598+0000 7fb0d9c00640 1 -- 172.21.15.8:0/4101947812 --> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0d414b840 con 0x7fb0b0067690 2024-03-23T23:58:37.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.598+0000 7fb0caa00640 1 -- 172.21.15.8:0/4101947812 <== mgr.4098 v2:172.21.15.196:6832/1295060067 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb0d414b840 con 0x7fb0b0067690 2024-03-23T23:58:37.600 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 6 to deep-scrub 2024-03-23T23:58:37.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.602+0000 7fb0d9c00640 1 -- 172.21.15.8:0/4101947812 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb0b0067690 msgr2=0x7fb0b0069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:37.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.602+0000 7fb0d9c00640 1 --2- 172.21.15.8:0/4101947812 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb0b0067690 0x7fb0b0069b50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc0ad000 tx=0x7fb0bc008040 comp rx=0 tx=0).stop 2024-03-23T23:58:37.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.602+0000 7fb0d9c00640 1 -- 172.21.15.8:0/4101947812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0d406ee90 msgr2=0x7fb0d40c8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:37.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.602+0000 7fb0d9c00640 1 --2- 172.21.15.8:0/4101947812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0d406ee90 0x7fb0d40c8440 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb0c400c480 tx=0x7fb0c400c940 comp rx=0 tx=0).stop 2024-03-23T23:58:37.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.602+0000 7fb0d9c00640 1 -- 172.21.15.8:0/4101947812 shutdown_connections 2024-03-23T23:58:37.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.602+0000 7fb0d9c00640 1 --2- 172.21.15.8:0/4101947812 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0d4150da0 0x7fb0d40c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:37.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.602+0000 7fb0d9c00640 1 --2- 172.21.15.8:0/4101947812 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb0b0067690 0x7fb0b0069b50 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:37.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.602+0000 7fb0d9c00640 1 --2- 172.21.15.8:0/4101947812 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0d4072670 0x7fb0d40c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:37.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.602+0000 7fb0d9c00640 1 --2- 172.21.15.8:0/4101947812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0d406ee90 0x7fb0d40c8440 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:37.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.602+0000 7fb0d9c00640 1 -- 172.21.15.8:0/4101947812 >> 172.21.15.8:0/4101947812 conn(0x7fb0d406c280 msgr2=0x7fb0d41488a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:37.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.602+0000 7fb0d9c00640 1 -- 172.21.15.8:0/4101947812 shutdown_connections 2024-03-23T23:58:37.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.602+0000 7fb0d9c00640 1 -- 172.21.15.8:0/4101947812 wait complete. 2024-03-23T23:58:37.622 INFO:tasks.ceph:Scrubbing osd.7 2024-03-23T23:58:37.622 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-03-23T23:58:37.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.766+0000 7f080f400640 1 Processor -- start 2024-03-23T23:58:37.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.766+0000 7f080f400640 1 -- start start 2024-03-23T23:58:37.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.766+0000 7f080f400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0808071fb0 0x7f0808072390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:37.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.766+0000 7f080f400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0808073390 con 0x7f080806eb00 2024-03-23T23:58:37.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.766+0000 7f080f400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0808153310 con 0x7f080814c880 2024-03-23T23:58:37.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.766+0000 7f080f400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0808070f50 con 0x7f0808071fb0 2024-03-23T23:58:37.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.770+0000 7f080d400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f080806eb00 0x7f080815cf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:55962/0 (socket says 172.21.15.8:55962) 2024-03-23T23:58:37.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.770+0000 7f080d400640 1 -- 172.21.15.8:0/1998345965 learned_addr learned my addr 172.21.15.8:0/1998345965 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:58:37.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.770+0000 7f080ca00640 1 --2- 172.21.15.8:0/1998345965 >> v2:172.21.15.196:3300/0 conn(0x7f0808071fb0 0x7f0808072390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:37.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.770+0000 7f0807400640 1 -- 172.21.15.8:0/1998345965 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1062213285 0 0) 0x7f0808073390 con 0x7f080806eb00 2024-03-23T23:58:37.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.770+0000 7f0807400640 1 -- 172.21.15.8:0/1998345965 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07f0003530 con 0x7f080806eb00 2024-03-23T23:58:37.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.770+0000 7f080ca00640 1 -- 172.21.15.8:0/1998345965 >> v1:172.21.15.196:6789/0 conn(0x7f080814c880 legacy=0x7f080806cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:37.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.770+0000 7f0807400640 1 -- 172.21.15.8:0/1998345965 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898594602 0 0) 0x7f0808153310 con 0x7f080814c880 2024-03-23T23:58:37.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.770+0000 7f080ca00640 1 -- 172.21.15.8:0/1998345965 >> v1:172.21.15.8:6789/0 conn(0x7f080806eb00 legacy=0x7f080815cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:37.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.770+0000 7f080ca00640 1 -- 172.21.15.8:0/1998345965 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0808071230 con 0x7f0808071fb0 2024-03-23T23:58:37.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.774+0000 7f080ca00640 1 --2- 172.21.15.8:0/1998345965 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0808071fb0 0x7f0808072390 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f07fc0097c0 tx=0x7f07fc01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf8c1cb5b1349258 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:37.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.774+0000 7f0807400640 1 -- 172.21.15.8:0/1998345965 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc0b0070 con 0x7f0808071fb0 2024-03-23T23:58:37.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.774+0000 7f0807400640 1 -- 172.21.15.8:0/1998345965 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07fc0ab600 con 0x7f0808071fb0 2024-03-23T23:58:37.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.774+0000 7f0807400640 1 -- 172.21.15.8:0/1998345965 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc0ab9d0 con 0x7f0808071fb0 2024-03-23T23:58:37.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.774+0000 7f080f400640 1 -- 172.21.15.8:0/1998345965 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0808071fb0 msgr2=0x7f0808072390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:37.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.774+0000 7f080f400640 1 --2- 172.21.15.8:0/1998345965 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0808071fb0 0x7f0808072390 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f07fc0097c0 tx=0x7f07fc01c410 comp rx=0 tx=0).stop 2024-03-23T23:58:37.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.774+0000 7f080f400640 1 -- 172.21.15.8:0/1998345965 shutdown_connections 2024-03-23T23:58:37.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.774+0000 7f080f400640 1 --2- 172.21.15.8:0/1998345965 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0808071fb0 0x7f0808072390 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:37.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.774+0000 7f080f400640 1 -- 172.21.15.8:0/1998345965 >> 172.21.15.8:0/1998345965 conn(0x7f08080c7060 msgr2=0x7f08080c7470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:37.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.774+0000 7f080f400640 1 -- 172.21.15.8:0/1998345965 shutdown_connections 2024-03-23T23:58:37.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.774+0000 7f080f400640 1 -- 172.21.15.8:0/1998345965 wait complete. 2024-03-23T23:58:37.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.778+0000 7f080f400640 1 Processor -- start 2024-03-23T23:58:37.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.778+0000 7f080f400640 1 -- start start 2024-03-23T23:58:37.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.778+0000 7f080f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f080806eb00 0x7f08081f25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:37.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.778+0000 7f080f400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0808071fb0 0x7f08080c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:37.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.778+0000 7f080f400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08080c4170 0x7f080814d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:37.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.778+0000 7f080f400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08080ad1c0 con 0x7f080806eb00 2024-03-23T23:58:37.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.778+0000 7f080f400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08080ad040 con 0x7f0808071fb0 2024-03-23T23:58:37.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.778+0000 7f080f400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0808160e70 con 0x7f08080c4170 2024-03-23T23:58:37.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.778+0000 7f080ca00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f080806eb00 0x7f08081f25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:37.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.778+0000 7f080ca00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f080806eb00 0x7f08081f25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46668/0 (socket says 172.21.15.8:46668) 2024-03-23T23:58:37.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.778+0000 7f080ca00640 1 -- 172.21.15.8:0/445254238 learned_addr learned my addr 172.21.15.8:0/445254238 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:37.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.778+0000 7f0807e00640 1 --2- 172.21.15.8:0/445254238 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0808071fb0 0x7f08080c3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:37.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.778+0000 7f080d400640 1 --2- 172.21.15.8:0/445254238 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08080c4170 0x7f080814d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:37.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.778+0000 7f080ca00640 1 -- 172.21.15.8:0/445254238 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08080c4170 msgr2=0x7f080814d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:37.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.778+0000 7f080ca00640 1 --2- 172.21.15.8:0/445254238 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08080c4170 0x7f080814d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:37.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.778+0000 7f080ca00640 1 -- 172.21.15.8:0/445254238 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0808071fb0 msgr2=0x7f08080c3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:37.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.778+0000 7f080ca00640 1 --2- 172.21.15.8:0/445254238 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0808071fb0 0x7f08080c3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:37.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.778+0000 7f080ca00640 1 -- 172.21.15.8:0/445254238 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080814e170 con 0x7f080806eb00 2024-03-23T23:58:37.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.778+0000 7f080ca00640 1 --2- 172.21.15.8:0/445254238 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f080806eb00 0x7f08081f25c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f07fc0097c0 tx=0x7f07fc0191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:37.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.778+0000 7f0804c00640 1 -- 172.21.15.8:0/445254238 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc0b8070 con 0x7f080806eb00 2024-03-23T23:58:37.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.778+0000 7f0804c00640 1 -- 172.21.15.8:0/445254238 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07fc004020 con 0x7f080806eb00 2024-03-23T23:58:37.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.778+0000 7f080f400640 1 -- 172.21.15.8:0/445254238 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f080814e450 con 0x7f080806eb00 2024-03-23T23:58:37.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.778+0000 7f0804c00640 1 -- 172.21.15.8:0/445254238 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc0b0040 con 0x7f080806eb00 2024-03-23T23:58:37.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.778+0000 7f080f400640 1 -- 172.21.15.8:0/445254238 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f080814fc40 con 0x7f080806eb00 2024-03-23T23:58:37.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.778+0000 7f080f400640 1 -- 172.21.15.8:0/445254238 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f080814e650 con 0x7f080806eb00 2024-03-23T23:58:37.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.782+0000 7f0804c00640 1 -- 172.21.15.8:0/445254238 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f07fc003620 con 0x7f080806eb00 2024-03-23T23:58:37.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.782+0000 7f0804c00640 1 --2- 172.21.15.8:0/445254238 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f07e8067690 0x7f07e8069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:37.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.782+0000 7f0804c00640 1 -- 172.21.15.8:0/445254238 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f07fc11f6b0 con 0x7f080806eb00 2024-03-23T23:58:37.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.782+0000 7f0804c00640 1 --2- 172.21.15.8:0/445254238 >> [v2:172.21.15.196:6816/4151820349,v1:172.21.15.196:6817/4151820349] conn(0x7f07e8072080 0x7f07e8074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:37.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.782+0000 7f0804c00640 1 -- 172.21.15.8:0/445254238 --> [v2:172.21.15.196:6816/4151820349,v1:172.21.15.196:6817/4151820349] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f07fc0ab600 con 0x7f07e8072080 2024-03-23T23:58:37.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.782+0000 7f0804c00640 1 -- 172.21.15.8:0/445254238 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07fc126050 con 0x7f080806eb00 2024-03-23T23:58:37.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.782+0000 7f0807e00640 1 --2- 172.21.15.8:0/445254238 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f07e8067690 0x7f07e8069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:37.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.782+0000 7f080d400640 1 --2- 172.21.15.8:0/445254238 >> [v2:172.21.15.196:6816/4151820349,v1:172.21.15.196:6817/4151820349] conn(0x7f07e8072080 0x7f07e8074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:37.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.782+0000 7f080d400640 1 --2- 172.21.15.8:0/445254238 >> [v2:172.21.15.196:6816/4151820349,v1:172.21.15.196:6817/4151820349] conn(0x7f07e8072080 0x7f07e8074520 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:37.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.782+0000 7f0807e00640 1 --2- 172.21.15.8:0/445254238 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f07e8067690 0x7f07e8069b50 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f080815e170 tx=0x7f07f4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:37.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.786+0000 7f0804c00640 1 -- 172.21.15.8:0/445254238 <== osd.7 v2:172.21.15.196:6816/4151820349 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f07fc0ab600 con 0x7f07e8072080 2024-03-23T23:58:37.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.798+0000 7f080f400640 1 -- 172.21.15.8:0/445254238 --> [v2:172.21.15.196:6816/4151820349,v1:172.21.15.196:6817/4151820349] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f080804f480 con 0x7f07e8072080 2024-03-23T23:58:37.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.798+0000 7f0804c00640 1 -- 172.21.15.8:0/445254238 <== osd.7 v2:172.21.15.196:6816/4151820349 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f080804f480 con 0x7f07e8072080 2024-03-23T23:58:37.800 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-23T23:58:37.800 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-23T23:58:37.800 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-23T23:58:37.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.798+0000 7f080f400640 1 -- 172.21.15.8:0/445254238 >> [v2:172.21.15.196:6816/4151820349,v1:172.21.15.196:6817/4151820349] conn(0x7f07e8072080 msgr2=0x7f07e8074520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:37.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.798+0000 7f080f400640 1 --2- 172.21.15.8:0/445254238 >> [v2:172.21.15.196:6816/4151820349,v1:172.21.15.196:6817/4151820349] conn(0x7f07e8072080 0x7f07e8074520 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:37.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.798+0000 7f080f400640 1 -- 172.21.15.8:0/445254238 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f07e8067690 msgr2=0x7f07e8069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:37.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.798+0000 7f080f400640 1 --2- 172.21.15.8:0/445254238 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f07e8067690 0x7f07e8069b50 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f080815e170 tx=0x7f07f4009040 comp rx=0 tx=0).stop 2024-03-23T23:58:37.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.798+0000 7f080f400640 1 -- 172.21.15.8:0/445254238 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f080806eb00 msgr2=0x7f08081f25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:37.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.798+0000 7f080f400640 1 --2- 172.21.15.8:0/445254238 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f080806eb00 0x7f08081f25c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f07fc0097c0 tx=0x7f07fc0191b0 comp rx=0 tx=0).stop 2024-03-23T23:58:37.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.798+0000 7f080d400640 1 -- 172.21.15.8:0/445254238 reap_dead start 2024-03-23T23:58:37.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.798+0000 7f080f400640 1 -- 172.21.15.8:0/445254238 shutdown_connections 2024-03-23T23:58:37.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.798+0000 7f080f400640 1 -- 172.21.15.8:0/445254238 >> 172.21.15.8:0/445254238 conn(0x7f08080c7060 msgr2=0x7f08080c75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:37.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.798+0000 7f080f400640 1 -- 172.21.15.8:0/445254238 shutdown_connections 2024-03-23T23:58:37.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.798+0000 7f080f400640 1 -- 172.21.15.8:0/445254238 wait complete. 2024-03-23T23:58:37.819 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-03-23T23:58:37.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.958+0000 7f7a98a00640 1 Processor -- start 2024-03-23T23:58:37.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.962+0000 7f7a98a00640 1 -- start start 2024-03-23T23:58:37.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.962+0000 7f7a98a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7a941585a0 0x7f7a940a7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:37.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.962+0000 7f7a98a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7a94158d60 0x7f7a94159160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:37.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.962+0000 7f7a98a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a940c37e0 con 0x7f7a940c8860 2024-03-23T23:58:37.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.962+0000 7f7a98a00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a940c4570 con 0x7f7a94158d60 2024-03-23T23:58:37.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.962+0000 7f7a98a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a940c3ac0 con 0x7f7a941585a0 2024-03-23T23:58:37.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.962+0000 7f7a93e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7a94158d60 0x7f7a94159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:37.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.962+0000 7f7a93e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7a94158d60 0x7f7a94159160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46684/0 (socket says 172.21.15.8:46684) 2024-03-23T23:58:37.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.962+0000 7f7a93e00640 1 -- 172.21.15.8:0/1237288881 learned_addr learned my addr 172.21.15.8:0/1237288881 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:37.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.962+0000 7f7a93400640 1 --2- 172.21.15.8:0/1237288881 >> v2:172.21.15.196:3300/0 conn(0x7f7a941585a0 0x7f7a940a7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:37.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.962+0000 7f7a92a00640 1 -- 172.21.15.8:0/1237288881 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4200126017 0 0) 0x7f7a940c37e0 con 0x7f7a940c8860 2024-03-23T23:58:37.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.962+0000 7f7a93e00640 1 -- 172.21.15.8:0/1237288881 >> v2:172.21.15.196:3300/0 conn(0x7f7a941585a0 msgr2=0x7f7a940a7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:37.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.962+0000 7f7a93e00640 1 --2- 172.21.15.8:0/1237288881 >> v2:172.21.15.196:3300/0 conn(0x7f7a941585a0 0x7f7a940a7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:37.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.962+0000 7f7a93e00640 1 -- 172.21.15.8:0/1237288881 >> v1:172.21.15.196:6789/0 conn(0x7f7a940c8860 legacy=0x7f7a940c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:37.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.962+0000 7f7a93e00640 1 -- 172.21.15.8:0/1237288881 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a940c4200 con 0x7f7a94158d60 2024-03-23T23:58:37.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.966+0000 7f7a93e00640 1 --2- 172.21.15.8:0/1237288881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a94158d60 0x7f7a94159160 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7a940abc00 tx=0x7f7a8c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f767e525ae56f55 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:37.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.966+0000 7f7a92a00640 1 -- 172.21.15.8:0/1237288881 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c0a5620 con 0x7f7a94158d60 2024-03-23T23:58:37.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.966+0000 7f7a92a00640 1 -- 172.21.15.8:0/1237288881 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8c0a57c0 con 0x7f7a94158d60 2024-03-23T23:58:37.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.966+0000 7f7a92a00640 1 -- 172.21.15.8:0/1237288881 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c0a5b90 con 0x7f7a94158d60 2024-03-23T23:58:37.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.966+0000 7f7a98a00640 1 -- 172.21.15.8:0/1237288881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a94158d60 msgr2=0x7f7a94159160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:37.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.966+0000 7f7a98a00640 1 --2- 172.21.15.8:0/1237288881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a94158d60 0x7f7a94159160 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7a940abc00 tx=0x7f7a8c01c960 comp rx=0 tx=0).stop 2024-03-23T23:58:37.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.966+0000 7f7a98a00640 1 -- 172.21.15.8:0/1237288881 shutdown_connections 2024-03-23T23:58:37.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.966+0000 7f7a98a00640 1 --2- 172.21.15.8:0/1237288881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a94158d60 0x7f7a94159160 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:37.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.966+0000 7f7a98a00640 1 --2- 172.21.15.8:0/1237288881 >> v2:172.21.15.196:3300/0 conn(0x7f7a941585a0 0x7f7a940a7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:37.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.966+0000 7f7a98a00640 1 -- 172.21.15.8:0/1237288881 >> 172.21.15.8:0/1237288881 conn(0x7f7a940c8de0 msgr2=0x7f7a940c91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:37.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.966+0000 7f7a98a00640 1 -- 172.21.15.8:0/1237288881 shutdown_connections 2024-03-23T23:58:37.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.970+0000 7f7a98a00640 1 -- 172.21.15.8:0/1237288881 wait complete. 2024-03-23T23:58:37.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.970+0000 7f7a98a00640 1 Processor -- start 2024-03-23T23:58:37.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.970+0000 7f7a98a00640 1 -- start start 2024-03-23T23:58:37.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.970+0000 7f7a98a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a940c8860 0x7f7a9414d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:37.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.970+0000 7f7a98a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a941585a0 0x7f7a940ac570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:37.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.970+0000 7f7a98a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a94158d60 0x7f7a940acab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:37.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.970+0000 7f7a98a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a941629a0 con 0x7f7a94158d60 2024-03-23T23:58:37.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.970+0000 7f7a98a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a94162820 con 0x7f7a940c8860 2024-03-23T23:58:37.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.970+0000 7f7a98a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a94162b20 con 0x7f7a941585a0 2024-03-23T23:58:37.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.970+0000 7f7a93e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a94158d60 0x7f7a940acab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:37.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.970+0000 7f7a93400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a940c8860 0x7f7a9414d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:37.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.970+0000 7f7a93e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a94158d60 0x7f7a940acab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46690/0 (socket says 172.21.15.8:46690) 2024-03-23T23:58:37.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.970+0000 7f7a93e00640 1 -- 172.21.15.8:0/2330428014 learned_addr learned my addr 172.21.15.8:0/2330428014 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:37.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.970+0000 7f7a8be00640 1 --2- 172.21.15.8:0/2330428014 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a941585a0 0x7f7a940ac570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:37.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.970+0000 7f7a93e00640 1 -- 172.21.15.8:0/2330428014 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a941585a0 msgr2=0x7f7a940ac570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:37.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.970+0000 7f7a93e00640 1 --2- 172.21.15.8:0/2330428014 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a941585a0 0x7f7a940ac570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:37.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.970+0000 7f7a93e00640 1 -- 172.21.15.8:0/2330428014 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a940c8860 msgr2=0x7f7a9414d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:37.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.970+0000 7f7a93e00640 1 --2- 172.21.15.8:0/2330428014 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a940c8860 0x7f7a9414d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:37.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.970+0000 7f7a93e00640 1 -- 172.21.15.8:0/2330428014 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a940a9640 con 0x7f7a94158d60 2024-03-23T23:58:37.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.970+0000 7f7a8be00640 1 --2- 172.21.15.8:0/2330428014 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a941585a0 0x7f7a940ac570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:58:37.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.970+0000 7f7a93e00640 1 --2- 172.21.15.8:0/2330428014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a94158d60 0x7f7a940acab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c0af040 tx=0x7f7a8c019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:37.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.970+0000 7f7a8b400640 1 -- 172.21.15.8:0/2330428014 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c0bc030 con 0x7f7a94158d60 2024-03-23T23:58:37.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.970+0000 7f7a8b400640 1 -- 172.21.15.8:0/2330428014 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8c0b8470 con 0x7f7a94158d60 2024-03-23T23:58:37.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.970+0000 7f7a8b400640 1 -- 172.21.15.8:0/2330428014 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c009510 con 0x7f7a94158d60 2024-03-23T23:58:37.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.970+0000 7f7a98a00640 1 -- 172.21.15.8:0/2330428014 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a940a9920 con 0x7f7a94158d60 2024-03-23T23:58:37.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.974+0000 7f7a98a00640 1 -- 172.21.15.8:0/2330428014 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a940a9ee0 con 0x7f7a94158d60 2024-03-23T23:58:37.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.974+0000 7f7a98a00640 1 -- 172.21.15.8:0/2330428014 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a9404f410 con 0x7f7a94158d60 2024-03-23T23:58:37.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.974+0000 7f7a8b400640 1 -- 172.21.15.8:0/2330428014 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f7a8c0bf070 con 0x7f7a94158d60 2024-03-23T23:58:37.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.974+0000 7f7a8b400640 1 --2- 172.21.15.8:0/2330428014 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7a70067660 0x7f7a70069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:37.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.974+0000 7f7a8b400640 1 -- 172.21.15.8:0/2330428014 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f7a8c120b50 con 0x7f7a94158d60 2024-03-23T23:58:37.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.974+0000 7f7a93400640 1 --2- 172.21.15.8:0/2330428014 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7a70067660 0x7f7a70069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:37.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.978+0000 7f7a93400640 1 --2- 172.21.15.8:0/2330428014 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7a70067660 0x7f7a70069b20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7a84009b60 tx=0x7f7a84009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:37.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:37.978+0000 7f7a8b400640 1 -- 172.21.15.8:0/2330428014 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f7a8c0165e0 con 0x7f7a94158d60 2024-03-23T23:58:38.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.142+0000 7f7a98a00640 1 -- 172.21.15.8:0/2330428014 --> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a940aba10 con 0x7f7a70067660 2024-03-23T23:58:38.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.146+0000 7f7a8b400640 1 -- 172.21.15.8:0/2330428014 <== mgr.4098 v2:172.21.15.196:6832/1295060067 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7a940aba10 con 0x7f7a70067660 2024-03-23T23:58:38.145 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 7 to deep-scrub 2024-03-23T23:58:38.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.146+0000 7f7a98a00640 1 -- 172.21.15.8:0/2330428014 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7a70067660 msgr2=0x7f7a70069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:38.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.146+0000 7f7a98a00640 1 --2- 172.21.15.8:0/2330428014 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7a70067660 0x7f7a70069b20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7a84009b60 tx=0x7f7a84009190 comp rx=0 tx=0).stop 2024-03-23T23:58:38.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.146+0000 7f7a98a00640 1 -- 172.21.15.8:0/2330428014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a94158d60 msgr2=0x7f7a940acab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:38.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.146+0000 7f7a98a00640 1 --2- 172.21.15.8:0/2330428014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a94158d60 0x7f7a940acab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c0af040 tx=0x7f7a8c019700 comp rx=0 tx=0).stop 2024-03-23T23:58:38.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.146+0000 7f7a98a00640 1 -- 172.21.15.8:0/2330428014 shutdown_connections 2024-03-23T23:58:38.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.146+0000 7f7a98a00640 1 --2- 172.21.15.8:0/2330428014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a94158d60 0x7f7a940acab0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:38.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.146+0000 7f7a98a00640 1 --2- 172.21.15.8:0/2330428014 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f7a70067660 0x7f7a70069b20 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:38.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.146+0000 7f7a98a00640 1 --2- 172.21.15.8:0/2330428014 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a941585a0 0x7f7a940ac570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:38.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.146+0000 7f7a98a00640 1 --2- 172.21.15.8:0/2330428014 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a940c8860 0x7f7a9414d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:38.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.146+0000 7f7a98a00640 1 -- 172.21.15.8:0/2330428014 >> 172.21.15.8:0/2330428014 conn(0x7f7a940c8de0 msgr2=0x7f7a9406da50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:38.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.146+0000 7f7a98a00640 1 -- 172.21.15.8:0/2330428014 shutdown_connections 2024-03-23T23:58:38.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.146+0000 7f7a98a00640 1 -- 172.21.15.8:0/2330428014 wait complete. 2024-03-23T23:58:38.168 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T23:58:38.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.310+0000 7fb8fa400640 1 Processor -- start 2024-03-23T23:58:38.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.310+0000 7fb8fa400640 1 -- start start 2024-03-23T23:58:38.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.310+0000 7fb8fa400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8f414fc70 0x7fb8f40c3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:38.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.310+0000 7fb8fa400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb8f40c3d00 0x7fb8f40c4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:38.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.310+0000 7fb8fa400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f40c2f70 con 0x7fb8f4152850 2024-03-23T23:58:38.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.310+0000 7fb8fa400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f40c36a0 con 0x7fb8f40c3d00 2024-03-23T23:58:38.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.310+0000 7fb8fa400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f4155e70 con 0x7fb8f414fc70 2024-03-23T23:58:38.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.310+0000 7fb8f2a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb8f40c3d00 0x7fb8f40c4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:38.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.310+0000 7fb8f2a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb8f40c3d00 0x7fb8f40c4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46692/0 (socket says 172.21.15.8:46692) 2024-03-23T23:58:38.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.310+0000 7fb8f2a00640 1 -- 172.21.15.8:0/3800435379 learned_addr learned my addr 172.21.15.8:0/3800435379 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:38.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.310+0000 7fb8f3400640 1 --2- 172.21.15.8:0/3800435379 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8f414fc70 0x7fb8f40c3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:38.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.314+0000 7fb8f2a00640 1 -- 172.21.15.8:0/3800435379 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8f414fc70 msgr2=0x7fb8f40c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:38.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.314+0000 7fb8f2a00640 1 --2- 172.21.15.8:0/3800435379 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8f414fc70 0x7fb8f40c3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:38.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.314+0000 7fb8f2a00640 1 -- 172.21.15.8:0/3800435379 >> v1:172.21.15.196:6789/0 conn(0x7fb8f4152850 legacy=0x7fb8f4152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:38.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.314+0000 7fb8f2a00640 1 -- 172.21.15.8:0/3800435379 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f4156150 con 0x7fb8f40c3d00 2024-03-23T23:58:38.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.314+0000 7fb8f2a00640 1 --2- 172.21.15.8:0/3800435379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8f40c3d00 0x7fb8f40c4160 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0009870 tx=0x7fb8e001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3b5d13bdcb9b73 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:38.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.314+0000 7fb8f2000640 1 -- 172.21.15.8:0/3800435379 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e00b1070 con 0x7fb8f40c3d00 2024-03-23T23:58:38.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.314+0000 7fb8f2000640 1 -- 172.21.15.8:0/3800435379 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e00ac620 con 0x7fb8f40c3d00 2024-03-23T23:58:38.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.314+0000 7fb8f2000640 1 -- 172.21.15.8:0/3800435379 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e00ac9f0 con 0x7fb8f40c3d00 2024-03-23T23:58:38.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.314+0000 7fb8fa400640 1 -- 172.21.15.8:0/3800435379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8f40c3d00 msgr2=0x7fb8f40c4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:38.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.314+0000 7fb8fa400640 1 --2- 172.21.15.8:0/3800435379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8f40c3d00 0x7fb8f40c4160 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0009870 tx=0x7fb8e001c4d0 comp rx=0 tx=0).stop 2024-03-23T23:58:38.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.318+0000 7fb8fa400640 1 -- 172.21.15.8:0/3800435379 shutdown_connections 2024-03-23T23:58:38.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.318+0000 7fb8fa400640 1 --2- 172.21.15.8:0/3800435379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8f40c3d00 0x7fb8f40c4160 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:38.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.318+0000 7fb8fa400640 1 --2- 172.21.15.8:0/3800435379 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8f414fc70 0x7fb8f40c3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:38.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.318+0000 7fb8fa400640 1 -- 172.21.15.8:0/3800435379 >> 172.21.15.8:0/3800435379 conn(0x7fb8f406b170 msgr2=0x7fb8f406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:38.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.318+0000 7fb8fa400640 1 -- 172.21.15.8:0/3800435379 shutdown_connections 2024-03-23T23:58:38.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.318+0000 7fb8fa400640 1 -- 172.21.15.8:0/3800435379 wait complete. 2024-03-23T23:58:38.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.318+0000 7fb8fa400640 1 Processor -- start 2024-03-23T23:58:38.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.318+0000 7fb8fa400640 1 -- start start 2024-03-23T23:58:38.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.318+0000 7fb8fa400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8f40c3d00 0x7fb8f414a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:38.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.318+0000 7fb8fa400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8f414fc70 0x7fb8f4144dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:38.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.318+0000 7fb8fa400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8f4152850 0x7fb8f4151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:38.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.318+0000 7fb8fa400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f4150050 con 0x7fb8f4152850 2024-03-23T23:58:38.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.318+0000 7fb8fa400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f40c18d0 con 0x7fb8f414fc70 2024-03-23T23:58:38.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.318+0000 7fb8fa400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f41533f0 con 0x7fb8f40c3d00 2024-03-23T23:58:38.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.318+0000 7fb8f3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8f4152850 0x7fb8f4151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:38.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.318+0000 7fb8f3400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8f40c3d00 0x7fb8f414a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:38.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.318+0000 7fb8f3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8f4152850 0x7fb8f4151f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46698/0 (socket says 172.21.15.8:46698) 2024-03-23T23:58:38.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.318+0000 7fb8f2a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8f414fc70 0x7fb8f4144dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:38.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.318+0000 7fb8f3e00640 1 -- 172.21.15.8:0/1067441717 learned_addr learned my addr 172.21.15.8:0/1067441717 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:38.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.318+0000 7fb8f3e00640 1 -- 172.21.15.8:0/1067441717 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8f40c3d00 msgr2=0x7fb8f414a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:38.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.318+0000 7fb8f3e00640 1 --2- 172.21.15.8:0/1067441717 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8f40c3d00 0x7fb8f414a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:38.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.318+0000 7fb8f3e00640 1 -- 172.21.15.8:0/1067441717 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8f414fc70 msgr2=0x7fb8f4144dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:38.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.318+0000 7fb8f3e00640 1 --2- 172.21.15.8:0/1067441717 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8f414fc70 0x7fb8f4144dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:38.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.318+0000 7fb8f3e00640 1 -- 172.21.15.8:0/1067441717 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f4154ee0 con 0x7fb8f4152850 2024-03-23T23:58:38.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.318+0000 7fb8f3e00640 1 --2- 172.21.15.8:0/1067441717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8f4152850 0x7fb8f4151f40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec00c770 tx=0x7fb8ec00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:38.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.318+0000 7fb8eb400640 1 -- 172.21.15.8:0/1067441717 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec003b80 con 0x7fb8f4152850 2024-03-23T23:58:38.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.318+0000 7fb8eb400640 1 -- 172.21.15.8:0/1067441717 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ec003d20 con 0x7fb8f4152850 2024-03-23T23:58:38.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.318+0000 7fb8eb400640 1 -- 172.21.15.8:0/1067441717 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec00aa90 con 0x7fb8f4152850 2024-03-23T23:58:38.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.318+0000 7fb8fa400640 1 -- 172.21.15.8:0/1067441717 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f4154920 con 0x7fb8f4152850 2024-03-23T23:58:38.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.322+0000 7fb8fa400640 1 -- 172.21.15.8:0/1067441717 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f4151740 con 0x7fb8f4152850 2024-03-23T23:58:38.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.322+0000 7fb8fa400640 1 -- 172.21.15.8:0/1067441717 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f4068270 con 0x7fb8f4152850 2024-03-23T23:58:38.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.322+0000 7fb8eb400640 1 -- 172.21.15.8:0/1067441717 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb8ec00ac30 con 0x7fb8f4152850 2024-03-23T23:58:38.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.322+0000 7fb8eb400640 1 --2- 172.21.15.8:0/1067441717 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb8d4067690 0x7fb8d4069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:38.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.322+0000 7fb8eb400640 1 -- 172.21.15.8:0/1067441717 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fb8ec0859a0 con 0x7fb8f4152850 2024-03-23T23:58:38.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.322+0000 7fb8f3400640 1 --2- 172.21.15.8:0/1067441717 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb8d4067690 0x7fb8d4069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:38.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.322+0000 7fb8f3400640 1 --2- 172.21.15.8:0/1067441717 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb8d4067690 0x7fb8d4069b50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4009b60 tx=0x7fb8e4009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:38.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.326+0000 7fb8eb400640 1 -- 172.21.15.8:0/1067441717 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fb8ec055ca0 con 0x7fb8f4152850 2024-03-23T23:58:38.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.490+0000 7fb8fa400640 1 -- 172.21.15.8:0/1067441717 --> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb8f414ab70 con 0x7fb8d4067690 2024-03-23T23:58:38.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.514+0000 7fb8eb400640 1 -- 172.21.15.8:0/1067441717 <== mgr.4098 v2:172.21.15.196:6832/1295060067 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+491057 (secure 0 0 0) 0x7fb8f414ab70 con 0x7fb8d4067690 2024-03-23T23:58:38.519 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:58:38.522 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-03-23T23:58:38.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.518+0000 7fb8fa400640 1 -- 172.21.15.8:0/1067441717 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb8d4067690 msgr2=0x7fb8d4069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:38.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.518+0000 7fb8fa400640 1 --2- 172.21.15.8:0/1067441717 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb8d4067690 0x7fb8d4069b50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4009b60 tx=0x7fb8e4009190 comp rx=0 tx=0).stop 2024-03-23T23:58:38.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.518+0000 7fb8fa400640 1 -- 172.21.15.8:0/1067441717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8f4152850 msgr2=0x7fb8f4151f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:38.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.518+0000 7fb8fa400640 1 --2- 172.21.15.8:0/1067441717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8f4152850 0x7fb8f4151f40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec00c770 tx=0x7fb8ec00cc30 comp rx=0 tx=0).stop 2024-03-23T23:58:38.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.518+0000 7fb8fa400640 1 -- 172.21.15.8:0/1067441717 shutdown_connections 2024-03-23T23:58:38.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.518+0000 7fb8fa400640 1 --2- 172.21.15.8:0/1067441717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8f4152850 0x7fb8f4151f40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:38.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.518+0000 7fb8fa400640 1 --2- 172.21.15.8:0/1067441717 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8f414fc70 0x7fb8f4144dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:38.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.518+0000 7fb8fa400640 1 --2- 172.21.15.8:0/1067441717 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb8d4067690 0x7fb8d4069b50 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:38.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.518+0000 7fb8fa400640 1 --2- 172.21.15.8:0/1067441717 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8f40c3d00 0x7fb8f414a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:38.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.518+0000 7fb8fa400640 1 -- 172.21.15.8:0/1067441717 >> 172.21.15.8:0/1067441717 conn(0x7fb8f406b170 msgr2=0x7fb8f4152ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:38.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.518+0000 7fb8fa400640 1 -- 172.21.15.8:0/1067441717 shutdown_connections 2024-03-23T23:58:38.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:38.518+0000 7fb8fa400640 1 -- 172.21.15.8:0/1067441717 wait complete. 2024-03-23T23:58:38.539 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":505,"stamp":"2024-03-23T23:58:37.728336+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":192276854,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":195,"num_read_kb":347,"num_write":9956070,"num_write_kb":116277060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":662028,"ondisk_log_size":662028,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":6481816,"kb_used_data":377880,"kb_used_omap":12,"kb_used_meta":6103859,"kb_avail":748492904,"statfs":{"total":773094113280,"available":766456733696,"internally_reserved":0,"allocated":386949120,"data_stored":385474692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":6250352176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":498,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006316"},"pg_stats":[{"pgid":"5.18","version":"27'5452","reported_seq":5474,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.440810+0000","last_change":"2024-03-23T23:42:50.736219+0000","last_active":"2024-03-23T23:58:30.440810+0000","last_peered":"2024-03-23T23:58:30.440810+0000","last_clean":"2024-03-23T23:58:30.440810+0000","last_became_active":"2024-03-23T23:42:50.735940+0000","last_became_peered":"2024-03-23T23:42:50.735940+0000","last_unstale":"2024-03-23T23:58:30.440810+0000","last_undegraded":"2024-03-23T23:58:30.440810+0000","last_fullsized":"2024-03-23T23:58:30.440810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5452,"log_dups_size":0,"ondisk_log_size":5452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:11:44.111477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80864,"num_write_kb":923838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"27'57","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:01.041480+0000","last_change":"2024-03-23T23:42:39.693858+0000","last_active":"2024-03-23T23:57:01.041480+0000","last_peered":"2024-03-23T23:57:01.041480+0000","last_clean":"2024-03-23T23:57:01.041480+0000","last_became_active":"2024-03-23T23:42:39.693636+0000","last_became_peered":"2024-03-23T23:42:39.693636+0000","last_unstale":"2024-03-23T23:57:01.041480+0000","last_undegraded":"2024-03-23T23:57:01.041480+0000","last_fullsized":"2024-03-23T23:57:01.041480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'5384","reported_seq":5416,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.621860+0000","last_change":"2024-03-23T23:42:40.685708+0000","last_active":"2024-03-23T23:58:27.621860+0000","last_peered":"2024-03-23T23:58:27.621860+0000","last_clean":"2024-03-23T23:58:27.621860+0000","last_became_active":"2024-03-23T23:42:40.682755+0000","last_became_peered":"2024-03-23T23:42:40.682755+0000","last_unstale":"2024-03-23T23:58:27.621860+0000","last_undegraded":"2024-03-23T23:58:27.621860+0000","last_fullsized":"2024-03-23T23:58:27.621860+0000","mapping_epoch":19,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5284,"log_dups_size":0,"ondisk_log_size":5284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79922,"num_write_kb":951101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.602099+0000","last_change":"2024-03-23T23:42:49.750108+0000","last_active":"2024-03-23T23:57:57.602099+0000","last_peered":"2024-03-23T23:57:57.602099+0000","last_clean":"2024-03-23T23:57:57.602099+0000","last_became_active":"2024-03-23T23:42:49.749634+0000","last_became_peered":"2024-03-23T23:42:49.749634+0000","last_unstale":"2024-03-23T23:57:57.602099+0000","last_undegraded":"2024-03-23T23:57:57.602099+0000","last_fullsized":"2024-03-23T23:57:57.602099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"27'6028","reported_seq":6051,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.461422+0000","last_change":"2024-03-23T23:42:50.752450+0000","last_active":"2024-03-23T23:58:30.461422+0000","last_peered":"2024-03-23T23:58:30.461422+0000","last_clean":"2024-03-23T23:58:30.461422+0000","last_became_active":"2024-03-23T23:42:50.752078+0000","last_became_peered":"2024-03-23T23:42:50.752078+0000","last_unstale":"2024-03-23T23:58:30.461422+0000","last_undegraded":"2024-03-23T23:58:30.461422+0000","last_fullsized":"2024-03-23T23:58:30.461422+0000","mapping_epoch":23,"log_start":"27'300","ondisk_log_start":"27'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5728,"log_dups_size":0,"ondisk_log_size":5728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89116,"num_write_kb":998926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"27'15","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:02.020598+0000","last_change":"2024-03-23T23:42:39.687108+0000","last_active":"2024-03-23T23:57:02.020598+0000","last_peered":"2024-03-23T23:57:02.020598+0000","last_clean":"2024-03-23T23:57:02.020598+0000","last_became_active":"2024-03-23T23:42:39.686875+0000","last_became_peered":"2024-03-23T23:42:39.686875+0000","last_unstale":"2024-03-23T23:57:02.020598+0000","last_undegraded":"2024-03-23T23:57:02.020598+0000","last_fullsized":"2024-03-23T23:57:02.020598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'7365","reported_seq":7405,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:34.231403+0000","last_change":"2024-03-23T23:58:34.231444+0000","last_active":"2024-03-23T23:58:34.231403+0000","last_peered":"2024-03-23T23:58:34.231403+0000","last_clean":"2024-03-23T23:58:34.231403+0000","last_became_active":"2024-03-23T23:42:40.698003+0000","last_became_peered":"2024-03-23T23:42:40.698003+0000","last_unstale":"2024-03-23T23:58:34.231403+0000","last_undegraded":"2024-03-23T23:58:34.231403+0000","last_fullsized":"2024-03-23T23:58:34.231403+0000","mapping_epoch":19,"log_start":"27'500","ondisk_log_start":"27'500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7365","last_scrub_stamp":"2024-03-23T23:58:34.231261+0000","last_deep_scrub":"27'7365","last_deep_scrub_stamp":"2024-03-23T23:58:34.231261+0000","last_clean_scrub_stamp":"2024-03-23T23:58:34.231261+0000","objects_scrubbed":0,"log_size":6865,"log_dups_size":0,"ondisk_log_size":6865,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:54:41.308919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110287,"num_write_kb":1353580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'28","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:32.652461+0000","last_change":"2024-03-23T23:42:49.728923+0000","last_active":"2024-03-23T23:57:32.652461+0000","last_peered":"2024-03-23T23:57:32.652461+0000","last_clean":"2024-03-23T23:57:32.652461+0000","last_became_active":"2024-03-23T23:42:49.728261+0000","last_became_peered":"2024-03-23T23:42:49.728261+0000","last_unstale":"2024-03-23T23:57:32.652461+0000","last_undegraded":"2024-03-23T23:57:32.652461+0000","last_fullsized":"2024-03-23T23:57:32.652461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:22.375891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"27'4530","reported_seq":4552,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.406649+0000","last_change":"2024-03-23T23:42:50.755852+0000","last_active":"2024-03-23T23:58:30.406649+0000","last_peered":"2024-03-23T23:58:30.406649+0000","last_clean":"2024-03-23T23:58:30.406649+0000","last_became_active":"2024-03-23T23:42:50.755600+0000","last_became_peered":"2024-03-23T23:42:50.755600+0000","last_unstale":"2024-03-23T23:58:30.406649+0000","last_undegraded":"2024-03-23T23:58:30.406649+0000","last_fullsized":"2024-03-23T23:58:30.406649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4530,"log_dups_size":0,"ondisk_log_size":4530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:29:47.303374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67405,"num_write_kb":746106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"27'60","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:17.810639+0000","last_change":"2024-03-23T23:42:39.696690+0000","last_active":"2024-03-23T23:55:17.810639+0000","last_peered":"2024-03-23T23:55:17.810639+0000","last_clean":"2024-03-23T23:55:17.810639+0000","last_became_active":"2024-03-23T23:42:39.696342+0000","last_became_peered":"2024-03-23T23:42:39.696342+0000","last_unstale":"2024-03-23T23:55:17.810639+0000","last_undegraded":"2024-03-23T23:55:17.810639+0000","last_fullsized":"2024-03-23T23:55:17.810639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:42:37.702720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":12316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'4666","reported_seq":4696,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.711924+0000","last_change":"2024-03-23T23:42:40.700355+0000","last_active":"2024-03-23T23:58:27.711924+0000","last_peered":"2024-03-23T23:58:27.711924+0000","last_clean":"2024-03-23T23:58:27.711924+0000","last_became_active":"2024-03-23T23:42:40.697668+0000","last_became_peered":"2024-03-23T23:42:40.697668+0000","last_unstale":"2024-03-23T23:58:27.711924+0000","last_undegraded":"2024-03-23T23:58:27.711924+0000","last_fullsized":"2024-03-23T23:58:27.711924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4666,"log_dups_size":0,"ondisk_log_size":4666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:23:43.515519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69534,"num_write_kb":791816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'1354","reported_seq":1378,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.424228+0000","last_change":"2024-03-23T23:42:49.744792+0000","last_active":"2024-03-23T23:57:53.424228+0000","last_peered":"2024-03-23T23:57:53.424228+0000","last_clean":"2024-03-23T23:57:53.424228+0000","last_became_active":"2024-03-23T23:42:49.744561+0000","last_became_peered":"2024-03-23T23:42:49.744561+0000","last_unstale":"2024-03-23T23:57:53.424228+0000","last_undegraded":"2024-03-23T23:57:53.424228+0000","last_fullsized":"2024-03-23T23:57:53.424228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1354,"log_dups_size":0,"ondisk_log_size":1354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:07:58.222020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1348,"num_write_kb":4325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"27'4460","reported_seq":4482,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.439151+0000","last_change":"2024-03-23T23:42:50.755575+0000","last_active":"2024-03-23T23:58:30.439151+0000","last_peered":"2024-03-23T23:58:30.439151+0000","last_clean":"2024-03-23T23:58:30.439151+0000","last_became_active":"2024-03-23T23:42:50.755337+0000","last_became_peered":"2024-03-23T23:42:50.755337+0000","last_unstale":"2024-03-23T23:58:30.439151+0000","last_undegraded":"2024-03-23T23:58:30.439151+0000","last_fullsized":"2024-03-23T23:58:30.439151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4460,"log_dups_size":0,"ondisk_log_size":4460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:13.911327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65733,"num_write_kb":735312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"27'16","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:12.437892+0000","last_change":"2024-03-23T23:42:39.696707+0000","last_active":"2024-03-23T23:55:12.437892+0000","last_peered":"2024-03-23T23:55:12.437892+0000","last_clean":"2024-03-23T23:55:12.437892+0000","last_became_active":"2024-03-23T23:42:39.696401+0000","last_became_peered":"2024-03-23T23:42:39.696401+0000","last_unstale":"2024-03-23T23:55:12.437892+0000","last_undegraded":"2024-03-23T23:55:12.437892+0000","last_fullsized":"2024-03-23T23:55:12.437892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:30:55.757707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'6122","reported_seq":6152,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.741740+0000","last_change":"2024-03-23T23:42:40.700389+0000","last_active":"2024-03-23T23:58:27.741740+0000","last_peered":"2024-03-23T23:58:27.741740+0000","last_clean":"2024-03-23T23:58:27.741740+0000","last_became_active":"2024-03-23T23:42:40.699770+0000","last_became_peered":"2024-03-23T23:42:40.699770+0000","last_unstale":"2024-03-23T23:58:27.741740+0000","last_undegraded":"2024-03-23T23:58:27.741740+0000","last_fullsized":"2024-03-23T23:58:27.741740+0000","mapping_epoch":19,"log_start":"27'200","ondisk_log_start":"27'200","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5922,"log_dups_size":0,"ondisk_log_size":5922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:27.675824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91052,"num_write_kb":1089478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'302","reported_seq":326,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.263097+0000","last_change":"2024-03-23T23:42:49.745710+0000","last_active":"2024-03-23T23:58:30.263097+0000","last_peered":"2024-03-23T23:58:30.263097+0000","last_clean":"2024-03-23T23:58:30.263097+0000","last_became_active":"2024-03-23T23:42:49.745526+0000","last_became_peered":"2024-03-23T23:42:49.745526+0000","last_unstale":"2024-03-23T23:58:30.263097+0000","last_undegraded":"2024-03-23T23:58:30.263097+0000","last_fullsized":"2024-03-23T23:58:30.263097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:05:26.746849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5723788,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":5809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"27'5356","reported_seq":5381,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:31.671859+0000","last_change":"2024-03-23T23:42:50.747274+0000","last_active":"2024-03-23T23:58:31.671859+0000","last_peered":"2024-03-23T23:58:31.671859+0000","last_clean":"2024-03-23T23:58:31.671859+0000","last_became_active":"2024-03-23T23:42:50.746937+0000","last_became_peered":"2024-03-23T23:42:50.746937+0000","last_unstale":"2024-03-23T23:58:31.671859+0000","last_undegraded":"2024-03-23T23:58:31.671859+0000","last_fullsized":"2024-03-23T23:58:31.671859+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5356,"log_dups_size":0,"ondisk_log_size":5356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":11,"num_write":79434,"num_write_kb":896560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"27'5252","reported_seq":5283,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.632377+0000","last_change":"2024-03-23T23:42:40.682467+0000","last_active":"2024-03-23T23:58:27.632377+0000","last_peered":"2024-03-23T23:58:27.632377+0000","last_clean":"2024-03-23T23:58:27.632377+0000","last_became_active":"2024-03-23T23:42:40.682192+0000","last_became_peered":"2024-03-23T23:42:40.682192+0000","last_unstale":"2024-03-23T23:58:27.632377+0000","last_undegraded":"2024-03-23T23:58:27.632377+0000","last_fullsized":"2024-03-23T23:58:27.632377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5252,"log_dups_size":0,"ondisk_log_size":5252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:37:24.839568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78193,"num_write_kb":930302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'10","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:56:06.895925+0000","last_change":"2024-03-23T23:42:39.696528+0000","last_active":"2024-03-23T23:56:06.895925+0000","last_peered":"2024-03-23T23:56:06.895925+0000","last_clean":"2024-03-23T23:56:06.895925+0000","last_became_active":"2024-03-23T23:42:39.696207+0000","last_became_peered":"2024-03-23T23:42:39.696207+0000","last_unstale":"2024-03-23T23:56:06.895925+0000","last_undegraded":"2024-03-23T23:56:06.895925+0000","last_fullsized":"2024-03-23T23:56:06.895925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:47:02.190910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'10","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.352552+0000","last_change":"2024-03-23T23:42:49.734156+0000","last_active":"2024-03-23T23:57:53.352552+0000","last_peered":"2024-03-23T23:57:53.352552+0000","last_clean":"2024-03-23T23:57:53.352552+0000","last_became_active":"2024-03-23T23:42:49.733888+0000","last_became_peered":"2024-03-23T23:42:49.733888+0000","last_unstale":"2024-03-23T23:57:53.352552+0000","last_undegraded":"2024-03-23T23:57:53.352552+0000","last_fullsized":"2024-03-23T23:57:53.352552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:23:52.568123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"27'5594","reported_seq":5618,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:35.253805+0000","last_change":"2024-03-23T23:42:50.759749+0000","last_active":"2024-03-23T23:58:35.253805+0000","last_peered":"2024-03-23T23:58:35.253805+0000","last_clean":"2024-03-23T23:58:35.253805+0000","last_became_active":"2024-03-23T23:42:50.758670+0000","last_became_peered":"2024-03-23T23:42:50.758670+0000","last_unstale":"2024-03-23T23:58:35.253805+0000","last_undegraded":"2024-03-23T23:58:35.253805+0000","last_fullsized":"2024-03-23T23:58:35.253805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5594,"log_dups_size":0,"ondisk_log_size":5594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82815,"num_write_kb":936767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"27'4462","reported_seq":4494,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.671639+0000","last_change":"2024-03-23T23:42:40.674574+0000","last_active":"2024-03-23T23:58:27.671639+0000","last_peered":"2024-03-23T23:58:27.671639+0000","last_clean":"2024-03-23T23:58:27.671639+0000","last_became_active":"2024-03-23T23:42:40.674293+0000","last_became_peered":"2024-03-23T23:42:40.674293+0000","last_unstale":"2024-03-23T23:58:27.671639+0000","last_undegraded":"2024-03-23T23:58:27.671639+0000","last_fullsized":"2024-03-23T23:58:27.671639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4462,"log_dups_size":0,"ondisk_log_size":4462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66336,"num_write_kb":780596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'216","reported_seq":250,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.764120+0000","last_change":"2024-03-23T23:42:39.683165+0000","last_active":"2024-03-23T23:58:27.764120+0000","last_peered":"2024-03-23T23:58:27.764120+0000","last_clean":"2024-03-23T23:58:27.764120+0000","last_became_active":"2024-03-23T23:42:39.680121+0000","last_became_peered":"2024-03-23T23:42:39.680121+0000","last_unstale":"2024-03-23T23:58:27.764120+0000","last_undegraded":"2024-03-23T23:58:27.764120+0000","last_fullsized":"2024-03-23T23:58:27.764120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1241175,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":1371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.611646+0000","last_change":"2024-03-23T23:42:49.745016+0000","last_active":"2024-03-23T23:57:57.611646+0000","last_peered":"2024-03-23T23:57:57.611646+0000","last_clean":"2024-03-23T23:57:57.611646+0000","last_became_active":"2024-03-23T23:42:49.744742+0000","last_became_peered":"2024-03-23T23:42:49.744742+0000","last_unstale":"2024-03-23T23:57:57.611646+0000","last_undegraded":"2024-03-23T23:57:57.611646+0000","last_fullsized":"2024-03-23T23:57:57.611646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:30.033743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"27'4313","reported_seq":4335,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.444649+0000","last_change":"2024-03-23T23:42:50.749792+0000","last_active":"2024-03-23T23:58:30.444649+0000","last_peered":"2024-03-23T23:58:30.444649+0000","last_clean":"2024-03-23T23:58:30.444649+0000","last_became_active":"2024-03-23T23:42:50.749491+0000","last_became_peered":"2024-03-23T23:42:50.749491+0000","last_unstale":"2024-03-23T23:58:30.444649+0000","last_undegraded":"2024-03-23T23:58:30.444649+0000","last_fullsized":"2024-03-23T23:58:30.444649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4313,"log_dups_size":0,"ondisk_log_size":4313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:25:44.894505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64025,"num_write_kb":713675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'4688","reported_seq":4720,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.643890+0000","last_change":"2024-03-23T23:42:40.682999+0000","last_active":"2024-03-23T23:58:27.643890+0000","last_peered":"2024-03-23T23:58:27.643890+0000","last_clean":"2024-03-23T23:58:27.643890+0000","last_became_active":"2024-03-23T23:42:40.682672+0000","last_became_peered":"2024-03-23T23:42:40.682672+0000","last_unstale":"2024-03-23T23:58:27.643890+0000","last_undegraded":"2024-03-23T23:58:27.643890+0000","last_fullsized":"2024-03-23T23:58:27.643890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4688,"log_dups_size":0,"ondisk_log_size":4688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69709,"num_write_kb":858998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'2","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:56.668902+0000","last_change":"2024-03-23T23:42:39.691470+0000","last_active":"2024-03-23T23:57:56.668902+0000","last_peered":"2024-03-23T23:57:56.668902+0000","last_clean":"2024-03-23T23:57:56.668902+0000","last_became_active":"2024-03-23T23:42:39.691124+0000","last_became_peered":"2024-03-23T23:42:39.691124+0000","last_unstale":"2024-03-23T23:57:56.668902+0000","last_undegraded":"2024-03-23T23:57:56.668902+0000","last_fullsized":"2024-03-23T23:57:56.668902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'23","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.600670+0000","last_change":"2024-03-23T23:42:49.750016+0000","last_active":"2024-03-23T23:57:57.600670+0000","last_peered":"2024-03-23T23:57:57.600670+0000","last_clean":"2024-03-23T23:57:57.600670+0000","last_became_active":"2024-03-23T23:42:49.749279+0000","last_became_peered":"2024-03-23T23:42:49.749279+0000","last_unstale":"2024-03-23T23:57:57.600670+0000","last_undegraded":"2024-03-23T23:57:57.600670+0000","last_fullsized":"2024-03-23T23:57:57.600670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"27'6858","reported_seq":6880,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.460885+0000","last_change":"2024-03-23T23:42:50.753669+0000","last_active":"2024-03-23T23:58:30.460885+0000","last_peered":"2024-03-23T23:58:30.460885+0000","last_clean":"2024-03-23T23:58:30.460885+0000","last_became_active":"2024-03-23T23:42:50.752674+0000","last_became_peered":"2024-03-23T23:42:50.752674+0000","last_unstale":"2024-03-23T23:58:30.460885+0000","last_undegraded":"2024-03-23T23:58:30.460885+0000","last_fullsized":"2024-03-23T23:58:30.460885+0000","mapping_epoch":23,"log_start":"27'900","ondisk_log_start":"27'900","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5958,"log_dups_size":0,"ondisk_log_size":5958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:39:04.727316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101780,"num_write_kb":1163482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"27'4769","reported_seq":4800,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.622856+0000","last_change":"2024-03-23T23:42:40.685051+0000","last_active":"2024-03-23T23:58:27.622856+0000","last_peered":"2024-03-23T23:58:27.622856+0000","last_clean":"2024-03-23T23:58:27.622856+0000","last_became_active":"2024-03-23T23:42:40.684677+0000","last_became_peered":"2024-03-23T23:42:40.684677+0000","last_unstale":"2024-03-23T23:58:27.622856+0000","last_undegraded":"2024-03-23T23:58:27.622856+0000","last_fullsized":"2024-03-23T23:58:27.622856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4769,"log_dups_size":0,"ondisk_log_size":4769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:20.920978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71276,"num_write_kb":829070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'20","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:44.378481+0000","last_change":"2024-03-23T23:42:39.695253+0000","last_active":"2024-03-23T23:55:44.378481+0000","last_peered":"2024-03-23T23:55:44.378481+0000","last_clean":"2024-03-23T23:55:44.378481+0000","last_became_active":"2024-03-23T23:42:39.694746+0000","last_became_peered":"2024-03-23T23:42:39.694746+0000","last_unstale":"2024-03-23T23:55:44.378481+0000","last_undegraded":"2024-03-23T23:55:44.378481+0000","last_fullsized":"2024-03-23T23:55:44.378481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:57.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'20","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.414354+0000","last_change":"2024-03-23T23:42:49.724285+0000","last_active":"2024-03-23T23:57:53.414354+0000","last_peered":"2024-03-23T23:57:53.414354+0000","last_clean":"2024-03-23T23:57:53.414354+0000","last_became_active":"2024-03-23T23:42:49.724009+0000","last_became_peered":"2024-03-23T23:42:49.724009+0000","last_unstale":"2024-03-23T23:57:53.414354+0000","last_undegraded":"2024-03-23T23:57:53.414354+0000","last_fullsized":"2024-03-23T23:57:53.414354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:01:04.035970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"27'4307","reported_seq":4331,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.386448+0000","last_change":"2024-03-23T23:42:50.746737+0000","last_active":"2024-03-23T23:58:30.386448+0000","last_peered":"2024-03-23T23:58:30.386448+0000","last_clean":"2024-03-23T23:58:30.386448+0000","last_became_active":"2024-03-23T23:42:50.746492+0000","last_became_peered":"2024-03-23T23:42:50.746492+0000","last_unstale":"2024-03-23T23:58:30.386448+0000","last_undegraded":"2024-03-23T23:58:30.386448+0000","last_fullsized":"2024-03-23T23:58:30.386448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4307,"log_dups_size":0,"ondisk_log_size":4307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63604,"num_write_kb":723087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"27'5742","reported_seq":5774,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.651292+0000","last_change":"2024-03-23T23:42:40.680963+0000","last_active":"2024-03-23T23:58:27.651292+0000","last_peered":"2024-03-23T23:58:27.651292+0000","last_clean":"2024-03-23T23:58:27.651292+0000","last_became_active":"2024-03-23T23:42:40.680744+0000","last_became_peered":"2024-03-23T23:42:40.680744+0000","last_unstale":"2024-03-23T23:58:27.651292+0000","last_undegraded":"2024-03-23T23:58:27.651292+0000","last_fullsized":"2024-03-23T23:58:27.651292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5742,"log_dups_size":0,"ondisk_log_size":5742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85158,"num_write_kb":1014619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'8","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:33.079685+0000","last_change":"2024-03-23T23:42:39.691813+0000","last_active":"2024-03-23T23:55:33.079685+0000","last_peered":"2024-03-23T23:55:33.079685+0000","last_clean":"2024-03-23T23:55:33.079685+0000","last_became_active":"2024-03-23T23:42:39.691519+0000","last_became_peered":"2024-03-23T23:42:39.691519+0000","last_unstale":"2024-03-23T23:55:33.079685+0000","last_undegraded":"2024-03-23T23:55:33.079685+0000","last_fullsized":"2024-03-23T23:55:33.079685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:27:41.386662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'34","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.597772+0000","last_change":"2024-03-23T23:42:49.734197+0000","last_active":"2024-03-23T23:57:57.597772+0000","last_peered":"2024-03-23T23:57:57.597772+0000","last_clean":"2024-03-23T23:57:57.597772+0000","last_became_active":"2024-03-23T23:42:49.733715+0000","last_became_peered":"2024-03-23T23:42:49.733715+0000","last_unstale":"2024-03-23T23:57:57.597772+0000","last_undegraded":"2024-03-23T23:57:57.597772+0000","last_fullsized":"2024-03-23T23:57:57.597772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:41:36.728428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84646,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":105,"num_write":31,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"27'4491","reported_seq":4514,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.352078+0000","last_change":"2024-03-23T23:42:50.739957+0000","last_active":"2024-03-23T23:58:30.352078+0000","last_peered":"2024-03-23T23:58:30.352078+0000","last_clean":"2024-03-23T23:58:30.352078+0000","last_became_active":"2024-03-23T23:42:50.739706+0000","last_became_peered":"2024-03-23T23:42:50.739706+0000","last_unstale":"2024-03-23T23:58:30.352078+0000","last_undegraded":"2024-03-23T23:58:30.352078+0000","last_fullsized":"2024-03-23T23:58:30.352078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4491,"log_dups_size":0,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:49:17.763463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66952,"num_write_kb":756851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'4353","reported_seq":4371,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.639971+0000","last_change":"2024-03-23T23:43:22.034415+0000","last_active":"2024-03-23T23:58:27.639971+0000","last_peered":"2024-03-23T23:58:27.639971+0000","last_clean":"2024-03-23T23:58:27.639971+0000","last_became_active":"2024-03-23T23:43:22.034125+0000","last_became_peered":"2024-03-23T23:43:22.034125+0000","last_unstale":"2024-03-23T23:58:27.639971+0000","last_undegraded":"2024-03-23T23:58:27.639971+0000","last_fullsized":"2024-03-23T23:58:27.639971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4353,"log_dups_size":0,"ondisk_log_size":4353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64538,"num_write_kb":790050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"27'317","reported_seq":351,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.790144+0000","last_change":"2024-03-23T23:42:39.678962+0000","last_active":"2024-03-23T23:58:27.790144+0000","last_peered":"2024-03-23T23:58:27.790144+0000","last_clean":"2024-03-23T23:58:27.790144+0000","last_became_active":"2024-03-23T23:42:39.678603+0000","last_became_peered":"2024-03-23T23:42:39.678603+0000","last_unstale":"2024-03-23T23:58:27.790144+0000","last_undegraded":"2024-03-23T23:58:27.790144+0000","last_fullsized":"2024-03-23T23:58:27.790144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":650,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'39","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.623083+0000","last_change":"2024-03-23T23:42:49.740561+0000","last_active":"2024-03-23T23:57:57.623083+0000","last_peered":"2024-03-23T23:57:57.623083+0000","last_clean":"2024-03-23T23:57:57.623083+0000","last_became_active":"2024-03-23T23:42:49.740290+0000","last_became_peered":"2024-03-23T23:42:49.740290+0000","last_unstale":"2024-03-23T23:57:57.623083+0000","last_undegraded":"2024-03-23T23:57:57.623083+0000","last_fullsized":"2024-03-23T23:57:57.623083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"27'5050","reported_seq":5073,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.381680+0000","last_change":"2024-03-23T23:42:50.751107+0000","last_active":"2024-03-23T23:58:30.381680+0000","last_peered":"2024-03-23T23:58:30.381680+0000","last_clean":"2024-03-23T23:58:30.381680+0000","last_became_active":"2024-03-23T23:42:50.750859+0000","last_became_peered":"2024-03-23T23:42:50.750859+0000","last_unstale":"2024-03-23T23:58:30.381680+0000","last_undegraded":"2024-03-23T23:58:30.381680+0000","last_fullsized":"2024-03-23T23:58:30.381680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5050,"log_dups_size":0,"ondisk_log_size":5050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:49:17.763463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75095,"num_write_kb":843705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"27'6329","reported_seq":6361,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.650603+0000","last_change":"2024-03-23T23:42:40.686486+0000","last_active":"2024-03-23T23:58:27.650603+0000","last_peered":"2024-03-23T23:58:27.650603+0000","last_clean":"2024-03-23T23:58:27.650603+0000","last_became_active":"2024-03-23T23:42:40.686186+0000","last_became_peered":"2024-03-23T23:42:40.686186+0000","last_unstale":"2024-03-23T23:58:27.650603+0000","last_undegraded":"2024-03-23T23:58:27.650603+0000","last_fullsized":"2024-03-23T23:58:27.650603+0000","mapping_epoch":19,"log_start":"27'600","ondisk_log_start":"27'600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5729,"log_dups_size":0,"ondisk_log_size":5729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94311,"num_write_kb":1142337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'2","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:28.330121+0000","last_change":"2024-03-23T23:42:39.695099+0000","last_active":"2024-03-23T23:55:28.330121+0000","last_peered":"2024-03-23T23:55:28.330121+0000","last_clean":"2024-03-23T23:55:28.330121+0000","last_became_active":"2024-03-23T23:42:39.694720+0000","last_became_peered":"2024-03-23T23:42:39.694720+0000","last_unstale":"2024-03-23T23:55:28.330121+0000","last_undegraded":"2024-03-23T23:55:28.330121+0000","last_fullsized":"2024-03-23T23:55:28.330121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T23:58:07.880313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.401931+0000","last_change":"2024-03-23T23:42:49.739099+0000","last_active":"2024-03-23T23:57:53.401931+0000","last_peered":"2024-03-23T23:57:53.401931+0000","last_clean":"2024-03-23T23:57:53.401931+0000","last_became_active":"2024-03-23T23:42:49.738198+0000","last_became_peered":"2024-03-23T23:42:49.738198+0000","last_unstale":"2024-03-23T23:57:53.401931+0000","last_undegraded":"2024-03-23T23:57:53.401931+0000","last_fullsized":"2024-03-23T23:57:53.401931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"27'5389","reported_seq":5413,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.491587+0000","last_change":"2024-03-23T23:42:50.754941+0000","last_active":"2024-03-23T23:58:30.491587+0000","last_peered":"2024-03-23T23:58:30.491587+0000","last_clean":"2024-03-23T23:58:30.491587+0000","last_became_active":"2024-03-23T23:42:50.754585+0000","last_became_peered":"2024-03-23T23:42:50.754585+0000","last_unstale":"2024-03-23T23:58:30.491587+0000","last_undegraded":"2024-03-23T23:58:30.491587+0000","last_fullsized":"2024-03-23T23:58:30.491587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5389,"log_dups_size":0,"ondisk_log_size":5389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80225,"num_write_kb":941986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'4652","reported_seq":4683,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.714118+0000","last_change":"2024-03-23T23:42:40.700610+0000","last_active":"2024-03-23T23:58:27.714118+0000","last_peered":"2024-03-23T23:58:27.714118+0000","last_clean":"2024-03-23T23:58:27.714118+0000","last_became_active":"2024-03-23T23:42:40.700112+0000","last_became_peered":"2024-03-23T23:42:40.700112+0000","last_unstale":"2024-03-23T23:58:27.714118+0000","last_undegraded":"2024-03-23T23:58:27.714118+0000","last_fullsized":"2024-03-23T23:58:27.714118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4652,"log_dups_size":0,"ondisk_log_size":4652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:07:49.169416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68979,"num_write_kb":836174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'2","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:24.371906+0000","last_change":"2024-03-23T23:42:39.686509+0000","last_active":"2024-03-23T23:57:24.371906+0000","last_peered":"2024-03-23T23:57:24.371906+0000","last_clean":"2024-03-23T23:57:24.371906+0000","last_became_active":"2024-03-23T23:42:39.686094+0000","last_became_peered":"2024-03-23T23:42:39.686094+0000","last_unstale":"2024-03-23T23:57:24.371906+0000","last_undegraded":"2024-03-23T23:57:24.371906+0000","last_fullsized":"2024-03-23T23:57:24.371906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'70","reported_seq":104,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:36.363389+0000","last_change":"2024-03-23T23:58:36.363415+0000","last_active":"2024-03-23T23:58:36.363389+0000","last_peered":"2024-03-23T23:58:36.363389+0000","last_clean":"2024-03-23T23:58:36.363389+0000","last_became_active":"2024-03-23T23:42:49.737916+0000","last_became_peered":"2024-03-23T23:42:49.737916+0000","last_unstale":"2024-03-23T23:58:36.363389+0000","last_undegraded":"2024-03-23T23:58:36.363389+0000","last_fullsized":"2024-03-23T23:58:36.363389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'70","last_scrub_stamp":"2024-03-23T23:58:36.363306+0000","last_deep_scrub":"27'70","last_deep_scrub_stamp":"2024-03-23T23:58:36.363306+0000","last_clean_scrub_stamp":"2024-03-23T23:58:36.363306+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:34:24.832959+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":8223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"27'4725","reported_seq":4749,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.347026+0000","last_change":"2024-03-23T23:42:50.764148+0000","last_active":"2024-03-23T23:58:30.347026+0000","last_peered":"2024-03-23T23:58:30.347026+0000","last_clean":"2024-03-23T23:58:30.347026+0000","last_became_active":"2024-03-23T23:42:50.763768+0000","last_became_peered":"2024-03-23T23:42:50.763768+0000","last_unstale":"2024-03-23T23:58:30.347026+0000","last_undegraded":"2024-03-23T23:58:30.347026+0000","last_fullsized":"2024-03-23T23:58:30.347026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4725,"log_dups_size":0,"ondisk_log_size":4725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69706,"num_write_kb":805786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"27'5477","reported_seq":5508,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.746904+0000","last_change":"2024-03-23T23:42:40.679988+0000","last_active":"2024-03-23T23:58:27.746904+0000","last_peered":"2024-03-23T23:58:27.746904+0000","last_clean":"2024-03-23T23:58:27.746904+0000","last_became_active":"2024-03-23T23:42:40.679488+0000","last_became_peered":"2024-03-23T23:42:40.679488+0000","last_unstale":"2024-03-23T23:58:27.746904+0000","last_undegraded":"2024-03-23T23:58:27.746904+0000","last_fullsized":"2024-03-23T23:58:27.746904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5477,"log_dups_size":0,"ondisk_log_size":5477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:10:32.251287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82124,"num_write_kb":1001722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'28","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:10.724250+0000","last_change":"2024-03-23T23:42:39.679741+0000","last_active":"2024-03-23T23:55:10.724250+0000","last_peered":"2024-03-23T23:55:10.724250+0000","last_clean":"2024-03-23T23:55:10.724250+0000","last_became_active":"2024-03-23T23:42:39.678864+0000","last_became_peered":"2024-03-23T23:42:39.678864+0000","last_unstale":"2024-03-23T23:55:10.724250+0000","last_undegraded":"2024-03-23T23:55:10.724250+0000","last_fullsized":"2024-03-23T23:55:10.724250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:50.559059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":8210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.601699+0000","last_change":"2024-03-23T23:42:49.739837+0000","last_active":"2024-03-23T23:57:57.601699+0000","last_peered":"2024-03-23T23:57:57.601699+0000","last_clean":"2024-03-23T23:57:57.601699+0000","last_became_active":"2024-03-23T23:42:49.739570+0000","last_became_peered":"2024-03-23T23:42:49.739570+0000","last_unstale":"2024-03-23T23:57:57.601699+0000","last_undegraded":"2024-03-23T23:57:57.601699+0000","last_fullsized":"2024-03-23T23:57:57.601699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'5788","reported_seq":5813,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.452132+0000","last_change":"2024-03-23T23:42:50.753912+0000","last_active":"2024-03-23T23:58:30.452132+0000","last_peered":"2024-03-23T23:58:30.452132+0000","last_clean":"2024-03-23T23:58:30.452132+0000","last_became_active":"2024-03-23T23:42:50.753629+0000","last_became_peered":"2024-03-23T23:42:50.753629+0000","last_unstale":"2024-03-23T23:58:30.452132+0000","last_undegraded":"2024-03-23T23:58:30.452132+0000","last_fullsized":"2024-03-23T23:58:30.452132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5788,"log_dups_size":0,"ondisk_log_size":5788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":85415,"num_write_kb":969479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'4118","reported_seq":4150,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.632968+0000","last_change":"2024-03-23T23:42:40.682840+0000","last_active":"2024-03-23T23:58:27.632968+0000","last_peered":"2024-03-23T23:58:27.632968+0000","last_clean":"2024-03-23T23:58:27.632968+0000","last_became_active":"2024-03-23T23:42:40.682391+0000","last_became_peered":"2024-03-23T23:42:40.682391+0000","last_unstale":"2024-03-23T23:58:27.632968+0000","last_undegraded":"2024-03-23T23:58:27.632968+0000","last_fullsized":"2024-03-23T23:58:27.632968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4118,"log_dups_size":0,"ondisk_log_size":4118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61030,"num_write_kb":768099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'47","reported_seq":125,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:03.449556+0000","last_change":"2024-03-23T23:42:39.680763+0000","last_active":"2024-03-23T23:58:03.449556+0000","last_peered":"2024-03-23T23:58:03.449556+0000","last_clean":"2024-03-23T23:58:03.449556+0000","last_became_active":"2024-03-23T23:42:39.680494+0000","last_became_peered":"2024-03-23T23:42:39.680494+0000","last_unstale":"2024-03-23T23:58:03.449556+0000","last_undegraded":"2024-03-23T23:58:03.449556+0000","last_fullsized":"2024-03-23T23:58:03.449556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84561,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":115,"num_write":44,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'9","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.637862+0000","last_change":"2024-03-23T23:42:49.737456+0000","last_active":"2024-03-23T23:57:57.637862+0000","last_peered":"2024-03-23T23:57:57.637862+0000","last_clean":"2024-03-23T23:57:57.637862+0000","last_became_active":"2024-03-23T23:42:49.737196+0000","last_became_peered":"2024-03-23T23:42:49.737196+0000","last_unstale":"2024-03-23T23:57:57.637862+0000","last_undegraded":"2024-03-23T23:57:57.637862+0000","last_fullsized":"2024-03-23T23:57:57.637862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"27'4476","reported_seq":4499,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.444814+0000","last_change":"2024-03-23T23:42:50.763308+0000","last_active":"2024-03-23T23:58:30.444814+0000","last_peered":"2024-03-23T23:58:30.444814+0000","last_clean":"2024-03-23T23:58:30.444814+0000","last_became_active":"2024-03-23T23:42:50.763007+0000","last_became_peered":"2024-03-23T23:42:50.763007+0000","last_unstale":"2024-03-23T23:58:30.444814+0000","last_undegraded":"2024-03-23T23:58:30.444814+0000","last_fullsized":"2024-03-23T23:58:30.444814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4476,"log_dups_size":0,"ondisk_log_size":4476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:32:46.055472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66536,"num_write_kb":757522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"27'4410","reported_seq":4442,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.616691+0000","last_change":"2024-03-23T23:42:40.675570+0000","last_active":"2024-03-23T23:58:27.616691+0000","last_peered":"2024-03-23T23:58:27.616691+0000","last_clean":"2024-03-23T23:58:27.616691+0000","last_became_active":"2024-03-23T23:42:40.674390+0000","last_became_peered":"2024-03-23T23:42:40.674390+0000","last_unstale":"2024-03-23T23:58:27.616691+0000","last_undegraded":"2024-03-23T23:58:27.616691+0000","last_fullsized":"2024-03-23T23:58:27.616691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4410,"log_dups_size":0,"ondisk_log_size":4410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65732,"num_write_kb":804228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'44","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:56.789441+0000","last_change":"2024-03-23T23:42:39.690057+0000","last_active":"2024-03-23T23:54:56.789441+0000","last_peered":"2024-03-23T23:54:56.789441+0000","last_clean":"2024-03-23T23:54:56.789441+0000","last_became_active":"2024-03-23T23:42:39.689763+0000","last_became_peered":"2024-03-23T23:42:39.689763+0000","last_unstale":"2024-03-23T23:54:56.789441+0000","last_undegraded":"2024-03-23T23:54:56.789441+0000","last_fullsized":"2024-03-23T23:54:56.789441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:01.607584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'354","reported_seq":388,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:35.220816+0000","last_change":"2024-03-23T23:58:35.220860+0000","last_active":"2024-03-23T23:58:35.220816+0000","last_peered":"2024-03-23T23:58:35.220816+0000","last_clean":"2024-03-23T23:58:35.220816+0000","last_became_active":"2024-03-23T23:42:49.733115+0000","last_became_peered":"2024-03-23T23:42:49.733115+0000","last_unstale":"2024-03-23T23:58:35.220816+0000","last_undegraded":"2024-03-23T23:58:35.220816+0000","last_fullsized":"2024-03-23T23:58:35.220816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'354","last_scrub_stamp":"2024-03-23T23:58:35.220733+0000","last_deep_scrub":"27'354","last_deep_scrub_stamp":"2024-03-23T23:58:35.220733+0000","last_clean_scrub_stamp":"2024-03-23T23:58:35.220733+0000","objects_scrubbed":1,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:25:39.027710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":739,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"27'6380","reported_seq":6403,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.486536+0000","last_change":"2024-03-23T23:42:50.759000+0000","last_active":"2024-03-23T23:58:30.486536+0000","last_peered":"2024-03-23T23:58:30.486536+0000","last_clean":"2024-03-23T23:58:30.486536+0000","last_became_active":"2024-03-23T23:42:50.758552+0000","last_became_peered":"2024-03-23T23:42:50.758552+0000","last_unstale":"2024-03-23T23:58:30.486536+0000","last_undegraded":"2024-03-23T23:58:30.486536+0000","last_fullsized":"2024-03-23T23:58:30.486536+0000","mapping_epoch":23,"log_start":"27'700","ondisk_log_start":"27'700","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5680,"log_dups_size":0,"ondisk_log_size":5680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:04:26.911514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94645,"num_write_kb":1081333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"27'5078","reported_seq":5110,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.633966+0000","last_change":"2024-03-23T23:42:40.700998+0000","last_active":"2024-03-23T23:58:27.633966+0000","last_peered":"2024-03-23T23:58:27.633966+0000","last_clean":"2024-03-23T23:58:27.633966+0000","last_became_active":"2024-03-23T23:42:40.700788+0000","last_became_peered":"2024-03-23T23:42:40.700788+0000","last_unstale":"2024-03-23T23:58:27.633966+0000","last_undegraded":"2024-03-23T23:58:27.633966+0000","last_fullsized":"2024-03-23T23:58:27.633966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5078,"log_dups_size":0,"ondisk_log_size":5078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75375,"num_write_kb":887789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'3","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:16.319491+0000","last_change":"2024-03-23T23:42:39.687712+0000","last_active":"2024-03-23T23:55:16.319491+0000","last_peered":"2024-03-23T23:55:16.319491+0000","last_clean":"2024-03-23T23:55:16.319491+0000","last_became_active":"2024-03-23T23:42:39.687378+0000","last_became_peered":"2024-03-23T23:42:39.687378+0000","last_unstale":"2024-03-23T23:55:16.319491+0000","last_undegraded":"2024-03-23T23:55:16.319491+0000","last_fullsized":"2024-03-23T23:55:16.319491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:20:38.456655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":189,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:45.391600+0000","last_change":"2024-03-23T23:42:27.940270+0000","last_active":"2024-03-23T23:54:45.391600+0000","last_peered":"2024-03-23T23:54:45.391600+0000","last_clean":"2024-03-23T23:54:45.391600+0000","last_became_active":"2024-03-23T23:42:27.939061+0000","last_became_peered":"2024-03-23T23:42:27.939061+0000","last_unstale":"2024-03-23T23:54:45.391600+0000","last_undegraded":"2024-03-23T23:54:45.391600+0000","last_fullsized":"2024-03-23T23:54:45.391600+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:26.509742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:26.509742+0000","last_clean_scrub_stamp":"2024-03-23T23:42:26.509742+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:49.258623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'3","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:46.805802+0000","last_change":"2024-03-23T23:42:49.729231+0000","last_active":"2024-03-23T23:57:46.805802+0000","last_peered":"2024-03-23T23:57:46.805802+0000","last_clean":"2024-03-23T23:57:46.805802+0000","last_became_active":"2024-03-23T23:42:49.728990+0000","last_became_peered":"2024-03-23T23:42:49.728990+0000","last_unstale":"2024-03-23T23:57:46.805802+0000","last_undegraded":"2024-03-23T23:57:46.805802+0000","last_fullsized":"2024-03-23T23:57:46.805802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:01:04.035970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"27'4440","reported_seq":4464,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.458297+0000","last_change":"2024-03-23T23:42:50.757668+0000","last_active":"2024-03-23T23:58:30.458297+0000","last_peered":"2024-03-23T23:58:30.458297+0000","last_clean":"2024-03-23T23:58:30.458297+0000","last_became_active":"2024-03-23T23:42:50.756900+0000","last_became_peered":"2024-03-23T23:42:50.756900+0000","last_unstale":"2024-03-23T23:58:30.458297+0000","last_undegraded":"2024-03-23T23:58:30.458297+0000","last_fullsized":"2024-03-23T23:58:30.458297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4440,"log_dups_size":0,"ondisk_log_size":4440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65770,"num_write_kb":738740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'5486","reported_seq":5517,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.714372+0000","last_change":"2024-03-23T23:42:40.711591+0000","last_active":"2024-03-23T23:58:27.714372+0000","last_peered":"2024-03-23T23:58:27.714372+0000","last_clean":"2024-03-23T23:58:27.714372+0000","last_became_active":"2024-03-23T23:42:40.711306+0000","last_became_peered":"2024-03-23T23:42:40.711306+0000","last_unstale":"2024-03-23T23:58:27.714372+0000","last_undegraded":"2024-03-23T23:58:27.714372+0000","last_fullsized":"2024-03-23T23:58:27.714372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5486,"log_dups_size":0,"ondisk_log_size":5486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:34:16.693372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81537,"num_write_kb":972707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:26.352658+0000","last_change":"2024-03-23T23:42:39.684163+0000","last_active":"2024-03-23T23:58:26.352658+0000","last_peered":"2024-03-23T23:58:26.352658+0000","last_clean":"2024-03-23T23:58:26.352658+0000","last_became_active":"2024-03-23T23:42:39.683211+0000","last_became_peered":"2024-03-23T23:42:39.683211+0000","last_unstale":"2024-03-23T23:58:26.352658+0000","last_undegraded":"2024-03-23T23:58:26.352658+0000","last_fullsized":"2024-03-23T23:58:26.352658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'123","reported_seq":148,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.630825+0000","last_change":"2024-03-23T23:42:49.735824+0000","last_active":"2024-03-23T23:57:57.630825+0000","last_peered":"2024-03-23T23:57:57.630825+0000","last_clean":"2024-03-23T23:57:57.630825+0000","last_became_active":"2024-03-23T23:42:49.735473+0000","last_became_peered":"2024-03-23T23:42:49.735473+0000","last_unstale":"2024-03-23T23:57:57.630825+0000","last_undegraded":"2024-03-23T23:57:57.630825+0000","last_fullsized":"2024-03-23T23:57:57.630825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:44:12.438729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":4181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"27'5305","reported_seq":5329,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.397902+0000","last_change":"2024-03-23T23:42:50.745563+0000","last_active":"2024-03-23T23:58:30.397902+0000","last_peered":"2024-03-23T23:58:30.397902+0000","last_clean":"2024-03-23T23:58:30.397902+0000","last_became_active":"2024-03-23T23:42:50.745256+0000","last_became_peered":"2024-03-23T23:42:50.745256+0000","last_unstale":"2024-03-23T23:58:30.397902+0000","last_undegraded":"2024-03-23T23:58:30.397902+0000","last_fullsized":"2024-03-23T23:58:30.397902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5305,"log_dups_size":0,"ondisk_log_size":5305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78242,"num_write_kb":887262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'5423","reported_seq":5455,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.664901+0000","last_change":"2024-03-23T23:42:40.700124+0000","last_active":"2024-03-23T23:58:27.664901+0000","last_peered":"2024-03-23T23:58:27.664901+0000","last_clean":"2024-03-23T23:58:27.664901+0000","last_became_active":"2024-03-23T23:42:40.697369+0000","last_became_peered":"2024-03-23T23:42:40.697369+0000","last_unstale":"2024-03-23T23:58:27.664901+0000","last_undegraded":"2024-03-23T23:58:27.664901+0000","last_fullsized":"2024-03-23T23:58:27.664901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5423,"log_dups_size":0,"ondisk_log_size":5423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:20.981139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":11,"num_write":80814,"num_write_kb":947944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'24","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:31.671889+0000","last_change":"2024-03-23T23:42:39.681013+0000","last_active":"2024-03-23T23:58:31.671889+0000","last_peered":"2024-03-23T23:58:31.671889+0000","last_clean":"2024-03-23T23:58:31.671889+0000","last_became_active":"2024-03-23T23:42:39.680669+0000","last_became_peered":"2024-03-23T23:42:39.680669+0000","last_unstale":"2024-03-23T23:58:31.671889+0000","last_undegraded":"2024-03-23T23:58:31.671889+0000","last_fullsized":"2024-03-23T23:58:31.671889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'391","reported_seq":417,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:26.377094+0000","last_change":"2024-03-23T23:42:49.736747+0000","last_active":"2024-03-23T23:58:26.377094+0000","last_peered":"2024-03-23T23:58:26.377094+0000","last_clean":"2024-03-23T23:58:26.377094+0000","last_became_active":"2024-03-23T23:42:49.734508+0000","last_became_peered":"2024-03-23T23:42:49.734508+0000","last_unstale":"2024-03-23T23:58:26.377094+0000","last_undegraded":"2024-03-23T23:58:26.377094+0000","last_fullsized":"2024-03-23T23:58:26.377094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":4222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"27'4747","reported_seq":4770,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.374104+0000","last_change":"2024-03-23T23:42:50.751141+0000","last_active":"2024-03-23T23:58:30.374104+0000","last_peered":"2024-03-23T23:58:30.374104+0000","last_clean":"2024-03-23T23:58:30.374104+0000","last_became_active":"2024-03-23T23:42:50.750269+0000","last_became_peered":"2024-03-23T23:42:50.750269+0000","last_unstale":"2024-03-23T23:58:30.374104+0000","last_undegraded":"2024-03-23T23:58:30.374104+0000","last_fullsized":"2024-03-23T23:58:30.374104+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4747,"log_dups_size":0,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:46:10.784416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70383,"num_write_kb":794086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"27'6880","reported_seq":6910,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.765308+0000","last_change":"2024-03-23T23:42:40.706713+0000","last_active":"2024-03-23T23:58:27.765308+0000","last_peered":"2024-03-23T23:58:27.765308+0000","last_clean":"2024-03-23T23:58:27.765308+0000","last_became_active":"2024-03-23T23:42:40.704328+0000","last_became_peered":"2024-03-23T23:42:40.704328+0000","last_unstale":"2024-03-23T23:58:27.765308+0000","last_undegraded":"2024-03-23T23:58:27.765308+0000","last_fullsized":"2024-03-23T23:58:27.765308+0000","mapping_epoch":19,"log_start":"27'1200","ondisk_log_start":"27'1200","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5680,"log_dups_size":0,"ondisk_log_size":5680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:15:52.261572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102549,"num_write_kb":1203650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'21","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:56:22.636769+0000","last_change":"2024-03-23T23:42:39.681906+0000","last_active":"2024-03-23T23:56:22.636769+0000","last_peered":"2024-03-23T23:56:22.636769+0000","last_clean":"2024-03-23T23:56:22.636769+0000","last_became_active":"2024-03-23T23:42:39.680506+0000","last_became_peered":"2024-03-23T23:42:39.680506+0000","last_unstale":"2024-03-23T23:56:22.636769+0000","last_undegraded":"2024-03-23T23:56:22.636769+0000","last_fullsized":"2024-03-23T23:56:22.636769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'28","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.608886+0000","last_change":"2024-03-23T23:42:49.737735+0000","last_active":"2024-03-23T23:57:57.608886+0000","last_peered":"2024-03-23T23:57:57.608886+0000","last_clean":"2024-03-23T23:57:57.608886+0000","last_became_active":"2024-03-23T23:42:49.737434+0000","last_became_peered":"2024-03-23T23:42:49.737434+0000","last_unstale":"2024-03-23T23:57:57.608886+0000","last_undegraded":"2024-03-23T23:57:57.608886+0000","last_fullsized":"2024-03-23T23:57:57.608886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:58:10.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"27'4785","reported_seq":4817,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:36.003393+0000","last_change":"2024-03-23T23:58:36.003421+0000","last_active":"2024-03-23T23:58:36.003393+0000","last_peered":"2024-03-23T23:58:36.003393+0000","last_clean":"2024-03-23T23:58:36.003393+0000","last_became_active":"2024-03-23T23:42:50.746105+0000","last_became_peered":"2024-03-23T23:42:50.746105+0000","last_unstale":"2024-03-23T23:58:36.003393+0000","last_undegraded":"2024-03-23T23:58:36.003393+0000","last_fullsized":"2024-03-23T23:58:36.003393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4785","last_scrub_stamp":"2024-03-23T23:58:36.003286+0000","last_deep_scrub":"27'4785","last_deep_scrub_stamp":"2024-03-23T23:58:36.003286+0000","last_clean_scrub_stamp":"2024-03-23T23:58:36.003286+0000","objects_scrubbed":0,"log_size":4785,"log_dups_size":0,"ondisk_log_size":4785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:17:39.747906+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70705,"num_write_kb":815494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"27'4266","reported_seq":4297,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.655527+0000","last_change":"2024-03-23T23:42:40.696584+0000","last_active":"2024-03-23T23:58:27.655527+0000","last_peered":"2024-03-23T23:58:27.655527+0000","last_clean":"2024-03-23T23:58:27.655527+0000","last_became_active":"2024-03-23T23:42:40.696141+0000","last_became_peered":"2024-03-23T23:42:40.696141+0000","last_unstale":"2024-03-23T23:58:27.655527+0000","last_undegraded":"2024-03-23T23:58:27.655527+0000","last_fullsized":"2024-03-23T23:58:27.655527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4266,"log_dups_size":0,"ondisk_log_size":4266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:45.303477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63684,"num_write_kb":761063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'239","reported_seq":271,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:40.459673+0000","last_change":"2024-03-23T23:42:39.686863+0000","last_active":"2024-03-23T23:54:40.459673+0000","last_peered":"2024-03-23T23:54:40.459673+0000","last_clean":"2024-03-23T23:54:40.459673+0000","last_became_active":"2024-03-23T23:42:39.686491+0000","last_became_peered":"2024-03-23T23:42:39.686491+0000","last_unstale":"2024-03-23T23:54:40.459673+0000","last_undegraded":"2024-03-23T23:54:40.459673+0000","last_fullsized":"2024-03-23T23:54:40.459673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:38:13.752628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:53.422658+0000","last_change":"2024-03-23T23:42:49.733982+0000","last_active":"2024-03-23T23:57:53.422658+0000","last_peered":"2024-03-23T23:57:53.422658+0000","last_clean":"2024-03-23T23:57:53.422658+0000","last_became_active":"2024-03-23T23:42:49.733389+0000","last_became_peered":"2024-03-23T23:42:49.733389+0000","last_unstale":"2024-03-23T23:57:53.422658+0000","last_undegraded":"2024-03-23T23:57:53.422658+0000","last_fullsized":"2024-03-23T23:57:53.422658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:13.685893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"27'5253","reported_seq":5276,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.403994+0000","last_change":"2024-03-23T23:42:50.764083+0000","last_active":"2024-03-23T23:58:30.403994+0000","last_peered":"2024-03-23T23:58:30.403994+0000","last_clean":"2024-03-23T23:58:30.403994+0000","last_became_active":"2024-03-23T23:42:50.763871+0000","last_became_peered":"2024-03-23T23:42:50.763871+0000","last_unstale":"2024-03-23T23:58:30.403994+0000","last_undegraded":"2024-03-23T23:58:30.403994+0000","last_fullsized":"2024-03-23T23:58:30.403994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5253,"log_dups_size":0,"ondisk_log_size":5253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77731,"num_write_kb":860727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"27'4092","reported_seq":4122,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.688058+0000","last_change":"2024-03-23T23:42:40.700961+0000","last_active":"2024-03-23T23:58:27.688058+0000","last_peered":"2024-03-23T23:58:27.688058+0000","last_clean":"2024-03-23T23:58:27.688058+0000","last_became_active":"2024-03-23T23:42:40.700800+0000","last_became_peered":"2024-03-23T23:42:40.700800+0000","last_unstale":"2024-03-23T23:58:27.688058+0000","last_undegraded":"2024-03-23T23:58:27.688058+0000","last_fullsized":"2024-03-23T23:58:27.688058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4092,"log_dups_size":0,"ondisk_log_size":4092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:54:27.641281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60579,"num_write_kb":760058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'15","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:03.450965+0000","last_change":"2024-03-23T23:42:39.676075+0000","last_active":"2024-03-23T23:58:03.450965+0000","last_peered":"2024-03-23T23:58:03.450965+0000","last_clean":"2024-03-23T23:58:03.450965+0000","last_became_active":"2024-03-23T23:42:39.675770+0000","last_became_peered":"2024-03-23T23:42:39.675770+0000","last_unstale":"2024-03-23T23:58:03.450965+0000","last_undegraded":"2024-03-23T23:58:03.450965+0000","last_fullsized":"2024-03-23T23:58:03.450965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.617479+0000","last_change":"2024-03-23T23:42:49.739529+0000","last_active":"2024-03-23T23:57:57.617479+0000","last_peered":"2024-03-23T23:57:57.617479+0000","last_clean":"2024-03-23T23:57:57.617479+0000","last_became_active":"2024-03-23T23:42:49.738053+0000","last_became_peered":"2024-03-23T23:42:49.738053+0000","last_unstale":"2024-03-23T23:57:57.617479+0000","last_undegraded":"2024-03-23T23:57:57.617479+0000","last_fullsized":"2024-03-23T23:57:57.617479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"27'5776","reported_seq":5798,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.478244+0000","last_change":"2024-03-23T23:42:50.771347+0000","last_active":"2024-03-23T23:58:30.478244+0000","last_peered":"2024-03-23T23:58:30.478244+0000","last_clean":"2024-03-23T23:58:30.478244+0000","last_became_active":"2024-03-23T23:42:50.770998+0000","last_became_peered":"2024-03-23T23:42:50.770998+0000","last_unstale":"2024-03-23T23:58:30.478244+0000","last_undegraded":"2024-03-23T23:58:30.478244+0000","last_fullsized":"2024-03-23T23:58:30.478244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5776,"log_dups_size":0,"ondisk_log_size":5776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:57:04.394872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85663,"num_write_kb":962089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'4463","reported_seq":4493,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.663853+0000","last_change":"2024-03-23T23:42:40.677314+0000","last_active":"2024-03-23T23:58:27.663853+0000","last_peered":"2024-03-23T23:58:27.663853+0000","last_clean":"2024-03-23T23:58:27.663853+0000","last_became_active":"2024-03-23T23:42:40.675416+0000","last_became_peered":"2024-03-23T23:42:40.675416+0000","last_unstale":"2024-03-23T23:58:27.663853+0000","last_undegraded":"2024-03-23T23:58:27.663853+0000","last_fullsized":"2024-03-23T23:58:27.663853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4463,"log_dups_size":0,"ondisk_log_size":4463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:01:06.338641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66376,"num_write_kb":804237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'5","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:40.155565+0000","last_change":"2024-03-23T23:42:39.681827+0000","last_active":"2024-03-23T23:54:40.155565+0000","last_peered":"2024-03-23T23:54:40.155565+0000","last_clean":"2024-03-23T23:54:40.155565+0000","last_became_active":"2024-03-23T23:42:39.681418+0000","last_became_peered":"2024-03-23T23:42:39.681418+0000","last_unstale":"2024-03-23T23:54:40.155565+0000","last_undegraded":"2024-03-23T23:54:40.155565+0000","last_fullsized":"2024-03-23T23:54:40.155565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:50.559059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'3","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:36.260312+0000","last_change":"2024-03-23T23:58:36.260332+0000","last_active":"2024-03-23T23:58:36.260312+0000","last_peered":"2024-03-23T23:58:36.260312+0000","last_clean":"2024-03-23T23:58:36.260312+0000","last_became_active":"2024-03-23T23:42:49.744422+0000","last_became_peered":"2024-03-23T23:42:49.744422+0000","last_unstale":"2024-03-23T23:58:36.260312+0000","last_undegraded":"2024-03-23T23:58:36.260312+0000","last_fullsized":"2024-03-23T23:58:36.260312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-03-23T23:58:36.260243+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-03-23T23:58:36.260243+0000","last_clean_scrub_stamp":"2024-03-23T23:58:36.260243+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:22:43.606768+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"27'4219","reported_seq":4241,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.454168+0000","last_change":"2024-03-23T23:42:50.753064+0000","last_active":"2024-03-23T23:58:30.454168+0000","last_peered":"2024-03-23T23:58:30.454168+0000","last_clean":"2024-03-23T23:58:30.454168+0000","last_became_active":"2024-03-23T23:42:50.752783+0000","last_became_peered":"2024-03-23T23:42:50.752783+0000","last_unstale":"2024-03-23T23:58:30.454168+0000","last_undegraded":"2024-03-23T23:58:30.454168+0000","last_fullsized":"2024-03-23T23:58:30.454168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4219,"log_dups_size":0,"ondisk_log_size":4219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:39:49.888359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62346,"num_write_kb":725472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'5180","reported_seq":5210,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.757007+0000","last_change":"2024-03-23T23:42:40.704046+0000","last_active":"2024-03-23T23:58:27.757007+0000","last_peered":"2024-03-23T23:58:27.757007+0000","last_clean":"2024-03-23T23:58:27.757007+0000","last_became_active":"2024-03-23T23:42:40.703787+0000","last_became_peered":"2024-03-23T23:42:40.703787+0000","last_unstale":"2024-03-23T23:58:27.757007+0000","last_undegraded":"2024-03-23T23:58:27.757007+0000","last_fullsized":"2024-03-23T23:58:27.757007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5180,"log_dups_size":0,"ondisk_log_size":5180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:16:16.737284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76955,"num_write_kb":929765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'3","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:39.321849+0000","last_change":"2024-03-23T23:42:39.688483+0000","last_active":"2024-03-23T23:54:39.321849+0000","last_peered":"2024-03-23T23:54:39.321849+0000","last_clean":"2024-03-23T23:54:39.321849+0000","last_became_active":"2024-03-23T23:42:39.688141+0000","last_became_peered":"2024-03-23T23:42:39.688141+0000","last_unstale":"2024-03-23T23:54:39.321849+0000","last_undegraded":"2024-03-23T23:54:39.321849+0000","last_fullsized":"2024-03-23T23:54:39.321849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:32.254099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'1144","reported_seq":1169,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.255766+0000","last_change":"2024-03-23T23:42:49.749027+0000","last_active":"2024-03-23T23:58:30.255766+0000","last_peered":"2024-03-23T23:58:30.255766+0000","last_clean":"2024-03-23T23:58:30.255766+0000","last_became_active":"2024-03-23T23:42:49.748687+0000","last_became_peered":"2024-03-23T23:42:49.748687+0000","last_unstale":"2024-03-23T23:58:30.255766+0000","last_undegraded":"2024-03-23T23:58:30.255766+0000","last_fullsized":"2024-03-23T23:58:30.255766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":1144,"log_dups_size":0,"ondisk_log_size":1144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1142,"num_write_kb":4626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"27'6486","reported_seq":6509,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.469442+0000","last_change":"2024-03-23T23:42:50.752273+0000","last_active":"2024-03-23T23:58:30.469442+0000","last_peered":"2024-03-23T23:58:30.469442+0000","last_clean":"2024-03-23T23:58:30.469442+0000","last_became_active":"2024-03-23T23:42:50.751874+0000","last_became_peered":"2024-03-23T23:42:50.751874+0000","last_unstale":"2024-03-23T23:58:30.469442+0000","last_undegraded":"2024-03-23T23:58:30.469442+0000","last_fullsized":"2024-03-23T23:58:30.469442+0000","mapping_epoch":23,"log_start":"27'1200","ondisk_log_start":"27'1200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5286,"log_dups_size":0,"ondisk_log_size":5286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96407,"num_write_kb":1089798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'4560","reported_seq":4591,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.618764+0000","last_change":"2024-03-23T23:42:40.688909+0000","last_active":"2024-03-23T23:58:27.618764+0000","last_peered":"2024-03-23T23:58:27.618764+0000","last_clean":"2024-03-23T23:58:27.618764+0000","last_became_active":"2024-03-23T23:42:40.688636+0000","last_became_peered":"2024-03-23T23:42:40.688636+0000","last_unstale":"2024-03-23T23:58:27.618764+0000","last_undegraded":"2024-03-23T23:58:27.618764+0000","last_fullsized":"2024-03-23T23:58:27.618764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4560,"log_dups_size":0,"ondisk_log_size":4560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68087,"num_write_kb":816248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'60","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:56:45.900583+0000","last_change":"2024-03-23T23:42:39.681926+0000","last_active":"2024-03-23T23:56:45.900583+0000","last_peered":"2024-03-23T23:56:45.900583+0000","last_clean":"2024-03-23T23:56:45.900583+0000","last_became_active":"2024-03-23T23:42:39.681028+0000","last_became_peered":"2024-03-23T23:42:39.681028+0000","last_unstale":"2024-03-23T23:56:45.900583+0000","last_undegraded":"2024-03-23T23:56:45.900583+0000","last_fullsized":"2024-03-23T23:56:45.900583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":8222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'22","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.622922+0000","last_change":"2024-03-23T23:42:49.741915+0000","last_active":"2024-03-23T23:57:57.622922+0000","last_peered":"2024-03-23T23:57:57.622922+0000","last_clean":"2024-03-23T23:57:57.622922+0000","last_became_active":"2024-03-23T23:42:49.741650+0000","last_became_peered":"2024-03-23T23:42:49.741650+0000","last_unstale":"2024-03-23T23:57:57.622922+0000","last_undegraded":"2024-03-23T23:57:57.622922+0000","last_fullsized":"2024-03-23T23:57:57.622922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:11:43.106922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"27'5263","reported_seq":5286,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.485849+0000","last_change":"2024-03-23T23:42:50.752979+0000","last_active":"2024-03-23T23:58:30.485849+0000","last_peered":"2024-03-23T23:58:30.485849+0000","last_clean":"2024-03-23T23:58:30.485849+0000","last_became_active":"2024-03-23T23:42:50.751848+0000","last_became_peered":"2024-03-23T23:42:50.751848+0000","last_unstale":"2024-03-23T23:58:30.485849+0000","last_undegraded":"2024-03-23T23:58:30.485849+0000","last_fullsized":"2024-03-23T23:58:30.485849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5263,"log_dups_size":0,"ondisk_log_size":5263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77613,"num_write_kb":898929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'4164","reported_seq":4194,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.694723+0000","last_change":"2024-03-23T23:42:40.689988+0000","last_active":"2024-03-23T23:58:27.694723+0000","last_peered":"2024-03-23T23:58:27.694723+0000","last_clean":"2024-03-23T23:58:27.694723+0000","last_became_active":"2024-03-23T23:42:40.689477+0000","last_became_peered":"2024-03-23T23:42:40.689477+0000","last_unstale":"2024-03-23T23:58:27.694723+0000","last_undegraded":"2024-03-23T23:58:27.694723+0000","last_fullsized":"2024-03-23T23:58:27.694723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4164,"log_dups_size":0,"ondisk_log_size":4164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:46:30.427072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61832,"num_write_kb":761424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'1204","reported_seq":1236,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:58.775515+0000","last_change":"2024-03-23T23:42:39.689429+0000","last_active":"2024-03-23T23:57:58.775515+0000","last_peered":"2024-03-23T23:57:58.775515+0000","last_clean":"2024-03-23T23:57:58.775515+0000","last_became_active":"2024-03-23T23:42:39.688066+0000","last_became_peered":"2024-03-23T23:42:39.688066+0000","last_unstale":"2024-03-23T23:57:58.775515+0000","last_undegraded":"2024-03-23T23:57:58.775515+0000","last_fullsized":"2024-03-23T23:57:58.775515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1204,"log_dups_size":0,"ondisk_log_size":1204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:32.254099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1202,"num_write_kb":4648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'3","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:35.376671+0000","last_change":"2024-03-23T23:58:35.376691+0000","last_active":"2024-03-23T23:58:35.376671+0000","last_peered":"2024-03-23T23:58:35.376671+0000","last_clean":"2024-03-23T23:58:35.376671+0000","last_became_active":"2024-03-23T23:42:49.733197+0000","last_became_peered":"2024-03-23T23:42:49.733197+0000","last_unstale":"2024-03-23T23:58:35.376671+0000","last_undegraded":"2024-03-23T23:58:35.376671+0000","last_fullsized":"2024-03-23T23:58:35.376671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-03-23T23:58:35.376594+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-03-23T23:58:35.376594+0000","last_clean_scrub_stamp":"2024-03-23T23:58:35.376594+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:05:35.471060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"27'4661","reported_seq":4684,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.414564+0000","last_change":"2024-03-23T23:42:50.756687+0000","last_active":"2024-03-23T23:58:30.414564+0000","last_peered":"2024-03-23T23:58:30.414564+0000","last_clean":"2024-03-23T23:58:30.414564+0000","last_became_active":"2024-03-23T23:42:50.756371+0000","last_became_peered":"2024-03-23T23:42:50.756371+0000","last_unstale":"2024-03-23T23:58:30.414564+0000","last_undegraded":"2024-03-23T23:58:30.414564+0000","last_fullsized":"2024-03-23T23:58:30.414564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4661,"log_dups_size":0,"ondisk_log_size":4661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69148,"num_write_kb":786028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'6424","reported_seq":6454,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.751614+0000","last_change":"2024-03-23T23:42:40.683025+0000","last_active":"2024-03-23T23:58:27.751614+0000","last_peered":"2024-03-23T23:58:27.751614+0000","last_clean":"2024-03-23T23:58:27.751614+0000","last_became_active":"2024-03-23T23:42:40.682798+0000","last_became_peered":"2024-03-23T23:42:40.682798+0000","last_unstale":"2024-03-23T23:58:27.751614+0000","last_undegraded":"2024-03-23T23:58:27.751614+0000","last_fullsized":"2024-03-23T23:58:27.751614+0000","mapping_epoch":19,"log_start":"27'900","ondisk_log_start":"27'900","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5524,"log_dups_size":0,"ondisk_log_size":5524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:41:51.565112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96000,"num_write_kb":1116606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'29","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:03.452818+0000","last_change":"2024-03-23T23:42:39.681675+0000","last_active":"2024-03-23T23:58:03.452818+0000","last_peered":"2024-03-23T23:58:03.452818+0000","last_clean":"2024-03-23T23:58:03.452818+0000","last_became_active":"2024-03-23T23:42:39.681364+0000","last_became_peered":"2024-03-23T23:42:39.681364+0000","last_unstale":"2024-03-23T23:58:03.452818+0000","last_undegraded":"2024-03-23T23:58:03.452818+0000","last_fullsized":"2024-03-23T23:58:03.452818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'47","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.606954+0000","last_change":"2024-03-23T23:42:49.723350+0000","last_active":"2024-03-23T23:57:57.606954+0000","last_peered":"2024-03-23T23:57:57.606954+0000","last_clean":"2024-03-23T23:57:57.606954+0000","last_became_active":"2024-03-23T23:42:49.723058+0000","last_became_peered":"2024-03-23T23:42:49.723058+0000","last_unstale":"2024-03-23T23:57:57.606954+0000","last_undegraded":"2024-03-23T23:57:57.606954+0000","last_fullsized":"2024-03-23T23:57:57.606954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:43:02.835034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":8215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"27'4271","reported_seq":4293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.472935+0000","last_change":"2024-03-23T23:42:50.746422+0000","last_active":"2024-03-23T23:58:30.472935+0000","last_peered":"2024-03-23T23:58:30.472935+0000","last_clean":"2024-03-23T23:58:30.472935+0000","last_became_active":"2024-03-23T23:42:50.746104+0000","last_became_peered":"2024-03-23T23:42:50.746104+0000","last_unstale":"2024-03-23T23:58:30.472935+0000","last_undegraded":"2024-03-23T23:58:30.472935+0000","last_fullsized":"2024-03-23T23:58:30.472935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4271,"log_dups_size":0,"ondisk_log_size":4271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:40:34.077584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63135,"num_write_kb":732213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"27'5366","reported_seq":5402,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.615129+0000","last_change":"2024-03-23T23:43:22.035935+0000","last_active":"2024-03-23T23:58:27.615129+0000","last_peered":"2024-03-23T23:58:27.615129+0000","last_clean":"2024-03-23T23:58:27.615129+0000","last_became_active":"2024-03-23T23:43:22.035573+0000","last_became_peered":"2024-03-23T23:43:22.035573+0000","last_unstale":"2024-03-23T23:58:27.615129+0000","last_undegraded":"2024-03-23T23:58:27.615129+0000","last_fullsized":"2024-03-23T23:58:27.615129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5366,"log_dups_size":0,"ondisk_log_size":5366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80141,"num_write_kb":923583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'4","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:43.402674+0000","last_change":"2024-03-23T23:42:39.691092+0000","last_active":"2024-03-23T23:54:43.402674+0000","last_peered":"2024-03-23T23:54:43.402674+0000","last_clean":"2024-03-23T23:54:43.402674+0000","last_became_active":"2024-03-23T23:42:39.687473+0000","last_became_peered":"2024-03-23T23:42:39.687473+0000","last_unstale":"2024-03-23T23:54:43.402674+0000","last_undegraded":"2024-03-23T23:54:43.402674+0000","last_fullsized":"2024-03-23T23:54:43.402674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:08:03.578884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'15","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.637771+0000","last_change":"2024-03-23T23:42:49.748693+0000","last_active":"2024-03-23T23:57:57.637771+0000","last_peered":"2024-03-23T23:57:57.637771+0000","last_clean":"2024-03-23T23:57:57.637771+0000","last_became_active":"2024-03-23T23:42:49.748389+0000","last_became_peered":"2024-03-23T23:42:49.748389+0000","last_unstale":"2024-03-23T23:57:57.637771+0000","last_undegraded":"2024-03-23T23:57:57.637771+0000","last_fullsized":"2024-03-23T23:57:57.637771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"27'4548","reported_seq":4570,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.467436+0000","last_change":"2024-03-23T23:42:50.749547+0000","last_active":"2024-03-23T23:58:30.467436+0000","last_peered":"2024-03-23T23:58:30.467436+0000","last_clean":"2024-03-23T23:58:30.467436+0000","last_became_active":"2024-03-23T23:42:50.749066+0000","last_became_peered":"2024-03-23T23:42:50.749066+0000","last_unstale":"2024-03-23T23:58:30.467436+0000","last_undegraded":"2024-03-23T23:58:30.467436+0000","last_fullsized":"2024-03-23T23:58:30.467436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4548,"log_dups_size":0,"ondisk_log_size":4548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:09:19.723830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67689,"num_write_kb":774425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'5741","reported_seq":5758,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.693698+0000","last_change":"2024-03-23T23:43:22.034371+0000","last_active":"2024-03-23T23:58:27.693698+0000","last_peered":"2024-03-23T23:58:27.693698+0000","last_clean":"2024-03-23T23:58:27.693698+0000","last_became_active":"2024-03-23T23:43:22.034063+0000","last_became_peered":"2024-03-23T23:43:22.034063+0000","last_unstale":"2024-03-23T23:58:27.693698+0000","last_undegraded":"2024-03-23T23:58:27.693698+0000","last_fullsized":"2024-03-23T23:58:27.693698+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5741,"log_dups_size":0,"ondisk_log_size":5741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85448,"num_write_kb":1013349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'3","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:46.901728+0000","last_change":"2024-03-23T23:42:39.684669+0000","last_active":"2024-03-23T23:54:46.901728+0000","last_peered":"2024-03-23T23:54:46.901728+0000","last_clean":"2024-03-23T23:54:46.901728+0000","last_became_active":"2024-03-23T23:42:39.684360+0000","last_became_peered":"2024-03-23T23:42:39.684360+0000","last_unstale":"2024-03-23T23:54:46.901728+0000","last_undegraded":"2024-03-23T23:54:46.901728+0000","last_fullsized":"2024-03-23T23:54:46.901728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:19.914926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'5","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:37.234941+0000","last_change":"2024-03-23T23:58:37.234983+0000","last_active":"2024-03-23T23:58:37.234941+0000","last_peered":"2024-03-23T23:58:37.234941+0000","last_clean":"2024-03-23T23:58:37.234941+0000","last_became_active":"2024-03-23T23:42:49.741270+0000","last_became_peered":"2024-03-23T23:42:49.741270+0000","last_unstale":"2024-03-23T23:58:37.234941+0000","last_undegraded":"2024-03-23T23:58:37.234941+0000","last_fullsized":"2024-03-23T23:58:37.234941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-03-23T23:58:37.234796+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-03-23T23:58:37.234796+0000","last_clean_scrub_stamp":"2024-03-23T23:58:37.234796+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:12:15.047909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"27'7540","reported_seq":7563,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.482685+0000","last_change":"2024-03-23T23:42:50.751992+0000","last_active":"2024-03-23T23:58:30.482685+0000","last_peered":"2024-03-23T23:58:30.482685+0000","last_clean":"2024-03-23T23:58:30.482685+0000","last_became_active":"2024-03-23T23:42:50.748281+0000","last_became_peered":"2024-03-23T23:42:50.748281+0000","last_unstale":"2024-03-23T23:58:30.482685+0000","last_undegraded":"2024-03-23T23:58:30.482685+0000","last_fullsized":"2024-03-23T23:58:30.482685+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":7540,"log_dups_size":0,"ondisk_log_size":7540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:57.968968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112036,"num_write_kb":1284404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"27'34","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.626804+0000","last_change":"2024-03-23T23:42:49.741658+0000","last_active":"2024-03-23T23:57:57.626804+0000","last_peered":"2024-03-23T23:57:57.626804+0000","last_clean":"2024-03-23T23:57:57.626804+0000","last_became_active":"2024-03-23T23:42:49.740899+0000","last_became_peered":"2024-03-23T23:42:49.740899+0000","last_unstale":"2024-03-23T23:57:57.626804+0000","last_undegraded":"2024-03-23T23:57:57.626804+0000","last_fullsized":"2024-03-23T23:57:57.626804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'6202","reported_seq":6233,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.643868+0000","last_change":"2024-03-23T23:42:40.679384+0000","last_active":"2024-03-23T23:58:27.643868+0000","last_peered":"2024-03-23T23:58:27.643868+0000","last_clean":"2024-03-23T23:58:27.643868+0000","last_became_active":"2024-03-23T23:42:40.679070+0000","last_became_peered":"2024-03-23T23:42:40.679070+0000","last_unstale":"2024-03-23T23:58:27.643868+0000","last_undegraded":"2024-03-23T23:58:27.643868+0000","last_fullsized":"2024-03-23T23:58:27.643868+0000","mapping_epoch":19,"log_start":"27'500","ondisk_log_start":"27'500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5702,"log_dups_size":0,"ondisk_log_size":5702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92139,"num_write_kb":1051130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'28","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:54:54.268838+0000","last_change":"2024-03-23T23:42:39.682839+0000","last_active":"2024-03-23T23:54:54.268838+0000","last_peered":"2024-03-23T23:54:54.268838+0000","last_clean":"2024-03-23T23:54:54.268838+0000","last_became_active":"2024-03-23T23:42:39.682584+0000","last_became_peered":"2024-03-23T23:42:39.682584+0000","last_unstale":"2024-03-23T23:54:54.268838+0000","last_undegraded":"2024-03-23T23:54:54.268838+0000","last_fullsized":"2024-03-23T23:54:54.268838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:14:19.914926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":8211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"27'5271","reported_seq":5295,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.334654+0000","last_change":"2024-03-23T23:42:50.752596+0000","last_active":"2024-03-23T23:58:30.334654+0000","last_peered":"2024-03-23T23:58:30.334654+0000","last_clean":"2024-03-23T23:58:30.334654+0000","last_became_active":"2024-03-23T23:42:50.751598+0000","last_became_peered":"2024-03-23T23:42:50.751598+0000","last_unstale":"2024-03-23T23:58:30.334654+0000","last_undegraded":"2024-03-23T23:58:30.334654+0000","last_fullsized":"2024-03-23T23:58:30.334654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5271,"log_dups_size":0,"ondisk_log_size":5271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78296,"num_write_kb":918025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"27'25","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.611935+0000","last_change":"2024-03-23T23:42:49.734629+0000","last_active":"2024-03-23T23:57:57.611935+0000","last_peered":"2024-03-23T23:57:57.611935+0000","last_clean":"2024-03-23T23:57:57.611935+0000","last_became_active":"2024-03-23T23:42:49.734309+0000","last_became_peered":"2024-03-23T23:42:49.734309+0000","last_unstale":"2024-03-23T23:57:57.611935+0000","last_undegraded":"2024-03-23T23:57:57.611935+0000","last_fullsized":"2024-03-23T23:57:57.611935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:46.760020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'5383","reported_seq":5414,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.656029+0000","last_change":"2024-03-23T23:42:40.674605+0000","last_active":"2024-03-23T23:58:27.656029+0000","last_peered":"2024-03-23T23:58:27.656029+0000","last_clean":"2024-03-23T23:58:27.656029+0000","last_became_active":"2024-03-23T23:42:40.674366+0000","last_became_peered":"2024-03-23T23:42:40.674366+0000","last_unstale":"2024-03-23T23:58:27.656029+0000","last_undegraded":"2024-03-23T23:58:27.656029+0000","last_fullsized":"2024-03-23T23:58:27.656029+0000","mapping_epoch":19,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5283,"log_dups_size":0,"ondisk_log_size":5283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80001,"num_write_kb":974706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'8","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:27.379328+0000","last_change":"2024-03-23T23:42:39.688646+0000","last_active":"2024-03-23T23:57:27.379328+0000","last_peered":"2024-03-23T23:57:27.379328+0000","last_clean":"2024-03-23T23:57:27.379328+0000","last_became_active":"2024-03-23T23:42:39.687489+0000","last_became_peered":"2024-03-23T23:42:39.687489+0000","last_unstale":"2024-03-23T23:57:27.379328+0000","last_undegraded":"2024-03-23T23:57:27.379328+0000","last_fullsized":"2024-03-23T23:57:27.379328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"27'6132","reported_seq":6155,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.511920+0000","last_change":"2024-03-23T23:42:50.748511+0000","last_active":"2024-03-23T23:58:30.511920+0000","last_peered":"2024-03-23T23:58:30.511920+0000","last_clean":"2024-03-23T23:58:30.511920+0000","last_became_active":"2024-03-23T23:42:50.747154+0000","last_became_peered":"2024-03-23T23:42:50.747154+0000","last_unstale":"2024-03-23T23:58:30.511920+0000","last_undegraded":"2024-03-23T23:58:30.511920+0000","last_fullsized":"2024-03-23T23:58:30.511920+0000","mapping_epoch":23,"log_start":"27'400","ondisk_log_start":"27'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5732,"log_dups_size":0,"ondisk_log_size":5732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91134,"num_write_kb":1034218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"27'17","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:55:02.411457+0000","last_change":"2024-03-23T23:42:39.681458+0000","last_active":"2024-03-23T23:55:02.411457+0000","last_peered":"2024-03-23T23:55:02.411457+0000","last_clean":"2024-03-23T23:55:02.411457+0000","last_became_active":"2024-03-23T23:42:39.681158+0000","last_became_peered":"2024-03-23T23:42:39.681158+0000","last_unstale":"2024-03-23T23:55:02.411457+0000","last_undegraded":"2024-03-23T23:55:02.411457+0000","last_fullsized":"2024-03-23T23:55:02.411457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:08:03.578884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'4519","reported_seq":4550,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.740417+0000","last_change":"2024-03-23T23:42:40.676571+0000","last_active":"2024-03-23T23:58:27.740417+0000","last_peered":"2024-03-23T23:58:27.740417+0000","last_clean":"2024-03-23T23:58:27.740417+0000","last_became_active":"2024-03-23T23:42:40.675877+0000","last_became_peered":"2024-03-23T23:42:40.675877+0000","last_unstale":"2024-03-23T23:58:27.740417+0000","last_undegraded":"2024-03-23T23:58:27.740417+0000","last_fullsized":"2024-03-23T23:58:27.740417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4519,"log_dups_size":0,"ondisk_log_size":4519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67585,"num_write_kb":780136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'19","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:57.610973+0000","last_change":"2024-03-23T23:42:49.734208+0000","last_active":"2024-03-23T23:57:57.610973+0000","last_peered":"2024-03-23T23:57:57.610973+0000","last_clean":"2024-03-23T23:57:57.610973+0000","last_became_active":"2024-03-23T23:42:49.732943+0000","last_became_peered":"2024-03-23T23:42:49.732943+0000","last_unstale":"2024-03-23T23:57:57.610973+0000","last_undegraded":"2024-03-23T23:57:57.610973+0000","last_fullsized":"2024-03-23T23:57:57.610973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"27'4603","reported_seq":4625,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.452531+0000","last_change":"2024-03-23T23:42:50.752722+0000","last_active":"2024-03-23T23:58:30.452531+0000","last_peered":"2024-03-23T23:58:30.452531+0000","last_clean":"2024-03-23T23:58:30.452531+0000","last_became_active":"2024-03-23T23:42:50.749400+0000","last_became_peered":"2024-03-23T23:42:50.749400+0000","last_unstale":"2024-03-23T23:58:30.452531+0000","last_undegraded":"2024-03-23T23:58:30.452531+0000","last_fullsized":"2024-03-23T23:58:30.452531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4603,"log_dups_size":0,"ondisk_log_size":4603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:16:44.027189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67787,"num_write_kb":753464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'1303","reported_seq":1336,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:57:32.406340+0000","last_change":"2024-03-23T23:42:39.688422+0000","last_active":"2024-03-23T23:57:32.406340+0000","last_peered":"2024-03-23T23:57:32.406340+0000","last_clean":"2024-03-23T23:57:32.406340+0000","last_became_active":"2024-03-23T23:42:39.687423+0000","last_became_peered":"2024-03-23T23:42:39.687423+0000","last_unstale":"2024-03-23T23:57:32.406340+0000","last_undegraded":"2024-03-23T23:57:32.406340+0000","last_fullsized":"2024-03-23T23:57:32.406340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:38.646910+0000","last_clean_scrub_stamp":"2024-03-23T23:42:38.646910+0000","objects_scrubbed":0,"log_size":1303,"log_dups_size":0,"ondisk_log_size":1303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1297,"num_write_kb":4300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'4605","reported_seq":4635,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.670982+0000","last_change":"2024-03-23T23:42:40.680801+0000","last_active":"2024-03-23T23:58:27.670982+0000","last_peered":"2024-03-23T23:58:27.670982+0000","last_clean":"2024-03-23T23:58:27.670982+0000","last_became_active":"2024-03-23T23:42:40.680511+0000","last_became_peered":"2024-03-23T23:42:40.680511+0000","last_unstale":"2024-03-23T23:58:27.670982+0000","last_undegraded":"2024-03-23T23:58:27.670982+0000","last_fullsized":"2024-03-23T23:58:27.670982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4605,"log_dups_size":0,"ondisk_log_size":4605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:27:42.392714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68637,"num_write_kb":787014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'90","reported_seq":115,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:02.451862+0000","last_change":"2024-03-23T23:42:49.751291+0000","last_active":"2024-03-23T23:58:02.451862+0000","last_peered":"2024-03-23T23:58:02.451862+0000","last_clean":"2024-03-23T23:58:02.451862+0000","last_became_active":"2024-03-23T23:42:49.749695+0000","last_became_peered":"2024-03-23T23:42:49.749695+0000","last_unstale":"2024-03-23T23:58:02.451862+0000","last_undegraded":"2024-03-23T23:58:02.451862+0000","last_fullsized":"2024-03-23T23:58:02.451862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:48.705566+0000","last_clean_scrub_stamp":"2024-03-23T23:42:48.705566+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":12324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"27'4656","reported_seq":4680,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.508935+0000","last_change":"2024-03-23T23:42:50.752672+0000","last_active":"2024-03-23T23:58:30.508935+0000","last_peered":"2024-03-23T23:58:30.508935+0000","last_clean":"2024-03-23T23:58:30.508935+0000","last_became_active":"2024-03-23T23:42:50.752394+0000","last_became_peered":"2024-03-23T23:42:50.752394+0000","last_unstale":"2024-03-23T23:58:30.508935+0000","last_undegraded":"2024-03-23T23:58:30.508935+0000","last_fullsized":"2024-03-23T23:58:30.508935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4656,"log_dups_size":0,"ondisk_log_size":4656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69093,"num_write_kb":797343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'5268","reported_seq":5299,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.664423+0000","last_change":"2024-03-23T23:42:40.679042+0000","last_active":"2024-03-23T23:58:27.664423+0000","last_peered":"2024-03-23T23:58:27.664423+0000","last_clean":"2024-03-23T23:58:27.664423+0000","last_became_active":"2024-03-23T23:42:40.678518+0000","last_became_peered":"2024-03-23T23:42:40.678518+0000","last_unstale":"2024-03-23T23:58:27.664423+0000","last_undegraded":"2024-03-23T23:58:27.664423+0000","last_fullsized":"2024-03-23T23:58:27.664423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5268,"log_dups_size":0,"ondisk_log_size":5268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:12:14.359173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78308,"num_write_kb":963226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"27'6097","reported_seq":6121,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.398093+0000","last_change":"2024-03-23T23:42:50.757132+0000","last_active":"2024-03-23T23:58:30.398093+0000","last_peered":"2024-03-23T23:58:30.398093+0000","last_clean":"2024-03-23T23:58:30.398093+0000","last_became_active":"2024-03-23T23:42:50.756813+0000","last_became_peered":"2024-03-23T23:42:50.756813+0000","last_unstale":"2024-03-23T23:58:30.398093+0000","last_undegraded":"2024-03-23T23:58:30.398093+0000","last_fullsized":"2024-03-23T23:58:30.398093+0000","mapping_epoch":23,"log_start":"27'400","ondisk_log_start":"27'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5697,"log_dups_size":0,"ondisk_log_size":5697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90451,"num_write_kb":1016115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"27'5502","reported_seq":5534,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.668240+0000","last_change":"2024-03-23T23:42:40.702411+0000","last_active":"2024-03-23T23:58:27.668240+0000","last_peered":"2024-03-23T23:58:27.668240+0000","last_clean":"2024-03-23T23:58:27.668240+0000","last_became_active":"2024-03-23T23:42:40.701398+0000","last_became_peered":"2024-03-23T23:42:40.701398+0000","last_unstale":"2024-03-23T23:58:27.668240+0000","last_undegraded":"2024-03-23T23:58:27.668240+0000","last_fullsized":"2024-03-23T23:58:27.668240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5502,"log_dups_size":0,"ondisk_log_size":5502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81712,"num_write_kb":960011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"27'5509","reported_seq":5532,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.415162+0000","last_change":"2024-03-23T23:42:50.756769+0000","last_active":"2024-03-23T23:58:30.415162+0000","last_peered":"2024-03-23T23:58:30.415162+0000","last_clean":"2024-03-23T23:58:30.415162+0000","last_became_active":"2024-03-23T23:42:50.756503+0000","last_became_peered":"2024-03-23T23:42:50.756503+0000","last_unstale":"2024-03-23T23:58:30.415162+0000","last_undegraded":"2024-03-23T23:58:30.415162+0000","last_fullsized":"2024-03-23T23:58:30.415162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5509,"log_dups_size":0,"ondisk_log_size":5509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:38:50.597847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81671,"num_write_kb":934046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"27'5990","reported_seq":6026,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.684080+0000","last_change":"2024-03-23T23:43:22.035915+0000","last_active":"2024-03-23T23:58:27.684080+0000","last_peered":"2024-03-23T23:58:27.684080+0000","last_clean":"2024-03-23T23:58:27.684080+0000","last_became_active":"2024-03-23T23:43:22.035611+0000","last_became_peered":"2024-03-23T23:43:22.035611+0000","last_unstale":"2024-03-23T23:58:27.684080+0000","last_undegraded":"2024-03-23T23:58:27.684080+0000","last_fullsized":"2024-03-23T23:58:27.684080+0000","mapping_epoch":26,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5890,"log_dups_size":0,"ondisk_log_size":5890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:49:53.121428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89084,"num_write_kb":1042929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"27'5555","reported_seq":5579,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.504461+0000","last_change":"2024-03-23T23:42:50.748726+0000","last_active":"2024-03-23T23:58:30.504461+0000","last_peered":"2024-03-23T23:58:30.504461+0000","last_clean":"2024-03-23T23:58:30.504461+0000","last_became_active":"2024-03-23T23:42:50.748105+0000","last_became_peered":"2024-03-23T23:42:50.748105+0000","last_unstale":"2024-03-23T23:58:30.504461+0000","last_undegraded":"2024-03-23T23:58:30.504461+0000","last_fullsized":"2024-03-23T23:58:30.504461+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5555,"log_dups_size":0,"ondisk_log_size":5555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82238,"num_write_kb":945396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"27'5030","reported_seq":5062,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.694271+0000","last_change":"2024-03-23T23:42:40.673293+0000","last_active":"2024-03-23T23:58:27.694271+0000","last_peered":"2024-03-23T23:58:27.694271+0000","last_clean":"2024-03-23T23:58:27.694271+0000","last_became_active":"2024-03-23T23:42:40.672910+0000","last_became_peered":"2024-03-23T23:42:40.672910+0000","last_unstale":"2024-03-23T23:58:27.694271+0000","last_undegraded":"2024-03-23T23:58:27.694271+0000","last_fullsized":"2024-03-23T23:58:27.694271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5030,"log_dups_size":0,"ondisk_log_size":5030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74941,"num_write_kb":923200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"27'5968","reported_seq":5991,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.397179+0000","last_change":"2024-03-23T23:42:50.750291+0000","last_active":"2024-03-23T23:58:30.397179+0000","last_peered":"2024-03-23T23:58:30.397179+0000","last_clean":"2024-03-23T23:58:30.397179+0000","last_became_active":"2024-03-23T23:42:50.749908+0000","last_became_peered":"2024-03-23T23:42:50.749908+0000","last_unstale":"2024-03-23T23:58:30.397179+0000","last_undegraded":"2024-03-23T23:58:30.397179+0000","last_fullsized":"2024-03-23T23:58:30.397179+0000","mapping_epoch":23,"log_start":"27'300","ondisk_log_start":"27'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5668,"log_dups_size":0,"ondisk_log_size":5668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:54.910408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88637,"num_write_kb":993297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"27'5454","reported_seq":5486,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.667092+0000","last_change":"2024-03-23T23:42:40.685370+0000","last_active":"2024-03-23T23:58:27.667092+0000","last_peered":"2024-03-23T23:58:27.667092+0000","last_clean":"2024-03-23T23:58:27.667092+0000","last_became_active":"2024-03-23T23:42:40.685120+0000","last_became_peered":"2024-03-23T23:42:40.685120+0000","last_unstale":"2024-03-23T23:58:27.667092+0000","last_undegraded":"2024-03-23T23:58:27.667092+0000","last_fullsized":"2024-03-23T23:58:27.667092+0000","mapping_epoch":19,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5354,"log_dups_size":0,"ondisk_log_size":5354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81249,"num_write_kb":968622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"27'5340","reported_seq":5363,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.454723+0000","last_change":"2024-03-23T23:42:50.747361+0000","last_active":"2024-03-23T23:58:30.454723+0000","last_peered":"2024-03-23T23:58:30.454723+0000","last_clean":"2024-03-23T23:58:30.454723+0000","last_became_active":"2024-03-23T23:42:50.746310+0000","last_became_peered":"2024-03-23T23:42:50.746310+0000","last_unstale":"2024-03-23T23:58:30.454723+0000","last_undegraded":"2024-03-23T23:58:30.454723+0000","last_fullsized":"2024-03-23T23:58:30.454723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5340,"log_dups_size":0,"ondisk_log_size":5340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:57.968968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79170,"num_write_kb":877684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"27'5337","reported_seq":5369,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.589713+0000","last_change":"2024-03-23T23:42:40.677168+0000","last_active":"2024-03-23T23:58:27.589713+0000","last_peered":"2024-03-23T23:58:27.589713+0000","last_clean":"2024-03-23T23:58:27.589713+0000","last_became_active":"2024-03-23T23:42:40.676912+0000","last_became_peered":"2024-03-23T23:42:40.676912+0000","last_unstale":"2024-03-23T23:58:27.589713+0000","last_undegraded":"2024-03-23T23:58:27.589713+0000","last_fullsized":"2024-03-23T23:58:27.589713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5337,"log_dups_size":0,"ondisk_log_size":5337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79200,"num_write_kb":983244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"27'5397","reported_seq":5420,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.495790+0000","last_change":"2024-03-23T23:42:50.749305+0000","last_active":"2024-03-23T23:58:30.495790+0000","last_peered":"2024-03-23T23:58:30.495790+0000","last_clean":"2024-03-23T23:58:30.495790+0000","last_became_active":"2024-03-23T23:42:50.748798+0000","last_became_peered":"2024-03-23T23:42:50.748798+0000","last_unstale":"2024-03-23T23:58:30.495790+0000","last_undegraded":"2024-03-23T23:58:30.495790+0000","last_fullsized":"2024-03-23T23:58:30.495790+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5397,"log_dups_size":0,"ondisk_log_size":5397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:18:19.610436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80551,"num_write_kb":913314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"27'4480","reported_seq":4511,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.752453+0000","last_change":"2024-03-23T23:42:40.694420+0000","last_active":"2024-03-23T23:58:27.752453+0000","last_peered":"2024-03-23T23:58:27.752453+0000","last_clean":"2024-03-23T23:58:27.752453+0000","last_became_active":"2024-03-23T23:42:40.693867+0000","last_became_peered":"2024-03-23T23:42:40.693867+0000","last_unstale":"2024-03-23T23:58:27.752453+0000","last_undegraded":"2024-03-23T23:58:27.752453+0000","last_fullsized":"2024-03-23T23:58:27.752453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4480,"log_dups_size":0,"ondisk_log_size":4480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:54.557634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66343,"num_write_kb":822171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"27'5452","reported_seq":5475,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.477723+0000","last_change":"2024-03-23T23:42:50.754149+0000","last_active":"2024-03-23T23:58:30.477723+0000","last_peered":"2024-03-23T23:58:30.477723+0000","last_clean":"2024-03-23T23:58:30.477723+0000","last_became_active":"2024-03-23T23:42:50.753471+0000","last_became_peered":"2024-03-23T23:42:50.753471+0000","last_unstale":"2024-03-23T23:58:30.477723+0000","last_undegraded":"2024-03-23T23:58:30.477723+0000","last_fullsized":"2024-03-23T23:58:30.477723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5452,"log_dups_size":0,"ondisk_log_size":5452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:28.822672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80762,"num_write_kb":909623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'5934","reported_seq":5966,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.565265+0000","last_change":"2024-03-23T23:42:40.685177+0000","last_active":"2024-03-23T23:58:27.565265+0000","last_peered":"2024-03-23T23:58:27.565265+0000","last_clean":"2024-03-23T23:58:27.565265+0000","last_became_active":"2024-03-23T23:42:40.684495+0000","last_became_peered":"2024-03-23T23:42:40.684495+0000","last_unstale":"2024-03-23T23:58:27.565265+0000","last_undegraded":"2024-03-23T23:58:27.565265+0000","last_fullsized":"2024-03-23T23:58:27.565265+0000","mapping_epoch":19,"log_start":"27'600","ondisk_log_start":"27'600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5334,"log_dups_size":0,"ondisk_log_size":5334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88442,"num_write_kb":1073631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"27'5682","reported_seq":5705,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.511705+0000","last_change":"2024-03-23T23:42:50.746438+0000","last_active":"2024-03-23T23:58:30.511705+0000","last_peered":"2024-03-23T23:58:30.511705+0000","last_clean":"2024-03-23T23:58:30.511705+0000","last_became_active":"2024-03-23T23:42:50.745771+0000","last_became_peered":"2024-03-23T23:42:50.745771+0000","last_unstale":"2024-03-23T23:58:30.511705+0000","last_undegraded":"2024-03-23T23:58:30.511705+0000","last_fullsized":"2024-03-23T23:58:30.511705+0000","mapping_epoch":23,"log_start":"27'400","ondisk_log_start":"27'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5282,"log_dups_size":0,"ondisk_log_size":5282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83950,"num_write_kb":942381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'5332","reported_seq":5363,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.685598+0000","last_change":"2024-03-23T23:42:40.701852+0000","last_active":"2024-03-23T23:58:27.685598+0000","last_peered":"2024-03-23T23:58:27.685598+0000","last_clean":"2024-03-23T23:58:27.685598+0000","last_became_active":"2024-03-23T23:42:40.701566+0000","last_became_peered":"2024-03-23T23:42:40.701566+0000","last_unstale":"2024-03-23T23:58:27.685598+0000","last_undegraded":"2024-03-23T23:58:27.685598+0000","last_fullsized":"2024-03-23T23:58:27.685598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5332,"log_dups_size":0,"ondisk_log_size":5332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79247,"num_write_kb":918114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"27'6956","reported_seq":6978,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.431698+0000","last_change":"2024-03-23T23:42:50.758879+0000","last_active":"2024-03-23T23:58:30.431698+0000","last_peered":"2024-03-23T23:58:30.431698+0000","last_clean":"2024-03-23T23:58:30.431698+0000","last_became_active":"2024-03-23T23:42:50.758564+0000","last_became_peered":"2024-03-23T23:42:50.758564+0000","last_unstale":"2024-03-23T23:58:30.431698+0000","last_undegraded":"2024-03-23T23:58:30.431698+0000","last_fullsized":"2024-03-23T23:58:30.431698+0000","mapping_epoch":23,"log_start":"27'1200","ondisk_log_start":"27'1200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5756,"log_dups_size":0,"ondisk_log_size":5756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:11:29.268536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103363,"num_write_kb":1190294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"27'4879","reported_seq":4911,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.668209+0000","last_change":"2024-03-23T23:42:40.684899+0000","last_active":"2024-03-23T23:58:27.668209+0000","last_peered":"2024-03-23T23:58:27.668209+0000","last_clean":"2024-03-23T23:58:27.668209+0000","last_became_active":"2024-03-23T23:42:40.684603+0000","last_became_peered":"2024-03-23T23:42:40.684603+0000","last_unstale":"2024-03-23T23:58:27.668209+0000","last_undegraded":"2024-03-23T23:58:27.668209+0000","last_fullsized":"2024-03-23T23:58:27.668209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4879,"log_dups_size":0,"ondisk_log_size":4879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72674,"num_write_kb":866936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"27'4847","reported_seq":4870,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.453075+0000","last_change":"2024-03-23T23:42:50.754096+0000","last_active":"2024-03-23T23:58:30.453075+0000","last_peered":"2024-03-23T23:58:30.453075+0000","last_clean":"2024-03-23T23:58:30.453075+0000","last_became_active":"2024-03-23T23:42:50.753602+0000","last_became_peered":"2024-03-23T23:42:50.753602+0000","last_unstale":"2024-03-23T23:58:30.453075+0000","last_undegraded":"2024-03-23T23:58:30.453075+0000","last_fullsized":"2024-03-23T23:58:30.453075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4847,"log_dups_size":0,"ondisk_log_size":4847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71433,"num_write_kb":836622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"27'5277","reported_seq":5294,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.657252+0000","last_change":"2024-03-23T23:43:22.035247+0000","last_active":"2024-03-23T23:58:27.657252+0000","last_peered":"2024-03-23T23:58:27.657252+0000","last_clean":"2024-03-23T23:58:27.657252+0000","last_became_active":"2024-03-23T23:43:22.034831+0000","last_became_peered":"2024-03-23T23:43:22.034831+0000","last_unstale":"2024-03-23T23:58:27.657252+0000","last_undegraded":"2024-03-23T23:58:27.657252+0000","last_fullsized":"2024-03-23T23:58:27.657252+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5277,"log_dups_size":0,"ondisk_log_size":5277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78302,"num_write_kb":947936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2d","version":"27'6041","reported_seq":6064,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.456835+0000","last_change":"2024-03-23T23:42:50.741324+0000","last_active":"2024-03-23T23:58:30.456835+0000","last_peered":"2024-03-23T23:58:30.456835+0000","last_clean":"2024-03-23T23:58:30.456835+0000","last_became_active":"2024-03-23T23:42:50.741065+0000","last_became_peered":"2024-03-23T23:42:50.741065+0000","last_unstale":"2024-03-23T23:58:30.456835+0000","last_undegraded":"2024-03-23T23:58:30.456835+0000","last_fullsized":"2024-03-23T23:58:30.456835+0000","mapping_epoch":23,"log_start":"27'700","ondisk_log_start":"27'700","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5341,"log_dups_size":0,"ondisk_log_size":5341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89207,"num_write_kb":985993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"27'6145","reported_seq":6185,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:36.242909+0000","last_change":"2024-03-23T23:58:36.242950+0000","last_active":"2024-03-23T23:58:36.242909+0000","last_peered":"2024-03-23T23:58:36.242909+0000","last_clean":"2024-03-23T23:58:36.242909+0000","last_became_active":"2024-03-23T23:42:40.688875+0000","last_became_peered":"2024-03-23T23:42:40.688875+0000","last_unstale":"2024-03-23T23:58:36.242909+0000","last_undegraded":"2024-03-23T23:58:36.242909+0000","last_fullsized":"2024-03-23T23:58:36.242909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6145","last_scrub_stamp":"2024-03-23T23:58:36.242781+0000","last_deep_scrub":"27'6145","last_deep_scrub_stamp":"2024-03-23T23:58:36.242781+0000","last_clean_scrub_stamp":"2024-03-23T23:58:36.242781+0000","objects_scrubbed":0,"log_size":6145,"log_dups_size":0,"ondisk_log_size":6145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:13:57.388811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91123,"num_write_kb":1098161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"27'5341","reported_seq":5364,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.447984+0000","last_change":"2024-03-23T23:42:50.762055+0000","last_active":"2024-03-23T23:58:30.447984+0000","last_peered":"2024-03-23T23:58:30.447984+0000","last_clean":"2024-03-23T23:58:30.447984+0000","last_became_active":"2024-03-23T23:42:50.761762+0000","last_became_peered":"2024-03-23T23:42:50.761762+0000","last_unstale":"2024-03-23T23:58:30.447984+0000","last_undegraded":"2024-03-23T23:58:30.447984+0000","last_fullsized":"2024-03-23T23:58:30.447984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5341,"log_dups_size":0,"ondisk_log_size":5341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:38:28.822672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79322,"num_write_kb":913380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'4790","reported_seq":4820,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.610687+0000","last_change":"2024-03-23T23:42:40.683701+0000","last_active":"2024-03-23T23:58:27.610687+0000","last_peered":"2024-03-23T23:58:27.610687+0000","last_clean":"2024-03-23T23:58:27.610687+0000","last_became_active":"2024-03-23T23:42:40.683377+0000","last_became_peered":"2024-03-23T23:42:40.683377+0000","last_unstale":"2024-03-23T23:58:27.610687+0000","last_undegraded":"2024-03-23T23:58:27.610687+0000","last_fullsized":"2024-03-23T23:58:27.610687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4790,"log_dups_size":0,"ondisk_log_size":4790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:59:13.323287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71235,"num_write_kb":860094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"27'6324","reported_seq":6346,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.491880+0000","last_change":"2024-03-23T23:42:50.754372+0000","last_active":"2024-03-23T23:58:30.491880+0000","last_peered":"2024-03-23T23:58:30.491880+0000","last_clean":"2024-03-23T23:58:30.491880+0000","last_became_active":"2024-03-23T23:42:50.754072+0000","last_became_peered":"2024-03-23T23:42:50.754072+0000","last_unstale":"2024-03-23T23:58:30.491880+0000","last_undegraded":"2024-03-23T23:58:30.491880+0000","last_fullsized":"2024-03-23T23:58:30.491880+0000","mapping_epoch":23,"log_start":"27'800","ondisk_log_start":"27'800","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5524,"log_dups_size":0,"ondisk_log_size":5524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:40:34.077584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93450,"num_write_kb":1059053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"27'5796","reported_seq":5826,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.683366+0000","last_change":"2024-03-23T23:42:40.689769+0000","last_active":"2024-03-23T23:58:27.683366+0000","last_peered":"2024-03-23T23:58:27.683366+0000","last_clean":"2024-03-23T23:58:27.683366+0000","last_became_active":"2024-03-23T23:42:40.689111+0000","last_became_peered":"2024-03-23T23:42:40.689111+0000","last_unstale":"2024-03-23T23:58:27.683366+0000","last_undegraded":"2024-03-23T23:58:27.683366+0000","last_fullsized":"2024-03-23T23:58:27.683366+0000","mapping_epoch":19,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5696,"log_dups_size":0,"ondisk_log_size":5696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:40:22.690954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86245,"num_write_kb":1027145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"27'5278","reported_seq":5301,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.420389+0000","last_change":"2024-03-23T23:42:50.759792+0000","last_active":"2024-03-23T23:58:30.420389+0000","last_peered":"2024-03-23T23:58:30.420389+0000","last_clean":"2024-03-23T23:58:30.420389+0000","last_became_active":"2024-03-23T23:42:50.759604+0000","last_became_peered":"2024-03-23T23:42:50.759604+0000","last_unstale":"2024-03-23T23:58:30.420389+0000","last_undegraded":"2024-03-23T23:58:30.420389+0000","last_fullsized":"2024-03-23T23:58:30.420389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5278,"log_dups_size":0,"ondisk_log_size":5278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:15:25.617521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77877,"num_write_kb":893934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"27'5684","reported_seq":5715,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.690742+0000","last_change":"2024-03-23T23:42:40.690961+0000","last_active":"2024-03-23T23:58:27.690742+0000","last_peered":"2024-03-23T23:58:27.690742+0000","last_clean":"2024-03-23T23:58:27.690742+0000","last_became_active":"2024-03-23T23:42:40.690690+0000","last_became_peered":"2024-03-23T23:42:40.690690+0000","last_unstale":"2024-03-23T23:58:27.690742+0000","last_undegraded":"2024-03-23T23:58:27.690742+0000","last_fullsized":"2024-03-23T23:58:27.690742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5684,"log_dups_size":0,"ondisk_log_size":5684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84510,"num_write_kb":984289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"27'4973","reported_seq":4997,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.379686+0000","last_change":"2024-03-23T23:42:50.764821+0000","last_active":"2024-03-23T23:58:30.379686+0000","last_peered":"2024-03-23T23:58:30.379686+0000","last_clean":"2024-03-23T23:58:30.379686+0000","last_became_active":"2024-03-23T23:42:50.764563+0000","last_became_peered":"2024-03-23T23:42:50.764563+0000","last_unstale":"2024-03-23T23:58:30.379686+0000","last_undegraded":"2024-03-23T23:58:30.379686+0000","last_fullsized":"2024-03-23T23:58:30.379686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4973,"log_dups_size":0,"ondisk_log_size":4973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73421,"num_write_kb":840152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"27'6976","reported_seq":7006,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.731575+0000","last_change":"2024-03-23T23:42:40.708540+0000","last_active":"2024-03-23T23:58:27.731575+0000","last_peered":"2024-03-23T23:58:27.731575+0000","last_clean":"2024-03-23T23:58:27.731575+0000","last_became_active":"2024-03-23T23:42:40.708031+0000","last_became_peered":"2024-03-23T23:42:40.708031+0000","last_unstale":"2024-03-23T23:58:27.731575+0000","last_undegraded":"2024-03-23T23:58:27.731575+0000","last_fullsized":"2024-03-23T23:58:27.731575+0000","mapping_epoch":19,"log_start":"27'1000","ondisk_log_start":"27'1000","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5976,"log_dups_size":0,"ondisk_log_size":5976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:44:03.386124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104041,"num_write_kb":1238038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"27'5691","reported_seq":5714,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.449903+0000","last_change":"2024-03-23T23:42:50.771062+0000","last_active":"2024-03-23T23:58:30.449903+0000","last_peered":"2024-03-23T23:58:30.449903+0000","last_clean":"2024-03-23T23:58:30.449903+0000","last_became_active":"2024-03-23T23:42:50.770790+0000","last_became_peered":"2024-03-23T23:42:50.770790+0000","last_unstale":"2024-03-23T23:58:30.449903+0000","last_undegraded":"2024-03-23T23:58:30.449903+0000","last_fullsized":"2024-03-23T23:58:30.449903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5691,"log_dups_size":0,"ondisk_log_size":5691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84043,"num_write_kb":972100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"27'4954","reported_seq":4984,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.678147+0000","last_change":"2024-03-23T23:42:40.697920+0000","last_active":"2024-03-23T23:58:27.678147+0000","last_peered":"2024-03-23T23:58:27.678147+0000","last_clean":"2024-03-23T23:58:27.678147+0000","last_became_active":"2024-03-23T23:42:40.697694+0000","last_became_peered":"2024-03-23T23:42:40.697694+0000","last_unstale":"2024-03-23T23:58:27.678147+0000","last_undegraded":"2024-03-23T23:58:27.678147+0000","last_fullsized":"2024-03-23T23:58:27.678147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4954,"log_dups_size":0,"ondisk_log_size":4954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73634,"num_write_kb":894008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"27'6061","reported_seq":6083,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.499162+0000","last_change":"2024-03-23T23:42:50.751694+0000","last_active":"2024-03-23T23:58:30.499162+0000","last_peered":"2024-03-23T23:58:30.499162+0000","last_clean":"2024-03-23T23:58:30.499162+0000","last_became_active":"2024-03-23T23:42:50.751452+0000","last_became_peered":"2024-03-23T23:42:50.751452+0000","last_unstale":"2024-03-23T23:58:30.499162+0000","last_undegraded":"2024-03-23T23:58:30.499162+0000","last_fullsized":"2024-03-23T23:58:30.499162+0000","mapping_epoch":23,"log_start":"27'600","ondisk_log_start":"27'600","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5461,"log_dups_size":0,"ondisk_log_size":5461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:57:49.981068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89888,"num_write_kb":1063697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"27'4435","reported_seq":4466,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.667937+0000","last_change":"2024-03-23T23:42:40.681928+0000","last_active":"2024-03-23T23:58:27.667937+0000","last_peered":"2024-03-23T23:58:27.667937+0000","last_clean":"2024-03-23T23:58:27.667937+0000","last_became_active":"2024-03-23T23:42:40.681337+0000","last_became_peered":"2024-03-23T23:42:40.681337+0000","last_unstale":"2024-03-23T23:58:27.667937+0000","last_undegraded":"2024-03-23T23:58:27.667937+0000","last_fullsized":"2024-03-23T23:58:27.667937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4435,"log_dups_size":0,"ondisk_log_size":4435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65733,"num_write_kb":782831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"27'3547","reported_seq":3569,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.415237+0000","last_change":"2024-03-23T23:42:50.769003+0000","last_active":"2024-03-23T23:58:30.415237+0000","last_peered":"2024-03-23T23:58:30.415237+0000","last_clean":"2024-03-23T23:58:30.415237+0000","last_became_active":"2024-03-23T23:42:50.768695+0000","last_became_peered":"2024-03-23T23:42:50.768695+0000","last_unstale":"2024-03-23T23:58:30.415237+0000","last_undegraded":"2024-03-23T23:58:30.415237+0000","last_fullsized":"2024-03-23T23:58:30.415237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":3547,"log_dups_size":0,"ondisk_log_size":3547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:17:11.847056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52531,"num_write_kb":593656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'4800","reported_seq":4831,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.660697+0000","last_change":"2024-03-23T23:42:40.680934+0000","last_active":"2024-03-23T23:58:27.660697+0000","last_peered":"2024-03-23T23:58:27.660697+0000","last_clean":"2024-03-23T23:58:27.660697+0000","last_became_active":"2024-03-23T23:42:40.680643+0000","last_became_peered":"2024-03-23T23:42:40.680643+0000","last_unstale":"2024-03-23T23:58:27.660697+0000","last_undegraded":"2024-03-23T23:58:27.660697+0000","last_fullsized":"2024-03-23T23:58:27.660697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4800,"log_dups_size":0,"ondisk_log_size":4800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71159,"num_write_kb":844038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"27'5011","reported_seq":5033,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.459466+0000","last_change":"2024-03-23T23:42:50.762401+0000","last_active":"2024-03-23T23:58:30.459466+0000","last_peered":"2024-03-23T23:58:30.459466+0000","last_clean":"2024-03-23T23:58:30.459466+0000","last_became_active":"2024-03-23T23:42:50.762183+0000","last_became_peered":"2024-03-23T23:42:50.762183+0000","last_unstale":"2024-03-23T23:58:30.459466+0000","last_undegraded":"2024-03-23T23:58:30.459466+0000","last_fullsized":"2024-03-23T23:58:30.459466+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5011,"log_dups_size":0,"ondisk_log_size":5011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:13:10.497921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74336,"num_write_kb":853450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"27'4024","reported_seq":4055,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.649316+0000","last_change":"2024-03-23T23:42:40.682736+0000","last_active":"2024-03-23T23:58:27.649316+0000","last_peered":"2024-03-23T23:58:27.649316+0000","last_clean":"2024-03-23T23:58:27.649316+0000","last_became_active":"2024-03-23T23:42:40.682410+0000","last_became_peered":"2024-03-23T23:42:40.682410+0000","last_unstale":"2024-03-23T23:58:27.649316+0000","last_undegraded":"2024-03-23T23:58:27.649316+0000","last_fullsized":"2024-03-23T23:58:27.649316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4024,"log_dups_size":0,"ondisk_log_size":4024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59528,"num_write_kb":755074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"27'4698","reported_seq":4721,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.450918+0000","last_change":"2024-03-23T23:42:50.749204+0000","last_active":"2024-03-23T23:58:30.450918+0000","last_peered":"2024-03-23T23:58:30.450918+0000","last_clean":"2024-03-23T23:58:30.450918+0000","last_became_active":"2024-03-23T23:42:50.748809+0000","last_became_peered":"2024-03-23T23:42:50.748809+0000","last_unstale":"2024-03-23T23:58:30.450918+0000","last_undegraded":"2024-03-23T23:58:30.450918+0000","last_fullsized":"2024-03-23T23:58:30.450918+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4698,"log_dups_size":0,"ondisk_log_size":4698,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69546,"num_write_kb":808803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'3645","reported_seq":3675,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.744600+0000","last_change":"2024-03-23T23:42:40.682523+0000","last_active":"2024-03-23T23:58:27.744600+0000","last_peered":"2024-03-23T23:58:27.744600+0000","last_clean":"2024-03-23T23:58:27.744600+0000","last_became_active":"2024-03-23T23:42:40.682155+0000","last_became_peered":"2024-03-23T23:42:40.682155+0000","last_unstale":"2024-03-23T23:58:27.744600+0000","last_undegraded":"2024-03-23T23:58:27.744600+0000","last_fullsized":"2024-03-23T23:58:27.744600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":3645,"log_dups_size":0,"ondisk_log_size":3645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:42:33.260151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54155,"num_write_kb":623068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"27'4100","reported_seq":4124,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.407525+0000","last_change":"2024-03-23T23:42:50.746115+0000","last_active":"2024-03-23T23:58:30.407525+0000","last_peered":"2024-03-23T23:58:30.407525+0000","last_clean":"2024-03-23T23:58:30.407525+0000","last_became_active":"2024-03-23T23:42:50.745858+0000","last_became_peered":"2024-03-23T23:42:50.745858+0000","last_unstale":"2024-03-23T23:58:30.407525+0000","last_undegraded":"2024-03-23T23:58:30.407525+0000","last_fullsized":"2024-03-23T23:58:30.407525+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4100,"log_dups_size":0,"ondisk_log_size":4100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":60470,"num_write_kb":714617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"27'5162","reported_seq":5192,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.639052+0000","last_change":"2024-03-23T23:42:40.702089+0000","last_active":"2024-03-23T23:58:27.639052+0000","last_peered":"2024-03-23T23:58:27.639052+0000","last_clean":"2024-03-23T23:58:27.639052+0000","last_became_active":"2024-03-23T23:42:40.701874+0000","last_became_peered":"2024-03-23T23:42:40.701874+0000","last_unstale":"2024-03-23T23:58:27.639052+0000","last_undegraded":"2024-03-23T23:58:27.639052+0000","last_fullsized":"2024-03-23T23:58:27.639052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5162,"log_dups_size":0,"ondisk_log_size":5162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:20.857317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76848,"num_write_kb":918422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"27'4951","reported_seq":4973,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.490830+0000","last_change":"2024-03-23T23:42:50.773115+0000","last_active":"2024-03-23T23:58:30.490830+0000","last_peered":"2024-03-23T23:58:30.490830+0000","last_clean":"2024-03-23T23:58:30.490830+0000","last_became_active":"2024-03-23T23:42:50.772849+0000","last_became_peered":"2024-03-23T23:42:50.772849+0000","last_unstale":"2024-03-23T23:58:30.490830+0000","last_undegraded":"2024-03-23T23:58:30.490830+0000","last_fullsized":"2024-03-23T23:58:30.490830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4951,"log_dups_size":0,"ondisk_log_size":4951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:29:42.898728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73640,"num_write_kb":854588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"27'5694","reported_seq":5724,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.749301+0000","last_change":"2024-03-23T23:42:40.703254+0000","last_active":"2024-03-23T23:58:27.749301+0000","last_peered":"2024-03-23T23:58:27.749301+0000","last_clean":"2024-03-23T23:58:27.749301+0000","last_became_active":"2024-03-23T23:42:40.702447+0000","last_became_peered":"2024-03-23T23:42:40.702447+0000","last_unstale":"2024-03-23T23:58:27.749301+0000","last_undegraded":"2024-03-23T23:58:27.749301+0000","last_fullsized":"2024-03-23T23:58:27.749301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5694,"log_dups_size":0,"ondisk_log_size":5694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:59:45.154553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84473,"num_write_kb":1008808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"27'4449","reported_seq":4471,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.442679+0000","last_change":"2024-03-23T23:42:50.748946+0000","last_active":"2024-03-23T23:58:30.442679+0000","last_peered":"2024-03-23T23:58:30.442679+0000","last_clean":"2024-03-23T23:58:30.442679+0000","last_became_active":"2024-03-23T23:42:50.745205+0000","last_became_peered":"2024-03-23T23:42:50.745205+0000","last_unstale":"2024-03-23T23:58:30.442679+0000","last_undegraded":"2024-03-23T23:58:30.442679+0000","last_fullsized":"2024-03-23T23:58:30.442679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4449,"log_dups_size":0,"ondisk_log_size":4449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:58:16.372010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65706,"num_write_kb":746784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"27'6105","reported_seq":6135,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.765689+0000","last_change":"2024-03-23T23:42:40.714331+0000","last_active":"2024-03-23T23:58:27.765689+0000","last_peered":"2024-03-23T23:58:27.765689+0000","last_clean":"2024-03-23T23:58:27.765689+0000","last_became_active":"2024-03-23T23:42:40.713737+0000","last_became_peered":"2024-03-23T23:42:40.713737+0000","last_unstale":"2024-03-23T23:58:27.765689+0000","last_undegraded":"2024-03-23T23:58:27.765689+0000","last_fullsized":"2024-03-23T23:58:27.765689+0000","mapping_epoch":19,"log_start":"27'400","ondisk_log_start":"27'400","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5705,"log_dups_size":0,"ondisk_log_size":5705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:24:43.902129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90841,"num_write_kb":1111853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"27'6499","reported_seq":6523,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.510896+0000","last_change":"2024-03-23T23:42:50.746666+0000","last_active":"2024-03-23T23:58:30.510896+0000","last_peered":"2024-03-23T23:58:30.510896+0000","last_clean":"2024-03-23T23:58:30.510896+0000","last_became_active":"2024-03-23T23:42:50.746149+0000","last_became_peered":"2024-03-23T23:42:50.746149+0000","last_unstale":"2024-03-23T23:58:30.510896+0000","last_undegraded":"2024-03-23T23:58:30.510896+0000","last_fullsized":"2024-03-23T23:58:30.510896+0000","mapping_epoch":23,"log_start":"27'1200","ondisk_log_start":"27'1200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5299,"log_dups_size":0,"ondisk_log_size":5299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96498,"num_write_kb":1062339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"27'5300","reported_seq":5331,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.667188+0000","last_change":"2024-03-23T23:42:40.710655+0000","last_active":"2024-03-23T23:58:27.667188+0000","last_peered":"2024-03-23T23:58:27.667188+0000","last_clean":"2024-03-23T23:58:27.667188+0000","last_became_active":"2024-03-23T23:42:40.710362+0000","last_became_peered":"2024-03-23T23:42:40.710362+0000","last_unstale":"2024-03-23T23:58:27.667188+0000","last_undegraded":"2024-03-23T23:58:27.667188+0000","last_fullsized":"2024-03-23T23:58:27.667188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5300,"log_dups_size":0,"ondisk_log_size":5300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79360,"num_write_kb":955033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"27'4854","reported_seq":4877,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.461302+0000","last_change":"2024-03-23T23:42:50.753397+0000","last_active":"2024-03-23T23:58:30.461302+0000","last_peered":"2024-03-23T23:58:30.461302+0000","last_clean":"2024-03-23T23:58:30.461302+0000","last_became_active":"2024-03-23T23:42:50.753085+0000","last_became_peered":"2024-03-23T23:42:50.753085+0000","last_unstale":"2024-03-23T23:58:30.461302+0000","last_undegraded":"2024-03-23T23:58:30.461302+0000","last_fullsized":"2024-03-23T23:58:30.461302+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4854,"log_dups_size":0,"ondisk_log_size":4854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:25:44.894505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71990,"num_write_kb":829684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"27'5530","reported_seq":5560,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.601069+0000","last_change":"2024-03-23T23:42:40.689380+0000","last_active":"2024-03-23T23:58:27.601069+0000","last_peered":"2024-03-23T23:58:27.601069+0000","last_clean":"2024-03-23T23:58:27.601069+0000","last_became_active":"2024-03-23T23:42:40.689023+0000","last_became_peered":"2024-03-23T23:42:40.689023+0000","last_unstale":"2024-03-23T23:58:27.601069+0000","last_undegraded":"2024-03-23T23:58:27.601069+0000","last_fullsized":"2024-03-23T23:58:27.601069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5530,"log_dups_size":0,"ondisk_log_size":5530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:17:19.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82240,"num_write_kb":999067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"27'4495","reported_seq":4519,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.430272+0000","last_change":"2024-03-23T23:42:50.756133+0000","last_active":"2024-03-23T23:58:30.430272+0000","last_peered":"2024-03-23T23:58:30.430272+0000","last_clean":"2024-03-23T23:58:30.430272+0000","last_became_active":"2024-03-23T23:42:50.755405+0000","last_became_peered":"2024-03-23T23:42:50.755405+0000","last_unstale":"2024-03-23T23:58:30.430272+0000","last_undegraded":"2024-03-23T23:58:30.430272+0000","last_fullsized":"2024-03-23T23:58:30.430272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4495,"log_dups_size":0,"ondisk_log_size":4495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66847,"num_write_kb":769767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"27'4564","reported_seq":4594,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.681397+0000","last_change":"2024-03-23T23:42:40.698234+0000","last_active":"2024-03-23T23:58:27.681397+0000","last_peered":"2024-03-23T23:58:27.681397+0000","last_clean":"2024-03-23T23:58:27.681397+0000","last_became_active":"2024-03-23T23:42:40.695978+0000","last_became_peered":"2024-03-23T23:42:40.695978+0000","last_unstale":"2024-03-23T23:58:27.681397+0000","last_undegraded":"2024-03-23T23:58:27.681397+0000","last_fullsized":"2024-03-23T23:58:27.681397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4564,"log_dups_size":0,"ondisk_log_size":4564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:06:04.633288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67848,"num_write_kb":796612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"27'5529","reported_seq":5552,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.469649+0000","last_change":"2024-03-23T23:42:50.752051+0000","last_active":"2024-03-23T23:58:30.469649+0000","last_peered":"2024-03-23T23:58:30.469649+0000","last_clean":"2024-03-23T23:58:30.469649+0000","last_became_active":"2024-03-23T23:42:50.751738+0000","last_became_peered":"2024-03-23T23:42:50.751738+0000","last_unstale":"2024-03-23T23:58:30.469649+0000","last_undegraded":"2024-03-23T23:58:30.469649+0000","last_fullsized":"2024-03-23T23:58:30.469649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5529,"log_dups_size":0,"ondisk_log_size":5529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:20:53.750917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81884,"num_write_kb":915818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'4914","reported_seq":4944,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.700527+0000","last_change":"2024-03-23T23:42:40.698407+0000","last_active":"2024-03-23T23:58:27.700527+0000","last_peered":"2024-03-23T23:58:27.700527+0000","last_clean":"2024-03-23T23:58:27.700527+0000","last_became_active":"2024-03-23T23:42:40.698092+0000","last_became_peered":"2024-03-23T23:42:40.698092+0000","last_unstale":"2024-03-23T23:58:27.700527+0000","last_undegraded":"2024-03-23T23:58:27.700527+0000","last_fullsized":"2024-03-23T23:58:27.700527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4914,"log_dups_size":0,"ondisk_log_size":4914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:00:33.261296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73128,"num_write_kb":826128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"27'4584","reported_seq":4607,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.450331+0000","last_change":"2024-03-23T23:42:50.753000+0000","last_active":"2024-03-23T23:58:30.450331+0000","last_peered":"2024-03-23T23:58:30.450331+0000","last_clean":"2024-03-23T23:58:30.450331+0000","last_became_active":"2024-03-23T23:42:50.752614+0000","last_became_peered":"2024-03-23T23:42:50.752614+0000","last_unstale":"2024-03-23T23:58:30.450331+0000","last_undegraded":"2024-03-23T23:58:30.450331+0000","last_fullsized":"2024-03-23T23:58:30.450331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4584,"log_dups_size":0,"ondisk_log_size":4584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67913,"num_write_kb":776364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"27'4451","reported_seq":4482,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.674349+0000","last_change":"2024-03-23T23:42:40.700631+0000","last_active":"2024-03-23T23:58:27.674349+0000","last_peered":"2024-03-23T23:58:27.674349+0000","last_clean":"2024-03-23T23:58:27.674349+0000","last_became_active":"2024-03-23T23:42:40.697932+0000","last_became_peered":"2024-03-23T23:42:40.697932+0000","last_unstale":"2024-03-23T23:58:27.674349+0000","last_undegraded":"2024-03-23T23:58:27.674349+0000","last_fullsized":"2024-03-23T23:58:27.674349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4451,"log_dups_size":0,"ondisk_log_size":4451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:05:17.694245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66105,"num_write_kb":808863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"27'4925","reported_seq":4948,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.419180+0000","last_change":"2024-03-23T23:42:50.765991+0000","last_active":"2024-03-23T23:58:30.419180+0000","last_peered":"2024-03-23T23:58:30.419180+0000","last_clean":"2024-03-23T23:58:30.419180+0000","last_became_active":"2024-03-23T23:42:50.765716+0000","last_became_peered":"2024-03-23T23:42:50.765716+0000","last_unstale":"2024-03-23T23:58:30.419180+0000","last_undegraded":"2024-03-23T23:58:30.419180+0000","last_fullsized":"2024-03-23T23:58:30.419180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4925,"log_dups_size":0,"ondisk_log_size":4925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72768,"num_write_kb":776524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'5362","reported_seq":5394,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.650030+0000","last_change":"2024-03-23T23:42:40.683983+0000","last_active":"2024-03-23T23:58:27.650030+0000","last_peered":"2024-03-23T23:58:27.650030+0000","last_clean":"2024-03-23T23:58:27.650030+0000","last_became_active":"2024-03-23T23:42:40.683711+0000","last_became_peered":"2024-03-23T23:42:40.683711+0000","last_unstale":"2024-03-23T23:58:27.650030+0000","last_undegraded":"2024-03-23T23:58:27.650030+0000","last_fullsized":"2024-03-23T23:58:27.650030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5362,"log_dups_size":0,"ondisk_log_size":5362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79587,"num_write_kb":960150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"27'5558","reported_seq":5580,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.493028+0000","last_change":"2024-03-23T23:42:50.766544+0000","last_active":"2024-03-23T23:58:30.493028+0000","last_peered":"2024-03-23T23:58:30.493028+0000","last_clean":"2024-03-23T23:58:30.493028+0000","last_became_active":"2024-03-23T23:42:50.766328+0000","last_became_peered":"2024-03-23T23:42:50.766328+0000","last_unstale":"2024-03-23T23:58:30.493028+0000","last_undegraded":"2024-03-23T23:58:30.493028+0000","last_fullsized":"2024-03-23T23:58:30.493028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5558,"log_dups_size":0,"ondisk_log_size":5558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:28:43.677331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82850,"num_write_kb":926357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"27'6244","reported_seq":6276,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.659238+0000","last_change":"2024-03-23T23:42:40.678622+0000","last_active":"2024-03-23T23:58:27.659238+0000","last_peered":"2024-03-23T23:58:27.659238+0000","last_clean":"2024-03-23T23:58:27.659238+0000","last_became_active":"2024-03-23T23:42:40.678325+0000","last_became_peered":"2024-03-23T23:42:40.678325+0000","last_unstale":"2024-03-23T23:58:27.659238+0000","last_undegraded":"2024-03-23T23:58:27.659238+0000","last_fullsized":"2024-03-23T23:58:27.659238+0000","mapping_epoch":19,"log_start":"27'500","ondisk_log_start":"27'500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5744,"log_dups_size":0,"ondisk_log_size":5744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92992,"num_write_kb":1109347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"27'5529","reported_seq":5551,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.425297+0000","last_change":"2024-03-23T23:42:50.750690+0000","last_active":"2024-03-23T23:58:30.425297+0000","last_peered":"2024-03-23T23:58:30.425297+0000","last_clean":"2024-03-23T23:58:30.425297+0000","last_became_active":"2024-03-23T23:42:50.750466+0000","last_became_peered":"2024-03-23T23:42:50.750466+0000","last_unstale":"2024-03-23T23:58:30.425297+0000","last_undegraded":"2024-03-23T23:58:30.425297+0000","last_fullsized":"2024-03-23T23:58:30.425297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5529,"log_dups_size":0,"ondisk_log_size":5529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:13:07.156401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82257,"num_write_kb":938007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"27'4808","reported_seq":4839,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.750839+0000","last_change":"2024-03-23T23:42:40.701959+0000","last_active":"2024-03-23T23:58:27.750839+0000","last_peered":"2024-03-23T23:58:27.750839+0000","last_clean":"2024-03-23T23:58:27.750839+0000","last_became_active":"2024-03-23T23:42:40.700855+0000","last_became_peered":"2024-03-23T23:42:40.700855+0000","last_unstale":"2024-03-23T23:58:27.750839+0000","last_undegraded":"2024-03-23T23:58:27.750839+0000","last_fullsized":"2024-03-23T23:58:27.750839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4808,"log_dups_size":0,"ondisk_log_size":4808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:49:42.009983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71971,"num_write_kb":878476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":4985198,"num_write_kb":56700971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":327294,"ondisk_log_size":327294,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":98084592,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":31,"num_read_kb":105,"num_write":4491,"num_write_kb":97550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":196231168,"data_stored":196169184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4215,"ondisk_log_size":4215,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":11,"num_write":4962178,"num_write_kb":59383104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326587,"ondisk_log_size":326587,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":93601894,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":44,"num_read_kb":115,"num_write":4044,"num_write_kb":93019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":187269120,"data_stored":187203788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3815,"ondisk_log_size":3815,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509635,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":612204,"kb_used_data":49444,"kb_used_omap":1,"kb_used_meta":562750,"kb_avail":93759636,"statfs":{"total":96636764160,"available":96009867264,"internally_reserved":0,"allocated":50630656,"data_stored":50448059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":576256454},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509631,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":889852,"kb_used_data":37236,"kb_used_omap":1,"kb_used_meta":852606,"kb_avail":93481988,"statfs":{"total":96636764160,"available":95725555712,"internally_reserved":0,"allocated":38129664,"data_stored":37949267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":873068997},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509630,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":997916,"kb_used_data":67412,"kb_used_omap":1,"kb_used_meta":930494,"kb_avail":93373924,"statfs":{"total":96636764160,"available":95614898176,"internally_reserved":0,"allocated":69029888,"data_stored":68838347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":952826309},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509632,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":977820,"kb_used_data":56340,"kb_used_omap":1,"kb_used_meta":921470,"kb_avail":93394020,"statfs":{"total":96636764160,"available":95635476480,"internally_reserved":0,"allocated":57692160,"data_stored":57497661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":943585735},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542334,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":916712,"kb_used_data":58208,"kb_used_omap":1,"kb_used_meta":858494,"kb_avail":93455128,"statfs":{"total":96636764160,"available":95698051072,"internally_reserved":0,"allocated":59604992,"data_stored":59426419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":879098314},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542339,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":575412,"kb_used_data":12652,"kb_used_omap":1,"kb_used_meta":562750,"kb_avail":93796428,"statfs":{"total":96636764160,"available":96047542272,"internally_reserved":0,"allocated":12955648,"data_stored":12782666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":576256453},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542338,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":775792,"kb_used_data":62952,"kb_used_omap":1,"kb_used_meta":712830,"kb_avail":93596048,"statfs":{"total":96636764160,"available":95842353152,"internally_reserved":0,"allocated":64462848,"data_stored":64271712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":729938373},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542337,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":736108,"kb_used_data":33636,"kb_used_omap":1,"kb_used_meta":702462,"kb_avail":93635732,"statfs":{"total":96636764160,"available":95882989568,"internally_reserved":0,"allocated":34443264,"data_stored":34260561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":719321541},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25178112,"data_stored":25166462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22224896,"data_stored":22212855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4280320,"data_stored":4278865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18116608,"data_stored":18103624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":33566720,"data_stored":33554558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20971610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20979712,"data_stored":20972192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":41947136,"data_stored":41943622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41955328,"data_stored":41943734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8392704,"data_stored":8388678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":39292928,"data_stored":39278914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":35180544,"data_stored":35168666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16871424,"data_stored":16862534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29368320,"data_stored":29360744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16777306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T23:58:38.550 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.550 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-03-23T23:42:38.646910+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=38, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.550 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.550 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-03-23T23:42:48.705566+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=48, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.550 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.550 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-03-23T23:42:38.646910+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=38, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.551 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-03-23T23:42:48.705566+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=48, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.551 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.551 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-03-23T23:42:38.646910+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=38, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.551 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.551 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-03-23T23:42:48.705566+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=48, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.551 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.551 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-03-23T23:42:38.646910+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=38, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.551 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.551 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-03-23T23:42:48.705566+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=48, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.551 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.552 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.552 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-03-23T23:42:38.646910+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=38, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.552 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-03-23T23:42:48.705566+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=48, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.552 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.552 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.552 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-03-23T23:42:38.646910+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=38, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.552 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-03-23T23:42:48.705566+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=48, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.552 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.552 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.553 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-03-23T23:42:38.646910+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=38, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.553 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-03-23T23:42:48.705566+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=48, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.553 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.553 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.553 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-03-23T23:42:38.646910+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=38, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.553 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-03-23T23:42:48.705566+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=48, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.553 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.553 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.553 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-03-23T23:42:38.646910+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=38, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.553 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-03-23T23:42:48.705566+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=48, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.554 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.554 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.554 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-03-23T23:42:38.646910+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=38, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.554 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-03-23T23:42:48.705566+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=48, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.554 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.554 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.554 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-23T23:42:38.646910+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=38, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.554 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-03-23T23:42:48.705566+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=48, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.554 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.555 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.555 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-03-23T23:42:38.646910+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=38, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.555 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.555 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.555 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-23T23:42:38.646910+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=38, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.555 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-03-23T23:42:48.705566+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=48, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.555 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.555 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.555 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-03-23T23:42:38.646910+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=38, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.556 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-03-23T23:42:48.705566+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=48, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.556 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.556 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.556 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-23T23:42:38.646910+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=38, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.556 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.556 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.556 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-03-23T23:42:38.646910+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=38, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.556 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-23T23:42:26.509742+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=26, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.556 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-23T23:42:48.705566+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=48, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.557 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.557 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.557 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-03-23T23:42:38.646910+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=38, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.557 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-03-23T23:42:48.705566+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=48, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.557 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.557 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.557 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-03-23T23:42:38.646910+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=38, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.557 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-03-23T23:42:48.705566+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=48, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.557 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.558 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.558 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-03-23T23:42:38.646910+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=38, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.558 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-03-23T23:42:48.705566+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=48, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.558 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.558 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-03-23T23:42:38.646910+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=38, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.558 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-03-23T23:42:48.705566+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=48, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.558 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.558 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.559 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-03-23T23:42:38.646910+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=38, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.559 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-03-23T23:42:48.705566+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=48, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.559 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.559 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.559 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-03-23T23:42:38.646910+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=38, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.559 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.559 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.559 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-03-23T23:42:38.646910+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=38, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.560 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-03-23T23:42:48.705566+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=48, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.560 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.560 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.560 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-03-23T23:42:38.646910+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=38, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.560 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-23T23:42:48.705566+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=48, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.560 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.560 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.560 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-03-23T23:42:38.646910+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=38, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.561 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.561 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.561 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-03-23T23:42:38.646910+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=38, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.561 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-03-23T23:42:48.705566+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=48, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.561 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.561 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.561 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-03-23T23:42:38.646910+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=38, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.561 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-03-23T23:42:48.705566+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=48, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.562 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.562 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.562 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-03-23T23:42:38.646910+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=38, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.562 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.562 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-03-23T23:42:48.705566+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=48, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.562 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.562 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-03-23T23:42:38.646910+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=38, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.563 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.563 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-03-23T23:42:48.705566+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=48, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.563 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.563 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-03-23T23:42:38.646910+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=38, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.563 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.563 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-03-23T23:42:38.646910+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=38, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.563 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.563 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-03-23T23:42:48.705566+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=48, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.564 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.564 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-03-23T23:42:38.646910+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=38, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.564 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.564 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-03-23T23:42:48.705566+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=48, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.564 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.564 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.565 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.565 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.565 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.565 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.565 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.565 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.565 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.565 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.566 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.566 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.566 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.566 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.566 INFO:tasks.ceph:pgid 5.21 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.566 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.566 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.566 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.567 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.567 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.567 INFO:tasks.ceph:pgid 5.2c last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.567 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.567 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.567 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.567 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.567 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.568 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.568 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.568 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.568 INFO:tasks.ceph:pgid 5.29 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.568 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.568 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.568 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.568 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.569 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.569 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.569 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.569 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.569 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.569 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.569 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.569 INFO:tasks.ceph:pgid 5.33 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.570 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.570 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.570 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.570 INFO:tasks.ceph:pgid 5.31 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.570 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.570 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.570 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.570 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.571 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.571 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.571 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.571 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.571 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.571 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.571 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.571 INFO:tasks.ceph:pgid 5.3b last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.571 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.571 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.572 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.572 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.572 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:38.572 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-23T23:58:47.577 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:58:47.580 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:58:58.573 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T23:58:58.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.726+0000 7ff268e00640 1 Processor -- start 2024-03-23T23:58:58.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.726+0000 7ff268e00640 1 -- start start 2024-03-23T23:58:58.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.726+0000 7ff268e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff264156ee0 0x7ff264073230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:58.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.726+0000 7ff268e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff2640ac270 0x7ff2640ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:58.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.726+0000 7ff268e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff264073770 con 0x7ff264149bd0 2024-03-23T23:58:58.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.726+0000 7ff268e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2640aa390 con 0x7ff2640ac270 2024-03-23T23:58:58.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.726+0000 7ff268e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26406e720 con 0x7ff264156ee0 2024-03-23T23:58:58.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.726+0000 7ff262800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff2640ac270 0x7ff2640ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:58.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.726+0000 7ff262800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff2640ac270 0x7ff2640ac6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38078/0 (socket says 172.21.15.8:38078) 2024-03-23T23:58:58.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.726+0000 7ff262800640 1 -- 172.21.15.8:0/568955403 learned_addr learned my addr 172.21.15.8:0/568955403 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:58.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.726+0000 7ff261400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff264149bd0 0x7ff26414a030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:59964/0 (socket says 172.21.15.8:59964) 2024-03-23T23:58:58.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.726+0000 7ff261e00640 1 --2- 172.21.15.8:0/568955403 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff264156ee0 0x7ff264073230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:58.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.726+0000 7ff262800640 1 -- 172.21.15.8:0/568955403 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff264156ee0 msgr2=0x7ff264073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:58.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.726+0000 7ff262800640 1 --2- 172.21.15.8:0/568955403 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff264156ee0 0x7ff264073230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:58.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.726+0000 7ff262800640 1 -- 172.21.15.8:0/568955403 >> v1:172.21.15.8:6789/0 conn(0x7ff264149bd0 legacy=0x7ff26414a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:58.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.726+0000 7ff262800640 1 -- 172.21.15.8:0/568955403 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26406ea00 con 0x7ff2640ac270 2024-03-23T23:58:58.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.726+0000 7ff260a00640 1 -- 172.21.15.8:0/568955403 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 482269036 0 0) 0x7ff264073770 con 0x7ff264149bd0 2024-03-23T23:58:58.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.730+0000 7ff262800640 1 --2- 172.21.15.8:0/568955403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2640ac270 0x7ff2640ac6e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff25c009e50 tx=0x7ff25c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea03252940f07b06 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:58.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.730+0000 7ff260a00640 1 -- 172.21.15.8:0/568955403 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c0a5830 con 0x7ff2640ac270 2024-03-23T23:58:58.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.730+0000 7ff260a00640 1 -- 172.21.15.8:0/568955403 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25c0a59d0 con 0x7ff2640ac270 2024-03-23T23:58:58.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.730+0000 7ff260a00640 1 -- 172.21.15.8:0/568955403 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c0a5da0 con 0x7ff2640ac270 2024-03-23T23:58:58.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.730+0000 7ff268e00640 1 -- 172.21.15.8:0/568955403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2640ac270 msgr2=0x7ff2640ac6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:58.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.730+0000 7ff268e00640 1 --2- 172.21.15.8:0/568955403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2640ac270 0x7ff2640ac6e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff25c009e50 tx=0x7ff25c01c970 comp rx=0 tx=0).stop 2024-03-23T23:58:58.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.730+0000 7ff268e00640 1 -- 172.21.15.8:0/568955403 shutdown_connections 2024-03-23T23:58:58.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.730+0000 7ff268e00640 1 --2- 172.21.15.8:0/568955403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2640ac270 0x7ff2640ac6e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:58.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.730+0000 7ff268e00640 1 --2- 172.21.15.8:0/568955403 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff264156ee0 0x7ff264073230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:58.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.730+0000 7ff268e00640 1 -- 172.21.15.8:0/568955403 >> 172.21.15.8:0/568955403 conn(0x7ff26406b170 msgr2=0x7ff26406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:58.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.730+0000 7ff268e00640 1 -- 172.21.15.8:0/568955403 shutdown_connections 2024-03-23T23:58:58.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.730+0000 7ff268e00640 1 -- 172.21.15.8:0/568955403 wait complete. 2024-03-23T23:58:58.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.730+0000 7ff268e00640 1 Processor -- start 2024-03-23T23:58:58.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.734+0000 7ff268e00640 1 -- start start 2024-03-23T23:58:58.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.734+0000 7ff268e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2640ac270 0x7ff2641439a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:58.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.734+0000 7ff268e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff264149bd0 0x7ff26414f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:58.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.734+0000 7ff268e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff264156ee0 0x7ff26414c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:58.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.734+0000 7ff268e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2641579f0 con 0x7ff2640ac270 2024-03-23T23:58:58.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.734+0000 7ff268e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff264157870 con 0x7ff264156ee0 2024-03-23T23:58:58.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.734+0000 7ff268e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2641572c0 con 0x7ff264149bd0 2024-03-23T23:58:58.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.734+0000 7ff261e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2640ac270 0x7ff2641439a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:58.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.734+0000 7ff261e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2640ac270 0x7ff2641439a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38082/0 (socket says 172.21.15.8:38082) 2024-03-23T23:58:58.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.734+0000 7ff261e00640 1 -- 172.21.15.8:0/2781046286 learned_addr learned my addr 172.21.15.8:0/2781046286 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:58:58.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.734+0000 7ff261400640 1 --2- 172.21.15.8:0/2781046286 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff264149bd0 0x7ff26414f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:58.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.734+0000 7ff262800640 1 --2- 172.21.15.8:0/2781046286 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff264156ee0 0x7ff26414c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:58.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.734+0000 7ff261e00640 1 -- 172.21.15.8:0/2781046286 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff264149bd0 msgr2=0x7ff26414f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:58.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.734+0000 7ff261e00640 1 --2- 172.21.15.8:0/2781046286 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff264149bd0 0x7ff26414f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:58.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.734+0000 7ff261e00640 1 -- 172.21.15.8:0/2781046286 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff264156ee0 msgr2=0x7ff26414c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:58.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.734+0000 7ff261e00640 1 --2- 172.21.15.8:0/2781046286 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff264156ee0 0x7ff26414c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:58.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.734+0000 7ff261e00640 1 -- 172.21.15.8:0/2781046286 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26414e430 con 0x7ff2640ac270 2024-03-23T23:58:58.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.734+0000 7ff261e00640 1 --2- 172.21.15.8:0/2781046286 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2640ac270 0x7ff2641439a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff25400e960 tx=0x7ff25400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:58.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.734+0000 7ff25a000640 1 -- 172.21.15.8:0/2781046286 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff254017070 con 0x7ff2640ac270 2024-03-23T23:58:58.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.734+0000 7ff25a000640 1 -- 172.21.15.8:0/2781046286 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25400c9a0 con 0x7ff2640ac270 2024-03-23T23:58:58.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.734+0000 7ff268e00640 1 -- 172.21.15.8:0/2781046286 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff26414e710 con 0x7ff2640ac270 2024-03-23T23:58:58.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.734+0000 7ff25a000640 1 -- 172.21.15.8:0/2781046286 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25400cd50 con 0x7ff2640ac270 2024-03-23T23:58:58.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.734+0000 7ff268e00640 1 -- 172.21.15.8:0/2781046286 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff264151590 con 0x7ff2640ac270 2024-03-23T23:58:58.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.734+0000 7ff268e00640 1 -- 172.21.15.8:0/2781046286 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff264068270 con 0x7ff2640ac270 2024-03-23T23:58:58.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.738+0000 7ff25a000640 1 -- 172.21.15.8:0/2781046286 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff25401a070 con 0x7ff2640ac270 2024-03-23T23:58:58.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.738+0000 7ff25a000640 1 --2- 172.21.15.8:0/2781046286 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff244067660 0x7ff244069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:58.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.738+0000 7ff25a000640 1 -- 172.21.15.8:0/2781046286 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7ff254085f80 con 0x7ff2640ac270 2024-03-23T23:58:58.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.738+0000 7ff261400640 1 --2- 172.21.15.8:0/2781046286 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff244067660 0x7ff244069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:58.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.738+0000 7ff261400640 1 --2- 172.21.15.8:0/2781046286 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff244067660 0x7ff244069b20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff2641529f0 tx=0x7ff250007df0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:58.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.742+0000 7ff25a000640 1 -- 172.21.15.8:0/2781046286 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7ff2540561e0 con 0x7ff2640ac270 2024-03-23T23:58:58.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.902+0000 7ff268e00640 1 -- 172.21.15.8:0/2781046286 --> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff264068980 con 0x7ff244067660 2024-03-23T23:58:58.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.914+0000 7ff25a000640 1 -- 172.21.15.8:0/2781046286 <== mgr.4098 v2:172.21.15.196:6832/1295060067 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+493677 (secure 0 0 0) 0x7ff264068980 con 0x7ff244067660 2024-03-23T23:58:58.922 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:58:58.925 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-03-23T23:58:58.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.922+0000 7ff268e00640 1 -- 172.21.15.8:0/2781046286 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff244067660 msgr2=0x7ff244069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:58.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.922+0000 7ff268e00640 1 --2- 172.21.15.8:0/2781046286 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff244067660 0x7ff244069b20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff2641529f0 tx=0x7ff250007df0 comp rx=0 tx=0).stop 2024-03-23T23:58:58.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.922+0000 7ff268e00640 1 -- 172.21.15.8:0/2781046286 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2640ac270 msgr2=0x7ff2641439a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:58.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.922+0000 7ff268e00640 1 --2- 172.21.15.8:0/2781046286 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2640ac270 0x7ff2641439a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff25400e960 tx=0x7ff25400ee20 comp rx=0 tx=0).stop 2024-03-23T23:58:58.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.922+0000 7ff268e00640 1 -- 172.21.15.8:0/2781046286 shutdown_connections 2024-03-23T23:58:58.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.922+0000 7ff268e00640 1 --2- 172.21.15.8:0/2781046286 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff264156ee0 0x7ff26414c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:58.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.922+0000 7ff268e00640 1 --2- 172.21.15.8:0/2781046286 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ff244067660 0x7ff244069b20 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:58.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.922+0000 7ff268e00640 1 --2- 172.21.15.8:0/2781046286 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff264149bd0 0x7ff26414f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:58.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.922+0000 7ff268e00640 1 --2- 172.21.15.8:0/2781046286 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2640ac270 0x7ff2641439a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:58.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.922+0000 7ff268e00640 1 -- 172.21.15.8:0/2781046286 >> 172.21.15.8:0/2781046286 conn(0x7ff26406b170 msgr2=0x7ff264073230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:58.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.922+0000 7ff268e00640 1 -- 172.21.15.8:0/2781046286 shutdown_connections 2024-03-23T23:58:58.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:58:58.922+0000 7ff268e00640 1 -- 172.21.15.8:0/2781046286 wait complete. 2024-03-23T23:58:58.941 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":515,"stamp":"2024-03-23T23:58:57.732691+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":192276854,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":195,"num_read_kb":347,"num_write":9956070,"num_write_kb":116277060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":662113,"ondisk_log_size":662113,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":6485976,"kb_used_data":377880,"kb_used_omap":12,"kb_used_meta":6108019,"kb_avail":748488744,"statfs":{"total":773094113280,"available":766452473856,"internally_reserved":0,"allocated":386949120,"data_stored":385474692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":6254612016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002528"},"pg_stats":[{"pgid":"5.18","version":"27'5452","reported_seq":5483,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:51.769602+0000","last_change":"2024-03-23T23:58:51.769625+0000","last_active":"2024-03-23T23:58:51.769602+0000","last_peered":"2024-03-23T23:58:51.769602+0000","last_clean":"2024-03-23T23:58:51.769602+0000","last_became_active":"2024-03-23T23:42:50.735940+0000","last_became_peered":"2024-03-23T23:42:50.735940+0000","last_unstale":"2024-03-23T23:58:51.769602+0000","last_undegraded":"2024-03-23T23:58:51.769602+0000","last_fullsized":"2024-03-23T23:58:51.769602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5452","last_scrub_stamp":"2024-03-23T23:58:51.769514+0000","last_deep_scrub":"27'5452","last_deep_scrub_stamp":"2024-03-23T23:58:51.769514+0000","last_clean_scrub_stamp":"2024-03-23T23:58:51.769514+0000","objects_scrubbed":0,"log_size":5452,"log_dups_size":0,"ondisk_log_size":5452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:22:28.423448+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80864,"num_write_kb":923838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"27'60","reported_seq":102,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:40.232981+0000","last_change":"2024-03-23T23:58:40.233055+0000","last_active":"2024-03-23T23:58:40.232981+0000","last_peered":"2024-03-23T23:58:40.232981+0000","last_clean":"2024-03-23T23:58:40.232981+0000","last_became_active":"2024-03-23T23:42:39.693636+0000","last_became_peered":"2024-03-23T23:42:39.693636+0000","last_unstale":"2024-03-23T23:58:40.232981+0000","last_undegraded":"2024-03-23T23:58:40.232981+0000","last_fullsized":"2024-03-23T23:58:40.232981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'60","last_scrub_stamp":"2024-03-23T23:58:40.232901+0000","last_deep_scrub":"27'60","last_deep_scrub_stamp":"2024-03-23T23:58:40.232901+0000","last_clean_scrub_stamp":"2024-03-23T23:58:40.232901+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:43:13.310561+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'5384","reported_seq":5424,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:45.476601+0000","last_change":"2024-03-23T23:58:45.476622+0000","last_active":"2024-03-23T23:58:45.476601+0000","last_peered":"2024-03-23T23:58:45.476601+0000","last_clean":"2024-03-23T23:58:45.476601+0000","last_became_active":"2024-03-23T23:42:40.682755+0000","last_became_peered":"2024-03-23T23:42:40.682755+0000","last_unstale":"2024-03-23T23:58:45.476601+0000","last_undegraded":"2024-03-23T23:58:45.476601+0000","last_fullsized":"2024-03-23T23:58:45.476601+0000","mapping_epoch":19,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5384","last_scrub_stamp":"2024-03-23T23:58:45.476539+0000","last_deep_scrub":"27'5384","last_deep_scrub_stamp":"2024-03-23T23:58:45.476539+0000","last_clean_scrub_stamp":"2024-03-23T23:58:45.476539+0000","objects_scrubbed":0,"log_size":5284,"log_dups_size":0,"ondisk_log_size":5284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:08:51.662878+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79922,"num_write_kb":951101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'4","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:42.361029+0000","last_change":"2024-03-23T23:58:42.361077+0000","last_active":"2024-03-23T23:58:42.361029+0000","last_peered":"2024-03-23T23:58:42.361029+0000","last_clean":"2024-03-23T23:58:42.361029+0000","last_became_active":"2024-03-23T23:42:49.749634+0000","last_became_peered":"2024-03-23T23:42:49.749634+0000","last_unstale":"2024-03-23T23:58:42.361029+0000","last_undegraded":"2024-03-23T23:58:42.361029+0000","last_fullsized":"2024-03-23T23:58:42.361029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-03-23T23:58:42.360946+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-03-23T23:58:42.360946+0000","last_clean_scrub_stamp":"2024-03-23T23:58:42.360946+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:22:19.014880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"27'6028","reported_seq":6059,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:55.347466+0000","last_change":"2024-03-23T23:58:55.347510+0000","last_active":"2024-03-23T23:58:55.347466+0000","last_peered":"2024-03-23T23:58:55.347466+0000","last_clean":"2024-03-23T23:58:55.347466+0000","last_became_active":"2024-03-23T23:42:50.752078+0000","last_became_peered":"2024-03-23T23:42:50.752078+0000","last_unstale":"2024-03-23T23:58:55.347466+0000","last_undegraded":"2024-03-23T23:58:55.347466+0000","last_fullsized":"2024-03-23T23:58:55.347466+0000","mapping_epoch":23,"log_start":"27'300","ondisk_log_start":"27'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6028","last_scrub_stamp":"2024-03-23T23:58:55.347364+0000","last_deep_scrub":"27'6028","last_deep_scrub_stamp":"2024-03-23T23:58:55.347364+0000","last_clean_scrub_stamp":"2024-03-23T23:58:55.347364+0000","objects_scrubbed":0,"log_size":5728,"log_dups_size":0,"ondisk_log_size":5728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:06.407984+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89116,"num_write_kb":998926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"27'16","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:50.507850+0000","last_change":"2024-03-23T23:58:50.507874+0000","last_active":"2024-03-23T23:58:50.507850+0000","last_peered":"2024-03-23T23:58:50.507850+0000","last_clean":"2024-03-23T23:58:50.507850+0000","last_became_active":"2024-03-23T23:42:39.686875+0000","last_became_peered":"2024-03-23T23:42:39.686875+0000","last_unstale":"2024-03-23T23:58:50.507850+0000","last_undegraded":"2024-03-23T23:58:50.507850+0000","last_fullsized":"2024-03-23T23:58:50.507850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-03-23T23:58:50.507775+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-03-23T23:58:50.507775+0000","last_clean_scrub_stamp":"2024-03-23T23:58:50.507775+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:59:04.479373+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'7365","reported_seq":7405,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:34.231403+0000","last_change":"2024-03-23T23:58:34.231444+0000","last_active":"2024-03-23T23:58:34.231403+0000","last_peered":"2024-03-23T23:58:34.231403+0000","last_clean":"2024-03-23T23:58:34.231403+0000","last_became_active":"2024-03-23T23:42:40.698003+0000","last_became_peered":"2024-03-23T23:42:40.698003+0000","last_unstale":"2024-03-23T23:58:34.231403+0000","last_undegraded":"2024-03-23T23:58:34.231403+0000","last_fullsized":"2024-03-23T23:58:34.231403+0000","mapping_epoch":19,"log_start":"27'500","ondisk_log_start":"27'500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7365","last_scrub_stamp":"2024-03-23T23:58:34.231261+0000","last_deep_scrub":"27'7365","last_deep_scrub_stamp":"2024-03-23T23:58:34.231261+0000","last_clean_scrub_stamp":"2024-03-23T23:58:34.231261+0000","objects_scrubbed":0,"log_size":6865,"log_dups_size":0,"ondisk_log_size":6865,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:54:41.308919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110287,"num_write_kb":1353580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'30","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:42.653944+0000","last_change":"2024-03-23T23:58:42.653969+0000","last_active":"2024-03-23T23:58:42.653944+0000","last_peered":"2024-03-23T23:58:42.653944+0000","last_clean":"2024-03-23T23:58:42.653944+0000","last_became_active":"2024-03-23T23:42:49.728261+0000","last_became_peered":"2024-03-23T23:42:49.728261+0000","last_unstale":"2024-03-23T23:58:42.653944+0000","last_undegraded":"2024-03-23T23:58:42.653944+0000","last_fullsized":"2024-03-23T23:58:42.653944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-03-23T23:58:42.653873+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-03-23T23:58:42.653873+0000","last_clean_scrub_stamp":"2024-03-23T23:58:42.653873+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:14:11.410705+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"27'4530","reported_seq":4553,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.422097+0000","last_change":"2024-03-23T23:42:50.755852+0000","last_active":"2024-03-23T23:58:30.422097+0000","last_peered":"2024-03-23T23:58:30.422097+0000","last_clean":"2024-03-23T23:58:30.422097+0000","last_became_active":"2024-03-23T23:42:50.755600+0000","last_became_peered":"2024-03-23T23:42:50.755600+0000","last_unstale":"2024-03-23T23:58:30.422097+0000","last_undegraded":"2024-03-23T23:58:30.422097+0000","last_fullsized":"2024-03-23T23:58:30.422097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4530,"log_dups_size":0,"ondisk_log_size":4530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67405,"num_write_kb":746106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"27'64","reported_seq":105,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:56.385686+0000","last_change":"2024-03-23T23:58:56.385716+0000","last_active":"2024-03-23T23:58:56.385686+0000","last_peered":"2024-03-23T23:58:56.385686+0000","last_clean":"2024-03-23T23:58:56.385686+0000","last_became_active":"2024-03-23T23:42:39.696342+0000","last_became_peered":"2024-03-23T23:42:39.696342+0000","last_unstale":"2024-03-23T23:58:56.385686+0000","last_undegraded":"2024-03-23T23:58:56.385686+0000","last_fullsized":"2024-03-23T23:58:56.385686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'64","last_scrub_stamp":"2024-03-23T23:58:56.385601+0000","last_deep_scrub":"27'64","last_deep_scrub_stamp":"2024-03-23T23:58:56.385601+0000","last_clean_scrub_stamp":"2024-03-23T23:58:56.385601+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:50:13.005163+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":12316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'4666","reported_seq":4705,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:47.429315+0000","last_change":"2024-03-23T23:58:47.429338+0000","last_active":"2024-03-23T23:58:47.429315+0000","last_peered":"2024-03-23T23:58:47.429315+0000","last_clean":"2024-03-23T23:58:47.429315+0000","last_became_active":"2024-03-23T23:42:40.697668+0000","last_became_peered":"2024-03-23T23:42:40.697668+0000","last_unstale":"2024-03-23T23:58:47.429315+0000","last_undegraded":"2024-03-23T23:58:47.429315+0000","last_fullsized":"2024-03-23T23:58:47.429315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4666","last_scrub_stamp":"2024-03-23T23:58:47.429252+0000","last_deep_scrub":"27'4666","last_deep_scrub_stamp":"2024-03-23T23:58:47.429252+0000","last_clean_scrub_stamp":"2024-03-23T23:58:47.429252+0000","objects_scrubbed":0,"log_size":4666,"log_dups_size":0,"ondisk_log_size":4666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:46:38.084168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69534,"num_write_kb":791816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'1355","reported_seq":1388,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:37.582696+0000","last_change":"2024-03-23T23:58:37.582720+0000","last_active":"2024-03-23T23:58:37.582696+0000","last_peered":"2024-03-23T23:58:37.582696+0000","last_clean":"2024-03-23T23:58:37.582696+0000","last_became_active":"2024-03-23T23:42:49.744561+0000","last_became_peered":"2024-03-23T23:42:49.744561+0000","last_unstale":"2024-03-23T23:58:37.582696+0000","last_undegraded":"2024-03-23T23:58:37.582696+0000","last_fullsized":"2024-03-23T23:58:37.582696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1355","last_scrub_stamp":"2024-03-23T23:58:37.582624+0000","last_deep_scrub":"27'1355","last_deep_scrub_stamp":"2024-03-23T23:58:37.582624+0000","last_clean_scrub_stamp":"2024-03-23T23:58:37.582624+0000","objects_scrubbed":1,"log_size":1355,"log_dups_size":0,"ondisk_log_size":1355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:41:05.824636+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1348,"num_write_kb":4325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"27'4460","reported_seq":4483,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.439295+0000","last_change":"2024-03-23T23:42:50.755575+0000","last_active":"2024-03-23T23:58:30.439295+0000","last_peered":"2024-03-23T23:58:30.439295+0000","last_clean":"2024-03-23T23:58:30.439295+0000","last_became_active":"2024-03-23T23:42:50.755337+0000","last_became_peered":"2024-03-23T23:42:50.755337+0000","last_unstale":"2024-03-23T23:58:30.439295+0000","last_undegraded":"2024-03-23T23:58:30.439295+0000","last_fullsized":"2024-03-23T23:58:30.439295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4460,"log_dups_size":0,"ondisk_log_size":4460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65733,"num_write_kb":735312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"27'18","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:57.380321+0000","last_change":"2024-03-23T23:58:57.380347+0000","last_active":"2024-03-23T23:58:57.380321+0000","last_peered":"2024-03-23T23:58:57.380321+0000","last_clean":"2024-03-23T23:58:57.380321+0000","last_became_active":"2024-03-23T23:42:39.696401+0000","last_became_peered":"2024-03-23T23:42:39.696401+0000","last_unstale":"2024-03-23T23:58:57.380321+0000","last_undegraded":"2024-03-23T23:58:57.380321+0000","last_fullsized":"2024-03-23T23:58:57.380321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-03-23T23:58:57.380252+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-03-23T23:58:57.380252+0000","last_clean_scrub_stamp":"2024-03-23T23:58:57.380252+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:50:10.736654+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'6122","reported_seq":6161,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:45.447923+0000","last_change":"2024-03-23T23:58:45.447945+0000","last_active":"2024-03-23T23:58:45.447923+0000","last_peered":"2024-03-23T23:58:45.447923+0000","last_clean":"2024-03-23T23:58:45.447923+0000","last_became_active":"2024-03-23T23:42:40.699770+0000","last_became_peered":"2024-03-23T23:42:40.699770+0000","last_unstale":"2024-03-23T23:58:45.447923+0000","last_undegraded":"2024-03-23T23:58:45.447923+0000","last_fullsized":"2024-03-23T23:58:45.447923+0000","mapping_epoch":19,"log_start":"27'200","ondisk_log_start":"27'200","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6122","last_scrub_stamp":"2024-03-23T23:58:45.447855+0000","last_deep_scrub":"27'6122","last_deep_scrub_stamp":"2024-03-23T23:58:45.447855+0000","last_clean_scrub_stamp":"2024-03-23T23:58:45.447855+0000","objects_scrubbed":0,"log_size":5922,"log_dups_size":0,"ondisk_log_size":5922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:45:15.428468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91052,"num_write_kb":1089478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'303","reported_seq":336,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:41.609887+0000","last_change":"2024-03-23T23:58:41.609930+0000","last_active":"2024-03-23T23:58:41.609887+0000","last_peered":"2024-03-23T23:58:41.609887+0000","last_clean":"2024-03-23T23:58:41.609887+0000","last_became_active":"2024-03-23T23:42:49.745526+0000","last_became_peered":"2024-03-23T23:42:49.745526+0000","last_unstale":"2024-03-23T23:58:41.609887+0000","last_undegraded":"2024-03-23T23:58:41.609887+0000","last_fullsized":"2024-03-23T23:58:41.609887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'303","last_scrub_stamp":"2024-03-23T23:58:41.609803+0000","last_deep_scrub":"27'303","last_deep_scrub_stamp":"2024-03-23T23:58:41.609803+0000","last_clean_scrub_stamp":"2024-03-23T23:58:41.609803+0000","objects_scrubbed":2,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:20:57.141206+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5723788,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":5809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"27'5356","reported_seq":5389,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:52.412420+0000","last_change":"2024-03-23T23:58:52.412442+0000","last_active":"2024-03-23T23:58:52.412420+0000","last_peered":"2024-03-23T23:58:52.412420+0000","last_clean":"2024-03-23T23:58:52.412420+0000","last_became_active":"2024-03-23T23:42:50.746937+0000","last_became_peered":"2024-03-23T23:42:50.746937+0000","last_unstale":"2024-03-23T23:58:52.412420+0000","last_undegraded":"2024-03-23T23:58:52.412420+0000","last_fullsized":"2024-03-23T23:58:52.412420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5356","last_scrub_stamp":"2024-03-23T23:58:52.412336+0000","last_deep_scrub":"27'5356","last_deep_scrub_stamp":"2024-03-23T23:58:52.412336+0000","last_clean_scrub_stamp":"2024-03-23T23:58:52.412336+0000","objects_scrubbed":0,"log_size":5356,"log_dups_size":0,"ondisk_log_size":5356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:10:07.015574+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":11,"num_write":79434,"num_write_kb":896560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"27'5252","reported_seq":5292,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:48.850693+0000","last_change":"2024-03-23T23:58:48.850715+0000","last_active":"2024-03-23T23:58:48.850693+0000","last_peered":"2024-03-23T23:58:48.850693+0000","last_clean":"2024-03-23T23:58:48.850693+0000","last_became_active":"2024-03-23T23:42:40.682192+0000","last_became_peered":"2024-03-23T23:42:40.682192+0000","last_unstale":"2024-03-23T23:58:48.850693+0000","last_undegraded":"2024-03-23T23:58:48.850693+0000","last_fullsized":"2024-03-23T23:58:48.850693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5252","last_scrub_stamp":"2024-03-23T23:58:48.850609+0000","last_deep_scrub":"27'5252","last_deep_scrub_stamp":"2024-03-23T23:58:48.850609+0000","last_clean_scrub_stamp":"2024-03-23T23:58:48.850609+0000","objects_scrubbed":0,"log_size":5252,"log_dups_size":0,"ondisk_log_size":5252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:34:57.930384+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78193,"num_write_kb":930302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'12","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:55.349754+0000","last_change":"2024-03-23T23:58:55.349780+0000","last_active":"2024-03-23T23:58:55.349754+0000","last_peered":"2024-03-23T23:58:55.349754+0000","last_clean":"2024-03-23T23:58:55.349754+0000","last_became_active":"2024-03-23T23:42:39.696207+0000","last_became_peered":"2024-03-23T23:42:39.696207+0000","last_unstale":"2024-03-23T23:58:55.349754+0000","last_undegraded":"2024-03-23T23:58:55.349754+0000","last_fullsized":"2024-03-23T23:58:55.349754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-03-23T23:58:55.349684+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-03-23T23:58:55.349684+0000","last_clean_scrub_stamp":"2024-03-23T23:58:55.349684+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:37:14.884832+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'12","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:38.609798+0000","last_change":"2024-03-23T23:58:38.609798+0000","last_active":"2024-03-23T23:58:38.609798+0000","last_peered":"2024-03-23T23:58:38.609798+0000","last_clean":"2024-03-23T23:58:38.609798+0000","last_became_active":"2024-03-23T23:42:49.733888+0000","last_became_peered":"2024-03-23T23:42:49.733888+0000","last_unstale":"2024-03-23T23:58:38.609798+0000","last_undegraded":"2024-03-23T23:58:38.609798+0000","last_fullsized":"2024-03-23T23:58:38.609798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-03-23T23:58:38.609713+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-03-23T23:58:38.609713+0000","last_clean_scrub_stamp":"2024-03-23T23:58:38.609713+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:20:37.674610+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"27'5594","reported_seq":5626,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:49.087623+0000","last_change":"2024-03-23T23:58:49.087645+0000","last_active":"2024-03-23T23:58:49.087623+0000","last_peered":"2024-03-23T23:58:49.087623+0000","last_clean":"2024-03-23T23:58:49.087623+0000","last_became_active":"2024-03-23T23:42:50.758670+0000","last_became_peered":"2024-03-23T23:42:50.758670+0000","last_unstale":"2024-03-23T23:58:49.087623+0000","last_undegraded":"2024-03-23T23:58:49.087623+0000","last_fullsized":"2024-03-23T23:58:49.087623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5594","last_scrub_stamp":"2024-03-23T23:58:49.087542+0000","last_deep_scrub":"27'5594","last_deep_scrub_stamp":"2024-03-23T23:58:49.087542+0000","last_clean_scrub_stamp":"2024-03-23T23:58:49.087542+0000","objects_scrubbed":0,"log_size":5594,"log_dups_size":0,"ondisk_log_size":5594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:32:25.916600+0000","scrub_duration":71,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82815,"num_write_kb":936767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"27'4462","reported_seq":4502,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:53.480041+0000","last_change":"2024-03-23T23:58:53.480063+0000","last_active":"2024-03-23T23:58:53.480041+0000","last_peered":"2024-03-23T23:58:53.480041+0000","last_clean":"2024-03-23T23:58:53.480041+0000","last_became_active":"2024-03-23T23:42:40.674293+0000","last_became_peered":"2024-03-23T23:42:40.674293+0000","last_unstale":"2024-03-23T23:58:53.480041+0000","last_undegraded":"2024-03-23T23:58:53.480041+0000","last_fullsized":"2024-03-23T23:58:53.480041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4462","last_scrub_stamp":"2024-03-23T23:58:53.479957+0000","last_deep_scrub":"27'4462","last_deep_scrub_stamp":"2024-03-23T23:58:53.479957+0000","last_clean_scrub_stamp":"2024-03-23T23:58:53.479957+0000","objects_scrubbed":0,"log_size":4462,"log_dups_size":0,"ondisk_log_size":4462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:40:22.270113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66336,"num_write_kb":780596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'216","reported_seq":258,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:46.310891+0000","last_change":"2024-03-23T23:58:46.310915+0000","last_active":"2024-03-23T23:58:46.310891+0000","last_peered":"2024-03-23T23:58:46.310891+0000","last_clean":"2024-03-23T23:58:46.310891+0000","last_became_active":"2024-03-23T23:42:39.680121+0000","last_became_peered":"2024-03-23T23:42:39.680121+0000","last_unstale":"2024-03-23T23:58:46.310891+0000","last_undegraded":"2024-03-23T23:58:46.310891+0000","last_fullsized":"2024-03-23T23:58:46.310891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'216","last_scrub_stamp":"2024-03-23T23:58:46.310827+0000","last_deep_scrub":"27'216","last_deep_scrub_stamp":"2024-03-23T23:58:46.310827+0000","last_clean_scrub_stamp":"2024-03-23T23:58:46.310827+0000","objects_scrubbed":1,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:15:45.169690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1241175,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":1371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:39.573568+0000","last_change":"2024-03-23T23:58:39.573588+0000","last_active":"2024-03-23T23:58:39.573568+0000","last_peered":"2024-03-23T23:58:39.573568+0000","last_clean":"2024-03-23T23:58:39.573568+0000","last_became_active":"2024-03-23T23:42:49.744742+0000","last_became_peered":"2024-03-23T23:42:49.744742+0000","last_unstale":"2024-03-23T23:58:39.573568+0000","last_undegraded":"2024-03-23T23:58:39.573568+0000","last_fullsized":"2024-03-23T23:58:39.573568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-03-23T23:58:39.573497+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-03-23T23:58:39.573497+0000","last_clean_scrub_stamp":"2024-03-23T23:58:39.573497+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:51:20.196752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"27'4313","reported_seq":4337,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:36.378846+0000","last_change":"2024-03-23T23:42:50.749792+0000","last_active":"2024-03-23T23:58:36.378846+0000","last_peered":"2024-03-23T23:58:36.378846+0000","last_clean":"2024-03-23T23:58:36.378846+0000","last_became_active":"2024-03-23T23:42:50.749491+0000","last_became_peered":"2024-03-23T23:42:50.749491+0000","last_unstale":"2024-03-23T23:58:36.378846+0000","last_undegraded":"2024-03-23T23:58:36.378846+0000","last_fullsized":"2024-03-23T23:58:36.378846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4313,"log_dups_size":0,"ondisk_log_size":4313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64025,"num_write_kb":713675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'4688","reported_seq":4728,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:56.521006+0000","last_change":"2024-03-23T23:58:56.521026+0000","last_active":"2024-03-23T23:58:56.521006+0000","last_peered":"2024-03-23T23:58:56.521006+0000","last_clean":"2024-03-23T23:58:56.521006+0000","last_became_active":"2024-03-23T23:42:40.682672+0000","last_became_peered":"2024-03-23T23:42:40.682672+0000","last_unstale":"2024-03-23T23:58:56.521006+0000","last_undegraded":"2024-03-23T23:58:56.521006+0000","last_fullsized":"2024-03-23T23:58:56.521006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4688","last_scrub_stamp":"2024-03-23T23:58:56.520927+0000","last_deep_scrub":"27'4688","last_deep_scrub_stamp":"2024-03-23T23:58:56.520927+0000","last_clean_scrub_stamp":"2024-03-23T23:58:56.520927+0000","objects_scrubbed":0,"log_size":4688,"log_dups_size":0,"ondisk_log_size":4688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:06:22.152354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69709,"num_write_kb":858998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'2","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:49.303183+0000","last_change":"2024-03-23T23:58:49.303204+0000","last_active":"2024-03-23T23:58:49.303183+0000","last_peered":"2024-03-23T23:58:49.303183+0000","last_clean":"2024-03-23T23:58:49.303183+0000","last_became_active":"2024-03-23T23:42:39.691124+0000","last_became_peered":"2024-03-23T23:42:39.691124+0000","last_unstale":"2024-03-23T23:58:49.303183+0000","last_undegraded":"2024-03-23T23:58:49.303183+0000","last_fullsized":"2024-03-23T23:58:49.303183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-03-23T23:58:49.303114+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-03-23T23:58:49.303114+0000","last_clean_scrub_stamp":"2024-03-23T23:58:49.303114+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:38:53.150639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'25","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:42.361109+0000","last_change":"2024-03-23T23:58:42.361109+0000","last_active":"2024-03-23T23:58:42.361109+0000","last_peered":"2024-03-23T23:58:42.361109+0000","last_clean":"2024-03-23T23:58:42.361109+0000","last_became_active":"2024-03-23T23:42:49.749279+0000","last_became_peered":"2024-03-23T23:42:49.749279+0000","last_unstale":"2024-03-23T23:58:42.361109+0000","last_undegraded":"2024-03-23T23:58:42.361109+0000","last_fullsized":"2024-03-23T23:58:42.361109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-03-23T23:58:42.360925+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-03-23T23:58:42.360925+0000","last_clean_scrub_stamp":"2024-03-23T23:58:42.360925+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:20:49.755080+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"27'6858","reported_seq":6882,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:37.042476+0000","last_change":"2024-03-23T23:42:50.753669+0000","last_active":"2024-03-23T23:58:37.042476+0000","last_peered":"2024-03-23T23:58:37.042476+0000","last_clean":"2024-03-23T23:58:37.042476+0000","last_became_active":"2024-03-23T23:42:50.752674+0000","last_became_peered":"2024-03-23T23:42:50.752674+0000","last_unstale":"2024-03-23T23:58:37.042476+0000","last_undegraded":"2024-03-23T23:58:37.042476+0000","last_fullsized":"2024-03-23T23:58:37.042476+0000","mapping_epoch":23,"log_start":"27'900","ondisk_log_start":"27'900","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5958,"log_dups_size":0,"ondisk_log_size":5958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101780,"num_write_kb":1163482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"27'4769","reported_seq":4809,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:48.678098+0000","last_change":"2024-03-23T23:58:48.678118+0000","last_active":"2024-03-23T23:58:48.678098+0000","last_peered":"2024-03-23T23:58:48.678098+0000","last_clean":"2024-03-23T23:58:48.678098+0000","last_became_active":"2024-03-23T23:42:40.684677+0000","last_became_peered":"2024-03-23T23:42:40.684677+0000","last_unstale":"2024-03-23T23:58:48.678098+0000","last_undegraded":"2024-03-23T23:58:48.678098+0000","last_fullsized":"2024-03-23T23:58:48.678098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4769","last_scrub_stamp":"2024-03-23T23:58:48.678032+0000","last_deep_scrub":"27'4769","last_deep_scrub_stamp":"2024-03-23T23:58:48.678032+0000","last_clean_scrub_stamp":"2024-03-23T23:58:48.678032+0000","objects_scrubbed":0,"log_size":4769,"log_dups_size":0,"ondisk_log_size":4769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:40:39.551526+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71276,"num_write_kb":829070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'21","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:54.343453+0000","last_change":"2024-03-23T23:58:54.343500+0000","last_active":"2024-03-23T23:58:54.343453+0000","last_peered":"2024-03-23T23:58:54.343453+0000","last_clean":"2024-03-23T23:58:54.343453+0000","last_became_active":"2024-03-23T23:42:39.694746+0000","last_became_peered":"2024-03-23T23:42:39.694746+0000","last_unstale":"2024-03-23T23:58:54.343453+0000","last_undegraded":"2024-03-23T23:58:54.343453+0000","last_fullsized":"2024-03-23T23:58:54.343453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2024-03-23T23:58:54.343335+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2024-03-23T23:58:54.343335+0000","last_clean_scrub_stamp":"2024-03-23T23:58:54.343335+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:00:58.284118+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'22","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:50.703721+0000","last_change":"2024-03-23T23:58:50.703748+0000","last_active":"2024-03-23T23:58:50.703721+0000","last_peered":"2024-03-23T23:58:50.703721+0000","last_clean":"2024-03-23T23:58:50.703721+0000","last_became_active":"2024-03-23T23:42:49.724009+0000","last_became_peered":"2024-03-23T23:42:49.724009+0000","last_unstale":"2024-03-23T23:58:50.703721+0000","last_undegraded":"2024-03-23T23:58:50.703721+0000","last_fullsized":"2024-03-23T23:58:50.703721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T23:58:50.703643+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T23:58:50.703643+0000","last_clean_scrub_stamp":"2024-03-23T23:58:50.703643+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:04:09.350054+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"27'4307","reported_seq":4331,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.386448+0000","last_change":"2024-03-23T23:42:50.746737+0000","last_active":"2024-03-23T23:58:30.386448+0000","last_peered":"2024-03-23T23:58:30.386448+0000","last_clean":"2024-03-23T23:58:30.386448+0000","last_became_active":"2024-03-23T23:42:50.746492+0000","last_became_peered":"2024-03-23T23:42:50.746492+0000","last_unstale":"2024-03-23T23:58:30.386448+0000","last_undegraded":"2024-03-23T23:58:30.386448+0000","last_fullsized":"2024-03-23T23:58:30.386448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4307,"log_dups_size":0,"ondisk_log_size":4307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63604,"num_write_kb":723087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"27'5742","reported_seq":5782,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:45.278212+0000","last_change":"2024-03-23T23:58:45.278272+0000","last_active":"2024-03-23T23:58:45.278212+0000","last_peered":"2024-03-23T23:58:45.278212+0000","last_clean":"2024-03-23T23:58:45.278212+0000","last_became_active":"2024-03-23T23:42:40.680744+0000","last_became_peered":"2024-03-23T23:42:40.680744+0000","last_unstale":"2024-03-23T23:58:45.278212+0000","last_undegraded":"2024-03-23T23:58:45.278212+0000","last_fullsized":"2024-03-23T23:58:45.278212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5742","last_scrub_stamp":"2024-03-23T23:58:45.278132+0000","last_deep_scrub":"27'5742","last_deep_scrub_stamp":"2024-03-23T23:58:45.278132+0000","last_clean_scrub_stamp":"2024-03-23T23:58:45.278132+0000","objects_scrubbed":0,"log_size":5742,"log_dups_size":0,"ondisk_log_size":5742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:20:52.672287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85158,"num_write_kb":1014619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'9","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:45.728479+0000","last_change":"2024-03-23T23:58:45.728504+0000","last_active":"2024-03-23T23:58:45.728479+0000","last_peered":"2024-03-23T23:58:45.728479+0000","last_clean":"2024-03-23T23:58:45.728479+0000","last_became_active":"2024-03-23T23:42:39.691519+0000","last_became_peered":"2024-03-23T23:42:39.691519+0000","last_unstale":"2024-03-23T23:58:45.728479+0000","last_undegraded":"2024-03-23T23:58:45.728479+0000","last_fullsized":"2024-03-23T23:58:45.728479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-03-23T23:58:45.728406+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-03-23T23:58:45.728406+0000","last_clean_scrub_stamp":"2024-03-23T23:58:45.728406+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:01:36.597796+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'35","reported_seq":100,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:36.520722+0000","last_change":"2024-03-23T23:58:36.520747+0000","last_active":"2024-03-23T23:58:36.520722+0000","last_peered":"2024-03-23T23:58:36.520722+0000","last_clean":"2024-03-23T23:58:36.520722+0000","last_became_active":"2024-03-23T23:42:49.733715+0000","last_became_peered":"2024-03-23T23:42:49.733715+0000","last_unstale":"2024-03-23T23:58:36.520722+0000","last_undegraded":"2024-03-23T23:58:36.520722+0000","last_fullsized":"2024-03-23T23:58:36.520722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2024-03-23T23:58:36.520662+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2024-03-23T23:58:36.520662+0000","last_clean_scrub_stamp":"2024-03-23T23:58:36.520662+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:30:35.829513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84646,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":105,"num_write":31,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"27'4491","reported_seq":4523,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:52.739786+0000","last_change":"2024-03-23T23:58:52.739825+0000","last_active":"2024-03-23T23:58:52.739786+0000","last_peered":"2024-03-23T23:58:52.739786+0000","last_clean":"2024-03-23T23:58:52.739786+0000","last_became_active":"2024-03-23T23:42:50.739706+0000","last_became_peered":"2024-03-23T23:42:50.739706+0000","last_unstale":"2024-03-23T23:58:52.739786+0000","last_undegraded":"2024-03-23T23:58:52.739786+0000","last_fullsized":"2024-03-23T23:58:52.739786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4491","last_scrub_stamp":"2024-03-23T23:58:52.739645+0000","last_deep_scrub":"27'4491","last_deep_scrub_stamp":"2024-03-23T23:58:52.739645+0000","last_clean_scrub_stamp":"2024-03-23T23:58:52.739645+0000","objects_scrubbed":0,"log_size":4491,"log_dups_size":0,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:38:03.343494+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66952,"num_write_kb":756851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'4353","reported_seq":4379,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:51.995670+0000","last_change":"2024-03-23T23:58:51.995691+0000","last_active":"2024-03-23T23:58:51.995670+0000","last_peered":"2024-03-23T23:58:51.995670+0000","last_clean":"2024-03-23T23:58:51.995670+0000","last_became_active":"2024-03-23T23:43:22.034125+0000","last_became_peered":"2024-03-23T23:43:22.034125+0000","last_unstale":"2024-03-23T23:58:51.995670+0000","last_undegraded":"2024-03-23T23:58:51.995670+0000","last_fullsized":"2024-03-23T23:58:51.995670+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4353","last_scrub_stamp":"2024-03-23T23:58:51.995592+0000","last_deep_scrub":"27'4353","last_deep_scrub_stamp":"2024-03-23T23:58:51.995592+0000","last_clean_scrub_stamp":"2024-03-23T23:58:51.995592+0000","objects_scrubbed":0,"log_size":4353,"log_dups_size":0,"ondisk_log_size":4353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:19:48.461127+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64538,"num_write_kb":790050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"27'317","reported_seq":359,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:47.321905+0000","last_change":"2024-03-23T23:58:47.321926+0000","last_active":"2024-03-23T23:58:47.321905+0000","last_peered":"2024-03-23T23:58:47.321905+0000","last_clean":"2024-03-23T23:58:47.321905+0000","last_became_active":"2024-03-23T23:42:39.678603+0000","last_became_peered":"2024-03-23T23:42:39.678603+0000","last_unstale":"2024-03-23T23:58:47.321905+0000","last_undegraded":"2024-03-23T23:58:47.321905+0000","last_fullsized":"2024-03-23T23:58:47.321905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'317","last_scrub_stamp":"2024-03-23T23:58:47.321845+0000","last_deep_scrub":"27'317","last_deep_scrub_stamp":"2024-03-23T23:58:47.321845+0000","last_clean_scrub_stamp":"2024-03-23T23:58:47.321845+0000","objects_scrubbed":1,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:41:20.070482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":650,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'41","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:39.319063+0000","last_change":"2024-03-23T23:58:39.319087+0000","last_active":"2024-03-23T23:58:39.319063+0000","last_peered":"2024-03-23T23:58:39.319063+0000","last_clean":"2024-03-23T23:58:39.319063+0000","last_became_active":"2024-03-23T23:42:49.740290+0000","last_became_peered":"2024-03-23T23:42:49.740290+0000","last_unstale":"2024-03-23T23:58:39.319063+0000","last_undegraded":"2024-03-23T23:58:39.319063+0000","last_fullsized":"2024-03-23T23:58:39.319063+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'41","last_scrub_stamp":"2024-03-23T23:58:39.319007+0000","last_deep_scrub":"27'41","last_deep_scrub_stamp":"2024-03-23T23:58:39.319007+0000","last_clean_scrub_stamp":"2024-03-23T23:58:39.319007+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:59:53.483821+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"27'5050","reported_seq":5074,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.381831+0000","last_change":"2024-03-23T23:42:50.751107+0000","last_active":"2024-03-23T23:58:30.381831+0000","last_peered":"2024-03-23T23:58:30.381831+0000","last_clean":"2024-03-23T23:58:30.381831+0000","last_became_active":"2024-03-23T23:42:50.750859+0000","last_became_peered":"2024-03-23T23:42:50.750859+0000","last_unstale":"2024-03-23T23:58:30.381831+0000","last_undegraded":"2024-03-23T23:58:30.381831+0000","last_fullsized":"2024-03-23T23:58:30.381831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5050,"log_dups_size":0,"ondisk_log_size":5050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75095,"num_write_kb":843705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"27'6329","reported_seq":6369,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:37.349118+0000","last_change":"2024-03-23T23:58:37.349143+0000","last_active":"2024-03-23T23:58:37.349118+0000","last_peered":"2024-03-23T23:58:37.349118+0000","last_clean":"2024-03-23T23:58:37.349118+0000","last_became_active":"2024-03-23T23:42:40.686186+0000","last_became_peered":"2024-03-23T23:42:40.686186+0000","last_unstale":"2024-03-23T23:58:37.349118+0000","last_undegraded":"2024-03-23T23:58:37.349118+0000","last_fullsized":"2024-03-23T23:58:37.349118+0000","mapping_epoch":19,"log_start":"27'600","ondisk_log_start":"27'600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6329","last_scrub_stamp":"2024-03-23T23:58:37.348719+0000","last_deep_scrub":"27'6329","last_deep_scrub_stamp":"2024-03-23T23:58:37.348719+0000","last_clean_scrub_stamp":"2024-03-23T23:58:37.348719+0000","objects_scrubbed":0,"log_size":5729,"log_dups_size":0,"ondisk_log_size":5729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:43:10.426379+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94311,"num_write_kb":1142337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'2","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:53.296463+0000","last_change":"2024-03-23T23:58:53.296483+0000","last_active":"2024-03-23T23:58:53.296463+0000","last_peered":"2024-03-23T23:58:53.296463+0000","last_clean":"2024-03-23T23:58:53.296463+0000","last_became_active":"2024-03-23T23:42:39.694720+0000","last_became_peered":"2024-03-23T23:42:39.694720+0000","last_unstale":"2024-03-23T23:58:53.296463+0000","last_undegraded":"2024-03-23T23:58:53.296463+0000","last_fullsized":"2024-03-23T23:58:53.296463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-03-23T23:58:53.296397+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-03-23T23:58:53.296397+0000","last_clean_scrub_stamp":"2024-03-23T23:58:53.296397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:47:31.673721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'3","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:47.215580+0000","last_change":"2024-03-23T23:58:47.215603+0000","last_active":"2024-03-23T23:58:47.215580+0000","last_peered":"2024-03-23T23:58:47.215580+0000","last_clean":"2024-03-23T23:58:47.215580+0000","last_became_active":"2024-03-23T23:42:49.738198+0000","last_became_peered":"2024-03-23T23:42:49.738198+0000","last_unstale":"2024-03-23T23:58:47.215580+0000","last_undegraded":"2024-03-23T23:58:47.215580+0000","last_fullsized":"2024-03-23T23:58:47.215580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-03-23T23:58:47.215506+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-03-23T23:58:47.215506+0000","last_clean_scrub_stamp":"2024-03-23T23:58:47.215506+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:35:52.208360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"27'5389","reported_seq":5421,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:51.281917+0000","last_change":"2024-03-23T23:58:51.281953+0000","last_active":"2024-03-23T23:58:51.281917+0000","last_peered":"2024-03-23T23:58:51.281917+0000","last_clean":"2024-03-23T23:58:51.281917+0000","last_became_active":"2024-03-23T23:42:50.754585+0000","last_became_peered":"2024-03-23T23:42:50.754585+0000","last_unstale":"2024-03-23T23:58:51.281917+0000","last_undegraded":"2024-03-23T23:58:51.281917+0000","last_fullsized":"2024-03-23T23:58:51.281917+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5389","last_scrub_stamp":"2024-03-23T23:58:51.281810+0000","last_deep_scrub":"27'5389","last_deep_scrub_stamp":"2024-03-23T23:58:51.281810+0000","last_clean_scrub_stamp":"2024-03-23T23:58:51.281810+0000","objects_scrubbed":0,"log_size":5389,"log_dups_size":0,"ondisk_log_size":5389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:48:22.632904+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80225,"num_write_kb":941986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'4652","reported_seq":4692,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:43.419290+0000","last_change":"2024-03-23T23:58:43.419310+0000","last_active":"2024-03-23T23:58:43.419290+0000","last_peered":"2024-03-23T23:58:43.419290+0000","last_clean":"2024-03-23T23:58:43.419290+0000","last_became_active":"2024-03-23T23:42:40.700112+0000","last_became_peered":"2024-03-23T23:42:40.700112+0000","last_unstale":"2024-03-23T23:58:43.419290+0000","last_undegraded":"2024-03-23T23:58:43.419290+0000","last_fullsized":"2024-03-23T23:58:43.419290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4652","last_scrub_stamp":"2024-03-23T23:58:43.419224+0000","last_deep_scrub":"27'4652","last_deep_scrub_stamp":"2024-03-23T23:58:43.419224+0000","last_clean_scrub_stamp":"2024-03-23T23:58:43.419224+0000","objects_scrubbed":0,"log_size":4652,"log_dups_size":0,"ondisk_log_size":4652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:40:34.292718+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68979,"num_write_kb":836174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'2","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:48.295907+0000","last_change":"2024-03-23T23:58:48.295928+0000","last_active":"2024-03-23T23:58:48.295907+0000","last_peered":"2024-03-23T23:58:48.295907+0000","last_clean":"2024-03-23T23:58:48.295907+0000","last_became_active":"2024-03-23T23:42:39.686094+0000","last_became_peered":"2024-03-23T23:42:39.686094+0000","last_unstale":"2024-03-23T23:58:48.295907+0000","last_undegraded":"2024-03-23T23:58:48.295907+0000","last_fullsized":"2024-03-23T23:58:48.295907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-03-23T23:58:48.295837+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-03-23T23:58:48.295837+0000","last_clean_scrub_stamp":"2024-03-23T23:58:48.295837+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:48:19.646932+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'70","reported_seq":104,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:36.363389+0000","last_change":"2024-03-23T23:58:36.363415+0000","last_active":"2024-03-23T23:58:36.363389+0000","last_peered":"2024-03-23T23:58:36.363389+0000","last_clean":"2024-03-23T23:58:36.363389+0000","last_became_active":"2024-03-23T23:42:49.737916+0000","last_became_peered":"2024-03-23T23:42:49.737916+0000","last_unstale":"2024-03-23T23:58:36.363389+0000","last_undegraded":"2024-03-23T23:58:36.363389+0000","last_fullsized":"2024-03-23T23:58:36.363389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'70","last_scrub_stamp":"2024-03-23T23:58:36.363306+0000","last_deep_scrub":"27'70","last_deep_scrub_stamp":"2024-03-23T23:58:36.363306+0000","last_clean_scrub_stamp":"2024-03-23T23:58:36.363306+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:34:24.832959+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":8223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"27'4725","reported_seq":4757,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:52.215129+0000","last_change":"2024-03-23T23:58:52.215167+0000","last_active":"2024-03-23T23:58:52.215129+0000","last_peered":"2024-03-23T23:58:52.215129+0000","last_clean":"2024-03-23T23:58:52.215129+0000","last_became_active":"2024-03-23T23:42:50.763768+0000","last_became_peered":"2024-03-23T23:42:50.763768+0000","last_unstale":"2024-03-23T23:58:52.215129+0000","last_undegraded":"2024-03-23T23:58:52.215129+0000","last_fullsized":"2024-03-23T23:58:52.215129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4725","last_scrub_stamp":"2024-03-23T23:58:52.215025+0000","last_deep_scrub":"27'4725","last_deep_scrub_stamp":"2024-03-23T23:58:52.215025+0000","last_clean_scrub_stamp":"2024-03-23T23:58:52.215025+0000","objects_scrubbed":0,"log_size":4725,"log_dups_size":0,"ondisk_log_size":4725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:38:56.062551+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69706,"num_write_kb":805786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"27'5477","reported_seq":5517,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:44.664454+0000","last_change":"2024-03-23T23:58:44.664476+0000","last_active":"2024-03-23T23:58:44.664454+0000","last_peered":"2024-03-23T23:58:44.664454+0000","last_clean":"2024-03-23T23:58:44.664454+0000","last_became_active":"2024-03-23T23:42:40.679488+0000","last_became_peered":"2024-03-23T23:42:40.679488+0000","last_unstale":"2024-03-23T23:58:44.664454+0000","last_undegraded":"2024-03-23T23:58:44.664454+0000","last_fullsized":"2024-03-23T23:58:44.664454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5477","last_scrub_stamp":"2024-03-23T23:58:44.664378+0000","last_deep_scrub":"27'5477","last_deep_scrub_stamp":"2024-03-23T23:58:44.664378+0000","last_clean_scrub_stamp":"2024-03-23T23:58:44.664378+0000","objects_scrubbed":0,"log_size":5477,"log_dups_size":0,"ondisk_log_size":5477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:19:52.748381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82124,"num_write_kb":1001722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'30","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:48.431402+0000","last_change":"2024-03-23T23:58:48.431428+0000","last_active":"2024-03-23T23:58:48.431402+0000","last_peered":"2024-03-23T23:58:48.431402+0000","last_clean":"2024-03-23T23:58:48.431402+0000","last_became_active":"2024-03-23T23:42:39.678864+0000","last_became_peered":"2024-03-23T23:42:39.678864+0000","last_unstale":"2024-03-23T23:58:48.431402+0000","last_undegraded":"2024-03-23T23:58:48.431402+0000","last_fullsized":"2024-03-23T23:58:48.431402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-03-23T23:58:48.431324+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-03-23T23:58:48.431324+0000","last_clean_scrub_stamp":"2024-03-23T23:58:48.431324+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:34:06.634133+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":8210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'2","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:40.321103+0000","last_change":"2024-03-23T23:58:40.321124+0000","last_active":"2024-03-23T23:58:40.321103+0000","last_peered":"2024-03-23T23:58:40.321103+0000","last_clean":"2024-03-23T23:58:40.321103+0000","last_became_active":"2024-03-23T23:42:49.739570+0000","last_became_peered":"2024-03-23T23:42:49.739570+0000","last_unstale":"2024-03-23T23:58:40.321103+0000","last_undegraded":"2024-03-23T23:58:40.321103+0000","last_fullsized":"2024-03-23T23:58:40.321103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-03-23T23:58:40.321022+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-03-23T23:58:40.321022+0000","last_clean_scrub_stamp":"2024-03-23T23:58:40.321022+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:36:52.234735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'5788","reported_seq":5821,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:46.033463+0000","last_change":"2024-03-23T23:58:46.033501+0000","last_active":"2024-03-23T23:58:46.033463+0000","last_peered":"2024-03-23T23:58:46.033463+0000","last_clean":"2024-03-23T23:58:46.033463+0000","last_became_active":"2024-03-23T23:42:50.753629+0000","last_became_peered":"2024-03-23T23:42:50.753629+0000","last_unstale":"2024-03-23T23:58:46.033463+0000","last_undegraded":"2024-03-23T23:58:46.033463+0000","last_fullsized":"2024-03-23T23:58:46.033463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5788","last_scrub_stamp":"2024-03-23T23:58:46.033358+0000","last_deep_scrub":"27'5788","last_deep_scrub_stamp":"2024-03-23T23:58:46.033358+0000","last_clean_scrub_stamp":"2024-03-23T23:58:46.033358+0000","objects_scrubbed":0,"log_size":5788,"log_dups_size":0,"ondisk_log_size":5788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:45:02.420598+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":85415,"num_write_kb":969479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'4118","reported_seq":4158,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:39.390529+0000","last_change":"2024-03-23T23:58:39.390550+0000","last_active":"2024-03-23T23:58:39.390529+0000","last_peered":"2024-03-23T23:58:39.390529+0000","last_clean":"2024-03-23T23:58:39.390529+0000","last_became_active":"2024-03-23T23:42:40.682391+0000","last_became_peered":"2024-03-23T23:42:40.682391+0000","last_unstale":"2024-03-23T23:58:39.390529+0000","last_undegraded":"2024-03-23T23:58:39.390529+0000","last_fullsized":"2024-03-23T23:58:39.390529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4118","last_scrub_stamp":"2024-03-23T23:58:39.390444+0000","last_deep_scrub":"27'4118","last_deep_scrub_stamp":"2024-03-23T23:58:39.390444+0000","last_clean_scrub_stamp":"2024-03-23T23:58:39.390444+0000","objects_scrubbed":0,"log_size":4118,"log_dups_size":0,"ondisk_log_size":4118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:36:03.164530+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61030,"num_write_kb":768099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'48","reported_seq":134,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:39.035241+0000","last_change":"2024-03-23T23:58:39.035264+0000","last_active":"2024-03-23T23:58:39.035241+0000","last_peered":"2024-03-23T23:58:39.035241+0000","last_clean":"2024-03-23T23:58:39.035241+0000","last_became_active":"2024-03-23T23:42:39.680494+0000","last_became_peered":"2024-03-23T23:42:39.680494+0000","last_unstale":"2024-03-23T23:58:39.035241+0000","last_undegraded":"2024-03-23T23:58:39.035241+0000","last_fullsized":"2024-03-23T23:58:39.035241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'48","last_scrub_stamp":"2024-03-23T23:58:39.035181+0000","last_deep_scrub":"27'48","last_deep_scrub_stamp":"2024-03-23T23:58:39.035181+0000","last_clean_scrub_stamp":"2024-03-23T23:58:39.035181+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:40:15.581233+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84561,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":115,"num_write":44,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'10","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:38.369258+0000","last_change":"2024-03-23T23:58:38.369300+0000","last_active":"2024-03-23T23:58:38.369258+0000","last_peered":"2024-03-23T23:58:38.369258+0000","last_clean":"2024-03-23T23:58:38.369258+0000","last_became_active":"2024-03-23T23:42:49.737196+0000","last_became_peered":"2024-03-23T23:42:49.737196+0000","last_unstale":"2024-03-23T23:58:38.369258+0000","last_undegraded":"2024-03-23T23:58:38.369258+0000","last_fullsized":"2024-03-23T23:58:38.369258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-03-23T23:58:38.369121+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-03-23T23:58:38.369121+0000","last_clean_scrub_stamp":"2024-03-23T23:58:38.369121+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:32:15.198180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"27'4476","reported_seq":4500,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.444941+0000","last_change":"2024-03-23T23:42:50.763308+0000","last_active":"2024-03-23T23:58:30.444941+0000","last_peered":"2024-03-23T23:58:30.444941+0000","last_clean":"2024-03-23T23:58:30.444941+0000","last_became_active":"2024-03-23T23:42:50.763007+0000","last_became_peered":"2024-03-23T23:42:50.763007+0000","last_unstale":"2024-03-23T23:58:30.444941+0000","last_undegraded":"2024-03-23T23:58:30.444941+0000","last_fullsized":"2024-03-23T23:58:30.444941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4476,"log_dups_size":0,"ondisk_log_size":4476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66536,"num_write_kb":757522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"27'4410","reported_seq":4450,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:42.250117+0000","last_change":"2024-03-23T23:58:42.250140+0000","last_active":"2024-03-23T23:58:42.250117+0000","last_peered":"2024-03-23T23:58:42.250117+0000","last_clean":"2024-03-23T23:58:42.250117+0000","last_became_active":"2024-03-23T23:42:40.674390+0000","last_became_peered":"2024-03-23T23:42:40.674390+0000","last_unstale":"2024-03-23T23:58:42.250117+0000","last_undegraded":"2024-03-23T23:58:42.250117+0000","last_fullsized":"2024-03-23T23:58:42.250117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4410","last_scrub_stamp":"2024-03-23T23:58:42.250038+0000","last_deep_scrub":"27'4410","last_deep_scrub_stamp":"2024-03-23T23:58:42.250038+0000","last_clean_scrub_stamp":"2024-03-23T23:58:42.250038+0000","objects_scrubbed":0,"log_size":4410,"log_dups_size":0,"ondisk_log_size":4410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:36:06.024124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65732,"num_write_kb":804228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'46","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:52.341892+0000","last_change":"2024-03-23T23:58:52.341940+0000","last_active":"2024-03-23T23:58:52.341892+0000","last_peered":"2024-03-23T23:58:52.341892+0000","last_clean":"2024-03-23T23:58:52.341892+0000","last_became_active":"2024-03-23T23:42:39.689763+0000","last_became_peered":"2024-03-23T23:42:39.689763+0000","last_unstale":"2024-03-23T23:58:52.341892+0000","last_undegraded":"2024-03-23T23:58:52.341892+0000","last_fullsized":"2024-03-23T23:58:52.341892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-03-23T23:58:52.341802+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-03-23T23:58:52.341802+0000","last_clean_scrub_stamp":"2024-03-23T23:58:52.341802+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:10:06.945040+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'354","reported_seq":388,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:35.220816+0000","last_change":"2024-03-23T23:58:35.220860+0000","last_active":"2024-03-23T23:58:35.220816+0000","last_peered":"2024-03-23T23:58:35.220816+0000","last_clean":"2024-03-23T23:58:35.220816+0000","last_became_active":"2024-03-23T23:42:49.733115+0000","last_became_peered":"2024-03-23T23:42:49.733115+0000","last_unstale":"2024-03-23T23:58:35.220816+0000","last_undegraded":"2024-03-23T23:58:35.220816+0000","last_fullsized":"2024-03-23T23:58:35.220816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'354","last_scrub_stamp":"2024-03-23T23:58:35.220733+0000","last_deep_scrub":"27'354","last_deep_scrub_stamp":"2024-03-23T23:58:35.220733+0000","last_clean_scrub_stamp":"2024-03-23T23:58:35.220733+0000","objects_scrubbed":1,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:25:39.027710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":739,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"27'6380","reported_seq":6404,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.489903+0000","last_change":"2024-03-23T23:42:50.759000+0000","last_active":"2024-03-23T23:58:30.489903+0000","last_peered":"2024-03-23T23:58:30.489903+0000","last_clean":"2024-03-23T23:58:30.489903+0000","last_became_active":"2024-03-23T23:42:50.758552+0000","last_became_peered":"2024-03-23T23:42:50.758552+0000","last_unstale":"2024-03-23T23:58:30.489903+0000","last_undegraded":"2024-03-23T23:58:30.489903+0000","last_fullsized":"2024-03-23T23:58:30.489903+0000","mapping_epoch":23,"log_start":"27'700","ondisk_log_start":"27'700","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5680,"log_dups_size":0,"ondisk_log_size":5680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94645,"num_write_kb":1081333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"27'5078","reported_seq":5118,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:43.410682+0000","last_change":"2024-03-23T23:58:43.410744+0000","last_active":"2024-03-23T23:58:43.410682+0000","last_peered":"2024-03-23T23:58:43.410682+0000","last_clean":"2024-03-23T23:58:43.410682+0000","last_became_active":"2024-03-23T23:42:40.700788+0000","last_became_peered":"2024-03-23T23:42:40.700788+0000","last_unstale":"2024-03-23T23:58:43.410682+0000","last_undegraded":"2024-03-23T23:58:43.410682+0000","last_fullsized":"2024-03-23T23:58:43.410682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5078","last_scrub_stamp":"2024-03-23T23:58:43.410560+0000","last_deep_scrub":"27'5078","last_deep_scrub_stamp":"2024-03-23T23:58:43.410560+0000","last_clean_scrub_stamp":"2024-03-23T23:58:43.410560+0000","objects_scrubbed":0,"log_size":5078,"log_dups_size":0,"ondisk_log_size":5078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:37:54.014410+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75375,"num_write_kb":887789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'3","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:50.373324+0000","last_change":"2024-03-23T23:58:50.373363+0000","last_active":"2024-03-23T23:58:50.373324+0000","last_peered":"2024-03-23T23:58:50.373324+0000","last_clean":"2024-03-23T23:58:50.373324+0000","last_became_active":"2024-03-23T23:42:39.687378+0000","last_became_peered":"2024-03-23T23:42:39.687378+0000","last_unstale":"2024-03-23T23:58:50.373324+0000","last_undegraded":"2024-03-23T23:58:50.373324+0000","last_fullsized":"2024-03-23T23:58:50.373324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-03-23T23:58:50.373238+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-03-23T23:58:50.373238+0000","last_clean_scrub_stamp":"2024-03-23T23:58:50.373238+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:00:08.690876+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":201,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:51.303233+0000","last_change":"2024-03-23T23:58:51.303233+0000","last_active":"2024-03-23T23:58:51.303233+0000","last_peered":"2024-03-23T23:58:51.303233+0000","last_clean":"2024-03-23T23:58:51.303233+0000","last_became_active":"2024-03-23T23:42:27.939061+0000","last_became_peered":"2024-03-23T23:42:27.939061+0000","last_unstale":"2024-03-23T23:58:51.303233+0000","last_undegraded":"2024-03-23T23:58:51.303233+0000","last_fullsized":"2024-03-23T23:58:51.303233+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-03-23T23:58:51.303148+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-03-23T23:58:51.303148+0000","last_clean_scrub_stamp":"2024-03-23T23:58:51.303148+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:08:45.693544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'3","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:49.773867+0000","last_change":"2024-03-23T23:58:49.773906+0000","last_active":"2024-03-23T23:58:49.773867+0000","last_peered":"2024-03-23T23:58:49.773867+0000","last_clean":"2024-03-23T23:58:49.773867+0000","last_became_active":"2024-03-23T23:42:49.728990+0000","last_became_peered":"2024-03-23T23:42:49.728990+0000","last_unstale":"2024-03-23T23:58:49.773867+0000","last_undegraded":"2024-03-23T23:58:49.773867+0000","last_fullsized":"2024-03-23T23:58:49.773867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-03-23T23:58:49.773781+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-03-23T23:58:49.773781+0000","last_clean_scrub_stamp":"2024-03-23T23:58:49.773781+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:41:04.381138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"27'4440","reported_seq":4472,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:48.002946+0000","last_change":"2024-03-23T23:58:48.002969+0000","last_active":"2024-03-23T23:58:48.002946+0000","last_peered":"2024-03-23T23:58:48.002946+0000","last_clean":"2024-03-23T23:58:48.002946+0000","last_became_active":"2024-03-23T23:42:50.756900+0000","last_became_peered":"2024-03-23T23:42:50.756900+0000","last_unstale":"2024-03-23T23:58:48.002946+0000","last_undegraded":"2024-03-23T23:58:48.002946+0000","last_fullsized":"2024-03-23T23:58:48.002946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4440","last_scrub_stamp":"2024-03-23T23:58:48.002852+0000","last_deep_scrub":"27'4440","last_deep_scrub_stamp":"2024-03-23T23:58:48.002852+0000","last_clean_scrub_stamp":"2024-03-23T23:58:48.002852+0000","objects_scrubbed":0,"log_size":4440,"log_dups_size":0,"ondisk_log_size":4440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:43:21.080512+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65770,"num_write_kb":738740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'5486","reported_seq":5526,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:41.241916+0000","last_change":"2024-03-23T23:58:41.241937+0000","last_active":"2024-03-23T23:58:41.241916+0000","last_peered":"2024-03-23T23:58:41.241916+0000","last_clean":"2024-03-23T23:58:41.241916+0000","last_became_active":"2024-03-23T23:42:40.711306+0000","last_became_peered":"2024-03-23T23:42:40.711306+0000","last_unstale":"2024-03-23T23:58:41.241916+0000","last_undegraded":"2024-03-23T23:58:41.241916+0000","last_fullsized":"2024-03-23T23:58:41.241916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5486","last_scrub_stamp":"2024-03-23T23:58:41.241842+0000","last_deep_scrub":"27'5486","last_deep_scrub_stamp":"2024-03-23T23:58:41.241842+0000","last_clean_scrub_stamp":"2024-03-23T23:58:41.241842+0000","objects_scrubbed":0,"log_size":5486,"log_dups_size":0,"ondisk_log_size":5486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:36:53.155555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81537,"num_write_kb":972707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'5","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:41.017229+0000","last_change":"2024-03-23T23:58:41.017249+0000","last_active":"2024-03-23T23:58:41.017229+0000","last_peered":"2024-03-23T23:58:41.017229+0000","last_clean":"2024-03-23T23:58:41.017229+0000","last_became_active":"2024-03-23T23:42:39.683211+0000","last_became_peered":"2024-03-23T23:42:39.683211+0000","last_unstale":"2024-03-23T23:58:41.017229+0000","last_undegraded":"2024-03-23T23:58:41.017229+0000","last_fullsized":"2024-03-23T23:58:41.017229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-03-23T23:58:41.017161+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-03-23T23:58:41.017161+0000","last_clean_scrub_stamp":"2024-03-23T23:58:41.017161+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:51:23.523336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'124","reported_seq":158,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:51.744403+0000","last_change":"2024-03-23T23:58:51.744426+0000","last_active":"2024-03-23T23:58:51.744403+0000","last_peered":"2024-03-23T23:58:51.744403+0000","last_clean":"2024-03-23T23:58:51.744403+0000","last_became_active":"2024-03-23T23:42:49.735473+0000","last_became_peered":"2024-03-23T23:42:49.735473+0000","last_unstale":"2024-03-23T23:58:51.744403+0000","last_undegraded":"2024-03-23T23:58:51.744403+0000","last_fullsized":"2024-03-23T23:58:51.744403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'124","last_scrub_stamp":"2024-03-23T23:58:51.744330+0000","last_deep_scrub":"27'124","last_deep_scrub_stamp":"2024-03-23T23:58:51.744330+0000","last_clean_scrub_stamp":"2024-03-23T23:58:51.744330+0000","objects_scrubbed":1,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:49:42.839879+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":4181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"27'5305","reported_seq":5337,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:45.045668+0000","last_change":"2024-03-23T23:58:45.045704+0000","last_active":"2024-03-23T23:58:45.045668+0000","last_peered":"2024-03-23T23:58:45.045668+0000","last_clean":"2024-03-23T23:58:45.045668+0000","last_became_active":"2024-03-23T23:42:50.745256+0000","last_became_peered":"2024-03-23T23:42:50.745256+0000","last_unstale":"2024-03-23T23:58:45.045668+0000","last_undegraded":"2024-03-23T23:58:45.045668+0000","last_fullsized":"2024-03-23T23:58:45.045668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5305","last_scrub_stamp":"2024-03-23T23:58:45.045583+0000","last_deep_scrub":"27'5305","last_deep_scrub_stamp":"2024-03-23T23:58:45.045583+0000","last_clean_scrub_stamp":"2024-03-23T23:58:45.045583+0000","objects_scrubbed":0,"log_size":5305,"log_dups_size":0,"ondisk_log_size":5305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:07:31.327376+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78242,"num_write_kb":887262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'5423","reported_seq":5456,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:28.440212+0000","last_change":"2024-03-23T23:42:40.700124+0000","last_active":"2024-03-23T23:58:28.440212+0000","last_peered":"2024-03-23T23:58:28.440212+0000","last_clean":"2024-03-23T23:58:28.440212+0000","last_became_active":"2024-03-23T23:42:40.697369+0000","last_became_peered":"2024-03-23T23:42:40.697369+0000","last_unstale":"2024-03-23T23:58:28.440212+0000","last_undegraded":"2024-03-23T23:58:28.440212+0000","last_fullsized":"2024-03-23T23:58:28.440212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5423,"log_dups_size":0,"ondisk_log_size":5423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":11,"num_write":80814,"num_write_kb":947944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'26","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:44.353019+0000","last_change":"2024-03-23T23:58:44.353045+0000","last_active":"2024-03-23T23:58:44.353019+0000","last_peered":"2024-03-23T23:58:44.353019+0000","last_clean":"2024-03-23T23:58:44.353019+0000","last_became_active":"2024-03-23T23:42:39.680669+0000","last_became_peered":"2024-03-23T23:42:39.680669+0000","last_unstale":"2024-03-23T23:58:44.353019+0000","last_undegraded":"2024-03-23T23:58:44.353019+0000","last_fullsized":"2024-03-23T23:58:44.353019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2024-03-23T23:58:44.352952+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2024-03-23T23:58:44.352952+0000","last_clean_scrub_stamp":"2024-03-23T23:58:44.352952+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:35:49.345806+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'393","reported_seq":427,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:37.246535+0000","last_change":"2024-03-23T23:58:37.246561+0000","last_active":"2024-03-23T23:58:37.246535+0000","last_peered":"2024-03-23T23:58:37.246535+0000","last_clean":"2024-03-23T23:58:37.246535+0000","last_became_active":"2024-03-23T23:42:49.734508+0000","last_became_peered":"2024-03-23T23:42:49.734508+0000","last_unstale":"2024-03-23T23:58:37.246535+0000","last_undegraded":"2024-03-23T23:58:37.246535+0000","last_fullsized":"2024-03-23T23:58:37.246535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'393","last_scrub_stamp":"2024-03-23T23:58:37.246475+0000","last_deep_scrub":"27'393","last_deep_scrub_stamp":"2024-03-23T23:58:37.246475+0000","last_clean_scrub_stamp":"2024-03-23T23:58:37.246475+0000","objects_scrubbed":2,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:05:37.340941+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":4222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"27'4747","reported_seq":4771,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.425387+0000","last_change":"2024-03-23T23:42:50.751141+0000","last_active":"2024-03-23T23:58:30.425387+0000","last_peered":"2024-03-23T23:58:30.425387+0000","last_clean":"2024-03-23T23:58:30.425387+0000","last_became_active":"2024-03-23T23:42:50.750269+0000","last_became_peered":"2024-03-23T23:42:50.750269+0000","last_unstale":"2024-03-23T23:58:30.425387+0000","last_undegraded":"2024-03-23T23:58:30.425387+0000","last_fullsized":"2024-03-23T23:58:30.425387+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4747,"log_dups_size":0,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70383,"num_write_kb":794086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"27'6880","reported_seq":6920,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:39.233716+0000","last_change":"2024-03-23T23:58:39.233716+0000","last_active":"2024-03-23T23:58:39.233716+0000","last_peered":"2024-03-23T23:58:39.233716+0000","last_clean":"2024-03-23T23:58:39.233716+0000","last_became_active":"2024-03-23T23:42:40.704328+0000","last_became_peered":"2024-03-23T23:42:40.704328+0000","last_unstale":"2024-03-23T23:58:39.233716+0000","last_undegraded":"2024-03-23T23:58:39.233716+0000","last_fullsized":"2024-03-23T23:58:39.233716+0000","mapping_epoch":19,"log_start":"27'1200","ondisk_log_start":"27'1200","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6880","last_scrub_stamp":"2024-03-23T23:58:39.233631+0000","last_deep_scrub":"27'6880","last_deep_scrub_stamp":"2024-03-23T23:58:39.233631+0000","last_clean_scrub_stamp":"2024-03-23T23:58:39.233631+0000","objects_scrubbed":0,"log_size":5680,"log_dups_size":0,"ondisk_log_size":5680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:32:16.062690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102549,"num_write_kb":1203650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'23","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:40.029254+0000","last_change":"2024-03-23T23:58:40.029254+0000","last_active":"2024-03-23T23:58:40.029254+0000","last_peered":"2024-03-23T23:58:40.029254+0000","last_clean":"2024-03-23T23:58:40.029254+0000","last_became_active":"2024-03-23T23:42:39.680506+0000","last_became_peered":"2024-03-23T23:42:39.680506+0000","last_unstale":"2024-03-23T23:58:40.029254+0000","last_undegraded":"2024-03-23T23:58:40.029254+0000","last_fullsized":"2024-03-23T23:58:40.029254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2024-03-23T23:58:40.029160+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2024-03-23T23:58:40.029160+0000","last_clean_scrub_stamp":"2024-03-23T23:58:40.029160+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:13:35.205084+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'29","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:38.570925+0000","last_change":"2024-03-23T23:58:38.570971+0000","last_active":"2024-03-23T23:58:38.570925+0000","last_peered":"2024-03-23T23:58:38.570925+0000","last_clean":"2024-03-23T23:58:38.570925+0000","last_became_active":"2024-03-23T23:42:49.737434+0000","last_became_peered":"2024-03-23T23:42:49.737434+0000","last_unstale":"2024-03-23T23:58:38.570925+0000","last_undegraded":"2024-03-23T23:58:38.570925+0000","last_fullsized":"2024-03-23T23:58:38.570925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2024-03-23T23:58:38.570738+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2024-03-23T23:58:38.570738+0000","last_clean_scrub_stamp":"2024-03-23T23:58:38.570738+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:27:27.969692+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"27'4785","reported_seq":4817,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:36.003393+0000","last_change":"2024-03-23T23:58:36.003421+0000","last_active":"2024-03-23T23:58:36.003393+0000","last_peered":"2024-03-23T23:58:36.003393+0000","last_clean":"2024-03-23T23:58:36.003393+0000","last_became_active":"2024-03-23T23:42:50.746105+0000","last_became_peered":"2024-03-23T23:42:50.746105+0000","last_unstale":"2024-03-23T23:58:36.003393+0000","last_undegraded":"2024-03-23T23:58:36.003393+0000","last_fullsized":"2024-03-23T23:58:36.003393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4785","last_scrub_stamp":"2024-03-23T23:58:36.003286+0000","last_deep_scrub":"27'4785","last_deep_scrub_stamp":"2024-03-23T23:58:36.003286+0000","last_clean_scrub_stamp":"2024-03-23T23:58:36.003286+0000","objects_scrubbed":0,"log_size":4785,"log_dups_size":0,"ondisk_log_size":4785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:17:39.747906+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70705,"num_write_kb":815494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"27'4266","reported_seq":4306,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:46.249275+0000","last_change":"2024-03-23T23:58:46.249295+0000","last_active":"2024-03-23T23:58:46.249275+0000","last_peered":"2024-03-23T23:58:46.249275+0000","last_clean":"2024-03-23T23:58:46.249275+0000","last_became_active":"2024-03-23T23:42:40.696141+0000","last_became_peered":"2024-03-23T23:42:40.696141+0000","last_unstale":"2024-03-23T23:58:46.249275+0000","last_undegraded":"2024-03-23T23:58:46.249275+0000","last_fullsized":"2024-03-23T23:58:46.249275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4266","last_scrub_stamp":"2024-03-23T23:58:46.249195+0000","last_deep_scrub":"27'4266","last_deep_scrub_stamp":"2024-03-23T23:58:46.249195+0000","last_clean_scrub_stamp":"2024-03-23T23:58:46.249195+0000","objects_scrubbed":0,"log_size":4266,"log_dups_size":0,"ondisk_log_size":4266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:03:22.115891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63684,"num_write_kb":761063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'241","reported_seq":283,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:43.639018+0000","last_change":"2024-03-23T23:58:43.639044+0000","last_active":"2024-03-23T23:58:43.639018+0000","last_peered":"2024-03-23T23:58:43.639018+0000","last_clean":"2024-03-23T23:58:43.639018+0000","last_became_active":"2024-03-23T23:42:39.686491+0000","last_became_peered":"2024-03-23T23:42:39.686491+0000","last_unstale":"2024-03-23T23:58:43.639018+0000","last_undegraded":"2024-03-23T23:58:43.639018+0000","last_fullsized":"2024-03-23T23:58:43.639018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'241","last_scrub_stamp":"2024-03-23T23:58:43.638935+0000","last_deep_scrub":"27'241","last_deep_scrub_stamp":"2024-03-23T23:58:43.638935+0000","last_clean_scrub_stamp":"2024-03-23T23:58:43.638935+0000","objects_scrubbed":2,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:49:13.146888+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'2","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:40.588420+0000","last_change":"2024-03-23T23:58:40.588441+0000","last_active":"2024-03-23T23:58:40.588420+0000","last_peered":"2024-03-23T23:58:40.588420+0000","last_clean":"2024-03-23T23:58:40.588420+0000","last_became_active":"2024-03-23T23:42:49.733389+0000","last_became_peered":"2024-03-23T23:42:49.733389+0000","last_unstale":"2024-03-23T23:58:40.588420+0000","last_undegraded":"2024-03-23T23:58:40.588420+0000","last_fullsized":"2024-03-23T23:58:40.588420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-03-23T23:58:40.588361+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-03-23T23:58:40.588361+0000","last_clean_scrub_stamp":"2024-03-23T23:58:40.588361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:27:44.866450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"27'5253","reported_seq":5276,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.403994+0000","last_change":"2024-03-23T23:42:50.764083+0000","last_active":"2024-03-23T23:58:30.403994+0000","last_peered":"2024-03-23T23:58:30.403994+0000","last_clean":"2024-03-23T23:58:30.403994+0000","last_became_active":"2024-03-23T23:42:50.763871+0000","last_became_peered":"2024-03-23T23:42:50.763871+0000","last_unstale":"2024-03-23T23:58:30.403994+0000","last_undegraded":"2024-03-23T23:58:30.403994+0000","last_fullsized":"2024-03-23T23:58:30.403994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5253,"log_dups_size":0,"ondisk_log_size":5253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77731,"num_write_kb":860727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"27'4092","reported_seq":4131,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:42.210152+0000","last_change":"2024-03-23T23:58:42.210173+0000","last_active":"2024-03-23T23:58:42.210152+0000","last_peered":"2024-03-23T23:58:42.210152+0000","last_clean":"2024-03-23T23:58:42.210152+0000","last_became_active":"2024-03-23T23:42:40.700800+0000","last_became_peered":"2024-03-23T23:42:40.700800+0000","last_unstale":"2024-03-23T23:58:42.210152+0000","last_undegraded":"2024-03-23T23:58:42.210152+0000","last_fullsized":"2024-03-23T23:58:42.210152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4092","last_scrub_stamp":"2024-03-23T23:58:42.210077+0000","last_deep_scrub":"27'4092","last_deep_scrub_stamp":"2024-03-23T23:58:42.210077+0000","last_clean_scrub_stamp":"2024-03-23T23:58:42.210077+0000","objects_scrubbed":0,"log_size":4092,"log_dups_size":0,"ondisk_log_size":4092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:19:38.675612+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60579,"num_write_kb":760058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'19","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:38.004719+0000","last_change":"2024-03-23T23:58:38.004719+0000","last_active":"2024-03-23T23:58:38.004719+0000","last_peered":"2024-03-23T23:58:38.004719+0000","last_clean":"2024-03-23T23:58:38.004719+0000","last_became_active":"2024-03-23T23:42:39.675770+0000","last_became_peered":"2024-03-23T23:42:39.675770+0000","last_unstale":"2024-03-23T23:58:38.004719+0000","last_undegraded":"2024-03-23T23:58:38.004719+0000","last_fullsized":"2024-03-23T23:58:38.004719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-03-23T23:58:38.004625+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-03-23T23:58:38.004625+0000","last_clean_scrub_stamp":"2024-03-23T23:58:38.004625+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:43.490584+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'4","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:48.208836+0000","last_change":"2024-03-23T23:58:48.208856+0000","last_active":"2024-03-23T23:58:48.208836+0000","last_peered":"2024-03-23T23:58:48.208836+0000","last_clean":"2024-03-23T23:58:48.208836+0000","last_became_active":"2024-03-23T23:42:49.738053+0000","last_became_peered":"2024-03-23T23:42:49.738053+0000","last_unstale":"2024-03-23T23:58:48.208836+0000","last_undegraded":"2024-03-23T23:58:48.208836+0000","last_fullsized":"2024-03-23T23:58:48.208836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-03-23T23:58:48.208765+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-03-23T23:58:48.208765+0000","last_clean_scrub_stamp":"2024-03-23T23:58:48.208765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:37:36.191114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"27'5776","reported_seq":5799,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.479065+0000","last_change":"2024-03-23T23:42:50.771347+0000","last_active":"2024-03-23T23:58:30.479065+0000","last_peered":"2024-03-23T23:58:30.479065+0000","last_clean":"2024-03-23T23:58:30.479065+0000","last_became_active":"2024-03-23T23:42:50.770998+0000","last_became_peered":"2024-03-23T23:42:50.770998+0000","last_unstale":"2024-03-23T23:58:30.479065+0000","last_undegraded":"2024-03-23T23:58:30.479065+0000","last_fullsized":"2024-03-23T23:58:30.479065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5776,"log_dups_size":0,"ondisk_log_size":5776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85663,"num_write_kb":962089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'4463","reported_seq":4503,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:46.762299+0000","last_change":"2024-03-23T23:58:46.762299+0000","last_active":"2024-03-23T23:58:46.762299+0000","last_peered":"2024-03-23T23:58:46.762299+0000","last_clean":"2024-03-23T23:58:46.762299+0000","last_became_active":"2024-03-23T23:42:40.675416+0000","last_became_peered":"2024-03-23T23:42:40.675416+0000","last_unstale":"2024-03-23T23:58:46.762299+0000","last_undegraded":"2024-03-23T23:58:46.762299+0000","last_fullsized":"2024-03-23T23:58:46.762299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4463","last_scrub_stamp":"2024-03-23T23:58:46.762095+0000","last_deep_scrub":"27'4463","last_deep_scrub_stamp":"2024-03-23T23:58:46.762095+0000","last_clean_scrub_stamp":"2024-03-23T23:58:46.762095+0000","objects_scrubbed":0,"log_size":4463,"log_dups_size":0,"ondisk_log_size":4463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:44:30.714116+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66376,"num_write_kb":804237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'5","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:42.690577+0000","last_change":"2024-03-23T23:58:42.690577+0000","last_active":"2024-03-23T23:58:42.690577+0000","last_peered":"2024-03-23T23:58:42.690577+0000","last_clean":"2024-03-23T23:58:42.690577+0000","last_became_active":"2024-03-23T23:42:39.681418+0000","last_became_peered":"2024-03-23T23:42:39.681418+0000","last_unstale":"2024-03-23T23:58:42.690577+0000","last_undegraded":"2024-03-23T23:58:42.690577+0000","last_fullsized":"2024-03-23T23:58:42.690577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-03-23T23:58:42.690454+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-03-23T23:58:42.690454+0000","last_clean_scrub_stamp":"2024-03-23T23:58:42.690454+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:22:56.691436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'3","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:36.260312+0000","last_change":"2024-03-23T23:58:36.260332+0000","last_active":"2024-03-23T23:58:36.260312+0000","last_peered":"2024-03-23T23:58:36.260312+0000","last_clean":"2024-03-23T23:58:36.260312+0000","last_became_active":"2024-03-23T23:42:49.744422+0000","last_became_peered":"2024-03-23T23:42:49.744422+0000","last_unstale":"2024-03-23T23:58:36.260312+0000","last_undegraded":"2024-03-23T23:58:36.260312+0000","last_fullsized":"2024-03-23T23:58:36.260312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-03-23T23:58:36.260243+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-03-23T23:58:36.260243+0000","last_clean_scrub_stamp":"2024-03-23T23:58:36.260243+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:22:43.606768+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"27'4219","reported_seq":4250,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:46.424834+0000","last_change":"2024-03-23T23:58:46.424856+0000","last_active":"2024-03-23T23:58:46.424834+0000","last_peered":"2024-03-23T23:58:46.424834+0000","last_clean":"2024-03-23T23:58:46.424834+0000","last_became_active":"2024-03-23T23:42:50.752783+0000","last_became_peered":"2024-03-23T23:42:50.752783+0000","last_unstale":"2024-03-23T23:58:46.424834+0000","last_undegraded":"2024-03-23T23:58:46.424834+0000","last_fullsized":"2024-03-23T23:58:46.424834+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4219","last_scrub_stamp":"2024-03-23T23:58:46.424738+0000","last_deep_scrub":"27'4219","last_deep_scrub_stamp":"2024-03-23T23:58:46.424738+0000","last_clean_scrub_stamp":"2024-03-23T23:58:46.424738+0000","objects_scrubbed":0,"log_size":4219,"log_dups_size":0,"ondisk_log_size":4219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:17:38.531050+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62346,"num_write_kb":725472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'5180","reported_seq":5219,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:38.259401+0000","last_change":"2024-03-23T23:58:38.259422+0000","last_active":"2024-03-23T23:58:38.259401+0000","last_peered":"2024-03-23T23:58:38.259401+0000","last_clean":"2024-03-23T23:58:38.259401+0000","last_became_active":"2024-03-23T23:42:40.703787+0000","last_became_peered":"2024-03-23T23:42:40.703787+0000","last_unstale":"2024-03-23T23:58:38.259401+0000","last_undegraded":"2024-03-23T23:58:38.259401+0000","last_fullsized":"2024-03-23T23:58:38.259401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5180","last_scrub_stamp":"2024-03-23T23:58:38.259317+0000","last_deep_scrub":"27'5180","last_deep_scrub_stamp":"2024-03-23T23:58:38.259317+0000","last_clean_scrub_stamp":"2024-03-23T23:58:38.259317+0000","objects_scrubbed":0,"log_size":5180,"log_dups_size":0,"ondisk_log_size":5180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:43:11.336977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76955,"num_write_kb":929765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'3","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:51.360196+0000","last_change":"2024-03-23T23:58:51.360217+0000","last_active":"2024-03-23T23:58:51.360196+0000","last_peered":"2024-03-23T23:58:51.360196+0000","last_clean":"2024-03-23T23:58:51.360196+0000","last_became_active":"2024-03-23T23:42:39.688141+0000","last_became_peered":"2024-03-23T23:42:39.688141+0000","last_unstale":"2024-03-23T23:58:51.360196+0000","last_undegraded":"2024-03-23T23:58:51.360196+0000","last_fullsized":"2024-03-23T23:58:51.360196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-03-23T23:58:51.360130+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-03-23T23:58:51.360130+0000","last_clean_scrub_stamp":"2024-03-23T23:58:51.360130+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:10:10.255281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'1147","reported_seq":1180,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:40.351711+0000","last_change":"2024-03-23T23:58:40.351775+0000","last_active":"2024-03-23T23:58:40.351711+0000","last_peered":"2024-03-23T23:58:40.351711+0000","last_clean":"2024-03-23T23:58:40.351711+0000","last_became_active":"2024-03-23T23:42:49.748687+0000","last_became_peered":"2024-03-23T23:42:49.748687+0000","last_unstale":"2024-03-23T23:58:40.351711+0000","last_undegraded":"2024-03-23T23:58:40.351711+0000","last_fullsized":"2024-03-23T23:58:40.351711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1147","last_scrub_stamp":"2024-03-23T23:58:40.351626+0000","last_deep_scrub":"27'1147","last_deep_scrub_stamp":"2024-03-23T23:58:40.351626+0000","last_clean_scrub_stamp":"2024-03-23T23:58:40.351626+0000","objects_scrubbed":4,"log_size":1147,"log_dups_size":0,"ondisk_log_size":1147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:21:30.756045+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1142,"num_write_kb":4626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"27'6486","reported_seq":6509,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.469442+0000","last_change":"2024-03-23T23:42:50.752273+0000","last_active":"2024-03-23T23:58:30.469442+0000","last_peered":"2024-03-23T23:58:30.469442+0000","last_clean":"2024-03-23T23:58:30.469442+0000","last_became_active":"2024-03-23T23:42:50.751874+0000","last_became_peered":"2024-03-23T23:42:50.751874+0000","last_unstale":"2024-03-23T23:58:30.469442+0000","last_undegraded":"2024-03-23T23:58:30.469442+0000","last_fullsized":"2024-03-23T23:58:30.469442+0000","mapping_epoch":23,"log_start":"27'1200","ondisk_log_start":"27'1200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5286,"log_dups_size":0,"ondisk_log_size":5286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96407,"num_write_kb":1089798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'4560","reported_seq":4599,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:38.274491+0000","last_change":"2024-03-23T23:58:38.274532+0000","last_active":"2024-03-23T23:58:38.274491+0000","last_peered":"2024-03-23T23:58:38.274491+0000","last_clean":"2024-03-23T23:58:38.274491+0000","last_became_active":"2024-03-23T23:42:40.688636+0000","last_became_peered":"2024-03-23T23:42:40.688636+0000","last_unstale":"2024-03-23T23:58:38.274491+0000","last_undegraded":"2024-03-23T23:58:38.274491+0000","last_fullsized":"2024-03-23T23:58:38.274491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4560","last_scrub_stamp":"2024-03-23T23:58:38.274373+0000","last_deep_scrub":"27'4560","last_deep_scrub_stamp":"2024-03-23T23:58:38.274373+0000","last_clean_scrub_stamp":"2024-03-23T23:58:38.274373+0000","objects_scrubbed":0,"log_size":4560,"log_dups_size":0,"ondisk_log_size":4560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:49:10.770804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68087,"num_write_kb":816248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'64","reported_seq":105,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:39.278682+0000","last_change":"2024-03-23T23:58:39.278710+0000","last_active":"2024-03-23T23:58:39.278682+0000","last_peered":"2024-03-23T23:58:39.278682+0000","last_clean":"2024-03-23T23:58:39.278682+0000","last_became_active":"2024-03-23T23:42:39.681028+0000","last_became_peered":"2024-03-23T23:42:39.681028+0000","last_unstale":"2024-03-23T23:58:39.278682+0000","last_undegraded":"2024-03-23T23:58:39.278682+0000","last_fullsized":"2024-03-23T23:58:39.278682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'64","last_scrub_stamp":"2024-03-23T23:58:39.278616+0000","last_deep_scrub":"27'64","last_deep_scrub_stamp":"2024-03-23T23:58:39.278616+0000","last_clean_scrub_stamp":"2024-03-23T23:58:39.278616+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:42:09.058279+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":8222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'24","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:40.536665+0000","last_change":"2024-03-23T23:58:40.536687+0000","last_active":"2024-03-23T23:58:40.536665+0000","last_peered":"2024-03-23T23:58:40.536665+0000","last_clean":"2024-03-23T23:58:40.536665+0000","last_became_active":"2024-03-23T23:42:49.741650+0000","last_became_peered":"2024-03-23T23:42:49.741650+0000","last_unstale":"2024-03-23T23:58:40.536665+0000","last_undegraded":"2024-03-23T23:58:40.536665+0000","last_fullsized":"2024-03-23T23:58:40.536665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2024-03-23T23:58:40.536597+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2024-03-23T23:58:40.536597+0000","last_clean_scrub_stamp":"2024-03-23T23:58:40.536597+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:12:18.349710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"27'5263","reported_seq":5286,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.485849+0000","last_change":"2024-03-23T23:42:50.752979+0000","last_active":"2024-03-23T23:58:30.485849+0000","last_peered":"2024-03-23T23:58:30.485849+0000","last_clean":"2024-03-23T23:58:30.485849+0000","last_became_active":"2024-03-23T23:42:50.751848+0000","last_became_peered":"2024-03-23T23:42:50.751848+0000","last_unstale":"2024-03-23T23:58:30.485849+0000","last_undegraded":"2024-03-23T23:58:30.485849+0000","last_fullsized":"2024-03-23T23:58:30.485849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5263,"log_dups_size":0,"ondisk_log_size":5263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77613,"num_write_kb":898929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'4164","reported_seq":4203,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:48.227209+0000","last_change":"2024-03-23T23:58:48.227230+0000","last_active":"2024-03-23T23:58:48.227209+0000","last_peered":"2024-03-23T23:58:48.227209+0000","last_clean":"2024-03-23T23:58:48.227209+0000","last_became_active":"2024-03-23T23:42:40.689477+0000","last_became_peered":"2024-03-23T23:42:40.689477+0000","last_unstale":"2024-03-23T23:58:48.227209+0000","last_undegraded":"2024-03-23T23:58:48.227209+0000","last_fullsized":"2024-03-23T23:58:48.227209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4164","last_scrub_stamp":"2024-03-23T23:58:48.227125+0000","last_deep_scrub":"27'4164","last_deep_scrub_stamp":"2024-03-23T23:58:48.227125+0000","last_clean_scrub_stamp":"2024-03-23T23:58:48.227125+0000","objects_scrubbed":0,"log_size":4164,"log_dups_size":0,"ondisk_log_size":4164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:48:19.578220+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61832,"num_write_kb":761424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'1207","reported_seq":1248,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:44.758366+0000","last_change":"2024-03-23T23:58:44.758391+0000","last_active":"2024-03-23T23:58:44.758366+0000","last_peered":"2024-03-23T23:58:44.758366+0000","last_clean":"2024-03-23T23:58:44.758366+0000","last_became_active":"2024-03-23T23:42:39.688066+0000","last_became_peered":"2024-03-23T23:42:39.688066+0000","last_unstale":"2024-03-23T23:58:44.758366+0000","last_undegraded":"2024-03-23T23:58:44.758366+0000","last_fullsized":"2024-03-23T23:58:44.758366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1207","last_scrub_stamp":"2024-03-23T23:58:44.758294+0000","last_deep_scrub":"27'1207","last_deep_scrub_stamp":"2024-03-23T23:58:44.758294+0000","last_clean_scrub_stamp":"2024-03-23T23:58:44.758294+0000","objects_scrubbed":4,"log_size":1207,"log_dups_size":0,"ondisk_log_size":1207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:09:15.822141+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1202,"num_write_kb":4648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'3","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:35.376671+0000","last_change":"2024-03-23T23:58:35.376691+0000","last_active":"2024-03-23T23:58:35.376671+0000","last_peered":"2024-03-23T23:58:35.376671+0000","last_clean":"2024-03-23T23:58:35.376671+0000","last_became_active":"2024-03-23T23:42:49.733197+0000","last_became_peered":"2024-03-23T23:42:49.733197+0000","last_unstale":"2024-03-23T23:58:35.376671+0000","last_undegraded":"2024-03-23T23:58:35.376671+0000","last_fullsized":"2024-03-23T23:58:35.376671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-03-23T23:58:35.376594+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-03-23T23:58:35.376594+0000","last_clean_scrub_stamp":"2024-03-23T23:58:35.376594+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:05:35.471060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"27'4661","reported_seq":4684,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.414564+0000","last_change":"2024-03-23T23:42:50.756687+0000","last_active":"2024-03-23T23:58:30.414564+0000","last_peered":"2024-03-23T23:58:30.414564+0000","last_clean":"2024-03-23T23:58:30.414564+0000","last_became_active":"2024-03-23T23:42:50.756371+0000","last_became_peered":"2024-03-23T23:42:50.756371+0000","last_unstale":"2024-03-23T23:58:30.414564+0000","last_undegraded":"2024-03-23T23:58:30.414564+0000","last_fullsized":"2024-03-23T23:58:30.414564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4661,"log_dups_size":0,"ondisk_log_size":4661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69148,"num_write_kb":786028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'6424","reported_seq":6463,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:47.679637+0000","last_change":"2024-03-23T23:58:47.679657+0000","last_active":"2024-03-23T23:58:47.679637+0000","last_peered":"2024-03-23T23:58:47.679637+0000","last_clean":"2024-03-23T23:58:47.679637+0000","last_became_active":"2024-03-23T23:42:40.682798+0000","last_became_peered":"2024-03-23T23:42:40.682798+0000","last_unstale":"2024-03-23T23:58:47.679637+0000","last_undegraded":"2024-03-23T23:58:47.679637+0000","last_fullsized":"2024-03-23T23:58:47.679637+0000","mapping_epoch":19,"log_start":"27'900","ondisk_log_start":"27'900","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6424","last_scrub_stamp":"2024-03-23T23:58:47.679553+0000","last_deep_scrub":"27'6424","last_deep_scrub_stamp":"2024-03-23T23:58:47.679553+0000","last_clean_scrub_stamp":"2024-03-23T23:58:47.679553+0000","objects_scrubbed":0,"log_size":5524,"log_dups_size":0,"ondisk_log_size":5524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:44:38.712935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96000,"num_write_kb":1116606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'31","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:45.302427+0000","last_change":"2024-03-23T23:58:45.302452+0000","last_active":"2024-03-23T23:58:45.302427+0000","last_peered":"2024-03-23T23:58:45.302427+0000","last_clean":"2024-03-23T23:58:45.302427+0000","last_became_active":"2024-03-23T23:42:39.681364+0000","last_became_peered":"2024-03-23T23:42:39.681364+0000","last_unstale":"2024-03-23T23:58:45.302427+0000","last_undegraded":"2024-03-23T23:58:45.302427+0000","last_fullsized":"2024-03-23T23:58:45.302427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2024-03-23T23:58:45.302367+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2024-03-23T23:58:45.302367+0000","last_clean_scrub_stamp":"2024-03-23T23:58:45.302367+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:37:33.284717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'51","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:49.739392+0000","last_change":"2024-03-23T23:58:49.739420+0000","last_active":"2024-03-23T23:58:49.739392+0000","last_peered":"2024-03-23T23:58:49.739392+0000","last_clean":"2024-03-23T23:58:49.739392+0000","last_became_active":"2024-03-23T23:42:49.723058+0000","last_became_peered":"2024-03-23T23:42:49.723058+0000","last_unstale":"2024-03-23T23:58:49.739392+0000","last_undegraded":"2024-03-23T23:58:49.739392+0000","last_fullsized":"2024-03-23T23:58:49.739392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'51","last_scrub_stamp":"2024-03-23T23:58:49.739323+0000","last_deep_scrub":"27'51","last_deep_scrub_stamp":"2024-03-23T23:58:49.739323+0000","last_clean_scrub_stamp":"2024-03-23T23:58:49.739323+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:04:24.758915+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":8215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"27'4271","reported_seq":4298,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-23T23:58:52.702136+0000","last_change":"2024-03-23T23:58:52.701942+0000","last_active":"2024-03-23T23:58:52.702136+0000","last_peered":"2024-03-23T23:58:52.702136+0000","last_clean":"2024-03-23T23:58:52.702136+0000","last_became_active":"2024-03-23T23:42:50.746104+0000","last_became_peered":"2024-03-23T23:42:50.746104+0000","last_unstale":"2024-03-23T23:58:52.702136+0000","last_undegraded":"2024-03-23T23:58:52.702136+0000","last_fullsized":"2024-03-23T23:58:52.702136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4271,"log_dups_size":0,"ondisk_log_size":4271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63135,"num_write_kb":732213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"27'5366","reported_seq":5410,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:54.215123+0000","last_change":"2024-03-23T23:58:54.215145+0000","last_active":"2024-03-23T23:58:54.215123+0000","last_peered":"2024-03-23T23:58:54.215123+0000","last_clean":"2024-03-23T23:58:54.215123+0000","last_became_active":"2024-03-23T23:43:22.035573+0000","last_became_peered":"2024-03-23T23:43:22.035573+0000","last_unstale":"2024-03-23T23:58:54.215123+0000","last_undegraded":"2024-03-23T23:58:54.215123+0000","last_fullsized":"2024-03-23T23:58:54.215123+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5366","last_scrub_stamp":"2024-03-23T23:58:54.214997+0000","last_deep_scrub":"27'5366","last_deep_scrub_stamp":"2024-03-23T23:58:54.214997+0000","last_clean_scrub_stamp":"2024-03-23T23:58:54.214997+0000","objects_scrubbed":0,"log_size":5366,"log_dups_size":0,"ondisk_log_size":5366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:08:48.605393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80141,"num_write_kb":923583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'4","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:52.402141+0000","last_change":"2024-03-23T23:58:52.402161+0000","last_active":"2024-03-23T23:58:52.402141+0000","last_peered":"2024-03-23T23:58:52.402141+0000","last_clean":"2024-03-23T23:58:52.402141+0000","last_became_active":"2024-03-23T23:42:39.687473+0000","last_became_peered":"2024-03-23T23:42:39.687473+0000","last_unstale":"2024-03-23T23:58:52.402141+0000","last_undegraded":"2024-03-23T23:58:52.402141+0000","last_fullsized":"2024-03-23T23:58:52.402141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-03-23T23:58:52.402065+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-03-23T23:58:52.402065+0000","last_clean_scrub_stamp":"2024-03-23T23:58:52.402065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:34:59.027137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'19","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:38.258184+0000","last_change":"2024-03-23T23:58:38.258184+0000","last_active":"2024-03-23T23:58:38.258184+0000","last_peered":"2024-03-23T23:58:38.258184+0000","last_clean":"2024-03-23T23:58:38.258184+0000","last_became_active":"2024-03-23T23:42:49.748389+0000","last_became_peered":"2024-03-23T23:42:49.748389+0000","last_unstale":"2024-03-23T23:58:38.258184+0000","last_undegraded":"2024-03-23T23:58:38.258184+0000","last_fullsized":"2024-03-23T23:58:38.258184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-03-23T23:58:38.258086+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-03-23T23:58:38.258086+0000","last_clean_scrub_stamp":"2024-03-23T23:58:38.258086+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:23:10.030147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"27'4548","reported_seq":4579,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:47.295217+0000","last_change":"2024-03-23T23:58:47.295239+0000","last_active":"2024-03-23T23:58:47.295217+0000","last_peered":"2024-03-23T23:58:47.295217+0000","last_clean":"2024-03-23T23:58:47.295217+0000","last_became_active":"2024-03-23T23:42:50.749066+0000","last_became_peered":"2024-03-23T23:42:50.749066+0000","last_unstale":"2024-03-23T23:58:47.295217+0000","last_undegraded":"2024-03-23T23:58:47.295217+0000","last_fullsized":"2024-03-23T23:58:47.295217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4548","last_scrub_stamp":"2024-03-23T23:58:47.295124+0000","last_deep_scrub":"27'4548","last_deep_scrub_stamp":"2024-03-23T23:58:47.295124+0000","last_clean_scrub_stamp":"2024-03-23T23:58:47.295124+0000","objects_scrubbed":0,"log_size":4548,"log_dups_size":0,"ondisk_log_size":4548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:39:32.364445+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67689,"num_write_kb":774425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'5741","reported_seq":5766,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:50.988365+0000","last_change":"2024-03-23T23:58:50.988387+0000","last_active":"2024-03-23T23:58:50.988365+0000","last_peered":"2024-03-23T23:58:50.988365+0000","last_clean":"2024-03-23T23:58:50.988365+0000","last_became_active":"2024-03-23T23:43:22.034063+0000","last_became_peered":"2024-03-23T23:43:22.034063+0000","last_unstale":"2024-03-23T23:58:50.988365+0000","last_undegraded":"2024-03-23T23:58:50.988365+0000","last_fullsized":"2024-03-23T23:58:50.988365+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5741","last_scrub_stamp":"2024-03-23T23:58:50.988280+0000","last_deep_scrub":"27'5741","last_deep_scrub_stamp":"2024-03-23T23:58:50.988280+0000","last_clean_scrub_stamp":"2024-03-23T23:58:50.988280+0000","objects_scrubbed":0,"log_size":5741,"log_dups_size":0,"ondisk_log_size":5741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:37:02.901993+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85448,"num_write_kb":1013349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'3","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:43.719613+0000","last_change":"2024-03-23T23:58:43.719657+0000","last_active":"2024-03-23T23:58:43.719613+0000","last_peered":"2024-03-23T23:58:43.719613+0000","last_clean":"2024-03-23T23:58:43.719613+0000","last_became_active":"2024-03-23T23:42:39.684360+0000","last_became_peered":"2024-03-23T23:42:39.684360+0000","last_unstale":"2024-03-23T23:58:43.719613+0000","last_undegraded":"2024-03-23T23:58:43.719613+0000","last_fullsized":"2024-03-23T23:58:43.719613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-03-23T23:58:43.719467+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-03-23T23:58:43.719467+0000","last_clean_scrub_stamp":"2024-03-23T23:58:43.719467+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:54:51.318427+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'5","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:37.234941+0000","last_change":"2024-03-23T23:58:37.234983+0000","last_active":"2024-03-23T23:58:37.234941+0000","last_peered":"2024-03-23T23:58:37.234941+0000","last_clean":"2024-03-23T23:58:37.234941+0000","last_became_active":"2024-03-23T23:42:49.741270+0000","last_became_peered":"2024-03-23T23:42:49.741270+0000","last_unstale":"2024-03-23T23:58:37.234941+0000","last_undegraded":"2024-03-23T23:58:37.234941+0000","last_fullsized":"2024-03-23T23:58:37.234941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-03-23T23:58:37.234796+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-03-23T23:58:37.234796+0000","last_clean_scrub_stamp":"2024-03-23T23:58:37.234796+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:12:15.047909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"27'7540","reported_seq":7564,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.488145+0000","last_change":"2024-03-23T23:42:50.751992+0000","last_active":"2024-03-23T23:58:30.488145+0000","last_peered":"2024-03-23T23:58:30.488145+0000","last_clean":"2024-03-23T23:58:30.488145+0000","last_became_active":"2024-03-23T23:42:50.748281+0000","last_became_peered":"2024-03-23T23:42:50.748281+0000","last_unstale":"2024-03-23T23:58:30.488145+0000","last_undegraded":"2024-03-23T23:58:30.488145+0000","last_fullsized":"2024-03-23T23:58:30.488145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":7540,"log_dups_size":0,"ondisk_log_size":7540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112036,"num_write_kb":1284404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"27'35","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:49.239030+0000","last_change":"2024-03-23T23:58:49.239052+0000","last_active":"2024-03-23T23:58:49.239030+0000","last_peered":"2024-03-23T23:58:49.239030+0000","last_clean":"2024-03-23T23:58:49.239030+0000","last_became_active":"2024-03-23T23:42:49.740899+0000","last_became_peered":"2024-03-23T23:42:49.740899+0000","last_unstale":"2024-03-23T23:58:49.239030+0000","last_undegraded":"2024-03-23T23:58:49.239030+0000","last_fullsized":"2024-03-23T23:58:49.239030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2024-03-23T23:58:49.238959+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2024-03-23T23:58:49.238959+0000","last_clean_scrub_stamp":"2024-03-23T23:58:49.238959+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:15:48.097822+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'6202","reported_seq":6241,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:43.324725+0000","last_change":"2024-03-23T23:58:43.324765+0000","last_active":"2024-03-23T23:58:43.324725+0000","last_peered":"2024-03-23T23:58:43.324725+0000","last_clean":"2024-03-23T23:58:43.324725+0000","last_became_active":"2024-03-23T23:42:40.679070+0000","last_became_peered":"2024-03-23T23:42:40.679070+0000","last_unstale":"2024-03-23T23:58:43.324725+0000","last_undegraded":"2024-03-23T23:58:43.324725+0000","last_fullsized":"2024-03-23T23:58:43.324725+0000","mapping_epoch":19,"log_start":"27'500","ondisk_log_start":"27'500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6202","last_scrub_stamp":"2024-03-23T23:58:43.324609+0000","last_deep_scrub":"27'6202","last_deep_scrub_stamp":"2024-03-23T23:58:43.324609+0000","last_clean_scrub_stamp":"2024-03-23T23:58:43.324609+0000","objects_scrubbed":0,"log_size":5702,"log_dups_size":0,"ondisk_log_size":5702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:00:45.620370+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92139,"num_write_kb":1051130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'30","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:49.432197+0000","last_change":"2024-03-23T23:58:49.432224+0000","last_active":"2024-03-23T23:58:49.432197+0000","last_peered":"2024-03-23T23:58:49.432197+0000","last_clean":"2024-03-23T23:58:49.432197+0000","last_became_active":"2024-03-23T23:42:39.682584+0000","last_became_peered":"2024-03-23T23:42:39.682584+0000","last_unstale":"2024-03-23T23:58:49.432197+0000","last_undegraded":"2024-03-23T23:58:49.432197+0000","last_fullsized":"2024-03-23T23:58:49.432197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-03-23T23:58:49.432120+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-03-23T23:58:49.432120+0000","last_clean_scrub_stamp":"2024-03-23T23:58:49.432120+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:57:16.880369+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":8211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"27'5271","reported_seq":5303,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:50.242425+0000","last_change":"2024-03-23T23:58:50.242447+0000","last_active":"2024-03-23T23:58:50.242425+0000","last_peered":"2024-03-23T23:58:50.242425+0000","last_clean":"2024-03-23T23:58:50.242425+0000","last_became_active":"2024-03-23T23:42:50.751598+0000","last_became_peered":"2024-03-23T23:42:50.751598+0000","last_unstale":"2024-03-23T23:58:50.242425+0000","last_undegraded":"2024-03-23T23:58:50.242425+0000","last_fullsized":"2024-03-23T23:58:50.242425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5271","last_scrub_stamp":"2024-03-23T23:58:50.242340+0000","last_deep_scrub":"27'5271","last_deep_scrub_stamp":"2024-03-23T23:58:50.242340+0000","last_clean_scrub_stamp":"2024-03-23T23:58:50.242340+0000","objects_scrubbed":0,"log_size":5271,"log_dups_size":0,"ondisk_log_size":5271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:41:22.990978+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78296,"num_write_kb":918025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"27'28","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:50.784213+0000","last_change":"2024-03-23T23:58:50.784268+0000","last_active":"2024-03-23T23:58:50.784213+0000","last_peered":"2024-03-23T23:58:50.784213+0000","last_clean":"2024-03-23T23:58:50.784213+0000","last_became_active":"2024-03-23T23:42:49.734309+0000","last_became_peered":"2024-03-23T23:42:49.734309+0000","last_unstale":"2024-03-23T23:58:50.784213+0000","last_undegraded":"2024-03-23T23:58:50.784213+0000","last_fullsized":"2024-03-23T23:58:50.784213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2024-03-23T23:58:50.784091+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2024-03-23T23:58:50.784091+0000","last_clean_scrub_stamp":"2024-03-23T23:58:50.784091+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:44:41.817473+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'5383","reported_seq":5422,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:54.457686+0000","last_change":"2024-03-23T23:58:54.457706+0000","last_active":"2024-03-23T23:58:54.457686+0000","last_peered":"2024-03-23T23:58:54.457686+0000","last_clean":"2024-03-23T23:58:54.457686+0000","last_became_active":"2024-03-23T23:42:40.674366+0000","last_became_peered":"2024-03-23T23:42:40.674366+0000","last_unstale":"2024-03-23T23:58:54.457686+0000","last_undegraded":"2024-03-23T23:58:54.457686+0000","last_fullsized":"2024-03-23T23:58:54.457686+0000","mapping_epoch":19,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5383","last_scrub_stamp":"2024-03-23T23:58:54.457619+0000","last_deep_scrub":"27'5383","last_deep_scrub_stamp":"2024-03-23T23:58:54.457619+0000","last_clean_scrub_stamp":"2024-03-23T23:58:54.457619+0000","objects_scrubbed":0,"log_size":5283,"log_dups_size":0,"ondisk_log_size":5283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:03:13.652175+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80001,"num_write_kb":974706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'8","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:52.462516+0000","last_change":"2024-03-23T23:58:52.462538+0000","last_active":"2024-03-23T23:58:52.462516+0000","last_peered":"2024-03-23T23:58:52.462516+0000","last_clean":"2024-03-23T23:58:52.462516+0000","last_became_active":"2024-03-23T23:42:39.687489+0000","last_became_peered":"2024-03-23T23:42:39.687489+0000","last_unstale":"2024-03-23T23:58:52.462516+0000","last_undegraded":"2024-03-23T23:58:52.462516+0000","last_fullsized":"2024-03-23T23:58:52.462516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-03-23T23:58:52.462437+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-03-23T23:58:52.462437+0000","last_clean_scrub_stamp":"2024-03-23T23:58:52.462437+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:12:58.928864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"27'6132","reported_seq":6163,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:53.371716+0000","last_change":"2024-03-23T23:58:53.371738+0000","last_active":"2024-03-23T23:58:53.371716+0000","last_peered":"2024-03-23T23:58:53.371716+0000","last_clean":"2024-03-23T23:58:53.371716+0000","last_became_active":"2024-03-23T23:42:50.747154+0000","last_became_peered":"2024-03-23T23:42:50.747154+0000","last_unstale":"2024-03-23T23:58:53.371716+0000","last_undegraded":"2024-03-23T23:58:53.371716+0000","last_fullsized":"2024-03-23T23:58:53.371716+0000","mapping_epoch":23,"log_start":"27'400","ondisk_log_start":"27'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6132","last_scrub_stamp":"2024-03-23T23:58:53.371651+0000","last_deep_scrub":"27'6132","last_deep_scrub_stamp":"2024-03-23T23:58:53.371651+0000","last_clean_scrub_stamp":"2024-03-23T23:58:53.371651+0000","objects_scrubbed":0,"log_size":5732,"log_dups_size":0,"ondisk_log_size":5732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:22:45.398741+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91134,"num_write_kb":1034218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"27'18","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:41.730821+0000","last_change":"2024-03-23T23:58:41.730867+0000","last_active":"2024-03-23T23:58:41.730821+0000","last_peered":"2024-03-23T23:58:41.730821+0000","last_clean":"2024-03-23T23:58:41.730821+0000","last_became_active":"2024-03-23T23:42:39.681158+0000","last_became_peered":"2024-03-23T23:42:39.681158+0000","last_unstale":"2024-03-23T23:58:41.730821+0000","last_undegraded":"2024-03-23T23:58:41.730821+0000","last_fullsized":"2024-03-23T23:58:41.730821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-03-23T23:58:41.730732+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-03-23T23:58:41.730732+0000","last_clean_scrub_stamp":"2024-03-23T23:58:41.730732+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:12:15.190633+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'4519","reported_seq":4558,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:43.251805+0000","last_change":"2024-03-23T23:58:43.251826+0000","last_active":"2024-03-23T23:58:43.251805+0000","last_peered":"2024-03-23T23:58:43.251805+0000","last_clean":"2024-03-23T23:58:43.251805+0000","last_became_active":"2024-03-23T23:42:40.675877+0000","last_became_peered":"2024-03-23T23:42:40.675877+0000","last_unstale":"2024-03-23T23:58:43.251805+0000","last_undegraded":"2024-03-23T23:58:43.251805+0000","last_fullsized":"2024-03-23T23:58:43.251805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4519","last_scrub_stamp":"2024-03-23T23:58:43.251745+0000","last_deep_scrub":"27'4519","last_deep_scrub_stamp":"2024-03-23T23:58:43.251745+0000","last_clean_scrub_stamp":"2024-03-23T23:58:43.251745+0000","objects_scrubbed":0,"log_size":4519,"log_dups_size":0,"ondisk_log_size":4519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:36:55.165458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67585,"num_write_kb":780136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'21","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:44.044679+0000","last_change":"2024-03-23T23:58:44.044723+0000","last_active":"2024-03-23T23:58:44.044679+0000","last_peered":"2024-03-23T23:58:44.044679+0000","last_clean":"2024-03-23T23:58:44.044679+0000","last_became_active":"2024-03-23T23:42:49.732943+0000","last_became_peered":"2024-03-23T23:42:49.732943+0000","last_unstale":"2024-03-23T23:58:44.044679+0000","last_undegraded":"2024-03-23T23:58:44.044679+0000","last_fullsized":"2024-03-23T23:58:44.044679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2024-03-23T23:58:44.044587+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2024-03-23T23:58:44.044587+0000","last_clean_scrub_stamp":"2024-03-23T23:58:44.044587+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:40.926549+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"27'4603","reported_seq":4626,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.452618+0000","last_change":"2024-03-23T23:42:50.752722+0000","last_active":"2024-03-23T23:58:30.452618+0000","last_peered":"2024-03-23T23:58:30.452618+0000","last_clean":"2024-03-23T23:58:30.452618+0000","last_became_active":"2024-03-23T23:42:50.749400+0000","last_became_peered":"2024-03-23T23:42:50.749400+0000","last_unstale":"2024-03-23T23:58:30.452618+0000","last_undegraded":"2024-03-23T23:58:30.452618+0000","last_fullsized":"2024-03-23T23:58:30.452618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4603,"log_dups_size":0,"ondisk_log_size":4603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67787,"num_write_kb":753464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'1304","reported_seq":1345,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:51.500783+0000","last_change":"2024-03-23T23:58:51.500807+0000","last_active":"2024-03-23T23:58:51.500783+0000","last_peered":"2024-03-23T23:58:51.500783+0000","last_clean":"2024-03-23T23:58:51.500783+0000","last_became_active":"2024-03-23T23:42:39.687423+0000","last_became_peered":"2024-03-23T23:42:39.687423+0000","last_unstale":"2024-03-23T23:58:51.500783+0000","last_undegraded":"2024-03-23T23:58:51.500783+0000","last_fullsized":"2024-03-23T23:58:51.500783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1304","last_scrub_stamp":"2024-03-23T23:58:51.500703+0000","last_deep_scrub":"27'1304","last_deep_scrub_stamp":"2024-03-23T23:58:51.500703+0000","last_clean_scrub_stamp":"2024-03-23T23:58:51.500703+0000","objects_scrubbed":1,"log_size":1304,"log_dups_size":0,"ondisk_log_size":1304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:11:04.795232+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1297,"num_write_kb":4300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'4605","reported_seq":4644,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:45.696120+0000","last_change":"2024-03-23T23:58:45.696140+0000","last_active":"2024-03-23T23:58:45.696120+0000","last_peered":"2024-03-23T23:58:45.696120+0000","last_clean":"2024-03-23T23:58:45.696120+0000","last_became_active":"2024-03-23T23:42:40.680511+0000","last_became_peered":"2024-03-23T23:42:40.680511+0000","last_unstale":"2024-03-23T23:58:45.696120+0000","last_undegraded":"2024-03-23T23:58:45.696120+0000","last_fullsized":"2024-03-23T23:58:45.696120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4605","last_scrub_stamp":"2024-03-23T23:58:45.696057+0000","last_deep_scrub":"27'4605","last_deep_scrub_stamp":"2024-03-23T23:58:45.696057+0000","last_clean_scrub_stamp":"2024-03-23T23:58:45.696057+0000","objects_scrubbed":0,"log_size":4605,"log_dups_size":0,"ondisk_log_size":4605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:22:53.042583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68637,"num_write_kb":787014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'94","reported_seq":127,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:44.479150+0000","last_change":"2024-03-23T23:58:44.479178+0000","last_active":"2024-03-23T23:58:44.479150+0000","last_peered":"2024-03-23T23:58:44.479150+0000","last_clean":"2024-03-23T23:58:44.479150+0000","last_became_active":"2024-03-23T23:42:49.749695+0000","last_became_peered":"2024-03-23T23:42:49.749695+0000","last_unstale":"2024-03-23T23:58:44.479150+0000","last_undegraded":"2024-03-23T23:58:44.479150+0000","last_fullsized":"2024-03-23T23:58:44.479150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'94","last_scrub_stamp":"2024-03-23T23:58:44.479077+0000","last_deep_scrub":"27'94","last_deep_scrub_stamp":"2024-03-23T23:58:44.479077+0000","last_clean_scrub_stamp":"2024-03-23T23:58:44.479077+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:46:40.863478+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":12324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"27'4656","reported_seq":4680,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.508935+0000","last_change":"2024-03-23T23:42:50.752672+0000","last_active":"2024-03-23T23:58:30.508935+0000","last_peered":"2024-03-23T23:58:30.508935+0000","last_clean":"2024-03-23T23:58:30.508935+0000","last_became_active":"2024-03-23T23:42:50.752394+0000","last_became_peered":"2024-03-23T23:42:50.752394+0000","last_unstale":"2024-03-23T23:58:30.508935+0000","last_undegraded":"2024-03-23T23:58:30.508935+0000","last_fullsized":"2024-03-23T23:58:30.508935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4656,"log_dups_size":0,"ondisk_log_size":4656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69093,"num_write_kb":797343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'5268","reported_seq":5308,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:47.793298+0000","last_change":"2024-03-23T23:58:47.793321+0000","last_active":"2024-03-23T23:58:47.793298+0000","last_peered":"2024-03-23T23:58:47.793298+0000","last_clean":"2024-03-23T23:58:47.793298+0000","last_became_active":"2024-03-23T23:42:40.678518+0000","last_became_peered":"2024-03-23T23:42:40.678518+0000","last_unstale":"2024-03-23T23:58:47.793298+0000","last_undegraded":"2024-03-23T23:58:47.793298+0000","last_fullsized":"2024-03-23T23:58:47.793298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5268","last_scrub_stamp":"2024-03-23T23:58:47.793198+0000","last_deep_scrub":"27'5268","last_deep_scrub_stamp":"2024-03-23T23:58:47.793198+0000","last_clean_scrub_stamp":"2024-03-23T23:58:47.793198+0000","objects_scrubbed":0,"log_size":5268,"log_dups_size":0,"ondisk_log_size":5268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:27:37.192152+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78308,"num_write_kb":963226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"27'6097","reported_seq":6121,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.398093+0000","last_change":"2024-03-23T23:42:50.757132+0000","last_active":"2024-03-23T23:58:30.398093+0000","last_peered":"2024-03-23T23:58:30.398093+0000","last_clean":"2024-03-23T23:58:30.398093+0000","last_became_active":"2024-03-23T23:42:50.756813+0000","last_became_peered":"2024-03-23T23:42:50.756813+0000","last_unstale":"2024-03-23T23:58:30.398093+0000","last_undegraded":"2024-03-23T23:58:30.398093+0000","last_fullsized":"2024-03-23T23:58:30.398093+0000","mapping_epoch":23,"log_start":"27'400","ondisk_log_start":"27'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5697,"log_dups_size":0,"ondisk_log_size":5697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90451,"num_write_kb":1016115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"27'5502","reported_seq":5542,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:43.125913+0000","last_change":"2024-03-23T23:58:43.125937+0000","last_active":"2024-03-23T23:58:43.125913+0000","last_peered":"2024-03-23T23:58:43.125913+0000","last_clean":"2024-03-23T23:58:43.125913+0000","last_became_active":"2024-03-23T23:42:40.701398+0000","last_became_peered":"2024-03-23T23:42:40.701398+0000","last_unstale":"2024-03-23T23:58:43.125913+0000","last_undegraded":"2024-03-23T23:58:43.125913+0000","last_fullsized":"2024-03-23T23:58:43.125913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5502","last_scrub_stamp":"2024-03-23T23:58:43.125831+0000","last_deep_scrub":"27'5502","last_deep_scrub_stamp":"2024-03-23T23:58:43.125831+0000","last_clean_scrub_stamp":"2024-03-23T23:58:43.125831+0000","objects_scrubbed":0,"log_size":5502,"log_dups_size":0,"ondisk_log_size":5502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:25:46.932807+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81712,"num_write_kb":960011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"27'5509","reported_seq":5533,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.457093+0000","last_change":"2024-03-23T23:42:50.756769+0000","last_active":"2024-03-23T23:58:30.457093+0000","last_peered":"2024-03-23T23:58:30.457093+0000","last_clean":"2024-03-23T23:58:30.457093+0000","last_became_active":"2024-03-23T23:42:50.756503+0000","last_became_peered":"2024-03-23T23:42:50.756503+0000","last_unstale":"2024-03-23T23:58:30.457093+0000","last_undegraded":"2024-03-23T23:58:30.457093+0000","last_fullsized":"2024-03-23T23:58:30.457093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5509,"log_dups_size":0,"ondisk_log_size":5509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81671,"num_write_kb":934046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"27'5990","reported_seq":6027,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.684194+0000","last_change":"2024-03-23T23:43:22.035915+0000","last_active":"2024-03-23T23:58:27.684194+0000","last_peered":"2024-03-23T23:58:27.684194+0000","last_clean":"2024-03-23T23:58:27.684194+0000","last_became_active":"2024-03-23T23:43:22.035611+0000","last_became_peered":"2024-03-23T23:43:22.035611+0000","last_unstale":"2024-03-23T23:58:27.684194+0000","last_undegraded":"2024-03-23T23:58:27.684194+0000","last_fullsized":"2024-03-23T23:58:27.684194+0000","mapping_epoch":26,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5890,"log_dups_size":0,"ondisk_log_size":5890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89084,"num_write_kb":1042929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"27'5555","reported_seq":5587,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:54.377832+0000","last_change":"2024-03-23T23:58:54.377853+0000","last_active":"2024-03-23T23:58:54.377832+0000","last_peered":"2024-03-23T23:58:54.377832+0000","last_clean":"2024-03-23T23:58:54.377832+0000","last_became_active":"2024-03-23T23:42:50.748105+0000","last_became_peered":"2024-03-23T23:42:50.748105+0000","last_unstale":"2024-03-23T23:58:54.377832+0000","last_undegraded":"2024-03-23T23:58:54.377832+0000","last_fullsized":"2024-03-23T23:58:54.377832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5555","last_scrub_stamp":"2024-03-23T23:58:54.377748+0000","last_deep_scrub":"27'5555","last_deep_scrub_stamp":"2024-03-23T23:58:54.377748+0000","last_clean_scrub_stamp":"2024-03-23T23:58:54.377748+0000","objects_scrubbed":0,"log_size":5555,"log_dups_size":0,"ondisk_log_size":5555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:28:03.603175+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82238,"num_write_kb":945396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"27'5030","reported_seq":5070,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:41.264470+0000","last_change":"2024-03-23T23:58:41.264510+0000","last_active":"2024-03-23T23:58:41.264470+0000","last_peered":"2024-03-23T23:58:41.264470+0000","last_clean":"2024-03-23T23:58:41.264470+0000","last_became_active":"2024-03-23T23:42:40.672910+0000","last_became_peered":"2024-03-23T23:42:40.672910+0000","last_unstale":"2024-03-23T23:58:41.264470+0000","last_undegraded":"2024-03-23T23:58:41.264470+0000","last_fullsized":"2024-03-23T23:58:41.264470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5030","last_scrub_stamp":"2024-03-23T23:58:41.264389+0000","last_deep_scrub":"27'5030","last_deep_scrub_stamp":"2024-03-23T23:58:41.264389+0000","last_clean_scrub_stamp":"2024-03-23T23:58:41.264389+0000","objects_scrubbed":0,"log_size":5030,"log_dups_size":0,"ondisk_log_size":5030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:32:18.093448+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74941,"num_write_kb":923200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"27'5968","reported_seq":6000,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:49.309308+0000","last_change":"2024-03-23T23:58:49.309331+0000","last_active":"2024-03-23T23:58:49.309308+0000","last_peered":"2024-03-23T23:58:49.309308+0000","last_clean":"2024-03-23T23:58:49.309308+0000","last_became_active":"2024-03-23T23:42:50.749908+0000","last_became_peered":"2024-03-23T23:42:50.749908+0000","last_unstale":"2024-03-23T23:58:49.309308+0000","last_undegraded":"2024-03-23T23:58:49.309308+0000","last_fullsized":"2024-03-23T23:58:49.309308+0000","mapping_epoch":23,"log_start":"27'300","ondisk_log_start":"27'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5968","last_scrub_stamp":"2024-03-23T23:58:49.309208+0000","last_deep_scrub":"27'5968","last_deep_scrub_stamp":"2024-03-23T23:58:49.309208+0000","last_clean_scrub_stamp":"2024-03-23T23:58:49.309208+0000","objects_scrubbed":0,"log_size":5668,"log_dups_size":0,"ondisk_log_size":5668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:17:25.701341+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88637,"num_write_kb":993297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"27'5454","reported_seq":5494,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:47.500388+0000","last_change":"2024-03-23T23:58:47.500409+0000","last_active":"2024-03-23T23:58:47.500388+0000","last_peered":"2024-03-23T23:58:47.500388+0000","last_clean":"2024-03-23T23:58:47.500388+0000","last_became_active":"2024-03-23T23:42:40.685120+0000","last_became_peered":"2024-03-23T23:42:40.685120+0000","last_unstale":"2024-03-23T23:58:47.500388+0000","last_undegraded":"2024-03-23T23:58:47.500388+0000","last_fullsized":"2024-03-23T23:58:47.500388+0000","mapping_epoch":19,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5454","last_scrub_stamp":"2024-03-23T23:58:47.500309+0000","last_deep_scrub":"27'5454","last_deep_scrub_stamp":"2024-03-23T23:58:47.500309+0000","last_clean_scrub_stamp":"2024-03-23T23:58:47.500309+0000","objects_scrubbed":0,"log_size":5354,"log_dups_size":0,"ondisk_log_size":5354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:00:05.817948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81249,"num_write_kb":968622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"27'5340","reported_seq":5364,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.454782+0000","last_change":"2024-03-23T23:42:50.747361+0000","last_active":"2024-03-23T23:58:30.454782+0000","last_peered":"2024-03-23T23:58:30.454782+0000","last_clean":"2024-03-23T23:58:30.454782+0000","last_became_active":"2024-03-23T23:42:50.746310+0000","last_became_peered":"2024-03-23T23:42:50.746310+0000","last_unstale":"2024-03-23T23:58:30.454782+0000","last_undegraded":"2024-03-23T23:58:30.454782+0000","last_fullsized":"2024-03-23T23:58:30.454782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5340,"log_dups_size":0,"ondisk_log_size":5340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79170,"num_write_kb":877684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"27'5337","reported_seq":5377,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:50.341522+0000","last_change":"2024-03-23T23:58:50.341542+0000","last_active":"2024-03-23T23:58:50.341522+0000","last_peered":"2024-03-23T23:58:50.341522+0000","last_clean":"2024-03-23T23:58:50.341522+0000","last_became_active":"2024-03-23T23:42:40.676912+0000","last_became_peered":"2024-03-23T23:42:40.676912+0000","last_unstale":"2024-03-23T23:58:50.341522+0000","last_undegraded":"2024-03-23T23:58:50.341522+0000","last_fullsized":"2024-03-23T23:58:50.341522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5337","last_scrub_stamp":"2024-03-23T23:58:50.341447+0000","last_deep_scrub":"27'5337","last_deep_scrub_stamp":"2024-03-23T23:58:50.341447+0000","last_clean_scrub_stamp":"2024-03-23T23:58:50.341447+0000","objects_scrubbed":0,"log_size":5337,"log_dups_size":0,"ondisk_log_size":5337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:00:56.513223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79200,"num_write_kb":983244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"27'5397","reported_seq":5429,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:45.276306+0000","last_change":"2024-03-23T23:58:45.276329+0000","last_active":"2024-03-23T23:58:45.276306+0000","last_peered":"2024-03-23T23:58:45.276306+0000","last_clean":"2024-03-23T23:58:45.276306+0000","last_became_active":"2024-03-23T23:42:50.748798+0000","last_became_peered":"2024-03-23T23:42:50.748798+0000","last_unstale":"2024-03-23T23:58:45.276306+0000","last_undegraded":"2024-03-23T23:58:45.276306+0000","last_fullsized":"2024-03-23T23:58:45.276306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5397","last_scrub_stamp":"2024-03-23T23:58:45.276211+0000","last_deep_scrub":"27'5397","last_deep_scrub_stamp":"2024-03-23T23:58:45.276211+0000","last_clean_scrub_stamp":"2024-03-23T23:58:45.276211+0000","objects_scrubbed":0,"log_size":5397,"log_dups_size":0,"ondisk_log_size":5397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:35:50.269065+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80551,"num_write_kb":913314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"27'4480","reported_seq":4520,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:38.740658+0000","last_change":"2024-03-23T23:58:38.740693+0000","last_active":"2024-03-23T23:58:38.740658+0000","last_peered":"2024-03-23T23:58:38.740658+0000","last_clean":"2024-03-23T23:58:38.740658+0000","last_became_active":"2024-03-23T23:42:40.693867+0000","last_became_peered":"2024-03-23T23:42:40.693867+0000","last_unstale":"2024-03-23T23:58:38.740658+0000","last_undegraded":"2024-03-23T23:58:38.740658+0000","last_fullsized":"2024-03-23T23:58:38.740658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4480","last_scrub_stamp":"2024-03-23T23:58:38.740571+0000","last_deep_scrub":"27'4480","last_deep_scrub_stamp":"2024-03-23T23:58:38.740571+0000","last_clean_scrub_stamp":"2024-03-23T23:58:38.740571+0000","objects_scrubbed":0,"log_size":4480,"log_dups_size":0,"ondisk_log_size":4480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:15:57.842005+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66343,"num_write_kb":822171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"27'5452","reported_seq":5476,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.477864+0000","last_change":"2024-03-23T23:42:50.754149+0000","last_active":"2024-03-23T23:58:30.477864+0000","last_peered":"2024-03-23T23:58:30.477864+0000","last_clean":"2024-03-23T23:58:30.477864+0000","last_became_active":"2024-03-23T23:42:50.753471+0000","last_became_peered":"2024-03-23T23:42:50.753471+0000","last_unstale":"2024-03-23T23:58:30.477864+0000","last_undegraded":"2024-03-23T23:58:30.477864+0000","last_fullsized":"2024-03-23T23:58:30.477864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5452,"log_dups_size":0,"ondisk_log_size":5452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80762,"num_write_kb":909623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'5934","reported_seq":5974,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:49.501382+0000","last_change":"2024-03-23T23:58:49.501402+0000","last_active":"2024-03-23T23:58:49.501382+0000","last_peered":"2024-03-23T23:58:49.501382+0000","last_clean":"2024-03-23T23:58:49.501382+0000","last_became_active":"2024-03-23T23:42:40.684495+0000","last_became_peered":"2024-03-23T23:42:40.684495+0000","last_unstale":"2024-03-23T23:58:49.501382+0000","last_undegraded":"2024-03-23T23:58:49.501382+0000","last_fullsized":"2024-03-23T23:58:49.501382+0000","mapping_epoch":19,"log_start":"27'600","ondisk_log_start":"27'600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5934","last_scrub_stamp":"2024-03-23T23:58:49.501310+0000","last_deep_scrub":"27'5934","last_deep_scrub_stamp":"2024-03-23T23:58:49.501310+0000","last_clean_scrub_stamp":"2024-03-23T23:58:49.501310+0000","objects_scrubbed":0,"log_size":5334,"log_dups_size":0,"ondisk_log_size":5334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:44:50.327019+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88442,"num_write_kb":1073631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"27'5682","reported_seq":5714,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:48.542010+0000","last_change":"2024-03-23T23:58:48.542010+0000","last_active":"2024-03-23T23:58:48.542010+0000","last_peered":"2024-03-23T23:58:48.542010+0000","last_clean":"2024-03-23T23:58:48.542010+0000","last_became_active":"2024-03-23T23:42:50.745771+0000","last_became_peered":"2024-03-23T23:42:50.745771+0000","last_unstale":"2024-03-23T23:58:48.542010+0000","last_undegraded":"2024-03-23T23:58:48.542010+0000","last_fullsized":"2024-03-23T23:58:48.542010+0000","mapping_epoch":23,"log_start":"27'400","ondisk_log_start":"27'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5682","last_scrub_stamp":"2024-03-23T23:58:48.541896+0000","last_deep_scrub":"27'5682","last_deep_scrub_stamp":"2024-03-23T23:58:48.541896+0000","last_clean_scrub_stamp":"2024-03-23T23:58:48.541896+0000","objects_scrubbed":0,"log_size":5282,"log_dups_size":0,"ondisk_log_size":5282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:21:14.943558+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83950,"num_write_kb":942381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'5332","reported_seq":5372,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:39.518297+0000","last_change":"2024-03-23T23:58:39.518318+0000","last_active":"2024-03-23T23:58:39.518297+0000","last_peered":"2024-03-23T23:58:39.518297+0000","last_clean":"2024-03-23T23:58:39.518297+0000","last_became_active":"2024-03-23T23:42:40.701566+0000","last_became_peered":"2024-03-23T23:42:40.701566+0000","last_unstale":"2024-03-23T23:58:39.518297+0000","last_undegraded":"2024-03-23T23:58:39.518297+0000","last_fullsized":"2024-03-23T23:58:39.518297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5332","last_scrub_stamp":"2024-03-23T23:58:39.518233+0000","last_deep_scrub":"27'5332","last_deep_scrub_stamp":"2024-03-23T23:58:39.518233+0000","last_clean_scrub_stamp":"2024-03-23T23:58:39.518233+0000","objects_scrubbed":0,"log_size":5332,"log_dups_size":0,"ondisk_log_size":5332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:34:48.598009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79247,"num_write_kb":918114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"27'6956","reported_seq":6979,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.440399+0000","last_change":"2024-03-23T23:42:50.758879+0000","last_active":"2024-03-23T23:58:30.440399+0000","last_peered":"2024-03-23T23:58:30.440399+0000","last_clean":"2024-03-23T23:58:30.440399+0000","last_became_active":"2024-03-23T23:42:50.758564+0000","last_became_peered":"2024-03-23T23:42:50.758564+0000","last_unstale":"2024-03-23T23:58:30.440399+0000","last_undegraded":"2024-03-23T23:58:30.440399+0000","last_fullsized":"2024-03-23T23:58:30.440399+0000","mapping_epoch":23,"log_start":"27'1200","ondisk_log_start":"27'1200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5756,"log_dups_size":0,"ondisk_log_size":5756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103363,"num_write_kb":1190294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"27'4879","reported_seq":4911,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.668209+0000","last_change":"2024-03-23T23:42:40.684899+0000","last_active":"2024-03-23T23:58:27.668209+0000","last_peered":"2024-03-23T23:58:27.668209+0000","last_clean":"2024-03-23T23:58:27.668209+0000","last_became_active":"2024-03-23T23:42:40.684603+0000","last_became_peered":"2024-03-23T23:42:40.684603+0000","last_unstale":"2024-03-23T23:58:27.668209+0000","last_undegraded":"2024-03-23T23:58:27.668209+0000","last_fullsized":"2024-03-23T23:58:27.668209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4879,"log_dups_size":0,"ondisk_log_size":4879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72674,"num_write_kb":866936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"27'4847","reported_seq":4879,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:47.003725+0000","last_change":"2024-03-23T23:58:47.003725+0000","last_active":"2024-03-23T23:58:47.003725+0000","last_peered":"2024-03-23T23:58:47.003725+0000","last_clean":"2024-03-23T23:58:47.003725+0000","last_became_active":"2024-03-23T23:42:50.753602+0000","last_became_peered":"2024-03-23T23:42:50.753602+0000","last_unstale":"2024-03-23T23:58:47.003725+0000","last_undegraded":"2024-03-23T23:58:47.003725+0000","last_fullsized":"2024-03-23T23:58:47.003725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4847","last_scrub_stamp":"2024-03-23T23:58:47.003626+0000","last_deep_scrub":"27'4847","last_deep_scrub_stamp":"2024-03-23T23:58:47.003626+0000","last_clean_scrub_stamp":"2024-03-23T23:58:47.003626+0000","objects_scrubbed":0,"log_size":4847,"log_dups_size":0,"ondisk_log_size":4847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:34:35.473279+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71433,"num_write_kb":836622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"27'5277","reported_seq":5302,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:53.039485+0000","last_change":"2024-03-23T23:58:53.039521+0000","last_active":"2024-03-23T23:58:53.039485+0000","last_peered":"2024-03-23T23:58:53.039485+0000","last_clean":"2024-03-23T23:58:53.039485+0000","last_became_active":"2024-03-23T23:43:22.034831+0000","last_became_peered":"2024-03-23T23:43:22.034831+0000","last_unstale":"2024-03-23T23:58:53.039485+0000","last_undegraded":"2024-03-23T23:58:53.039485+0000","last_fullsized":"2024-03-23T23:58:53.039485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5277","last_scrub_stamp":"2024-03-23T23:58:53.039400+0000","last_deep_scrub":"27'5277","last_deep_scrub_stamp":"2024-03-23T23:58:53.039400+0000","last_clean_scrub_stamp":"2024-03-23T23:58:53.039400+0000","objects_scrubbed":0,"log_size":5277,"log_dups_size":0,"ondisk_log_size":5277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:21:00.433555+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78302,"num_write_kb":947936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2d","version":"27'6041","reported_seq":6073,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:46.501716+0000","last_change":"2024-03-23T23:58:46.501716+0000","last_active":"2024-03-23T23:58:46.501716+0000","last_peered":"2024-03-23T23:58:46.501716+0000","last_clean":"2024-03-23T23:58:46.501716+0000","last_became_active":"2024-03-23T23:42:50.741065+0000","last_became_peered":"2024-03-23T23:42:50.741065+0000","last_unstale":"2024-03-23T23:58:46.501716+0000","last_undegraded":"2024-03-23T23:58:46.501716+0000","last_fullsized":"2024-03-23T23:58:46.501716+0000","mapping_epoch":23,"log_start":"27'700","ondisk_log_start":"27'700","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6041","last_scrub_stamp":"2024-03-23T23:58:46.501602+0000","last_deep_scrub":"27'6041","last_deep_scrub_stamp":"2024-03-23T23:58:46.501602+0000","last_clean_scrub_stamp":"2024-03-23T23:58:46.501602+0000","objects_scrubbed":0,"log_size":5341,"log_dups_size":0,"ondisk_log_size":5341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:15:34.219768+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89207,"num_write_kb":985993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"27'6145","reported_seq":6185,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:36.242909+0000","last_change":"2024-03-23T23:58:36.242950+0000","last_active":"2024-03-23T23:58:36.242909+0000","last_peered":"2024-03-23T23:58:36.242909+0000","last_clean":"2024-03-23T23:58:36.242909+0000","last_became_active":"2024-03-23T23:42:40.688875+0000","last_became_peered":"2024-03-23T23:42:40.688875+0000","last_unstale":"2024-03-23T23:58:36.242909+0000","last_undegraded":"2024-03-23T23:58:36.242909+0000","last_fullsized":"2024-03-23T23:58:36.242909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6145","last_scrub_stamp":"2024-03-23T23:58:36.242781+0000","last_deep_scrub":"27'6145","last_deep_scrub_stamp":"2024-03-23T23:58:36.242781+0000","last_clean_scrub_stamp":"2024-03-23T23:58:36.242781+0000","objects_scrubbed":0,"log_size":6145,"log_dups_size":0,"ondisk_log_size":6145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:13:57.388811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91123,"num_write_kb":1098161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"27'5341","reported_seq":5365,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:32.796480+0000","last_change":"2024-03-23T23:42:50.762055+0000","last_active":"2024-03-23T23:58:32.796480+0000","last_peered":"2024-03-23T23:58:32.796480+0000","last_clean":"2024-03-23T23:58:32.796480+0000","last_became_active":"2024-03-23T23:42:50.761762+0000","last_became_peered":"2024-03-23T23:42:50.761762+0000","last_unstale":"2024-03-23T23:58:32.796480+0000","last_undegraded":"2024-03-23T23:58:32.796480+0000","last_fullsized":"2024-03-23T23:58:32.796480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5341,"log_dups_size":0,"ondisk_log_size":5341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79322,"num_write_kb":913380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'4790","reported_seq":4830,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:40.753446+0000","last_change":"2024-03-23T23:58:40.753446+0000","last_active":"2024-03-23T23:58:40.753446+0000","last_peered":"2024-03-23T23:58:40.753446+0000","last_clean":"2024-03-23T23:58:40.753446+0000","last_became_active":"2024-03-23T23:42:40.683377+0000","last_became_peered":"2024-03-23T23:42:40.683377+0000","last_unstale":"2024-03-23T23:58:40.753446+0000","last_undegraded":"2024-03-23T23:58:40.753446+0000","last_fullsized":"2024-03-23T23:58:40.753446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4790","last_scrub_stamp":"2024-03-23T23:58:40.753338+0000","last_deep_scrub":"27'4790","last_deep_scrub_stamp":"2024-03-23T23:58:40.753338+0000","last_clean_scrub_stamp":"2024-03-23T23:58:40.753338+0000","objects_scrubbed":0,"log_size":4790,"log_dups_size":0,"ondisk_log_size":4790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:39:35.714339+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71235,"num_write_kb":860094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"27'6324","reported_seq":6348,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:36.378977+0000","last_change":"2024-03-23T23:42:50.754372+0000","last_active":"2024-03-23T23:58:36.378977+0000","last_peered":"2024-03-23T23:58:36.378977+0000","last_clean":"2024-03-23T23:58:36.378977+0000","last_became_active":"2024-03-23T23:42:50.754072+0000","last_became_peered":"2024-03-23T23:42:50.754072+0000","last_unstale":"2024-03-23T23:58:36.378977+0000","last_undegraded":"2024-03-23T23:58:36.378977+0000","last_fullsized":"2024-03-23T23:58:36.378977+0000","mapping_epoch":23,"log_start":"27'800","ondisk_log_start":"27'800","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5524,"log_dups_size":0,"ondisk_log_size":5524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93450,"num_write_kb":1059053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"27'5796","reported_seq":5836,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:50.281476+0000","last_change":"2024-03-23T23:58:50.281496+0000","last_active":"2024-03-23T23:58:50.281476+0000","last_peered":"2024-03-23T23:58:50.281476+0000","last_clean":"2024-03-23T23:58:50.281476+0000","last_became_active":"2024-03-23T23:42:40.689111+0000","last_became_peered":"2024-03-23T23:42:40.689111+0000","last_unstale":"2024-03-23T23:58:50.281476+0000","last_undegraded":"2024-03-23T23:58:50.281476+0000","last_fullsized":"2024-03-23T23:58:50.281476+0000","mapping_epoch":19,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5796","last_scrub_stamp":"2024-03-23T23:58:50.281399+0000","last_deep_scrub":"27'5796","last_deep_scrub_stamp":"2024-03-23T23:58:50.281399+0000","last_clean_scrub_stamp":"2024-03-23T23:58:50.281399+0000","objects_scrubbed":0,"log_size":5696,"log_dups_size":0,"ondisk_log_size":5696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:24:11.594155+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86245,"num_write_kb":1027145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"27'5278","reported_seq":5302,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.420571+0000","last_change":"2024-03-23T23:42:50.759792+0000","last_active":"2024-03-23T23:58:30.420571+0000","last_peered":"2024-03-23T23:58:30.420571+0000","last_clean":"2024-03-23T23:58:30.420571+0000","last_became_active":"2024-03-23T23:42:50.759604+0000","last_became_peered":"2024-03-23T23:42:50.759604+0000","last_unstale":"2024-03-23T23:58:30.420571+0000","last_undegraded":"2024-03-23T23:58:30.420571+0000","last_fullsized":"2024-03-23T23:58:30.420571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5278,"log_dups_size":0,"ondisk_log_size":5278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77877,"num_write_kb":893934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"27'5684","reported_seq":5724,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:42.084982+0000","last_change":"2024-03-23T23:58:42.084982+0000","last_active":"2024-03-23T23:58:42.084982+0000","last_peered":"2024-03-23T23:58:42.084982+0000","last_clean":"2024-03-23T23:58:42.084982+0000","last_became_active":"2024-03-23T23:42:40.690690+0000","last_became_peered":"2024-03-23T23:42:40.690690+0000","last_unstale":"2024-03-23T23:58:42.084982+0000","last_undegraded":"2024-03-23T23:58:42.084982+0000","last_fullsized":"2024-03-23T23:58:42.084982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5684","last_scrub_stamp":"2024-03-23T23:58:42.084877+0000","last_deep_scrub":"27'5684","last_deep_scrub_stamp":"2024-03-23T23:58:42.084877+0000","last_clean_scrub_stamp":"2024-03-23T23:58:42.084877+0000","objects_scrubbed":0,"log_size":5684,"log_dups_size":0,"ondisk_log_size":5684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:54:49.162535+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84510,"num_write_kb":984289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"27'4973","reported_seq":5005,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:53.263738+0000","last_change":"2024-03-23T23:58:53.263761+0000","last_active":"2024-03-23T23:58:53.263738+0000","last_peered":"2024-03-23T23:58:53.263738+0000","last_clean":"2024-03-23T23:58:53.263738+0000","last_became_active":"2024-03-23T23:42:50.764563+0000","last_became_peered":"2024-03-23T23:42:50.764563+0000","last_unstale":"2024-03-23T23:58:53.263738+0000","last_undegraded":"2024-03-23T23:58:53.263738+0000","last_fullsized":"2024-03-23T23:58:53.263738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4973","last_scrub_stamp":"2024-03-23T23:58:53.263650+0000","last_deep_scrub":"27'4973","last_deep_scrub_stamp":"2024-03-23T23:58:53.263650+0000","last_clean_scrub_stamp":"2024-03-23T23:58:53.263650+0000","objects_scrubbed":0,"log_size":4973,"log_dups_size":0,"ondisk_log_size":4973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:00:59.435426+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73421,"num_write_kb":840152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"27'6976","reported_seq":7015,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:37.547436+0000","last_change":"2024-03-23T23:58:37.547462+0000","last_active":"2024-03-23T23:58:37.547436+0000","last_peered":"2024-03-23T23:58:37.547436+0000","last_clean":"2024-03-23T23:58:37.547436+0000","last_became_active":"2024-03-23T23:42:40.708031+0000","last_became_peered":"2024-03-23T23:42:40.708031+0000","last_unstale":"2024-03-23T23:58:37.547436+0000","last_undegraded":"2024-03-23T23:58:37.547436+0000","last_fullsized":"2024-03-23T23:58:37.547436+0000","mapping_epoch":19,"log_start":"27'1000","ondisk_log_start":"27'1000","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6976","last_scrub_stamp":"2024-03-23T23:58:37.547344+0000","last_deep_scrub":"27'6976","last_deep_scrub_stamp":"2024-03-23T23:58:37.547344+0000","last_clean_scrub_stamp":"2024-03-23T23:58:37.547344+0000","objects_scrubbed":0,"log_size":5976,"log_dups_size":0,"ondisk_log_size":5976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:44:21.499365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104041,"num_write_kb":1238038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"27'5691","reported_seq":5714,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.449903+0000","last_change":"2024-03-23T23:42:50.771062+0000","last_active":"2024-03-23T23:58:30.449903+0000","last_peered":"2024-03-23T23:58:30.449903+0000","last_clean":"2024-03-23T23:58:30.449903+0000","last_became_active":"2024-03-23T23:42:50.770790+0000","last_became_peered":"2024-03-23T23:42:50.770790+0000","last_unstale":"2024-03-23T23:58:30.449903+0000","last_undegraded":"2024-03-23T23:58:30.449903+0000","last_fullsized":"2024-03-23T23:58:30.449903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5691,"log_dups_size":0,"ondisk_log_size":5691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84043,"num_write_kb":972100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"27'4954","reported_seq":4993,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:53.431098+0000","last_change":"2024-03-23T23:58:53.431140+0000","last_active":"2024-03-23T23:58:53.431098+0000","last_peered":"2024-03-23T23:58:53.431098+0000","last_clean":"2024-03-23T23:58:53.431098+0000","last_became_active":"2024-03-23T23:42:40.697694+0000","last_became_peered":"2024-03-23T23:42:40.697694+0000","last_unstale":"2024-03-23T23:58:53.431098+0000","last_undegraded":"2024-03-23T23:58:53.431098+0000","last_fullsized":"2024-03-23T23:58:53.431098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4954","last_scrub_stamp":"2024-03-23T23:58:53.431009+0000","last_deep_scrub":"27'4954","last_deep_scrub_stamp":"2024-03-23T23:58:53.431009+0000","last_clean_scrub_stamp":"2024-03-23T23:58:53.431009+0000","objects_scrubbed":0,"log_size":4954,"log_dups_size":0,"ondisk_log_size":4954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:57:28.912425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73634,"num_write_kb":894008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"27'6061","reported_seq":6084,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.499584+0000","last_change":"2024-03-23T23:42:50.751694+0000","last_active":"2024-03-23T23:58:30.499584+0000","last_peered":"2024-03-23T23:58:30.499584+0000","last_clean":"2024-03-23T23:58:30.499584+0000","last_became_active":"2024-03-23T23:42:50.751452+0000","last_became_peered":"2024-03-23T23:42:50.751452+0000","last_unstale":"2024-03-23T23:58:30.499584+0000","last_undegraded":"2024-03-23T23:58:30.499584+0000","last_fullsized":"2024-03-23T23:58:30.499584+0000","mapping_epoch":23,"log_start":"27'600","ondisk_log_start":"27'600","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5461,"log_dups_size":0,"ondisk_log_size":5461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89888,"num_write_kb":1063697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"27'4435","reported_seq":4474,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:41.343403+0000","last_change":"2024-03-23T23:58:41.343424+0000","last_active":"2024-03-23T23:58:41.343403+0000","last_peered":"2024-03-23T23:58:41.343403+0000","last_clean":"2024-03-23T23:58:41.343403+0000","last_became_active":"2024-03-23T23:42:40.681337+0000","last_became_peered":"2024-03-23T23:42:40.681337+0000","last_unstale":"2024-03-23T23:58:41.343403+0000","last_undegraded":"2024-03-23T23:58:41.343403+0000","last_fullsized":"2024-03-23T23:58:41.343403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4435","last_scrub_stamp":"2024-03-23T23:58:41.343319+0000","last_deep_scrub":"27'4435","last_deep_scrub_stamp":"2024-03-23T23:58:41.343319+0000","last_clean_scrub_stamp":"2024-03-23T23:58:41.343319+0000","objects_scrubbed":0,"log_size":4435,"log_dups_size":0,"ondisk_log_size":4435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:19:37.808855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65733,"num_write_kb":782831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"27'3547","reported_seq":3570,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.456960+0000","last_change":"2024-03-23T23:42:50.769003+0000","last_active":"2024-03-23T23:58:30.456960+0000","last_peered":"2024-03-23T23:58:30.456960+0000","last_clean":"2024-03-23T23:58:30.456960+0000","last_became_active":"2024-03-23T23:42:50.768695+0000","last_became_peered":"2024-03-23T23:42:50.768695+0000","last_unstale":"2024-03-23T23:58:30.456960+0000","last_undegraded":"2024-03-23T23:58:30.456960+0000","last_fullsized":"2024-03-23T23:58:30.456960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":3547,"log_dups_size":0,"ondisk_log_size":3547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52531,"num_write_kb":593656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'4800","reported_seq":4839,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:44.284186+0000","last_change":"2024-03-23T23:58:44.284206+0000","last_active":"2024-03-23T23:58:44.284186+0000","last_peered":"2024-03-23T23:58:44.284186+0000","last_clean":"2024-03-23T23:58:44.284186+0000","last_became_active":"2024-03-23T23:42:40.680643+0000","last_became_peered":"2024-03-23T23:42:40.680643+0000","last_unstale":"2024-03-23T23:58:44.284186+0000","last_undegraded":"2024-03-23T23:58:44.284186+0000","last_fullsized":"2024-03-23T23:58:44.284186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4800","last_scrub_stamp":"2024-03-23T23:58:44.284109+0000","last_deep_scrub":"27'4800","last_deep_scrub_stamp":"2024-03-23T23:58:44.284109+0000","last_clean_scrub_stamp":"2024-03-23T23:58:44.284109+0000","objects_scrubbed":0,"log_size":4800,"log_dups_size":0,"ondisk_log_size":4800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:19:40.749644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71159,"num_write_kb":844038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"27'5011","reported_seq":5034,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.473066+0000","last_change":"2024-03-23T23:42:50.762401+0000","last_active":"2024-03-23T23:58:30.473066+0000","last_peered":"2024-03-23T23:58:30.473066+0000","last_clean":"2024-03-23T23:58:30.473066+0000","last_became_active":"2024-03-23T23:42:50.762183+0000","last_became_peered":"2024-03-23T23:42:50.762183+0000","last_unstale":"2024-03-23T23:58:30.473066+0000","last_undegraded":"2024-03-23T23:58:30.473066+0000","last_fullsized":"2024-03-23T23:58:30.473066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5011,"log_dups_size":0,"ondisk_log_size":5011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74336,"num_write_kb":853450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"27'4024","reported_seq":4063,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:55.510916+0000","last_change":"2024-03-23T23:58:55.510938+0000","last_active":"2024-03-23T23:58:55.510916+0000","last_peered":"2024-03-23T23:58:55.510916+0000","last_clean":"2024-03-23T23:58:55.510916+0000","last_became_active":"2024-03-23T23:42:40.682410+0000","last_became_peered":"2024-03-23T23:42:40.682410+0000","last_unstale":"2024-03-23T23:58:55.510916+0000","last_undegraded":"2024-03-23T23:58:55.510916+0000","last_fullsized":"2024-03-23T23:58:55.510916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4024","last_scrub_stamp":"2024-03-23T23:58:55.510846+0000","last_deep_scrub":"27'4024","last_deep_scrub_stamp":"2024-03-23T23:58:55.510846+0000","last_clean_scrub_stamp":"2024-03-23T23:58:55.510846+0000","objects_scrubbed":0,"log_size":4024,"log_dups_size":0,"ondisk_log_size":4024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:19:09.039947+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59528,"num_write_kb":755074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"27'4698","reported_seq":4721,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.450918+0000","last_change":"2024-03-23T23:42:50.749204+0000","last_active":"2024-03-23T23:58:30.450918+0000","last_peered":"2024-03-23T23:58:30.450918+0000","last_clean":"2024-03-23T23:58:30.450918+0000","last_became_active":"2024-03-23T23:42:50.748809+0000","last_became_peered":"2024-03-23T23:42:50.748809+0000","last_unstale":"2024-03-23T23:58:30.450918+0000","last_undegraded":"2024-03-23T23:58:30.450918+0000","last_fullsized":"2024-03-23T23:58:30.450918+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4698,"log_dups_size":0,"ondisk_log_size":4698,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69546,"num_write_kb":808803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'3645","reported_seq":3684,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:46.718614+0000","last_change":"2024-03-23T23:58:46.718636+0000","last_active":"2024-03-23T23:58:46.718614+0000","last_peered":"2024-03-23T23:58:46.718614+0000","last_clean":"2024-03-23T23:58:46.718614+0000","last_became_active":"2024-03-23T23:42:40.682155+0000","last_became_peered":"2024-03-23T23:42:40.682155+0000","last_unstale":"2024-03-23T23:58:46.718614+0000","last_undegraded":"2024-03-23T23:58:46.718614+0000","last_fullsized":"2024-03-23T23:58:46.718614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3645","last_scrub_stamp":"2024-03-23T23:58:46.718541+0000","last_deep_scrub":"27'3645","last_deep_scrub_stamp":"2024-03-23T23:58:46.718541+0000","last_clean_scrub_stamp":"2024-03-23T23:58:46.718541+0000","objects_scrubbed":0,"log_size":3645,"log_dups_size":0,"ondisk_log_size":3645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:12:24.531654+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54155,"num_write_kb":623068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"27'4100","reported_seq":4132,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:37.016624+0000","last_change":"2024-03-23T23:58:37.016646+0000","last_active":"2024-03-23T23:58:37.016624+0000","last_peered":"2024-03-23T23:58:37.016624+0000","last_clean":"2024-03-23T23:58:37.016624+0000","last_became_active":"2024-03-23T23:42:50.745858+0000","last_became_peered":"2024-03-23T23:42:50.745858+0000","last_unstale":"2024-03-23T23:58:37.016624+0000","last_undegraded":"2024-03-23T23:58:37.016624+0000","last_fullsized":"2024-03-23T23:58:37.016624+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4100","last_scrub_stamp":"2024-03-23T23:58:37.016533+0000","last_deep_scrub":"27'4100","last_deep_scrub_stamp":"2024-03-23T23:58:37.016533+0000","last_clean_scrub_stamp":"2024-03-23T23:58:37.016533+0000","objects_scrubbed":0,"log_size":4100,"log_dups_size":0,"ondisk_log_size":4100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:54:50.296449+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":60470,"num_write_kb":714617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"27'5162","reported_seq":5201,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:37.697548+0000","last_change":"2024-03-23T23:58:37.697570+0000","last_active":"2024-03-23T23:58:37.697548+0000","last_peered":"2024-03-23T23:58:37.697548+0000","last_clean":"2024-03-23T23:58:37.697548+0000","last_became_active":"2024-03-23T23:42:40.701874+0000","last_became_peered":"2024-03-23T23:42:40.701874+0000","last_unstale":"2024-03-23T23:58:37.697548+0000","last_undegraded":"2024-03-23T23:58:37.697548+0000","last_fullsized":"2024-03-23T23:58:37.697548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5162","last_scrub_stamp":"2024-03-23T23:58:37.697468+0000","last_deep_scrub":"27'5162","last_deep_scrub_stamp":"2024-03-23T23:58:37.697468+0000","last_clean_scrub_stamp":"2024-03-23T23:58:37.697468+0000","objects_scrubbed":0,"log_size":5162,"log_dups_size":0,"ondisk_log_size":5162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:59:05.069988+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76848,"num_write_kb":918422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"27'4951","reported_seq":4974,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.496249+0000","last_change":"2024-03-23T23:42:50.773115+0000","last_active":"2024-03-23T23:58:30.496249+0000","last_peered":"2024-03-23T23:58:30.496249+0000","last_clean":"2024-03-23T23:58:30.496249+0000","last_became_active":"2024-03-23T23:42:50.772849+0000","last_became_peered":"2024-03-23T23:42:50.772849+0000","last_unstale":"2024-03-23T23:58:30.496249+0000","last_undegraded":"2024-03-23T23:58:30.496249+0000","last_fullsized":"2024-03-23T23:58:30.496249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4951,"log_dups_size":0,"ondisk_log_size":4951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73640,"num_write_kb":854588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"27'5694","reported_seq":5733,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:39.705506+0000","last_change":"2024-03-23T23:58:39.705529+0000","last_active":"2024-03-23T23:58:39.705506+0000","last_peered":"2024-03-23T23:58:39.705506+0000","last_clean":"2024-03-23T23:58:39.705506+0000","last_became_active":"2024-03-23T23:42:40.702447+0000","last_became_peered":"2024-03-23T23:42:40.702447+0000","last_unstale":"2024-03-23T23:58:39.705506+0000","last_undegraded":"2024-03-23T23:58:39.705506+0000","last_fullsized":"2024-03-23T23:58:39.705506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5694","last_scrub_stamp":"2024-03-23T23:58:39.705420+0000","last_deep_scrub":"27'5694","last_deep_scrub_stamp":"2024-03-23T23:58:39.705420+0000","last_clean_scrub_stamp":"2024-03-23T23:58:39.705420+0000","objects_scrubbed":0,"log_size":5694,"log_dups_size":0,"ondisk_log_size":5694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:03:00.560218+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84473,"num_write_kb":1008808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"27'4449","reported_seq":4480,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:42.476053+0000","last_change":"2024-03-23T23:58:42.476076+0000","last_active":"2024-03-23T23:58:42.476053+0000","last_peered":"2024-03-23T23:58:42.476053+0000","last_clean":"2024-03-23T23:58:42.476053+0000","last_became_active":"2024-03-23T23:42:50.745205+0000","last_became_peered":"2024-03-23T23:42:50.745205+0000","last_unstale":"2024-03-23T23:58:42.476053+0000","last_undegraded":"2024-03-23T23:58:42.476053+0000","last_fullsized":"2024-03-23T23:58:42.476053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4449","last_scrub_stamp":"2024-03-23T23:58:42.475960+0000","last_deep_scrub":"27'4449","last_deep_scrub_stamp":"2024-03-23T23:58:42.475960+0000","last_clean_scrub_stamp":"2024-03-23T23:58:42.475960+0000","objects_scrubbed":0,"log_size":4449,"log_dups_size":0,"ondisk_log_size":4449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:49:33.571509+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65706,"num_write_kb":746784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"27'6105","reported_seq":6144,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:43.224029+0000","last_change":"2024-03-23T23:58:43.224050+0000","last_active":"2024-03-23T23:58:43.224029+0000","last_peered":"2024-03-23T23:58:43.224029+0000","last_clean":"2024-03-23T23:58:43.224029+0000","last_became_active":"2024-03-23T23:42:40.713737+0000","last_became_peered":"2024-03-23T23:42:40.713737+0000","last_unstale":"2024-03-23T23:58:43.224029+0000","last_undegraded":"2024-03-23T23:58:43.224029+0000","last_fullsized":"2024-03-23T23:58:43.224029+0000","mapping_epoch":19,"log_start":"27'400","ondisk_log_start":"27'400","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6105","last_scrub_stamp":"2024-03-23T23:58:43.223955+0000","last_deep_scrub":"27'6105","last_deep_scrub_stamp":"2024-03-23T23:58:43.223955+0000","last_clean_scrub_stamp":"2024-03-23T23:58:43.223955+0000","objects_scrubbed":0,"log_size":5705,"log_dups_size":0,"ondisk_log_size":5705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:20:50.618110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90841,"num_write_kb":1111853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"27'6499","reported_seq":6523,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.510896+0000","last_change":"2024-03-23T23:42:50.746666+0000","last_active":"2024-03-23T23:58:30.510896+0000","last_peered":"2024-03-23T23:58:30.510896+0000","last_clean":"2024-03-23T23:58:30.510896+0000","last_became_active":"2024-03-23T23:42:50.746149+0000","last_became_peered":"2024-03-23T23:42:50.746149+0000","last_unstale":"2024-03-23T23:58:30.510896+0000","last_undegraded":"2024-03-23T23:58:30.510896+0000","last_fullsized":"2024-03-23T23:58:30.510896+0000","mapping_epoch":23,"log_start":"27'1200","ondisk_log_start":"27'1200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5299,"log_dups_size":0,"ondisk_log_size":5299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96498,"num_write_kb":1062339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"27'5300","reported_seq":5339,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:41.360620+0000","last_change":"2024-03-23T23:58:41.360641+0000","last_active":"2024-03-23T23:58:41.360620+0000","last_peered":"2024-03-23T23:58:41.360620+0000","last_clean":"2024-03-23T23:58:41.360620+0000","last_became_active":"2024-03-23T23:42:40.710362+0000","last_became_peered":"2024-03-23T23:42:40.710362+0000","last_unstale":"2024-03-23T23:58:41.360620+0000","last_undegraded":"2024-03-23T23:58:41.360620+0000","last_fullsized":"2024-03-23T23:58:41.360620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5300","last_scrub_stamp":"2024-03-23T23:58:41.360551+0000","last_deep_scrub":"27'5300","last_deep_scrub_stamp":"2024-03-23T23:58:41.360551+0000","last_clean_scrub_stamp":"2024-03-23T23:58:41.360551+0000","objects_scrubbed":0,"log_size":5300,"log_dups_size":0,"ondisk_log_size":5300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:00:18.949608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79360,"num_write_kb":955033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"27'4854","reported_seq":4878,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.464576+0000","last_change":"2024-03-23T23:42:50.753397+0000","last_active":"2024-03-23T23:58:30.464576+0000","last_peered":"2024-03-23T23:58:30.464576+0000","last_clean":"2024-03-23T23:58:30.464576+0000","last_became_active":"2024-03-23T23:42:50.753085+0000","last_became_peered":"2024-03-23T23:42:50.753085+0000","last_unstale":"2024-03-23T23:58:30.464576+0000","last_undegraded":"2024-03-23T23:58:30.464576+0000","last_fullsized":"2024-03-23T23:58:30.464576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4854,"log_dups_size":0,"ondisk_log_size":4854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71990,"num_write_kb":829684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"27'5530","reported_seq":5561,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.607263+0000","last_change":"2024-03-23T23:42:40.689380+0000","last_active":"2024-03-23T23:58:27.607263+0000","last_peered":"2024-03-23T23:58:27.607263+0000","last_clean":"2024-03-23T23:58:27.607263+0000","last_became_active":"2024-03-23T23:42:40.689023+0000","last_became_peered":"2024-03-23T23:42:40.689023+0000","last_unstale":"2024-03-23T23:58:27.607263+0000","last_undegraded":"2024-03-23T23:58:27.607263+0000","last_fullsized":"2024-03-23T23:58:27.607263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":5530,"log_dups_size":0,"ondisk_log_size":5530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82240,"num_write_kb":999067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"27'4495","reported_seq":4527,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:56.380259+0000","last_change":"2024-03-23T23:58:56.380281+0000","last_active":"2024-03-23T23:58:56.380259+0000","last_peered":"2024-03-23T23:58:56.380259+0000","last_clean":"2024-03-23T23:58:56.380259+0000","last_became_active":"2024-03-23T23:42:50.755405+0000","last_became_peered":"2024-03-23T23:42:50.755405+0000","last_unstale":"2024-03-23T23:58:56.380259+0000","last_undegraded":"2024-03-23T23:58:56.380259+0000","last_fullsized":"2024-03-23T23:58:56.380259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4495","last_scrub_stamp":"2024-03-23T23:58:56.380172+0000","last_deep_scrub":"27'4495","last_deep_scrub_stamp":"2024-03-23T23:58:56.380172+0000","last_clean_scrub_stamp":"2024-03-23T23:58:56.380172+0000","objects_scrubbed":0,"log_size":4495,"log_dups_size":0,"ondisk_log_size":4495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:27:14.313837+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66847,"num_write_kb":769767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"27'4564","reported_seq":4595,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.683683+0000","last_change":"2024-03-23T23:42:40.698234+0000","last_active":"2024-03-23T23:58:27.683683+0000","last_peered":"2024-03-23T23:58:27.683683+0000","last_clean":"2024-03-23T23:58:27.683683+0000","last_became_active":"2024-03-23T23:42:40.695978+0000","last_became_peered":"2024-03-23T23:42:40.695978+0000","last_unstale":"2024-03-23T23:58:27.683683+0000","last_undegraded":"2024-03-23T23:58:27.683683+0000","last_fullsized":"2024-03-23T23:58:27.683683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:39.652962+0000","last_clean_scrub_stamp":"2024-03-23T23:42:39.652962+0000","objects_scrubbed":0,"log_size":4564,"log_dups_size":0,"ondisk_log_size":4564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67848,"num_write_kb":796612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"27'5529","reported_seq":5561,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:44.467357+0000","last_change":"2024-03-23T23:58:44.467380+0000","last_active":"2024-03-23T23:58:44.467357+0000","last_peered":"2024-03-23T23:58:44.467357+0000","last_clean":"2024-03-23T23:58:44.467357+0000","last_became_active":"2024-03-23T23:42:50.751738+0000","last_became_peered":"2024-03-23T23:42:50.751738+0000","last_unstale":"2024-03-23T23:58:44.467357+0000","last_undegraded":"2024-03-23T23:58:44.467357+0000","last_fullsized":"2024-03-23T23:58:44.467357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5529","last_scrub_stamp":"2024-03-23T23:58:44.467266+0000","last_deep_scrub":"27'5529","last_deep_scrub_stamp":"2024-03-23T23:58:44.467266+0000","last_clean_scrub_stamp":"2024-03-23T23:58:44.467266+0000","objects_scrubbed":0,"log_size":5529,"log_dups_size":0,"ondisk_log_size":5529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:00:22.056323+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81884,"num_write_kb":915818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'4914","reported_seq":4953,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:44.265517+0000","last_change":"2024-03-23T23:58:44.265537+0000","last_active":"2024-03-23T23:58:44.265517+0000","last_peered":"2024-03-23T23:58:44.265517+0000","last_clean":"2024-03-23T23:58:44.265517+0000","last_became_active":"2024-03-23T23:42:40.698092+0000","last_became_peered":"2024-03-23T23:42:40.698092+0000","last_unstale":"2024-03-23T23:58:44.265517+0000","last_undegraded":"2024-03-23T23:58:44.265517+0000","last_fullsized":"2024-03-23T23:58:44.265517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4914","last_scrub_stamp":"2024-03-23T23:58:44.265437+0000","last_deep_scrub":"27'4914","last_deep_scrub_stamp":"2024-03-23T23:58:44.265437+0000","last_clean_scrub_stamp":"2024-03-23T23:58:44.265437+0000","objects_scrubbed":0,"log_size":4914,"log_dups_size":0,"ondisk_log_size":4914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:11:50.228207+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73128,"num_write_kb":826128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"27'4584","reported_seq":4607,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.450331+0000","last_change":"2024-03-23T23:42:50.753000+0000","last_active":"2024-03-23T23:58:30.450331+0000","last_peered":"2024-03-23T23:58:30.450331+0000","last_clean":"2024-03-23T23:58:30.450331+0000","last_became_active":"2024-03-23T23:42:50.752614+0000","last_became_peered":"2024-03-23T23:42:50.752614+0000","last_unstale":"2024-03-23T23:58:30.450331+0000","last_undegraded":"2024-03-23T23:58:30.450331+0000","last_fullsized":"2024-03-23T23:58:30.450331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":4584,"log_dups_size":0,"ondisk_log_size":4584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67913,"num_write_kb":776364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"27'4451","reported_seq":4491,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:41.487435+0000","last_change":"2024-03-23T23:58:41.487455+0000","last_active":"2024-03-23T23:58:41.487435+0000","last_peered":"2024-03-23T23:58:41.487435+0000","last_clean":"2024-03-23T23:58:41.487435+0000","last_became_active":"2024-03-23T23:42:40.697932+0000","last_became_peered":"2024-03-23T23:42:40.697932+0000","last_unstale":"2024-03-23T23:58:41.487435+0000","last_undegraded":"2024-03-23T23:58:41.487435+0000","last_fullsized":"2024-03-23T23:58:41.487435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4451","last_scrub_stamp":"2024-03-23T23:58:41.487371+0000","last_deep_scrub":"27'4451","last_deep_scrub_stamp":"2024-03-23T23:58:41.487371+0000","last_clean_scrub_stamp":"2024-03-23T23:58:41.487371+0000","objects_scrubbed":0,"log_size":4451,"log_dups_size":0,"ondisk_log_size":4451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:44:32.520752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66105,"num_write_kb":808863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"27'4925","reported_seq":4956,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:49.999662+0000","last_change":"2024-03-23T23:58:49.999711+0000","last_active":"2024-03-23T23:58:49.999662+0000","last_peered":"2024-03-23T23:58:49.999662+0000","last_clean":"2024-03-23T23:58:49.999662+0000","last_became_active":"2024-03-23T23:42:50.765716+0000","last_became_peered":"2024-03-23T23:42:50.765716+0000","last_unstale":"2024-03-23T23:58:49.999662+0000","last_undegraded":"2024-03-23T23:58:49.999662+0000","last_fullsized":"2024-03-23T23:58:49.999662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4925","last_scrub_stamp":"2024-03-23T23:58:49.999509+0000","last_deep_scrub":"27'4925","last_deep_scrub_stamp":"2024-03-23T23:58:49.999509+0000","last_clean_scrub_stamp":"2024-03-23T23:58:49.999509+0000","objects_scrubbed":0,"log_size":4925,"log_dups_size":0,"ondisk_log_size":4925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:36:13.773595+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72768,"num_write_kb":776524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'5362","reported_seq":5402,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:46.240983+0000","last_change":"2024-03-23T23:58:46.241007+0000","last_active":"2024-03-23T23:58:46.240983+0000","last_peered":"2024-03-23T23:58:46.240983+0000","last_clean":"2024-03-23T23:58:46.240983+0000","last_became_active":"2024-03-23T23:42:40.683711+0000","last_became_peered":"2024-03-23T23:42:40.683711+0000","last_unstale":"2024-03-23T23:58:46.240983+0000","last_undegraded":"2024-03-23T23:58:46.240983+0000","last_fullsized":"2024-03-23T23:58:46.240983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5362","last_scrub_stamp":"2024-03-23T23:58:46.240907+0000","last_deep_scrub":"27'5362","last_deep_scrub_stamp":"2024-03-23T23:58:46.240907+0000","last_clean_scrub_stamp":"2024-03-23T23:58:46.240907+0000","objects_scrubbed":0,"log_size":5362,"log_dups_size":0,"ondisk_log_size":5362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:00:48.536668+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79587,"num_write_kb":960150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"27'5558","reported_seq":5581,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.499014+0000","last_change":"2024-03-23T23:42:50.766544+0000","last_active":"2024-03-23T23:58:30.499014+0000","last_peered":"2024-03-23T23:58:30.499014+0000","last_clean":"2024-03-23T23:58:30.499014+0000","last_became_active":"2024-03-23T23:42:50.766328+0000","last_became_peered":"2024-03-23T23:42:50.766328+0000","last_unstale":"2024-03-23T23:58:30.499014+0000","last_undegraded":"2024-03-23T23:58:30.499014+0000","last_fullsized":"2024-03-23T23:58:30.499014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5558,"log_dups_size":0,"ondisk_log_size":5558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82850,"num_write_kb":926357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"27'6244","reported_seq":6284,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:51.365962+0000","last_change":"2024-03-23T23:58:51.365982+0000","last_active":"2024-03-23T23:58:51.365962+0000","last_peered":"2024-03-23T23:58:51.365962+0000","last_clean":"2024-03-23T23:58:51.365962+0000","last_became_active":"2024-03-23T23:42:40.678325+0000","last_became_peered":"2024-03-23T23:42:40.678325+0000","last_unstale":"2024-03-23T23:58:51.365962+0000","last_undegraded":"2024-03-23T23:58:51.365962+0000","last_fullsized":"2024-03-23T23:58:51.365962+0000","mapping_epoch":19,"log_start":"27'500","ondisk_log_start":"27'500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6244","last_scrub_stamp":"2024-03-23T23:58:51.365895+0000","last_deep_scrub":"27'6244","last_deep_scrub_stamp":"2024-03-23T23:58:51.365895+0000","last_clean_scrub_stamp":"2024-03-23T23:58:51.365895+0000","objects_scrubbed":0,"log_size":5744,"log_dups_size":0,"ondisk_log_size":5744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:08:45.756291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92992,"num_write_kb":1109347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"27'5529","reported_seq":5552,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.425474+0000","last_change":"2024-03-23T23:42:50.750690+0000","last_active":"2024-03-23T23:58:30.425474+0000","last_peered":"2024-03-23T23:58:30.425474+0000","last_clean":"2024-03-23T23:58:30.425474+0000","last_became_active":"2024-03-23T23:42:50.750466+0000","last_became_peered":"2024-03-23T23:42:50.750466+0000","last_unstale":"2024-03-23T23:58:30.425474+0000","last_undegraded":"2024-03-23T23:58:30.425474+0000","last_fullsized":"2024-03-23T23:58:30.425474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:42:49.710121+0000","last_clean_scrub_stamp":"2024-03-23T23:42:49.710121+0000","objects_scrubbed":0,"log_size":5529,"log_dups_size":0,"ondisk_log_size":5529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82257,"num_write_kb":938007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"27'4808","reported_seq":4848,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:40.229875+0000","last_change":"2024-03-23T23:58:40.229918+0000","last_active":"2024-03-23T23:58:40.229875+0000","last_peered":"2024-03-23T23:58:40.229875+0000","last_clean":"2024-03-23T23:58:40.229875+0000","last_became_active":"2024-03-23T23:42:40.700855+0000","last_became_peered":"2024-03-23T23:42:40.700855+0000","last_unstale":"2024-03-23T23:58:40.229875+0000","last_undegraded":"2024-03-23T23:58:40.229875+0000","last_fullsized":"2024-03-23T23:58:40.229875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4808","last_scrub_stamp":"2024-03-23T23:58:40.229723+0000","last_deep_scrub":"27'4808","last_deep_scrub_stamp":"2024-03-23T23:58:40.229723+0000","last_clean_scrub_stamp":"2024-03-23T23:58:40.229723+0000","objects_scrubbed":0,"log_size":4808,"log_dups_size":0,"ondisk_log_size":4808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:36:04.003809+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71971,"num_write_kb":878476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":4985198,"num_write_kb":56700971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":327294,"ondisk_log_size":327294,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":98084592,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":31,"num_read_kb":105,"num_write":4491,"num_write_kb":97550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":196231168,"data_stored":196169184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4256,"ondisk_log_size":4256,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":11,"num_write":4962178,"num_write_kb":59383104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326587,"ondisk_log_size":326587,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":93601894,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":44,"num_read_kb":115,"num_write":4044,"num_write_kb":93019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":187269120,"data_stored":187203788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3857,"ondisk_log_size":3857,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509639,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":616364,"kb_used_data":49444,"kb_used_omap":1,"kb_used_meta":566910,"kb_avail":93755476,"statfs":{"total":96636764160,"available":96005607424,"internally_reserved":0,"allocated":50630656,"data_stored":50448059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":580516294},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509635,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":889852,"kb_used_data":37236,"kb_used_omap":1,"kb_used_meta":852606,"kb_avail":93481988,"statfs":{"total":96636764160,"available":95725555712,"internally_reserved":0,"allocated":38129664,"data_stored":37949267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":873068997},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509634,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":997916,"kb_used_data":67412,"kb_used_omap":1,"kb_used_meta":930494,"kb_avail":93373924,"statfs":{"total":96636764160,"available":95614898176,"internally_reserved":0,"allocated":69029888,"data_stored":68838347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":952826309},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509636,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":977820,"kb_used_data":56340,"kb_used_omap":1,"kb_used_meta":921470,"kb_avail":93394020,"statfs":{"total":96636764160,"available":95635476480,"internally_reserved":0,"allocated":57692160,"data_stored":57497661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":943585735},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542338,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":916712,"kb_used_data":58208,"kb_used_omap":1,"kb_used_meta":858494,"kb_avail":93455128,"statfs":{"total":96636764160,"available":95698051072,"internally_reserved":0,"allocated":59604992,"data_stored":59426419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":879098314},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542343,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":575412,"kb_used_data":12652,"kb_used_omap":1,"kb_used_meta":562750,"kb_avail":93796428,"statfs":{"total":96636764160,"available":96047542272,"internally_reserved":0,"allocated":12955648,"data_stored":12782666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":576256453},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542342,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":775792,"kb_used_data":62952,"kb_used_omap":1,"kb_used_meta":712830,"kb_avail":93596048,"statfs":{"total":96636764160,"available":95842353152,"internally_reserved":0,"allocated":64462848,"data_stored":64271712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":729938373},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542341,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":736108,"kb_used_data":33636,"kb_used_omap":1,"kb_used_meta":702462,"kb_avail":93635732,"statfs":{"total":96636764160,"available":95882989568,"internally_reserved":0,"allocated":34443264,"data_stored":34260561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":719321541},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25178112,"data_stored":25166462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22224896,"data_stored":22212855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4280320,"data_stored":4278865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18116608,"data_stored":18103624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":33566720,"data_stored":33554558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20971610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20979712,"data_stored":20972192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":41947136,"data_stored":41943622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41955328,"data_stored":41943734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8392704,"data_stored":8388678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":39292928,"data_stored":39278914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":35180544,"data_stored":35168666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16871424,"data_stored":16862534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29368320,"data_stored":29360744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16777306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T23:58:58.950 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.950 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.950 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.950 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.950 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.951 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.951 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.951 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.952 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.952 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.952 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.952 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.952 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.953 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.953 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.953 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.953 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.954 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.954 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.954 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.954 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.954 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.955 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.955 INFO:tasks.ceph:pgid 5.21 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.955 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.955 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.955 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.955 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.956 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.956 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.956 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.956 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.956 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.956 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.956 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.957 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.957 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.957 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.957 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-03-23T23:42:39.652962+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=39, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.957 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.957 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.958 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2024-03-23T23:42:49.710121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=42, tm_sec=49, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=32, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:58.958 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-23T23:59:17.653 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:59:17.657 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:59:18.958 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T23:59:19.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.098+0000 7fbd7ae00640 1 Processor -- start 2024-03-23T23:59:19.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.098+0000 7fbd7ae00640 1 -- start start 2024-03-23T23:59:19.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.098+0000 7fbd7ae00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbd740c2f70 0x7fbd740c5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:19.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.098+0000 7fbd7ae00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd74156410 0x7fbd7414f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:19.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.098+0000 7fbd7ae00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd74159100 con 0x7fbd74159ba0 2024-03-23T23:59:19.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.098+0000 7fbd7ae00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd74159710 con 0x7fbd740c2f70 2024-03-23T23:59:19.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.098+0000 7fbd7ae00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd740c3df0 con 0x7fbd74156410 2024-03-23T23:59:19.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.102+0000 7fbd78e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd74156410 0x7fbd7414f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:19.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.102+0000 7fbd78e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd74156410 0x7fbd7414f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:33226/0 (socket says 172.21.15.8:33226) 2024-03-23T23:59:19.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.102+0000 7fbd78e00640 1 -- 172.21.15.8:0/2079755781 learned_addr learned my addr 172.21.15.8:0/2079755781 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:59:19.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.102+0000 7fbd73e00640 1 --2- 172.21.15.8:0/2079755781 >> v2:172.21.15.196:3300/0 conn(0x7fbd740c2f70 0x7fbd740c5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:19.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.102+0000 7fbd78e00640 1 -- 172.21.15.8:0/2079755781 >> v2:172.21.15.196:3300/0 conn(0x7fbd740c2f70 msgr2=0x7fbd740c5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:59:19.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.102+0000 7fbd78e00640 1 --2- 172.21.15.8:0/2079755781 >> v2:172.21.15.196:3300/0 conn(0x7fbd740c2f70 0x7fbd740c5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:19.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.102+0000 7fbd78e00640 1 -- 172.21.15.8:0/2079755781 >> v1:172.21.15.196:6789/0 conn(0x7fbd74159ba0 legacy=0x7fbd74156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:19.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.102+0000 7fbd78e00640 1 -- 172.21.15.8:0/2079755781 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd741593a0 con 0x7fbd74156410 2024-03-23T23:59:19.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.102+0000 7fbd78e00640 1 --2- 172.21.15.8:0/2079755781 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd74156410 0x7fbd7414f4b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbd74159890 tx=0x7fbd6c01c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7364b043e17c5ec server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:19.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.102+0000 7fbd73400640 1 -- 172.21.15.8:0/2079755781 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c0a5860 con 0x7fbd74156410 2024-03-23T23:59:19.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.102+0000 7fbd73400640 1 -- 172.21.15.8:0/2079755781 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6c0a5a00 con 0x7fbd74156410 2024-03-23T23:59:19.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.102+0000 7fbd73400640 1 -- 172.21.15.8:0/2079755781 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c0a5dd0 con 0x7fbd74156410 2024-03-23T23:59:19.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.106+0000 7fbd7ae00640 1 -- 172.21.15.8:0/2079755781 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd74156410 msgr2=0x7fbd7414f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:19.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.106+0000 7fbd7ae00640 1 --2- 172.21.15.8:0/2079755781 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd74156410 0x7fbd7414f4b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbd74159890 tx=0x7fbd6c01c980 comp rx=0 tx=0).stop 2024-03-23T23:59:19.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.106+0000 7fbd7ae00640 1 -- 172.21.15.8:0/2079755781 shutdown_connections 2024-03-23T23:59:19.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.106+0000 7fbd7ae00640 1 --2- 172.21.15.8:0/2079755781 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd74156410 0x7fbd7414f4b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:19.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.106+0000 7fbd7ae00640 1 --2- 172.21.15.8:0/2079755781 >> v2:172.21.15.196:3300/0 conn(0x7fbd740c2f70 0x7fbd740c5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:19.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.106+0000 7fbd7ae00640 1 -- 172.21.15.8:0/2079755781 >> 172.21.15.8:0/2079755781 conn(0x7fbd740743f0 msgr2=0x7fbd74074800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:19.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.106+0000 7fbd7ae00640 1 -- 172.21.15.8:0/2079755781 shutdown_connections 2024-03-23T23:59:19.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.106+0000 7fbd7ae00640 1 -- 172.21.15.8:0/2079755781 wait complete. 2024-03-23T23:59:19.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.106+0000 7fbd7ae00640 1 Processor -- start 2024-03-23T23:59:19.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.106+0000 7fbd7ae00640 1 -- start start 2024-03-23T23:59:19.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.106+0000 7fbd7ae00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd740c2f70 0x7fbd741436a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:19.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.106+0000 7fbd7ae00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd74156410 0x7fbd741480d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:19.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.106+0000 7fbd7ae00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd74159ba0 0x7fbd74148610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:19.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.106+0000 7fbd7ae00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd741575e0 con 0x7fbd74159ba0 2024-03-23T23:59:19.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.106+0000 7fbd7ae00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd740c3350 con 0x7fbd740c2f70 2024-03-23T23:59:19.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.106+0000 7fbd7ae00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd74147c60 con 0x7fbd74156410 2024-03-23T23:59:19.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.106+0000 7fbd78e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd74159ba0 0x7fbd74148610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:19.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.106+0000 7fbd73e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd740c2f70 0x7fbd741436a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:19.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.106+0000 7fbd6b400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd74156410 0x7fbd741480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:19.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.106+0000 7fbd78e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd74159ba0 0x7fbd74148610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43670/0 (socket says 172.21.15.8:43670) 2024-03-23T23:59:19.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.106+0000 7fbd78e00640 1 -- 172.21.15.8:0/3126427024 learned_addr learned my addr 172.21.15.8:0/3126427024 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:59:19.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.106+0000 7fbd78e00640 1 -- 172.21.15.8:0/3126427024 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd74156410 msgr2=0x7fbd741480d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:19.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.106+0000 7fbd78e00640 1 --2- 172.21.15.8:0/3126427024 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd74156410 0x7fbd741480d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:19.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.106+0000 7fbd78e00640 1 -- 172.21.15.8:0/3126427024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd740c2f70 msgr2=0x7fbd741436a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:19.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.106+0000 7fbd78e00640 1 --2- 172.21.15.8:0/3126427024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd740c2f70 0x7fbd741436a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:19.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.106+0000 7fbd78e00640 1 -- 172.21.15.8:0/3126427024 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd740a8bf0 con 0x7fbd74159ba0 2024-03-23T23:59:19.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.106+0000 7fbd6b400640 1 --2- 172.21.15.8:0/3126427024 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd74156410 0x7fbd741480d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:59:19.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.106+0000 7fbd73e00640 1 --2- 172.21.15.8:0/3126427024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd740c2f70 0x7fbd741436a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:59:19.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.110+0000 7fbd78e00640 1 --2- 172.21.15.8:0/3126427024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd74159ba0 0x7fbd74148610 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c0af040 tx=0x7fbd6c019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:19.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.110+0000 7fbd70c00640 1 -- 172.21.15.8:0/3126427024 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c0bc020 con 0x7fbd74159ba0 2024-03-23T23:59:19.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.110+0000 7fbd70c00640 1 -- 172.21.15.8:0/3126427024 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6c0b8880 con 0x7fbd74159ba0 2024-03-23T23:59:19.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.110+0000 7fbd7ae00640 1 -- 172.21.15.8:0/3126427024 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd7406d6c0 con 0x7fbd74159ba0 2024-03-23T23:59:19.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.110+0000 7fbd70c00640 1 -- 172.21.15.8:0/3126427024 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c0b8c70 con 0x7fbd74159ba0 2024-03-23T23:59:19.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.110+0000 7fbd7ae00640 1 -- 172.21.15.8:0/3126427024 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd7406dc80 con 0x7fbd74159ba0 2024-03-23T23:59:19.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.110+0000 7fbd7ae00640 1 -- 172.21.15.8:0/3126427024 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd74068270 con 0x7fbd74159ba0 2024-03-23T23:59:19.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.110+0000 7fbd70c00640 1 -- 172.21.15.8:0/3126427024 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fbd6c0bf020 con 0x7fbd74159ba0 2024-03-23T23:59:19.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.110+0000 7fbd70c00640 1 --2- 172.21.15.8:0/3126427024 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbd50067690 0x7fbd50069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:19.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.110+0000 7fbd70c00640 1 -- 172.21.15.8:0/3126427024 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fbd6c1205d0 con 0x7fbd74159ba0 2024-03-23T23:59:19.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.114+0000 7fbd73e00640 1 --2- 172.21.15.8:0/3126427024 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbd50067690 0x7fbd50069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:19.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.114+0000 7fbd73e00640 1 --2- 172.21.15.8:0/3126427024 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbd50067690 0x7fbd50069b50 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbd74149180 tx=0x7fbd64008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:19.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.114+0000 7fbd70c00640 1 -- 172.21.15.8:0/3126427024 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fbd6c0c7020 con 0x7fbd74159ba0 2024-03-23T23:59:19.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.278+0000 7fbd7ae00640 1 -- 172.21.15.8:0/3126427024 --> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbd740c4a50 con 0x7fbd50067690 2024-03-23T23:59:19.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.290+0000 7fbd70c00640 1 -- 172.21.15.8:0/3126427024 <== mgr.4098 v2:172.21.15.196:6832/1295060067 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+495560 (secure 0 0 0) 0x7fbd740c4a50 con 0x7fbd50067690 2024-03-23T23:59:19.297 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:59:19.301 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-03-23T23:59:19.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.294+0000 7fbd7ae00640 1 -- 172.21.15.8:0/3126427024 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbd50067690 msgr2=0x7fbd50069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:19.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.294+0000 7fbd7ae00640 1 --2- 172.21.15.8:0/3126427024 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbd50067690 0x7fbd50069b50 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbd74149180 tx=0x7fbd64008040 comp rx=0 tx=0).stop 2024-03-23T23:59:19.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.294+0000 7fbd7ae00640 1 -- 172.21.15.8:0/3126427024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd74159ba0 msgr2=0x7fbd74148610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:19.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.294+0000 7fbd7ae00640 1 --2- 172.21.15.8:0/3126427024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd74159ba0 0x7fbd74148610 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c0af040 tx=0x7fbd6c019720 comp rx=0 tx=0).stop 2024-03-23T23:59:19.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.294+0000 7fbd7ae00640 1 -- 172.21.15.8:0/3126427024 shutdown_connections 2024-03-23T23:59:19.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.294+0000 7fbd7ae00640 1 --2- 172.21.15.8:0/3126427024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd74159ba0 0x7fbd74148610 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:19.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.294+0000 7fbd7ae00640 1 --2- 172.21.15.8:0/3126427024 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fbd50067690 0x7fbd50069b50 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:19.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.294+0000 7fbd7ae00640 1 --2- 172.21.15.8:0/3126427024 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd74156410 0x7fbd741480d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:19.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.294+0000 7fbd7ae00640 1 --2- 172.21.15.8:0/3126427024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd740c2f70 0x7fbd741436a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:19.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.294+0000 7fbd7ae00640 1 -- 172.21.15.8:0/3126427024 >> 172.21.15.8:0/3126427024 conn(0x7fbd740743f0 msgr2=0x7fbd740c9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:19.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.298+0000 7fbd7ae00640 1 -- 172.21.15.8:0/3126427024 shutdown_connections 2024-03-23T23:59:19.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.298+0000 7fbd7ae00640 1 -- 172.21.15.8:0/3126427024 wait complete. 2024-03-23T23:59:19.326 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":525,"stamp":"2024-03-23T23:59:17.737421+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":192276854,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":195,"num_read_kb":347,"num_write":9956070,"num_write_kb":116277060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":662113,"ondisk_log_size":662113,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":6490136,"kb_used_data":377880,"kb_used_omap":12,"kb_used_meta":6112179,"kb_avail":748484584,"statfs":{"total":773094113280,"available":766448214016,"internally_reserved":0,"allocated":386949120,"data_stored":385474692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":6258871856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002593"},"pg_stats":[{"pgid":"5.18","version":"27'5452","reported_seq":5483,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:51.769602+0000","last_change":"2024-03-23T23:58:51.769625+0000","last_active":"2024-03-23T23:58:51.769602+0000","last_peered":"2024-03-23T23:58:51.769602+0000","last_clean":"2024-03-23T23:58:51.769602+0000","last_became_active":"2024-03-23T23:42:50.735940+0000","last_became_peered":"2024-03-23T23:42:50.735940+0000","last_unstale":"2024-03-23T23:58:51.769602+0000","last_undegraded":"2024-03-23T23:58:51.769602+0000","last_fullsized":"2024-03-23T23:58:51.769602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5452","last_scrub_stamp":"2024-03-23T23:58:51.769514+0000","last_deep_scrub":"27'5452","last_deep_scrub_stamp":"2024-03-23T23:58:51.769514+0000","last_clean_scrub_stamp":"2024-03-23T23:58:51.769514+0000","objects_scrubbed":0,"log_size":5452,"log_dups_size":0,"ondisk_log_size":5452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:22:28.423448+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80864,"num_write_kb":923838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"27'60","reported_seq":103,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:40.233055+0000","last_change":"2024-03-23T23:58:40.233055+0000","last_active":"2024-03-23T23:58:40.233055+0000","last_peered":"2024-03-23T23:58:40.233055+0000","last_clean":"2024-03-23T23:58:40.233055+0000","last_became_active":"2024-03-23T23:42:39.693636+0000","last_became_peered":"2024-03-23T23:42:39.693636+0000","last_unstale":"2024-03-23T23:58:40.233055+0000","last_undegraded":"2024-03-23T23:58:40.233055+0000","last_fullsized":"2024-03-23T23:58:40.233055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'60","last_scrub_stamp":"2024-03-23T23:58:40.232901+0000","last_deep_scrub":"27'60","last_deep_scrub_stamp":"2024-03-23T23:58:40.232901+0000","last_clean_scrub_stamp":"2024-03-23T23:58:40.232901+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:43:13.310561+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'5384","reported_seq":5425,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:45.476622+0000","last_change":"2024-03-23T23:58:45.476622+0000","last_active":"2024-03-23T23:58:45.476622+0000","last_peered":"2024-03-23T23:58:45.476622+0000","last_clean":"2024-03-23T23:58:45.476622+0000","last_became_active":"2024-03-23T23:42:40.682755+0000","last_became_peered":"2024-03-23T23:42:40.682755+0000","last_unstale":"2024-03-23T23:58:45.476622+0000","last_undegraded":"2024-03-23T23:58:45.476622+0000","last_fullsized":"2024-03-23T23:58:45.476622+0000","mapping_epoch":19,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5384","last_scrub_stamp":"2024-03-23T23:58:45.476539+0000","last_deep_scrub":"27'5384","last_deep_scrub_stamp":"2024-03-23T23:58:45.476539+0000","last_clean_scrub_stamp":"2024-03-23T23:58:45.476539+0000","objects_scrubbed":0,"log_size":5284,"log_dups_size":0,"ondisk_log_size":5284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:08:51.662878+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79922,"num_write_kb":951101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'4","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:42.361029+0000","last_change":"2024-03-23T23:58:42.361077+0000","last_active":"2024-03-23T23:58:42.361029+0000","last_peered":"2024-03-23T23:58:42.361029+0000","last_clean":"2024-03-23T23:58:42.361029+0000","last_became_active":"2024-03-23T23:42:49.749634+0000","last_became_peered":"2024-03-23T23:42:49.749634+0000","last_unstale":"2024-03-23T23:58:42.361029+0000","last_undegraded":"2024-03-23T23:58:42.361029+0000","last_fullsized":"2024-03-23T23:58:42.361029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-03-23T23:58:42.360946+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-03-23T23:58:42.360946+0000","last_clean_scrub_stamp":"2024-03-23T23:58:42.360946+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:22:19.014880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"27'6028","reported_seq":6059,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:55.347466+0000","last_change":"2024-03-23T23:58:55.347510+0000","last_active":"2024-03-23T23:58:55.347466+0000","last_peered":"2024-03-23T23:58:55.347466+0000","last_clean":"2024-03-23T23:58:55.347466+0000","last_became_active":"2024-03-23T23:42:50.752078+0000","last_became_peered":"2024-03-23T23:42:50.752078+0000","last_unstale":"2024-03-23T23:58:55.347466+0000","last_undegraded":"2024-03-23T23:58:55.347466+0000","last_fullsized":"2024-03-23T23:58:55.347466+0000","mapping_epoch":23,"log_start":"27'300","ondisk_log_start":"27'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6028","last_scrub_stamp":"2024-03-23T23:58:55.347364+0000","last_deep_scrub":"27'6028","last_deep_scrub_stamp":"2024-03-23T23:58:55.347364+0000","last_clean_scrub_stamp":"2024-03-23T23:58:55.347364+0000","objects_scrubbed":0,"log_size":5728,"log_dups_size":0,"ondisk_log_size":5728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:48:06.407984+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89116,"num_write_kb":998926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"27'16","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:50.507874+0000","last_change":"2024-03-23T23:58:50.507874+0000","last_active":"2024-03-23T23:58:50.507874+0000","last_peered":"2024-03-23T23:58:50.507874+0000","last_clean":"2024-03-23T23:58:50.507874+0000","last_became_active":"2024-03-23T23:42:39.686875+0000","last_became_peered":"2024-03-23T23:42:39.686875+0000","last_unstale":"2024-03-23T23:58:50.507874+0000","last_undegraded":"2024-03-23T23:58:50.507874+0000","last_fullsized":"2024-03-23T23:58:50.507874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-03-23T23:58:50.507775+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-03-23T23:58:50.507775+0000","last_clean_scrub_stamp":"2024-03-23T23:58:50.507775+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:59:04.479373+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'7365","reported_seq":7406,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:34.231444+0000","last_change":"2024-03-23T23:58:34.231444+0000","last_active":"2024-03-23T23:58:34.231444+0000","last_peered":"2024-03-23T23:58:34.231444+0000","last_clean":"2024-03-23T23:58:34.231444+0000","last_became_active":"2024-03-23T23:42:40.698003+0000","last_became_peered":"2024-03-23T23:42:40.698003+0000","last_unstale":"2024-03-23T23:58:34.231444+0000","last_undegraded":"2024-03-23T23:58:34.231444+0000","last_fullsized":"2024-03-23T23:58:34.231444+0000","mapping_epoch":19,"log_start":"27'500","ondisk_log_start":"27'500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7365","last_scrub_stamp":"2024-03-23T23:58:34.231261+0000","last_deep_scrub":"27'7365","last_deep_scrub_stamp":"2024-03-23T23:58:34.231261+0000","last_clean_scrub_stamp":"2024-03-23T23:58:34.231261+0000","objects_scrubbed":0,"log_size":6865,"log_dups_size":0,"ondisk_log_size":6865,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:54:41.308919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110287,"num_write_kb":1353580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'30","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:42.653944+0000","last_change":"2024-03-23T23:58:42.653969+0000","last_active":"2024-03-23T23:58:42.653944+0000","last_peered":"2024-03-23T23:58:42.653944+0000","last_clean":"2024-03-23T23:58:42.653944+0000","last_became_active":"2024-03-23T23:42:49.728261+0000","last_became_peered":"2024-03-23T23:42:49.728261+0000","last_unstale":"2024-03-23T23:58:42.653944+0000","last_undegraded":"2024-03-23T23:58:42.653944+0000","last_fullsized":"2024-03-23T23:58:42.653944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-03-23T23:58:42.653873+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-03-23T23:58:42.653873+0000","last_clean_scrub_stamp":"2024-03-23T23:58:42.653873+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:14:11.410705+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"27'4530","reported_seq":4561,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:59:01.340382+0000","last_change":"2024-03-23T23:59:01.340405+0000","last_active":"2024-03-23T23:59:01.340382+0000","last_peered":"2024-03-23T23:59:01.340382+0000","last_clean":"2024-03-23T23:59:01.340382+0000","last_became_active":"2024-03-23T23:42:50.755600+0000","last_became_peered":"2024-03-23T23:42:50.755600+0000","last_unstale":"2024-03-23T23:59:01.340382+0000","last_undegraded":"2024-03-23T23:59:01.340382+0000","last_fullsized":"2024-03-23T23:59:01.340382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4530","last_scrub_stamp":"2024-03-23T23:59:01.340293+0000","last_deep_scrub":"27'4530","last_deep_scrub_stamp":"2024-03-23T23:59:01.340293+0000","last_clean_scrub_stamp":"2024-03-23T23:59:01.340293+0000","objects_scrubbed":0,"log_size":4530,"log_dups_size":0,"ondisk_log_size":4530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:42:37.838266+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67405,"num_write_kb":746106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"27'64","reported_seq":105,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:56.385686+0000","last_change":"2024-03-23T23:58:56.385716+0000","last_active":"2024-03-23T23:58:56.385686+0000","last_peered":"2024-03-23T23:58:56.385686+0000","last_clean":"2024-03-23T23:58:56.385686+0000","last_became_active":"2024-03-23T23:42:39.696342+0000","last_became_peered":"2024-03-23T23:42:39.696342+0000","last_unstale":"2024-03-23T23:58:56.385686+0000","last_undegraded":"2024-03-23T23:58:56.385686+0000","last_fullsized":"2024-03-23T23:58:56.385686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'64","last_scrub_stamp":"2024-03-23T23:58:56.385601+0000","last_deep_scrub":"27'64","last_deep_scrub_stamp":"2024-03-23T23:58:56.385601+0000","last_clean_scrub_stamp":"2024-03-23T23:58:56.385601+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:50:13.005163+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":12316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'4666","reported_seq":4705,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:47.429315+0000","last_change":"2024-03-23T23:58:47.429338+0000","last_active":"2024-03-23T23:58:47.429315+0000","last_peered":"2024-03-23T23:58:47.429315+0000","last_clean":"2024-03-23T23:58:47.429315+0000","last_became_active":"2024-03-23T23:42:40.697668+0000","last_became_peered":"2024-03-23T23:42:40.697668+0000","last_unstale":"2024-03-23T23:58:47.429315+0000","last_undegraded":"2024-03-23T23:58:47.429315+0000","last_fullsized":"2024-03-23T23:58:47.429315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4666","last_scrub_stamp":"2024-03-23T23:58:47.429252+0000","last_deep_scrub":"27'4666","last_deep_scrub_stamp":"2024-03-23T23:58:47.429252+0000","last_clean_scrub_stamp":"2024-03-23T23:58:47.429252+0000","objects_scrubbed":0,"log_size":4666,"log_dups_size":0,"ondisk_log_size":4666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:46:38.084168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69534,"num_write_kb":791816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'1355","reported_seq":1388,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:37.582696+0000","last_change":"2024-03-23T23:58:37.582720+0000","last_active":"2024-03-23T23:58:37.582696+0000","last_peered":"2024-03-23T23:58:37.582696+0000","last_clean":"2024-03-23T23:58:37.582696+0000","last_became_active":"2024-03-23T23:42:49.744561+0000","last_became_peered":"2024-03-23T23:42:49.744561+0000","last_unstale":"2024-03-23T23:58:37.582696+0000","last_undegraded":"2024-03-23T23:58:37.582696+0000","last_fullsized":"2024-03-23T23:58:37.582696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1355","last_scrub_stamp":"2024-03-23T23:58:37.582624+0000","last_deep_scrub":"27'1355","last_deep_scrub_stamp":"2024-03-23T23:58:37.582624+0000","last_clean_scrub_stamp":"2024-03-23T23:58:37.582624+0000","objects_scrubbed":1,"log_size":1355,"log_dups_size":0,"ondisk_log_size":1355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:41:05.824636+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1348,"num_write_kb":4325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"27'4460","reported_seq":4491,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:57.439005+0000","last_change":"2024-03-23T23:58:57.439027+0000","last_active":"2024-03-23T23:58:57.439005+0000","last_peered":"2024-03-23T23:58:57.439005+0000","last_clean":"2024-03-23T23:58:57.439005+0000","last_became_active":"2024-03-23T23:42:50.755337+0000","last_became_peered":"2024-03-23T23:42:50.755337+0000","last_unstale":"2024-03-23T23:58:57.439005+0000","last_undegraded":"2024-03-23T23:58:57.439005+0000","last_fullsized":"2024-03-23T23:58:57.439005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4460","last_scrub_stamp":"2024-03-23T23:58:57.438929+0000","last_deep_scrub":"27'4460","last_deep_scrub_stamp":"2024-03-23T23:58:57.438929+0000","last_clean_scrub_stamp":"2024-03-23T23:58:57.438929+0000","objects_scrubbed":0,"log_size":4460,"log_dups_size":0,"ondisk_log_size":4460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:17:33.378972+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65733,"num_write_kb":735312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"27'18","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:57.380321+0000","last_change":"2024-03-23T23:58:57.380347+0000","last_active":"2024-03-23T23:58:57.380321+0000","last_peered":"2024-03-23T23:58:57.380321+0000","last_clean":"2024-03-23T23:58:57.380321+0000","last_became_active":"2024-03-23T23:42:39.696401+0000","last_became_peered":"2024-03-23T23:42:39.696401+0000","last_unstale":"2024-03-23T23:58:57.380321+0000","last_undegraded":"2024-03-23T23:58:57.380321+0000","last_fullsized":"2024-03-23T23:58:57.380321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-03-23T23:58:57.380252+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-03-23T23:58:57.380252+0000","last_clean_scrub_stamp":"2024-03-23T23:58:57.380252+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:50:10.736654+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'6122","reported_seq":6161,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:45.447923+0000","last_change":"2024-03-23T23:58:45.447945+0000","last_active":"2024-03-23T23:58:45.447923+0000","last_peered":"2024-03-23T23:58:45.447923+0000","last_clean":"2024-03-23T23:58:45.447923+0000","last_became_active":"2024-03-23T23:42:40.699770+0000","last_became_peered":"2024-03-23T23:42:40.699770+0000","last_unstale":"2024-03-23T23:58:45.447923+0000","last_undegraded":"2024-03-23T23:58:45.447923+0000","last_fullsized":"2024-03-23T23:58:45.447923+0000","mapping_epoch":19,"log_start":"27'200","ondisk_log_start":"27'200","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6122","last_scrub_stamp":"2024-03-23T23:58:45.447855+0000","last_deep_scrub":"27'6122","last_deep_scrub_stamp":"2024-03-23T23:58:45.447855+0000","last_clean_scrub_stamp":"2024-03-23T23:58:45.447855+0000","objects_scrubbed":0,"log_size":5922,"log_dups_size":0,"ondisk_log_size":5922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:45:15.428468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91052,"num_write_kb":1089478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'303","reported_seq":336,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:41.609887+0000","last_change":"2024-03-23T23:58:41.609930+0000","last_active":"2024-03-23T23:58:41.609887+0000","last_peered":"2024-03-23T23:58:41.609887+0000","last_clean":"2024-03-23T23:58:41.609887+0000","last_became_active":"2024-03-23T23:42:49.745526+0000","last_became_peered":"2024-03-23T23:42:49.745526+0000","last_unstale":"2024-03-23T23:58:41.609887+0000","last_undegraded":"2024-03-23T23:58:41.609887+0000","last_fullsized":"2024-03-23T23:58:41.609887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'303","last_scrub_stamp":"2024-03-23T23:58:41.609803+0000","last_deep_scrub":"27'303","last_deep_scrub_stamp":"2024-03-23T23:58:41.609803+0000","last_clean_scrub_stamp":"2024-03-23T23:58:41.609803+0000","objects_scrubbed":2,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:20:57.141206+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5723788,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":5809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"27'5356","reported_seq":5389,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:52.412420+0000","last_change":"2024-03-23T23:58:52.412442+0000","last_active":"2024-03-23T23:58:52.412420+0000","last_peered":"2024-03-23T23:58:52.412420+0000","last_clean":"2024-03-23T23:58:52.412420+0000","last_became_active":"2024-03-23T23:42:50.746937+0000","last_became_peered":"2024-03-23T23:42:50.746937+0000","last_unstale":"2024-03-23T23:58:52.412420+0000","last_undegraded":"2024-03-23T23:58:52.412420+0000","last_fullsized":"2024-03-23T23:58:52.412420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5356","last_scrub_stamp":"2024-03-23T23:58:52.412336+0000","last_deep_scrub":"27'5356","last_deep_scrub_stamp":"2024-03-23T23:58:52.412336+0000","last_clean_scrub_stamp":"2024-03-23T23:58:52.412336+0000","objects_scrubbed":0,"log_size":5356,"log_dups_size":0,"ondisk_log_size":5356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:10:07.015574+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":11,"num_write":79434,"num_write_kb":896560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"27'5252","reported_seq":5292,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:48.850693+0000","last_change":"2024-03-23T23:58:48.850715+0000","last_active":"2024-03-23T23:58:48.850693+0000","last_peered":"2024-03-23T23:58:48.850693+0000","last_clean":"2024-03-23T23:58:48.850693+0000","last_became_active":"2024-03-23T23:42:40.682192+0000","last_became_peered":"2024-03-23T23:42:40.682192+0000","last_unstale":"2024-03-23T23:58:48.850693+0000","last_undegraded":"2024-03-23T23:58:48.850693+0000","last_fullsized":"2024-03-23T23:58:48.850693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5252","last_scrub_stamp":"2024-03-23T23:58:48.850609+0000","last_deep_scrub":"27'5252","last_deep_scrub_stamp":"2024-03-23T23:58:48.850609+0000","last_clean_scrub_stamp":"2024-03-23T23:58:48.850609+0000","objects_scrubbed":0,"log_size":5252,"log_dups_size":0,"ondisk_log_size":5252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:34:57.930384+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78193,"num_write_kb":930302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'12","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:55.349754+0000","last_change":"2024-03-23T23:58:55.349780+0000","last_active":"2024-03-23T23:58:55.349754+0000","last_peered":"2024-03-23T23:58:55.349754+0000","last_clean":"2024-03-23T23:58:55.349754+0000","last_became_active":"2024-03-23T23:42:39.696207+0000","last_became_peered":"2024-03-23T23:42:39.696207+0000","last_unstale":"2024-03-23T23:58:55.349754+0000","last_undegraded":"2024-03-23T23:58:55.349754+0000","last_fullsized":"2024-03-23T23:58:55.349754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-03-23T23:58:55.349684+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-03-23T23:58:55.349684+0000","last_clean_scrub_stamp":"2024-03-23T23:58:55.349684+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:37:14.884832+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'12","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:38.609798+0000","last_change":"2024-03-23T23:58:38.609798+0000","last_active":"2024-03-23T23:58:38.609798+0000","last_peered":"2024-03-23T23:58:38.609798+0000","last_clean":"2024-03-23T23:58:38.609798+0000","last_became_active":"2024-03-23T23:42:49.733888+0000","last_became_peered":"2024-03-23T23:42:49.733888+0000","last_unstale":"2024-03-23T23:58:38.609798+0000","last_undegraded":"2024-03-23T23:58:38.609798+0000","last_fullsized":"2024-03-23T23:58:38.609798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-03-23T23:58:38.609713+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-03-23T23:58:38.609713+0000","last_clean_scrub_stamp":"2024-03-23T23:58:38.609713+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:20:37.674610+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"27'5594","reported_seq":5626,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:49.087623+0000","last_change":"2024-03-23T23:58:49.087645+0000","last_active":"2024-03-23T23:58:49.087623+0000","last_peered":"2024-03-23T23:58:49.087623+0000","last_clean":"2024-03-23T23:58:49.087623+0000","last_became_active":"2024-03-23T23:42:50.758670+0000","last_became_peered":"2024-03-23T23:42:50.758670+0000","last_unstale":"2024-03-23T23:58:49.087623+0000","last_undegraded":"2024-03-23T23:58:49.087623+0000","last_fullsized":"2024-03-23T23:58:49.087623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5594","last_scrub_stamp":"2024-03-23T23:58:49.087542+0000","last_deep_scrub":"27'5594","last_deep_scrub_stamp":"2024-03-23T23:58:49.087542+0000","last_clean_scrub_stamp":"2024-03-23T23:58:49.087542+0000","objects_scrubbed":0,"log_size":5594,"log_dups_size":0,"ondisk_log_size":5594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:32:25.916600+0000","scrub_duration":71,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82815,"num_write_kb":936767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"27'4462","reported_seq":4502,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:53.480041+0000","last_change":"2024-03-23T23:58:53.480063+0000","last_active":"2024-03-23T23:58:53.480041+0000","last_peered":"2024-03-23T23:58:53.480041+0000","last_clean":"2024-03-23T23:58:53.480041+0000","last_became_active":"2024-03-23T23:42:40.674293+0000","last_became_peered":"2024-03-23T23:42:40.674293+0000","last_unstale":"2024-03-23T23:58:53.480041+0000","last_undegraded":"2024-03-23T23:58:53.480041+0000","last_fullsized":"2024-03-23T23:58:53.480041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4462","last_scrub_stamp":"2024-03-23T23:58:53.479957+0000","last_deep_scrub":"27'4462","last_deep_scrub_stamp":"2024-03-23T23:58:53.479957+0000","last_clean_scrub_stamp":"2024-03-23T23:58:53.479957+0000","objects_scrubbed":0,"log_size":4462,"log_dups_size":0,"ondisk_log_size":4462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:40:22.270113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66336,"num_write_kb":780596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'216","reported_seq":258,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:46.310891+0000","last_change":"2024-03-23T23:58:46.310915+0000","last_active":"2024-03-23T23:58:46.310891+0000","last_peered":"2024-03-23T23:58:46.310891+0000","last_clean":"2024-03-23T23:58:46.310891+0000","last_became_active":"2024-03-23T23:42:39.680121+0000","last_became_peered":"2024-03-23T23:42:39.680121+0000","last_unstale":"2024-03-23T23:58:46.310891+0000","last_undegraded":"2024-03-23T23:58:46.310891+0000","last_fullsized":"2024-03-23T23:58:46.310891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'216","last_scrub_stamp":"2024-03-23T23:58:46.310827+0000","last_deep_scrub":"27'216","last_deep_scrub_stamp":"2024-03-23T23:58:46.310827+0000","last_clean_scrub_stamp":"2024-03-23T23:58:46.310827+0000","objects_scrubbed":1,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:15:45.169690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1241175,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":1371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:39.573568+0000","last_change":"2024-03-23T23:58:39.573588+0000","last_active":"2024-03-23T23:58:39.573568+0000","last_peered":"2024-03-23T23:58:39.573568+0000","last_clean":"2024-03-23T23:58:39.573568+0000","last_became_active":"2024-03-23T23:42:49.744742+0000","last_became_peered":"2024-03-23T23:42:49.744742+0000","last_unstale":"2024-03-23T23:58:39.573568+0000","last_undegraded":"2024-03-23T23:58:39.573568+0000","last_fullsized":"2024-03-23T23:58:39.573568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-03-23T23:58:39.573497+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-03-23T23:58:39.573497+0000","last_clean_scrub_stamp":"2024-03-23T23:58:39.573497+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:51:20.196752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"27'4313","reported_seq":4345,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:54.651918+0000","last_change":"2024-03-23T23:58:54.651941+0000","last_active":"2024-03-23T23:58:54.651918+0000","last_peered":"2024-03-23T23:58:54.651918+0000","last_clean":"2024-03-23T23:58:54.651918+0000","last_became_active":"2024-03-23T23:42:50.749491+0000","last_became_peered":"2024-03-23T23:42:50.749491+0000","last_unstale":"2024-03-23T23:58:54.651918+0000","last_undegraded":"2024-03-23T23:58:54.651918+0000","last_fullsized":"2024-03-23T23:58:54.651918+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4313","last_scrub_stamp":"2024-03-23T23:58:54.651821+0000","last_deep_scrub":"27'4313","last_deep_scrub_stamp":"2024-03-23T23:58:54.651821+0000","last_clean_scrub_stamp":"2024-03-23T23:58:54.651821+0000","objects_scrubbed":0,"log_size":4313,"log_dups_size":0,"ondisk_log_size":4313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:15:42.369987+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64025,"num_write_kb":713675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'4688","reported_seq":4728,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:56.521006+0000","last_change":"2024-03-23T23:58:56.521026+0000","last_active":"2024-03-23T23:58:56.521006+0000","last_peered":"2024-03-23T23:58:56.521006+0000","last_clean":"2024-03-23T23:58:56.521006+0000","last_became_active":"2024-03-23T23:42:40.682672+0000","last_became_peered":"2024-03-23T23:42:40.682672+0000","last_unstale":"2024-03-23T23:58:56.521006+0000","last_undegraded":"2024-03-23T23:58:56.521006+0000","last_fullsized":"2024-03-23T23:58:56.521006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4688","last_scrub_stamp":"2024-03-23T23:58:56.520927+0000","last_deep_scrub":"27'4688","last_deep_scrub_stamp":"2024-03-23T23:58:56.520927+0000","last_clean_scrub_stamp":"2024-03-23T23:58:56.520927+0000","objects_scrubbed":0,"log_size":4688,"log_dups_size":0,"ondisk_log_size":4688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:06:22.152354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69709,"num_write_kb":858998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'2","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:49.303183+0000","last_change":"2024-03-23T23:58:49.303204+0000","last_active":"2024-03-23T23:58:49.303183+0000","last_peered":"2024-03-23T23:58:49.303183+0000","last_clean":"2024-03-23T23:58:49.303183+0000","last_became_active":"2024-03-23T23:42:39.691124+0000","last_became_peered":"2024-03-23T23:42:39.691124+0000","last_unstale":"2024-03-23T23:58:49.303183+0000","last_undegraded":"2024-03-23T23:58:49.303183+0000","last_fullsized":"2024-03-23T23:58:49.303183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-03-23T23:58:49.303114+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-03-23T23:58:49.303114+0000","last_clean_scrub_stamp":"2024-03-23T23:58:49.303114+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:38:53.150639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'25","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:42.361109+0000","last_change":"2024-03-23T23:58:42.361109+0000","last_active":"2024-03-23T23:58:42.361109+0000","last_peered":"2024-03-23T23:58:42.361109+0000","last_clean":"2024-03-23T23:58:42.361109+0000","last_became_active":"2024-03-23T23:42:49.749279+0000","last_became_peered":"2024-03-23T23:42:49.749279+0000","last_unstale":"2024-03-23T23:58:42.361109+0000","last_undegraded":"2024-03-23T23:58:42.361109+0000","last_fullsized":"2024-03-23T23:58:42.361109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-03-23T23:58:42.360925+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-03-23T23:58:42.360925+0000","last_clean_scrub_stamp":"2024-03-23T23:58:42.360925+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:20:49.755080+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"27'6858","reported_seq":6890,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:56.434264+0000","last_change":"2024-03-23T23:58:56.434286+0000","last_active":"2024-03-23T23:58:56.434264+0000","last_peered":"2024-03-23T23:58:56.434264+0000","last_clean":"2024-03-23T23:58:56.434264+0000","last_became_active":"2024-03-23T23:42:50.752674+0000","last_became_peered":"2024-03-23T23:42:50.752674+0000","last_unstale":"2024-03-23T23:58:56.434264+0000","last_undegraded":"2024-03-23T23:58:56.434264+0000","last_fullsized":"2024-03-23T23:58:56.434264+0000","mapping_epoch":23,"log_start":"27'900","ondisk_log_start":"27'900","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6858","last_scrub_stamp":"2024-03-23T23:58:56.434176+0000","last_deep_scrub":"27'6858","last_deep_scrub_stamp":"2024-03-23T23:58:56.434176+0000","last_clean_scrub_stamp":"2024-03-23T23:58:56.434176+0000","objects_scrubbed":0,"log_size":5958,"log_dups_size":0,"ondisk_log_size":5958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:40:25.224332+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101780,"num_write_kb":1163482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"27'4769","reported_seq":4809,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:48.678098+0000","last_change":"2024-03-23T23:58:48.678118+0000","last_active":"2024-03-23T23:58:48.678098+0000","last_peered":"2024-03-23T23:58:48.678098+0000","last_clean":"2024-03-23T23:58:48.678098+0000","last_became_active":"2024-03-23T23:42:40.684677+0000","last_became_peered":"2024-03-23T23:42:40.684677+0000","last_unstale":"2024-03-23T23:58:48.678098+0000","last_undegraded":"2024-03-23T23:58:48.678098+0000","last_fullsized":"2024-03-23T23:58:48.678098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4769","last_scrub_stamp":"2024-03-23T23:58:48.678032+0000","last_deep_scrub":"27'4769","last_deep_scrub_stamp":"2024-03-23T23:58:48.678032+0000","last_clean_scrub_stamp":"2024-03-23T23:58:48.678032+0000","objects_scrubbed":0,"log_size":4769,"log_dups_size":0,"ondisk_log_size":4769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:40:39.551526+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71276,"num_write_kb":829070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'21","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:54.343453+0000","last_change":"2024-03-23T23:58:54.343500+0000","last_active":"2024-03-23T23:58:54.343453+0000","last_peered":"2024-03-23T23:58:54.343453+0000","last_clean":"2024-03-23T23:58:54.343453+0000","last_became_active":"2024-03-23T23:42:39.694746+0000","last_became_peered":"2024-03-23T23:42:39.694746+0000","last_unstale":"2024-03-23T23:58:54.343453+0000","last_undegraded":"2024-03-23T23:58:54.343453+0000","last_fullsized":"2024-03-23T23:58:54.343453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2024-03-23T23:58:54.343335+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2024-03-23T23:58:54.343335+0000","last_clean_scrub_stamp":"2024-03-23T23:58:54.343335+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:00:58.284118+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'22","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:50.703721+0000","last_change":"2024-03-23T23:58:50.703748+0000","last_active":"2024-03-23T23:58:50.703721+0000","last_peered":"2024-03-23T23:58:50.703721+0000","last_clean":"2024-03-23T23:58:50.703721+0000","last_became_active":"2024-03-23T23:42:49.724009+0000","last_became_peered":"2024-03-23T23:42:49.724009+0000","last_unstale":"2024-03-23T23:58:50.703721+0000","last_undegraded":"2024-03-23T23:58:50.703721+0000","last_fullsized":"2024-03-23T23:58:50.703721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T23:58:50.703643+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T23:58:50.703643+0000","last_clean_scrub_stamp":"2024-03-23T23:58:50.703643+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:04:09.350054+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"27'4307","reported_seq":4340,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:59.501126+0000","last_change":"2024-03-23T23:58:59.501126+0000","last_active":"2024-03-23T23:58:59.501126+0000","last_peered":"2024-03-23T23:58:59.501126+0000","last_clean":"2024-03-23T23:58:59.501126+0000","last_became_active":"2024-03-23T23:42:50.746492+0000","last_became_peered":"2024-03-23T23:42:50.746492+0000","last_unstale":"2024-03-23T23:58:59.501126+0000","last_undegraded":"2024-03-23T23:58:59.501126+0000","last_fullsized":"2024-03-23T23:58:59.501126+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4307","last_scrub_stamp":"2024-03-23T23:58:59.501010+0000","last_deep_scrub":"27'4307","last_deep_scrub_stamp":"2024-03-23T23:58:59.501010+0000","last_clean_scrub_stamp":"2024-03-23T23:58:59.501010+0000","objects_scrubbed":0,"log_size":4307,"log_dups_size":0,"ondisk_log_size":4307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:20:53.939097+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63604,"num_write_kb":723087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"27'5742","reported_seq":5782,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:45.278212+0000","last_change":"2024-03-23T23:58:45.278272+0000","last_active":"2024-03-23T23:58:45.278212+0000","last_peered":"2024-03-23T23:58:45.278212+0000","last_clean":"2024-03-23T23:58:45.278212+0000","last_became_active":"2024-03-23T23:42:40.680744+0000","last_became_peered":"2024-03-23T23:42:40.680744+0000","last_unstale":"2024-03-23T23:58:45.278212+0000","last_undegraded":"2024-03-23T23:58:45.278212+0000","last_fullsized":"2024-03-23T23:58:45.278212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5742","last_scrub_stamp":"2024-03-23T23:58:45.278132+0000","last_deep_scrub":"27'5742","last_deep_scrub_stamp":"2024-03-23T23:58:45.278132+0000","last_clean_scrub_stamp":"2024-03-23T23:58:45.278132+0000","objects_scrubbed":0,"log_size":5742,"log_dups_size":0,"ondisk_log_size":5742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:20:52.672287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85158,"num_write_kb":1014619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'9","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:45.728479+0000","last_change":"2024-03-23T23:58:45.728504+0000","last_active":"2024-03-23T23:58:45.728479+0000","last_peered":"2024-03-23T23:58:45.728479+0000","last_clean":"2024-03-23T23:58:45.728479+0000","last_became_active":"2024-03-23T23:42:39.691519+0000","last_became_peered":"2024-03-23T23:42:39.691519+0000","last_unstale":"2024-03-23T23:58:45.728479+0000","last_undegraded":"2024-03-23T23:58:45.728479+0000","last_fullsized":"2024-03-23T23:58:45.728479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-03-23T23:58:45.728406+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-03-23T23:58:45.728406+0000","last_clean_scrub_stamp":"2024-03-23T23:58:45.728406+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:01:36.597796+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'35","reported_seq":100,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:36.520722+0000","last_change":"2024-03-23T23:58:36.520747+0000","last_active":"2024-03-23T23:58:36.520722+0000","last_peered":"2024-03-23T23:58:36.520722+0000","last_clean":"2024-03-23T23:58:36.520722+0000","last_became_active":"2024-03-23T23:42:49.733715+0000","last_became_peered":"2024-03-23T23:42:49.733715+0000","last_unstale":"2024-03-23T23:58:36.520722+0000","last_undegraded":"2024-03-23T23:58:36.520722+0000","last_fullsized":"2024-03-23T23:58:36.520722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2024-03-23T23:58:36.520662+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2024-03-23T23:58:36.520662+0000","last_clean_scrub_stamp":"2024-03-23T23:58:36.520662+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:30:35.829513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84646,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":105,"num_write":31,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"27'4491","reported_seq":4523,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:52.739786+0000","last_change":"2024-03-23T23:58:52.739825+0000","last_active":"2024-03-23T23:58:52.739786+0000","last_peered":"2024-03-23T23:58:52.739786+0000","last_clean":"2024-03-23T23:58:52.739786+0000","last_became_active":"2024-03-23T23:42:50.739706+0000","last_became_peered":"2024-03-23T23:42:50.739706+0000","last_unstale":"2024-03-23T23:58:52.739786+0000","last_undegraded":"2024-03-23T23:58:52.739786+0000","last_fullsized":"2024-03-23T23:58:52.739786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4491","last_scrub_stamp":"2024-03-23T23:58:52.739645+0000","last_deep_scrub":"27'4491","last_deep_scrub_stamp":"2024-03-23T23:58:52.739645+0000","last_clean_scrub_stamp":"2024-03-23T23:58:52.739645+0000","objects_scrubbed":0,"log_size":4491,"log_dups_size":0,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:38:03.343494+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66952,"num_write_kb":756851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'4353","reported_seq":4379,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:51.995670+0000","last_change":"2024-03-23T23:58:51.995691+0000","last_active":"2024-03-23T23:58:51.995670+0000","last_peered":"2024-03-23T23:58:51.995670+0000","last_clean":"2024-03-23T23:58:51.995670+0000","last_became_active":"2024-03-23T23:43:22.034125+0000","last_became_peered":"2024-03-23T23:43:22.034125+0000","last_unstale":"2024-03-23T23:58:51.995670+0000","last_undegraded":"2024-03-23T23:58:51.995670+0000","last_fullsized":"2024-03-23T23:58:51.995670+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4353","last_scrub_stamp":"2024-03-23T23:58:51.995592+0000","last_deep_scrub":"27'4353","last_deep_scrub_stamp":"2024-03-23T23:58:51.995592+0000","last_clean_scrub_stamp":"2024-03-23T23:58:51.995592+0000","objects_scrubbed":0,"log_size":4353,"log_dups_size":0,"ondisk_log_size":4353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:19:48.461127+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64538,"num_write_kb":790050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"27'317","reported_seq":359,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:47.321905+0000","last_change":"2024-03-23T23:58:47.321926+0000","last_active":"2024-03-23T23:58:47.321905+0000","last_peered":"2024-03-23T23:58:47.321905+0000","last_clean":"2024-03-23T23:58:47.321905+0000","last_became_active":"2024-03-23T23:42:39.678603+0000","last_became_peered":"2024-03-23T23:42:39.678603+0000","last_unstale":"2024-03-23T23:58:47.321905+0000","last_undegraded":"2024-03-23T23:58:47.321905+0000","last_fullsized":"2024-03-23T23:58:47.321905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'317","last_scrub_stamp":"2024-03-23T23:58:47.321845+0000","last_deep_scrub":"27'317","last_deep_scrub_stamp":"2024-03-23T23:58:47.321845+0000","last_clean_scrub_stamp":"2024-03-23T23:58:47.321845+0000","objects_scrubbed":1,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:41:20.070482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":650,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'41","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:39.319087+0000","last_change":"2024-03-23T23:58:39.319087+0000","last_active":"2024-03-23T23:58:39.319087+0000","last_peered":"2024-03-23T23:58:39.319087+0000","last_clean":"2024-03-23T23:58:39.319087+0000","last_became_active":"2024-03-23T23:42:49.740290+0000","last_became_peered":"2024-03-23T23:42:49.740290+0000","last_unstale":"2024-03-23T23:58:39.319087+0000","last_undegraded":"2024-03-23T23:58:39.319087+0000","last_fullsized":"2024-03-23T23:58:39.319087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'41","last_scrub_stamp":"2024-03-23T23:58:39.319007+0000","last_deep_scrub":"27'41","last_deep_scrub_stamp":"2024-03-23T23:58:39.319007+0000","last_clean_scrub_stamp":"2024-03-23T23:58:39.319007+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:59:53.483821+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"27'5050","reported_seq":5082,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:53.728277+0000","last_change":"2024-03-23T23:58:53.728316+0000","last_active":"2024-03-23T23:58:53.728277+0000","last_peered":"2024-03-23T23:58:53.728277+0000","last_clean":"2024-03-23T23:58:53.728277+0000","last_became_active":"2024-03-23T23:42:50.750859+0000","last_became_peered":"2024-03-23T23:42:50.750859+0000","last_unstale":"2024-03-23T23:58:53.728277+0000","last_undegraded":"2024-03-23T23:58:53.728277+0000","last_fullsized":"2024-03-23T23:58:53.728277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5050","last_scrub_stamp":"2024-03-23T23:58:53.728178+0000","last_deep_scrub":"27'5050","last_deep_scrub_stamp":"2024-03-23T23:58:53.728178+0000","last_clean_scrub_stamp":"2024-03-23T23:58:53.728178+0000","objects_scrubbed":0,"log_size":5050,"log_dups_size":0,"ondisk_log_size":5050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:00:31.317235+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75095,"num_write_kb":843705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"27'6329","reported_seq":6369,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:37.349118+0000","last_change":"2024-03-23T23:58:37.349143+0000","last_active":"2024-03-23T23:58:37.349118+0000","last_peered":"2024-03-23T23:58:37.349118+0000","last_clean":"2024-03-23T23:58:37.349118+0000","last_became_active":"2024-03-23T23:42:40.686186+0000","last_became_peered":"2024-03-23T23:42:40.686186+0000","last_unstale":"2024-03-23T23:58:37.349118+0000","last_undegraded":"2024-03-23T23:58:37.349118+0000","last_fullsized":"2024-03-23T23:58:37.349118+0000","mapping_epoch":19,"log_start":"27'600","ondisk_log_start":"27'600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6329","last_scrub_stamp":"2024-03-23T23:58:37.348719+0000","last_deep_scrub":"27'6329","last_deep_scrub_stamp":"2024-03-23T23:58:37.348719+0000","last_clean_scrub_stamp":"2024-03-23T23:58:37.348719+0000","objects_scrubbed":0,"log_size":5729,"log_dups_size":0,"ondisk_log_size":5729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:43:10.426379+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94311,"num_write_kb":1142337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'2","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:53.296463+0000","last_change":"2024-03-23T23:58:53.296483+0000","last_active":"2024-03-23T23:58:53.296463+0000","last_peered":"2024-03-23T23:58:53.296463+0000","last_clean":"2024-03-23T23:58:53.296463+0000","last_became_active":"2024-03-23T23:42:39.694720+0000","last_became_peered":"2024-03-23T23:42:39.694720+0000","last_unstale":"2024-03-23T23:58:53.296463+0000","last_undegraded":"2024-03-23T23:58:53.296463+0000","last_fullsized":"2024-03-23T23:58:53.296463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-03-23T23:58:53.296397+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-03-23T23:58:53.296397+0000","last_clean_scrub_stamp":"2024-03-23T23:58:53.296397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:47:31.673721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'3","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:47.215580+0000","last_change":"2024-03-23T23:58:47.215603+0000","last_active":"2024-03-23T23:58:47.215580+0000","last_peered":"2024-03-23T23:58:47.215580+0000","last_clean":"2024-03-23T23:58:47.215580+0000","last_became_active":"2024-03-23T23:42:49.738198+0000","last_became_peered":"2024-03-23T23:42:49.738198+0000","last_unstale":"2024-03-23T23:58:47.215580+0000","last_undegraded":"2024-03-23T23:58:47.215580+0000","last_fullsized":"2024-03-23T23:58:47.215580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-03-23T23:58:47.215506+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-03-23T23:58:47.215506+0000","last_clean_scrub_stamp":"2024-03-23T23:58:47.215506+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:35:52.208360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"27'5389","reported_seq":5421,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:51.281917+0000","last_change":"2024-03-23T23:58:51.281953+0000","last_active":"2024-03-23T23:58:51.281917+0000","last_peered":"2024-03-23T23:58:51.281917+0000","last_clean":"2024-03-23T23:58:51.281917+0000","last_became_active":"2024-03-23T23:42:50.754585+0000","last_became_peered":"2024-03-23T23:42:50.754585+0000","last_unstale":"2024-03-23T23:58:51.281917+0000","last_undegraded":"2024-03-23T23:58:51.281917+0000","last_fullsized":"2024-03-23T23:58:51.281917+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5389","last_scrub_stamp":"2024-03-23T23:58:51.281810+0000","last_deep_scrub":"27'5389","last_deep_scrub_stamp":"2024-03-23T23:58:51.281810+0000","last_clean_scrub_stamp":"2024-03-23T23:58:51.281810+0000","objects_scrubbed":0,"log_size":5389,"log_dups_size":0,"ondisk_log_size":5389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:48:22.632904+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80225,"num_write_kb":941986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'4652","reported_seq":4692,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:43.419290+0000","last_change":"2024-03-23T23:58:43.419310+0000","last_active":"2024-03-23T23:58:43.419290+0000","last_peered":"2024-03-23T23:58:43.419290+0000","last_clean":"2024-03-23T23:58:43.419290+0000","last_became_active":"2024-03-23T23:42:40.700112+0000","last_became_peered":"2024-03-23T23:42:40.700112+0000","last_unstale":"2024-03-23T23:58:43.419290+0000","last_undegraded":"2024-03-23T23:58:43.419290+0000","last_fullsized":"2024-03-23T23:58:43.419290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4652","last_scrub_stamp":"2024-03-23T23:58:43.419224+0000","last_deep_scrub":"27'4652","last_deep_scrub_stamp":"2024-03-23T23:58:43.419224+0000","last_clean_scrub_stamp":"2024-03-23T23:58:43.419224+0000","objects_scrubbed":0,"log_size":4652,"log_dups_size":0,"ondisk_log_size":4652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:40:34.292718+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68979,"num_write_kb":836174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'2","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:48.295907+0000","last_change":"2024-03-23T23:58:48.295928+0000","last_active":"2024-03-23T23:58:48.295907+0000","last_peered":"2024-03-23T23:58:48.295907+0000","last_clean":"2024-03-23T23:58:48.295907+0000","last_became_active":"2024-03-23T23:42:39.686094+0000","last_became_peered":"2024-03-23T23:42:39.686094+0000","last_unstale":"2024-03-23T23:58:48.295907+0000","last_undegraded":"2024-03-23T23:58:48.295907+0000","last_fullsized":"2024-03-23T23:58:48.295907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-03-23T23:58:48.295837+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-03-23T23:58:48.295837+0000","last_clean_scrub_stamp":"2024-03-23T23:58:48.295837+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:48:19.646932+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'70","reported_seq":105,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:36.363415+0000","last_change":"2024-03-23T23:58:36.363415+0000","last_active":"2024-03-23T23:58:36.363415+0000","last_peered":"2024-03-23T23:58:36.363415+0000","last_clean":"2024-03-23T23:58:36.363415+0000","last_became_active":"2024-03-23T23:42:49.737916+0000","last_became_peered":"2024-03-23T23:42:49.737916+0000","last_unstale":"2024-03-23T23:58:36.363415+0000","last_undegraded":"2024-03-23T23:58:36.363415+0000","last_fullsized":"2024-03-23T23:58:36.363415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'70","last_scrub_stamp":"2024-03-23T23:58:36.363306+0000","last_deep_scrub":"27'70","last_deep_scrub_stamp":"2024-03-23T23:58:36.363306+0000","last_clean_scrub_stamp":"2024-03-23T23:58:36.363306+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:34:24.832959+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":8223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"27'4725","reported_seq":4757,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:52.215129+0000","last_change":"2024-03-23T23:58:52.215167+0000","last_active":"2024-03-23T23:58:52.215129+0000","last_peered":"2024-03-23T23:58:52.215129+0000","last_clean":"2024-03-23T23:58:52.215129+0000","last_became_active":"2024-03-23T23:42:50.763768+0000","last_became_peered":"2024-03-23T23:42:50.763768+0000","last_unstale":"2024-03-23T23:58:52.215129+0000","last_undegraded":"2024-03-23T23:58:52.215129+0000","last_fullsized":"2024-03-23T23:58:52.215129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4725","last_scrub_stamp":"2024-03-23T23:58:52.215025+0000","last_deep_scrub":"27'4725","last_deep_scrub_stamp":"2024-03-23T23:58:52.215025+0000","last_clean_scrub_stamp":"2024-03-23T23:58:52.215025+0000","objects_scrubbed":0,"log_size":4725,"log_dups_size":0,"ondisk_log_size":4725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:38:56.062551+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69706,"num_write_kb":805786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"27'5477","reported_seq":5517,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:44.664454+0000","last_change":"2024-03-23T23:58:44.664476+0000","last_active":"2024-03-23T23:58:44.664454+0000","last_peered":"2024-03-23T23:58:44.664454+0000","last_clean":"2024-03-23T23:58:44.664454+0000","last_became_active":"2024-03-23T23:42:40.679488+0000","last_became_peered":"2024-03-23T23:42:40.679488+0000","last_unstale":"2024-03-23T23:58:44.664454+0000","last_undegraded":"2024-03-23T23:58:44.664454+0000","last_fullsized":"2024-03-23T23:58:44.664454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5477","last_scrub_stamp":"2024-03-23T23:58:44.664378+0000","last_deep_scrub":"27'5477","last_deep_scrub_stamp":"2024-03-23T23:58:44.664378+0000","last_clean_scrub_stamp":"2024-03-23T23:58:44.664378+0000","objects_scrubbed":0,"log_size":5477,"log_dups_size":0,"ondisk_log_size":5477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:19:52.748381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82124,"num_write_kb":1001722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'30","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:48.431402+0000","last_change":"2024-03-23T23:58:48.431428+0000","last_active":"2024-03-23T23:58:48.431402+0000","last_peered":"2024-03-23T23:58:48.431402+0000","last_clean":"2024-03-23T23:58:48.431402+0000","last_became_active":"2024-03-23T23:42:39.678864+0000","last_became_peered":"2024-03-23T23:42:39.678864+0000","last_unstale":"2024-03-23T23:58:48.431402+0000","last_undegraded":"2024-03-23T23:58:48.431402+0000","last_fullsized":"2024-03-23T23:58:48.431402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-03-23T23:58:48.431324+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-03-23T23:58:48.431324+0000","last_clean_scrub_stamp":"2024-03-23T23:58:48.431324+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:34:06.634133+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":8210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'2","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:40.321103+0000","last_change":"2024-03-23T23:58:40.321124+0000","last_active":"2024-03-23T23:58:40.321103+0000","last_peered":"2024-03-23T23:58:40.321103+0000","last_clean":"2024-03-23T23:58:40.321103+0000","last_became_active":"2024-03-23T23:42:49.739570+0000","last_became_peered":"2024-03-23T23:42:49.739570+0000","last_unstale":"2024-03-23T23:58:40.321103+0000","last_undegraded":"2024-03-23T23:58:40.321103+0000","last_fullsized":"2024-03-23T23:58:40.321103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-03-23T23:58:40.321022+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-03-23T23:58:40.321022+0000","last_clean_scrub_stamp":"2024-03-23T23:58:40.321022+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:36:52.234735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'5788","reported_seq":5821,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:46.033463+0000","last_change":"2024-03-23T23:58:46.033501+0000","last_active":"2024-03-23T23:58:46.033463+0000","last_peered":"2024-03-23T23:58:46.033463+0000","last_clean":"2024-03-23T23:58:46.033463+0000","last_became_active":"2024-03-23T23:42:50.753629+0000","last_became_peered":"2024-03-23T23:42:50.753629+0000","last_unstale":"2024-03-23T23:58:46.033463+0000","last_undegraded":"2024-03-23T23:58:46.033463+0000","last_fullsized":"2024-03-23T23:58:46.033463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5788","last_scrub_stamp":"2024-03-23T23:58:46.033358+0000","last_deep_scrub":"27'5788","last_deep_scrub_stamp":"2024-03-23T23:58:46.033358+0000","last_clean_scrub_stamp":"2024-03-23T23:58:46.033358+0000","objects_scrubbed":0,"log_size":5788,"log_dups_size":0,"ondisk_log_size":5788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:45:02.420598+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":85415,"num_write_kb":969479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'4118","reported_seq":4159,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:39.390550+0000","last_change":"2024-03-23T23:58:39.390550+0000","last_active":"2024-03-23T23:58:39.390550+0000","last_peered":"2024-03-23T23:58:39.390550+0000","last_clean":"2024-03-23T23:58:39.390550+0000","last_became_active":"2024-03-23T23:42:40.682391+0000","last_became_peered":"2024-03-23T23:42:40.682391+0000","last_unstale":"2024-03-23T23:58:39.390550+0000","last_undegraded":"2024-03-23T23:58:39.390550+0000","last_fullsized":"2024-03-23T23:58:39.390550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4118","last_scrub_stamp":"2024-03-23T23:58:39.390444+0000","last_deep_scrub":"27'4118","last_deep_scrub_stamp":"2024-03-23T23:58:39.390444+0000","last_clean_scrub_stamp":"2024-03-23T23:58:39.390444+0000","objects_scrubbed":0,"log_size":4118,"log_dups_size":0,"ondisk_log_size":4118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:36:03.164530+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61030,"num_write_kb":768099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'48","reported_seq":135,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:39.035264+0000","last_change":"2024-03-23T23:58:39.035264+0000","last_active":"2024-03-23T23:58:39.035264+0000","last_peered":"2024-03-23T23:58:39.035264+0000","last_clean":"2024-03-23T23:58:39.035264+0000","last_became_active":"2024-03-23T23:42:39.680494+0000","last_became_peered":"2024-03-23T23:42:39.680494+0000","last_unstale":"2024-03-23T23:58:39.035264+0000","last_undegraded":"2024-03-23T23:58:39.035264+0000","last_fullsized":"2024-03-23T23:58:39.035264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'48","last_scrub_stamp":"2024-03-23T23:58:39.035181+0000","last_deep_scrub":"27'48","last_deep_scrub_stamp":"2024-03-23T23:58:39.035181+0000","last_clean_scrub_stamp":"2024-03-23T23:58:39.035181+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:40:15.581233+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84561,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":115,"num_write":44,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'10","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:38.369258+0000","last_change":"2024-03-23T23:58:38.369300+0000","last_active":"2024-03-23T23:58:38.369258+0000","last_peered":"2024-03-23T23:58:38.369258+0000","last_clean":"2024-03-23T23:58:38.369258+0000","last_became_active":"2024-03-23T23:42:49.737196+0000","last_became_peered":"2024-03-23T23:42:49.737196+0000","last_unstale":"2024-03-23T23:58:38.369258+0000","last_undegraded":"2024-03-23T23:58:38.369258+0000","last_fullsized":"2024-03-23T23:58:38.369258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-03-23T23:58:38.369121+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-03-23T23:58:38.369121+0000","last_clean_scrub_stamp":"2024-03-23T23:58:38.369121+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:32:15.198180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"27'4476","reported_seq":4508,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:59:00.500739+0000","last_change":"2024-03-23T23:59:00.500774+0000","last_active":"2024-03-23T23:59:00.500739+0000","last_peered":"2024-03-23T23:59:00.500739+0000","last_clean":"2024-03-23T23:59:00.500739+0000","last_became_active":"2024-03-23T23:42:50.763007+0000","last_became_peered":"2024-03-23T23:42:50.763007+0000","last_unstale":"2024-03-23T23:59:00.500739+0000","last_undegraded":"2024-03-23T23:59:00.500739+0000","last_fullsized":"2024-03-23T23:59:00.500739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4476","last_scrub_stamp":"2024-03-23T23:59:00.500648+0000","last_deep_scrub":"27'4476","last_deep_scrub_stamp":"2024-03-23T23:59:00.500648+0000","last_clean_scrub_stamp":"2024-03-23T23:59:00.500648+0000","objects_scrubbed":0,"log_size":4476,"log_dups_size":0,"ondisk_log_size":4476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:27:30.447927+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66536,"num_write_kb":757522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"27'4410","reported_seq":4451,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:42.250140+0000","last_change":"2024-03-23T23:58:42.250140+0000","last_active":"2024-03-23T23:58:42.250140+0000","last_peered":"2024-03-23T23:58:42.250140+0000","last_clean":"2024-03-23T23:58:42.250140+0000","last_became_active":"2024-03-23T23:42:40.674390+0000","last_became_peered":"2024-03-23T23:42:40.674390+0000","last_unstale":"2024-03-23T23:58:42.250140+0000","last_undegraded":"2024-03-23T23:58:42.250140+0000","last_fullsized":"2024-03-23T23:58:42.250140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4410","last_scrub_stamp":"2024-03-23T23:58:42.250038+0000","last_deep_scrub":"27'4410","last_deep_scrub_stamp":"2024-03-23T23:58:42.250038+0000","last_clean_scrub_stamp":"2024-03-23T23:58:42.250038+0000","objects_scrubbed":0,"log_size":4410,"log_dups_size":0,"ondisk_log_size":4410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:36:06.024124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65732,"num_write_kb":804228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'46","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:52.341940+0000","last_change":"2024-03-23T23:58:52.341940+0000","last_active":"2024-03-23T23:58:52.341940+0000","last_peered":"2024-03-23T23:58:52.341940+0000","last_clean":"2024-03-23T23:58:52.341940+0000","last_became_active":"2024-03-23T23:42:39.689763+0000","last_became_peered":"2024-03-23T23:42:39.689763+0000","last_unstale":"2024-03-23T23:58:52.341940+0000","last_undegraded":"2024-03-23T23:58:52.341940+0000","last_fullsized":"2024-03-23T23:58:52.341940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-03-23T23:58:52.341802+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-03-23T23:58:52.341802+0000","last_clean_scrub_stamp":"2024-03-23T23:58:52.341802+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:10:06.945040+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'354","reported_seq":388,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:35.220816+0000","last_change":"2024-03-23T23:58:35.220860+0000","last_active":"2024-03-23T23:58:35.220816+0000","last_peered":"2024-03-23T23:58:35.220816+0000","last_clean":"2024-03-23T23:58:35.220816+0000","last_became_active":"2024-03-23T23:42:49.733115+0000","last_became_peered":"2024-03-23T23:42:49.733115+0000","last_unstale":"2024-03-23T23:58:35.220816+0000","last_undegraded":"2024-03-23T23:58:35.220816+0000","last_fullsized":"2024-03-23T23:58:35.220816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'354","last_scrub_stamp":"2024-03-23T23:58:35.220733+0000","last_deep_scrub":"27'354","last_deep_scrub_stamp":"2024-03-23T23:58:35.220733+0000","last_clean_scrub_stamp":"2024-03-23T23:58:35.220733+0000","objects_scrubbed":1,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:25:39.027710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":739,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"27'6380","reported_seq":6412,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:59:03.455052+0000","last_change":"2024-03-23T23:59:03.455090+0000","last_active":"2024-03-23T23:59:03.455052+0000","last_peered":"2024-03-23T23:59:03.455052+0000","last_clean":"2024-03-23T23:59:03.455052+0000","last_became_active":"2024-03-23T23:42:50.758552+0000","last_became_peered":"2024-03-23T23:42:50.758552+0000","last_unstale":"2024-03-23T23:59:03.455052+0000","last_undegraded":"2024-03-23T23:59:03.455052+0000","last_fullsized":"2024-03-23T23:59:03.455052+0000","mapping_epoch":23,"log_start":"27'700","ondisk_log_start":"27'700","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6380","last_scrub_stamp":"2024-03-23T23:59:03.454950+0000","last_deep_scrub":"27'6380","last_deep_scrub_stamp":"2024-03-23T23:59:03.454950+0000","last_clean_scrub_stamp":"2024-03-23T23:59:03.454950+0000","objects_scrubbed":0,"log_size":5680,"log_dups_size":0,"ondisk_log_size":5680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:59:10.543597+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94645,"num_write_kb":1081333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"27'5078","reported_seq":5119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:43.410744+0000","last_change":"2024-03-23T23:58:43.410744+0000","last_active":"2024-03-23T23:58:43.410744+0000","last_peered":"2024-03-23T23:58:43.410744+0000","last_clean":"2024-03-23T23:58:43.410744+0000","last_became_active":"2024-03-23T23:42:40.700788+0000","last_became_peered":"2024-03-23T23:42:40.700788+0000","last_unstale":"2024-03-23T23:58:43.410744+0000","last_undegraded":"2024-03-23T23:58:43.410744+0000","last_fullsized":"2024-03-23T23:58:43.410744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5078","last_scrub_stamp":"2024-03-23T23:58:43.410560+0000","last_deep_scrub":"27'5078","last_deep_scrub_stamp":"2024-03-23T23:58:43.410560+0000","last_clean_scrub_stamp":"2024-03-23T23:58:43.410560+0000","objects_scrubbed":0,"log_size":5078,"log_dups_size":0,"ondisk_log_size":5078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:37:54.014410+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75375,"num_write_kb":887789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'3","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:50.373324+0000","last_change":"2024-03-23T23:58:50.373363+0000","last_active":"2024-03-23T23:58:50.373324+0000","last_peered":"2024-03-23T23:58:50.373324+0000","last_clean":"2024-03-23T23:58:50.373324+0000","last_became_active":"2024-03-23T23:42:39.687378+0000","last_became_peered":"2024-03-23T23:42:39.687378+0000","last_unstale":"2024-03-23T23:58:50.373324+0000","last_undegraded":"2024-03-23T23:58:50.373324+0000","last_fullsized":"2024-03-23T23:58:50.373324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-03-23T23:58:50.373238+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-03-23T23:58:50.373238+0000","last_clean_scrub_stamp":"2024-03-23T23:58:50.373238+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:00:08.690876+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":201,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:51.303233+0000","last_change":"2024-03-23T23:58:51.303233+0000","last_active":"2024-03-23T23:58:51.303233+0000","last_peered":"2024-03-23T23:58:51.303233+0000","last_clean":"2024-03-23T23:58:51.303233+0000","last_became_active":"2024-03-23T23:42:27.939061+0000","last_became_peered":"2024-03-23T23:42:27.939061+0000","last_unstale":"2024-03-23T23:58:51.303233+0000","last_undegraded":"2024-03-23T23:58:51.303233+0000","last_fullsized":"2024-03-23T23:58:51.303233+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-03-23T23:58:51.303148+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-03-23T23:58:51.303148+0000","last_clean_scrub_stamp":"2024-03-23T23:58:51.303148+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:08:45.693544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'3","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:49.773867+0000","last_change":"2024-03-23T23:58:49.773906+0000","last_active":"2024-03-23T23:58:49.773867+0000","last_peered":"2024-03-23T23:58:49.773867+0000","last_clean":"2024-03-23T23:58:49.773867+0000","last_became_active":"2024-03-23T23:42:49.728990+0000","last_became_peered":"2024-03-23T23:42:49.728990+0000","last_unstale":"2024-03-23T23:58:49.773867+0000","last_undegraded":"2024-03-23T23:58:49.773867+0000","last_fullsized":"2024-03-23T23:58:49.773867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-03-23T23:58:49.773781+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-03-23T23:58:49.773781+0000","last_clean_scrub_stamp":"2024-03-23T23:58:49.773781+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:41:04.381138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"27'4440","reported_seq":4472,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:48.002946+0000","last_change":"2024-03-23T23:58:48.002969+0000","last_active":"2024-03-23T23:58:48.002946+0000","last_peered":"2024-03-23T23:58:48.002946+0000","last_clean":"2024-03-23T23:58:48.002946+0000","last_became_active":"2024-03-23T23:42:50.756900+0000","last_became_peered":"2024-03-23T23:42:50.756900+0000","last_unstale":"2024-03-23T23:58:48.002946+0000","last_undegraded":"2024-03-23T23:58:48.002946+0000","last_fullsized":"2024-03-23T23:58:48.002946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4440","last_scrub_stamp":"2024-03-23T23:58:48.002852+0000","last_deep_scrub":"27'4440","last_deep_scrub_stamp":"2024-03-23T23:58:48.002852+0000","last_clean_scrub_stamp":"2024-03-23T23:58:48.002852+0000","objects_scrubbed":0,"log_size":4440,"log_dups_size":0,"ondisk_log_size":4440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:43:21.080512+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65770,"num_write_kb":738740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'5486","reported_seq":5526,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:41.241916+0000","last_change":"2024-03-23T23:58:41.241937+0000","last_active":"2024-03-23T23:58:41.241916+0000","last_peered":"2024-03-23T23:58:41.241916+0000","last_clean":"2024-03-23T23:58:41.241916+0000","last_became_active":"2024-03-23T23:42:40.711306+0000","last_became_peered":"2024-03-23T23:42:40.711306+0000","last_unstale":"2024-03-23T23:58:41.241916+0000","last_undegraded":"2024-03-23T23:58:41.241916+0000","last_fullsized":"2024-03-23T23:58:41.241916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5486","last_scrub_stamp":"2024-03-23T23:58:41.241842+0000","last_deep_scrub":"27'5486","last_deep_scrub_stamp":"2024-03-23T23:58:41.241842+0000","last_clean_scrub_stamp":"2024-03-23T23:58:41.241842+0000","objects_scrubbed":0,"log_size":5486,"log_dups_size":0,"ondisk_log_size":5486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:36:53.155555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81537,"num_write_kb":972707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'5","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:41.017229+0000","last_change":"2024-03-23T23:58:41.017249+0000","last_active":"2024-03-23T23:58:41.017229+0000","last_peered":"2024-03-23T23:58:41.017229+0000","last_clean":"2024-03-23T23:58:41.017229+0000","last_became_active":"2024-03-23T23:42:39.683211+0000","last_became_peered":"2024-03-23T23:42:39.683211+0000","last_unstale":"2024-03-23T23:58:41.017229+0000","last_undegraded":"2024-03-23T23:58:41.017229+0000","last_fullsized":"2024-03-23T23:58:41.017229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-03-23T23:58:41.017161+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-03-23T23:58:41.017161+0000","last_clean_scrub_stamp":"2024-03-23T23:58:41.017161+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:51:23.523336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'124","reported_seq":158,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:51.744403+0000","last_change":"2024-03-23T23:58:51.744426+0000","last_active":"2024-03-23T23:58:51.744403+0000","last_peered":"2024-03-23T23:58:51.744403+0000","last_clean":"2024-03-23T23:58:51.744403+0000","last_became_active":"2024-03-23T23:42:49.735473+0000","last_became_peered":"2024-03-23T23:42:49.735473+0000","last_unstale":"2024-03-23T23:58:51.744403+0000","last_undegraded":"2024-03-23T23:58:51.744403+0000","last_fullsized":"2024-03-23T23:58:51.744403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'124","last_scrub_stamp":"2024-03-23T23:58:51.744330+0000","last_deep_scrub":"27'124","last_deep_scrub_stamp":"2024-03-23T23:58:51.744330+0000","last_clean_scrub_stamp":"2024-03-23T23:58:51.744330+0000","objects_scrubbed":1,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:49:42.839879+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":4181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"27'5305","reported_seq":5337,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:45.045668+0000","last_change":"2024-03-23T23:58:45.045704+0000","last_active":"2024-03-23T23:58:45.045668+0000","last_peered":"2024-03-23T23:58:45.045668+0000","last_clean":"2024-03-23T23:58:45.045668+0000","last_became_active":"2024-03-23T23:42:50.745256+0000","last_became_peered":"2024-03-23T23:42:50.745256+0000","last_unstale":"2024-03-23T23:58:45.045668+0000","last_undegraded":"2024-03-23T23:58:45.045668+0000","last_fullsized":"2024-03-23T23:58:45.045668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5305","last_scrub_stamp":"2024-03-23T23:58:45.045583+0000","last_deep_scrub":"27'5305","last_deep_scrub_stamp":"2024-03-23T23:58:45.045583+0000","last_clean_scrub_stamp":"2024-03-23T23:58:45.045583+0000","objects_scrubbed":0,"log_size":5305,"log_dups_size":0,"ondisk_log_size":5305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:07:31.327376+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78242,"num_write_kb":887262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'5423","reported_seq":5464,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:55.424248+0000","last_change":"2024-03-23T23:58:55.424268+0000","last_active":"2024-03-23T23:58:55.424248+0000","last_peered":"2024-03-23T23:58:55.424248+0000","last_clean":"2024-03-23T23:58:55.424248+0000","last_became_active":"2024-03-23T23:42:40.697369+0000","last_became_peered":"2024-03-23T23:42:40.697369+0000","last_unstale":"2024-03-23T23:58:55.424248+0000","last_undegraded":"2024-03-23T23:58:55.424248+0000","last_fullsized":"2024-03-23T23:58:55.424248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5423","last_scrub_stamp":"2024-03-23T23:58:55.424179+0000","last_deep_scrub":"27'5423","last_deep_scrub_stamp":"2024-03-23T23:58:55.424179+0000","last_clean_scrub_stamp":"2024-03-23T23:58:55.424179+0000","objects_scrubbed":0,"log_size":5423,"log_dups_size":0,"ondisk_log_size":5423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:13:01.890606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":11,"num_write":80814,"num_write_kb":947944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'26","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:44.353019+0000","last_change":"2024-03-23T23:58:44.353045+0000","last_active":"2024-03-23T23:58:44.353019+0000","last_peered":"2024-03-23T23:58:44.353019+0000","last_clean":"2024-03-23T23:58:44.353019+0000","last_became_active":"2024-03-23T23:42:39.680669+0000","last_became_peered":"2024-03-23T23:42:39.680669+0000","last_unstale":"2024-03-23T23:58:44.353019+0000","last_undegraded":"2024-03-23T23:58:44.353019+0000","last_fullsized":"2024-03-23T23:58:44.353019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2024-03-23T23:58:44.352952+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2024-03-23T23:58:44.352952+0000","last_clean_scrub_stamp":"2024-03-23T23:58:44.352952+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:35:49.345806+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'393","reported_seq":427,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:37.246535+0000","last_change":"2024-03-23T23:58:37.246561+0000","last_active":"2024-03-23T23:58:37.246535+0000","last_peered":"2024-03-23T23:58:37.246535+0000","last_clean":"2024-03-23T23:58:37.246535+0000","last_became_active":"2024-03-23T23:42:49.734508+0000","last_became_peered":"2024-03-23T23:42:49.734508+0000","last_unstale":"2024-03-23T23:58:37.246535+0000","last_undegraded":"2024-03-23T23:58:37.246535+0000","last_fullsized":"2024-03-23T23:58:37.246535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'393","last_scrub_stamp":"2024-03-23T23:58:37.246475+0000","last_deep_scrub":"27'393","last_deep_scrub_stamp":"2024-03-23T23:58:37.246475+0000","last_clean_scrub_stamp":"2024-03-23T23:58:37.246475+0000","objects_scrubbed":2,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:05:37.340941+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":4222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"27'4747","reported_seq":4779,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:59:00.397563+0000","last_change":"2024-03-23T23:59:00.397585+0000","last_active":"2024-03-23T23:59:00.397563+0000","last_peered":"2024-03-23T23:59:00.397563+0000","last_clean":"2024-03-23T23:59:00.397563+0000","last_became_active":"2024-03-23T23:42:50.750269+0000","last_became_peered":"2024-03-23T23:42:50.750269+0000","last_unstale":"2024-03-23T23:59:00.397563+0000","last_undegraded":"2024-03-23T23:59:00.397563+0000","last_fullsized":"2024-03-23T23:59:00.397563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4747","last_scrub_stamp":"2024-03-23T23:59:00.397471+0000","last_deep_scrub":"27'4747","last_deep_scrub_stamp":"2024-03-23T23:59:00.397471+0000","last_clean_scrub_stamp":"2024-03-23T23:59:00.397471+0000","objects_scrubbed":0,"log_size":4747,"log_dups_size":0,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:29:32.287499+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70383,"num_write_kb":794086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"27'6880","reported_seq":6920,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:39.233716+0000","last_change":"2024-03-23T23:58:39.233716+0000","last_active":"2024-03-23T23:58:39.233716+0000","last_peered":"2024-03-23T23:58:39.233716+0000","last_clean":"2024-03-23T23:58:39.233716+0000","last_became_active":"2024-03-23T23:42:40.704328+0000","last_became_peered":"2024-03-23T23:42:40.704328+0000","last_unstale":"2024-03-23T23:58:39.233716+0000","last_undegraded":"2024-03-23T23:58:39.233716+0000","last_fullsized":"2024-03-23T23:58:39.233716+0000","mapping_epoch":19,"log_start":"27'1200","ondisk_log_start":"27'1200","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6880","last_scrub_stamp":"2024-03-23T23:58:39.233631+0000","last_deep_scrub":"27'6880","last_deep_scrub_stamp":"2024-03-23T23:58:39.233631+0000","last_clean_scrub_stamp":"2024-03-23T23:58:39.233631+0000","objects_scrubbed":0,"log_size":5680,"log_dups_size":0,"ondisk_log_size":5680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:32:16.062690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102549,"num_write_kb":1203650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'23","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:40.029254+0000","last_change":"2024-03-23T23:58:40.029254+0000","last_active":"2024-03-23T23:58:40.029254+0000","last_peered":"2024-03-23T23:58:40.029254+0000","last_clean":"2024-03-23T23:58:40.029254+0000","last_became_active":"2024-03-23T23:42:39.680506+0000","last_became_peered":"2024-03-23T23:42:39.680506+0000","last_unstale":"2024-03-23T23:58:40.029254+0000","last_undegraded":"2024-03-23T23:58:40.029254+0000","last_fullsized":"2024-03-23T23:58:40.029254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2024-03-23T23:58:40.029160+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2024-03-23T23:58:40.029160+0000","last_clean_scrub_stamp":"2024-03-23T23:58:40.029160+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:13:35.205084+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'29","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:38.570925+0000","last_change":"2024-03-23T23:58:38.570971+0000","last_active":"2024-03-23T23:58:38.570925+0000","last_peered":"2024-03-23T23:58:38.570925+0000","last_clean":"2024-03-23T23:58:38.570925+0000","last_became_active":"2024-03-23T23:42:49.737434+0000","last_became_peered":"2024-03-23T23:42:49.737434+0000","last_unstale":"2024-03-23T23:58:38.570925+0000","last_undegraded":"2024-03-23T23:58:38.570925+0000","last_fullsized":"2024-03-23T23:58:38.570925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2024-03-23T23:58:38.570738+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2024-03-23T23:58:38.570738+0000","last_clean_scrub_stamp":"2024-03-23T23:58:38.570738+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:27:27.969692+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"27'4785","reported_seq":4817,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:36.003393+0000","last_change":"2024-03-23T23:58:36.003421+0000","last_active":"2024-03-23T23:58:36.003393+0000","last_peered":"2024-03-23T23:58:36.003393+0000","last_clean":"2024-03-23T23:58:36.003393+0000","last_became_active":"2024-03-23T23:42:50.746105+0000","last_became_peered":"2024-03-23T23:42:50.746105+0000","last_unstale":"2024-03-23T23:58:36.003393+0000","last_undegraded":"2024-03-23T23:58:36.003393+0000","last_fullsized":"2024-03-23T23:58:36.003393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4785","last_scrub_stamp":"2024-03-23T23:58:36.003286+0000","last_deep_scrub":"27'4785","last_deep_scrub_stamp":"2024-03-23T23:58:36.003286+0000","last_clean_scrub_stamp":"2024-03-23T23:58:36.003286+0000","objects_scrubbed":0,"log_size":4785,"log_dups_size":0,"ondisk_log_size":4785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:17:39.747906+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70705,"num_write_kb":815494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"27'4266","reported_seq":4306,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:46.249275+0000","last_change":"2024-03-23T23:58:46.249295+0000","last_active":"2024-03-23T23:58:46.249275+0000","last_peered":"2024-03-23T23:58:46.249275+0000","last_clean":"2024-03-23T23:58:46.249275+0000","last_became_active":"2024-03-23T23:42:40.696141+0000","last_became_peered":"2024-03-23T23:42:40.696141+0000","last_unstale":"2024-03-23T23:58:46.249275+0000","last_undegraded":"2024-03-23T23:58:46.249275+0000","last_fullsized":"2024-03-23T23:58:46.249275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4266","last_scrub_stamp":"2024-03-23T23:58:46.249195+0000","last_deep_scrub":"27'4266","last_deep_scrub_stamp":"2024-03-23T23:58:46.249195+0000","last_clean_scrub_stamp":"2024-03-23T23:58:46.249195+0000","objects_scrubbed":0,"log_size":4266,"log_dups_size":0,"ondisk_log_size":4266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:03:22.115891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63684,"num_write_kb":761063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'241","reported_seq":283,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:43.639018+0000","last_change":"2024-03-23T23:58:43.639044+0000","last_active":"2024-03-23T23:58:43.639018+0000","last_peered":"2024-03-23T23:58:43.639018+0000","last_clean":"2024-03-23T23:58:43.639018+0000","last_became_active":"2024-03-23T23:42:39.686491+0000","last_became_peered":"2024-03-23T23:42:39.686491+0000","last_unstale":"2024-03-23T23:58:43.639018+0000","last_undegraded":"2024-03-23T23:58:43.639018+0000","last_fullsized":"2024-03-23T23:58:43.639018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'241","last_scrub_stamp":"2024-03-23T23:58:43.638935+0000","last_deep_scrub":"27'241","last_deep_scrub_stamp":"2024-03-23T23:58:43.638935+0000","last_clean_scrub_stamp":"2024-03-23T23:58:43.638935+0000","objects_scrubbed":2,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:49:13.146888+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'2","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:40.588420+0000","last_change":"2024-03-23T23:58:40.588441+0000","last_active":"2024-03-23T23:58:40.588420+0000","last_peered":"2024-03-23T23:58:40.588420+0000","last_clean":"2024-03-23T23:58:40.588420+0000","last_became_active":"2024-03-23T23:42:49.733389+0000","last_became_peered":"2024-03-23T23:42:49.733389+0000","last_unstale":"2024-03-23T23:58:40.588420+0000","last_undegraded":"2024-03-23T23:58:40.588420+0000","last_fullsized":"2024-03-23T23:58:40.588420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-03-23T23:58:40.588361+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-03-23T23:58:40.588361+0000","last_clean_scrub_stamp":"2024-03-23T23:58:40.588361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:27:44.866450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"27'5253","reported_seq":5284,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:59:05.482815+0000","last_change":"2024-03-23T23:59:05.482837+0000","last_active":"2024-03-23T23:59:05.482815+0000","last_peered":"2024-03-23T23:59:05.482815+0000","last_clean":"2024-03-23T23:59:05.482815+0000","last_became_active":"2024-03-23T23:42:50.763871+0000","last_became_peered":"2024-03-23T23:42:50.763871+0000","last_unstale":"2024-03-23T23:59:05.482815+0000","last_undegraded":"2024-03-23T23:59:05.482815+0000","last_fullsized":"2024-03-23T23:59:05.482815+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5253","last_scrub_stamp":"2024-03-23T23:59:05.482653+0000","last_deep_scrub":"27'5253","last_deep_scrub_stamp":"2024-03-23T23:59:05.482653+0000","last_clean_scrub_stamp":"2024-03-23T23:59:05.482653+0000","objects_scrubbed":0,"log_size":5253,"log_dups_size":0,"ondisk_log_size":5253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:32.757787+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77731,"num_write_kb":860727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"27'4092","reported_seq":4132,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:42.210173+0000","last_change":"2024-03-23T23:58:42.210173+0000","last_active":"2024-03-23T23:58:42.210173+0000","last_peered":"2024-03-23T23:58:42.210173+0000","last_clean":"2024-03-23T23:58:42.210173+0000","last_became_active":"2024-03-23T23:42:40.700800+0000","last_became_peered":"2024-03-23T23:42:40.700800+0000","last_unstale":"2024-03-23T23:58:42.210173+0000","last_undegraded":"2024-03-23T23:58:42.210173+0000","last_fullsized":"2024-03-23T23:58:42.210173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4092","last_scrub_stamp":"2024-03-23T23:58:42.210077+0000","last_deep_scrub":"27'4092","last_deep_scrub_stamp":"2024-03-23T23:58:42.210077+0000","last_clean_scrub_stamp":"2024-03-23T23:58:42.210077+0000","objects_scrubbed":0,"log_size":4092,"log_dups_size":0,"ondisk_log_size":4092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:19:38.675612+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60579,"num_write_kb":760058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'19","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:38.004719+0000","last_change":"2024-03-23T23:58:38.004719+0000","last_active":"2024-03-23T23:58:38.004719+0000","last_peered":"2024-03-23T23:58:38.004719+0000","last_clean":"2024-03-23T23:58:38.004719+0000","last_became_active":"2024-03-23T23:42:39.675770+0000","last_became_peered":"2024-03-23T23:42:39.675770+0000","last_unstale":"2024-03-23T23:58:38.004719+0000","last_undegraded":"2024-03-23T23:58:38.004719+0000","last_fullsized":"2024-03-23T23:58:38.004719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-03-23T23:58:38.004625+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-03-23T23:58:38.004625+0000","last_clean_scrub_stamp":"2024-03-23T23:58:38.004625+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:17:43.490584+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'4","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:48.208836+0000","last_change":"2024-03-23T23:58:48.208856+0000","last_active":"2024-03-23T23:58:48.208836+0000","last_peered":"2024-03-23T23:58:48.208836+0000","last_clean":"2024-03-23T23:58:48.208836+0000","last_became_active":"2024-03-23T23:42:49.738053+0000","last_became_peered":"2024-03-23T23:42:49.738053+0000","last_unstale":"2024-03-23T23:58:48.208836+0000","last_undegraded":"2024-03-23T23:58:48.208836+0000","last_fullsized":"2024-03-23T23:58:48.208836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-03-23T23:58:48.208765+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-03-23T23:58:48.208765+0000","last_clean_scrub_stamp":"2024-03-23T23:58:48.208765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:37:36.191114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"27'5776","reported_seq":5807,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:59:02.532980+0000","last_change":"2024-03-23T23:59:02.533003+0000","last_active":"2024-03-23T23:59:02.532980+0000","last_peered":"2024-03-23T23:59:02.532980+0000","last_clean":"2024-03-23T23:59:02.532980+0000","last_became_active":"2024-03-23T23:42:50.770998+0000","last_became_peered":"2024-03-23T23:42:50.770998+0000","last_unstale":"2024-03-23T23:59:02.532980+0000","last_undegraded":"2024-03-23T23:59:02.532980+0000","last_fullsized":"2024-03-23T23:59:02.532980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5776","last_scrub_stamp":"2024-03-23T23:59:02.532892+0000","last_deep_scrub":"27'5776","last_deep_scrub_stamp":"2024-03-23T23:59:02.532892+0000","last_clean_scrub_stamp":"2024-03-23T23:59:02.532892+0000","objects_scrubbed":0,"log_size":5776,"log_dups_size":0,"ondisk_log_size":5776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:40:49.557182+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85663,"num_write_kb":962089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'4463","reported_seq":4503,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:46.762299+0000","last_change":"2024-03-23T23:58:46.762299+0000","last_active":"2024-03-23T23:58:46.762299+0000","last_peered":"2024-03-23T23:58:46.762299+0000","last_clean":"2024-03-23T23:58:46.762299+0000","last_became_active":"2024-03-23T23:42:40.675416+0000","last_became_peered":"2024-03-23T23:42:40.675416+0000","last_unstale":"2024-03-23T23:58:46.762299+0000","last_undegraded":"2024-03-23T23:58:46.762299+0000","last_fullsized":"2024-03-23T23:58:46.762299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4463","last_scrub_stamp":"2024-03-23T23:58:46.762095+0000","last_deep_scrub":"27'4463","last_deep_scrub_stamp":"2024-03-23T23:58:46.762095+0000","last_clean_scrub_stamp":"2024-03-23T23:58:46.762095+0000","objects_scrubbed":0,"log_size":4463,"log_dups_size":0,"ondisk_log_size":4463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:44:30.714116+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66376,"num_write_kb":804237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'5","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:42.690577+0000","last_change":"2024-03-23T23:58:42.690577+0000","last_active":"2024-03-23T23:58:42.690577+0000","last_peered":"2024-03-23T23:58:42.690577+0000","last_clean":"2024-03-23T23:58:42.690577+0000","last_became_active":"2024-03-23T23:42:39.681418+0000","last_became_peered":"2024-03-23T23:42:39.681418+0000","last_unstale":"2024-03-23T23:58:42.690577+0000","last_undegraded":"2024-03-23T23:58:42.690577+0000","last_fullsized":"2024-03-23T23:58:42.690577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-03-23T23:58:42.690454+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-03-23T23:58:42.690454+0000","last_clean_scrub_stamp":"2024-03-23T23:58:42.690454+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:22:56.691436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'3","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:36.260312+0000","last_change":"2024-03-23T23:58:36.260332+0000","last_active":"2024-03-23T23:58:36.260312+0000","last_peered":"2024-03-23T23:58:36.260312+0000","last_clean":"2024-03-23T23:58:36.260312+0000","last_became_active":"2024-03-23T23:42:49.744422+0000","last_became_peered":"2024-03-23T23:42:49.744422+0000","last_unstale":"2024-03-23T23:58:36.260312+0000","last_undegraded":"2024-03-23T23:58:36.260312+0000","last_fullsized":"2024-03-23T23:58:36.260312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-03-23T23:58:36.260243+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-03-23T23:58:36.260243+0000","last_clean_scrub_stamp":"2024-03-23T23:58:36.260243+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:22:43.606768+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"27'4219","reported_seq":4250,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:46.424834+0000","last_change":"2024-03-23T23:58:46.424856+0000","last_active":"2024-03-23T23:58:46.424834+0000","last_peered":"2024-03-23T23:58:46.424834+0000","last_clean":"2024-03-23T23:58:46.424834+0000","last_became_active":"2024-03-23T23:42:50.752783+0000","last_became_peered":"2024-03-23T23:42:50.752783+0000","last_unstale":"2024-03-23T23:58:46.424834+0000","last_undegraded":"2024-03-23T23:58:46.424834+0000","last_fullsized":"2024-03-23T23:58:46.424834+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4219","last_scrub_stamp":"2024-03-23T23:58:46.424738+0000","last_deep_scrub":"27'4219","last_deep_scrub_stamp":"2024-03-23T23:58:46.424738+0000","last_clean_scrub_stamp":"2024-03-23T23:58:46.424738+0000","objects_scrubbed":0,"log_size":4219,"log_dups_size":0,"ondisk_log_size":4219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:17:38.531050+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62346,"num_write_kb":725472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'5180","reported_seq":5220,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:38.259422+0000","last_change":"2024-03-23T23:58:38.259422+0000","last_active":"2024-03-23T23:58:38.259422+0000","last_peered":"2024-03-23T23:58:38.259422+0000","last_clean":"2024-03-23T23:58:38.259422+0000","last_became_active":"2024-03-23T23:42:40.703787+0000","last_became_peered":"2024-03-23T23:42:40.703787+0000","last_unstale":"2024-03-23T23:58:38.259422+0000","last_undegraded":"2024-03-23T23:58:38.259422+0000","last_fullsized":"2024-03-23T23:58:38.259422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5180","last_scrub_stamp":"2024-03-23T23:58:38.259317+0000","last_deep_scrub":"27'5180","last_deep_scrub_stamp":"2024-03-23T23:58:38.259317+0000","last_clean_scrub_stamp":"2024-03-23T23:58:38.259317+0000","objects_scrubbed":0,"log_size":5180,"log_dups_size":0,"ondisk_log_size":5180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:43:11.336977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76955,"num_write_kb":929765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'3","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:51.360217+0000","last_change":"2024-03-23T23:58:51.360217+0000","last_active":"2024-03-23T23:58:51.360217+0000","last_peered":"2024-03-23T23:58:51.360217+0000","last_clean":"2024-03-23T23:58:51.360217+0000","last_became_active":"2024-03-23T23:42:39.688141+0000","last_became_peered":"2024-03-23T23:42:39.688141+0000","last_unstale":"2024-03-23T23:58:51.360217+0000","last_undegraded":"2024-03-23T23:58:51.360217+0000","last_fullsized":"2024-03-23T23:58:51.360217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-03-23T23:58:51.360130+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-03-23T23:58:51.360130+0000","last_clean_scrub_stamp":"2024-03-23T23:58:51.360130+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:10:10.255281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'1147","reported_seq":1180,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:40.351711+0000","last_change":"2024-03-23T23:58:40.351775+0000","last_active":"2024-03-23T23:58:40.351711+0000","last_peered":"2024-03-23T23:58:40.351711+0000","last_clean":"2024-03-23T23:58:40.351711+0000","last_became_active":"2024-03-23T23:42:49.748687+0000","last_became_peered":"2024-03-23T23:42:49.748687+0000","last_unstale":"2024-03-23T23:58:40.351711+0000","last_undegraded":"2024-03-23T23:58:40.351711+0000","last_fullsized":"2024-03-23T23:58:40.351711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1147","last_scrub_stamp":"2024-03-23T23:58:40.351626+0000","last_deep_scrub":"27'1147","last_deep_scrub_stamp":"2024-03-23T23:58:40.351626+0000","last_clean_scrub_stamp":"2024-03-23T23:58:40.351626+0000","objects_scrubbed":4,"log_size":1147,"log_dups_size":0,"ondisk_log_size":1147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:21:30.756045+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1142,"num_write_kb":4626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"27'6486","reported_seq":6517,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:59:01.531044+0000","last_change":"2024-03-23T23:59:01.531065+0000","last_active":"2024-03-23T23:59:01.531044+0000","last_peered":"2024-03-23T23:59:01.531044+0000","last_clean":"2024-03-23T23:59:01.531044+0000","last_became_active":"2024-03-23T23:42:50.751874+0000","last_became_peered":"2024-03-23T23:42:50.751874+0000","last_unstale":"2024-03-23T23:59:01.531044+0000","last_undegraded":"2024-03-23T23:59:01.531044+0000","last_fullsized":"2024-03-23T23:59:01.531044+0000","mapping_epoch":23,"log_start":"27'1200","ondisk_log_start":"27'1200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6486","last_scrub_stamp":"2024-03-23T23:59:01.530967+0000","last_deep_scrub":"27'6486","last_deep_scrub_stamp":"2024-03-23T23:59:01.530967+0000","last_clean_scrub_stamp":"2024-03-23T23:59:01.530967+0000","objects_scrubbed":0,"log_size":5286,"log_dups_size":0,"ondisk_log_size":5286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:15:13.628535+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96407,"num_write_kb":1089798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'4560","reported_seq":4600,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:38.274532+0000","last_change":"2024-03-23T23:58:38.274532+0000","last_active":"2024-03-23T23:58:38.274532+0000","last_peered":"2024-03-23T23:58:38.274532+0000","last_clean":"2024-03-23T23:58:38.274532+0000","last_became_active":"2024-03-23T23:42:40.688636+0000","last_became_peered":"2024-03-23T23:42:40.688636+0000","last_unstale":"2024-03-23T23:58:38.274532+0000","last_undegraded":"2024-03-23T23:58:38.274532+0000","last_fullsized":"2024-03-23T23:58:38.274532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4560","last_scrub_stamp":"2024-03-23T23:58:38.274373+0000","last_deep_scrub":"27'4560","last_deep_scrub_stamp":"2024-03-23T23:58:38.274373+0000","last_clean_scrub_stamp":"2024-03-23T23:58:38.274373+0000","objects_scrubbed":0,"log_size":4560,"log_dups_size":0,"ondisk_log_size":4560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:49:10.770804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68087,"num_write_kb":816248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'64","reported_seq":106,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:39.278710+0000","last_change":"2024-03-23T23:58:39.278710+0000","last_active":"2024-03-23T23:58:39.278710+0000","last_peered":"2024-03-23T23:58:39.278710+0000","last_clean":"2024-03-23T23:58:39.278710+0000","last_became_active":"2024-03-23T23:42:39.681028+0000","last_became_peered":"2024-03-23T23:42:39.681028+0000","last_unstale":"2024-03-23T23:58:39.278710+0000","last_undegraded":"2024-03-23T23:58:39.278710+0000","last_fullsized":"2024-03-23T23:58:39.278710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'64","last_scrub_stamp":"2024-03-23T23:58:39.278616+0000","last_deep_scrub":"27'64","last_deep_scrub_stamp":"2024-03-23T23:58:39.278616+0000","last_clean_scrub_stamp":"2024-03-23T23:58:39.278616+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:42:09.058279+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":8222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'24","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:40.536665+0000","last_change":"2024-03-23T23:58:40.536687+0000","last_active":"2024-03-23T23:58:40.536665+0000","last_peered":"2024-03-23T23:58:40.536665+0000","last_clean":"2024-03-23T23:58:40.536665+0000","last_became_active":"2024-03-23T23:42:49.741650+0000","last_became_peered":"2024-03-23T23:42:49.741650+0000","last_unstale":"2024-03-23T23:58:40.536665+0000","last_undegraded":"2024-03-23T23:58:40.536665+0000","last_fullsized":"2024-03-23T23:58:40.536665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2024-03-23T23:58:40.536597+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2024-03-23T23:58:40.536597+0000","last_clean_scrub_stamp":"2024-03-23T23:58:40.536597+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:12:18.349710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"27'5263","reported_seq":5294,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:59:03.479006+0000","last_change":"2024-03-23T23:59:03.479046+0000","last_active":"2024-03-23T23:59:03.479006+0000","last_peered":"2024-03-23T23:59:03.479006+0000","last_clean":"2024-03-23T23:59:03.479006+0000","last_became_active":"2024-03-23T23:42:50.751848+0000","last_became_peered":"2024-03-23T23:42:50.751848+0000","last_unstale":"2024-03-23T23:59:03.479006+0000","last_undegraded":"2024-03-23T23:59:03.479006+0000","last_fullsized":"2024-03-23T23:59:03.479006+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5263","last_scrub_stamp":"2024-03-23T23:59:03.478903+0000","last_deep_scrub":"27'5263","last_deep_scrub_stamp":"2024-03-23T23:59:03.478903+0000","last_clean_scrub_stamp":"2024-03-23T23:59:03.478903+0000","objects_scrubbed":0,"log_size":5263,"log_dups_size":0,"ondisk_log_size":5263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:21:09.486327+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77613,"num_write_kb":898929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'4164","reported_seq":4203,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:48.227209+0000","last_change":"2024-03-23T23:58:48.227230+0000","last_active":"2024-03-23T23:58:48.227209+0000","last_peered":"2024-03-23T23:58:48.227209+0000","last_clean":"2024-03-23T23:58:48.227209+0000","last_became_active":"2024-03-23T23:42:40.689477+0000","last_became_peered":"2024-03-23T23:42:40.689477+0000","last_unstale":"2024-03-23T23:58:48.227209+0000","last_undegraded":"2024-03-23T23:58:48.227209+0000","last_fullsized":"2024-03-23T23:58:48.227209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4164","last_scrub_stamp":"2024-03-23T23:58:48.227125+0000","last_deep_scrub":"27'4164","last_deep_scrub_stamp":"2024-03-23T23:58:48.227125+0000","last_clean_scrub_stamp":"2024-03-23T23:58:48.227125+0000","objects_scrubbed":0,"log_size":4164,"log_dups_size":0,"ondisk_log_size":4164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:48:19.578220+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61832,"num_write_kb":761424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'1207","reported_seq":1248,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:44.758366+0000","last_change":"2024-03-23T23:58:44.758391+0000","last_active":"2024-03-23T23:58:44.758366+0000","last_peered":"2024-03-23T23:58:44.758366+0000","last_clean":"2024-03-23T23:58:44.758366+0000","last_became_active":"2024-03-23T23:42:39.688066+0000","last_became_peered":"2024-03-23T23:42:39.688066+0000","last_unstale":"2024-03-23T23:58:44.758366+0000","last_undegraded":"2024-03-23T23:58:44.758366+0000","last_fullsized":"2024-03-23T23:58:44.758366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1207","last_scrub_stamp":"2024-03-23T23:58:44.758294+0000","last_deep_scrub":"27'1207","last_deep_scrub_stamp":"2024-03-23T23:58:44.758294+0000","last_clean_scrub_stamp":"2024-03-23T23:58:44.758294+0000","objects_scrubbed":4,"log_size":1207,"log_dups_size":0,"ondisk_log_size":1207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:09:15.822141+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1202,"num_write_kb":4648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'3","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:35.376691+0000","last_change":"2024-03-23T23:58:35.376691+0000","last_active":"2024-03-23T23:58:35.376691+0000","last_peered":"2024-03-23T23:58:35.376691+0000","last_clean":"2024-03-23T23:58:35.376691+0000","last_became_active":"2024-03-23T23:42:49.733197+0000","last_became_peered":"2024-03-23T23:42:49.733197+0000","last_unstale":"2024-03-23T23:58:35.376691+0000","last_undegraded":"2024-03-23T23:58:35.376691+0000","last_fullsized":"2024-03-23T23:58:35.376691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-03-23T23:58:35.376594+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-03-23T23:58:35.376594+0000","last_clean_scrub_stamp":"2024-03-23T23:58:35.376594+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:05:35.471060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"27'4661","reported_seq":4693,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:57.343144+0000","last_change":"2024-03-23T23:58:57.343144+0000","last_active":"2024-03-23T23:58:57.343144+0000","last_peered":"2024-03-23T23:58:57.343144+0000","last_clean":"2024-03-23T23:58:57.343144+0000","last_became_active":"2024-03-23T23:42:50.756371+0000","last_became_peered":"2024-03-23T23:42:50.756371+0000","last_unstale":"2024-03-23T23:58:57.343144+0000","last_undegraded":"2024-03-23T23:58:57.343144+0000","last_fullsized":"2024-03-23T23:58:57.343144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4661","last_scrub_stamp":"2024-03-23T23:58:57.343032+0000","last_deep_scrub":"27'4661","last_deep_scrub_stamp":"2024-03-23T23:58:57.343032+0000","last_clean_scrub_stamp":"2024-03-23T23:58:57.343032+0000","objects_scrubbed":0,"log_size":4661,"log_dups_size":0,"ondisk_log_size":4661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:09:56.181388+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69148,"num_write_kb":786028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'6424","reported_seq":6463,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:47.679637+0000","last_change":"2024-03-23T23:58:47.679657+0000","last_active":"2024-03-23T23:58:47.679637+0000","last_peered":"2024-03-23T23:58:47.679637+0000","last_clean":"2024-03-23T23:58:47.679637+0000","last_became_active":"2024-03-23T23:42:40.682798+0000","last_became_peered":"2024-03-23T23:42:40.682798+0000","last_unstale":"2024-03-23T23:58:47.679637+0000","last_undegraded":"2024-03-23T23:58:47.679637+0000","last_fullsized":"2024-03-23T23:58:47.679637+0000","mapping_epoch":19,"log_start":"27'900","ondisk_log_start":"27'900","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6424","last_scrub_stamp":"2024-03-23T23:58:47.679553+0000","last_deep_scrub":"27'6424","last_deep_scrub_stamp":"2024-03-23T23:58:47.679553+0000","last_clean_scrub_stamp":"2024-03-23T23:58:47.679553+0000","objects_scrubbed":0,"log_size":5524,"log_dups_size":0,"ondisk_log_size":5524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:44:38.712935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96000,"num_write_kb":1116606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'31","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:45.302427+0000","last_change":"2024-03-23T23:58:45.302452+0000","last_active":"2024-03-23T23:58:45.302427+0000","last_peered":"2024-03-23T23:58:45.302427+0000","last_clean":"2024-03-23T23:58:45.302427+0000","last_became_active":"2024-03-23T23:42:39.681364+0000","last_became_peered":"2024-03-23T23:42:39.681364+0000","last_unstale":"2024-03-23T23:58:45.302427+0000","last_undegraded":"2024-03-23T23:58:45.302427+0000","last_fullsized":"2024-03-23T23:58:45.302427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2024-03-23T23:58:45.302367+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2024-03-23T23:58:45.302367+0000","last_clean_scrub_stamp":"2024-03-23T23:58:45.302367+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:37:33.284717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'51","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:49.739392+0000","last_change":"2024-03-23T23:58:49.739420+0000","last_active":"2024-03-23T23:58:49.739392+0000","last_peered":"2024-03-23T23:58:49.739392+0000","last_clean":"2024-03-23T23:58:49.739392+0000","last_became_active":"2024-03-23T23:42:49.723058+0000","last_became_peered":"2024-03-23T23:42:49.723058+0000","last_unstale":"2024-03-23T23:58:49.739392+0000","last_undegraded":"2024-03-23T23:58:49.739392+0000","last_fullsized":"2024-03-23T23:58:49.739392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'51","last_scrub_stamp":"2024-03-23T23:58:49.739323+0000","last_deep_scrub":"27'51","last_deep_scrub_stamp":"2024-03-23T23:58:49.739323+0000","last_clean_scrub_stamp":"2024-03-23T23:58:49.739323+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:04:24.758915+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":8215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"27'4271","reported_seq":4303,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:52.770468+0000","last_change":"2024-03-23T23:58:52.770491+0000","last_active":"2024-03-23T23:58:52.770468+0000","last_peered":"2024-03-23T23:58:52.770468+0000","last_clean":"2024-03-23T23:58:52.770468+0000","last_became_active":"2024-03-23T23:42:50.746104+0000","last_became_peered":"2024-03-23T23:42:50.746104+0000","last_unstale":"2024-03-23T23:58:52.770468+0000","last_undegraded":"2024-03-23T23:58:52.770468+0000","last_fullsized":"2024-03-23T23:58:52.770468+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4271","last_scrub_stamp":"2024-03-23T23:58:52.770349+0000","last_deep_scrub":"27'4271","last_deep_scrub_stamp":"2024-03-23T23:58:52.770349+0000","last_clean_scrub_stamp":"2024-03-23T23:58:52.770349+0000","objects_scrubbed":0,"log_size":4271,"log_dups_size":0,"ondisk_log_size":4271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:40:43.643843+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63135,"num_write_kb":732213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"27'5366","reported_seq":5410,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:54.215123+0000","last_change":"2024-03-23T23:58:54.215145+0000","last_active":"2024-03-23T23:58:54.215123+0000","last_peered":"2024-03-23T23:58:54.215123+0000","last_clean":"2024-03-23T23:58:54.215123+0000","last_became_active":"2024-03-23T23:43:22.035573+0000","last_became_peered":"2024-03-23T23:43:22.035573+0000","last_unstale":"2024-03-23T23:58:54.215123+0000","last_undegraded":"2024-03-23T23:58:54.215123+0000","last_fullsized":"2024-03-23T23:58:54.215123+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5366","last_scrub_stamp":"2024-03-23T23:58:54.214997+0000","last_deep_scrub":"27'5366","last_deep_scrub_stamp":"2024-03-23T23:58:54.214997+0000","last_clean_scrub_stamp":"2024-03-23T23:58:54.214997+0000","objects_scrubbed":0,"log_size":5366,"log_dups_size":0,"ondisk_log_size":5366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:08:48.605393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80141,"num_write_kb":923583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'4","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:52.402141+0000","last_change":"2024-03-23T23:58:52.402161+0000","last_active":"2024-03-23T23:58:52.402141+0000","last_peered":"2024-03-23T23:58:52.402141+0000","last_clean":"2024-03-23T23:58:52.402141+0000","last_became_active":"2024-03-23T23:42:39.687473+0000","last_became_peered":"2024-03-23T23:42:39.687473+0000","last_unstale":"2024-03-23T23:58:52.402141+0000","last_undegraded":"2024-03-23T23:58:52.402141+0000","last_fullsized":"2024-03-23T23:58:52.402141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-03-23T23:58:52.402065+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-03-23T23:58:52.402065+0000","last_clean_scrub_stamp":"2024-03-23T23:58:52.402065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:34:59.027137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'19","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:38.258184+0000","last_change":"2024-03-23T23:58:38.258184+0000","last_active":"2024-03-23T23:58:38.258184+0000","last_peered":"2024-03-23T23:58:38.258184+0000","last_clean":"2024-03-23T23:58:38.258184+0000","last_became_active":"2024-03-23T23:42:49.748389+0000","last_became_peered":"2024-03-23T23:42:49.748389+0000","last_unstale":"2024-03-23T23:58:38.258184+0000","last_undegraded":"2024-03-23T23:58:38.258184+0000","last_fullsized":"2024-03-23T23:58:38.258184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-03-23T23:58:38.258086+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-03-23T23:58:38.258086+0000","last_clean_scrub_stamp":"2024-03-23T23:58:38.258086+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:23:10.030147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"27'4548","reported_seq":4580,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:47.295239+0000","last_change":"2024-03-23T23:58:47.295239+0000","last_active":"2024-03-23T23:58:47.295239+0000","last_peered":"2024-03-23T23:58:47.295239+0000","last_clean":"2024-03-23T23:58:47.295239+0000","last_became_active":"2024-03-23T23:42:50.749066+0000","last_became_peered":"2024-03-23T23:42:50.749066+0000","last_unstale":"2024-03-23T23:58:47.295239+0000","last_undegraded":"2024-03-23T23:58:47.295239+0000","last_fullsized":"2024-03-23T23:58:47.295239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4548","last_scrub_stamp":"2024-03-23T23:58:47.295124+0000","last_deep_scrub":"27'4548","last_deep_scrub_stamp":"2024-03-23T23:58:47.295124+0000","last_clean_scrub_stamp":"2024-03-23T23:58:47.295124+0000","objects_scrubbed":0,"log_size":4548,"log_dups_size":0,"ondisk_log_size":4548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:39:32.364445+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67689,"num_write_kb":774425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'5741","reported_seq":5766,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:50.988365+0000","last_change":"2024-03-23T23:58:50.988387+0000","last_active":"2024-03-23T23:58:50.988365+0000","last_peered":"2024-03-23T23:58:50.988365+0000","last_clean":"2024-03-23T23:58:50.988365+0000","last_became_active":"2024-03-23T23:43:22.034063+0000","last_became_peered":"2024-03-23T23:43:22.034063+0000","last_unstale":"2024-03-23T23:58:50.988365+0000","last_undegraded":"2024-03-23T23:58:50.988365+0000","last_fullsized":"2024-03-23T23:58:50.988365+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5741","last_scrub_stamp":"2024-03-23T23:58:50.988280+0000","last_deep_scrub":"27'5741","last_deep_scrub_stamp":"2024-03-23T23:58:50.988280+0000","last_clean_scrub_stamp":"2024-03-23T23:58:50.988280+0000","objects_scrubbed":0,"log_size":5741,"log_dups_size":0,"ondisk_log_size":5741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:37:02.901993+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85448,"num_write_kb":1013349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'3","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:43.719613+0000","last_change":"2024-03-23T23:58:43.719657+0000","last_active":"2024-03-23T23:58:43.719613+0000","last_peered":"2024-03-23T23:58:43.719613+0000","last_clean":"2024-03-23T23:58:43.719613+0000","last_became_active":"2024-03-23T23:42:39.684360+0000","last_became_peered":"2024-03-23T23:42:39.684360+0000","last_unstale":"2024-03-23T23:58:43.719613+0000","last_undegraded":"2024-03-23T23:58:43.719613+0000","last_fullsized":"2024-03-23T23:58:43.719613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-03-23T23:58:43.719467+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-03-23T23:58:43.719467+0000","last_clean_scrub_stamp":"2024-03-23T23:58:43.719467+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:54:51.318427+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:37.234983+0000","last_change":"2024-03-23T23:58:37.234983+0000","last_active":"2024-03-23T23:58:37.234983+0000","last_peered":"2024-03-23T23:58:37.234983+0000","last_clean":"2024-03-23T23:58:37.234983+0000","last_became_active":"2024-03-23T23:42:49.741270+0000","last_became_peered":"2024-03-23T23:42:49.741270+0000","last_unstale":"2024-03-23T23:58:37.234983+0000","last_undegraded":"2024-03-23T23:58:37.234983+0000","last_fullsized":"2024-03-23T23:58:37.234983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-03-23T23:58:37.234796+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-03-23T23:58:37.234796+0000","last_clean_scrub_stamp":"2024-03-23T23:58:37.234796+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:12:15.047909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"27'7540","reported_seq":7572,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:54.765802+0000","last_change":"2024-03-23T23:58:54.765840+0000","last_active":"2024-03-23T23:58:54.765802+0000","last_peered":"2024-03-23T23:58:54.765802+0000","last_clean":"2024-03-23T23:58:54.765802+0000","last_became_active":"2024-03-23T23:42:50.748281+0000","last_became_peered":"2024-03-23T23:42:50.748281+0000","last_unstale":"2024-03-23T23:58:54.765802+0000","last_undegraded":"2024-03-23T23:58:54.765802+0000","last_fullsized":"2024-03-23T23:58:54.765802+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7540","last_scrub_stamp":"2024-03-23T23:58:54.765703+0000","last_deep_scrub":"27'7540","last_deep_scrub_stamp":"2024-03-23T23:58:54.765703+0000","last_clean_scrub_stamp":"2024-03-23T23:58:54.765703+0000","objects_scrubbed":0,"log_size":7540,"log_dups_size":0,"ondisk_log_size":7540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:45:24.746316+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112036,"num_write_kb":1284404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"27'35","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:49.239052+0000","last_change":"2024-03-23T23:58:49.239052+0000","last_active":"2024-03-23T23:58:49.239052+0000","last_peered":"2024-03-23T23:58:49.239052+0000","last_clean":"2024-03-23T23:58:49.239052+0000","last_became_active":"2024-03-23T23:42:49.740899+0000","last_became_peered":"2024-03-23T23:42:49.740899+0000","last_unstale":"2024-03-23T23:58:49.239052+0000","last_undegraded":"2024-03-23T23:58:49.239052+0000","last_fullsized":"2024-03-23T23:58:49.239052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2024-03-23T23:58:49.238959+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2024-03-23T23:58:49.238959+0000","last_clean_scrub_stamp":"2024-03-23T23:58:49.238959+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:15:48.097822+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'6202","reported_seq":6241,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:43.324725+0000","last_change":"2024-03-23T23:58:43.324765+0000","last_active":"2024-03-23T23:58:43.324725+0000","last_peered":"2024-03-23T23:58:43.324725+0000","last_clean":"2024-03-23T23:58:43.324725+0000","last_became_active":"2024-03-23T23:42:40.679070+0000","last_became_peered":"2024-03-23T23:42:40.679070+0000","last_unstale":"2024-03-23T23:58:43.324725+0000","last_undegraded":"2024-03-23T23:58:43.324725+0000","last_fullsized":"2024-03-23T23:58:43.324725+0000","mapping_epoch":19,"log_start":"27'500","ondisk_log_start":"27'500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6202","last_scrub_stamp":"2024-03-23T23:58:43.324609+0000","last_deep_scrub":"27'6202","last_deep_scrub_stamp":"2024-03-23T23:58:43.324609+0000","last_clean_scrub_stamp":"2024-03-23T23:58:43.324609+0000","objects_scrubbed":0,"log_size":5702,"log_dups_size":0,"ondisk_log_size":5702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:00:45.620370+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92139,"num_write_kb":1051130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'30","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:49.432197+0000","last_change":"2024-03-23T23:58:49.432224+0000","last_active":"2024-03-23T23:58:49.432197+0000","last_peered":"2024-03-23T23:58:49.432197+0000","last_clean":"2024-03-23T23:58:49.432197+0000","last_became_active":"2024-03-23T23:42:39.682584+0000","last_became_peered":"2024-03-23T23:42:39.682584+0000","last_unstale":"2024-03-23T23:58:49.432197+0000","last_undegraded":"2024-03-23T23:58:49.432197+0000","last_fullsized":"2024-03-23T23:58:49.432197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-03-23T23:58:49.432120+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-03-23T23:58:49.432120+0000","last_clean_scrub_stamp":"2024-03-23T23:58:49.432120+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:57:16.880369+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":8211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"27'5271","reported_seq":5304,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:50.242447+0000","last_change":"2024-03-23T23:58:50.242447+0000","last_active":"2024-03-23T23:58:50.242447+0000","last_peered":"2024-03-23T23:58:50.242447+0000","last_clean":"2024-03-23T23:58:50.242447+0000","last_became_active":"2024-03-23T23:42:50.751598+0000","last_became_peered":"2024-03-23T23:42:50.751598+0000","last_unstale":"2024-03-23T23:58:50.242447+0000","last_undegraded":"2024-03-23T23:58:50.242447+0000","last_fullsized":"2024-03-23T23:58:50.242447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5271","last_scrub_stamp":"2024-03-23T23:58:50.242340+0000","last_deep_scrub":"27'5271","last_deep_scrub_stamp":"2024-03-23T23:58:50.242340+0000","last_clean_scrub_stamp":"2024-03-23T23:58:50.242340+0000","objects_scrubbed":0,"log_size":5271,"log_dups_size":0,"ondisk_log_size":5271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:41:22.990978+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78296,"num_write_kb":918025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"27'28","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:50.784213+0000","last_change":"2024-03-23T23:58:50.784268+0000","last_active":"2024-03-23T23:58:50.784213+0000","last_peered":"2024-03-23T23:58:50.784213+0000","last_clean":"2024-03-23T23:58:50.784213+0000","last_became_active":"2024-03-23T23:42:49.734309+0000","last_became_peered":"2024-03-23T23:42:49.734309+0000","last_unstale":"2024-03-23T23:58:50.784213+0000","last_undegraded":"2024-03-23T23:58:50.784213+0000","last_fullsized":"2024-03-23T23:58:50.784213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2024-03-23T23:58:50.784091+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2024-03-23T23:58:50.784091+0000","last_clean_scrub_stamp":"2024-03-23T23:58:50.784091+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:44:41.817473+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'5383","reported_seq":5422,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:54.457686+0000","last_change":"2024-03-23T23:58:54.457706+0000","last_active":"2024-03-23T23:58:54.457686+0000","last_peered":"2024-03-23T23:58:54.457686+0000","last_clean":"2024-03-23T23:58:54.457686+0000","last_became_active":"2024-03-23T23:42:40.674366+0000","last_became_peered":"2024-03-23T23:42:40.674366+0000","last_unstale":"2024-03-23T23:58:54.457686+0000","last_undegraded":"2024-03-23T23:58:54.457686+0000","last_fullsized":"2024-03-23T23:58:54.457686+0000","mapping_epoch":19,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5383","last_scrub_stamp":"2024-03-23T23:58:54.457619+0000","last_deep_scrub":"27'5383","last_deep_scrub_stamp":"2024-03-23T23:58:54.457619+0000","last_clean_scrub_stamp":"2024-03-23T23:58:54.457619+0000","objects_scrubbed":0,"log_size":5283,"log_dups_size":0,"ondisk_log_size":5283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:03:13.652175+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80001,"num_write_kb":974706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'8","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:52.462516+0000","last_change":"2024-03-23T23:58:52.462538+0000","last_active":"2024-03-23T23:58:52.462516+0000","last_peered":"2024-03-23T23:58:52.462516+0000","last_clean":"2024-03-23T23:58:52.462516+0000","last_became_active":"2024-03-23T23:42:39.687489+0000","last_became_peered":"2024-03-23T23:42:39.687489+0000","last_unstale":"2024-03-23T23:58:52.462516+0000","last_undegraded":"2024-03-23T23:58:52.462516+0000","last_fullsized":"2024-03-23T23:58:52.462516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-03-23T23:58:52.462437+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-03-23T23:58:52.462437+0000","last_clean_scrub_stamp":"2024-03-23T23:58:52.462437+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:12:58.928864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"27'6132","reported_seq":6163,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:53.371716+0000","last_change":"2024-03-23T23:58:53.371738+0000","last_active":"2024-03-23T23:58:53.371716+0000","last_peered":"2024-03-23T23:58:53.371716+0000","last_clean":"2024-03-23T23:58:53.371716+0000","last_became_active":"2024-03-23T23:42:50.747154+0000","last_became_peered":"2024-03-23T23:42:50.747154+0000","last_unstale":"2024-03-23T23:58:53.371716+0000","last_undegraded":"2024-03-23T23:58:53.371716+0000","last_fullsized":"2024-03-23T23:58:53.371716+0000","mapping_epoch":23,"log_start":"27'400","ondisk_log_start":"27'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6132","last_scrub_stamp":"2024-03-23T23:58:53.371651+0000","last_deep_scrub":"27'6132","last_deep_scrub_stamp":"2024-03-23T23:58:53.371651+0000","last_clean_scrub_stamp":"2024-03-23T23:58:53.371651+0000","objects_scrubbed":0,"log_size":5732,"log_dups_size":0,"ondisk_log_size":5732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:22:45.398741+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91134,"num_write_kb":1034218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"27'18","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:41.730821+0000","last_change":"2024-03-23T23:58:41.730867+0000","last_active":"2024-03-23T23:58:41.730821+0000","last_peered":"2024-03-23T23:58:41.730821+0000","last_clean":"2024-03-23T23:58:41.730821+0000","last_became_active":"2024-03-23T23:42:39.681158+0000","last_became_peered":"2024-03-23T23:42:39.681158+0000","last_unstale":"2024-03-23T23:58:41.730821+0000","last_undegraded":"2024-03-23T23:58:41.730821+0000","last_fullsized":"2024-03-23T23:58:41.730821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-03-23T23:58:41.730732+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-03-23T23:58:41.730732+0000","last_clean_scrub_stamp":"2024-03-23T23:58:41.730732+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:12:15.190633+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'4519","reported_seq":4558,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:43.251805+0000","last_change":"2024-03-23T23:58:43.251826+0000","last_active":"2024-03-23T23:58:43.251805+0000","last_peered":"2024-03-23T23:58:43.251805+0000","last_clean":"2024-03-23T23:58:43.251805+0000","last_became_active":"2024-03-23T23:42:40.675877+0000","last_became_peered":"2024-03-23T23:42:40.675877+0000","last_unstale":"2024-03-23T23:58:43.251805+0000","last_undegraded":"2024-03-23T23:58:43.251805+0000","last_fullsized":"2024-03-23T23:58:43.251805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4519","last_scrub_stamp":"2024-03-23T23:58:43.251745+0000","last_deep_scrub":"27'4519","last_deep_scrub_stamp":"2024-03-23T23:58:43.251745+0000","last_clean_scrub_stamp":"2024-03-23T23:58:43.251745+0000","objects_scrubbed":0,"log_size":4519,"log_dups_size":0,"ondisk_log_size":4519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:36:55.165458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67585,"num_write_kb":780136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'21","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:44.044679+0000","last_change":"2024-03-23T23:58:44.044723+0000","last_active":"2024-03-23T23:58:44.044679+0000","last_peered":"2024-03-23T23:58:44.044679+0000","last_clean":"2024-03-23T23:58:44.044679+0000","last_became_active":"2024-03-23T23:42:49.732943+0000","last_became_peered":"2024-03-23T23:42:49.732943+0000","last_unstale":"2024-03-23T23:58:44.044679+0000","last_undegraded":"2024-03-23T23:58:44.044679+0000","last_fullsized":"2024-03-23T23:58:44.044679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2024-03-23T23:58:44.044587+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2024-03-23T23:58:44.044587+0000","last_clean_scrub_stamp":"2024-03-23T23:58:44.044587+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:40.926549+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"27'4603","reported_seq":4634,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:56.724404+0000","last_change":"2024-03-23T23:58:56.724426+0000","last_active":"2024-03-23T23:58:56.724404+0000","last_peered":"2024-03-23T23:58:56.724404+0000","last_clean":"2024-03-23T23:58:56.724404+0000","last_became_active":"2024-03-23T23:42:50.749400+0000","last_became_peered":"2024-03-23T23:42:50.749400+0000","last_unstale":"2024-03-23T23:58:56.724404+0000","last_undegraded":"2024-03-23T23:58:56.724404+0000","last_fullsized":"2024-03-23T23:58:56.724404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4603","last_scrub_stamp":"2024-03-23T23:58:56.724313+0000","last_deep_scrub":"27'4603","last_deep_scrub_stamp":"2024-03-23T23:58:56.724313+0000","last_clean_scrub_stamp":"2024-03-23T23:58:56.724313+0000","objects_scrubbed":0,"log_size":4603,"log_dups_size":0,"ondisk_log_size":4603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:21:23.125974+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67787,"num_write_kb":753464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'1304","reported_seq":1345,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:51.500783+0000","last_change":"2024-03-23T23:58:51.500807+0000","last_active":"2024-03-23T23:58:51.500783+0000","last_peered":"2024-03-23T23:58:51.500783+0000","last_clean":"2024-03-23T23:58:51.500783+0000","last_became_active":"2024-03-23T23:42:39.687423+0000","last_became_peered":"2024-03-23T23:42:39.687423+0000","last_unstale":"2024-03-23T23:58:51.500783+0000","last_undegraded":"2024-03-23T23:58:51.500783+0000","last_fullsized":"2024-03-23T23:58:51.500783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1304","last_scrub_stamp":"2024-03-23T23:58:51.500703+0000","last_deep_scrub":"27'1304","last_deep_scrub_stamp":"2024-03-23T23:58:51.500703+0000","last_clean_scrub_stamp":"2024-03-23T23:58:51.500703+0000","objects_scrubbed":1,"log_size":1304,"log_dups_size":0,"ondisk_log_size":1304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:11:04.795232+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1297,"num_write_kb":4300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'4605","reported_seq":4644,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:45.696120+0000","last_change":"2024-03-23T23:58:45.696140+0000","last_active":"2024-03-23T23:58:45.696120+0000","last_peered":"2024-03-23T23:58:45.696120+0000","last_clean":"2024-03-23T23:58:45.696120+0000","last_became_active":"2024-03-23T23:42:40.680511+0000","last_became_peered":"2024-03-23T23:42:40.680511+0000","last_unstale":"2024-03-23T23:58:45.696120+0000","last_undegraded":"2024-03-23T23:58:45.696120+0000","last_fullsized":"2024-03-23T23:58:45.696120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4605","last_scrub_stamp":"2024-03-23T23:58:45.696057+0000","last_deep_scrub":"27'4605","last_deep_scrub_stamp":"2024-03-23T23:58:45.696057+0000","last_clean_scrub_stamp":"2024-03-23T23:58:45.696057+0000","objects_scrubbed":0,"log_size":4605,"log_dups_size":0,"ondisk_log_size":4605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:22:53.042583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68637,"num_write_kb":787014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'94","reported_seq":127,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:44.479150+0000","last_change":"2024-03-23T23:58:44.479178+0000","last_active":"2024-03-23T23:58:44.479150+0000","last_peered":"2024-03-23T23:58:44.479150+0000","last_clean":"2024-03-23T23:58:44.479150+0000","last_became_active":"2024-03-23T23:42:49.749695+0000","last_became_peered":"2024-03-23T23:42:49.749695+0000","last_unstale":"2024-03-23T23:58:44.479150+0000","last_undegraded":"2024-03-23T23:58:44.479150+0000","last_fullsized":"2024-03-23T23:58:44.479150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'94","last_scrub_stamp":"2024-03-23T23:58:44.479077+0000","last_deep_scrub":"27'94","last_deep_scrub_stamp":"2024-03-23T23:58:44.479077+0000","last_clean_scrub_stamp":"2024-03-23T23:58:44.479077+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:46:40.863478+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":12324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"27'4656","reported_seq":4689,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:59:02.502439+0000","last_change":"2024-03-23T23:59:02.502460+0000","last_active":"2024-03-23T23:59:02.502439+0000","last_peered":"2024-03-23T23:59:02.502439+0000","last_clean":"2024-03-23T23:59:02.502439+0000","last_became_active":"2024-03-23T23:42:50.752394+0000","last_became_peered":"2024-03-23T23:42:50.752394+0000","last_unstale":"2024-03-23T23:59:02.502439+0000","last_undegraded":"2024-03-23T23:59:02.502439+0000","last_fullsized":"2024-03-23T23:59:02.502439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4656","last_scrub_stamp":"2024-03-23T23:59:02.502345+0000","last_deep_scrub":"27'4656","last_deep_scrub_stamp":"2024-03-23T23:59:02.502345+0000","last_clean_scrub_stamp":"2024-03-23T23:59:02.502345+0000","objects_scrubbed":0,"log_size":4656,"log_dups_size":0,"ondisk_log_size":4656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:17:43.364956+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69093,"num_write_kb":797343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'5268","reported_seq":5308,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:47.793298+0000","last_change":"2024-03-23T23:58:47.793321+0000","last_active":"2024-03-23T23:58:47.793298+0000","last_peered":"2024-03-23T23:58:47.793298+0000","last_clean":"2024-03-23T23:58:47.793298+0000","last_became_active":"2024-03-23T23:42:40.678518+0000","last_became_peered":"2024-03-23T23:42:40.678518+0000","last_unstale":"2024-03-23T23:58:47.793298+0000","last_undegraded":"2024-03-23T23:58:47.793298+0000","last_fullsized":"2024-03-23T23:58:47.793298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5268","last_scrub_stamp":"2024-03-23T23:58:47.793198+0000","last_deep_scrub":"27'5268","last_deep_scrub_stamp":"2024-03-23T23:58:47.793198+0000","last_clean_scrub_stamp":"2024-03-23T23:58:47.793198+0000","objects_scrubbed":0,"log_size":5268,"log_dups_size":0,"ondisk_log_size":5268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:27:37.192152+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78308,"num_write_kb":963226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"27'6097","reported_seq":6129,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:58.338720+0000","last_change":"2024-03-23T23:58:58.338742+0000","last_active":"2024-03-23T23:58:58.338720+0000","last_peered":"2024-03-23T23:58:58.338720+0000","last_clean":"2024-03-23T23:58:58.338720+0000","last_became_active":"2024-03-23T23:42:50.756813+0000","last_became_peered":"2024-03-23T23:42:50.756813+0000","last_unstale":"2024-03-23T23:58:58.338720+0000","last_undegraded":"2024-03-23T23:58:58.338720+0000","last_fullsized":"2024-03-23T23:58:58.338720+0000","mapping_epoch":23,"log_start":"27'400","ondisk_log_start":"27'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6097","last_scrub_stamp":"2024-03-23T23:58:58.338656+0000","last_deep_scrub":"27'6097","last_deep_scrub_stamp":"2024-03-23T23:58:58.338656+0000","last_clean_scrub_stamp":"2024-03-23T23:58:58.338656+0000","objects_scrubbed":0,"log_size":5697,"log_dups_size":0,"ondisk_log_size":5697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:48:45.159362+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90451,"num_write_kb":1016115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"27'5502","reported_seq":5542,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:43.125913+0000","last_change":"2024-03-23T23:58:43.125937+0000","last_active":"2024-03-23T23:58:43.125913+0000","last_peered":"2024-03-23T23:58:43.125913+0000","last_clean":"2024-03-23T23:58:43.125913+0000","last_became_active":"2024-03-23T23:42:40.701398+0000","last_became_peered":"2024-03-23T23:42:40.701398+0000","last_unstale":"2024-03-23T23:58:43.125913+0000","last_undegraded":"2024-03-23T23:58:43.125913+0000","last_fullsized":"2024-03-23T23:58:43.125913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5502","last_scrub_stamp":"2024-03-23T23:58:43.125831+0000","last_deep_scrub":"27'5502","last_deep_scrub_stamp":"2024-03-23T23:58:43.125831+0000","last_clean_scrub_stamp":"2024-03-23T23:58:43.125831+0000","objects_scrubbed":0,"log_size":5502,"log_dups_size":0,"ondisk_log_size":5502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:25:46.932807+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81712,"num_write_kb":960011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"27'5509","reported_seq":5541,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:58.429094+0000","last_change":"2024-03-23T23:58:58.429117+0000","last_active":"2024-03-23T23:58:58.429094+0000","last_peered":"2024-03-23T23:58:58.429094+0000","last_clean":"2024-03-23T23:58:58.429094+0000","last_became_active":"2024-03-23T23:42:50.756503+0000","last_became_peered":"2024-03-23T23:42:50.756503+0000","last_unstale":"2024-03-23T23:58:58.429094+0000","last_undegraded":"2024-03-23T23:58:58.429094+0000","last_fullsized":"2024-03-23T23:58:58.429094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5509","last_scrub_stamp":"2024-03-23T23:58:58.429013+0000","last_deep_scrub":"27'5509","last_deep_scrub_stamp":"2024-03-23T23:58:58.429013+0000","last_clean_scrub_stamp":"2024-03-23T23:58:58.429013+0000","objects_scrubbed":0,"log_size":5509,"log_dups_size":0,"ondisk_log_size":5509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:19:54.079847+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81671,"num_write_kb":934046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"27'5990","reported_seq":6035,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:59:03.541158+0000","last_change":"2024-03-23T23:59:03.541179+0000","last_active":"2024-03-23T23:59:03.541158+0000","last_peered":"2024-03-23T23:59:03.541158+0000","last_clean":"2024-03-23T23:59:03.541158+0000","last_became_active":"2024-03-23T23:43:22.035611+0000","last_became_peered":"2024-03-23T23:43:22.035611+0000","last_unstale":"2024-03-23T23:59:03.541158+0000","last_undegraded":"2024-03-23T23:59:03.541158+0000","last_fullsized":"2024-03-23T23:59:03.541158+0000","mapping_epoch":26,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5990","last_scrub_stamp":"2024-03-23T23:59:03.541075+0000","last_deep_scrub":"27'5990","last_deep_scrub_stamp":"2024-03-23T23:59:03.541075+0000","last_clean_scrub_stamp":"2024-03-23T23:59:03.541075+0000","objects_scrubbed":0,"log_size":5890,"log_dups_size":0,"ondisk_log_size":5890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:37:45.697328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89084,"num_write_kb":1042929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"27'5555","reported_seq":5587,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:54.377832+0000","last_change":"2024-03-23T23:58:54.377853+0000","last_active":"2024-03-23T23:58:54.377832+0000","last_peered":"2024-03-23T23:58:54.377832+0000","last_clean":"2024-03-23T23:58:54.377832+0000","last_became_active":"2024-03-23T23:42:50.748105+0000","last_became_peered":"2024-03-23T23:42:50.748105+0000","last_unstale":"2024-03-23T23:58:54.377832+0000","last_undegraded":"2024-03-23T23:58:54.377832+0000","last_fullsized":"2024-03-23T23:58:54.377832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5555","last_scrub_stamp":"2024-03-23T23:58:54.377748+0000","last_deep_scrub":"27'5555","last_deep_scrub_stamp":"2024-03-23T23:58:54.377748+0000","last_clean_scrub_stamp":"2024-03-23T23:58:54.377748+0000","objects_scrubbed":0,"log_size":5555,"log_dups_size":0,"ondisk_log_size":5555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:28:03.603175+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82238,"num_write_kb":945396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"27'5030","reported_seq":5070,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:41.264470+0000","last_change":"2024-03-23T23:58:41.264510+0000","last_active":"2024-03-23T23:58:41.264470+0000","last_peered":"2024-03-23T23:58:41.264470+0000","last_clean":"2024-03-23T23:58:41.264470+0000","last_became_active":"2024-03-23T23:42:40.672910+0000","last_became_peered":"2024-03-23T23:42:40.672910+0000","last_unstale":"2024-03-23T23:58:41.264470+0000","last_undegraded":"2024-03-23T23:58:41.264470+0000","last_fullsized":"2024-03-23T23:58:41.264470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5030","last_scrub_stamp":"2024-03-23T23:58:41.264389+0000","last_deep_scrub":"27'5030","last_deep_scrub_stamp":"2024-03-23T23:58:41.264389+0000","last_clean_scrub_stamp":"2024-03-23T23:58:41.264389+0000","objects_scrubbed":0,"log_size":5030,"log_dups_size":0,"ondisk_log_size":5030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:32:18.093448+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74941,"num_write_kb":923200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"27'5968","reported_seq":6000,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:49.309308+0000","last_change":"2024-03-23T23:58:49.309331+0000","last_active":"2024-03-23T23:58:49.309308+0000","last_peered":"2024-03-23T23:58:49.309308+0000","last_clean":"2024-03-23T23:58:49.309308+0000","last_became_active":"2024-03-23T23:42:50.749908+0000","last_became_peered":"2024-03-23T23:42:50.749908+0000","last_unstale":"2024-03-23T23:58:49.309308+0000","last_undegraded":"2024-03-23T23:58:49.309308+0000","last_fullsized":"2024-03-23T23:58:49.309308+0000","mapping_epoch":23,"log_start":"27'300","ondisk_log_start":"27'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5968","last_scrub_stamp":"2024-03-23T23:58:49.309208+0000","last_deep_scrub":"27'5968","last_deep_scrub_stamp":"2024-03-23T23:58:49.309208+0000","last_clean_scrub_stamp":"2024-03-23T23:58:49.309208+0000","objects_scrubbed":0,"log_size":5668,"log_dups_size":0,"ondisk_log_size":5668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:17:25.701341+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88637,"num_write_kb":993297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"27'5454","reported_seq":5494,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:47.500388+0000","last_change":"2024-03-23T23:58:47.500409+0000","last_active":"2024-03-23T23:58:47.500388+0000","last_peered":"2024-03-23T23:58:47.500388+0000","last_clean":"2024-03-23T23:58:47.500388+0000","last_became_active":"2024-03-23T23:42:40.685120+0000","last_became_peered":"2024-03-23T23:42:40.685120+0000","last_unstale":"2024-03-23T23:58:47.500388+0000","last_undegraded":"2024-03-23T23:58:47.500388+0000","last_fullsized":"2024-03-23T23:58:47.500388+0000","mapping_epoch":19,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5454","last_scrub_stamp":"2024-03-23T23:58:47.500309+0000","last_deep_scrub":"27'5454","last_deep_scrub_stamp":"2024-03-23T23:58:47.500309+0000","last_clean_scrub_stamp":"2024-03-23T23:58:47.500309+0000","objects_scrubbed":0,"log_size":5354,"log_dups_size":0,"ondisk_log_size":5354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:00:05.817948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81249,"num_write_kb":968622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"27'5340","reported_seq":5372,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:53.679679+0000","last_change":"2024-03-23T23:58:53.679701+0000","last_active":"2024-03-23T23:58:53.679679+0000","last_peered":"2024-03-23T23:58:53.679679+0000","last_clean":"2024-03-23T23:58:53.679679+0000","last_became_active":"2024-03-23T23:42:50.746310+0000","last_became_peered":"2024-03-23T23:42:50.746310+0000","last_unstale":"2024-03-23T23:58:53.679679+0000","last_undegraded":"2024-03-23T23:58:53.679679+0000","last_fullsized":"2024-03-23T23:58:53.679679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5340","last_scrub_stamp":"2024-03-23T23:58:53.679588+0000","last_deep_scrub":"27'5340","last_deep_scrub_stamp":"2024-03-23T23:58:53.679588+0000","last_clean_scrub_stamp":"2024-03-23T23:58:53.679588+0000","objects_scrubbed":0,"log_size":5340,"log_dups_size":0,"ondisk_log_size":5340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:34:11.882397+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79170,"num_write_kb":877684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"27'5337","reported_seq":5377,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:50.341522+0000","last_change":"2024-03-23T23:58:50.341542+0000","last_active":"2024-03-23T23:58:50.341522+0000","last_peered":"2024-03-23T23:58:50.341522+0000","last_clean":"2024-03-23T23:58:50.341522+0000","last_became_active":"2024-03-23T23:42:40.676912+0000","last_became_peered":"2024-03-23T23:42:40.676912+0000","last_unstale":"2024-03-23T23:58:50.341522+0000","last_undegraded":"2024-03-23T23:58:50.341522+0000","last_fullsized":"2024-03-23T23:58:50.341522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5337","last_scrub_stamp":"2024-03-23T23:58:50.341447+0000","last_deep_scrub":"27'5337","last_deep_scrub_stamp":"2024-03-23T23:58:50.341447+0000","last_clean_scrub_stamp":"2024-03-23T23:58:50.341447+0000","objects_scrubbed":0,"log_size":5337,"log_dups_size":0,"ondisk_log_size":5337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:00:56.513223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79200,"num_write_kb":983244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"27'5397","reported_seq":5429,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:45.276306+0000","last_change":"2024-03-23T23:58:45.276329+0000","last_active":"2024-03-23T23:58:45.276306+0000","last_peered":"2024-03-23T23:58:45.276306+0000","last_clean":"2024-03-23T23:58:45.276306+0000","last_became_active":"2024-03-23T23:42:50.748798+0000","last_became_peered":"2024-03-23T23:42:50.748798+0000","last_unstale":"2024-03-23T23:58:45.276306+0000","last_undegraded":"2024-03-23T23:58:45.276306+0000","last_fullsized":"2024-03-23T23:58:45.276306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5397","last_scrub_stamp":"2024-03-23T23:58:45.276211+0000","last_deep_scrub":"27'5397","last_deep_scrub_stamp":"2024-03-23T23:58:45.276211+0000","last_clean_scrub_stamp":"2024-03-23T23:58:45.276211+0000","objects_scrubbed":0,"log_size":5397,"log_dups_size":0,"ondisk_log_size":5397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:35:50.269065+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80551,"num_write_kb":913314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"27'4480","reported_seq":4520,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:38.740658+0000","last_change":"2024-03-23T23:58:38.740693+0000","last_active":"2024-03-23T23:58:38.740658+0000","last_peered":"2024-03-23T23:58:38.740658+0000","last_clean":"2024-03-23T23:58:38.740658+0000","last_became_active":"2024-03-23T23:42:40.693867+0000","last_became_peered":"2024-03-23T23:42:40.693867+0000","last_unstale":"2024-03-23T23:58:38.740658+0000","last_undegraded":"2024-03-23T23:58:38.740658+0000","last_fullsized":"2024-03-23T23:58:38.740658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4480","last_scrub_stamp":"2024-03-23T23:58:38.740571+0000","last_deep_scrub":"27'4480","last_deep_scrub_stamp":"2024-03-23T23:58:38.740571+0000","last_clean_scrub_stamp":"2024-03-23T23:58:38.740571+0000","objects_scrubbed":0,"log_size":4480,"log_dups_size":0,"ondisk_log_size":4480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:15:57.842005+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66343,"num_write_kb":822171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"27'5452","reported_seq":5484,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:56.853556+0000","last_change":"2024-03-23T23:58:56.853579+0000","last_active":"2024-03-23T23:58:56.853556+0000","last_peered":"2024-03-23T23:58:56.853556+0000","last_clean":"2024-03-23T23:58:56.853556+0000","last_became_active":"2024-03-23T23:42:50.753471+0000","last_became_peered":"2024-03-23T23:42:50.753471+0000","last_unstale":"2024-03-23T23:58:56.853556+0000","last_undegraded":"2024-03-23T23:58:56.853556+0000","last_fullsized":"2024-03-23T23:58:56.853556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5452","last_scrub_stamp":"2024-03-23T23:58:56.853465+0000","last_deep_scrub":"27'5452","last_deep_scrub_stamp":"2024-03-23T23:58:56.853465+0000","last_clean_scrub_stamp":"2024-03-23T23:58:56.853465+0000","objects_scrubbed":0,"log_size":5452,"log_dups_size":0,"ondisk_log_size":5452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:46:47.508381+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80762,"num_write_kb":909623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'5934","reported_seq":5974,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:49.501382+0000","last_change":"2024-03-23T23:58:49.501402+0000","last_active":"2024-03-23T23:58:49.501382+0000","last_peered":"2024-03-23T23:58:49.501382+0000","last_clean":"2024-03-23T23:58:49.501382+0000","last_became_active":"2024-03-23T23:42:40.684495+0000","last_became_peered":"2024-03-23T23:42:40.684495+0000","last_unstale":"2024-03-23T23:58:49.501382+0000","last_undegraded":"2024-03-23T23:58:49.501382+0000","last_fullsized":"2024-03-23T23:58:49.501382+0000","mapping_epoch":19,"log_start":"27'600","ondisk_log_start":"27'600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5934","last_scrub_stamp":"2024-03-23T23:58:49.501310+0000","last_deep_scrub":"27'5934","last_deep_scrub_stamp":"2024-03-23T23:58:49.501310+0000","last_clean_scrub_stamp":"2024-03-23T23:58:49.501310+0000","objects_scrubbed":0,"log_size":5334,"log_dups_size":0,"ondisk_log_size":5334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:44:50.327019+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88442,"num_write_kb":1073631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"27'5682","reported_seq":5714,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:48.542010+0000","last_change":"2024-03-23T23:58:48.542010+0000","last_active":"2024-03-23T23:58:48.542010+0000","last_peered":"2024-03-23T23:58:48.542010+0000","last_clean":"2024-03-23T23:58:48.542010+0000","last_became_active":"2024-03-23T23:42:50.745771+0000","last_became_peered":"2024-03-23T23:42:50.745771+0000","last_unstale":"2024-03-23T23:58:48.542010+0000","last_undegraded":"2024-03-23T23:58:48.542010+0000","last_fullsized":"2024-03-23T23:58:48.542010+0000","mapping_epoch":23,"log_start":"27'400","ondisk_log_start":"27'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5682","last_scrub_stamp":"2024-03-23T23:58:48.541896+0000","last_deep_scrub":"27'5682","last_deep_scrub_stamp":"2024-03-23T23:58:48.541896+0000","last_clean_scrub_stamp":"2024-03-23T23:58:48.541896+0000","objects_scrubbed":0,"log_size":5282,"log_dups_size":0,"ondisk_log_size":5282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:21:14.943558+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83950,"num_write_kb":942381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'5332","reported_seq":5372,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:39.518297+0000","last_change":"2024-03-23T23:58:39.518318+0000","last_active":"2024-03-23T23:58:39.518297+0000","last_peered":"2024-03-23T23:58:39.518297+0000","last_clean":"2024-03-23T23:58:39.518297+0000","last_became_active":"2024-03-23T23:42:40.701566+0000","last_became_peered":"2024-03-23T23:42:40.701566+0000","last_unstale":"2024-03-23T23:58:39.518297+0000","last_undegraded":"2024-03-23T23:58:39.518297+0000","last_fullsized":"2024-03-23T23:58:39.518297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5332","last_scrub_stamp":"2024-03-23T23:58:39.518233+0000","last_deep_scrub":"27'5332","last_deep_scrub_stamp":"2024-03-23T23:58:39.518233+0000","last_clean_scrub_stamp":"2024-03-23T23:58:39.518233+0000","objects_scrubbed":0,"log_size":5332,"log_dups_size":0,"ondisk_log_size":5332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:34:48.598009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79247,"num_write_kb":918114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"27'6956","reported_seq":6988,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:59:02.389223+0000","last_change":"2024-03-23T23:59:02.389223+0000","last_active":"2024-03-23T23:59:02.389223+0000","last_peered":"2024-03-23T23:59:02.389223+0000","last_clean":"2024-03-23T23:59:02.389223+0000","last_became_active":"2024-03-23T23:42:50.758564+0000","last_became_peered":"2024-03-23T23:42:50.758564+0000","last_unstale":"2024-03-23T23:59:02.389223+0000","last_undegraded":"2024-03-23T23:59:02.389223+0000","last_fullsized":"2024-03-23T23:59:02.389223+0000","mapping_epoch":23,"log_start":"27'1200","ondisk_log_start":"27'1200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6956","last_scrub_stamp":"2024-03-23T23:59:02.389124+0000","last_deep_scrub":"27'6956","last_deep_scrub_stamp":"2024-03-23T23:59:02.389124+0000","last_clean_scrub_stamp":"2024-03-23T23:59:02.389124+0000","objects_scrubbed":0,"log_size":5756,"log_dups_size":0,"ondisk_log_size":5756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:04:02.196777+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103363,"num_write_kb":1190294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"27'4879","reported_seq":4919,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:57.483217+0000","last_change":"2024-03-23T23:58:57.483238+0000","last_active":"2024-03-23T23:58:57.483217+0000","last_peered":"2024-03-23T23:58:57.483217+0000","last_clean":"2024-03-23T23:58:57.483217+0000","last_became_active":"2024-03-23T23:42:40.684603+0000","last_became_peered":"2024-03-23T23:42:40.684603+0000","last_unstale":"2024-03-23T23:58:57.483217+0000","last_undegraded":"2024-03-23T23:58:57.483217+0000","last_fullsized":"2024-03-23T23:58:57.483217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4879","last_scrub_stamp":"2024-03-23T23:58:57.483137+0000","last_deep_scrub":"27'4879","last_deep_scrub_stamp":"2024-03-23T23:58:57.483137+0000","last_clean_scrub_stamp":"2024-03-23T23:58:57.483137+0000","objects_scrubbed":0,"log_size":4879,"log_dups_size":0,"ondisk_log_size":4879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:27:27.430415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72674,"num_write_kb":866936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"27'4847","reported_seq":4879,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:47.003725+0000","last_change":"2024-03-23T23:58:47.003725+0000","last_active":"2024-03-23T23:58:47.003725+0000","last_peered":"2024-03-23T23:58:47.003725+0000","last_clean":"2024-03-23T23:58:47.003725+0000","last_became_active":"2024-03-23T23:42:50.753602+0000","last_became_peered":"2024-03-23T23:42:50.753602+0000","last_unstale":"2024-03-23T23:58:47.003725+0000","last_undegraded":"2024-03-23T23:58:47.003725+0000","last_fullsized":"2024-03-23T23:58:47.003725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4847","last_scrub_stamp":"2024-03-23T23:58:47.003626+0000","last_deep_scrub":"27'4847","last_deep_scrub_stamp":"2024-03-23T23:58:47.003626+0000","last_clean_scrub_stamp":"2024-03-23T23:58:47.003626+0000","objects_scrubbed":0,"log_size":4847,"log_dups_size":0,"ondisk_log_size":4847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:34:35.473279+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71433,"num_write_kb":836622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"27'5277","reported_seq":5303,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:53.039521+0000","last_change":"2024-03-23T23:58:53.039521+0000","last_active":"2024-03-23T23:58:53.039521+0000","last_peered":"2024-03-23T23:58:53.039521+0000","last_clean":"2024-03-23T23:58:53.039521+0000","last_became_active":"2024-03-23T23:43:22.034831+0000","last_became_peered":"2024-03-23T23:43:22.034831+0000","last_unstale":"2024-03-23T23:58:53.039521+0000","last_undegraded":"2024-03-23T23:58:53.039521+0000","last_fullsized":"2024-03-23T23:58:53.039521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5277","last_scrub_stamp":"2024-03-23T23:58:53.039400+0000","last_deep_scrub":"27'5277","last_deep_scrub_stamp":"2024-03-23T23:58:53.039400+0000","last_clean_scrub_stamp":"2024-03-23T23:58:53.039400+0000","objects_scrubbed":0,"log_size":5277,"log_dups_size":0,"ondisk_log_size":5277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:21:00.433555+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78302,"num_write_kb":947936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2d","version":"27'6041","reported_seq":6073,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:46.501716+0000","last_change":"2024-03-23T23:58:46.501716+0000","last_active":"2024-03-23T23:58:46.501716+0000","last_peered":"2024-03-23T23:58:46.501716+0000","last_clean":"2024-03-23T23:58:46.501716+0000","last_became_active":"2024-03-23T23:42:50.741065+0000","last_became_peered":"2024-03-23T23:42:50.741065+0000","last_unstale":"2024-03-23T23:58:46.501716+0000","last_undegraded":"2024-03-23T23:58:46.501716+0000","last_fullsized":"2024-03-23T23:58:46.501716+0000","mapping_epoch":23,"log_start":"27'700","ondisk_log_start":"27'700","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6041","last_scrub_stamp":"2024-03-23T23:58:46.501602+0000","last_deep_scrub":"27'6041","last_deep_scrub_stamp":"2024-03-23T23:58:46.501602+0000","last_clean_scrub_stamp":"2024-03-23T23:58:46.501602+0000","objects_scrubbed":0,"log_size":5341,"log_dups_size":0,"ondisk_log_size":5341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:15:34.219768+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89207,"num_write_kb":985993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"27'6145","reported_seq":6185,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:36.242909+0000","last_change":"2024-03-23T23:58:36.242950+0000","last_active":"2024-03-23T23:58:36.242909+0000","last_peered":"2024-03-23T23:58:36.242909+0000","last_clean":"2024-03-23T23:58:36.242909+0000","last_became_active":"2024-03-23T23:42:40.688875+0000","last_became_peered":"2024-03-23T23:42:40.688875+0000","last_unstale":"2024-03-23T23:58:36.242909+0000","last_undegraded":"2024-03-23T23:58:36.242909+0000","last_fullsized":"2024-03-23T23:58:36.242909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6145","last_scrub_stamp":"2024-03-23T23:58:36.242781+0000","last_deep_scrub":"27'6145","last_deep_scrub_stamp":"2024-03-23T23:58:36.242781+0000","last_clean_scrub_stamp":"2024-03-23T23:58:36.242781+0000","objects_scrubbed":0,"log_size":6145,"log_dups_size":0,"ondisk_log_size":6145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:13:57.388811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91123,"num_write_kb":1098161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"27'5341","reported_seq":5373,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:58.716710+0000","last_change":"2024-03-23T23:58:58.716731+0000","last_active":"2024-03-23T23:58:58.716710+0000","last_peered":"2024-03-23T23:58:58.716710+0000","last_clean":"2024-03-23T23:58:58.716710+0000","last_became_active":"2024-03-23T23:42:50.761762+0000","last_became_peered":"2024-03-23T23:42:50.761762+0000","last_unstale":"2024-03-23T23:58:58.716710+0000","last_undegraded":"2024-03-23T23:58:58.716710+0000","last_fullsized":"2024-03-23T23:58:58.716710+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5341","last_scrub_stamp":"2024-03-23T23:58:58.716622+0000","last_deep_scrub":"27'5341","last_deep_scrub_stamp":"2024-03-23T23:58:58.716622+0000","last_clean_scrub_stamp":"2024-03-23T23:58:58.716622+0000","objects_scrubbed":0,"log_size":5341,"log_dups_size":0,"ondisk_log_size":5341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:59:12.688221+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79322,"num_write_kb":913380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'4790","reported_seq":4830,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:40.753446+0000","last_change":"2024-03-23T23:58:40.753446+0000","last_active":"2024-03-23T23:58:40.753446+0000","last_peered":"2024-03-23T23:58:40.753446+0000","last_clean":"2024-03-23T23:58:40.753446+0000","last_became_active":"2024-03-23T23:42:40.683377+0000","last_became_peered":"2024-03-23T23:42:40.683377+0000","last_unstale":"2024-03-23T23:58:40.753446+0000","last_undegraded":"2024-03-23T23:58:40.753446+0000","last_fullsized":"2024-03-23T23:58:40.753446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4790","last_scrub_stamp":"2024-03-23T23:58:40.753338+0000","last_deep_scrub":"27'4790","last_deep_scrub_stamp":"2024-03-23T23:58:40.753338+0000","last_clean_scrub_stamp":"2024-03-23T23:58:40.753338+0000","objects_scrubbed":0,"log_size":4790,"log_dups_size":0,"ondisk_log_size":4790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:39:35.714339+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71235,"num_write_kb":860094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"27'6324","reported_seq":6356,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:57.673909+0000","last_change":"2024-03-23T23:58:57.673958+0000","last_active":"2024-03-23T23:58:57.673909+0000","last_peered":"2024-03-23T23:58:57.673909+0000","last_clean":"2024-03-23T23:58:57.673909+0000","last_became_active":"2024-03-23T23:42:50.754072+0000","last_became_peered":"2024-03-23T23:42:50.754072+0000","last_unstale":"2024-03-23T23:58:57.673909+0000","last_undegraded":"2024-03-23T23:58:57.673909+0000","last_fullsized":"2024-03-23T23:58:57.673909+0000","mapping_epoch":23,"log_start":"27'800","ondisk_log_start":"27'800","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6324","last_scrub_stamp":"2024-03-23T23:58:57.673717+0000","last_deep_scrub":"27'6324","last_deep_scrub_stamp":"2024-03-23T23:58:57.673717+0000","last_clean_scrub_stamp":"2024-03-23T23:58:57.673717+0000","objects_scrubbed":0,"log_size":5524,"log_dups_size":0,"ondisk_log_size":5524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:44:58.499426+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93450,"num_write_kb":1059053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"27'5796","reported_seq":5836,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:50.281476+0000","last_change":"2024-03-23T23:58:50.281496+0000","last_active":"2024-03-23T23:58:50.281476+0000","last_peered":"2024-03-23T23:58:50.281476+0000","last_clean":"2024-03-23T23:58:50.281476+0000","last_became_active":"2024-03-23T23:42:40.689111+0000","last_became_peered":"2024-03-23T23:42:40.689111+0000","last_unstale":"2024-03-23T23:58:50.281476+0000","last_undegraded":"2024-03-23T23:58:50.281476+0000","last_fullsized":"2024-03-23T23:58:50.281476+0000","mapping_epoch":19,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5796","last_scrub_stamp":"2024-03-23T23:58:50.281399+0000","last_deep_scrub":"27'5796","last_deep_scrub_stamp":"2024-03-23T23:58:50.281399+0000","last_clean_scrub_stamp":"2024-03-23T23:58:50.281399+0000","objects_scrubbed":0,"log_size":5696,"log_dups_size":0,"ondisk_log_size":5696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:24:11.594155+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86245,"num_write_kb":1027145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"27'5278","reported_seq":5310,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:59.478622+0000","last_change":"2024-03-23T23:58:59.478659+0000","last_active":"2024-03-23T23:58:59.478622+0000","last_peered":"2024-03-23T23:58:59.478622+0000","last_clean":"2024-03-23T23:58:59.478622+0000","last_became_active":"2024-03-23T23:42:50.759604+0000","last_became_peered":"2024-03-23T23:42:50.759604+0000","last_unstale":"2024-03-23T23:58:59.478622+0000","last_undegraded":"2024-03-23T23:58:59.478622+0000","last_fullsized":"2024-03-23T23:58:59.478622+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5278","last_scrub_stamp":"2024-03-23T23:58:59.478530+0000","last_deep_scrub":"27'5278","last_deep_scrub_stamp":"2024-03-23T23:58:59.478530+0000","last_clean_scrub_stamp":"2024-03-23T23:58:59.478530+0000","objects_scrubbed":0,"log_size":5278,"log_dups_size":0,"ondisk_log_size":5278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:06:25.109958+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77877,"num_write_kb":893934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"27'5684","reported_seq":5724,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:42.084982+0000","last_change":"2024-03-23T23:58:42.084982+0000","last_active":"2024-03-23T23:58:42.084982+0000","last_peered":"2024-03-23T23:58:42.084982+0000","last_clean":"2024-03-23T23:58:42.084982+0000","last_became_active":"2024-03-23T23:42:40.690690+0000","last_became_peered":"2024-03-23T23:42:40.690690+0000","last_unstale":"2024-03-23T23:58:42.084982+0000","last_undegraded":"2024-03-23T23:58:42.084982+0000","last_fullsized":"2024-03-23T23:58:42.084982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5684","last_scrub_stamp":"2024-03-23T23:58:42.084877+0000","last_deep_scrub":"27'5684","last_deep_scrub_stamp":"2024-03-23T23:58:42.084877+0000","last_clean_scrub_stamp":"2024-03-23T23:58:42.084877+0000","objects_scrubbed":0,"log_size":5684,"log_dups_size":0,"ondisk_log_size":5684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:54:49.162535+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84510,"num_write_kb":984289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"27'4973","reported_seq":5005,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:53.263738+0000","last_change":"2024-03-23T23:58:53.263761+0000","last_active":"2024-03-23T23:58:53.263738+0000","last_peered":"2024-03-23T23:58:53.263738+0000","last_clean":"2024-03-23T23:58:53.263738+0000","last_became_active":"2024-03-23T23:42:50.764563+0000","last_became_peered":"2024-03-23T23:42:50.764563+0000","last_unstale":"2024-03-23T23:58:53.263738+0000","last_undegraded":"2024-03-23T23:58:53.263738+0000","last_fullsized":"2024-03-23T23:58:53.263738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4973","last_scrub_stamp":"2024-03-23T23:58:53.263650+0000","last_deep_scrub":"27'4973","last_deep_scrub_stamp":"2024-03-23T23:58:53.263650+0000","last_clean_scrub_stamp":"2024-03-23T23:58:53.263650+0000","objects_scrubbed":0,"log_size":4973,"log_dups_size":0,"ondisk_log_size":4973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:00:59.435426+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73421,"num_write_kb":840152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"27'6976","reported_seq":7016,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:37.547462+0000","last_change":"2024-03-23T23:58:37.547462+0000","last_active":"2024-03-23T23:58:37.547462+0000","last_peered":"2024-03-23T23:58:37.547462+0000","last_clean":"2024-03-23T23:58:37.547462+0000","last_became_active":"2024-03-23T23:42:40.708031+0000","last_became_peered":"2024-03-23T23:42:40.708031+0000","last_unstale":"2024-03-23T23:58:37.547462+0000","last_undegraded":"2024-03-23T23:58:37.547462+0000","last_fullsized":"2024-03-23T23:58:37.547462+0000","mapping_epoch":19,"log_start":"27'1000","ondisk_log_start":"27'1000","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6976","last_scrub_stamp":"2024-03-23T23:58:37.547344+0000","last_deep_scrub":"27'6976","last_deep_scrub_stamp":"2024-03-23T23:58:37.547344+0000","last_clean_scrub_stamp":"2024-03-23T23:58:37.547344+0000","objects_scrubbed":0,"log_size":5976,"log_dups_size":0,"ondisk_log_size":5976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:44:21.499365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104041,"num_write_kb":1238038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"27'5691","reported_seq":5722,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:59.394695+0000","last_change":"2024-03-23T23:58:59.394717+0000","last_active":"2024-03-23T23:58:59.394695+0000","last_peered":"2024-03-23T23:58:59.394695+0000","last_clean":"2024-03-23T23:58:59.394695+0000","last_became_active":"2024-03-23T23:42:50.770790+0000","last_became_peered":"2024-03-23T23:42:50.770790+0000","last_unstale":"2024-03-23T23:58:59.394695+0000","last_undegraded":"2024-03-23T23:58:59.394695+0000","last_fullsized":"2024-03-23T23:58:59.394695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5691","last_scrub_stamp":"2024-03-23T23:58:59.394552+0000","last_deep_scrub":"27'5691","last_deep_scrub_stamp":"2024-03-23T23:58:59.394552+0000","last_clean_scrub_stamp":"2024-03-23T23:58:59.394552+0000","objects_scrubbed":0,"log_size":5691,"log_dups_size":0,"ondisk_log_size":5691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:10:15.887632+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84043,"num_write_kb":972100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"27'4954","reported_seq":4994,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:53.431140+0000","last_change":"2024-03-23T23:58:53.431140+0000","last_active":"2024-03-23T23:58:53.431140+0000","last_peered":"2024-03-23T23:58:53.431140+0000","last_clean":"2024-03-23T23:58:53.431140+0000","last_became_active":"2024-03-23T23:42:40.697694+0000","last_became_peered":"2024-03-23T23:42:40.697694+0000","last_unstale":"2024-03-23T23:58:53.431140+0000","last_undegraded":"2024-03-23T23:58:53.431140+0000","last_fullsized":"2024-03-23T23:58:53.431140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4954","last_scrub_stamp":"2024-03-23T23:58:53.431009+0000","last_deep_scrub":"27'4954","last_deep_scrub_stamp":"2024-03-23T23:58:53.431009+0000","last_clean_scrub_stamp":"2024-03-23T23:58:53.431009+0000","objects_scrubbed":0,"log_size":4954,"log_dups_size":0,"ondisk_log_size":4954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:57:28.912425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73634,"num_write_kb":894008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"27'6061","reported_seq":6092,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:55.668464+0000","last_change":"2024-03-23T23:58:55.668506+0000","last_active":"2024-03-23T23:58:55.668464+0000","last_peered":"2024-03-23T23:58:55.668464+0000","last_clean":"2024-03-23T23:58:55.668464+0000","last_became_active":"2024-03-23T23:42:50.751452+0000","last_became_peered":"2024-03-23T23:42:50.751452+0000","last_unstale":"2024-03-23T23:58:55.668464+0000","last_undegraded":"2024-03-23T23:58:55.668464+0000","last_fullsized":"2024-03-23T23:58:55.668464+0000","mapping_epoch":23,"log_start":"27'600","ondisk_log_start":"27'600","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6061","last_scrub_stamp":"2024-03-23T23:58:55.668363+0000","last_deep_scrub":"27'6061","last_deep_scrub_stamp":"2024-03-23T23:58:55.668363+0000","last_clean_scrub_stamp":"2024-03-23T23:58:55.668363+0000","objects_scrubbed":0,"log_size":5461,"log_dups_size":0,"ondisk_log_size":5461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:06:12.894462+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89888,"num_write_kb":1063697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"27'4435","reported_seq":4475,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:41.343424+0000","last_change":"2024-03-23T23:58:41.343424+0000","last_active":"2024-03-23T23:58:41.343424+0000","last_peered":"2024-03-23T23:58:41.343424+0000","last_clean":"2024-03-23T23:58:41.343424+0000","last_became_active":"2024-03-23T23:42:40.681337+0000","last_became_peered":"2024-03-23T23:42:40.681337+0000","last_unstale":"2024-03-23T23:58:41.343424+0000","last_undegraded":"2024-03-23T23:58:41.343424+0000","last_fullsized":"2024-03-23T23:58:41.343424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4435","last_scrub_stamp":"2024-03-23T23:58:41.343319+0000","last_deep_scrub":"27'4435","last_deep_scrub_stamp":"2024-03-23T23:58:41.343319+0000","last_clean_scrub_stamp":"2024-03-23T23:58:41.343319+0000","objects_scrubbed":0,"log_size":4435,"log_dups_size":0,"ondisk_log_size":4435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:19:37.808855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65733,"num_write_kb":782831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"27'3547","reported_seq":3578,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:59:01.537407+0000","last_change":"2024-03-23T23:59:01.537431+0000","last_active":"2024-03-23T23:59:01.537407+0000","last_peered":"2024-03-23T23:59:01.537407+0000","last_clean":"2024-03-23T23:59:01.537407+0000","last_became_active":"2024-03-23T23:42:50.768695+0000","last_became_peered":"2024-03-23T23:42:50.768695+0000","last_unstale":"2024-03-23T23:59:01.537407+0000","last_undegraded":"2024-03-23T23:59:01.537407+0000","last_fullsized":"2024-03-23T23:59:01.537407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3547","last_scrub_stamp":"2024-03-23T23:59:01.537311+0000","last_deep_scrub":"27'3547","last_deep_scrub_stamp":"2024-03-23T23:59:01.537311+0000","last_clean_scrub_stamp":"2024-03-23T23:59:01.537311+0000","objects_scrubbed":0,"log_size":3547,"log_dups_size":0,"ondisk_log_size":3547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:15:27.868991+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52531,"num_write_kb":593656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'4800","reported_seq":4840,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:44.284206+0000","last_change":"2024-03-23T23:58:44.284206+0000","last_active":"2024-03-23T23:58:44.284206+0000","last_peered":"2024-03-23T23:58:44.284206+0000","last_clean":"2024-03-23T23:58:44.284206+0000","last_became_active":"2024-03-23T23:42:40.680643+0000","last_became_peered":"2024-03-23T23:42:40.680643+0000","last_unstale":"2024-03-23T23:58:44.284206+0000","last_undegraded":"2024-03-23T23:58:44.284206+0000","last_fullsized":"2024-03-23T23:58:44.284206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4800","last_scrub_stamp":"2024-03-23T23:58:44.284109+0000","last_deep_scrub":"27'4800","last_deep_scrub_stamp":"2024-03-23T23:58:44.284109+0000","last_clean_scrub_stamp":"2024-03-23T23:58:44.284109+0000","objects_scrubbed":0,"log_size":4800,"log_dups_size":0,"ondisk_log_size":4800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:19:40.749644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71159,"num_write_kb":844038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"27'5011","reported_seq":5042,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:59:04.469144+0000","last_change":"2024-03-23T23:59:04.469168+0000","last_active":"2024-03-23T23:59:04.469144+0000","last_peered":"2024-03-23T23:59:04.469144+0000","last_clean":"2024-03-23T23:59:04.469144+0000","last_became_active":"2024-03-23T23:42:50.762183+0000","last_became_peered":"2024-03-23T23:42:50.762183+0000","last_unstale":"2024-03-23T23:59:04.469144+0000","last_undegraded":"2024-03-23T23:59:04.469144+0000","last_fullsized":"2024-03-23T23:59:04.469144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5011","last_scrub_stamp":"2024-03-23T23:59:04.469050+0000","last_deep_scrub":"27'5011","last_deep_scrub_stamp":"2024-03-23T23:59:04.469050+0000","last_clean_scrub_stamp":"2024-03-23T23:59:04.469050+0000","objects_scrubbed":0,"log_size":5011,"log_dups_size":0,"ondisk_log_size":5011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:39:19.979855+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74336,"num_write_kb":853450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"27'4024","reported_seq":4063,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:55.510916+0000","last_change":"2024-03-23T23:58:55.510938+0000","last_active":"2024-03-23T23:58:55.510916+0000","last_peered":"2024-03-23T23:58:55.510916+0000","last_clean":"2024-03-23T23:58:55.510916+0000","last_became_active":"2024-03-23T23:42:40.682410+0000","last_became_peered":"2024-03-23T23:42:40.682410+0000","last_unstale":"2024-03-23T23:58:55.510916+0000","last_undegraded":"2024-03-23T23:58:55.510916+0000","last_fullsized":"2024-03-23T23:58:55.510916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4024","last_scrub_stamp":"2024-03-23T23:58:55.510846+0000","last_deep_scrub":"27'4024","last_deep_scrub_stamp":"2024-03-23T23:58:55.510846+0000","last_clean_scrub_stamp":"2024-03-23T23:58:55.510846+0000","objects_scrubbed":0,"log_size":4024,"log_dups_size":0,"ondisk_log_size":4024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:19:09.039947+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59528,"num_write_kb":755074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"27'4698","reported_seq":4729,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:59:00.554758+0000","last_change":"2024-03-23T23:59:00.554780+0000","last_active":"2024-03-23T23:59:00.554758+0000","last_peered":"2024-03-23T23:59:00.554758+0000","last_clean":"2024-03-23T23:59:00.554758+0000","last_became_active":"2024-03-23T23:42:50.748809+0000","last_became_peered":"2024-03-23T23:42:50.748809+0000","last_unstale":"2024-03-23T23:59:00.554758+0000","last_undegraded":"2024-03-23T23:59:00.554758+0000","last_fullsized":"2024-03-23T23:59:00.554758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4698","last_scrub_stamp":"2024-03-23T23:59:00.554674+0000","last_deep_scrub":"27'4698","last_deep_scrub_stamp":"2024-03-23T23:59:00.554674+0000","last_clean_scrub_stamp":"2024-03-23T23:59:00.554674+0000","objects_scrubbed":0,"log_size":4698,"log_dups_size":0,"ondisk_log_size":4698,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:37:42.710927+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69546,"num_write_kb":808803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'3645","reported_seq":3684,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:46.718614+0000","last_change":"2024-03-23T23:58:46.718636+0000","last_active":"2024-03-23T23:58:46.718614+0000","last_peered":"2024-03-23T23:58:46.718614+0000","last_clean":"2024-03-23T23:58:46.718614+0000","last_became_active":"2024-03-23T23:42:40.682155+0000","last_became_peered":"2024-03-23T23:42:40.682155+0000","last_unstale":"2024-03-23T23:58:46.718614+0000","last_undegraded":"2024-03-23T23:58:46.718614+0000","last_fullsized":"2024-03-23T23:58:46.718614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3645","last_scrub_stamp":"2024-03-23T23:58:46.718541+0000","last_deep_scrub":"27'3645","last_deep_scrub_stamp":"2024-03-23T23:58:46.718541+0000","last_clean_scrub_stamp":"2024-03-23T23:58:46.718541+0000","objects_scrubbed":0,"log_size":3645,"log_dups_size":0,"ondisk_log_size":3645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:12:24.531654+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54155,"num_write_kb":623068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"27'4100","reported_seq":4132,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:37.016624+0000","last_change":"2024-03-23T23:58:37.016646+0000","last_active":"2024-03-23T23:58:37.016624+0000","last_peered":"2024-03-23T23:58:37.016624+0000","last_clean":"2024-03-23T23:58:37.016624+0000","last_became_active":"2024-03-23T23:42:50.745858+0000","last_became_peered":"2024-03-23T23:42:50.745858+0000","last_unstale":"2024-03-23T23:58:37.016624+0000","last_undegraded":"2024-03-23T23:58:37.016624+0000","last_fullsized":"2024-03-23T23:58:37.016624+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4100","last_scrub_stamp":"2024-03-23T23:58:37.016533+0000","last_deep_scrub":"27'4100","last_deep_scrub_stamp":"2024-03-23T23:58:37.016533+0000","last_clean_scrub_stamp":"2024-03-23T23:58:37.016533+0000","objects_scrubbed":0,"log_size":4100,"log_dups_size":0,"ondisk_log_size":4100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:54:50.296449+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":60470,"num_write_kb":714617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"27'5162","reported_seq":5201,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:37.697548+0000","last_change":"2024-03-23T23:58:37.697570+0000","last_active":"2024-03-23T23:58:37.697548+0000","last_peered":"2024-03-23T23:58:37.697548+0000","last_clean":"2024-03-23T23:58:37.697548+0000","last_became_active":"2024-03-23T23:42:40.701874+0000","last_became_peered":"2024-03-23T23:42:40.701874+0000","last_unstale":"2024-03-23T23:58:37.697548+0000","last_undegraded":"2024-03-23T23:58:37.697548+0000","last_fullsized":"2024-03-23T23:58:37.697548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5162","last_scrub_stamp":"2024-03-23T23:58:37.697468+0000","last_deep_scrub":"27'5162","last_deep_scrub_stamp":"2024-03-23T23:58:37.697468+0000","last_clean_scrub_stamp":"2024-03-23T23:58:37.697468+0000","objects_scrubbed":0,"log_size":5162,"log_dups_size":0,"ondisk_log_size":5162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:59:05.069988+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76848,"num_write_kb":918422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"27'4951","reported_seq":4983,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:59:06.421503+0000","last_change":"2024-03-23T23:59:06.421503+0000","last_active":"2024-03-23T23:59:06.421503+0000","last_peered":"2024-03-23T23:59:06.421503+0000","last_clean":"2024-03-23T23:59:06.421503+0000","last_became_active":"2024-03-23T23:42:50.772849+0000","last_became_peered":"2024-03-23T23:42:50.772849+0000","last_unstale":"2024-03-23T23:59:06.421503+0000","last_undegraded":"2024-03-23T23:59:06.421503+0000","last_fullsized":"2024-03-23T23:59:06.421503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4951","last_scrub_stamp":"2024-03-23T23:59:06.421354+0000","last_deep_scrub":"27'4951","last_deep_scrub_stamp":"2024-03-23T23:59:06.421354+0000","last_clean_scrub_stamp":"2024-03-23T23:59:06.421354+0000","objects_scrubbed":0,"log_size":4951,"log_dups_size":0,"ondisk_log_size":4951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:30:44.737400+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73640,"num_write_kb":854588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"27'5694","reported_seq":5733,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:39.705506+0000","last_change":"2024-03-23T23:58:39.705529+0000","last_active":"2024-03-23T23:58:39.705506+0000","last_peered":"2024-03-23T23:58:39.705506+0000","last_clean":"2024-03-23T23:58:39.705506+0000","last_became_active":"2024-03-23T23:42:40.702447+0000","last_became_peered":"2024-03-23T23:42:40.702447+0000","last_unstale":"2024-03-23T23:58:39.705506+0000","last_undegraded":"2024-03-23T23:58:39.705506+0000","last_fullsized":"2024-03-23T23:58:39.705506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5694","last_scrub_stamp":"2024-03-23T23:58:39.705420+0000","last_deep_scrub":"27'5694","last_deep_scrub_stamp":"2024-03-23T23:58:39.705420+0000","last_clean_scrub_stamp":"2024-03-23T23:58:39.705420+0000","objects_scrubbed":0,"log_size":5694,"log_dups_size":0,"ondisk_log_size":5694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:03:00.560218+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84473,"num_write_kb":1008808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"27'4449","reported_seq":4480,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:42.476053+0000","last_change":"2024-03-23T23:58:42.476076+0000","last_active":"2024-03-23T23:58:42.476053+0000","last_peered":"2024-03-23T23:58:42.476053+0000","last_clean":"2024-03-23T23:58:42.476053+0000","last_became_active":"2024-03-23T23:42:50.745205+0000","last_became_peered":"2024-03-23T23:42:50.745205+0000","last_unstale":"2024-03-23T23:58:42.476053+0000","last_undegraded":"2024-03-23T23:58:42.476053+0000","last_fullsized":"2024-03-23T23:58:42.476053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4449","last_scrub_stamp":"2024-03-23T23:58:42.475960+0000","last_deep_scrub":"27'4449","last_deep_scrub_stamp":"2024-03-23T23:58:42.475960+0000","last_clean_scrub_stamp":"2024-03-23T23:58:42.475960+0000","objects_scrubbed":0,"log_size":4449,"log_dups_size":0,"ondisk_log_size":4449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:49:33.571509+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65706,"num_write_kb":746784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"27'6105","reported_seq":6144,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:43.224029+0000","last_change":"2024-03-23T23:58:43.224050+0000","last_active":"2024-03-23T23:58:43.224029+0000","last_peered":"2024-03-23T23:58:43.224029+0000","last_clean":"2024-03-23T23:58:43.224029+0000","last_became_active":"2024-03-23T23:42:40.713737+0000","last_became_peered":"2024-03-23T23:42:40.713737+0000","last_unstale":"2024-03-23T23:58:43.224029+0000","last_undegraded":"2024-03-23T23:58:43.224029+0000","last_fullsized":"2024-03-23T23:58:43.224029+0000","mapping_epoch":19,"log_start":"27'400","ondisk_log_start":"27'400","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6105","last_scrub_stamp":"2024-03-23T23:58:43.223955+0000","last_deep_scrub":"27'6105","last_deep_scrub_stamp":"2024-03-23T23:58:43.223955+0000","last_clean_scrub_stamp":"2024-03-23T23:58:43.223955+0000","objects_scrubbed":0,"log_size":5705,"log_dups_size":0,"ondisk_log_size":5705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:20:50.618110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90841,"num_write_kb":1111853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"27'6499","reported_seq":6531,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:58.517540+0000","last_change":"2024-03-23T23:58:58.517563+0000","last_active":"2024-03-23T23:58:58.517540+0000","last_peered":"2024-03-23T23:58:58.517540+0000","last_clean":"2024-03-23T23:58:58.517540+0000","last_became_active":"2024-03-23T23:42:50.746149+0000","last_became_peered":"2024-03-23T23:42:50.746149+0000","last_unstale":"2024-03-23T23:58:58.517540+0000","last_undegraded":"2024-03-23T23:58:58.517540+0000","last_fullsized":"2024-03-23T23:58:58.517540+0000","mapping_epoch":23,"log_start":"27'1200","ondisk_log_start":"27'1200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6499","last_scrub_stamp":"2024-03-23T23:58:58.517452+0000","last_deep_scrub":"27'6499","last_deep_scrub_stamp":"2024-03-23T23:58:58.517452+0000","last_clean_scrub_stamp":"2024-03-23T23:58:58.517452+0000","objects_scrubbed":0,"log_size":5299,"log_dups_size":0,"ondisk_log_size":5299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:30:39.355403+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96498,"num_write_kb":1062339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"27'5300","reported_seq":5339,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:41.360620+0000","last_change":"2024-03-23T23:58:41.360641+0000","last_active":"2024-03-23T23:58:41.360620+0000","last_peered":"2024-03-23T23:58:41.360620+0000","last_clean":"2024-03-23T23:58:41.360620+0000","last_became_active":"2024-03-23T23:42:40.710362+0000","last_became_peered":"2024-03-23T23:42:40.710362+0000","last_unstale":"2024-03-23T23:58:41.360620+0000","last_undegraded":"2024-03-23T23:58:41.360620+0000","last_fullsized":"2024-03-23T23:58:41.360620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5300","last_scrub_stamp":"2024-03-23T23:58:41.360551+0000","last_deep_scrub":"27'5300","last_deep_scrub_stamp":"2024-03-23T23:58:41.360551+0000","last_clean_scrub_stamp":"2024-03-23T23:58:41.360551+0000","objects_scrubbed":0,"log_size":5300,"log_dups_size":0,"ondisk_log_size":5300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:00:18.949608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79360,"num_write_kb":955033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"27'4854","reported_seq":4886,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:55.791214+0000","last_change":"2024-03-23T23:58:55.791234+0000","last_active":"2024-03-23T23:58:55.791214+0000","last_peered":"2024-03-23T23:58:55.791214+0000","last_clean":"2024-03-23T23:58:55.791214+0000","last_became_active":"2024-03-23T23:42:50.753085+0000","last_became_peered":"2024-03-23T23:42:50.753085+0000","last_unstale":"2024-03-23T23:58:55.791214+0000","last_undegraded":"2024-03-23T23:58:55.791214+0000","last_fullsized":"2024-03-23T23:58:55.791214+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4854","last_scrub_stamp":"2024-03-23T23:58:55.791126+0000","last_deep_scrub":"27'4854","last_deep_scrub_stamp":"2024-03-23T23:58:55.791126+0000","last_clean_scrub_stamp":"2024-03-23T23:58:55.791126+0000","objects_scrubbed":0,"log_size":4854,"log_dups_size":0,"ondisk_log_size":4854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:17:47.897438+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71990,"num_write_kb":829684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"27'5530","reported_seq":5569,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:58.321255+0000","last_change":"2024-03-23T23:58:58.321291+0000","last_active":"2024-03-23T23:58:58.321255+0000","last_peered":"2024-03-23T23:58:58.321255+0000","last_clean":"2024-03-23T23:58:58.321255+0000","last_became_active":"2024-03-23T23:42:40.689023+0000","last_became_peered":"2024-03-23T23:42:40.689023+0000","last_unstale":"2024-03-23T23:58:58.321255+0000","last_undegraded":"2024-03-23T23:58:58.321255+0000","last_fullsized":"2024-03-23T23:58:58.321255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5530","last_scrub_stamp":"2024-03-23T23:58:58.321163+0000","last_deep_scrub":"27'5530","last_deep_scrub_stamp":"2024-03-23T23:58:58.321163+0000","last_clean_scrub_stamp":"2024-03-23T23:58:58.321163+0000","objects_scrubbed":0,"log_size":5530,"log_dups_size":0,"ondisk_log_size":5530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:27:16.670399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82240,"num_write_kb":999067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"27'4495","reported_seq":4528,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:56.380281+0000","last_change":"2024-03-23T23:58:56.380281+0000","last_active":"2024-03-23T23:58:56.380281+0000","last_peered":"2024-03-23T23:58:56.380281+0000","last_clean":"2024-03-23T23:58:56.380281+0000","last_became_active":"2024-03-23T23:42:50.755405+0000","last_became_peered":"2024-03-23T23:42:50.755405+0000","last_unstale":"2024-03-23T23:58:56.380281+0000","last_undegraded":"2024-03-23T23:58:56.380281+0000","last_fullsized":"2024-03-23T23:58:56.380281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4495","last_scrub_stamp":"2024-03-23T23:58:56.380172+0000","last_deep_scrub":"27'4495","last_deep_scrub_stamp":"2024-03-23T23:58:56.380172+0000","last_clean_scrub_stamp":"2024-03-23T23:58:56.380172+0000","objects_scrubbed":0,"log_size":4495,"log_dups_size":0,"ondisk_log_size":4495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:27:14.313837+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66847,"num_write_kb":769767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"27'4564","reported_seq":4603,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:54.415846+0000","last_change":"2024-03-23T23:58:54.415865+0000","last_active":"2024-03-23T23:58:54.415846+0000","last_peered":"2024-03-23T23:58:54.415846+0000","last_clean":"2024-03-23T23:58:54.415846+0000","last_became_active":"2024-03-23T23:42:40.695978+0000","last_became_peered":"2024-03-23T23:42:40.695978+0000","last_unstale":"2024-03-23T23:58:54.415846+0000","last_undegraded":"2024-03-23T23:58:54.415846+0000","last_fullsized":"2024-03-23T23:58:54.415846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4564","last_scrub_stamp":"2024-03-23T23:58:54.415776+0000","last_deep_scrub":"27'4564","last_deep_scrub_stamp":"2024-03-23T23:58:54.415776+0000","last_clean_scrub_stamp":"2024-03-23T23:58:54.415776+0000","objects_scrubbed":0,"log_size":4564,"log_dups_size":0,"ondisk_log_size":4564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:11:07.710305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67848,"num_write_kb":796612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"27'5529","reported_seq":5561,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:44.467357+0000","last_change":"2024-03-23T23:58:44.467380+0000","last_active":"2024-03-23T23:58:44.467357+0000","last_peered":"2024-03-23T23:58:44.467357+0000","last_clean":"2024-03-23T23:58:44.467357+0000","last_became_active":"2024-03-23T23:42:50.751738+0000","last_became_peered":"2024-03-23T23:42:50.751738+0000","last_unstale":"2024-03-23T23:58:44.467357+0000","last_undegraded":"2024-03-23T23:58:44.467357+0000","last_fullsized":"2024-03-23T23:58:44.467357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5529","last_scrub_stamp":"2024-03-23T23:58:44.467266+0000","last_deep_scrub":"27'5529","last_deep_scrub_stamp":"2024-03-23T23:58:44.467266+0000","last_clean_scrub_stamp":"2024-03-23T23:58:44.467266+0000","objects_scrubbed":0,"log_size":5529,"log_dups_size":0,"ondisk_log_size":5529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:00:22.056323+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81884,"num_write_kb":915818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'4914","reported_seq":4953,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:44.265517+0000","last_change":"2024-03-23T23:58:44.265537+0000","last_active":"2024-03-23T23:58:44.265517+0000","last_peered":"2024-03-23T23:58:44.265517+0000","last_clean":"2024-03-23T23:58:44.265517+0000","last_became_active":"2024-03-23T23:42:40.698092+0000","last_became_peered":"2024-03-23T23:42:40.698092+0000","last_unstale":"2024-03-23T23:58:44.265517+0000","last_undegraded":"2024-03-23T23:58:44.265517+0000","last_fullsized":"2024-03-23T23:58:44.265517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4914","last_scrub_stamp":"2024-03-23T23:58:44.265437+0000","last_deep_scrub":"27'4914","last_deep_scrub_stamp":"2024-03-23T23:58:44.265437+0000","last_clean_scrub_stamp":"2024-03-23T23:58:44.265437+0000","objects_scrubbed":0,"log_size":4914,"log_dups_size":0,"ondisk_log_size":4914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:11:50.228207+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73128,"num_write_kb":826128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"27'4584","reported_seq":4615,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:59:04.513647+0000","last_change":"2024-03-23T23:59:04.513669+0000","last_active":"2024-03-23T23:59:04.513647+0000","last_peered":"2024-03-23T23:59:04.513647+0000","last_clean":"2024-03-23T23:59:04.513647+0000","last_became_active":"2024-03-23T23:42:50.752614+0000","last_became_peered":"2024-03-23T23:42:50.752614+0000","last_unstale":"2024-03-23T23:59:04.513647+0000","last_undegraded":"2024-03-23T23:59:04.513647+0000","last_fullsized":"2024-03-23T23:59:04.513647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4584","last_scrub_stamp":"2024-03-23T23:59:04.513557+0000","last_deep_scrub":"27'4584","last_deep_scrub_stamp":"2024-03-23T23:59:04.513557+0000","last_clean_scrub_stamp":"2024-03-23T23:59:04.513557+0000","objects_scrubbed":0,"log_size":4584,"log_dups_size":0,"ondisk_log_size":4584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:18.494182+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67913,"num_write_kb":776364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"27'4451","reported_seq":4492,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:41.487455+0000","last_change":"2024-03-23T23:58:41.487455+0000","last_active":"2024-03-23T23:58:41.487455+0000","last_peered":"2024-03-23T23:58:41.487455+0000","last_clean":"2024-03-23T23:58:41.487455+0000","last_became_active":"2024-03-23T23:42:40.697932+0000","last_became_peered":"2024-03-23T23:42:40.697932+0000","last_unstale":"2024-03-23T23:58:41.487455+0000","last_undegraded":"2024-03-23T23:58:41.487455+0000","last_fullsized":"2024-03-23T23:58:41.487455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4451","last_scrub_stamp":"2024-03-23T23:58:41.487371+0000","last_deep_scrub":"27'4451","last_deep_scrub_stamp":"2024-03-23T23:58:41.487371+0000","last_clean_scrub_stamp":"2024-03-23T23:58:41.487371+0000","objects_scrubbed":0,"log_size":4451,"log_dups_size":0,"ondisk_log_size":4451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:44:32.520752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66105,"num_write_kb":808863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"27'4925","reported_seq":4956,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:49.999662+0000","last_change":"2024-03-23T23:58:49.999711+0000","last_active":"2024-03-23T23:58:49.999662+0000","last_peered":"2024-03-23T23:58:49.999662+0000","last_clean":"2024-03-23T23:58:49.999662+0000","last_became_active":"2024-03-23T23:42:50.765716+0000","last_became_peered":"2024-03-23T23:42:50.765716+0000","last_unstale":"2024-03-23T23:58:49.999662+0000","last_undegraded":"2024-03-23T23:58:49.999662+0000","last_fullsized":"2024-03-23T23:58:49.999662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4925","last_scrub_stamp":"2024-03-23T23:58:49.999509+0000","last_deep_scrub":"27'4925","last_deep_scrub_stamp":"2024-03-23T23:58:49.999509+0000","last_clean_scrub_stamp":"2024-03-23T23:58:49.999509+0000","objects_scrubbed":0,"log_size":4925,"log_dups_size":0,"ondisk_log_size":4925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:36:13.773595+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72768,"num_write_kb":776524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'5362","reported_seq":5403,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:46.241007+0000","last_change":"2024-03-23T23:58:46.241007+0000","last_active":"2024-03-23T23:58:46.241007+0000","last_peered":"2024-03-23T23:58:46.241007+0000","last_clean":"2024-03-23T23:58:46.241007+0000","last_became_active":"2024-03-23T23:42:40.683711+0000","last_became_peered":"2024-03-23T23:42:40.683711+0000","last_unstale":"2024-03-23T23:58:46.241007+0000","last_undegraded":"2024-03-23T23:58:46.241007+0000","last_fullsized":"2024-03-23T23:58:46.241007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5362","last_scrub_stamp":"2024-03-23T23:58:46.240907+0000","last_deep_scrub":"27'5362","last_deep_scrub_stamp":"2024-03-23T23:58:46.240907+0000","last_clean_scrub_stamp":"2024-03-23T23:58:46.240907+0000","objects_scrubbed":0,"log_size":5362,"log_dups_size":0,"ondisk_log_size":5362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:00:48.536668+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79587,"num_write_kb":960150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"27'5558","reported_seq":5589,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:59:05.465236+0000","last_change":"2024-03-23T23:59:05.465260+0000","last_active":"2024-03-23T23:59:05.465236+0000","last_peered":"2024-03-23T23:59:05.465236+0000","last_clean":"2024-03-23T23:59:05.465236+0000","last_became_active":"2024-03-23T23:42:50.766328+0000","last_became_peered":"2024-03-23T23:42:50.766328+0000","last_unstale":"2024-03-23T23:59:05.465236+0000","last_undegraded":"2024-03-23T23:59:05.465236+0000","last_fullsized":"2024-03-23T23:59:05.465236+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5558","last_scrub_stamp":"2024-03-23T23:59:05.465147+0000","last_deep_scrub":"27'5558","last_deep_scrub_stamp":"2024-03-23T23:59:05.465147+0000","last_clean_scrub_stamp":"2024-03-23T23:59:05.465147+0000","objects_scrubbed":0,"log_size":5558,"log_dups_size":0,"ondisk_log_size":5558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:48:04.931212+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82850,"num_write_kb":926357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"27'6244","reported_seq":6285,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:51.365982+0000","last_change":"2024-03-23T23:58:51.365982+0000","last_active":"2024-03-23T23:58:51.365982+0000","last_peered":"2024-03-23T23:58:51.365982+0000","last_clean":"2024-03-23T23:58:51.365982+0000","last_became_active":"2024-03-23T23:42:40.678325+0000","last_became_peered":"2024-03-23T23:42:40.678325+0000","last_unstale":"2024-03-23T23:58:51.365982+0000","last_undegraded":"2024-03-23T23:58:51.365982+0000","last_fullsized":"2024-03-23T23:58:51.365982+0000","mapping_epoch":19,"log_start":"27'500","ondisk_log_start":"27'500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6244","last_scrub_stamp":"2024-03-23T23:58:51.365895+0000","last_deep_scrub":"27'6244","last_deep_scrub_stamp":"2024-03-23T23:58:51.365895+0000","last_clean_scrub_stamp":"2024-03-23T23:58:51.365895+0000","objects_scrubbed":0,"log_size":5744,"log_dups_size":0,"ondisk_log_size":5744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:08:45.756291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92992,"num_write_kb":1109347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"27'5529","reported_seq":5560,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:59.408474+0000","last_change":"2024-03-23T23:58:59.408498+0000","last_active":"2024-03-23T23:58:59.408474+0000","last_peered":"2024-03-23T23:58:59.408474+0000","last_clean":"2024-03-23T23:58:59.408474+0000","last_became_active":"2024-03-23T23:42:50.750466+0000","last_became_peered":"2024-03-23T23:42:50.750466+0000","last_unstale":"2024-03-23T23:58:59.408474+0000","last_undegraded":"2024-03-23T23:58:59.408474+0000","last_fullsized":"2024-03-23T23:58:59.408474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5529","last_scrub_stamp":"2024-03-23T23:58:59.408377+0000","last_deep_scrub":"27'5529","last_deep_scrub_stamp":"2024-03-23T23:58:59.408377+0000","last_clean_scrub_stamp":"2024-03-23T23:58:59.408377+0000","objects_scrubbed":0,"log_size":5529,"log_dups_size":0,"ondisk_log_size":5529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:31:53.624309+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82257,"num_write_kb":938007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"27'4808","reported_seq":4848,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T23:58:40.229875+0000","last_change":"2024-03-23T23:58:40.229918+0000","last_active":"2024-03-23T23:58:40.229875+0000","last_peered":"2024-03-23T23:58:40.229875+0000","last_clean":"2024-03-23T23:58:40.229875+0000","last_became_active":"2024-03-23T23:42:40.700855+0000","last_became_peered":"2024-03-23T23:42:40.700855+0000","last_unstale":"2024-03-23T23:58:40.229875+0000","last_undegraded":"2024-03-23T23:58:40.229875+0000","last_fullsized":"2024-03-23T23:58:40.229875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4808","last_scrub_stamp":"2024-03-23T23:58:40.229723+0000","last_deep_scrub":"27'4808","last_deep_scrub_stamp":"2024-03-23T23:58:40.229723+0000","last_clean_scrub_stamp":"2024-03-23T23:58:40.229723+0000","objects_scrubbed":0,"log_size":4808,"log_dups_size":0,"ondisk_log_size":4808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:36:04.003809+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71971,"num_write_kb":878476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":4985198,"num_write_kb":56700971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":327294,"ondisk_log_size":327294,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":98084592,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":31,"num_read_kb":105,"num_write":4491,"num_write_kb":97550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":196231168,"data_stored":196169184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4256,"ondisk_log_size":4256,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":11,"num_write":4962178,"num_write_kb":59383104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326587,"ondisk_log_size":326587,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":93601894,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":44,"num_read_kb":115,"num_write":4044,"num_write_kb":93019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":187269120,"data_stored":187203788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3857,"ondisk_log_size":3857,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509643,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":616364,"kb_used_data":49444,"kb_used_omap":1,"kb_used_meta":566910,"kb_avail":93755476,"statfs":{"total":96636764160,"available":96005607424,"internally_reserved":0,"allocated":50630656,"data_stored":50448059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":580516294},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509639,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":889852,"kb_used_data":37236,"kb_used_omap":1,"kb_used_meta":852606,"kb_avail":93481988,"statfs":{"total":96636764160,"available":95725555712,"internally_reserved":0,"allocated":38129664,"data_stored":37949267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":873068997},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509638,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":997916,"kb_used_data":67412,"kb_used_omap":1,"kb_used_meta":930494,"kb_avail":93373924,"statfs":{"total":96636764160,"available":95614898176,"internally_reserved":0,"allocated":69029888,"data_stored":68838347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":952826309},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509640,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":977820,"kb_used_data":56340,"kb_used_omap":1,"kb_used_meta":921470,"kb_avail":93394020,"statfs":{"total":96636764160,"available":95635476480,"internally_reserved":0,"allocated":57692160,"data_stored":57497661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":943585735},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542342,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":916712,"kb_used_data":58208,"kb_used_omap":1,"kb_used_meta":858494,"kb_avail":93455128,"statfs":{"total":96636764160,"available":95698051072,"internally_reserved":0,"allocated":59604992,"data_stored":59426419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":879098314},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542347,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":575412,"kb_used_data":12652,"kb_used_omap":1,"kb_used_meta":562750,"kb_avail":93796428,"statfs":{"total":96636764160,"available":96047542272,"internally_reserved":0,"allocated":12955648,"data_stored":12782666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":576256453},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542346,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":779952,"kb_used_data":62952,"kb_used_omap":1,"kb_used_meta":716990,"kb_avail":93591888,"statfs":{"total":96636764160,"available":95838093312,"internally_reserved":0,"allocated":64462848,"data_stored":64271712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":734198213},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542345,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":736108,"kb_used_data":33636,"kb_used_omap":1,"kb_used_meta":702462,"kb_avail":93635732,"statfs":{"total":96636764160,"available":95882989568,"internally_reserved":0,"allocated":34443264,"data_stored":34260561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":719321541},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25178112,"data_stored":25166462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22224896,"data_stored":22212855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4280320,"data_stored":4278865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18116608,"data_stored":18103624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":33566720,"data_stored":33554558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20971610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20979712,"data_stored":20972192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":41947136,"data_stored":41943622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41955328,"data_stored":41943734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8392704,"data_stored":8388678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":39292928,"data_stored":39278914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":35180544,"data_stored":35168666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16871424,"data_stored":16862534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29368320,"data_stored":29360744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16777306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T23:59:19.368 DEBUG:teuthology.orchestra.run.smithi008:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-23T23:59:19.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.506+0000 7f602ba00640 1 Processor -- start 2024-03-23T23:59:19.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.506+0000 7f602ba00640 1 -- start start 2024-03-23T23:59:19.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.510+0000 7f602ba00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f60240c2370 0x7f60240c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:19.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.510+0000 7f602ba00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f602415e100 0x7f60241604f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:19.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.510+0000 7f602ba00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60240c2bb0 con 0x7f60240c2750 2024-03-23T23:59:19.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.510+0000 7f602ba00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f602406d6a0 con 0x7f60240c2370 2024-03-23T23:59:19.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.510+0000 7f602ba00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60241531f0 con 0x7f602415e100 2024-03-23T23:59:19.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.510+0000 7f6029000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f60240c2370 0x7f60240c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:19.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.510+0000 7f6029000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f60240c2370 0x7f60240c6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43672/0 (socket says 172.21.15.8:43672) 2024-03-23T23:59:19.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.510+0000 7f6029000640 1 -- 172.21.15.8:0/3033138033 learned_addr learned my addr 172.21.15.8:0/3033138033 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:59:19.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.510+0000 7f6029a00640 1 --2- 172.21.15.8:0/3033138033 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f602415e100 0x7f60241604f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:19.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.510+0000 7f6029000640 1 -- 172.21.15.8:0/3033138033 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f602415e100 msgr2=0x7f60241604f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:59:19.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.510+0000 7f6029000640 1 --2- 172.21.15.8:0/3033138033 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f602415e100 0x7f60241604f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:19.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.510+0000 7f6029000640 1 -- 172.21.15.8:0/3033138033 >> v1:172.21.15.196:6789/0 conn(0x7f60240c2750 legacy=0x7f602406db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:19.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.510+0000 7f6023400640 1 -- 172.21.15.8:0/3033138033 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2999840624 0 0) 0x7f60240c2bb0 con 0x7f60240c2750 2024-03-23T23:59:19.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.510+0000 7f6029000640 1 -- 172.21.15.8:0/3033138033 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60241559a0 con 0x7f60240c2370 2024-03-23T23:59:19.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.514+0000 7f6029000640 1 --2- 172.21.15.8:0/3033138033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60240c2370 0x7f60240c6e40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6018009870 tx=0x7f601801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dac822432765e2eb server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:19.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.514+0000 7f6023400640 1 -- 172.21.15.8:0/3033138033 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60180b0070 con 0x7f60240c2370 2024-03-23T23:59:19.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.514+0000 7f6023400640 1 -- 172.21.15.8:0/3033138033 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60180ab600 con 0x7f60240c2370 2024-03-23T23:59:19.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.514+0000 7f6023400640 1 -- 172.21.15.8:0/3033138033 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60180ab9d0 con 0x7f60240c2370 2024-03-23T23:59:19.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.514+0000 7f602ba00640 1 -- 172.21.15.8:0/3033138033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60240c2370 msgr2=0x7f60240c6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:19.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.514+0000 7f602ba00640 1 --2- 172.21.15.8:0/3033138033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60240c2370 0x7f60240c6e40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6018009870 tx=0x7f601801c4d0 comp rx=0 tx=0).stop 2024-03-23T23:59:19.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.514+0000 7f602ba00640 1 -- 172.21.15.8:0/3033138033 shutdown_connections 2024-03-23T23:59:19.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.514+0000 7f602ba00640 1 --2- 172.21.15.8:0/3033138033 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f602415e100 0x7f60241604f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:19.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.514+0000 7f602ba00640 1 --2- 172.21.15.8:0/3033138033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60240c2370 0x7f60240c6e40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:19.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.514+0000 7f602ba00640 1 -- 172.21.15.8:0/3033138033 >> 172.21.15.8:0/3033138033 conn(0x7f60240aacf0 msgr2=0x7f60240ab100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:19.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.514+0000 7f602ba00640 1 -- 172.21.15.8:0/3033138033 shutdown_connections 2024-03-23T23:59:19.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.514+0000 7f602ba00640 1 -- 172.21.15.8:0/3033138033 wait complete. 2024-03-23T23:59:19.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.514+0000 7f602ba00640 1 Processor -- start 2024-03-23T23:59:19.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.514+0000 7f602ba00640 1 -- start start 2024-03-23T23:59:19.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.514+0000 7f602ba00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60240c2370 0x7f60241523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:19.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.514+0000 7f602ba00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60240c2750 0x7f60241ef8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:19.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.514+0000 7f602ba00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f602415e100 0x7f60241efe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:19.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.514+0000 7f602ba00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60240ab810 con 0x7f602415e100 2024-03-23T23:59:19.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.514+0000 7f602ba00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6024071250 con 0x7f60240c2750 2024-03-23T23:59:19.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.514+0000 7f602ba00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60240c8be0 con 0x7f60240c2370 2024-03-23T23:59:19.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.518+0000 7f6029a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f602415e100 0x7f60241efe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:19.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.518+0000 7f6029000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60240c2370 0x7f60241523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:19.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.518+0000 7f6029000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60240c2370 0x7f60241523c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:33256/0 (socket says 172.21.15.8:33256) 2024-03-23T23:59:19.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.518+0000 7f6029000640 1 -- 172.21.15.8:0/2380485238 learned_addr learned my addr 172.21.15.8:0/2380485238 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:59:19.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.518+0000 7f6023e00640 1 --2- 172.21.15.8:0/2380485238 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60240c2750 0x7f60241ef8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:19.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.518+0000 7f6029000640 1 -- 172.21.15.8:0/2380485238 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60240c2750 msgr2=0x7f60241ef8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:19.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.518+0000 7f6029000640 1 --2- 172.21.15.8:0/2380485238 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60240c2750 0x7f60241ef8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:19.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.518+0000 7f6029000640 1 -- 172.21.15.8:0/2380485238 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f602415e100 msgr2=0x7f60241efe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:19.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.518+0000 7f6029000640 1 --2- 172.21.15.8:0/2380485238 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f602415e100 0x7f60241efe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:19.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.518+0000 7f6029000640 1 -- 172.21.15.8:0/2380485238 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60241566a0 con 0x7f60240c2370 2024-03-23T23:59:19.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.518+0000 7f6029000640 1 --2- 172.21.15.8:0/2380485238 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60240c2370 0x7f60241523c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f601801a100 tx=0x7f601801ad10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:19.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.518+0000 7f6020c00640 1 -- 172.21.15.8:0/2380485238 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60180ba020 con 0x7f60240c2370 2024-03-23T23:59:19.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.518+0000 7f6020c00640 1 -- 172.21.15.8:0/2380485238 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60180b6420 con 0x7f60240c2370 2024-03-23T23:59:19.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.518+0000 7f602ba00640 1 -- 172.21.15.8:0/2380485238 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60241f1ed0 con 0x7f60240c2370 2024-03-23T23:59:19.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.518+0000 7f6020c00640 1 -- 172.21.15.8:0/2380485238 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60180b0040 con 0x7f60240c2370 2024-03-23T23:59:19.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.518+0000 7f602ba00640 1 -- 172.21.15.8:0/2380485238 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f602415a260 con 0x7f60240c2370 2024-03-23T23:59:19.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.518+0000 7f602ba00640 1 -- 172.21.15.8:0/2380485238 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602404f410 con 0x7f60240c2370 2024-03-23T23:59:19.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.518+0000 7f6020c00640 1 -- 172.21.15.8:0/2380485238 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f60180bd020 con 0x7f60240c2370 2024-03-23T23:59:19.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.522+0000 7f6020c00640 1 --2- 172.21.15.8:0/2380485238 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6004067660 0x7f6004069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:19.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.522+0000 7f6020c00640 1 -- 172.21.15.8:0/2380485238 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f601811fcd0 con 0x7f60240c2370 2024-03-23T23:59:19.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.522+0000 7f6023e00640 1 --2- 172.21.15.8:0/2380485238 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6004067660 0x7f6004069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:19.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.522+0000 7f6023e00640 1 --2- 172.21.15.8:0/2380485238 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6004067660 0x7f6004069b20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6024150b40 tx=0x7f6010009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:19.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.526+0000 7f6020c00640 1 -- 172.21.15.8:0/2380485238 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f6018125020 con 0x7f60240c2370 2024-03-23T23:59:19.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.770+0000 7f602ba00640 1 -- 172.21.15.8:0/2380485238 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f60240c3460 con 0x7f60240c2370 2024-03-23T23:59:19.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.778+0000 7f6020c00640 1 -- 172.21.15.8:0/2380485238 <== mon.2 v2:172.21.15.196:3301/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f60180ab600 con 0x7f60240c2370 2024-03-23T23:59:19.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.778+0000 7f6020c00640 1 -- 172.21.15.8:0/2380485238 <== mon.2 v2:172.21.15.196:3301/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f60180c4030 con 0x7f60240c2370 2024-03-23T23:59:19.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.778+0000 7f602ba00640 1 -- 172.21.15.8:0/2380485238 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6004067660 msgr2=0x7f6004069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:19.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.778+0000 7f602ba00640 1 --2- 172.21.15.8:0/2380485238 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6004067660 0x7f6004069b20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6024150b40 tx=0x7f6010009040 comp rx=0 tx=0).stop 2024-03-23T23:59:19.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.778+0000 7f602ba00640 1 -- 172.21.15.8:0/2380485238 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60240c2370 msgr2=0x7f60241523c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:19.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.778+0000 7f602ba00640 1 --2- 172.21.15.8:0/2380485238 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60240c2370 0x7f60241523c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f601801a100 tx=0x7f601801ad10 comp rx=0 tx=0).stop 2024-03-23T23:59:19.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.778+0000 7f602ba00640 1 -- 172.21.15.8:0/2380485238 shutdown_connections 2024-03-23T23:59:19.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.778+0000 7f602ba00640 1 --2- 172.21.15.8:0/2380485238 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f602415e100 0x7f60241efe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:19.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.778+0000 7f602ba00640 1 --2- 172.21.15.8:0/2380485238 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60240c2750 0x7f60241ef8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:19.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.778+0000 7f602ba00640 1 --2- 172.21.15.8:0/2380485238 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f6004067660 0x7f6004069b20 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:19.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.778+0000 7f602ba00640 1 --2- 172.21.15.8:0/2380485238 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60240c2370 0x7f60241523c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:19.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.778+0000 7f602ba00640 1 -- 172.21.15.8:0/2380485238 >> 172.21.15.8:0/2380485238 conn(0x7f60240aacf0 msgr2=0x7f60240ab0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:19.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.778+0000 7f602ba00640 1 -- 172.21.15.8:0/2380485238 shutdown_connections 2024-03-23T23:59:19.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.778+0000 7f602ba00640 1 -- 172.21.15.8:0/2380485238 wait complete. 2024-03-23T23:59:19.801 INFO:tasks.cephfs.filesystem:Destroying file system a and related pools 2024-03-23T23:59:19.801 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T23:59:19.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.942+0000 7f45d0200640 1 Processor -- start 2024-03-23T23:59:19.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.942+0000 7f45d0200640 1 -- start start 2024-03-23T23:59:19.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.942+0000 7f45d0200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f45c8156ee0 0x7f45c8073230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:19.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.942+0000 7f45d0200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45c8149bd0 0x7f45c814a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:19.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.942+0000 7f45d0200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f45c80ac270 0x7f45c80ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:19.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.942+0000 7f45d0200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c8073770 con 0x7f45c8156ee0 2024-03-23T23:59:19.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.942+0000 7f45d0200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c80aa390 con 0x7f45c80ac270 2024-03-23T23:59:19.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.942+0000 7f45d0200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c806e720 con 0x7f45c8149bd0 2024-03-23T23:59:19.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.942+0000 7f45cd800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f45c8156ee0 0x7f45c8073230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:19.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.942+0000 7f45cd800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f45c8156ee0 0x7f45c8073230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43692/0 (socket says 172.21.15.8:43692) 2024-03-23T23:59:19.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.942+0000 7f45cd800640 1 -- 172.21.15.8:0/985032122 learned_addr learned my addr 172.21.15.8:0/985032122 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:59:19.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.942+0000 7f45ce200640 1 --2- 172.21.15.8:0/985032122 >> v2:172.21.15.196:3300/0 conn(0x7f45c80ac270 0x7f45c80ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:19.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.942+0000 7f45cce00640 1 --2- 172.21.15.8:0/985032122 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45c8149bd0 0x7f45c814a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:19.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.942+0000 7f45cd800640 1 -- 172.21.15.8:0/985032122 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45c8149bd0 msgr2=0x7f45c814a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:59:19.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.942+0000 7f45cd800640 1 --2- 172.21.15.8:0/985032122 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45c8149bd0 0x7f45c814a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:19.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.942+0000 7f45cd800640 1 -- 172.21.15.8:0/985032122 >> v2:172.21.15.196:3300/0 conn(0x7f45c80ac270 msgr2=0x7f45c80ac6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:59:19.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.942+0000 7f45cd800640 1 --2- 172.21.15.8:0/985032122 >> v2:172.21.15.196:3300/0 conn(0x7f45c80ac270 0x7f45c80ac6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:19.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.942+0000 7f45cd800640 1 -- 172.21.15.8:0/985032122 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c806ea00 con 0x7f45c8156ee0 2024-03-23T23:59:19.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.946+0000 7f45cd800640 1 --2- 172.21.15.8:0/985032122 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45c8156ee0 0x7f45c8073230 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f45c806f680 tx=0x7f45bc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c19969a779a7b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:19.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.946+0000 7f45c7e00640 1 -- 172.21.15.8:0/985032122 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc0ab620 con 0x7f45c8156ee0 2024-03-23T23:59:19.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.946+0000 7f45c7e00640 1 -- 172.21.15.8:0/985032122 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f45bc0b0070 con 0x7f45c8156ee0 2024-03-23T23:59:19.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.946+0000 7f45c7e00640 1 -- 172.21.15.8:0/985032122 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc0aba00 con 0x7f45c8156ee0 2024-03-23T23:59:19.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.946+0000 7f45d0200640 1 -- 172.21.15.8:0/985032122 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45c8156ee0 msgr2=0x7f45c8073230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:19.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.946+0000 7f45d0200640 1 --2- 172.21.15.8:0/985032122 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45c8156ee0 0x7f45c8073230 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f45c806f680 tx=0x7f45bc01c460 comp rx=0 tx=0).stop 2024-03-23T23:59:19.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.946+0000 7f45d0200640 1 -- 172.21.15.8:0/985032122 shutdown_connections 2024-03-23T23:59:19.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.946+0000 7f45d0200640 1 --2- 172.21.15.8:0/985032122 >> v2:172.21.15.196:3300/0 conn(0x7f45c80ac270 0x7f45c80ac6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:19.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.946+0000 7f45d0200640 1 --2- 172.21.15.8:0/985032122 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45c8149bd0 0x7f45c814a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:19.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.946+0000 7f45d0200640 1 --2- 172.21.15.8:0/985032122 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45c8156ee0 0x7f45c8073230 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:19.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.946+0000 7f45d0200640 1 -- 172.21.15.8:0/985032122 >> 172.21.15.8:0/985032122 conn(0x7f45c806b170 msgr2=0x7f45c806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:19.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.946+0000 7f45d0200640 1 -- 172.21.15.8:0/985032122 shutdown_connections 2024-03-23T23:59:19.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.946+0000 7f45d0200640 1 -- 172.21.15.8:0/985032122 wait complete. 2024-03-23T23:59:19.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.950+0000 7f45d0200640 1 Processor -- start 2024-03-23T23:59:19.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.950+0000 7f45d0200640 1 -- start start 2024-03-23T23:59:19.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.950+0000 7f45d0200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45c80ac270 0x7f45c81eddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:19.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.950+0000 7f45d0200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45c8149bd0 0x7f45c8072240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:19.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.950+0000 7f45d0200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45c8156ee0 0x7f45c81f1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:19.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.950+0000 7f45d0200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c8157870 con 0x7f45c8156ee0 2024-03-23T23:59:19.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.950+0000 7f45d0200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c814a570 con 0x7f45c8149bd0 2024-03-23T23:59:19.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.950+0000 7f45d0200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c81579f0 con 0x7f45c80ac270 2024-03-23T23:59:19.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.950+0000 7f45ce200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45c8156ee0 0x7f45c81f1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:19.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.950+0000 7f45cd800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45c80ac270 0x7f45c81eddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:19.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.950+0000 7f45cd800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45c80ac270 0x7f45c81eddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:33260/0 (socket says 172.21.15.8:33260) 2024-03-23T23:59:19.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.950+0000 7f45cd800640 1 -- 172.21.15.8:0/2969186794 learned_addr learned my addr 172.21.15.8:0/2969186794 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:59:19.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.950+0000 7f45ce200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45c8156ee0 0x7f45c81f1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43696/0 (socket says 172.21.15.8:43696) 2024-03-23T23:59:19.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.950+0000 7f45cce00640 1 --2- 172.21.15.8:0/2969186794 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45c8149bd0 0x7f45c8072240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:19.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.950+0000 7f45cd800640 1 -- 172.21.15.8:0/2969186794 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45c8149bd0 msgr2=0x7f45c8072240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:19.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.950+0000 7f45cd800640 1 --2- 172.21.15.8:0/2969186794 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45c8149bd0 0x7f45c8072240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:19.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.950+0000 7f45cd800640 1 -- 172.21.15.8:0/2969186794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45c8156ee0 msgr2=0x7f45c81f1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:19.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.950+0000 7f45cd800640 1 --2- 172.21.15.8:0/2969186794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45c8156ee0 0x7f45c81f1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:19.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.950+0000 7f45cd800640 1 -- 172.21.15.8:0/2969186794 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c81f1330 con 0x7f45c80ac270 2024-03-23T23:59:19.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.950+0000 7f45ce200640 1 --2- 172.21.15.8:0/2969186794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45c8156ee0 0x7f45c81f1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:59:19.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.950+0000 7f45cd800640 1 --2- 172.21.15.8:0/2969186794 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45c80ac270 0x7f45c81eddc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f45bc01ab10 tx=0x7f45bc019200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:19.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.950+0000 7f45c5600640 1 -- 172.21.15.8:0/2969186794 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc0abd10 con 0x7f45c80ac270 2024-03-23T23:59:19.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.950+0000 7f45c5600640 1 -- 172.21.15.8:0/2969186794 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f45bc0be3f0 con 0x7f45c80ac270 2024-03-23T23:59:19.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.950+0000 7f45c5600640 1 -- 172.21.15.8:0/2969186794 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc0be800 con 0x7f45c80ac270 2024-03-23T23:59:19.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.950+0000 7f45d0200640 1 -- 172.21.15.8:0/2969186794 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c814e4e0 con 0x7f45c80ac270 2024-03-23T23:59:19.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.950+0000 7f45d0200640 1 -- 172.21.15.8:0/2969186794 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c814eaa0 con 0x7f45c80ac270 2024-03-23T23:59:19.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.954+0000 7f45d0200640 1 -- 172.21.15.8:0/2969186794 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c8068270 con 0x7f45c80ac270 2024-03-23T23:59:19.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.954+0000 7f45c5600640 1 -- 172.21.15.8:0/2969186794 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f45bc0b43f0 con 0x7f45c80ac270 2024-03-23T23:59:19.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.954+0000 7f45c5600640 1 --2- 172.21.15.8:0/2969186794 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f45a80676e0 0x7f45a8069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:19.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.954+0000 7f45c5600640 1 -- 172.21.15.8:0/2969186794 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f45bc11fe50 con 0x7f45c80ac270 2024-03-23T23:59:19.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.954+0000 7f45cce00640 1 --2- 172.21.15.8:0/2969186794 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f45a80676e0 0x7f45a8069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:19.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.954+0000 7f45cce00640 1 --2- 172.21.15.8:0/2969186794 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f45a80676e0 0x7f45a8069ba0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f45c8146320 tx=0x7f45b4009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:19.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:19.958+0000 7f45c5600640 1 -- 172.21.15.8:0/2969186794 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f45bc0c4060 con 0x7f45c80ac270 2024-03-23T23:59:20.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.154+0000 7f45d0200640 1 -- 172.21.15.8:0/2969186794 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45c806c4a0 con 0x7f45c80ac270 2024-03-23T23:59:20.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.154+0000 7f45c5600640 1 -- 172.21.15.8:0/2969186794 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6245 (secure 0 0 0) 0x7f45bc016110 con 0x7f45c80ac270 2024-03-23T23:59:20.157 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:59:20.157 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6836/3149325777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3149325777},{"type":"v1","addr":"172.21.15.196:6836","nonce":3149325777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6833/1542162403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1542162403},{"type":"v1","addr":"172.21.15.8:6833","nonce":1542162403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T23:42:40.070799+0000","modified":"2024-03-23T23:42:44.080269+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6837/3402347550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":3402347550},{"type":"v1","addr":"172.21.15.196:6837","nonce":3402347550}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T23:42:50.113972+0000","modified":"2024-03-23T23:42:54.152778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.8:6835/3531853933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3531853933},{"type":"v1","addr":"172.21.15.8:6835","nonce":3531853933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4269,"qdb_cluster":[4269]},"id":2}]} 2024-03-23T23:59:20.157 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 15 2024-03-23T23:59:20.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.158+0000 7f45d0200640 1 -- 172.21.15.8:0/2969186794 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f45a80676e0 msgr2=0x7f45a8069ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:20.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.158+0000 7f45d0200640 1 --2- 172.21.15.8:0/2969186794 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f45a80676e0 0x7f45a8069ba0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f45c8146320 tx=0x7f45b4009190 comp rx=0 tx=0).stop 2024-03-23T23:59:20.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.158+0000 7f45d0200640 1 -- 172.21.15.8:0/2969186794 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45c80ac270 msgr2=0x7f45c81eddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:20.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.158+0000 7f45d0200640 1 --2- 172.21.15.8:0/2969186794 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45c80ac270 0x7f45c81eddc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f45bc01ab10 tx=0x7f45bc019200 comp rx=0 tx=0).stop 2024-03-23T23:59:20.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.158+0000 7f45d0200640 1 -- 172.21.15.8:0/2969186794 shutdown_connections 2024-03-23T23:59:20.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.158+0000 7f45d0200640 1 --2- 172.21.15.8:0/2969186794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45c8156ee0 0x7f45c81f1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:20.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.158+0000 7f45d0200640 1 --2- 172.21.15.8:0/2969186794 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45c8149bd0 0x7f45c8072240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:20.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.158+0000 7f45d0200640 1 --2- 172.21.15.8:0/2969186794 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f45a80676e0 0x7f45a8069ba0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:20.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.158+0000 7f45d0200640 1 --2- 172.21.15.8:0/2969186794 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45c80ac270 0x7f45c81eddc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:20.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.158+0000 7f45d0200640 1 -- 172.21.15.8:0/2969186794 >> 172.21.15.8:0/2969186794 conn(0x7f45c806b170 msgr2=0x7f45c8148700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:20.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.158+0000 7f45d0200640 1 -- 172.21.15.8:0/2969186794 shutdown_connections 2024-03-23T23:59:20.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.158+0000 7f45d0200640 1 -- 172.21.15.8:0/2969186794 wait complete. 2024-03-23T23:59:20.179 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T23:59:20.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.318+0000 7f93e0200640 1 Processor -- start 2024-03-23T23:59:20.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.318+0000 7f93e0200640 1 -- start start 2024-03-23T23:59:20.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.318+0000 7f93e0200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93d806d6e0 0x7f93d8155a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:20.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.318+0000 7f93e0200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93d80c4340 con 0x7f93d80c8a50 2024-03-23T23:59:20.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.318+0000 7f93e0200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93d80c4060 con 0x7f93d80c4e40 2024-03-23T23:59:20.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.318+0000 7f93e0200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d80c4740 con 0x7f93d806d6e0 2024-03-23T23:59:20.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.318+0000 7f93dd800640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f93d80c8a50 0x7f93d80c2660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:58392/0 (socket says 172.21.15.8:58392) 2024-03-23T23:59:20.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.318+0000 7f93dd800640 1 -- 172.21.15.8:0/4255192281 learned_addr learned my addr 172.21.15.8:0/4255192281 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:59:20.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.318+0000 7f93dce00640 1 --2- 172.21.15.8:0/4255192281 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93d806d6e0 0x7f93d8155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:20.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.318+0000 7f93d7e00640 1 -- 172.21.15.8:0/4255192281 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2931018556 0 0) 0x7f93d80c4340 con 0x7f93d80c8a50 2024-03-23T23:59:20.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.318+0000 7f93d7e00640 1 -- 172.21.15.8:0/4255192281 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93c0003530 con 0x7f93d80c8a50 2024-03-23T23:59:20.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.318+0000 7f93d7e00640 1 -- 172.21.15.8:0/4255192281 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1077806680 0 0) 0x7f93d80c4060 con 0x7f93d80c4e40 2024-03-23T23:59:20.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.318+0000 7f93d7e00640 1 -- 172.21.15.8:0/4255192281 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93d80c4340 con 0x7f93d80c4e40 2024-03-23T23:59:20.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.318+0000 7f93dce00640 1 -- 172.21.15.8:0/4255192281 >> v1:172.21.15.196:6789/0 conn(0x7f93d80c4e40 legacy=0x7f93d8160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:20.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.318+0000 7f93dce00640 1 -- 172.21.15.8:0/4255192281 >> v1:172.21.15.8:6789/0 conn(0x7f93d80c8a50 legacy=0x7f93d80c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:20.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.318+0000 7f93dce00640 1 -- 172.21.15.8:0/4255192281 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d80c3570 con 0x7f93d806d6e0 2024-03-23T23:59:20.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.322+0000 7f93dce00640 1 --2- 172.21.15.8:0/4255192281 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93d806d6e0 0x7f93d8155a60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f93c40097f0 tx=0x7f93c401c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a4b7036343bb679 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:20.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.322+0000 7f93d7e00640 1 -- 172.21.15.8:0/4255192281 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c40b0070 con 0x7f93d806d6e0 2024-03-23T23:59:20.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.322+0000 7f93d7e00640 1 -- 172.21.15.8:0/4255192281 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f93c40ab600 con 0x7f93d806d6e0 2024-03-23T23:59:20.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.322+0000 7f93d7e00640 1 -- 172.21.15.8:0/4255192281 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c40ab9f0 con 0x7f93d806d6e0 2024-03-23T23:59:20.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.322+0000 7f93e0200640 1 -- 172.21.15.8:0/4255192281 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93d806d6e0 msgr2=0x7f93d8155a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:20.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.322+0000 7f93e0200640 1 --2- 172.21.15.8:0/4255192281 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93d806d6e0 0x7f93d8155a60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f93c40097f0 tx=0x7f93c401c420 comp rx=0 tx=0).stop 2024-03-23T23:59:20.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.322+0000 7f93e0200640 1 -- 172.21.15.8:0/4255192281 shutdown_connections 2024-03-23T23:59:20.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.322+0000 7f93e0200640 1 --2- 172.21.15.8:0/4255192281 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93d806d6e0 0x7f93d8155a60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:20.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.322+0000 7f93e0200640 1 -- 172.21.15.8:0/4255192281 >> 172.21.15.8:0/4255192281 conn(0x7f93d80aafe0 msgr2=0x7f93d80ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:20.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.322+0000 7f93e0200640 1 -- 172.21.15.8:0/4255192281 shutdown_connections 2024-03-23T23:59:20.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.322+0000 7f93e0200640 1 -- 172.21.15.8:0/4255192281 wait complete. 2024-03-23T23:59:20.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.326+0000 7f93e0200640 1 Processor -- start 2024-03-23T23:59:20.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.326+0000 7f93e0200640 1 -- start start 2024-03-23T23:59:20.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.326+0000 7f93e0200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93d80c4e40 0x7f93d8154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:20.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.326+0000 7f93e0200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93d80c8a50 0x7f93d81429c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:20.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.326+0000 7f93e0200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93d8146d00 0x7f93d8142f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:20.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.326+0000 7f93e0200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d80c8e30 con 0x7f93d80c4e40 2024-03-23T23:59:20.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.326+0000 7f93e0200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d806e1e0 con 0x7f93d8146d00 2024-03-23T23:59:20.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.326+0000 7f93e0200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d8147ae0 con 0x7f93d80c8a50 2024-03-23T23:59:20.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.326+0000 7f93dd800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93d80c4e40 0x7f93d8154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:20.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.326+0000 7f93dd800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93d80c4e40 0x7f93d8154ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43712/0 (socket says 172.21.15.8:43712) 2024-03-23T23:59:20.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.326+0000 7f93dd800640 1 -- 172.21.15.8:0/2475497898 learned_addr learned my addr 172.21.15.8:0/2475497898 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:59:20.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.326+0000 7f93dce00640 1 --2- 172.21.15.8:0/2475497898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93d80c8a50 0x7f93d81429c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:20.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.326+0000 7f93de200640 1 --2- 172.21.15.8:0/2475497898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93d8146d00 0x7f93d8142f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:20.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.326+0000 7f93dd800640 1 -- 172.21.15.8:0/2475497898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93d80c8a50 msgr2=0x7f93d81429c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:20.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.326+0000 7f93dd800640 1 --2- 172.21.15.8:0/2475497898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93d80c8a50 0x7f93d81429c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:20.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.326+0000 7f93dd800640 1 -- 172.21.15.8:0/2475497898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93d8146d00 msgr2=0x7f93d8142f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:20.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.326+0000 7f93dd800640 1 --2- 172.21.15.8:0/2475497898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93d8146d00 0x7f93d8142f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:20.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.326+0000 7f93dd800640 1 -- 172.21.15.8:0/2475497898 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d8147dc0 con 0x7f93d80c4e40 2024-03-23T23:59:20.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.326+0000 7f93dd800640 1 --2- 172.21.15.8:0/2475497898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93d80c4e40 0x7f93d8154ca0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f93cc00c420 tx=0x7f93cc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:20.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.326+0000 7f93d5600640 1 -- 172.21.15.8:0/2475497898 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc017070 con 0x7f93d80c4e40 2024-03-23T23:59:20.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.326+0000 7f93d5600640 1 -- 172.21.15.8:0/2475497898 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f93cc005cf0 con 0x7f93d80c4e40 2024-03-23T23:59:20.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.326+0000 7f93d5600640 1 -- 172.21.15.8:0/2475497898 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc0072f0 con 0x7f93d80c4e40 2024-03-23T23:59:20.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.326+0000 7f93e0200640 1 -- 172.21.15.8:0/2475497898 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d81421c0 con 0x7f93d80c4e40 2024-03-23T23:59:20.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.326+0000 7f93e0200640 1 -- 172.21.15.8:0/2475497898 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d81551e0 con 0x7f93d80c4e40 2024-03-23T23:59:20.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.330+0000 7f93e0200640 1 -- 172.21.15.8:0/2475497898 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d8068270 con 0x7f93d80c4e40 2024-03-23T23:59:20.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.330+0000 7f93d5600640 1 -- 172.21.15.8:0/2475497898 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f93cc01a070 con 0x7f93d80c4e40 2024-03-23T23:59:20.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.330+0000 7f93d5600640 1 --2- 172.21.15.8:0/2475497898 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f93b8067660 0x7f93b8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:20.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.330+0000 7f93d5600640 1 -- 172.21.15.8:0/2475497898 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f93cc085000 con 0x7f93d80c4e40 2024-03-23T23:59:20.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.330+0000 7f93dce00640 1 --2- 172.21.15.8:0/2475497898 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f93b8067660 0x7f93b8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:20.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.330+0000 7f93dce00640 1 --2- 172.21.15.8:0/2475497898 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f93b8067660 0x7f93b8069b20 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f93c40ad000 tx=0x7f93c40a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:20.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.334+0000 7f93d5600640 1 -- 172.21.15.8:0/2475497898 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f93cc055270 con 0x7f93d80c4e40 2024-03-23T23:59:20.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.738+0000 7f93e0200640 1 -- 172.21.15.8:0/2475497898 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93d80c8fb0 con 0x7f93d80c4e40 2024-03-23T23:59:20.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.742+0000 7f93d5600640 1 -- 172.21.15.8:0/2475497898 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6245 (secure 0 0 0) 0x7f93cc059310 con 0x7f93d80c4e40 2024-03-23T23:59:20.742 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:59:20.742 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6836/3149325777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3149325777},{"type":"v1","addr":"172.21.15.196:6836","nonce":3149325777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6833/1542162403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1542162403},{"type":"v1","addr":"172.21.15.8:6833","nonce":1542162403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T23:42:40.070799+0000","modified":"2024-03-23T23:42:44.080269+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6837/3402347550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":3402347550},{"type":"v1","addr":"172.21.15.196:6837","nonce":3402347550}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T23:42:50.113972+0000","modified":"2024-03-23T23:42:54.152778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.8:6835/3531853933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3531853933},{"type":"v1","addr":"172.21.15.8:6835","nonce":3531853933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4269,"qdb_cluster":[4269]},"id":2}]} 2024-03-23T23:59:20.742 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 15 2024-03-23T23:59:20.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.742+0000 7f93e0200640 1 -- 172.21.15.8:0/2475497898 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f93b8067660 msgr2=0x7f93b8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:20.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.742+0000 7f93e0200640 1 --2- 172.21.15.8:0/2475497898 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f93b8067660 0x7f93b8069b20 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f93c40ad000 tx=0x7f93c40a6000 comp rx=0 tx=0).stop 2024-03-23T23:59:20.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.742+0000 7f93e0200640 1 -- 172.21.15.8:0/2475497898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93d80c4e40 msgr2=0x7f93d8154ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:20.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.742+0000 7f93e0200640 1 --2- 172.21.15.8:0/2475497898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93d80c4e40 0x7f93d8154ca0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f93cc00c420 tx=0x7f93cc00c8e0 comp rx=0 tx=0).stop 2024-03-23T23:59:20.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.742+0000 7f93e0200640 1 -- 172.21.15.8:0/2475497898 shutdown_connections 2024-03-23T23:59:20.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.742+0000 7f93e0200640 1 --2- 172.21.15.8:0/2475497898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93d8146d00 0x7f93d8142f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:20.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.742+0000 7f93e0200640 1 --2- 172.21.15.8:0/2475497898 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f93b8067660 0x7f93b8069b20 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:20.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.742+0000 7f93e0200640 1 --2- 172.21.15.8:0/2475497898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93d80c8a50 0x7f93d81429c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:20.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.742+0000 7f93e0200640 1 --2- 172.21.15.8:0/2475497898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93d80c4e40 0x7f93d8154ca0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:20.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.742+0000 7f93e0200640 1 -- 172.21.15.8:0/2475497898 >> 172.21.15.8:0/2475497898 conn(0x7f93d80aafe0 msgr2=0x7f93d814e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:20.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.742+0000 7f93e0200640 1 -- 172.21.15.8:0/2475497898 shutdown_connections 2024-03-23T23:59:20.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.742+0000 7f93e0200640 1 -- 172.21.15.8:0/2475497898 wait complete. 2024-03-23T23:59:20.765 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:59:20.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.906+0000 7f5a27200640 1 Processor -- start 2024-03-23T23:59:20.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.906+0000 7f5a27200640 1 -- start start 2024-03-23T23:59:20.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.906+0000 7f5a27200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a200c8a50 0x7f5a200c2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:20.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.906+0000 7f5a27200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a200c4340 con 0x7f5a200c2ba0 2024-03-23T23:59:20.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.906+0000 7f5a27200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a200c4060 con 0x7f5a2006d6e0 2024-03-23T23:59:20.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.906+0000 7f5a27200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a200c4740 con 0x7f5a200c8a50 2024-03-23T23:59:20.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.906+0000 7f5a1fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a200c8a50 0x7f5a200c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:20.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.906+0000 7f5a25200640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f5a200c2ba0 0x7f5a20160300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:58406/0 (socket says 172.21.15.8:58406) 2024-03-23T23:59:20.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.906+0000 7f5a25200640 1 -- 172.21.15.8:0/1770471256 learned_addr learned my addr 172.21.15.8:0/1770471256 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:59:20.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.906+0000 7f5a17400640 1 --1- 172.21.15.8:0/1770471256 >> v1:172.21.15.196:6789/0 conn(0x7f5a2006d6e0 0x7f5a20155a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.8:50696/0 (socket says 172.21.15.8:50696) 2024-03-23T23:59:20.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.910+0000 7f5a1fe00640 1 -- 172.21.15.8:0/1770471256 >> v1:172.21.15.196:6789/0 conn(0x7f5a2006d6e0 legacy=0x7f5a20155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:20.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.910+0000 7f5a1fe00640 1 -- 172.21.15.8:0/1770471256 >> v1:172.21.15.8:6789/0 conn(0x7f5a200c2ba0 legacy=0x7f5a20160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:20.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.910+0000 7f5a1fe00640 1 -- 172.21.15.8:0/1770471256 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a200c3570 con 0x7f5a200c8a50 2024-03-23T23:59:20.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.910+0000 7f5a1f400640 1 -- 172.21.15.8:0/1770471256 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 161652919 0 0) 0x7f5a200c4060 con 0x7f5a2006d6e0 2024-03-23T23:59:20.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.910+0000 7f5a1fe00640 1 --2- 172.21.15.8:0/1770471256 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a200c8a50 0x7f5a200c2660 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5a100097f0 tx=0x7f5a1001c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53e28dbfae07547f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:20.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.910+0000 7f5a1f400640 1 -- 172.21.15.8:0/1770471256 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a100b0070 con 0x7f5a200c8a50 2024-03-23T23:59:20.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.910+0000 7f5a1f400640 1 -- 172.21.15.8:0/1770471256 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5a100ab600 con 0x7f5a200c8a50 2024-03-23T23:59:20.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.910+0000 7f5a1f400640 1 -- 172.21.15.8:0/1770471256 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a100ab9f0 con 0x7f5a200c8a50 2024-03-23T23:59:20.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.910+0000 7f5a27200640 1 -- 172.21.15.8:0/1770471256 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a200c8a50 msgr2=0x7f5a200c2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:20.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.910+0000 7f5a27200640 1 --2- 172.21.15.8:0/1770471256 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a200c8a50 0x7f5a200c2660 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5a100097f0 tx=0x7f5a1001c2e0 comp rx=0 tx=0).stop 2024-03-23T23:59:20.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.914+0000 7f5a27200640 1 -- 172.21.15.8:0/1770471256 shutdown_connections 2024-03-23T23:59:20.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.914+0000 7f5a27200640 1 --2- 172.21.15.8:0/1770471256 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a200c8a50 0x7f5a200c2660 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:20.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.914+0000 7f5a27200640 1 -- 172.21.15.8:0/1770471256 >> 172.21.15.8:0/1770471256 conn(0x7f5a200aafe0 msgr2=0x7f5a200ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:20.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.914+0000 7f5a27200640 1 -- 172.21.15.8:0/1770471256 shutdown_connections 2024-03-23T23:59:20.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.914+0000 7f5a27200640 1 -- 172.21.15.8:0/1770471256 wait complete. 2024-03-23T23:59:20.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.914+0000 7f5a27200640 1 Processor -- start 2024-03-23T23:59:20.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.914+0000 7f5a27200640 1 -- start start 2024-03-23T23:59:20.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.914+0000 7f5a27200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5a200c2ba0 0x7f5a20154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:20.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.914+0000 7f5a27200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a200c8a50 0x7f5a20155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:20.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.914+0000 7f5a27200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5a20157e20 0x7f5a20155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:20.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.914+0000 7f5a27200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a200c8e30 con 0x7f5a20157e20 2024-03-23T23:59:20.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.914+0000 7f5a27200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a200c4920 con 0x7f5a200c2ba0 2024-03-23T23:59:20.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.914+0000 7f5a27200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a20158d40 con 0x7f5a200c8a50 2024-03-23T23:59:20.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.914+0000 7f5a25200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5a20157e20 0x7f5a20155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:20.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.914+0000 7f5a17400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a200c8a50 0x7f5a20155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:20.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.914+0000 7f5a1fe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5a200c2ba0 0x7f5a20154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:20.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.914+0000 7f5a17400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a200c8a50 0x7f5a20155660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.8:33312/0 (socket says 172.21.15.8:33312) 2024-03-23T23:59:20.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.914+0000 7f5a17400640 1 -- 172.21.15.8:0/3302159628 learned_addr learned my addr 172.21.15.8:0/3302159628 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:59:20.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.914+0000 7f5a17400640 1 -- 172.21.15.8:0/3302159628 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5a200c2ba0 msgr2=0x7f5a20154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:20.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.914+0000 7f5a17400640 1 --2- 172.21.15.8:0/3302159628 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5a200c2ba0 0x7f5a20154110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:20.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.914+0000 7f5a17400640 1 -- 172.21.15.8:0/3302159628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5a20157e20 msgr2=0x7f5a20155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:20.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.914+0000 7f5a17400640 1 --2- 172.21.15.8:0/3302159628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5a20157e20 0x7f5a20155ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:20.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.914+0000 7f5a17400640 1 -- 172.21.15.8:0/3302159628 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a20158f90 con 0x7f5a200c8a50 2024-03-23T23:59:20.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.914+0000 7f5a17400640 1 --2- 172.21.15.8:0/3302159628 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a200c8a50 0x7f5a20155660 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5a0800c520 tx=0x7f5a0800c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:20.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.914+0000 7f5a1cc00640 1 -- 172.21.15.8:0/3302159628 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a08018070 con 0x7f5a200c8a50 2024-03-23T23:59:20.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.914+0000 7f5a1cc00640 1 -- 172.21.15.8:0/3302159628 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5a080074e0 con 0x7f5a200c8a50 2024-03-23T23:59:20.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.914+0000 7f5a1cc00640 1 -- 172.21.15.8:0/3302159628 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a08004a10 con 0x7f5a200c8a50 2024-03-23T23:59:20.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.914+0000 7f5a27200640 1 -- 172.21.15.8:0/3302159628 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a20159270 con 0x7f5a200c8a50 2024-03-23T23:59:20.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.918+0000 7f5a27200640 1 -- 172.21.15.8:0/3302159628 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a20154e60 con 0x7f5a200c8a50 2024-03-23T23:59:20.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.918+0000 7f5a27200640 1 -- 172.21.15.8:0/3302159628 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a20068270 con 0x7f5a200c8a50 2024-03-23T23:59:20.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.918+0000 7f5a1cc00640 1 -- 172.21.15.8:0/3302159628 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f5a0801b070 con 0x7f5a200c8a50 2024-03-23T23:59:20.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.918+0000 7f5a1cc00640 1 --2- 172.21.15.8:0/3302159628 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f59fc067660 0x7f59fc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:20.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.918+0000 7f5a1cc00640 1 -- 172.21.15.8:0/3302159628 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f5a08084f30 con 0x7f5a200c8a50 2024-03-23T23:59:20.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.918+0000 7f5a1fe00640 1 --2- 172.21.15.8:0/3302159628 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f59fc067660 0x7f59fc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:20.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.918+0000 7f5a1fe00640 1 --2- 172.21.15.8:0/3302159628 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f59fc067660 0x7f59fc069b20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5a100ad000 tx=0x7f5a10008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:20.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:20.922+0000 7f5a1cc00640 1 -- 172.21.15.8:0/3302159628 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f5a080551a0 con 0x7f5a200c8a50 2024-03-23T23:59:21.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.230+0000 7f5a27200640 1 -- 172.21.15.8:0/3302159628 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a200c8fb0 con 0x7f5a200c8a50 2024-03-23T23:59:21.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.234+0000 7f5a1cc00640 1 -- 172.21.15.8:0/3302159628 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20567 (secure 0 0 0) 0x7f5a08059240 con 0x7f5a200c8a50 2024-03-23T23:59:21.235 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:59:21.235 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":27,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","created":"2024-03-23T23:42:15.169430+0000","modified":"2024-03-23T23:43:21.884365+0000","last_up_change":"2024-03-23T23:42:26.509742+0000","last_in_change":"2024-03-23T23:42:17.662330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:42:26.327445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-23T23:42:38.218800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-23T23:42:39.054195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-23T23:42:48.327799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-23T23:42:49.113061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e967bf31-21d6-4d11-bc3d-0df8177a1b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6809","nonce":2187201732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6811","nonce":2187201732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6815","nonce":2187201732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6813","nonce":2187201732}]},"public_addr":"172.21.15.8:6809/2187201732","cluster_addr":"172.21.15.8:6811/2187201732","heartbeat_back_addr":"172.21.15.8:6815/2187201732","heartbeat_front_addr":"172.21.15.8:6813/2187201732","state":["exists","up"]},{"osd":1,"uuid":"c8e33701-7acd-4474-8402-d52461171fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6818","nonce":3205168010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6822","nonce":3205168010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6830","nonce":3205168010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6826","nonce":3205168010}]},"public_addr":"172.21.15.8:6818/3205168010","cluster_addr":"172.21.15.8:6822/3205168010","heartbeat_back_addr":"172.21.15.8:6830/3205168010","heartbeat_front_addr":"172.21.15.8:6826/3205168010","state":["exists","up"]},{"osd":2,"uuid":"ceebdbf7-4c2f-4757-b52d-fd8b20e77570","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6801","nonce":475463656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6803","nonce":475463656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6807","nonce":475463656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6805","nonce":475463656}]},"public_addr":"172.21.15.8:6801/475463656","cluster_addr":"172.21.15.8:6803/475463656","heartbeat_back_addr":"172.21.15.8:6807/475463656","heartbeat_front_addr":"172.21.15.8:6805/475463656","state":["exists","up"]},{"osd":3,"uuid":"89e258da-5767-429e-8441-edf877d2f3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6819","nonce":1514082871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6821","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6823","nonce":1514082871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6829","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6831","nonce":1514082871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6825","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6827","nonce":1514082871}]},"public_addr":"172.21.15.8:6819/1514082871","cluster_addr":"172.21.15.8:6823/1514082871","heartbeat_back_addr":"172.21.15.8:6831/1514082871","heartbeat_front_addr":"172.21.15.8:6827/1514082871","state":["exists","up"]},{"osd":4,"uuid":"2b7451ae-ea16-4f0a-ae50-04fde75e45ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6825","nonce":3516578147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6827","nonce":3516578147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6831","nonce":3516578147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6829","nonce":3516578147}]},"public_addr":"172.21.15.196:6825/3516578147","cluster_addr":"172.21.15.196:6827/3516578147","heartbeat_back_addr":"172.21.15.196:6831/3516578147","heartbeat_front_addr":"172.21.15.196:6829/3516578147","state":["exists","up"]},{"osd":5,"uuid":"e68a8914-e591-466a-bc9e-f2d7c67aac13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6802","nonce":830595758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6806","nonce":830595758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6814","nonce":830595758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6810","nonce":830595758}]},"public_addr":"172.21.15.196:6802/830595758","cluster_addr":"172.21.15.196:6806/830595758","heartbeat_back_addr":"172.21.15.196:6814/830595758","heartbeat_front_addr":"172.21.15.196:6810/830595758","state":["exists","up"]},{"osd":6,"uuid":"e47723c5-50a0-4cd8-92d9-01972072b422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6801","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6803","nonce":472639906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6805","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6807","nonce":472639906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6815","nonce":472639906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6811","nonce":472639906}]},"public_addr":"172.21.15.196:6803/472639906","cluster_addr":"172.21.15.196:6807/472639906","heartbeat_back_addr":"172.21.15.196:6815/472639906","heartbeat_front_addr":"172.21.15.196:6811/472639906","state":["exists","up"]},{"osd":7,"uuid":"e1e9113d-8005-47b3-9a75-9e701199f1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6817","nonce":4151820349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6819","nonce":4151820349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6823","nonce":4151820349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6821","nonce":4151820349}]},"public_addr":"172.21.15.196:6817/4151820349","cluster_addr":"172.21.15.196:6819/4151820349","heartbeat_back_addr":"172.21.15.196:6823/4151820349","heartbeat_front_addr":"172.21.15.196:6821/4151820349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.221790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.265974+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.190319+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.376359+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.329657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.402958+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.300703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.133121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:59:21.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.234+0000 7f5a27200640 1 -- 172.21.15.8:0/3302159628 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f59fc067660 msgr2=0x7f59fc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:21.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.234+0000 7f5a27200640 1 --2- 172.21.15.8:0/3302159628 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f59fc067660 0x7f59fc069b20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5a100ad000 tx=0x7f5a10008040 comp rx=0 tx=0).stop 2024-03-23T23:59:21.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.234+0000 7f5a27200640 1 -- 172.21.15.8:0/3302159628 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a200c8a50 msgr2=0x7f5a20155660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:21.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.234+0000 7f5a27200640 1 --2- 172.21.15.8:0/3302159628 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a200c8a50 0x7f5a20155660 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5a0800c520 tx=0x7f5a0800c9e0 comp rx=0 tx=0).stop 2024-03-23T23:59:21.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.234+0000 7f5a27200640 1 -- 172.21.15.8:0/3302159628 shutdown_connections 2024-03-23T23:59:21.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.234+0000 7f5a27200640 1 --2- 172.21.15.8:0/3302159628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5a20157e20 0x7f5a20155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:21.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.234+0000 7f5a27200640 1 --2- 172.21.15.8:0/3302159628 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f59fc067660 0x7f59fc069b20 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:21.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.234+0000 7f5a27200640 1 --2- 172.21.15.8:0/3302159628 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a200c8a50 0x7f5a20155660 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:21.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.234+0000 7f5a27200640 1 --2- 172.21.15.8:0/3302159628 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5a200c2ba0 0x7f5a20154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:21.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.234+0000 7f5a27200640 1 -- 172.21.15.8:0/3302159628 >> 172.21.15.8:0/3302159628 conn(0x7f5a200aafe0 msgr2=0x7f5a200c3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:21.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.234+0000 7f5a27200640 1 -- 172.21.15.8:0/3302159628 shutdown_connections 2024-03-23T23:59:21.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.234+0000 7f5a27200640 1 -- 172.21.15.8:0/3302159628 wait complete. 2024-03-23T23:59:21.257 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail a 2024-03-23T23:59:21.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.398+0000 7fc056c00640 1 Processor -- start 2024-03-23T23:59:21.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.398+0000 7fc056c00640 1 -- start start 2024-03-23T23:59:21.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.398+0000 7fc056c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc0500c8a50 0x7fc0500c2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:21.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.398+0000 7fc056c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc05006d6e0 0x7fc050155a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:21.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.398+0000 7fc056c00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0500c4340 con 0x7fc0500c2ba0 2024-03-23T23:59:21.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.398+0000 7fc056c00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0500c4740 con 0x7fc0500c8a50 2024-03-23T23:59:21.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.398+0000 7fc056c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0500c4060 con 0x7fc05006d6e0 2024-03-23T23:59:21.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.398+0000 7fc04fe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc0500c8a50 0x7fc0500c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:21.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.398+0000 7fc054c00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fc0500c2ba0 0x7fc050158fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:58408/0 (socket says 172.21.15.8:58408) 2024-03-23T23:59:21.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.398+0000 7fc054c00640 1 -- 172.21.15.8:0/3225811491 learned_addr learned my addr 172.21.15.8:0/3225811491 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:59:21.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.398+0000 7fc04fe00640 1 --2- 172.21.15.8:0/3225811491 >> v2:172.21.15.8:3300/0 conn(0x7fc0500c8a50 0x7fc0500c2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43730/0 (socket says 172.21.15.8:43730) 2024-03-23T23:59:21.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.398+0000 7fc047400640 1 --2- 172.21.15.8:0/3225811491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc05006d6e0 0x7fc050155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:21.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.398+0000 7fc04fe00640 1 -- 172.21.15.8:0/3225811491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc05006d6e0 msgr2=0x7fc050155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:59:21.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.398+0000 7fc04fe00640 1 --2- 172.21.15.8:0/3225811491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc05006d6e0 0x7fc050155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:21.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.398+0000 7fc04fe00640 1 -- 172.21.15.8:0/3225811491 >> v1:172.21.15.8:6789/0 conn(0x7fc0500c2ba0 legacy=0x7fc050158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:21.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.402+0000 7fc04fe00640 1 -- 172.21.15.8:0/3225811491 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0500c3570 con 0x7fc0500c8a50 2024-03-23T23:59:21.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.398+0000 7fc04f400640 1 -- 172.21.15.8:0/3225811491 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 606382667 0 0) 0x7fc0500c4340 con 0x7fc0500c2ba0 2024-03-23T23:59:21.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.402+0000 7fc04fe00640 1 --2- 172.21.15.8:0/3225811491 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0500c8a50 0x7fc0500c2660 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc0400097c0 tx=0x7fc04001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9d8d2d16c919501 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:21.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.402+0000 7fc04f400640 1 -- 172.21.15.8:0/3225811491 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0400b1070 con 0x7fc0500c8a50 2024-03-23T23:59:21.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.402+0000 7fc04f400640 1 -- 172.21.15.8:0/3225811491 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc0400a8050 con 0x7fc0500c8a50 2024-03-23T23:59:21.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.402+0000 7fc04f400640 1 -- 172.21.15.8:0/3225811491 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0400ac880 con 0x7fc0500c8a50 2024-03-23T23:59:21.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.402+0000 7fc056c00640 1 -- 172.21.15.8:0/3225811491 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0500c8a50 msgr2=0x7fc0500c2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:21.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.402+0000 7fc056c00640 1 --2- 172.21.15.8:0/3225811491 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0500c8a50 0x7fc0500c2660 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc0400097c0 tx=0x7fc04001c3e0 comp rx=0 tx=0).stop 2024-03-23T23:59:21.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.402+0000 7fc056c00640 1 -- 172.21.15.8:0/3225811491 shutdown_connections 2024-03-23T23:59:21.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.402+0000 7fc056c00640 1 --2- 172.21.15.8:0/3225811491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc05006d6e0 0x7fc050155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:21.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.402+0000 7fc056c00640 1 --2- 172.21.15.8:0/3225811491 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0500c8a50 0x7fc0500c2660 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:21.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.402+0000 7fc056c00640 1 -- 172.21.15.8:0/3225811491 >> 172.21.15.8:0/3225811491 conn(0x7fc0500aafe0 msgr2=0x7fc0500ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:21.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.402+0000 7fc056c00640 1 -- 172.21.15.8:0/3225811491 shutdown_connections 2024-03-23T23:59:21.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.402+0000 7fc056c00640 1 -- 172.21.15.8:0/3225811491 wait complete. 2024-03-23T23:59:21.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.406+0000 7fc056c00640 1 Processor -- start 2024-03-23T23:59:21.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.406+0000 7fc056c00640 1 -- start start 2024-03-23T23:59:21.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.406+0000 7fc056c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc0500c2ba0 0x7fc05014d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:21.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.406+0000 7fc056c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0500c8a50 0x7fc0500ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:21.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.406+0000 7fc056c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc05006ed00 0x7fc05006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:21.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.406+0000 7fc056c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05006e360 con 0x7fc0500c8a50 2024-03-23T23:59:21.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.406+0000 7fc056c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05006e1e0 con 0x7fc05006ed00 2024-03-23T23:59:21.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.406+0000 7fc056c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0500c3c30 con 0x7fc0500c2ba0 2024-03-23T23:59:21.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.406+0000 7fc047400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0500c8a50 0x7fc0500ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:21.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.406+0000 7fc047400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0500c8a50 0x7fc0500ac3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43744/0 (socket says 172.21.15.8:43744) 2024-03-23T23:59:21.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.406+0000 7fc047400640 1 -- 172.21.15.8:0/1569122414 learned_addr learned my addr 172.21.15.8:0/1569122414 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:59:21.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.406+0000 7fc04fe00640 1 --2- 172.21.15.8:0/1569122414 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc0500c2ba0 0x7fc05014d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:21.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.406+0000 7fc054c00640 1 --2- 172.21.15.8:0/1569122414 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc05006ed00 0x7fc05006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:21.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.406+0000 7fc047400640 1 -- 172.21.15.8:0/1569122414 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc0500c2ba0 msgr2=0x7fc05014d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:21.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.406+0000 7fc047400640 1 --2- 172.21.15.8:0/1569122414 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc0500c2ba0 0x7fc05014d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:21.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.406+0000 7fc047400640 1 -- 172.21.15.8:0/1569122414 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc05006ed00 msgr2=0x7fc05006f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:21.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.406+0000 7fc047400640 1 --2- 172.21.15.8:0/1569122414 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc05006ed00 0x7fc05006f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:21.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.406+0000 7fc047400640 1 -- 172.21.15.8:0/1569122414 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0500aee60 con 0x7fc0500c8a50 2024-03-23T23:59:21.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.406+0000 7fc054c00640 1 --2- 172.21.15.8:0/1569122414 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc05006ed00 0x7fc05006f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:59:21.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.406+0000 7fc047400640 1 --2- 172.21.15.8:0/1569122414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0500c8a50 0x7fc0500ac3e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc038009db0 tx=0x7fc03800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:21.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.406+0000 7fc04cc00640 1 -- 172.21.15.8:0/1569122414 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc038018020 con 0x7fc0500c8a50 2024-03-23T23:59:21.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.406+0000 7fc04cc00640 1 -- 172.21.15.8:0/1569122414 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc038014480 con 0x7fc0500c8a50 2024-03-23T23:59:21.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.406+0000 7fc04cc00640 1 -- 172.21.15.8:0/1569122414 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc038014870 con 0x7fc0500c8a50 2024-03-23T23:59:21.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.406+0000 7fc056c00640 1 -- 172.21.15.8:0/1569122414 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0501eeec0 con 0x7fc0500c8a50 2024-03-23T23:59:21.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.406+0000 7fc056c00640 1 -- 172.21.15.8:0/1569122414 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0501ef1a0 con 0x7fc0500c8a50 2024-03-23T23:59:21.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.410+0000 7fc056c00640 1 -- 172.21.15.8:0/1569122414 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc050068270 con 0x7fc0500c8a50 2024-03-23T23:59:21.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.410+0000 7fc04cc00640 1 -- 172.21.15.8:0/1569122414 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc03801b020 con 0x7fc0500c8a50 2024-03-23T23:59:21.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.410+0000 7fc04cc00640 1 --2- 172.21.15.8:0/1569122414 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc02c067660 0x7fc02c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:21.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.410+0000 7fc04cc00640 1 -- 172.21.15.8:0/1569122414 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fc038086790 con 0x7fc0500c8a50 2024-03-23T23:59:21.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.410+0000 7fc04fe00640 1 --2- 172.21.15.8:0/1569122414 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc02c067660 0x7fc02c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:21.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.414+0000 7fc04fe00640 1 --2- 172.21.15.8:0/1569122414 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc02c067660 0x7fc02c069b20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc0400ae000 tx=0x7fc0400a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:21.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.414+0000 7fc04cc00640 1 -- 172.21.15.8:0/1569122414 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fc038022070 con 0x7fc0500c8a50 2024-03-23T23:59:21.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.658+0000 7fc056c00640 1 -- 172.21.15.8:0/1569122414 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "a"} v 0) v1 -- 0x7fc0500c32b0 con 0x7fc0500c8a50 2024-03-23T23:59:21.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.662+0000 7fc04cc00640 1 -- 172.21.15.8:0/1569122414 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "a"}]=0 a marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) v1 ==== 151+0+0 (secure 0 0 0) 0x7fc038010040 con 0x7fc0500c8a50 2024-03-23T23:59:21.661 INFO:teuthology.orchestra.run.smithi008.stderr:a marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-23T23:59:21.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.662+0000 7fc056c00640 1 -- 172.21.15.8:0/1569122414 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc02c067660 msgr2=0x7fc02c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:21.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.662+0000 7fc056c00640 1 --2- 172.21.15.8:0/1569122414 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc02c067660 0x7fc02c069b20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc0400ae000 tx=0x7fc0400a7000 comp rx=0 tx=0).stop 2024-03-23T23:59:21.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.662+0000 7fc056c00640 1 -- 172.21.15.8:0/1569122414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0500c8a50 msgr2=0x7fc0500ac3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:21.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.662+0000 7fc056c00640 1 --2- 172.21.15.8:0/1569122414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0500c8a50 0x7fc0500ac3e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc038009db0 tx=0x7fc03800c490 comp rx=0 tx=0).stop 2024-03-23T23:59:21.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.662+0000 7fc056c00640 1 -- 172.21.15.8:0/1569122414 shutdown_connections 2024-03-23T23:59:21.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.662+0000 7fc056c00640 1 --2- 172.21.15.8:0/1569122414 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc05006ed00 0x7fc05006f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:21.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.662+0000 7fc056c00640 1 --2- 172.21.15.8:0/1569122414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0500c8a50 0x7fc0500ac3e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:21.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.662+0000 7fc056c00640 1 --2- 172.21.15.8:0/1569122414 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc02c067660 0x7fc02c069b20 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:21.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.662+0000 7fc056c00640 1 --2- 172.21.15.8:0/1569122414 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc0500c2ba0 0x7fc05014d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:21.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.662+0000 7fc056c00640 1 -- 172.21.15.8:0/1569122414 >> 172.21.15.8:0/1569122414 conn(0x7fc0500aafe0 msgr2=0x7fc0500a97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:21.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.662+0000 7fc056c00640 1 -- 172.21.15.8:0/1569122414 shutdown_connections 2024-03-23T23:59:21.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.662+0000 7fc056c00640 1 -- 172.21.15.8:0/1569122414 wait complete. 2024-03-23T23:59:21.685 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm a --yes-i-really-mean-it 2024-03-23T23:59:21.769 INFO:tasks.ceph.mds.d.smithi196.stdout:starting mds.d at 2024-03-23T23:59:21.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.830+0000 7eff2fe00640 1 Processor -- start 2024-03-23T23:59:21.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.830+0000 7eff2fe00640 1 -- start start 2024-03-23T23:59:21.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.830+0000 7eff2fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff28152ff0 0x7eff280714f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:21.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.830+0000 7eff2fe00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7eff28159860 0x7eff2806ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:21.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.830+0000 7eff2fe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7eff2806f190 0x7eff280c2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:21.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.830+0000 7eff2fe00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff28159dd0 con 0x7eff2806f190 2024-03-23T23:59:21.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.830+0000 7eff2fe00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff280701f0 con 0x7eff28159860 2024-03-23T23:59:21.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.830+0000 7eff2fe00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff280704d0 con 0x7eff28152ff0 2024-03-23T23:59:21.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.830+0000 7eff2de00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7eff2806f190 0x7eff280c2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:21.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.830+0000 7eff2de00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7eff2806f190 0x7eff280c2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43752/0 (socket says 172.21.15.8:43752) 2024-03-23T23:59:21.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.830+0000 7eff2de00640 1 -- 172.21.15.8:0/2867660365 learned_addr learned my addr 172.21.15.8:0/2867660365 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:59:21.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.830+0000 7eff2ca00640 1 --2- 172.21.15.8:0/2867660365 >> v2:172.21.15.196:3300/0 conn(0x7eff28159860 0x7eff2806ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:21.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.830+0000 7eff2d400640 1 --2- 172.21.15.8:0/2867660365 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff28152ff0 0x7eff280714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:21.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.830+0000 7eff2de00640 1 -- 172.21.15.8:0/2867660365 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff28152ff0 msgr2=0x7eff280714f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:59:21.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.830+0000 7eff2de00640 1 --2- 172.21.15.8:0/2867660365 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff28152ff0 0x7eff280714f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:21.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.830+0000 7eff2de00640 1 -- 172.21.15.8:0/2867660365 >> v2:172.21.15.196:3300/0 conn(0x7eff28159860 msgr2=0x7eff2806ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:59:21.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.830+0000 7eff2de00640 1 --2- 172.21.15.8:0/2867660365 >> v2:172.21.15.196:3300/0 conn(0x7eff28159860 0x7eff2806ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:21.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.830+0000 7eff2de00640 1 -- 172.21.15.8:0/2867660365 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff280707b0 con 0x7eff2806f190 2024-03-23T23:59:21.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.838+0000 7eff2de00640 1 --2- 172.21.15.8:0/2867660365 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff2806f190 0x7eff280c2390 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7eff2806bb00 tx=0x7eff2001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=978e14d483bd29ed server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:21.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.838+0000 7eff27e00640 1 -- 172.21.15.8:0/2867660365 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff200a64e0 con 0x7eff2806f190 2024-03-23T23:59:21.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.838+0000 7eff27e00640 1 -- 172.21.15.8:0/2867660365 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7eff200a6680 con 0x7eff2806f190 2024-03-23T23:59:21.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.838+0000 7eff27e00640 1 -- 172.21.15.8:0/2867660365 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff200a6a70 con 0x7eff2806f190 2024-03-23T23:59:21.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.838+0000 7eff2fe00640 1 -- 172.21.15.8:0/2867660365 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff2806f190 msgr2=0x7eff280c2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:21.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.838+0000 7eff2fe00640 1 --2- 172.21.15.8:0/2867660365 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff2806f190 0x7eff280c2390 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7eff2806bb00 tx=0x7eff2001c960 comp rx=0 tx=0).stop 2024-03-23T23:59:21.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.838+0000 7eff2fe00640 1 -- 172.21.15.8:0/2867660365 shutdown_connections 2024-03-23T23:59:21.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.838+0000 7eff2fe00640 1 --2- 172.21.15.8:0/2867660365 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff2806f190 0x7eff280c2390 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:21.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.838+0000 7eff2fe00640 1 --2- 172.21.15.8:0/2867660365 >> v2:172.21.15.196:3300/0 conn(0x7eff28159860 0x7eff2806ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:21.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.838+0000 7eff2fe00640 1 --2- 172.21.15.8:0/2867660365 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff28152ff0 0x7eff280714f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:21.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.838+0000 7eff2fe00640 1 -- 172.21.15.8:0/2867660365 >> 172.21.15.8:0/2867660365 conn(0x7eff280aad10 msgr2=0x7eff280ab120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:21.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.838+0000 7eff2fe00640 1 -- 172.21.15.8:0/2867660365 shutdown_connections 2024-03-23T23:59:21.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.838+0000 7eff2fe00640 1 -- 172.21.15.8:0/2867660365 wait complete. 2024-03-23T23:59:21.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.838+0000 7eff2fe00640 1 Processor -- start 2024-03-23T23:59:21.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.838+0000 7eff2fe00640 1 -- start start 2024-03-23T23:59:21.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.838+0000 7eff2fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff2806f190 0x7eff2806dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:21.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.838+0000 7eff2fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff28152ff0 0x7eff281509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:21.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.838+0000 7eff2fe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff28159860 0x7eff280ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:21.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.838+0000 7eff2fe00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff28156090 con 0x7eff2806f190 2024-03-23T23:59:21.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.838+0000 7eff2fe00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff280c7630 con 0x7eff28159860 2024-03-23T23:59:21.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.838+0000 7eff2fe00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff28156210 con 0x7eff28152ff0 2024-03-23T23:59:21.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.838+0000 7eff2d400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff2806f190 0x7eff2806dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:21.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.838+0000 7eff2d400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff2806f190 0x7eff2806dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43764/0 (socket says 172.21.15.8:43764) 2024-03-23T23:59:21.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.838+0000 7eff2d400640 1 -- 172.21.15.8:0/3715346529 learned_addr learned my addr 172.21.15.8:0/3715346529 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:59:21.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.842+0000 7eff2de00640 1 --2- 172.21.15.8:0/3715346529 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff28159860 0x7eff280ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:21.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.842+0000 7eff2ca00640 1 --2- 172.21.15.8:0/3715346529 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff28152ff0 0x7eff281509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:21.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.842+0000 7eff2d400640 1 -- 172.21.15.8:0/3715346529 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff28152ff0 msgr2=0x7eff281509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:21.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.842+0000 7eff2d400640 1 --2- 172.21.15.8:0/3715346529 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff28152ff0 0x7eff281509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:21.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.842+0000 7eff2d400640 1 -- 172.21.15.8:0/3715346529 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff28159860 msgr2=0x7eff280ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:21.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.842+0000 7eff2d400640 1 --2- 172.21.15.8:0/3715346529 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff28159860 0x7eff280ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:21.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.842+0000 7eff2d400640 1 -- 172.21.15.8:0/3715346529 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2806c110 con 0x7eff2806f190 2024-03-23T23:59:21.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.842+0000 7eff2de00640 1 --2- 172.21.15.8:0/3715346529 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff28159860 0x7eff280ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:59:21.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.842+0000 7eff2d400640 1 --2- 172.21.15.8:0/3715346529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff2806f190 0x7eff2806dd80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00e8b0 tx=0x7eff1c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:21.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.842+0000 7eff25600640 1 -- 172.21.15.8:0/3715346529 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c017070 con 0x7eff2806f190 2024-03-23T23:59:21.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.842+0000 7eff25600640 1 -- 172.21.15.8:0/3715346529 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7eff1c00c8e0 con 0x7eff2806f190 2024-03-23T23:59:21.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.842+0000 7eff25600640 1 -- 172.21.15.8:0/3715346529 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c00ccd0 con 0x7eff2806f190 2024-03-23T23:59:21.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.842+0000 7eff2fe00640 1 -- 172.21.15.8:0/3715346529 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff280aa350 con 0x7eff2806f190 2024-03-23T23:59:21.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.842+0000 7eff2fe00640 1 -- 172.21.15.8:0/3715346529 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff2814eed0 con 0x7eff2806f190 2024-03-23T23:59:21.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.842+0000 7eff2fe00640 1 -- 172.21.15.8:0/3715346529 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff2804f410 con 0x7eff2806f190 2024-03-23T23:59:21.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.842+0000 7eff25600640 1 -- 172.21.15.8:0/3715346529 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7eff1c01a070 con 0x7eff2806f190 2024-03-23T23:59:21.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.842+0000 7eff25600640 1 --2- 172.21.15.8:0/3715346529 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7eff08067660 0x7eff08069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:21.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.842+0000 7eff25600640 1 -- 172.21.15.8:0/3715346529 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6752+0+0 (secure 0 0 0) 0x7eff1c085ca0 con 0x7eff2806f190 2024-03-23T23:59:21.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.846+0000 7eff2ca00640 1 --2- 172.21.15.8:0/3715346529 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7eff08067660 0x7eff08069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:21.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.846+0000 7eff2ca00640 1 --2- 172.21.15.8:0/3715346529 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7eff08067660 0x7eff08069b20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7eff281512b0 tx=0x7eff14008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:21.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:21.854+0000 7eff25600640 1 -- 172.21.15.8:0/3715346529 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7eff1c056490 con 0x7eff2806f190 2024-03-23T23:59:22.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.050+0000 7eff2fe00640 1 -- 172.21.15.8:0/3715346529 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "a", "yes_i_really_mean_it": true} v 0) v1 -- 0x7eff280c8d40 con 0x7eff2806f190 2024-03-23T23:59:22.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.670+0000 7eff25600640 1 -- 172.21.15.8:0/3715346529 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "a", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 99+0+0 (secure 0 0 0) 0x7eff1c055d90 con 0x7eff2806f190 2024-03-23T23:59:22.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.670+0000 7eff2fe00640 1 -- 172.21.15.8:0/3715346529 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7eff08067660 msgr2=0x7eff08069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:22.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.670+0000 7eff2fe00640 1 --2- 172.21.15.8:0/3715346529 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7eff08067660 0x7eff08069b20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7eff281512b0 tx=0x7eff14008040 comp rx=0 tx=0).stop 2024-03-23T23:59:22.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.670+0000 7eff2fe00640 1 -- 172.21.15.8:0/3715346529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff2806f190 msgr2=0x7eff2806dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:22.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.670+0000 7eff2fe00640 1 --2- 172.21.15.8:0/3715346529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff2806f190 0x7eff2806dd80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00e8b0 tx=0x7eff1c00ed70 comp rx=0 tx=0).stop 2024-03-23T23:59:22.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.670+0000 7eff2fe00640 1 -- 172.21.15.8:0/3715346529 shutdown_connections 2024-03-23T23:59:22.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.670+0000 7eff2fe00640 1 --2- 172.21.15.8:0/3715346529 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff28159860 0x7eff280ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:22.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.670+0000 7eff2fe00640 1 --2- 172.21.15.8:0/3715346529 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7eff08067660 0x7eff08069b20 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:22.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.670+0000 7eff2fe00640 1 --2- 172.21.15.8:0/3715346529 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff28152ff0 0x7eff281509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:22.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.670+0000 7eff2fe00640 1 --2- 172.21.15.8:0/3715346529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff2806f190 0x7eff2806dd80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:22.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.670+0000 7eff2fe00640 1 -- 172.21.15.8:0/3715346529 >> 172.21.15.8:0/3715346529 conn(0x7eff280aad10 msgr2=0x7eff2815f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:22.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.670+0000 7eff2fe00640 1 -- 172.21.15.8:0/3715346529 shutdown_connections 2024-03-23T23:59:22.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.674+0000 7eff2fe00640 1 -- 172.21.15.8:0/3715346529 wait complete. 2024-03-23T23:59:22.693 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm a_metadata a_metadata --yes-i-really-really-mean-it 2024-03-23T23:59:22.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.838+0000 7fe0c8600640 1 Processor -- start 2024-03-23T23:59:22.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.838+0000 7fe0c8600640 1 -- start start 2024-03-23T23:59:22.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.842+0000 7fe0c8600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe0c0150da0 0x7fe0c006d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:22.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.842+0000 7fe0c8600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe0c006de30 0x7fe0c0156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:22.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.842+0000 7fe0c8600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe0c006e290 0x7fe0c01570e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:22.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.842+0000 7fe0c8600640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c0154480 con 0x7fe0c006de30 2024-03-23T23:59:22.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.842+0000 7fe0c8600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c00aa180 con 0x7fe0c006e290 2024-03-23T23:59:22.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.842+0000 7fe0c8600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c00aa460 con 0x7fe0c0150da0 2024-03-23T23:59:22.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.842+0000 7fe0c5200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe0c006de30 0x7fe0c0156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:22.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.842+0000 7fe0c5200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe0c006de30 0x7fe0c0156ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35696/0 (socket says 172.21.15.8:35696) 2024-03-23T23:59:22.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.842+0000 7fe0c5200640 1 -- 172.21.15.8:0/3534035773 learned_addr learned my addr 172.21.15.8:0/3534035773 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:59:22.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.842+0000 7fe0c5c00640 1 --2- 172.21.15.8:0/3534035773 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe0c0150da0 0x7fe0c006d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:22.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.842+0000 7fe0c6600640 1 --2- 172.21.15.8:0/3534035773 >> v2:172.21.15.196:3300/0 conn(0x7fe0c006e290 0x7fe0c01570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:22.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.842+0000 7fe0c5200640 1 -- 172.21.15.8:0/3534035773 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe0c0150da0 msgr2=0x7fe0c006d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:59:22.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.842+0000 7fe0c5200640 1 --2- 172.21.15.8:0/3534035773 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe0c0150da0 0x7fe0c006d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:22.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.842+0000 7fe0c5200640 1 -- 172.21.15.8:0/3534035773 >> v2:172.21.15.196:3300/0 conn(0x7fe0c006e290 msgr2=0x7fe0c01570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:59:22.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.842+0000 7fe0c5200640 1 --2- 172.21.15.8:0/3534035773 >> v2:172.21.15.196:3300/0 conn(0x7fe0c006e290 0x7fe0c01570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:22.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.842+0000 7fe0c5200640 1 -- 172.21.15.8:0/3534035773 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c00aa740 con 0x7fe0c006de30 2024-03-23T23:59:22.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.842+0000 7fe0c5200640 1 --2- 172.21.15.8:0/3534035773 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0c006de30 0x7fe0c0156ba0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0073510 tx=0x7fe0ac01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65733484472e6a76 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:22.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.846+0000 7fe0bfe00640 1 -- 172.21.15.8:0/3534035773 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac0b0070 con 0x7fe0c006de30 2024-03-23T23:59:22.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.846+0000 7fe0bfe00640 1 -- 172.21.15.8:0/3534035773 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe0ac0ab600 con 0x7fe0c006de30 2024-03-23T23:59:22.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.846+0000 7fe0bfe00640 1 -- 172.21.15.8:0/3534035773 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac0ab9f0 con 0x7fe0c006de30 2024-03-23T23:59:22.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.846+0000 7fe0c8600640 1 -- 172.21.15.8:0/3534035773 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0c006de30 msgr2=0x7fe0c0156ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:22.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.846+0000 7fe0c8600640 1 --2- 172.21.15.8:0/3534035773 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0c006de30 0x7fe0c0156ba0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0073510 tx=0x7fe0ac01c460 comp rx=0 tx=0).stop 2024-03-23T23:59:22.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.846+0000 7fe0c8600640 1 -- 172.21.15.8:0/3534035773 shutdown_connections 2024-03-23T23:59:22.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.846+0000 7fe0c8600640 1 --2- 172.21.15.8:0/3534035773 >> v2:172.21.15.196:3300/0 conn(0x7fe0c006e290 0x7fe0c01570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:22.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.846+0000 7fe0c8600640 1 --2- 172.21.15.8:0/3534035773 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0c006de30 0x7fe0c0156ba0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:22.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.846+0000 7fe0c8600640 1 --2- 172.21.15.8:0/3534035773 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe0c0150da0 0x7fe0c006d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:22.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.846+0000 7fe0c8600640 1 -- 172.21.15.8:0/3534035773 >> 172.21.15.8:0/3534035773 conn(0x7fe0c00c7060 msgr2=0x7fe0c00c7470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:22.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.846+0000 7fe0c8600640 1 -- 172.21.15.8:0/3534035773 shutdown_connections 2024-03-23T23:59:22.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.846+0000 7fe0c8600640 1 -- 172.21.15.8:0/3534035773 wait complete. 2024-03-23T23:59:22.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.846+0000 7fe0c8600640 1 Processor -- start 2024-03-23T23:59:22.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.846+0000 7fe0c8600640 1 -- start start 2024-03-23T23:59:22.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.846+0000 7fe0c8600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe0c006de30 0x7fe0c014c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:22.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.846+0000 7fe0c8600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0c006e290 0x7fe0c01428e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:22.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.846+0000 7fe0c8600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe0c0150da0 0x7fe0c0142e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:22.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.846+0000 7fe0c8600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c01541b0 con 0x7fe0c006e290 2024-03-23T23:59:22.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.846+0000 7fe0c8600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c0154030 con 0x7fe0c0150da0 2024-03-23T23:59:22.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.846+0000 7fe0c8600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c00ac5f0 con 0x7fe0c006de30 2024-03-23T23:59:22.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.846+0000 7fe0c5200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0c006e290 0x7fe0c01428e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:22.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.846+0000 7fe0c5200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0c006e290 0x7fe0c01428e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35698/0 (socket says 172.21.15.8:35698) 2024-03-23T23:59:22.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.846+0000 7fe0c5200640 1 -- 172.21.15.8:0/1047791550 learned_addr learned my addr 172.21.15.8:0/1047791550 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:59:22.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.846+0000 7fe0c6600640 1 --2- 172.21.15.8:0/1047791550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe0c0150da0 0x7fe0c0142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:22.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.846+0000 7fe0c5200640 1 -- 172.21.15.8:0/1047791550 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe0c006de30 msgr2=0x7fe0c014c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:22.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.846+0000 7fe0c5c00640 1 --2- 172.21.15.8:0/1047791550 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe0c006de30 0x7fe0c014c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:22.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.850+0000 7fe0c5200640 1 --2- 172.21.15.8:0/1047791550 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe0c006de30 0x7fe0c014c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:22.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.850+0000 7fe0c5200640 1 -- 172.21.15.8:0/1047791550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe0c0150da0 msgr2=0x7fe0c0142e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:22.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.850+0000 7fe0c5200640 1 --2- 172.21.15.8:0/1047791550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe0c0150da0 0x7fe0c0142e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:22.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.850+0000 7fe0c5200640 1 -- 172.21.15.8:0/1047791550 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c0072cc0 con 0x7fe0c006e290 2024-03-23T23:59:22.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.850+0000 7fe0c6600640 1 --2- 172.21.15.8:0/1047791550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe0c0150da0 0x7fe0c0142e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:59:22.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.850+0000 7fe0c5c00640 1 --2- 172.21.15.8:0/1047791550 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe0c006de30 0x7fe0c014c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:59:22.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.850+0000 7fe0c5200640 1 --2- 172.21.15.8:0/1047791550 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0c006e290 0x7fe0c01428e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac01ab10 tx=0x7fe0ac019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:22.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.850+0000 7fe0bd600640 1 -- 172.21.15.8:0/1047791550 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac0ba070 con 0x7fe0c006e290 2024-03-23T23:59:22.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.850+0000 7fe0bd600640 1 -- 172.21.15.8:0/1047791550 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe0ac0b4620 con 0x7fe0c006e290 2024-03-23T23:59:22.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.850+0000 7fe0bd600640 1 -- 172.21.15.8:0/1047791550 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac0b0040 con 0x7fe0c006e290 2024-03-23T23:59:22.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.850+0000 7fe0c8600640 1 -- 172.21.15.8:0/1047791550 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c0072fa0 con 0x7fe0c006e290 2024-03-23T23:59:22.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.850+0000 7fe0c8600640 1 -- 172.21.15.8:0/1047791550 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c00715b0 con 0x7fe0c006e290 2024-03-23T23:59:22.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.850+0000 7fe0c8600640 1 -- 172.21.15.8:0/1047791550 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c004f480 con 0x7fe0c006e290 2024-03-23T23:59:22.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.850+0000 7fe0bd600640 1 -- 172.21.15.8:0/1047791550 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fe0ac0bd070 con 0x7fe0c006e290 2024-03-23T23:59:22.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.854+0000 7fe0bd600640 1 --2- 172.21.15.8:0/1047791550 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe0a0067660 0x7fe0a0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:22.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.854+0000 7fe0bd600640 1 -- 172.21.15.8:0/1047791550 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6752+0+0 (secure 0 0 0) 0x7fe0ac11efa0 con 0x7fe0c006e290 2024-03-23T23:59:22.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.854+0000 7fe0c5c00640 1 --2- 172.21.15.8:0/1047791550 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe0a0067660 0x7fe0a0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:22.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.854+0000 7fe0c5c00640 1 --2- 172.21.15.8:0/1047791550 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe0a0067660 0x7fe0a0069b20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe0b40099c0 tx=0x7fe0b4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:22.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:22.858+0000 7fe0bd600640 1 -- 172.21.15.8:0/1047791550 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fe0ac016110 con 0x7fe0c006e290 2024-03-23T23:59:23.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.018+0000 7fe0c8600640 1 -- 172.21.15.8:0/1047791550 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "a_metadata", "pool2": "a_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe0c014f670 con 0x7fe0c006e290 2024-03-23T23:59:23.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.670+0000 7fe0bd600640 1 -- 172.21.15.8:0/1047791550 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "a_metadata", "pool2": "a_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'a_metadata' removed v29) v1 ==== 166+0+0 (secure 0 0 0) 0x7fe0ac0ef700 con 0x7fe0c006e290 2024-03-23T23:59:23.672 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'a_metadata' removed 2024-03-23T23:59:23.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.674+0000 7fe0c8600640 1 -- 172.21.15.8:0/1047791550 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe0a0067660 msgr2=0x7fe0a0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:23.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.674+0000 7fe0c8600640 1 --2- 172.21.15.8:0/1047791550 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe0a0067660 0x7fe0a0069b20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe0b40099c0 tx=0x7fe0b4008040 comp rx=0 tx=0).stop 2024-03-23T23:59:23.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.674+0000 7fe0c8600640 1 -- 172.21.15.8:0/1047791550 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0c006e290 msgr2=0x7fe0c01428e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:23.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.674+0000 7fe0c8600640 1 --2- 172.21.15.8:0/1047791550 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0c006e290 0x7fe0c01428e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac01ab10 tx=0x7fe0ac019200 comp rx=0 tx=0).stop 2024-03-23T23:59:23.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.674+0000 7fe0c8600640 1 -- 172.21.15.8:0/1047791550 shutdown_connections 2024-03-23T23:59:23.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.674+0000 7fe0c8600640 1 --2- 172.21.15.8:0/1047791550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe0c0150da0 0x7fe0c0142e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:23.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.674+0000 7fe0c8600640 1 --2- 172.21.15.8:0/1047791550 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0c006e290 0x7fe0c01428e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:23.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.674+0000 7fe0c8600640 1 --2- 172.21.15.8:0/1047791550 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fe0a0067660 0x7fe0a0069b20 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:23.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.674+0000 7fe0c8600640 1 --2- 172.21.15.8:0/1047791550 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe0c006de30 0x7fe0c014c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:23.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.674+0000 7fe0c8600640 1 -- 172.21.15.8:0/1047791550 >> 172.21.15.8:0/1047791550 conn(0x7fe0c00c7060 msgr2=0x7fe0c014ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:23.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.674+0000 7fe0c8600640 1 -- 172.21.15.8:0/1047791550 shutdown_connections 2024-03-23T23:59:23.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.674+0000 7fe0c8600640 1 -- 172.21.15.8:0/1047791550 wait complete. 2024-03-23T23:59:23.698 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm a_data a_data --yes-i-really-really-mean-it 2024-03-23T23:59:23.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.846+0000 7ffb3e000640 1 Processor -- start 2024-03-23T23:59:23.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.846+0000 7ffb3e000640 1 -- start start 2024-03-23T23:59:23.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.846+0000 7ffb3e000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ffb3806ff30 0x7ffb381506a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:23.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.846+0000 7ffb3e000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb38072fd0 0x7ffb38150be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:23.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.846+0000 7ffb3e000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb381569b0 con 0x7ffb380c2890 2024-03-23T23:59:23.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.846+0000 7ffb3e000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb380c25f0 con 0x7ffb3806ff30 2024-03-23T23:59:23.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.846+0000 7ffb3e000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb38156c90 con 0x7ffb38072fd0 2024-03-23T23:59:23.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.846+0000 7ffb3d600640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ffb380c2890 0x7ffb381533c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:32932/0 (socket says 172.21.15.8:32932) 2024-03-23T23:59:23.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.846+0000 7ffb3d600640 1 -- 172.21.15.8:0/3402099371 learned_addr learned my addr 172.21.15.8:0/3402099371 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:59:23.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.846+0000 7ffb3cc00640 1 --2- 172.21.15.8:0/3402099371 >> v2:172.21.15.196:3300/0 conn(0x7ffb3806ff30 0x7ffb381506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:23.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.846+0000 7ffb37e00640 1 --2- 172.21.15.8:0/3402099371 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb38072fd0 0x7ffb38150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:23.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.846+0000 7ffb37400640 1 -- 172.21.15.8:0/3402099371 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4247823058 0 0) 0x7ffb381569b0 con 0x7ffb380c2890 2024-03-23T23:59:23.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.846+0000 7ffb37400640 1 -- 172.21.15.8:0/3402099371 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb20003530 con 0x7ffb380c2890 2024-03-23T23:59:23.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.846+0000 7ffb37e00640 1 -- 172.21.15.8:0/3402099371 >> v2:172.21.15.196:3300/0 conn(0x7ffb3806ff30 msgr2=0x7ffb381506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:59:23.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.846+0000 7ffb37e00640 1 --2- 172.21.15.8:0/3402099371 >> v2:172.21.15.196:3300/0 conn(0x7ffb3806ff30 0x7ffb381506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:23.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.846+0000 7ffb37e00640 1 -- 172.21.15.8:0/3402099371 >> v1:172.21.15.8:6789/0 conn(0x7ffb380c2890 legacy=0x7ffb381533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:23.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.846+0000 7ffb37e00640 1 -- 172.21.15.8:0/3402099371 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb38156f70 con 0x7ffb38072fd0 2024-03-23T23:59:23.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.846+0000 7ffb3cc00640 1 --2- 172.21.15.8:0/3402099371 >> v2:172.21.15.196:3300/0 conn(0x7ffb3806ff30 0x7ffb381506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:59:23.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.850+0000 7ffb37e00640 1 --2- 172.21.15.8:0/3402099371 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb38072fd0 0x7ffb38150be0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffb240097c0 tx=0x7ffb2401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5c14400efacf2ea server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:23.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.850+0000 7ffb37400640 1 -- 172.21.15.8:0/3402099371 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb240b0070 con 0x7ffb38072fd0 2024-03-23T23:59:23.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.850+0000 7ffb37400640 1 -- 172.21.15.8:0/3402099371 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ffb240ab600 con 0x7ffb38072fd0 2024-03-23T23:59:23.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.850+0000 7ffb37400640 1 -- 172.21.15.8:0/3402099371 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb240ab9f0 con 0x7ffb38072fd0 2024-03-23T23:59:23.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.850+0000 7ffb3e000640 1 -- 172.21.15.8:0/3402099371 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb38072fd0 msgr2=0x7ffb38150be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:23.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.850+0000 7ffb3e000640 1 --2- 172.21.15.8:0/3402099371 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb38072fd0 0x7ffb38150be0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffb240097c0 tx=0x7ffb2401c410 comp rx=0 tx=0).stop 2024-03-23T23:59:23.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.850+0000 7ffb3e000640 1 -- 172.21.15.8:0/3402099371 shutdown_connections 2024-03-23T23:59:23.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.850+0000 7ffb3e000640 1 --2- 172.21.15.8:0/3402099371 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb38072fd0 0x7ffb38150be0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:23.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.850+0000 7ffb3e000640 1 --2- 172.21.15.8:0/3402099371 >> v2:172.21.15.196:3300/0 conn(0x7ffb3806ff30 0x7ffb381506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:23.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.850+0000 7ffb3e000640 1 -- 172.21.15.8:0/3402099371 >> 172.21.15.8:0/3402099371 conn(0x7ffb380c4990 msgr2=0x7ffb380c4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:23.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.850+0000 7ffb3e000640 1 -- 172.21.15.8:0/3402099371 shutdown_connections 2024-03-23T23:59:23.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.850+0000 7ffb3e000640 1 -- 172.21.15.8:0/3402099371 wait complete. 2024-03-23T23:59:23.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.850+0000 7ffb3e000640 1 Processor -- start 2024-03-23T23:59:23.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.854+0000 7ffb3e000640 1 -- start start 2024-03-23T23:59:23.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.854+0000 7ffb3e000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb3806ff30 0x7ffb38142fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:23.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.854+0000 7ffb3e000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb380c2890 0x7ffb381437d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:23.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.854+0000 7ffb3e000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb38143d10 0x7ffb38141aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:23.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.854+0000 7ffb3e000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb380c5630 con 0x7ffb38143d10 2024-03-23T23:59:23.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.854+0000 7ffb3e000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb380c54b0 con 0x7ffb3806ff30 2024-03-23T23:59:23.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.854+0000 7ffb3e000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb38070310 con 0x7ffb380c2890 2024-03-23T23:59:23.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.854+0000 7ffb3d600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb38143d10 0x7ffb38141aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:23.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.854+0000 7ffb3cc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb3806ff30 0x7ffb38142fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:23.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.854+0000 7ffb3d600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb38143d10 0x7ffb38141aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35706/0 (socket says 172.21.15.8:35706) 2024-03-23T23:59:23.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.854+0000 7ffb37e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb380c2890 0x7ffb381437d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:23.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.854+0000 7ffb3d600640 1 -- 172.21.15.8:0/637182059 learned_addr learned my addr 172.21.15.8:0/637182059 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:59:23.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.854+0000 7ffb3d600640 1 -- 172.21.15.8:0/637182059 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb380c2890 msgr2=0x7ffb381437d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:23.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.854+0000 7ffb3d600640 1 --2- 172.21.15.8:0/637182059 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb380c2890 0x7ffb381437d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:23.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.854+0000 7ffb3d600640 1 -- 172.21.15.8:0/637182059 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb3806ff30 msgr2=0x7ffb38142fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:23.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.854+0000 7ffb3d600640 1 --2- 172.21.15.8:0/637182059 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb3806ff30 0x7ffb38142fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:23.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.854+0000 7ffb3d600640 1 -- 172.21.15.8:0/637182059 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3813ffd0 con 0x7ffb38143d10 2024-03-23T23:59:23.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.854+0000 7ffb37e00640 1 --2- 172.21.15.8:0/637182059 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb380c2890 0x7ffb381437d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:59:23.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.854+0000 7ffb3cc00640 1 --2- 172.21.15.8:0/637182059 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb3806ff30 0x7ffb38142fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:59:23.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.854+0000 7ffb3d600640 1 --2- 172.21.15.8:0/637182059 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb38143d10 0x7ffb38141aa0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ffb3000c9f0 tx=0x7ffb3000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:23.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.854+0000 7ffb34c00640 1 -- 172.21.15.8:0/637182059 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb30017070 con 0x7ffb38143d10 2024-03-23T23:59:23.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.854+0000 7ffb34c00640 1 -- 172.21.15.8:0/637182059 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ffb3000ab70 con 0x7ffb38143d10 2024-03-23T23:59:23.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.854+0000 7ffb3e000640 1 -- 172.21.15.8:0/637182059 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb381402b0 con 0x7ffb38143d10 2024-03-23T23:59:23.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.854+0000 7ffb34c00640 1 -- 172.21.15.8:0/637182059 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb30012400 con 0x7ffb38143d10 2024-03-23T23:59:23.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.854+0000 7ffb3e000640 1 -- 172.21.15.8:0/637182059 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb38143510 con 0x7ffb38143d10 2024-03-23T23:59:23.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.854+0000 7ffb3e000640 1 -- 172.21.15.8:0/637182059 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb3804f410 con 0x7ffb38143d10 2024-03-23T23:59:23.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.858+0000 7ffb34c00640 1 -- 172.21.15.8:0/637182059 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ffb3001a070 con 0x7ffb38143d10 2024-03-23T23:59:23.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.858+0000 7ffb34c00640 1 --2- 172.21.15.8:0/637182059 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ffb18067660 0x7ffb18069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:23.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.858+0000 7ffb34c00640 1 -- 172.21.15.8:0/637182059 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ffb30085800 con 0x7ffb38143d10 2024-03-23T23:59:23.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.858+0000 7ffb3cc00640 1 --2- 172.21.15.8:0/637182059 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ffb18067660 0x7ffb18069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:23.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.858+0000 7ffb3cc00640 1 --2- 172.21.15.8:0/637182059 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ffb18067660 0x7ffb18069b20 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c009580 tx=0x7ffb2c009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:23.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:23.862+0000 7ffb34c00640 1 -- 172.21.15.8:0/637182059 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7ffb30055aa0 con 0x7ffb38143d10 2024-03-23T23:59:24.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.026+0000 7ffb3e000640 1 -- 172.21.15.8:0/637182059 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "a_data", "pool2": "a_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ffb380c5860 con 0x7ffb38143d10 2024-03-23T23:59:24.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.678+0000 7ffb34c00640 1 -- 172.21.15.8:0/637182059 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "a_data", "pool2": "a_data", "yes_i_really_really_mean_it": true}]=0 pool 'a_data' removed v30) v1 ==== 154+0+0 (secure 0 0 0) 0x7ffb30059b40 con 0x7ffb38143d10 2024-03-23T23:59:24.678 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'a_data' removed 2024-03-23T23:59:24.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.682+0000 7ffb3e000640 1 -- 172.21.15.8:0/637182059 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ffb18067660 msgr2=0x7ffb18069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:24.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.682+0000 7ffb3e000640 1 --2- 172.21.15.8:0/637182059 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ffb18067660 0x7ffb18069b20 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c009580 tx=0x7ffb2c009190 comp rx=0 tx=0).stop 2024-03-23T23:59:24.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.682+0000 7ffb3e000640 1 -- 172.21.15.8:0/637182059 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb38143d10 msgr2=0x7ffb38141aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:24.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.682+0000 7ffb3e000640 1 --2- 172.21.15.8:0/637182059 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb38143d10 0x7ffb38141aa0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ffb3000c9f0 tx=0x7ffb3000ceb0 comp rx=0 tx=0).stop 2024-03-23T23:59:24.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.686+0000 7ffb3e000640 1 -- 172.21.15.8:0/637182059 shutdown_connections 2024-03-23T23:59:24.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.686+0000 7ffb3e000640 1 --2- 172.21.15.8:0/637182059 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb38143d10 0x7ffb38141aa0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:24.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.686+0000 7ffb3e000640 1 --2- 172.21.15.8:0/637182059 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7ffb18067660 0x7ffb18069b20 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:24.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.686+0000 7ffb3e000640 1 --2- 172.21.15.8:0/637182059 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb380c2890 0x7ffb381437d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:24.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.686+0000 7ffb3e000640 1 --2- 172.21.15.8:0/637182059 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb3806ff30 0x7ffb38142fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:24.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.686+0000 7ffb3e000640 1 -- 172.21.15.8:0/637182059 >> 172.21.15.8:0/637182059 conn(0x7ffb380c4990 msgr2=0x7ffb38152f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:24.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.690+0000 7ffb3e000640 1 -- 172.21.15.8:0/637182059 shutdown_connections 2024-03-23T23:59:24.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.690+0000 7ffb3e000640 1 -- 172.21.15.8:0/637182059 wait complete. 2024-03-23T23:59:24.758 INFO:tasks.cephfs.filesystem:Destroying file system b and related pools 2024-03-23T23:59:24.758 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T23:59:24.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.926+0000 7f9e1e600640 1 Processor -- start 2024-03-23T23:59:24.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.926+0000 7f9e1e600640 1 -- start start 2024-03-23T23:59:24.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.926+0000 7f9e1e600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9e18149bd0 0x7f9e1814a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:24.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.926+0000 7f9e1e600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e180ac270 0x7f9e180ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:24.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.926+0000 7f9e1e600640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e1814a5a0 con 0x7f9e18156ee0 2024-03-23T23:59:24.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.926+0000 7f9e1e600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e180aa390 con 0x7f9e18149bd0 2024-03-23T23:59:24.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.926+0000 7f9e1e600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1806e720 con 0x7f9e180ac270 2024-03-23T23:59:24.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.926+0000 7f9e17400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f9e18156ee0 0x7f9e18073230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:32942/0 (socket says 172.21.15.8:32942) 2024-03-23T23:59:24.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.926+0000 7f9e17400640 1 -- 172.21.15.8:0/1162537142 learned_addr learned my addr 172.21.15.8:0/1162537142 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:59:24.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.926+0000 7f9e17e00640 1 --2- 172.21.15.8:0/1162537142 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e180ac270 0x7f9e180ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:24.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.926+0000 7f9e16a00640 1 --2- 172.21.15.8:0/1162537142 >> v2:172.21.15.196:3300/0 conn(0x7f9e18149bd0 0x7f9e1814a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:24.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.926+0000 7f9e16000640 1 -- 172.21.15.8:0/1162537142 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1524353713 0 0) 0x7f9e1814a5a0 con 0x7f9e18156ee0 2024-03-23T23:59:24.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.926+0000 7f9e16000640 1 -- 172.21.15.8:0/1162537142 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dfc003530 con 0x7f9e18156ee0 2024-03-23T23:59:24.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.926+0000 7f9e16a00640 1 -- 172.21.15.8:0/1162537142 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e180ac270 msgr2=0x7f9e180ac6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:59:24.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.926+0000 7f9e16a00640 1 --2- 172.21.15.8:0/1162537142 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e180ac270 0x7f9e180ac6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:24.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.926+0000 7f9e16a00640 1 -- 172.21.15.8:0/1162537142 >> v1:172.21.15.8:6789/0 conn(0x7f9e18156ee0 legacy=0x7f9e18073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:24.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.926+0000 7f9e16a00640 1 -- 172.21.15.8:0/1162537142 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e1806ea00 con 0x7f9e18149bd0 2024-03-23T23:59:24.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.930+0000 7f9e16a00640 1 --2- 172.21.15.8:0/1162537142 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e18149bd0 0x7f9e1814a060 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9e040097c0 tx=0x7f9e0401c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9c4eba4d7840661 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:24.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.930+0000 7f9e16000640 1 -- 172.21.15.8:0/1162537142 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e040b1070 con 0x7f9e18149bd0 2024-03-23T23:59:24.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.930+0000 7f9e16000640 1 -- 172.21.15.8:0/1162537142 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9e040a8050 con 0x7f9e18149bd0 2024-03-23T23:59:24.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.930+0000 7f9e16000640 1 -- 172.21.15.8:0/1162537142 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e040ac880 con 0x7f9e18149bd0 2024-03-23T23:59:24.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.930+0000 7f9e1e600640 1 -- 172.21.15.8:0/1162537142 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e18149bd0 msgr2=0x7f9e1814a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:24.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.930+0000 7f9e1e600640 1 --2- 172.21.15.8:0/1162537142 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e18149bd0 0x7f9e1814a060 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9e040097c0 tx=0x7f9e0401c3e0 comp rx=0 tx=0).stop 2024-03-23T23:59:24.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.930+0000 7f9e1e600640 1 -- 172.21.15.8:0/1162537142 shutdown_connections 2024-03-23T23:59:24.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.930+0000 7f9e1e600640 1 --2- 172.21.15.8:0/1162537142 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e180ac270 0x7f9e180ac6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:24.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.930+0000 7f9e1e600640 1 --2- 172.21.15.8:0/1162537142 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e18149bd0 0x7f9e1814a060 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:24.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.930+0000 7f9e1e600640 1 -- 172.21.15.8:0/1162537142 >> 172.21.15.8:0/1162537142 conn(0x7f9e1806b170 msgr2=0x7f9e1806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:24.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.930+0000 7f9e1e600640 1 -- 172.21.15.8:0/1162537142 shutdown_connections 2024-03-23T23:59:24.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.930+0000 7f9e1e600640 1 -- 172.21.15.8:0/1162537142 wait complete. 2024-03-23T23:59:24.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.934+0000 7f9e1e600640 1 Processor -- start 2024-03-23T23:59:24.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.934+0000 7f9e1e600640 1 -- start start 2024-03-23T23:59:24.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.934+0000 7f9e1e600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e180ac270 0x7f9e180c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:24.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.934+0000 7f9e1e600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e18149bd0 0x7f9e181edca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:24.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.934+0000 7f9e1e600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e18156ee0 0x7f9e181ee1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:24.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.934+0000 7f9e1e600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e181579f0 con 0x7f9e180ac270 2024-03-23T23:59:24.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.934+0000 7f9e1e600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e18157870 con 0x7f9e18149bd0 2024-03-23T23:59:24.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.934+0000 7f9e1e600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e181572c0 con 0x7f9e18156ee0 2024-03-23T23:59:24.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.934+0000 7f9e17400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e180ac270 0x7f9e180c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:24.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.934+0000 7f9e17400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e180ac270 0x7f9e180c50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35720/0 (socket says 172.21.15.8:35720) 2024-03-23T23:59:24.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.934+0000 7f9e17400640 1 -- 172.21.15.8:0/2587087105 learned_addr learned my addr 172.21.15.8:0/2587087105 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:59:24.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.934+0000 7f9e16a00640 1 --2- 172.21.15.8:0/2587087105 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e18149bd0 0x7f9e181edca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:24.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.934+0000 7f9e17e00640 1 --2- 172.21.15.8:0/2587087105 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e18156ee0 0x7f9e181ee1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:24.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.934+0000 7f9e17400640 1 -- 172.21.15.8:0/2587087105 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e18156ee0 msgr2=0x7f9e181ee1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:24.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.934+0000 7f9e17400640 1 --2- 172.21.15.8:0/2587087105 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e18156ee0 0x7f9e181ee1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:24.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.934+0000 7f9e17400640 1 -- 172.21.15.8:0/2587087105 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e18149bd0 msgr2=0x7f9e181edca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:24.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.934+0000 7f9e17400640 1 --2- 172.21.15.8:0/2587087105 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e18149bd0 0x7f9e181edca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:24.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.934+0000 7f9e17400640 1 -- 172.21.15.8:0/2587087105 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e181f1210 con 0x7f9e180ac270 2024-03-23T23:59:24.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.934+0000 7f9e16a00640 1 --2- 172.21.15.8:0/2587087105 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e18149bd0 0x7f9e181edca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:59:24.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.934+0000 7f9e17400640 1 --2- 172.21.15.8:0/2587087105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e180ac270 0x7f9e180c50c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9e0800c450 tx=0x7f9e0800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:24.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.934+0000 7f9e0f400640 1 -- 172.21.15.8:0/2587087105 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e08017070 con 0x7f9e180ac270 2024-03-23T23:59:24.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.934+0000 7f9e0f400640 1 -- 172.21.15.8:0/2587087105 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9e08005cf0 con 0x7f9e180ac270 2024-03-23T23:59:24.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.934+0000 7f9e1e600640 1 -- 172.21.15.8:0/2587087105 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e181f14f0 con 0x7f9e180ac270 2024-03-23T23:59:24.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.934+0000 7f9e0f400640 1 -- 172.21.15.8:0/2587087105 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e080072b0 con 0x7f9e180ac270 2024-03-23T23:59:24.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.934+0000 7f9e1e600640 1 -- 172.21.15.8:0/2587087105 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e181f1ab0 con 0x7f9e180ac270 2024-03-23T23:59:24.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.938+0000 7f9e1e600640 1 -- 172.21.15.8:0/2587087105 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e18068270 con 0x7f9e180ac270 2024-03-23T23:59:24.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.938+0000 7f9e0f400640 1 -- 172.21.15.8:0/2587087105 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f9e0801a070 con 0x7f9e180ac270 2024-03-23T23:59:24.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.942+0000 7f9e0f400640 1 --2- 172.21.15.8:0/2587087105 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9df8067660 0x7f9df8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:24.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.942+0000 7f9e0f400640 1 -- 172.21.15.8:0/2587087105 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5775+0+0 (secure 0 0 0) 0x7f9e08084c40 con 0x7f9e180ac270 2024-03-23T23:59:24.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.942+0000 7f9e16a00640 1 --2- 172.21.15.8:0/2587087105 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9df8067660 0x7f9df8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:24.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.942+0000 7f9e16a00640 1 --2- 172.21.15.8:0/2587087105 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9df8067660 0x7f9df8069b20 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9e040ae000 tx=0x7f9e040a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:24.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:24.942+0000 7f9e0f400640 1 -- 172.21.15.8:0/2587087105 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f9e08055190 con 0x7f9e180ac270 2024-03-23T23:59:25.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.182+0000 7f9e1e600640 1 -- 172.21.15.8:0/2587087105 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e181470f0 con 0x7f9e180ac270 2024-03-23T23:59:25.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.182+0000 7f9e0f400640 1 -- 172.21.15.8:0/2587087105 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4974 (secure 0 0 0) 0x7f9e08059230 con 0x7f9e180ac270 2024-03-23T23:59:25.185 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:59:25.185 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":17,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6836/3149325777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3149325777},{"type":"v1","addr":"172.21.15.196:6836","nonce":3149325777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6833/1542162403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1542162403},{"type":"v1","addr":"172.21.15.8:6833","nonce":1542162403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":204440,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/2153720528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":2153720528},{"type":"v1","addr":"172.21.15.196:6837","nonce":2153720528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T23:42:50.113972+0000","modified":"2024-03-23T23:42:54.152778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.8:6835/3531853933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3531853933},{"type":"v1","addr":"172.21.15.8:6835","nonce":3531853933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4269,"qdb_cluster":[4269]},"id":2}]} 2024-03-23T23:59:25.186 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 17 2024-03-23T23:59:25.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.186+0000 7f9e1e600640 1 -- 172.21.15.8:0/2587087105 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9df8067660 msgr2=0x7f9df8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:25.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.186+0000 7f9e1e600640 1 --2- 172.21.15.8:0/2587087105 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9df8067660 0x7f9df8069b20 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9e040ae000 tx=0x7f9e040a7000 comp rx=0 tx=0).stop 2024-03-23T23:59:25.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.186+0000 7f9e1e600640 1 -- 172.21.15.8:0/2587087105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e180ac270 msgr2=0x7f9e180c50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:25.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.186+0000 7f9e1e600640 1 --2- 172.21.15.8:0/2587087105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e180ac270 0x7f9e180c50c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9e0800c450 tx=0x7f9e0800c910 comp rx=0 tx=0).stop 2024-03-23T23:59:25.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.186+0000 7f9e1e600640 1 -- 172.21.15.8:0/2587087105 shutdown_connections 2024-03-23T23:59:25.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.186+0000 7f9e1e600640 1 --2- 172.21.15.8:0/2587087105 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f9df8067660 0x7f9df8069b20 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:25.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.186+0000 7f9e1e600640 1 --2- 172.21.15.8:0/2587087105 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e18156ee0 0x7f9e181ee1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:25.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.186+0000 7f9e1e600640 1 --2- 172.21.15.8:0/2587087105 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e18149bd0 0x7f9e181edca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:25.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.186+0000 7f9e1e600640 1 --2- 172.21.15.8:0/2587087105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e180ac270 0x7f9e180c50c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:25.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.186+0000 7f9e1e600640 1 -- 172.21.15.8:0/2587087105 >> 172.21.15.8:0/2587087105 conn(0x7f9e1806b170 msgr2=0x7f9e18145da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:25.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.186+0000 7f9e1e600640 1 -- 172.21.15.8:0/2587087105 shutdown_connections 2024-03-23T23:59:25.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.186+0000 7f9e1e600640 1 -- 172.21.15.8:0/2587087105 wait complete. 2024-03-23T23:59:25.206 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T23:59:25.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.346+0000 7fb83e800640 1 Processor -- start 2024-03-23T23:59:25.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.346+0000 7fb83e800640 1 -- start start 2024-03-23T23:59:25.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.346+0000 7fb83e800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb8380c1e30 0x7fb83806fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:25.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.346+0000 7fb83e800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8381598a0 con 0x7fb83806f850 2024-03-23T23:59:25.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.346+0000 7fb83e800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb838159b80 con 0x7fb83806f140 2024-03-23T23:59:25.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.346+0000 7fb83e800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb838072c00 con 0x7fb8380c1e30 2024-03-23T23:59:25.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.350+0000 7fb837400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fb83806f850 0x7fb838155a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:32954/0 (socket says 172.21.15.8:32954) 2024-03-23T23:59:25.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.350+0000 7fb837400640 1 -- 172.21.15.8:0/3186133900 learned_addr learned my addr 172.21.15.8:0/3186133900 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:59:25.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.350+0000 7fb836a00640 1 --2- 172.21.15.8:0/3186133900 >> v2:172.21.15.196:3300/0 conn(0x7fb8380c1e30 0x7fb83806fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:25.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.350+0000 7fb836000640 1 -- 172.21.15.8:0/3186133900 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 148736828 0 0) 0x7fb8381598a0 con 0x7fb83806f850 2024-03-23T23:59:25.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.350+0000 7fb836000640 1 -- 172.21.15.8:0/3186133900 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb81c003530 con 0x7fb83806f850 2024-03-23T23:59:25.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.350+0000 7fb836a00640 1 -- 172.21.15.8:0/3186133900 >> v1:172.21.15.196:6789/0 conn(0x7fb83806f140 legacy=0x7fb838156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:25.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.350+0000 7fb836a00640 1 -- 172.21.15.8:0/3186133900 >> v1:172.21.15.8:6789/0 conn(0x7fb83806f850 legacy=0x7fb838155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:25.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.350+0000 7fb836a00640 1 -- 172.21.15.8:0/3186133900 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8380721f0 con 0x7fb8380c1e30 2024-03-23T23:59:25.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.354+0000 7fb836a00640 1 --2- 172.21.15.8:0/3186133900 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8380c1e30 0x7fb83806fc30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb8240097c0 tx=0x7fb82401c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8290df16600b0fd4 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:25.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.354+0000 7fb836000640 1 -- 172.21.15.8:0/3186133900 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8240b0070 con 0x7fb8380c1e30 2024-03-23T23:59:25.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.354+0000 7fb836000640 1 -- 172.21.15.8:0/3186133900 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb8240ab600 con 0x7fb8380c1e30 2024-03-23T23:59:25.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.354+0000 7fb836000640 1 -- 172.21.15.8:0/3186133900 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8240ab9f0 con 0x7fb8380c1e30 2024-03-23T23:59:25.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.354+0000 7fb83e800640 1 -- 172.21.15.8:0/3186133900 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8380c1e30 msgr2=0x7fb83806fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:25.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.354+0000 7fb83e800640 1 --2- 172.21.15.8:0/3186133900 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8380c1e30 0x7fb83806fc30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb8240097c0 tx=0x7fb82401c380 comp rx=0 tx=0).stop 2024-03-23T23:59:25.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.354+0000 7fb83e800640 1 -- 172.21.15.8:0/3186133900 shutdown_connections 2024-03-23T23:59:25.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.354+0000 7fb83e800640 1 --2- 172.21.15.8:0/3186133900 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8380c1e30 0x7fb83806fc30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:25.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.354+0000 7fb83e800640 1 -- 172.21.15.8:0/3186133900 >> 172.21.15.8:0/3186133900 conn(0x7fb83806c280 msgr2=0x7fb83806c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:25.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.354+0000 7fb83e800640 1 -- 172.21.15.8:0/3186133900 shutdown_connections 2024-03-23T23:59:25.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.354+0000 7fb83e800640 1 -- 172.21.15.8:0/3186133900 wait complete. 2024-03-23T23:59:25.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.358+0000 7fb83e800640 1 Processor -- start 2024-03-23T23:59:25.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.358+0000 7fb83e800640 1 -- start start 2024-03-23T23:59:25.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.358+0000 7fb83e800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb83806f140 0x7fb8380c7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:25.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.358+0000 7fb83e800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb83806f850 0x7fb8381f2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:25.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.358+0000 7fb83e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8380c1e30 0x7fb8381f27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:25.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.358+0000 7fb83e800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb838163bc0 con 0x7fb8380c1e30 2024-03-23T23:59:25.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.358+0000 7fb83e800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb838072560 con 0x7fb83806f850 2024-03-23T23:59:25.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.358+0000 7fb83e800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb838163d40 con 0x7fb83806f140 2024-03-23T23:59:25.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.358+0000 7fb837e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8380c1e30 0x7fb8381f27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:25.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.358+0000 7fb837e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8380c1e30 0x7fb8381f27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35724/0 (socket says 172.21.15.8:35724) 2024-03-23T23:59:25.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.358+0000 7fb837e00640 1 -- 172.21.15.8:0/1716272823 learned_addr learned my addr 172.21.15.8:0/1716272823 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:59:25.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.358+0000 7fb837400640 1 --2- 172.21.15.8:0/1716272823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb83806f140 0x7fb8380c7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:25.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.358+0000 7fb836a00640 1 --2- 172.21.15.8:0/1716272823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb83806f850 0x7fb8381f2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:25.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.358+0000 7fb836a00640 1 -- 172.21.15.8:0/1716272823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb83806f140 msgr2=0x7fb8380c7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:25.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.358+0000 7fb836a00640 1 --2- 172.21.15.8:0/1716272823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb83806f140 0x7fb8380c7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:25.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.358+0000 7fb836a00640 1 -- 172.21.15.8:0/1716272823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8380c1e30 msgr2=0x7fb8381f27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:25.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.362+0000 7fb836a00640 1 --2- 172.21.15.8:0/1716272823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8380c1e30 0x7fb8381f27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:25.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.362+0000 7fb836a00640 1 -- 172.21.15.8:0/1716272823 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83815af90 con 0x7fb83806f850 2024-03-23T23:59:25.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.362+0000 7fb837e00640 1 --2- 172.21.15.8:0/1716272823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8380c1e30 0x7fb8381f27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:59:25.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.362+0000 7fb836a00640 1 --2- 172.21.15.8:0/1716272823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb83806f850 0x7fb8381f2290 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb8240ab000 tx=0x7fb824019120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:25.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.362+0000 7fb82f400640 1 -- 172.21.15.8:0/1716272823 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8240b8020 con 0x7fb83806f850 2024-03-23T23:59:25.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.362+0000 7fb82f400640 1 -- 172.21.15.8:0/1716272823 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb8240b4410 con 0x7fb83806f850 2024-03-23T23:59:25.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.362+0000 7fb82f400640 1 -- 172.21.15.8:0/1716272823 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8240b0040 con 0x7fb83806f850 2024-03-23T23:59:25.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.362+0000 7fb83e800640 1 -- 172.21.15.8:0/1716272823 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb83815f960 con 0x7fb83806f850 2024-03-23T23:59:25.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.362+0000 7fb83e800640 1 -- 172.21.15.8:0/1716272823 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb83815ff20 con 0x7fb83806f850 2024-03-23T23:59:25.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.362+0000 7fb83e800640 1 -- 172.21.15.8:0/1716272823 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb838068270 con 0x7fb83806f850 2024-03-23T23:59:25.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.362+0000 7fb82f400640 1 -- 172.21.15.8:0/1716272823 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb8240bb020 con 0x7fb83806f850 2024-03-23T23:59:25.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.362+0000 7fb82f400640 1 --2- 172.21.15.8:0/1716272823 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb818067660 0x7fb818069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:25.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.362+0000 7fb82f400640 1 -- 172.21.15.8:0/1716272823 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5775+0+0 (secure 0 0 0) 0x7fb82411f2e0 con 0x7fb83806f850 2024-03-23T23:59:25.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.366+0000 7fb837400640 1 --2- 172.21.15.8:0/1716272823 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb818067660 0x7fb818069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:25.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.366+0000 7fb837400640 1 --2- 172.21.15.8:0/1716272823 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb818067660 0x7fb818069b20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb8280011f0 tx=0x7fb828007d40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:25.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.370+0000 7fb82f400640 1 -- 172.21.15.8:0/1716272823 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fb8240c2030 con 0x7fb83806f850 2024-03-23T23:59:25.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.566+0000 7fb83e800640 1 -- 172.21.15.8:0/1716272823 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8380c24a0 con 0x7fb83806f850 2024-03-23T23:59:25.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.570+0000 7fb82f400640 1 -- 172.21.15.8:0/1716272823 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4974 (secure 0 0 0) 0x7fb824016090 con 0x7fb83806f850 2024-03-23T23:59:25.570 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:59:25.570 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":17,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6836/3149325777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3149325777},{"type":"v1","addr":"172.21.15.196:6836","nonce":3149325777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6833/1542162403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1542162403},{"type":"v1","addr":"172.21.15.8:6833","nonce":1542162403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":204440,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/2153720528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":2153720528},{"type":"v1","addr":"172.21.15.196:6837","nonce":2153720528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T23:42:50.113972+0000","modified":"2024-03-23T23:42:54.152778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.8:6835/3531853933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3531853933},{"type":"v1","addr":"172.21.15.8:6835","nonce":3531853933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4269,"qdb_cluster":[4269]},"id":2}]} 2024-03-23T23:59:25.570 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 17 2024-03-23T23:59:25.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.570+0000 7fb83e800640 1 -- 172.21.15.8:0/1716272823 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb818067660 msgr2=0x7fb818069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:25.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.570+0000 7fb83e800640 1 --2- 172.21.15.8:0/1716272823 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb818067660 0x7fb818069b20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb8280011f0 tx=0x7fb828007d40 comp rx=0 tx=0).stop 2024-03-23T23:59:25.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.570+0000 7fb83e800640 1 -- 172.21.15.8:0/1716272823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb83806f850 msgr2=0x7fb8381f2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:25.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.570+0000 7fb83e800640 1 --2- 172.21.15.8:0/1716272823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb83806f850 0x7fb8381f2290 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb8240ab000 tx=0x7fb824019120 comp rx=0 tx=0).stop 2024-03-23T23:59:25.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.570+0000 7fb83e800640 1 -- 172.21.15.8:0/1716272823 shutdown_connections 2024-03-23T23:59:25.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.570+0000 7fb83e800640 1 --2- 172.21.15.8:0/1716272823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8380c1e30 0x7fb8381f27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:25.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.570+0000 7fb83e800640 1 --2- 172.21.15.8:0/1716272823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb83806f850 0x7fb8381f2290 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:25.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.570+0000 7fb83e800640 1 --2- 172.21.15.8:0/1716272823 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fb818067660 0x7fb818069b20 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:25.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.570+0000 7fb83e800640 1 --2- 172.21.15.8:0/1716272823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb83806f140 0x7fb8380c7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:25.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.570+0000 7fb83e800640 1 -- 172.21.15.8:0/1716272823 >> 172.21.15.8:0/1716272823 conn(0x7fb83806c280 msgr2=0x7fb838151b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:25.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.570+0000 7fb83e800640 1 -- 172.21.15.8:0/1716272823 shutdown_connections 2024-03-23T23:59:25.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.570+0000 7fb83e800640 1 -- 172.21.15.8:0/1716272823 wait complete. 2024-03-23T23:59:25.591 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:59:25.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.730+0000 7fde8a600640 1 Processor -- start 2024-03-23T23:59:25.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.730+0000 7fde8a600640 1 -- start start 2024-03-23T23:59:25.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.734+0000 7fde8a600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fde8406e520 0x7fde840ac530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:25.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.734+0000 7fde8a600640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde8414a3d0 con 0x7fde84149ff0 2024-03-23T23:59:25.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.734+0000 7fde8a600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde84153f20 con 0x7fde840c1c70 2024-03-23T23:59:25.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.734+0000 7fde8a600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde840ad460 con 0x7fde8406e520 2024-03-23T23:59:25.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.734+0000 7fde89200640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fde84149ff0 0x7fde8406de10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:32964/0 (socket says 172.21.15.8:32964) 2024-03-23T23:59:25.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.734+0000 7fde89200640 1 -- 172.21.15.8:0/2262807471 learned_addr learned my addr 172.21.15.8:0/2262807471 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:59:25.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.734+0000 7fde89c00640 1 --2- 172.21.15.8:0/2262807471 >> v2:172.21.15.196:3300/0 conn(0x7fde8406e520 0x7fde840ac530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:25.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.734+0000 7fde83e00640 1 -- 172.21.15.8:0/2262807471 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1868242144 0 0) 0x7fde8414a3d0 con 0x7fde84149ff0 2024-03-23T23:59:25.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.734+0000 7fde83e00640 1 -- 172.21.15.8:0/2262807471 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde68003530 con 0x7fde84149ff0 2024-03-23T23:59:25.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.734+0000 7fde89c00640 1 -- 172.21.15.8:0/2262807471 >> v1:172.21.15.196:6789/0 conn(0x7fde840c1c70 legacy=0x7fde840abe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:25.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.734+0000 7fde89c00640 1 -- 172.21.15.8:0/2262807471 >> v1:172.21.15.8:6789/0 conn(0x7fde84149ff0 legacy=0x7fde8406de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:25.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.734+0000 7fde89c00640 1 -- 172.21.15.8:0/2262807471 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde84154200 con 0x7fde8406e520 2024-03-23T23:59:25.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.738+0000 7fde89c00640 1 --2- 172.21.15.8:0/2262807471 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde8406e520 0x7fde840ac530 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fde7c009d90 tx=0x7fde7c01c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58de55d5763271f8 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:25.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.738+0000 7fde83e00640 1 -- 172.21.15.8:0/2262807471 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c0b2070 con 0x7fde8406e520 2024-03-23T23:59:25.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.738+0000 7fde83e00640 1 -- 172.21.15.8:0/2262807471 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fde7c0a58b0 con 0x7fde8406e520 2024-03-23T23:59:25.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.738+0000 7fde83e00640 1 -- 172.21.15.8:0/2262807471 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c0a5ca0 con 0x7fde8406e520 2024-03-23T23:59:25.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.738+0000 7fde8a600640 1 -- 172.21.15.8:0/2262807471 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde8406e520 msgr2=0x7fde840ac530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:25.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.738+0000 7fde8a600640 1 --2- 172.21.15.8:0/2262807471 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde8406e520 0x7fde840ac530 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fde7c009d90 tx=0x7fde7c01c8e0 comp rx=0 tx=0).stop 2024-03-23T23:59:25.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.738+0000 7fde8a600640 1 -- 172.21.15.8:0/2262807471 shutdown_connections 2024-03-23T23:59:25.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.738+0000 7fde8a600640 1 --2- 172.21.15.8:0/2262807471 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde8406e520 0x7fde840ac530 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:25.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.738+0000 7fde8a600640 1 -- 172.21.15.8:0/2262807471 >> 172.21.15.8:0/2262807471 conn(0x7fde840c7270 msgr2=0x7fde840c7680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:25.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.738+0000 7fde8a600640 1 -- 172.21.15.8:0/2262807471 shutdown_connections 2024-03-23T23:59:25.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.738+0000 7fde8a600640 1 -- 172.21.15.8:0/2262807471 wait complete. 2024-03-23T23:59:25.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.738+0000 7fde8a600640 1 Processor -- start 2024-03-23T23:59:25.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.738+0000 7fde8a600640 1 -- start start 2024-03-23T23:59:25.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.742+0000 7fde8a600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde8406e520 0x7fde841ef840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:25.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.742+0000 7fde8a600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde840c1c70 0x7fde8413fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:25.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.742+0000 7fde8a600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde84149ff0 0x7fde841ec2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:25.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.742+0000 7fde8a600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde84161650 con 0x7fde84149ff0 2024-03-23T23:59:25.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.742+0000 7fde8a600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde840aca70 con 0x7fde840c1c70 2024-03-23T23:59:25.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.742+0000 7fde8a600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde841617d0 con 0x7fde8406e520 2024-03-23T23:59:25.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.742+0000 7fde89c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde84149ff0 0x7fde841ec2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:25.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.742+0000 7fde7be00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde840c1c70 0x7fde8413fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:25.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.742+0000 7fde89c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde84149ff0 0x7fde841ec2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35728/0 (socket says 172.21.15.8:35728) 2024-03-23T23:59:25.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.742+0000 7fde89c00640 1 -- 172.21.15.8:0/312331595 learned_addr learned my addr 172.21.15.8:0/312331595 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:59:25.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.742+0000 7fde89200640 1 --2- 172.21.15.8:0/312331595 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde8406e520 0x7fde841ef840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:25.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.742+0000 7fde89c00640 1 -- 172.21.15.8:0/312331595 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde8406e520 msgr2=0x7fde841ef840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:25.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.742+0000 7fde89c00640 1 --2- 172.21.15.8:0/312331595 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde8406e520 0x7fde841ef840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:25.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.742+0000 7fde89c00640 1 -- 172.21.15.8:0/312331595 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde840c1c70 msgr2=0x7fde8413fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:25.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.742+0000 7fde89c00640 1 --2- 172.21.15.8:0/312331595 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde840c1c70 0x7fde8413fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:25.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.742+0000 7fde89c00640 1 -- 172.21.15.8:0/312331595 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde841401d0 con 0x7fde84149ff0 2024-03-23T23:59:25.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.742+0000 7fde7be00640 1 --2- 172.21.15.8:0/312331595 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde840c1c70 0x7fde8413fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:59:25.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.742+0000 7fde89c00640 1 --2- 172.21.15.8:0/312331595 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde84149ff0 0x7fde841ec2d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fde7c009d90 tx=0x7fde7c019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:25.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.742+0000 7fde81600640 1 -- 172.21.15.8:0/312331595 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c0b2050 con 0x7fde84149ff0 2024-03-23T23:59:25.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.742+0000 7fde81600640 1 -- 172.21.15.8:0/312331595 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fde7c0be070 con 0x7fde84149ff0 2024-03-23T23:59:25.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.742+0000 7fde81600640 1 -- 172.21.15.8:0/312331595 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c0ada50 con 0x7fde84149ff0 2024-03-23T23:59:25.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.742+0000 7fde8a600640 1 -- 172.21.15.8:0/312331595 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde841ec810 con 0x7fde84149ff0 2024-03-23T23:59:25.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.742+0000 7fde8a600640 1 -- 172.21.15.8:0/312331595 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde84148f30 con 0x7fde84149ff0 2024-03-23T23:59:25.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.742+0000 7fde8a600640 1 -- 172.21.15.8:0/312331595 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde8404f410 con 0x7fde84149ff0 2024-03-23T23:59:25.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.746+0000 7fde81600640 1 -- 172.21.15.8:0/312331595 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fde7c0adbf0 con 0x7fde84149ff0 2024-03-23T23:59:25.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.746+0000 7fde81600640 1 --2- 172.21.15.8:0/312331595 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fde60067660 0x7fde60069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:25.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.746+0000 7fde81600640 1 -- 172.21.15.8:0/312331595 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5775+0+0 (secure 0 0 0) 0x7fde7c120910 con 0x7fde84149ff0 2024-03-23T23:59:25.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.746+0000 7fde89200640 1 --2- 172.21.15.8:0/312331595 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fde60067660 0x7fde60069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:25.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.746+0000 7fde89200640 1 --2- 172.21.15.8:0/312331595 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fde60067660 0x7fde60069b20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fde740011f0 tx=0x7fde74007d40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:25.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.750+0000 7fde81600640 1 -- 172.21.15.8:0/312331595 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fde7c016560 con 0x7fde84149ff0 2024-03-23T23:59:25.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.914+0000 7fde8a600640 1 -- 172.21.15.8:0/312331595 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde840735c0 con 0x7fde84149ff0 2024-03-23T23:59:25.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.914+0000 7fde81600640 1 -- 172.21.15.8:0/312331595 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16708 (secure 0 0 0) 0x7fde7c0f0e70 con 0x7fde84149ff0 2024-03-23T23:59:25.916 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-23T23:59:25.916 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":30,"fsid":"c1a2a381-bc04-418a-8aea-f38031d04f8d","created":"2024-03-23T23:42:15.169430+0000","modified":"2024-03-23T23:59:24.673981+0000","last_up_change":"2024-03-23T23:42:26.509742+0000","last_in_change":"2024-03-23T23:42:17.662330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:42:26.327445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-23T23:42:48.327799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-23T23:42:49.113061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e967bf31-21d6-4d11-bc3d-0df8177a1b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6809","nonce":2187201732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6811","nonce":2187201732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6815","nonce":2187201732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":2187201732},{"type":"v1","addr":"172.21.15.8:6813","nonce":2187201732}]},"public_addr":"172.21.15.8:6809/2187201732","cluster_addr":"172.21.15.8:6811/2187201732","heartbeat_back_addr":"172.21.15.8:6815/2187201732","heartbeat_front_addr":"172.21.15.8:6813/2187201732","state":["exists","up"]},{"osd":1,"uuid":"c8e33701-7acd-4474-8402-d52461171fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6818","nonce":3205168010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6822","nonce":3205168010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6830","nonce":3205168010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3205168010},{"type":"v1","addr":"172.21.15.8:6826","nonce":3205168010}]},"public_addr":"172.21.15.8:6818/3205168010","cluster_addr":"172.21.15.8:6822/3205168010","heartbeat_back_addr":"172.21.15.8:6830/3205168010","heartbeat_front_addr":"172.21.15.8:6826/3205168010","state":["exists","up"]},{"osd":2,"uuid":"ceebdbf7-4c2f-4757-b52d-fd8b20e77570","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6801","nonce":475463656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6803","nonce":475463656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6807","nonce":475463656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":475463656},{"type":"v1","addr":"172.21.15.8:6805","nonce":475463656}]},"public_addr":"172.21.15.8:6801/475463656","cluster_addr":"172.21.15.8:6803/475463656","heartbeat_back_addr":"172.21.15.8:6807/475463656","heartbeat_front_addr":"172.21.15.8:6805/475463656","state":["exists","up"]},{"osd":3,"uuid":"89e258da-5767-429e-8441-edf877d2f3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6819","nonce":1514082871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6821","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6823","nonce":1514082871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6829","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6831","nonce":1514082871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6825","nonce":1514082871},{"type":"v1","addr":"172.21.15.8:6827","nonce":1514082871}]},"public_addr":"172.21.15.8:6819/1514082871","cluster_addr":"172.21.15.8:6823/1514082871","heartbeat_back_addr":"172.21.15.8:6831/1514082871","heartbeat_front_addr":"172.21.15.8:6827/1514082871","state":["exists","up"]},{"osd":4,"uuid":"2b7451ae-ea16-4f0a-ae50-04fde75e45ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6825","nonce":3516578147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6827","nonce":3516578147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6831","nonce":3516578147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3516578147},{"type":"v1","addr":"172.21.15.196:6829","nonce":3516578147}]},"public_addr":"172.21.15.196:6825/3516578147","cluster_addr":"172.21.15.196:6827/3516578147","heartbeat_back_addr":"172.21.15.196:6831/3516578147","heartbeat_front_addr":"172.21.15.196:6829/3516578147","state":["exists","up"]},{"osd":5,"uuid":"e68a8914-e591-466a-bc9e-f2d7c67aac13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6802","nonce":830595758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6806","nonce":830595758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6814","nonce":830595758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":830595758},{"type":"v1","addr":"172.21.15.196:6810","nonce":830595758}]},"public_addr":"172.21.15.196:6802/830595758","cluster_addr":"172.21.15.196:6806/830595758","heartbeat_back_addr":"172.21.15.196:6814/830595758","heartbeat_front_addr":"172.21.15.196:6810/830595758","state":["exists","up"]},{"osd":6,"uuid":"e47723c5-50a0-4cd8-92d9-01972072b422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6801","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6803","nonce":472639906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6805","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6807","nonce":472639906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6815","nonce":472639906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":472639906},{"type":"v1","addr":"172.21.15.196:6811","nonce":472639906}]},"public_addr":"172.21.15.196:6803/472639906","cluster_addr":"172.21.15.196:6807/472639906","heartbeat_back_addr":"172.21.15.196:6815/472639906","heartbeat_front_addr":"172.21.15.196:6811/472639906","state":["exists","up"]},{"osd":7,"uuid":"e1e9113d-8005-47b3-9a75-9e701199f1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6817","nonce":4151820349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6819","nonce":4151820349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6823","nonce":4151820349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4151820349},{"type":"v1","addr":"172.21.15.196:6821","nonce":4151820349}]},"public_addr":"172.21.15.196:6817/4151820349","cluster_addr":"172.21.15.196:6819/4151820349","heartbeat_back_addr":"172.21.15.196:6823/4151820349","heartbeat_front_addr":"172.21.15.196:6821/4151820349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.221790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.265974+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.190319+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.376359+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.329657+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.402958+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.300703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:42:23.133121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.196:6837/3402347550":"2024-03-24T23:59:21.661199+0000","172.21.15.196:6835/3402347550":"2024-03-24T23:59:21.661199+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:59:25.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.918+0000 7fde8a600640 1 -- 172.21.15.8:0/312331595 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fde60067660 msgr2=0x7fde60069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:25.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.918+0000 7fde8a600640 1 --2- 172.21.15.8:0/312331595 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fde60067660 0x7fde60069b20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fde740011f0 tx=0x7fde74007d40 comp rx=0 tx=0).stop 2024-03-23T23:59:25.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.918+0000 7fde8a600640 1 -- 172.21.15.8:0/312331595 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde84149ff0 msgr2=0x7fde841ec2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:25.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.918+0000 7fde8a600640 1 --2- 172.21.15.8:0/312331595 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde84149ff0 0x7fde841ec2d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fde7c009d90 tx=0x7fde7c019680 comp rx=0 tx=0).stop 2024-03-23T23:59:25.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.918+0000 7fde8a600640 1 -- 172.21.15.8:0/312331595 shutdown_connections 2024-03-23T23:59:25.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.918+0000 7fde8a600640 1 --2- 172.21.15.8:0/312331595 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde84149ff0 0x7fde841ec2d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:25.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.918+0000 7fde8a600640 1 --2- 172.21.15.8:0/312331595 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde840c1c70 0x7fde8413fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:25.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.918+0000 7fde8a600640 1 --2- 172.21.15.8:0/312331595 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fde60067660 0x7fde60069b20 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:25.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.918+0000 7fde8a600640 1 --2- 172.21.15.8:0/312331595 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde8406e520 0x7fde841ef840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:25.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.918+0000 7fde8a600640 1 -- 172.21.15.8:0/312331595 >> 172.21.15.8:0/312331595 conn(0x7fde840c7270 msgr2=0x7fde840c5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:25.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.918+0000 7fde8a600640 1 -- 172.21.15.8:0/312331595 shutdown_connections 2024-03-23T23:59:25.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:25.918+0000 7fde8a600640 1 -- 172.21.15.8:0/312331595 wait complete. 2024-03-23T23:59:25.952 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail b 2024-03-23T23:59:26.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.178+0000 7f1d9e400640 1 Processor -- start 2024-03-23T23:59:26.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.178+0000 7f1d9e400640 1 -- start start 2024-03-23T23:59:26.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.182+0000 7f1d9e400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1d980c4160 0x7f1d98152f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:26.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.182+0000 7f1d9e400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d980c2f70 con 0x7f1d980c3d00 2024-03-23T23:59:26.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.182+0000 7f1d9e400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d98155e70 con 0x7f1d9814fc70 2024-03-23T23:59:26.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.182+0000 7f1d9e400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d980c4590 con 0x7f1d980c4160 2024-03-23T23:59:26.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.182+0000 7f1d8fe00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f1d980c3d00 0x7f1d98152850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:32966/0 (socket says 172.21.15.8:32966) 2024-03-23T23:59:26.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.182+0000 7f1d8fe00640 1 -- 172.21.15.8:0/2163023880 learned_addr learned my addr 172.21.15.8:0/2163023880 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:59:26.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.182+0000 7f1d97e00640 1 --2- 172.21.15.8:0/2163023880 >> v2:172.21.15.196:3300/0 conn(0x7f1d980c4160 0x7f1d98152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:26.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.182+0000 7f1d96a00640 1 -- 172.21.15.8:0/2163023880 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1087943216 0 0) 0x7f1d980c2f70 con 0x7f1d980c3d00 2024-03-23T23:59:26.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.182+0000 7f1d96a00640 1 -- 172.21.15.8:0/2163023880 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d7c003530 con 0x7f1d980c3d00 2024-03-23T23:59:26.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.182+0000 7f1d96a00640 1 -- 172.21.15.8:0/2163023880 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3439431409 0 0) 0x7f1d98155e70 con 0x7f1d9814fc70 2024-03-23T23:59:26.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.182+0000 7f1d96a00640 1 -- 172.21.15.8:0/2163023880 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d980c2f70 con 0x7f1d9814fc70 2024-03-23T23:59:26.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.182+0000 7f1d96a00640 1 -- 172.21.15.8:0/2163023880 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 874332719 0 0) 0x7f1d7c003530 con 0x7f1d980c3d00 2024-03-23T23:59:26.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.182+0000 7f1d97e00640 1 -- 172.21.15.8:0/2163023880 >> v1:172.21.15.196:6789/0 conn(0x7f1d9814fc70 legacy=0x7f1d980c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:26.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.182+0000 7f1d97e00640 1 -- 172.21.15.8:0/2163023880 >> v1:172.21.15.8:6789/0 conn(0x7f1d980c3d00 legacy=0x7f1d98152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:26.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.182+0000 7f1d97e00640 1 -- 172.21.15.8:0/2163023880 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d98156150 con 0x7f1d980c4160 2024-03-23T23:59:26.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.186+0000 7f1d97e00640 1 --2- 172.21.15.8:0/2163023880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d980c4160 0x7f1d98152f60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1d90009d90 tx=0x7f1d9001c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc925f51e9195252 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:26.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.186+0000 7f1d96a00640 1 -- 172.21.15.8:0/2163023880 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d900b2070 con 0x7f1d980c4160 2024-03-23T23:59:26.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.186+0000 7f1d96a00640 1 -- 172.21.15.8:0/2163023880 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1d900a5530 con 0x7f1d980c4160 2024-03-23T23:59:26.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.186+0000 7f1d96a00640 1 -- 172.21.15.8:0/2163023880 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80001680 con 0x7f1d980c4160 2024-03-23T23:59:26.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.186+0000 7f1d9e400640 1 -- 172.21.15.8:0/2163023880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d980c4160 msgr2=0x7f1d98152f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:26.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.186+0000 7f1d9e400640 1 --2- 172.21.15.8:0/2163023880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d980c4160 0x7f1d98152f60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1d90009d90 tx=0x7f1d9001c800 comp rx=0 tx=0).stop 2024-03-23T23:59:26.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.186+0000 7f1d9e400640 1 -- 172.21.15.8:0/2163023880 shutdown_connections 2024-03-23T23:59:26.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.186+0000 7f1d9e400640 1 --2- 172.21.15.8:0/2163023880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d980c4160 0x7f1d98152f60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:26.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.186+0000 7f1d9e400640 1 -- 172.21.15.8:0/2163023880 >> 172.21.15.8:0/2163023880 conn(0x7f1d9806b170 msgr2=0x7f1d9806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:26.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.186+0000 7f1d9e400640 1 -- 172.21.15.8:0/2163023880 shutdown_connections 2024-03-23T23:59:26.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.186+0000 7f1d9e400640 1 -- 172.21.15.8:0/2163023880 wait complete. 2024-03-23T23:59:26.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.186+0000 7f1d9e400640 1 Processor -- start 2024-03-23T23:59:26.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.186+0000 7f1d9e400640 1 -- start start 2024-03-23T23:59:26.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.186+0000 7f1d9e400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1d980c3d00 0x7f1d98151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:26.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.186+0000 7f1d9e400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d980c4160 0x7f1d98141940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:26.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.186+0000 7f1d9e400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d9814fc70 0x7f1d9814e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:26.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.186+0000 7f1d9e400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d980c18d0 con 0x7f1d980c4160 2024-03-23T23:59:26.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.186+0000 7f1d9e400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d981534a0 con 0x7f1d9814fc70 2024-03-23T23:59:26.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.186+0000 7f1d9e400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d98150050 con 0x7f1d980c3d00 2024-03-23T23:59:26.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.186+0000 7f1d8fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d980c4160 0x7f1d98141940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:26.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.186+0000 7f1d8fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d980c4160 0x7f1d98141940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35744/0 (socket says 172.21.15.8:35744) 2024-03-23T23:59:26.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.186+0000 7f1d8fe00640 1 -- 172.21.15.8:0/2688091707 learned_addr learned my addr 172.21.15.8:0/2688091707 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:59:26.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.186+0000 7f1d97400640 1 --2- 172.21.15.8:0/2688091707 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1d980c3d00 0x7f1d98151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:26.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.186+0000 7f1d97e00640 1 --2- 172.21.15.8:0/2688091707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d9814fc70 0x7f1d9814e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:26.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.190+0000 7f1d8fe00640 1 -- 172.21.15.8:0/2688091707 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1d980c3d00 msgr2=0x7f1d98151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:26.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.190+0000 7f1d8fe00640 1 --2- 172.21.15.8:0/2688091707 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1d980c3d00 0x7f1d98151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:26.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.190+0000 7f1d8fe00640 1 -- 172.21.15.8:0/2688091707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d9814fc70 msgr2=0x7f1d9814e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:26.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.190+0000 7f1d8fe00640 1 --2- 172.21.15.8:0/2688091707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d9814fc70 0x7f1d9814e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:26.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.190+0000 7f1d8fe00640 1 -- 172.21.15.8:0/2688091707 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9814e030 con 0x7f1d980c4160 2024-03-23T23:59:26.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.190+0000 7f1d8fe00640 1 --2- 172.21.15.8:0/2688091707 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d980c4160 0x7f1d98141940 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1d8000c5d0 tx=0x7f1d8000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:26.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.190+0000 7f1d8f400640 1 -- 172.21.15.8:0/2688091707 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80017070 con 0x7f1d980c4160 2024-03-23T23:59:26.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.190+0000 7f1d8f400640 1 -- 172.21.15.8:0/2688091707 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1d80005d10 con 0x7f1d980c4160 2024-03-23T23:59:26.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.190+0000 7f1d8f400640 1 -- 172.21.15.8:0/2688091707 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d800072d0 con 0x7f1d980c4160 2024-03-23T23:59:26.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.190+0000 7f1d9e400640 1 -- 172.21.15.8:0/2688091707 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d981503c0 con 0x7f1d980c4160 2024-03-23T23:59:26.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.190+0000 7f1d9e400640 1 -- 172.21.15.8:0/2688091707 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d98150980 con 0x7f1d980c4160 2024-03-23T23:59:26.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.190+0000 7f1d9e400640 1 -- 172.21.15.8:0/2688091707 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d98068270 con 0x7f1d980c4160 2024-03-23T23:59:26.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.190+0000 7f1d8f400640 1 -- 172.21.15.8:0/2688091707 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f1d8001a070 con 0x7f1d980c4160 2024-03-23T23:59:26.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.190+0000 7f1d8f400640 1 --2- 172.21.15.8:0/2688091707 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1d74067690 0x7f1d74069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:26.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.190+0000 7f1d8f400640 1 -- 172.21.15.8:0/2688091707 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5775+0+0 (secure 0 0 0) 0x7f1d80084e90 con 0x7f1d980c4160 2024-03-23T23:59:26.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.194+0000 7f1d97400640 1 --2- 172.21.15.8:0/2688091707 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1d74067690 0x7f1d74069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:26.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.194+0000 7f1d97400640 1 --2- 172.21.15.8:0/2688091707 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1d74067690 0x7f1d74069b50 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1d880011f0 tx=0x7f1d88009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:26.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.198+0000 7f1d8f400640 1 -- 172.21.15.8:0/2688091707 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f1d800553e0 con 0x7f1d980c4160 2024-03-23T23:59:26.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.402+0000 7f1d9e400640 1 -- 172.21.15.8:0/2688091707 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "b"} v 0) v1 -- 0x7f1d980c2ce0 con 0x7f1d980c4160 2024-03-23T23:59:26.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.402+0000 7f1d8f400640 1 -- 172.21.15.8:0/2688091707 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "b"}]=0 b marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 151+0+0 (secure 0 0 0) 0x7f1d80086020 con 0x7f1d980c4160 2024-03-23T23:59:26.405 INFO:teuthology.orchestra.run.smithi008.stderr:b marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-23T23:59:26.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.406+0000 7f1d9e400640 1 -- 172.21.15.8:0/2688091707 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1d74067690 msgr2=0x7f1d74069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:26.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.406+0000 7f1d9e400640 1 --2- 172.21.15.8:0/2688091707 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1d74067690 0x7f1d74069b50 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1d880011f0 tx=0x7f1d88009040 comp rx=0 tx=0).stop 2024-03-23T23:59:26.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.406+0000 7f1d9e400640 1 -- 172.21.15.8:0/2688091707 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d980c4160 msgr2=0x7f1d98141940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:26.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.406+0000 7f1d9e400640 1 --2- 172.21.15.8:0/2688091707 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d980c4160 0x7f1d98141940 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1d8000c5d0 tx=0x7f1d8000ca90 comp rx=0 tx=0).stop 2024-03-23T23:59:26.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.410+0000 7f1d9e400640 1 -- 172.21.15.8:0/2688091707 shutdown_connections 2024-03-23T23:59:26.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.410+0000 7f1d9e400640 1 --2- 172.21.15.8:0/2688091707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d9814fc70 0x7f1d9814e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:26.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.410+0000 7f1d9e400640 1 --2- 172.21.15.8:0/2688091707 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d980c4160 0x7f1d98141940 secure :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1d8000c5d0 tx=0x7f1d8000ca90 comp rx=0 tx=0).stop 2024-03-23T23:59:26.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.410+0000 7f1d9e400640 1 --2- 172.21.15.8:0/2688091707 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f1d74067690 0x7f1d74069b50 secure :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1d880011f0 tx=0x7f1d88009040 comp rx=0 tx=0).stop 2024-03-23T23:59:26.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.410+0000 7f1d9e400640 1 --2- 172.21.15.8:0/2688091707 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1d980c3d00 0x7f1d98151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:26.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.410+0000 7f1d9e400640 1 -- 172.21.15.8:0/2688091707 >> 172.21.15.8:0/2688091707 conn(0x7f1d9806b170 msgr2=0x7f1d980c3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:26.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.410+0000 7f1d9e400640 1 -- 172.21.15.8:0/2688091707 shutdown_connections 2024-03-23T23:59:26.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.410+0000 7f1d9e400640 1 -- 172.21.15.8:0/2688091707 wait complete. 2024-03-23T23:59:26.431 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm b --yes-i-really-mean-it 2024-03-23T23:59:26.476 INFO:tasks.ceph.mds.a.smithi008.stdout:starting mds.a at 2024-03-23T23:59:26.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.578+0000 7fc963800640 1 Processor -- start 2024-03-23T23:59:26.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.578+0000 7fc963800640 1 -- start start 2024-03-23T23:59:26.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.578+0000 7fc963800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc95c0aab90 0x7fc95c152670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:26.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.578+0000 7fc963800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc95c06e940 con 0x7fc95c06dab0 2024-03-23T23:59:26.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.578+0000 7fc963800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc95c06ec20 con 0x7fc95c06d300 2024-03-23T23:59:26.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.578+0000 7fc963800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc95c06e6f0 con 0x7fc95c0aab90 2024-03-23T23:59:26.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.578+0000 7fc953e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc95c0aab90 0x7fc95c152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:26.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.578+0000 7fc960e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fc95c06dab0 0x7fc95c156580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:32976/0 (socket says 172.21.15.8:32976) 2024-03-23T23:59:26.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.578+0000 7fc960e00640 1 -- 172.21.15.8:0/2996811819 learned_addr learned my addr 172.21.15.8:0/2996811819 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:59:26.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.578+0000 7fc953e00640 1 -- 172.21.15.8:0/2996811819 >> v1:172.21.15.196:6789/0 conn(0x7fc95c06d300 legacy=0x7fc95c14f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:26.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.578+0000 7fc953e00640 1 -- 172.21.15.8:0/2996811819 >> v1:172.21.15.8:6789/0 conn(0x7fc95c06dab0 legacy=0x7fc95c156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:26.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.578+0000 7fc953e00640 1 -- 172.21.15.8:0/2996811819 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95c155d80 con 0x7fc95c0aab90 2024-03-23T23:59:26.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.578+0000 7fc95be00640 1 -- 172.21.15.8:0/2996811819 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494504259 0 0) 0x7fc95c06e940 con 0x7fc95c06dab0 2024-03-23T23:59:26.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.582+0000 7fc953e00640 1 --2- 172.21.15.8:0/2996811819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc95c0aab90 0x7fc95c152670 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc9440097c0 tx=0x7fc94401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f7f0a7b9d2e758 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:26.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.582+0000 7fc95be00640 1 -- 172.21.15.8:0/2996811819 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9440b0070 con 0x7fc95c0aab90 2024-03-23T23:59:26.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.582+0000 7fc95be00640 1 -- 172.21.15.8:0/2996811819 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc9440ab600 con 0x7fc95c0aab90 2024-03-23T23:59:26.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.582+0000 7fc95be00640 1 -- 172.21.15.8:0/2996811819 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9440ab9f0 con 0x7fc95c0aab90 2024-03-23T23:59:26.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.582+0000 7fc963800640 1 -- 172.21.15.8:0/2996811819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc95c0aab90 msgr2=0x7fc95c152670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:26.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.582+0000 7fc963800640 1 --2- 172.21.15.8:0/2996811819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc95c0aab90 0x7fc95c152670 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc9440097c0 tx=0x7fc94401c4a0 comp rx=0 tx=0).stop 2024-03-23T23:59:26.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.582+0000 7fc963800640 1 -- 172.21.15.8:0/2996811819 shutdown_connections 2024-03-23T23:59:26.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.582+0000 7fc963800640 1 --2- 172.21.15.8:0/2996811819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc95c0aab90 0x7fc95c152670 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:26.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.582+0000 7fc963800640 1 -- 172.21.15.8:0/2996811819 >> 172.21.15.8:0/2996811819 conn(0x7fc95c06b170 msgr2=0x7fc95c06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:26.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.582+0000 7fc963800640 1 -- 172.21.15.8:0/2996811819 shutdown_connections 2024-03-23T23:59:26.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.582+0000 7fc963800640 1 -- 172.21.15.8:0/2996811819 wait complete. 2024-03-23T23:59:26.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.582+0000 7fc963800640 1 Processor -- start 2024-03-23T23:59:26.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.586+0000 7fc963800640 1 -- start start 2024-03-23T23:59:26.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.586+0000 7fc963800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc95c06d300 0x7fc95c1543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:26.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.586+0000 7fc963800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc95c06dab0 0x7fc95c14d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:26.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.586+0000 7fc963800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc95c0aab90 0x7fc95c14b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:26.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.586+0000 7fc963800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c06e010 con 0x7fc95c06dab0 2024-03-23T23:59:26.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.586+0000 7fc963800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c06de90 con 0x7fc95c06d300 2024-03-23T23:59:26.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.586+0000 7fc963800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c160760 con 0x7fc95c0aab90 2024-03-23T23:59:26.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.586+0000 7fc953e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc95c06dab0 0x7fc95c14d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:26.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.586+0000 7fc953e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc95c06dab0 0x7fc95c14d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35780/0 (socket says 172.21.15.8:35780) 2024-03-23T23:59:26.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.586+0000 7fc953e00640 1 -- 172.21.15.8:0/4265148924 learned_addr learned my addr 172.21.15.8:0/4265148924 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:59:26.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.586+0000 7fc960e00640 1 --2- 172.21.15.8:0/4265148924 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc95c06d300 0x7fc95c1543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:26.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.586+0000 7fc961800640 1 --2- 172.21.15.8:0/4265148924 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc95c0aab90 0x7fc95c14b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:26.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.586+0000 7fc953e00640 1 -- 172.21.15.8:0/4265148924 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc95c0aab90 msgr2=0x7fc95c14b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:26.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.586+0000 7fc953e00640 1 --2- 172.21.15.8:0/4265148924 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc95c0aab90 0x7fc95c14b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:26.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.586+0000 7fc953e00640 1 -- 172.21.15.8:0/4265148924 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc95c06d300 msgr2=0x7fc95c1543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:26.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.586+0000 7fc953e00640 1 --2- 172.21.15.8:0/4265148924 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc95c06d300 0x7fc95c1543f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:26.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.586+0000 7fc953e00640 1 -- 172.21.15.8:0/4265148924 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95c154930 con 0x7fc95c06dab0 2024-03-23T23:59:26.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.586+0000 7fc953e00640 1 --2- 172.21.15.8:0/4265148924 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc95c06dab0 0x7fc95c14d960 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc94401a0d0 tx=0x7fc944019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:26.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.586+0000 7fc959600640 1 -- 172.21.15.8:0/4265148924 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9440b0040 con 0x7fc95c06dab0 2024-03-23T23:59:26.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.586+0000 7fc959600640 1 -- 172.21.15.8:0/4265148924 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc9440b5460 con 0x7fc95c06dab0 2024-03-23T23:59:26.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.586+0000 7fc959600640 1 -- 172.21.15.8:0/4265148924 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9440b5870 con 0x7fc95c06dab0 2024-03-23T23:59:26.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.586+0000 7fc963800640 1 -- 172.21.15.8:0/4265148924 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc95c150820 con 0x7fc95c06dab0 2024-03-23T23:59:26.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.586+0000 7fc963800640 1 -- 172.21.15.8:0/4265148924 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc95c154e60 con 0x7fc95c06dab0 2024-03-23T23:59:26.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.586+0000 7fc963800640 1 -- 172.21.15.8:0/4265148924 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc95c04f410 con 0x7fc95c06dab0 2024-03-23T23:59:26.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.590+0000 7fc959600640 1 -- 172.21.15.8:0/4265148924 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc9440bf020 con 0x7fc95c06dab0 2024-03-23T23:59:26.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.590+0000 7fc959600640 1 --2- 172.21.15.8:0/4265148924 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc938067660 0x7fc938069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:26.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.590+0000 7fc959600640 1 -- 172.21.15.8:0/4265148924 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5861+0+0 (secure 0 0 0) 0x7fc94411f630 con 0x7fc95c06dab0 2024-03-23T23:59:26.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.590+0000 7fc960e00640 1 --2- 172.21.15.8:0/4265148924 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc938067660 0x7fc938069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:26.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.590+0000 7fc960e00640 1 --2- 172.21.15.8:0/4265148924 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc938067660 0x7fc938069b20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc94c000f70 tx=0x7fc94c007240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:26.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.594+0000 7fc959600640 1 -- 172.21.15.8:0/4265148924 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fc9440c6020 con 0x7fc95c06dab0 2024-03-23T23:59:26.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:26.798+0000 7fc963800640 1 -- 172.21.15.8:0/4265148924 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "b", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc95c06d0e0 con 0x7fc95c06dab0 2024-03-23T23:59:27.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.406+0000 7fc959600640 1 -- 172.21.15.8:0/4265148924 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "b", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 99+0+0 (secure 0 0 0) 0x7fc944016090 con 0x7fc95c06dab0 2024-03-23T23:59:27.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.406+0000 7fc963800640 1 -- 172.21.15.8:0/4265148924 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc938067660 msgr2=0x7fc938069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:27.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.406+0000 7fc963800640 1 --2- 172.21.15.8:0/4265148924 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc938067660 0x7fc938069b20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc94c000f70 tx=0x7fc94c007240 comp rx=0 tx=0).stop 2024-03-23T23:59:27.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.406+0000 7fc963800640 1 -- 172.21.15.8:0/4265148924 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc95c06dab0 msgr2=0x7fc95c14d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:27.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.406+0000 7fc963800640 1 --2- 172.21.15.8:0/4265148924 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc95c06dab0 0x7fc95c14d960 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc94401a0d0 tx=0x7fc944019240 comp rx=0 tx=0).stop 2024-03-23T23:59:27.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.406+0000 7fc963800640 1 -- 172.21.15.8:0/4265148924 shutdown_connections 2024-03-23T23:59:27.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.406+0000 7fc963800640 1 --2- 172.21.15.8:0/4265148924 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fc938067660 0x7fc938069b20 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:27.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.406+0000 7fc963800640 1 --2- 172.21.15.8:0/4265148924 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc95c0aab90 0x7fc95c14b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:27.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.406+0000 7fc963800640 1 --2- 172.21.15.8:0/4265148924 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc95c06dab0 0x7fc95c14d960 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:27.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.406+0000 7fc963800640 1 --2- 172.21.15.8:0/4265148924 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc95c06d300 0x7fc95c1543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:27.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.406+0000 7fc963800640 1 -- 172.21.15.8:0/4265148924 >> 172.21.15.8:0/4265148924 conn(0x7fc95c06b170 msgr2=0x7fc95c067090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:27.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.410+0000 7fc963800640 1 -- 172.21.15.8:0/4265148924 shutdown_connections 2024-03-23T23:59:27.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.410+0000 7fc963800640 1 -- 172.21.15.8:0/4265148924 wait complete. 2024-03-23T23:59:27.433 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm b_metadata b_metadata --yes-i-really-really-mean-it 2024-03-23T23:59:27.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.630+0000 7f82eb600640 1 Processor -- start 2024-03-23T23:59:27.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.630+0000 7f82eb600640 1 -- start start 2024-03-23T23:59:27.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.634+0000 7f82eb600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f82e414c880 0x7f82e4072390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:27.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.634+0000 7f82eb600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82e406eb00 0x7f82e415cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:27.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.634+0000 7f82eb600640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e4073390 con 0x7f82e4071fb0 2024-03-23T23:59:27.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.634+0000 7f82eb600640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e4153310 con 0x7f82e414c880 2024-03-23T23:59:27.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.634+0000 7f82eb600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e4070f50 con 0x7f82e406eb00 2024-03-23T23:59:27.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.634+0000 7f82e3e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f82e414c880 0x7f82e4072390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:27.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.634+0000 7f82e8c00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f82e4071fb0 0x7f82e406cdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:32986/0 (socket says 172.21.15.8:32986) 2024-03-23T23:59:27.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.634+0000 7f82e8c00640 1 -- 172.21.15.8:0/223065406 learned_addr learned my addr 172.21.15.8:0/223065406 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:59:27.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.634+0000 7f82e9600640 1 --2- 172.21.15.8:0/223065406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82e406eb00 0x7f82e415cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:27.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.634+0000 7f82e3e00640 1 -- 172.21.15.8:0/223065406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82e406eb00 msgr2=0x7f82e415cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:59:27.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.634+0000 7f82e3e00640 1 --2- 172.21.15.8:0/223065406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82e406eb00 0x7f82e415cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:27.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.634+0000 7f82e3e00640 1 -- 172.21.15.8:0/223065406 >> v1:172.21.15.8:6789/0 conn(0x7f82e4071fb0 legacy=0x7f82e406cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:27.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.634+0000 7f82e3e00640 1 -- 172.21.15.8:0/223065406 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e4071230 con 0x7f82e414c880 2024-03-23T23:59:27.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.634+0000 7f82e3400640 1 -- 172.21.15.8:0/223065406 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3575807879 0 0) 0x7f82e4073390 con 0x7f82e4071fb0 2024-03-23T23:59:27.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.638+0000 7f82e3e00640 1 --2- 172.21.15.8:0/223065406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82e414c880 0x7f82e4072390 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f82d00097c0 tx=0x7f82d001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f91fcd70c9560757 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:27.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.638+0000 7f82e3400640 1 -- 172.21.15.8:0/223065406 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d00b0070 con 0x7f82e414c880 2024-03-23T23:59:27.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.638+0000 7f82e3400640 1 -- 172.21.15.8:0/223065406 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f82d00ab600 con 0x7f82e414c880 2024-03-23T23:59:27.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.638+0000 7f82e3400640 1 -- 172.21.15.8:0/223065406 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d00ab9f0 con 0x7f82e414c880 2024-03-23T23:59:27.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.638+0000 7f82eb600640 1 -- 172.21.15.8:0/223065406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82e414c880 msgr2=0x7f82e4072390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:27.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.638+0000 7f82eb600640 1 --2- 172.21.15.8:0/223065406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82e414c880 0x7f82e4072390 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f82d00097c0 tx=0x7f82d001c380 comp rx=0 tx=0).stop 2024-03-23T23:59:27.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.638+0000 7f82eb600640 1 -- 172.21.15.8:0/223065406 shutdown_connections 2024-03-23T23:59:27.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.638+0000 7f82eb600640 1 --2- 172.21.15.8:0/223065406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82e406eb00 0x7f82e415cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:27.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.638+0000 7f82eb600640 1 --2- 172.21.15.8:0/223065406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82e414c880 0x7f82e4072390 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:27.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.638+0000 7f82eb600640 1 -- 172.21.15.8:0/223065406 >> 172.21.15.8:0/223065406 conn(0x7f82e40c7060 msgr2=0x7f82e40c7470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:27.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.638+0000 7f82eb600640 1 -- 172.21.15.8:0/223065406 shutdown_connections 2024-03-23T23:59:27.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.638+0000 7f82eb600640 1 -- 172.21.15.8:0/223065406 wait complete. 2024-03-23T23:59:27.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.638+0000 7f82eb600640 1 Processor -- start 2024-03-23T23:59:27.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.638+0000 7f82eb600640 1 -- start start 2024-03-23T23:59:27.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.638+0000 7f82eb600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82e406eb00 0x7f82e41f1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:27.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.638+0000 7f82eb600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f82e4071fb0 0x7f82e4148010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:27.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.638+0000 7f82eb600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82e4152040 0x7f82e414ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:27.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.638+0000 7f82eb600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e40ad1c0 con 0x7f82e4152040 2024-03-23T23:59:27.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.638+0000 7f82eb600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e40ad040 con 0x7f82e4071fb0 2024-03-23T23:59:27.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.638+0000 7f82eb600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e415fc90 con 0x7f82e406eb00 2024-03-23T23:59:27.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.642+0000 7f82e9600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82e4152040 0x7f82e414ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:27.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.642+0000 7f82e9600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82e4152040 0x7f82e414ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35794/0 (socket says 172.21.15.8:35794) 2024-03-23T23:59:27.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.642+0000 7f82e9600640 1 -- 172.21.15.8:0/891512109 learned_addr learned my addr 172.21.15.8:0/891512109 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:59:27.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.642+0000 7f82e8c00640 1 --2- 172.21.15.8:0/891512109 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82e406eb00 0x7f82e41f1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:27.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.642+0000 7f82e3e00640 1 --2- 172.21.15.8:0/891512109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f82e4071fb0 0x7f82e4148010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:27.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.642+0000 7f82e9600640 1 -- 172.21.15.8:0/891512109 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82e406eb00 msgr2=0x7f82e41f1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:27.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.642+0000 7f82e9600640 1 --2- 172.21.15.8:0/891512109 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82e406eb00 0x7f82e41f1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:27.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.642+0000 7f82e9600640 1 -- 172.21.15.8:0/891512109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f82e4071fb0 msgr2=0x7f82e4148010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:27.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.642+0000 7f82e9600640 1 --2- 172.21.15.8:0/891512109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f82e4071fb0 0x7f82e4148010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:27.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.642+0000 7f82e9600640 1 -- 172.21.15.8:0/891512109 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e40c64e0 con 0x7f82e4152040 2024-03-23T23:59:27.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.642+0000 7f82e3e00640 1 --2- 172.21.15.8:0/891512109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f82e4071fb0 0x7f82e4148010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:59:27.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.642+0000 7f82e9600640 1 --2- 172.21.15.8:0/891512109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82e4152040 0x7f82e414ba40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f82dc007e40 tx=0x7f82dc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:27.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.642+0000 7f82e0c00640 1 -- 172.21.15.8:0/891512109 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc014620 con 0x7f82e4152040 2024-03-23T23:59:27.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.642+0000 7f82e0c00640 1 -- 172.21.15.8:0/891512109 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f82dc019070 con 0x7f82e4152040 2024-03-23T23:59:27.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.642+0000 7f82eb600640 1 -- 172.21.15.8:0/891512109 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e40c6780 con 0x7f82e4152040 2024-03-23T23:59:27.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.642+0000 7f82e0c00640 1 -- 172.21.15.8:0/891512109 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc014a40 con 0x7f82e4152040 2024-03-23T23:59:27.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.642+0000 7f82eb600640 1 -- 172.21.15.8:0/891512109 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e4148550 con 0x7f82e4152040 2024-03-23T23:59:27.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.642+0000 7f82eb600640 1 -- 172.21.15.8:0/891512109 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e404f480 con 0x7f82e4152040 2024-03-23T23:59:27.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.642+0000 7f82e0c00640 1 -- 172.21.15.8:0/891512109 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f82dc014be0 con 0x7f82e4152040 2024-03-23T23:59:27.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.642+0000 7f82e0c00640 1 --2- 172.21.15.8:0/891512109 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f82c4067660 0x7f82c4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:27.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.646+0000 7f82e0c00640 1 -- 172.21.15.8:0/891512109 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5861+0+0 (secure 0 0 0) 0x7f82dc0861e0 con 0x7f82e4152040 2024-03-23T23:59:27.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.646+0000 7f82e8c00640 1 --2- 172.21.15.8:0/891512109 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f82c4067660 0x7f82c4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:27.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.646+0000 7f82e8c00640 1 --2- 172.21.15.8:0/891512109 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f82c4067660 0x7f82c4069b20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f82d8007fd0 tx=0x7f82d8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:27.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.646+0000 7f82e0c00640 1 -- 172.21.15.8:0/891512109 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7f82dc056db0 con 0x7f82e4152040 2024-03-23T23:59:27.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:27.814+0000 7f82eb600640 1 -- 172.21.15.8:0/891512109 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "b_metadata", "pool2": "b_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f82e40c3780 con 0x7f82e4152040 2024-03-23T23:59:28.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.698+0000 7f82e0c00640 1 -- 172.21.15.8:0/891512109 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "b_metadata", "pool2": "b_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'b_metadata' removed v32) v1 ==== 166+0+0 (secure 0 0 0) 0x7f82dc0566b0 con 0x7f82e4152040 2024-03-23T23:59:28.701 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'b_metadata' removed 2024-03-23T23:59:28.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.702+0000 7f82eb600640 1 -- 172.21.15.8:0/891512109 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f82c4067660 msgr2=0x7f82c4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:28.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.702+0000 7f82eb600640 1 --2- 172.21.15.8:0/891512109 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f82c4067660 0x7f82c4069b20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f82d8007fd0 tx=0x7f82d8009040 comp rx=0 tx=0).stop 2024-03-23T23:59:28.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.702+0000 7f82eb600640 1 -- 172.21.15.8:0/891512109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82e4152040 msgr2=0x7f82e414ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:28.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.702+0000 7f82eb600640 1 --2- 172.21.15.8:0/891512109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82e4152040 0x7f82e414ba40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f82dc007e40 tx=0x7f82dc00e4b0 comp rx=0 tx=0).stop 2024-03-23T23:59:28.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.702+0000 7f82eb600640 1 -- 172.21.15.8:0/891512109 shutdown_connections 2024-03-23T23:59:28.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.702+0000 7f82eb600640 1 --2- 172.21.15.8:0/891512109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82e4152040 0x7f82e414ba40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:28.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.702+0000 7f82eb600640 1 --2- 172.21.15.8:0/891512109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f82e4071fb0 0x7f82e4148010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:28.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.702+0000 7f82eb600640 1 --2- 172.21.15.8:0/891512109 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7f82c4067660 0x7f82c4069b20 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:28.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.702+0000 7f82eb600640 1 --2- 172.21.15.8:0/891512109 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82e406eb00 0x7f82e41f1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:28.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.702+0000 7f82eb600640 1 -- 172.21.15.8:0/891512109 >> 172.21.15.8:0/891512109 conn(0x7f82e40c7060 msgr2=0x7f82e4143f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:28.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.706+0000 7f82eb600640 1 -- 172.21.15.8:0/891512109 shutdown_connections 2024-03-23T23:59:28.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.706+0000 7f82eb600640 1 -- 172.21.15.8:0/891512109 wait complete. 2024-03-23T23:59:28.757 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm b_data b_data --yes-i-really-really-mean-it 2024-03-23T23:59:28.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.906+0000 7fd1d1a00640 1 Processor -- start 2024-03-23T23:59:28.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.906+0000 7fd1d1a00640 1 -- start start 2024-03-23T23:59:28.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.910+0000 7fd1d1a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd1cc06e000 0x7fd1cc0abde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:28.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.910+0000 7fd1d1a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1cc154480 con 0x7fd1cc0ac320 2024-03-23T23:59:28.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.910+0000 7fd1d1a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1cc0aa180 con 0x7fd1cc150da0 2024-03-23T23:59:28.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.910+0000 7fd1d1a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1cc0aa460 con 0x7fd1cc06e000 2024-03-23T23:59:28.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.910+0000 7fd1cb400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd1cc0ac320 0x7fd1cc0ac750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:32990/0 (socket says 172.21.15.8:32990) 2024-03-23T23:59:28.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.910+0000 7fd1cb400640 1 -- 172.21.15.8:0/54206238 learned_addr learned my addr 172.21.15.8:0/54206238 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-03-23T23:59:28.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.910+0000 7fd1c3e00640 1 --2- 172.21.15.8:0/54206238 >> v2:172.21.15.196:3300/0 conn(0x7fd1cc06e000 0x7fd1cc0abde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:28.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.910+0000 7fd1ca000640 1 -- 172.21.15.8:0/54206238 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3095407244 0 0) 0x7fd1cc154480 con 0x7fd1cc0ac320 2024-03-23T23:59:28.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.910+0000 7fd1ca000640 1 -- 172.21.15.8:0/54206238 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1b0003530 con 0x7fd1cc0ac320 2024-03-23T23:59:28.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.910+0000 7fd1ca000640 1 -- 172.21.15.8:0/54206238 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 598007372 0 0) 0x7fd1b0003530 con 0x7fd1cc0ac320 2024-03-23T23:59:28.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.910+0000 7fd1ca000640 1 -- 172.21.15.8:0/54206238 >> v2:172.21.15.196:3300/0 conn(0x7fd1cc06e000 msgr2=0x7fd1cc0abde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:59:28.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.910+0000 7fd1ca000640 1 --2- 172.21.15.8:0/54206238 >> v2:172.21.15.196:3300/0 conn(0x7fd1cc06e000 0x7fd1cc0abde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:28.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.910+0000 7fd1ca000640 1 -- 172.21.15.8:0/54206238 >> v1:172.21.15.196:6789/0 conn(0x7fd1cc150da0 legacy=0x7fd1cc06d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:28.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.910+0000 7fd1ca000640 1 -- 172.21.15.8:0/54206238 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1cc0aa740 con 0x7fd1cc0ac320 2024-03-23T23:59:28.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.910+0000 7fd1ca000640 1 -- 172.21.15.8:0/54206238 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2335217279 0 0) 0x7fd1c4001a00 con 0x7fd1cc0ac320 2024-03-23T23:59:28.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.910+0000 7fd1ca000640 1 -- 172.21.15.8:0/54206238 >> v1:172.21.15.8:6789/0 conn(0x7fd1cc0ac320 legacy=0x7fd1cc0ac750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:28.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.910+0000 7fd1ca000640 1 --2- 172.21.15.8:0/54206238 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd1b00039c0 0x7fd1b0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:28.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.910+0000 7fd1ca000640 1 --2- 172.21.15.8:0/54206238 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd1b0004810 0x7fd1b0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:28.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.910+0000 7fd1ca000640 1 --2- 172.21.15.8:0/54206238 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1b00051d0 0x7fd1b000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:28.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.910+0000 7fd1ca000640 1 -- 172.21.15.8:0/54206238 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc0aa460 con 0x7fd1b00051d0 2024-03-23T23:59:28.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.910+0000 7fd1ca000640 1 -- 172.21.15.8:0/54206238 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b000c070 con 0x7fd1b0004810 2024-03-23T23:59:28.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.910+0000 7fd1ca000640 1 -- 172.21.15.8:0/54206238 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b000c270 con 0x7fd1b00039c0 2024-03-23T23:59:28.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.910+0000 7fd1c3e00640 1 --2- 172.21.15.8:0/54206238 >> v2:172.21.15.196:3300/0 conn(0x7fd1cc06e000 0x7fd1cc0abde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:59:28.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.910+0000 7fd1cb400640 1 --2- 172.21.15.8:0/54206238 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1b00051d0 0x7fd1b000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:28.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.910+0000 7fd1caa00640 1 --2- 172.21.15.8:0/54206238 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd1b00039c0 0x7fd1b0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:28.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.910+0000 7fd1c3e00640 1 --2- 172.21.15.8:0/54206238 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd1b0004810 0x7fd1b0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:28.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.910+0000 7fd1cb400640 1 -- 172.21.15.8:0/54206238 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd1b00039c0 msgr2=0x7fd1b0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:59:28.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.910+0000 7fd1cb400640 1 --2- 172.21.15.8:0/54206238 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd1b00039c0 0x7fd1b0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:28.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.910+0000 7fd1cb400640 1 -- 172.21.15.8:0/54206238 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd1b0004810 msgr2=0x7fd1b0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:59:28.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.910+0000 7fd1cb400640 1 --2- 172.21.15.8:0/54206238 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd1b0004810 0x7fd1b0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:28.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.910+0000 7fd1cb400640 1 -- 172.21.15.8:0/54206238 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b0003530 con 0x7fd1b00051d0 2024-03-23T23:59:28.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.910+0000 7fd1caa00640 1 --2- 172.21.15.8:0/54206238 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd1b00039c0 0x7fd1b0003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:59:28.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.914+0000 7fd1cb400640 1 -- 172.21.15.8:0/54206238 reap_dead start 2024-03-23T23:59:28.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.914+0000 7fd1cb400640 1 --2- 172.21.15.8:0/54206238 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1b00051d0 0x7fd1b000b9d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd1c400a850 tx=0x7fd1c401d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbbe85cee38efc51 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:28.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.914+0000 7fd1ca000640 1 -- 172.21.15.8:0/54206238 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c400a4a0 con 0x7fd1b00051d0 2024-03-23T23:59:28.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.914+0000 7fd1ca000640 1 -- 172.21.15.8:0/54206238 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd1c40ad650 con 0x7fd1b00051d0 2024-03-23T23:59:28.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.914+0000 7fd1ca000640 1 -- 172.21.15.8:0/54206238 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c40ada60 con 0x7fd1b00051d0 2024-03-23T23:59:28.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.914+0000 7fd1d1a00640 1 -- 172.21.15.8:0/54206238 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1b00051d0 msgr2=0x7fd1b000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:28.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.914+0000 7fd1d1a00640 1 --2- 172.21.15.8:0/54206238 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1b00051d0 0x7fd1b000b9d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd1c400a850 tx=0x7fd1c401d3a0 comp rx=0 tx=0).stop 2024-03-23T23:59:28.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.914+0000 7fd1d1a00640 1 -- 172.21.15.8:0/54206238 shutdown_connections 2024-03-23T23:59:28.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.914+0000 7fd1d1a00640 1 --2- 172.21.15.8:0/54206238 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1b00051d0 0x7fd1b000b9d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:28.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.914+0000 7fd1d1a00640 1 -- 172.21.15.8:0/54206238 >> 172.21.15.8:0/54206238 conn(0x7fd1cc0c7060 msgr2=0x7fd1cc0c7470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:28.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.914+0000 7fd1d1a00640 1 -- 172.21.15.8:0/54206238 shutdown_connections 2024-03-23T23:59:28.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.914+0000 7fd1d1a00640 1 -- 172.21.15.8:0/54206238 wait complete. 2024-03-23T23:59:28.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.914+0000 7fd1d1a00640 1 Processor -- start 2024-03-23T23:59:28.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.914+0000 7fd1d1a00640 1 -- start start 2024-03-23T23:59:28.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.918+0000 7fd1d1a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd1b00051d0 0x7fd1cc1ebb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:28.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.918+0000 7fd1d1a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1cc14b050 0x7fd1cc0725f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:28.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.918+0000 7fd1d1a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd1cc072b30 0x7fd1cc144ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:28.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.918+0000 7fd1d1a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc06cfe0 con 0x7fd1cc14b050 2024-03-23T23:59:28.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.918+0000 7fd1d1a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc151180 con 0x7fd1b00051d0 2024-03-23T23:59:28.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.918+0000 7fd1d1a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc06e490 con 0x7fd1cc072b30 2024-03-23T23:59:28.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.918+0000 7fd1c3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1cc14b050 0x7fd1cc0725f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:28.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.918+0000 7fd1c3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1cc14b050 0x7fd1cc0725f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35810/0 (socket says 172.21.15.8:35810) 2024-03-23T23:59:28.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.918+0000 7fd1c3e00640 1 -- 172.21.15.8:0/324149864 learned_addr learned my addr 172.21.15.8:0/324149864 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-23T23:59:28.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.918+0000 7fd1caa00640 1 --2- 172.21.15.8:0/324149864 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd1b00051d0 0x7fd1cc1ebb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:28.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.918+0000 7fd1cb400640 1 --2- 172.21.15.8:0/324149864 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd1cc072b30 0x7fd1cc144ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:28.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.918+0000 7fd1c3e00640 1 -- 172.21.15.8:0/324149864 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd1cc072b30 msgr2=0x7fd1cc144ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:28.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.918+0000 7fd1c3e00640 1 --2- 172.21.15.8:0/324149864 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd1cc072b30 0x7fd1cc144ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:28.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.918+0000 7fd1c3e00640 1 -- 172.21.15.8:0/324149864 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd1b00051d0 msgr2=0x7fd1cc1ebb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:28.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.918+0000 7fd1c3e00640 1 --2- 172.21.15.8:0/324149864 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd1b00051d0 0x7fd1cc1ebb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:28.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.918+0000 7fd1c3e00640 1 -- 172.21.15.8:0/324149864 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1cc14ace0 con 0x7fd1cc14b050 2024-03-23T23:59:28.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.918+0000 7fd1c3e00640 1 --2- 172.21.15.8:0/324149864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1cc14b050 0x7fd1cc0725f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4011cd0 tx=0x7fd1b400f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:28.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.918+0000 7fd1c2a00640 1 -- 172.21.15.8:0/324149864 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b400fd20 con 0x7fd1cc14b050 2024-03-23T23:59:28.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.918+0000 7fd1c2a00640 1 -- 172.21.15.8:0/324149864 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd1b4004020 con 0x7fd1cc14b050 2024-03-23T23:59:28.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.918+0000 7fd1c2a00640 1 -- 172.21.15.8:0/324149864 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4004410 con 0x7fd1cc14b050 2024-03-23T23:59:28.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.918+0000 7fd1d1a00640 1 -- 172.21.15.8:0/324149864 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1cc140a00 con 0x7fd1cc14b050 2024-03-23T23:59:28.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.918+0000 7fd1d1a00640 1 -- 172.21.15.8:0/324149864 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1cc14c700 con 0x7fd1cc14b050 2024-03-23T23:59:28.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.918+0000 7fd1d1a00640 1 -- 172.21.15.8:0/324149864 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1cc04f480 con 0x7fd1cc14b050 2024-03-23T23:59:28.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.918+0000 7fd1c2a00640 1 -- 172.21.15.8:0/324149864 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd1b4012040 con 0x7fd1cc14b050 2024-03-23T23:59:28.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.922+0000 7fd1c2a00640 1 --2- 172.21.15.8:0/324149864 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd1a8067690 0x7fd1a8069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:28.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.922+0000 7fd1c2a00640 1 -- 172.21.15.8:0/324149864 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5433+0+0 (secure 0 0 0) 0x7fd1b4085cb0 con 0x7fd1cc14b050 2024-03-23T23:59:28.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.922+0000 7fd1caa00640 1 --2- 172.21.15.8:0/324149864 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd1a8067690 0x7fd1a8069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:28.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.922+0000 7fd1caa00640 1 --2- 172.21.15.8:0/324149864 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd1a8067690 0x7fd1a8069b50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc005450 tx=0x7fd1bc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:28.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:28.926+0000 7fd1c2a00640 1 -- 172.21.15.8:0/324149864 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177849 (secure 0 0 0) 0x7fd1b4019030 con 0x7fd1cc14b050 2024-03-23T23:59:29.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:29.090+0000 7fd1d1a00640 1 -- 172.21.15.8:0/324149864 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "b_data", "pool2": "b_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd1cc0c7780 con 0x7fd1cc14b050 2024-03-23T23:59:29.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:29.702+0000 7fd1c2a00640 1 -- 172.21.15.8:0/324149864 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "b_data", "pool2": "b_data", "yes_i_really_really_mean_it": true}]=0 pool 'b_data' removed v33) v1 ==== 154+0+0 (secure 0 0 0) 0x7fd1b4056a40 con 0x7fd1cc14b050 2024-03-23T23:59:29.703 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'b_data' removed 2024-03-23T23:59:29.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:29.706+0000 7fd1d1a00640 1 -- 172.21.15.8:0/324149864 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd1a8067690 msgr2=0x7fd1a8069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:29.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:29.706+0000 7fd1d1a00640 1 --2- 172.21.15.8:0/324149864 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd1a8067690 0x7fd1a8069b50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc005450 tx=0x7fd1bc009040 comp rx=0 tx=0).stop 2024-03-23T23:59:29.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:29.706+0000 7fd1d1a00640 1 -- 172.21.15.8:0/324149864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1cc14b050 msgr2=0x7fd1cc0725f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:29.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:29.706+0000 7fd1d1a00640 1 --2- 172.21.15.8:0/324149864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1cc14b050 0x7fd1cc0725f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4011cd0 tx=0x7fd1b400f610 comp rx=0 tx=0).stop 2024-03-23T23:59:29.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:29.706+0000 7fd1d1a00640 1 -- 172.21.15.8:0/324149864 shutdown_connections 2024-03-23T23:59:29.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:29.706+0000 7fd1d1a00640 1 --2- 172.21.15.8:0/324149864 >> [v2:172.21.15.196:6832/1295060067,v1:172.21.15.196:6833/1295060067] conn(0x7fd1a8067690 0x7fd1a8069b50 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:29.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:29.706+0000 7fd1d1a00640 1 --2- 172.21.15.8:0/324149864 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd1cc072b30 0x7fd1cc144ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:29.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:29.706+0000 7fd1d1a00640 1 --2- 172.21.15.8:0/324149864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1cc14b050 0x7fd1cc0725f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:29.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:29.706+0000 7fd1d1a00640 1 --2- 172.21.15.8:0/324149864 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd1b00051d0 0x7fd1cc1ebb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:29.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:29.706+0000 7fd1d1a00640 1 -- 172.21.15.8:0/324149864 >> 172.21.15.8:0/324149864 conn(0x7fd1cc0c7060 msgr2=0x7fd1cc1500a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:29.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:29.706+0000 7fd1d1a00640 1 -- 172.21.15.8:0/324149864 shutdown_connections 2024-03-23T23:59:29.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-23T23:59:29.706+0000 7fd1d1a00640 1 -- 172.21.15.8:0/324149864 wait complete. 2024-03-23T23:59:29.753 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-23T23:59:29.753 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-23T23:59:29.753 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:59:29.770 INFO:tasks.ceph.mds.a:Stopped 2024-03-23T23:59:29.770 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-23T23:59:29.770 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:59:29.828 INFO:tasks.ceph.mds.c:Stopped 2024-03-23T23:59:29.828 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-23T23:59:29.828 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:59:29.841 INFO:tasks.ceph.mds.b:Stopped 2024-03-23T23:59:29.841 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-23T23:59:29.841 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:59:29.897 INFO:tasks.ceph.mds.d:Stopped 2024-03-23T23:59:29.897 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-23T23:59:29.897 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-23T23:59:29.898 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:59:35.999 INFO:tasks.ceph.osd.0:Stopped 2024-03-23T23:59:36.000 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-23T23:59:36.000 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:59:36.183 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-03-23T23:59:42.101 INFO:tasks.ceph.osd.1:Stopped 2024-03-23T23:59:42.102 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-23T23:59:42.102 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:59:42.293 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-03-23T23:59:42.293 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-03-23T23:59:47.717 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:59:47.721 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:59:48.203 INFO:tasks.ceph.osd.2:Stopped 2024-03-23T23:59:48.204 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-23T23:59:48.204 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:59:48.301 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-03-23T23:59:48.301 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-03-23T23:59:54.208 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-03-23T23:59:54.209 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-03-23T23:59:54.305 INFO:tasks.ceph.osd.3:Stopped 2024-03-23T23:59:54.305 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-23T23:59:54.305 INFO:teuthology.orchestra.run:waiting for 300 2024-03-24T00:00:00.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-03-24T00:00:00.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-03-24T00:00:00.407 INFO:tasks.ceph.osd.4:Stopped 2024-03-24T00:00:00.407 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-24T00:00:00.407 INFO:teuthology.orchestra.run:waiting for 300 2024-03-24T00:00:05.721 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-03-24T00:00:05.722 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-03-24T00:00:06.509 INFO:tasks.ceph.osd.5:Stopped 2024-03-24T00:00:06.509 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-24T00:00:06.509 INFO:teuthology.orchestra.run:waiting for 300 2024-03-24T00:00:11.327 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-03-24T00:00:11.328 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-03-24T00:00:12.610 INFO:tasks.ceph.osd.6:Stopped 2024-03-24T00:00:12.611 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-24T00:00:12.611 INFO:teuthology.orchestra.run:waiting for 300 2024-03-24T00:00:16.341 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-03-24T00:00:16.341+0000 7f589b600640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 44302) UID: 0 2024-03-24T00:00:16.342 INFO:tasks.ceph.mon.a.smithi008.stderr:2024-03-24T00:00:16.341+0000 7fd0aca00640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 44302) UID: 0 2024-03-24T00:00:16.342 INFO:tasks.ceph.mon.a.smithi008.stderr:2024-03-24T00:00:16.341+0000 7fd0aca00640 -1 mon.a@0(leader) e1 *** Got Signal Hangup *** 2024-03-24T00:00:16.371 INFO:tasks.ceph.mon.a.smithi008.stderr:2024-03-24T00:00:16.369+0000 7fd0aca00640 -1 received signal: Hangup from (PID: 44311) UID: 0 2024-03-24T00:00:16.372 INFO:tasks.ceph.mon.a.smithi008.stderr:2024-03-24T00:00:16.369+0000 7fd0aca00640 -1 mon.a@0(leader) e1 *** Got Signal Hangup *** 2024-03-24T00:00:16.372 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-03-24T00:00:16.369+0000 7f589b600640 -1 received signal: Hangup from (PID: 44311) UID: 0 2024-03-24T00:00:16.831 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-03-24T00:00:16.832 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-03-24T00:00:17.782 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T00:00:17.785 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T00:00:17.801 INFO:teuthology.orchestra.run.smithi008.stderr:error: state file /var/lib/logrotate/status is already locked 2024-03-24T00:00:17.801 INFO:teuthology.orchestra.run.smithi008.stderr:logrotate does not support parallel execution on the same set of logfiles. 2024-03-24T00:00:17.803 DEBUG:teuthology.orchestra.run:got remote process result: 3 2024-03-24T00:00:17.803 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/ceph.py", line 189, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi008 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2024-03-24T00:00:18.712 INFO:tasks.ceph.osd.7:Stopped 2024-03-24T00:00:18.713 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-24T00:00:18.713 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-24T00:00:18.713 INFO:teuthology.orchestra.run:waiting for 300 2024-03-24T00:00:18.767 INFO:tasks.ceph.mgr.y:Stopped 2024-03-24T00:00:18.767 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-24T00:00:18.767 INFO:teuthology.orchestra.run:waiting for 300 2024-03-24T00:00:18.828 INFO:tasks.ceph.mgr.x:Stopped 2024-03-24T00:00:18.828 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-24T00:00:18.828 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-24T00:00:18.828 INFO:teuthology.orchestra.run:waiting for 300 2024-03-24T00:00:18.847 INFO:tasks.ceph.mon.a:Stopped 2024-03-24T00:00:18.847 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-24T00:00:18.847 INFO:teuthology.orchestra.run:waiting for 300 2024-03-24T00:00:18.865 INFO:tasks.ceph.mon.b:Stopped 2024-03-24T00:00:18.865 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-24T00:00:18.865 INFO:teuthology.orchestra.run:waiting for 300 2024-03-24T00:00:18.923 INFO:tasks.ceph.mon.c:Stopped 2024-03-24T00:00:18.923 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-24T00:00:18.924 DEBUG:teuthology.orchestra.run.smithi008:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-03-24T00:00:18.975 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi008.front.sepia.ceph.com 2024-03-24T00:00:18.976 DEBUG:teuthology.orchestra.run.smithi008:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-24T00:00:19.594 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi008.front.sepia.ceph.com 2024-03-24T00:00:19.595 DEBUG:teuthology.orchestra.run.smithi008:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-24T00:00:19.842 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi008.front.sepia.ceph.com 2024-03-24T00:00:19.842 DEBUG:teuthology.orchestra.run.smithi008:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-24T00:00:20.207 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi008.front.sepia.ceph.com 2024-03-24T00:00:20.207 DEBUG:teuthology.orchestra.run.smithi008:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-24T00:00:20.473 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi196.front.sepia.ceph.com 2024-03-24T00:00:20.473 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-24T00:00:20.853 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi196.front.sepia.ceph.com 2024-03-24T00:00:20.854 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-24T00:00:21.148 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi196.front.sepia.ceph.com 2024-03-24T00:00:21.148 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-03-24T00:00:21.550 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi196.front.sepia.ceph.com 2024-03-24T00:00:21.551 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-03-24T00:00:21.832 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-03-24T00:00:21.975 INFO:tasks.ceph:Archiving mon data... 2024-03-24T00:00:21.977 DEBUG:teuthology.misc:Transferring archived files from smithi008:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616400/data/mon.a.tgz 2024-03-24T00:00:21.977 DEBUG:teuthology.orchestra.run.smithi008:> mktemp 2024-03-24T00:00:21.985 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/tmp.LaPUWpaKia 2024-03-24T00:00:21.985 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.LaPUWpaKia 2024-03-24T00:00:22.125 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0666 /tmp/tmp.LaPUWpaKia 2024-03-24T00:00:22.197 DEBUG:teuthology.orchestra.remote:smithi008:/tmp/tmp.LaPUWpaKia is 413KB 2024-03-24T00:00:22.259 DEBUG:teuthology.orchestra.run.smithi008:> rm -fr /tmp/tmp.LaPUWpaKia 2024-03-24T00:00:22.267 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616400/data/mon.b.tgz 2024-03-24T00:00:22.267 DEBUG:teuthology.orchestra.run.smithi196:> mktemp 2024-03-24T00:00:22.275 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.LxoHJkUgDv 2024-03-24T00:00:22.275 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.LxoHJkUgDv 2024-03-24T00:00:22.414 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.LxoHJkUgDv 2024-03-24T00:00:22.523 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.LxoHJkUgDv is 414KB 2024-03-24T00:00:22.589 DEBUG:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.LxoHJkUgDv 2024-03-24T00:00:22.597 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616400/data/mon.c.tgz 2024-03-24T00:00:22.597 DEBUG:teuthology.orchestra.run.smithi196:> mktemp 2024-03-24T00:00:22.646 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.gJRBIwM8CV 2024-03-24T00:00:22.646 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.gJRBIwM8CV 2024-03-24T00:00:22.784 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.gJRBIwM8CV 2024-03-24T00:00:22.863 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.gJRBIwM8CV is 414KB 2024-03-24T00:00:22.925 DEBUG:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.gJRBIwM8CV 2024-03-24T00:00:22.933 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-24T00:00:22.933 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-24T00:00:22.936 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-24T00:00:23.005 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-24T00:00:23.076 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-24T00:00:23.076 INFO:tasks.ceph:Archiving crash dumps... 2024-03-24T00:00:23.077 DEBUG:teuthology.misc:Transferring archived files from smithi008:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616400/remote/smithi008/crash 2024-03-24T00:00:23.078 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-24T00:00:23.097 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616400/remote/smithi196/crash 2024-03-24T00:00:23.098 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-24T00:00:23.136 INFO:tasks.ceph:Shutting down logrotate 2024-03-24T00:00:23.137 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/ceph.py", line 257, in ceph_log logrotater.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/ceph.py", line 222, in end self.thread.get() File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/ceph.py", line 189, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi008 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2024-03-24T00:00:23.155 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-24T00:00:23.164 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/ceph.py", line 257, in ceph_log logrotater.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/ceph.py", line 222, in end self.thread.get() File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/ceph.py", line 189, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi008 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2024-03-24T00:00:23.164 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-24T00:00:23.165 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-24T00:00:23.168 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-24T00:00:23.269 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-24T00:00:23.283 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-24T00:00:23.283 DEBUG:teuthology.orchestra.run.smithi008:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-24T00:00:23.286 DEBUG:teuthology.orchestra.run.smithi196:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-24T00:00:23.297 INFO:teuthology.orchestra.run.smithi008.stdout: remote refid st t when poll reach delay offset jitter 2024-03-24T00:00:23.297 INFO:teuthology.orchestra.run.smithi008.stdout:============================================================================== 2024-03-24T00:00:23.297 INFO:teuthology.orchestra.run.smithi008.stdout:*hv01.front.sepi 44.4.53.2 2 u 41 64 377 0.073 -0.790 0.206 2024-03-24T00:00:23.297 INFO:teuthology.orchestra.run.smithi008.stdout:+hv02.front.sepi 63.231.80.2 3 u 43 64 377 0.084 -0.163 0.301 2024-03-24T00:00:23.297 INFO:teuthology.orchestra.run.smithi008.stdout:+hv03.front.sepi 74.6.168.72 3 u 38 64 377 0.076 -2.006 0.269 2024-03-24T00:00:23.298 INFO:teuthology.orchestra.run.smithi008.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-03-24T00:00:23.391 INFO:teuthology.orchestra.run.smithi196.stdout: remote refid st t when poll reach delay offset jitter 2024-03-24T00:00:23.392 INFO:teuthology.orchestra.run.smithi196.stdout:============================================================================== 2024-03-24T00:00:23.392 INFO:teuthology.orchestra.run.smithi196.stdout:*hv01.front.sepi 44.4.53.2 2 u 40 64 377 0.075 -4.708 1.807 2024-03-24T00:00:23.392 INFO:teuthology.orchestra.run.smithi196.stdout:+hv02.front.sepi 63.231.80.2 3 u 42 64 377 0.097 -4.829 1.286 2024-03-24T00:00:23.392 INFO:teuthology.orchestra.run.smithi196.stdout:+hv03.front.sepi 74.6.168.72 3 u 33 64 377 0.071 -8.141 1.459 2024-03-24T00:00:23.392 INFO:teuthology.orchestra.run.smithi196.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-03-24T00:00:23.393 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-24T00:00:24.017 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-24T00:00:24.019 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-24T00:00:24.028 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-24T00:00:24.037 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-24T00:00:24.046 INFO:teuthology.task.internal:Duration was 1754.855006 seconds 2024-03-24T00:00:24.046 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-24T00:00:24.058 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-24T00:00:24.058 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-24T00:00:24.061 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-24T00:00:24.331 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-24T00:00:24.331 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi008.front.sepia.ceph.com 2024-03-24T00:00:24.331 DEBUG:teuthology.orchestra.run.smithi008:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-24T00:00:24.352 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi196.front.sepia.ceph.com 2024-03-24T00:00:24.352 DEBUG:teuthology.orchestra.run.smithi196:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-24T00:00:24.401 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-24T00:00:24.402 DEBUG:teuthology.orchestra.run.smithi008:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-24T00:00:24.405 DEBUG:teuthology.orchestra.run.smithi196:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-24T00:00:24.466 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-24T00:00:24.466 DEBUG:teuthology.orchestra.run.smithi008:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-24T00:00:24.470 DEBUG:teuthology.orchestra.run.smithi196:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-24T00:00:24.632 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-24T00:00:24.645 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-24T00:00:24.646 DEBUG:teuthology.orchestra.run.smithi008:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-24T00:00:24.666 DEBUG:teuthology.orchestra.run.smithi196:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-24T00:00:24.685 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-24T00:00:24.740 DEBUG:teuthology.orchestra.run.smithi008:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-24T00:00:24.743 DEBUG:teuthology.orchestra.run.smithi196:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-24T00:00:24.758 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern = core 2024-03-24T00:00:24.855 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = core 2024-03-24T00:00:24.875 DEBUG:teuthology.orchestra.run.smithi008:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-24T00:00:24.883 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-24T00:00:24.883 DEBUG:teuthology.orchestra.run.smithi196:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-24T00:00:24.890 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-24T00:00:24.890 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-24T00:00:24.906 INFO:teuthology.task.internal:Transferring archived files... 2024-03-24T00:00:24.907 DEBUG:teuthology.misc:Transferring archived files from smithi008:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616400/remote/smithi008 2024-03-24T00:00:24.907 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-24T00:00:24.952 DEBUG:teuthology.misc:Transferring archived files from smithi196:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616400/remote/smithi196 2024-03-24T00:00:24.952 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-24T00:00:24.979 INFO:teuthology.task.internal:Removing archive directory... 2024-03-24T00:00:24.979 DEBUG:teuthology.orchestra.run.smithi008:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-24T00:00:24.991 DEBUG:teuthology.orchestra.run.smithi196:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-24T00:00:25.026 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-24T00:00:25.052 INFO:teuthology.task.internal:Not uploading archives. 2024-03-24T00:00:25.052 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-24T00:00:25.090 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-24T00:00:25.090 DEBUG:teuthology.orchestra.run.smithi008:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-24T00:00:25.093 DEBUG:teuthology.orchestra.run.smithi196:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-24T00:00:25.099 INFO:teuthology.orchestra.run.smithi008.stdout: 655468 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 24 00:00 /home/ubuntu/cephtest 2024-03-24T00:00:25.101 INFO:teuthology.orchestra.run.smithi196.stdout: 658116 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 24 00:00 /home/ubuntu/cephtest 2024-03-24T00:00:25.103 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-24T00:00:25.117 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-24T00:00:25.158 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi008 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2024-03-24T00:00:25.158 INFO:teuthology.nuke:Checking targets against current locks 2024-03-24T00:00:25.190 DEBUG:teuthology.nuke:shortname: smithi008 2024-03-24T00:00:25.191 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-24T00:00:25.214 DEBUG:teuthology.nuke:shortname: smithi196 2024-03-24T00:00:25.214 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-24T00:00:25.217 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616400', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-23 23:22:19.138598', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJN38IWx94OLOMXUXdFrdT37nqwqtfkJzR43R06nGM7XS6nGJmg0rG09Eh8zbXVEzJnk5dyYmUZbX5A7ECQIFx0='} 2024-03-24T00:00:25.238 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616400', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-23 23:22:19.136853', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK8YegBLgKIYs1tCXSJgZygUC8okbxmgyW3Bo4qT/lXzZIgBTWgvCyNQ1UwaePBVTdPiU13/gD1i2t3Q/ETquuU='} 2024-03-24T00:00:25.264 INFO:teuthology.orchestra.console.smithi008:Power off 2024-03-24T00:00:25.265 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-24T00:00:25.287 DEBUG:teuthology.orchestra.console.smithi008:power off output: Chassis Power Control: Down/Off 2024-03-24T00:00:25.287 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T00:00:25.303 INFO:teuthology.orchestra.console.smithi196:Power off 2024-03-24T00:00:25.303 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-24T00:00:25.312 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2024-03-24T00:00:25.322 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off 2024-03-24T00:00:25.322 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T00:00:25.344 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-03-24T00:00:29.313 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T00:00:29.345 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T00:00:29.422 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2024-03-24T00:00:29.454 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-03-24T00:00:33.424 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T00:00:33.456 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T00:00:33.533 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2024-03-24T00:00:33.565 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-03-24T00:00:37.534 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T00:00:37.566 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T00:00:37.645 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2024-03-24T00:00:37.675 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2024-03-24T00:00:37.746 INFO:teuthology.orchestra.console.smithi008:Power off completed 2024-03-24T00:00:37.775 INFO:teuthology.orchestra.console.smithi196:Power off completed 2024-03-24T00:00:37.988 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 client.1-kernel-sha1: 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 description: fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}} duration: 1754.855005979538 failure_reason: 'Command failed on smithi008 with status 3: ''sudo logrotate /etc/logrotate.d/ceph-test.conf''' flavor: default owner: mchangir status: fail success: false 2024-03-24T00:00:37.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T00:00:38.073 INFO:teuthology.run:FAIL